-- Logs begin at Sat 2022-05-28 20:01:13 UTC, end at Sat 2022-05-28 22:29:31 UTC. -- May 28 20:51:18.021415 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... May 28 20:51:18.030190 ncdv-master-1 devstack@n-api.service[127072]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 28 20:51:18.032080 ncdv-master-1 devstack@n-api.service[127072]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 28 20:51:18 2022] *** May 28 20:51:18.032080 ncdv-master-1 devstack@n-api.service[127072]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 28 20:51:18.032080 ncdv-master-1 devstack@n-api.service[127072]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 28 20:51:18.032080 ncdv-master-1 devstack@n-api.service[127072]: nodename: ncdv-master-1 May 28 20:51:18.032080 ncdv-master-1 devstack@n-api.service[127072]: machine: x86_64 May 28 20:51:18.032080 ncdv-master-1 devstack@n-api.service[127072]: clock source: unix May 28 20:51:18.032080 ncdv-master-1 devstack@n-api.service[127072]: pcre jit disabled May 28 20:51:18.032080 ncdv-master-1 devstack@n-api.service[127072]: detected number of CPU cores: 4 May 28 20:51:18.032080 ncdv-master-1 devstack@n-api.service[127072]: current working directory: / May 28 20:51:18.032080 ncdv-master-1 devstack@n-api.service[127072]: detected binary path: /usr/bin/uwsgi-core May 28 20:51:18.032080 ncdv-master-1 devstack@n-api.service[127072]: your processes number limit is 47680 May 28 20:51:18.032080 ncdv-master-1 devstack@n-api.service[127072]: your memory page size is 4096 bytes May 28 20:51:18.032080 ncdv-master-1 devstack@n-api.service[127072]: detected max file descriptor number: 2048 May 28 20:51:18.032080 ncdv-master-1 devstack@n-api.service[127072]: lock engine: pthread robust mutexes May 28 20:51:18.033016 ncdv-master-1 devstack@n-api.service[127072]: thunder lock: enabled May 28 20:51:18.033016 ncdv-master-1 devstack@n-api.service[127072]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 28 20:51:18.033016 ncdv-master-1 devstack@n-api.service[127072]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 28 20:51:18.080760 ncdv-master-1 devstack@n-api.service[127072]: Python main interpreter initialized at 0x55c9ff27b9c0 May 28 20:51:18.080760 ncdv-master-1 devstack@n-api.service[127072]: python threads support enabled May 28 20:51:18.080760 ncdv-master-1 devstack@n-api.service[127072]: your server socket listen backlog is limited to 100 connections May 28 20:51:18.080760 ncdv-master-1 devstack@n-api.service[127072]: your mercy for graceful operations on workers is 90 seconds May 28 20:51:18.081099 ncdv-master-1 devstack@n-api.service[127072]: mapped 403077 bytes (393 KB) for 2 cores May 28 20:51:18.081176 ncdv-master-1 devstack@n-api.service[127072]: *** Operational MODE: preforking *** May 28 20:51:18.081421 ncdv-master-1 devstack@n-api.service[127072]: *** uWSGI is running in multiple interpreter mode *** May 28 20:51:18.081421 ncdv-master-1 devstack@n-api.service[127072]: spawned uWSGI master process (pid: 127072) May 28 20:51:18.081665 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. May 28 20:51:18.083039 ncdv-master-1 devstack@n-api.service[127072]: spawned uWSGI worker 1 (pid: 127073, cores: 1) May 28 20:51:18.083172 ncdv-master-1 devstack@n-api.service[127072]: spawned uWSGI worker 2 (pid: 127074, cores: 1) May 28 20:51:18.083253 ncdv-master-1 devstack@n-api.service[127072]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 20:51:19.325294 ncdv-master-1 devstack@n-api.service[127073]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 28 20:51:19.325955 ncdv-master-1 devstack@n-api.service[127074]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 28 20:51:20.060563 ncdv-master-1 devstack@n-api.service[127074]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 20:51:20.060563 ncdv-master-1 devstack@n-api.service[127074]: from cryptography.utils import int_from_bytes May 28 20:51:20.061108 ncdv-master-1 devstack@n-api.service[127074]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 20:51:20.061108 ncdv-master-1 devstack@n-api.service[127074]: from cryptography.utils import int_from_bytes May 28 20:51:20.086508 ncdv-master-1 devstack@n-api.service[127073]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 20:51:20.086508 ncdv-master-1 devstack@n-api.service[127073]: from cryptography.utils import int_from_bytes May 28 20:51:20.087040 ncdv-master-1 devstack@n-api.service[127073]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 20:51:20.087040 ncdv-master-1 devstack@n-api.service[127073]: from cryptography.utils import int_from_bytes May 28 20:51:22.708153 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 20:51:22.708823 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 20:51:22.708928 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 20:51:22.709253 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 20:51:22.709503 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 20:51:22.709921 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.710246 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.710565 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.710877 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.711135 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 20:51:22.711583 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.711674 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 20:51:22.711761 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.711861 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.711954 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 20:51:22.712101 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.712263 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 20:51:22.712423 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.712518 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 20:51:22.712680 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.712906 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.713001 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.713233 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.713327 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.713559 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.713654 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.713898 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.715634 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.715728 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.715878 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.716321 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.716462 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.716578 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.716696 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.716809 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.716934 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.717048 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.717171 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.717171 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.717426 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.717528 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.717663 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.717758 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.717867 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.717962 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.718096 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.718189 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.718275 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.718361 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.718446 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.718525 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.718659 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.718755 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.718846 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.718936 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.719022 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.719107 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.719193 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.719193 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.719409 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.719503 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.719593 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.719683 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.719768 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.719928 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.720023 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.720236 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.720335 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.720639 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.720742 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.720941 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.721033 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.721279 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.721444 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.721592 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.721726 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.721906 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.722016 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.722237 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.722348 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.722557 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.722657 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.722869 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.722956 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.723180 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.723278 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.723491 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.723593 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.723786 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.723968 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.724087 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.724282 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.724397 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.724593 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.724689 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.724916 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.725014 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.725240 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.725340 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.725513 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.725618 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.725778 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.725905 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.726114 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.726203 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.726425 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.726514 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.726738 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.726838 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.726985 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.727082 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.727228 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.727386 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.727538 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.727696 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.727851 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.728071 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.728200 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.728459 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.728589 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.728688 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.728776 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.728903 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.728998 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.729210 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.729302 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.729531 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.729620 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.729876 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.729968 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.730172 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.730270 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.730435 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.730532 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.730690 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.730820 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.731009 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.731126 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.731327 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.731434 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.731634 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.731739 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.731941 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.732049 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.732246 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.732350 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.732555 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.732660 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.732863 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.732966 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.733171 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.733275 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.733469 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.733564 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.733775 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.733907 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.734111 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.734219 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.734410 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.734514 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.734716 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.734825 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.735013 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.735103 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.735325 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.735424 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.735640 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.735749 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.735940 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.736029 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.736186 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.736285 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.736480 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.736573 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.736780 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.736868 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.737090 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.737186 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.737390 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.737479 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.738223 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.738333 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.738518 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.738617 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.738815 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.738903 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.739117 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.739204 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.739419 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.739517 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.739719 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.739807 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.740020 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.740107 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.740321 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.740418 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.740620 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.740714 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.740920 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.741013 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.741220 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.741319 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.741519 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.741606 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.741823 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.741937 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.742154 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.742243 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.742451 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.742537 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.742754 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.742848 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.743055 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.743152 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.743358 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.743454 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.743661 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.743749 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.743961 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.744048 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.744260 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.744354 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.744567 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.744659 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.744870 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.744979 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.745169 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.745260 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.745480 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.745569 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.745784 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.745912 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.746109 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.746209 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.746414 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.746509 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.746707 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.746794 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.747008 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.747112 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.747317 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.747416 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.747617 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.747706 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.747919 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.748006 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.748217 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.748314 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.748516 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.748605 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.748815 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.748909 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.749117 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.749218 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.749416 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.749515 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.749715 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.749813 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.750060 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.750235 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.750364 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.750453 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.750672 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.750802 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.750990 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.751093 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.751292 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.751378 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.751595 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.751688 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.751898 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.752010 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.752205 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.752300 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.752510 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.752597 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.752821 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.752910 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.753126 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.753214 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.754068 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.754182 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.754400 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.754489 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.754714 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.754806 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.755026 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.755140 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.755331 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.755418 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.755642 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.755747 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.755953 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.756049 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.756373 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.756514 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 20:51:22.756631 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.756747 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.757105 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.757227 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.757400 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.757490 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.757723 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.757812 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.758062 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.758161 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.758378 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.758466 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.758692 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.758788 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.759000 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.759089 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.759312 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.759420 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.759633 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.759722 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.759949 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.760045 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.760257 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.760346 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.760573 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.760659 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.760895 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.760991 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.761211 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.761299 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.761529 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.761624 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.761864 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.761958 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.762177 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.762282 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.762484 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.762578 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.762790 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.762886 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.763105 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.763192 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.763429 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.763514 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.763734 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.763823 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.764045 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.764139 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.764348 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.764435 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.764653 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.764750 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.764956 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.765059 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.765263 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.765372 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.765564 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.765661 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.765910 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.766015 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.766224 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.766341 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.766529 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.766617 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.766834 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.766929 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.767145 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.767247 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.767448 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.767537 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.767754 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.767842 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.768060 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.768165 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.768357 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.768445 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.768656 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.768753 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.768972 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.769067 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.769278 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.769365 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.769575 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.769670 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.769914 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.770007 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.770238 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.770325 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.770537 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.770637 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.770856 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.770944 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.771153 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.771240 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.771459 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.771555 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.771763 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.771868 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.772066 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.772153 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.772360 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.772455 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.772663 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.772751 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.772969 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.773065 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.773270 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.773433 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.773585 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.773673 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.773915 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.774020 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.774216 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.774313 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.774531 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.774621 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.774828 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.774915 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.775124 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.775220 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.775429 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.775521 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.775732 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.775820 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.776036 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.776124 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.776338 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.776437 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.776640 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.776730 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.776945 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.777034 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.777249 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.777335 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.777554 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.777643 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.777884 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.777976 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.778214 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.778301 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.778512 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.778597 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.778818 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.778915 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.779133 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.779220 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.779441 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.779547 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.779741 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.779829 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.780048 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.780137 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.780347 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.780446 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.780647 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.780773 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.780945 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.781034 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.781249 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.781349 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.781546 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.781636 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.781873 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.782009 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.782169 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.782271 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.782466 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.782554 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.782762 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.782850 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.783077 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.783167 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.783381 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.783476 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.783679 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.783767 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.783978 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.784077 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.784275 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.784371 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.784639 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.784740 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.784944 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.785034 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.785247 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.785334 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.785556 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.785660 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.785886 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.786008 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.786199 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.786303 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.786504 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.786645 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.786828 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.786916 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.787132 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.787220 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.787437 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.787536 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.787739 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.787827 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.788042 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.788128 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.788354 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.788454 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.788659 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.788747 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.788971 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.789060 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.789280 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.789378 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.789598 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.789687 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.789927 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.790019 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.790243 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.790335 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.790542 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.790630 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.790853 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.790942 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.791168 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.791256 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.791482 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.791578 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.791792 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.791892 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.792112 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.792200 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.792419 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.792509 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.792729 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.792816 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.793035 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.793132 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.793340 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.793436 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.793645 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.793741 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.793973 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.794065 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.794280 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.794368 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.794584 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.794684 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.794897 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.794985 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.795202 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.795296 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.795519 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.795616 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.795822 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.795914 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.796133 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.796242 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.796432 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.796577 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.796739 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.796835 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.797050 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.797144 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.797363 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.797461 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.797666 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.797762 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.797997 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.798090 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.798309 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.798399 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.798609 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.798696 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.798928 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.799022 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.799231 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.799319 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.799528 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.799623 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.799827 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.799921 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.800132 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.800776 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.800973 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.801061 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.801278 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.801365 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.801583 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.801731 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.801892 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.802027 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.802203 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.802431 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.802569 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.802704 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.802838 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.802974 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.803114 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.803257 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.803390 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.803525 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.803659 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.803793 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.803936 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.804082 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.804250 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.804388 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.804564 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.804701 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.804861 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.805008 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.805150 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.805283 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.805461 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.805606 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.805767 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.805899 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.806089 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.806178 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.806386 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.806488 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.806686 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.806793 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.806992 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.807080 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.807308 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.807394 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.807608 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.807698 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.807919 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.808007 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.808234 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.808324 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.808538 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.808635 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.808842 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.808938 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.809145 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.809235 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.809447 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.809536 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.809748 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.809864 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.810078 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.810179 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.810380 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.810468 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.810685 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.810808 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.810988 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.811086 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.811292 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.811381 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.811595 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.811683 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.811917 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.812016 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.812219 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.812306 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.812522 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.812609 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.812826 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.812922 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.813123 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.813210 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.813426 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.813522 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.813741 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.813829 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.814151 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.814327 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.814465 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.814657 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.814779 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.814969 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.815092 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.815284 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.815405 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.815598 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.815727 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.816481 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.816601 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.816814 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.816913 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.817133 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.817236 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.817475 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.817573 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.817778 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.817921 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.818109 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.818209 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.818409 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.818687 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.818782 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.819004 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.819103 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.819302 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.819398 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.819601 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.819689 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.819899 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.819987 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.820204 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.820294 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.820500 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.820587 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.820799 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.820887 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.821097 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.821187 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.821394 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.821493 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.821700 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.821802 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.822027 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.822130 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.822332 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.822434 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.822628 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.822716 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.822945 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.823042 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.823249 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.823338 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.823547 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.823643 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.823845 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.823942 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.824144 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.824235 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.824453 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.824539 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.824776 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.824867 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.825067 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.825156 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.825385 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.825473 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.825691 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.825788 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.826034 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.826137 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.826334 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.826423 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.826655 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.826747 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.826961 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.827061 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.827259 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.827347 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.827562 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.827651 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.827865 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.827951 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.828171 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.828277 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.828471 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.828567 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.828777 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.828865 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.829081 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.829183 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.829390 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.829477 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.829696 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.829791 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.830018 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.830120 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.830325 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.830414 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.830623 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.830710 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.830933 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.831034 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.831239 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.831329 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.831564 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.831655 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.831864 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.831953 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.832174 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.832271 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.832479 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.832569 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.832780 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.832877 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.833087 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.833175 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.833387 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.833482 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.833689 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.833783 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.834013 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.834101 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.834315 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.834414 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.834615 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.834763 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.834921 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.835073 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.835226 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.835369 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.835514 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.835655 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.835829 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.835962 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.836136 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.836281 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.836425 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.836510 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.836724 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.836820 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.837033 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.837163 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.837325 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.837426 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.837622 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.837721 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.837948 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.838062 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.838255 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.838360 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.838564 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.838663 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.838861 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.838968 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.839162 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.839259 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.839456 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.839552 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.839752 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.839858 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.840047 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.840144 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.840350 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.840449 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.840647 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.840745 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.840944 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.841048 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.841240 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.841338 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.841536 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.841633 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.841831 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.841980 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.842169 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.842276 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.842473 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.842561 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.842771 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.842861 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.843070 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.843166 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.843365 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.843452 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.843665 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.843750 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.843975 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.844075 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.844278 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.844367 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.844583 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.844677 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.844888 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.844984 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.845191 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.845287 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.845495 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.845592 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.845799 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.847057 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.847057 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.847057 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.847057 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.847572 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.847572 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.847822 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.848102 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.848296 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.848431 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.848648 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.848751 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.848962 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.849051 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.849326 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.849413 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.849637 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.849738 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.849983 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.850092 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.850308 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.850397 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.850626 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.850722 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.850942 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.851037 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.851250 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.851336 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.851553 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.851649 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.851882 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.852032 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.852180 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.852267 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.852491 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.852580 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.852800 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.852888 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.853107 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.853194 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.853418 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.853507 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.853729 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.853816 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.854067 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.854155 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.854383 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.854481 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.854693 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.854794 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.855007 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.855104 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.855315 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.855486 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.855620 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.855707 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.855931 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.856095 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.856244 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.856334 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.856547 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.856633 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.856857 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.856956 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.857227 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.857326 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.857474 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.857563 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.857779 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.857882 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.858120 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.858235 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.858435 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.858532 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.858745 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.858841 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.859060 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.859150 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.859374 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.859464 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.859681 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.859771 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.860008 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.860105 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.860323 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.860418 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.860627 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.860718 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.860938 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.861027 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.861245 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.861346 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.861559 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.861648 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.861883 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.861975 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.862252 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.862355 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.862557 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.862654 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.863359 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.863462 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.863684 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.863781 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.863989 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.864079 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.864293 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.864381 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.864597 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.864693 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.864919 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.865014 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.865223 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.865309 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.865545 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.865669 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.865974 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.866076 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.866286 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.866383 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.866589 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.866688 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.866894 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.866990 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.867201 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.867314 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.867514 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.867627 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.867840 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.867929 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.868149 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.868236 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.868456 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.868547 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.868761 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.868856 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.869087 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.869185 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.869396 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.869484 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.869715 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.869803 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.870063 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.870163 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.870373 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.870462 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.870687 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.870774 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.870992 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.871164 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.871312 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.871481 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.871631 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.871824 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.871971 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.872118 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.872247 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.872443 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.872658 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.872768 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.872978 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.873074 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.873287 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.873385 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.873606 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.873702 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.873953 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.874047 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.874258 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.874363 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.874561 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.874650 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.874869 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.874957 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.875170 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.875267 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.875473 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.875562 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.875796 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.875896 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.876096 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.876186 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.876404 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.876494 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.876711 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.876845 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.877027 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.877168 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.877327 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.877485 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.877636 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.877806 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.878044 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.878160 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.878421 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.879009 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.879253 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.879374 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.879569 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.879666 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.879886 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.879974 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.880193 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.880294 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.880497 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.880584 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.880811 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.880905 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.881119 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.881215 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.881423 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.881511 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.881726 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.882175 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.882310 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.882401 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.882617 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.882704 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.882940 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.883028 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.883252 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.883350 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.883578 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.883667 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.883891 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.883979 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.884196 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.884284 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.884526 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.884612 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.884835 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.884923 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.885150 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.885238 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.885460 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.885555 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.885782 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.885944 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.886096 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.886191 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.886398 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.886487 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.886706 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.886803 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.887013 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.887154 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.887311 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.887403 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.887608 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.887731 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.887914 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.888015 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.888211 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.888301 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.888511 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.888610 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.888812 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.888902 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.889128 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.889217 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.889427 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.889519 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.889745 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.889867 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.890075 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.890175 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.890374 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.890465 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.890672 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.890763 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.890972 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.891063 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.891307 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.891399 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.891608 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.891703 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.891915 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.892004 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.892220 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.892310 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.892526 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.892614 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.892831 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.892927 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.893141 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.893237 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.893452 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.893539 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.893762 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.893898 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.894100 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.894197 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.894411 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.894501 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.894722 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.894818 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.895028 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.895117 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.895339 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.895427 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.895651 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.895749 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.895962 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.896070 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.896274 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.896362 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.896586 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.896678 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.896902 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.896991 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.897214 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.897431 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.897534 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.897760 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.897871 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.898118 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.898206 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.898434 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.898533 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.898749 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.898837 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.899062 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.899151 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.899374 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.899471 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.899687 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.899776 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.899999 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.900085 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.900307 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.900396 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.900617 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.900706 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.900936 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.901023 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.901252 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.901459 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.901573 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.901790 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.901930 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.902134 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.902235 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.902453 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.902542 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.902767 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.902856 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.903084 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.903219 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.903404 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.903492 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.903717 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.903805 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.904030 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.904121 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.904344 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.904431 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.904657 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.904755 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.904966 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.905055 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.905276 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.905371 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.905584 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.905682 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.905915 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.906023 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.906231 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.906331 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.906541 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.906644 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.906850 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.906938 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.907163 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.907250 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.907472 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.907577 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.907792 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.907923 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.908122 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.908217 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.908440 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.908528 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.908751 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.908850 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.909062 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.909219 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.909373 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.909477 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.909725 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.909899 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.910136 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.910238 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.910453 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.910543 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.910771 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.910859 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.911086 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.911184 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.911403 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.911492 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.911719 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.911806 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.912046 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.912142 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.912351 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.912439 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.912652 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.912742 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.912961 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.913126 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.913269 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.913359 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.913571 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.913658 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.913916 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.914141 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.914241 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.914467 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.914556 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.914806 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.914903 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.915113 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.915209 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.915456 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.915639 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.915774 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.915982 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.916096 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.916296 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.916431 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.916614 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.916742 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.916940 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.917051 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.917253 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.917354 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.917560 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.917666 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.917941 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.918090 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.918212 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.918313 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.918513 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.918611 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.918825 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.918915 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.919133 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.919221 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.919435 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.919533 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.919735 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.920016 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.920106 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.920340 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.920440 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.920642 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.920741 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.920949 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.921047 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.921250 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.921371 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.921573 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.921669 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.921897 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.921991 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.922199 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.922416 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.922517 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.922600 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.922790 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.922880 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.923088 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.923189 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.923386 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.923475 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.923686 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.923773 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.923985 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.924083 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.924291 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.924380 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.924591 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.924685 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.924898 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.924992 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.925684 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.925779 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.926031 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.926122 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.926400 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.926503 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.926637 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.926727 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.926955 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.927042 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.927260 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.927350 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.927575 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.927663 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.927872 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.927986 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.928174 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.928264 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.928477 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.928564 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.928777 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.928874 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.929088 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.929183 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.929391 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.929487 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.929702 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.929800 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.930030 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.930120 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.930343 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.930565 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.930655 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.930897 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.930988 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.931214 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.931304 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.931544 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.931642 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.931872 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.931968 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.932173 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.932259 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.932472 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.932570 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.932775 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.932864 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.933094 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.933183 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.933401 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.933498 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.933707 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.933796 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.934034 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.934135 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.934343 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.934444 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.934649 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.934899 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.934987 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.935237 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.935334 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.935539 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.935626 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.935844 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.935931 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.936147 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.936244 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.936506 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.936607 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.936751 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.936842 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.937060 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.937160 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.937369 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.937467 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.937689 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.937786 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.938027 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.938125 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.938339 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.938436 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.938648 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.938735 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.938959 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.939055 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.939262 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.939349 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.939567 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.939664 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.939872 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.939969 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.940176 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.940265 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.940483 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.940578 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.940794 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.940914 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.941667 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.941756 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.942021 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.942124 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.942427 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.942515 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.942733 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.942827 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.943051 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.943148 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.943370 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.943459 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.943679 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.943766 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.943996 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.944094 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.944306 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.944406 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.944610 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.944697 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.944918 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.945013 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.945224 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.945317 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.945540 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.945635 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.945895 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.946017 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.946214 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.946315 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.946522 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.946617 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.946820 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.946917 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.947129 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.947237 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.947427 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.947525 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.947733 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.947847 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.948047 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.948160 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.948353 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.948483 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.948651 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.948806 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.948948 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.949119 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.949254 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.949443 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.949553 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.949757 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.949865 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.950113 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.950214 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.950452 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.950540 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.950761 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.950851 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.951060 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.951166 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.951360 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.951457 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.951659 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.951767 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.951957 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.952063 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.952254 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.952343 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.952550 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.952646 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.952855 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.952953 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.953153 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.953241 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.953451 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.953545 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.953747 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.953858 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.954080 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.954181 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.954378 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.954466 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.954682 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.954769 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.954988 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.955076 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.955300 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.955390 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.955604 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.955695 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.955908 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.955996 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.956212 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.956300 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.956544 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.956633 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.956849 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.956939 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.957154 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.957256 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.957466 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.957555 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.957768 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.957970 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.958103 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.958250 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.958407 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.958487 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.958713 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.958800 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.959012 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.959108 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.959317 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.959405 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.959623 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.959711 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.959928 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.960032 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.960249 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.960338 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.960570 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.960657 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.960871 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.960961 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.961190 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.961278 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.961503 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.961597 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.961816 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.961938 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.962149 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.962246 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.962458 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.962548 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.962784 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.962874 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.963094 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.963182 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.963405 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.963502 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.963715 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.963803 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.964021 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.964110 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.964328 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.964427 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.964639 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.964726 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.964952 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.965038 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.965273 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.965370 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.965577 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.965665 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.965918 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.966009 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.966239 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.966335 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.966558 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.966646 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.966879 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.966966 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.967193 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.967282 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.967525 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.967615 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.967841 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.967925 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.968149 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.968237 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.968503 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.968603 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.968755 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.968844 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.968996 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 20:51:22.969087 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.969369 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.969689 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.970043 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.970373 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.970686 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.971013 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.971341 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.971690 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.972005 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.972388 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.972718 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.973034 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.973349 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.973663 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 20:51:22.973930 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127074) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 20:51:23.031710 ncdv-master-1 devstack@n-api.service[127073]: INFO dbcounter [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] Registered counter for database nova_api May 28 20:51:23.037471 ncdv-master-1 devstack@n-api.service[127074]: INFO dbcounter [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] Registered counter for database nova_api May 28 20:51:23.052408 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_db.sqlalchemy.engines [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 20:51:23.057419 ncdv-master-1 devstack@n-api.service[127074]: DEBUG oslo_db.sqlalchemy.engines [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 20:51:23.058838 ncdv-master-1 devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writer thread running {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 20:51:23.064112 ncdv-master-1 devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writer thread running {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 20:51:23.117246 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.context [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc53a60a-e345-4363-abb1-87c4d33bcbf6(cell1) {{(pid=127073) load_cells /opt/stack/nova/nova/context.py:464}} May 28 20:51:23.120560 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.context [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc53a60a-e345-4363-abb1-87c4d33bcbf6(cell1) {{(pid=127074) load_cells /opt/stack/nova/nova/context.py:464}} May 28 20:51:23.121083 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 20:51:23.122732 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 20:51:23.123532 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 20:51:23.124640 ncdv-master-1 devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 20:51:23.125576 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 20:51:23.126215 ncdv-master-1 devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 20:51:23.127007 ncdv-master-1 devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 20:51:23.127564 ncdv-master-1 devstack@n-api.service[127073]: INFO dbcounter [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] Registered counter for database nova_cell0 May 28 20:51:23.129499 ncdv-master-1 devstack@n-api.service[127074]: DEBUG oslo_concurrency.lockutils [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127074) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 20:51:23.131468 ncdv-master-1 devstack@n-api.service[127074]: INFO dbcounter [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] Registered counter for database nova_cell0 May 28 20:51:23.132384 ncdv-master-1 devstack@n-api.service[127073]: INFO dbcounter [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] Registered counter for database nova_cell1 May 28 20:51:23.135644 ncdv-master-1 devstack@n-api.service[127074]: INFO dbcounter [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] Registered counter for database nova_cell1 May 28 20:51:23.140118 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_db.sqlalchemy.engines [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 20:51:23.141427 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_db.sqlalchemy.engines [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 20:51:23.142998 ncdv-master-1 devstack@n-api.service[127074]: DEBUG oslo_db.sqlalchemy.engines [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 20:51:23.146210 ncdv-master-1 devstack@n-api.service[127074]: DEBUG oslo_db.sqlalchemy.engines [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 20:51:23.148010 ncdv-master-1 devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writer thread running {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 20:51:23.150037 ncdv-master-1 devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writer thread running {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 20:51:23.150614 ncdv-master-1 devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writer thread running {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 20:51:23.156058 ncdv-master-1 devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writer thread running {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 20:51:23.294878 ncdv-master-1 devstack@n-api.service[127073]: INFO dbcounter [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] Registered counter for database nova_cell0 May 28 20:51:23.295561 ncdv-master-1 devstack@n-api.service[127074]: INFO dbcounter [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] Registered counter for database nova_cell0 May 28 20:51:23.301626 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_db.sqlalchemy.engines [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 20:51:23.303298 ncdv-master-1 devstack@n-api.service[127074]: DEBUG oslo_db.sqlalchemy.engines [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127074) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 20:51:23.305994 ncdv-master-1 devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writer thread running {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 20:51:23.307540 ncdv-master-1 devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writer thread running {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 20:51:23.716839 ncdv-master-1 devstack@n-api.service[127073]: WARNING keystonemiddleware.auth_token [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 20:51:23.724001 ncdv-master-1 devstack@n-api.service[127073]: WARNING keystonemiddleware.auth_token [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 20:51:23.753019 ncdv-master-1 devstack@n-api.service[127074]: WARNING keystonemiddleware.auth_token [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 20:51:23.761556 ncdv-master-1 devstack@n-api.service[127074]: WARNING keystonemiddleware.auth_token [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 20:51:24.060870 ncdv-master-1 devstack@n-api.service[127073]: WARNING keystonemiddleware.auth_token [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 20:51:24.066879 ncdv-master-1 devstack@n-api.service[127073]: WARNING keystonemiddleware.auth_token [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 20:51:24.072134 ncdv-master-1 devstack@n-api.service[127073]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c9ff27b9c0 pid: 127073 (default app) May 28 20:51:24.074444 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:51:24.075631 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001998 May 28 20:51:24.076043 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Sat May 28 20:51:24 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:51:24.097910 ncdv-master-1 devstack@n-api.service[127074]: WARNING keystonemiddleware.auth_token [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 20:51:24.103832 ncdv-master-1 devstack@n-api.service[127074]: WARNING keystonemiddleware.auth_token [None req-d4161fa3-2c20-432a-a949-da0177fb2002 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 20:51:24.109058 ncdv-master-1 devstack@n-api.service[127074]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c9ff27b9c0 pid: 127074 (default app) May 28 20:52:46.035600 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:52:46.036621 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 28 20:52:46.037014 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 20:52:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:52:46.051518 ncdv-master-1 devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=3 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 20:52:46.052991 ncdv-master-1 devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell1:SELECT=3 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 20:52:46.053822 ncdv-master-1 devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=3 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 20:52:46.055038 ncdv-master-1 devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 20:52:46.491769 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1533dfcf-050a-437e-9c00-9c96e378d158 admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:52:46.520965 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1533dfcf-050a-437e-9c00-9c96e378d158 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.475818 May 28 20:52:46.521821 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1291 bytes} [Sat May 28 20:52:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 20:52:48.855986 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:52:48.856939 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-faf2fc04-af75-4a53-aa06-f4e59cc8f935 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 28 20:52:48.857503 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 20:52:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:52:48.919563 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e7898dc7-6d18-442e-8a5a-fbcfa6833e1b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:52:48.938297 ncdv-master-1 devstack@n-api.service[127074]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 20:52:48.938297 ncdv-master-1 devstack@n-api.service[127074]: warnings.warn(msg) May 28 20:52:49.030550 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e7898dc7-6d18-442e-8a5a-fbcfa6833e1b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.166803 May 28 20:52:49.031310 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 20:52:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 20:52:49.297311 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-9f5202bc-3b67-487c-9d65-a8eb0f3b4724 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:52:49.306654 ncdv-master-1 devstack@n-api.service[127073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 20:52:49.306654 ncdv-master-1 devstack@n-api.service[127073]: warnings.warn(msg) May 28 20:52:49.306654 ncdv-master-1 devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=3 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 20:52:49.306654 ncdv-master-1 devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell1:SELECT=3 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 20:52:49.306654 ncdv-master-1 devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=3 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 20:52:49.306654 ncdv-master-1 devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 20:52:49.441140 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-9f5202bc-3b67-487c-9d65-a8eb0f3b4724 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.401737 May 28 20:52:49.442229 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1335 bytes} [Sat May 28 20:52:49 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 20:52:51.805561 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-e7898dc7-6d18-442e-8a5a-fbcfa6833e1b admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:52:51.806677 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-e7898dc7-6d18-442e-8a5a-fbcfa6833e1b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001640 May 28 20:52:51.807086 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 20:52:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:52:51.916247 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d61970d8-56a3-4d97-a209-1a4387c757b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "id": "d1", "disk": 5}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:52:51.934331 ncdv-master-1 devstack@n-api.service[127073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 20:52:51.934331 ncdv-master-1 devstack@n-api.service[127073]: warnings.warn(msg) May 28 20:52:52.033181 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d61970d8-56a3-4d97-a209-1a4387c757b7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.220373 May 28 20:52:52.033746 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 20:52:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 20:52:52.045899 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ad6caebb-b889-4367-a916-cf968ebf6da1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:52:52.047575 ncdv-master-1 devstack@n-api.service[127074]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 20:52:52.047575 ncdv-master-1 devstack@n-api.service[127074]: warnings.warn(msg) May 28 20:52:52.141640 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ad6caebb-b889-4367-a916-cf968ebf6da1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099444 May 28 20:52:52.143067 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1335 bytes} [Sat May 28 20:52:52 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 20:52:54.543628 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-d61970d8-56a3-4d97-a209-1a4387c757b7 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:52:54.544657 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-d61970d8-56a3-4d97-a209-1a4387c757b7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 28 20:52:54.545061 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 20:52:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:52:54.610397 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b81c0673-5cc5-467e-81f8-462d922b2107 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "ram": 1024, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:52:54.698228 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b81c0673-5cc5-467e-81f8-462d922b2107 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145957 May 28 20:52:54.711577 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-0289a7f6-f80c-43b6-a9a6-fa3cc02e663b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:52:54.717080 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 20:52:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 20:52:54.795059 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-0289a7f6-f80c-43b6-a9a6-fa3cc02e663b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087201 May 28 20:52:54.796076 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1335 bytes} [Sat May 28 20:52:54 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 20:52:57.458391 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b81c0673-5cc5-467e-81f8-462d922b2107 admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:52:57.461163 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b81c0673-5cc5-467e-81f8-462d922b2107 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002702 May 28 20:52:57.462097 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 20:52:57 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:52:57.551972 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-32e63d0d-024a-4bfb-a156-21f2b1124fb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "ram": 2048, "vcpus": 2, "swap": 0, "name": "ds2G", "os-flavor-access:is_public": true}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:52:57.656120 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-32e63d0d-024a-4bfb-a156-21f2b1124fb7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.183334 May 28 20:52:57.656800 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 20:52:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 20:52:57.669285 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-153506c1-3e4a-45b4-a9e5-59cb7072bb3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:52:57.779478 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-153506c1-3e4a-45b4-a9e5-59cb7072bb3a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113703 May 28 20:52:57.788288 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1335 bytes} [Sat May 28 20:52:57 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 20:53:00.544693 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-32e63d0d-024a-4bfb-a156-21f2b1124fb7 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:00.556651 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-32e63d0d-024a-4bfb-a156-21f2b1124fb7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 28 20:53:00.556651 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 20:53:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:00.610445 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-458499ad-299a-4aab-8147-42bf53e90222 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "id": "d4", "disk": 20, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:00.701145 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-458499ad-299a-4aab-8147-42bf53e90222 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.148547 May 28 20:53:00.701708 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 20:53:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 20:53:00.713763 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-2fcf35b3-cc8f-4057-906c-a4a259848bc9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:00.841532 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-2fcf35b3-cc8f-4057-906c-a4a259848bc9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131374 May 28 20:53:00.842130 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1335 bytes} [Sat May 28 20:53:00 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 20:53:03.269679 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-458499ad-299a-4aab-8147-42bf53e90222 admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:03.271424 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-458499ad-299a-4aab-8147-42bf53e90222 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002168 May 28 20:53:03.273907 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 20:53:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:03.347545 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-cb7c6895-9d5f-4e61-a37c-7e846ac45b89 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:03.371164 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-cb7c6895-9d5f-4e61-a37c-7e846ac45b89 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.091437 May 28 20:53:03.371994 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1291 bytes} [Sat May 28 20:53:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 20:53:05.746262 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-458499ad-299a-4aab-8147-42bf53e90222 admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:05.747268 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-458499ad-299a-4aab-8147-42bf53e90222 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 28 20:53:05.747672 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 20:53:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:05.807578 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4f31b859-3a75-45fe-a6c6-10d56475d5ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "name": "m1.tiny", "swap": 0, "disk": 1, "id": "1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:05.856462 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4f31b859-3a75-45fe-a6c6-10d56475d5ad admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.102831 May 28 20:53:05.857284 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 20:53:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 20:53:05.870538 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-6d018363-6bae-4246-9c7b-287c8fc09a7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:05.954042 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-6d018363-6bae-4246-9c7b-287c8fc09a7b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084520 May 28 20:53:05.954042 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1332 bytes} [Sat May 28 20:53:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 20:53:08.529290 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-4f31b859-3a75-45fe-a6c6-10d56475d5ad admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:08.530355 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-4f31b859-3a75-45fe-a6c6-10d56475d5ad admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 May 28 20:53:08.530795 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 20:53:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:08.594405 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-719e9197-d9f1-48e2-8964-4053307c1814 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:08.669077 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-719e9197-d9f1-48e2-8964-4053307c1814 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.131849 May 28 20:53:08.669659 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 20:53:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 20:53:08.682022 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-15fa2fa7-7496-4adb-8c93-e1bc93ce4591 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:08.773817 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-15fa2fa7-7496-4adb-8c93-e1bc93ce4591 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095490 May 28 20:53:08.774452 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1332 bytes} [Sat May 28 20:53:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 20:53:11.175565 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-719e9197-d9f1-48e2-8964-4053307c1814 admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:11.176633 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-719e9197-d9f1-48e2-8964-4053307c1814 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 May 28 20:53:11.177057 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 20:53:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:11.238425 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ce25e481-f0ff-4297-981e-f87293b2e5a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 40, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "ram": 4096, "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:11.318549 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ce25e481-f0ff-4297-981e-f87293b2e5a0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.135698 May 28 20:53:11.319172 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 20:53:11 2022] POST /compute/v2.1/flavors => generated 406 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 20:53:11.331681 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-78dbc92a-18db-4886-8ff8-a80c03dd516f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:11.407607 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-78dbc92a-18db-4886-8ff8-a80c03dd516f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080203 May 28 20:53:11.408406 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1332 bytes} [Sat May 28 20:53:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 20:53:13.922768 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-ce25e481-f0ff-4297-981e-f87293b2e5a0 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:13.924301 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-ce25e481-f0ff-4297-981e-f87293b2e5a0 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002047 May 28 20:53:13.924747 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 20:53:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:13.983990 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1648a91b-cd97-4a4f-84be-18276764017a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 8192}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:14.048907 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1648a91b-cd97-4a4f-84be-18276764017a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.118146 May 28 20:53:14.049556 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 20:53:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 20:53:14.066588 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1ec6f6f6-008d-4f98-b74a-69a817ab9de1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:14.156049 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1ec6f6f6-008d-4f98-b74a-69a817ab9de1 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093600 May 28 20:53:14.156669 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1332 bytes} [Sat May 28 20:53:14 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 20:53:16.473033 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-1648a91b-cd97-4a4f-84be-18276764017a admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:16.474098 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-1648a91b-cd97-4a4f-84be-18276764017a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 28 20:53:16.474523 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 20:53:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:16.535210 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-60de6887-6b25-44f8-8479-60a6058cd613 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "id": "5", "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:16.626269 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-60de6887-6b25-44f8-8479-60a6058cd613 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.145658 May 28 20:53:16.627319 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1282 bytes} [Sat May 28 20:53:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 20:53:16.639738 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fcab99b6-cc79-45e4-9c2a-77c64add6927 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:16.643373 ncdv-master-1 devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 20:53:16.783415 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fcab99b6-cc79-45e4-9c2a-77c64add6927 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.147611 May 28 20:53:16.784016 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1332 bytes} [Sat May 28 20:53:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 20:53:44.712042 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-60de6887-6b25-44f8-8479-60a6058cd613 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:44.713062 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-60de6887-6b25-44f8-8479-60a6058cd613 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 28 20:53:44.713452 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 20:53:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:44.775442 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-b052916e-688e-4964-bdc8-df7ca475fa26 admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:44.792704 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-b052916e-688e-4964-bdc8-df7ca475fa26 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071805 May 28 20:53:44.793241 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1291 bytes} [Sat May 28 20:53:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 20:53:45.829517 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-60de6887-6b25-44f8-8479-60a6058cd613 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:45.830567 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-60de6887-6b25-44f8-8479-60a6058cd613 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 28 20:53:45.830971 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 20:53:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:46.089061 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0d6f6b1c-d3db-40d6-b798-f2780f1c1f9a admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:46.094653 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-0d6f6b1c-d3db-40d6-b798-f2780f1c1f9a admin admin] HTTP exception thrown: Flavor 42 could not be found. May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0d6f6b1c-d3db-40d6-b798-f2780f1c1f9a admin admin] Request method failure captured: May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: Accept: application/json May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: Accept-Encoding: gzip, deflate May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: Connection: keep-alive May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: Content-Length: 0 May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: Host: 10.222.0.33 May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: Openstack-Api-Version: compute 2.90 May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: Openstack-System-Scope: None May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: User-Agent: python-novaclient May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: X-Auth-Token: gAAAAABikovZ5gct9vC2fMPJNt7zsoFHNZyzD4-KdPJjKJWp1yt9Fx4TwtMwTfEN-AGNaWZPemDJniSf1M420oZ-WFIw_8b_PzBiQ9OyEmKCz50k9MM7tLBp8ifiM8IU0WgzitjNJPzjy3PgIRJY5ZLW9iR3NxXl76S69sUvv9dKmqfe4VwGaRA May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: X-Domain-Id: None May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: X-Domain-Name: None May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: X-Identity-Status: Confirmed May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: X-Is-Admin-Project: True May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: X-Openstack-Nova-Api-Version: 2.90 May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: X-Project-Domain-Id: default May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: X-Project-Domain-Name: Default May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: X-Project-Id: a7d6b819de6044b98f2c78098814b8f2 May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: X-Project-Name: admin May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: X-Role: member,reader,admin May 28 20:53:46.103370 ncdv-master-1 devstack@n-api.service[127074]: X-Roles: member,reader,admin May 28 20:53:46.105147 ncdv-master-1 devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7d6b819de6044b98f2c78098814b8f2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 20:53:46.105147 ncdv-master-1 devstack@n-api.service[127074]: X-Tenant: admin May 28 20:53:46.105147 ncdv-master-1 devstack@n-api.service[127074]: X-Tenant-Id: a7d6b819de6044b98f2c78098814b8f2 May 28 20:53:46.105147 ncdv-master-1 devstack@n-api.service[127074]: X-Tenant-Name: admin May 28 20:53:46.105147 ncdv-master-1 devstack@n-api.service[127074]: X-User: admin May 28 20:53:46.105147 ncdv-master-1 devstack@n-api.service[127074]: X-User-Domain-Id: default May 28 20:53:46.105147 ncdv-master-1 devstack@n-api.service[127074]: X-User-Domain-Name: Default May 28 20:53:46.105147 ncdv-master-1 devstack@n-api.service[127074]: X-User-Id: 3e371762e9974f2484669486a37339c7 May 28 20:53:46.105147 ncdv-master-1 devstack@n-api.service[127074]: X-User-Name: admin May 28 20:53:46.105147 ncdv-master-1 devstack@n-api.service[127074]: method: > May 28 20:53:46.105147 ncdv-master-1 devstack@n-api.service[127074]: exception: Flavor 42 could not be found. May 28 20:53:46.105147 ncdv-master-1 devstack@n-api.service[127074]: action_args: {'id': '42'} May 28 20:53:46.105147 ncdv-master-1 devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 20:53:46.105147 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 20:53:46.107156 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi May 28 20:53:46.109880 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-0d6f6b1c-d3db-40d6-b798-f2780f1c1f9a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 20:53:46.114784 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-0d6f6b1c-d3db-40d6-b798-f2780f1c1f9a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.070204 May 28 20:53:46.114784 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 20:53:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 20:53:46.115292 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-702541a0-a968-4701-8b03-0d266889ad80 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:46.118208 ncdv-master-1 devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 20:53:46.136589 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-702541a0-a968-4701-8b03-0d266889ad80 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024982 May 28 20:53:46.137147 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Sat May 28 20:53:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 20:53:46.149264 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-19c71930-3a93-4ef0-a7ea-1b6e997560e6 admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:46.170610 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-19c71930-3a93-4ef0-a7ea-1b6e997560e6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025103 May 28 20:53:46.171139 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Sat May 28 20:53:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 20:53:46.180381 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-841106c7-4c8f-48e7-96d5-02eed642ff98 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:46.186365 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-841106c7-4c8f-48e7-96d5-02eed642ff98 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-841106c7-4c8f-48e7-96d5-02eed642ff98 admin admin] Request method failure captured: May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: Accept: application/json May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: Accept-Encoding: gzip, deflate May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: Connection: keep-alive May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: Content-Length: 0 May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: Host: 10.222.0.33 May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: Openstack-Api-Version: compute 2.90 May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: Openstack-System-Scope: None May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: User-Agent: python-novaclient May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: X-Auth-Token: gAAAAABikovZ5gct9vC2fMPJNt7zsoFHNZyzD4-KdPJjKJWp1yt9Fx4TwtMwTfEN-AGNaWZPemDJniSf1M420oZ-WFIw_8b_PzBiQ9OyEmKCz50k9MM7tLBp8ifiM8IU0WgzitjNJPzjy3PgIRJY5ZLW9iR3NxXl76S69sUvv9dKmqfe4VwGaRA May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: X-Domain-Id: None May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: X-Domain-Name: None May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: X-Identity-Status: Confirmed May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: X-Is-Admin-Project: True May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: X-Openstack-Nova-Api-Version: 2.90 May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: X-Project-Domain-Id: default May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: X-Project-Domain-Name: Default May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: X-Project-Id: a7d6b819de6044b98f2c78098814b8f2 May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: X-Project-Name: admin May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: X-Role: member,reader,admin May 28 20:53:46.189584 ncdv-master-1 devstack@n-api.service[127073]: X-Roles: member,reader,admin May 28 20:53:46.194759 ncdv-master-1 devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7d6b819de6044b98f2c78098814b8f2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 20:53:46.194759 ncdv-master-1 devstack@n-api.service[127073]: X-Tenant: admin May 28 20:53:46.194759 ncdv-master-1 devstack@n-api.service[127073]: X-Tenant-Id: a7d6b819de6044b98f2c78098814b8f2 May 28 20:53:46.194759 ncdv-master-1 devstack@n-api.service[127073]: X-Tenant-Name: admin May 28 20:53:46.194759 ncdv-master-1 devstack@n-api.service[127073]: X-User: admin May 28 20:53:46.194759 ncdv-master-1 devstack@n-api.service[127073]: X-User-Domain-Id: default May 28 20:53:46.194759 ncdv-master-1 devstack@n-api.service[127073]: X-User-Domain-Name: Default May 28 20:53:46.194759 ncdv-master-1 devstack@n-api.service[127073]: X-User-Id: 3e371762e9974f2484669486a37339c7 May 28 20:53:46.194759 ncdv-master-1 devstack@n-api.service[127073]: X-User-Name: admin May 28 20:53:46.194759 ncdv-master-1 devstack@n-api.service[127073]: method: > May 28 20:53:46.194759 ncdv-master-1 devstack@n-api.service[127073]: exception: Flavor 42 could not be found. May 28 20:53:46.194759 ncdv-master-1 devstack@n-api.service[127073]: action_args: {'id': '42'} May 28 20:53:46.194759 ncdv-master-1 devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 20:53:46.194759 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 20:53:46.195846 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi May 28 20:53:46.197196 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-841106c7-4c8f-48e7-96d5-02eed642ff98 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 20:53:46.198788 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-841106c7-4c8f-48e7-96d5-02eed642ff98 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014085 May 28 20:53:46.198788 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 20:53:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 28 20:53:47.193274 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-19c71930-3a93-4ef0-a7ea-1b6e997560e6 admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:47.194351 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-19c71930-3a93-4ef0-a7ea-1b6e997560e6 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 28 20:53:47.194754 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 20:53:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:47.389359 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7239b1b5-7963-499d-98f1-00a4e456a338 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:47.395615 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-7239b1b5-7963-499d-98f1-00a4e456a338 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7239b1b5-7963-499d-98f1-00a4e456a338 admin admin] Request method failure captured: May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: Accept: application/json May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: Accept-Encoding: gzip, deflate May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: Connection: keep-alive May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: Content-Length: 0 May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: Host: 10.222.0.33 May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: Openstack-Api-Version: compute 2.90 May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: Openstack-System-Scope: None May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: User-Agent: python-novaclient May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: X-Auth-Token: gAAAAABikovb3gaPPP_aBaAG80wURpupGap8K4LGMzPzOwj0golUs6pVGdJjXWqWZrRwzuu_NLwlIUtPMqYsbMGVrweexPdhgZYexAtkJKkmRq7RTY6N2C_VpvqUV0qTYjMFXDJX3-NGeK9YGTQarsZWgwW_NCUh1wCzR3pCWEPvHv7zCdZdkGA May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: X-Domain-Id: None May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: X-Domain-Name: None May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: X-Identity-Status: Confirmed May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: X-Is-Admin-Project: True May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: X-Openstack-Nova-Api-Version: 2.90 May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: X-Project-Domain-Id: default May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: X-Project-Domain-Name: Default May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: X-Project-Id: a7d6b819de6044b98f2c78098814b8f2 May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: X-Project-Name: admin May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: X-Role: member,reader,admin May 28 20:53:47.397103 ncdv-master-1 devstack@n-api.service[127073]: X-Roles: member,reader,admin May 28 20:53:47.398727 ncdv-master-1 devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7d6b819de6044b98f2c78098814b8f2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 20:53:47.398727 ncdv-master-1 devstack@n-api.service[127073]: X-Tenant: admin May 28 20:53:47.398727 ncdv-master-1 devstack@n-api.service[127073]: X-Tenant-Id: a7d6b819de6044b98f2c78098814b8f2 May 28 20:53:47.398727 ncdv-master-1 devstack@n-api.service[127073]: X-Tenant-Name: admin May 28 20:53:47.398727 ncdv-master-1 devstack@n-api.service[127073]: X-User: admin May 28 20:53:47.398727 ncdv-master-1 devstack@n-api.service[127073]: X-User-Domain-Id: default May 28 20:53:47.398727 ncdv-master-1 devstack@n-api.service[127073]: X-User-Domain-Name: Default May 28 20:53:47.398727 ncdv-master-1 devstack@n-api.service[127073]: X-User-Id: 3e371762e9974f2484669486a37339c7 May 28 20:53:47.398727 ncdv-master-1 devstack@n-api.service[127073]: X-User-Name: admin May 28 20:53:47.398727 ncdv-master-1 devstack@n-api.service[127073]: method: > May 28 20:53:47.398727 ncdv-master-1 devstack@n-api.service[127073]: exception: Flavor 84 could not be found. May 28 20:53:47.398727 ncdv-master-1 devstack@n-api.service[127073]: action_args: {'id': '84'} May 28 20:53:47.398727 ncdv-master-1 devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 20:53:47.398727 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 20:53:47.399677 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi May 28 20:53:47.400960 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7239b1b5-7963-499d-98f1-00a4e456a338 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 20:53:47.402278 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7239b1b5-7963-499d-98f1-00a4e456a338 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061296 May 28 20:53:47.402278 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 20:53:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 20:53:47.408196 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-983af613-4b68-4a76-847f-734553c3700a admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:47.422168 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-983af613-4b68-4a76-847f-734553c3700a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017649 May 28 20:53:47.422695 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Sat May 28 20:53:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 20:53:47.432165 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5ab78799-4448-4f26-afbf-3e8c268e4f9f admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:47.445887 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-5ab78799-4448-4f26-afbf-3e8c268e4f9f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017310 May 28 20:53:47.446423 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Sat May 28 20:53:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 20:53:47.455415 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3bc448da-77b9-455a-b47c-7abddc8bdde0 admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:47.461194 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-3bc448da-77b9-455a-b47c-7abddc8bdde0 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3bc448da-77b9-455a-b47c-7abddc8bdde0 admin admin] Request method failure captured: May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: Accept: application/json May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: Accept-Encoding: gzip, deflate May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: Connection: keep-alive May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: Content-Length: 0 May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: Host: 10.222.0.33 May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: Openstack-Api-Version: compute 2.90 May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: Openstack-System-Scope: None May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: User-Agent: python-novaclient May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: X-Auth-Token: gAAAAABikovb3gaPPP_aBaAG80wURpupGap8K4LGMzPzOwj0golUs6pVGdJjXWqWZrRwzuu_NLwlIUtPMqYsbMGVrweexPdhgZYexAtkJKkmRq7RTY6N2C_VpvqUV0qTYjMFXDJX3-NGeK9YGTQarsZWgwW_NCUh1wCzR3pCWEPvHv7zCdZdkGA May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: X-Domain-Id: None May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: X-Domain-Name: None May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: X-Identity-Status: Confirmed May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: X-Is-Admin-Project: True May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: X-Openstack-Nova-Api-Version: 2.90 May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: X-Project-Domain-Id: default May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: X-Project-Domain-Name: Default May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: X-Project-Id: a7d6b819de6044b98f2c78098814b8f2 May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: X-Project-Name: admin May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: X-Role: member,reader,admin May 28 20:53:47.462958 ncdv-master-1 devstack@n-api.service[127074]: X-Roles: member,reader,admin May 28 20:53:47.464264 ncdv-master-1 devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7d6b819de6044b98f2c78098814b8f2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 20:53:47.464264 ncdv-master-1 devstack@n-api.service[127074]: X-Tenant: admin May 28 20:53:47.464264 ncdv-master-1 devstack@n-api.service[127074]: X-Tenant-Id: a7d6b819de6044b98f2c78098814b8f2 May 28 20:53:47.464264 ncdv-master-1 devstack@n-api.service[127074]: X-Tenant-Name: admin May 28 20:53:47.464264 ncdv-master-1 devstack@n-api.service[127074]: X-User: admin May 28 20:53:47.464264 ncdv-master-1 devstack@n-api.service[127074]: X-User-Domain-Id: default May 28 20:53:47.464264 ncdv-master-1 devstack@n-api.service[127074]: X-User-Domain-Name: Default May 28 20:53:47.464264 ncdv-master-1 devstack@n-api.service[127074]: X-User-Id: 3e371762e9974f2484669486a37339c7 May 28 20:53:47.464264 ncdv-master-1 devstack@n-api.service[127074]: X-User-Name: admin May 28 20:53:47.464264 ncdv-master-1 devstack@n-api.service[127074]: method: > May 28 20:53:47.464264 ncdv-master-1 devstack@n-api.service[127074]: exception: Flavor 84 could not be found. May 28 20:53:47.464264 ncdv-master-1 devstack@n-api.service[127074]: action_args: {'id': '84'} May 28 20:53:47.464264 ncdv-master-1 devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 20:53:47.464264 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 20:53:47.465207 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi May 28 20:53:47.466623 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3bc448da-77b9-455a-b47c-7abddc8bdde0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 20:53:47.467888 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3bc448da-77b9-455a-b47c-7abddc8bdde0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012256 May 28 20:53:47.467888 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 20:53:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 28 20:53:48.339920 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5ab78799-4448-4f26-afbf-3e8c268e4f9f admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:48.345651 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-5ab78799-4448-4f26-afbf-3e8c268e4f9f admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 28 20:53:48.345651 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 20:53:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:48.533540 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3b44a8b3-f1da-4a60-b667-ea122e262164 admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:48.539752 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.wsgi [None req-3b44a8b3-f1da-4a60-b667-ea122e262164 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3b44a8b3-f1da-4a60-b667-ea122e262164 admin admin] Request method failure captured: May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: Accept: application/json May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: Accept-Encoding: gzip, deflate May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: Connection: keep-alive May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: Content-Length: 0 May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: Host: 10.222.0.33 May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: Openstack-Api-Version: compute 2.90 May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: Openstack-System-Scope: None May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: User-Agent: python-novaclient May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: X-Auth-Token: gAAAAABikovcfrS3qrjJazMJXsquE3h8x2FoIV-bTccpLstlDfgWtTtDqMSRdu4XdLS8n_fvvECmNzhbh4Tl-pjii_z5h2_EjPXNWL4ga_iwXNGP9_2nNcRtx678EF0acXzIsmTFfw0BJwax2_r7acZDYvSy61IetTauQwBHMU66EuyDcushgxw May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: X-Domain-Id: None May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: X-Domain-Name: None May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: X-Identity-Status: Confirmed May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: X-Is-Admin-Project: True May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: X-Openstack-Nova-Api-Version: 2.90 May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: X-Project-Domain-Id: default May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: X-Project-Domain-Name: Default May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: X-Project-Id: a7d6b819de6044b98f2c78098814b8f2 May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: X-Project-Name: admin May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: X-Role: member,reader,admin May 28 20:53:48.541233 ncdv-master-1 devstack@n-api.service[127074]: X-Roles: member,reader,admin May 28 20:53:48.542798 ncdv-master-1 devstack@n-api.service[127074]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7d6b819de6044b98f2c78098814b8f2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 20:53:48.542798 ncdv-master-1 devstack@n-api.service[127074]: X-Tenant: admin May 28 20:53:48.542798 ncdv-master-1 devstack@n-api.service[127074]: X-Tenant-Id: a7d6b819de6044b98f2c78098814b8f2 May 28 20:53:48.542798 ncdv-master-1 devstack@n-api.service[127074]: X-Tenant-Name: admin May 28 20:53:48.542798 ncdv-master-1 devstack@n-api.service[127074]: X-User: admin May 28 20:53:48.542798 ncdv-master-1 devstack@n-api.service[127074]: X-User-Domain-Id: default May 28 20:53:48.542798 ncdv-master-1 devstack@n-api.service[127074]: X-User-Domain-Name: Default May 28 20:53:48.542798 ncdv-master-1 devstack@n-api.service[127074]: X-User-Id: 3e371762e9974f2484669486a37339c7 May 28 20:53:48.542798 ncdv-master-1 devstack@n-api.service[127074]: X-User-Name: admin May 28 20:53:48.542798 ncdv-master-1 devstack@n-api.service[127074]: method: > May 28 20:53:48.542798 ncdv-master-1 devstack@n-api.service[127074]: exception: Flavor 451 could not be found. May 28 20:53:48.542798 ncdv-master-1 devstack@n-api.service[127074]: action_args: {'id': '451'} May 28 20:53:48.542798 ncdv-master-1 devstack@n-api.service[127074]: {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 20:53:48.542798 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 20:53:48.543827 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: ERROR nova.api.openstack.wsgi May 28 20:53:48.545269 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-3b44a8b3-f1da-4a60-b667-ea122e262164 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=127074) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 20:53:48.546540 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-3b44a8b3-f1da-4a60-b667-ea122e262164 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059871 May 28 20:53:48.546540 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 20:53:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 20:53:48.552875 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-7747b569-0bab-4d4c-b1c6-0487cb147469 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:48.566221 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-7747b569-0bab-4d4c-b1c6-0487cb147469 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017617 May 28 20:53:48.566753 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Sat May 28 20:53:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 20:53:48.576398 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fa9aaded-c25b-492c-905f-bcc3534a9ded admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:48.589866 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fa9aaded-c25b-492c-905f-bcc3534a9ded admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017162 May 28 20:53:48.590403 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Sat May 28 20:53:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 20:53:48.600085 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b5347cb1-5647-41a7-925c-d210c65e4687 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:48.605320 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.wsgi [None req-b5347cb1-5647-41a7-925c-d210c65e4687 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b5347cb1-5647-41a7-925c-d210c65e4687 admin admin] Request method failure captured: May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: Accept: application/json May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: Accept-Encoding: gzip, deflate May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: Connection: keep-alive May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: Content-Length: 0 May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: Host: 10.222.0.33 May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: Openstack-Api-Version: compute 2.90 May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: Openstack-System-Scope: None May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: User-Agent: python-novaclient May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: X-Auth-Token: gAAAAABikovcfrS3qrjJazMJXsquE3h8x2FoIV-bTccpLstlDfgWtTtDqMSRdu4XdLS8n_fvvECmNzhbh4Tl-pjii_z5h2_EjPXNWL4ga_iwXNGP9_2nNcRtx678EF0acXzIsmTFfw0BJwax2_r7acZDYvSy61IetTauQwBHMU66EuyDcushgxw May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: X-Domain-Id: None May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: X-Domain-Name: None May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: X-Identity-Status: Confirmed May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: X-Is-Admin-Project: True May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: X-Openstack-Nova-Api-Version: 2.90 May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: X-Project-Domain-Id: default May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: X-Project-Domain-Name: Default May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: X-Project-Id: a7d6b819de6044b98f2c78098814b8f2 May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: X-Project-Name: admin May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: X-Role: member,reader,admin May 28 20:53:48.606914 ncdv-master-1 devstack@n-api.service[127073]: X-Roles: member,reader,admin May 28 20:53:48.608458 ncdv-master-1 devstack@n-api.service[127073]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a7d6b819de6044b98f2c78098814b8f2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a7d6b819de6044b98f2c78098814b8f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 20:53:48.608458 ncdv-master-1 devstack@n-api.service[127073]: X-Tenant: admin May 28 20:53:48.608458 ncdv-master-1 devstack@n-api.service[127073]: X-Tenant-Id: a7d6b819de6044b98f2c78098814b8f2 May 28 20:53:48.608458 ncdv-master-1 devstack@n-api.service[127073]: X-Tenant-Name: admin May 28 20:53:48.608458 ncdv-master-1 devstack@n-api.service[127073]: X-User: admin May 28 20:53:48.608458 ncdv-master-1 devstack@n-api.service[127073]: X-User-Domain-Id: default May 28 20:53:48.608458 ncdv-master-1 devstack@n-api.service[127073]: X-User-Domain-Name: Default May 28 20:53:48.608458 ncdv-master-1 devstack@n-api.service[127073]: X-User-Id: 3e371762e9974f2484669486a37339c7 May 28 20:53:48.608458 ncdv-master-1 devstack@n-api.service[127073]: X-User-Name: admin May 28 20:53:48.608458 ncdv-master-1 devstack@n-api.service[127073]: method: > May 28 20:53:48.608458 ncdv-master-1 devstack@n-api.service[127073]: exception: Flavor 451 could not be found. May 28 20:53:48.608458 ncdv-master-1 devstack@n-api.service[127073]: action_args: {'id': '451'} May 28 20:53:48.608458 ncdv-master-1 devstack@n-api.service[127073]: {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 20:53:48.608458 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 20:53:48.609523 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: ERROR nova.api.openstack.wsgi May 28 20:53:48.610864 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-b5347cb1-5647-41a7-925c-d210c65e4687 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=127073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 20:53:48.612083 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-b5347cb1-5647-41a7-925c-d210c65e4687 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012243 May 28 20:53:48.612083 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 20:53:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 28 20:53:49.479340 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fa9aaded-c25b-492c-905f-bcc3534a9ded admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:49.480332 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fa9aaded-c25b-492c-905f-bcc3534a9ded admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 May 28 20:53:49.480724 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 20:53:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:49.678338 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-e021a54a-3e87-4199-acec-8398dbb47ea9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:49.739316 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-e021a54a-3e87-4199-acec-8398dbb47ea9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.112401 May 28 20:53:49.739794 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Sat May 28 20:53:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 20:53:50.615594 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fa9aaded-c25b-492c-905f-bcc3534a9ded admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:50.616590 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fa9aaded-c25b-492c-905f-bcc3534a9ded admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 May 28 20:53:50.616981 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 20:53:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:50.811408 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1f912ebe-45ed-4192-bd89-d04b4e8f1f81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:50.871074 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1f912ebe-45ed-4192-bd89-d04b4e8f1f81 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.110209 May 28 20:53:50.871632 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Sat May 28 20:53:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 20:53:51.745521 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fa9aaded-c25b-492c-905f-bcc3534a9ded admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:51.746561 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fa9aaded-c25b-492c-905f-bcc3534a9ded admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 28 20:53:51.746952 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 20:53:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:51.942315 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-bd62f617-5f35-42bc-8267-bc0c7cb9f150 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:52.001330 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-bd62f617-5f35-42bc-8267-bc0c7cb9f150 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.112016 May 28 20:53:52.001818 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Sat May 28 20:53:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 20:53:52.879103 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fa9aaded-c25b-492c-905f-bcc3534a9ded admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:52.880104 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fa9aaded-c25b-492c-905f-bcc3534a9ded admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002313 May 28 20:53:52.880499 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 20:53:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:53.074614 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-79c98ff7-d9a9-41a3-99f8-c4eabe63291c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 20:53:53.134611 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-79c98ff7-d9a9-41a3-99f8-c4eabe63291c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.113250 May 28 20:53:53.135470 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Sat May 28 20:53:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 20:53:54.013042 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fa9aaded-c25b-492c-905f-bcc3534a9ded admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:54.014061 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fa9aaded-c25b-492c-905f-bcc3534a9ded admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 May 28 20:53:54.014459 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 20:53:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:53:54.208434 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-076fd13a-da0e-4783-aabe-9dd81bf5e917 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:53:54.227099 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-076fd13a-da0e-4783-aabe-9dd81bf5e917 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069931 May 28 20:53:54.227569 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Sat May 28 20:53:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 20:54:58.477179 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-fa9aaded-c25b-492c-905f-bcc3534a9ded admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:54:58.478207 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-fa9aaded-c25b-492c-905f-bcc3534a9ded admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 May 28 20:54:58.478609 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 930 bytes} [Sat May 28 20:54:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 20:54:58.487848 ncdv-master-1 devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 20:54:58.540274 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c0c8a390-fa7d-417f-a211-ae150dc6a300 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:54:58.559724 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c0c8a390-fa7d-417f-a211-ae150dc6a300 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073611 May 28 20:54:58.559888 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1291 bytes} [Sat May 28 20:54:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 20:54:58.580727 ncdv-master-1 devstack@n-api.service[127074]: DEBUG dbcounter [-] [127074] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=127074) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 20:54:58.584415 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-65b84d51-4378-495d-80d9-60890624a40f admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:54:58.591831 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-65b84d51-4378-495d-80d9-60890624a40f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013162 May 28 20:54:58.592494 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1282 bytes} [Sat May 28 20:54:58 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 20:54:58.604670 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-1d2a342f-b43d-4d5c-a803-d11850692fc8 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:54:58.612214 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-1d2a342f-b43d-4d5c-a803-d11850692fc8 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011367 May 28 20:54:58.612738 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1285 bytes} [Sat May 28 20:54:58 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 20:54:58.623823 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ff50c415-6fde-484f-b918-947efa3ff69b admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:54:58.631831 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ff50c415-6fde-484f-b918-947efa3ff69b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011577 May 28 20:54:58.632345 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1285 bytes} [Sat May 28 20:54:58 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 20:54:58.643829 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-39c13310-7fcf-484d-8230-3daf550aecb6 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 20:54:58.651409 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-39c13310-7fcf-484d-8230-3daf550aecb6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011551 May 28 20:54:58.651929 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1282 bytes} [Sat May 28 20:54:58 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:01:07.576457 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ff50c415-6fde-484f-b918-947efa3ff69b admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:01:07.577493 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ff50c415-6fde-484f-b918-947efa3ff69b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 May 28 21:01:07.577957 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 21:01:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:01:07.738119 ncdv-master-1 devstack@n-api.service[127073]: DEBUG dbcounter [-] [127073] Writing DB stats nova_api:SELECT=6 {{(pid=127073) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:01:07.851150 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-5abcd7c5-cf2f-4158-9682-d4c2152ab17a admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:01:07.855465 ncdv-master-1 devstack@n-api.service[127073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:01:07.855465 ncdv-master-1 devstack@n-api.service[127073]: warnings.warn(msg) May 28 21:01:07.855465 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5abcd7c5-cf2f-4158-9682-d4c2152ab17a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:01:07.855465 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5abcd7c5-cf2f-4158-9682-d4c2152ab17a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:01:07.855465 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5abcd7c5-cf2f-4158-9682-d4c2152ab17a admin admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:01:07.855465 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-5abcd7c5-cf2f-4158-9682-d4c2152ab17a admin admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:01:07.896835 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-5abcd7c5-cf2f-4158-9682-d4c2152ab17a admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.160217 May 28 21:01:07.897413 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:01:07 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:01:08.768226 ncdv-master-1 devstack@n-api.service[127074]: DEBUG nova.api.openstack.wsgi [None req-ff50c415-6fde-484f-b918-947efa3ff69b admin admin] Calling method '>' {{(pid=127074) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:01:08.769241 ncdv-master-1 devstack@n-api.service[127074]: INFO nova.api.openstack.requestlog [None req-ff50c415-6fde-484f-b918-947efa3ff69b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 28 21:01:08.769654 ncdv-master-1 devstack@n-api.service[127074]: [pid: 127074|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Sat May 28 21:01:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:01:08.967905 ncdv-master-1 devstack@n-api.service[127073]: DEBUG nova.api.openstack.wsgi [None req-c7d13e24-6140-4cde-8b33-af60407e70a6 admin admin] Calling method '>' {{(pid=127073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:01:08.969067 ncdv-master-1 devstack@n-api.service[127073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:01:08.969067 ncdv-master-1 devstack@n-api.service[127073]: warnings.warn(msg) May 28 21:01:08.970316 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7d13e24-6140-4cde-8b33-af60407e70a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:01:08.970751 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7d13e24-6140-4cde-8b33-af60407e70a6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:01:08.971521 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7d13e24-6140-4cde-8b33-af60407e70a6 admin admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:01:08.971945 ncdv-master-1 devstack@n-api.service[127073]: DEBUG oslo_concurrency.lockutils [None req-c7d13e24-6140-4cde-8b33-af60407e70a6 admin admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:01:08.994535 ncdv-master-1 devstack@n-api.service[127073]: INFO nova.api.openstack.requestlog [None req-c7d13e24-6140-4cde-8b33-af60407e70a6 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.079546 May 28 21:01:08.995054 ncdv-master-1 devstack@n-api.service[127073]: [pid: 127073|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:01:08 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:01:56.564756 ncdv-master-1 devstack@n-api.service[127072]: Sat May 28 21:01:56 2022 - graceful shutdown triggered... May 28 21:01:56.565293 ncdv-master-1 devstack@n-api.service[127074]: Gracefully killing worker 2 (pid: 127074)... May 28 21:01:56.564884 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... May 28 21:01:56.566300 ncdv-master-1 devstack@n-api.service[127073]: Gracefully killing worker 1 (pid: 127073)... May 28 21:01:57.565722 ncdv-master-1 devstack@n-api.service[127072]: worker 1 buried after 1 seconds May 28 21:01:57.566218 ncdv-master-1 devstack@n-api.service[127072]: worker 2 buried after 1 seconds May 28 21:01:57.566218 ncdv-master-1 devstack@n-api.service[127072]: goodbye to uWSGI. May 28 21:01:57.567335 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. May 28 21:01:57.567891 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. May 28 21:01:57.571172 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... May 28 21:01:57.609931 ncdv-master-1 devstack@n-api.service[143111]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 28 21:01:57.611862 ncdv-master-1 devstack@n-api.service[143111]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat May 28 21:01:57 2022] *** May 28 21:01:57.611862 ncdv-master-1 devstack@n-api.service[143111]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 28 21:01:57.611862 ncdv-master-1 devstack@n-api.service[143111]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 28 21:01:57.611862 ncdv-master-1 devstack@n-api.service[143111]: nodename: ncdv-master-1 May 28 21:01:57.611862 ncdv-master-1 devstack@n-api.service[143111]: machine: x86_64 May 28 21:01:57.611862 ncdv-master-1 devstack@n-api.service[143111]: clock source: unix May 28 21:01:57.611862 ncdv-master-1 devstack@n-api.service[143111]: pcre jit disabled May 28 21:01:57.611862 ncdv-master-1 devstack@n-api.service[143111]: detected number of CPU cores: 4 May 28 21:01:57.611862 ncdv-master-1 devstack@n-api.service[143111]: current working directory: / May 28 21:01:57.611862 ncdv-master-1 devstack@n-api.service[143111]: detected binary path: /usr/bin/uwsgi-core May 28 21:01:57.612631 ncdv-master-1 devstack@n-api.service[143111]: your processes number limit is 47680 May 28 21:01:57.612631 ncdv-master-1 devstack@n-api.service[143111]: your memory page size is 4096 bytes May 28 21:01:57.612631 ncdv-master-1 devstack@n-api.service[143111]: detected max file descriptor number: 2048 May 28 21:01:57.612631 ncdv-master-1 devstack@n-api.service[143111]: lock engine: pthread robust mutexes May 28 21:01:57.612631 ncdv-master-1 devstack@n-api.service[143111]: thunder lock: enabled May 28 21:01:57.612631 ncdv-master-1 devstack@n-api.service[143111]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 28 21:01:57.612631 ncdv-master-1 devstack@n-api.service[143111]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 28 21:01:57.663310 ncdv-master-1 devstack@n-api.service[143111]: Python main interpreter initialized at 0x55a311e889c0 May 28 21:01:57.663310 ncdv-master-1 devstack@n-api.service[143111]: python threads support enabled May 28 21:01:57.663310 ncdv-master-1 devstack@n-api.service[143111]: your server socket listen backlog is limited to 100 connections May 28 21:01:57.663310 ncdv-master-1 devstack@n-api.service[143111]: your mercy for graceful operations on workers is 90 seconds May 28 21:01:57.663756 ncdv-master-1 devstack@n-api.service[143111]: mapped 403077 bytes (393 KB) for 2 cores May 28 21:01:57.663756 ncdv-master-1 devstack@n-api.service[143111]: *** Operational MODE: preforking *** May 28 21:01:57.663962 ncdv-master-1 devstack@n-api.service[143111]: *** uWSGI is running in multiple interpreter mode *** May 28 21:01:57.663962 ncdv-master-1 devstack@n-api.service[143111]: spawned uWSGI master process (pid: 143111) May 28 21:01:57.664169 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. May 28 21:01:57.666234 ncdv-master-1 devstack@n-api.service[143111]: spawned uWSGI worker 1 (pid: 143128, cores: 1) May 28 21:01:57.666234 ncdv-master-1 devstack@n-api.service[143111]: spawned uWSGI worker 2 (pid: 143129, cores: 1) May 28 21:01:57.666234 ncdv-master-1 devstack@n-api.service[143111]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 28 21:01:58.923342 ncdv-master-1 devstack@n-api.service[143128]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 28 21:01:58.927933 ncdv-master-1 devstack@n-api.service[143129]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 28 21:01:59.727523 ncdv-master-1 devstack@n-api.service[143128]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 21:01:59.727523 ncdv-master-1 devstack@n-api.service[143128]: from cryptography.utils import int_from_bytes May 28 21:01:59.727892 ncdv-master-1 devstack@n-api.service[143128]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 21:01:59.727892 ncdv-master-1 devstack@n-api.service[143128]: from cryptography.utils import int_from_bytes May 28 21:01:59.733373 ncdv-master-1 devstack@n-api.service[143129]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 21:01:59.733373 ncdv-master-1 devstack@n-api.service[143129]: from cryptography.utils import int_from_bytes May 28 21:01:59.733695 ncdv-master-1 devstack@n-api.service[143129]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 28 21:01:59.733695 ncdv-master-1 devstack@n-api.service[143129]: from cryptography.utils import int_from_bytes May 28 21:02:02.169747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 21:02:02.170311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 28 21:02:02.170671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 21:02:02.170765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 28 21:02:02.170850 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 21:02:02.170934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 28 21:02:02.171016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 21:02:02.171110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 28 21:02:02.171186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 21:02:02.171349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 28 21:02:02.171696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.171819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.172040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.172150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.172386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.172722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.173068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.173196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.173387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.173489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.173712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.173813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.174100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.174207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.174409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.174516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.174681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.174786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.175009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.175122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.175351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.175461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.175668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.175766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.175986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.176368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.176468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.176544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.176623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.176695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.177032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.177149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.177227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.177299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.177537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.177643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.177883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.178080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.178935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.179055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.179139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.179227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.179320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.179405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.179497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.179574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.180165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.180270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.180358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.180441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.180525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.180599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.180671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.180753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.181208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.181336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.181429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.181519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.181612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.181760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.181911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.182113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.182392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.182546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.182729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.182849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.183047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.183163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.183364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.183463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.183768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.183863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.184089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.184190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.184404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.184616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.184826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.184928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.185058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.185191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.185371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.185510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.185708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.185815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.186062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.186165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.186374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.186472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.186695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.186812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.187001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.187103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.187316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.187414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.187630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.187724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.187945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.188054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.188207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.188314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.188527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.188635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.188795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.188960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.189111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.189208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.189440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.189536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.189745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.189879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.190031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.190129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.190355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.190486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.190620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.190745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.190923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.191063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.191252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.191405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.191568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.191671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.191882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.191991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.192193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.192298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.192507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.192608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.192817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.192921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.193134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.193345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.193446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.193545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.193741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.193869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.194089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.194212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.194407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.194510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.194734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.194837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.195589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.195768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.195920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.196066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.196238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.196382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.196535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.196627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.196847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.196962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.197191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.197288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.197515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.197619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.197829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.197985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.198173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.198275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.198491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.198598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.198802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.198909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.199116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.199224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.199430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.199534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.199753 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.199858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.200011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.200116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.200325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.200431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.200629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.200731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.200937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.201046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.201246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.201395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.201557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.201703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.201889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.202006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.202203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.202298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.202514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.202614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.202835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.202946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.203131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.203360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.203459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.203544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.203738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.203836 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.204047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.204151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.204354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.204458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.204664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.204761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.204974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.205068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.205287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.205389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.205599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.205733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.206018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.206124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.206336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.206455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.206644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.206754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.206953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.207061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.207263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.207357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.207627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.207806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.207901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.207989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.208216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.208312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.208535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.208675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.212014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.212202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.212362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.212529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.212709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.212868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.213025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.213181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.213356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.213599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.213760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.213944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.214110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.214257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.214403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.214562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.214709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.214854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.215007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.215155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.215309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.215468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.215584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.215691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.215789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.215877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.215971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.216071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.216166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.216379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.216523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.216630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.216858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.216979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.217153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.217259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.217406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.217568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.217737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.217876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.217968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.218070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.218166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.218254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.218348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.218505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.218611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.218702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.218839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.218971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 28 21:02:02.219072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.219168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.219264 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.219398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.219546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.219648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.219736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.219736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.219915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.220002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.220086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.220185 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.220273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.220359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.220451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.220546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.220642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.220726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.220862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.220961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.221058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.221202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.221311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.221407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.221407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.221570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.221704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.221911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.222060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.222236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.222349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.222613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.222724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.222937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.223273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.223456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.223614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.223756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.223935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.224036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.224284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.224397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.224605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.224707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.224929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.225032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.225296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.225468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.225604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.225789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.225995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.226213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.226321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.226559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.226769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.226941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.227116 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.227343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.227453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.227788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.227933 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.228073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.228175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.228263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.228426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.228598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.228737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.228828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.229018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.229200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.229364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.229521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.229931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.230052 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.230157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.230263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.230361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.230500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.230728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.230822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.231055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.231163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.231378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.231480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.231700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.231796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.232021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.232173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.232336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.232432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.232649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.232745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.232963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.233068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.233279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.233373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.233591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.233703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.233941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.234058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.234260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.234365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.234576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.234680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.234885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.234989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.235194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.235288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.235508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.235628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.235823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.235922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.236133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.236228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.236465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.236603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.236775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.236871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.237089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.237195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.237399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.237547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.237723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.237824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.238084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.238179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.238400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.238512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.238717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.238812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.239028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.239131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.239340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.239453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.239652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.239755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.239962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.240057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.240281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.240389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.240596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.240696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.240906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.241002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.241233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.241338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.241545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.241659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.241906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.242036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.242231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.242369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.242548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.242672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.242864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.242988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.243179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.243303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.243494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.243618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.243878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.244019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.244165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.244307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.244440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.244573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.244734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.244838 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.245051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.245147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.245366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.245462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.245691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.245797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.246027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.246121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.246331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.246679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.246901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.247013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.247218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.247324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.247526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.247610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.247837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.247948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.248149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.248246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.248462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.248563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.248768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.248876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.249079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.249225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.249430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.249592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.249732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.249930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.250123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.250270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.250457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.250587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.250782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.250901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.251104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.251232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.251425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.251548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.251753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.251884 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.252073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.252206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.252395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.252517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.252715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.252846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.253036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.253170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.253366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.253496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.253882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.254190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.254515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.254766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.254874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.255109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.255213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.255453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.255555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.255785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.255889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.256112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.256411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.256570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.256758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.256902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.256995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.257095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.257191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.257973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.258121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.258238 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.258391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.258568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.258723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.259038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.259179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.259302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.259431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.259529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.259658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.259849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.260017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.260254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.260373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.260607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.260703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.260934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.261034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.261256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.261366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.261584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.261686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.261928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.262028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.262254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.262364 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.262566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.262661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.262883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.262977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.263203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.263311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.263521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.263616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.263848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.263990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.264169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.264272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.264492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.264585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.264810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.264944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.265131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.265228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.265449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.265549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.265764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.265880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.266106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.266201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.266429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.266525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.266752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.266857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.267074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.267172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.267456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.267564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.267706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.267812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.268031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.268134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.268344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.268437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.268657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.268760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.268972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.269066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.269282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.269387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.269597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.269702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.269949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.270049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.270275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.270367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.270594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.270699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.270910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.271003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.271217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.271356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.271540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.271688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.271854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.271956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.272168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.272263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.272480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.272576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.272792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.272887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.273681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.273787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.274036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.274133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.274355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.274456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.274685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.274783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.275019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.275157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.275328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.275430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.275653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.275756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.275973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.276074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.276287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.276384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.276598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.276708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.276909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.277005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.277232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.277338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.277557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.277697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.277889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.278035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.278204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.278300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.278524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.278630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.278837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.278931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.279158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.279299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.279476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.279570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.279788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.279897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.280098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.280192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.280417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.280520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.280729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.280823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.281043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.281324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.281428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.281675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.281807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.282031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.282162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.282365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.282569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.282911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.283028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.283151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.283345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.283683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.283882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.284045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.284207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.284369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.284524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.284671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.284841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.285009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.285166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.285363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.285562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.285721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.285915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.286220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.286538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.286858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.286987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.287173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.287317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.287489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.287644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.287841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.287962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.288107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.288230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.288430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.288563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.288769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.288918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.289093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.289350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.289491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.289622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.289739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.289934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.290080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.290255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.290386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.290571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.290701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.290895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.291034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.291241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.291377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.291531 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.291656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.291846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.291970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.292165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.292295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.292476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.292607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.292788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.292912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.293099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.293221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.293409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.293531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.293732 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.293907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.294069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.294201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.294389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.294518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.294699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.294824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.295030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.295153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.295343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.295474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.295652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.295772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.296013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.296153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.296289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.296414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.296592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.296713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.296905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.297036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.297226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.297363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.297538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.297661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.297901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.298044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.298195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.298335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.298506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.298636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.298818 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.298958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.299138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.299274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.299488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.299632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.299773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.299915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.300063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.300199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.300352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.300486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.300657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.300791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.300973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.301113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.301283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.301412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.301595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.301716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.301936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.302093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.302253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.302389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.302561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.302713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.302868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.302996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.303187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.303333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.303497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.303640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.303799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.303944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.304107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.304254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.304446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.304592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.304758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.304894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.305067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.305213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.305382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.305573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.305717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.305907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.306057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.306264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.306419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.306551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.306675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.306791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.306928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.307064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.307238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.307360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.307548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.307670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.307855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.308002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.308202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.308329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.308446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.308559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.308762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.308884 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.309073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.309209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.309388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.309535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.309732 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.309896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.310051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.310198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.310332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.310472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.310614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.310756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.310935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.311078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.311244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.311382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.311559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.311708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.311851 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.311984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.312163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.312350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.312504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.312724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.312860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.312992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.313124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.313255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.313401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.313542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.313686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.313819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.314006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.314138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.314284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.314418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.314574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.314719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.314888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.315034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.315197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.315344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.315506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.315651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.315813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.315951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.316166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.316381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.316524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.316647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.316822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.316965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.317133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.317310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.317453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.317576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.317769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.317943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.318113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.318328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.318450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.318571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.318731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.318863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.319035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.319163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.319356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.319477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.319669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.320490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.320616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.320731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.320844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.320966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.321112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.321244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.321435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.321558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.321748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.321919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.322092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.322237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.322379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.322511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.322709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.322853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.323029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.323171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.323335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.323470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.323649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.323785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.323960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.324102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.324271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.324413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.324581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.324723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.324893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.325028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.325210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.325346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.325525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.325675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.325861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.326016 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.326240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.326403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.326608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.326761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.326886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.327000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.327161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.327290 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.327476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.327615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.327786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.327909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.328113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.328237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.328440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.328577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.328726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.328849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.329040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.329162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.329349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.329475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.329665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.329797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.330034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.330186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.330360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.330506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.330674 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.330819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.330988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.331134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.331320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.331458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.331632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.331774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.331977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.332118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.332266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.332400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.332571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.332708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.332881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.333024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.333305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.333438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.333622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.333746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.333964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.334111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.334281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.334413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.334591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.334723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.334897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.335030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.335213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.335336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.336165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.336331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.336451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.336598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.336788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.336917 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.337050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.337164 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.337380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.337521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.337723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.337906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.338027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.338140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.338344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.338562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.338695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.338820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.338982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.339106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.339313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.339515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.339738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.339874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.340088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.340220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.340383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.340513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.340711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.340842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.341046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.341170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.341359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.341491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.341670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.341801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.342010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.342134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.342323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.342444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.342637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.342842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.342963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.343089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.343268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.343401 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.343577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.343716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.343892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.344014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.344209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.344340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.344522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.344655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.344837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.344968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.345166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.345295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.345477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.345608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.345809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.345996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.346159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.346283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.346490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.346622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.346827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.346967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.347123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.347262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.347513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.347652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.347768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.347896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.348040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.348171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.348351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.348474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.348679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.348816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.348967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.349088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.349281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.349413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.349595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.349728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.349928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.350067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.350269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.350399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.350551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.350675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.350860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.350994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.351217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.351390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.351534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.351657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.351864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.352088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.352225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.352352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.352491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.352614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.352819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.352956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.353199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.353331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.353455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.353572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.353740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.353936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.354059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.354182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.354408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.354541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.354719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.354851 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.355033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.355169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.355345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.355467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.355679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.355810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.356101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.356235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.356360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.356495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.356623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.356739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.357011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.357161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.357287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.357422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.357539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.357763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.357935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.358064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.358210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.358342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.358553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.358701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.358895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.359022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.359176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.359310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.359488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.359620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.359806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.359929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.360116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.360905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.361048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.361166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.361281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.361403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.361541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.361659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.361774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.361952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.362083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.362205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.362335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.362460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.362582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.362705 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.362830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.362955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.363084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.363208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.363412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.363551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.363683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.363806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.363932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.364130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.364254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.364455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.364579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.364781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.364904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.365095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.365225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.365415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.365546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.365733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.365900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.366079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.366222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.366404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.366524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.366723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.366878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.367099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.367237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.367384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.367518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.367700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.367929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.368067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.368201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.368324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.368452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.368625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.368749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.368953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.369083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.369315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.369505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.369630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.369938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.370078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.370203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.370328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.370602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.370734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.370850 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.370972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.371088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.371254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.371639 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.371840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.371986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.372156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.372287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.372496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.372623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.372785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.372917 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.373107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.373244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.373451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.373599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.373728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.373880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.374076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.374214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.374400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.374524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.374729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.374851 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.375395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.375551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.375551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.375769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.375769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.375991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.376119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.376242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.376357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.376471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.376664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.376788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.376985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.377209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.377341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.377515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.377638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.377998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.378163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.378302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.378432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.378556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.378673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.378853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.379006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.379200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.379319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.379493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.379621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.379796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.379928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.380103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.380226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.380422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.380569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.380772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.380893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.381039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.381164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.381368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.381520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.382117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.382251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.382383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.383038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.383163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.383293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.383417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.383646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.383777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.383894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.384044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.384177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.384367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.384490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.384691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.384822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.385023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.385158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.385333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.385463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.385642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.385775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.385985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.386127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.386299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.386422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.386609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.386741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.386943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.387068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.387339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.387474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.387590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.387721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.387883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.388121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.388351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.388482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.388604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.388724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.388854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.389073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.389224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.389432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.389562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.389720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.389911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.390069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.390192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.390386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.390519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.390698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.391460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.391460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.391698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.391814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.392048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.392210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.392340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.392466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.392583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.392696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.392839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.392967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.393093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.393209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.393323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.393460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.393587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.393801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.393990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.393990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.394224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.394348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.394475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.394599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.394714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.394828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.394941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.395054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.395177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.395293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.395417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.395563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.395694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.395878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.396011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.396188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.396311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.397050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.397191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.397323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.397545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.397669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.397785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.397941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.398138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.398990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.399130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.399264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.399264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.399606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.399740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.399867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.399983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.400096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.400268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.400397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.400522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.400652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.400769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.400884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.400997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.401118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.401242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.401359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.401573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.401703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.401820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.402114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.402243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.402361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.402520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.402642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.402756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.402870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.403066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.403740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.403972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.404101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.404101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.404339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.404457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.404570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.404691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.404807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.404929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.405057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.405181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.405296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.405409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.405530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.405652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.405799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.406359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.406484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.406599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.406713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.406842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.406972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.407099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.407215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.407329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.407451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.407671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.407803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.407922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.408044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.408160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.408282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.408407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.408585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.408718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.409030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.409192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.409336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.409481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.409635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.409830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.409993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.410120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.410251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.410393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.410560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.410723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.410854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.411053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.411191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.411380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.411508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.411728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.411857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.412011 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.412143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.412332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.412456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.412647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.412778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.412963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.413095 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.413276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.413400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.413589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.413740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.413955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.414162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.414282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.414407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.414587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.414718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.414899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.415024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.415247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.415414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.415578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.415712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.415867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.415999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.416194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.416318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.416515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.416652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.416834 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.416964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.417147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.417316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.417467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.417605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.417816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.417978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.418116 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.418231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.418423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.418564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.418736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.418871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.419165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.419325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.419469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.419611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.419752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.419964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.420086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.420734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.420873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.420998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.421115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.421229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.421351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.421506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.421642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.421904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.422029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.422144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.422258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.422386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.422504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.422618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.422742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.422864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.422979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.423108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.423231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.423346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.585411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.585780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.585780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.586166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.586231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.586301 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.586301 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.586425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.586480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.586539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.586723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.586804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.586875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.586957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.587027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.587094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.587161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.587235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.587304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.587371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.587371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.587491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.587557 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.587700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.587771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.587839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.587904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.587970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.588044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.588113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.588180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.588245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.588311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.588374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.588431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.588485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.588545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.588610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.588689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.588777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.588847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.588913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.588979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.589045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.589119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.589188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.589254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.589320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.589386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.589452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.589525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.589594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.589661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.589726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.589792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.593104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.593350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.593433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.593493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.593549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.593605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.593738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.593874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.593983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.594079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.594156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.594274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.594400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.594477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.594546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.594613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.594681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.594749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.594826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.594896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.594964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.595032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.595108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.595178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.595246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.595314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.595389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.595459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.595459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.595622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.595735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.595819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.595879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.595991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.596065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.596132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.596245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.596365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=143129) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 21:02:02.596441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.596441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.596441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.596441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.596441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.596441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.596441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.596441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.597094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.597094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.597094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.597094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.597094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 28 21:02:02.597094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=143128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 28 21:02:02.597559 ncdv-master-1 devstack@n-api.service[143129]: INFO dbcounter [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] Registered counter for database nova_api May 28 21:02:02.597631 ncdv-master-1 devstack@n-api.service[143128]: INFO dbcounter [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] Registered counter for database nova_api May 28 21:02:02.597706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_db.sqlalchemy.engines [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=143129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 21:02:02.597826 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_db.sqlalchemy.engines [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=143128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 21:02:02.597963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writer thread running {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 21:02:02.598066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writer thread running {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 21:02:02.598159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.context [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc53a60a-e345-4363-abb1-87c4d33bcbf6(cell1) {{(pid=143129) load_cells /opt/stack/nova/nova/context.py:464}} May 28 21:02:02.598267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.context [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc53a60a-e345-4363-abb1-87c4d33bcbf6(cell1) {{(pid=143128) load_cells /opt/stack/nova/nova/context.py:464}} May 28 21:02:02.599853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:02.601516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:02.602310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:02.602555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:02.604401 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:02.604555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:02.605215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:02.606400 ncdv-master-1 devstack@n-api.service[143129]: INFO dbcounter [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] Registered counter for database nova_cell0 May 28 21:02:02.607801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:02.611162 ncdv-master-1 devstack@n-api.service[143128]: INFO dbcounter [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] Registered counter for database nova_cell0 May 28 21:02:02.611447 ncdv-master-1 devstack@n-api.service[143129]: INFO dbcounter [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] Registered counter for database nova_cell1 May 28 21:02:02.619932 ncdv-master-1 devstack@n-api.service[143128]: INFO dbcounter [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] Registered counter for database nova_cell1 May 28 21:02:02.620253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_db.sqlalchemy.engines [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=143129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 21:02:02.629628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_db.sqlalchemy.engines [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=143128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 21:02:02.634264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_db.sqlalchemy.engines [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=143128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 21:02:02.636936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_db.sqlalchemy.engines [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=143129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 21:02:02.642125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writer thread running {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 21:02:02.644268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writer thread running {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 21:02:02.652845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writer thread running {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 21:02:02.800845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writer thread running {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 21:02:02.802478 ncdv-master-1 devstack@n-api.service[143129]: INFO dbcounter [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] Registered counter for database nova_cell0 May 28 21:02:02.810244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_db.sqlalchemy.engines [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=143129) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 21:02:02.811269 ncdv-master-1 devstack@n-api.service[143128]: INFO dbcounter [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] Registered counter for database nova_cell0 May 28 21:02:02.815059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writer thread running {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 21:02:02.820115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_db.sqlalchemy.engines [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=143128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 28 21:02:02.824892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writer thread running {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 28 21:02:03.253439 ncdv-master-1 devstack@n-api.service[143129]: WARNING keystonemiddleware.auth_token [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 21:02:03.260795 ncdv-master-1 devstack@n-api.service[143129]: WARNING keystonemiddleware.auth_token [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 21:02:03.265821 ncdv-master-1 devstack@n-api.service[143128]: WARNING keystonemiddleware.auth_token [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 21:02:03.273711 ncdv-master-1 devstack@n-api.service[143128]: WARNING keystonemiddleware.auth_token [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 21:02:03.485876 ncdv-master-1 devstack@n-api.service[143129]: WARNING keystonemiddleware.auth_token [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 21:02:03.492102 ncdv-master-1 devstack@n-api.service[143129]: WARNING keystonemiddleware.auth_token [None req-44ae4e4e-cf81-4550-9baf-236df5fc6b29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 21:02:03.497818 ncdv-master-1 devstack@n-api.service[143129]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a311e889c0 pid: 143129 (default app) May 28 21:02:03.504451 ncdv-master-1 devstack@n-api.service[143128]: WARNING keystonemiddleware.auth_token [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 28 21:02:03.511113 ncdv-master-1 devstack@n-api.service[143128]: WARNING keystonemiddleware.auth_token [None req-c015cf9a-8b35-479f-bb9d-e39ce3ad1fb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 28 21:02:03.516411 ncdv-master-1 devstack@n-api.service[143128]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a311e889c0 pid: 143128 (default app) May 28 21:02:51.340504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:02:51.341325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:02:51.342143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:02:51.342882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:02:52.756603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:02:52.757399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:02:52.758306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:02:52.759165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:02:52.911660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0df7600a-3579-43e2-a330-4e22f4aa8f3b tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:52.914563 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:52.914563 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:52.915842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0df7600a-3579-43e2-a330-4e22f4aa8f3b tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:52.916294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0df7600a-3579-43e2-a330-4e22f4aa8f3b tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:52.917089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0df7600a-3579-43e2-a330-4e22f4aa8f3b tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:52.917694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0df7600a-3579-43e2-a330-4e22f4aa8f3b tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:52.962298 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0df7600a-3579-43e2-a330-4e22f4aa8f3b tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.628021 May 28 21:02:52.962891 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1/1] 10.222.0.33 () {58 vars in 1175 bytes} [Sat May 28 21:02:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:02:53.340339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0c7e1860-e894-404a-98ba-7ea42c1096b6 tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-961153515", "id": 1214290951, "os-flavor-access:is_public": "False"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:53.358787 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:53.358787 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:53.452338 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0c7e1860-e894-404a-98ba-7ea42c1096b6 tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.481121 May 28 21:02:53.452937 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2/2] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:02:52 2022] POST /compute/v2.1/flavors => generated 430 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:02:53.457356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cb94c847-235c-41e7-96b1-ef7669f0bdcd tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-262000441"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:53.458692 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:53.458692 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:53.459590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.aggregate [None req-cb94c847-235c-41e7-96b1-ef7669f0bdcd tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Generated uuid 45e9bf21-ba14-4e14-954a-abe9a508043d for aggregate {{(pid=143129) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:02:53.593707 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cb94c847-235c-41e7-96b1-ef7669f0bdcd tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.135388 May 28 21:02:53.594908 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3/3] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:02:53 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:02:53.709116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1da4adf0-e89f-4165-a304-d3196a1deca3 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Calling method '.version_select at 0x7f4d66c44940>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:53.712835 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:53.712835 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:53.715442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-87fb448a-8919-4a07-ba49-f6b527f2a6ca tempest-AZAdminNegativeTestJSON-766081635 tempest-AZAdminNegativeTestJSON-766081635-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:53.716223 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:53.716223 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:53.717292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-87fb448a-8919-4a07-ba49-f6b527f2a6ca tempest-AZAdminNegativeTestJSON-766081635 tempest-AZAdminNegativeTestJSON-766081635-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'f35355f9f95643ecb2ffc62e648f431a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec9619348174863907663b9b935773b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:02:53.718389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1da4adf0-e89f-4165-a304-d3196a1deca3 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc53a60a-e345-4363-abb1-87c4d33bcbf6(cell1) {{(pid=143128) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 28 21:02:53.719344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1da4adf0-e89f-4165-a304-d3196a1deca3 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:53.719896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1da4adf0-e89f-4165-a304-d3196a1deca3 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-87fb448a-8919-4a07-ba49-f6b527f2a6ca tempest-AZAdminNegativeTestJSON-766081635 tempest-AZAdminNegativeTestJSON-766081635-project] Request method failure captured: May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko36OIA4PnZZQY3VgJ2VGcCt8JcYn1XGQ-W1vlcAN_alGm40CR0mq4266jmiRI_vzhteetIFghpCYVM9kjU72N_k091yQ7EGlFtuguIcXn9iVBKd_vM9Q3B45IcEnMoOJGQGQDrGPES7arhh4Q8v-tZWlbM6vIKwAuQEL7Fb5lBgaMA May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 9ec9619348174863907663b9b935773b May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AZAdminNegativeTestJSON-766081635 May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:02:53.720301 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:02:53.721569 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9ec9619348174863907663b9b935773b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9ec9619348174863907663b9b935773b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9ec9619348174863907663b9b935773b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9ec9619348174863907663b9b935773b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:02:53.721569 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AZAdminNegativeTestJSON-766081635 May 28 21:02:53.721569 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 9ec9619348174863907663b9b935773b May 28 21:02:53.721569 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-766081635 May 28 21:02:53.721569 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AZAdminNegativeTestJSON-766081635-project May 28 21:02:53.721569 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:02:53.721569 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:02:53.721569 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f35355f9f95643ecb2ffc62e648f431a May 28 21:02:53.721569 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AZAdminNegativeTestJSON-766081635-project May 28 21:02:53.721569 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:02:53.721569 ncdv-master-1 devstack@n-api.service[143129]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 28 21:02:53.721569 ncdv-master-1 devstack@n-api.service[143129]: action_args: {} May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:02:53.722341 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:02:53.723829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-87fb448a-8919-4a07-ba49-f6b527f2a6ca tempest-AZAdminNegativeTestJSON-766081635 tempest-AZAdminNegativeTestJSON-766081635-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:02:53.726379 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-87fb448a-8919-4a07-ba49-f6b527f2a6ca tempest-AZAdminNegativeTestJSON-766081635 tempest-AZAdminNegativeTestJSON-766081635-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.125619 May 28 21:02:53.727695 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 4/4] 10.222.0.33 () {58 vars in 1184 bytes} [Sat May 28 21:02:53 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 132 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:02:53.754023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1da4adf0-e89f-4165-a304-d3196a1deca3 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:53.754569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1da4adf0-e89f-4165-a304-d3196a1deca3 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:53.771796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1da4adf0-e89f-4165-a304-d3196a1deca3 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:53.773063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1da4adf0-e89f-4165-a304-d3196a1deca3 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:53.779553 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1da4adf0-e89f-4165-a304-d3196a1deca3 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 1.033331 May 28 21:02:53.780666 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1/5] 10.222.0.33 () {60 vars in 1207 bytes} [Sat May 28 21:02:52 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:02:53.974533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e2dc39ef-fa9f-485b-85e0-c92372914721 tempest-FlavorsV261TestJSON-610813830 tempest-FlavorsV261TestJSON-610813830-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-665189819", "id": 46728779, "os-flavor-access:is_public": "True"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:53.977633 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:53.977633 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:54.037071 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e2dc39ef-fa9f-485b-85e0-c92372914721 tempest-FlavorsV261TestJSON-610813830 tempest-FlavorsV261TestJSON-610813830-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 461 microversion: 2.61 time: 0.307243 May 28 21:02:54.037638 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 5/6] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:02:53 2022] POST /compute/v2.1/flavors => generated 461 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:02:54.068721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ecd9ca2c-b228-4de5-8248-3f136dbff31d tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '.version_select at 0x7f4d66c85dc0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:54.069535 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:54.069535 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:54.070842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecd9ca2c-b228-4de5-8248-3f136dbff31d tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:54.071461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecd9ca2c-b228-4de5-8248-3f136dbff31d tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:54.089692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecd9ca2c-b228-4de5-8248-3f136dbff31d tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:54.090198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecd9ca2c-b228-4de5-8248-3f136dbff31d tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:54.101140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecd9ca2c-b228-4de5-8248-3f136dbff31d tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:54.101772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecd9ca2c-b228-4de5-8248-3f136dbff31d tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:54.107838 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ecd9ca2c-b228-4de5-8248-3f136dbff31d tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.325836 May 28 21:02:54.108571 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2/7] 10.222.0.33 () {58 vars in 1166 bytes} [Sat May 28 21:02:53 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:02:54.113273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e2c82b5d-7996-4c46-b2aa-1989b31dd4ab tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "d257d738741646539f55b9dab71b33bf"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:54.114747 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:54.114747 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:54.259219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f2d71163-1b18-45d8-89f8-e015e7319b91 tempest-AZAdminV2TestJSON-17128743 tempest-AZAdminV2TestJSON-17128743-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:54.261220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2d71163-1b18-45d8-89f8-e015e7319b91 tempest-AZAdminV2TestJSON-17128743 tempest-AZAdminV2TestJSON-17128743-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:54.261748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2d71163-1b18-45d8-89f8-e015e7319b91 tempest-AZAdminV2TestJSON-17128743 tempest-AZAdminV2TestJSON-17128743-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:54.262488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2d71163-1b18-45d8-89f8-e015e7319b91 tempest-AZAdminV2TestJSON-17128743 tempest-AZAdminV2TestJSON-17128743-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:54.263243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2d71163-1b18-45d8-89f8-e015e7319b91 tempest-AZAdminV2TestJSON-17128743 tempest-AZAdminV2TestJSON-17128743-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:54.302530 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f2d71163-1b18-45d8-89f8-e015e7319b91 tempest-AZAdminV2TestJSON-17128743 tempest-AZAdminV2TestJSON-17128743-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.263238 May 28 21:02:54.303115 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 6/8] 10.222.0.33 () {58 vars in 1163 bytes} [Sat May 28 21:02:54 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:02:54.309516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d03cc265-93c4-4bc1-91e3-18ae70ac3345 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:54.309516 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:54.309516 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:54.324241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d03cc265-93c4-4bc1-91e3-18ae70ac3345 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:54.324795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d03cc265-93c4-4bc1-91e3-18ae70ac3345 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:54.495084 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e2c82b5d-7996-4c46-b2aa-1989b31dd4ab tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1214290951/action" status: 200 len: 97 microversion: 2.1 time: 0.385298 May 28 21:02:54.496082 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3/9] 10.222.0.33 () {60 vars in 1199 bytes} [Sat May 28 21:02:54 2022] POST /compute/v2.1/flavors/1214290951/action => generated 97 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:02:54.633559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1ad44f96-52ad-4837-a4c8-373b42639557 tempest-FlavorsV261TestJSON-2010965055 tempest-FlavorsV261TestJSON-2010965055-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:54.668915 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1ad44f96-52ad-4837-a4c8-373b42639557 tempest-FlavorsV261TestJSON-2010965055 tempest-FlavorsV261TestJSON-2010965055-project] 10.222.0.33 "GET /compute/v2.1/flavors/46728779" status: 200 len: 461 microversion: 2.61 time: 0.171794 May 28 21:02:54.669771 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 4/10] 10.222.0.33 () {60 vars in 1192 bytes} [Sat May 28 21:02:54 2022] GET /compute/v2.1/flavors/46728779 => generated 461 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:02:54.675206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-62972768-b778-4d2c-b28c-d2e4eaf64eae tempest-AZAdminV2TestJSON-17128743 tempest-AZAdminV2TestJSON-17128743-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:54.676369 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:54.676369 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:54.677954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62972768-b778-4d2c-b28c-d2e4eaf64eae tempest-AZAdminV2TestJSON-17128743 tempest-AZAdminV2TestJSON-17128743-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:54.679050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62972768-b778-4d2c-b28c-d2e4eaf64eae tempest-AZAdminV2TestJSON-17128743 tempest-AZAdminV2TestJSON-17128743-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:54.679992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62972768-b778-4d2c-b28c-d2e4eaf64eae tempest-AZAdminV2TestJSON-17128743 tempest-AZAdminV2TestJSON-17128743-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:54.680570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62972768-b778-4d2c-b28c-d2e4eaf64eae tempest-AZAdminV2TestJSON-17128743 tempest-AZAdminV2TestJSON-17128743-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:54.721370 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-62972768-b778-4d2c-b28c-d2e4eaf64eae tempest-AZAdminV2TestJSON-17128743 tempest-AZAdminV2TestJSON-17128743-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.050397 May 28 21:02:54.729904 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 5/11] 10.222.0.33 () {58 vars in 1184 bytes} [Sat May 28 21:02:54 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:02:54.863393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-54c323e7-bbae-4bfa-b5db-6ef238aacfae tempest-FlavorsAccessTestJSON-926232869 tempest-FlavorsAccessTestJSON-926232869-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:54.894287 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-54c323e7-bbae-4bfa-b5db-6ef238aacfae tempest-FlavorsAccessTestJSON-926232869 tempest-FlavorsAccessTestJSON-926232869-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5822 microversion: 2.1 time: 0.170673 May 28 21:02:54.904954 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:02:54 2022] GET /compute/v2.1/flavors/detail => generated 5822 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:02:54.912538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f33da0d6-d15a-4b4d-a44a-980639cd31d7 tempest-FlavorsV261TestJSON-610813830 tempest-FlavorsV261TestJSON-610813830-project-admin] Action: 'update', calling method: .version_select at 0x7f4d66fc2af0>, body: {"flavor": {"description": "new"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:54.914512 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d03cc265-93c4-4bc1-91e3-18ae70ac3345 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 0.610087 May 28 21:02:54.920667 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 7/13] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 21:02:54 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:02:54.925759 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:54.925759 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:54.926855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-11ee5fb5-b0d6-4095-a9fe-ad19f8d99619 tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "d257d738741646539f55b9dab71b33bf"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:54.928545 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:54.928545 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:55.059970 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f33da0d6-d15a-4b4d-a44a-980639cd31d7 tempest-FlavorsV261TestJSON-610813830 tempest-FlavorsV261TestJSON-610813830-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/46728779" status: 200 len: 462 microversion: 2.61 time: 0.163605 May 28 21:02:55.060527 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 7/14] 10.222.0.33 () {62 vars in 1212 bytes} [Sat May 28 21:02:54 2022] PUT /compute/v2.1/flavors/46728779 => generated 462 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:02:55.067124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d711d6bb-ed18-4231-b6be-00338c82bc5a tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:55.067124 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:55.067124 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:55.098389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d711d6bb-ed18-4231-b6be-00338c82bc5a tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:55.098844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d711d6bb-ed18-4231-b6be-00338c82bc5a tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:55.179360 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-d711d6bb-ed18-4231-b6be-00338c82bc5a tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] HTTP exception thrown: Aggregate 1 already has host nch1-master-1. May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d711d6bb-ed18-4231-b6be-00338c82bc5a tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Request method failure captured: May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 39 May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko370rLdfXX4RvwKIIWwK-2mPGBCkpX0PzL-OxzORwnUdnHaFT41nxek8xgx2O8JdRJse_n5803IES7o4r9sVN0MpSfgwrSxYiyf3hdkC-ftGvC_oIP0nL27MCioSlDipifKv3tIx0h5o-kJLhdOqqgXgNPHmQHomd8e3HzFGpiSxgA May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:02:55.209290 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:02:55.211529 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0eeea9efb9364971b8335deff54816d3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:02:55.211529 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:55.211529 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:02:55.211529 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:55.211529 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:02:55.211529 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:02:55.211529 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:02:55.211529 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 2fb485e80a0c42e6bae2142de7c23338 May 28 21:02:55.211529 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:02:55.211529 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:02:55.211529 ncdv-master-1 devstack@n-api.service[143128]: {"add_host": {"host": "nch1-master-1"}} May 28 21:02:55.211529 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:02:55.211529 ncdv-master-1 devstack@n-api.service[143128]: exception: Aggregate 1 already has host nch1-master-1. May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '1', 'body': {'add_host': {'host': 'nch1-master-1'}}} May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = self._query(query) May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi conn.query(q) May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result.read() May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 28 21:02:55.212333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch1-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi session.flush() May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._flush(objects) May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 28 21:02:55.213422 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi compat.raise_( May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi flush_context.execute() May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi rec.execute(self) May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 28 21:02:55.214532 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = self._query(query) May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi conn.query(q) May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 28 21:02:55.215514 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result.read() May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch1-master-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 28, 21, 2, 55, 134890), 'updated_at': None, 'host': 'nch1-master-1', 'aggregate_id': 1}] May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:55.216561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host nch1-master-1. May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:55.217564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host nch1-master-1. May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:02:55.219534 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:02:55.223846 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host nch1-master-1. May 28 21:02:55.223846 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:55.223846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d711d6bb-ed18-4231-b6be-00338c82bc5a tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Returning 409 to user: Aggregate 1 already has host nch1-master-1. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:02:55.223846 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d711d6bb-ed18-4231-b6be-00338c82bc5a tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.152183 May 28 21:02:55.223846 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 8/15] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 21:02:55 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) May 28 21:02:55.227571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e3d626da-36e0-44db-a24d-fa97e11f7115 tempest-FlavorsV261TestJSON-2010965055 tempest-FlavorsV261TestJSON-2010965055-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:55.258009 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e3d626da-36e0-44db-a24d-fa97e11f7115 tempest-FlavorsV261TestJSON-2010965055 tempest-FlavorsV261TestJSON-2010965055-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6243 microversion: 2.61 time: 0.037102 May 28 21:02:55.258578 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 9/16] 10.222.0.33 () {60 vars in 1186 bytes} [Sat May 28 21:02:55 2022] GET /compute/v2.1/flavors/detail => generated 6243 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:02:55.276432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-37add99d-c33b-4029-bf2d-8db3bd3eb5a1 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:55.278824 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:55.278824 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:55.291751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37add99d-c33b-4029-bf2d-8db3bd3eb5a1 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:55.292210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37add99d-c33b-4029-bf2d-8db3bd3eb5a1 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:55.583746 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-11ee5fb5-b0d6-4095-a9fe-ad19f8d99619 tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/1214290951/action" status: 200 len: 21 microversion: 2.1 time: 0.661776 May 28 21:02:55.588765 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 8/17] 10.222.0.33 () {60 vars in 1199 bytes} [Sat May 28 21:02:54 2022] POST /compute/v2.1/flavors/1214290951/action => generated 21 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:02:55.589381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2077041c-7700-46ad-bb58-4b0f71df7131 tempest-FlavorsV261TestJSON-2010965055 tempest-FlavorsV261TestJSON-2010965055-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:55.625550 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2077041c-7700-46ad-bb58-4b0f71df7131 tempest-FlavorsV261TestJSON-2010965055 tempest-FlavorsV261TestJSON-2010965055-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3150 microversion: 2.61 time: 0.039698 May 28 21:02:55.626668 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 9/18] 10.222.0.33 () {60 vars in 1165 bytes} [Sat May 28 21:02:55 2022] GET /compute/v2.1/flavors => generated 3150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:02:55.641447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-675370f7-3688-4694-a884-c9c6b36aed2c tempest-FlavorsAccessTestJSON-926232869 tempest-FlavorsAccessTestJSON-926232869-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:55.664921 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-675370f7-3688-4694-a884-c9c6b36aed2c tempest-FlavorsAccessTestJSON-926232869 tempest-FlavorsAccessTestJSON-926232869-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.036790 May 28 21:02:55.665626 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 10/19] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:02:55 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:02:55.670595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c44bdc46-1007-41b1-8c7c-d63a5e501798 tempest-FlavorsV261TestJSON-610813830 tempest-FlavorsV261TestJSON-610813830-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:55.671512 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:55.671512 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:55.797687 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c44bdc46-1007-41b1-8c7c-d63a5e501798 tempest-FlavorsV261TestJSON-610813830 tempest-FlavorsV261TestJSON-610813830-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/46728779" status: 202 len: 0 microversion: 2.61 time: 0.129325 May 28 21:02:55.798610 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1195 bytes} [Sat May 28 21:02:55 2022] DELETE /compute/v2.1/flavors/46728779 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 21:02:55.807758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-05c3a2a0-20ca-45a7-872d-59bd596c2aa7 tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:55.941235 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-05c3a2a0-20ca-45a7-872d-59bd596c2aa7 tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1214290951" status: 202 len: 0 microversion: 2.1 time: 0.139886 May 28 21:02:55.942309 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 12/21] 10.222.0.33 () {58 vars in 1160 bytes} [Sat May 28 21:02:55 2022] DELETE /compute/v2.1/flavors/1214290951 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:02:55.948858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6cba57cc-a768-4827-9263-977c089249e6 tempest-FlavorsV261TestJSON-610813830 tempest-FlavorsV261TestJSON-610813830-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:55.979987 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6cba57cc-a768-4827-9263-977c089249e6 tempest-FlavorsV261TestJSON-610813830 tempest-FlavorsV261TestJSON-610813830-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.035614 May 28 21:02:55.980646 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 13/22] 10.222.0.33 () {60 vars in 1186 bytes} [Sat May 28 21:02:55 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:02:55.986154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-33ce7410-84ad-43d3-bd1e-aac9a3481c02 tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:56.007741 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-33ce7410-84ad-43d3-bd1e-aac9a3481c02 tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025479 May 28 21:02:56.009010 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 14/23] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:02:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:02:56.026719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-393fe7c2-820d-4624-a167-7bf8b48d1663 tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-730389069", "id": 1738881220, "os-flavor-access:is_public": "False"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:56.029055 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:56.029055 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:56.106487 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-37add99d-c33b-4029-bf2d-8db3bd3eb5a1 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.835361 May 28 21:02:56.108152 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 10/24] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 21:02:55 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:02:56.119362 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-393fe7c2-820d-4624-a167-7bf8b48d1663 tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.098993 May 28 21:02:56.120529 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 15/25] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:02:56 2022] POST /compute/v2.1/flavors => generated 430 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:02:56.132508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7bc47093-1167-44d1-ba57-c0ef52b6011f tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:56.133285 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:56.133285 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:56.133699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bc2978ef-a684-4c22-b52e-66e22aa0bca0 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:56.134856 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:56.134856 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:56.153766 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7bc47093-1167-44d1-ba57-c0ef52b6011f tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1738881220/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.025412 May 28 21:02:56.159698 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 16/26] 10.222.0.33 () {58 vars in 1208 bytes} [Sat May 28 21:02:56 2022] GET /compute/v2.1/flavors/1738881220/os-flavor-access => generated 21 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 21:02:56.166106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f1c679c2-f90d-4d5a-8643-f5c386e3feed tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:56.274780 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bc2978ef-a684-4c22-b52e-66e22aa0bca0 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.152549 May 28 21:02:56.275749 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 11/27] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:02:56 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:02:56.285223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6ea39c55-f68f-4ec9-b766-757a51bb7b67 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1353384320"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:56.298604 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f1c679c2-f90d-4d5a-8643-f5c386e3feed tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1738881220" status: 202 len: 0 microversion: 2.1 time: 0.137134 May 28 21:02:56.302526 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 17/28] 10.222.0.33 () {58 vars in 1160 bytes} [Sat May 28 21:02:56 2022] DELETE /compute/v2.1/flavors/1738881220 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:02:56.303237 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:56.303237 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:56.304279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.aggregate [None req-6ea39c55-f68f-4ec9-b766-757a51bb7b67 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Generated uuid 8b8168b6-da4e-45cb-b374-498981ecdfb9 for aggregate {{(pid=143128) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:02:56.313639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0be2dc3e-4845-47f1-894a-07056583ae83 tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:56.335634 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0be2dc3e-4845-47f1-894a-07056583ae83 tempest-FlavorsAccessTestJSON-525584540 tempest-FlavorsAccessTestJSON-525584540-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025044 May 28 21:02:56.347234 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 18/29] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:02:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:02:56.358756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-656f4c3f-84c3-4340-b4b5-ea40b845c73e tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2051670966"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:56.360336 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:56.360336 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:56.361531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.aggregate [None req-656f4c3f-84c3-4340-b4b5-ea40b845c73e tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Generated uuid e1d5964d-fa0a-4815-9098-e0056c1fbd1f for aggregate {{(pid=143129) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:02:56.420753 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6ea39c55-f68f-4ec9-b766-757a51bb7b67 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.139372 May 28 21:02:56.422026 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 12/30] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:02:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:02:56.462408 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-656f4c3f-84c3-4340-b4b5-ea40b845c73e tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.104461 May 28 21:02:56.462997 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 19/31] 10.222.0.33 () {62 vars in 1204 bytes} [Sat May 28 21:02:56 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:02:56.473375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4ca66551-3624-451b-8cc1-e92babf1e660 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1195208365"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:56.547626 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:56.547626 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:56.656692 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4ca66551-3624-451b-8cc1-e92babf1e660 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.186994 May 28 21:02:56.665387 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 20/32] 10.222.0.33 () {62 vars in 1209 bytes} [Sat May 28 21:02:56 2022] PUT /compute/v2.1/os-aggregates/3 => generated 299 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:02:56.670131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1b4ac12f-376c-46a2-be77-0fa19c49b0c3 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:56.670896 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:56.670896 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:56.677919 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1b4ac12f-376c-46a2-be77-0fa19c49b0c3 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.011366 May 28 21:02:56.684638 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 21/33] 10.222.0.33 () {60 vars in 1189 bytes} [Sat May 28 21:02:56 2022] GET /compute/v2.1/os-aggregates/3 => generated 299 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:02:56.690436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-02a86457-41a8-41c9-a57a-ca2cbfc0961e tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:56.695023 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:56.695023 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:56.703265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02a86457-41a8-41c9-a57a-ca2cbfc0961e tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:56.703875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02a86457-41a8-41c9-a57a-ca2cbfc0961e tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:56.836022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3b698f60-51ae-4935-8ccf-9241417f08c4 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:56.838603 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:56.838603 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:56.842638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3b698f60-51ae-4935-8ccf-9241417f08c4 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'd870c609a91f4540bfbd7471106fc398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133f6301e034a2faf8215358bf3e691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3b698f60-51ae-4935-8ccf-9241417f08c4 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Request method failure captured: May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 39 May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko33KPbLJXwfUJ8ak84X8jCQi_SjGobHAM92z-MjqFNnnQ6BkLTZPfDyd23ra5bMIIAwK5pJCFmLSmqnUEdaoOVPrxpf0yK-gXQlZY-RjNbWVfBnkuDf2q7wdSxB-eQlmECQoCgYaKp1fSrw5cbrAO6Kh2OGf7JPKCAJb5vv16CgCpc May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 7133f6301e034a2faf8215358bf3e691 May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:02:56.848694 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:02:56.849867 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7133f6301e034a2faf8215358bf3e691", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:02:56.849867 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:02:56.849867 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 7133f6301e034a2faf8215358bf3e691 May 28 21:02:56.849867 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:02:56.849867 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminNegativeTestJSON-265216604-project May 28 21:02:56.849867 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:02:56.849867 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:02:56.849867 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: d870c609a91f4540bfbd7471106fc398 May 28 21:02:56.849867 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-265216604-project May 28 21:02:56.849867 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:02:56.849867 ncdv-master-1 devstack@n-api.service[143128]: {"add_host": {"host": "nch1-master-1"}} May 28 21:02:56.849867 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:02:56.849867 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '2', 'body': {'add_host': {'host': 'nch1-master-1'}}} May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:02:56.851204 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. May 28 21:02:56.852094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:56.857811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3b698f60-51ae-4935-8ccf-9241417f08c4 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:02:56.857811 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3b698f60-51ae-4935-8ccf-9241417f08c4 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.422839 May 28 21:02:56.857811 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 13/34] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 21:02:56 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 424 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 28 21:02:56.864126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aec24b16-0a12-4a99-9169-418f7634071e tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:56.864922 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:56.864922 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:56.961892 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aec24b16-0a12-4a99-9169-418f7634071e tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.103821 May 28 21:02:56.963993 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 14/35] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:02:56 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:02:56.974637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-67f5de8b-c583-4755-aa0d-109eba474b65 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2105721351"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:56.979812 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:56.979812 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:56.980951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.aggregate [None req-67f5de8b-c583-4755-aa0d-109eba474b65 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Generated uuid 828b8821-1d0e-40a0-ba85-4ba14daa5b37 for aggregate {{(pid=143128) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:02:57.030670 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-02a86457-41a8-41c9-a57a-ca2cbfc0961e tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.41 time: 0.343616 May 28 21:02:57.032308 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 22/36] 10.222.0.33 () {62 vars in 1231 bytes} [Sat May 28 21:02:56 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:02:57.043149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e57c49a6-7906-4cc6-a46c-23c3647cd700 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:57.046492 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:57.046492 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:57.065351 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-67f5de8b-c583-4755-aa0d-109eba474b65 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.096409 May 28 21:02:57.066128 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 15/37] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:02:56 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:02:57.080807 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e57c49a6-7906-4cc6-a46c-23c3647cd700 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:57.081471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e57c49a6-7906-4cc6-a46c-23c3647cd700 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:57.082850 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b4f07ab1-d508-4690-8781-59ef56726506 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1328977445"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:57.087676 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:57.087676 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:57.097955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b4f07ab1-d508-4690-8781-59ef56726506 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:57.098846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b4f07ab1-d508-4690-8781-59ef56726506 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:57.129908 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b4f07ab1-d508-4690-8781-59ef56726506 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:57.132277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b4f07ab1-d508-4690-8781-59ef56726506 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:57.154982 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-b4f07ab1-d508-4690-8781-59ef56726506 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1328977445 could not be found. May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b4f07ab1-d508-4690-8781-59ef56726506 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Request method failure captured: May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 58 May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko370rLdfXX4RvwKIIWwK-2mPGBCkpX0PzL-OxzORwnUdnHaFT41nxek8xgx2O8JdRJse_n5803IES7o4r9sVN0MpSfgwrSxYiyf3hdkC-ftGvC_oIP0nL27MCioSlDipifKv3tIx0h5o-kJLhdOqqgXgNPHmQHomd8e3HzFGpiSxgA May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:02:57.157759 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:02:57.159124 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0eeea9efb9364971b8335deff54816d3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:02:57.159124 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:57.159124 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:02:57.159124 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:57.159124 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:02:57.159124 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:02:57.159124 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:02:57.159124 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 2fb485e80a0c42e6bae2142de7c23338 May 28 21:02:57.159124 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:02:57.159124 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:02:57.159124 ncdv-master-1 devstack@n-api.service[143128]: {"add_host": {"host": "tempest-nonexist_host-1328977445"}} May 28 21:02:57.159124 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:02:57.159124 ncdv-master-1 devstack@n-api.service[143128]: exception: Compute host tempest-nonexist_host-1328977445 could not be found. May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1328977445'}}} May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1328977445' is not mapped to any cell May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.159899 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate May 28 21:02:57.161032 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1328977445 could not be found. May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1328977445 could not be found. May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:57.162717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.165439 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.165439 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:57.165439 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:57.165439 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:02:57.165439 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:02:57.165439 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1328977445 could not be found. May 28 21:02:57.165439 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.165439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b4f07ab1-d508-4690-8781-59ef56726506 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1328977445 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:02:57.165439 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b4f07ab1-d508-4690-8781-59ef56726506 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.080740 May 28 21:02:57.167967 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 16/38] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 21:02:57 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:02:57.172878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fbcb206b-42f8-418e-a305-153b5b028cb9 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:57.173649 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:57.173649 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:57.270564 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fbcb206b-42f8-418e-a305-153b5b028cb9 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.100827 May 28 21:02:57.277001 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 17/39] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:02:57 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:02:57.282048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8a166d1c-2251-4186-b840-c30c2df15328 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:57.291373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=11,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8a166d1c-2251-4186-b840-c30c2df15328 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Request method failure captured: May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 283 May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko370rLdfXX4RvwKIIWwK-2mPGBCkpX0PzL-OxzORwnUdnHaFT41nxek8xgx2O8JdRJse_n5803IES7o4r9sVN0MpSfgwrSxYiyf3hdkC-ftGvC_oIP0nL27MCioSlDipifKv3tIx0h5o-kJLhdOqqgXgNPHmQHomd8e3HzFGpiSxgA May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:02:57.305685 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:02:57.307082 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0eeea9efb9364971b8335deff54816d3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:02:57.307082 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:57.307082 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:02:57.307082 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:57.307082 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:02:57.307082 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:02:57.307082 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:02:57.307082 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 2fb485e80a0c42e6bae2142de7c23338 May 28 21:02:57.307082 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:02:57.307082 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:02:57.307082 ncdv-master-1 devstack@n-api.service[143128]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 28 21:02:57.307778 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:02:57.307778 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:02:57.307778 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 28 21:02:57.307778 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:02:57.307778 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.307778 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:02:57.307778 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:02:57.307778 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:02:57.307778 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise error May 28 21:02:57.307778 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:02:57.307778 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:02:57.308450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:02:57.309537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:02:57.309537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:02:57.309537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:02:57.309537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:02:57.309537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:02:57.309537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.309537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:57.309537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.309537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.309537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:57.309537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:57.309537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:02:57.309537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:02:57.311306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:02:57.311306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.312895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8a166d1c-2251-4186-b840-c30c2df15328 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:02:57.314420 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8a166d1c-2251-4186-b840-c30c2df15328 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.035910 May 28 21:02:57.315152 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 18/40] 10.222.0.33 () {60 vars in 1164 bytes} [Sat May 28 21:02:57 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:02:57.326100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5869913d-82ae-44e4-b429-e1ddb9490f76 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5869913d-82ae-44e4-b429-e1ddb9490f76 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Request method failure captured: May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 27 May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko370rLdfXX4RvwKIIWwK-2mPGBCkpX0PzL-OxzORwnUdnHaFT41nxek8xgx2O8JdRJse_n5803IES7o4r9sVN0MpSfgwrSxYiyf3hdkC-ftGvC_oIP0nL27MCioSlDipifKv3tIx0h5o-kJLhdOqqgXgNPHmQHomd8e3HzFGpiSxgA May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:02:57.329365 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:02:57.339377 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0eeea9efb9364971b8335deff54816d3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:02:57.339377 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:57.339377 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:02:57.339377 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:57.339377 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:02:57.339377 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:02:57.339377 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:02:57.339377 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 2fb485e80a0c42e6bae2142de7c23338 May 28 21:02:57.339377 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:02:57.339377 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:02:57.339377 ncdv-master-1 devstack@n-api.service[143128]: {"aggregate": {"name": ""}} May 28 21:02:57.339377 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:02:57.339377 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid input for field/attribute name. Value: . '' is too short May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'aggregate': {'name': ''}}} May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise error May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi On instance['aggregate']: May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi '' May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:02:57.340240 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 28 21:02:57.341295 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.342479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5869913d-82ae-44e4-b429-e1ddb9490f76 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:02:57.342479 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5869913d-82ae-44e4-b429-e1ddb9490f76 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.010389 May 28 21:02:57.342479 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 19/41] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:02:57 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 21:02:57.358246 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e57c49a6-7906-4cc6-a46c-23c3647cd700 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.41 time: 0.318594 May 28 21:02:57.358786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-956bd771-5a6b-4ad3-a6a1-874a5451ad44 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1600375576"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:57.360268 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 23/42] 10.222.0.33 () {62 vars in 1231 bytes} [Sat May 28 21:02:57 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:02:57.361077 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:57.361077 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:57.362690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-956bd771-5a6b-4ad3-a6a1-874a5451ad44 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'd870c609a91f4540bfbd7471106fc398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133f6301e034a2faf8215358bf3e691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-956bd771-5a6b-4ad3-a6a1-874a5451ad44 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Request method failure captured: May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 60 May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko33KPbLJXwfUJ8ak84X8jCQi_SjGobHAM92z-MjqFNnnQ6BkLTZPfDyd23ra5bMIIAwK5pJCFmLSmqnUEdaoOVPrxpf0yK-gXQlZY-RjNbWVfBnkuDf2q7wdSxB-eQlmECQoCgYaKp1fSrw5cbrAO6Kh2OGf7JPKCAJb5vv16CgCpc May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 7133f6301e034a2faf8215358bf3e691 May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:02:57.365573 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:02:57.366900 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7133f6301e034a2faf8215358bf3e691", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:02:57.366900 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:02:57.366900 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 7133f6301e034a2faf8215358bf3e691 May 28 21:02:57.366900 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:02:57.366900 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminNegativeTestJSON-265216604-project May 28 21:02:57.366900 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:02:57.366900 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:02:57.366900 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: d870c609a91f4540bfbd7471106fc398 May 28 21:02:57.366900 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-265216604-project May 28 21:02:57.366900 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:02:57.366900 ncdv-master-1 devstack@n-api.service[143128]: {"aggregate": {"name": "tempest-test_aggregate-1600375576"}} May 28 21:02:57.366900 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:02:57.366900 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1600375576'}}} May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:02:57.367661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:02:57.368800 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. May 28 21:02:57.369953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.371990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-285741a1-15cb-4524-8f52-116a35d06859 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:57.372515 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:57.372515 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:57.373071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-956bd771-5a6b-4ad3-a6a1-874a5451ad44 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:02:57.375559 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-956bd771-5a6b-4ad3-a6a1-874a5451ad44 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.023121 May 28 21:02:57.382461 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 20/43] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:02:57 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:02:57.389597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4291c6ba-5419-4b6e-945e-b15aa0cc84c0 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-302599031"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:57.391999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.aggregate [None req-4291c6ba-5419-4b6e-945e-b15aa0cc84c0 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Generated uuid 098f64d0-9e27-47da-b81c-fd036a260d44 for aggregate {{(pid=143128) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:02:57.435470 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-285741a1-15cb-4524-8f52-116a35d06859 tempest-AggregatesAdminTestV241-89973644 tempest-AggregatesAdminTestV241-89973644-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.067952 May 28 21:02:57.441344 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 24/44] 10.222.0.33 () {60 vars in 1192 bytes} [Sat May 28 21:02:57 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:02:57.486498 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4291c6ba-5419-4b6e-945e-b15aa0cc84c0 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.101507 May 28 21:02:57.487322 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 21/45] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:02:57 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:02:57.496564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1d041d83-6288-4087-ab00-c87621e4c433 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1415322150", "name": "tempest-test_aggregate-2142897475"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:57.500116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c9698873-5754-4cfb-8a94-83c76e9a5ea8 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-302599031"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:57.508230 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:57.508230 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:57.512763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.aggregate [None req-c9698873-5754-4cfb-8a94-83c76e9a5ea8 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Generated uuid c210e877-790b-4ca7-a963-625fdadd102c for aggregate {{(pid=143128) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:02:57.521925 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:57.521925 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:57.523768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.aggregate [None req-1d041d83-6288-4087-ab00-c87621e4c433 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Generated uuid 7f0a21f7-0c3a-4930-be85-2c3feb081766 for aggregate {{(pid=143129) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:02:57.551712 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-c9698873-5754-4cfb-8a94-83c76e9a5ea8 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-302599031 already exists. May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c9698873-5754-4cfb-8a94-83c76e9a5ea8 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Request method failure captured: May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 59 May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko370rLdfXX4RvwKIIWwK-2mPGBCkpX0PzL-OxzORwnUdnHaFT41nxek8xgx2O8JdRJse_n5803IES7o4r9sVN0MpSfgwrSxYiyf3hdkC-ftGvC_oIP0nL27MCioSlDipifKv3tIx0h5o-kJLhdOqqgXgNPHmQHomd8e3HzFGpiSxgA May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:02:57.554840 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:02:57.556139 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0eeea9efb9364971b8335deff54816d3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:02:57.556139 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:57.556139 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:02:57.556139 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:57.556139 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:02:57.556139 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:02:57.556139 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:02:57.556139 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 2fb485e80a0c42e6bae2142de7c23338 May 28 21:02:57.556139 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:02:57.556139 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:02:57.556139 ncdv-master-1 devstack@n-api.service[143128]: {"aggregate": {"name": "tempest-test_aggregate-302599031"}} May 28 21:02:57.556139 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:02:57.556139 ncdv-master-1 devstack@n-api.service[143128]: exception: Aggregate tempest-test_aggregate-302599031 already exists. May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-302599031'}}} May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi aggregate.create() May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create May 28 21:02:57.556902 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-302599031 already exists. May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:02:57.558070 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create May 28 21:02:57.559294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) May 28 21:02:57.559294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-302599031 already exists. May 28 21:02:57.559294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.559294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:57.559294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.559294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.559294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:57.559294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:57.559294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:02:57.559294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:02:57.559294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-302599031 already exists. May 28 21:02:57.559294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.559294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c9698873-5754-4cfb-8a94-83c76e9a5ea8 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-302599031 already exists. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:02:57.559294 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c9698873-5754-4cfb-8a94-83c76e9a5ea8 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.062701 May 28 21:02:57.569595 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 22/46] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:02:57 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 28 21:02:57.579533 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-280c7638-773a-47bd-a678-3e8eb0b5c00b tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:57.581750 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:57.581750 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:57.632251 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1d041d83-6288-4087-ab00-c87621e4c433 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.151446 May 28 21:02:57.638084 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 25/47] 10.222.0.33 () {60 vars in 1164 bytes} [Sat May 28 21:02:57 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:02:57.650935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c1af4db3-a453-4be5-bc40-11834065c685 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:57.652946 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:57.652946 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:57.674498 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c1af4db3-a453-4be5-bc40-11834065c685 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 516 microversion: 2.1 time: 0.035137 May 28 21:02:57.676341 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 26/48] 10.222.0.33 () {58 vars in 1142 bytes} [Sat May 28 21:02:57 2022] GET /compute/v2.1/os-aggregates => generated 516 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:02:57.688022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8c54c2f9-5a75-45c8-968d-b7f139be37fd tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:57.703357 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-280c7638-773a-47bd-a678-3e8eb0b5c00b tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.137762 May 28 21:02:57.706574 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:57.706574 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:57.719665 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 23/49] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:02:57 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:02:57.727561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eda06502-3b34-4ae7-b923-3f90a1092f9e tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1638960836"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:57.731851 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:57.731851 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:57.733241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.aggregate [None req-eda06502-3b34-4ae7-b923-3f90a1092f9e tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Generated uuid 1c2e83d7-7408-4eb5-afdd-88530b927232 for aggregate {{(pid=143128) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:02:57.748299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c54c2f9-5a75-45c8-968d-b7f139be37fd tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:57.748767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c54c2f9-5a75-45c8-968d-b7f139be37fd tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:57.846349 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eda06502-3b34-4ae7-b923-3f90a1092f9e tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.124305 May 28 21:02:57.855324 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 24/50] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:02:57 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:02:57.866028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b88b9e78-9a3f-430c-8eaf-93facb403581 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:57.872755 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:57.872755 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:57.883028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b88b9e78-9a3f-430c-8eaf-93facb403581 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'd870c609a91f4540bfbd7471106fc398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133f6301e034a2faf8215358bf3e691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b88b9e78-9a3f-430c-8eaf-93facb403581 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Request method failure captured: May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko33KPbLJXwfUJ8ak84X8jCQi_SjGobHAM92z-MjqFNnnQ6BkLTZPfDyd23ra5bMIIAwK5pJCFmLSmqnUEdaoOVPrxpf0yK-gXQlZY-RjNbWVfBnkuDf2q7wdSxB-eQlmECQoCgYaKp1fSrw5cbrAO6Kh2OGf7JPKCAJb5vv16CgCpc May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 7133f6301e034a2faf8215358bf3e691 May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:02:57.888934 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:02:57.890111 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7133f6301e034a2faf8215358bf3e691", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:02:57.890111 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:02:57.890111 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 7133f6301e034a2faf8215358bf3e691 May 28 21:02:57.890111 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:02:57.890111 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminNegativeTestJSON-265216604-project May 28 21:02:57.890111 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:02:57.890111 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:02:57.890111 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: d870c609a91f4540bfbd7471106fc398 May 28 21:02:57.890111 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-265216604-project May 28 21:02:57.890111 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:02:57.890111 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 28 21:02:57.890111 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '7'} May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:02:57.890697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:57.891579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b88b9e78-9a3f-430c-8eaf-93facb403581 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:02:57.893606 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b88b9e78-9a3f-430c-8eaf-93facb403581 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.034430 May 28 21:02:57.898060 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 25/51] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:02:57 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:02:57.912148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-141b0bdb-565c-44b6-b9e8-9bf620c20e0e tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:58.088324 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-141b0bdb-565c-44b6-b9e8-9bf620c20e0e tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.185083 May 28 21:02:58.088324 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 26/52] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:02:57 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:02:58.096191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f55acc5a-23a5-45ec-9179-e608d4129e27 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:58.097120 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:58.097120 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:58.118684 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-f55acc5a-23a5-45ec-9179-e608d4129e27 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f55acc5a-23a5-45ec-9179-e608d4129e27 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Request method failure captured: May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko370rLdfXX4RvwKIIWwK-2mPGBCkpX0PzL-OxzORwnUdnHaFT41nxek8xgx2O8JdRJse_n5803IES7o4r9sVN0MpSfgwrSxYiyf3hdkC-ftGvC_oIP0nL27MCioSlDipifKv3tIx0h5o-kJLhdOqqgXgNPHmQHomd8e3HzFGpiSxgA May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:02:58.120683 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:02:58.122313 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0eeea9efb9364971b8335deff54816d3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:02:58.122313 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:58.122313 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:02:58.122313 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:58.122313 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:02:58.122313 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:02:58.122313 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:02:58.122313 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 2fb485e80a0c42e6bae2142de7c23338 May 28 21:02:58.122313 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:02:58.122313 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:02:58.122313 ncdv-master-1 devstack@n-api.service[143128]: exception: Aggregate -1 could not be found. May 28 21:02:58.122313 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '-1'} May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 28 21:02:58.123060 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:58.124293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:58.125658 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:58.125658 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:58.125658 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:02:58.125658 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:02:58.125658 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 28 21:02:58.125658 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:58.126813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f55acc5a-23a5-45ec-9179-e608d4129e27 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:02:58.128267 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f55acc5a-23a5-45ec-9179-e608d4129e27 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035797 May 28 21:02:58.129479 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 27/53] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:02:58 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 21:02:58.148257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-624a6ee0-b8ab-4487-af79-09f7df777c6a tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1465840364"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:58.148846 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:58.148846 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:58.150839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.aggregate [None req-624a6ee0-b8ab-4487-af79-09f7df777c6a tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Generated uuid 752d3e99-cf03-4d00-82f4-634eabf22f1b for aggregate {{(pid=143128) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:02:58.175676 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8c54c2f9-5a75-45c8-968d-b7f139be37fd tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 315 microversion: 2.1 time: 0.490861 May 28 21:02:58.185879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=11 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:02:58.186488 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 27/54] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 21:02:57 2022] POST /compute/v2.1/os-aggregates/6/action => generated 315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:02:58.279776 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-624a6ee0-b8ab-4487-af79-09f7df777c6a tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.142923 May 28 21:02:58.280580 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 28/55] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:02:58 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:02:58.295163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-847f2fab-0954-4b66-8cbf-a4d9163be586 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:58.296149 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:58.296149 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:02:58.297233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-847f2fab-0954-4b66-8cbf-a4d9163be586 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'd870c609a91f4540bfbd7471106fc398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133f6301e034a2faf8215358bf3e691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-847f2fab-0954-4b66-8cbf-a4d9163be586 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Request method failure captured: May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko33KPbLJXwfUJ8ak84X8jCQi_SjGobHAM92z-MjqFNnnQ6BkLTZPfDyd23ra5bMIIAwK5pJCFmLSmqnUEdaoOVPrxpf0yK-gXQlZY-RjNbWVfBnkuDf2q7wdSxB-eQlmECQoCgYaKp1fSrw5cbrAO6Kh2OGf7JPKCAJb5vv16CgCpc May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 7133f6301e034a2faf8215358bf3e691 May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:02:58.299446 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:02:58.300788 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7133f6301e034a2faf8215358bf3e691", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:02:58.300788 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:02:58.300788 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 7133f6301e034a2faf8215358bf3e691 May 28 21:02:58.300788 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:02:58.300788 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AggregatesAdminNegativeTestJSON-265216604-project May 28 21:02:58.300788 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:02:58.300788 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:02:58.300788 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: d870c609a91f4540bfbd7471106fc398 May 28 21:02:58.300788 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-265216604-project May 28 21:02:58.300788 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:02:58.300788 ncdv-master-1 devstack@n-api.service[143129]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 28 21:02:58.300788 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '8'} May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:02:58.301503 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. May 28 21:02:58.302658 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:02:58.305010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-847f2fab-0954-4b66-8cbf-a4d9163be586 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:02:58.306005 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-847f2fab-0954-4b66-8cbf-a4d9163be586 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.014635 May 28 21:02:58.306446 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 28/56] 10.222.0.33 () {58 vars in 1148 bytes} [Sat May 28 21:02:58 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:02:58.322423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-16381f19-ad07-4f2d-86c0-67dcf3d36310 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:58.323319 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:58.323319 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:58.463018 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-16381f19-ad07-4f2d-86c0-67dcf3d36310 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.146563 May 28 21:02:58.463914 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 29/57] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:02:58 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:02:58.472819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-80f32567-bd43-4569-a4aa-01a8a465646a tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:58.473869 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:58.473869 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:58.481522 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-80f32567-bd43-4569-a4aa-01a8a465646a tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] HTTP exception thrown: Aggregate -1 could not be found. May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-80f32567-bd43-4569-a4aa-01a8a465646a tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Request method failure captured: May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko370rLdfXX4RvwKIIWwK-2mPGBCkpX0PzL-OxzORwnUdnHaFT41nxek8xgx2O8JdRJse_n5803IES7o4r9sVN0MpSfgwrSxYiyf3hdkC-ftGvC_oIP0nL27MCioSlDipifKv3tIx0h5o-kJLhdOqqgXgNPHmQHomd8e3HzFGpiSxgA May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:02:58.492092 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:02:58.498272 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0eeea9efb9364971b8335deff54816d3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:02:58.498272 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:58.498272 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:02:58.498272 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:02:58.498272 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:02:58.498272 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:02:58.498272 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:02:58.498272 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 2fb485e80a0c42e6bae2142de7c23338 May 28 21:02:58.498272 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:02:58.498272 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:02:58.498272 ncdv-master-1 devstack@n-api.service[143128]: exception: Aggregate -1 could not be found. May 28 21:02:58.498272 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '-1'} May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:58.499199 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. May 28 21:02:58.500139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:58.501077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-80f32567-bd43-4569-a4aa-01a8a465646a tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:02:58.501077 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-80f32567-bd43-4569-a4aa-01a8a465646a tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.024808 May 28 21:02:58.501077 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 30/58] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:02:58 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:02:58.511703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-73596ca3-2f01-4686-ab85-ffe754bef880 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:02:58.519215 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:02:58.519215 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:02:58.521058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-73596ca3-2f01-4686-ab85-ffe754bef880 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'd870c609a91f4540bfbd7471106fc398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133f6301e034a2faf8215358bf3e691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-73596ca3-2f01-4686-ab85-ffe754bef880 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Request method failure captured: May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko33KPbLJXwfUJ8ak84X8jCQi_SjGobHAM92z-MjqFNnnQ6BkLTZPfDyd23ra5bMIIAwK5pJCFmLSmqnUEdaoOVPrxpf0yK-gXQlZY-RjNbWVfBnkuDf2q7wdSxB-eQlmECQoCgYaKp1fSrw5cbrAO6Kh2OGf7JPKCAJb5vv16CgCpc May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 7133f6301e034a2faf8215358bf3e691 May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:02:58.526180 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:02:58.527282 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7133f6301e034a2faf8215358bf3e691", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:02:58.527282 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:02:58.527282 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 7133f6301e034a2faf8215358bf3e691 May 28 21:02:58.527282 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:02:58.527282 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminNegativeTestJSON-265216604-project May 28 21:02:58.527282 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:02:58.527282 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:02:58.527282 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: d870c609a91f4540bfbd7471106fc398 May 28 21:02:58.527282 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-265216604-project May 28 21:02:58.527282 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:02:58.527282 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 28 21:02:58.527282 ncdv-master-1 devstack@n-api.service[143128]: action_args: {} May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:02:58.527866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:02:58.528790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-73596ca3-2f01-4686-ab85-ffe754bef880 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:02:58.531810 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-73596ca3-2f01-4686-ab85-ffe754bef880 tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.029238 May 28 21:02:58.533425 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 31/59] 10.222.0.33 () {58 vars in 1142 bytes} [Sat May 28 21:02:58 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:02:59.062124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1523380332", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "availability_zone": "tempest-test_az-1415322150"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:02:59.083169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:59.083632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:02:59.084449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:02:59.084925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:00.721492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:03:01.098766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:03:01.104983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:03:01.104983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:03:01.104983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:03:01.104983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:03:01.116683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:01.117155 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:01.118155 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:01.118519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:01.161541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Getting quotas for project 8c0200afe2ad4f6db3a7a21cf37f65c8. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:03:01.178712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Getting quotas for user 89ed91b9d56241d99b6df99ede3fb446 and project 8c0200afe2ad4f6db3a7a21cf37f65c8. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:03:01.193570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:03:01.196789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:03:01.370617 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9ea82e48-9088-4d86-bf56-544f7465062d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.970248 May 28 21:03:01.377099 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 29/60] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:02:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:03:01.383907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-746acd53-3fbc-4793-8214-6ead008ac035 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:01.384304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-746acd53-3fbc-4793-8214-6ead008ac035 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:02.610169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-746acd53-3fbc-4793-8214-6ead008ac035 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:02.625792 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-746acd53-3fbc-4793-8214-6ead008ac035 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1243 microversion: 2.1 time: 1.246813 May 28 21:03:02.626449 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 32/61] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:01 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1243 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:03.644725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7f342a49-cd52-49f6-b927-21dc2a7b5cae tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:03.645512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7f342a49-cd52-49f6-b927-21dc2a7b5cae tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:03.677980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f342a49-cd52-49f6-b927-21dc2a7b5cae tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:03.678894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f342a49-cd52-49f6-b927-21dc2a7b5cae tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:03.680393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f342a49-cd52-49f6-b927-21dc2a7b5cae tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:03.681369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f342a49-cd52-49f6-b927-21dc2a7b5cae tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:03.840490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7f342a49-cd52-49f6-b927-21dc2a7b5cae tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:03.861238 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7f342a49-cd52-49f6-b927-21dc2a7b5cae tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1243 microversion: 2.1 time: 0.221374 May 28 21:03:03.862547 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 30/62] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:03 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1243 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:04.885592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7068fa48-9706-4e42-a38a-4f241b4a0cea tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:04.886296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7068fa48-9706-4e42-a38a-4f241b4a0cea tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:04.894152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7068fa48-9706-4e42-a38a-4f241b4a0cea tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:04.894617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7068fa48-9706-4e42-a38a-4f241b4a0cea tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:04.895403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7068fa48-9706-4e42-a38a-4f241b4a0cea tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:04.895852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7068fa48-9706-4e42-a38a-4f241b4a0cea tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:05.074470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7068fa48-9706-4e42-a38a-4f241b4a0cea tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:05.106356 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7068fa48-9706-4e42-a38a-4f241b4a0cea tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1291 microversion: 2.1 time: 0.223120 May 28 21:03:05.106983 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 33/63] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:04 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1291 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:06.131186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c72a83db-2720-49c1-a513-3b7103db5cec tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:06.131858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c72a83db-2720-49c1-a513-3b7103db5cec tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:06.145356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c72a83db-2720-49c1-a513-3b7103db5cec tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:06.146481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c72a83db-2720-49c1-a513-3b7103db5cec tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:06.149942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c72a83db-2720-49c1-a513-3b7103db5cec tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:06.152132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c72a83db-2720-49c1-a513-3b7103db5cec tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:06.279146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c72a83db-2720-49c1-a513-3b7103db5cec tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:06.292382 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c72a83db-2720-49c1-a513-3b7103db5cec tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1297 microversion: 2.1 time: 0.172651 May 28 21:03:06.305250 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 31/64] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:06 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1297 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:06.813340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-436909db-5f3d-42ef-9fd3-da41f2c37afa tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-156377836", "id": 359761404, "os-flavor-access:is_public": "False"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:06.816081 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:06.816081 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:07.075474 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-436909db-5f3d-42ef-9fd3-da41f2c37afa tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.756155 May 28 21:03:07.075474 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 34/65] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:03:06 2022] POST /compute/v2.1/flavors => generated 435 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:03:07.090681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2101398433", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:07.094189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ad76ed88-ff60-451a-9472-ffea4581f898 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0d902454e7bd44339240a17aef7d1335"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:07.097601 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:07.097601 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:07.110161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:07.182544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:03:08.052901 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ad76ed88-ff60-451a-9472-ffea4581f898 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/359761404/action" status: 200 len: 96 microversion: 2.1 time: 0.975975 May 28 21:03:08.054582 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 35/66] 10.222.0.33 () {60 vars in 1196 bytes} [Sat May 28 21:03:07 2022] POST /compute/v2.1/flavors/359761404/action => generated 96 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:03:08.092041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b24661e2-e8de-4626-9963-c31273026c5a tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:08.093047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b24661e2-e8de-4626-9963-c31273026c5a tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:08.117606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b24661e2-e8de-4626-9963-c31273026c5a tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:08.131638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b24661e2-e8de-4626-9963-c31273026c5a tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:08.132129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b24661e2-e8de-4626-9963-c31273026c5a tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:08.132844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b24661e2-e8de-4626-9963-c31273026c5a tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:08.292325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:03:08.293433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:03:08.294119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:03:08.294709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:03:08.295300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:03:08.316644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:08.317387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:08.318308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:08.318967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:08.367157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Getting quotas for project 0397fe0f76e24a83aa24ecec35dfb61e. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:03:08.381369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Getting quotas for user ad6f51b7b6834fefa06c58829399de85 and project 0397fe0f76e24a83aa24ecec35dfb61e. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:03:08.408236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:03:08.410926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:03:08.604346 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eb99b83e-56e7-467d-ab93-6a80bf229594 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.083010 May 28 21:03:08.604755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b24661e2-e8de-4626-9963-c31273026c5a tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:08.608362 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 32/67] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:03:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:03:08.616219 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b24661e2-e8de-4626-9963-c31273026c5a tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 0.560490 May 28 21:03:08.629014 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 36/68] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:08 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:08.728380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-42832b26-893f-417e-b76e-a26e102766d9 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Calling method '.version_select at 0x7f4d65eeb670>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:08.730173 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:08.730173 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:08.733013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42832b26-893f-417e-b76e-a26e102766d9 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:08.734115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42832b26-893f-417e-b76e-a26e102766d9 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:08.781629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42832b26-893f-417e-b76e-a26e102766d9 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:08.781629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42832b26-893f-417e-b76e-a26e102766d9 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:08.800044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bd0ddf71-b173-4ce1-84f0-7b8c736fd817 tempest-HypervisorAdminV228Test-1368876845 tempest-HypervisorAdminV228Test-1368876845-project-admin] Calling method '.version_select at 0x7f4d6742e0d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:08.800991 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:08.800991 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:08.818206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bd0ddf71-b173-4ce1-84f0-7b8c736fd817 tempest-HypervisorAdminV228Test-1368876845 tempest-HypervisorAdminV228Test-1368876845-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc53a60a-e345-4363-abb1-87c4d33bcbf6(cell1) {{(pid=143129) load_cells /opt/stack/nova/nova/compute/api.py:306}} May 28 21:03:08.819811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd0ddf71-b173-4ce1-84f0-7b8c736fd817 tempest-HypervisorAdminV228Test-1368876845 tempest-HypervisorAdminV228Test-1368876845-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:08.820282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd0ddf71-b173-4ce1-84f0-7b8c736fd817 tempest-HypervisorAdminV228Test-1368876845 tempest-HypervisorAdminV228Test-1368876845-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:08.862780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42832b26-893f-417e-b76e-a26e102766d9 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:08.863580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42832b26-893f-417e-b76e-a26e102766d9 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:08.902958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42832b26-893f-417e-b76e-a26e102766d9 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:08.904877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd0ddf71-b173-4ce1-84f0-7b8c736fd817 tempest-HypervisorAdminV228Test-1368876845 tempest-HypervisorAdminV228Test-1368876845-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:08.906442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd0ddf71-b173-4ce1-84f0-7b8c736fd817 tempest-HypervisorAdminV228Test-1368876845 tempest-HypervisorAdminV228Test-1368876845-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:08.915450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42832b26-893f-417e-b76e-a26e102766d9 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:08.964644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd0ddf71-b173-4ce1-84f0-7b8c736fd817 tempest-HypervisorAdminV228Test-1368876845 tempest-HypervisorAdminV228Test-1368876845-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:08.965478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd0ddf71-b173-4ce1-84f0-7b8c736fd817 tempest-HypervisorAdminV228Test-1368876845 tempest-HypervisorAdminV228Test-1368876845-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:08.985121 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bd0ddf71-b173-4ce1-84f0-7b8c736fd817 tempest-HypervisorAdminV228Test-1368876845 tempest-HypervisorAdminV228Test-1368876845-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.374830 May 28 21:03:08.992626 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 33/69] 10.222.0.33 () {60 vars in 1186 bytes} [Sat May 28 21:03:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:03:09.000584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42832b26-893f-417e-b76e-a26e102766d9 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:09.003420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42832b26-893f-417e-b76e-a26e102766d9 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:09.010764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ed412fcb-b619-4427-b4d7-0c7dc469d7ce tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0d902454e7bd44339240a17aef7d1335"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:09.022951 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-42832b26-893f-417e-b76e-a26e102766d9 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1664 microversion: 2.53 time: 0.385436 May 28 21:03:09.023922 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:09.023922 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:09.029416 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 37/70] 10.222.0.33 () {60 vars in 1242 bytes} [Sat May 28 21:03:08 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1664 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:09.049926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-920b5c1d-4020-4605-8b01-ee1f4d394eb6 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:09.050887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-920b5c1d-4020-4605-8b01-ee1f4d394eb6 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:09.276553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-920b5c1d-4020-4605-8b01-ee1f4d394eb6 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:09.286037 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-920b5c1d-4020-4605-8b01-ee1f4d394eb6 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1220 microversion: 2.1 time: 0.250981 May 28 21:03:09.289542 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 38/71] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:09 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1220 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:09.295552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-affad4b7-e4f5-468e-951e-2ddd2ca6253f tempest-HypervisorAdminV228Test-1368876845 tempest-HypervisorAdminV228Test-1368876845-project-admin] Calling method '.version_select at 0x7f4d64d34f70>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:09.296354 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:09.296354 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:09.297563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-affad4b7-e4f5-468e-951e-2ddd2ca6253f tempest-HypervisorAdminV228Test-1368876845 tempest-HypervisorAdminV228Test-1368876845-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:09.298048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-affad4b7-e4f5-468e-951e-2ddd2ca6253f tempest-HypervisorAdminV228Test-1368876845 tempest-HypervisorAdminV228Test-1368876845-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:09.337609 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-ed412fcb-b619-4427-b4d7-0c7dc469d7ce tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] HTTP exception thrown: Flavor access already exists for flavor 18 and project 0d902454e7bd44339240a17aef7d1335 combination. May 28 21:03:09.402679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-affad4b7-e4f5-468e-951e-2ddd2ca6253f tempest-HypervisorAdminV228Test-1368876845 tempest-HypervisorAdminV228Test-1368876845-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:09.408214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-affad4b7-e4f5-468e-951e-2ddd2ca6253f tempest-HypervisorAdminV228Test-1368876845 tempest-HypervisorAdminV228Test-1368876845-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ed412fcb-b619-4427-b4d7-0c7dc469d7ce tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Request method failure captured: May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/flavors/359761404/action HTTP/1.1 May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 67 May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4HLhcB69jF2SkVVzvoeZBUXwK-l1dabWcpsZTJmS9zetZSmNVJ8IfryIYWUVoC9WEJ0cBZB-uLd3zYVTqtv6HHiowWGQwWxy1TIKRPXqve3lAMwclJGXRqx2JBbkZvzu7em4nG7x8C72lmy5EC23NykonYBwNjsXmegM94S02A0UY May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 38bea6ec7e1c4836868191839fd7b889 May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1342488242 May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:03:09.433718 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:03:09.435209 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38bea6ec7e1c4836868191839fd7b889", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38bea6ec7e1c4836868191839fd7b889"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38bea6ec7e1c4836868191839fd7b889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38bea6ec7e1c4836868191839fd7b889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:09.435209 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1342488242 May 28 21:03:09.435209 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 38bea6ec7e1c4836868191839fd7b889 May 28 21:03:09.435209 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1342488242 May 28 21:03:09.435209 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin May 28 21:03:09.435209 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:03:09.435209 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:03:09.435209 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 4d52e97d8e154a7986918ed3918cb4e2 May 28 21:03:09.435209 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin May 28 21:03:09.435209 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:03:09.435209 ncdv-master-1 devstack@n-api.service[143129]: {"addTenantAccess": {"tenant": "0d902454e7bd44339240a17aef7d1335"}} May 28 21:03:09.435209 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: exception: Flavor access already exists for flavor 18 and project 0d902454e7bd44339240a17aef7d1335 combination. May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '359761404', 'body': {'addTenantAccess': {'tenant': '0d902454e7bd44339240a17aef7d1335'}}} May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = self._query(query) May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi conn.query(q) May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result.read() May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 28 21:03:09.436023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '18-0d902454e7bd44339240a17aef7d1335' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi project.save(context.session) May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi session.flush() May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._flush(objects) May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 28 21:03:09.437304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi compat.raise_( May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi flush_context.execute() May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi rec.execute(self) May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 28 21:03:09.439316 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = self._query(query) May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi conn.query(q) May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 28 21:03:09.440531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result.read() May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '18-0d902454e7bd44339240a17aef7d1335' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 28, 21, 3, 9, 279492), 'updated_at': None, 'flavor_id': 18, 'project_id': '0d902454e7bd44339240a17aef7d1335'}] May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:09.441746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._add_access(project_id) May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 18 and project 0d902454e7bd44339240a17aef7d1335 combination. May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:09.442780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 18 and project 0d902454e7bd44339240a17aef7d1335 combination. May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:03:09.444323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:03:09.445591 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 18 and project 0d902454e7bd44339240a17aef7d1335 combination. May 28 21:03:09.445591 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:09.445591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ed412fcb-b619-4427-b4d7-0c7dc469d7ce tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Returning 409 to user: Flavor access already exists for flavor 18 and project 0d902454e7bd44339240a17aef7d1335 combination. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:09.445591 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ed412fcb-b619-4427-b4d7-0c7dc469d7ce tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/359761404/action" status: 409 len: 152 microversion: 2.1 time: 0.439614 May 28 21:03:09.456821 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 34/72] 10.222.0.33 () {60 vars in 1196 bytes} [Sat May 28 21:03:08 2022] POST /compute/v2.1/flavors/359761404/action => generated 152 bytes in 462 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:03:09.462085 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-affad4b7-e4f5-468e-951e-2ddd2ca6253f tempest-HypervisorAdminV228Test-1368876845 tempest-HypervisorAdminV228Test-1368876845-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.170641 May 28 21:03:09.475802 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 39/73] 10.222.0.33 () {60 vars in 1192 bytes} [Sat May 28 21:03:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:03:09.479330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e27e4735-ed18-43dd-b10a-01d2751fca54 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0d902454e7bd44339240a17aef7d1335"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:09.480835 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:09.480835 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:09.494442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4f838672-6753-4e04-80e1-a81f26b2cc5f tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Calling method '.version_select at 0x7f4d64d308b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:09.500045 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:09.500045 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:09.508238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f838672-6753-4e04-80e1-a81f26b2cc5f tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:09.514581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f838672-6753-4e04-80e1-a81f26b2cc5f tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:09.615057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f838672-6753-4e04-80e1-a81f26b2cc5f tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:09.624408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f838672-6753-4e04-80e1-a81f26b2cc5f tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:09.786370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f838672-6753-4e04-80e1-a81f26b2cc5f tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:09.790070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f838672-6753-4e04-80e1-a81f26b2cc5f tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:09.839309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f838672-6753-4e04-80e1-a81f26b2cc5f tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:09.839825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f838672-6753-4e04-80e1-a81f26b2cc5f tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:09.883870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f838672-6753-4e04-80e1-a81f26b2cc5f tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:09.883870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f838672-6753-4e04-80e1-a81f26b2cc5f tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:09.884574 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4f838672-6753-4e04-80e1-a81f26b2cc5f tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 357 microversion: 2.53 time: 0.426104 May 28 21:03:09.891052 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 35/74] 10.222.0.33 () {60 vars in 1221 bytes} [Sat May 28 21:03:09 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 357 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:03:09.897895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-745b6cb6-fd4c-430a-8c1a-920b2dc49e67 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:09.898618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-745b6cb6-fd4c-430a-8c1a-920b2dc49e67 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:09.907510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-745b6cb6-fd4c-430a-8c1a-920b2dc49e67 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:09.908090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-745b6cb6-fd4c-430a-8c1a-920b2dc49e67 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:09.908738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-745b6cb6-fd4c-430a-8c1a-920b2dc49e67 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:09.909284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-745b6cb6-fd4c-430a-8c1a-920b2dc49e67 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:10.803823 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e27e4735-ed18-43dd-b10a-01d2751fca54 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/359761404/action" status: 200 len: 21 microversion: 2.1 time: 1.330003 May 28 21:03:10.805740 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 40/75] 10.222.0.33 () {60 vars in 1196 bytes} [Sat May 28 21:03:09 2022] POST /compute/v2.1/flavors/359761404/action => generated 21 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:03:10.820894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3de6c08b-8361-48ee-9327-33f323776736 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Calling method '.version_select at 0x7f4d64e4eb80>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:10.824914 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:10.824914 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:10.828685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3de6c08b-8361-48ee-9327-33f323776736 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:10.839666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3de6c08b-8361-48ee-9327-33f323776736 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:10.856524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-745b6cb6-fd4c-430a-8c1a-920b2dc49e67 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:10.871347 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-745b6cb6-fd4c-430a-8c1a-920b2dc49e67 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 0.978448 May 28 21:03:10.882716 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 36/76] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:09 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:10.890632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6d6b6f6c-7845-455e-855d-01a81dc7093f tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:10.891501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6d6b6f6c-7845-455e-855d-01a81dc7093f tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:10.898158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3de6c08b-8361-48ee-9327-33f323776736 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:10.902992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3de6c08b-8361-48ee-9327-33f323776736 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:10.917411 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3de6c08b-8361-48ee-9327-33f323776736 tempest-HypervisorAdminV253TestBase-1188795342 tempest-HypervisorAdminV253TestBase-1188795342-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/d571c266-50ef-4af0-8315-6e532ca04cc8" status: 200 len: 792 microversion: 2.53 time: 0.111523 May 28 21:03:10.924242 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 41/77] 10.222.0.33 () {60 vars in 1297 bytes} [Sat May 28 21:03:10 2022] GET /compute/v2.1/os-hypervisors/d571c266-50ef-4af0-8315-6e532ca04cc8 => generated 792 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:03:10.945212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b3f98d54-681a-4140-85f6-e3f0f1e8777e tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:10.946651 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:10.946651 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:11.050570 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b3f98d54-681a-4140-85f6-e3f0f1e8777e tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/359761404" status: 202 len: 0 microversion: 2.1 time: 0.124835 May 28 21:03:11.051602 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 42/78] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:03:10 2022] DELETE /compute/v2.1/flavors/359761404 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:03:11.073586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9d1a4811-6db1-4a0a-a270-dd2031c4d98e tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:11.154540 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9d1a4811-6db1-4a0a-a270-dd2031c4d98e tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.086016 May 28 21:03:11.160976 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 43/79] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:03:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:11.191867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9d614834-80a0-4345-a8b0-28b8170f2f77 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1185552216", "id": 855951203, "os-flavor-access:is_public": "True"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:11.193794 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:11.193794 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:11.202608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6d6b6f6c-7845-455e-855d-01a81dc7093f tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:11.230510 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6d6b6f6c-7845-455e-855d-01a81dc7093f tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1220 microversion: 2.1 time: 0.343575 May 28 21:03:11.235063 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 37/80] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:10 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1220 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:11.289473 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9d614834-80a0-4345-a8b0-28b8170f2f77 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.114021 May 28 21:03:11.293412 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 44/81] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:03:11 2022] POST /compute/v2.1/flavors => generated 435 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:11.327946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5f86eec1-b1f0-4ced-8f35-d55ddc9fa5ec tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:11.334177 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:11.334177 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:11.362080 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-5f86eec1-b1f0-4ced-8f35-d55ddc9fa5ec tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] HTTP exception thrown: Access list not available for public flavors. May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5f86eec1-b1f0-4ced-8f35-d55ddc9fa5ec tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Request method failure captured: May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/flavors/855951203/os-flavor-access HTTP/1.1 May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4HLhcB69jF2SkVVzvoeZBUXwK-l1dabWcpsZTJmS9zetZSmNVJ8IfryIYWUVoC9WEJ0cBZB-uLd3zYVTqtv6HHiowWGQwWxy1TIKRPXqve3lAMwclJGXRqx2JBbkZvzu7em4nG7x8C72lmy5EC23NykonYBwNjsXmegM94S02A0UY May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 38bea6ec7e1c4836868191839fd7b889 May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1342488242 May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:03:11.363804 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:03:11.365159 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38bea6ec7e1c4836868191839fd7b889", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38bea6ec7e1c4836868191839fd7b889"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38bea6ec7e1c4836868191839fd7b889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38bea6ec7e1c4836868191839fd7b889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:11.365159 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1342488242 May 28 21:03:11.365159 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 38bea6ec7e1c4836868191839fd7b889 May 28 21:03:11.365159 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1342488242 May 28 21:03:11.365159 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin May 28 21:03:11.365159 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:03:11.365159 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:03:11.365159 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 4d52e97d8e154a7986918ed3918cb4e2 May 28 21:03:11.365159 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin May 28 21:03:11.365159 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:03:11.365159 ncdv-master-1 devstack@n-api.service[143128]: exception: Access list not available for public flavors. May 28 21:03:11.365159 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'flavor_id': '855951203'} May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. May 28 21:03:11.366558 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:11.368435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5f86eec1-b1f0-4ced-8f35-d55ddc9fa5ec tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:11.371793 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5f86eec1-b1f0-4ced-8f35-d55ddc9fa5ec tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/855951203/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.067026 May 28 21:03:11.372395 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 45/82] 10.222.0.33 () {58 vars in 1205 bytes} [Sat May 28 21:03:11 2022] GET /compute/v2.1/flavors/855951203/os-flavor-access => generated 91 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:03:11.394658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-20ae5bc1-a672-4ae6-8dd5-75cdce8f0038 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:11.530097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-7eea0601-9363-4d02-9849-4890af22a6d1 req-78397805-fcc6-4862-883f-256bb4cdfb6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0ba50c-cc90-4921-9fd4-b612903c5b1d", "tag": "d321012d-93e1-483f-9d36-9dd314faf3c8"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:11.539735 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-20ae5bc1-a672-4ae6-8dd5-75cdce8f0038 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/855951203" status: 202 len: 0 microversion: 2.1 time: 0.153707 May 28 21:03:11.541633 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 46/83] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:03:11 2022] DELETE /compute/v2.1/flavors/855951203 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:03:11.561458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f60b8b30-615c-4f87-bd31-8af91d40fad0 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:11.590040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7eea0601-9363-4d02-9849-4890af22a6d1 req-78397805-fcc6-4862-883f-256bb4cdfb6e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:11.595676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7eea0601-9363-4d02-9849-4890af22a6d1 req-78397805-fcc6-4862-883f-256bb4cdfb6e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:11.653181 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f60b8b30-615c-4f87-bd31-8af91d40fad0 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.095820 May 28 21:03:11.653798 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 47/84] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:03:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:11.671071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-30043fb0-f563-4ee5-a148-b3b86d92c908 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-796449008", "id": 380393273, "os-flavor-access:is_public": "False"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:11.710543 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-7eea0601-9363-4d02-9849-4890af22a6d1 req-78397805-fcc6-4862-883f-256bb4cdfb6e service nova] Creating event network-changed:d321012d-93e1-483f-9d36-9dd314faf3c8 for instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d on nch1-master-1 May 28 21:03:11.711677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7eea0601-9363-4d02-9849-4890af22a6d1 req-78397805-fcc6-4862-883f-256bb4cdfb6e service nova] Acquired lock "compute-rpcapi-router" {{(pid=143129) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 21:03:11.713094 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c44993dd-e8c6-455a-a4d3-9f7096f2d52e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:11.714694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c44993dd-e8c6-455a-a4d3-9f7096f2d52e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:11.715795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c44993dd-e8c6-455a-a4d3-9f7096f2d52e None None] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:11.716438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c44993dd-e8c6-455a-a4d3-9f7096f2d52e None None] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:11.755236 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-30043fb0-f563-4ee5-a148-b3b86d92c908 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.088058 May 28 21:03:11.761742 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 48/85] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:03:11 2022] POST /compute/v2.1/flavors => generated 435 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:11.771127 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.compute.rpcapi [None req-c44993dd-e8c6-455a-a4d3-9f7096f2d52e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 28 21:03:11.773047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c44993dd-e8c6-455a-a4d3-9f7096f2d52e None None] Releasing lock "compute-rpcapi-router" {{(pid=143129) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 21:03:11.833011 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c44993dd-e8c6-455a-a4d3-9f7096f2d52e None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.575553 May 28 21:03:11.836052 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 38/86] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:11.889181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2fed6bc6-a93b-4e75-881a-3529ce87a816 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:11.891623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2fed6bc6-a93b-4e75-881a-3529ce87a816 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:11.906439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fed6bc6-a93b-4e75-881a-3529ce87a816 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:11.911256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fed6bc6-a93b-4e75-881a-3529ce87a816 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:11.914058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fed6bc6-a93b-4e75-881a-3529ce87a816 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:11.916647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fed6bc6-a93b-4e75-881a-3529ce87a816 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:12.242030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3f3fb0c5-1fff-42f2-9022-1cda71530f67 tempest-FlavorsAccessNegativeTestJSON-1791158616 tempest-FlavorsAccessNegativeTestJSON-1791158616-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0d902454e7bd44339240a17aef7d1335"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:12.243310 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:12.243310 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:12.244213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3f3fb0c5-1fff-42f2-9022-1cda71530f67 tempest-FlavorsAccessNegativeTestJSON-1791158616 tempest-FlavorsAccessNegativeTestJSON-1791158616-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '13e536776b8f4bd99fbf6a7b5f02fc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d902454e7bd44339240a17aef7d1335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3f3fb0c5-1fff-42f2-9022-1cda71530f67 tempest-FlavorsAccessNegativeTestJSON-1791158616 tempest-FlavorsAccessNegativeTestJSON-1791158616-project] Request method failure captured: May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/flavors/380393273/action HTTP/1.1 May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 67 May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4FHYAPu_e0esMITmVuPuXpuKUFcENXiZtK29o-1OCA4dLkzT7Op8tktONb29FXKxvgGbGNLyGNF36d3MROwA-g_439dK54fG-z25SPsp-m69v15NqeqSB94DRaJICk4so0j-YIa6x765sT9x2opuLUOqrW_Y20fIeTiuQaCETsgDA May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0d902454e7bd44339240a17aef7d1335 May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1791158616 May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:03:12.246113 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:03:12.247285 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d902454e7bd44339240a17aef7d1335", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d902454e7bd44339240a17aef7d1335"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d902454e7bd44339240a17aef7d1335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d902454e7bd44339240a17aef7d1335"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:12.247285 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1791158616 May 28 21:03:12.247285 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0d902454e7bd44339240a17aef7d1335 May 28 21:03:12.247285 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1791158616 May 28 21:03:12.247285 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-FlavorsAccessNegativeTestJSON-1791158616-project May 28 21:03:12.247285 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:03:12.247285 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:03:12.247285 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 13e536776b8f4bd99fbf6a7b5f02fc79 May 28 21:03:12.247285 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1791158616-project May 28 21:03:12.247285 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:03:12.247285 ncdv-master-1 devstack@n-api.service[143128]: {"addTenantAccess": {"tenant": "0d902454e7bd44339240a17aef7d1335"}} May 28 21:03:12.247285 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '380393273', 'body': {'addTenantAccess': {'tenant': '0d902454e7bd44339240a17aef7d1335'}}} May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:03:12.248028 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. May 28 21:03:12.249147 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:12.251937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3f3fb0c5-1fff-42f2-9022-1cda71530f67 tempest-FlavorsAccessNegativeTestJSON-1791158616 tempest-FlavorsAccessNegativeTestJSON-1791158616-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:12.254840 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3f3fb0c5-1fff-42f2-9022-1cda71530f67 tempest-FlavorsAccessNegativeTestJSON-1791158616 tempest-FlavorsAccessNegativeTestJSON-1791158616-project] 10.222.0.33 "POST /compute/v2.1/flavors/380393273/action" status: 403 len: 130 microversion: 2.1 time: 0.491854 May 28 21:03:12.261870 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 49/87] 10.222.0.33 () {60 vars in 1196 bytes} [Sat May 28 21:03:11 2022] POST /compute/v2.1/flavors/380393273/action => generated 130 bytes in 493 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:03:12.277892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-93cc358c-4892-4496-b587-64caf88e8b21 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:12.283167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-93cc358c-4892-4496-b587-64caf88e8b21 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:12.312356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93cc358c-4892-4496-b587-64caf88e8b21 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:12.318491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93cc358c-4892-4496-b587-64caf88e8b21 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:12.318491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93cc358c-4892-4496-b587-64caf88e8b21 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:12.318491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93cc358c-4892-4496-b587-64caf88e8b21 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:12.572358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-93cc358c-4892-4496-b587-64caf88e8b21 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:12.593334 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-93cc358c-4892-4496-b587-64caf88e8b21 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1272 microversion: 2.1 time: 0.334038 May 28 21:03:12.597908 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 50/88] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:12 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1272 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:12.610952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2fed6bc6-a93b-4e75-881a-3529ce87a816 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:12.623370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-24ae380d-3ff0-4670-adf9-4abf370c0e3d tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:12.623370 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:12.623370 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:12.623653 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2fed6bc6-a93b-4e75-881a-3529ce87a816 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 0.736284 May 28 21:03:12.624387 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 39/89] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:11 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:12.696125 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-24ae380d-3ff0-4670-adf9-4abf370c0e3d tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/380393273" status: 202 len: 0 microversion: 2.1 time: 0.094664 May 28 21:03:12.698736 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 51/90] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:03:12 2022] DELETE /compute/v2.1/flavors/380393273 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:03:12.706151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-56b0c449-b264-4075-a59b-ea9310339692 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:12.756106 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-56b0c449-b264-4075-a59b-ea9310339692 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054494 May 28 21:03:12.772464 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 40/91] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:03:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:12.776486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-59b1a2ce-f526-48c1-bc08-01e938c9e689 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-837557013", "id": 469877195, "os-flavor-access:is_public": "False"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:12.779061 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:12.779061 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:12.906238 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-59b1a2ce-f526-48c1-bc08-01e938c9e689 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.133763 May 28 21:03:12.907620 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 52/92] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:03:12 2022] POST /compute/v2.1/flavors => generated 435 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:12.936625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5b786994-37e3-431d-a6d1-c9610cec8217 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0d902454e7bd44339240a17aef7d1335"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:12.942704 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:12.942704 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:13.317989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=2,nova_api:INSERT=11 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:13.424995 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5b786994-37e3-431d-a6d1-c9610cec8217 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/469877195/action" status: 200 len: 96 microversion: 2.1 time: 0.504775 May 28 21:03:13.431466 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 41/93] 10.222.0.33 () {60 vars in 1196 bytes} [Sat May 28 21:03:12 2022] POST /compute/v2.1/flavors/469877195/action => generated 96 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:03:13.437161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd16cc5d-8c08-4da5-a6fd-edfc1eed083e tempest-FlavorsAccessNegativeTestJSON-1791158616 tempest-FlavorsAccessNegativeTestJSON-1791158616-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0d902454e7bd44339240a17aef7d1335"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:13.438665 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:13.438665 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:13.441317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bd16cc5d-8c08-4da5-a6fd-edfc1eed083e tempest-FlavorsAccessNegativeTestJSON-1791158616 tempest-FlavorsAccessNegativeTestJSON-1791158616-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '13e536776b8f4bd99fbf6a7b5f02fc79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d902454e7bd44339240a17aef7d1335', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd16cc5d-8c08-4da5-a6fd-edfc1eed083e tempest-FlavorsAccessNegativeTestJSON-1791158616 tempest-FlavorsAccessNegativeTestJSON-1791158616-project] Request method failure captured: May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/flavors/469877195/action HTTP/1.1 May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 70 May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4FHYAPu_e0esMITmVuPuXpuKUFcENXiZtK29o-1OCA4dLkzT7Op8tktONb29FXKxvgGbGNLyGNF36d3MROwA-g_439dK54fG-z25SPsp-m69v15NqeqSB94DRaJICk4so0j-YIa6x765sT9x2opuLUOqrW_Y20fIeTiuQaCETsgDA May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0d902454e7bd44339240a17aef7d1335 May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1791158616 May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:03:13.445805 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:03:13.446986 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0d902454e7bd44339240a17aef7d1335", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d902454e7bd44339240a17aef7d1335"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0d902454e7bd44339240a17aef7d1335"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0d902454e7bd44339240a17aef7d1335"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:13.446986 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1791158616 May 28 21:03:13.446986 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0d902454e7bd44339240a17aef7d1335 May 28 21:03:13.446986 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1791158616 May 28 21:03:13.446986 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-FlavorsAccessNegativeTestJSON-1791158616-project May 28 21:03:13.446986 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:03:13.446986 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:03:13.446986 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 13e536776b8f4bd99fbf6a7b5f02fc79 May 28 21:03:13.446986 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1791158616-project May 28 21:03:13.446986 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:03:13.446986 ncdv-master-1 devstack@n-api.service[143128]: {"removeTenantAccess": {"tenant": "0d902454e7bd44339240a17aef7d1335"}} May 28 21:03:13.446986 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '469877195', 'body': {'removeTenantAccess': {'tenant': '0d902454e7bd44339240a17aef7d1335'}}} May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can( May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:03:13.447638 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. May 28 21:03:13.448624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:13.449582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd16cc5d-8c08-4da5-a6fd-edfc1eed083e tempest-FlavorsAccessNegativeTestJSON-1791158616 tempest-FlavorsAccessNegativeTestJSON-1791158616-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:13.449582 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bd16cc5d-8c08-4da5-a6fd-edfc1eed083e tempest-FlavorsAccessNegativeTestJSON-1791158616 tempest-FlavorsAccessNegativeTestJSON-1791158616-project] 10.222.0.33 "POST /compute/v2.1/flavors/469877195/action" status: 403 len: 133 microversion: 2.1 time: 0.015936 May 28 21:03:13.456002 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 53/94] 10.222.0.33 () {60 vars in 1196 bytes} [Sat May 28 21:03:13 2022] POST /compute/v2.1/flavors/469877195/action => generated 133 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 28 21:03:13.460246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-49a9b673-414e-4f1a-84ee-e4e6444bca11 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0d902454e7bd44339240a17aef7d1335"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:13.462711 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:13.462711 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:13.614208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9d0c492f-ad77-4748-b426-cc2e24d7f7e4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:13.614831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9d0c492f-ad77-4748-b426-cc2e24d7f7e4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:13.633386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d0c492f-ad77-4748-b426-cc2e24d7f7e4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:13.633862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d0c492f-ad77-4748-b426-cc2e24d7f7e4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:13.644192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d0c492f-ad77-4748-b426-cc2e24d7f7e4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:13.644650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d0c492f-ad77-4748-b426-cc2e24d7f7e4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:14.030412 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-49a9b673-414e-4f1a-84ee-e4e6444bca11 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/469877195/action" status: 200 len: 21 microversion: 2.1 time: 0.574353 May 28 21:03:14.031887 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 42/95] 10.222.0.33 () {60 vars in 1196 bytes} [Sat May 28 21:03:13 2022] POST /compute/v2.1/flavors/469877195/action => generated 21 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:03:14.054589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-29e1ceab-2ba0-45dc-a2e5-4b5b98358896 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:14.057626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-29e1ceab-2ba0-45dc-a2e5-4b5b98358896 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:14.079881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29e1ceab-2ba0-45dc-a2e5-4b5b98358896 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:14.090380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29e1ceab-2ba0-45dc-a2e5-4b5b98358896 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:14.091637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29e1ceab-2ba0-45dc-a2e5-4b5b98358896 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:14.095414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29e1ceab-2ba0-45dc-a2e5-4b5b98358896 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:14.128856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9d0c492f-ad77-4748-b426-cc2e24d7f7e4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:14.150212 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9d0c492f-ad77-4748-b426-cc2e24d7f7e4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1278 microversion: 2.1 time: 0.539628 May 28 21:03:14.176909 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 54/96] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:13 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1278 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:14.191649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3129e605-2317-408e-ac1f-f7ba00228fdd tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:14.192925 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:14.192925 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:14.233980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=79,nova_api:DELETE=15 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:14.339013 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3129e605-2317-408e-ac1f-f7ba00228fdd tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/469877195" status: 202 len: 0 microversion: 2.1 time: 0.159735 May 28 21:03:14.344527 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 55/97] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:03:14 2022] DELETE /compute/v2.1/flavors/469877195 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:03:14.350766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c4777365-1804-4799-b9fd-5228ad71be0a tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:14.450107 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c4777365-1804-4799-b9fd-5228ad71be0a tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.098188 May 28 21:03:14.473373 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 56/98] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:03:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:14.491767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8fac9d41-4561-40a3-8358-c3c8aab97b61 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1427003513", "id": 28070521, "os-flavor-access:is_public": "False"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:14.500140 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:14.500140 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:14.621353 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8fac9d41-4561-40a3-8358-c3c8aab97b61 tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.146516 May 28 21:03:14.630752 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 57/99] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:03:14 2022] POST /compute/v2.1/flavors => generated 433 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:14.647994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d1ea7758-f650-46b5-bffe-0f911ba3fb3d tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "751501c7dfad4ad0a00524c6baf4471d"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:14.652056 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:14.652056 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:14.807439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-29e1ceab-2ba0-45dc-a2e5-4b5b98358896 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:14.822737 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-29e1ceab-2ba0-45dc-a2e5-4b5b98358896 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 0.778747 May 28 21:03:14.824532 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 43/100] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:14 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:15.181923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-979efd8d-d52f-41ad-ae78-f6d5157094ec tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:15.183637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-979efd8d-d52f-41ad-ae78-f6d5157094ec tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:15.194823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-979efd8d-d52f-41ad-ae78-f6d5157094ec tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:15.198486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-979efd8d-d52f-41ad-ae78-f6d5157094ec tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:15.204430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-979efd8d-d52f-41ad-ae78-f6d5157094ec tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:15.205145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-979efd8d-d52f-41ad-ae78-f6d5157094ec tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:15.309677 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-d1ea7758-f650-46b5-bffe-0f911ba3fb3d tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] HTTP exception thrown: Flavor access not found for 22 / 751501c7dfad4ad0a00524c6baf4471d combination. May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d1ea7758-f650-46b5-bffe-0f911ba3fb3d tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Request method failure captured: May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/flavors/28070521/action HTTP/1.1 May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 70 May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4HLhcB69jF2SkVVzvoeZBUXwK-l1dabWcpsZTJmS9zetZSmNVJ8IfryIYWUVoC9WEJ0cBZB-uLd3zYVTqtv6HHiowWGQwWxy1TIKRPXqve3lAMwclJGXRqx2JBbkZvzu7em4nG7x8C72lmy5EC23NykonYBwNjsXmegM94S02A0UY May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 38bea6ec7e1c4836868191839fd7b889 May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1342488242 May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:03:15.313560 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:03:15.314777 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38bea6ec7e1c4836868191839fd7b889", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38bea6ec7e1c4836868191839fd7b889"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38bea6ec7e1c4836868191839fd7b889"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38bea6ec7e1c4836868191839fd7b889"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:15.314777 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1342488242 May 28 21:03:15.314777 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 38bea6ec7e1c4836868191839fd7b889 May 28 21:03:15.314777 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1342488242 May 28 21:03:15.314777 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin May 28 21:03:15.314777 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:03:15.314777 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:03:15.314777 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 4d52e97d8e154a7986918ed3918cb4e2 May 28 21:03:15.314777 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin May 28 21:03:15.314777 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:03:15.314777 ncdv-master-1 devstack@n-api.service[143128]: {"removeTenantAccess": {"tenant": "751501c7dfad4ad0a00524c6baf4471d"}} May 28 21:03:15.314777 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: exception: Flavor access not found for 22 / 751501c7dfad4ad0a00524c6baf4471d combination. May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '28070521', 'body': {'removeTenantAccess': {'tenant': '751501c7dfad4ad0a00524c6baf4471d'}}} May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project May 28 21:03:15.316961 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 22 / 751501c7dfad4ad0a00524c6baf4471d combination. May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 22 / 751501c7dfad4ad0a00524c6baf4471d combination. May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:15.320068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:15.321157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:15.321157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:15.321157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:03:15.321157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:03:15.321157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 22 / 751501c7dfad4ad0a00524c6baf4471d combination. May 28 21:03:15.321157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:15.333444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d1ea7758-f650-46b5-bffe-0f911ba3fb3d tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Returning 404 to user: Flavor access not found for 22 / 751501c7dfad4ad0a00524c6baf4471d combination. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:15.337053 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d1ea7758-f650-46b5-bffe-0f911ba3fb3d tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/28070521/action" status: 404 len: 124 microversion: 2.1 time: 0.702983 May 28 21:03:15.342230 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 58/101] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:03:14 2022] POST /compute/v2.1/flavors/28070521/action => generated 124 bytes in 711 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:03:15.360367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-21c37d4f-f931-448e-b753-947a0690800e tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:15.407746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-979efd8d-d52f-41ad-ae78-f6d5157094ec tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:15.418888 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-979efd8d-d52f-41ad-ae78-f6d5157094ec tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1278 microversion: 2.1 time: 0.241561 May 28 21:03:15.433383 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 44/102] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:15 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1278 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:15.464693 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-21c37d4f-f931-448e-b753-947a0690800e tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/28070521" status: 202 len: 0 microversion: 2.1 time: 0.116860 May 28 21:03:15.465277 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 59/103] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:03:15 2022] DELETE /compute/v2.1/flavors/28070521 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:03:15.474852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-63b59d1e-626c-46e0-9fd0-e8943fb0dbcf tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:15.513125 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-63b59d1e-626c-46e0-9fd0-e8943fb0dbcf tempest-FlavorsAccessNegativeTestJSON-1342488242 tempest-FlavorsAccessNegativeTestJSON-1342488242-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033741 May 28 21:03:15.514017 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 45/104] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:03:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:15.849880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e1309945-c5be-4c8f-84c0-69b680c5adb1 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:15.851163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e1309945-c5be-4c8f-84c0-69b680c5adb1 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:15.884799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1309945-c5be-4c8f-84c0-69b680c5adb1 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:15.884799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1309945-c5be-4c8f-84c0-69b680c5adb1 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:15.884799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1309945-c5be-4c8f-84c0-69b680c5adb1 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:15.884799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1309945-c5be-4c8f-84c0-69b680c5adb1 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:16.443126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-71a60eb4-d853-46e0-9112-3653a96f2502 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:16.445236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-71a60eb4-d853-46e0-9112-3653a96f2502 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:16.456869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71a60eb4-d853-46e0-9112-3653a96f2502 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:16.457393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71a60eb4-d853-46e0-9112-3653a96f2502 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:16.458301 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71a60eb4-d853-46e0-9112-3653a96f2502 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:16.459772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71a60eb4-d853-46e0-9112-3653a96f2502 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:17.252516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e1309945-c5be-4c8f-84c0-69b680c5adb1 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:17.260232 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e1309945-c5be-4c8f-84c0-69b680c5adb1 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 1.414706 May 28 21:03:17.262517 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 60/105] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:15 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:17.276804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-71a60eb4-d853-46e0-9112-3653a96f2502 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:17.285476 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-71a60eb4-d853-46e0-9112-3653a96f2502 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1320 microversion: 2.1 time: 0.847637 May 28 21:03:17.286097 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 46/106] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:16 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1320 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:18.279641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-40fa3fd6-f8c5-4b9d-b46e-dcdca19ae073 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:18.280411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-40fa3fd6-f8c5-4b9d-b46e-dcdca19ae073 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:18.306150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7df5745f-eb24-4c2b-b124-30db09b605af tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:18.306786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7df5745f-eb24-4c2b-b124-30db09b605af tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:18.311213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40fa3fd6-f8c5-4b9d-b46e-dcdca19ae073 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:18.311663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40fa3fd6-f8c5-4b9d-b46e-dcdca19ae073 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:18.340000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7df5745f-eb24-4c2b-b124-30db09b605af tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:18.340590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7df5745f-eb24-4c2b-b124-30db09b605af tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:18.342454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40fa3fd6-f8c5-4b9d-b46e-dcdca19ae073 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:18.342995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40fa3fd6-f8c5-4b9d-b46e-dcdca19ae073 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:18.356765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7df5745f-eb24-4c2b-b124-30db09b605af tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:18.358890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7df5745f-eb24-4c2b-b124-30db09b605af tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:19.285688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:19.691296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-40fa3fd6-f8c5-4b9d-b46e-dcdca19ae073 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:19.707497 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-40fa3fd6-f8c5-4b9d-b46e-dcdca19ae073 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 1.432429 May 28 21:03:19.708111 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 61/107] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:18 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:19.726838 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-464ef842-af06-47d6-8cd8-8072cf285e1e req-e1a192b1-8a85-4695-b632-5b4fbc533475 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d5fc1f-9d70-4c86-a832-7efdfa840264", "tag": "f2c60ad1-91a8-4f62-80cc-17fecb0b2cca"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:19.750645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7df5745f-eb24-4c2b-b124-30db09b605af tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:19.762403 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7df5745f-eb24-4c2b-b124-30db09b605af tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1320 microversion: 2.1 time: 1.461559 May 28 21:03:19.766924 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 47/108] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:18 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1320 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:19.767848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-464ef842-af06-47d6-8cd8-8072cf285e1e req-e1a192b1-8a85-4695-b632-5b4fbc533475 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:19.768604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-464ef842-af06-47d6-8cd8-8072cf285e1e req-e1a192b1-8a85-4695-b632-5b4fbc533475 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:19.805912 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-464ef842-af06-47d6-8cd8-8072cf285e1e req-e1a192b1-8a85-4695-b632-5b4fbc533475 service nova] Creating event network-changed:f2c60ad1-91a8-4f62-80cc-17fecb0b2cca for instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 on nch2-master-1 May 28 21:03:19.805912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-464ef842-af06-47d6-8cd8-8072cf285e1e req-e1a192b1-8a85-4695-b632-5b4fbc533475 service nova] Acquired lock "compute-rpcapi-router" {{(pid=143128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 21:03:19.805912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a87e010-51d8-4a5d-a454-a710808c728b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:19.805912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a87e010-51d8-4a5d-a454-a710808c728b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:19.805912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a87e010-51d8-4a5d-a454-a710808c728b None None] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:19.806314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a87e010-51d8-4a5d-a454-a710808c728b None None] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:19.823347 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.compute.rpcapi [None req-9a87e010-51d8-4a5d-a454-a710808c728b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 28 21:03:19.830989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a87e010-51d8-4a5d-a454-a710808c728b None None] Releasing lock "compute-rpcapi-router" {{(pid=143128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 21:03:19.879386 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9a87e010-51d8-4a5d-a454-a710808c728b None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166384 May 28 21:03:19.886033 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 62/109] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:20.728984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-19135f06-d301-4cf4-ad5e-2d2e7a2281a4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:20.734906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-19135f06-d301-4cf4-ad5e-2d2e7a2281a4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:20.758149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19135f06-d301-4cf4-ad5e-2d2e7a2281a4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:20.763349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19135f06-d301-4cf4-ad5e-2d2e7a2281a4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:20.768079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19135f06-d301-4cf4-ad5e-2d2e7a2281a4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:20.768767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19135f06-d301-4cf4-ad5e-2d2e7a2281a4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:20.805333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-455e7f11-3da9-4c4c-af8b-e5e9b32fe338 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:20.807330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-455e7f11-3da9-4c4c-af8b-e5e9b32fe338 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:20.824505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-455e7f11-3da9-4c4c-af8b-e5e9b32fe338 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:20.827350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:20.829493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-455e7f11-3da9-4c4c-af8b-e5e9b32fe338 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:20.830368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-455e7f11-3da9-4c4c-af8b-e5e9b32fe338 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:20.830821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-455e7f11-3da9-4c4c-af8b-e5e9b32fe338 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:21.219448 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=14 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:21.746572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=12 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:21.988714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-455e7f11-3da9-4c4c-af8b-e5e9b32fe338 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:21.996804 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-455e7f11-3da9-4c4c-af8b-e5e9b32fe338 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1320 microversion: 2.1 time: 1.217760 May 28 21:03:22.012035 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 63/110] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:20 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1320 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:22.094934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-19135f06-d301-4cf4-ad5e-2d2e7a2281a4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:22.105708 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-19135f06-d301-4cf4-ad5e-2d2e7a2281a4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 1.384793 May 28 21:03:22.120763 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 48/111] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:20 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:23.025174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5d1d6c2b-f094-4a34-8ee1-7615a444dddb tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:23.025797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5d1d6c2b-f094-4a34-8ee1-7615a444dddb tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:23.034476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d1d6c2b-f094-4a34-8ee1-7615a444dddb tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:23.034928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d1d6c2b-f094-4a34-8ee1-7615a444dddb tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:23.038588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d1d6c2b-f094-4a34-8ee1-7615a444dddb tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:23.038588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d1d6c2b-f094-4a34-8ee1-7615a444dddb tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:23.095056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=89 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:23.123989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-81b343a5-eb69-40f5-92fe-0b74378614d4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:23.124623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-81b343a5-eb69-40f5-92fe-0b74378614d4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:23.135895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81b343a5-eb69-40f5-92fe-0b74378614d4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:23.136362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81b343a5-eb69-40f5-92fe-0b74378614d4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:23.141925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81b343a5-eb69-40f5-92fe-0b74378614d4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:23.142488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81b343a5-eb69-40f5-92fe-0b74378614d4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:23.439841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5d1d6c2b-f094-4a34-8ee1-7615a444dddb tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:23.461351 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5d1d6c2b-f094-4a34-8ee1-7615a444dddb tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1320 microversion: 2.1 time: 0.440663 May 28 21:03:23.466388 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 64/112] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:23 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1320 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:23.590296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-81b343a5-eb69-40f5-92fe-0b74378614d4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:23.599530 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-81b343a5-eb69-40f5-92fe-0b74378614d4 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 0.480915 May 28 21:03:23.600735 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 49/113] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:23 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:24.621792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-48f93b4a-7a0d-4a7b-9287-884025e5ae63 tempest-InstanceUsageAuditLogTestJSON-2115615575 tempest-InstanceUsageAuditLogTestJSON-2115615575-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:24.621792 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:24.621792 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:24.721266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1a9bd1ac-9c6f-464b-8c85-cdf2922e9fac tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:24.722012 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-48f93b4a-7a0d-4a7b-9287-884025e5ae63 tempest-InstanceUsageAuditLogTestJSON-2115615575 tempest-InstanceUsageAuditLogTestJSON-2115615575-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-28 21:03:23" status: 200 len: 318 microversion: 2.1 time: 1.115087 May 28 21:03:24.722432 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1a9bd1ac-9c6f-464b-8c85-cdf2922e9fac tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.941807 May 28 21:03:24.722613 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 65/114] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 21:03:23 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-28%2021%3A03%3A23 => generated 318 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:24.722934 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 50/115] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:03:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:24.723298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-099dd2bc-3a25-4d09-9b66-1f57aa141fb2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:24.723298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-099dd2bc-3a25-4d09-9b66-1f57aa141fb2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:24.726885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5c9603bd-2941-4b12-a684-4b6345fda3cd tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:24.727025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5c9603bd-2941-4b12-a684-4b6345fda3cd tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:24.748425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c9603bd-2941-4b12-a684-4b6345fda3cd tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:24.753662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-099dd2bc-3a25-4d09-9b66-1f57aa141fb2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:24.754759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c9603bd-2941-4b12-a684-4b6345fda3cd tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:24.755937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-099dd2bc-3a25-4d09-9b66-1f57aa141fb2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:24.757251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c9603bd-2941-4b12-a684-4b6345fda3cd tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:24.759437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-099dd2bc-3a25-4d09-9b66-1f57aa141fb2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:24.759702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c9603bd-2941-4b12-a684-4b6345fda3cd tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:24.761539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-099dd2bc-3a25-4d09-9b66-1f57aa141fb2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:25.203823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5c9603bd-2941-4b12-a684-4b6345fda3cd tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:25.207213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-099dd2bc-3a25-4d09-9b66-1f57aa141fb2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:25.212487 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5c9603bd-2941-4b12-a684-4b6345fda3cd tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 0.504220 May 28 21:03:25.213072 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 51/116] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:24 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:25.225519 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-099dd2bc-3a25-4d09-9b66-1f57aa141fb2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1320 microversion: 2.1 time: 0.527448 May 28 21:03:25.225705 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 66/117] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:24 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1320 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:25.239176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9c8bbd0e-9b2f-47cf-b7ec-eb07afcd8cc8 tempest-InstanceUsageAuditLogTestJSON-2115615575 tempest-InstanceUsageAuditLogTestJSON-2115615575-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:25.243636 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:25.243636 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:25.261230 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9c8bbd0e-9b2f-47cf-b7ec-eb07afcd8cc8 tempest-InstanceUsageAuditLogTestJSON-2115615575 tempest-InstanceUsageAuditLogTestJSON-2115615575-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.029913 May 28 21:03:25.262208 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 67/118] 10.222.0.33 () {58 vars in 1184 bytes} [Sat May 28 21:03:25 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:25.418132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-87f22717-cb7e-4a59-a51b-c3e860a6c061 tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1208088989", "id": 1952902279, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:25.419732 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:25.419732 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:25.653928 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-87f22717-cb7e-4a59-a51b-c3e860a6c061 tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.439201 May 28 21:03:25.655058 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 52/119] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:03:25 2022] POST /compute/v2.1/flavors => generated 425 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:25.676442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b6c4ff31-50ba-4e23-b2af-775dc99d9cc9 tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:25.704546 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b6c4ff31-50ba-4e23-b2af-775dc99d9cc9 tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.039619 May 28 21:03:25.707413 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 53/120] 10.222.0.33 () {58 vars in 1181 bytes} [Sat May 28 21:03:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:03:25.718120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-59340648-8ca9-4b08-811f-33ef5d92432d tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-142094913", "id": 1455677346, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:25.804853 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-59340648-8ca9-4b08-811f-33ef5d92432d tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.091026 May 28 21:03:25.809248 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 54/121] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:03:25 2022] POST /compute/v2.1/flavors => generated 424 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:25.820979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-16f12e53-b29e-49a0-913a-d5cee1efbbc2 tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:25.830811 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-16f12e53-b29e-49a0-913a-d5cee1efbbc2 tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014339 May 28 21:03:25.832171 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 55/122] 10.222.0.33 () {58 vars in 1181 bytes} [Sat May 28 21:03:25 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:03:25.846810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2780d273-7a65-42ea-a6ab-6248de1992e2 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Action: 'create', calling method: .version_select at 0x7f4d64ca1790>, body: {"keypair": {"name": "tempest-keypair-1501955601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMChduTpRRp6NM6rQA0LeMUfiXtGFYolir2I2MtIebuzFX15ecCAIcNc3UsiXlaM0YyqwMM0JCIpNspga0i4fVcLFn9udiV21pjk2ZvwPqYHi58xZ4LRSHB9Ow7mketXmw=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:25.946917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-2780d273-7a65-42ea-a6ab-6248de1992e2 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Getting quotas for project 0e60b122ef584254b06fd8258c987f8d. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:03:25.961485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-2780d273-7a65-42ea-a6ab-6248de1992e2 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Getting quotas for user cdeaa660f8ec465bba68096d0ed4b1ae and project 0e60b122ef584254b06fd8258c987f8d. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:03:26.114649 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2780d273-7a65-42ea-a6ab-6248de1992e2 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.272718 May 28 21:03:26.116927 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 56/123] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:03:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:03:26.231024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ca522c23-9aa8-403d-a5c2-2518c32ba947 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:26.231878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ca522c23-9aa8-403d-a5c2-2518c32ba947 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:26.244459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca522c23-9aa8-403d-a5c2-2518c32ba947 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:26.247133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca522c23-9aa8-403d-a5c2-2518c32ba947 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:26.253118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca522c23-9aa8-403d-a5c2-2518c32ba947 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:26.253911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca522c23-9aa8-403d-a5c2-2518c32ba947 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:26.574883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ca522c23-9aa8-403d-a5c2-2518c32ba947 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:26.585652 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ca522c23-9aa8-403d-a5c2-2518c32ba947 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 0.360072 May 28 21:03:26.587044 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 57/124] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:26 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:26.593603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-28bc285d-0b7b-47ef-98ee-66bc5e3a842a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:26.594406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-28bc285d-0b7b-47ef-98ee-66bc5e3a842a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:26.604515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28bc285d-0b7b-47ef-98ee-66bc5e3a842a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:26.605195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28bc285d-0b7b-47ef-98ee-66bc5e3a842a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:26.606251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28bc285d-0b7b-47ef-98ee-66bc5e3a842a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:26.606834 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28bc285d-0b7b-47ef-98ee-66bc5e3a842a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:26.651090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fca4e9d7-71e4-4f1a-90f0-994c99b5d697 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Calling method '.version_select at 0x7f4d64c0e040>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:26.651090 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:26.651090 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:26.651090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fca4e9d7-71e4-4f1a-90f0-994c99b5d697 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '753243d6136d43e9904bdeed3bddfd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812177ca96534d55a6eedb917b146b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fca4e9d7-71e4-4f1a-90f0-994c99b5d697 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Request method failure captured: May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4ZvgrjypVP6z8qwVsFFAdSyou8fjpFmm0ZW2P3PAoJrN2Slde9NU_yw3DSm2V7lEMbjN2Jmxv-V6vxrHS4YR0R1jmq_llB4zB_iGbslIgelikHEq2K_6AJd6EYzEiwSDpQ54-tlhy02LJNDZFagdOyxMjy-B5Oi-Sg4ukW6uInaPg May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 812177ca96534d55a6eedb917b146b66 May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1650428005 May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:03:26.664925 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:03:26.666575 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_812177ca96534d55a6eedb917b146b66", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/812177ca96534d55a6eedb917b146b66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/812177ca96534d55a6eedb917b146b66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/812177ca96534d55a6eedb917b146b66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:26.666575 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1650428005 May 28 21:03:26.666575 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 812177ca96534d55a6eedb917b146b66 May 28 21:03:26.666575 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1650428005 May 28 21:03:26.666575 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HypervisorAdminNegativeTestJSON-1650428005-project May 28 21:03:26.666575 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:03:26.666575 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:03:26.666575 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 753243d6136d43e9904bdeed3bddfd99 May 28 21:03:26.666575 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1650428005-project May 28 21:03:26.666575 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:03:26.666575 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 28 21:03:26.666575 ncdv-master-1 devstack@n-api.service[143128]: action_args: {} May 28 21:03:26.666575 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._detail(req) May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:03:26.667365 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. May 28 21:03:26.668599 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:26.674183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fca4e9d7-71e4-4f1a-90f0-994c99b5d697 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:26.674745 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fca4e9d7-71e4-4f1a-90f0-994c99b5d697 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 1.410801 May 28 21:03:26.675256 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 68/125] 10.222.0.33 () {58 vars in 1166 bytes} [Sat May 28 21:03:25 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 1412 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:03:26.693570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-36d87d8d-c124-46f6-a849-14840f4ebbdc tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Calling method '.version_select at 0x7f4d64bcc0d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:26.711173 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:26.711173 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:26.712502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-36d87d8d-c124-46f6-a849-14840f4ebbdc tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '753243d6136d43e9904bdeed3bddfd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812177ca96534d55a6eedb917b146b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-36d87d8d-c124-46f6-a849-14840f4ebbdc tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Request method failure captured: May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4ZvgrjypVP6z8qwVsFFAdSyou8fjpFmm0ZW2P3PAoJrN2Slde9NU_yw3DSm2V7lEMbjN2Jmxv-V6vxrHS4YR0R1jmq_llB4zB_iGbslIgelikHEq2K_6AJd6EYzEiwSDpQ54-tlhy02LJNDZFagdOyxMjy-B5Oi-Sg4ukW6uInaPg May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 812177ca96534d55a6eedb917b146b66 May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1650428005 May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:03:26.725153 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:03:26.726492 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_812177ca96534d55a6eedb917b146b66", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/812177ca96534d55a6eedb917b146b66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/812177ca96534d55a6eedb917b146b66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/812177ca96534d55a6eedb917b146b66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:26.726492 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1650428005 May 28 21:03:26.726492 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 812177ca96534d55a6eedb917b146b66 May 28 21:03:26.726492 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1650428005 May 28 21:03:26.726492 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HypervisorAdminNegativeTestJSON-1650428005-project May 28 21:03:26.726492 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:03:26.726492 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:03:26.726492 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 753243d6136d43e9904bdeed3bddfd99 May 28 21:03:26.726492 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1650428005-project May 28 21:03:26.726492 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:03:26.726492 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 28 21:03:26.726492 ncdv-master-1 devstack@n-api.service[143128]: action_args: {} May 28 21:03:26.726492 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._index(req) May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:03:26.727181 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. May 28 21:03:26.728194 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:26.729187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-36d87d8d-c124-46f6-a849-14840f4ebbdc tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:26.729187 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-36d87d8d-c124-46f6-a849-14840f4ebbdc tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.045680 May 28 21:03:26.729187 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 69/126] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:03:26 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:03:26.750382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-896de2a5-3c99-4d71-ae55-19a9b44297c0 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Calling method '.version_select at 0x7f4d64c0ef70>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:26.751175 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:26.751175 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:26.752274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-896de2a5-3c99-4d71-ae55-19a9b44297c0 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '753243d6136d43e9904bdeed3bddfd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812177ca96534d55a6eedb917b146b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-896de2a5-3c99-4d71-ae55-19a9b44297c0 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Request method failure captured: May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4ZvgrjypVP6z8qwVsFFAdSyou8fjpFmm0ZW2P3PAoJrN2Slde9NU_yw3DSm2V7lEMbjN2Jmxv-V6vxrHS4YR0R1jmq_llB4zB_iGbslIgelikHEq2K_6AJd6EYzEiwSDpQ54-tlhy02LJNDZFagdOyxMjy-B5Oi-Sg4ukW6uInaPg May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 812177ca96534d55a6eedb917b146b66 May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1650428005 May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:03:26.766454 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:03:26.768361 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_812177ca96534d55a6eedb917b146b66", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/812177ca96534d55a6eedb917b146b66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/812177ca96534d55a6eedb917b146b66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/812177ca96534d55a6eedb917b146b66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:26.768361 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1650428005 May 28 21:03:26.768361 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 812177ca96534d55a6eedb917b146b66 May 28 21:03:26.768361 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1650428005 May 28 21:03:26.768361 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HypervisorAdminNegativeTestJSON-1650428005-project May 28 21:03:26.768361 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:03:26.768361 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:03:26.768361 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 753243d6136d43e9904bdeed3bddfd99 May 28 21:03:26.768361 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1650428005-project May 28 21:03:26.768361 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:03:26.768361 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 28 21:03:26.768361 ncdv-master-1 devstack@n-api.service[143128]: action_args: {} May 28 21:03:26.768361 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:03:26.775475 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. May 28 21:03:26.777804 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:26.779009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-896de2a5-3c99-4d71-ae55-19a9b44297c0 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:26.779009 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-896de2a5-3c99-4d71-ae55-19a9b44297c0 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.027743 May 28 21:03:26.779009 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 70/127] 10.222.0.33 () {58 vars in 1178 bytes} [Sat May 28 21:03:26 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:03:26.842707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-28bc285d-0b7b-47ef-98ee-66bc5e3a842a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:26.855214 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-28bc285d-0b7b-47ef-98ee-66bc5e3a842a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1320 microversion: 2.1 time: 0.266554 May 28 21:03:26.857742 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 58/128] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:26 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1320 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:27.490125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8e32259d-1acb-4c63-aa4e-86af6091fbe4 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Calling method '.version_select at 0x7f4d64c5dd30>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:27.492588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e32259d-1acb-4c63-aa4e-86af6091fbe4 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:27.493190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e32259d-1acb-4c63-aa4e-86af6091fbe4 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:27.528773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e32259d-1acb-4c63-aa4e-86af6091fbe4 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:27.529237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e32259d-1acb-4c63-aa4e-86af6091fbe4 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:27.555053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e32259d-1acb-4c63-aa4e-86af6091fbe4 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:27.556979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e32259d-1acb-4c63-aa4e-86af6091fbe4 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:27.571489 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8e32259d-1acb-4c63-aa4e-86af6091fbe4 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.791475 May 28 21:03:27.575596 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 71/129] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:03:26 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:27.586647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-980c9232-4ad5-4046-a9c2-f2726eba6030 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Calling method '.version_select at 0x7f4d64f76e50>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:27.589054 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:27.589054 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:27.590551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-980c9232-4ad5-4046-a9c2-f2726eba6030 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '753243d6136d43e9904bdeed3bddfd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812177ca96534d55a6eedb917b146b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-980c9232-4ad5-4046-a9c2-f2726eba6030 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Request method failure captured: May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4ZvgrjypVP6z8qwVsFFAdSyou8fjpFmm0ZW2P3PAoJrN2Slde9NU_yw3DSm2V7lEMbjN2Jmxv-V6vxrHS4YR0R1jmq_llB4zB_iGbslIgelikHEq2K_6AJd6EYzEiwSDpQ54-tlhy02LJNDZFagdOyxMjy-B5Oi-Sg4ukW6uInaPg May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 812177ca96534d55a6eedb917b146b66 May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1650428005 May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:03:27.592801 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:03:27.593967 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_812177ca96534d55a6eedb917b146b66", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/812177ca96534d55a6eedb917b146b66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/812177ca96534d55a6eedb917b146b66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/812177ca96534d55a6eedb917b146b66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:27.593967 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1650428005 May 28 21:03:27.593967 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 812177ca96534d55a6eedb917b146b66 May 28 21:03:27.593967 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1650428005 May 28 21:03:27.593967 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-HypervisorAdminNegativeTestJSON-1650428005-project May 28 21:03:27.593967 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:03:27.593967 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:03:27.593967 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 753243d6136d43e9904bdeed3bddfd99 May 28 21:03:27.593967 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1650428005-project May 28 21:03:27.593967 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:03:27.593967 ncdv-master-1 devstack@n-api.service[143129]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 28 21:03:27.593967 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '1'} May 28 21:03:27.593967 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:03:27.597608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. May 28 21:03:27.598657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:27.599497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-980c9232-4ad5-4046-a9c2-f2726eba6030 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:27.599497 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-980c9232-4ad5-4046-a9c2-f2726eba6030 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.012222 May 28 21:03:27.609733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bc46ce3e-49fe-4d5a-9748-755fa97fc376 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:27.610501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bc46ce3e-49fe-4d5a-9748-755fa97fc376 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:27.619460 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 59/130] 10.222.0.33 () {58 vars in 1172 bytes} [Sat May 28 21:03:27 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:03:27.628368 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ea65d6e1-c38a-4735-ad92-9f05c1f4275d tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Calling method '.version_select at 0x7f4d64ca10d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:27.636872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc46ce3e-49fe-4d5a-9748-755fa97fc376 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:27.638138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc46ce3e-49fe-4d5a-9748-755fa97fc376 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:27.638726 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-ea65d6e1-c38a-4735-ad92-9f05c1f4275d tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] HTTP exception thrown: Hypervisor with ID '051b6584-fc0f-423a-8544-9bfbe1922212' could not be found. May 28 21:03:27.640324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc46ce3e-49fe-4d5a-9748-755fa97fc376 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:27.646923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc46ce3e-49fe-4d5a-9748-755fa97fc376 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ea65d6e1-c38a-4735-ad92-9f05c1f4275d tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Request method failure captured: May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/os-hypervisors/051b6584-fc0f-423a-8544-9bfbe1922212/uptime HTTP/1.1 May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4csDREqnq0hyrSkowib5JGSQoH6bLlvGMBsF5J3tu0_e-07XoIPVRQqalTl2apouRZHhk89OWSPUclX8qmeBVVJLDPNf69KBb3PtV5sWUH2bVfNCJNtMku-BkZCA9KQJzuPQQXE44byV9Hi_Ch_iDn4Tb186pft0KMZ6TM7QHhJeQ May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 9397ab700e3b472597d1462ad128d87f May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-372239771 May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:03:27.656089 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:03:27.657279 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9397ab700e3b472597d1462ad128d87f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9397ab700e3b472597d1462ad128d87f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9397ab700e3b472597d1462ad128d87f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9397ab700e3b472597d1462ad128d87f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:27.657279 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-372239771 May 28 21:03:27.657279 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 9397ab700e3b472597d1462ad128d87f May 28 21:03:27.657279 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-372239771 May 28 21:03:27.657279 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin May 28 21:03:27.657279 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:03:27.657279 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:03:27.657279 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 5c05235c31c84ed99ed6e18a9f9d9c9c May 28 21:03:27.657279 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin May 28 21:03:27.657279 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:03:27.657279 ncdv-master-1 devstack@n-api.service[143129]: exception: Hypervisor with ID '051b6584-fc0f-423a-8544-9bfbe1922212' could not be found. May 28 21:03:27.657279 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '051b6584-fc0f-423a-8544-9bfbe1922212'} May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '051b6584-fc0f-423a-8544-9bfbe1922212' May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 28 21:03:27.657959 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '051b6584-fc0f-423a-8544-9bfbe1922212' could not be found. May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:27.664412 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:27.665757 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:27.665757 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:27.665757 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:27.665757 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:03:27.665757 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:03:27.665757 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '051b6584-fc0f-423a-8544-9bfbe1922212' could not be found. May 28 21:03:27.665757 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:27.665757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ea65d6e1-c38a-4735-ad92-9f05c1f4275d tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Returning 404 to user: Hypervisor with ID '051b6584-fc0f-423a-8544-9bfbe1922212' could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:27.665757 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ea65d6e1-c38a-4735-ad92-9f05c1f4275d tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/051b6584-fc0f-423a-8544-9bfbe1922212/uptime" status: 404 len: 123 microversion: 2.1 time: 0.037582 May 28 21:03:27.665757 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 60/131] 10.222.0.33 () {58 vars in 1277 bytes} [Sat May 28 21:03:27 2022] GET /compute/v2.1/os-hypervisors/051b6584-fc0f-423a-8544-9bfbe1922212/uptime => generated 123 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:03:27.693744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-01f0b69f-b1f2-4687-84dc-34716cf36e15 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Calling method '.version_select at 0x7f4d64ca1040>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:27.699577 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:27.699577 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:27.706083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01f0b69f-b1f2-4687-84dc-34716cf36e15 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:27.710028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01f0b69f-b1f2-4687-84dc-34716cf36e15 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:27.773602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01f0b69f-b1f2-4687-84dc-34716cf36e15 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:27.776881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01f0b69f-b1f2-4687-84dc-34716cf36e15 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:27.806702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01f0b69f-b1f2-4687-84dc-34716cf36e15 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:27.808934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01f0b69f-b1f2-4687-84dc-34716cf36e15 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:27.825508 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-01f0b69f-b1f2-4687-84dc-34716cf36e15 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.157693 May 28 21:03:27.833055 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 61/132] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:03:27 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:27.848080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0f6fe844-70f2-4578-8a10-460eb31e2541 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Calling method '.version_select at 0x7f4d673dadc0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:27.851258 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:27.851258 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:27.855785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0f6fe844-70f2-4578-8a10-460eb31e2541 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '753243d6136d43e9904bdeed3bddfd99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '812177ca96534d55a6eedb917b146b66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0f6fe844-70f2-4578-8a10-460eb31e2541 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Request method failure captured: May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4ZvgrjypVP6z8qwVsFFAdSyou8fjpFmm0ZW2P3PAoJrN2Slde9NU_yw3DSm2V7lEMbjN2Jmxv-V6vxrHS4YR0R1jmq_llB4zB_iGbslIgelikHEq2K_6AJd6EYzEiwSDpQ54-tlhy02LJNDZFagdOyxMjy-B5Oi-Sg4ukW6uInaPg May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 812177ca96534d55a6eedb917b146b66 May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1650428005 May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:03:27.859375 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:03:27.860537 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_812177ca96534d55a6eedb917b146b66", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/812177ca96534d55a6eedb917b146b66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/812177ca96534d55a6eedb917b146b66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/812177ca96534d55a6eedb917b146b66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:27.860537 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1650428005 May 28 21:03:27.860537 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 812177ca96534d55a6eedb917b146b66 May 28 21:03:27.860537 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1650428005 May 28 21:03:27.860537 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-HypervisorAdminNegativeTestJSON-1650428005-project May 28 21:03:27.860537 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:03:27.860537 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:03:27.860537 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 753243d6136d43e9904bdeed3bddfd99 May 28 21:03:27.860537 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1650428005-project May 28 21:03:27.860537 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:03:27.860537 ncdv-master-1 devstack@n-api.service[143129]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 28 21:03:27.860537 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '1'} May 28 21:03:27.860537 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:03:27.861564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. May 28 21:03:27.862718 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:27.864939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0f6fe844-70f2-4578-8a10-460eb31e2541 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:27.891874 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0f6fe844-70f2-4578-8a10-460eb31e2541 tempest-HypervisorAdminNegativeTestJSON-1650428005 tempest-HypervisorAdminNegativeTestJSON-1650428005-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.024757 May 28 21:03:27.894147 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 62/133] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:03:27 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:03:27.917626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-19373537-a59e-4047-af07-5d2661828e18 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:27.923912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-19373537-a59e-4047-af07-5d2661828e18 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:27.963912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19373537-a59e-4047-af07-5d2661828e18 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:27.964566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19373537-a59e-4047-af07-5d2661828e18 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:27.965723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19373537-a59e-4047-af07-5d2661828e18 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:27.973102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19373537-a59e-4047-af07-5d2661828e18 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:28.328286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bc46ce3e-49fe-4d5a-9748-755fa97fc376 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:28.372477 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bc46ce3e-49fe-4d5a-9748-755fa97fc376 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 0.768943 May 28 21:03:28.372477 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 72/134] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:27 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:28.376200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-19373537-a59e-4047-af07-5d2661828e18 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:28.386691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4d7fa5a4-7aa7-4017-b273-95e6bf2fa9c9 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Calling method '.version_select at 0x7f4d64bcc5e0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:28.387863 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:28.387863 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:28.388185 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-19373537-a59e-4047-af07-5d2661828e18 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1320 microversion: 2.1 time: 0.492398 May 28 21:03:28.389108 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 63/135] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:27 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1320 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:28.400764 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-4d7fa5a4-7aa7-4017-b273-95e6bf2fa9c9 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] HTTP exception thrown: Hypervisor with ID '135d985a-c1ad-47f6-acfb-9a21ac619c8c' could not be found. May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4d7fa5a4-7aa7-4017-b273-95e6bf2fa9c9 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Request method failure captured: May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-hypervisors/135d985a-c1ad-47f6-acfb-9a21ac619c8c HTTP/1.1 May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4csDREqnq0hyrSkowib5JGSQoH6bLlvGMBsF5J3tu0_e-07XoIPVRQqalTl2apouRZHhk89OWSPUclX8qmeBVVJLDPNf69KBb3PtV5sWUH2bVfNCJNtMku-BkZCA9KQJzuPQQXE44byV9Hi_Ch_iDn4Tb186pft0KMZ6TM7QHhJeQ May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 9397ab700e3b472597d1462ad128d87f May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-372239771 May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:03:28.404835 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:03:28.406354 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9397ab700e3b472597d1462ad128d87f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9397ab700e3b472597d1462ad128d87f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9397ab700e3b472597d1462ad128d87f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9397ab700e3b472597d1462ad128d87f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:28.406354 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-372239771 May 28 21:03:28.406354 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 9397ab700e3b472597d1462ad128d87f May 28 21:03:28.406354 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-372239771 May 28 21:03:28.406354 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin May 28 21:03:28.406354 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:03:28.406354 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:03:28.406354 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 5c05235c31c84ed99ed6e18a9f9d9c9c May 28 21:03:28.406354 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin May 28 21:03:28.406354 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:03:28.406354 ncdv-master-1 devstack@n-api.service[143128]: exception: Hypervisor with ID '135d985a-c1ad-47f6-acfb-9a21ac619c8c' could not be found. May 28 21:03:28.406354 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '135d985a-c1ad-47f6-acfb-9a21ac619c8c'} May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi value = int(str(value)) May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '135d985a-c1ad-47f6-acfb-9a21ac619c8c' May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 509, in validate_integer May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise ValueError(msg) May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer May 28 21:03:28.407151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 21:03:28.408588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '135d985a-c1ad-47f6-acfb-9a21ac619c8c' could not be found. May 28 21:03:28.410037 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:28.410037 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:28.410037 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:28.410037 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:28.410037 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:28.410037 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:28.410037 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:03:28.410037 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:03:28.410037 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '135d985a-c1ad-47f6-acfb-9a21ac619c8c' could not be found. May 28 21:03:28.410037 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:28.410037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4d7fa5a4-7aa7-4017-b273-95e6bf2fa9c9 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] Returning 404 to user: Hypervisor with ID '135d985a-c1ad-47f6-acfb-9a21ac619c8c' could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:28.410037 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4d7fa5a4-7aa7-4017-b273-95e6bf2fa9c9 tempest-HypervisorAdminNegativeTestJSON-372239771 tempest-HypervisorAdminNegativeTestJSON-372239771-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/135d985a-c1ad-47f6-acfb-9a21ac619c8c" status: 404 len: 123 microversion: 2.1 time: 0.033069 May 28 21:03:28.418473 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 73/136] 10.222.0.33 () {58 vars in 1256 bytes} [Sat May 28 21:03:28 2022] GET /compute/v2.1/os-hypervisors/135d985a-c1ad-47f6-acfb-9a21ac619c8c => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:03:29.387130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c12f35bc-12f6-4b65-a2f9-5116167e96b8 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:29.387749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c12f35bc-12f6-4b65-a2f9-5116167e96b8 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:29.398446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c12f35bc-12f6-4b65-a2f9-5116167e96b8 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:29.399152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c12f35bc-12f6-4b65-a2f9-5116167e96b8 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:29.401621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c12f35bc-12f6-4b65-a2f9-5116167e96b8 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:29.402833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c12f35bc-12f6-4b65-a2f9-5116167e96b8 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:29.409430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-59de4c0d-f817-4b97-8ed2-767806a27877 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:29.415052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-59de4c0d-f817-4b97-8ed2-767806a27877 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:29.424934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59de4c0d-f817-4b97-8ed2-767806a27877 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:29.425894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59de4c0d-f817-4b97-8ed2-767806a27877 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:29.427038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59de4c0d-f817-4b97-8ed2-767806a27877 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:29.427889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59de4c0d-f817-4b97-8ed2-767806a27877 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:29.715463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c12f35bc-12f6-4b65-a2f9-5116167e96b8 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:29.723968 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c12f35bc-12f6-4b65-a2f9-5116167e96b8 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 0.340595 May 28 21:03:29.736277 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 64/137] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:29 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:29.751623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-59de4c0d-f817-4b97-8ed2-767806a27877 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:29.762188 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-59de4c0d-f817-4b97-8ed2-767806a27877 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1320 microversion: 2.1 time: 0.357351 May 28 21:03:29.774298 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 74/138] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:29 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1320 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:30.125068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1892357033", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "1455677346", "adminPass": "***", "networks": [{"uuid": "97ecda77-65a2-49eb-8d73-e28ced3f1a19"}], "security_groups": [{"name": "tempest-securitygroup--2017529550"}], "key_name": "tempest-keypair-1501955601", "user_data": "}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:30.279956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] validate_networks() for [('97ecda77-65a2-49eb-8d73-e28ced3f1a19', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:03:30.526983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:31.218925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8d14a5ad-e085-4583-91d5-c1fc69ac897a tempest-FlavorMetadataValidation-1553533262 tempest-FlavorMetadataValidation-1553533262-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-811785880", "id": 234054546, "os-flavor-access:is_public": "True"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:31.220666 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:31.220666 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:31.328802 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8d14a5ad-e085-4583-91d5-c1fc69ac897a tempest-FlavorMetadataValidation-1553533262 tempest-FlavorMetadataValidation-1553533262-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.814326 May 28 21:03:31.339165 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 75/139] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:03:30 2022] POST /compute/v2.1/flavors => generated 467 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:03:31.339165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dea4e8b7-23f6-4ec8-86b5-295b29254c3f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:31.339165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dea4e8b7-23f6-4ec8-86b5-295b29254c3f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:31.344075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dea4e8b7-23f6-4ec8-86b5-295b29254c3f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:31.344532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dea4e8b7-23f6-4ec8-86b5-295b29254c3f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:31.345315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dea4e8b7-23f6-4ec8-86b5-295b29254c3f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:31.345760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dea4e8b7-23f6-4ec8-86b5-295b29254c3f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:31.687038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dea4e8b7-23f6-4ec8-86b5-295b29254c3f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:31.694943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:03:31.696629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:03:31.697234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:03:31.697754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:03:31.698233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:03:31.708432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:31.708905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:31.709708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:31.710206 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dea4e8b7-23f6-4ec8-86b5-295b29254c3f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 0.379221 May 28 21:03:31.710384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:31.712669 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 76/140] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:31 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:31.724553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-072e33b0-b38c-44ad-8394-46c0bc9eb2a3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:31.726361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-072e33b0-b38c-44ad-8394-46c0bc9eb2a3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:31.730088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Getting quotas for project 0e60b122ef584254b06fd8258c987f8d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:03:31.734818 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Getting quotas for user cdeaa660f8ec465bba68096d0ed4b1ae and project 0e60b122ef584254b06fd8258c987f8d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:03:31.744293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-072e33b0-b38c-44ad-8394-46c0bc9eb2a3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:31.744806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-072e33b0-b38c-44ad-8394-46c0bc9eb2a3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:31.745759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-072e33b0-b38c-44ad-8394-46c0bc9eb2a3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:31.753898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-072e33b0-b38c-44ad-8394-46c0bc9eb2a3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:31.756524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:03:31.759207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:03:31.897932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-072e33b0-b38c-44ad-8394-46c0bc9eb2a3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:31.905922 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-072e33b0-b38c-44ad-8394-46c0bc9eb2a3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1320 microversion: 2.1 time: 0.189750 May 28 21:03:31.906504 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 77/141] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:31 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1320 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:31.911499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c945075-27df-48f5-86d2-2b30674b1605 tempest-FlavorMetadataValidation-1553533262 tempest-FlavorMetadataValidation-1553533262-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:31.913931 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:31.913931 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:31.925362 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9912bff9-cebe-4deb-b66f-2492494ada72 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.808298 May 28 21:03:31.931710 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 65/142] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:03:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:03:32.217750 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3c945075-27df-48f5-86d2-2b30674b1605 tempest-FlavorMetadataValidation-1553533262 tempest-FlavorMetadataValidation-1553533262-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/234054546/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.309906 May 28 21:03:32.223652 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 78/143] 10.222.0.33 () {62 vars in 1261 bytes} [Sat May 28 21:03:31 2022] POST /compute/v2.1/flavors/234054546/os-extra_specs => generated 62 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:32.230902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1dcd2b77-a127-4cff-9b19-7d17d9e70dba tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:32.231797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1dcd2b77-a127-4cff-9b19-7d17d9e70dba tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:32.299024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1dcd2b77-a127-4cff-9b19-7d17d9e70dba tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:32.307745 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1dcd2b77-a127-4cff-9b19-7d17d9e70dba tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 200 len: 1265 microversion: 2.1 time: 0.080727 May 28 21:03:32.308151 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 79/144] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:32 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:32.322385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1f5c5e74-1c10-4cd3-af30-d61101fd8683 tempest-FlavorMetadataValidation-1553533262 tempest-FlavorMetadataValidation-1553533262-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:32.323249 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:32.323249 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:32.332439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1859849875", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:32.394097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:03:32.435843 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1f5c5e74-1c10-4cd3-af30-d61101fd8683 tempest-FlavorMetadataValidation-1553533262 tempest-FlavorMetadataValidation-1553533262-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/234054546" status: 202 len: 0 microversion: 2.86 time: 0.126302 May 28 21:03:32.436419 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 80/145] 10.222.0.33 () {60 vars in 1198 bytes} [Sat May 28 21:03:32 2022] DELETE /compute/v2.1/flavors/234054546 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 21:03:32.505453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-3401e007-9b75-4393-85c5-18ae2d9c0047 req-a4adbbea-73aa-4ee3-b8fb-ec8be46dac8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d5fc1f-9d70-4c86-a832-7efdfa840264", "name": "network-vif-plugged", "status": "completed", "tag": "f2c60ad1-91a8-4f62-80cc-17fecb0b2cca"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:32.514188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3401e007-9b75-4393-85c5-18ae2d9c0047 req-a4adbbea-73aa-4ee3-b8fb-ec8be46dac8d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:32.514961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3401e007-9b75-4393-85c5-18ae2d9c0047 req-a4adbbea-73aa-4ee3-b8fb-ec8be46dac8d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:32.527605 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-3401e007-9b75-4393-85c5-18ae2d9c0047 req-a4adbbea-73aa-4ee3-b8fb-ec8be46dac8d service nova] Creating event network-vif-plugged:f2c60ad1-91a8-4f62-80cc-17fecb0b2cca for instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 on nch2-master-1 May 28 21:03:32.533123 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-3401e007-9b75-4393-85c5-18ae2d9c0047 req-a4adbbea-73aa-4ee3-b8fb-ec8be46dac8d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095520 May 28 21:03:32.534145 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 81/146] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:32.539295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-64fd1d38-69b6-4060-af97-3f5b209dd538 tempest-FlavorMetadataValidation-1553533262 tempest-FlavorMetadataValidation-1553533262-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:32.560737 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-64fd1d38-69b6-4060-af97-3f5b209dd538 tempest-FlavorMetadataValidation-1553533262 tempest-FlavorMetadataValidation-1553533262-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6684 microversion: 2.86 time: 0.025302 May 28 21:03:32.561570 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 82/147] 10.222.0.33 () {60 vars in 1186 bytes} [Sat May 28 21:03:32 2022] GET /compute/v2.1/flavors/detail => generated 6684 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:32.691017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:03:32.691446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:03:32.691930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:03:32.692342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:03:32.692755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:03:32.707255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:32.718377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:32.718377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:32.718377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:32.730561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8031d918-2c7b-42a5-9b3a-d69cf82b18bb tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:32.731936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8031d918-2c7b-42a5-9b3a-d69cf82b18bb tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:32.738856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Getting quotas for project d6c38a96a96b4fba9e41ac58f5054803. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:03:32.744808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Getting quotas for user c14b965da64c40e382c69050ba01b183 and project d6c38a96a96b4fba9e41ac58f5054803. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:03:32.748333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8031d918-2c7b-42a5-9b3a-d69cf82b18bb tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:32.748802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8031d918-2c7b-42a5-9b3a-d69cf82b18bb tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:32.753418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8031d918-2c7b-42a5-9b3a-d69cf82b18bb tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:32.753418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8031d918-2c7b-42a5-9b3a-d69cf82b18bb tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:32.759028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:03:32.761495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:03:32.887713 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dc0fde1c-7d7f-4969-8e18-ed30890c0ee3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.960063 May 28 21:03:32.894545 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 66/148] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:03:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:03:32.901024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-10494122-655a-4e92-8c06-55b7f9f4eb1c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:32.901656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-10494122-655a-4e92-8c06-55b7f9f4eb1c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:32.912398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:33.057810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-10494122-655a-4e92-8c06-55b7f9f4eb1c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:33.073617 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-10494122-655a-4e92-8c06-55b7f9f4eb1c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1213 microversion: 2.1 time: 0.177562 May 28 21:03:33.074241 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 67/149] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:32 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1213 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:33.087909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-45862056-7d8e-40bf-8449-c315f43cc979 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:33.088514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-45862056-7d8e-40bf-8449-c315f43cc979 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:33.095474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-45862056-7d8e-40bf-8449-c315f43cc979 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:33.096218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-45862056-7d8e-40bf-8449-c315f43cc979 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:33.096893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-45862056-7d8e-40bf-8449-c315f43cc979 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:33.097319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-45862056-7d8e-40bf-8449-c315f43cc979 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:33.114088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8031d918-2c7b-42a5-9b3a-d69cf82b18bb tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:33.139555 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8031d918-2c7b-42a5-9b3a-d69cf82b18bb tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 0.414535 May 28 21:03:33.140818 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 83/150] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:32 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:33.326004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-39ed8254-fe6d-4e90-9749-7fee4a128dd0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:33.327051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-39ed8254-fe6d-4e90-9749-7fee4a128dd0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:33.334784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39ed8254-fe6d-4e90-9749-7fee4a128dd0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:33.335977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39ed8254-fe6d-4e90-9749-7fee4a128dd0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:33.336976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39ed8254-fe6d-4e90-9749-7fee4a128dd0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:33.337494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39ed8254-fe6d-4e90-9749-7fee4a128dd0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:33.341773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-45862056-7d8e-40bf-8449-c315f43cc979 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:33.355473 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-45862056-7d8e-40bf-8449-c315f43cc979 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1320 microversion: 2.1 time: 0.268114 May 28 21:03:33.355473 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 68/151] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:33 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1320 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:33.416614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-39ed8254-fe6d-4e90-9749-7fee4a128dd0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:33.425107 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-39ed8254-fe6d-4e90-9749-7fee4a128dd0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 200 len: 1291 microversion: 2.1 time: 0.103558 May 28 21:03:33.425788 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 84/152] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:33 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 1291 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:34.091267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-68052867-7281-4643-84a4-dd6630ae492f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:34.092476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-68052867-7281-4643-84a4-dd6630ae492f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:34.156593 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4246edc0-c03f-48bc-9bce-cf81f6ae7d12 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:34.157676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-68052867-7281-4643-84a4-dd6630ae492f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:34.157896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4246edc0-c03f-48bc-9bce-cf81f6ae7d12 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:34.164418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4246edc0-c03f-48bc-9bce-cf81f6ae7d12 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:34.166441 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-68052867-7281-4643-84a4-dd6630ae492f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1213 microversion: 2.1 time: 0.078962 May 28 21:03:34.167506 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 69/153] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:34 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:34.170150 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4246edc0-c03f-48bc-9bce-cf81f6ae7d12 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:34.171188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4246edc0-c03f-48bc-9bce-cf81f6ae7d12 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:34.171842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4246edc0-c03f-48bc-9bce-cf81f6ae7d12 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:34.341259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4246edc0-c03f-48bc-9bce-cf81f6ae7d12 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:34.355396 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4246edc0-c03f-48bc-9bce-cf81f6ae7d12 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 0.202411 May 28 21:03:34.356596 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 85/154] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:34 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:34.370634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc31eae7-8804-4482-8118-4e606f8c1a2a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:34.371458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc31eae7-8804-4482-8118-4e606f8c1a2a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:34.378370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc31eae7-8804-4482-8118-4e606f8c1a2a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:34.378821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc31eae7-8804-4482-8118-4e606f8c1a2a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:34.379596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc31eae7-8804-4482-8118-4e606f8c1a2a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:34.380032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc31eae7-8804-4482-8118-4e606f8c1a2a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:34.452712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9fc58f55-fa54-4fd0-9904-9e39251f4774 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:34.453586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9fc58f55-fa54-4fd0-9904-9e39251f4774 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:34.471354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9fc58f55-fa54-4fd0-9904-9e39251f4774 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:34.472069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9fc58f55-fa54-4fd0-9904-9e39251f4774 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:34.473018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9fc58f55-fa54-4fd0-9904-9e39251f4774 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:34.473612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9fc58f55-fa54-4fd0-9904-9e39251f4774 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:34.604965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9fc58f55-fa54-4fd0-9904-9e39251f4774 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:34.619919 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9fc58f55-fa54-4fd0-9904-9e39251f4774 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 200 len: 1339 microversion: 2.1 time: 0.170989 May 28 21:03:34.621600 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 86/155] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:34 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 1339 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:34.657822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc31eae7-8804-4482-8118-4e606f8c1a2a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:34.668526 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc31eae7-8804-4482-8118-4e606f8c1a2a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1320 microversion: 2.1 time: 0.302653 May 28 21:03:34.680637 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 70/156] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:34 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:34.918525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-544292515", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:35.083267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:03:35.185125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dfae39cd-8a17-4edb-8994-e56718d102b9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:35.186404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dfae39cd-8a17-4edb-8994-e56718d102b9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:35.195715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dfae39cd-8a17-4edb-8994-e56718d102b9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:35.196402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dfae39cd-8a17-4edb-8994-e56718d102b9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:35.197631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dfae39cd-8a17-4edb-8994-e56718d102b9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:35.198389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dfae39cd-8a17-4edb-8994-e56718d102b9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:35.289050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dfae39cd-8a17-4edb-8994-e56718d102b9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:35.296885 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dfae39cd-8a17-4edb-8994-e56718d102b9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1287 microversion: 2.1 time: 0.115959 May 28 21:03:35.297466 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 71/157] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:35 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:35.374661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-18d11d4f-9984-488d-a625-6351c498ff87 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:35.375394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-18d11d4f-9984-488d-a625-6351c498ff87 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:35.382751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-18d11d4f-9984-488d-a625-6351c498ff87 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:35.385282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-18d11d4f-9984-488d-a625-6351c498ff87 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:35.385282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-18d11d4f-9984-488d-a625-6351c498ff87 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:35.385282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-18d11d4f-9984-488d-a625-6351c498ff87 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:35.391039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:03:35.391512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:03:35.392357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:03:35.392973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:03:35.393466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:03:35.409358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:35.409882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:35.411326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:35.411781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:35.447186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Getting quotas for project b6c7378af3e841f58fdf1a907d06bc08. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:03:35.454155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Getting quotas for user 0e733cc9497a48cba4ccdde860be104f and project b6c7378af3e841f58fdf1a907d06bc08. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:03:35.468245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:03:35.471972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:03:35.573864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-18d11d4f-9984-488d-a625-6351c498ff87 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:35.584040 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-18d11d4f-9984-488d-a625-6351c498ff87 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 0.213336 May 28 21:03:35.584535 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 72/158] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:35 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:35.646047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f31fbe2b-1059-4a52-b11a-57a616521d05 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:35.647006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f31fbe2b-1059-4a52-b11a-57a616521d05 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:35.658730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f31fbe2b-1059-4a52-b11a-57a616521d05 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:35.658949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f31fbe2b-1059-4a52-b11a-57a616521d05 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:35.667884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f31fbe2b-1059-4a52-b11a-57a616521d05 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:35.671856 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-14c20941-73f5-4c02-a669-53b3e9e5633b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.905770 May 28 21:03:35.672596 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 87/159] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:03:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:03:35.679930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f31fbe2b-1059-4a52-b11a-57a616521d05 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:35.690241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6d489135-0a2e-453b-aa9a-f6f1ca1b1fde tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:35.694818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6d489135-0a2e-453b-aa9a-f6f1ca1b1fde tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:35.710616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:DELETE=7,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:35.796597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6d489135-0a2e-453b-aa9a-f6f1ca1b1fde tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:35.825707 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6d489135-0a2e-453b-aa9a-f6f1ca1b1fde tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1218 microversion: 2.1 time: 0.144801 May 28 21:03:35.841271 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 88/160] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:35 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:35.854916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-336f0e27-53f4-4aec-b33e-c3fac1c1c6f0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:35.856422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f31fbe2b-1059-4a52-b11a-57a616521d05 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:35.857953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-336f0e27-53f4-4aec-b33e-c3fac1c1c6f0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:35.865333 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f31fbe2b-1059-4a52-b11a-57a616521d05 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 200 len: 1345 microversion: 2.1 time: 0.224675 May 28 21:03:35.870609 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 73/161] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:35 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 1345 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:35.873986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-336f0e27-53f4-4aec-b33e-c3fac1c1c6f0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:35.874687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-336f0e27-53f4-4aec-b33e-c3fac1c1c6f0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:35.876776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-336f0e27-53f4-4aec-b33e-c3fac1c1c6f0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:35.878281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-336f0e27-53f4-4aec-b33e-c3fac1c1c6f0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:36.130881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-336f0e27-53f4-4aec-b33e-c3fac1c1c6f0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:36.143102 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-336f0e27-53f4-4aec-b33e-c3fac1c1c6f0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1470 microversion: 2.1 time: 0.304448 May 28 21:03:36.144160 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 89/162] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:35 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:36.157646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-5ed64908-0447-47bf-a1cc-ece8b46e50ad req-ca6ab315-785e-470e-9ecc-c9b37e244ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0ba50c-cc90-4921-9fd4-b612903c5b1d", "name": "network-vif-plugged", "status": "completed", "tag": "d321012d-93e1-483f-9d36-9dd314faf3c8"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:36.169800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5ed64908-0447-47bf-a1cc-ece8b46e50ad req-ca6ab315-785e-470e-9ecc-c9b37e244ae8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:36.170833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5ed64908-0447-47bf-a1cc-ece8b46e50ad req-ca6ab315-785e-470e-9ecc-c9b37e244ae8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:36.198172 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-5ed64908-0447-47bf-a1cc-ece8b46e50ad req-ca6ab315-785e-470e-9ecc-c9b37e244ae8 service nova] Creating event network-vif-plugged:d321012d-93e1-483f-9d36-9dd314faf3c8 for instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d on nch1-master-1 May 28 21:03:36.220531 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-5ed64908-0447-47bf-a1cc-ece8b46e50ad req-ca6ab315-785e-470e-9ecc-c9b37e244ae8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064941 May 28 21:03:36.221707 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 74/163] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:36.317568 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a371aa09-510b-4d53-8daf-10066087107b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:36.318835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a371aa09-510b-4d53-8daf-10066087107b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:36.337108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a371aa09-510b-4d53-8daf-10066087107b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:36.340175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a371aa09-510b-4d53-8daf-10066087107b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:36.340175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a371aa09-510b-4d53-8daf-10066087107b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:36.341489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a371aa09-510b-4d53-8daf-10066087107b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:36.474366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a371aa09-510b-4d53-8daf-10066087107b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:36.482100 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a371aa09-510b-4d53-8daf-10066087107b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1305 microversion: 2.1 time: 0.171064 May 28 21:03:36.487765 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 75/164] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:36 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1305 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:36.559944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-30207ef5-bba8-4a1f-b76d-cbd864d7423a tempest-DeleteServersAdminTestJSON-1492394443 tempest-DeleteServersAdminTestJSON-1492394443-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:36.561190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-30207ef5-bba8-4a1f-b76d-cbd864d7423a tempest-DeleteServersAdminTestJSON-1492394443 tempest-DeleteServersAdminTestJSON-1492394443-project-admin] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:36.568653 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30207ef5-bba8-4a1f-b76d-cbd864d7423a tempest-DeleteServersAdminTestJSON-1492394443 tempest-DeleteServersAdminTestJSON-1492394443-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:36.569855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30207ef5-bba8-4a1f-b76d-cbd864d7423a tempest-DeleteServersAdminTestJSON-1492394443 tempest-DeleteServersAdminTestJSON-1492394443-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:36.570665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30207ef5-bba8-4a1f-b76d-cbd864d7423a tempest-DeleteServersAdminTestJSON-1492394443 tempest-DeleteServersAdminTestJSON-1492394443-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:36.571273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30207ef5-bba8-4a1f-b76d-cbd864d7423a tempest-DeleteServersAdminTestJSON-1492394443 tempest-DeleteServersAdminTestJSON-1492394443-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:36.601578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ec8fdc18-ea46-496f-9408-0a92bb3e4b6f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:36.602127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ec8fdc18-ea46-496f-9408-0a92bb3e4b6f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:36.610005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec8fdc18-ea46-496f-9408-0a92bb3e4b6f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:36.610675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec8fdc18-ea46-496f-9408-0a92bb3e4b6f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:36.612904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec8fdc18-ea46-496f-9408-0a92bb3e4b6f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:36.613613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec8fdc18-ea46-496f-9408-0a92bb3e4b6f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:36.649897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-30207ef5-bba8-4a1f-b76d-cbd864d7423a tempest-DeleteServersAdminTestJSON-1492394443 tempest-DeleteServersAdminTestJSON-1492394443-project-admin] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:03:36.996379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ec8fdc18-ea46-496f-9408-0a92bb3e4b6f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:37.007826 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ec8fdc18-ea46-496f-9408-0a92bb3e4b6f tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 0.411052 May 28 21:03:37.018771 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 76/165] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:36 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:37.024295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4857e245-b011-4d86-9a90-79333367a684 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:37.024919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4857e245-b011-4d86-9a90-79333367a684 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:37.030186 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-30207ef5-bba8-4a1f-b76d-cbd864d7423a tempest-DeleteServersAdminTestJSON-1492394443 tempest-DeleteServersAdminTestJSON-1492394443-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 204 len: 0 microversion: 2.1 time: 0.861633 May 28 21:03:37.031361 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 90/166] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:03:36 2022] DELETE /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:03:37.042633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4a26bd28-c197-484c-85fe-11a9bdf2590f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:37.043799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4a26bd28-c197-484c-85fe-11a9bdf2590f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:37.053711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a26bd28-c197-484c-85fe-11a9bdf2590f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:37.054778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a26bd28-c197-484c-85fe-11a9bdf2590f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:37.056335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a26bd28-c197-484c-85fe-11a9bdf2590f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:37.056986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a26bd28-c197-484c-85fe-11a9bdf2590f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:37.123149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4857e245-b011-4d86-9a90-79333367a684 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:37.135217 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4857e245-b011-4d86-9a90-79333367a684 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1218 microversion: 2.1 time: 0.115151 May 28 21:03:37.151286 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 77/167] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:37 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:37.154242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b7d73bd2-1f53-4e58-a6ae-cff1d3af0a8a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:37.155283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b7d73bd2-1f53-4e58-a6ae-cff1d3af0a8a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:37.163592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7d73bd2-1f53-4e58-a6ae-cff1d3af0a8a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:37.164347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7d73bd2-1f53-4e58-a6ae-cff1d3af0a8a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:37.164841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7d73bd2-1f53-4e58-a6ae-cff1d3af0a8a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:37.165525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7d73bd2-1f53-4e58-a6ae-cff1d3af0a8a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:37.288898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4a26bd28-c197-484c-85fe-11a9bdf2590f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:37.298060 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4a26bd28-c197-484c-85fe-11a9bdf2590f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 200 len: 1413 microversion: 2.1 time: 0.264303 May 28 21:03:37.299606 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 91/168] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:37 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 1413 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:37.364613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b7d73bd2-1f53-4e58-a6ae-cff1d3af0a8a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:37.380612 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b7d73bd2-1f53-4e58-a6ae-cff1d3af0a8a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1476 microversion: 2.1 time: 0.232000 May 28 21:03:37.386680 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 78/169] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:37 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1476 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:37.504624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e70bd46c-b7e0-4b6d-b508-0b48ab54348a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:37.505245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e70bd46c-b7e0-4b6d-b508-0b48ab54348a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:37.512094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e70bd46c-b7e0-4b6d-b508-0b48ab54348a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:37.512543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e70bd46c-b7e0-4b6d-b508-0b48ab54348a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:37.513348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e70bd46c-b7e0-4b6d-b508-0b48ab54348a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:37.513783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e70bd46c-b7e0-4b6d-b508-0b48ab54348a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:37.546465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:37.611317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e70bd46c-b7e0-4b6d-b508-0b48ab54348a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:37.620135 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e70bd46c-b7e0-4b6d-b508-0b48ab54348a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1293 microversion: 2.1 time: 0.119208 May 28 21:03:37.621040 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 92/170] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:37 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1293 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:38.024470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ac504961-2058-404f-b5e1-4ec94d5a5d4d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:38.025092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ac504961-2058-404f-b5e1-4ec94d5a5d4d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:38.031678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac504961-2058-404f-b5e1-4ec94d5a5d4d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:38.032110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac504961-2058-404f-b5e1-4ec94d5a5d4d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:38.033049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac504961-2058-404f-b5e1-4ec94d5a5d4d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:38.033488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac504961-2058-404f-b5e1-4ec94d5a5d4d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:38.193616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-87723258-4ba1-46c2-8f40-a1c19a022273 tempest-FlavorsV255TestJSON-670541660 tempest-FlavorsV255TestJSON-670541660-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-428333500", "id": 340906342, "os-flavor-access:is_public": "True"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:38.199037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ac504961-2058-404f-b5e1-4ec94d5a5d4d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:38.204655 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:38.204655 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:38.216586 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ac504961-2058-404f-b5e1-4ec94d5a5d4d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1339 microversion: 2.1 time: 0.195826 May 28 21:03:38.218460 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 93/171] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:38 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1339 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:38.223861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-bad1dcca-1495-4a65-b180-1c7d2d2ef63d req-0b3595ed-1fa3-4d4d-8ba5-1b56c0f93803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02214efd-8392-465b-bd6a-d658850d4f15", "tag": "23b08d0d-93fe-4fe9-9644-d306caa2b456"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:38.233817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-bad1dcca-1495-4a65-b180-1c7d2d2ef63d req-0b3595ed-1fa3-4d4d-8ba5-1b56c0f93803 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:38.235745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-bad1dcca-1495-4a65-b180-1c7d2d2ef63d req-0b3595ed-1fa3-4d4d-8ba5-1b56c0f93803 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:38.261767 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-bad1dcca-1495-4a65-b180-1c7d2d2ef63d req-0b3595ed-1fa3-4d4d-8ba5-1b56c0f93803 service nova] Creating event network-changed:23b08d0d-93fe-4fe9-9644-d306caa2b456 for instance 02214efd-8392-465b-bd6a-d658850d4f15 on nch1-master-1 May 28 21:03:38.267231 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-bad1dcca-1495-4a65-b180-1c7d2d2ef63d req-0b3595ed-1fa3-4d4d-8ba5-1b56c0f93803 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048851 May 28 21:03:38.267932 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 94/172] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:38.273772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-339883e3-9463-4f0c-b408-e2c3c8dff04c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:38.281683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-339883e3-9463-4f0c-b408-e2c3c8dff04c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:38.314402 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-87723258-4ba1-46c2-8f40-a1c19a022273 tempest-FlavorsV255TestJSON-670541660 tempest-FlavorsV255TestJSON-670541660-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.303364 May 28 21:03:38.315134 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 79/173] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:03:38 2022] POST /compute/v2.1/flavors => generated 445 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 21:03:38.323555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-694b4b02-d626-4919-a8ad-bbf2520fe495 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:38.323766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-339883e3-9463-4f0c-b408-e2c3c8dff04c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:38.325692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-694b4b02-d626-4919-a8ad-bbf2520fe495 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:38.325862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-339883e3-9463-4f0c-b408-e2c3c8dff04c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:38.326930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-339883e3-9463-4f0c-b408-e2c3c8dff04c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:38.327605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-339883e3-9463-4f0c-b408-e2c3c8dff04c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:38.342272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-694b4b02-d626-4919-a8ad-bbf2520fe495 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:38.343057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-694b4b02-d626-4919-a8ad-bbf2520fe495 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:38.344208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-694b4b02-d626-4919-a8ad-bbf2520fe495 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:38.345094 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-694b4b02-d626-4919-a8ad-bbf2520fe495 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:38.350442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:38.556542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-339883e3-9463-4f0c-b408-e2c3c8dff04c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:38.577977 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-339883e3-9463-4f0c-b408-e2c3c8dff04c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1222 microversion: 2.1 time: 0.306843 May 28 21:03:38.578789 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 95/174] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:38 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1222 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:38.673860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-694b4b02-d626-4919-a8ad-bbf2520fe495 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:38.683682 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-694b4b02-d626-4919-a8ad-bbf2520fe495 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 200 len: 1413 microversion: 2.1 time: 0.367109 May 28 21:03:38.689081 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 80/175] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:38 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 1413 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:38.695337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a3e94620-6644-4e44-a406-6e3204025ef3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:38.697535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a3e94620-6644-4e44-a406-6e3204025ef3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:38.704974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3e94620-6644-4e44-a406-6e3204025ef3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:38.705541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3e94620-6644-4e44-a406-6e3204025ef3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:38.706446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3e94620-6644-4e44-a406-6e3204025ef3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:38.707104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3e94620-6644-4e44-a406-6e3204025ef3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:38.813431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9e4be5c5-eddd-497c-a97b-3c0c86d3ff62 tempest-FlavorsV255TestJSON-1484497959 tempest-FlavorsV255TestJSON-1484497959-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:38.829273 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9e4be5c5-eddd-497c-a97b-3c0c86d3ff62 tempest-FlavorsV255TestJSON-1484497959 tempest-FlavorsV255TestJSON-1484497959-project] 10.222.0.33 "GET /compute/v2.1/flavors/340906342" status: 200 len: 445 microversion: 2.55 time: 0.248030 May 28 21:03:38.830216 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 96/176] 10.222.0.33 () {60 vars in 1195 bytes} [Sat May 28 21:03:38 2022] GET /compute/v2.1/flavors/340906342 => generated 445 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:03:38.835975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-abddbf8e-8de4-403f-9290-9fda3af51810 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:38.836834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-abddbf8e-8de4-403f-9290-9fda3af51810 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:38.844186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abddbf8e-8de4-403f-9290-9fda3af51810 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:38.845011 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abddbf8e-8de4-403f-9290-9fda3af51810 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:38.846091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abddbf8e-8de4-403f-9290-9fda3af51810 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:38.846814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abddbf8e-8de4-403f-9290-9fda3af51810 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:38.896150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a3e94620-6644-4e44-a406-6e3204025ef3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:38.908718 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a3e94620-6644-4e44-a406-6e3204025ef3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1476 microversion: 2.1 time: 0.218019 May 28 21:03:38.909578 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 81/177] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:38 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1476 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:38.972515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1386522898", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "a8cad774-f5d9-4630-8882-1fcbf23ca116"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:39.010390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-abddbf8e-8de4-403f-9290-9fda3af51810 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:39.020691 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-abddbf8e-8de4-403f-9290-9fda3af51810 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1335 microversion: 2.1 time: 0.189221 May 28 21:03:39.021279 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 97/178] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:38 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1335 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:39.027245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a0ad76d1-8a74-4df5-8f8b-18c11ed68d98 tempest-FlavorsV255TestJSON-670541660 tempest-FlavorsV255TestJSON-670541660-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:39.037704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] validate_networks() for [('a8cad774-f5d9-4630-8882-1fcbf23ca116', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:03:39.043476 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:39.043476 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:39.121716 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a0ad76d1-8a74-4df5-8f8b-18c11ed68d98 tempest-FlavorsV255TestJSON-670541660 tempest-FlavorsV255TestJSON-670541660-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/340906342" status: 200 len: 446 microversion: 2.55 time: 0.097970 May 28 21:03:39.122393 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 98/179] 10.222.0.33 () {62 vars in 1215 bytes} [Sat May 28 21:03:39 2022] PUT /compute/v2.1/flavors/340906342 => generated 446 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:03:39.134081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c09774bf-194a-4149-9dcc-a76bf72d5635 tempest-FlavorsV255TestJSON-1484497959 tempest-FlavorsV255TestJSON-1484497959-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:39.156263 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c09774bf-194a-4149-9dcc-a76bf72d5635 tempest-FlavorsV255TestJSON-1484497959 tempest-FlavorsV255TestJSON-1484497959-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6592 microversion: 2.55 time: 0.026466 May 28 21:03:39.156999 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 99/180] 10.222.0.33 () {60 vars in 1186 bytes} [Sat May 28 21:03:39 2022] GET /compute/v2.1/flavors/detail => generated 6592 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:39.176954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-90254a34-5358-4d8d-b417-f95dcbe4f91a tempest-FlavorsV255TestJSON-1484497959 tempest-FlavorsV255TestJSON-1484497959-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:39.198127 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-90254a34-5358-4d8d-b417-f95dcbe4f91a tempest-FlavorsV255TestJSON-1484497959 tempest-FlavorsV255TestJSON-1484497959-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 3682 microversion: 2.55 time: 0.025288 May 28 21:03:39.207628 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 100/181] 10.222.0.33 () {60 vars in 1165 bytes} [Sat May 28 21:03:39 2022] GET /compute/v2.1/flavors => generated 3682 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:39.222590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-81f82ef3-48a0-4015-9b29-c4bdf08c7668 tempest-FlavorsV255TestJSON-670541660 tempest-FlavorsV255TestJSON-670541660-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:39.223361 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:39.223361 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:39.299561 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-81f82ef3-48a0-4015-9b29-c4bdf08c7668 tempest-FlavorsV255TestJSON-670541660 tempest-FlavorsV255TestJSON-670541660-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/340906342" status: 202 len: 0 microversion: 2.55 time: 0.084378 May 28 21:03:39.300641 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 101/182] 10.222.0.33 () {60 vars in 1198 bytes} [Sat May 28 21:03:39 2022] DELETE /compute/v2.1/flavors/340906342 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 21:03:39.305630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0303af2a-f97c-45dc-81ab-f96798218826 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:39.306284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0303af2a-f97c-45dc-81ab-f96798218826 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:39.312537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0303af2a-f97c-45dc-81ab-f96798218826 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:39.312992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0303af2a-f97c-45dc-81ab-f96798218826 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:39.313771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0303af2a-f97c-45dc-81ab-f96798218826 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:39.314243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0303af2a-f97c-45dc-81ab-f96798218826 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:39.570736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:03:39.571280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:03:39.571782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:03:39.572207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:03:39.572646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:03:39.586535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:39.587496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:39.588441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:39.589105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:39.624807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0303af2a-f97c-45dc-81ab-f96798218826 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:39.635262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Getting quotas for project 45a2b4e7e1484ea3807bc8d8bc31296c. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:03:39.636640 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0303af2a-f97c-45dc-81ab-f96798218826 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1488 microversion: 2.1 time: 0.334629 May 28 21:03:39.637151 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 102/183] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:39 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1488 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:39.641420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Getting quotas for user fc6ee6dba5d24e90bff48384539fcd7f and project 45a2b4e7e1484ea3807bc8d8bc31296c. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:03:39.653271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a3626252-40b8-4fcc-bb6a-5a2f1f9175bb tempest-FlavorsV255TestJSON-670541660 tempest-FlavorsV255TestJSON-670541660-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:39.654354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:03:39.657692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:03:39.677466 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a3626252-40b8-4fcc-bb6a-5a2f1f9175bb tempest-FlavorsV255TestJSON-670541660 tempest-FlavorsV255TestJSON-670541660-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 6156 microversion: 2.55 time: 0.038936 May 28 21:03:39.679592 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 103/184] 10.222.0.33 () {60 vars in 1186 bytes} [Sat May 28 21:03:39 2022] GET /compute/v2.1/flavors/detail => generated 6156 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:39.685004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-638eb087-7d0c-4598-8ae6-cf6f86d63968 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:39.685831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-638eb087-7d0c-4598-8ae6-cf6f86d63968 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:39.699913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-638eb087-7d0c-4598-8ae6-cf6f86d63968 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:39.705791 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-638eb087-7d0c-4598-8ae6-cf6f86d63968 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:39.705791 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-638eb087-7d0c-4598-8ae6-cf6f86d63968 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:39.705791 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-638eb087-7d0c-4598-8ae6-cf6f86d63968 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:39.819350 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ac471cd6-47f0-40a9-96a3-cc568e2f6166 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.908145 May 28 21:03:39.820868 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 82/185] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:03:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 21:03:39.830485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9bd7b8e9-3952-49cf-8168-34b89931025c tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:39.831389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9bd7b8e9-3952-49cf-8168-34b89931025c tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:39.842440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bd7b8e9-3952-49cf-8168-34b89931025c tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:39.845314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bd7b8e9-3952-49cf-8168-34b89931025c tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:39.847125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bd7b8e9-3952-49cf-8168-34b89931025c tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:39.847824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bd7b8e9-3952-49cf-8168-34b89931025c tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:39.867650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-638eb087-7d0c-4598-8ae6-cf6f86d63968 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:39.881358 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-638eb087-7d0c-4598-8ae6-cf6f86d63968 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1288 microversion: 2.1 time: 0.200357 May 28 21:03:39.884761 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 104/186] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:39 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1288 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:39.905111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-66665990-642f-4277-bd20-1e6ba00fa11a tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:39.910249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-66665990-642f-4277-bd20-1e6ba00fa11a tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:39.930620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-66665990-642f-4277-bd20-1e6ba00fa11a tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:39.933016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-66665990-642f-4277-bd20-1e6ba00fa11a tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:39.935025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-66665990-642f-4277-bd20-1e6ba00fa11a tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:39.944736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-66665990-642f-4277-bd20-1e6ba00fa11a tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:40.343844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-66665990-642f-4277-bd20-1e6ba00fa11a tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:40.353598 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-66665990-642f-4277-bd20-1e6ba00fa11a tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 200 len: 1413 microversion: 2.1 time: 0.467730 May 28 21:03:40.358431 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 105/187] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:39 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 1413 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:40.363300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3e23ab9b-55fb-473d-9c74-3ce61533582c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:40.365262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3e23ab9b-55fb-473d-9c74-3ce61533582c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:40.458190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3e23ab9b-55fb-473d-9c74-3ce61533582c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:40.467401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3e23ab9b-55fb-473d-9c74-3ce61533582c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:40.471150 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3e23ab9b-55fb-473d-9c74-3ce61533582c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:40.477327 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3e23ab9b-55fb-473d-9c74-3ce61533582c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1262 microversion: 2.25 time: 0.117244 May 28 21:03:40.477327 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 106/188] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:03:40 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1262 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:40.488788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-24e04a7f-e674-4fdb-beff-a7ed31d52ecc tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:40.490476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-24e04a7f-e674-4fdb-beff-a7ed31d52ecc tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:40.504735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24e04a7f-e674-4fdb-beff-a7ed31d52ecc tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:40.506256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24e04a7f-e674-4fdb-beff-a7ed31d52ecc tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:40.507777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24e04a7f-e674-4fdb-beff-a7ed31d52ecc tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:40.508340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24e04a7f-e674-4fdb-beff-a7ed31d52ecc tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:40.599237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-24e04a7f-e674-4fdb-beff-a7ed31d52ecc tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:40.609221 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-24e04a7f-e674-4fdb-beff-a7ed31d52ecc tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 200 len: 1305 microversion: 2.1 time: 0.133548 May 28 21:03:40.613470 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 107/189] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:40 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 1305 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:40.629278 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eec2d6b5-09e2-41e6-8964-cfc5c503e3e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:40.630479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eec2d6b5-09e2-41e6-8964-cfc5c503e3e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:40.639656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eec2d6b5-09e2-41e6-8964-cfc5c503e3e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:40.641144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eec2d6b5-09e2-41e6-8964-cfc5c503e3e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:40.642327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eec2d6b5-09e2-41e6-8964-cfc5c503e3e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:40.643009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eec2d6b5-09e2-41e6-8964-cfc5c503e3e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:40.646143 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9bd7b8e9-3952-49cf-8168-34b89931025c tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1639 microversion: 2.1 time: 0.823611 May 28 21:03:40.646753 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 83/190] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:39 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1639 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:40.681467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-65032edc-8684-487c-8109-461baa06dd99 req-f7bc7afb-d9a1-49a9-aae3-0e2321f3302a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d5fc1f-9d70-4c86-a832-7efdfa840264", "name": "network-vif-deleted", "tag": "f2c60ad1-91a8-4f62-80cc-17fecb0b2cca"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:40.712760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-65032edc-8684-487c-8109-461baa06dd99 req-f7bc7afb-d9a1-49a9-aae3-0e2321f3302a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:40.714820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-65032edc-8684-487c-8109-461baa06dd99 req-f7bc7afb-d9a1-49a9-aae3-0e2321f3302a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:40.733691 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-65032edc-8684-487c-8109-461baa06dd99 req-f7bc7afb-d9a1-49a9-aae3-0e2321f3302a service nova] Creating event network-vif-deleted:f2c60ad1-91a8-4f62-80cc-17fecb0b2cca for instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 on nch2-master-1 May 28 21:03:40.740604 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-65032edc-8684-487c-8109-461baa06dd99 req-f7bc7afb-d9a1-49a9-aae3-0e2321f3302a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069867 May 28 21:03:40.744478 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 84/191] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:40.750917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ba41b27f-7e89-4879-973d-88518edd728d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:40.751526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ba41b27f-7e89-4879-973d-88518edd728d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:40.758585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba41b27f-7e89-4879-973d-88518edd728d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:40.759451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba41b27f-7e89-4879-973d-88518edd728d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:40.760404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba41b27f-7e89-4879-973d-88518edd728d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:40.761002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba41b27f-7e89-4879-973d-88518edd728d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:40.804160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ba41b27f-7e89-4879-973d-88518edd728d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:03:41.203212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eec2d6b5-09e2-41e6-8964-cfc5c503e3e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:41.222138 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eec2d6b5-09e2-41e6-8964-cfc5c503e3e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1335 microversion: 2.1 time: 0.610227 May 28 21:03:41.226561 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 108/192] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:40 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1335 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:41.245752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-08eca9f8-8b01-4ad7-841c-406aa88981fa tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:41.245752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-08eca9f8-8b01-4ad7-841c-406aa88981fa tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:41.274652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08eca9f8-8b01-4ad7-841c-406aa88981fa tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:41.275659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08eca9f8-8b01-4ad7-841c-406aa88981fa tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:41.277967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08eca9f8-8b01-4ad7-841c-406aa88981fa tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:41.281499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08eca9f8-8b01-4ad7-841c-406aa88981fa tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:41.339887 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ba41b27f-7e89-4879-973d-88518edd728d tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 204 len: 0 microversion: 2.1 time: 0.593492 May 28 21:03:41.340530 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 85/193] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:03:40 2022] DELETE /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:03:41.350233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-04674f0e-7bdc-494f-995d-f6482a716d05 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:41.350233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-04674f0e-7bdc-494f-995d-f6482a716d05 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:41.357181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04674f0e-7bdc-494f-995d-f6482a716d05 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:41.357639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04674f0e-7bdc-494f-995d-f6482a716d05 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:41.358464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04674f0e-7bdc-494f-995d-f6482a716d05 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:41.358913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04674f0e-7bdc-494f-995d-f6482a716d05 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:41.409513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-08eca9f8-8b01-4ad7-841c-406aa88981fa tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:41.418422 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-08eca9f8-8b01-4ad7-841c-406aa88981fa tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1276 microversion: 2.1 time: 0.186819 May 28 21:03:41.419031 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 109/194] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:41 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:41.435114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-13a2f61c-fae4-47a5-abea-7fe207e013bb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:41.435934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-13a2f61c-fae4-47a5-abea-7fe207e013bb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:41.443665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13a2f61c-fae4-47a5-abea-7fe207e013bb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:41.444622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13a2f61c-fae4-47a5-abea-7fe207e013bb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:41.445408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13a2f61c-fae4-47a5-abea-7fe207e013bb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:41.446491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13a2f61c-fae4-47a5-abea-7fe207e013bb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:41.620577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-04674f0e-7bdc-494f-995d-f6482a716d05 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:41.630942 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-04674f0e-7bdc-494f-995d-f6482a716d05 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1494 microversion: 2.1 time: 0.285403 May 28 21:03:41.641783 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 86/195] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:41 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1494 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:41.647883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6f0e0757-b4d8-4a97-b81a-ecf7500e3456 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:41.648955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6f0e0757-b4d8-4a97-b81a-ecf7500e3456 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:41.656932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f0e0757-b4d8-4a97-b81a-ecf7500e3456 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:41.657398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f0e0757-b4d8-4a97-b81a-ecf7500e3456 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:41.658292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f0e0757-b4d8-4a97-b81a-ecf7500e3456 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:41.662593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f0e0757-b4d8-4a97-b81a-ecf7500e3456 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:41.663702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-13a2f61c-fae4-47a5-abea-7fe207e013bb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:41.671859 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-13a2f61c-fae4-47a5-abea-7fe207e013bb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 200 len: 1413 microversion: 2.1 time: 0.242198 May 28 21:03:41.684280 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 110/196] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:41 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 1413 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:41.687395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-51733ae0-bbdb-4f99-b56c-341895369a78 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:41.688270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-51733ae0-bbdb-4f99-b56c-341895369a78 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:41.695750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51733ae0-bbdb-4f99-b56c-341895369a78 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:41.696457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51733ae0-bbdb-4f99-b56c-341895369a78 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:41.702698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51733ae0-bbdb-4f99-b56c-341895369a78 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:41.702698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51733ae0-bbdb-4f99-b56c-341895369a78 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:41.716238 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-51733ae0-bbdb-4f99-b56c-341895369a78 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] HTTP exception thrown: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-51733ae0-bbdb-4f99-b56c-341895369a78 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Request method failure captured: May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 HTTP/1.1 May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4Hg0PvVUyBknyQqZCaf8gp50Ah1XwrAdr9OY3gltNBNCSr2z6X1P04xbo7D4TauVPh5sHjW90Jri4Vqo4JEV7Nbi5vrJ8-NhiBV7q2mK5VNHa5ogaxLyUkXk9Y2VWufb1mEAIobl72jgd4FOykBuVESKgtZmZYYDfCyCaIPs-SvIM May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0397fe0f76e24a83aa24ecec35dfb61e May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:03:41.718859 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:03:41.721079 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0397fe0f76e24a83aa24ecec35dfb61e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:41.721079 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:03:41.721079 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0397fe0f76e24a83aa24ecec35dfb61e May 28 21:03:41.721079 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:03:41.721079 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersAdminTestJSON-508495299-project May 28 21:03:41.721079 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:03:41.721079 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:03:41.721079 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ad6f51b7b6834fefa06c58829399de85 May 28 21:03:41.721079 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersAdminTestJSON-508495299-project May 28 21:03:41.721079 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:03:41.721079 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. May 28 21:03:41.721079 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '98d5fc1f-9d70-4c86-a832-7efdfa840264'} May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:41.721981 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. May 28 21:03:41.723306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:41.724390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-51733ae0-bbdb-4f99-b56c-341895369a78 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Returning 404 to user: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:41.724390 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-51733ae0-bbdb-4f99-b56c-341895369a78 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 404 len: 111 microversion: 2.1 time: 0.037559 May 28 21:03:41.724390 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 111/197] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:41 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:03:41.733513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6f0e0757-b4d8-4a97-b81a-ecf7500e3456 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:41.747284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6f0e0757-b4d8-4a97-b81a-ecf7500e3456 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:41.749035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6f0e0757-b4d8-4a97-b81a-ecf7500e3456 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:41.750354 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6f0e0757-b4d8-4a97-b81a-ecf7500e3456 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1258 microversion: 2.25 time: 0.107304 May 28 21:03:41.751065 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 87/198] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:03:41 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1258 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:41.874431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-443976031", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:41.930582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:03:42.162288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:03:42.163282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:03:42.164002 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:03:42.164447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:03:42.165002 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:03:42.173991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:42.174440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:42.175321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:42.175751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:42.193000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Getting quotas for project 0397fe0f76e24a83aa24ecec35dfb61e. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:03:42.197026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Getting quotas for user ad6f51b7b6834fefa06c58829399de85 and project 0397fe0f76e24a83aa24ecec35dfb61e. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:03:42.208407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:03:42.210922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:03:42.243781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c14f8412-dbec-4f79-93f2-8a88267456f8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:42.244408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c14f8412-dbec-4f79-93f2-8a88267456f8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:42.251971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c14f8412-dbec-4f79-93f2-8a88267456f8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:42.252524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c14f8412-dbec-4f79-93f2-8a88267456f8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:42.253381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c14f8412-dbec-4f79-93f2-8a88267456f8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:42.253935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c14f8412-dbec-4f79-93f2-8a88267456f8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:42.468465 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0eee0529-8ae7-4987-ad74-47b48a6b66b3 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598651 May 28 21:03:42.469269 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 112/199] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:03:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:03:42.477885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c7258eea-45ff-45eb-8d2f-974730d2d44a tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:42.478631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c7258eea-45ff-45eb-8d2f-974730d2d44a tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:42.486483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7258eea-45ff-45eb-8d2f-974730d2d44a tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:42.487167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7258eea-45ff-45eb-8d2f-974730d2d44a tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:42.488111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7258eea-45ff-45eb-8d2f-974730d2d44a tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:42.488835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7258eea-45ff-45eb-8d2f-974730d2d44a tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:42.653757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c14f8412-dbec-4f79-93f2-8a88267456f8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:42.662231 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c14f8412-dbec-4f79-93f2-8a88267456f8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1335 microversion: 2.1 time: 0.422531 May 28 21:03:42.673051 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 88/200] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:42 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1335 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:42.673051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-789ad967-306f-400e-a264-8c287190e5c5 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:42.673051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-789ad967-306f-400e-a264-8c287190e5c5 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:42.791241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-789ad967-306f-400e-a264-8c287190e5c5 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:42.799347 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-789ad967-306f-400e-a264-8c287190e5c5 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1219 microversion: 2.1 time: 0.134580 May 28 21:03:42.800353 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 89/201] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:42 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1219 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:42.807133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-911632c5-ab0d-4914-8a55-3ac6107e6294 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:42.807942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-911632c5-ab0d-4914-8a55-3ac6107e6294 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:42.814676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-911632c5-ab0d-4914-8a55-3ac6107e6294 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:42.815425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-911632c5-ab0d-4914-8a55-3ac6107e6294 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:42.816412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-911632c5-ab0d-4914-8a55-3ac6107e6294 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:42.817020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-911632c5-ab0d-4914-8a55-3ac6107e6294 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:42.950730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c7258eea-45ff-45eb-8d2f-974730d2d44a tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:42.958339 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c7258eea-45ff-45eb-8d2f-974730d2d44a tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1318 microversion: 2.1 time: 0.487933 May 28 21:03:42.958916 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 113/202] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:42 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1318 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:42.963350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a79799c6-cbb2-4bc2-a958-788a7b35299f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:42.963969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a79799c6-cbb2-4bc2-a958-788a7b35299f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:42.969807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a79799c6-cbb2-4bc2-a958-788a7b35299f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:42.970292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a79799c6-cbb2-4bc2-a958-788a7b35299f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:42.971076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a79799c6-cbb2-4bc2-a958-788a7b35299f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:42.971536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a79799c6-cbb2-4bc2-a958-788a7b35299f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:43.203768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-911632c5-ab0d-4914-8a55-3ac6107e6294 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:43.210996 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-911632c5-ab0d-4914-8a55-3ac6107e6294 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1494 microversion: 2.1 time: 0.409246 May 28 21:03:43.221137 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 90/203] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:42 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1494 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:43.226958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c391db5d-9419-4747-a277-69a2e2407b67 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:43.232281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c391db5d-9419-4747-a277-69a2e2407b67 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:43.234346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c391db5d-9419-4747-a277-69a2e2407b67 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:43.234898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c391db5d-9419-4747-a277-69a2e2407b67 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:43.235927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c391db5d-9419-4747-a277-69a2e2407b67 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:43.236434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c391db5d-9419-4747-a277-69a2e2407b67 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:43.246198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a79799c6-cbb2-4bc2-a958-788a7b35299f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:43.256709 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a79799c6-cbb2-4bc2-a958-788a7b35299f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 200 len: 1413 microversion: 2.1 time: 0.294212 May 28 21:03:43.256709 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 114/204] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:42 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 1413 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:43.260940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-06122fd9-d696-40bf-a761-fcb997af914f req-58d56297-2f6e-49ee-a529-5ed2fb52069c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faaac109-511d-4007-aa35-544196d7db72", "tag": "1e6e9239-2ae6-4bf5-87a3-6c2699670420"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:43.270334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-06122fd9-d696-40bf-a761-fcb997af914f req-58d56297-2f6e-49ee-a529-5ed2fb52069c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:43.270972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-06122fd9-d696-40bf-a761-fcb997af914f req-58d56297-2f6e-49ee-a529-5ed2fb52069c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:43.289550 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-06122fd9-d696-40bf-a761-fcb997af914f req-58d56297-2f6e-49ee-a529-5ed2fb52069c service nova] Creating event network-changed:1e6e9239-2ae6-4bf5-87a3-6c2699670420 for instance faaac109-511d-4007-aa35-544196d7db72 on nch1-master-1 May 28 21:03:43.295728 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-06122fd9-d696-40bf-a761-fcb997af914f req-58d56297-2f6e-49ee-a529-5ed2fb52069c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038333 May 28 21:03:43.296348 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 115/205] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:43.313221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c391db5d-9419-4747-a277-69a2e2407b67 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:43.323578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c391db5d-9419-4747-a277-69a2e2407b67 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:43.325174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c391db5d-9419-4747-a277-69a2e2407b67 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:43.326902 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c391db5d-9419-4747-a277-69a2e2407b67 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1320 microversion: 2.25 time: 0.104438 May 28 21:03:43.338199 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 91/206] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:03:43 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1320 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:43.681492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2e304980-b515-42e4-ad54-63caebd9ba1f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:43.682241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2e304980-b515-42e4-ad54-63caebd9ba1f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:43.700528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e304980-b515-42e4-ad54-63caebd9ba1f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:43.712157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e304980-b515-42e4-ad54-63caebd9ba1f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:43.713057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e304980-b515-42e4-ad54-63caebd9ba1f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:43.716863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e304980-b515-42e4-ad54-63caebd9ba1f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:43.837310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bee5d91c-9b0f-410a-bad1-bda89cfcb6e9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:43.844794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bee5d91c-9b0f-410a-bad1-bda89cfcb6e9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:43.866616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bee5d91c-9b0f-410a-bad1-bda89cfcb6e9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:43.867108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bee5d91c-9b0f-410a-bad1-bda89cfcb6e9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:43.867916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bee5d91c-9b0f-410a-bad1-bda89cfcb6e9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:43.868366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bee5d91c-9b0f-410a-bad1-bda89cfcb6e9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:44.165245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bee5d91c-9b0f-410a-bad1-bda89cfcb6e9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:44.168174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2e304980-b515-42e4-ad54-63caebd9ba1f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:44.175127 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bee5d91c-9b0f-410a-bad1-bda89cfcb6e9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1215 microversion: 2.1 time: 0.354120 May 28 21:03:44.176253 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 92/207] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:43 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1215 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:44.177687 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2e304980-b515-42e4-ad54-63caebd9ba1f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1335 microversion: 2.1 time: 0.500731 May 28 21:03:44.181049 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 116/208] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:43 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1335 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:44.182207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f6f34eed-3c0f-4518-903a-75455433533d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:44.182977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f6f34eed-3c0f-4518-903a-75455433533d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:44.193561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6f34eed-3c0f-4518-903a-75455433533d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:44.195206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6f34eed-3c0f-4518-903a-75455433533d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:44.196720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6f34eed-3c0f-4518-903a-75455433533d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:44.197445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6f34eed-3c0f-4518-903a-75455433533d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:44.229162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-72137c12-2e1d-4aa7-8dc8-bb4cf665aa84 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:44.230047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-72137c12-2e1d-4aa7-8dc8-bb4cf665aa84 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:44.242932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72137c12-2e1d-4aa7-8dc8-bb4cf665aa84 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:44.243569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72137c12-2e1d-4aa7-8dc8-bb4cf665aa84 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:44.248486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72137c12-2e1d-4aa7-8dc8-bb4cf665aa84 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:44.249049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72137c12-2e1d-4aa7-8dc8-bb4cf665aa84 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:44.522295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f6f34eed-3c0f-4518-903a-75455433533d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:44.530001 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f6f34eed-3c0f-4518-903a-75455433533d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1318 microversion: 2.1 time: 0.352525 May 28 21:03:44.531960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-72137c12-2e1d-4aa7-8dc8-bb4cf665aa84 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:44.535232 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 93/209] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:44 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:44.540523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-946c4278-ef6f-4460-9293-61db7d542f21 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:44.541150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-946c4278-ef6f-4460-9293-61db7d542f21 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:44.546958 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-72137c12-2e1d-4aa7-8dc8-bb4cf665aa84 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1494 microversion: 2.1 time: 0.322360 May 28 21:03:44.547797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-946c4278-ef6f-4460-9293-61db7d542f21 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:44.548399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-946c4278-ef6f-4460-9293-61db7d542f21 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:44.552108 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 117/210] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:44 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1494 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:44.558933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-946c4278-ef6f-4460-9293-61db7d542f21 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:44.559473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-946c4278-ef6f-4460-9293-61db7d542f21 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:44.643058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2df136f9-c50d-401c-8d1f-14aa8901bdb1 req-cfb92add-119a-417f-9c3f-65a7d848db1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e0c9107-400f-44f1-9b29-22d42ccc3222", "tag": "b077c693-5951-44da-bbb6-776d04855388"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:44.653793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2df136f9-c50d-401c-8d1f-14aa8901bdb1 req-cfb92add-119a-417f-9c3f-65a7d848db1a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:44.654451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2df136f9-c50d-401c-8d1f-14aa8901bdb1 req-cfb92add-119a-417f-9c3f-65a7d848db1a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:44.671871 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2df136f9-c50d-401c-8d1f-14aa8901bdb1 req-cfb92add-119a-417f-9c3f-65a7d848db1a service nova] Creating event network-changed:b077c693-5951-44da-bbb6-776d04855388 for instance 6e0c9107-400f-44f1-9b29-22d42ccc3222 on nch2-master-1 May 28 21:03:44.684375 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2df136f9-c50d-401c-8d1f-14aa8901bdb1 req-cfb92add-119a-417f-9c3f-65a7d848db1a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130373 May 28 21:03:44.689404 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 118/211] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:44.702457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8708203c-d927-4d64-be71-579fe40e32c5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:44.706140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8708203c-d927-4d64-be71-579fe40e32c5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:44.719581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8708203c-d927-4d64-be71-579fe40e32c5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:44.720493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8708203c-d927-4d64-be71-579fe40e32c5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:44.724012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8708203c-d927-4d64-be71-579fe40e32c5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:44.724694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8708203c-d927-4d64-be71-579fe40e32c5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:44.748290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:45.079014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8708203c-d927-4d64-be71-579fe40e32c5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:45.088481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-946c4278-ef6f-4460-9293-61db7d542f21 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:45.111120 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-946c4278-ef6f-4460-9293-61db7d542f21 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 200 len: 1413 microversion: 2.1 time: 0.563369 May 28 21:03:45.113109 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 94/212] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:44 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 1413 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:45.114572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8708203c-d927-4d64-be71-579fe40e32c5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:45.117952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8708203c-d927-4d64-be71-579fe40e32c5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:45.119467 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8708203c-d927-4d64-be71-579fe40e32c5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1362 microversion: 2.25 time: 0.427442 May 28 21:03:45.120849 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 119/213] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:03:44 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1362 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:45.197434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-32b73286-3847-44f5-9c52-7ac2fb99ec4e tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:45.199191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-687fa4cf-2b69-47f1-ab2b-4a775fafb4db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:45.200268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-32b73286-3847-44f5-9c52-7ac2fb99ec4e tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:45.201921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-687fa4cf-2b69-47f1-ab2b-4a775fafb4db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:45.216707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32b73286-3847-44f5-9c52-7ac2fb99ec4e tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:45.217179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32b73286-3847-44f5-9c52-7ac2fb99ec4e tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:45.218048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-687fa4cf-2b69-47f1-ab2b-4a775fafb4db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:45.218588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-687fa4cf-2b69-47f1-ab2b-4a775fafb4db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:45.219397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-687fa4cf-2b69-47f1-ab2b-4a775fafb4db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:45.220051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-687fa4cf-2b69-47f1-ab2b-4a775fafb4db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:45.220404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32b73286-3847-44f5-9c52-7ac2fb99ec4e tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:45.222943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32b73286-3847-44f5-9c52-7ac2fb99ec4e tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:45.374610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-32b73286-3847-44f5-9c52-7ac2fb99ec4e tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:45.400949 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-32b73286-3847-44f5-9c52-7ac2fb99ec4e tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1277 microversion: 2.1 time: 0.212071 May 28 21:03:45.405146 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 95/214] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:45 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:45.452827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-687fa4cf-2b69-47f1-ab2b-4a775fafb4db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:45.465019 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-687fa4cf-2b69-47f1-ab2b-4a775fafb4db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1335 microversion: 2.1 time: 0.272428 May 28 21:03:45.465696 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 120/215] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:45 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1335 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:45.501682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-0ca6758e-f937-44a1-b91a-0574d1d17fbc req-deebb110-b3e6-4d91-b660-dd16c4769779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0ba50c-cc90-4921-9fd4-b612903c5b1d", "name": "network-vif-deleted", "tag": "d321012d-93e1-483f-9d36-9dd314faf3c8"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:45.511065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0ca6758e-f937-44a1-b91a-0574d1d17fbc req-deebb110-b3e6-4d91-b660-dd16c4769779 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:45.511523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0ca6758e-f937-44a1-b91a-0574d1d17fbc req-deebb110-b3e6-4d91-b660-dd16c4769779 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:45.523597 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-0ca6758e-f937-44a1-b91a-0574d1d17fbc req-deebb110-b3e6-4d91-b660-dd16c4769779 service nova] Creating event network-vif-deleted:d321012d-93e1-483f-9d36-9dd314faf3c8 for instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d on nch1-master-1 May 28 21:03:45.528800 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-0ca6758e-f937-44a1-b91a-0574d1d17fbc req-deebb110-b3e6-4d91-b660-dd16c4769779 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031351 May 28 21:03:45.529457 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 96/216] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:45.550739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-54b6d3f9-2ebb-4e83-bf46-8f0b64ea6f86 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:45.554324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-54b6d3f9-2ebb-4e83-bf46-8f0b64ea6f86 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:45.563222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54b6d3f9-2ebb-4e83-bf46-8f0b64ea6f86 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:45.563931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54b6d3f9-2ebb-4e83-bf46-8f0b64ea6f86 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:45.564897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54b6d3f9-2ebb-4e83-bf46-8f0b64ea6f86 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:45.565375 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54b6d3f9-2ebb-4e83-bf46-8f0b64ea6f86 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:45.572609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e9c3a590-4883-48f4-9b98-f188043ef171 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:45.573343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e9c3a590-4883-48f4-9b98-f188043ef171 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:45.584485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e9c3a590-4883-48f4-9b98-f188043ef171 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:45.585272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e9c3a590-4883-48f4-9b98-f188043ef171 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:45.585711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e9c3a590-4883-48f4-9b98-f188043ef171 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:45.586267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e9c3a590-4883-48f4-9b98-f188043ef171 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:45.699666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e9c3a590-4883-48f4-9b98-f188043ef171 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89ed91b9d56241d99b6df99ede3fb446', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c0200afe2ad4f6db3a7a21cf37f65c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:45.707743 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e9c3a590-4883-48f4-9b98-f188043ef171 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 200 len: 1452 microversion: 2.1 time: 0.146844 May 28 21:03:45.708826 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 97/217] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:45 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:45.757417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-54b6d3f9-2ebb-4e83-bf46-8f0b64ea6f86 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:45.764909 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-54b6d3f9-2ebb-4e83-bf46-8f0b64ea6f86 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1318 microversion: 2.1 time: 0.221075 May 28 21:03:45.765475 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 121/218] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:45 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:46.072612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-8f5fc007-4c75-4866-bac1-c87f6dfc71cb req-cb18e69b-db60-41f7-bd63-297907b1fd3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02214efd-8392-465b-bd6a-d658850d4f15", "name": "network-vif-plugged", "status": "completed", "tag": "23b08d0d-93fe-4fe9-9644-d306caa2b456"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:46.086431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8f5fc007-4c75-4866-bac1-c87f6dfc71cb req-cb18e69b-db60-41f7-bd63-297907b1fd3f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:46.087578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8f5fc007-4c75-4866-bac1-c87f6dfc71cb req-cb18e69b-db60-41f7-bd63-297907b1fd3f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:46.095293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:46.106389 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-8f5fc007-4c75-4866-bac1-c87f6dfc71cb req-cb18e69b-db60-41f7-bd63-297907b1fd3f service nova] Creating event network-vif-plugged:23b08d0d-93fe-4fe9-9644-d306caa2b456 for instance 02214efd-8392-465b-bd6a-d658850d4f15 on nch1-master-1 May 28 21:03:46.112674 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-8f5fc007-4c75-4866-bac1-c87f6dfc71cb req-cb18e69b-db60-41f7-bd63-297907b1fd3f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044163 May 28 21:03:46.113353 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 98/219] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:46.135978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-47f3697f-9693-44b0-9a6a-020a004e0312 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:46.136384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-47f3697f-9693-44b0-9a6a-020a004e0312 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:46.142581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:46.147588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47f3697f-9693-44b0-9a6a-020a004e0312 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:46.148043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47f3697f-9693-44b0-9a6a-020a004e0312 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:46.148834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47f3697f-9693-44b0-9a6a-020a004e0312 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:46.148947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-70b0ba5a-59d4-488c-b59b-3e4840f6731f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:46.149279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47f3697f-9693-44b0-9a6a-020a004e0312 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:46.149563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-70b0ba5a-59d4-488c-b59b-3e4840f6731f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:46.156326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70b0ba5a-59d4-488c-b59b-3e4840f6731f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:46.156784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70b0ba5a-59d4-488c-b59b-3e4840f6731f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:46.157660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70b0ba5a-59d4-488c-b59b-3e4840f6731f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:46.158524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70b0ba5a-59d4-488c-b59b-3e4840f6731f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:46.404794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-47f3697f-9693-44b0-9a6a-020a004e0312 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:46.413897 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-47f3697f-9693-44b0-9a6a-020a004e0312 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 200 len: 1413 microversion: 2.1 time: 0.286844 May 28 21:03:46.416713 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 122/220] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:46 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 1413 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:46.433574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-70b0ba5a-59d4-488c-b59b-3e4840f6731f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:46.448228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-70b0ba5a-59d4-488c-b59b-3e4840f6731f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:46.450102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-70b0ba5a-59d4-488c-b59b-3e4840f6731f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:46.451448 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-70b0ba5a-59d4-488c-b59b-3e4840f6731f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1362 microversion: 2.25 time: 0.310165 May 28 21:03:46.453106 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 99/221] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:03:46 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:46.461775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d501c248-0e10-4d2f-855f-892e2744210a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:46.462509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d501c248-0e10-4d2f-855f-892e2744210a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:46.471325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d501c248-0e10-4d2f-855f-892e2744210a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:46.471784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d501c248-0e10-4d2f-855f-892e2744210a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:46.472612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d501c248-0e10-4d2f-855f-892e2744210a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:46.473051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d501c248-0e10-4d2f-855f-892e2744210a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:46.641510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d501c248-0e10-4d2f-855f-892e2744210a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:46.644130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-af0ce859-e1c1-428a-8f60-c9aeb4ecf570 tempest-NetworksTest-1257548884 tempest-NetworksTest-1257548884-project-admin] Calling method '.version_select at 0x7f4d64b2fdc0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:46.650340 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d501c248-0e10-4d2f-855f-892e2744210a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1277 microversion: 2.1 time: 0.196137 May 28 21:03:46.650916 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 100/222] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:46 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:46.655785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-74d548a4-509a-438f-a88b-33deb3802020 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:46.656601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-74d548a4-509a-438f-a88b-33deb3802020 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:46.663297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74d548a4-509a-438f-a88b-33deb3802020 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:46.663970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74d548a4-509a-438f-a88b-33deb3802020 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:46.664924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74d548a4-509a-438f-a88b-33deb3802020 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:46.665749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74d548a4-509a-438f-a88b-33deb3802020 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:47.193960 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-af0ce859-e1c1-428a-8f60-c9aeb4ecf570 tempest-NetworksTest-1257548884 tempest-NetworksTest-1257548884-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 4709 microversion: 2.1 time: 0.775905 May 28 21:03:47.198456 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 123/223] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:03:46 2022] GET /compute/v2.1/os-networks => generated 4709 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:47.204035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-364f0dbb-a527-41c4-99a6-40a509a5154e tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:47.204657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-364f0dbb-a527-41c4-99a6-40a509a5154e tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:47.206524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-74d548a4-509a-438f-a88b-33deb3802020 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:47.212328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-364f0dbb-a527-41c4-99a6-40a509a5154e tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:47.217790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-364f0dbb-a527-41c4-99a6-40a509a5154e tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:47.217790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-364f0dbb-a527-41c4-99a6-40a509a5154e tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:47.217790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-364f0dbb-a527-41c4-99a6-40a509a5154e tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:47.218336 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-74d548a4-509a-438f-a88b-33deb3802020 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1335 microversion: 2.1 time: 0.564422 May 28 21:03:47.218336 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 101/224] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:46 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1335 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:47.223300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8ba5b3d9-f9b4-4748-a94d-612e25070a9d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:47.224090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8ba5b3d9-f9b4-4748-a94d-612e25070a9d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:47.230754 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-364f0dbb-a527-41c4-99a6-40a509a5154e tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] HTTP exception thrown: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. May 28 21:03:47.231418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ba5b3d9-f9b4-4748-a94d-612e25070a9d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:47.231875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ba5b3d9-f9b4-4748-a94d-612e25070a9d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:47.232712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ba5b3d9-f9b4-4748-a94d-612e25070a9d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-364f0dbb-a527-41c4-99a6-40a509a5154e tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Request method failure captured: May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d HTTP/1.1 May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko36ckvXhU1bG6pMKOcXmUfL4sCWw8lb3OMEKBfkivz1HFmeQ45o0VukGXegdVCPq9jT6SbC595YDc9Ttchx6PRzLJAM3CPQi_ZNDcuw9X392HNPbKf-7t8jw2ZpLnxsJeF-Tl37ZEFOimuPEjQvGbJPiP_zzUapFZpa-YhXoolDiDM May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 8c0200afe2ad4f6db3a7a21cf37f65c8 May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminTestJSON-1277582828 May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:03:47.232818 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:03:47.234012 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c0200afe2ad4f6db3a7a21cf37f65c8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c0200afe2ad4f6db3a7a21cf37f65c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c0200afe2ad4f6db3a7a21cf37f65c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c0200afe2ad4f6db3a7a21cf37f65c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:47.234012 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminTestJSON-1277582828 May 28 21:03:47.234012 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 8c0200afe2ad4f6db3a7a21cf37f65c8 May 28 21:03:47.234012 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1277582828 May 28 21:03:47.234012 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminTestJSON-1277582828-project May 28 21:03:47.234012 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:03:47.234012 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:03:47.234012 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 89ed91b9d56241d99b6df99ede3fb446 May 28 21:03:47.234012 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminTestJSON-1277582828-project May 28 21:03:47.234012 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:03:47.234012 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. May 28 21:03:47.234012 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'fd0ba50c-cc90-4921-9fd4-b612903c5b1d'} May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:47.234667 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. May 28 21:03:47.235681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:47.237232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-364f0dbb-a527-41c4-99a6-40a509a5154e tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Returning 404 to user: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:47.237302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ba5b3d9-f9b4-4748-a94d-612e25070a9d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:47.239839 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-364f0dbb-a527-41c4-99a6-40a509a5154e tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 404 len: 111 microversion: 2.1 time: 0.036248 May 28 21:03:47.239839 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 124/225] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:47 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:03:47.246254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1bd5e054-bf02-452b-aa3e-f4df0aefe57b tempest-NetworksTest-1257548884 tempest-NetworksTest-1257548884-project-admin] Calling method '.version_select at 0x7f4d64a2f040>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:47.480364 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1bd5e054-bf02-452b-aa3e-f4df0aefe57b tempest-NetworksTest-1257548884 tempest-NetworksTest-1257548884-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks/c6a4137f-600a-4b7b-adb7-2b951592ddc4" status: 200 len: 652 microversion: 2.1 time: 0.240538 May 28 21:03:47.481865 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 125/226] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 21:03:47 2022] GET /compute/v2.1/os-networks/c6a4137f-600a-4b7b-adb7-2b951592ddc4 => generated 652 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:47.486985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4664fcff-347c-428e-9277-0479f1e162ef tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:47.488879 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:47.488879 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:47.498313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4664fcff-347c-428e-9277-0479f1e162ef tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:47.498803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4664fcff-347c-428e-9277-0479f1e162ef tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:47.499617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8ba5b3d9-f9b4-4748-a94d-612e25070a9d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:47.508742 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8ba5b3d9-f9b4-4748-a94d-612e25070a9d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1318 microversion: 2.1 time: 0.289602 May 28 21:03:47.509329 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 102/227] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:47 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:47.514188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fa807be6-9cc7-48ff-a380-568836b9ee5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:47.517327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fa807be6-9cc7-48ff-a380-568836b9ee5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:47.520906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:47.537592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa807be6-9cc7-48ff-a380-568836b9ee5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:47.537592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa807be6-9cc7-48ff-a380-568836b9ee5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:47.542764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa807be6-9cc7-48ff-a380-568836b9ee5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:47.543321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa807be6-9cc7-48ff-a380-568836b9ee5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:47.702689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fa807be6-9cc7-48ff-a380-568836b9ee5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:47.710729 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fa807be6-9cc7-48ff-a380-568836b9ee5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 200 len: 1413 microversion: 2.1 time: 0.200097 May 28 21:03:47.711793 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 103/228] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:47 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 1413 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:47.718553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9258dc24-7a2c-45d7-a04d-6cb7a96f63d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:47.719211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9258dc24-7a2c-45d7-a04d-6cb7a96f63d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:47.725892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9258dc24-7a2c-45d7-a04d-6cb7a96f63d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:47.726357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9258dc24-7a2c-45d7-a04d-6cb7a96f63d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:47.728274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9258dc24-7a2c-45d7-a04d-6cb7a96f63d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:47.728274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9258dc24-7a2c-45d7-a04d-6cb7a96f63d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:47.800508 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4664fcff-347c-428e-9277-0479f1e162ef tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 300 microversion: 2.1 time: 0.317595 May 28 21:03:47.801318 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 126/229] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 21:03:47 2022] POST /compute/v2.1/os-aggregates/6/action => generated 300 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:47.806338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-46f18464-e2f6-486c-9c6d-e3a5595bb7cd tempest-NetworksTest-1257548884 tempest-NetworksTest-1257548884-project-admin] Calling method '.version_select at 0x7f4d64b2fca0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:47.917310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9258dc24-7a2c-45d7-a04d-6cb7a96f63d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:47.925486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9258dc24-7a2c-45d7-a04d-6cb7a96f63d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:47.927049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9258dc24-7a2c-45d7-a04d-6cb7a96f63d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:47.928190 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9258dc24-7a2c-45d7-a04d-6cb7a96f63d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1362 microversion: 2.25 time: 0.213337 May 28 21:03:47.929026 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 104/230] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:03:47 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:47.933569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-325fed41-5fa7-425b-8afa-cda27301796c req-a68fa29a-895e-4eb1-8395-a0df8d613d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a5aeda8-15ad-4cb5-afde-74d2498a22ca", "tag": "99558272-1b1d-489a-b9a1-76641b7fe979"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:47.941541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-325fed41-5fa7-425b-8afa-cda27301796c req-a68fa29a-895e-4eb1-8395-a0df8d613d9a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:47.942055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-325fed41-5fa7-425b-8afa-cda27301796c req-a68fa29a-895e-4eb1-8395-a0df8d613d9a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:47.954220 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-325fed41-5fa7-425b-8afa-cda27301796c req-a68fa29a-895e-4eb1-8395-a0df8d613d9a service nova] Creating event network-changed:99558272-1b1d-489a-b9a1-76641b7fe979 for instance 5a5aeda8-15ad-4cb5-afde-74d2498a22ca on nch2-master-1 May 28 21:03:47.959242 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-325fed41-5fa7-425b-8afa-cda27301796c req-a68fa29a-895e-4eb1-8395-a0df8d613d9a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028935 May 28 21:03:47.960391 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 105/231] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:47.966077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-047239d6-5e3a-403b-af36-e65651b4bb9c tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:47.966964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-047239d6-5e3a-403b-af36-e65651b4bb9c tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:47.973945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-047239d6-5e3a-403b-af36-e65651b4bb9c tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:47.976861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-047239d6-5e3a-403b-af36-e65651b4bb9c tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:47.976963 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-46f18464-e2f6-486c-9c6d-e3a5595bb7cd tempest-NetworksTest-1257548884 tempest-NetworksTest-1257548884-project-admin] 10.222.0.33 "GET /compute/v2.1/os-networks" status: 200 len: 4709 microversion: 2.1 time: 0.172160 May 28 21:03:47.977042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-047239d6-5e3a-403b-af36-e65651b4bb9c tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:47.977113 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 127/232] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:03:47 2022] GET /compute/v2.1/os-networks => generated 4709 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:47.977180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-047239d6-5e3a-403b-af36-e65651b4bb9c tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:47.988177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-027b467a-4927-4790-b7e3-d5befaab305c tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:47.989275 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:47.989275 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:48.057668 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-027b467a-4927-4790-b7e3-d5befaab305c tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.074481 May 28 21:03:48.058647 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 128/233] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:03:47 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:03:48.074268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2a3e0b40-fae5-44ae-81f3-ce464d7dbbd9 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-728311930"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:48.076209 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:48.076209 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:48.077086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.aggregate [None req-2a3e0b40-fae5-44ae-81f3-ce464d7dbbd9 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Generated uuid 072ccaef-1523-4f05-9d9d-12f052d4d28e for aggregate {{(pid=143128) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:03:48.153890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-047239d6-5e3a-403b-af36-e65651b4bb9c tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:48.161413 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-047239d6-5e3a-403b-af36-e65651b4bb9c tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1319 microversion: 2.1 time: 0.199908 May 28 21:03:48.162013 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 106/234] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:47 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:48.167049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-63223020-afcd-4a5b-85ef-77ce5ccd5862 req-b23cdefd-3db2-45fd-a309-770b62000034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faaac109-511d-4007-aa35-544196d7db72", "name": "network-vif-plugged", "status": "completed", "tag": "1e6e9239-2ae6-4bf5-87a3-6c2699670420"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:48.174859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-63223020-afcd-4a5b-85ef-77ce5ccd5862 req-b23cdefd-3db2-45fd-a309-770b62000034 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:48.175308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-63223020-afcd-4a5b-85ef-77ce5ccd5862 req-b23cdefd-3db2-45fd-a309-770b62000034 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:48.187101 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-63223020-afcd-4a5b-85ef-77ce5ccd5862 req-b23cdefd-3db2-45fd-a309-770b62000034 service nova] Creating event network-vif-plugged:1e6e9239-2ae6-4bf5-87a3-6c2699670420 for instance faaac109-511d-4007-aa35-544196d7db72 on nch1-master-1 May 28 21:03:48.188280 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2a3e0b40-fae5-44ae-81f3-ce464d7dbbd9 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.117570 May 28 21:03:48.192375 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-63223020-afcd-4a5b-85ef-77ce5ccd5862 req-b23cdefd-3db2-45fd-a309-770b62000034 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029223 May 28 21:03:48.193245 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 107/235] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:48.194530 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 129/236] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:03:48 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:48.199380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2b524481-d9c7-4c6d-a8ad-32646a33b0dd tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:48.200771 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:48.200771 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:48.209283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b524481-d9c7-4c6d-a8ad-32646a33b0dd tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:48.210053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b524481-d9c7-4c6d-a8ad-32646a33b0dd tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:48.233783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ab37b624-2334-43e7-81db-bf3891402143 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:48.234439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ab37b624-2334-43e7-81db-bf3891402143 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:48.242425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab37b624-2334-43e7-81db-bf3891402143 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:48.243121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab37b624-2334-43e7-81db-bf3891402143 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:48.243916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab37b624-2334-43e7-81db-bf3891402143 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:48.244374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab37b624-2334-43e7-81db-bf3891402143 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:48.467097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ab37b624-2334-43e7-81db-bf3891402143 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:48.476576 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ab37b624-2334-43e7-81db-bf3891402143 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1313 microversion: 2.1 time: 0.246661 May 28 21:03:48.488804 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 130/237] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:48 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:48.527630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a4edc9a6-cc31-48ea-82a2-d2f475b6a28c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:48.528918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a4edc9a6-cc31-48ea-82a2-d2f475b6a28c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:48.536604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4edc9a6-cc31-48ea-82a2-d2f475b6a28c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:48.537903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4edc9a6-cc31-48ea-82a2-d2f475b6a28c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:48.539283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4edc9a6-cc31-48ea-82a2-d2f475b6a28c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:48.539864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4edc9a6-cc31-48ea-82a2-d2f475b6a28c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:48.562113 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2b524481-d9c7-4c6d-a8ad-32646a33b0dd tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 241 microversion: 2.1 time: 0.366471 May 28 21:03:48.564577 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 108/238] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 21:03:48 2022] POST /compute/v2.1/os-aggregates/9/action => generated 241 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:48.578907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1b2f01f6-3c83-4d76-b851-15dc75b9c3e1 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:48.579992 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:48.579992 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:48.605377 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1b2f01f6-3c83-4d76-b851-15dc75b9c3e1 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 241 microversion: 2.1 time: 0.035260 May 28 21:03:48.606403 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 109/239] 10.222.0.33 () {58 vars in 1148 bytes} [Sat May 28 21:03:48 2022] GET /compute/v2.1/os-aggregates/9 => generated 241 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:03:48.618411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4c823e73-57b8-428f-b42e-a3ace1dfbfc9 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:48.621700 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:48.621700 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:48.640773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c823e73-57b8-428f-b42e-a3ace1dfbfc9 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:48.643771 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c823e73-57b8-428f-b42e-a3ace1dfbfc9 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:48.829694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a4edc9a6-cc31-48ea-82a2-d2f475b6a28c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:48.839053 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a4edc9a6-cc31-48ea-82a2-d2f475b6a28c tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1318 microversion: 2.1 time: 0.316301 May 28 21:03:48.839627 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 131/240] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:48 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:03:48.862642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-81c01e4b-600a-4b54-b11e-16539495d7c6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:48.862642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-81c01e4b-600a-4b54-b11e-16539495d7c6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:48.862642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-81c01e4b-600a-4b54-b11e-16539495d7c6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:48.862642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-81c01e4b-600a-4b54-b11e-16539495d7c6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:48.863027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-81c01e4b-600a-4b54-b11e-16539495d7c6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:48.863027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-81c01e4b-600a-4b54-b11e-16539495d7c6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:49.062791 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4c823e73-57b8-428f-b42e-a3ace1dfbfc9 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.448493 May 28 21:03:49.064553 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 110/241] 10.222.0.33 () {60 vars in 1190 bytes} [Sat May 28 21:03:48 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:49.074338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-98f4645e-f187-4467-8626-aeb18176225c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:49.075406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-98f4645e-f187-4467-8626-aeb18176225c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:49.096158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98f4645e-f187-4467-8626-aeb18176225c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:49.096158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98f4645e-f187-4467-8626-aeb18176225c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:49.096158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98f4645e-f187-4467-8626-aeb18176225c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:49.096411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98f4645e-f187-4467-8626-aeb18176225c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:49.162802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-81c01e4b-600a-4b54-b11e-16539495d7c6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:49.175873 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-81c01e4b-600a-4b54-b11e-16539495d7c6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 200 len: 1589 microversion: 2.1 time: 0.331854 May 28 21:03:49.176900 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 132/242] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:48 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 1589 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:49.194412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-33a074f9-9c0e-4477-bee3-85ff965e7fb5 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:49.195576 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:49.195576 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:49.286677 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-33a074f9-9c0e-4477-bee3-85ff965e7fb5 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.096950 May 28 21:03:49.287361 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 133/243] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:03:49 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:03:49.293266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ca57764-cfc2-4ef6-818a-2b8ef2e3c009 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:49.293966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8ca57764-cfc2-4ef6-818a-2b8ef2e3c009 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:49.304742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ca57764-cfc2-4ef6-818a-2b8ef2e3c009 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:49.305252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ca57764-cfc2-4ef6-818a-2b8ef2e3c009 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:49.306249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ca57764-cfc2-4ef6-818a-2b8ef2e3c009 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:49.307474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ca57764-cfc2-4ef6-818a-2b8ef2e3c009 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:49.325362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-98f4645e-f187-4467-8626-aeb18176225c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:49.335540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-98f4645e-f187-4467-8626-aeb18176225c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:49.337759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-98f4645e-f187-4467-8626-aeb18176225c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:49.343262 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-98f4645e-f187-4467-8626-aeb18176225c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1362 microversion: 2.25 time: 0.273284 May 28 21:03:49.343262 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 111/244] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:03:49 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:49.344686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2554eded-2ee3-4b46-b51f-3f7f55475d3c tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:49.345189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2554eded-2ee3-4b46-b51f-3f7f55475d3c tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:49.351839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2554eded-2ee3-4b46-b51f-3f7f55475d3c tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:49.352544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2554eded-2ee3-4b46-b51f-3f7f55475d3c tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:49.353552 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2554eded-2ee3-4b46-b51f-3f7f55475d3c tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:49.354189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2554eded-2ee3-4b46-b51f-3f7f55475d3c tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:49.505182 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2554eded-2ee3-4b46-b51f-3f7f55475d3c tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164363 May 28 21:03:49.505986 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 112/245] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:03:49 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:49.516833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1e172ed2-87dc-442e-98a4-ac37dc78080b tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-253059016"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:49.519221 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:49.519221 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:49.520287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.aggregate [None req-1e172ed2-87dc-442e-98a4-ac37dc78080b tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Generated uuid 48b8624c-d3ce-4237-9db3-8e0e659189d7 for aggregate {{(pid=143129) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:03:49.618296 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1e172ed2-87dc-442e-98a4-ac37dc78080b tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.109689 May 28 21:03:49.624656 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 113/246] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:03:49 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:49.624788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8ca57764-cfc2-4ef6-818a-2b8ef2e3c009 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:49.629813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:49.634568 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8ca57764-cfc2-4ef6-818a-2b8ef2e3c009 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1319 microversion: 2.1 time: 0.345636 May 28 21:03:49.635161 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 134/247] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:49 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1319 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:49.637089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d823a3d6-ac9f-4a95-a06d-1ae41c1ea415 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:49.637983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d823a3d6-ac9f-4a95-a06d-1ae41c1ea415 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:49.649632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-98ed5a5a-dd22-490e-9349-5d0f65d9604c tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:49.651814 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:49.651814 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:49.653759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d823a3d6-ac9f-4a95-a06d-1ae41c1ea415 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:49.655329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d823a3d6-ac9f-4a95-a06d-1ae41c1ea415 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:49.656197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d823a3d6-ac9f-4a95-a06d-1ae41c1ea415 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:49.656892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d823a3d6-ac9f-4a95-a06d-1ae41c1ea415 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:49.672745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98ed5a5a-dd22-490e-9349-5d0f65d9604c tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:49.673194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98ed5a5a-dd22-490e-9349-5d0f65d9604c tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:49.981388 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-98ed5a5a-dd22-490e-9349-5d0f65d9604c tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.345123 May 28 21:03:49.983099 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 135/248] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:03:49 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:49.989938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4d27db70-9a1a-459f-b106-df7dd185cb8b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:49.992502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4d27db70-9a1a-459f-b106-df7dd185cb8b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:50.006370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d27db70-9a1a-459f-b106-df7dd185cb8b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:50.007232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d27db70-9a1a-459f-b106-df7dd185cb8b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:50.010435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d27db70-9a1a-459f-b106-df7dd185cb8b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:50.012549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d27db70-9a1a-459f-b106-df7dd185cb8b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:50.104453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d823a3d6-ac9f-4a95-a06d-1ae41c1ea415 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:50.113430 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d823a3d6-ac9f-4a95-a06d-1ae41c1ea415 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1463 microversion: 2.1 time: 0.486041 May 28 21:03:50.114061 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 114/249] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:49 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1463 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:50.132334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d9a7ae6c-315c-450b-9f6f-b558d9bf7331 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:50.133337 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:50.133337 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:50.141104 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d9a7ae6c-315c-450b-9f6f-b558d9bf7331 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.012407 May 28 21:03:50.142246 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 115/250] 10.222.0.33 () {58 vars in 1142 bytes} [Sat May 28 21:03:50 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:50.148567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d8799e00-1667-46f7-9db9-ded2c1b597ad req-afc3a1ec-493b-4368-b756-e187c85edd82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76fb3f87-77b7-4de0-b4f2-8f54809d3ec8", "tag": "64c8a0b3-7223-443b-a027-c61aa0dab93c"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:50.158130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d8799e00-1667-46f7-9db9-ded2c1b597ad req-afc3a1ec-493b-4368-b756-e187c85edd82 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:50.158583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d8799e00-1667-46f7-9db9-ded2c1b597ad req-afc3a1ec-493b-4368-b756-e187c85edd82 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:50.172007 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d8799e00-1667-46f7-9db9-ded2c1b597ad req-afc3a1ec-493b-4368-b756-e187c85edd82 service nova] Creating event network-changed:64c8a0b3-7223-443b-a027-c61aa0dab93c for instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 on nch2-master-1 May 28 21:03:50.177372 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d8799e00-1667-46f7-9db9-ded2c1b597ad req-afc3a1ec-493b-4368-b756-e187c85edd82 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033638 May 28 21:03:50.178449 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 116/251] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:50.313946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4d27db70-9a1a-459f-b106-df7dd185cb8b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:50.321904 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4d27db70-9a1a-459f-b106-df7dd185cb8b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1318 microversion: 2.1 time: 0.336767 May 28 21:03:50.323217 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 136/252] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:49 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:50.330268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a70287ea-4f7e-402d-a6b5-cba78d666cc2 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:50.331650 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:50.331650 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:50.345593 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a70287ea-4f7e-402d-a6b5-cba78d666cc2 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:50.346109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a70287ea-4f7e-402d-a6b5-cba78d666cc2 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:50.554202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7a2641dd-438c-4758-9c4c-47139edee2a8 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:50.559917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7a2641dd-438c-4758-9c4c-47139edee2a8 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:50.563464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a2641dd-438c-4758-9c4c-47139edee2a8 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:50.564961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a2641dd-438c-4758-9c4c-47139edee2a8 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:50.565825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a2641dd-438c-4758-9c4c-47139edee2a8 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:50.566365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a2641dd-438c-4758-9c4c-47139edee2a8 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:50.664460 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a70287ea-4f7e-402d-a6b5-cba78d666cc2 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.337662 May 28 21:03:50.670741 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 137/253] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:03:50 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:50.677762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7f30a0ae-3afb-45ae-94bc-ef0f3d9478b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:50.679725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7f30a0ae-3afb-45ae-94bc-ef0f3d9478b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:50.686977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f30a0ae-3afb-45ae-94bc-ef0f3d9478b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:50.687612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f30a0ae-3afb-45ae-94bc-ef0f3d9478b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:50.688460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f30a0ae-3afb-45ae-94bc-ef0f3d9478b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:50.689077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f30a0ae-3afb-45ae-94bc-ef0f3d9478b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:50.981517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7f30a0ae-3afb-45ae-94bc-ef0f3d9478b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:50.994789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7f30a0ae-3afb-45ae-94bc-ef0f3d9478b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:50.997665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7f30a0ae-3afb-45ae-94bc-ef0f3d9478b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:50.999053 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7f30a0ae-3afb-45ae-94bc-ef0f3d9478b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1362 microversion: 2.25 time: 0.327015 May 28 21:03:51.000109 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 138/254] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:03:50 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:51.011640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-7b48aeef-0dbd-4b41-9c15-5db3aac753c7 req-ccd317bc-0350-4480-8dc7-202f470f8057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0c9107-400f-44f1-9b29-22d42ccc3222", "name": "network-vif-plugged", "status": "completed", "tag": "b077c693-5951-44da-bbb6-776d04855388"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:51.020790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7b48aeef-0dbd-4b41-9c15-5db3aac753c7 req-ccd317bc-0350-4480-8dc7-202f470f8057 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:51.021482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7b48aeef-0dbd-4b41-9c15-5db3aac753c7 req-ccd317bc-0350-4480-8dc7-202f470f8057 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:51.034296 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-7b48aeef-0dbd-4b41-9c15-5db3aac753c7 req-ccd317bc-0350-4480-8dc7-202f470f8057 service nova] Creating event network-vif-plugged:b077c693-5951-44da-bbb6-776d04855388 for instance 6e0c9107-400f-44f1-9b29-22d42ccc3222 on nch2-master-1 May 28 21:03:51.040222 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-7b48aeef-0dbd-4b41-9c15-5db3aac753c7 req-ccd317bc-0350-4480-8dc7-202f470f8057 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038778 May 28 21:03:51.042064 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 139/255] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:51.048381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-18d9c36d-4328-4194-8459-7fffbc2637e5 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:51.049084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-18d9c36d-4328-4194-8459-7fffbc2637e5 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:51.055971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18d9c36d-4328-4194-8459-7fffbc2637e5 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:51.056268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18d9c36d-4328-4194-8459-7fffbc2637e5 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:51.057212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18d9c36d-4328-4194-8459-7fffbc2637e5 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:51.057657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18d9c36d-4328-4194-8459-7fffbc2637e5 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:51.321867 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7a2641dd-438c-4758-9c4c-47139edee2a8 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1614 microversion: 2.1 time: 1.138697 May 28 21:03:51.322801 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 117/256] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:50 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1614 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:51.327726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4b9c0237-8219-4eae-9ded-3f2c3c66145a tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:51.329510 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:51.329510 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:51.416624 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4b9c0237-8219-4eae-9ded-3f2c3c66145a tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.092540 May 28 21:03:51.418182 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 118/257] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:03:51 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:03:51.427825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-de2764ea-bb12-43bd-8913-d53046325286 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:51.429832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-de2764ea-bb12-43bd-8913-d53046325286 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:51.439216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de2764ea-bb12-43bd-8913-d53046325286 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:51.439960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de2764ea-bb12-43bd-8913-d53046325286 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:51.440950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de2764ea-bb12-43bd-8913-d53046325286 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:51.441471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de2764ea-bb12-43bd-8913-d53046325286 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:51.658904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-18d9c36d-4328-4194-8459-7fffbc2637e5 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:51.668283 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-18d9c36d-4328-4194-8459-7fffbc2637e5 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1319 microversion: 2.1 time: 0.623926 May 28 21:03:51.668882 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 140/258] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:51 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1319 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:51.683686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-856edce0-54ae-4f30-883f-46eade20d488 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:51.684791 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-856edce0-54ae-4f30-883f-46eade20d488 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:51.692235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-856edce0-54ae-4f30-883f-46eade20d488 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:51.692768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-856edce0-54ae-4f30-883f-46eade20d488 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:51.693782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-856edce0-54ae-4f30-883f-46eade20d488 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:51.694404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-856edce0-54ae-4f30-883f-46eade20d488 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:51.828011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-de2764ea-bb12-43bd-8913-d53046325286 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:51.839509 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-de2764ea-bb12-43bd-8913-d53046325286 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1318 microversion: 2.1 time: 0.419495 May 28 21:03:51.842287 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 119/259] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:51 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1318 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:51.852549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c4c24dac-3c6d-41e7-a91f-251ad7cde3bb tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-592992519"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:51.854131 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:51.854131 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:51.855382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.aggregate [None req-c4c24dac-3c6d-41e7-a91f-251ad7cde3bb tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Generated uuid 77aa3079-939c-4975-9a01-04055c0a8f62 for aggregate {{(pid=143129) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:03:51.999455 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c4c24dac-3c6d-41e7-a91f-251ad7cde3bb tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.154766 May 28 21:03:52.001830 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 120/260] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:03:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:52.039628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b3f67dc3-ca74-4358-b669-0a17e040ce92 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:52.044922 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:52.044922 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:52.050182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-856edce0-54ae-4f30-883f-46eade20d488 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a43b061d4e864c289ac541d11e46c4de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b8421c635c440eaec446bfb659bd22', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:52.052613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-856edce0-54ae-4f30-883f-46eade20d488 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] [instance: faaac109-511d-4007-aa35-544196d7db72] flavor_id is None. Assuming migration. {{(pid=143128) resize /opt/stack/nova/nova/compute/api.py:4142}} May 28 21:03:52.053309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-856edce0-54ae-4f30-883f-46eade20d488 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] [instance: faaac109-511d-4007-aa35-544196d7db72] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=143128) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 21:03:52.065438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3f67dc3-ca74-4358-b669-0a17e040ce92 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:52.071616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3f67dc3-ca74-4358-b669-0a17e040ce92 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:52.182998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:52.207873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=26 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:52.458739 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b3f67dc3-ca74-4358-b669-0a17e040ce92 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.438977 May 28 21:03:52.459934 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 121/261] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:03:52 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:52.470538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dfc59bc4-fc6b-4f70-a2c2-a7e0d1470459 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:52.470538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dfc59bc4-fc6b-4f70-a2c2-a7e0d1470459 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:52.484827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dfc59bc4-fc6b-4f70-a2c2-a7e0d1470459 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:52.487024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dfc59bc4-fc6b-4f70-a2c2-a7e0d1470459 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:52.488038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dfc59bc4-fc6b-4f70-a2c2-a7e0d1470459 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:52.488501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dfc59bc4-fc6b-4f70-a2c2-a7e0d1470459 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:52.633006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dfc59bc4-fc6b-4f70-a2c2-a7e0d1470459 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:52.647887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dfc59bc4-fc6b-4f70-a2c2-a7e0d1470459 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:52.649483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dfc59bc4-fc6b-4f70-a2c2-a7e0d1470459 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:52.650639 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dfc59bc4-fc6b-4f70-a2c2-a7e0d1470459 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1362 microversion: 2.25 time: 0.189597 May 28 21:03:52.651457 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 122/262] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:03:52 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:52.655875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fdb8c7b9-b390-4eb4-9487-0f396c034421 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:52.656493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fdb8c7b9-b390-4eb4-9487-0f396c034421 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:52.663001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fdb8c7b9-b390-4eb4-9487-0f396c034421 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:52.663458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fdb8c7b9-b390-4eb4-9487-0f396c034421 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:52.664238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fdb8c7b9-b390-4eb4-9487-0f396c034421 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:52.664685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fdb8c7b9-b390-4eb4-9487-0f396c034421 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:52.730501 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-856edce0-54ae-4f30-883f-46eade20d488 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72/action" status: 202 len: 0 microversion: 2.1 time: 1.059942 May 28 21:03:52.731208 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 141/263] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:03:51 2022] POST /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72/action => generated 0 bytes in 1062 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:03:52.747041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-164fe97a-5c74-4a79-80fb-43b86e720e01 req-28dcf3cc-8056-4c0b-bc91-a9bfcc984390 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02214efd-8392-465b-bd6a-d658850d4f15", "tag": "23b08d0d-93fe-4fe9-9644-d306caa2b456"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:52.768634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-164fe97a-5c74-4a79-80fb-43b86e720e01 req-28dcf3cc-8056-4c0b-bc91-a9bfcc984390 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:52.768634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-164fe97a-5c74-4a79-80fb-43b86e720e01 req-28dcf3cc-8056-4c0b-bc91-a9bfcc984390 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:52.786922 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-164fe97a-5c74-4a79-80fb-43b86e720e01 req-28dcf3cc-8056-4c0b-bc91-a9bfcc984390 service nova] Creating event network-changed:23b08d0d-93fe-4fe9-9644-d306caa2b456 for instance 02214efd-8392-465b-bd6a-d658850d4f15 on nch1-master-1 May 28 21:03:52.794178 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-164fe97a-5c74-4a79-80fb-43b86e720e01 req-28dcf3cc-8056-4c0b-bc91-a9bfcc984390 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060279 May 28 21:03:52.795359 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 142/264] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:52.798283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=30 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:52.804617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6b5b161b-0efb-4471-9c40-7ab5d6b0d229 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:52.817262 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:52.817262 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:52.832057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b5b161b-0efb-4471-9c40-7ab5d6b0d229 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:52.832658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b5b161b-0efb-4471-9c40-7ab5d6b0d229 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:52.848792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:52.922303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fdb8c7b9-b390-4eb4-9487-0f396c034421 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:52.926320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:52.931397 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fdb8c7b9-b390-4eb4-9487-0f396c034421 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 200 len: 1589 microversion: 2.1 time: 0.278574 May 28 21:03:52.938689 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 123/265] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:52 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 1589 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:52.947938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3dd49046-644e-4109-af7a-e42704910f7b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:52.952015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3dd49046-644e-4109-af7a-e42704910f7b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:52.965417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3dd49046-644e-4109-af7a-e42704910f7b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:52.968672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3dd49046-644e-4109-af7a-e42704910f7b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:52.974445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3dd49046-644e-4109-af7a-e42704910f7b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:52.975693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3dd49046-644e-4109-af7a-e42704910f7b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:53.097314 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6b5b161b-0efb-4471-9c40-7ab5d6b0d229 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.300498 May 28 21:03:53.098544 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 143/266] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:03:52 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:53.107852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7ba330d9-ac67-4978-b3a0-951b1e49ba5f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:53.108803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7ba330d9-ac67-4978-b3a0-951b1e49ba5f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:53.125013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ba330d9-ac67-4978-b3a0-951b1e49ba5f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:53.126843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ba330d9-ac67-4978-b3a0-951b1e49ba5f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:53.128592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ba330d9-ac67-4978-b3a0-951b1e49ba5f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:53.129555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ba330d9-ac67-4978-b3a0-951b1e49ba5f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:53.203168 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3dd49046-644e-4109-af7a-e42704910f7b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:53.212076 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3dd49046-644e-4109-af7a-e42704910f7b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1319 microversion: 2.1 time: 0.272040 May 28 21:03:53.213113 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 124/267] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:52 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:53.218059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a131837c-663f-4158-8b07-7ed4c6bb5e5f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:53.218974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a131837c-663f-4158-8b07-7ed4c6bb5e5f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:53.228344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a131837c-663f-4158-8b07-7ed4c6bb5e5f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:53.229002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a131837c-663f-4158-8b07-7ed4c6bb5e5f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:53.230085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a131837c-663f-4158-8b07-7ed4c6bb5e5f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:53.232464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a131837c-663f-4158-8b07-7ed4c6bb5e5f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:53.397167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7ba330d9-ac67-4978-b3a0-951b1e49ba5f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:53.404902 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7ba330d9-ac67-4978-b3a0-951b1e49ba5f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1472 microversion: 2.1 time: 0.304660 May 28 21:03:53.409936 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 144/268] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:53 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1472 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:53.417332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-e8f145ed-fbad-4d16-b2c0-bc6c46c022b9 req-9d6642b0-4a60-49c1-a9d0-5dc95787124a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a5aeda8-15ad-4cb5-afde-74d2498a22ca", "name": "network-vif-plugged", "status": "completed", "tag": "99558272-1b1d-489a-b9a1-76641b7fe979"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:53.442347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e8f145ed-fbad-4d16-b2c0-bc6c46c022b9 req-9d6642b0-4a60-49c1-a9d0-5dc95787124a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:53.443904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e8f145ed-fbad-4d16-b2c0-bc6c46c022b9 req-9d6642b0-4a60-49c1-a9d0-5dc95787124a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:53.470419 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e8f145ed-fbad-4d16-b2c0-bc6c46c022b9 req-9d6642b0-4a60-49c1-a9d0-5dc95787124a service nova] Creating event network-vif-plugged:99558272-1b1d-489a-b9a1-76641b7fe979 for instance 5a5aeda8-15ad-4cb5-afde-74d2498a22ca on nch2-master-1 May 28 21:03:53.478537 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-e8f145ed-fbad-4d16-b2c0-bc6c46c022b9 req-9d6642b0-4a60-49c1-a9d0-5dc95787124a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066719 May 28 21:03:53.480222 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 145/269] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:53.484493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a131837c-663f-4158-8b07-7ed4c6bb5e5f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:53.488729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b39b6511-8cac-4653-95d7-8eb8cb1725f0 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:53.489865 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:53.489865 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:53.493606 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a131837c-663f-4158-8b07-7ed4c6bb5e5f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1468 microversion: 2.1 time: 0.279369 May 28 21:03:53.498622 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 125/270] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:53 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1468 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:53.594625 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b39b6511-8cac-4653-95d7-8eb8cb1725f0 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.112687 May 28 21:03:53.596135 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 146/271] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:03:53 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:03:53.607012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6a54794a-d59c-4ef8-af81-e2a25cd44747 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1607951948"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:53.608354 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:53.608354 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:53.611039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.aggregate [None req-6a54794a-d59c-4ef8-af81-e2a25cd44747 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Generated uuid 66dc7243-a574-4b6b-b91c-6a3c23cddead for aggregate {{(pid=143128) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:03:53.699529 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6a54794a-d59c-4ef8-af81-e2a25cd44747 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.096795 May 28 21:03:53.700449 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 147/272] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:03:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:03:53.720976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4a6efa1c-3017-4433-9d37-9222474cdfb4 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1067362489"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:53.726089 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:53.726089 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:53.728960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.aggregate [None req-4a6efa1c-3017-4433-9d37-9222474cdfb4 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Generated uuid e83d2f31-4188-4e1f-ba3f-51cae97467dd for aggregate {{(pid=143128) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:03:53.832139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-97d4cb83-7063-47a8-8447-bf704f12b6fa tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1597851299", "block_migration": true, "disk_over_commit": false}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:53.833390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-97d4cb83-7063-47a8-8447-bf704f12b6fa tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:53.839243 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4a6efa1c-3017-4433-9d37-9222474cdfb4 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.137751 May 28 21:03:53.839878 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 148/273] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:03:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:53.844733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8f6e27c5-870c-4763-ae60-5cd0b3ae4925 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:53.845742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8f6e27c5-870c-4763-ae60-5cd0b3ae4925 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:53.847311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97d4cb83-7063-47a8-8447-bf704f12b6fa tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:53.847781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97d4cb83-7063-47a8-8447-bf704f12b6fa tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:53.848564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97d4cb83-7063-47a8-8447-bf704f12b6fa tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:53.849027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97d4cb83-7063-47a8-8447-bf704f12b6fa tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:53.852826 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f6e27c5-870c-4763-ae60-5cd0b3ae4925 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:53.853278 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f6e27c5-870c-4763-ae60-5cd0b3ae4925 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:53.854094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f6e27c5-870c-4763-ae60-5cd0b3ae4925 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:53.854523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f6e27c5-870c-4763-ae60-5cd0b3ae4925 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:53.938814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-97d4cb83-7063-47a8-8447-bf704f12b6fa tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lazy-loading 'flavor' on Instance uuid 6e0c9107-400f-44f1-9b29-22d42ccc3222 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:03:54.009370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-97d4cb83-7063-47a8-8447-bf704f12b6fa tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Going to try to live migrate instance to tempest-host-1597851299 {{(pid=143129) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 21:03:54.018904 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-97d4cb83-7063-47a8-8447-bf704f12b6fa tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] HTTP exception thrown: Compute host tempest-host-1597851299 could not be found. May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-97d4cb83-7063-47a8-8447-bf704f12b6fa tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Request method failure captured: May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222/action HTTP/1.1 May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 107 May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4mlV_sE2qay-ZtoUhz8aQCAElz9RWXKQ_sl5rqK4LWwcB-C5EW7o113GeiprdPFFEcI2yOcum4dnaELprlK-XjUmbgM1l_Z0DuJaBJ1cbItGl2llc1e_Q_ARU3LHkmOrK8aTc6c3g7UTWb6JEb9xGjJagXuIgZm6xfipF7kPkE_2w May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2a0bc9e83b434c4c93a514f9c0ee106b May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-LiveMigrationNegativeTest-716858929 May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:03:54.026203 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:03:54.027453 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2a0bc9e83b434c4c93a514f9c0ee106b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a0bc9e83b434c4c93a514f9c0ee106b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2a0bc9e83b434c4c93a514f9c0ee106b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a0bc9e83b434c4c93a514f9c0ee106b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:54.027453 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-LiveMigrationNegativeTest-716858929 May 28 21:03:54.027453 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2a0bc9e83b434c4c93a514f9c0ee106b May 28 21:03:54.027453 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-716858929 May 28 21:03:54.027453 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-LiveMigrationNegativeTest-716858929-project-admin May 28 21:03:54.027453 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:03:54.027453 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:03:54.027453 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: a943a5a756c241379440c3ad9b937435 May 28 21:03:54.027453 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-LiveMigrationNegativeTest-716858929-project-admin May 28 21:03:54.027453 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:03:54.027453 ncdv-master-1 devstack@n-api.service[143129]: {"os-migrateLive": {"host": "tempest-host-1597851299", "block_migration": true, "disk_over_commit": false}} May 28 21:03:54.027453 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: exception: Compute host tempest-host-1597851299 could not be found. May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '6e0c9107-400f-44f1-9b29-22d42ccc3222', 'body': {'os-migrateLive': {'host': 'tempest-host-1597851299', 'block_migration': True, 'disk_over_commit': False}}} May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:03:54.028128 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1597851299 could not be found. May 28 21:03:54.029158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1597851299 could not be found. May 28 21:03:54.031468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:54.034104 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:54.034104 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:54.034104 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:54.034104 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:54.034104 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:54.034104 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:03:54.034104 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:03:54.034104 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1597851299 could not be found. May 28 21:03:54.034104 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:54.034104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-97d4cb83-7063-47a8-8447-bf704f12b6fa tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Returning 400 to user: Compute host tempest-host-1597851299 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:54.034104 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-97d4cb83-7063-47a8-8447-bf704f12b6fa tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222/action" status: 400 len: 100 microversion: 2.1 time: 0.524074 May 28 21:03:54.034104 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 126/274] 10.222.0.33 () {60 vars in 1278 bytes} [Sat May 28 21:03:53 2022] POST /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222/action => generated 100 bytes in 525 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 21:03:54.042541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aa225588-0639-4037-a13e-0cfcbfc5619a tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:54.043385 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:54.043385 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:54.094376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8f6e27c5-870c-4763-ae60-5cd0b3ae4925 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:54.104717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8f6e27c5-870c-4763-ae60-5cd0b3ae4925 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:54.120911 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aa225588-0639-4037-a13e-0cfcbfc5619a tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.085194 May 28 21:03:54.121681 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 127/275] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:03:54 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:03:54.123207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8f6e27c5-870c-4763-ae60-5cd0b3ae4925 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:54.125071 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8f6e27c5-870c-4763-ae60-5cd0b3ae4925 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1362 microversion: 2.25 time: 0.283686 May 28 21:03:54.127897 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 149/276] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:03:53 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:54.136706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6c4b1390-3f28-4cb7-9aa4-e7555ef6d0f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:54.144339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6c4b1390-3f28-4cb7-9aa4-e7555ef6d0f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:54.144614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aa823458-ebe7-4015-b0eb-23af1f67d8bc tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:54.144614 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:54.144614 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:54.148914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c4b1390-3f28-4cb7-9aa4-e7555ef6d0f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:54.149609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c4b1390-3f28-4cb7-9aa4-e7555ef6d0f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:54.150601 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c4b1390-3f28-4cb7-9aa4-e7555ef6d0f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:54.151040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c4b1390-3f28-4cb7-9aa4-e7555ef6d0f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:54.172549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa823458-ebe7-4015-b0eb-23af1f67d8bc tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:54.173213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa823458-ebe7-4015-b0eb-23af1f67d8bc tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:54.318792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6c4b1390-3f28-4cb7-9aa4-e7555ef6d0f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:54.327062 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6c4b1390-3f28-4cb7-9aa4-e7555ef6d0f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1468 microversion: 2.1 time: 0.197917 May 28 21:03:54.337873 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 150/277] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:54 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1468 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:54.337873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8f73836f-2718-432c-a265-fc9c6f567d9b tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:54.337873 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:54.337873 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:54.337873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:54.340450 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-8f73836f-2718-432c-a265-fc9c6f567d9b tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] HTTP exception thrown: Aggregate 12 could not be found. May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8f73836f-2718-432c-a265-fc9c6f567d9b tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Request method failure captured: May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-aggregates/12 HTTP/1.1 May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko39Ha4oSnxuDLIz1SCYZ3rW_RIgqAdJGEfJS1uh_VhgnkLjExcHCum2UuUikfhoEMg1cvb12NwiU70soYnd6r3GoWPRrYgvuU18ZIOaJvrpeZZrOsqnZZr2h9GTgcpCTOsgKVjBpu3-8GEtjQvfS6CIw8iy6MCKcvetkHOddYOIZ_4 May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 6277287bf774466582bc214b11186b70 May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminTestJSON-1477534321 May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:03:54.342391 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:03:54.343566 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6277287bf774466582bc214b11186b70", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6277287bf774466582bc214b11186b70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6277287bf774466582bc214b11186b70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6277287bf774466582bc214b11186b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:54.343566 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminTestJSON-1477534321 May 28 21:03:54.343566 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 6277287bf774466582bc214b11186b70 May 28 21:03:54.343566 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1477534321 May 28 21:03:54.343566 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminTestJSON-1477534321-project-admin May 28 21:03:54.343566 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:03:54.343566 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:03:54.343566 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: d1b067ff75914828a49edd61f6a9318b May 28 21:03:54.343566 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminTestJSON-1477534321-project-admin May 28 21:03:54.343566 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:03:54.343566 ncdv-master-1 devstack@n-api.service[143128]: exception: Aggregate 12 could not be found. May 28 21:03:54.343566 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '12'} May 28 21:03:54.343566 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:54.344294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. May 28 21:03:54.345328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:54.349586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8f73836f-2718-432c-a265-fc9c6f567d9b tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:54.351253 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8f73836f-2718-432c-a265-fc9c6f567d9b tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.022289 May 28 21:03:54.355737 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 151/278] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:03:54 2022] GET /compute/v2.1/os-aggregates/12 => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:03:54.360657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dc8bbeef-1565-4fea-934e-a0829a8c8a4b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:54.361503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dc8bbeef-1565-4fea-934e-a0829a8c8a4b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:54.370448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc8bbeef-1565-4fea-934e-a0829a8c8a4b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:54.371476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc8bbeef-1565-4fea-934e-a0829a8c8a4b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:54.372699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc8bbeef-1565-4fea-934e-a0829a8c8a4b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:54.373337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc8bbeef-1565-4fea-934e-a0829a8c8a4b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:54.442639 ncdv-master-1 devstack@n-api.service[143129]: WARNING nova.scheduler.client.report [None req-aa823458-ebe7-4015-b0eb-23af1f67d8bc tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] [req-b1586e3d-dc8a-45b8-b395-5fd95001d87d] Failed to update aggregates to [e83d2f31-4188-4e1f-ba3f-51cae97467dd] for resource provider with UUID d571c266-50ef-4af0-8315-6e532ca04cc8. Got 409: {"errors": [{"status": 409, "title": "Conflict", "detail": "There was a conflict when trying to complete your request.\n\n Update conflict: Another thread concurrently updated the resource provider data. Please retry your update ", "request_id": "req-b1586e3d-dc8a-45b8-b395-5fd95001d87d"}]} May 28 21:03:54.542160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dc8bbeef-1565-4fea-934e-a0829a8c8a4b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:54.549802 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dc8bbeef-1565-4fea-934e-a0829a8c8a4b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1319 microversion: 2.1 time: 0.192851 May 28 21:03:54.550396 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 152/279] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:54 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:54.555174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-35877adf-2fc2-4541-ae4c-708e393a6e4f tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:54.555923 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:54.555923 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:54.575222 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aa823458-ebe7-4015-b0eb-23af1f67d8bc tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 243 microversion: 2.1 time: 0.446711 May 28 21:03:54.576557 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 128/280] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:03:54 2022] POST /compute/v2.1/os-aggregates/13/action => generated 243 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:54.586493 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-35877adf-2fc2-4541-ae4c-708e393a6e4f tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] HTTP exception thrown: Aggregate 12 could not be found. May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-35877adf-2fc2-4541-ae4c-708e393a6e4f tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Request method failure captured: May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-aggregates/12 HTTP/1.1 May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko39Ha4oSnxuDLIz1SCYZ3rW_RIgqAdJGEfJS1uh_VhgnkLjExcHCum2UuUikfhoEMg1cvb12NwiU70soYnd6r3GoWPRrYgvuU18ZIOaJvrpeZZrOsqnZZr2h9GTgcpCTOsgKVjBpu3-8GEtjQvfS6CIw8iy6MCKcvetkHOddYOIZ_4 May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 6277287bf774466582bc214b11186b70 May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminTestJSON-1477534321 May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:03:54.589124 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:03:54.590551 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6277287bf774466582bc214b11186b70", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6277287bf774466582bc214b11186b70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6277287bf774466582bc214b11186b70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6277287bf774466582bc214b11186b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:54.590551 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminTestJSON-1477534321 May 28 21:03:54.590551 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 6277287bf774466582bc214b11186b70 May 28 21:03:54.590551 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1477534321 May 28 21:03:54.590551 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminTestJSON-1477534321-project-admin May 28 21:03:54.590551 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:03:54.590551 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:03:54.590551 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: d1b067ff75914828a49edd61f6a9318b May 28 21:03:54.590551 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminTestJSON-1477534321-project-admin May 28 21:03:54.590551 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:03:54.590551 ncdv-master-1 devstack@n-api.service[143128]: exception: Aggregate 12 could not be found. May 28 21:03:54.590551 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '12'} May 28 21:03:54.590551 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:03:54.591388 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 12 could not be found. May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 12 could not be found. May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:54.592653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:54.593999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:54.593999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:03:54.593999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:03:54.593999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 12 could not be found. May 28 21:03:54.593999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:54.594815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0a748035-999b-4a48-8b15-e60700902853 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:54.594815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0a748035-999b-4a48-8b15-e60700902853 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:54.596421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-35877adf-2fc2-4541-ae4c-708e393a6e4f tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Returning 404 to user: Aggregate 12 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:54.598196 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-35877adf-2fc2-4541-ae4c-708e393a6e4f tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/12" status: 404 len: 78 microversion: 2.1 time: 0.045914 May 28 21:03:54.604941 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 153/281] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:03:54 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 78 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:03:54.605136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a748035-999b-4a48-8b15-e60700902853 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:54.605136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a748035-999b-4a48-8b15-e60700902853 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:54.606112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a748035-999b-4a48-8b15-e60700902853 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:54.606561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a748035-999b-4a48-8b15-e60700902853 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:54.611248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1069749864", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:54.676705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:03:54.853438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0a748035-999b-4a48-8b15-e60700902853 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:54.861918 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0a748035-999b-4a48-8b15-e60700902853 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1472 microversion: 2.1 time: 0.283296 May 28 21:03:54.862569 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 129/282] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:54 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1472 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:54.920955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-023350d4-e761-44e5-abda-8e9255e6a144 tempest-QuotaClassesAdminTestJSON-1231542084 tempest-QuotaClassesAdminTestJSON-1231542084-project-admin] Calling method '.version_select at 0x7f4d64972e50>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:54.921774 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:54.921774 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:54.940516 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-023350d4-e761-44e5-abda-8e9255e6a144 tempest-QuotaClassesAdminTestJSON-1231542084 tempest-QuotaClassesAdminTestJSON-1231542084-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.076559 May 28 21:03:54.947234 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 130/283] 10.222.0.33 () {58 vars in 1184 bytes} [Sat May 28 21:03:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:54.952641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-30ea8fe2-3dc8-4854-8d8f-bb277ca37d7a tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:54.954129 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:54.954129 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:54.955002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-30ea8fe2-3dc8-4854-8d8f-bb277ca37d7a tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'd870c609a91f4540bfbd7471106fc398', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7133f6301e034a2faf8215358bf3e691', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-30ea8fe2-3dc8-4854-8d8f-bb277ca37d7a tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Request method failure captured: May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 42 May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko33KPbLJXwfUJ8ak84X8jCQi_SjGobHAM92z-MjqFNnnQ6BkLTZPfDyd23ra5bMIIAwK5pJCFmLSmqnUEdaoOVPrxpf0yK-gXQlZY-RjNbWVfBnkuDf2q7wdSxB-eQlmECQoCgYaKp1fSrw5cbrAO6Kh2OGf7JPKCAJb5vv16CgCpc May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 7133f6301e034a2faf8215358bf3e691 May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:03:54.956595 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:03:54.958337 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7133f6301e034a2faf8215358bf3e691", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7133f6301e034a2faf8215358bf3e691"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:54.958337 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:03:54.958337 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 7133f6301e034a2faf8215358bf3e691 May 28 21:03:54.958337 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-265216604 May 28 21:03:54.958337 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AggregatesAdminNegativeTestJSON-265216604-project May 28 21:03:54.958337 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:03:54.958337 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:03:54.958337 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: d870c609a91f4540bfbd7471106fc398 May 28 21:03:54.958337 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-265216604-project May 28 21:03:54.958337 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:03:54.958337 ncdv-master-1 devstack@n-api.service[143129]: {"remove_host": {"host": "nch1-master-1"}} May 28 21:03:54.958337 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:03:54.958337 ncdv-master-1 devstack@n-api.service[143129]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '13', 'body': {'remove_host': {'host': 'nch1-master-1'}}} May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:03:54.959198 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. May 28 21:03:54.960495 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:03:54.961775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-30ea8fe2-3dc8-4854-8d8f-bb277ca37d7a tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:54.961775 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-30ea8fe2-3dc8-4854-8d8f-bb277ca37d7a tempest-AggregatesAdminNegativeTestJSON-265216604 tempest-AggregatesAdminNegativeTestJSON-265216604-project] 10.222.0.33 "POST /compute/v2.1/os-aggregates/13/action" status: 403 len: 121 microversion: 2.1 time: 0.009493 May 28 21:03:54.961775 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 131/284] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:03:54 2022] POST /compute/v2.1/os-aggregates/13/action => generated 121 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:03:54.967493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0c27467a-2abf-4f9a-bd14-e73750268276 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-994998007", "name": "tempest-test_aggregate-1111289078"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:54.968865 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:54.968865 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:54.969783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.aggregate [None req-0c27467a-2abf-4f9a-bd14-e73750268276 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Generated uuid b50b8ef4-adb9-46f4-a7bd-1699316e545a for aggregate {{(pid=143129) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:03:54.982351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:03:54.982966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:03:54.983591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:03:54.984313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:03:54.984430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:54.984974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:03:54.995697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:54.996211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:54.997172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:54.997754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:55.015026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Getting quotas for project b6c7378af3e841f58fdf1a907d06bc08. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:03:55.020105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Getting quotas for user 0e733cc9497a48cba4ccdde860be104f and project b6c7378af3e841f58fdf1a907d06bc08. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:03:55.032954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:03:55.035230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:03:55.118507 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0c27467a-2abf-4f9a-bd14-e73750268276 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.158246 May 28 21:03:55.119330 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 132/285] 10.222.0.33 () {60 vars in 1164 bytes} [Sat May 28 21:03:54 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:55.127939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1d5366c6-ee4a-4ffd-ad13-dc0903f35317 tempest-QuotaClassesAdminTestJSON-1231542084 tempest-QuotaClassesAdminTestJSON-1231542084-project-admin] Action: 'update', calling method: .version_select at 0x7f4d64910a60>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:55.129945 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:55.129945 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:55.157669 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3e99b661-844a-4dcb-b04f-5ec9786d658b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554013 May 28 21:03:55.158348 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 154/286] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:03:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:03:55.164113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f5270bdf-f4eb-4d95-9c9a-bc993f8d9b40 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:55.165375 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:55.165375 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:55.174595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5270bdf-f4eb-4d95-9c9a-bc993f8d9b40 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:55.175042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5270bdf-f4eb-4d95-9c9a-bc993f8d9b40 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:55.465548 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f5270bdf-f4eb-4d95-9c9a-bc993f8d9b40 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.305287 May 28 21:03:55.466664 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 155/287] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:03:55 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:55.472354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-12fbda00-4c75-4160-8a2e-f4850b438161 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:55.473524 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:55.473524 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:55.555468 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-12fbda00-4c75-4160-8a2e-f4850b438161 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.084769 May 28 21:03:55.555468 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 156/288] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:03:55 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:03:55.558912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-640c7a0c-7425-4d1e-a3a3-d2e2fd10bf61 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:55.559710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-640c7a0c-7425-4d1e-a3a3-d2e2fd10bf61 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:55.567412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-640c7a0c-7425-4d1e-a3a3-d2e2fd10bf61 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:55.567859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-640c7a0c-7425-4d1e-a3a3-d2e2fd10bf61 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:55.568852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-640c7a0c-7425-4d1e-a3a3-d2e2fd10bf61 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:55.569290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-640c7a0c-7425-4d1e-a3a3-d2e2fd10bf61 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:55.702762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-640c7a0c-7425-4d1e-a3a3-d2e2fd10bf61 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:55.711906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-640c7a0c-7425-4d1e-a3a3-d2e2fd10bf61 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:55.713431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-640c7a0c-7425-4d1e-a3a3-d2e2fd10bf61 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:55.714617 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-640c7a0c-7425-4d1e-a3a3-d2e2fd10bf61 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1557 microversion: 2.25 time: 0.160206 May 28 21:03:55.715489 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 157/289] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:03:55 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:55.720039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f7161734-f1a3-4dbd-9593-c650c982a00d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:55.720652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f7161734-f1a3-4dbd-9593-c650c982a00d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:55.774341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f7161734-f1a3-4dbd-9593-c650c982a00d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:55.790036 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f7161734-f1a3-4dbd-9593-c650c982a00d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1219 microversion: 2.1 time: 0.073437 May 28 21:03:55.790633 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 158/290] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:55 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:55.795053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dde961ab-7dd4-44b6-8515-df06899474d9 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:55.795805 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:55.795805 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:55.878592 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dde961ab-7dd4-44b6-8515-df06899474d9 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.086893 May 28 21:03:55.879190 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 159/291] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:03:55 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:03:55.885408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a33e25de-50fb-4c41-950a-20246c0ba462 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:55.886215 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:55.886215 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:55.892558 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-a33e25de-50fb-4c41-950a-20246c0ba462 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] HTTP exception thrown: Aggregate 14 could not be found. May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a33e25de-50fb-4c41-950a-20246c0ba462 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Request method failure captured: May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko39Ha4oSnxuDLIz1SCYZ3rW_RIgqAdJGEfJS1uh_VhgnkLjExcHCum2UuUikfhoEMg1cvb12NwiU70soYnd6r3GoWPRrYgvuU18ZIOaJvrpeZZrOsqnZZr2h9GTgcpCTOsgKVjBpu3-8GEtjQvfS6CIw8iy6MCKcvetkHOddYOIZ_4 May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 6277287bf774466582bc214b11186b70 May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminTestJSON-1477534321 May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:03:55.894160 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:03:55.895833 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6277287bf774466582bc214b11186b70", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6277287bf774466582bc214b11186b70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6277287bf774466582bc214b11186b70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6277287bf774466582bc214b11186b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:55.895833 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminTestJSON-1477534321 May 28 21:03:55.895833 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 6277287bf774466582bc214b11186b70 May 28 21:03:55.895833 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1477534321 May 28 21:03:55.895833 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminTestJSON-1477534321-project-admin May 28 21:03:55.895833 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:03:55.895833 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:03:55.895833 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: d1b067ff75914828a49edd61f6a9318b May 28 21:03:55.895833 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminTestJSON-1477534321-project-admin May 28 21:03:55.895833 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:03:55.895833 ncdv-master-1 devstack@n-api.service[143128]: exception: Aggregate 14 could not be found. May 28 21:03:55.895833 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '14'} May 28 21:03:55.895833 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:55.896586 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. May 28 21:03:55.898701 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:55.900132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a33e25de-50fb-4c41-950a-20246c0ba462 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:55.900132 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a33e25de-50fb-4c41-950a-20246c0ba462 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.015234 May 28 21:03:55.900132 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 160/292] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:03:55 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:03:55.901650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5b0bbd22-0950-4140-b0d4-607fefe19ab9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:55.902372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5b0bbd22-0950-4140-b0d4-607fefe19ab9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:55.909497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b0bbd22-0950-4140-b0d4-607fefe19ab9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:55.909996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b0bbd22-0950-4140-b0d4-607fefe19ab9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:55.910837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b0bbd22-0950-4140-b0d4-607fefe19ab9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:55.911284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b0bbd22-0950-4140-b0d4-607fefe19ab9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:56.054159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5b0bbd22-0950-4140-b0d4-607fefe19ab9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:56.066299 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5b0bbd22-0950-4140-b0d4-607fefe19ab9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1319 microversion: 2.1 time: 0.168706 May 28 21:03:56.066589 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 161/293] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:55 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:56.200106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-65e986d1-0b60-4de2-be7f-9727afa1e461 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:56.204553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-65e986d1-0b60-4de2-be7f-9727afa1e461 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:56.206878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65e986d1-0b60-4de2-be7f-9727afa1e461 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:56.207505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65e986d1-0b60-4de2-be7f-9727afa1e461 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:56.208271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65e986d1-0b60-4de2-be7f-9727afa1e461 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:56.208704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65e986d1-0b60-4de2-be7f-9727afa1e461 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:56.453303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-65e986d1-0b60-4de2-be7f-9727afa1e461 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'services' on Instance uuid 5a5aeda8-15ad-4cb5-afde-74d2498a22ca {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:03:56.453303 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-65e986d1-0b60-4de2-be7f-9727afa1e461 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 2050 microversion: 2.25 time: 0.342992 May 28 21:03:56.453303 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 162/294] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:03:56 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 2050 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:56.453303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cc5e718d-a317-4cf9-acf5-82e7fc6197ab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:56.453303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cc5e718d-a317-4cf9-acf5-82e7fc6197ab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:56.454220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc5e718d-a317-4cf9-acf5-82e7fc6197ab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:56.454220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc5e718d-a317-4cf9-acf5-82e7fc6197ab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:56.454220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc5e718d-a317-4cf9-acf5-82e7fc6197ab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:56.454220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc5e718d-a317-4cf9-acf5-82e7fc6197ab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:56.686740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cc5e718d-a317-4cf9-acf5-82e7fc6197ab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:56.694933 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cc5e718d-a317-4cf9-acf5-82e7fc6197ab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1472 microversion: 2.1 time: 0.282709 May 28 21:03:56.695560 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 163/295] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:56 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1472 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:56.703667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7df90096-9572-40f9-90ce-0635ade6025f tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2042675546"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:56.704967 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:56.704967 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:56.705913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.aggregate [None req-7df90096-9572-40f9-90ce-0635ade6025f tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Generated uuid de42fe91-a927-477d-a2c3-ad6aa7a74e90 for aggregate {{(pid=143128) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:03:56.897290 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7df90096-9572-40f9-90ce-0635ade6025f tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.200164 May 28 21:03:56.898391 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 164/296] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:03:56 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:56.903825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d50259e4-0bcf-410e-837d-766ed824b30e tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:56.904584 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:56.904584 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:56.915969 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-d50259e4-0bcf-410e-837d-766ed824b30e tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] HTTP exception thrown: Aggregate 14 could not be found. May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d50259e4-0bcf-410e-837d-766ed824b30e tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Request method failure captured: May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko39Ha4oSnxuDLIz1SCYZ3rW_RIgqAdJGEfJS1uh_VhgnkLjExcHCum2UuUikfhoEMg1cvb12NwiU70soYnd6r3GoWPRrYgvuU18ZIOaJvrpeZZrOsqnZZr2h9GTgcpCTOsgKVjBpu3-8GEtjQvfS6CIw8iy6MCKcvetkHOddYOIZ_4 May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 6277287bf774466582bc214b11186b70 May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminTestJSON-1477534321 May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:03:56.917697 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:03:56.919032 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6277287bf774466582bc214b11186b70", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6277287bf774466582bc214b11186b70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6277287bf774466582bc214b11186b70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6277287bf774466582bc214b11186b70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:56.919032 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminTestJSON-1477534321 May 28 21:03:56.919032 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 6277287bf774466582bc214b11186b70 May 28 21:03:56.919032 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1477534321 May 28 21:03:56.919032 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminTestJSON-1477534321-project-admin May 28 21:03:56.919032 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:03:56.919032 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:03:56.919032 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: d1b067ff75914828a49edd61f6a9318b May 28 21:03:56.919032 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminTestJSON-1477534321-project-admin May 28 21:03:56.919032 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:03:56.919032 ncdv-master-1 devstack@n-api.service[143128]: exception: Aggregate 14 could not be found. May 28 21:03:56.919032 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '14'} May 28 21:03:56.919032 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:03:56.919780 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:56.920990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:56.922225 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:56.922225 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:03:56.922225 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:03:56.922225 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. May 28 21:03:56.922225 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:56.922225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d50259e4-0bcf-410e-837d-766ed824b30e tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:56.922225 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d50259e4-0bcf-410e-837d-766ed824b30e tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.019550 May 28 21:03:56.925636 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 165/297] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:03:56 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:03:56.930775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-0922e934-a49d-4221-96a2-b345b6b49aa7 req-a7846e83-bb40-4344-83cc-f30319f0823a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76fb3f87-77b7-4de0-b4f2-8f54809d3ec8", "name": "network-vif-plugged", "status": "completed", "tag": "64c8a0b3-7223-443b-a027-c61aa0dab93c"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:56.939092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0922e934-a49d-4221-96a2-b345b6b49aa7 req-a7846e83-bb40-4344-83cc-f30319f0823a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:56.939529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0922e934-a49d-4221-96a2-b345b6b49aa7 req-a7846e83-bb40-4344-83cc-f30319f0823a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:56.951450 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-0922e934-a49d-4221-96a2-b345b6b49aa7 req-a7846e83-bb40-4344-83cc-f30319f0823a service nova] Creating event network-vif-plugged:64c8a0b3-7223-443b-a027-c61aa0dab93c for instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 on nch2-master-1 May 28 21:03:56.953386 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1d5366c6-ee4a-4ffd-ad13-dc0903f35317 tempest-QuotaClassesAdminTestJSON-1231542084 tempest-QuotaClassesAdminTestJSON-1231542084-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.828228 May 28 21:03:56.953386 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 133/298] 10.222.0.33 () {60 vars in 1205 bytes} [Sat May 28 21:03:55 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:56.957451 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-0922e934-a49d-4221-96a2-b345b6b49aa7 req-a7846e83-bb40-4344-83cc-f30319f0823a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030231 May 28 21:03:56.957992 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 166/299] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:56.958866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-74596391-9509-4716-9719-6bb631c26b27 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:56.960122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-74596391-9509-4716-9719-6bb631c26b27 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:56.965458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-51f5445d-3924-4ca9-83e5-96fa3330695f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:56.966428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-51f5445d-3924-4ca9-83e5-96fa3330695f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:56.971144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74596391-9509-4716-9719-6bb631c26b27 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:56.972412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74596391-9509-4716-9719-6bb631c26b27 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:56.973149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51f5445d-3924-4ca9-83e5-96fa3330695f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:56.973674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51f5445d-3924-4ca9-83e5-96fa3330695f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:56.974122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74596391-9509-4716-9719-6bb631c26b27 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:56.974403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51f5445d-3924-4ca9-83e5-96fa3330695f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:56.974839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51f5445d-3924-4ca9-83e5-96fa3330695f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:56.975865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74596391-9509-4716-9719-6bb631c26b27 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:57.075079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-51f5445d-3924-4ca9-83e5-96fa3330695f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:57.085221 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-51f5445d-3924-4ca9-83e5-96fa3330695f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1223 microversion: 2.1 time: 0.124903 May 28 21:03:57.086102 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 167/300] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:56 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1223 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:57.090716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5dcd821a-3a2e-454a-8f36-3cac50a08491 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:57.092317 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:57.092317 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:57.102282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5dcd821a-3a2e-454a-8f36-3cac50a08491 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:57.103020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5dcd821a-3a2e-454a-8f36-3cac50a08491 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:57.109540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5dcd821a-3a2e-454a-8f36-3cac50a08491 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:57.110128 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5dcd821a-3a2e-454a-8f36-3cac50a08491 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:57.118276 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.compute.aggregates [None req-5dcd821a-3a2e-454a-8f36-3cac50a08491 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 28 21:03:57.118946 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-5dcd821a-3a2e-454a-8f36-3cac50a08491 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5dcd821a-3a2e-454a-8f36-3cac50a08491 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Request method failure captured: May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 42 May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko370rLdfXX4RvwKIIWwK-2mPGBCkpX0PzL-OxzORwnUdnHaFT41nxek8xgx2O8JdRJse_n5803IES7o4r9sVN0MpSfgwrSxYiyf3hdkC-ftGvC_oIP0nL27MCioSlDipifKv3tIx0h5o-kJLhdOqqgXgNPHmQHomd8e3HzFGpiSxgA May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:03:57.121298 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:03:57.122566 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0eeea9efb9364971b8335deff54816d3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0eeea9efb9364971b8335deff54816d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:03:57.122566 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:03:57.122566 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0eeea9efb9364971b8335deff54816d3 May 28 21:03:57.122566 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595 May 28 21:03:57.122566 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:03:57.122566 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:03:57.122566 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:03:57.122566 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 2fb485e80a0c42e6bae2142de7c23338 May 28 21:03:57.122566 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin May 28 21:03:57.122566 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:03:57.122566 ncdv-master-1 devstack@n-api.service[143128]: {"remove_host": {"host": "nonexist_host"}} May 28 21:03:57.122566 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:03:57.122566 ncdv-master-1 devstack@n-api.service[143128]: exception: Cannot remove host nonexist_host in aggregate 15 May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host May 28 21:03:57.123298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) May 28 21:03:57.125011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:57.126298 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:03:57.128856 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:03:57.128856 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:03:57.128856 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:03:57.128856 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:03:57.128856 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 May 28 21:03:57.128856 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:03:57.128856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5dcd821a-3a2e-454a-8f36-3cac50a08491 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:03:57.128856 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5dcd821a-3a2e-454a-8f36-3cac50a08491 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.035568 May 28 21:03:57.128856 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 168/301] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:03:57 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:03:57.133539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4e79d2a1-d4b4-432f-936a-d0e29695a646 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1193437663"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:57.134978 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:57.134978 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:57.135848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.aggregate [None req-4e79d2a1-d4b4-432f-936a-d0e29695a646 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Generated uuid 7eaf5e7e-24dc-4d59-ae38-0547d346e82b for aggregate {{(pid=143128) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:03:57.165422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-74596391-9509-4716-9719-6bb631c26b27 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'services' on Instance uuid 5a5aeda8-15ad-4cb5-afde-74d2498a22ca {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:03:57.216600 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-74596391-9509-4716-9719-6bb631c26b27 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 2050 microversion: 2.25 time: 0.261888 May 28 21:03:57.217105 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 134/302] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:03:56 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 2050 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:03:57.221590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-683bd6a5-3d2a-45d5-a739-47269b76ccc0 tempest-QuotaClassesAdminTestJSON-1231542084 tempest-QuotaClassesAdminTestJSON-1231542084-project-admin] Calling method '.version_select at 0x7f4d64910b80>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:57.222639 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:57.222639 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:57.232952 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-683bd6a5-3d2a-45d5-a739-47269b76ccc0 tempest-QuotaClassesAdminTestJSON-1231542084 tempest-QuotaClassesAdminTestJSON-1231542084-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.014653 May 28 21:03:57.233692 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 135/303] 10.222.0.33 () {58 vars in 1184 bytes} [Sat May 28 21:03:57 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:57.242821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3c1374f4-c984-4f4c-88ad-8595549bb4b0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:57.243519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3c1374f4-c984-4f4c-88ad-8595549bb4b0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:57.249786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c1374f4-c984-4f4c-88ad-8595549bb4b0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:57.250274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c1374f4-c984-4f4c-88ad-8595549bb4b0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:57.251042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c1374f4-c984-4f4c-88ad-8595549bb4b0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:57.251485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c1374f4-c984-4f4c-88ad-8595549bb4b0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:57.273609 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4e79d2a1-d4b4-432f-936a-d0e29695a646 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.144920 May 28 21:03:57.274823 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 169/304] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:03:57 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:57.280516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-284d8fae-266c-4ae4-937a-32f3b28c26b6 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:57.281385 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:57.281385 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:57.392186 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-284d8fae-266c-4ae4-937a-32f3b28c26b6 tempest-AggregatesAdminNegativeTestJSON-1172966595 tempest-AggregatesAdminNegativeTestJSON-1172966595-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.115605 May 28 21:03:57.396218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3c1374f4-c984-4f4c-88ad-8595549bb4b0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:57.397961 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 170/305] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:03:57 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:03:57.405036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ed9f539f-2a10-46f6-bf4d-fa336557b114 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:57.405437 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3c1374f4-c984-4f4c-88ad-8595549bb4b0 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1319 microversion: 2.1 time: 0.166446 May 28 21:03:57.406319 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 136/306] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:57 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:57.414948 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:57.414948 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:57.414948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed9f539f-2a10-46f6-bf4d-fa336557b114 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:57.414948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed9f539f-2a10-46f6-bf4d-fa336557b114 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:57.414948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed9f539f-2a10-46f6-bf4d-fa336557b114 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:57.415348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed9f539f-2a10-46f6-bf4d-fa336557b114 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:57.422055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c1358e46-d2a7-40a4-a502-b4d33905a4ff tempest-QuotaClassesAdminTestJSON-1231542084 tempest-QuotaClassesAdminTestJSON-1231542084-project-admin] Action: 'update', calling method: .version_select at 0x7f4d64910dc0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:57.426027 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:57.426027 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:57.441588 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ed9f539f-2a10-46f6-bf4d-fa336557b114 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.042262 May 28 21:03:57.442235 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 171/307] 10.222.0.33 () {60 vars in 1216 bytes} [Sat May 28 21:03:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:03:57.450668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-444223fe-5b29-48bf-a238-d094c4bc478b tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:57.460580 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:57.460580 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:03:57.460580 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-444223fe-5b29-48bf-a238-d094c4bc478b tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.016485 May 28 21:03:57.461650 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 172/308] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:03:57 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:57.468217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2d5f9063-00b2-40c2-8819-8b825021ab59 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:57.469795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2d5f9063-00b2-40c2-8819-8b825021ab59 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:57.476279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d5f9063-00b2-40c2-8819-8b825021ab59 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:57.476743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d5f9063-00b2-40c2-8819-8b825021ab59 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:57.477566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d5f9063-00b2-40c2-8819-8b825021ab59 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:57.478063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d5f9063-00b2-40c2-8819-8b825021ab59 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:57.546788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-2d5f9063-00b2-40c2-8819-8b825021ab59 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'flavor' on Instance uuid 5a5aeda8-15ad-4cb5-afde-74d2498a22ca {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:03:57.593200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2d5f9063-00b2-40c2-8819-8b825021ab59 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Going to try to live migrate instance to nch1-master-1 {{(pid=143128) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 21:03:58.637547 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c1358e46-d2a7-40a4-a502-b4d33905a4ff tempest-QuotaClassesAdminTestJSON-1231542084 tempest-QuotaClassesAdminTestJSON-1231542084-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.220624 May 28 21:03:58.642022 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 137/309] 10.222.0.33 () {60 vars in 1205 bytes} [Sat May 28 21:03:57 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:58.655697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4b9eeacf-aaf2-4dc1-990e-9706cf2a630b tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:58.657330 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:58.657330 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:58.681200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:INSERT=13,nova_api:SELECT=63,nova_api:UPDATE=24 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:03:58.764206 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4b9eeacf-aaf2-4dc1-990e-9706cf2a630b tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.120704 May 28 21:03:58.765187 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 138/310] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:03:58 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:58.773491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-936cd283-fbaa-4203-9345-906c554447e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:58.774474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-936cd283-fbaa-4203-9345-906c554447e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:58.787150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-936cd283-fbaa-4203-9345-906c554447e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:58.787150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-936cd283-fbaa-4203-9345-906c554447e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:58.787150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-936cd283-fbaa-4203-9345-906c554447e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:58.787150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-936cd283-fbaa-4203-9345-906c554447e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:58.962518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-936cd283-fbaa-4203-9345-906c554447e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:58.971523 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-936cd283-fbaa-4203-9345-906c554447e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.204564 May 28 21:03:58.972221 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 139/311] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:58 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:58.977078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c10f0b7b-438f-4f15-8eb1-a2e28579f2b7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:58.977767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c10f0b7b-438f-4f15-8eb1-a2e28579f2b7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:58.984027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c10f0b7b-438f-4f15-8eb1-a2e28579f2b7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:58.984564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c10f0b7b-438f-4f15-8eb1-a2e28579f2b7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:58.985411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c10f0b7b-438f-4f15-8eb1-a2e28579f2b7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:58.986197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c10f0b7b-438f-4f15-8eb1-a2e28579f2b7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:59.154639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c10f0b7b-438f-4f15-8eb1-a2e28579f2b7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:59.164467 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c10f0b7b-438f-4f15-8eb1-a2e28579f2b7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1319 microversion: 2.1 time: 0.191006 May 28 21:03:59.174975 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 140/312] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:58 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:59.180576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4fbd8d02-9b3e-48ec-b1b2-1b443dc4725a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:59.181181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4fbd8d02-9b3e-48ec-b1b2-1b443dc4725a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:59.187711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fbd8d02-9b3e-48ec-b1b2-1b443dc4725a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:59.191653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fbd8d02-9b3e-48ec-b1b2-1b443dc4725a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:59.191653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fbd8d02-9b3e-48ec-b1b2-1b443dc4725a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:59.191653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fbd8d02-9b3e-48ec-b1b2-1b443dc4725a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:59.345074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4fbd8d02-9b3e-48ec-b1b2-1b443dc4725a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:03:59.366912 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4fbd8d02-9b3e-48ec-b1b2-1b443dc4725a tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1469 microversion: 2.1 time: 0.188018 May 28 21:03:59.367634 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 141/313] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:03:59 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1469 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:03:59.387647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f944a563-232f-4253-8f36-7005f41eb828 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:59.391777 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:59.391777 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:59.400245 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f944a563-232f-4253-8f36-7005f41eb828 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.016832 May 28 21:03:59.401530 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 142/314] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:03:59 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:03:59.406652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-141f0355-9439-48f7-869f-62fff2403788 tempest-DeleteServersAdminTestJSON-1492394443 tempest-DeleteServersAdminTestJSON-1492394443-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:03:59.413078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-141f0355-9439-48f7-869f-62fff2403788 tempest-DeleteServersAdminTestJSON-1492394443 tempest-DeleteServersAdminTestJSON-1492394443-project-admin] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:03:59.415394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-141f0355-9439-48f7-869f-62fff2403788 tempest-DeleteServersAdminTestJSON-1492394443 tempest-DeleteServersAdminTestJSON-1492394443-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:59.416014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-141f0355-9439-48f7-869f-62fff2403788 tempest-DeleteServersAdminTestJSON-1492394443 tempest-DeleteServersAdminTestJSON-1492394443-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:59.416948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-141f0355-9439-48f7-869f-62fff2403788 tempest-DeleteServersAdminTestJSON-1492394443 tempest-DeleteServersAdminTestJSON-1492394443-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:03:59.417542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-141f0355-9439-48f7-869f-62fff2403788 tempest-DeleteServersAdminTestJSON-1492394443 tempest-DeleteServersAdminTestJSON-1492394443-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:03:59.862825 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-141f0355-9439-48f7-869f-62fff2403788 tempest-DeleteServersAdminTestJSON-1492394443 tempest-DeleteServersAdminTestJSON-1492394443-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8/action" status: 202 len: 0 microversion: 2.1 time: 0.459867 May 28 21:03:59.866687 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 143/315] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:03:59 2022] POST /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:03:59.871846 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b8ca5f8d-6f4e-48d2-9bb3-95d57a3145a4 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:03:59.872772 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:03:59.872772 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:03:59.999949 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b8ca5f8d-6f4e-48d2-9bb3-95d57a3145a4 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.131963 May 28 21:04:00.000599 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 144/316] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:03:59 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:04:00.005717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-871f7c74-f033-4bd9-addf-cc867b9ae30b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:00.006486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-871f7c74-f033-4bd9-addf-cc867b9ae30b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:00.012811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-871f7c74-f033-4bd9-addf-cc867b9ae30b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:00.013417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-871f7c74-f033-4bd9-addf-cc867b9ae30b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:00.014225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-871f7c74-f033-4bd9-addf-cc867b9ae30b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:00.014799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-871f7c74-f033-4bd9-addf-cc867b9ae30b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:00.048337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-871f7c74-f033-4bd9-addf-cc867b9ae30b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:00.048807 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-871f7c74-f033-4bd9-addf-cc867b9ae30b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:00.052162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-871f7c74-f033-4bd9-addf-cc867b9ae30b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lazy-loading 'fault' on Instance uuid 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:00.275200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-871f7c74-f033-4bd9-addf-cc867b9ae30b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:00.283848 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-871f7c74-f033-4bd9-addf-cc867b9ae30b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1452 microversion: 2.1 time: 0.282186 May 28 21:04:00.284432 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 145/317] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:00 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1452 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:00.290423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-adce9e28-3103-4477-937b-424ceb85362e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:00.291034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-adce9e28-3103-4477-937b-424ceb85362e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:00.301882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-adce9e28-3103-4477-937b-424ceb85362e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:00.302375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-adce9e28-3103-4477-937b-424ceb85362e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:00.304247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-adce9e28-3103-4477-937b-424ceb85362e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:00.304777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-adce9e28-3103-4477-937b-424ceb85362e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:00.461620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-adce9e28-3103-4477-937b-424ceb85362e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:00.469467 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-adce9e28-3103-4477-937b-424ceb85362e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.184018 May 28 21:04:00.470071 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 146/318] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:00 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:00.474674 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e2e17cd3-b28b-4376-8f5e-793012efabf3 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-560700028", "availability_zone": "tempest-test_az-11866658"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:00.476672 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:00.476672 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:00.477556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.aggregate [None req-e2e17cd3-b28b-4376-8f5e-793012efabf3 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Generated uuid 8bb63af1-4ca5-4125-9a4e-612b83a1d1fc for aggregate {{(pid=143129) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:04:00.567078 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e2e17cd3-b28b-4376-8f5e-793012efabf3 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.095726 May 28 21:04:00.569009 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 147/319] 10.222.0.33 () {60 vars in 1164 bytes} [Sat May 28 21:04:00 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:00.575737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-165b8e84-2a68-425d-9b4e-c6c161df71aa req-455abafb-7e53-48d5-b4c0-8f6e7a435c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "080ad07a-7fee-47d3-b63d-64528a1a2fee", "tag": "47695f97-27b1-4ab1-b7b1-dd2664c2a147"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:00.604738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-165b8e84-2a68-425d-9b4e-c6c161df71aa req-455abafb-7e53-48d5-b4c0-8f6e7a435c8b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:00.605585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-165b8e84-2a68-425d-9b4e-c6c161df71aa req-455abafb-7e53-48d5-b4c0-8f6e7a435c8b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:00.618883 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-165b8e84-2a68-425d-9b4e-c6c161df71aa req-455abafb-7e53-48d5-b4c0-8f6e7a435c8b service nova] Creating event network-changed:47695f97-27b1-4ab1-b7b1-dd2664c2a147 for instance 080ad07a-7fee-47d3-b63d-64528a1a2fee on nch1-master-1 May 28 21:04:00.625665 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-165b8e84-2a68-425d-9b4e-c6c161df71aa req-455abafb-7e53-48d5-b4c0-8f6e7a435c8b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054626 May 28 21:04:00.627189 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 148/320] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:00.636061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1b80e515-5feb-47f0-96d9-f646f7a909c3 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:00.637157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1b80e515-5feb-47f0-96d9-f646f7a909c3 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:00.651035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b80e515-5feb-47f0-96d9-f646f7a909c3 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:00.651035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b80e515-5feb-47f0-96d9-f646f7a909c3 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:00.651035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b80e515-5feb-47f0-96d9-f646f7a909c3 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:00.652027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b80e515-5feb-47f0-96d9-f646f7a909c3 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:00.813492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1b80e515-5feb-47f0-96d9-f646f7a909c3 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:00.821235 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1b80e515-5feb-47f0-96d9-f646f7a909c3 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1319 microversion: 2.1 time: 0.191935 May 28 21:04:00.822027 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 149/321] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:00 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:00.827975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e278e67f-84b1-4bc7-8052-e1a649452248 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:00.828615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e278e67f-84b1-4bc7-8052-e1a649452248 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:00.836967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e278e67f-84b1-4bc7-8052-e1a649452248 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:00.842463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e278e67f-84b1-4bc7-8052-e1a649452248 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:00.842463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e278e67f-84b1-4bc7-8052-e1a649452248 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:00.842463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e278e67f-84b1-4bc7-8052-e1a649452248 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:00.842463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:00.866733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e278e67f-84b1-4bc7-8052-e1a649452248 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:04:01.269057 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e278e67f-84b1-4bc7-8052-e1a649452248 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "DELETE /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 204 len: 0 microversion: 2.1 time: 0.445833 May 28 21:04:01.269814 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 150/322] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:04:00 2022] DELETE /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:04:01.275051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ce340cae-d5e7-43fd-9103-7b5128c7f038 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-560700028_new", "availability_zone": "tempest-test_az-11866658_new"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:01.277377 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:01.277377 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:01.370994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce340cae-d5e7-43fd-9103-7b5128c7f038 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:01.371452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce340cae-d5e7-43fd-9103-7b5128c7f038 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:01.386889 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2d5f9063-00b2-40c2-8819-8b825021ab59 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca/action" status: 202 len: 0 microversion: 2.25 time: 3.923597 May 28 21:04:01.387777 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 173/323] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:03:57 2022] POST /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca/action => generated 0 bytes in 3925 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 21:04:01.396653 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d043bb4b-ee55-414f-ad36-5cc480bcfff4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:01.397523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d043bb4b-ee55-414f-ad36-5cc480bcfff4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:01.409450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d043bb4b-ee55-414f-ad36-5cc480bcfff4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:01.410272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d043bb4b-ee55-414f-ad36-5cc480bcfff4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:01.411248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d043bb4b-ee55-414f-ad36-5cc480bcfff4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:01.411693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d043bb4b-ee55-414f-ad36-5cc480bcfff4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:01.447721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d043bb4b-ee55-414f-ad36-5cc480bcfff4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:01.448183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d043bb4b-ee55-414f-ad36-5cc480bcfff4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:01.448684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-d043bb4b-ee55-414f-ad36-5cc480bcfff4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lazy-loading 'fault' on Instance uuid 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:01.497200 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ce340cae-d5e7-43fd-9103-7b5128c7f038 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 332 microversion: 2.1 time: 0.226002 May 28 21:04:01.503212 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 151/324] 10.222.0.33 () {60 vars in 1172 bytes} [Sat May 28 21:04:01 2022] PUT /compute/v2.1/os-aggregates/17 => generated 332 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:01.508918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89b38a04-2c69-425a-a322-3648c3452478 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:01.509653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-89b38a04-2c69-425a-a322-3648c3452478 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:01.516936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89b38a04-2c69-425a-a322-3648c3452478 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:01.517438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89b38a04-2c69-425a-a322-3648c3452478 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:01.518330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89b38a04-2c69-425a-a322-3648c3452478 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:01.518774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89b38a04-2c69-425a-a322-3648c3452478 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:01.585426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d043bb4b-ee55-414f-ad36-5cc480bcfff4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:01.613206 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d043bb4b-ee55-414f-ad36-5cc480bcfff4 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1458 microversion: 2.1 time: 0.220721 May 28 21:04:01.614358 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 174/325] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:01 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1458 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:01.620348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4e5315ec-297a-4ebd-a5d3-e0bd09aa7b99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:01.620961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4e5315ec-297a-4ebd-a5d3-e0bd09aa7b99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:01.630158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e5315ec-297a-4ebd-a5d3-e0bd09aa7b99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:01.632223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e5315ec-297a-4ebd-a5d3-e0bd09aa7b99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:01.633050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e5315ec-297a-4ebd-a5d3-e0bd09aa7b99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:01.633495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e5315ec-297a-4ebd-a5d3-e0bd09aa7b99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:01.655959 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:01.682327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-89b38a04-2c69-425a-a322-3648c3452478 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:01.692489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-89b38a04-2c69-425a-a322-3648c3452478 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:01.694110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-89b38a04-2c69-425a-a322-3648c3452478 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:01.695278 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-89b38a04-2c69-425a-a322-3648c3452478 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1567 microversion: 2.25 time: 0.190812 May 28 21:04:01.695836 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 152/326] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:01 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:01.705370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fcaec5ea-f8f8-4387-a206-909b2fad5bca tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:01.710400 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:01.710400 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:01.719667 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fcaec5ea-f8f8-4387-a206-909b2fad5bca tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 335 microversion: 2.1 time: 0.022780 May 28 21:04:01.720383 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 153/327] 10.222.0.33 () {58 vars in 1142 bytes} [Sat May 28 21:04:01 2022] GET /compute/v2.1/os-aggregates => generated 335 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:01.732466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-df084b2d-88bc-471c-8165-e40e21bb8c89 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:01.733355 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:01.733355 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:01.802702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4e5315ec-297a-4ebd-a5d3-e0bd09aa7b99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:01.811221 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4e5315ec-297a-4ebd-a5d3-e0bd09aa7b99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.195664 May 28 21:04:01.811794 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 175/328] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:01 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:01.832302 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-df084b2d-88bc-471c-8165-e40e21bb8c89 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.104429 May 28 21:04:01.837375 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 154/329] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:04:01 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) May 28 21:04:01.839265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-64bdc3df-acc7-412c-9b34-087d8c16369d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:01.839878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-64bdc3df-acc7-412c-9b34-087d8c16369d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:01.845000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3dfa2634-9672-4daa-b12a-9d461f159552 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-941227445"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:01.846390 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:01.846390 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:01.846816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64bdc3df-acc7-412c-9b34-087d8c16369d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:01.847268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64bdc3df-acc7-412c-9b34-087d8c16369d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:01.847439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.aggregate [None req-3dfa2634-9672-4daa-b12a-9d461f159552 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Generated uuid 81185920-bbca-4587-9d49-f66a26e0fa33 for aggregate {{(pid=143129) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:04:01.848182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64bdc3df-acc7-412c-9b34-087d8c16369d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:01.848655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64bdc3df-acc7-412c-9b34-087d8c16369d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:01.981724 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3dfa2634-9672-4daa-b12a-9d461f159552 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.140342 May 28 21:04:01.984392 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 155/330] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:04:01 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:04:01.993203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b46c1b7a-3c6d-4ca8-a4b8-71bd7172e066 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:01.993996 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:01.993996 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:01.995367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-64bdc3df-acc7-412c-9b34-087d8c16369d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:02.004012 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-64bdc3df-acc7-412c-9b34-087d8c16369d tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1319 microversion: 2.1 time: 0.169165 May 28 21:04:02.005071 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 176/331] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:01 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:02.006437 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b46c1b7a-3c6d-4ca8-a4b8-71bd7172e066 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.017933 May 28 21:04:02.007303 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 156/332] 10.222.0.33 () {58 vars in 1142 bytes} [Sat May 28 21:04:01 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:04:02.017102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-793f750e-1043-4b7d-8dce-1988376124b1 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:02.017880 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:02.017880 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:02.099374 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-793f750e-1043-4b7d-8dce-1988376124b1 tempest-AggregatesAdminTestJSON-1477534321 tempest-AggregatesAdminTestJSON-1477534321-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.084855 May 28 21:04:02.102167 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 177/333] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:04:02 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:04:02.110475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-823a0750-6481-4226-ac7d-3b4dc1200800 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:02.111040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-823a0750-6481-4226-ac7d-3b4dc1200800 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:02.118464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-823a0750-6481-4226-ac7d-3b4dc1200800 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:02.118704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-823a0750-6481-4226-ac7d-3b4dc1200800 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:02.121615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-823a0750-6481-4226-ac7d-3b4dc1200800 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:02.122331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-823a0750-6481-4226-ac7d-3b4dc1200800 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:02.139941 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-823a0750-6481-4226-ac7d-3b4dc1200800 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] HTTP exception thrown: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-823a0750-6481-4226-ac7d-3b4dc1200800 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Request method failure captured: May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d HTTP/1.1 May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko36ckvXhU1bG6pMKOcXmUfL4sCWw8lb3OMEKBfkivz1HFmeQ45o0VukGXegdVCPq9jT6SbC595YDc9Ttchx6PRzLJAM3CPQi_ZNDcuw9X392HNPbKf-7t8jw2ZpLnxsJeF-Tl37ZEFOimuPEjQvGbJPiP_zzUapFZpa-YhXoolDiDM May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 8c0200afe2ad4f6db3a7a21cf37f65c8 May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AggregatesAdminTestJSON-1277582828 May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:04:02.142978 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:04:02.144421 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c0200afe2ad4f6db3a7a21cf37f65c8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c0200afe2ad4f6db3a7a21cf37f65c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c0200afe2ad4f6db3a7a21cf37f65c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c0200afe2ad4f6db3a7a21cf37f65c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:02.144421 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AggregatesAdminTestJSON-1277582828 May 28 21:04:02.144421 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 8c0200afe2ad4f6db3a7a21cf37f65c8 May 28 21:04:02.144421 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1277582828 May 28 21:04:02.144421 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AggregatesAdminTestJSON-1277582828-project May 28 21:04:02.144421 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:04:02.144421 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:04:02.144421 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 89ed91b9d56241d99b6df99ede3fb446 May 28 21:04:02.144421 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AggregatesAdminTestJSON-1277582828-project May 28 21:04:02.144421 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:04:02.144421 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. May 28 21:04:02.144421 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'fd0ba50c-cc90-4921-9fd4-b612903c5b1d'} May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:02.145233 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. May 28 21:04:02.149380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:02.150880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-823a0750-6481-4226-ac7d-3b4dc1200800 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Returning 404 to user: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:02.150880 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-823a0750-6481-4226-ac7d-3b4dc1200800 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 404 len: 111 microversion: 2.1 time: 0.042045 May 28 21:04:02.150880 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 157/334] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:04:02 2022] DELETE /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:04:02.157622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b5bbd4d3-f57b-4a59-899f-0196f0c42b81 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:02.158959 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b5bbd4d3-f57b-4a59-899f-0196f0c42b81 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] [instance: fd0ba50c-cc90-4921-9fd4-b612903c5b1d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:02.167726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5bbd4d3-f57b-4a59-899f-0196f0c42b81 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:02.168383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5bbd4d3-f57b-4a59-899f-0196f0c42b81 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:02.170207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5bbd4d3-f57b-4a59-899f-0196f0c42b81 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:02.170843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5bbd4d3-f57b-4a59-899f-0196f0c42b81 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:02.193385 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-b5bbd4d3-f57b-4a59-899f-0196f0c42b81 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] HTTP exception thrown: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b5bbd4d3-f57b-4a59-899f-0196f0c42b81 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Request method failure captured: May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d HTTP/1.1 May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko36ckvXhU1bG6pMKOcXmUfL4sCWw8lb3OMEKBfkivz1HFmeQ45o0VukGXegdVCPq9jT6SbC595YDc9Ttchx6PRzLJAM3CPQi_ZNDcuw9X392HNPbKf-7t8jw2ZpLnxsJeF-Tl37ZEFOimuPEjQvGbJPiP_zzUapFZpa-YhXoolDiDM May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 8c0200afe2ad4f6db3a7a21cf37f65c8 May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AggregatesAdminTestJSON-1277582828 May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:04:02.196746 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:04:02.198540 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c0200afe2ad4f6db3a7a21cf37f65c8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c0200afe2ad4f6db3a7a21cf37f65c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c0200afe2ad4f6db3a7a21cf37f65c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c0200afe2ad4f6db3a7a21cf37f65c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:02.198540 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AggregatesAdminTestJSON-1277582828 May 28 21:04:02.198540 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 8c0200afe2ad4f6db3a7a21cf37f65c8 May 28 21:04:02.198540 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1277582828 May 28 21:04:02.198540 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AggregatesAdminTestJSON-1277582828-project May 28 21:04:02.198540 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:02.198540 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:02.198540 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 89ed91b9d56241d99b6df99ede3fb446 May 28 21:04:02.198540 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AggregatesAdminTestJSON-1277582828-project May 28 21:04:02.198540 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:04:02.198540 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. May 28 21:04:02.198540 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'fd0ba50c-cc90-4921-9fd4-b612903c5b1d'} May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:02.199306 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. May 28 21:04:02.200689 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:02.208651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b5bbd4d3-f57b-4a59-899f-0196f0c42b81 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] Returning 404 to user: Instance fd0ba50c-cc90-4921-9fd4-b612903c5b1d could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:02.208651 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b5bbd4d3-f57b-4a59-899f-0196f0c42b81 tempest-AggregatesAdminTestJSON-1277582828 tempest-AggregatesAdminTestJSON-1277582828-project] 10.222.0.33 "GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d" status: 404 len: 111 microversion: 2.1 time: 0.051796 May 28 21:04:02.208651 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 178/335] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:02 2022] GET /compute/v2.1/servers/fd0ba50c-cc90-4921-9fd4-b612903c5b1d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:04:02.632636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-199160b1-f261-4ca2-92fd-22a48d030cc2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:02.633258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-199160b1-f261-4ca2-92fd-22a48d030cc2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:02.643189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-199160b1-f261-4ca2-92fd-22a48d030cc2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:02.647328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-199160b1-f261-4ca2-92fd-22a48d030cc2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:02.648516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-199160b1-f261-4ca2-92fd-22a48d030cc2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:02.650039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-199160b1-f261-4ca2-92fd-22a48d030cc2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:02.706243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-199160b1-f261-4ca2-92fd-22a48d030cc2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:02.707031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-199160b1-f261-4ca2-92fd-22a48d030cc2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:02.707645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-199160b1-f261-4ca2-92fd-22a48d030cc2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lazy-loading 'fault' on Instance uuid 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:02.717970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-57e4f60e-d3f7-466e-a4e7-f0cbfa3bbec9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:02.718712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-57e4f60e-d3f7-466e-a4e7-f0cbfa3bbec9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:02.722989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:02.735993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57e4f60e-d3f7-466e-a4e7-f0cbfa3bbec9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:02.736383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57e4f60e-d3f7-466e-a4e7-f0cbfa3bbec9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:02.740248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57e4f60e-d3f7-466e-a4e7-f0cbfa3bbec9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:02.741550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57e4f60e-d3f7-466e-a4e7-f0cbfa3bbec9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:02.860158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-199160b1-f261-4ca2-92fd-22a48d030cc2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:02.868404 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-199160b1-f261-4ca2-92fd-22a48d030cc2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1458 microversion: 2.1 time: 0.239617 May 28 21:04:02.869879 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 158/336] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:02 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1458 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:02.870243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-199160b1-f261-4ca2-92fd-22a48d030cc2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:02.871069 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-199160b1-f261-4ca2-92fd-22a48d030cc2 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001314 May 28 21:04:02.877124 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 159/337] 10.222.0.33 () {56 vars in 885 bytes} [Sat May 28 21:04:02 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 28 21:04:02.881863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2e863e17-b83e-42ef-840a-d0f9b1115302 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:02.882489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2e863e17-b83e-42ef-840a-d0f9b1115302 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:02.889021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e863e17-b83e-42ef-840a-d0f9b1115302 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:02.889696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e863e17-b83e-42ef-840a-d0f9b1115302 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:02.890697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e863e17-b83e-42ef-840a-d0f9b1115302 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:02.891527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e863e17-b83e-42ef-840a-d0f9b1115302 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:03.092771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-57e4f60e-d3f7-466e-a4e7-f0cbfa3bbec9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:03.106267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-57e4f60e-d3f7-466e-a4e7-f0cbfa3bbec9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:03.110815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-57e4f60e-d3f7-466e-a4e7-f0cbfa3bbec9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:03.112590 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-57e4f60e-d3f7-466e-a4e7-f0cbfa3bbec9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1567 microversion: 2.25 time: 0.402141 May 28 21:04:03.120956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2e863e17-b83e-42ef-840a-d0f9b1115302 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:03.126229 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 179/338] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:02 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1567 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:04:03.129481 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2e863e17-b83e-42ef-840a-d0f9b1115302 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.251294 May 28 21:04:03.136386 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 160/339] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:02 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:03.140560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f7715a37-1fad-4be3-bd1b-8015b187c4e0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:03.141349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f7715a37-1fad-4be3-bd1b-8015b187c4e0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:03.150668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7715a37-1fad-4be3-bd1b-8015b187c4e0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:03.159558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7715a37-1fad-4be3-bd1b-8015b187c4e0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:03.159558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7715a37-1fad-4be3-bd1b-8015b187c4e0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:03.159558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7715a37-1fad-4be3-bd1b-8015b187c4e0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:03.364733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f7715a37-1fad-4be3-bd1b-8015b187c4e0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:03.373246 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f7715a37-1fad-4be3-bd1b-8015b187c4e0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1319 microversion: 2.1 time: 0.245201 May 28 21:04:03.374125 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 180/340] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:03 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:03.813977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-919b545b-9114-4519-91b3-8ed97ff0d63b req-7d35c887-69ae-4e81-baa5-d03b0838f7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76fb3f87-77b7-4de0-b4f2-8f54809d3ec8", "name": "network-vif-deleted", "tag": "64c8a0b3-7223-443b-a027-c61aa0dab93c"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:03.830723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-919b545b-9114-4519-91b3-8ed97ff0d63b req-7d35c887-69ae-4e81-baa5-d03b0838f7da service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:03.831017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-919b545b-9114-4519-91b3-8ed97ff0d63b req-7d35c887-69ae-4e81-baa5-d03b0838f7da service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:03.859375 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-919b545b-9114-4519-91b3-8ed97ff0d63b req-7d35c887-69ae-4e81-baa5-d03b0838f7da service nova] Creating event network-vif-deleted:64c8a0b3-7223-443b-a027-c61aa0dab93c for instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 on nch2-master-1 May 28 21:04:03.874970 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-919b545b-9114-4519-91b3-8ed97ff0d63b req-7d35c887-69ae-4e81-baa5-d03b0838f7da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065864 May 28 21:04:03.880578 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 161/341] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:03.886722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3cea529e-4f30-4f61-93cb-631612d5d1f8 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:03.887438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3cea529e-4f30-4f61-93cb-631612d5d1f8 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:03.899167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cea529e-4f30-4f61-93cb-631612d5d1f8 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:03.899633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cea529e-4f30-4f61-93cb-631612d5d1f8 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:03.907399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cea529e-4f30-4f61-93cb-631612d5d1f8 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:03.908477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cea529e-4f30-4f61-93cb-631612d5d1f8 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:04.008430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cea529e-4f30-4f61-93cb-631612d5d1f8 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:04.008805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cea529e-4f30-4f61-93cb-631612d5d1f8 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:04.009264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-3cea529e-4f30-4f61-93cb-631612d5d1f8 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lazy-loading 'fault' on Instance uuid 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:04.061940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3cea529e-4f30-4f61-93cb-631612d5d1f8 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad6f51b7b6834fefa06c58829399de85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0397fe0f76e24a83aa24ecec35dfb61e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:04.078198 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3cea529e-4f30-4f61-93cb-631612d5d1f8 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 200 len: 1416 microversion: 2.1 time: 0.195633 May 28 21:04:04.078883 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 181/342] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:03 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 1416 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:04.134329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-30f12d6d-4479-43dc-b974-fcb254d56c5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:04.135032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-30f12d6d-4479-43dc-b974-fcb254d56c5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:04.141816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30f12d6d-4479-43dc-b974-fcb254d56c5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:04.142554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30f12d6d-4479-43dc-b974-fcb254d56c5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:04.143335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30f12d6d-4479-43dc-b974-fcb254d56c5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:04.143943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30f12d6d-4479-43dc-b974-fcb254d56c5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:04.155998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2f559c66-399e-45a9-8620-332cc38e788e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:04.156825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2f559c66-399e-45a9-8620-332cc38e788e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:04.179393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f559c66-399e-45a9-8620-332cc38e788e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:04.182920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f559c66-399e-45a9-8620-332cc38e788e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:04.183730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f559c66-399e-45a9-8620-332cc38e788e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:04.184169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f559c66-399e-45a9-8620-332cc38e788e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:04.516738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-30f12d6d-4479-43dc-b974-fcb254d56c5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:04.534196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-30f12d6d-4479-43dc-b974-fcb254d56c5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:04.540656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-30f12d6d-4479-43dc-b974-fcb254d56c5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:04.542310 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-30f12d6d-4479-43dc-b974-fcb254d56c5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1567 microversion: 2.25 time: 0.412264 May 28 21:04:04.544166 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 162/343] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:04 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1567 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:04.549615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aceac010-4811-4d7d-a783-ccc59ed679c4 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:04.550921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aceac010-4811-4d7d-a783-ccc59ed679c4 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:04.551499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2f559c66-399e-45a9-8620-332cc38e788e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:04.560676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aceac010-4811-4d7d-a783-ccc59ed679c4 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:04.561328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aceac010-4811-4d7d-a783-ccc59ed679c4 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:04.563377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aceac010-4811-4d7d-a783-ccc59ed679c4 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:04.564806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aceac010-4811-4d7d-a783-ccc59ed679c4 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:04.565913 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2f559c66-399e-45a9-8620-332cc38e788e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.413599 May 28 21:04:04.575478 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 182/344] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:04 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:04:04.853749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aceac010-4811-4d7d-a783-ccc59ed679c4 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:04.862727 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aceac010-4811-4d7d-a783-ccc59ed679c4 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1319 microversion: 2.1 time: 0.317281 May 28 21:04:04.863315 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 163/345] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:04 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:04.919842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-601021966", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:05.003020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:04:05.095515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3534cbfe-707e-4a37-b44c-9fe8d85cffb9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:05.096033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3534cbfe-707e-4a37-b44c-9fe8d85cffb9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:05.105326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3534cbfe-707e-4a37-b44c-9fe8d85cffb9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.105779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3534cbfe-707e-4a37-b44c-9fe8d85cffb9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.108356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3534cbfe-707e-4a37-b44c-9fe8d85cffb9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.108990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3534cbfe-707e-4a37-b44c-9fe8d85cffb9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.137095 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-3534cbfe-707e-4a37-b44c-9fe8d85cffb9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] HTTP exception thrown: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3534cbfe-707e-4a37-b44c-9fe8d85cffb9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Request method failure captured: May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 HTTP/1.1 May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4Hg0PvVUyBknyQqZCaf8gp50Ah1XwrAdr9OY3gltNBNCSr2z6X1P04xbo7D4TauVPh5sHjW90Jri4Vqo4JEV7Nbi5vrJ8-NhiBV7q2mK5VNHa5ogaxLyUkXk9Y2VWufb1mEAIobl72jgd4FOykBuVESKgtZmZYYDfCyCaIPs-SvIM May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 0397fe0f76e24a83aa24ecec35dfb61e May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:04:05.149292 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:04:05.150893 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0397fe0f76e24a83aa24ecec35dfb61e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:05.150893 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:04:05.150893 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 0397fe0f76e24a83aa24ecec35dfb61e May 28 21:04:05.150893 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:04:05.150893 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-DeleteServersAdminTestJSON-508495299-project May 28 21:04:05.150893 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:04:05.150893 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:04:05.150893 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ad6f51b7b6834fefa06c58829399de85 May 28 21:04:05.150893 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-DeleteServersAdminTestJSON-508495299-project May 28 21:04:05.150893 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:04:05.150893 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. May 28 21:04:05.150893 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '76fb3f87-77b7-4de0-b4f2-8f54809d3ec8'} May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:05.151564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. May 28 21:04:05.152863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.153909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3534cbfe-707e-4a37-b44c-9fe8d85cffb9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Returning 404 to user: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:05.153909 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3534cbfe-707e-4a37-b44c-9fe8d85cffb9 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 404 len: 111 microversion: 2.1 time: 0.059306 May 28 21:04:05.156294 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 164/346] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:05 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:04:05.163134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9c9b2328-68d3-43a3-a8f0-d30f64206505 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:05.166867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9c9b2328-68d3-43a3-a8f0-d30f64206505 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:05.176025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c9b2328-68d3-43a3-a8f0-d30f64206505 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.177230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c9b2328-68d3-43a3-a8f0-d30f64206505 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.179115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c9b2328-68d3-43a3-a8f0-d30f64206505 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.179791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c9b2328-68d3-43a3-a8f0-d30f64206505 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.210536 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-9c9b2328-68d3-43a3-a8f0-d30f64206505 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] HTTP exception thrown: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9c9b2328-68d3-43a3-a8f0-d30f64206505 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Request method failure captured: May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 HTTP/1.1 May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4Hg0PvVUyBknyQqZCaf8gp50Ah1XwrAdr9OY3gltNBNCSr2z6X1P04xbo7D4TauVPh5sHjW90Jri4Vqo4JEV7Nbi5vrJ8-NhiBV7q2mK5VNHa5ogaxLyUkXk9Y2VWufb1mEAIobl72jgd4FOykBuVESKgtZmZYYDfCyCaIPs-SvIM May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 0397fe0f76e24a83aa24ecec35dfb61e May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:04:05.212250 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:04:05.213671 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0397fe0f76e24a83aa24ecec35dfb61e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:05.213671 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:04:05.213671 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 0397fe0f76e24a83aa24ecec35dfb61e May 28 21:04:05.213671 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:04:05.213671 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-DeleteServersAdminTestJSON-508495299-project May 28 21:04:05.213671 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:04:05.213671 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:04:05.213671 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ad6f51b7b6834fefa06c58829399de85 May 28 21:04:05.213671 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-DeleteServersAdminTestJSON-508495299-project May 28 21:04:05.213671 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:04:05.213671 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. May 28 21:04:05.213671 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '76fb3f87-77b7-4de0-b4f2-8f54809d3ec8'} May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:05.214502 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. May 28 21:04:05.215741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.216983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9c9b2328-68d3-43a3-a8f0-d30f64206505 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Returning 404 to user: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:05.216983 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9c9b2328-68d3-43a3-a8f0-d30f64206505 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "DELETE /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 404 len: 111 microversion: 2.1 time: 0.056345 May 28 21:04:05.217364 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 165/347] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:04:05 2022] DELETE /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:04:05.226685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-13d8ab3a-aa2e-4ce6-a5c9-0b05b651c5ee tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:05.227408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-13d8ab3a-aa2e-4ce6-a5c9-0b05b651c5ee tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:05.233883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13d8ab3a-aa2e-4ce6-a5c9-0b05b651c5ee tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.234512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13d8ab3a-aa2e-4ce6-a5c9-0b05b651c5ee tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.235393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13d8ab3a-aa2e-4ce6-a5c9-0b05b651c5ee tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.235942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13d8ab3a-aa2e-4ce6-a5c9-0b05b651c5ee tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.251673 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-13d8ab3a-aa2e-4ce6-a5c9-0b05b651c5ee tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] HTTP exception thrown: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-13d8ab3a-aa2e-4ce6-a5c9-0b05b651c5ee tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Request method failure captured: May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 HTTP/1.1 May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4Hg0PvVUyBknyQqZCaf8gp50Ah1XwrAdr9OY3gltNBNCSr2z6X1P04xbo7D4TauVPh5sHjW90Jri4Vqo4JEV7Nbi5vrJ8-NhiBV7q2mK5VNHa5ogaxLyUkXk9Y2VWufb1mEAIobl72jgd4FOykBuVESKgtZmZYYDfCyCaIPs-SvIM May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 0397fe0f76e24a83aa24ecec35dfb61e May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:04:05.253308 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:04:05.254539 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0397fe0f76e24a83aa24ecec35dfb61e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:05.254539 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:04:05.254539 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 0397fe0f76e24a83aa24ecec35dfb61e May 28 21:04:05.254539 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:04:05.254539 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-DeleteServersAdminTestJSON-508495299-project May 28 21:04:05.254539 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:04:05.254539 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:04:05.254539 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ad6f51b7b6834fefa06c58829399de85 May 28 21:04:05.254539 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-DeleteServersAdminTestJSON-508495299-project May 28 21:04:05.254539 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:04:05.254539 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. May 28 21:04:05.254539 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '76fb3f87-77b7-4de0-b4f2-8f54809d3ec8'} May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:05.255211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. May 28 21:04:05.256832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.257812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-13d8ab3a-aa2e-4ce6-a5c9-0b05b651c5ee tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Returning 404 to user: Instance 76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:05.257812 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-13d8ab3a-aa2e-4ce6-a5c9-0b05b651c5ee tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8" status: 404 len: 111 microversion: 2.1 time: 0.033126 May 28 21:04:05.257812 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 166/348] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:05 2022] GET /compute/v2.1/servers/76fb3f87-77b7-4de0-b4f2-8f54809d3ec8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:04:05.267870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d3595a49-cbc4-4db7-8fcf-5fca7a54af3b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:05.268473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d3595a49-cbc4-4db7-8fcf-5fca7a54af3b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:05.283477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3595a49-cbc4-4db7-8fcf-5fca7a54af3b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.283477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3595a49-cbc4-4db7-8fcf-5fca7a54af3b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.283477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3595a49-cbc4-4db7-8fcf-5fca7a54af3b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.283477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3595a49-cbc4-4db7-8fcf-5fca7a54af3b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.293728 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-d3595a49-cbc4-4db7-8fcf-5fca7a54af3b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] HTTP exception thrown: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d3595a49-cbc4-4db7-8fcf-5fca7a54af3b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Request method failure captured: May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 HTTP/1.1 May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4Hg0PvVUyBknyQqZCaf8gp50Ah1XwrAdr9OY3gltNBNCSr2z6X1P04xbo7D4TauVPh5sHjW90Jri4Vqo4JEV7Nbi5vrJ8-NhiBV7q2mK5VNHa5ogaxLyUkXk9Y2VWufb1mEAIobl72jgd4FOykBuVESKgtZmZYYDfCyCaIPs-SvIM May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 0397fe0f76e24a83aa24ecec35dfb61e May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:04:05.295340 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:04:05.296999 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0397fe0f76e24a83aa24ecec35dfb61e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:05.296999 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:04:05.296999 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 0397fe0f76e24a83aa24ecec35dfb61e May 28 21:04:05.296999 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:04:05.296999 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-DeleteServersAdminTestJSON-508495299-project May 28 21:04:05.296999 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:04:05.296999 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:04:05.296999 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ad6f51b7b6834fefa06c58829399de85 May 28 21:04:05.296999 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-DeleteServersAdminTestJSON-508495299-project May 28 21:04:05.296999 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:04:05.296999 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. May 28 21:04:05.296999 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '98d5fc1f-9d70-4c86-a832-7efdfa840264'} May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:05.297780 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. May 28 21:04:05.298923 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.300023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d3595a49-cbc4-4db7-8fcf-5fca7a54af3b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Returning 404 to user: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:05.300023 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d3595a49-cbc4-4db7-8fcf-5fca7a54af3b tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "DELETE /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 404 len: 111 microversion: 2.1 time: 0.033050 May 28 21:04:05.300023 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 167/349] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:04:05 2022] DELETE /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:04:05.310725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c18130c1-01a6-443f-9547-6986b1b65b69 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:05.313186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c18130c1-01a6-443f-9547-6986b1b65b69 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] [instance: 98d5fc1f-9d70-4c86-a832-7efdfa840264] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:05.316597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:04:05.317030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:04:05.317576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:04:05.318040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:04:05.318258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c18130c1-01a6-443f-9547-6986b1b65b69 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.318514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:04:05.319293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c18130c1-01a6-443f-9547-6986b1b65b69 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.320081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c18130c1-01a6-443f-9547-6986b1b65b69 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.320528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c18130c1-01a6-443f-9547-6986b1b65b69 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.328546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.330650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.336418 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-c18130c1-01a6-443f-9547-6986b1b65b69 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] HTTP exception thrown: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c18130c1-01a6-443f-9547-6986b1b65b69 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Request method failure captured: May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 HTTP/1.1 May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4Hg0PvVUyBknyQqZCaf8gp50Ah1XwrAdr9OY3gltNBNCSr2z6X1P04xbo7D4TauVPh5sHjW90Jri4Vqo4JEV7Nbi5vrJ8-NhiBV7q2mK5VNHa5ogaxLyUkXk9Y2VWufb1mEAIobl72jgd4FOykBuVESKgtZmZYYDfCyCaIPs-SvIM May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 0397fe0f76e24a83aa24ecec35dfb61e May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:04:05.337999 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:04:05.343059 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0397fe0f76e24a83aa24ecec35dfb61e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0397fe0f76e24a83aa24ecec35dfb61e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:05.343059 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:04:05.343059 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 0397fe0f76e24a83aa24ecec35dfb61e May 28 21:04:05.343059 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-508495299 May 28 21:04:05.343059 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-DeleteServersAdminTestJSON-508495299-project May 28 21:04:05.343059 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:04:05.343059 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:04:05.343059 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ad6f51b7b6834fefa06c58829399de85 May 28 21:04:05.343059 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-DeleteServersAdminTestJSON-508495299-project May 28 21:04:05.343059 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:04:05.343059 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. May 28 21:04:05.343059 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '98d5fc1f-9d70-4c86-a832-7efdfa840264'} May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:05.344069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. May 28 21:04:05.345382 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:05.346893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.347096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c18130c1-01a6-443f-9547-6986b1b65b69 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] Returning 404 to user: Instance 98d5fc1f-9d70-4c86-a832-7efdfa840264 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:05.347096 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c18130c1-01a6-443f-9547-6986b1b65b69 tempest-DeleteServersAdminTestJSON-508495299 tempest-DeleteServersAdminTestJSON-508495299-project] 10.222.0.33 "GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264" status: 404 len: 111 microversion: 2.1 time: 0.037686 May 28 21:04:05.347096 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 168/350] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:05 2022] GET /compute/v2.1/servers/98d5fc1f-9d70-4c86-a832-7efdfa840264 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:04:05.347417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.361597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Getting quotas for project cde37d77fb1343f4af1dd8e735a41615. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:04:05.367631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Getting quotas for user 05ada83d82f648eeabca0dce3b8eb3cd and project cde37d77fb1343f4af1dd8e735a41615. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:04:05.380679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:04:05.383722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:04:05.499245 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b11d8636-ab2e-414f-9110-f12b1fb31734 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888137 May 28 21:04:05.505287 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 183/351] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:04:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:04:05.511175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ef5094fa-035e-4576-821e-acd98055935c tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:05.511925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ef5094fa-035e-4576-821e-acd98055935c tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:05.561942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-af41ba80-d6d0-48df-877f-ff3f16f4a552 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:05.563034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-af41ba80-d6d0-48df-877f-ff3f16f4a552 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:05.569948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af41ba80-d6d0-48df-877f-ff3f16f4a552 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.570608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af41ba80-d6d0-48df-877f-ff3f16f4a552 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.571834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af41ba80-d6d0-48df-877f-ff3f16f4a552 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.572426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af41ba80-d6d0-48df-877f-ff3f16f4a552 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.580629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ef5094fa-035e-4576-821e-acd98055935c tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:05.588126 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ef5094fa-035e-4576-821e-acd98055935c tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1213 microversion: 2.1 time: 0.081795 May 28 21:04:05.589006 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 169/352] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:05 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:04:05.593888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-630c018f-2e60-409e-9707-44402c5c6a20 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:05.594493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-630c018f-2e60-409e-9707-44402c5c6a20 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:05.601803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-630c018f-2e60-409e-9707-44402c5c6a20 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.602298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-630c018f-2e60-409e-9707-44402c5c6a20 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.603083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-630c018f-2e60-409e-9707-44402c5c6a20 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.603539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-630c018f-2e60-409e-9707-44402c5c6a20 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.778245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-af41ba80-d6d0-48df-877f-ff3f16f4a552 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:05.793601 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-af41ba80-d6d0-48df-877f-ff3f16f4a552 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:05.797254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-af41ba80-d6d0-48df-877f-ff3f16f4a552 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:05.797254 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-af41ba80-d6d0-48df-877f-ff3f16f4a552 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1567 microversion: 2.25 time: 0.239363 May 28 21:04:05.797578 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 184/353] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:05 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:05.806776 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-630c018f-2e60-409e-9707-44402c5c6a20 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:05.816544 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-630c018f-2e60-409e-9707-44402c5c6a20 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.226362 May 28 21:04:05.817330 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 170/354] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:05 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:05.879931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-449f9130-f7d4-4388-b543-b84d66dff68f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:05.880554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-449f9130-f7d4-4388-b543-b84d66dff68f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:05.886741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-449f9130-f7d4-4388-b543-b84d66dff68f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.887197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-449f9130-f7d4-4388-b543-b84d66dff68f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.887980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-449f9130-f7d4-4388-b543-b84d66dff68f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.888415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-449f9130-f7d4-4388-b543-b84d66dff68f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.898681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-cf3f052a-68f5-4152-b5cc-548afb108708 req-a60550d3-d28b-4d05-b206-72735d50bc71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a5aeda8-15ad-4cb5-afde-74d2498a22ca", "name": "network-vif-unplugged", "status": "completed", "tag": "99558272-1b1d-489a-b9a1-76641b7fe979"}, {"name": "network-changed", "server_uuid": "5a5aeda8-15ad-4cb5-afde-74d2498a22ca", "tag": "99558272-1b1d-489a-b9a1-76641b7fe979"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:05.906888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=89,nova_api:DELETE=4,nova_api:UPDATE=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:05.912133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cf3f052a-68f5-4152-b5cc-548afb108708 req-a60550d3-d28b-4d05-b206-72735d50bc71 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:05.912133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cf3f052a-68f5-4152-b5cc-548afb108708 req-a60550d3-d28b-4d05-b206-72735d50bc71 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:05.949762 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-cf3f052a-68f5-4152-b5cc-548afb108708 req-a60550d3-d28b-4d05-b206-72735d50bc71 service nova] Creating event network-vif-unplugged:99558272-1b1d-489a-b9a1-76641b7fe979 for instance 5a5aeda8-15ad-4cb5-afde-74d2498a22ca on nch2-master-1 May 28 21:04:05.952849 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-cf3f052a-68f5-4152-b5cc-548afb108708 req-a60550d3-d28b-4d05-b206-72735d50bc71 service nova] Creating event network-changed:99558272-1b1d-489a-b9a1-76641b7fe979 for instance 5a5aeda8-15ad-4cb5-afde-74d2498a22ca on nch2-master-1 May 28 21:04:05.963063 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-cf3f052a-68f5-4152-b5cc-548afb108708 req-a60550d3-d28b-4d05-b206-72735d50bc71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.068687 May 28 21:04:05.965425 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 171/355] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:04:06.135613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-5ce8397b-f835-4003-9457-15dfe0bcd9d1 req-8025f073-af8f-4004-8450-02b0d2deb63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080ad07a-7fee-47d3-b63d-64528a1a2fee", "name": "network-vif-plugged", "status": "completed", "tag": "47695f97-27b1-4ab1-b7b1-dd2664c2a147"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:06.141480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-449f9130-f7d4-4388-b543-b84d66dff68f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:06.154282 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-449f9130-f7d4-4388-b543-b84d66dff68f tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1319 microversion: 2.1 time: 0.275462 May 28 21:04:06.154417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5ce8397b-f835-4003-9457-15dfe0bcd9d1 req-8025f073-af8f-4004-8450-02b0d2deb63f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:06.154417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5ce8397b-f835-4003-9457-15dfe0bcd9d1 req-8025f073-af8f-4004-8450-02b0d2deb63f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:06.155809 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 185/356] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:05 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1319 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:06.185446 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-5ce8397b-f835-4003-9457-15dfe0bcd9d1 req-8025f073-af8f-4004-8450-02b0d2deb63f service nova] Creating event network-vif-plugged:47695f97-27b1-4ab1-b7b1-dd2664c2a147 for instance 080ad07a-7fee-47d3-b63d-64528a1a2fee on nch1-master-1 May 28 21:04:06.191749 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-5ce8397b-f835-4003-9457-15dfe0bcd9d1 req-8025f073-af8f-4004-8450-02b0d2deb63f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064640 May 28 21:04:06.192328 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 172/357] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:04:06.605233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-76048f91-7879-4acf-90a8-6f5a321f2f0e tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:06.606043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-76048f91-7879-4acf-90a8-6f5a321f2f0e tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:06.710530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-76048f91-7879-4acf-90a8-6f5a321f2f0e tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:06.720545 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-76048f91-7879-4acf-90a8-6f5a321f2f0e tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1213 microversion: 2.1 time: 0.118399 May 28 21:04:06.721389 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 186/358] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:06 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1213 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:06.815946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b22ff837-0217-44db-85f1-9a32b04dedff tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:06.816655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b22ff837-0217-44db-85f1-9a32b04dedff tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:06.823780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b22ff837-0217-44db-85f1-9a32b04dedff tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:06.826596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b22ff837-0217-44db-85f1-9a32b04dedff tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:06.826596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b22ff837-0217-44db-85f1-9a32b04dedff tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:06.826596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b22ff837-0217-44db-85f1-9a32b04dedff tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:06.838576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bbfcf7ea-91c1-438e-955a-a15cf20ed653 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:06.854493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bbfcf7ea-91c1-438e-955a-a15cf20ed653 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:06.887762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbfcf7ea-91c1-438e-955a-a15cf20ed653 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:06.888265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbfcf7ea-91c1-438e-955a-a15cf20ed653 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:06.889097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbfcf7ea-91c1-438e-955a-a15cf20ed653 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:06.889539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbfcf7ea-91c1-438e-955a-a15cf20ed653 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:07.272976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b22ff837-0217-44db-85f1-9a32b04dedff tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:07.282043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b22ff837-0217-44db-85f1-9a32b04dedff tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:07.284615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b22ff837-0217-44db-85f1-9a32b04dedff tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:07.286121 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b22ff837-0217-44db-85f1-9a32b04dedff tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1567 microversion: 2.25 time: 0.474900 May 28 21:04:07.287898 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 173/359] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:06 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1567 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:07.293388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-53afbcf5-d248-4ccc-8403-fb15f1ea9164 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:07.294114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-53afbcf5-d248-4ccc-8403-fb15f1ea9164 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:07.300069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-53afbcf5-d248-4ccc-8403-fb15f1ea9164 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:07.300733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-53afbcf5-d248-4ccc-8403-fb15f1ea9164 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:07.301495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-53afbcf5-d248-4ccc-8403-fb15f1ea9164 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:07.302136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-53afbcf5-d248-4ccc-8403-fb15f1ea9164 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:07.315774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bbfcf7ea-91c1-438e-955a-a15cf20ed653 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:07.325423 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bbfcf7ea-91c1-438e-955a-a15cf20ed653 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.490769 May 28 21:04:07.326033 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 187/360] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:06 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:07.486576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-53afbcf5-d248-4ccc-8403-fb15f1ea9164 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:07.494509 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-53afbcf5-d248-4ccc-8403-fb15f1ea9164 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1319 microversion: 2.1 time: 0.205352 May 28 21:04:07.495971 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 174/361] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:07 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:07.742213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b3657b06-1eb8-4ce1-b941-2d5744aa7559 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:07.742918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b3657b06-1eb8-4ce1-b941-2d5744aa7559 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:07.751105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3657b06-1eb8-4ce1-b941-2d5744aa7559 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:07.754174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3657b06-1eb8-4ce1-b941-2d5744aa7559 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:07.755172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3657b06-1eb8-4ce1-b941-2d5744aa7559 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:07.755614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3657b06-1eb8-4ce1-b941-2d5744aa7559 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:07.834336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b3657b06-1eb8-4ce1-b941-2d5744aa7559 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:07.842552 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b3657b06-1eb8-4ce1-b941-2d5744aa7559 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1265 microversion: 2.1 time: 0.106836 May 28 21:04:07.843529 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 188/362] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:07 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:08.308727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9aeb3958-78be-4fa0-a2b4-8e48a4ff6b1c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:08.309557 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9aeb3958-78be-4fa0-a2b4-8e48a4ff6b1c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:08.316466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9aeb3958-78be-4fa0-a2b4-8e48a4ff6b1c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:08.317041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9aeb3958-78be-4fa0-a2b4-8e48a4ff6b1c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:08.318249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9aeb3958-78be-4fa0-a2b4-8e48a4ff6b1c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:08.319326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9aeb3958-78be-4fa0-a2b4-8e48a4ff6b1c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:08.472382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9aeb3958-78be-4fa0-a2b4-8e48a4ff6b1c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:08.482293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9aeb3958-78be-4fa0-a2b4-8e48a4ff6b1c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:08.484303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9aeb3958-78be-4fa0-a2b4-8e48a4ff6b1c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:08.485902 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9aeb3958-78be-4fa0-a2b4-8e48a4ff6b1c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1567 microversion: 2.25 time: 0.181515 May 28 21:04:08.498042 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 189/363] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:08 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:08.503245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1c8eb6ef-8cb2-406e-becb-4b47d893e50a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:08.504113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1c8eb6ef-8cb2-406e-becb-4b47d893e50a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:08.511189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c8eb6ef-8cb2-406e-becb-4b47d893e50a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:08.512177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c8eb6ef-8cb2-406e-becb-4b47d893e50a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:08.513200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c8eb6ef-8cb2-406e-becb-4b47d893e50a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:08.513783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c8eb6ef-8cb2-406e-becb-4b47d893e50a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:08.647223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-35bb424c-23d7-402c-b6dd-19f6283bfc11 tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-214300556", "ram": 512, "vcpus": 1, "disk": 10, "id": 997231995, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:08.649645 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:08.649645 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:08.681996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1c8eb6ef-8cb2-406e-becb-4b47d893e50a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:08.691000 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1c8eb6ef-8cb2-406e-becb-4b47d893e50a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.191645 May 28 21:04:08.692273 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 190/364] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:08 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:08.697156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6cf4ce12-eb39-482f-90a1-8f1343c9f7bb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:08.698001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6cf4ce12-eb39-482f-90a1-8f1343c9f7bb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:08.704675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cf4ce12-eb39-482f-90a1-8f1343c9f7bb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:08.705343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cf4ce12-eb39-482f-90a1-8f1343c9f7bb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:08.706388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cf4ce12-eb39-482f-90a1-8f1343c9f7bb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:08.707054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cf4ce12-eb39-482f-90a1-8f1343c9f7bb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:08.744057 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-35bb424c-23d7-402c-b6dd-19f6283bfc11 tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.460459 May 28 21:04:08.747033 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 175/365] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:04:08 2022] POST /compute/v2.1/flavors => generated 412 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:08.756907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-17b77133-6bc4-4128-af97-f71df4120046 tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:08.759025 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:08.759025 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:08.859471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6cf4ce12-eb39-482f-90a1-8f1343c9f7bb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:08.866382 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-17b77133-6bc4-4128-af97-f71df4120046 tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/997231995/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.113108 May 28 21:04:08.869780 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 176/366] 10.222.0.33 () {60 vars in 1220 bytes} [Sat May 28 21:04:08 2022] POST /compute/v2.1/flavors/997231995/os-extra_specs => generated 66 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 21:04:08.875144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6187eddc-895d-4213-9852-b50c6c83141f tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:08.875765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6187eddc-895d-4213-9852-b50c6c83141f tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:08.881107 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6cf4ce12-eb39-482f-90a1-8f1343c9f7bb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1469 microversion: 2.1 time: 0.187598 May 28 21:04:08.881913 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 191/367] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:08 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:08.885738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6187eddc-895d-4213-9852-b50c6c83141f tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:08.887522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6187eddc-895d-4213-9852-b50c6c83141f tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:08.888926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6187eddc-895d-4213-9852-b50c6c83141f tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:08.889392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6187eddc-895d-4213-9852-b50c6c83141f tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:08.957555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6187eddc-895d-4213-9852-b50c6c83141f tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:08.966695 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6187eddc-895d-4213-9852-b50c6c83141f tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1271 microversion: 2.1 time: 0.095485 May 28 21:04:08.967281 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 177/368] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:08 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:08.971723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b485caac-a5fa-4789-a2cb-964779915c7f tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:08.972261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b485caac-a5fa-4789-a2cb-964779915c7f tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:08.981389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b485caac-a5fa-4789-a2cb-964779915c7f tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:08.981956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b485caac-a5fa-4789-a2cb-964779915c7f tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:08.982692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b485caac-a5fa-4789-a2cb-964779915c7f tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:08.983272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b485caac-a5fa-4789-a2cb-964779915c7f tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:09.025868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-b485caac-a5fa-4789-a2cb-964779915c7f tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lazy-loading 'flavor' on Instance uuid 080ad07a-7fee-47d3-b63d-64528a1a2fee {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:09.118972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:09.297286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a66edbc6-a2a0-4a20-82bd-612cfa85add4 tempest-FlavorsExtraSpecsTestJSON-1321744902 tempest-FlavorsExtraSpecsTestJSON-1321744902-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:09.314271 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a66edbc6-a2a0-4a20-82bd-612cfa85add4 tempest-FlavorsExtraSpecsTestJSON-1321744902 tempest-FlavorsExtraSpecsTestJSON-1321744902-project] 10.222.0.33 "GET /compute/v2.1/flavors/997231995/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.431042 May 28 21:04:09.314528 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b485caac-a5fa-4789-a2cb-964779915c7f tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee/action" status: 202 len: 0 microversion: 2.1 time: 0.345810 May 28 21:04:09.324265 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 192/369] 10.222.0.33 () {58 vars in 1199 bytes} [Sat May 28 21:04:08 2022] GET /compute/v2.1/flavors/997231995/os-extra_specs => generated 66 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:04:09.328375 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 178/370] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:04:08 2022] POST /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:04:09.332363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5a33505a-c843-49bb-a3e4-74faae1f2267 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:09.334997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5a33505a-c843-49bb-a3e4-74faae1f2267 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:09.339960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5a8a5d6e-7245-4ebd-b142-a0db52026988 tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:09.341988 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:09.341988 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:09.345624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5a33505a-c843-49bb-a3e4-74faae1f2267 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:09.347883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5a33505a-c843-49bb-a3e4-74faae1f2267 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:09.347883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5a33505a-c843-49bb-a3e4-74faae1f2267 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:09.347883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5a33505a-c843-49bb-a3e4-74faae1f2267 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:09.367821 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5a8a5d6e-7245-4ebd-b142-a0db52026988 tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/997231995/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036442 May 28 21:04:09.369205 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 179/371] 10.222.0.33 () {60 vars in 1220 bytes} [Sat May 28 21:04:09 2022] POST /compute/v2.1/flavors/997231995/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:04:09.380626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-51667eaa-eeb5-4f84-8066-f76d86d80a1e tempest-FlavorsExtraSpecsTestJSON-1321744902 tempest-FlavorsExtraSpecsTestJSON-1321744902-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:09.393424 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-51667eaa-eeb5-4f84-8066-f76d86d80a1e tempest-FlavorsExtraSpecsTestJSON-1321744902 tempest-FlavorsExtraSpecsTestJSON-1321744902-project] 10.222.0.33 "GET /compute/v2.1/flavors/997231995/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.018963 May 28 21:04:09.405664 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 180/372] 10.222.0.33 () {58 vars in 1241 bytes} [Sat May 28 21:04:09 2022] GET /compute/v2.1/flavors/997231995/os-extra_specs/hw:numa_nodes => generated 22 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:04:09.414249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-66f49e9a-e1fe-4946-ba9d-276c222940fe tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:09.453824 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-66f49e9a-e1fe-4946-ba9d-276c222940fe tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/997231995/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035468 May 28 21:04:09.453824 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 181/373] 10.222.0.33 () {60 vars in 1220 bytes} [Sat May 28 21:04:09 2022] POST /compute/v2.1/flavors/997231995/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:04:09.456414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-875ccd72-4b6e-4f8d-845a-2e000e3dd9fa tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:09.467416 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-875ccd72-4b6e-4f8d-845a-2e000e3dd9fa tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/997231995/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014847 May 28 21:04:09.468322 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 182/374] 10.222.0.33 () {58 vars in 1199 bytes} [Sat May 28 21:04:09 2022] GET /compute/v2.1/flavors/997231995/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:04:09.479224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5a4a6207-62e8-4b4b-a342-790a5c86491d tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:09.485044 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:09.485044 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:09.543004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5a33505a-c843-49bb-a3e4-74faae1f2267 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:09.554305 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5a33505a-c843-49bb-a3e4-74faae1f2267 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1477 microversion: 2.1 time: 0.228030 May 28 21:04:09.566402 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 193/375] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:09 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1477 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:09.573499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e5292b95-2c1f-49c9-a5e2-d3f9b4f5a333 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:09.574439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e5292b95-2c1f-49c9-a5e2-d3f9b4f5a333 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:09.583063 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5a4a6207-62e8-4b4b-a342-790a5c86491d tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/997231995/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.109202 May 28 21:04:09.583661 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 183/376] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:04:09 2022] PUT /compute/v2.1/flavors/997231995/os-extra_specs/hw:numa_nodes => generated 22 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 21:04:09.586503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5292b95-2c1f-49c9-a5e2-d3f9b4f5a333 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:09.591131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5292b95-2c1f-49c9-a5e2-d3f9b4f5a333 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:09.591131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5292b95-2c1f-49c9-a5e2-d3f9b4f5a333 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:09.591131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5292b95-2c1f-49c9-a5e2-d3f9b4f5a333 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:09.596305 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4ce131d4-3204-4ee8-ba73-80c633ecf4c0 tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:09.607292 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4ce131d4-3204-4ee8-ba73-80c633ecf4c0 tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/997231995/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014743 May 28 21:04:09.608173 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 184/377] 10.222.0.33 () {58 vars in 1199 bytes} [Sat May 28 21:04:09 2022] GET /compute/v2.1/flavors/997231995/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 21:04:09.623202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7ac725d4-c1c5-4eb7-9281-73477585775f tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:09.625608 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:09.625608 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:09.746085 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7ac725d4-c1c5-4eb7-9281-73477585775f tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/997231995/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.130222 May 28 21:04:09.746085 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 185/378] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:04:09 2022] DELETE /compute/v2.1/flavors/997231995/os-extra_specs/hw:numa_nodes => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:04:09.751623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b577630b-80f5-4fb4-bafa-0e49f98219fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:09.753182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b577630b-80f5-4fb4-bafa-0e49f98219fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:09.763358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b577630b-80f5-4fb4-bafa-0e49f98219fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:09.763815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b577630b-80f5-4fb4-bafa-0e49f98219fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:09.764605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b577630b-80f5-4fb4-bafa-0e49f98219fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:09.765051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b577630b-80f5-4fb4-bafa-0e49f98219fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:09.769781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e5292b95-2c1f-49c9-a5e2-d3f9b4f5a333 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:09.777874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e5292b95-2c1f-49c9-a5e2-d3f9b4f5a333 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:09.777874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e5292b95-2c1f-49c9-a5e2-d3f9b4f5a333 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:09.778163 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e5292b95-2c1f-49c9-a5e2-d3f9b4f5a333 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1567 microversion: 2.25 time: 0.210288 May 28 21:04:09.778690 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 194/379] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:09 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:09.783023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-40679329-6152-4a98-8a2b-cd6b914135c1 tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:09.783773 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:09.783773 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:09.926772 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-40679329-6152-4a98-8a2b-cd6b914135c1 tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/997231995/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.147009 May 28 21:04:09.930494 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 195/380] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:04:09 2022] DELETE /compute/v2.1/flavors/997231995/os-extra_specs/hw:cpu_policy => generated 0 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:04:09.968471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b577630b-80f5-4fb4-bafa-0e49f98219fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:09.979786 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b577630b-80f5-4fb4-bafa-0e49f98219fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.231425 May 28 21:04:09.992134 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 186/381] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:09 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:09.998494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7c2b2b5b-c7f2-4a58-be07-2a42d7604dec tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:10.017205 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7c2b2b5b-c7f2-4a58-be07-2a42d7604dec tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/997231995/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.023829 May 28 21:04:10.017895 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 187/382] 10.222.0.33 () {58 vars in 1199 bytes} [Sat May 28 21:04:09 2022] GET /compute/v2.1/flavors/997231995/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:04:10.034873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4fca295e-84ac-41ec-89fd-9ea976725217 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:10.035498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4fca295e-84ac-41ec-89fd-9ea976725217 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:10.048159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fca295e-84ac-41ec-89fd-9ea976725217 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.048613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fca295e-84ac-41ec-89fd-9ea976725217 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.049408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fca295e-84ac-41ec-89fd-9ea976725217 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.049860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fca295e-84ac-41ec-89fd-9ea976725217 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.261391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4fca295e-84ac-41ec-89fd-9ea976725217 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:10.271178 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4fca295e-84ac-41ec-89fd-9ea976725217 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1313 microversion: 2.1 time: 0.244889 May 28 21:04:10.277272 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 188/383] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:10 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:10.281594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5f82038f-a059-4601-b6fa-074876cc5a19 tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:10.283308 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:10.283308 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:10.318343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a2e1540a-d6de-4796-ad6d-a16b3e343071 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Calling method '.version_select at 0x7f4d6482c670>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:10.319674 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:10.319674 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:10.320824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2e1540a-d6de-4796-ad6d-a16b3e343071 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.321283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2e1540a-d6de-4796-ad6d-a16b3e343071 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.322136 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2e1540a-d6de-4796-ad6d-a16b3e343071 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.322581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2e1540a-d6de-4796-ad6d-a16b3e343071 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.354751 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5f82038f-a059-4601-b6fa-074876cc5a19 tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/997231995" status: 202 len: 0 microversion: 2.1 time: 0.077435 May 28 21:04:10.358312 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 189/384] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:04:10 2022] DELETE /compute/v2.1/flavors/997231995 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:04:10.367037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0f17d61e-4eb4-4ca7-87a7-c6f5a8838224 tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:10.391462 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a2e1540a-d6de-4796-ad6d-a16b3e343071 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.455235 May 28 21:04:10.392587 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 196/385] 10.222.0.33 () {58 vars in 1127 bytes} [Sat May 28 21:04:09 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:10.400215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-c1521f14-1f6a-4ddb-a483-58261f025425 req-de547a0b-73d0-4313-a9d1-0de27cabb68b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d503b27-5533-4d4d-bc74-d82d93cf69a5", "tag": "10c0bb91-17c5-48f9-8b95-c67e52a9e297"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:10.400641 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0f17d61e-4eb4-4ca7-87a7-c6f5a8838224 tempest-FlavorsExtraSpecsTestJSON-55723120 tempest-FlavorsExtraSpecsTestJSON-55723120-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5820 microversion: 2.1 time: 0.040795 May 28 21:04:10.411662 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 190/386] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:04:10 2022] GET /compute/v2.1/flavors/detail => generated 5820 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:10.415682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c1521f14-1f6a-4ddb-a483-58261f025425 req-de547a0b-73d0-4313-a9d1-0de27cabb68b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.416333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c1521f14-1f6a-4ddb-a483-58261f025425 req-de547a0b-73d0-4313-a9d1-0de27cabb68b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.417886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3be0cc7f-3258-419f-9ef8-7dd8fc37b031 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Calling method '.version_select at 0x7f4d6487b310>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:10.419318 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:10.419318 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:10.420598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3be0cc7f-3258-419f-9ef8-7dd8fc37b031 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.421054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3be0cc7f-3258-419f-9ef8-7dd8fc37b031 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.421884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3be0cc7f-3258-419f-9ef8-7dd8fc37b031 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.422324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3be0cc7f-3258-419f-9ef8-7dd8fc37b031 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.430416 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-c1521f14-1f6a-4ddb-a483-58261f025425 req-de547a0b-73d0-4313-a9d1-0de27cabb68b service nova] Creating event network-changed:10c0bb91-17c5-48f9-8b95-c67e52a9e297 for instance 5d503b27-5533-4d4d-bc74-d82d93cf69a5 on nch2-master-1 May 28 21:04:10.435782 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-c1521f14-1f6a-4ddb-a483-58261f025425 req-de547a0b-73d0-4313-a9d1-0de27cabb68b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041327 May 28 21:04:10.437962 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 197/387] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:10.456312 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3be0cc7f-3258-419f-9ef8-7dd8fc37b031 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.042565 May 28 21:04:10.463740 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 191/388] 10.222.0.33 () {58 vars in 1138 bytes} [Sat May 28 21:04:10 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:10.469336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-96799bfa-e7de-43db-8aa8-fcbffde88add tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Calling method '.version_select at 0x7f4d648028b0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:10.471629 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:10.471629 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:10.474111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96799bfa-e7de-43db-8aa8-fcbffde88add tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.474111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96799bfa-e7de-43db-8aa8-fcbffde88add tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.475632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96799bfa-e7de-43db-8aa8-fcbffde88add tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.476260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96799bfa-e7de-43db-8aa8-fcbffde88add tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.512466 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-96799bfa-e7de-43db-8aa8-fcbffde88add tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.042564 May 28 21:04:10.512466 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 198/389] 10.222.0.33 () {58 vars in 1144 bytes} [Sat May 28 21:04:10 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:04:10.524610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1e58a21e-b0cc-4c18-8c60-7f9381a2db23 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Calling method '.version_select at 0x7f4d648219d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:10.526367 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:10.526367 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:10.528205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e58a21e-b0cc-4c18-8c60-7f9381a2db23 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.528666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e58a21e-b0cc-4c18-8c60-7f9381a2db23 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.529671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e58a21e-b0cc-4c18-8c60-7f9381a2db23 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.530203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e58a21e-b0cc-4c18-8c60-7f9381a2db23 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.555563 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1e58a21e-b0cc-4c18-8c60-7f9381a2db23 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.035233 May 28 21:04:10.561262 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 192/390] 10.222.0.33 () {58 vars in 1127 bytes} [Sat May 28 21:04:10 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:10.568114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-18e48db1-f0a5-4eaa-9151-91b0784aa3e9 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Calling method '.version_select at 0x7f4d64802280>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:10.569826 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:10.569826 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:10.571216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18e48db1-f0a5-4eaa-9151-91b0784aa3e9 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.571674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18e48db1-f0a5-4eaa-9151-91b0784aa3e9 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.572722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18e48db1-f0a5-4eaa-9151-91b0784aa3e9 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.577914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18e48db1-f0a5-4eaa-9151-91b0784aa3e9 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.583158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-02334664-6f3d-45d8-814a-92f94d6c5a9b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:10.587867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:10.592837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-02334664-6f3d-45d8-814a-92f94d6c5a9b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:10.596077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02334664-6f3d-45d8-814a-92f94d6c5a9b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.596550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02334664-6f3d-45d8-814a-92f94d6c5a9b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.597768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02334664-6f3d-45d8-814a-92f94d6c5a9b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.598315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02334664-6f3d-45d8-814a-92f94d6c5a9b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.638460 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-18e48db1-f0a5-4eaa-9151-91b0784aa3e9 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.073094 May 28 21:04:10.638460 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 199/391] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:04:10 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:10.647095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-da98e442-1154-4420-aaae-f3cd7182d8d6 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Calling method '.version_select at 0x7f4d648021f0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:10.648316 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:10.648316 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:10.649516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da98e442-1154-4420-aaae-f3cd7182d8d6 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.650013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da98e442-1154-4420-aaae-f3cd7182d8d6 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.650828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da98e442-1154-4420-aaae-f3cd7182d8d6 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.651293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da98e442-1154-4420-aaae-f3cd7182d8d6 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.695097 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-da98e442-1154-4420-aaae-f3cd7182d8d6 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.051685 May 28 21:04:10.696360 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 200/392] 10.222.0.33 () {58 vars in 1127 bytes} [Sat May 28 21:04:10 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:10.714967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-78696493-752c-4030-84db-e2b65bc3f083 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Calling method '.version_select at 0x7f4d64802940>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:10.715979 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:10.715979 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:10.727463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78696493-752c-4030-84db-e2b65bc3f083 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.727923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78696493-752c-4030-84db-e2b65bc3f083 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.750887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78696493-752c-4030-84db-e2b65bc3f083 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.751351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78696493-752c-4030-84db-e2b65bc3f083 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.774976 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-78696493-752c-4030-84db-e2b65bc3f083 tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 729 microversion: 2.1 time: 0.073056 May 28 21:04:10.775862 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 201/393] 10.222.0.33 () {58 vars in 1169 bytes} [Sat May 28 21:04:10 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 729 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:10.784877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-08f3a43c-4e88-4334-a5fa-e48441fe46ed tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Calling method '.version_select at 0x7f4d646ec790>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:10.785969 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:10.785969 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:10.795827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08f3a43c-4e88-4334-a5fa-e48441fe46ed tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.796297 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08f3a43c-4e88-4334-a5fa-e48441fe46ed tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.814046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08f3a43c-4e88-4334-a5fa-e48441fe46ed tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.814762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08f3a43c-4e88-4334-a5fa-e48441fe46ed tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.842163 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-08f3a43c-4e88-4334-a5fa-e48441fe46ed tempest-HostsAdminTestJSON-1158785711 tempest-HostsAdminTestJSON-1158785711-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 729 microversion: 2.1 time: 0.061087 May 28 21:04:10.843979 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 202/394] 10.222.0.33 () {58 vars in 1169 bytes} [Sat May 28 21:04:10 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 729 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:04:10.850596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-02334664-6f3d-45d8-814a-92f94d6c5a9b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:10.851673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d0f40a22-6719-4e08-a80f-a82771fe4214 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:10.852797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d0f40a22-6719-4e08-a80f-a82771fe4214 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:10.861048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0f40a22-6719-4e08-a80f-a82771fe4214 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.861754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0f40a22-6719-4e08-a80f-a82771fe4214 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.862426 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-02334664-6f3d-45d8-814a-92f94d6c5a9b tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1460 microversion: 2.1 time: 0.287706 May 28 21:04:10.863088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0f40a22-6719-4e08-a80f-a82771fe4214 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.863823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0f40a22-6719-4e08-a80f-a82771fe4214 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.866163 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 193/395] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:10 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1460 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:10.883261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-74e0465c-5e50-463f-8869-7a67f80b92fb tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:10.884112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-74e0465c-5e50-463f-8869-7a67f80b92fb tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:10.886601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:10.907603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74e0465c-5e50-463f-8869-7a67f80b92fb tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.912044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74e0465c-5e50-463f-8869-7a67f80b92fb tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:10.913066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74e0465c-5e50-463f-8869-7a67f80b92fb tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:10.917976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74e0465c-5e50-463f-8869-7a67f80b92fb tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:11.212033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d0f40a22-6719-4e08-a80f-a82771fe4214 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:11.221558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d0f40a22-6719-4e08-a80f-a82771fe4214 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:11.223322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d0f40a22-6719-4e08-a80f-a82771fe4214 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:11.224615 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d0f40a22-6719-4e08-a80f-a82771fe4214 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1567 microversion: 2.25 time: 0.379143 May 28 21:04:11.235332 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 203/396] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:10 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1567 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:11.438409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3556f215-4cf6-401b-bba6-fc214fa84436 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Calling method '.version_select at 0x7f4d64715940>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:11.440353 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:11.440353 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:11.441765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3556f215-4cf6-401b-bba6-fc214fa84436 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:11.442500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3556f215-4cf6-401b-bba6-fc214fa84436 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:11.444201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3556f215-4cf6-401b-bba6-fc214fa84436 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:11.445535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3556f215-4cf6-401b-bba6-fc214fa84436 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:11.501027 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3556f215-4cf6-401b-bba6-fc214fa84436 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.273673 May 28 21:04:11.502142 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 204/397] 10.222.0.33 () {58 vars in 1127 bytes} [Sat May 28 21:04:11 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:11.509415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b9faa743-0958-4de6-9aef-2dce188a0f22 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:11.510271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b9faa743-0958-4de6-9aef-2dce188a0f22 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:11.517639 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9faa743-0958-4de6-9aef-2dce188a0f22 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:11.518488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9faa743-0958-4de6-9aef-2dce188a0f22 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:11.531853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9faa743-0958-4de6-9aef-2dce188a0f22 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:11.532333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9faa743-0958-4de6-9aef-2dce188a0f22 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:11.558661 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-74e0465c-5e50-463f-8869-7a67f80b92fb tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1611 microversion: 2.1 time: 0.676792 May 28 21:04:11.560283 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 194/398] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:10 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1611 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:04:11.572991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ce04c042-63f6-4aaa-9b49-448cfcdf1bda tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:11.573385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ce04c042-63f6-4aaa-9b49-448cfcdf1bda tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:11.587077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce04c042-63f6-4aaa-9b49-448cfcdf1bda tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:11.588146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce04c042-63f6-4aaa-9b49-448cfcdf1bda tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:11.589178 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce04c042-63f6-4aaa-9b49-448cfcdf1bda tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:11.589863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce04c042-63f6-4aaa-9b49-448cfcdf1bda tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:11.754048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b9faa743-0958-4de6-9aef-2dce188a0f22 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:11.764176 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b9faa743-0958-4de6-9aef-2dce188a0f22 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.260714 May 28 21:04:11.765343 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 205/399] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:11 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:11.840130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ce04c042-63f6-4aaa-9b49-448cfcdf1bda tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:11.848147 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ce04c042-63f6-4aaa-9b49-448cfcdf1bda tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1313 microversion: 2.1 time: 0.286871 May 28 21:04:11.848903 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 195/400] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:11 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:11.856710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b3c06632-9e2e-4bd9-977c-d2f469a02926 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:11.859047 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:11.859047 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:11.860721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3c06632-9e2e-4bd9-977c-d2f469a02926 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:11.861283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3c06632-9e2e-4bd9-977c-d2f469a02926 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:11.862030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3c06632-9e2e-4bd9-977c-d2f469a02926 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:11.862803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3c06632-9e2e-4bd9-977c-d2f469a02926 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:11.888418 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b3c06632-9e2e-4bd9-977c-d2f469a02926 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036848 May 28 21:04:11.889402 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 196/401] 10.222.0.33 () {58 vars in 1175 bytes} [Sat May 28 21:04:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:11.900764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b3c64887-b263-491f-b146-b2e55df35cb0 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:11.905508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b3c64887-b263-491f-b146-b2e55df35cb0 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:11.908536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3c64887-b263-491f-b146-b2e55df35cb0 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:11.909000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3c64887-b263-491f-b146-b2e55df35cb0 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:11.909791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3c64887-b263-491f-b146-b2e55df35cb0 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:11.910276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3c64887-b263-491f-b146-b2e55df35cb0 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:11.936748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-b3c64887-b263-491f-b146-b2e55df35cb0 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Lazy-loading 'flavor' on Instance uuid 080ad07a-7fee-47d3-b63d-64528a1a2fee {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:11.950100 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-b3c64887-b263-491f-b146-b2e55df35cb0 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 080ad07a-7fee-47d3-b63d-64528a1a2fee while it is in vm_state suspended May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b3c64887-b263-491f-b146-b2e55df35cb0 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Request method failure captured: May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee/action HTTP/1.1 May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 97 May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4mlV_sE2qay-ZtoUhz8aQCAElz9RWXKQ_sl5rqK4LWwcB-C5EW7o113GeiprdPFFEcI2yOcum4dnaELprlK-XjUmbgM1l_Z0DuJaBJ1cbItGl2llc1e_Q_ARU3LHkmOrK8aTc6c3g7UTWb6JEb9xGjJagXuIgZm6xfipF7kPkE_2w May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2a0bc9e83b434c4c93a514f9c0ee106b May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-LiveMigrationNegativeTest-716858929 May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:04:11.952228 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:04:11.953531 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2a0bc9e83b434c4c93a514f9c0ee106b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a0bc9e83b434c4c93a514f9c0ee106b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2a0bc9e83b434c4c93a514f9c0ee106b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2a0bc9e83b434c4c93a514f9c0ee106b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:11.953531 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-LiveMigrationNegativeTest-716858929 May 28 21:04:11.953531 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2a0bc9e83b434c4c93a514f9c0ee106b May 28 21:04:11.953531 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-716858929 May 28 21:04:11.953531 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-LiveMigrationNegativeTest-716858929-project-admin May 28 21:04:11.953531 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:04:11.953531 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:04:11.953531 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: a943a5a756c241379440c3ad9b937435 May 28 21:04:11.953531 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-LiveMigrationNegativeTest-716858929-project-admin May 28 21:04:11.953531 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:04:11.953531 ncdv-master-1 devstack@n-api.service[143129]: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} May 28 21:04:11.953531 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: exception: Cannot 'os-migrateLive' instance 080ad07a-7fee-47d3-b63d-64528a1a2fee while it is in vm_state suspended May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '080ad07a-7fee-47d3-b63d-64528a1a2fee', 'body': {'os-migrateLive': {'host': 'nch2-master-1', 'block_migration': True, 'disk_over_commit': False}}} May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 28 21:04:11.954351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 080ad07a-7fee-47d3-b63d-64528a1a2fee in vm_state suspended. Cannot live_migrate while the instance is in this state. May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:04:11.955305 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 080ad07a-7fee-47d3-b63d-64528a1a2fee while it is in vm_state suspended May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 080ad07a-7fee-47d3-b63d-64528a1a2fee while it is in vm_state suspended May 28 21:04:11.956371 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:11.958864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b3c64887-b263-491f-b146-b2e55df35cb0 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 080ad07a-7fee-47d3-b63d-64528a1a2fee while it is in vm_state suspended {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:11.958864 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b3c64887-b263-491f-b146-b2e55df35cb0 tempest-LiveMigrationNegativeTest-716858929 tempest-LiveMigrationNegativeTest-716858929-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee/action" status: 409 len: 155 microversion: 2.1 time: 0.057258 May 28 21:04:11.958864 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 197/402] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:04:11 2022] POST /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee/action => generated 155 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:04:11.964922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-579a8431-5b75-40b2-b738-89f09adead96 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:11.965426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-579a8431-5b75-40b2-b738-89f09adead96 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:11.967637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6fd57ad1-5bf9-42cc-974a-193ca1a438d4 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Calling method '.version_select at 0x7f4d64a2f790>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:11.969288 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:11.969288 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:11.970451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6fd57ad1-5bf9-42cc-974a-193ca1a438d4 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'db0f47bc701d49f5a68fc6e26ed1629a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f50b8715e64beca36d4320ac0ca972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:11.971883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-579a8431-5b75-40b2-b738-89f09adead96 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:11.972337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-579a8431-5b75-40b2-b738-89f09adead96 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:11.973109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-579a8431-5b75-40b2-b738-89f09adead96 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6fd57ad1-5bf9-42cc-974a-193ca1a438d4 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Request method failure captured: May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-hosts HTTP/1.1 May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5JOFi97AwQSAYJHFITLbKbFV-Vwfe-h-TWvpsRZjixpyZnIF6M-qhQpSEI08e02DLUO_2FYvAlkyiw8RvBTQzU6jsK1-s1dnqYneMAmf6BEojJoxL5VeR0sLj8e8IlmVR2CH0dygVjefbUFg8Q6ae4wpzYh70d0ziYuStq2XmC-i8 May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e0f50b8715e64beca36d4320ac0ca972 May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:04:11.973474 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:04:11.980424 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0f50b8715e64beca36d4320ac0ca972", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:11.980424 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:11.980424 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e0f50b8715e64beca36d4320ac0ca972 May 28 21:04:11.980424 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:11.980424 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HostsAdminNegativeTestJSON-1209011890-project May 28 21:04:11.980424 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:11.980424 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:11.980424 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: db0f47bc701d49f5a68fc6e26ed1629a May 28 21:04:11.980424 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1209011890-project May 28 21:04:11.980424 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:04:11.980424 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 28 21:04:11.980424 ncdv-master-1 devstack@n-api.service[143128]: action_args: {} May 28 21:04:11.980424 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:04:11.981153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. May 28 21:04:11.982211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:11.983202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-579a8431-5b75-40b2-b738-89f09adead96 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:11.983279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6fd57ad1-5bf9-42cc-974a-193ca1a438d4 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:11.983279 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6fd57ad1-5bf9-42cc-974a-193ca1a438d4 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] 10.222.0.33 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.205517 May 28 21:04:11.983279 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 206/403] 10.222.0.33 () {58 vars in 1127 bytes} [Sat May 28 21:04:11 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 207 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:04:11.989785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-615e60dd-604b-4d60-8ce9-8fac190fad1f tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Calling method '.version_select at 0x7f4d646ece50>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:11.990902 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:11.990902 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:11.992409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-615e60dd-604b-4d60-8ce9-8fac190fad1f tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'db0f47bc701d49f5a68fc6e26ed1629a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f50b8715e64beca36d4320ac0ca972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-615e60dd-604b-4d60-8ce9-8fac190fad1f tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Request method failure captured: May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5JOFi97AwQSAYJHFITLbKbFV-Vwfe-h-TWvpsRZjixpyZnIF6M-qhQpSEI08e02DLUO_2FYvAlkyiw8RvBTQzU6jsK1-s1dnqYneMAmf6BEojJoxL5VeR0sLj8e8IlmVR2CH0dygVjefbUFg8Q6ae4wpzYh70d0ziYuStq2XmC-i8 May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e0f50b8715e64beca36d4320ac0ca972 May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:04:11.995306 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:04:11.996470 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0f50b8715e64beca36d4320ac0ca972", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:11.996470 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:11.996470 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e0f50b8715e64beca36d4320ac0ca972 May 28 21:04:11.996470 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:11.996470 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HostsAdminNegativeTestJSON-1209011890-project May 28 21:04:11.996470 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:11.996470 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:11.996470 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: db0f47bc701d49f5a68fc6e26ed1629a May 28 21:04:11.996470 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1209011890-project May 28 21:04:11.996470 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:04:11.996470 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 28 21:04:11.996470 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ncdv-master-1'} May 28 21:04:11.996470 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:04:11.997171 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. May 28 21:04:11.999119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.001500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-615e60dd-604b-4d60-8ce9-8fac190fad1f tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:12.002975 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-615e60dd-604b-4d60-8ce9-8fac190fad1f tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.017915 May 28 21:04:12.004038 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 207/404] 10.222.0.33 () {58 vars in 1190 bytes} [Sat May 28 21:04:11 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:04:12.011459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-579a8431-5b75-40b2-b738-89f09adead96 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:04:12.015785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eab6952b-36dd-4964-98f6-053ad035f404 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Calling method '.version_select at 0x7f4d646ec700>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:12.026162 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-eab6952b-36dd-4964-98f6-053ad035f404 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eab6952b-36dd-4964-98f6-053ad035f404 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Request method failure captured: May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5KXUuUMPalVhiBtj4-L4zHO24Pz3bI_s3pKwtGCCuqFWHgMpc5-yuiZfhGmft5bq-WO4vV20PPt82OPDMWpAPZr3alDNeR7eSUv-IfyZtFyNc2G0BrBsBqXsxStskSHOLrZJZUNlT-056pQ10JySXoLbVg5EMKzf-YAzHzXwej5FA May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:04:12.030314 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:04:12.031516 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3555b83003064628a3778162f14c522b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3555b83003064628a3778162f14c522b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:12.031516 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.031516 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.031516 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.031516 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.031516 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:12.031516 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:12.031516 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: a264123dcd6e455b945b54652bf218db May 28 21:04:12.031516 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.031516 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:04:12.031516 ncdv-master-1 devstack@n-api.service[143128]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.031516 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'nonexistent_hostname'} May 28 21:04:12.031516 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:04:12.032321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 28 21:04:12.033333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:04:12.034385 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.034385 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.034385 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.034385 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.034385 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.034385 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.034385 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.034385 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:12.034385 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:12.034385 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.034385 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.036999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eab6952b-36dd-4964-98f6-053ad035f404 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:12.039102 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eab6952b-36dd-4964-98f6-053ad035f404 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.029002 May 28 21:04:12.043637 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 208/405] 10.222.0.33 () {58 vars in 1211 bytes} [Sat May 28 21:04:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:04:12.056558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7b4d477e-3953-4af4-9f00-f8c9cf91c4b9 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Calling method '.version_select at 0x7f4d6482c940>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:12.056558 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:12.056558 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:12.056558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7b4d477e-3953-4af4-9f00-f8c9cf91c4b9 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'db0f47bc701d49f5a68fc6e26ed1629a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f50b8715e64beca36d4320ac0ca972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7b4d477e-3953-4af4-9f00-f8c9cf91c4b9 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Request method failure captured: May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5JOFi97AwQSAYJHFITLbKbFV-Vwfe-h-TWvpsRZjixpyZnIF6M-qhQpSEI08e02DLUO_2FYvAlkyiw8RvBTQzU6jsK1-s1dnqYneMAmf6BEojJoxL5VeR0sLj8e8IlmVR2CH0dygVjefbUFg8Q6ae4wpzYh70d0ziYuStq2XmC-i8 May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e0f50b8715e64beca36d4320ac0ca972 May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:04:12.057706 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:04:12.059133 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0f50b8715e64beca36d4320ac0ca972", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:12.059133 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:12.059133 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e0f50b8715e64beca36d4320ac0ca972 May 28 21:04:12.059133 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:12.059133 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HostsAdminNegativeTestJSON-1209011890-project May 28 21:04:12.059133 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:12.059133 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:12.059133 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: db0f47bc701d49f5a68fc6e26ed1629a May 28 21:04:12.059133 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1209011890-project May 28 21:04:12.059133 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:04:12.059133 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 28 21:04:12.059133 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ncdv-master-1'} May 28 21:04:12.059133 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:04:12.059994 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. May 28 21:04:12.061372 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.064611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7b4d477e-3953-4af4-9f00-f8c9cf91c4b9 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:12.065772 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7b4d477e-3953-4af4-9f00-f8c9cf91c4b9 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.019835 May 28 21:04:12.070974 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 209/406] 10.222.0.33 () {58 vars in 1169 bytes} [Sat May 28 21:04:12 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:04:12.077318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7c93a2fb-3c8f-4c02-a9cf-a123e6a34088 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Calling method '.version_select at 0x7f4d64a2fc10>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:12.093934 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-7c93a2fb-3c8f-4c02-a9cf-a123e6a34088 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7c93a2fb-3c8f-4c02-a9cf-a123e6a34088 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Request method failure captured: May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5KXUuUMPalVhiBtj4-L4zHO24Pz3bI_s3pKwtGCCuqFWHgMpc5-yuiZfhGmft5bq-WO4vV20PPt82OPDMWpAPZr3alDNeR7eSUv-IfyZtFyNc2G0BrBsBqXsxStskSHOLrZJZUNlT-056pQ10JySXoLbVg5EMKzf-YAzHzXwej5FA May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:04:12.095729 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:04:12.096949 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3555b83003064628a3778162f14c522b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3555b83003064628a3778162f14c522b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:12.096949 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.096949 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.096949 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.096949 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.096949 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:12.096949 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:12.096949 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: a264123dcd6e455b945b54652bf218db May 28 21:04:12.096949 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.096949 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:04:12.096949 ncdv-master-1 devstack@n-api.service[143128]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.096949 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'nonexistent_hostname'} May 28 21:04:12.096949 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.097660 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.098749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.099772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7c93a2fb-3c8f-4c02-a9cf-a123e6a34088 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:12.099772 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7c93a2fb-3c8f-4c02-a9cf-a123e6a34088 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.024765 May 28 21:04:12.102509 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 210/407] 10.222.0.33 () {58 vars in 1190 bytes} [Sat May 28 21:04:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 21:04:12.108156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fd539f30-043d-4164-a06c-bb5c98bd6267 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Calling method '.version_select at 0x7f4d6482c9d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:12.109317 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:12.109317 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:12.114928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fd539f30-043d-4164-a06c-bb5c98bd6267 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'db0f47bc701d49f5a68fc6e26ed1629a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f50b8715e64beca36d4320ac0ca972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fd539f30-043d-4164-a06c-bb5c98bd6267 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Request method failure captured: May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5JOFi97AwQSAYJHFITLbKbFV-Vwfe-h-TWvpsRZjixpyZnIF6M-qhQpSEI08e02DLUO_2FYvAlkyiw8RvBTQzU6jsK1-s1dnqYneMAmf6BEojJoxL5VeR0sLj8e8IlmVR2CH0dygVjefbUFg8Q6ae4wpzYh70d0ziYuStq2XmC-i8 May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e0f50b8715e64beca36d4320ac0ca972 May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:04:12.117107 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:04:12.118329 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0f50b8715e64beca36d4320ac0ca972", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:12.118329 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:12.118329 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e0f50b8715e64beca36d4320ac0ca972 May 28 21:04:12.118329 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:12.118329 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HostsAdminNegativeTestJSON-1209011890-project May 28 21:04:12.118329 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:12.118329 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:12.118329 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: db0f47bc701d49f5a68fc6e26ed1629a May 28 21:04:12.118329 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1209011890-project May 28 21:04:12.118329 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:04:12.118329 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 28 21:04:12.118329 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ncdv-master-1'} May 28 21:04:12.118329 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:04:12.119139 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. May 28 21:04:12.120590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.121514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fd539f30-043d-4164-a06c-bb5c98bd6267 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:12.121514 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fd539f30-043d-4164-a06c-bb5c98bd6267 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.015099 May 28 21:04:12.121514 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 211/408] 10.222.0.33 () {58 vars in 1196 bytes} [Sat May 28 21:04:12 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:04:12.129897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-17147ede-b8cb-4e5f-bba4-e9011464208a tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Calling method '.version_select at 0x7f4d646eca60>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:12.140489 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-17147ede-b8cb-4e5f-bba4-e9011464208a tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-17147ede-b8cb-4e5f-bba4-e9011464208a tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Request method failure captured: May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5KXUuUMPalVhiBtj4-L4zHO24Pz3bI_s3pKwtGCCuqFWHgMpc5-yuiZfhGmft5bq-WO4vV20PPt82OPDMWpAPZr3alDNeR7eSUv-IfyZtFyNc2G0BrBsBqXsxStskSHOLrZJZUNlT-056pQ10JySXoLbVg5EMKzf-YAzHzXwej5FA May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:04:12.142323 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:04:12.143724 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3555b83003064628a3778162f14c522b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3555b83003064628a3778162f14c522b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:12.143724 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.143724 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.143724 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.143724 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.143724 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:12.143724 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:12.143724 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: a264123dcd6e455b945b54652bf218db May 28 21:04:12.143724 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.143724 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:04:12.143724 ncdv-master-1 devstack@n-api.service[143128]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.143724 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'nonexistent_hostname'} May 28 21:04:12.143724 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:04:12.144684 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 28 21:04:12.145721 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:04:12.146795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.146795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.146795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.146795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.146795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.146795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.146795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.146795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:12.146795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:12.146795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.146795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.146795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-17147ede-b8cb-4e5f-bba4-e9011464208a tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:12.146795 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-17147ede-b8cb-4e5f-bba4-e9011464208a tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.018947 May 28 21:04:12.146795 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 212/409] 10.222.0.33 () {58 vars in 1217 bytes} [Sat May 28 21:04:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 21:04:12.160396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0477ee3e-a06b-46d6-b294-3334dbedcc8e tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Calling method '.version_select at 0x7f4d6482cc10>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:12.160396 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:12.160396 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:12.160396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0477ee3e-a06b-46d6-b294-3334dbedcc8e tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'db0f47bc701d49f5a68fc6e26ed1629a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f50b8715e64beca36d4320ac0ca972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0477ee3e-a06b-46d6-b294-3334dbedcc8e tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Request method failure captured: May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5JOFi97AwQSAYJHFITLbKbFV-Vwfe-h-TWvpsRZjixpyZnIF6M-qhQpSEI08e02DLUO_2FYvAlkyiw8RvBTQzU6jsK1-s1dnqYneMAmf6BEojJoxL5VeR0sLj8e8IlmVR2CH0dygVjefbUFg8Q6ae4wpzYh70d0ziYuStq2XmC-i8 May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e0f50b8715e64beca36d4320ac0ca972 May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:04:12.161504 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:04:12.163329 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0f50b8715e64beca36d4320ac0ca972", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:12.163329 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:12.163329 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e0f50b8715e64beca36d4320ac0ca972 May 28 21:04:12.163329 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:12.163329 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HostsAdminNegativeTestJSON-1209011890-project May 28 21:04:12.163329 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:12.163329 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:12.163329 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: db0f47bc701d49f5a68fc6e26ed1629a May 28 21:04:12.163329 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1209011890-project May 28 21:04:12.163329 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:04:12.163329 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 28 21:04:12.163329 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ncdv-master-1'} May 28 21:04:12.163329 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:04:12.164162 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. May 28 21:04:12.165330 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.167223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0477ee3e-a06b-46d6-b294-3334dbedcc8e tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:12.168252 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0477ee3e-a06b-46d6-b294-3334dbedcc8e tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] 10.222.0.33 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.018353 May 28 21:04:12.168983 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 213/410] 10.222.0.33 () {58 vars in 1193 bytes} [Sat May 28 21:04:12 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:04:12.179914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3d3273cf-82b4-475e-98a1-979c13309698 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Calling method '.version_select at 0x7f4d646ec670>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:12.189576 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-3d3273cf-82b4-475e-98a1-979c13309698 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3d3273cf-82b4-475e-98a1-979c13309698 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Request method failure captured: May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5KXUuUMPalVhiBtj4-L4zHO24Pz3bI_s3pKwtGCCuqFWHgMpc5-yuiZfhGmft5bq-WO4vV20PPt82OPDMWpAPZr3alDNeR7eSUv-IfyZtFyNc2G0BrBsBqXsxStskSHOLrZJZUNlT-056pQ10JySXoLbVg5EMKzf-YAzHzXwej5FA May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:04:12.191344 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:04:12.192721 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3555b83003064628a3778162f14c522b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3555b83003064628a3778162f14c522b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:12.192721 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.192721 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.192721 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.192721 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.192721 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:12.192721 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:12.192721 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: a264123dcd6e455b945b54652bf218db May 28 21:04:12.192721 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.192721 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:04:12.192721 ncdv-master-1 devstack@n-api.service[143128]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.192721 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'nonexistent_hostname'} May 28 21:04:12.192721 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:04:12.194086 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action May 28 21:04:12.195097 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:04:12.196835 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.196835 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.196835 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.196835 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.196835 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.196835 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.196835 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.196835 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:12.196835 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:12.196835 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.196835 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.196835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3d3273cf-82b4-475e-98a1-979c13309698 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:12.196835 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3d3273cf-82b4-475e-98a1-979c13309698 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.017765 May 28 21:04:12.196835 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 214/411] 10.222.0.33 () {58 vars in 1214 bytes} [Sat May 28 21:04:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 21:04:12.202453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-586ed473-207e-4790-b127-f517c12f0e77 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Action: 'update', calling method: .version_select at 0x7f4d64802280>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-586ed473-207e-4790-b127-f517c12f0e77 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Request method failure captured: May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 51 May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5KXUuUMPalVhiBtj4-L4zHO24Pz3bI_s3pKwtGCCuqFWHgMpc5-yuiZfhGmft5bq-WO4vV20PPt82OPDMWpAPZr3alDNeR7eSUv-IfyZtFyNc2G0BrBsBqXsxStskSHOLrZJZUNlT-056pQ10JySXoLbVg5EMKzf-YAzHzXwej5FA May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:04:12.205143 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:04:12.206438 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3555b83003064628a3778162f14c522b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3555b83003064628a3778162f14c522b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:12.206438 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.206438 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.206438 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.206438 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.206438 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:12.206438 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:12.206438 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: a264123dcd6e455b945b54652bf218db May 28 21:04:12.206438 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.206438 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:04:12.206438 ncdv-master-1 devstack@n-api.service[143128]: {"status": "enable", "maintenance_mode": "invalid"} May 28 21:04:12.206438 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:04:12.206438 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise error May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'disable', May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'Enable', May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'Disable', May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'ENABLE', May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi On instance: May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'invalid' May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.207160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.208559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.210795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.210795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:04:12.210795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:04:12.210795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 21:04:12.210795 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.210795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-586ed473-207e-4790-b127-f517c12f0e77 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:12.210795 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-586ed473-207e-4790-b127-f517c12f0e77 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.007798 May 28 21:04:12.210795 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 215/412] 10.222.0.33 () {60 vars in 1189 bytes} [Sat May 28 21:04:12 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:04:12.216164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cb0216cc-3bf5-480a-bed9-2f8b18e7585f tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Action: 'update', calling method: .version_select at 0x7f4d646ecca0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cb0216cc-3bf5-480a-bed9-2f8b18e7585f tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Request method failure captured: May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 51 May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5KXUuUMPalVhiBtj4-L4zHO24Pz3bI_s3pKwtGCCuqFWHgMpc5-yuiZfhGmft5bq-WO4vV20PPt82OPDMWpAPZr3alDNeR7eSUv-IfyZtFyNc2G0BrBsBqXsxStskSHOLrZJZUNlT-056pQ10JySXoLbVg5EMKzf-YAzHzXwej5FA May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:04:12.218700 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:04:12.219884 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3555b83003064628a3778162f14c522b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3555b83003064628a3778162f14c522b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:12.219884 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.219884 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.219884 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.219884 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.219884 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:12.219884 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:12.219884 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: a264123dcd6e455b945b54652bf218db May 28 21:04:12.219884 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.219884 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:04:12.219884 ncdv-master-1 devstack@n-api.service[143128]: {"status": "invalid", "maintenance_mode": "enable"} May 28 21:04:12.219884 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:04:12.219884 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise error May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'disable', May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'Enable', May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'Disable', May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'ENABLE', May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi On instance: May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'invalid' May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.220590 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.221887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.222869 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.222869 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:04:12.222869 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:04:12.222869 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] May 28 21:04:12.222869 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.222869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cb0216cc-3bf5-480a-bed9-2f8b18e7585f tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:12.222869 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cb0216cc-3bf5-480a-bed9-2f8b18e7585f tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.007446 May 28 21:04:12.222869 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 216/413] 10.222.0.33 () {60 vars in 1189 bytes} [Sat May 28 21:04:12 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:04:12.230371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-be296b87-c777-433e-9399-72c60881f260 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Action: 'update', calling method: .version_select at 0x7f4d6482cc10>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:12.231534 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:12.231534 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:12.232615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-be296b87-c777-433e-9399-72c60881f260 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'db0f47bc701d49f5a68fc6e26ed1629a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f50b8715e64beca36d4320ac0ca972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-be296b87-c777-433e-9399-72c60881f260 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Request method failure captured: May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 50 May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5JOFi97AwQSAYJHFITLbKbFV-Vwfe-h-TWvpsRZjixpyZnIF6M-qhQpSEI08e02DLUO_2FYvAlkyiw8RvBTQzU6jsK1-s1dnqYneMAmf6BEojJoxL5VeR0sLj8e8IlmVR2CH0dygVjefbUFg8Q6ae4wpzYh70d0ziYuStq2XmC-i8 May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e0f50b8715e64beca36d4320ac0ca972 May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:04:12.234225 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:04:12.235600 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e0f50b8715e64beca36d4320ac0ca972", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e0f50b8715e64beca36d4320ac0ca972"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:12.235600 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:12.235600 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e0f50b8715e64beca36d4320ac0ca972 May 28 21:04:12.235600 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1209011890 May 28 21:04:12.235600 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HostsAdminNegativeTestJSON-1209011890-project May 28 21:04:12.235600 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:12.235600 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:12.235600 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: db0f47bc701d49f5a68fc6e26ed1629a May 28 21:04:12.235600 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1209011890-project May 28 21:04:12.235600 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:04:12.235600 ncdv-master-1 devstack@n-api.service[143128]: {"status": "enable", "maintenance_mode": "enable"} May 28 21:04:12.235600 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:04:12.235600 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 28 21:04:12.235600 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:04:12.236561 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. May 28 21:04:12.237924 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.239559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-be296b87-c777-433e-9399-72c60881f260 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:12.239559 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-be296b87-c777-433e-9399-72c60881f260 tempest-HostsAdminNegativeTestJSON-1209011890 tempest-HostsAdminNegativeTestJSON-1209011890-project] 10.222.0.33 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.008840 May 28 21:04:12.239559 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 217/414] 10.222.0.33 () {60 vars in 1189 bytes} [Sat May 28 21:04:12 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 28 21:04:12.245073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9c959000-8f55-4614-9d2d-e63b8aed2ddb tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:12.245786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9c959000-8f55-4614-9d2d-e63b8aed2ddb tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:12.252039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c959000-8f55-4614-9d2d-e63b8aed2ddb tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:12.252553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c959000-8f55-4614-9d2d-e63b8aed2ddb tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:12.253360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c959000-8f55-4614-9d2d-e63b8aed2ddb tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:12.253801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c959000-8f55-4614-9d2d-e63b8aed2ddb tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:12.338007 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-579a8431-5b75-40b2-b738-89f09adead96 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "DELETE /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 204 len: 0 microversion: 2.1 time: 0.376487 May 28 21:04:12.339134 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 198/415] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:04:11 2022] DELETE /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:04:12.347486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a5c985ca-762c-49e7-b450-75a3be3cd47c tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Action: 'update', calling method: .version_select at 0x7f4d6487b700>, body: {"status": null, "maintenance_mode": null} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a5c985ca-762c-49e7-b450-75a3be3cd47c tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Request method failure captured: May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 42 May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko5KXUuUMPalVhiBtj4-L4zHO24Pz3bI_s3pKwtGCCuqFWHgMpc5-yuiZfhGmft5bq-WO4vV20PPt82OPDMWpAPZr3alDNeR7eSUv-IfyZtFyNc2G0BrBsBqXsxStskSHOLrZJZUNlT-056pQ10JySXoLbVg5EMKzf-YAzHzXwej5FA May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:04:12.351111 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:04:12.352554 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3555b83003064628a3778162f14c522b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3555b83003064628a3778162f14c522b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:12.352554 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.352554 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.352554 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.352554 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.352554 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:04:12.352554 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:04:12.352554 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: a264123dcd6e455b945b54652bf218db May 28 21:04:12.352554 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.352554 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:04:12.352554 ncdv-master-1 devstack@n-api.service[143129]: {"status": null, "maintenance_mode": null} May 28 21:04:12.352554 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:04:12.352554 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 28 21:04:12.352554 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'enum': ['enable', May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'disable', May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'Enable', May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'Disable', May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'ENABLE', May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'DISABLE'], May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': 'string'} May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance: May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi None May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.353314 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.354664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.355689 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:04:12.355689 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:04:12.355689 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' May 28 21:04:12.355689 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:12.355689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a5c985ca-762c-49e7-b450-75a3be3cd47c tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:12.355689 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a5c985ca-762c-49e7-b450-75a3be3cd47c tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.009591 May 28 21:04:12.355689 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 199/416] 10.222.0.33 () {60 vars in 1189 bytes} [Sat May 28 21:04:12 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:04:12.358732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2fa2ce41-90b7-4603-b5fd-dce055c009c0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:12.364706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2fa2ce41-90b7-4603-b5fd-dce055c009c0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:12.370106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fa2ce41-90b7-4603-b5fd-dce055c009c0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:12.370794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fa2ce41-90b7-4603-b5fd-dce055c009c0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:12.371756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fa2ce41-90b7-4603-b5fd-dce055c009c0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:12.372368 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fa2ce41-90b7-4603-b5fd-dce055c009c0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:12.434693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9c959000-8f55-4614-9d2d-e63b8aed2ddb tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:12.445091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9c959000-8f55-4614-9d2d-e63b8aed2ddb tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:12.446807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9c959000-8f55-4614-9d2d-e63b8aed2ddb tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:12.449688 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9c959000-8f55-4614-9d2d-e63b8aed2ddb tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1567 microversion: 2.25 time: 0.207505 May 28 21:04:12.455012 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 218/417] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:12 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:12.461597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a8a457e7-ecd6-457c-820d-382a486d9d14 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Action: 'update', calling method: .version_select at 0x7f4d646bd8b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:12.463346 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:12.463346 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:12.464389 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.hosts [None req-a8a457e7-ecd6-457c-820d-382a486d9d14 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Enabling host nonexistent_hostname. May 28 21:04:12.467620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:12.473107 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-a8a457e7-ecd6-457c-820d-382a486d9d14 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a8a457e7-ecd6-457c-820d-382a486d9d14 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Request method failure captured: May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 50 May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5KXUuUMPalVhiBtj4-L4zHO24Pz3bI_s3pKwtGCCuqFWHgMpc5-yuiZfhGmft5bq-WO4vV20PPt82OPDMWpAPZr3alDNeR7eSUv-IfyZtFyNc2G0BrBsBqXsxStskSHOLrZJZUNlT-056pQ10JySXoLbVg5EMKzf-YAzHzXwej5FA May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:04:12.476729 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:04:12.478215 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3555b83003064628a3778162f14c522b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3555b83003064628a3778162f14c522b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3555b83003064628a3778162f14c522b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:12.478215 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.478215 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 3555b83003064628a3778162f14c522b May 28 21:04:12.478215 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1328602158 May 28 21:04:12.478215 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.478215 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:12.478215 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:12.478215 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: a264123dcd6e455b945b54652bf218db May 28 21:04:12.478215 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1328602158-project-admin May 28 21:04:12.478215 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:04:12.478215 ncdv-master-1 devstack@n-api.service[143128]: {"status": "enable", "maintenance_mode": "enable"} May 28 21:04:12.478215 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:04:12.478215 ncdv-master-1 devstack@n-api.service[143128]: exception: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.478215 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host May 28 21:04:12.478960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:04:12.479921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update May 28 21:04:12.485922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) May 28 21:04:12.485922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status May 28 21:04:12.485922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:04:12.485922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.485922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.485922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:12.485922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.485922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:12.485922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:12.485922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:12.485922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:12.485922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:12.485922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell May 28 21:04:12.485922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:12.485922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a8a457e7-ecd6-457c-820d-382a486d9d14 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:12.487606 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a8a457e7-ecd6-457c-820d-382a486d9d14 tempest-HostsAdminNegativeTestJSON-1328602158 tempest-HostsAdminNegativeTestJSON-1328602158-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.023428 May 28 21:04:12.487606 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 219/418] 10.222.0.33 () {60 vars in 1210 bytes} [Sat May 28 21:04:12 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:04:12.532630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2fa2ce41-90b7-4603-b5fd-dce055c009c0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:12.540828 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2fa2ce41-90b7-4603-b5fd-dce055c009c0 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1466 microversion: 2.1 time: 0.186317 May 28 21:04:12.542070 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 200/419] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:12 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1466 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:12.782183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-25e5833a-836c-41d1-80b7-a053363888e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:12.782847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-25e5833a-836c-41d1-80b7-a053363888e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:12.790318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25e5833a-836c-41d1-80b7-a053363888e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:12.790774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25e5833a-836c-41d1-80b7-a053363888e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:12.791591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25e5833a-836c-41d1-80b7-a053363888e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:12.792037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25e5833a-836c-41d1-80b7-a053363888e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:12.866108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-423a25f2-b9b6-417b-9e46-8e6a75b505a7 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:12.866730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-423a25f2-b9b6-417b-9e46-8e6a75b505a7 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:12.874050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-423a25f2-b9b6-417b-9e46-8e6a75b505a7 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:12.874509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-423a25f2-b9b6-417b-9e46-8e6a75b505a7 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:12.875282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-423a25f2-b9b6-417b-9e46-8e6a75b505a7 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:12.875752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-423a25f2-b9b6-417b-9e46-8e6a75b505a7 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:13.028333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-25e5833a-836c-41d1-80b7-a053363888e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:13.036498 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-25e5833a-836c-41d1-80b7-a053363888e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.258072 May 28 21:04:13.037559 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 220/420] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:12 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:13.085183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-423a25f2-b9b6-417b-9e46-8e6a75b505a7 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:13.089116 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-423a25f2-b9b6-417b-9e46-8e6a75b505a7 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1313 microversion: 2.1 time: 0.228132 May 28 21:04:13.089921 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 201/421] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:12 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:13.469495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-016deeef-d529-4b5c-947f-4b77ff94cf88 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:13.470252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-016deeef-d529-4b5c-947f-4b77ff94cf88 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:13.478530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-016deeef-d529-4b5c-947f-4b77ff94cf88 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:13.479215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-016deeef-d529-4b5c-947f-4b77ff94cf88 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:13.480214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-016deeef-d529-4b5c-947f-4b77ff94cf88 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:13.480648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-016deeef-d529-4b5c-947f-4b77ff94cf88 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:13.559035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cf15b15b-ef86-42d2-8ed9-d83d84caa4e1 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:13.559655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cf15b15b-ef86-42d2-8ed9-d83d84caa4e1 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:13.567213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf15b15b-ef86-42d2-8ed9-d83d84caa4e1 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:13.567671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf15b15b-ef86-42d2-8ed9-d83d84caa4e1 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:13.569086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf15b15b-ef86-42d2-8ed9-d83d84caa4e1 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:13.569687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf15b15b-ef86-42d2-8ed9-d83d84caa4e1 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:13.749464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-016deeef-d529-4b5c-947f-4b77ff94cf88 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:13.762575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-016deeef-d529-4b5c-947f-4b77ff94cf88 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:13.772923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-016deeef-d529-4b5c-947f-4b77ff94cf88 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:13.776905 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-016deeef-d529-4b5c-947f-4b77ff94cf88 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1567 microversion: 2.25 time: 0.312837 May 28 21:04:13.781302 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 221/422] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:13 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1567 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:13.793379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cf15b15b-ef86-42d2-8ed9-d83d84caa4e1 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:13.802208 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cf15b15b-ef86-42d2-8ed9-d83d84caa4e1 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1466 microversion: 2.1 time: 0.246990 May 28 21:04:13.810109 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 202/423] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:13 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1466 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:04:14.055712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c7466234-86a7-48d8-8dd5-2402166f8667 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:14.056886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c7466234-86a7-48d8-8dd5-2402166f8667 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:14.066279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7466234-86a7-48d8-8dd5-2402166f8667 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:14.066759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7466234-86a7-48d8-8dd5-2402166f8667 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:14.067603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7466234-86a7-48d8-8dd5-2402166f8667 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:14.068051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7466234-86a7-48d8-8dd5-2402166f8667 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:14.106363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3c9db304-50bc-4817-a8cf-998864edf988 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:14.107480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3c9db304-50bc-4817-a8cf-998864edf988 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:14.114308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c9db304-50bc-4817-a8cf-998864edf988 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:14.115086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c9db304-50bc-4817-a8cf-998864edf988 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:14.118536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c9db304-50bc-4817-a8cf-998864edf988 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:14.119154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c9db304-50bc-4817-a8cf-998864edf988 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:14.321724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c7466234-86a7-48d8-8dd5-2402166f8667 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:14.326635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3c9db304-50bc-4817-a8cf-998864edf988 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:14.334839 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c7466234-86a7-48d8-8dd5-2402166f8667 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.284758 May 28 21:04:14.336468 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3c9db304-50bc-4817-a8cf-998864edf988 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1313 microversion: 2.1 time: 0.234185 May 28 21:04:14.339779 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 222/424] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:14 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:14.339893 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 203/425] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:14 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:04:14.799604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9043da38-f1ab-436d-8b26-4ae34e4cd53d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:14.800217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9043da38-f1ab-436d-8b26-4ae34e4cd53d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:14.814527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9043da38-f1ab-436d-8b26-4ae34e4cd53d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:14.816221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9043da38-f1ab-436d-8b26-4ae34e4cd53d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:14.816221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9043da38-f1ab-436d-8b26-4ae34e4cd53d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:14.816419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9043da38-f1ab-436d-8b26-4ae34e4cd53d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:14.824769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e9eb4dab-2052-4e07-8d58-3bbea2c3b629 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:14.825609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e9eb4dab-2052-4e07-8d58-3bbea2c3b629 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:14.832671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e9eb4dab-2052-4e07-8d58-3bbea2c3b629 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:14.833344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e9eb4dab-2052-4e07-8d58-3bbea2c3b629 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:14.834840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e9eb4dab-2052-4e07-8d58-3bbea2c3b629 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:14.841679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e9eb4dab-2052-4e07-8d58-3bbea2c3b629 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:15.213736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e9eb4dab-2052-4e07-8d58-3bbea2c3b629 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:15.217659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9043da38-f1ab-436d-8b26-4ae34e4cd53d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:15.224971 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e9eb4dab-2052-4e07-8d58-3bbea2c3b629 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1466 microversion: 2.1 time: 0.403779 May 28 21:04:15.226223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9043da38-f1ab-436d-8b26-4ae34e4cd53d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:15.237132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9043da38-f1ab-436d-8b26-4ae34e4cd53d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:15.238687 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9043da38-f1ab-436d-8b26-4ae34e4cd53d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1567 microversion: 2.25 time: 0.443326 May 28 21:04:15.239693 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 223/426] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:14 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1567 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:15.251644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-e8f6062c-45d7-4f48-bf3a-9c016b829294 req-043d17db-c466-4490-9303-7265cc64144d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "080ad07a-7fee-47d3-b63d-64528a1a2fee", "name": "network-vif-deleted", "tag": "47695f97-27b1-4ab1-b7b1-dd2664c2a147"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:15.263096 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 204/427] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:14 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1466 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:04:15.266682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e8f6062c-45d7-4f48-bf3a-9c016b829294 req-043d17db-c466-4490-9303-7265cc64144d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:15.273179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e8f6062c-45d7-4f48-bf3a-9c016b829294 req-043d17db-c466-4490-9303-7265cc64144d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:15.294289 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e8f6062c-45d7-4f48-bf3a-9c016b829294 req-043d17db-c466-4490-9303-7265cc64144d service nova] Creating event network-vif-deleted:47695f97-27b1-4ab1-b7b1-dd2664c2a147 for instance 080ad07a-7fee-47d3-b63d-64528a1a2fee on nch1-master-1 May 28 21:04:15.304425 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-e8f6062c-45d7-4f48-bf3a-9c016b829294 req-043d17db-c466-4490-9303-7265cc64144d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063212 May 28 21:04:15.306316 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 224/428] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:15.352818 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c8a571f5-d06a-453c-8a76-b06076fe8f99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:15.353650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c8a571f5-d06a-453c-8a76-b06076fe8f99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:15.354545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8928fb18-d038-4d19-a5c9-038acfea625b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:15.355465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8928fb18-d038-4d19-a5c9-038acfea625b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:15.363769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8a571f5-d06a-453c-8a76-b06076fe8f99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:15.364232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8a571f5-d06a-453c-8a76-b06076fe8f99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:15.365222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8a571f5-d06a-453c-8a76-b06076fe8f99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:15.365680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8a571f5-d06a-453c-8a76-b06076fe8f99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:15.366879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8928fb18-d038-4d19-a5c9-038acfea625b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:15.367334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8928fb18-d038-4d19-a5c9-038acfea625b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:15.368106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8928fb18-d038-4d19-a5c9-038acfea625b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:15.369357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8928fb18-d038-4d19-a5c9-038acfea625b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:15.588249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=46,nova_cell0:UPDATE=12 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:15.645870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c8a571f5-d06a-453c-8a76-b06076fe8f99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:15.648238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:15.655669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8928fb18-d038-4d19-a5c9-038acfea625b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:15.661306 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c8a571f5-d06a-453c-8a76-b06076fe8f99 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.312510 May 28 21:04:15.661915 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 205/429] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:15 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:15.664487 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8928fb18-d038-4d19-a5c9-038acfea625b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1313 microversion: 2.1 time: 0.314635 May 28 21:04:15.665082 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 225/430] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:15 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:16.247615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-636ee534-1b3d-4229-bb96-d25bc2aeef35 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:16.248286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-636ee534-1b3d-4229-bb96-d25bc2aeef35 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:16.255307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-636ee534-1b3d-4229-bb96-d25bc2aeef35 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:16.255800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-636ee534-1b3d-4229-bb96-d25bc2aeef35 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:16.256570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-636ee534-1b3d-4229-bb96-d25bc2aeef35 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:16.257009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-636ee534-1b3d-4229-bb96-d25bc2aeef35 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:16.267525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8fb44394-d423-4aca-9f6a-0b48f4b44f8d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:16.267525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8fb44394-d423-4aca-9f6a-0b48f4b44f8d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:16.279182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fb44394-d423-4aca-9f6a-0b48f4b44f8d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:16.280219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fb44394-d423-4aca-9f6a-0b48f4b44f8d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:16.282448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fb44394-d423-4aca-9f6a-0b48f4b44f8d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:16.283132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fb44394-d423-4aca-9f6a-0b48f4b44f8d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:16.300278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-636ee534-1b3d-4229-bb96-d25bc2aeef35 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:16.300743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-636ee534-1b3d-4229-bb96-d25bc2aeef35 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:16.301199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-636ee534-1b3d-4229-bb96-d25bc2aeef35 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lazy-loading 'fault' on Instance uuid 080ad07a-7fee-47d3-b63d-64528a1a2fee {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:16.433424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-636ee534-1b3d-4229-bb96-d25bc2aeef35 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:16.441639 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-636ee534-1b3d-4229-bb96-d25bc2aeef35 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 200 len: 1309 microversion: 2.1 time: 0.199153 May 28 21:04:16.450498 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 206/431] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:16 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 1309 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:16.527824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8fb44394-d423-4aca-9f6a-0b48f4b44f8d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:16.536260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8fb44394-d423-4aca-9f6a-0b48f4b44f8d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:16.538618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8fb44394-d423-4aca-9f6a-0b48f4b44f8d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:16.539842 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8fb44394-d423-4aca-9f6a-0b48f4b44f8d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1557 microversion: 2.25 time: 0.281116 May 28 21:04:16.540491 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 226/432] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:16 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1557 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:04:16.556859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ff0cf27b-3d2a-40be-8b26-c9b0108275b3 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '.version_select at 0x7f4d6474ce50>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:16.559783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff0cf27b-3d2a-40be-8b26-c9b0108275b3 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:16.560408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff0cf27b-3d2a-40be-8b26-c9b0108275b3 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:16.577349 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ff0cf27b-3d2a-40be-8b26-c9b0108275b3 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1104 microversion: 2.25 time: 0.024178 May 28 21:04:16.578253 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 207/433] 10.222.0.33 () {60 vars in 1183 bytes} [Sat May 28 21:04:16 2022] GET /compute/v2.1/os-migrations => generated 1104 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:04:16.590890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6436dd16-8835-430f-9c0b-6a2665c210cf tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:16.591681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6436dd16-8835-430f-9c0b-6a2665c210cf tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:16.603187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6436dd16-8835-430f-9c0b-6a2665c210cf tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:16.603972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6436dd16-8835-430f-9c0b-6a2665c210cf tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:16.605186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6436dd16-8835-430f-9c0b-6a2665c210cf tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:16.605786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6436dd16-8835-430f-9c0b-6a2665c210cf tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:16.680960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c66dfd30-f1ee-464a-a706-9de6b93dd4b4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:16.682008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c66dfd30-f1ee-464a-a706-9de6b93dd4b4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:16.695766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c66dfd30-f1ee-464a-a706-9de6b93dd4b4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:16.696611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c66dfd30-f1ee-464a-a706-9de6b93dd4b4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:16.705288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c66dfd30-f1ee-464a-a706-9de6b93dd4b4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:16.705288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c66dfd30-f1ee-464a-a706-9de6b93dd4b4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:16.719787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=16 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:16.812072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-6436dd16-8835-430f-9c0b-6a2665c210cf tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'services' on Instance uuid 5a5aeda8-15ad-4cb5-afde-74d2498a22ca {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:16.833142 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6436dd16-8835-430f-9c0b-6a2665c210cf tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 2050 microversion: 2.25 time: 0.246473 May 28 21:04:16.836119 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 227/434] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:16 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 2050 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:16.841524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e2c23874-b30b-4daa-85a4-7524786d5915 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:16.842670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e2c23874-b30b-4daa-85a4-7524786d5915 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:16.851983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e2c23874-b30b-4daa-85a4-7524786d5915 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:16.852740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e2c23874-b30b-4daa-85a4-7524786d5915 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:16.854666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e2c23874-b30b-4daa-85a4-7524786d5915 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:16.855336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e2c23874-b30b-4daa-85a4-7524786d5915 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.106714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e2c23874-b30b-4daa-85a4-7524786d5915 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:17.108866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c66dfd30-f1ee-464a-a706-9de6b93dd4b4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:17.117684 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e2c23874-b30b-4daa-85a4-7524786d5915 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1313 microversion: 2.1 time: 0.279885 May 28 21:04:17.118275 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 228/435] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:16 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:17.121423 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c66dfd30-f1ee-464a-a706-9de6b93dd4b4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.441115 May 28 21:04:17.122534 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 208/436] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:16 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:17.133624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-195184903", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "a8cad774-f5d9-4630-8882-1fcbf23ca116"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:17.187580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] validate_networks() for [('a8cad774-f5d9-4630-8882-1fcbf23ca116', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:04:17.274701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a8c33464-9071-445e-9979-84ae71ddd0d4 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Calling method '.version_select at 0x7f4d6487b820>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:17.276247 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:17.276247 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:17.277696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8c33464-9071-445e-9979-84ae71ddd0d4 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.278161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8c33464-9071-445e-9979-84ae71ddd0d4 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.292924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8c33464-9071-445e-9979-84ae71ddd0d4 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.293625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8c33464-9071-445e-9979-84ae71ddd0d4 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.305937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8c33464-9071-445e-9979-84ae71ddd0d4 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.306393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8c33464-9071-445e-9979-84ae71ddd0d4 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.312711 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a8c33464-9071-445e-9979-84ae71ddd0d4 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.183872 May 28 21:04:17.313289 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 209/437] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:04:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:17.325052 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b4a2f982-3d20-4e0e-affd-50185ed386ec tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Calling method '.version_select at 0x7f4d6487bc10>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:17.325903 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:17.325903 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:17.327254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4a2f982-3d20-4e0e-affd-50185ed386ec tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.327721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4a2f982-3d20-4e0e-affd-50185ed386ec tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.354729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4a2f982-3d20-4e0e-affd-50185ed386ec tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.355422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4a2f982-3d20-4e0e-affd-50185ed386ec tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.393122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4a2f982-3d20-4e0e-affd-50185ed386ec tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.394535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4a2f982-3d20-4e0e-affd-50185ed386ec tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.415435 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b4a2f982-3d20-4e0e-affd-50185ed386ec tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.093894 May 28 21:04:17.416656 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 210/438] 10.222.0.33 () {58 vars in 1166 bytes} [Sat May 28 21:04:17 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:04:17.436741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-237c2c67-84b7-43e6-892b-54f4353a35c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Calling method '.version_select at 0x7f4d647ef8b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:17.437717 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:17.437717 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:17.439365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-237c2c67-84b7-43e6-892b-54f4353a35c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.440026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-237c2c67-84b7-43e6-892b-54f4353a35c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.457323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-237c2c67-84b7-43e6-892b-54f4353a35c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.458033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-237c2c67-84b7-43e6-892b-54f4353a35c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.472869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-237c2c67-84b7-43e6-892b-54f4353a35c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.473612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-237c2c67-84b7-43e6-892b-54f4353a35c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.485049 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-237c2c67-84b7-43e6-892b-54f4353a35c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.057748 May 28 21:04:17.489575 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 211/439] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:04:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:17.495235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fcb6d0bb-634e-4d1a-bc3b-4512d5d9c1fb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:17.496362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fcb6d0bb-634e-4d1a-bc3b-4512d5d9c1fb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 080ad07a-7fee-47d3-b63d-64528a1a2fee] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:17.503343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcb6d0bb-634e-4d1a-bc3b-4512d5d9c1fb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.504126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcb6d0bb-634e-4d1a-bc3b-4512d5d9c1fb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.505173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcb6d0bb-634e-4d1a-bc3b-4512d5d9c1fb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.505997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcb6d0bb-634e-4d1a-bc3b-4512d5d9c1fb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.525275 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-fcb6d0bb-634e-4d1a-bc3b-4512d5d9c1fb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] HTTP exception thrown: Instance 080ad07a-7fee-47d3-b63d-64528a1a2fee could not be found. May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fcb6d0bb-634e-4d1a-bc3b-4512d5d9c1fb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Request method failure captured: May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee HTTP/1.1 May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4lsPojcqeRJCoi5q4YLXkMLLGsVrPFOHcetj01dLcqH-o9tIv00gsvbfU88VT2S0Z-UW-qBJmEPnQOZ0AyKyNeiCUgVZBfv38iY02KP9tP6GN43-J-yjK_FbEEAWvHMXrdDtEmwJdp397KYq4VMM-rBRyqoprUC5mjDEx9E1GDRgM May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: b6c7378af3e841f58fdf1a907d06bc08 May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-LiveMigrationNegativeTest-1158149238 May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:04:17.528010 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:04:17.529203 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b6c7378af3e841f58fdf1a907d06bc08", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b6c7378af3e841f58fdf1a907d06bc08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b6c7378af3e841f58fdf1a907d06bc08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b6c7378af3e841f58fdf1a907d06bc08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:17.529203 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-LiveMigrationNegativeTest-1158149238 May 28 21:04:17.529203 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: b6c7378af3e841f58fdf1a907d06bc08 May 28 21:04:17.529203 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1158149238 May 28 21:04:17.529203 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-LiveMigrationNegativeTest-1158149238-project May 28 21:04:17.529203 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:04:17.529203 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:04:17.529203 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 0e733cc9497a48cba4ccdde860be104f May 28 21:04:17.529203 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-LiveMigrationNegativeTest-1158149238-project May 28 21:04:17.529203 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:04:17.529203 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 080ad07a-7fee-47d3-b63d-64528a1a2fee could not be found. May 28 21:04:17.529203 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '080ad07a-7fee-47d3-b63d-64528a1a2fee'} May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 080ad07a-7fee-47d3-b63d-64528a1a2fee could not be found. May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:17.529997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 080ad07a-7fee-47d3-b63d-64528a1a2fee could not be found. May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 080ad07a-7fee-47d3-b63d-64528a1a2fee could not be found. May 28 21:04:17.531022 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:04:17.541250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fcb6d0bb-634e-4d1a-bc3b-4512d5d9c1fb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Returning 404 to user: Instance 080ad07a-7fee-47d3-b63d-64528a1a2fee could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:17.541250 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fcb6d0bb-634e-4d1a-bc3b-4512d5d9c1fb tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee" status: 404 len: 111 microversion: 2.1 time: 0.041025 May 28 21:04:17.541250 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 212/440] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:17 2022] GET /compute/v2.1/servers/080ad07a-7fee-47d3-b63d-64528a1a2fee => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:04:17.541250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b4597118-7a81-4d41-b56e-2c4faec1507a tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Calling method '.version_select at 0x7f4d64728d30>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:17.541250 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:17.541250 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:17.541760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4597118-7a81-4d41-b56e-2c4faec1507a tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.541760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4597118-7a81-4d41-b56e-2c4faec1507a tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.561330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4597118-7a81-4d41-b56e-2c4faec1507a tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.561783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4597118-7a81-4d41-b56e-2c4faec1507a tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.575804 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b4597118-7a81-4d41-b56e-2c4faec1507a tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.044273 May 28 21:04:17.576413 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 213/441] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:04:17 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:17.582172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f37db4aa-73c5-428a-93c1-9108a55408f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:17.587595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f37db4aa-73c5-428a-93c1-9108a55408f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:17.594897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f37db4aa-73c5-428a-93c1-9108a55408f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.595630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f37db4aa-73c5-428a-93c1-9108a55408f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.596918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f37db4aa-73c5-428a-93c1-9108a55408f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.597517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f37db4aa-73c5-428a-93c1-9108a55408f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.635197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f37db4aa-73c5-428a-93c1-9108a55408f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:04:17.708025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:04:17.708526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:04:17.708955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:04:17.709384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:04:17.709785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:04:17.719938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.720391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.721195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.721637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.739324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Getting quotas for project 45a2b4e7e1484ea3807bc8d8bc31296c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:04:17.745373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Getting quotas for user fc6ee6dba5d24e90bff48384539fcd7f and project 45a2b4e7e1484ea3807bc8d8bc31296c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:04:17.757812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:04:17.760166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:04:17.892975 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e60c3a05-19c5-4f93-addd-534eca41a52e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.763691 May 28 21:04:17.899157 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 229/442] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:04:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 21:04:17.902883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d7ee25f8-5d93-4607-8e23-0192343be98d tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Calling method '.version_select at 0x7f4d64732040>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:17.903899 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:17.903899 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:17.905102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d7ee25f8-5d93-4607-8e23-0192343be98d tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.905623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d7ee25f8-5d93-4607-8e23-0192343be98d tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.908749 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f37db4aa-73c5-428a-93c1-9108a55408f9 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 204 len: 0 microversion: 2.1 time: 0.331105 May 28 21:04:17.916914 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 214/443] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:04:17 2022] DELETE /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:04:17.929446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d14c4904-3bb9-4004-a01a-5c4aa4ca5358 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:17.930192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d14c4904-3bb9-4004-a01a-5c4aa4ca5358 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:17.932553 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d7ee25f8-5d93-4607-8e23-0192343be98d tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.037745 May 28 21:04:17.933148 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 230/444] 10.222.0.33 () {58 vars in 1178 bytes} [Sat May 28 21:04:17 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:17.938666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4871e09d-df15-4bd2-bc61-a031733a3ec7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:17.939882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4871e09d-df15-4bd2-bc61-a031733a3ec7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:17.950443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4871e09d-df15-4bd2-bc61-a031733a3ec7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.950443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4871e09d-df15-4bd2-bc61-a031733a3ec7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.950443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4871e09d-df15-4bd2-bc61-a031733a3ec7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:17.950443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4871e09d-df15-4bd2-bc61-a031733a3ec7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:17.996885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d14c4904-3bb9-4004-a01a-5c4aa4ca5358 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:18.005011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d14c4904-3bb9-4004-a01a-5c4aa4ca5358 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:18.006614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d14c4904-3bb9-4004-a01a-5c4aa4ca5358 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:18.007880 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d14c4904-3bb9-4004-a01a-5c4aa4ca5358 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1261 microversion: 2.25 time: 0.089473 May 28 21:04:18.009192 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 215/445] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:17 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:18.013975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ca4d8c55-76a7-4ddf-a8d3-f433c65aa629 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Calling method '.version_select at 0x7f4d647efee0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:18.015278 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:18.015278 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:18.018243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca4d8c55-76a7-4ddf-a8d3-f433c65aa629 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:18.018792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca4d8c55-76a7-4ddf-a8d3-f433c65aa629 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:18.036884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca4d8c55-76a7-4ddf-a8d3-f433c65aa629 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:18.037817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca4d8c55-76a7-4ddf-a8d3-f433c65aa629 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:18.050089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca4d8c55-76a7-4ddf-a8d3-f433c65aa629 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:18.050555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca4d8c55-76a7-4ddf-a8d3-f433c65aa629 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:18.058724 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ca4d8c55-76a7-4ddf-a8d3-f433c65aa629 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048459 May 28 21:04:18.070981 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 216/446] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:04:18 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:18.083325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8838d8a1-19c1-4132-963f-7c2fe5582463 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Calling method '.version_select at 0x7f4d647efd30>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:18.088221 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:18.088221 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:18.089593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8838d8a1-19c1-4132-963f-7c2fe5582463 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:18.090086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8838d8a1-19c1-4132-963f-7c2fe5582463 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:18.124769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8838d8a1-19c1-4132-963f-7c2fe5582463 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:18.126700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8838d8a1-19c1-4132-963f-7c2fe5582463 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:18.144549 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8838d8a1-19c1-4132-963f-7c2fe5582463 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.077960 May 28 21:04:18.152126 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 217/447] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:04:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:18.152126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc5a8473-bff8-48aa-894f-86e7c1f89cb3 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:18.152126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc5a8473-bff8-48aa-894f-86e7c1f89cb3 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:18.158913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc5a8473-bff8-48aa-894f-86e7c1f89cb3 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:18.159371 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc5a8473-bff8-48aa-894f-86e7c1f89cb3 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:18.160150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc5a8473-bff8-48aa-894f-86e7c1f89cb3 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:18.160592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc5a8473-bff8-48aa-894f-86e7c1f89cb3 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:18.170482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4871e09d-df15-4bd2-bc61-a031733a3ec7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:18.183680 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4871e09d-df15-4bd2-bc61-a031733a3ec7 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1474 microversion: 2.1 time: 0.249197 May 28 21:04:18.184426 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 231/448] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:17 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1474 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:18.199041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b8e92d76-e617-4a7a-af99-1fb2174e0d42 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:18.199041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b8e92d76-e617-4a7a-af99-1fb2174e0d42 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:18.199041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b8e92d76-e617-4a7a-af99-1fb2174e0d42 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:18.199041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b8e92d76-e617-4a7a-af99-1fb2174e0d42 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:18.200679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b8e92d76-e617-4a7a-af99-1fb2174e0d42 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:18.201534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b8e92d76-e617-4a7a-af99-1fb2174e0d42 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:18.220568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:18.613040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc5a8473-bff8-48aa-894f-86e7c1f89cb3 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:18.620971 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc5a8473-bff8-48aa-894f-86e7c1f89cb3 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1313 microversion: 2.1 time: 0.474067 May 28 21:04:18.621543 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 218/449] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:18 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1313 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:18.626071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9354401e-4ef5-4b75-9524-b09ad4faaa58 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Calling method '.version_select at 0x7f4d647288b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:18.627018 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:18.627018 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:18.628402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9354401e-4ef5-4b75-9524-b09ad4faaa58 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:18.629023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9354401e-4ef5-4b75-9524-b09ad4faaa58 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:18.637262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b8e92d76-e617-4a7a-af99-1fb2174e0d42 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:18.641610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9354401e-4ef5-4b75-9524-b09ad4faaa58 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:18.642099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9354401e-4ef5-4b75-9524-b09ad4faaa58 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:18.645389 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b8e92d76-e617-4a7a-af99-1fb2174e0d42 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.459897 May 28 21:04:18.646053 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 232/450] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:18 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:18.649356 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9354401e-4ef5-4b75-9524-b09ad4faaa58 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.026589 May 28 21:04:18.649940 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 219/451] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:04:18 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:18.654979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-536fac65-0783-4da7-aa87-85c1d05e5587 req-d8c7d98a-e20a-4c15-9c93-004eead6dee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d503b27-5533-4d4d-bc74-d82d93cf69a5", "name": "network-vif-plugged", "status": "completed", "tag": "10c0bb91-17c5-48f9-8b95-c67e52a9e297"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:18.665106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-536fac65-0783-4da7-aa87-85c1d05e5587 req-d8c7d98a-e20a-4c15-9c93-004eead6dee5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:18.665942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-536fac65-0783-4da7-aa87-85c1d05e5587 req-d8c7d98a-e20a-4c15-9c93-004eead6dee5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:18.678408 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-536fac65-0783-4da7-aa87-85c1d05e5587 req-d8c7d98a-e20a-4c15-9c93-004eead6dee5 service nova] Creating event network-vif-plugged:10c0bb91-17c5-48f9-8b95-c67e52a9e297 for instance 5d503b27-5533-4d4d-bc74-d82d93cf69a5 on nch2-master-1 May 28 21:04:18.683944 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-536fac65-0783-4da7-aa87-85c1d05e5587 req-d8c7d98a-e20a-4c15-9c93-004eead6dee5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032648 May 28 21:04:18.684530 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 220/452] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:18.690557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-be9e8b9d-7dbc-47bd-a8f4-473b48cd11c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Calling method '.version_select at 0x7f4d6474cdc0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:18.691481 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:18.691481 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:18.692918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be9e8b9d-7dbc-47bd-a8f4-473b48cd11c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:18.693394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be9e8b9d-7dbc-47bd-a8f4-473b48cd11c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:18.708507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be9e8b9d-7dbc-47bd-a8f4-473b48cd11c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:18.709506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be9e8b9d-7dbc-47bd-a8f4-473b48cd11c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:18.719728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be9e8b9d-7dbc-47bd-a8f4-473b48cd11c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:18.720599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be9e8b9d-7dbc-47bd-a8f4-473b48cd11c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:18.921415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a61747e4-2e74-4f01-9736-fbfc650b1a93 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] Action: 'create', calling method: .version_select at 0x7f4d64715ee0>, body: {"keypair": {"name": "tempest-keypair-2039733788", "type": "ssh", "user_id": "4918ffab682b4aefaa6180bc9e4aa6c3", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOr4aNLLjEeeMhRdkpSeKxDUqHrMcdD46Qvn8FskBc6faTZTvLhbDvDhAkXOnIRhT1lwj1zhik5eFTJLjcvGgLhVHBdzcgCiIkYqh4QtYGdx5mthw8N3oGJsNai/a+S5Sg=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:18.947170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-a61747e4-2e74-4f01-9736-fbfc650b1a93 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] Getting quotas for project 99c01e770b5948d4b50929145a205280. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:04:18.955632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-a61747e4-2e74-4f01-9736-fbfc650b1a93 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] Getting quotas for user 29ef88bde23941d6a45cd4e2eb0c720d and project 99c01e770b5948d4b50929145a205280. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:04:19.059187 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a61747e4-2e74-4f01-9736-fbfc650b1a93 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.411444 May 28 21:04:19.060119 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 233/453] 10.222.0.33 () {62 vars in 1199 bytes} [Sat May 28 21:04:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 414 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 28 21:04:19.065075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-899cff0d-ed25-437a-bee9-bc604d286d20 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:19.070017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-899cff0d-ed25-437a-bee9-bc604d286d20 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:19.077077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-899cff0d-ed25-437a-bee9-bc604d286d20 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:19.078802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-899cff0d-ed25-437a-bee9-bc604d286d20 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:19.079687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-899cff0d-ed25-437a-bee9-bc604d286d20 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:19.080146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-899cff0d-ed25-437a-bee9-bc604d286d20 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:19.158437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-899cff0d-ed25-437a-bee9-bc604d286d20 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:19.167217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-899cff0d-ed25-437a-bee9-bc604d286d20 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:19.168970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-899cff0d-ed25-437a-bee9-bc604d286d20 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:19.170139 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-899cff0d-ed25-437a-bee9-bc604d286d20 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1265 microversion: 2.25 time: 0.108884 May 28 21:04:19.171043 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 234/454] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:19 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:19.184832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b48b5dd8-3987-4d2a-b224-5b9400054a27 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] Action: 'create', calling method: .version_select at 0x7f4d646d8ee0>, body: {"keypair": {"name": "tempest-keypair-861301624", "type": "ssh", "user_id": "4918ffab682b4aefaa6180bc9e4aa6c3", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4JGlBM5uthNy372BO/asMECj4WXQD2i1lg5eqFrmDlqZWqGNlbDNWRSYWbAEEr0Y1hivnsHrC79Aj+M3P+VncPVBUzfFpcsAV3dcbcy3MwELnQsWCO6IoUP3O16Q/aXw=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:19.199756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b48b5dd8-3987-4d2a-b224-5b9400054a27 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] Getting quotas for project 99c01e770b5948d4b50929145a205280. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:04:19.205057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b48b5dd8-3987-4d2a-b224-5b9400054a27 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] Getting quotas for user 29ef88bde23941d6a45cd4e2eb0c720d and project 99c01e770b5948d4b50929145a205280. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:04:19.321659 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b48b5dd8-3987-4d2a-b224-5b9400054a27 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.145781 May 28 21:04:19.322325 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 235/455] 10.222.0.33 () {62 vars in 1199 bytes} [Sat May 28 21:04:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 151 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 28 21:04:19.326932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9a344a74-8bc6-4bde-9b2c-4f42a293e909 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:19.327835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9a344a74-8bc6-4bde-9b2c-4f42a293e909 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:19.333935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a344a74-8bc6-4bde-9b2c-4f42a293e909 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:19.334385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a344a74-8bc6-4bde-9b2c-4f42a293e909 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:19.335209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a344a74-8bc6-4bde-9b2c-4f42a293e909 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:19.335644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a344a74-8bc6-4bde-9b2c-4f42a293e909 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:19.592870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9a344a74-8bc6-4bde-9b2c-4f42a293e909 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:19.600472 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9a344a74-8bc6-4bde-9b2c-4f42a293e909 tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1474 microversion: 2.1 time: 0.277143 May 28 21:04:19.601048 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 236/456] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:19 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1474 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:19.605448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d29cb8b4-410c-4da5-b2ae-69bfa7962a5f tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] Calling method '.version_select at 0x7f4d646d81f0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:19.614496 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d29cb8b4-410c-4da5-b2ae-69bfa7962a5f tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-2039733788?user_id=4918ffab682b4aefaa6180bc9e4aa6c3" status: 200 len: 512 microversion: 2.10 time: 0.012439 May 28 21:04:19.615562 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 237/457] 10.222.0.33 () {60 vars in 1339 bytes} [Sat May 28 21:04:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2039733788?user_id=4918ffab682b4aefaa6180bc9e4aa6c3 => generated 512 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:04:19.628345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b1d39b95-a78f-4f0e-ae0c-d657b9f32f76 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] Action: 'create', calling method: .version_select at 0x7f4d646d8790>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1641930571", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRhF3B/0sv+1/pUaH/lA/CRv6HqoLyk3DyVZOE3crvgDBYbASGvHIEfy5YRJRBvMOjyR3GDUbLaaDTye/9hyjHNGlBdkU9z87AKs8fbuwN0sZn4AvIT3Rz3wY90AAcHdQ=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:19.644040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b1d39b95-a78f-4f0e-ae0c-d657b9f32f76 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] Getting quotas for project 99c01e770b5948d4b50929145a205280. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:04:19.655963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b1d39b95-a78f-4f0e-ae0c-d657b9f32f76 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] Getting quotas for user 29ef88bde23941d6a45cd4e2eb0c720d and project 99c01e770b5948d4b50929145a205280. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:04:19.747648 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b1d39b95-a78f-4f0e-ae0c-d657b9f32f76 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.122923 May 28 21:04:19.748749 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 238/458] 10.222.0.33 () {62 vars in 1199 bytes} [Sat May 28 21:04:19 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 28 21:04:19.756808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b37dd01b-ca69-4ee5-9f57-0b391fa4ae19 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:19.757676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b37dd01b-ca69-4ee5-9f57-0b391fa4ae19 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:19.764364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b37dd01b-ca69-4ee5-9f57-0b391fa4ae19 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:19.765007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b37dd01b-ca69-4ee5-9f57-0b391fa4ae19 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:19.765771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b37dd01b-ca69-4ee5-9f57-0b391fa4ae19 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:19.766565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b37dd01b-ca69-4ee5-9f57-0b391fa4ae19 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:19.952732 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-be9e8b9d-7dbc-47bd-a8f4-473b48cd11c6 tempest-HypervisorAdminTestJSON-125292797 tempest-HypervisorAdminTestJSON-125292797-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 1.266607 May 28 21:04:19.959474 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 221/459] 10.222.0.33 () {58 vars in 1172 bytes} [Sat May 28 21:04:18 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:19.964641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-36447a5c-cce1-4931-9de5-e1a3861734c7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:19.968688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-36447a5c-cce1-4931-9de5-e1a3861734c7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:19.973333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36447a5c-cce1-4931-9de5-e1a3861734c7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:19.973579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36447a5c-cce1-4931-9de5-e1a3861734c7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:19.975840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36447a5c-cce1-4931-9de5-e1a3861734c7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:19.976008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b37dd01b-ca69-4ee5-9f57-0b391fa4ae19 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:19.976497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36447a5c-cce1-4931-9de5-e1a3861734c7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:19.984152 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b37dd01b-ca69-4ee5-9f57-0b391fa4ae19 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1313 microversion: 2.1 time: 0.234212 May 28 21:04:19.989889 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 239/460] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:19 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:19.989889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-541fe65d-35d7-4998-80e7-4791a1fc13c8 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] Calling method '.version_select at 0x7f4d64605ee0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:19.995803 ncdv-master-1 devstack@n-api.service[143128]: WARNING oslo_db.sqlalchemy.utils [None req-541fe65d-35d7-4998-80e7-4791a1fc13c8 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. May 28 21:04:20.003485 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-541fe65d-35d7-4998-80e7-4791a1fc13c8 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] 10.222.0.33 "GET /compute/v2.1/os-keypairs?user_id=4918ffab682b4aefaa6180bc9e4aa6c3" status: 200 len: 725 microversion: 2.10 time: 0.017417 May 28 21:04:20.004329 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 240/461] 10.222.0.33 () {60 vars in 1258 bytes} [Sat May 28 21:04:19 2022] GET /compute/v2.1/os-keypairs?user_id=4918ffab682b4aefaa6180bc9e4aa6c3 => generated 725 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:04:20.073047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-896537343", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "153ab96f-260d-4085-99e8-0491f645a707"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:20.148745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] validate_networks() for [('153ab96f-260d-4085-99e8-0491f645a707', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:04:20.337176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-36447a5c-cce1-4931-9de5-e1a3861734c7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:20.350156 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-36447a5c-cce1-4931-9de5-e1a3861734c7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1477 microversion: 2.1 time: 0.394300 May 28 21:04:20.351084 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 222/462] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:19 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1477 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:20.356571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e27df987-5fcd-4ccf-9d81-a70856236bbd tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] Calling method '.version_select at 0x7f4d646f33a0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:20.476238 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e27df987-5fcd-4ccf-9d81-a70856236bbd tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1641930571" status: 204 len: 0 microversion: 2.10 time: 0.124061 May 28 21:04:20.481732 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 223/463] 10.222.0.33 () {60 vars in 1324 bytes} [Sat May 28 21:04:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1641930571 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:04:20.488627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8d43870a-d319-4e3e-9a87-26b8b14b5d04 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:20.489482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8d43870a-d319-4e3e-9a87-26b8b14b5d04 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:20.512728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d43870a-d319-4e3e-9a87-26b8b14b5d04 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:20.513670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d43870a-d319-4e3e-9a87-26b8b14b5d04 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:20.515154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d43870a-d319-4e3e-9a87-26b8b14b5d04 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:20.515808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d43870a-d319-4e3e-9a87-26b8b14b5d04 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:20.717632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8d43870a-d319-4e3e-9a87-26b8b14b5d04 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:20.732127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8d43870a-d319-4e3e-9a87-26b8b14b5d04 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:20.733932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8d43870a-d319-4e3e-9a87-26b8b14b5d04 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:20.735392 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8d43870a-d319-4e3e-9a87-26b8b14b5d04 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1321 microversion: 2.25 time: 0.251898 May 28 21:04:20.744634 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 224/464] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:20 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:20.758784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-299d068b-c028-4008-97a6-baca879c2e76 req-1d6a7c4c-85f8-414c-8c25-f35b899be951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e0c9107-400f-44f1-9b29-22d42ccc3222", "name": "network-vif-deleted", "tag": "b077c693-5951-44da-bbb6-776d04855388"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:20.767678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-299d068b-c028-4008-97a6-baca879c2e76 req-1d6a7c4c-85f8-414c-8c25-f35b899be951 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:20.768361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-299d068b-c028-4008-97a6-baca879c2e76 req-1d6a7c4c-85f8-414c-8c25-f35b899be951 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:20.794130 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-299d068b-c028-4008-97a6-baca879c2e76 req-1d6a7c4c-85f8-414c-8c25-f35b899be951 service nova] Creating event network-vif-deleted:b077c693-5951-44da-bbb6-776d04855388 for instance 6e0c9107-400f-44f1-9b29-22d42ccc3222 on nch2-master-1 May 28 21:04:20.810001 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-299d068b-c028-4008-97a6-baca879c2e76 req-1d6a7c4c-85f8-414c-8c25-f35b899be951 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065698 May 28 21:04:20.810958 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 225/465] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:20.817157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-261fbd3e-acb3-449f-b3b6-6c23f5d5b3e7 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] Calling method '.version_select at 0x7f4d6473e8b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:20.876766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:04:20.877733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:04:20.878358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:04:20.878696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:04:20.879242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:04:20.889701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:20.890129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:20.890938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:20.891377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:20.909305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Getting quotas for project 2f5c3054461d4d07861a1685cfeba36a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:04:20.914688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Getting quotas for user 7b44b524592e4a57a26681767b9c4541 and project 2f5c3054461d4d07861a1685cfeba36a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:04:20.931301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:04:20.933830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:04:20.962277 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-261fbd3e-acb3-449f-b3b6-6c23f5d5b3e7 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-861301624?user_id=4918ffab682b4aefaa6180bc9e4aa6c3" status: 204 len: 0 microversion: 2.10 time: 0.149852 May 28 21:04:20.963163 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 226/466] 10.222.0.33 () {60 vars in 1339 bytes} [Sat May 28 21:04:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-861301624?user_id=4918ffab682b4aefaa6180bc9e4aa6c3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:04:20.968663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-39e8af56-02a9-42f8-abc2-2780c7cd6dfc tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:20.969896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-39e8af56-02a9-42f8-abc2-2780c7cd6dfc tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:20.978032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39e8af56-02a9-42f8-abc2-2780c7cd6dfc tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:20.978403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39e8af56-02a9-42f8-abc2-2780c7cd6dfc tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:20.979591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39e8af56-02a9-42f8-abc2-2780c7cd6dfc tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:20.980053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39e8af56-02a9-42f8-abc2-2780c7cd6dfc tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:20.985357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:21.029872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:21.062996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39e8af56-02a9-42f8-abc2-2780c7cd6dfc tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:21.065180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39e8af56-02a9-42f8-abc2-2780c7cd6dfc tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:21.065916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-39e8af56-02a9-42f8-abc2-2780c7cd6dfc tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lazy-loading 'fault' on Instance uuid 6e0c9107-400f-44f1-9b29-22d42ccc3222 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:21.134019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-39e8af56-02a9-42f8-abc2-2780c7cd6dfc tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e733cc9497a48cba4ccdde860be104f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6c7378af3e841f58fdf1a907d06bc08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:21.147437 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-39e8af56-02a9-42f8-abc2-2780c7cd6dfc tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 200 len: 1308 microversion: 2.1 time: 0.182791 May 28 21:04:21.149364 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 227/467] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:20 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 1308 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:21.149938 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c3c56eff-ee72-4666-bacf-c2e16d51535c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.139309 May 28 21:04:21.151821 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 241/468] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:04:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:04:21.160039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e54ec561-17f2-4580-8dde-634440972977 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] Calling method '.version_select at 0x7f4d646f5280>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:21.169137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-59f5fd22-cded-42bc-83dd-2614ed965dee tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:21.170394 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-59f5fd22-cded-42bc-83dd-2614ed965dee tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:21.186307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59f5fd22-cded-42bc-83dd-2614ed965dee tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:21.186793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59f5fd22-cded-42bc-83dd-2614ed965dee tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:21.187793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59f5fd22-cded-42bc-83dd-2614ed965dee tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:21.188248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59f5fd22-cded-42bc-83dd-2614ed965dee tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:21.205127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:21.270645 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e54ec561-17f2-4580-8dde-634440972977 tempest-KeyPairsV210TestJSON-1844090152 tempest-KeyPairsV210TestJSON-1844090152-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039733788?user_id=4918ffab682b4aefaa6180bc9e4aa6c3" status: 204 len: 0 microversion: 2.10 time: 0.119992 May 28 21:04:21.278296 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 228/469] 10.222.0.33 () {60 vars in 1342 bytes} [Sat May 28 21:04:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2039733788?user_id=4918ffab682b4aefaa6180bc9e4aa6c3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:04:21.283327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b69b2cd0-327e-43f8-a545-84868bf0a0ff tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:21.285330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b69b2cd0-327e-43f8-a545-84868bf0a0ff tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:21.429813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b69b2cd0-327e-43f8-a545-84868bf0a0ff tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:21.437442 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b69b2cd0-327e-43f8-a545-84868bf0a0ff tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1210 microversion: 2.1 time: 0.157996 May 28 21:04:21.441593 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 229/470] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:21 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1210 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:21.457701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-513ef7ee-97c7-4849-8b62-360073b32ced tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:21.458363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-513ef7ee-97c7-4849-8b62-360073b32ced tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:21.471650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-513ef7ee-97c7-4849-8b62-360073b32ced tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:21.472461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-513ef7ee-97c7-4849-8b62-360073b32ced tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:21.475994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-513ef7ee-97c7-4849-8b62-360073b32ced tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:21.476656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-513ef7ee-97c7-4849-8b62-360073b32ced tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:21.577591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-59f5fd22-cded-42bc-83dd-2614ed965dee tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:21.590001 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-59f5fd22-cded-42bc-83dd-2614ed965dee tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1463 microversion: 2.1 time: 0.433886 May 28 21:04:21.621087 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 242/471] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:21 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1463 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:21.758657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-513ef7ee-97c7-4849-8b62-360073b32ced tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:21.766146 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-513ef7ee-97c7-4849-8b62-360073b32ced tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1476 microversion: 2.1 time: 0.321637 May 28 21:04:21.767198 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 230/472] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:21 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1476 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:21.773047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-5f7f1c8d-5169-45b4-998e-d15e7029a2a6 req-516786ee-8dc3-4a89-9f56-711adaa60508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faaac109-511d-4007-aa35-544196d7db72", "name": "network-vif-unplugged", "status": "completed", "tag": "1e6e9239-2ae6-4bf5-87a3-6c2699670420"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:21.782912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5f7f1c8d-5169-45b4-998e-d15e7029a2a6 req-516786ee-8dc3-4a89-9f56-711adaa60508 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:21.783633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5f7f1c8d-5169-45b4-998e-d15e7029a2a6 req-516786ee-8dc3-4a89-9f56-711adaa60508 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:21.799290 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-5f7f1c8d-5169-45b4-998e-d15e7029a2a6 req-516786ee-8dc3-4a89-9f56-711adaa60508 service nova] Creating event network-vif-unplugged:1e6e9239-2ae6-4bf5-87a3-6c2699670420 for instance faaac109-511d-4007-aa35-544196d7db72 on nch2-master-1 May 28 21:04:21.811031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-5f7f1c8d-5169-45b4-998e-d15e7029a2a6 req-516786ee-8dc3-4a89-9f56-711adaa60508 service nova] Instance faaac109-511d-4007-aa35-544196d7db72 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:04:21.830299 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-5f7f1c8d-5169-45b4-998e-d15e7029a2a6 req-516786ee-8dc3-4a89-9f56-711adaa60508 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057171 May 28 21:04:21.830299 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 231/473] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:21.843756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fef5f47b-aab4-4ef5-abee-809a5b885268 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:21.847064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fef5f47b-aab4-4ef5-abee-809a5b885268 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:21.864746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fef5f47b-aab4-4ef5-abee-809a5b885268 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:21.864746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fef5f47b-aab4-4ef5-abee-809a5b885268 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:21.866145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fef5f47b-aab4-4ef5-abee-809a5b885268 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:21.868979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fef5f47b-aab4-4ef5-abee-809a5b885268 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:21.870545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:21.880212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ddf99878-a0e8-4596-9c4f-750cfe9852ff tempest-TenantUsagesTestJSON-2135922492 tempest-TenantUsagesTestJSON-2135922492-project-admin] Calling method '.version_select at 0x7f4d6482ce50>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:21.955947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddf99878-a0e8-4596-9c4f-750cfe9852ff tempest-TenantUsagesTestJSON-2135922492 tempest-TenantUsagesTestJSON-2135922492-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:21.956440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddf99878-a0e8-4596-9c4f-750cfe9852ff tempest-TenantUsagesTestJSON-2135922492 tempest-TenantUsagesTestJSON-2135922492-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:22.019897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddf99878-a0e8-4596-9c4f-750cfe9852ff tempest-TenantUsagesTestJSON-2135922492 tempest-TenantUsagesTestJSON-2135922492-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:22.020517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddf99878-a0e8-4596-9c4f-750cfe9852ff tempest-TenantUsagesTestJSON-2135922492 tempest-TenantUsagesTestJSON-2135922492-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:22.028382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fef5f47b-aab4-4ef5-abee-809a5b885268 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:22.041224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fef5f47b-aab4-4ef5-abee-809a5b885268 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:22.045961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fef5f47b-aab4-4ef5-abee-809a5b885268 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:22.049001 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fef5f47b-aab4-4ef5-abee-809a5b885268 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1319 microversion: 2.25 time: 0.214494 May 28 21:04:22.051299 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 232/474] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:21 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:22.051675 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ddf99878-a0e8-4596-9c4f-750cfe9852ff tempest-TenantUsagesTestJSON-2135922492 tempest-TenantUsagesTestJSON-2135922492-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/cde37d77fb1343f4af1dd8e735a41615?start=2022-05-27T21%3A04%3A21.633760&end=2022-05-29T21%3A04%3A21.633760" status: 200 len: 694 microversion: 2.1 time: 0.410785 May 28 21:04:22.065698 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 243/475] 10.222.0.33 () {58 vars in 1411 bytes} [Sat May 28 21:04:21 2022] GET /compute/v2.1/os-simple-tenant-usage/cde37d77fb1343f4af1dd8e735a41615?start=2022-05-27T21%3A04%3A21.633760&end=2022-05-29T21%3A04%3A21.633760 => generated 694 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:22.078401 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-80026fc6-77ea-47b0-aa9b-8e03dbe53b33 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '.version_select at 0x7f4d6487bee0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:22.093909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80026fc6-77ea-47b0-aa9b-8e03dbe53b33 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:22.094933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80026fc6-77ea-47b0-aa9b-8e03dbe53b33 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:22.124359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80026fc6-77ea-47b0-aa9b-8e03dbe53b33 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:22.128219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80026fc6-77ea-47b0-aa9b-8e03dbe53b33 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:22.153107 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-80026fc6-77ea-47b0-aa9b-8e03dbe53b33 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/cde37d77fb1343f4af1dd8e735a41615?start=2022-05-27T21%3A04%3A21.633760&end=2022-05-29T21%3A04%3A21.633760" status: 200 len: 693 microversion: 2.1 time: 0.085186 May 28 21:04:22.158430 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 233/476] 10.222.0.33 () {58 vars in 1411 bytes} [Sat May 28 21:04:22 2022] GET /compute/v2.1/os-simple-tenant-usage/cde37d77fb1343f4af1dd8e735a41615?start=2022-05-27T21%3A04%3A21.633760&end=2022-05-29T21%3A04%3A21.633760 => generated 693 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:22.166109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-067a1523-638b-4166-a058-12d38d5981ed tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:22.166784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-067a1523-638b-4166-a058-12d38d5981ed tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] [instance: 6e0c9107-400f-44f1-9b29-22d42ccc3222] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:22.171784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-77572415-c403-4d5d-a754-84ed217fe8f5 tempest-TenantUsagesTestJSON-2135922492 tempest-TenantUsagesTestJSON-2135922492-project-admin] Calling method '.version_select at 0x7f4d647efee0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:22.176755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-067a1523-638b-4166-a058-12d38d5981ed tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:22.177142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-067a1523-638b-4166-a058-12d38d5981ed tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:22.178519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-067a1523-638b-4166-a058-12d38d5981ed tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:22.178969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-067a1523-638b-4166-a058-12d38d5981ed tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:22.187247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77572415-c403-4d5d-a754-84ed217fe8f5 tempest-TenantUsagesTestJSON-2135922492 tempest-TenantUsagesTestJSON-2135922492-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:22.188703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77572415-c403-4d5d-a754-84ed217fe8f5 tempest-TenantUsagesTestJSON-2135922492 tempest-TenantUsagesTestJSON-2135922492-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:22.211790 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-067a1523-638b-4166-a058-12d38d5981ed tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] HTTP exception thrown: Instance 6e0c9107-400f-44f1-9b29-22d42ccc3222 could not be found. May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-067a1523-638b-4166-a058-12d38d5981ed tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Request method failure captured: May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 HTTP/1.1 May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4lsPojcqeRJCoi5q4YLXkMLLGsVrPFOHcetj01dLcqH-o9tIv00gsvbfU88VT2S0Z-UW-qBJmEPnQOZ0AyKyNeiCUgVZBfv38iY02KP9tP6GN43-J-yjK_FbEEAWvHMXrdDtEmwJdp397KYq4VMM-rBRyqoprUC5mjDEx9E1GDRgM May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: b6c7378af3e841f58fdf1a907d06bc08 May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-LiveMigrationNegativeTest-1158149238 May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:04:22.214468 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:04:22.215772 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b6c7378af3e841f58fdf1a907d06bc08", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b6c7378af3e841f58fdf1a907d06bc08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b6c7378af3e841f58fdf1a907d06bc08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b6c7378af3e841f58fdf1a907d06bc08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:22.215772 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-LiveMigrationNegativeTest-1158149238 May 28 21:04:22.215772 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: b6c7378af3e841f58fdf1a907d06bc08 May 28 21:04:22.215772 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1158149238 May 28 21:04:22.215772 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-LiveMigrationNegativeTest-1158149238-project May 28 21:04:22.215772 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:22.215772 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:22.215772 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 0e733cc9497a48cba4ccdde860be104f May 28 21:04:22.215772 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-LiveMigrationNegativeTest-1158149238-project May 28 21:04:22.215772 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:04:22.215772 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 6e0c9107-400f-44f1-9b29-22d42ccc3222 could not be found. May 28 21:04:22.215772 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '6e0c9107-400f-44f1-9b29-22d42ccc3222'} May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e0c9107-400f-44f1-9b29-22d42ccc3222 could not be found. May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:22.216504 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e0c9107-400f-44f1-9b29-22d42ccc3222 could not be found. May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e0c9107-400f-44f1-9b29-22d42ccc3222 could not be found. May 28 21:04:22.217639 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:22.220887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-067a1523-638b-4166-a058-12d38d5981ed tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] Returning 404 to user: Instance 6e0c9107-400f-44f1-9b29-22d42ccc3222 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:22.220887 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-067a1523-638b-4166-a058-12d38d5981ed tempest-LiveMigrationNegativeTest-1158149238 tempest-LiveMigrationNegativeTest-1158149238-project] 10.222.0.33 "GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222" status: 404 len: 111 microversion: 2.1 time: 0.054547 May 28 21:04:22.220887 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 244/477] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:22 2022] GET /compute/v2.1/servers/6e0c9107-400f-44f1-9b29-22d42ccc3222 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:04:22.228034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77572415-c403-4d5d-a754-84ed217fe8f5 tempest-TenantUsagesTestJSON-2135922492 tempest-TenantUsagesTestJSON-2135922492-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:22.228034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77572415-c403-4d5d-a754-84ed217fe8f5 tempest-TenantUsagesTestJSON-2135922492 tempest-TenantUsagesTestJSON-2135922492-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:22.262741 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-77572415-c403-4d5d-a754-84ed217fe8f5 tempest-TenantUsagesTestJSON-2135922492 tempest-TenantUsagesTestJSON-2135922492-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-27T21%3A04%3A21.633760&end=2022-05-29T21%3A04%3A21.633760&detailed=1" status: 200 len: 5630 microversion: 2.1 time: 0.096552 May 28 21:04:22.264062 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 234/478] 10.222.0.33 () {58 vars in 1334 bytes} [Sat May 28 21:04:22 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-27T21%3A04%3A21.633760&end=2022-05-29T21%3A04%3A21.633760&detailed=1 => generated 5630 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:22.282505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-189558af-f479-4cb8-99ff-d2d4ae0caf77 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:22.282505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-189558af-f479-4cb8-99ff-d2d4ae0caf77 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:22.295298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-189558af-f479-4cb8-99ff-d2d4ae0caf77 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:22.296822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-189558af-f479-4cb8-99ff-d2d4ae0caf77 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:22.297656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-189558af-f479-4cb8-99ff-d2d4ae0caf77 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:22.300678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-189558af-f479-4cb8-99ff-d2d4ae0caf77 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:22.346969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-189558af-f479-4cb8-99ff-d2d4ae0caf77 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:04:22.459882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7a464ff-ab3f-4cfb-8077-ae115c41c71a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:22.460595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d7a464ff-ab3f-4cfb-8077-ae115c41c71a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:22.607029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d7a464ff-ab3f-4cfb-8077-ae115c41c71a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:22.615920 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d7a464ff-ab3f-4cfb-8077-ae115c41c71a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1210 microversion: 2.1 time: 0.160793 May 28 21:04:22.617208 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 235/479] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:22 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1210 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:04:22.758310 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-189558af-f479-4cb8-99ff-d2d4ae0caf77 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 204 len: 0 microversion: 2.1 time: 0.480322 May 28 21:04:22.759895 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 245/480] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:04:22 2022] DELETE /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:04:22.768627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ac823620-0261-487b-bac1-4633841d21d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:22.769619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ac823620-0261-487b-bac1-4633841d21d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:22.777225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac823620-0261-487b-bac1-4633841d21d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:22.785299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-149ab5c9-bb58-4049-9850-9aad3cadb9e1 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:22.787492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-149ab5c9-bb58-4049-9850-9aad3cadb9e1 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:22.790409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac823620-0261-487b-bac1-4633841d21d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:22.792766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac823620-0261-487b-bac1-4633841d21d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:22.798505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac823620-0261-487b-bac1-4633841d21d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:22.804681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-149ab5c9-bb58-4049-9850-9aad3cadb9e1 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:22.810788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-149ab5c9-bb58-4049-9850-9aad3cadb9e1 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:22.811756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-149ab5c9-bb58-4049-9850-9aad3cadb9e1 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:22.812460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-149ab5c9-bb58-4049-9850-9aad3cadb9e1 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:23.162841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ac823620-0261-487b-bac1-4633841d21d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:23.170794 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ac823620-0261-487b-bac1-4633841d21d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1469 microversion: 2.1 time: 0.405904 May 28 21:04:23.174696 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 236/481] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:22 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1469 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:23.191029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-27b94baf-05b8-42b1-8ac9-94311650337d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:23.191911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-27b94baf-05b8-42b1-8ac9-94311650337d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:23.207692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27b94baf-05b8-42b1-8ac9-94311650337d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:23.208358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27b94baf-05b8-42b1-8ac9-94311650337d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:23.209952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27b94baf-05b8-42b1-8ac9-94311650337d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:23.210570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27b94baf-05b8-42b1-8ac9-94311650337d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:23.398817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-149ab5c9-bb58-4049-9850-9aad3cadb9e1 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:23.414566 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-149ab5c9-bb58-4049-9850-9aad3cadb9e1 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1476 microversion: 2.1 time: 0.633723 May 28 21:04:23.415508 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 246/482] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:22 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1476 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:23.599415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-27b94baf-05b8-42b1-8ac9-94311650337d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:23.607375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-27b94baf-05b8-42b1-8ac9-94311650337d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:23.608900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-27b94baf-05b8-42b1-8ac9-94311650337d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:23.610048 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-27b94baf-05b8-42b1-8ac9-94311650337d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1361 microversion: 2.25 time: 0.422976 May 28 21:04:23.610613 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 237/483] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:23 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1361 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:23.635667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2319808a-10e7-49b5-bc42-f8f43138631c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:23.636671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2319808a-10e7-49b5-bc42-f8f43138631c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:23.644169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2319808a-10e7-49b5-bc42-f8f43138631c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:23.644737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2319808a-10e7-49b5-bc42-f8f43138631c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:23.645622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2319808a-10e7-49b5-bc42-f8f43138631c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:23.646137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2319808a-10e7-49b5-bc42-f8f43138631c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:23.721488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2319808a-10e7-49b5-bc42-f8f43138631c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:23.737811 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2319808a-10e7-49b5-bc42-f8f43138631c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1262 microversion: 2.1 time: 0.108503 May 28 21:04:23.739064 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 247/484] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:23 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1262 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:23.866271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-cfb34e39-c4bf-4c3a-9433-78ae87e1af1e req-f4075f40-c461-4ce7-a095-6a7df39d6861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faaac109-511d-4007-aa35-544196d7db72", "tag": "1e6e9239-2ae6-4bf5-87a3-6c2699670420"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:23.877389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cfb34e39-c4bf-4c3a-9433-78ae87e1af1e req-f4075f40-c461-4ce7-a095-6a7df39d6861 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:23.877389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cfb34e39-c4bf-4c3a-9433-78ae87e1af1e req-f4075f40-c461-4ce7-a095-6a7df39d6861 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:23.898373 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-cfb34e39-c4bf-4c3a-9433-78ae87e1af1e req-f4075f40-c461-4ce7-a095-6a7df39d6861 service nova] Creating event network-changed:1e6e9239-2ae6-4bf5-87a3-6c2699670420 for instance faaac109-511d-4007-aa35-544196d7db72 on nch2-master-1 May 28 21:04:23.914887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-cfb34e39-c4bf-4c3a-9433-78ae87e1af1e req-f4075f40-c461-4ce7-a095-6a7df39d6861 service nova] Instance faaac109-511d-4007-aa35-544196d7db72 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:04:23.936812 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-cfb34e39-c4bf-4c3a-9433-78ae87e1af1e req-f4075f40-c461-4ce7-a095-6a7df39d6861 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074520 May 28 21:04:23.939062 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 238/485] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:24.199683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e9d89f6a-6623-4bc9-a1fa-41bde62fc608 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:24.200688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e9d89f6a-6623-4bc9-a1fa-41bde62fc608 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:24.208073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9d89f6a-6623-4bc9-a1fa-41bde62fc608 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:24.208780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9d89f6a-6623-4bc9-a1fa-41bde62fc608 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:24.210136 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9d89f6a-6623-4bc9-a1fa-41bde62fc608 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:24.210803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9d89f6a-6623-4bc9-a1fa-41bde62fc608 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:24.436909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5c826a5a-9bbd-4b1c-875c-a17aea90f57f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:24.438010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5c826a5a-9bbd-4b1c-875c-a17aea90f57f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:24.451153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e9d89f6a-6623-4bc9-a1fa-41bde62fc608 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:24.467438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c826a5a-9bbd-4b1c-875c-a17aea90f57f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:24.467897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c826a5a-9bbd-4b1c-875c-a17aea90f57f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:24.471112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c826a5a-9bbd-4b1c-875c-a17aea90f57f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:24.480278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c826a5a-9bbd-4b1c-875c-a17aea90f57f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:24.480427 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e9d89f6a-6623-4bc9-a1fa-41bde62fc608 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1469 microversion: 2.1 time: 0.285831 May 28 21:04:24.480427 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 248/486] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:24 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1469 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:24.629259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-00f9b074-8026-42c0-a320-6b77a5e9ad70 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:24.630304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-00f9b074-8026-42c0-a320-6b77a5e9ad70 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:24.638067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00f9b074-8026-42c0-a320-6b77a5e9ad70 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:24.643819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00f9b074-8026-42c0-a320-6b77a5e9ad70 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:24.644746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00f9b074-8026-42c0-a320-6b77a5e9ad70 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:24.645384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00f9b074-8026-42c0-a320-6b77a5e9ad70 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:24.898710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5c826a5a-9bbd-4b1c-875c-a17aea90f57f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:24.911272 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5c826a5a-9bbd-4b1c-875c-a17aea90f57f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1476 microversion: 2.1 time: 0.482259 May 28 21:04:24.913362 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 239/487] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:24 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1476 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:04:24.918073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-a3883cff-da4c-47c1-b80f-9830a6b3cd02 req-4d7a441e-654a-49d2-af04-4994a7393671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "738ac5a7-1dc6-430e-a5dc-f08d9c5faca6", "tag": "0b49f1a2-af84-4fdb-9e25-802752a26503"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:24.948661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a3883cff-da4c-47c1-b80f-9830a6b3cd02 req-4d7a441e-654a-49d2-af04-4994a7393671 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:24.949907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a3883cff-da4c-47c1-b80f-9830a6b3cd02 req-4d7a441e-654a-49d2-af04-4994a7393671 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:24.984191 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a3883cff-da4c-47c1-b80f-9830a6b3cd02 req-4d7a441e-654a-49d2-af04-4994a7393671 service nova] Creating event network-changed:0b49f1a2-af84-4fdb-9e25-802752a26503 for instance 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 on nch2-master-1 May 28 21:04:24.995801 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-a3883cff-da4c-47c1-b80f-9830a6b3cd02 req-4d7a441e-654a-49d2-af04-4994a7393671 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080477 May 28 21:04:25.004836 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 240/488] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:25.012038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f127d76b-c36e-41ac-b3b4-abe7dda9b7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:25.012864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f127d76b-c36e-41ac-b3b4-abe7dda9b7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:25.019933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f127d76b-c36e-41ac-b3b4-abe7dda9b7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:25.020560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f127d76b-c36e-41ac-b3b4-abe7dda9b7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:25.022231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f127d76b-c36e-41ac-b3b4-abe7dda9b7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:25.022835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f127d76b-c36e-41ac-b3b4-abe7dda9b7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:25.053019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-00f9b074-8026-42c0-a320-6b77a5e9ad70 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:25.081170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-00f9b074-8026-42c0-a320-6b77a5e9ad70 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:25.082745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-00f9b074-8026-42c0-a320-6b77a5e9ad70 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:25.087030 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-00f9b074-8026-42c0-a320-6b77a5e9ad70 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1361 microversion: 2.25 time: 0.462744 May 28 21:04:25.098554 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 249/489] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:24 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1361 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:25.152412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f127d76b-c36e-41ac-b3b4-abe7dda9b7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:25.160349 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f127d76b-c36e-41ac-b3b4-abe7dda9b7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1268 microversion: 2.1 time: 0.153411 May 28 21:04:25.160939 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 241/490] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:25 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:25.497723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0475d80d-d206-4536-a370-b66ecc9ca5d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:25.497723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0475d80d-d206-4536-a370-b66ecc9ca5d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:25.502589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0475d80d-d206-4536-a370-b66ecc9ca5d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:25.503342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0475d80d-d206-4536-a370-b66ecc9ca5d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:25.504201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0475d80d-d206-4536-a370-b66ecc9ca5d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:25.504719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0475d80d-d206-4536-a370-b66ecc9ca5d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:25.656338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0475d80d-d206-4536-a370-b66ecc9ca5d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:25.666680 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0475d80d-d206-4536-a370-b66ecc9ca5d2 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1469 microversion: 2.1 time: 0.178388 May 28 21:04:25.678481 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 250/491] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:25 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1469 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:25.938082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ed3eeebc-55ac-4c75-83f6-394a0a6b98fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:25.938905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ed3eeebc-55ac-4c75-83f6-394a0a6b98fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:25.953598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed3eeebc-55ac-4c75-83f6-394a0a6b98fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:25.954111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed3eeebc-55ac-4c75-83f6-394a0a6b98fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:25.955230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed3eeebc-55ac-4c75-83f6-394a0a6b98fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:25.955934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed3eeebc-55ac-4c75-83f6-394a0a6b98fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:26.106796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-47da8a08-e917-4562-bf30-8d01e5b064d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:26.108056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-47da8a08-e917-4562-bf30-8d01e5b064d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:26.120673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47da8a08-e917-4562-bf30-8d01e5b064d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:26.123094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47da8a08-e917-4562-bf30-8d01e5b064d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:26.124086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47da8a08-e917-4562-bf30-8d01e5b064d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:26.125723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47da8a08-e917-4562-bf30-8d01e5b064d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:26.178317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ed3eeebc-55ac-4c75-83f6-394a0a6b98fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:26.189769 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ed3eeebc-55ac-4c75-83f6-394a0a6b98fc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1474 microversion: 2.1 time: 0.264195 May 28 21:04:26.197894 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 242/492] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:25 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1474 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:26.226293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb70fdf4-d7c5-462e-8521-8cbad1ee0be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:26.226970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fb70fdf4-d7c5-462e-8521-8cbad1ee0be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:26.235140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb70fdf4-d7c5-462e-8521-8cbad1ee0be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:26.235650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb70fdf4-d7c5-462e-8521-8cbad1ee0be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:26.236554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb70fdf4-d7c5-462e-8521-8cbad1ee0be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:26.237520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb70fdf4-d7c5-462e-8521-8cbad1ee0be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:26.322151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fb70fdf4-d7c5-462e-8521-8cbad1ee0be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:26.348865 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb70fdf4-d7c5-462e-8521-8cbad1ee0be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1268 microversion: 2.1 time: 0.154879 May 28 21:04:26.350081 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 243/493] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:26 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:26.455192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-dec71a54-fe09-40cf-a7cc-fe8db20d8700 req-2c6a38e5-955e-4e34-8361-35570ab69f91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d503b27-5533-4d4d-bc74-d82d93cf69a5", "name": "network-vif-deleted", "tag": "10c0bb91-17c5-48f9-8b95-c67e52a9e297"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:26.476579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-dec71a54-fe09-40cf-a7cc-fe8db20d8700 req-2c6a38e5-955e-4e34-8361-35570ab69f91 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:26.477346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-dec71a54-fe09-40cf-a7cc-fe8db20d8700 req-2c6a38e5-955e-4e34-8361-35570ab69f91 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:26.485508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-47da8a08-e917-4562-bf30-8d01e5b064d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:26.518678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-47da8a08-e917-4562-bf30-8d01e5b064d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:26.523159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-47da8a08-e917-4562-bf30-8d01e5b064d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:26.524640 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-dec71a54-fe09-40cf-a7cc-fe8db20d8700 req-2c6a38e5-955e-4e34-8361-35570ab69f91 service nova] Creating event network-vif-deleted:10c0bb91-17c5-48f9-8b95-c67e52a9e297 for instance 5d503b27-5533-4d4d-bc74-d82d93cf69a5 on nch2-master-1 May 28 21:04:26.525724 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-47da8a08-e917-4562-bf30-8d01e5b064d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1361 microversion: 2.25 time: 0.423046 May 28 21:04:26.527941 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 251/494] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:26 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1361 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:26.540606 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-dec71a54-fe09-40cf-a7cc-fe8db20d8700 req-2c6a38e5-955e-4e34-8361-35570ab69f91 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090899 May 28 21:04:26.541769 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 244/495] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:04:26.698488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6f45c113-f2b5-4f33-ab9b-d7d6d1569df5 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:26.699274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6f45c113-f2b5-4f33-ab9b-d7d6d1569df5 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:26.709470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f45c113-f2b5-4f33-ab9b-d7d6d1569df5 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:26.710396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f45c113-f2b5-4f33-ab9b-d7d6d1569df5 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:26.711970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f45c113-f2b5-4f33-ab9b-d7d6d1569df5 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:26.714320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f45c113-f2b5-4f33-ab9b-d7d6d1569df5 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:26.811766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6f45c113-f2b5-4f33-ab9b-d7d6d1569df5 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:26.824412 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6f45c113-f2b5-4f33-ab9b-d7d6d1569df5 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1298 microversion: 2.1 time: 0.140347 May 28 21:04:26.825352 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 252/496] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:26 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1298 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:27.210586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3f893b95-7073-4dea-b943-e04e64efa294 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:27.211945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3f893b95-7073-4dea-b943-e04e64efa294 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:27.219498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f893b95-7073-4dea-b943-e04e64efa294 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:27.220500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f893b95-7073-4dea-b943-e04e64efa294 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:27.221491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f893b95-7073-4dea-b943-e04e64efa294 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:27.222171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f893b95-7073-4dea-b943-e04e64efa294 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:27.366875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6f387b2a-ada0-4768-83ed-1412e8d47fd0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:27.367946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6f387b2a-ada0-4768-83ed-1412e8d47fd0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:27.375101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f387b2a-ada0-4768-83ed-1412e8d47fd0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:27.375790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f387b2a-ada0-4768-83ed-1412e8d47fd0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:27.376582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f387b2a-ada0-4768-83ed-1412e8d47fd0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:27.377185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f387b2a-ada0-4768-83ed-1412e8d47fd0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:27.399950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3f893b95-7073-4dea-b943-e04e64efa294 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:27.408229 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3f893b95-7073-4dea-b943-e04e64efa294 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1471 microversion: 2.1 time: 0.203140 May 28 21:04:27.408813 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 245/497] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:27 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1471 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:27.426148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-431acf0e-b781-4e06-94f8-467d8b8d69a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:27.427011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-431acf0e-b781-4e06-94f8-467d8b8d69a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:27.433934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-431acf0e-b781-4e06-94f8-467d8b8d69a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:27.434602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-431acf0e-b781-4e06-94f8-467d8b8d69a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:27.435561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-431acf0e-b781-4e06-94f8-467d8b8d69a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:27.436012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-431acf0e-b781-4e06-94f8-467d8b8d69a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:27.512670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6f387b2a-ada0-4768-83ed-1412e8d47fd0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:27.520886 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6f387b2a-ada0-4768-83ed-1412e8d47fd0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1310 microversion: 2.1 time: 0.158376 May 28 21:04:27.522102 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 253/498] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:27 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1310 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:04:27.544334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84b19bc0-ce1d-4053-9ed8-10b5d4f0205b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:27.544947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-84b19bc0-ce1d-4053-9ed8-10b5d4f0205b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:27.550932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84b19bc0-ce1d-4053-9ed8-10b5d4f0205b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:27.551382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84b19bc0-ce1d-4053-9ed8-10b5d4f0205b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:27.552135 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84b19bc0-ce1d-4053-9ed8-10b5d4f0205b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:27.552609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84b19bc0-ce1d-4053-9ed8-10b5d4f0205b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:27.567335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:27.681658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-84b19bc0-ce1d-4053-9ed8-10b5d4f0205b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:27.689632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-84b19bc0-ce1d-4053-9ed8-10b5d4f0205b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:27.691419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-84b19bc0-ce1d-4053-9ed8-10b5d4f0205b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:27.692361 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-84b19bc0-ce1d-4053-9ed8-10b5d4f0205b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1361 microversion: 2.25 time: 0.151840 May 28 21:04:27.692929 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 254/499] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:27 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:04:27.841288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0712e417-4c91-4bf2-a6bb-55cce9329b2b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:27.842729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0712e417-4c91-4bf2-a6bb-55cce9329b2b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:27.857719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0712e417-4c91-4bf2-a6bb-55cce9329b2b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:27.863511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0712e417-4c91-4bf2-a6bb-55cce9329b2b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:27.863511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0712e417-4c91-4bf2-a6bb-55cce9329b2b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:27.863511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0712e417-4c91-4bf2-a6bb-55cce9329b2b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:27.897473 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-431acf0e-b781-4e06-94f8-467d8b8d69a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "POST /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72/action" status: 204 len: 0 microversion: 2.1 time: 0.474735 May 28 21:04:27.898609 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 246/500] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:04:27 2022] POST /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72/action => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:04:27.907219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0712e417-4c91-4bf2-a6bb-55cce9329b2b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:27.907845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0712e417-4c91-4bf2-a6bb-55cce9329b2b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:27.908492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-0712e417-4c91-4bf2-a6bb-55cce9329b2b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lazy-loading 'fault' on Instance uuid 5d503b27-5533-4d4d-bc74-d82d93cf69a5 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:27.910810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aaf53a0a-f164-4ad9-a350-cc3836e43fa0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:27.915202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aaf53a0a-f164-4ad9-a350-cc3836e43fa0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:27.928989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aaf53a0a-f164-4ad9-a350-cc3836e43fa0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:27.930799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aaf53a0a-f164-4ad9-a350-cc3836e43fa0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:27.933537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aaf53a0a-f164-4ad9-a350-cc3836e43fa0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:27.934323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aaf53a0a-f164-4ad9-a350-cc3836e43fa0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:27.967127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0712e417-4c91-4bf2-a6bb-55cce9329b2b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05ada83d82f648eeabca0dce3b8eb3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde37d77fb1343f4af1dd8e735a41615', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:27.976412 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0712e417-4c91-4bf2-a6bb-55cce9329b2b tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 200 len: 1303 microversion: 2.1 time: 0.139208 May 28 21:04:27.980316 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 255/501] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:27 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:28.216417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aaf53a0a-f164-4ad9-a350-cc3836e43fa0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:28.230847 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aaf53a0a-f164-4ad9-a350-cc3836e43fa0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1471 microversion: 2.1 time: 0.326601 May 28 21:04:28.236775 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 247/502] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:27 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1471 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:04:28.366543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-381ce04c-ac71-42f0-89bf-e61a61f31ee1 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Calling method '.version_select at 0x7f4d64615ca0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:28.522783 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-381ce04c-ac71-42f0-89bf-e61a61f31ee1 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/33c240b84f2a4ff3bc3680450a299110" status: 200 len: 371 microversion: 2.1 time: 0.539888 May 28 21:04:28.524529 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 256/503] 10.222.0.33 () {58 vars in 1241 bytes} [Sat May 28 21:04:27 2022] GET /compute/v2.1/os-quota-sets/33c240b84f2a4ff3bc3680450a299110 => generated 371 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:28.535415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5501e265-b749-4d27-9c98-2eb90a743f30 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Action: 'update', calling method: .version_select at 0x7f4d6473e790>, body: {"quota_set": {"ram": "5120"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:28.556360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ffc66923-cace-496d-9147-83b4182d12f2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:28.557007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ffc66923-cace-496d-9147-83b4182d12f2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:28.571788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ffc66923-cace-496d-9147-83b4182d12f2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:28.576410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ffc66923-cace-496d-9147-83b4182d12f2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:28.576410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ffc66923-cace-496d-9147-83b4182d12f2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:28.576410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ffc66923-cace-496d-9147-83b4182d12f2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:28.866652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ffc66923-cace-496d-9147-83b4182d12f2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:28.879355 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ffc66923-cace-496d-9147-83b4182d12f2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1310 microversion: 2.1 time: 0.338509 May 28 21:04:28.891014 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 257/504] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:28 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1310 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:28.906819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f3df4067-292a-4cd9-8076-9d5d99fa4570 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:28.908556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f3df4067-292a-4cd9-8076-9d5d99fa4570 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:28.921302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3df4067-292a-4cd9-8076-9d5d99fa4570 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:28.924040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3df4067-292a-4cd9-8076-9d5d99fa4570 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:28.926772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3df4067-292a-4cd9-8076-9d5d99fa4570 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:28.928382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3df4067-292a-4cd9-8076-9d5d99fa4570 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:29.032891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5501e265-b749-4d27-9c98-2eb90a743f30 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:29.033375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5501e265-b749-4d27-9c98-2eb90a743f30 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:29.035735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5501e265-b749-4d27-9c98-2eb90a743f30 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:29.036230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5501e265-b749-4d27-9c98-2eb90a743f30 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:29.259282 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5501e265-b749-4d27-9c98-2eb90a743f30 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/33c240b84f2a4ff3bc3680450a299110" status: 200 len: 328 microversion: 2.1 time: 0.728237 May 28 21:04:29.261158 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 248/505] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:04:28 2022] PUT /compute/v2.1/os-quota-sets/33c240b84f2a4ff3bc3680450a299110 => generated 328 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:29.267248 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-2bdd5c56-106d-462a-b31d-8a6a7e9038e9 req-fd417cb4-2469-4a8f-a00b-f3d00c9d71a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94133e8e-365a-46fa-8755-5dc32d37dd83", "tag": "302e794d-9be0-4dec-a52e-1c0380a7606a"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:29.282985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2bdd5c56-106d-462a-b31d-8a6a7e9038e9 req-fd417cb4-2469-4a8f-a00b-f3d00c9d71a6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:29.284196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f3df4067-292a-4cd9-8076-9d5d99fa4570 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:29.284804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2bdd5c56-106d-462a-b31d-8a6a7e9038e9 req-fd417cb4-2469-4a8f-a00b-f3d00c9d71a6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:29.293824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f3df4067-292a-4cd9-8076-9d5d99fa4570 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:29.300862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f3df4067-292a-4cd9-8076-9d5d99fa4570 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:29.305170 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f3df4067-292a-4cd9-8076-9d5d99fa4570 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1361 microversion: 2.25 time: 0.410158 May 28 21:04:29.306455 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 258/506] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:28 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1361 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:29.312061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:29.314421 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-2bdd5c56-106d-462a-b31d-8a6a7e9038e9 req-fd417cb4-2469-4a8f-a00b-f3d00c9d71a6 service nova] Creating event network-changed:302e794d-9be0-4dec-a52e-1c0380a7606a for instance 94133e8e-365a-46fa-8755-5dc32d37dd83 on nch1-master-1 May 28 21:04:29.323342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d866cb3b-2e08-407a-b6e6-f00ee9553285 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:29.324639 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-2bdd5c56-106d-462a-b31d-8a6a7e9038e9 req-fd417cb4-2469-4a8f-a00b-f3d00c9d71a6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061861 May 28 21:04:29.326296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d866cb3b-2e08-407a-b6e6-f00ee9553285 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] [instance: 5d503b27-5533-4d4d-bc74-d82d93cf69a5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:29.328789 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 249/507] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:29.347703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d866cb3b-2e08-407a-b6e6-f00ee9553285 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:29.347703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d866cb3b-2e08-407a-b6e6-f00ee9553285 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:29.347703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d866cb3b-2e08-407a-b6e6-f00ee9553285 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:29.347703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d866cb3b-2e08-407a-b6e6-f00ee9553285 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:29.348001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-986d6c51-7290-42e9-ba90-49b47b5f0c5b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:29.348001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-986d6c51-7290-42e9-ba90-49b47b5f0c5b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:29.370398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-986d6c51-7290-42e9-ba90-49b47b5f0c5b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:29.370955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-986d6c51-7290-42e9-ba90-49b47b5f0c5b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:29.371966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-986d6c51-7290-42e9-ba90-49b47b5f0c5b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:29.373520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-986d6c51-7290-42e9-ba90-49b47b5f0c5b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:29.386265 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-d866cb3b-2e08-407a-b6e6-f00ee9553285 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] HTTP exception thrown: Instance 5d503b27-5533-4d4d-bc74-d82d93cf69a5 could not be found. May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d866cb3b-2e08-407a-b6e6-f00ee9553285 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Request method failure captured: May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 HTTP/1.1 May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5D0WuHqxXAGpIkApLodYxUonbN48iZQpIMkWTnLZ-uexVazehbIqQk0CJ4FJn8fw5EUswxsx7-pPkaJbQVNEvZz5kEoUuZbEqucFnKRUdPID1ut_nBIEBoMPR50pRP8OzEFZ6D1D_kh6OHMfB4LlbL54_oILIBoch6loHaYJK6S1o May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cde37d77fb1343f4af1dd8e735a41615 May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TenantUsagesTestJSON-1456811634 May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:04:29.392404 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:04:29.393911 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cde37d77fb1343f4af1dd8e735a41615", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cde37d77fb1343f4af1dd8e735a41615"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cde37d77fb1343f4af1dd8e735a41615"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cde37d77fb1343f4af1dd8e735a41615"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:04:29.393911 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TenantUsagesTestJSON-1456811634 May 28 21:04:29.393911 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cde37d77fb1343f4af1dd8e735a41615 May 28 21:04:29.393911 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1456811634 May 28 21:04:29.393911 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TenantUsagesTestJSON-1456811634-project May 28 21:04:29.393911 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:04:29.393911 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:04:29.393911 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 05ada83d82f648eeabca0dce3b8eb3cd May 28 21:04:29.393911 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TenantUsagesTestJSON-1456811634-project May 28 21:04:29.393911 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:04:29.393911 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 5d503b27-5533-4d4d-bc74-d82d93cf69a5 could not be found. May 28 21:04:29.393911 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '5d503b27-5533-4d4d-bc74-d82d93cf69a5'} May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d503b27-5533-4d4d-bc74-d82d93cf69a5 could not be found. May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:04:29.394796 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d503b27-5533-4d4d-bc74-d82d93cf69a5 could not be found. May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d503b27-5533-4d4d-bc74-d82d93cf69a5 could not be found. May 28 21:04:29.396281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:04:29.398024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d866cb3b-2e08-407a-b6e6-f00ee9553285 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] Returning 404 to user: Instance 5d503b27-5533-4d4d-bc74-d82d93cf69a5 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:04:29.398024 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d866cb3b-2e08-407a-b6e6-f00ee9553285 tempest-TenantUsagesTestJSON-1456811634 tempest-TenantUsagesTestJSON-1456811634-project] 10.222.0.33 "GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5" status: 404 len: 111 microversion: 2.1 time: 0.084164 May 28 21:04:29.398024 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 259/508] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:29 2022] GET /compute/v2.1/servers/5d503b27-5533-4d4d-bc74-d82d93cf69a5 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:04:29.409331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7acf493e-14f2-4549-b8ca-1c243e4ad232 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:29.413993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7acf493e-14f2-4549-b8ca-1c243e4ad232 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:29.425977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7acf493e-14f2-4549-b8ca-1c243e4ad232 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:29.426379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7acf493e-14f2-4549-b8ca-1c243e4ad232 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:29.427174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7acf493e-14f2-4549-b8ca-1c243e4ad232 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:29.428589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7acf493e-14f2-4549-b8ca-1c243e4ad232 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:29.434339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-986d6c51-7290-42e9-ba90-49b47b5f0c5b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:04:29.753184 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-986d6c51-7290-42e9-ba90-49b47b5f0c5b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "DELETE /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 204 len: 0 microversion: 2.1 time: 0.422181 May 28 21:04:29.755030 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 250/509] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:04:29 2022] DELETE /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:04:29.763685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f62ad1fe-78a9-4de5-8c02-1ea8f884fa92 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:29.780563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7acf493e-14f2-4549-b8ca-1c243e4ad232 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:29.789036 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7acf493e-14f2-4549-b8ca-1c243e4ad232 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1471 microversion: 2.1 time: 0.393511 May 28 21:04:29.790026 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 260/510] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:29 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1471 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:29.850635 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f62ad1fe-78a9-4de5-8c02-1ea8f884fa92 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-quota-sets/33c240b84f2a4ff3bc3680450a299110" status: 202 len: 0 microversion: 2.1 time: 0.093527 May 28 21:04:29.851237 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 251/511] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:04:29 2022] DELETE /compute/v2.1/os-quota-sets/33c240b84f2a4ff3bc3680450a299110 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:04:29.859151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-db027117-077e-4dbb-8a0a-57f3779ce985 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Calling method '.version_select at 0x7f4d646f5550>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:30.145424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2130981125", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:30.222717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:04:30.424874 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-db027117-077e-4dbb-8a0a-57f3779ce985 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/33c240b84f2a4ff3bc3680450a299110" status: 200 len: 371 microversion: 2.1 time: 0.569402 May 28 21:04:30.432916 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 252/512] 10.222.0.33 () {58 vars in 1241 bytes} [Sat May 28 21:04:29 2022] GET /compute/v2.1/os-quota-sets/33c240b84f2a4ff3bc3680450a299110 => generated 371 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:04:30.439864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-797301691", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "1952902279", "adminPass": "***", "networks": [{"uuid": "97ecda77-65a2-49eb-8d73-e28ced3f1a19"}], "security_groups": [{"name": "tempest-securitygroup--2017529550"}], "key_name": "tempest-keypair-1501955601", "user_data": "}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:30.548112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:04:30.548549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:04:30.549031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:04:30.549442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:04:30.550429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:04:30.569240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:30.569709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:30.571062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:30.571666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:30.581796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=25 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:30.584935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] validate_networks() for [('97ecda77-65a2-49eb-8d73-e28ced3f1a19', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:04:30.592224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Getting quotas for project 56e1dc5556624e2fb8de8a030c34c334. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:04:30.598115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Getting quotas for user 478d1609aa114d16b338e07d2d4c05c9 and project 56e1dc5556624e2fb8de8a030c34c334. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:04:30.623566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:04:30.626923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:04:30.799944 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-868d0030-12cb-41e5-9be6-2d4d58bf955f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.008563 May 28 21:04:30.803143 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 261/513] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:04:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:04:30.812088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d9a010e1-b3cc-4b13-a0db-bc95b8802d64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:30.829401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d9a010e1-b3cc-4b13-a0db-bc95b8802d64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:30.881362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9a010e1-b3cc-4b13-a0db-bc95b8802d64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:30.881820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9a010e1-b3cc-4b13-a0db-bc95b8802d64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:30.882640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9a010e1-b3cc-4b13-a0db-bc95b8802d64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:30.883078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9a010e1-b3cc-4b13-a0db-bc95b8802d64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:31.233000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d9a010e1-b3cc-4b13-a0db-bc95b8802d64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:31.241421 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d9a010e1-b3cc-4b13-a0db-bc95b8802d64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1310 microversion: 2.1 time: 0.436990 May 28 21:04:31.252049 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 262/514] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:30 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1310 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:31.258527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0da5d0da-7c04-40cb-9bfd-c79e35862db3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:31.259459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0da5d0da-7c04-40cb-9bfd-c79e35862db3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:31.266446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0da5d0da-7c04-40cb-9bfd-c79e35862db3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:31.273427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0da5d0da-7c04-40cb-9bfd-c79e35862db3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:31.274298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0da5d0da-7c04-40cb-9bfd-c79e35862db3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:31.274911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0da5d0da-7c04-40cb-9bfd-c79e35862db3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:31.445049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:04:31.445587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:04:31.446002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:04:31.446456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:04:31.446882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:04:31.462915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:31.464353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:31.465657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:31.466394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:31.487092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0da5d0da-7c04-40cb-9bfd-c79e35862db3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:31.489060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Getting quotas for project 0e60b122ef584254b06fd8258c987f8d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:04:31.495125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Getting quotas for user cdeaa660f8ec465bba68096d0ed4b1ae and project 0e60b122ef584254b06fd8258c987f8d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:04:31.498252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0da5d0da-7c04-40cb-9bfd-c79e35862db3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:31.500921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0da5d0da-7c04-40cb-9bfd-c79e35862db3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:31.502780 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0da5d0da-7c04-40cb-9bfd-c79e35862db3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1361 microversion: 2.25 time: 0.248209 May 28 21:04:31.505860 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 263/515] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:31 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:31.509535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-518c3b10-4848-469c-a09a-32f204b52259 req-3a156ca8-507f-4f67-80bb-c356075ababc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faaac109-511d-4007-aa35-544196d7db72", "name": "network-vif-plugged", "status": "completed", "tag": "1e6e9239-2ae6-4bf5-87a3-6c2699670420"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:31.518839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-518c3b10-4848-469c-a09a-32f204b52259 req-3a156ca8-507f-4f67-80bb-c356075ababc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:31.519514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-518c3b10-4848-469c-a09a-32f204b52259 req-3a156ca8-507f-4f67-80bb-c356075ababc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:31.520409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:04:31.525738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:04:31.534777 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-518c3b10-4848-469c-a09a-32f204b52259 req-3a156ca8-507f-4f67-80bb-c356075ababc service nova] Creating event network-vif-plugged:1e6e9239-2ae6-4bf5-87a3-6c2699670420 for instance faaac109-511d-4007-aa35-544196d7db72 on nch2-master-1 May 28 21:04:31.550283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-518c3b10-4848-469c-a09a-32f204b52259 req-3a156ca8-507f-4f67-80bb-c356075ababc service nova] Instance faaac109-511d-4007-aa35-544196d7db72 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:04:31.564108 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-518c3b10-4848-469c-a09a-32f204b52259 req-3a156ca8-507f-4f67-80bb-c356075ababc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058819 May 28 21:04:31.564804 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 264/516] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:31.571420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d7d76d79-2151-461e-90f1-cdba14e2d0f4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:31.572126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d7d76d79-2151-461e-90f1-cdba14e2d0f4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:31.579178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d7d76d79-2151-461e-90f1-cdba14e2d0f4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:31.579762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d7d76d79-2151-461e-90f1-cdba14e2d0f4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:31.580931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d7d76d79-2151-461e-90f1-cdba14e2d0f4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:31.581377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d7d76d79-2151-461e-90f1-cdba14e2d0f4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:31.662559 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2fb2e2be-7025-46ea-9af2-114e7ade2fde tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.227899 May 28 21:04:31.668747 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 253/517] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:04:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:04:31.673918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-48d1cc01-56de-47e2-8857-1bc8dc3eb121 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Calling method '.version_select at 0x7f4d6465d1f0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:31.768291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d7d76d79-2151-461e-90f1-cdba14e2d0f4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:31.781747 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d7d76d79-2151-461e-90f1-cdba14e2d0f4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1471 microversion: 2.1 time: 0.214657 May 28 21:04:31.783181 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 265/518] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:31 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:31.790013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1353987737", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:31.870410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:04:31.982554 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-48d1cc01-56de-47e2-8857-1bc8dc3eb121 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/16cb773714aa47299fa289c53ff1121f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.312407 May 28 21:04:31.991771 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 254/519] 10.222.0.33 () {58 vars in 1268 bytes} [Sat May 28 21:04:31 2022] GET /compute/v2.1/os-quota-sets/16cb773714aa47299fa289c53ff1121f/defaults => generated 371 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:31.998000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-918854f1-dbe9-4bb7-a747-3ae518171c3a tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:32.003452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-918854f1-dbe9-4bb7-a747-3ae518171c3a tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:32.082886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-918854f1-dbe9-4bb7-a747-3ae518171c3a tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:32.090922 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-918854f1-dbe9-4bb7-a747-3ae518171c3a tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1264 microversion: 2.1 time: 0.097680 May 28 21:04:32.092064 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 255/520] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:31 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1264 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:32.171303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:04:32.171303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:04:32.171533 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:04:32.171854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:04:32.172269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:04:32.185773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:32.186865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:32.188627 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:32.189078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:32.213200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Getting quotas for project 56e1dc5556624e2fb8de8a030c34c334. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:04:32.221484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Getting quotas for user 478d1609aa114d16b338e07d2d4c05c9 and project 56e1dc5556624e2fb8de8a030c34c334. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:04:32.238286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:04:32.241542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:04:32.259942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a4a44839-68a0-469d-a434-1e0526887c9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:32.260893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a4a44839-68a0-469d-a434-1e0526887c9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:32.265009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:32.280156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4a44839-68a0-469d-a434-1e0526887c9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:32.280909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4a44839-68a0-469d-a434-1e0526887c9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:32.281500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4a44839-68a0-469d-a434-1e0526887c9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:32.287749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4a44839-68a0-469d-a434-1e0526887c9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:32.471002 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1836e2c1-a4db-4d8d-ab42-c720fce2eaf0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686440 May 28 21:04:32.477123 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 266/521] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:04:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:04:32.482794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fa7dd155-a53b-4fca-8489-53e62ccda0d3 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:32.483427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fa7dd155-a53b-4fca-8489-53e62ccda0d3 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:32.597700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fa7dd155-a53b-4fca-8489-53e62ccda0d3 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:32.611846 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fa7dd155-a53b-4fca-8489-53e62ccda0d3 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 200 len: 1214 microversion: 2.1 time: 0.133661 May 28 21:04:32.615740 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 267/522] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:32 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:32.623526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2d009cbe-1ed1-4527-86cc-abe44e2b0a47 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:32.623929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2d009cbe-1ed1-4527-86cc-abe44e2b0a47 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:32.633551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d009cbe-1ed1-4527-86cc-abe44e2b0a47 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:32.633551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d009cbe-1ed1-4527-86cc-abe44e2b0a47 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:32.633551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d009cbe-1ed1-4527-86cc-abe44e2b0a47 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:32.633551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d009cbe-1ed1-4527-86cc-abe44e2b0a47 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:32.811386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a4a44839-68a0-469d-a434-1e0526887c9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:32.827674 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a4a44839-68a0-469d-a434-1e0526887c9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1310 microversion: 2.1 time: 0.567259 May 28 21:04:32.840509 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 256/523] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:32 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1310 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:04:32.850259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8715f032-50bd-41e2-ba23-f6901d374da4 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Action: 'update', calling method: .version_select at 0x7f4d646f5dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:33.084436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8715f032-50bd-41e2-ba23-f6901d374da4 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:33.087621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8715f032-50bd-41e2-ba23-f6901d374da4 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:33.089310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8715f032-50bd-41e2-ba23-f6901d374da4 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:33.091699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8715f032-50bd-41e2-ba23-f6901d374da4 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:33.119488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2d009cbe-1ed1-4527-86cc-abe44e2b0a47 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:33.129029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2d009cbe-1ed1-4527-86cc-abe44e2b0a47 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:33.136337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2d009cbe-1ed1-4527-86cc-abe44e2b0a47 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:33.137518 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2d009cbe-1ed1-4527-86cc-abe44e2b0a47 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1361 microversion: 2.25 time: 0.520768 May 28 21:04:33.138120 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 268/524] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:32 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1361 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:33.153385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8747fe12-b7fb-45a1-b8f7-17cde93c1968 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:33.154243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8747fe12-b7fb-45a1-b8f7-17cde93c1968 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:33.162065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8747fe12-b7fb-45a1-b8f7-17cde93c1968 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:33.170738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8747fe12-b7fb-45a1-b8f7-17cde93c1968 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:33.172948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8747fe12-b7fb-45a1-b8f7-17cde93c1968 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:33.177362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8747fe12-b7fb-45a1-b8f7-17cde93c1968 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:33.299686 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8715f032-50bd-41e2-ba23-f6901d374da4 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/991a68ad732f498e80a0a745646328af" status: 200 len: 328 microversion: 2.1 time: 0.457654 May 28 21:04:33.305997 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 257/525] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:04:32 2022] PUT /compute/v2.1/os-quota-sets/991a68ad732f498e80a0a745646328af => generated 328 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:33.311479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-b3a5d314-3b35-466f-8369-81911a3fc3bf req-6a14f410-1f91-461b-8d8a-a299b01de3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02214efd-8392-465b-bd6a-d658850d4f15", "name": "network-vif-deleted", "tag": "23b08d0d-93fe-4fe9-9644-d306caa2b456"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:33.320270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b3a5d314-3b35-466f-8369-81911a3fc3bf req-6a14f410-1f91-461b-8d8a-a299b01de3e9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:33.320723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b3a5d314-3b35-466f-8369-81911a3fc3bf req-6a14f410-1f91-461b-8d8a-a299b01de3e9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:33.333003 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b3a5d314-3b35-466f-8369-81911a3fc3bf req-6a14f410-1f91-461b-8d8a-a299b01de3e9 service nova] Creating event network-vif-deleted:23b08d0d-93fe-4fe9-9644-d306caa2b456 for instance 02214efd-8392-465b-bd6a-d658850d4f15 on nch1-master-1 May 28 21:04:33.338171 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-b3a5d314-3b35-466f-8369-81911a3fc3bf req-6a14f410-1f91-461b-8d8a-a299b01de3e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030451 May 28 21:04:33.338769 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 258/526] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:33.345071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-57dc0f1f-3206-483c-a287-20cbbd75185b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:33.346247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-57dc0f1f-3206-483c-a287-20cbbd75185b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:33.356517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57dc0f1f-3206-483c-a287-20cbbd75185b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:33.357745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57dc0f1f-3206-483c-a287-20cbbd75185b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:33.359358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57dc0f1f-3206-483c-a287-20cbbd75185b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:33.359990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57dc0f1f-3206-483c-a287-20cbbd75185b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:33.416047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8747fe12-b7fb-45a1-b8f7-17cde93c1968 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:33.428325 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8747fe12-b7fb-45a1-b8f7-17cde93c1968 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1471 microversion: 2.1 time: 0.278095 May 28 21:04:33.428921 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 269/527] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:33 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1471 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:33.438132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6352e297-1bf3-48e0-992d-aeb295dc3da9 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Calling method '.version_select at 0x7f4d645a68b0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:33.503592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-57dc0f1f-3206-483c-a287-20cbbd75185b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:33.540543 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-57dc0f1f-3206-483c-a287-20cbbd75185b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1268 microversion: 2.1 time: 0.192952 May 28 21:04:33.542296 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 259/528] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:33 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1268 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:33.586724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-bce87dc3-4ab4-4e88-a3fe-6c7d8434f123 req-24368fa7-5ced-4b03-841b-e0599b8bdbbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "738ac5a7-1dc6-430e-a5dc-f08d9c5faca6", "name": "network-vif-plugged", "status": "completed", "tag": "0b49f1a2-af84-4fdb-9e25-802752a26503"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:33.600872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-bce87dc3-4ab4-4e88-a3fe-6c7d8434f123 req-24368fa7-5ced-4b03-841b-e0599b8bdbbe service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:33.604283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-bce87dc3-4ab4-4e88-a3fe-6c7d8434f123 req-24368fa7-5ced-4b03-841b-e0599b8bdbbe service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:33.623581 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-bce87dc3-4ab4-4e88-a3fe-6c7d8434f123 req-24368fa7-5ced-4b03-841b-e0599b8bdbbe service nova] Creating event network-vif-plugged:0b49f1a2-af84-4fdb-9e25-802752a26503 for instance 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 on nch2-master-1 May 28 21:04:33.644062 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-bce87dc3-4ab4-4e88-a3fe-6c7d8434f123 req-24368fa7-5ced-4b03-841b-e0599b8bdbbe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057683 May 28 21:04:33.645668 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 260/529] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:04:33.689925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-59ff4f99-d0b7-4763-be2f-efa751e504a1 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:33.690821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-59ff4f99-d0b7-4763-be2f-efa751e504a1 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:33.892590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-59ff4f99-d0b7-4763-be2f-efa751e504a1 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:33.908622 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-59ff4f99-d0b7-4763-be2f-efa751e504a1 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 200 len: 1214 microversion: 2.1 time: 0.259202 May 28 21:04:33.921560 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 261/530] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:33 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 1214 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:33.944091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c88a2b29-b808-47f8-beff-ceb6501170c6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:33.944719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c88a2b29-b808-47f8-beff-ceb6501170c6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:33.976987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c88a2b29-b808-47f8-beff-ceb6501170c6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:33.978626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c88a2b29-b808-47f8-beff-ceb6501170c6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:33.983780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c88a2b29-b808-47f8-beff-ceb6501170c6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:33.984855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c88a2b29-b808-47f8-beff-ceb6501170c6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:34.038859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6352e297-1bf3-48e0-992d-aeb295dc3da9 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:34.040843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6352e297-1bf3-48e0-992d-aeb295dc3da9 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:34.045041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6352e297-1bf3-48e0-992d-aeb295dc3da9 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:34.045748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6352e297-1bf3-48e0-992d-aeb295dc3da9 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:34.092968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:34.121138 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6352e297-1bf3-48e0-992d-aeb295dc3da9 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/991a68ad732f498e80a0a745646328af/detail" status: 200 len: 916 microversion: 2.1 time: 0.690116 May 28 21:04:34.149475 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 270/531] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:04:33 2022] GET /compute/v2.1/os-quota-sets/991a68ad732f498e80a0a745646328af/detail => generated 916 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:34.157192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b094c01d-e8e0-47aa-ad1d-2e7418e36bad tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:34.157718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b094c01d-e8e0-47aa-ad1d-2e7418e36bad tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:34.172935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b094c01d-e8e0-47aa-ad1d-2e7418e36bad tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:34.173711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b094c01d-e8e0-47aa-ad1d-2e7418e36bad tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:34.176674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b094c01d-e8e0-47aa-ad1d-2e7418e36bad tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:34.178065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b094c01d-e8e0-47aa-ad1d-2e7418e36bad tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:34.427764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c88a2b29-b808-47f8-beff-ceb6501170c6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:34.442715 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c88a2b29-b808-47f8-beff-ceb6501170c6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1310 microversion: 2.1 time: 0.519689 May 28 21:04:34.448038 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 262/532] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:33 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1310 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:34.452987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a358cca9-e8c7-486d-90c5-fa5a54da1afd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:34.461801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a358cca9-e8c7-486d-90c5-fa5a54da1afd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:34.479999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a358cca9-e8c7-486d-90c5-fa5a54da1afd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:34.480297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a358cca9-e8c7-486d-90c5-fa5a54da1afd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:34.481165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a358cca9-e8c7-486d-90c5-fa5a54da1afd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:34.481620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a358cca9-e8c7-486d-90c5-fa5a54da1afd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:34.690943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b094c01d-e8e0-47aa-ad1d-2e7418e36bad tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:34.712408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b094c01d-e8e0-47aa-ad1d-2e7418e36bad tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:34.715017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b094c01d-e8e0-47aa-ad1d-2e7418e36bad tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:34.720799 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b094c01d-e8e0-47aa-ad1d-2e7418e36bad tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1361 microversion: 2.25 time: 0.567698 May 28 21:04:34.728698 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 271/533] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:34 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1361 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:34.732655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-21664805-c987-41e7-8d9e-f59ec1df1f33 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:34.733587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-21664805-c987-41e7-8d9e-f59ec1df1f33 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:34.744119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21664805-c987-41e7-8d9e-f59ec1df1f33 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:34.745114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21664805-c987-41e7-8d9e-f59ec1df1f33 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:34.749390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21664805-c987-41e7-8d9e-f59ec1df1f33 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:34.750204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21664805-c987-41e7-8d9e-f59ec1df1f33 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:34.767956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a358cca9-e8c7-486d-90c5-fa5a54da1afd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:34.779016 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a358cca9-e8c7-486d-90c5-fa5a54da1afd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1463 microversion: 2.1 time: 0.329579 May 28 21:04:34.779704 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 263/534] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:34 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1463 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:34.784426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7483cc52-4681-4f77-b307-740b4377410d tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Action: 'update', calling method: .version_select at 0x7f4d646f5550>, body: {"quota_set": {"ram": "2048"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:34.827108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-21664805-c987-41e7-8d9e-f59ec1df1f33 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:34.835342 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-21664805-c987-41e7-8d9e-f59ec1df1f33 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1316 microversion: 2.1 time: 0.109631 May 28 21:04:34.835922 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 272/535] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:34 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1316 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:34.840718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-75c13952-bfa7-462d-af38-5d53ac3a8933 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:34.841334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-75c13952-bfa7-462d-af38-5d53ac3a8933 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:34.849889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75c13952-bfa7-462d-af38-5d53ac3a8933 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:34.850384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75c13952-bfa7-462d-af38-5d53ac3a8933 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:34.851216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75c13952-bfa7-462d-af38-5d53ac3a8933 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:34.851663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75c13952-bfa7-462d-af38-5d53ac3a8933 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:34.997526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7483cc52-4681-4f77-b307-740b4377410d tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:35.004417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7483cc52-4681-4f77-b307-740b4377410d tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:35.004417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7483cc52-4681-4f77-b307-740b4377410d tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:35.004417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7483cc52-4681-4f77-b307-740b4377410d tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:35.039697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7483cc52-4681-4f77-b307-740b4377410d tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:35.040398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7483cc52-4681-4f77-b307-740b4377410d tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:35.041398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7483cc52-4681-4f77-b307-740b4377410d tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:35.042062 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7483cc52-4681-4f77-b307-740b4377410d tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:35.063955 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-75c13952-bfa7-462d-af38-5d53ac3a8933 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1614 microversion: 2.1 time: 0.226940 May 28 21:04:35.064556 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 273/536] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:34 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1614 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:35.075883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-538928cf-50a0-48c3-b69e-d128c46b239f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:35.077294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-538928cf-50a0-48c3-b69e-d128c46b239f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:35.089810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-538928cf-50a0-48c3-b69e-d128c46b239f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:35.090563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-538928cf-50a0-48c3-b69e-d128c46b239f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:35.091549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-538928cf-50a0-48c3-b69e-d128c46b239f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:35.092096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-538928cf-50a0-48c3-b69e-d128c46b239f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:35.198141 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7483cc52-4681-4f77-b307-740b4377410d tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/991a68ad732f498e80a0a745646328af?user_id=4bda39bf693641ffaf1d977717476a19" status: 200 len: 328 microversion: 2.1 time: 0.417252 May 28 21:04:35.199174 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 264/537] 10.222.0.33 () {60 vars in 1342 bytes} [Sat May 28 21:04:34 2022] PUT /compute/v2.1/os-quota-sets/991a68ad732f498e80a0a745646328af?user_id=4bda39bf693641ffaf1d977717476a19 => generated 328 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:35.205648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-538928cf-50a0-48c3-b69e-d128c46b239f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:35.209606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-309c54f2-82a7-4c9f-a41e-ded7a470677d tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Calling method '.version_select at 0x7f4d6465d670>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:35.212723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-309c54f2-82a7-4c9f-a41e-ded7a470677d tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:35.213186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-309c54f2-82a7-4c9f-a41e-ded7a470677d tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:35.219182 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-538928cf-50a0-48c3-b69e-d128c46b239f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 200 len: 1210 microversion: 2.1 time: 0.152607 May 28 21:04:35.229565 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 274/538] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:35 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 1210 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:35.230657 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-309c54f2-82a7-4c9f-a41e-ded7a470677d tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 793 microversion: 2.1 time: 0.015320 May 28 21:04:35.230657 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 265/539] 10.222.0.33 () {58 vars in 1142 bytes} [Sat May 28 21:04:35 2022] GET /compute/v2.1/os-migrations => generated 793 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:35.248256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6d363e72-dae6-4543-b7b6-19cf38341c26 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Calling method '.version_select at 0x7f4d645a6790>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:35.400125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-645181933", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:35.471373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:04:35.490376 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6d363e72-dae6-4543-b7b6-19cf38341c26 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/991a68ad732f498e80a0a745646328af?user_id=4bda39bf693641ffaf1d977717476a19" status: 200 len: 370 microversion: 2.1 time: 0.269203 May 28 21:04:35.491258 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 275/540] 10.222.0.33 () {58 vars in 1322 bytes} [Sat May 28 21:04:35 2022] GET /compute/v2.1/os-quota-sets/991a68ad732f498e80a0a745646328af?user_id=4bda39bf693641ffaf1d977717476a19 => generated 370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:35.497281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cf3a7ced-003a-4cae-895f-ae24ac479acb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:35.498172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cf3a7ced-003a-4cae-895f-ae24ac479acb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:35.505108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf3a7ced-003a-4cae-895f-ae24ac479acb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:35.506497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf3a7ced-003a-4cae-895f-ae24ac479acb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:35.507496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf3a7ced-003a-4cae-895f-ae24ac479acb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:35.508127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf3a7ced-003a-4cae-895f-ae24ac479acb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:35.795205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cf3a7ced-003a-4cae-895f-ae24ac479acb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:35.797644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:35.805812 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cf3a7ced-003a-4cae-895f-ae24ac479acb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1310 microversion: 2.1 time: 0.312866 May 28 21:04:35.807463 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 276/541] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:35 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1310 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:35.823895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3ded6600-686c-4512-9ba7-718ac1763db4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:35.824781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3ded6600-686c-4512-9ba7-718ac1763db4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:35.832947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ded6600-686c-4512-9ba7-718ac1763db4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:35.833419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ded6600-686c-4512-9ba7-718ac1763db4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:35.838198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ded6600-686c-4512-9ba7-718ac1763db4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:35.838656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ded6600-686c-4512-9ba7-718ac1763db4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:35.952353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:04:35.953122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:04:35.953827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:04:35.955354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:04:35.955354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:04:35.975817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:35.978238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:35.980203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:35.980702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:36.013669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Getting quotas for project d6c38a96a96b4fba9e41ac58f5054803. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:04:36.019561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Getting quotas for user c14b965da64c40e382c69050ba01b183 and project d6c38a96a96b4fba9e41ac58f5054803. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:04:36.039531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:04:36.040201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:04:36.162775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3ded6600-686c-4512-9ba7-718ac1763db4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:36.175518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3ded6600-686c-4512-9ba7-718ac1763db4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:36.181345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3ded6600-686c-4512-9ba7-718ac1763db4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:36.188195 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3ded6600-686c-4512-9ba7-718ac1763db4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1556 microversion: 2.25 time: 0.379486 May 28 21:04:36.190250 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 277/542] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:35 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1556 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:36.205445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d394d3c6-c914-4547-8b0b-bb53e75295fa tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:36.206375 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d394d3c6-c914-4547-8b0b-bb53e75295fa tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:36.219646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d394d3c6-c914-4547-8b0b-bb53e75295fa tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:36.222813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d394d3c6-c914-4547-8b0b-bb53e75295fa tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:36.226363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d394d3c6-c914-4547-8b0b-bb53e75295fa tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:36.227738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d394d3c6-c914-4547-8b0b-bb53e75295fa tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:36.291277 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-663e3eec-ff27-406e-a85b-f2ec264f5931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899093 May 28 21:04:36.294322 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 266/543] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:04:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:04:36.318118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-009c49b1-e08b-4751-95a2-600eac1c5dae tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:36.319263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-009c49b1-e08b-4751-95a2-600eac1c5dae tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:36.332956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-009c49b1-e08b-4751-95a2-600eac1c5dae tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:36.333565 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-009c49b1-e08b-4751-95a2-600eac1c5dae tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:36.336235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-009c49b1-e08b-4751-95a2-600eac1c5dae tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:36.336859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-009c49b1-e08b-4751-95a2-600eac1c5dae tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:36.373045 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d394d3c6-c914-4547-8b0b-bb53e75295fa tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:36.383469 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d394d3c6-c914-4547-8b0b-bb53e75295fa tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1334 microversion: 2.1 time: 0.191913 May 28 21:04:36.385113 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 278/544] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:36 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1334 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:36.400841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a64b456f-df6f-4e3c-a104-2d596e330697 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:36.402883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a64b456f-df6f-4e3c-a104-2d596e330697 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:36.412257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a64b456f-df6f-4e3c-a104-2d596e330697 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:36.413428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a64b456f-df6f-4e3c-a104-2d596e330697 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:36.414613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a64b456f-df6f-4e3c-a104-2d596e330697 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:36.415214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a64b456f-df6f-4e3c-a104-2d596e330697 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:36.606930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a64b456f-df6f-4e3c-a104-2d596e330697 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:36.616388 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a64b456f-df6f-4e3c-a104-2d596e330697 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 200 len: 1274 microversion: 2.1 time: 0.229608 May 28 21:04:36.617592 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 279/545] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:36 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 1274 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:36.624963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-61cbfb4f-ec0a-4ceb-8b49-9f031e55f8f7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:36.625827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-61cbfb4f-ec0a-4ceb-8b49-9f031e55f8f7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:36.713614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-61cbfb4f-ec0a-4ceb-8b49-9f031e55f8f7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:36.720904 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-61cbfb4f-ec0a-4ceb-8b49-9f031e55f8f7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1212 microversion: 2.1 time: 0.102061 May 28 21:04:36.721487 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 280/546] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:36 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1212 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:36.729540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a8f832e8-c154-4e01-bbe7-22bc0b2f221b tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Calling method '.version_select at 0x7f4d64615940>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:36.741528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-009c49b1-e08b-4751-95a2-600eac1c5dae tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'services' on Instance uuid 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:36.773475 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-009c49b1-e08b-4751-95a2-600eac1c5dae tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 2048 microversion: 2.25 time: 0.469948 May 28 21:04:36.778613 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 267/547] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:36 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 2048 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:36.794923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ffc1bf66-8ac5-4f10-824d-1b82393720a9 req-e4d3b678-704f-41c2-ac80-43f43b6839ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94133e8e-365a-46fa-8755-5dc32d37dd83", "name": "network-vif-plugged", "status": "completed", "tag": "302e794d-9be0-4dec-a52e-1c0380a7606a"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:36.811583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ffc1bf66-8ac5-4f10-824d-1b82393720a9 req-e4d3b678-704f-41c2-ac80-43f43b6839ea service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:36.812680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ffc1bf66-8ac5-4f10-824d-1b82393720a9 req-e4d3b678-704f-41c2-ac80-43f43b6839ea service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:36.829630 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ffc1bf66-8ac5-4f10-824d-1b82393720a9 req-e4d3b678-704f-41c2-ac80-43f43b6839ea service nova] Creating event network-vif-plugged:302e794d-9be0-4dec-a52e-1c0380a7606a for instance 94133e8e-365a-46fa-8755-5dc32d37dd83 on nch1-master-1 May 28 21:04:36.850454 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ffc1bf66-8ac5-4f10-824d-1b82393720a9 req-e4d3b678-704f-41c2-ac80-43f43b6839ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069616 May 28 21:04:36.851812 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 268/548] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:36.871768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fa8efdf5-191d-4be0-97a0-d61c87df2135 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:36.874338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fa8efdf5-191d-4be0-97a0-d61c87df2135 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:36.886007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa8efdf5-191d-4be0-97a0-d61c87df2135 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:36.886810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa8efdf5-191d-4be0-97a0-d61c87df2135 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:36.887811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa8efdf5-191d-4be0-97a0-d61c87df2135 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:36.888405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa8efdf5-191d-4be0-97a0-d61c87df2135 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:36.989395 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a8f832e8-c154-4e01-bbe7-22bc0b2f221b tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/16cb773714aa47299fa289c53ff1121f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.266223 May 28 21:04:36.990317 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 281/549] 10.222.0.33 () {58 vars in 1268 bytes} [Sat May 28 21:04:36 2022] GET /compute/v2.1/os-quota-sets/16cb773714aa47299fa289c53ff1121f/defaults => generated 371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:36.997916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d7cde85e-0c6a-4806-991f-bf0d97eee392 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:36.998992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d7cde85e-0c6a-4806-991f-bf0d97eee392 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:37.007194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d7cde85e-0c6a-4806-991f-bf0d97eee392 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:37.007654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d7cde85e-0c6a-4806-991f-bf0d97eee392 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:37.017509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d7cde85e-0c6a-4806-991f-bf0d97eee392 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:37.017509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d7cde85e-0c6a-4806-991f-bf0d97eee392 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:37.508714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d7cde85e-0c6a-4806-991f-bf0d97eee392 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:37.509299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-fa8efdf5-191d-4be0-97a0-d61c87df2135 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'services' on Instance uuid 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:37.516367 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d7cde85e-0c6a-4806-991f-bf0d97eee392 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1310 microversion: 2.1 time: 0.524871 May 28 21:04:37.527018 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 282/550] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:36 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1310 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:37.527480 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fa8efdf5-191d-4be0-97a0-d61c87df2135 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 2048 microversion: 2.25 time: 0.673913 May 28 21:04:37.528527 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 269/551] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:36 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 2048 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:37.538370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cca4fd55-0223-4a94-acf5-4abe0182afd9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:37.539424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cca4fd55-0223-4a94-acf5-4abe0182afd9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:37.544843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1ecf6963-cd1b-47d9-91f1-e23e0460cd91 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Action: 'update', calling method: .version_select at 0x7f4d6450be50>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:37.551500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cca4fd55-0223-4a94-acf5-4abe0182afd9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:37.551957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cca4fd55-0223-4a94-acf5-4abe0182afd9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:37.553347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cca4fd55-0223-4a94-acf5-4abe0182afd9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:37.553794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cca4fd55-0223-4a94-acf5-4abe0182afd9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:37.673769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ecf6963-cd1b-47d9-91f1-e23e0460cd91 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:37.674274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ecf6963-cd1b-47d9-91f1-e23e0460cd91 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:37.675080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ecf6963-cd1b-47d9-91f1-e23e0460cd91 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:37.675525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ecf6963-cd1b-47d9-91f1-e23e0460cd91 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:37.921491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cca4fd55-0223-4a94-acf5-4abe0182afd9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:37.930270 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cca4fd55-0223-4a94-acf5-4abe0182afd9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1390 microversion: 2.1 time: 0.399671 May 28 21:04:37.931082 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 270/552] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:37 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1390 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:37.941122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-588cbdc5-148e-49e5-8aab-b595c611beb7 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:37.942688 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:37.942688 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:37.947560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-588cbdc5-148e-49e5-8aab-b595c611beb7 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:37.948093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-588cbdc5-148e-49e5-8aab-b595c611beb7 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:37.949006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-588cbdc5-148e-49e5-8aab-b595c611beb7 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:37.949488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-588cbdc5-148e-49e5-8aab-b595c611beb7 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:37.982891 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-588cbdc5-148e-49e5-8aab-b595c611beb7 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.050190 May 28 21:04:37.983658 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 271/553] 10.222.0.33 () {60 vars in 1216 bytes} [Sat May 28 21:04:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:04:37.988625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-64bb4b4e-fc0f-44fb-9f9d-551f92f3a14b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:37.989546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-64bb4b4e-fc0f-44fb-9f9d-551f92f3a14b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:37.997477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64bb4b4e-fc0f-44fb-9f9d-551f92f3a14b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:37.998280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64bb4b4e-fc0f-44fb-9f9d-551f92f3a14b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:37.999277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64bb4b4e-fc0f-44fb-9f9d-551f92f3a14b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:37.999904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64bb4b4e-fc0f-44fb-9f9d-551f92f3a14b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:38.316745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-64bb4b4e-fc0f-44fb-9f9d-551f92f3a14b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:38.329575 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-64bb4b4e-fc0f-44fb-9f9d-551f92f3a14b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 200 len: 1314 microversion: 2.1 time: 0.344656 May 28 21:04:38.330537 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 272/554] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:37 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:38.352951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-69591fc5-6a34-4c2d-beba-04418369b248 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:38.352951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-69591fc5-6a34-4c2d-beba-04418369b248 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:38.354590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69591fc5-6a34-4c2d-beba-04418369b248 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:38.355118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69591fc5-6a34-4c2d-beba-04418369b248 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:38.355973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69591fc5-6a34-4c2d-beba-04418369b248 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:38.356490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69591fc5-6a34-4c2d-beba-04418369b248 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:38.477586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-69591fc5-6a34-4c2d-beba-04418369b248 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:38.493774 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-69591fc5-6a34-4c2d-beba-04418369b248 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1208 microversion: 2.1 time: 0.161819 May 28 21:04:38.498062 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 273/555] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:38 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1208 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:38.516559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9d1ca8ad-915b-49b6-9985-40d2823a4789 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:38.521760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9d1ca8ad-915b-49b6-9985-40d2823a4789 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:38.531506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d1ca8ad-915b-49b6-9985-40d2823a4789 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:38.532342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d1ca8ad-915b-49b6-9985-40d2823a4789 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:38.533481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d1ca8ad-915b-49b6-9985-40d2823a4789 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:38.534255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d1ca8ad-915b-49b6-9985-40d2823a4789 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:38.567524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:38.779978 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9d1ca8ad-915b-49b6-9985-40d2823a4789 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6/action" status: 202 len: 0 microversion: 2.25 time: 0.280109 May 28 21:04:38.781122 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 274/556] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:04:38 2022] POST /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 21:04:38.789213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-457e17ed-87b4-47d1-a5c7-737c6611524d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:38.792657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-457e17ed-87b4-47d1-a5c7-737c6611524d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:38.800312 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-457e17ed-87b4-47d1-a5c7-737c6611524d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:38.801072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-457e17ed-87b4-47d1-a5c7-737c6611524d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:38.802169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-457e17ed-87b4-47d1-a5c7-737c6611524d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:38.802811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-457e17ed-87b4-47d1-a5c7-737c6611524d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:39.161086 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1ecf6963-cd1b-47d9-91f1-e23e0460cd91 tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/16cb773714aa47299fa289c53ff1121f" status: 200 len: 329 microversion: 2.1 time: 1.632400 May 28 21:04:39.161787 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 283/557] 10.222.0.33 () {60 vars in 1262 bytes} [Sat May 28 21:04:37 2022] PUT /compute/v2.1/os-quota-sets/16cb773714aa47299fa289c53ff1121f => generated 329 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:39.179916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-91d098ea-e788-4d13-94c4-d0944c813995 req-8d9bc2f9-9fd7-47ce-99ea-7a31bb1cda9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edd95c29-a1f5-4f51-bc41-28015bfd2bec", "tag": "7b9b3936-54e0-461a-9a4b-6152d1b72738"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:39.209412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-91d098ea-e788-4d13-94c4-d0944c813995 req-8d9bc2f9-9fd7-47ce-99ea-7a31bb1cda9f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:39.209887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-91d098ea-e788-4d13-94c4-d0944c813995 req-8d9bc2f9-9fd7-47ce-99ea-7a31bb1cda9f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:39.232592 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-91d098ea-e788-4d13-94c4-d0944c813995 req-8d9bc2f9-9fd7-47ce-99ea-7a31bb1cda9f service nova] Creating event network-changed:7b9b3936-54e0-461a-9a4b-6152d1b72738 for instance edd95c29-a1f5-4f51-bc41-28015bfd2bec on nch2-master-1 May 28 21:04:39.239688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-457e17ed-87b4-47d1-a5c7-737c6611524d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:39.249116 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-457e17ed-87b4-47d1-a5c7-737c6611524d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1493 microversion: 2.1 time: 0.466312 May 28 21:04:39.259120 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-91d098ea-e788-4d13-94c4-d0944c813995 req-8d9bc2f9-9fd7-47ce-99ea-7a31bb1cda9f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076619 May 28 21:04:39.259831 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 275/558] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:38 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1493 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:39.260032 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 284/559] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:39.267370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a24e1a4e-87ee-4a90-8839-d9d8b253ea13 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:39.274316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e0f4cb53-5b81-4814-97e6-d57a04372ccb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:39.275151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e0f4cb53-5b81-4814-97e6-d57a04372ccb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:39.281254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a24e1a4e-87ee-4a90-8839-d9d8b253ea13 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:39.294485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0f4cb53-5b81-4814-97e6-d57a04372ccb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:39.295264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0f4cb53-5b81-4814-97e6-d57a04372ccb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:39.295939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a24e1a4e-87ee-4a90-8839-d9d8b253ea13 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:39.296586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a24e1a4e-87ee-4a90-8839-d9d8b253ea13 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:39.297070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0f4cb53-5b81-4814-97e6-d57a04372ccb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:39.297685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0f4cb53-5b81-4814-97e6-d57a04372ccb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:39.297900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a24e1a4e-87ee-4a90-8839-d9d8b253ea13 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:39.298500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a24e1a4e-87ee-4a90-8839-d9d8b253ea13 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:39.873409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-a24e1a4e-87ee-4a90-8839-d9d8b253ea13 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'services' on Instance uuid 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:39.901507 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a24e1a4e-87ee-4a90-8839-d9d8b253ea13 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 2053 microversion: 2.25 time: 0.639686 May 28 21:04:39.913094 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 276/560] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:39 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 2053 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:39.917147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-229593a0-96d7-4dc5-a5fd-d73a021686fa tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Action: 'update', calling method: .version_select at 0x7f4d64636e50>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:40.013952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-229593a0-96d7-4dc5-a5fd-d73a021686fa tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:40.014661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-229593a0-96d7-4dc5-a5fd-d73a021686fa tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:40.015559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-229593a0-96d7-4dc5-a5fd-d73a021686fa tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:40.016080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-229593a0-96d7-4dc5-a5fd-d73a021686fa tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:40.051308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e0f4cb53-5b81-4814-97e6-d57a04372ccb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:40.072983 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e0f4cb53-5b81-4814-97e6-d57a04372ccb tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1390 microversion: 2.1 time: 0.821239 May 28 21:04:40.082899 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 285/561] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:39 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1390 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:40.088599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:40.248338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-356740c3-7d42-4c30-97c3-0f40713272c9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:40.248847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-356740c3-7d42-4c30-97c3-0f40713272c9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:40.266731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-356740c3-7d42-4c30-97c3-0f40713272c9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:40.267179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-356740c3-7d42-4c30-97c3-0f40713272c9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:40.267965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-356740c3-7d42-4c30-97c3-0f40713272c9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:40.268407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-356740c3-7d42-4c30-97c3-0f40713272c9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:40.523934 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-356740c3-7d42-4c30-97c3-0f40713272c9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1644 microversion: 2.1 time: 0.439115 May 28 21:04:40.537920 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 286/562] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:40 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1644 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:40.543931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-45df6e59-1ff4-4235-885a-78e4d4ea7db4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:40.545046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-45df6e59-1ff4-4235-885a-78e4d4ea7db4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:40.552507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45df6e59-1ff4-4235-885a-78e4d4ea7db4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:40.553191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45df6e59-1ff4-4235-885a-78e4d4ea7db4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:40.554512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45df6e59-1ff4-4235-885a-78e4d4ea7db4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:40.556343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45df6e59-1ff4-4235-885a-78e4d4ea7db4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:40.806089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-45df6e59-1ff4-4235-885a-78e4d4ea7db4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:40.818560 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-45df6e59-1ff4-4235-885a-78e4d4ea7db4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 200 len: 1314 microversion: 2.1 time: 0.277522 May 28 21:04:40.819206 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 287/563] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:40 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:40.825219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f3df5421-ab28-4737-8cfd-d6b810e3c36f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:40.826196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f3df5421-ab28-4737-8cfd-d6b810e3c36f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:40.833145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3df5421-ab28-4737-8cfd-d6b810e3c36f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:40.838862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3df5421-ab28-4737-8cfd-d6b810e3c36f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:40.838862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3df5421-ab28-4737-8cfd-d6b810e3c36f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:40.838862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3df5421-ab28-4737-8cfd-d6b810e3c36f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:41.279114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f3df5421-ab28-4737-8cfd-d6b810e3c36f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:41.289157 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f3df5421-ab28-4737-8cfd-d6b810e3c36f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1312 microversion: 2.1 time: 0.467573 May 28 21:04:41.294685 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 288/564] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:40 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1312 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:41.308322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-097d4be0-09f3-4105-8397-01f7b54bec6d req-add2d5aa-159e-43b8-ab49-c17a973e9203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df5a24ed-101d-4ca1-a87e-e81c12b6d167", "tag": "ab017b92-2fd2-43c0-8352-ef3dbe3b47d3"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:41.328678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-097d4be0-09f3-4105-8397-01f7b54bec6d req-add2d5aa-159e-43b8-ab49-c17a973e9203 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:41.351434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-097d4be0-09f3-4105-8397-01f7b54bec6d req-add2d5aa-159e-43b8-ab49-c17a973e9203 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:41.400787 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-097d4be0-09f3-4105-8397-01f7b54bec6d req-add2d5aa-159e-43b8-ab49-c17a973e9203 service nova] Creating event network-changed:ab017b92-2fd2-43c0-8352-ef3dbe3b47d3 for instance df5a24ed-101d-4ca1-a87e-e81c12b6d167 on nch2-master-1 May 28 21:04:41.405909 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-097d4be0-09f3-4105-8397-01f7b54bec6d req-add2d5aa-159e-43b8-ab49-c17a973e9203 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109848 May 28 21:04:41.407132 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 289/565] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:41.413663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a893a681-e916-4679-81ff-446eeaf135ad tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:41.415527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a893a681-e916-4679-81ff-446eeaf135ad tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:41.424805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a893a681-e916-4679-81ff-446eeaf135ad tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:41.426117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a893a681-e916-4679-81ff-446eeaf135ad tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:41.428177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a893a681-e916-4679-81ff-446eeaf135ad tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:41.429362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a893a681-e916-4679-81ff-446eeaf135ad tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:41.779502 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a893a681-e916-4679-81ff-446eeaf135ad tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1644 microversion: 2.1 time: 0.370411 May 28 21:04:41.780685 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 290/566] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:41 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1644 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:41.786005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-017989b3-f268-4d0b-b1b5-96d8d21e3239 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:41.787460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-017989b3-f268-4d0b-b1b5-96d8d21e3239 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:41.797481 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-017989b3-f268-4d0b-b1b5-96d8d21e3239 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:41.797914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-017989b3-f268-4d0b-b1b5-96d8d21e3239 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:41.798705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-017989b3-f268-4d0b-b1b5-96d8d21e3239 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:41.799152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-017989b3-f268-4d0b-b1b5-96d8d21e3239 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:42.132240 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-229593a0-96d7-4dc5-a5fd-d73a021686fa tempest-QuotasAdminTestJSON-675682544 tempest-QuotasAdminTestJSON-675682544-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/16cb773714aa47299fa289c53ff1121f" status: 200 len: 329 microversion: 2.1 time: 2.222733 May 28 21:04:42.137813 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 277/567] 10.222.0.33 () {60 vars in 1262 bytes} [Sat May 28 21:04:39 2022] PUT /compute/v2.1/os-quota-sets/16cb773714aa47299fa289c53ff1121f => generated 329 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:42.148794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3a044c1e-aecb-4ec1-9792-eb0079eb13d9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:42.149333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3a044c1e-aecb-4ec1-9792-eb0079eb13d9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:42.156019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a044c1e-aecb-4ec1-9792-eb0079eb13d9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:42.156481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a044c1e-aecb-4ec1-9792-eb0079eb13d9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:42.159783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a044c1e-aecb-4ec1-9792-eb0079eb13d9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:42.159783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a044c1e-aecb-4ec1-9792-eb0079eb13d9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:42.422833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-017989b3-f268-4d0b-b1b5-96d8d21e3239 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'services' on Instance uuid 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:42.437412 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-017989b3-f268-4d0b-b1b5-96d8d21e3239 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 2033 microversion: 2.25 time: 0.654610 May 28 21:04:42.437740 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 291/568] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:41 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 2033 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:42.453120 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-98a51305-e464-4447-b471-1f80fd2b7ab0 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:42.454587 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:42.454587 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:42.455931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98a51305-e464-4447-b471-1f80fd2b7ab0 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:42.456434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98a51305-e464-4447-b471-1f80fd2b7ab0 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:42.457229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98a51305-e464-4447-b471-1f80fd2b7ab0 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:42.457664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98a51305-e464-4447-b471-1f80fd2b7ab0 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:42.475631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3a044c1e-aecb-4ec1-9792-eb0079eb13d9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:42.484416 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-98a51305-e464-4447-b471-1f80fd2b7ab0 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.034592 May 28 21:04:42.488925 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3a044c1e-aecb-4ec1-9792-eb0079eb13d9 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1390 microversion: 2.1 time: 0.349661 May 28 21:04:42.490437 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 292/569] 10.222.0.33 () {58 vars in 1175 bytes} [Sat May 28 21:04:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:42.497057 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 278/570] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:42 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1390 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:42.498757 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4b967d6c-d90e-483f-ae54-5223380b62ab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:42.499542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4b967d6c-d90e-483f-ae54-5223380b62ab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:42.507314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b967d6c-d90e-483f-ae54-5223380b62ab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:42.507919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b967d6c-d90e-483f-ae54-5223380b62ab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:42.508848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b967d6c-d90e-483f-ae54-5223380b62ab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:42.509614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b967d6c-d90e-483f-ae54-5223380b62ab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:42.667953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-866dfdd6-29db-48bc-9ae9-d469b8a25341 tempest-QuotaClassesAdmin257Test-1768330956 tempest-QuotaClassesAdmin257Test-1768330956-project-admin] Calling method '.version_select at 0x7f4d6460de50>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:42.668834 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:42.668834 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:04:42.680963 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-866dfdd6-29db-48bc-9ae9-d469b8a25341 tempest-QuotaClassesAdmin257Test-1768330956 tempest-QuotaClassesAdmin257Test-1768330956-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.184174 May 28 21:04:42.685926 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 279/571] 10.222.0.33 () {60 vars in 1225 bytes} [Sat May 28 21:04:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:04:42.690810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f3df1792-0020-4af1-a228-cc7ef1d60e95 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:42.699326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f3df1792-0020-4af1-a228-cc7ef1d60e95 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:42.706918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3df1792-0020-4af1-a228-cc7ef1d60e95 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:42.707382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3df1792-0020-4af1-a228-cc7ef1d60e95 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:42.709477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3df1792-0020-4af1-a228-cc7ef1d60e95 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:42.709477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3df1792-0020-4af1-a228-cc7ef1d60e95 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:42.825672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4b967d6c-d90e-483f-ae54-5223380b62ab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:42.842004 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4b967d6c-d90e-483f-ae54-5223380b62ab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 200 len: 1314 microversion: 2.1 time: 0.346197 May 28 21:04:42.843236 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 293/572] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:42 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:42.848294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-54bbdafe-d1b4-45f0-8463-509a433b9734 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:42.849979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-54bbdafe-d1b4-45f0-8463-509a433b9734 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:42.870829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54bbdafe-d1b4-45f0-8463-509a433b9734 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:42.873799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54bbdafe-d1b4-45f0-8463-509a433b9734 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:42.876698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54bbdafe-d1b4-45f0-8463-509a433b9734 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:42.877234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54bbdafe-d1b4-45f0-8463-509a433b9734 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:42.935283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-54bbdafe-d1b4-45f0-8463-509a433b9734 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'flavor' on Instance uuid 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:42.962999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-54bbdafe-d1b4-45f0-8463-509a433b9734 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Going to try to live migrate instance to nch1-master-1 {{(pid=143128) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 21:04:43.104919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f3df1792-0020-4af1-a228-cc7ef1d60e95 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:43.125663 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f3df1792-0020-4af1-a228-cc7ef1d60e95 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1312 microversion: 2.1 time: 0.438538 May 28 21:04:43.130834 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 280/573] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:42 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1312 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:43.143643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1376efae-6964-450f-a593-f17d606d0982 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:43.147639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1376efae-6964-450f-a593-f17d606d0982 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:43.162968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1376efae-6964-450f-a593-f17d606d0982 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:43.164157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1376efae-6964-450f-a593-f17d606d0982 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:43.165135 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1376efae-6964-450f-a593-f17d606d0982 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:43.166196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1376efae-6964-450f-a593-f17d606d0982 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:43.201084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-1376efae-6964-450f-a593-f17d606d0982 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lazy-loading 'flavor' on Instance uuid 94133e8e-365a-46fa-8755-5dc32d37dd83 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:04:43.216284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1376efae-6964-450f-a593-f17d606d0982 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Going to try to live migrate instance to nch2-master-1 {{(pid=143129) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 21:04:46.619904 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-54bbdafe-d1b4-45f0-8463-509a433b9734 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6/action" status: 202 len: 0 microversion: 2.25 time: 3.775046 May 28 21:04:46.627319 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 294/574] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:04:42 2022] POST /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6/action => generated 0 bytes in 3777 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 21:04:46.637809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0840d22c-5cb1-4e5c-ac19-fa1606aff319 tempest-QuotaClassesAdmin257Test-1768330956 tempest-QuotaClassesAdmin257Test-1768330956-project-admin] Action: 'update', calling method: .version_select at 0x7f4d64545430>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:46.639467 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:46.639467 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:46.653935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:46.721978 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1376efae-6964-450f-a593-f17d606d0982 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83/action" status: 202 len: 0 microversion: 2.1 time: 3.587861 May 28 21:04:46.724507 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 281/575] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:04:43 2022] POST /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83/action => generated 0 bytes in 3590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:04:46.727741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d3a78f65-1780-4b0d-b284-f99a7846b0f3 req-c1ad3355-bab2-4746-af7e-c3a971ce6750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "569b037d-ace0-4ce6-8182-ddac69d2b2e2", "tag": "04dfc232-ea06-4928-bc0e-827e83fc3bda"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:46.744870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d3a78f65-1780-4b0d-b284-f99a7846b0f3 req-c1ad3355-bab2-4746-af7e-c3a971ce6750 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:46.745452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d3a78f65-1780-4b0d-b284-f99a7846b0f3 req-c1ad3355-bab2-4746-af7e-c3a971ce6750 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:46.777897 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d3a78f65-1780-4b0d-b284-f99a7846b0f3 req-c1ad3355-bab2-4746-af7e-c3a971ce6750 service nova] Creating event network-changed:04dfc232-ea06-4928-bc0e-827e83fc3bda for instance 569b037d-ace0-4ce6-8182-ddac69d2b2e2 on nch1-master-1 May 28 21:04:46.791329 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d3a78f65-1780-4b0d-b284-f99a7846b0f3 req-c1ad3355-bab2-4746-af7e-c3a971ce6750 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067424 May 28 21:04:46.797166 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 282/576] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:46.805253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0415d1c5-d6cc-46cd-8fc7-4924bd4bd16f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:46.806944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0415d1c5-d6cc-46cd-8fc7-4924bd4bd16f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:46.816050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0415d1c5-d6cc-46cd-8fc7-4924bd4bd16f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:46.821593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0415d1c5-d6cc-46cd-8fc7-4924bd4bd16f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:46.821593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0415d1c5-d6cc-46cd-8fc7-4924bd4bd16f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:46.821593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0415d1c5-d6cc-46cd-8fc7-4924bd4bd16f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:47.106507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=84,nova_cell0:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:47.270536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0415d1c5-d6cc-46cd-8fc7-4924bd4bd16f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:47.287673 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0415d1c5-d6cc-46cd-8fc7-4924bd4bd16f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1390 microversion: 2.1 time: 0.482651 May 28 21:04:47.288583 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 283/577] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:46 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1390 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:47.297905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-f4cd6609-ad7d-4c6f-978b-f596f5ab0e84 req-48a5ccaf-466f-402e-b8e6-d4dba14621e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11", "tag": "a8cbb2e6-44eb-497a-b75f-b22790446b3f"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:47.320704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f4cd6609-ad7d-4c6f-978b-f596f5ab0e84 req-48a5ccaf-466f-402e-b8e6-d4dba14621e1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:47.321197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f4cd6609-ad7d-4c6f-978b-f596f5ab0e84 req-48a5ccaf-466f-402e-b8e6-d4dba14621e1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:47.347432 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-f4cd6609-ad7d-4c6f-978b-f596f5ab0e84 req-48a5ccaf-466f-402e-b8e6-d4dba14621e1 service nova] Creating event network-changed:a8cbb2e6-44eb-497a-b75f-b22790446b3f for instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 on nch2-master-1 May 28 21:04:47.355880 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-f4cd6609-ad7d-4c6f-978b-f596f5ab0e84 req-48a5ccaf-466f-402e-b8e6-d4dba14621e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065844 May 28 21:04:47.357312 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 284/578] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:47.364851 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d206cdfb-d437-48a2-b984-de857ea952af tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:47.365912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d206cdfb-d437-48a2-b984-de857ea952af tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:47.374101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d206cdfb-d437-48a2-b984-de857ea952af tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:47.375465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d206cdfb-d437-48a2-b984-de857ea952af tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:47.378201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d206cdfb-d437-48a2-b984-de857ea952af tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:47.379125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d206cdfb-d437-48a2-b984-de857ea952af tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:47.410068 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0840d22c-5cb1-4e5c-ac19-fa1606aff319 tempest-QuotaClassesAdmin257Test-1768330956 tempest-QuotaClassesAdmin257Test-1768330956-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.788052 May 28 21:04:47.411001 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 295/579] 10.222.0.33 () {62 vars in 1246 bytes} [Sat May 28 21:04:46 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:04:47.415710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9fa3e811-934f-4331-825d-103cb947774e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:47.416335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9fa3e811-934f-4331-825d-103cb947774e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:47.429109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9fa3e811-934f-4331-825d-103cb947774e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:47.429574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9fa3e811-934f-4331-825d-103cb947774e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:47.430434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9fa3e811-934f-4331-825d-103cb947774e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:47.430925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9fa3e811-934f-4331-825d-103cb947774e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:47.932980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d206cdfb-d437-48a2-b984-de857ea952af tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:47.944119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9fa3e811-934f-4331-825d-103cb947774e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:47.949303 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d206cdfb-d437-48a2-b984-de857ea952af tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 200 len: 1314 microversion: 2.1 time: 0.590000 May 28 21:04:47.958987 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 285/580] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:47 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:47.963264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:47.964111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-794c8213-7a93-42f7-993c-225e2a224416 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:47.964746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-794c8213-7a93-42f7-993c-225e2a224416 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:47.967428 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9fa3e811-934f-4331-825d-103cb947774e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1312 microversion: 2.1 time: 0.555353 May 28 21:04:47.981359 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 296/581] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:47 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1312 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:47.984241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-794c8213-7a93-42f7-993c-225e2a224416 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:47.984710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-794c8213-7a93-42f7-993c-225e2a224416 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:47.990428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-794c8213-7a93-42f7-993c-225e2a224416 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:47.990428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-794c8213-7a93-42f7-993c-225e2a224416 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:47.991146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-412c5c38-0a67-4c5c-a851-c16c629423ca req-0ce3cbff-1caf-498d-b16e-36acc88c16b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd95c29-a1f5-4f51-bc41-28015bfd2bec", "name": "network-vif-plugged", "status": "completed", "tag": "7b9b3936-54e0-461a-9a4b-6152d1b72738"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:48.004400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-412c5c38-0a67-4c5c-a851-c16c629423ca req-0ce3cbff-1caf-498d-b16e-36acc88c16b9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:48.005394 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-412c5c38-0a67-4c5c-a851-c16c629423ca req-0ce3cbff-1caf-498d-b16e-36acc88c16b9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:48.021879 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-412c5c38-0a67-4c5c-a851-c16c629423ca req-0ce3cbff-1caf-498d-b16e-36acc88c16b9 service nova] Creating event network-vif-plugged:7b9b3936-54e0-461a-9a4b-6152d1b72738 for instance edd95c29-a1f5-4f51-bc41-28015bfd2bec on nch2-master-1 May 28 21:04:48.032005 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-412c5c38-0a67-4c5c-a851-c16c629423ca req-0ce3cbff-1caf-498d-b16e-36acc88c16b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048159 May 28 21:04:48.033684 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 297/582] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:48.045069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2e8968d2-b0b9-4ac4-9b12-307fef0ecb89 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:48.046301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2e8968d2-b0b9-4ac4-9b12-307fef0ecb89 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:48.059505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e8968d2-b0b9-4ac4-9b12-307fef0ecb89 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:48.060537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e8968d2-b0b9-4ac4-9b12-307fef0ecb89 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:48.061760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e8968d2-b0b9-4ac4-9b12-307fef0ecb89 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:48.062476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e8968d2-b0b9-4ac4-9b12-307fef0ecb89 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:48.974504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2e8968d2-b0b9-4ac4-9b12-307fef0ecb89 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:48.978082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-794c8213-7a93-42f7-993c-225e2a224416 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:48.987212 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2e8968d2-b0b9-4ac4-9b12-307fef0ecb89 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1503 microversion: 2.1 time: 0.949705 May 28 21:04:48.991152 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 298/583] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:48 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1503 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:48.992794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-794c8213-7a93-42f7-993c-225e2a224416 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:48.998421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-794c8213-7a93-42f7-993c-225e2a224416 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:49.001720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-74169f9c-17f4-4b49-ac82-ab96227e15a1 tempest-QuotaClassesAdmin257Test-1768330956 tempest-QuotaClassesAdmin257Test-1768330956-project-admin] Calling method '.version_select at 0x7f4d646d8ca0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:49.002055 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-794c8213-7a93-42f7-993c-225e2a224416 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1566 microversion: 2.25 time: 1.041691 May 28 21:04:49.002434 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 286/584] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:47 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1566 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:49.003648 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:49.003648 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:49.016120 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-74169f9c-17f4-4b49-ac82-ab96227e15a1 tempest-QuotaClassesAdmin257Test-1768330956 tempest-QuotaClassesAdmin257Test-1768330956-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.023374 May 28 21:04:49.017988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-28355c76-0155-4f88-90b1-99ab49af1069 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:49.023486 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 299/585] 10.222.0.33 () {60 vars in 1225 bytes} [Sat May 28 21:04:48 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:04:49.023623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-28355c76-0155-4f88-90b1-99ab49af1069 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:49.028616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d61df314-64e1-463c-b170-42b533630d0b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:49.029585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d61df314-64e1-463c-b170-42b533630d0b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:49.030620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28355c76-0155-4f88-90b1-99ab49af1069 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:49.031154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28355c76-0155-4f88-90b1-99ab49af1069 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:49.034186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28355c76-0155-4f88-90b1-99ab49af1069 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:49.034718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28355c76-0155-4f88-90b1-99ab49af1069 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:49.038666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d61df314-64e1-463c-b170-42b533630d0b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:49.039400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d61df314-64e1-463c-b170-42b533630d0b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:49.040478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d61df314-64e1-463c-b170-42b533630d0b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:49.041120 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d61df314-64e1-463c-b170-42b533630d0b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:49.432287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-28355c76-0155-4f88-90b1-99ab49af1069 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:49.447955 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-28355c76-0155-4f88-90b1-99ab49af1069 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1390 microversion: 2.1 time: 0.433866 May 28 21:04:49.448881 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 287/586] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:49 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1390 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:49.454768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-362d4a9f-5258-4162-b644-69e0c460cc86 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:49.455598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-362d4a9f-5258-4162-b644-69e0c460cc86 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:49.462533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-362d4a9f-5258-4162-b644-69e0c460cc86 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:49.464664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-362d4a9f-5258-4162-b644-69e0c460cc86 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:49.467421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-362d4a9f-5258-4162-b644-69e0c460cc86 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:49.468123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-362d4a9f-5258-4162-b644-69e0c460cc86 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:49.481011 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d61df314-64e1-463c-b170-42b533630d0b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:49.501152 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d61df314-64e1-463c-b170-42b533630d0b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 200 len: 1314 microversion: 2.1 time: 0.480184 May 28 21:04:49.502935 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 300/587] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:49 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:49.514716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dae79ba3-3f14-4064-9282-7641af84bd5e tempest-QuotaClassesAdmin257Test-1768330956 tempest-QuotaClassesAdmin257Test-1768330956-project-admin] Action: 'update', calling method: .version_select at 0x7f4d647325e0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:49.516785 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:04:49.516785 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:04:49.715024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-362d4a9f-5258-4162-b644-69e0c460cc86 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:49.726621 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-362d4a9f-5258-4162-b644-69e0c460cc86 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1312 microversion: 2.1 time: 0.274275 May 28 21:04:49.728339 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 288/588] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:49 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1312 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:49.912343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-371436462", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:49.974688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:04:50.034260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=21 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:50.203821 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dae79ba3-3f14-4064-9282-7641af84bd5e tempest-QuotaClassesAdmin257Test-1768330956 tempest-QuotaClassesAdmin257Test-1768330956-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.693624 May 28 21:04:50.204298 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 301/589] 10.222.0.33 () {62 vars in 1246 bytes} [Sat May 28 21:04:49 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:04:50.209168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-701f602b-ab0a-4b1c-8c86-ff9f21c88150 req-485927d1-b700-4364-a990-6020ef61ab4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "738ac5a7-1dc6-430e-a5dc-f08d9c5faca6", "name": "network-vif-unplugged", "status": "completed", "tag": "0b49f1a2-af84-4fdb-9e25-802752a26503"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:50.267802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-701f602b-ab0a-4b1c-8c86-ff9f21c88150 req-485927d1-b700-4364-a990-6020ef61ab4d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:50.268251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-701f602b-ab0a-4b1c-8c86-ff9f21c88150 req-485927d1-b700-4364-a990-6020ef61ab4d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:50.304085 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-701f602b-ab0a-4b1c-8c86-ff9f21c88150 req-485927d1-b700-4364-a990-6020ef61ab4d service nova] Creating event network-vif-unplugged:0b49f1a2-af84-4fdb-9e25-802752a26503 for instance 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 on nch2-master-1 May 28 21:04:50.319223 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-701f602b-ab0a-4b1c-8c86-ff9f21c88150 req-485927d1-b700-4364-a990-6020ef61ab4d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111699 May 28 21:04:50.322105 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 302/590] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:50.337536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a28b2eb7-5d12-4836-b740-e66d9f4e90b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:50.339414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a28b2eb7-5d12-4836-b740-e66d9f4e90b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:50.356048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a28b2eb7-5d12-4836-b740-e66d9f4e90b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:50.356705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a28b2eb7-5d12-4836-b740-e66d9f4e90b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:50.358722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a28b2eb7-5d12-4836-b740-e66d9f4e90b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:50.361287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a28b2eb7-5d12-4836-b740-e66d9f4e90b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:50.405136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:04:50.405678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:04:50.406397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:04:50.406956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:04:50.407554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:04:50.424781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=89 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:50.428628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:50.430113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:50.434054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:50.435923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:50.489921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Getting quotas for project 8058694a4ecb467783677e687e16ecb6. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:04:50.500150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Getting quotas for user 3b044baceddf49219485bd14aa914e35 and project 8058694a4ecb467783677e687e16ecb6. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:04:50.526592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:04:50.529767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:04:50.578265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a28b2eb7-5d12-4836-b740-e66d9f4e90b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:50.589986 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a28b2eb7-5d12-4836-b740-e66d9f4e90b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1503 microversion: 2.1 time: 0.265566 May 28 21:04:50.590859 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 303/591] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:50 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1503 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:50.595613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a75c9d02-6788-4ddb-b600-7aa0734bcd06 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:50.596418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a75c9d02-6788-4ddb-b600-7aa0734bcd06 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:50.603099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a75c9d02-6788-4ddb-b600-7aa0734bcd06 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:50.603833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a75c9d02-6788-4ddb-b600-7aa0734bcd06 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:50.604630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a75c9d02-6788-4ddb-b600-7aa0734bcd06 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:50.605088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a75c9d02-6788-4ddb-b600-7aa0734bcd06 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:50.688031 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7cfb61b3-3f95-4679-9709-eb6b477673b2 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.956236 May 28 21:04:50.688689 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 289/592] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:04:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:04:50.722954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c5a4ac5e-4894-4d27-8c8a-2fe9aac8decd tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:50.723925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c5a4ac5e-4894-4d27-8c8a-2fe9aac8decd tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:50.733314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5a4ac5e-4894-4d27-8c8a-2fe9aac8decd tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:50.733782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5a4ac5e-4894-4d27-8c8a-2fe9aac8decd tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:50.734623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5a4ac5e-4894-4d27-8c8a-2fe9aac8decd tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:50.735064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5a4ac5e-4894-4d27-8c8a-2fe9aac8decd tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:51.065429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a75c9d02-6788-4ddb-b600-7aa0734bcd06 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:51.078663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a75c9d02-6788-4ddb-b600-7aa0734bcd06 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:51.080602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a75c9d02-6788-4ddb-b600-7aa0734bcd06 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:51.082119 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a75c9d02-6788-4ddb-b600-7aa0734bcd06 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1566 microversion: 2.25 time: 0.490244 May 28 21:04:51.093179 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 304/593] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:50 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1566 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:51.099980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3f416fbf-cc9a-4654-8c0c-8574ee478127 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:51.100990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3f416fbf-cc9a-4654-8c0c-8574ee478127 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:51.112289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f416fbf-cc9a-4654-8c0c-8574ee478127 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:51.113206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f416fbf-cc9a-4654-8c0c-8574ee478127 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:51.114098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f416fbf-cc9a-4654-8c0c-8574ee478127 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:51.115368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f416fbf-cc9a-4654-8c0c-8574ee478127 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:51.194443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c5a4ac5e-4894-4d27-8c8a-2fe9aac8decd tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:51.218182 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c5a4ac5e-4894-4d27-8c8a-2fe9aac8decd tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1390 microversion: 2.1 time: 0.523649 May 28 21:04:51.219904 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 290/594] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:50 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1390 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:51.225971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ee980392-019a-4af9-b2d7-1dce1fce7fbc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:51.227230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ee980392-019a-4af9-b2d7-1dce1fce7fbc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:51.231239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:UPDATE=14,nova_api:SELECT=70,nova_api:INSERT=16 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:51.379289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ee980392-019a-4af9-b2d7-1dce1fce7fbc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:51.388948 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ee980392-019a-4af9-b2d7-1dce1fce7fbc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1221 microversion: 2.1 time: 0.167740 May 28 21:04:51.390275 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 291/595] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:51 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1221 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:51.403930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a49ce6f4-038d-4f0d-b38a-28d7083b9f2e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:51.404657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a49ce6f4-038d-4f0d-b38a-28d7083b9f2e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:51.413546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a49ce6f4-038d-4f0d-b38a-28d7083b9f2e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:51.414159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a49ce6f4-038d-4f0d-b38a-28d7083b9f2e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:51.414951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a49ce6f4-038d-4f0d-b38a-28d7083b9f2e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:51.415397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a49ce6f4-038d-4f0d-b38a-28d7083b9f2e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:51.423994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3f416fbf-cc9a-4654-8c0c-8574ee478127 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:51.433959 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3f416fbf-cc9a-4654-8c0c-8574ee478127 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 200 len: 1314 microversion: 2.1 time: 0.337753 May 28 21:04:51.457672 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 305/596] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:51 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:51.463951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-39d7fd77-9249-4c75-9f34-53908b413a6d req-643ebef0-a5c3-4a5b-8e4c-a33eba9becb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5a24ed-101d-4ca1-a87e-e81c12b6d167", "name": "network-vif-plugged", "status": "completed", "tag": "ab017b92-2fd2-43c0-8352-ef3dbe3b47d3"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:51.494156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-39d7fd77-9249-4c75-9f34-53908b413a6d req-643ebef0-a5c3-4a5b-8e4c-a33eba9becb9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:51.494879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-39d7fd77-9249-4c75-9f34-53908b413a6d req-643ebef0-a5c3-4a5b-8e4c-a33eba9becb9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:51.507400 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-39d7fd77-9249-4c75-9f34-53908b413a6d req-643ebef0-a5c3-4a5b-8e4c-a33eba9becb9 service nova] Creating event network-vif-plugged:ab017b92-2fd2-43c0-8352-ef3dbe3b47d3 for instance df5a24ed-101d-4ca1-a87e-e81c12b6d167 on nch2-master-1 May 28 21:04:51.513685 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-39d7fd77-9249-4c75-9f34-53908b413a6d req-643ebef0-a5c3-4a5b-8e4c-a33eba9becb9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054394 May 28 21:04:51.514890 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 306/597] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:51.608501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bf98b485-8fff-40d2-910b-dd2a23dd1d4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:51.609222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bf98b485-8fff-40d2-910b-dd2a23dd1d4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:51.618366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf98b485-8fff-40d2-910b-dd2a23dd1d4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:51.623507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf98b485-8fff-40d2-910b-dd2a23dd1d4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:51.624845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf98b485-8fff-40d2-910b-dd2a23dd1d4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:51.625457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf98b485-8fff-40d2-910b-dd2a23dd1d4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:51.707840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a49ce6f4-038d-4f0d-b38a-28d7083b9f2e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:51.712074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:51.753824 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a49ce6f4-038d-4f0d-b38a-28d7083b9f2e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1312 microversion: 2.1 time: 0.359959 May 28 21:04:51.760588 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 292/598] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:51 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1312 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:52.018551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bf98b485-8fff-40d2-910b-dd2a23dd1d4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:52.026984 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bf98b485-8fff-40d2-910b-dd2a23dd1d4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1503 microversion: 2.1 time: 0.423508 May 28 21:04:52.027645 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 307/599] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:51 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1503 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:52.104071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e73aa1ff-e588-4ae8-b286-a3812f89a825 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:52.105074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e73aa1ff-e588-4ae8-b286-a3812f89a825 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:52.116186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e73aa1ff-e588-4ae8-b286-a3812f89a825 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:52.117310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e73aa1ff-e588-4ae8-b286-a3812f89a825 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:52.118713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e73aa1ff-e588-4ae8-b286-a3812f89a825 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:52.119593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e73aa1ff-e588-4ae8-b286-a3812f89a825 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:52.235271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-39c61d69-766a-4ead-bd9a-85f8eb321b39 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:52.235902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-39c61d69-766a-4ead-bd9a-85f8eb321b39 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:52.249443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39c61d69-766a-4ead-bd9a-85f8eb321b39 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:52.249914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39c61d69-766a-4ead-bd9a-85f8eb321b39 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:52.250695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39c61d69-766a-4ead-bd9a-85f8eb321b39 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:52.251137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39c61d69-766a-4ead-bd9a-85f8eb321b39 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:52.428930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e73aa1ff-e588-4ae8-b286-a3812f89a825 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:52.450415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e73aa1ff-e588-4ae8-b286-a3812f89a825 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:52.453258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e73aa1ff-e588-4ae8-b286-a3812f89a825 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:52.457368 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e73aa1ff-e588-4ae8-b286-a3812f89a825 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1566 microversion: 2.25 time: 0.361400 May 28 21:04:52.457981 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 293/600] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:52 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1566 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:52.465984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=9 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:52.484700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-a030d1d0-cf97-40e4-890b-9604c8d165c4 req-e231ec54-0036-4ef7-839a-3ded1c9d75fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94133e8e-365a-46fa-8755-5dc32d37dd83", "name": "network-vif-unplugged", "status": "completed", "tag": "302e794d-9be0-4dec-a52e-1c0380a7606a"}, {"name": "network-changed", "server_uuid": "738ac5a7-1dc6-430e-a5dc-f08d9c5faca6", "tag": "0b49f1a2-af84-4fdb-9e25-802752a26503"}, {"name": "network-changed", "server_uuid": "94133e8e-365a-46fa-8755-5dc32d37dd83", "tag": "302e794d-9be0-4dec-a52e-1c0380a7606a"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:52.499308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a030d1d0-cf97-40e4-890b-9604c8d165c4 req-e231ec54-0036-4ef7-839a-3ded1c9d75fe service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:52.499910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a030d1d0-cf97-40e4-890b-9604c8d165c4 req-e231ec54-0036-4ef7-839a-3ded1c9d75fe service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:52.509042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-39c61d69-766a-4ead-bd9a-85f8eb321b39 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:52.521730 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-39c61d69-766a-4ead-bd9a-85f8eb321b39 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1390 microversion: 2.1 time: 0.290420 May 28 21:04:52.536118 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 308/601] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:52 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1390 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:04:52.541427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c9bf43d6-1b5e-4489-8795-0be5dd7237ba tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:52.542422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c9bf43d6-1b5e-4489-8795-0be5dd7237ba tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:52.544295 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a030d1d0-cf97-40e4-890b-9604c8d165c4 req-e231ec54-0036-4ef7-839a-3ded1c9d75fe service nova] Creating event network-vif-unplugged:302e794d-9be0-4dec-a52e-1c0380a7606a for instance 94133e8e-365a-46fa-8755-5dc32d37dd83 on nch1-master-1 May 28 21:04:52.547849 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a030d1d0-cf97-40e4-890b-9604c8d165c4 req-e231ec54-0036-4ef7-839a-3ded1c9d75fe service nova] Creating event network-changed:0b49f1a2-af84-4fdb-9e25-802752a26503 for instance 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 on nch2-master-1 May 28 21:04:52.549312 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a030d1d0-cf97-40e4-890b-9604c8d165c4 req-e231ec54-0036-4ef7-839a-3ded1c9d75fe service nova] Creating event network-changed:302e794d-9be0-4dec-a52e-1c0380a7606a for instance 94133e8e-365a-46fa-8755-5dc32d37dd83 on nch1-master-1 May 28 21:04:52.551090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9bf43d6-1b5e-4489-8795-0be5dd7237ba tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:52.551551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9bf43d6-1b5e-4489-8795-0be5dd7237ba tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:52.552951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9bf43d6-1b5e-4489-8795-0be5dd7237ba tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:52.553500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9bf43d6-1b5e-4489-8795-0be5dd7237ba tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:52.563294 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-a030d1d0-cf97-40e4-890b-9604c8d165c4 req-e231ec54-0036-4ef7-839a-3ded1c9d75fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.088582 May 28 21:04:52.564669 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 294/602] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:52.575761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7903fd85-63eb-4838-b34f-8ba5d282bc71 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:52.576855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7903fd85-63eb-4838-b34f-8ba5d282bc71 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:52.594262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7903fd85-63eb-4838-b34f-8ba5d282bc71 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:52.594262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7903fd85-63eb-4838-b34f-8ba5d282bc71 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:52.595068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7903fd85-63eb-4838-b34f-8ba5d282bc71 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:52.595508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7903fd85-63eb-4838-b34f-8ba5d282bc71 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:52.760145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c9bf43d6-1b5e-4489-8795-0be5dd7237ba tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:52.771731 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c9bf43d6-1b5e-4489-8795-0be5dd7237ba tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1225 microversion: 2.1 time: 0.233538 May 28 21:04:52.781022 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 309/603] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:52 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1225 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:52.782564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3e795f14-4042-40e5-9313-626c34a8bbc7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:52.783354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3e795f14-4042-40e5-9313-626c34a8bbc7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:52.795738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e795f14-4042-40e5-9313-626c34a8bbc7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:52.796358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e795f14-4042-40e5-9313-626c34a8bbc7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:52.797260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e795f14-4042-40e5-9313-626c34a8bbc7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:52.797860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e795f14-4042-40e5-9313-626c34a8bbc7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:53.051835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7903fd85-63eb-4838-b34f-8ba5d282bc71 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:53.062936 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7903fd85-63eb-4838-b34f-8ba5d282bc71 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 200 len: 1314 microversion: 2.1 time: 0.496943 May 28 21:04:53.068267 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 295/604] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:52 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:53.072780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f33c73c4-5322-43ef-add6-ac07cc18aee5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:53.073936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f33c73c4-5322-43ef-add6-ac07cc18aee5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:53.086280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f33c73c4-5322-43ef-add6-ac07cc18aee5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:53.087221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f33c73c4-5322-43ef-add6-ac07cc18aee5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:53.090109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f33c73c4-5322-43ef-add6-ac07cc18aee5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:53.090853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f33c73c4-5322-43ef-add6-ac07cc18aee5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:53.194455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3e795f14-4042-40e5-9313-626c34a8bbc7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:53.206990 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3e795f14-4042-40e5-9313-626c34a8bbc7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1312 microversion: 2.1 time: 0.429335 May 28 21:04:53.211658 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 310/605] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:52 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1312 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:53.275072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f33c73c4-5322-43ef-add6-ac07cc18aee5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:53.283684 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f33c73c4-5322-43ef-add6-ac07cc18aee5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1503 microversion: 2.1 time: 0.216221 May 28 21:04:53.284998 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 296/606] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:53 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:53.476835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0382d838-bf27-499c-85f5-6b219f403000 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:53.478214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0382d838-bf27-499c-85f5-6b219f403000 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:53.489074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0382d838-bf27-499c-85f5-6b219f403000 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:53.491210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0382d838-bf27-499c-85f5-6b219f403000 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:53.492257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0382d838-bf27-499c-85f5-6b219f403000 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:53.494966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0382d838-bf27-499c-85f5-6b219f403000 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:53.543488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-61ed213e-6c03-4f78-9711-37db2b28f7d0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:53.548475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-61ed213e-6c03-4f78-9711-37db2b28f7d0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:53.561819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61ed213e-6c03-4f78-9711-37db2b28f7d0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:53.566584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61ed213e-6c03-4f78-9711-37db2b28f7d0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:53.568329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61ed213e-6c03-4f78-9711-37db2b28f7d0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:53.569010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61ed213e-6c03-4f78-9711-37db2b28f7d0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:54.384964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0382d838-bf27-499c-85f5-6b219f403000 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:54.405276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0382d838-bf27-499c-85f5-6b219f403000 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:54.407377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0382d838-bf27-499c-85f5-6b219f403000 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:54.409590 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0382d838-bf27-499c-85f5-6b219f403000 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1566 microversion: 2.25 time: 0.938209 May 28 21:04:54.410714 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 311/607] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:53 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1566 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:54.425951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-35a5ea31-3364-47b9-99ff-1d2f282d84e3 req-377a85a5-449f-4d53-af33-0554295d0201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11", "name": "network-vif-plugged", "status": "completed", "tag": "a8cbb2e6-44eb-497a-b75f-b22790446b3f"}, {"server_uuid": "569b037d-ace0-4ce6-8182-ddac69d2b2e2", "name": "network-vif-plugged", "status": "completed", "tag": "04dfc232-ea06-4928-bc0e-827e83fc3bda"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:54.437354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-35a5ea31-3364-47b9-99ff-1d2f282d84e3 req-377a85a5-449f-4d53-af33-0554295d0201 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:54.437905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-35a5ea31-3364-47b9-99ff-1d2f282d84e3 req-377a85a5-449f-4d53-af33-0554295d0201 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:54.442077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-61ed213e-6c03-4f78-9711-37db2b28f7d0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:54.453701 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-35a5ea31-3364-47b9-99ff-1d2f282d84e3 req-377a85a5-449f-4d53-af33-0554295d0201 service nova] Creating event network-vif-plugged:a8cbb2e6-44eb-497a-b75f-b22790446b3f for instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 on nch2-master-1 May 28 21:04:54.454634 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-35a5ea31-3364-47b9-99ff-1d2f282d84e3 req-377a85a5-449f-4d53-af33-0554295d0201 service nova] Creating event network-vif-plugged:04dfc232-ea06-4928-bc0e-827e83fc3bda for instance 569b037d-ace0-4ce6-8182-ddac69d2b2e2 on nch1-master-1 May 28 21:04:54.461034 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-61ed213e-6c03-4f78-9711-37db2b28f7d0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1390 microversion: 2.1 time: 0.921063 May 28 21:04:54.463690 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 297/608] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:53 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1390 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:54.465314 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-35a5ea31-3364-47b9-99ff-1d2f282d84e3 req-377a85a5-449f-4d53-af33-0554295d0201 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052136 May 28 21:04:54.466425 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 312/609] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:54.475695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4ac63fe8-e6c8-4639-96ed-627c9903244e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:54.476367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4ac63fe8-e6c8-4639-96ed-627c9903244e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:54.494585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6ae957e3-cb6f-4a06-80d1-a80ceb4b4e3a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:54.495475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6ae957e3-cb6f-4a06-80d1-a80ceb4b4e3a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:54.514611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ae957e3-cb6f-4a06-80d1-a80ceb4b4e3a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:54.515790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ae957e3-cb6f-4a06-80d1-a80ceb4b4e3a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:54.517908 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ae957e3-cb6f-4a06-80d1-a80ceb4b4e3a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:54.518299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ac63fe8-e6c8-4639-96ed-627c9903244e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:54.518612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ae957e3-cb6f-4a06-80d1-a80ceb4b4e3a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:54.523370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ac63fe8-e6c8-4639-96ed-627c9903244e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:54.524386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ac63fe8-e6c8-4639-96ed-627c9903244e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:54.524853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ac63fe8-e6c8-4639-96ed-627c9903244e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:54.687647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4ac63fe8-e6c8-4639-96ed-627c9903244e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:54.700054 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4ac63fe8-e6c8-4639-96ed-627c9903244e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1279 microversion: 2.1 time: 0.234749 May 28 21:04:54.703897 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 298/610] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:54 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1279 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:54.711324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-480c87a1-5a37-4b8c-996f-14a237e325e9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:54.712208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-480c87a1-5a37-4b8c-996f-14a237e325e9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:54.721036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-480c87a1-5a37-4b8c-996f-14a237e325e9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:54.721933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-480c87a1-5a37-4b8c-996f-14a237e325e9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:54.723112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-480c87a1-5a37-4b8c-996f-14a237e325e9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:54.724875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-480c87a1-5a37-4b8c-996f-14a237e325e9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:54.850855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6ae957e3-cb6f-4a06-80d1-a80ceb4b4e3a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:54.858754 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6ae957e3-cb6f-4a06-80d1-a80ceb4b4e3a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 200 len: 1463 microversion: 2.1 time: 0.390991 May 28 21:04:54.859333 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 313/611] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:54 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 1463 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:54.865923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8523b714-a99d-4e4b-8c6e-237afbddf149 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:54.866552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8523b714-a99d-4e4b-8c6e-237afbddf149 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:54.877067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8523b714-a99d-4e4b-8c6e-237afbddf149 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:54.877521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8523b714-a99d-4e4b-8c6e-237afbddf149 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:54.880534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8523b714-a99d-4e4b-8c6e-237afbddf149 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:54.880534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8523b714-a99d-4e4b-8c6e-237afbddf149 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:55.078852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-480c87a1-5a37-4b8c-996f-14a237e325e9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:55.089683 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-480c87a1-5a37-4b8c-996f-14a237e325e9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1312 microversion: 2.1 time: 0.383081 May 28 21:04:55.094332 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 299/612] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:54 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1312 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:55.102722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-46f57837-ba9d-4cf1-b3a1-8889583560c1 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:55.104119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-46f57837-ba9d-4cf1-b3a1-8889583560c1 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:55.113548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-46f57837-ba9d-4cf1-b3a1-8889583560c1 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:55.114463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-46f57837-ba9d-4cf1-b3a1-8889583560c1 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:55.115521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-46f57837-ba9d-4cf1-b3a1-8889583560c1 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:55.116941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-46f57837-ba9d-4cf1-b3a1-8889583560c1 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:55.155056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8523b714-a99d-4e4b-8c6e-237afbddf149 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:55.168872 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8523b714-a99d-4e4b-8c6e-237afbddf149 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1503 microversion: 2.1 time: 0.307730 May 28 21:04:55.169803 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 314/613] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:54 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:55.305131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-46f57837-ba9d-4cf1-b3a1-8889583560c1 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:55.323431 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-46f57837-ba9d-4cf1-b3a1-8889583560c1 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1463 microversion: 2.1 time: 0.227197 May 28 21:04:55.324175 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 300/614] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:55 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1463 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:55.429223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d29438da-5456-468e-bf8d-0327c411018e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:55.429859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d29438da-5456-468e-bf8d-0327c411018e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:55.441774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d29438da-5456-468e-bf8d-0327c411018e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:55.443090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d29438da-5456-468e-bf8d-0327c411018e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:55.443888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d29438da-5456-468e-bf8d-0327c411018e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:55.444339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d29438da-5456-468e-bf8d-0327c411018e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:55.451297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1191337952", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "edd95c29-a1f5-4f51-bc41-28015bfd2bec"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:55.520881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:04:55.937682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d29438da-5456-468e-bf8d-0327c411018e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:55.950116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d29438da-5456-468e-bf8d-0327c411018e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:55.953073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d29438da-5456-468e-bf8d-0327c411018e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:55.956958 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d29438da-5456-468e-bf8d-0327c411018e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1566 microversion: 2.25 time: 0.532312 May 28 21:04:55.960030 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 315/615] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:55 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1566 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:55.972774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-781bda1e-d3a6-400c-9deb-c51eacb0ac08 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:55.974342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-781bda1e-d3a6-400c-9deb-c51eacb0ac08 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:55.988053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-781bda1e-d3a6-400c-9deb-c51eacb0ac08 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:55.988924 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-781bda1e-d3a6-400c-9deb-c51eacb0ac08 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:55.991444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-781bda1e-d3a6-400c-9deb-c51eacb0ac08 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:55.992124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-781bda1e-d3a6-400c-9deb-c51eacb0ac08 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:56.257315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:04:56.258558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:04:56.259066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:04:56.259497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:04:56.259915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:04:56.291707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:56.292182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:56.294936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:56.295639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:56.303468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-781bda1e-d3a6-400c-9deb-c51eacb0ac08 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:56.312727 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-781bda1e-d3a6-400c-9deb-c51eacb0ac08 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1390 microversion: 2.1 time: 0.351306 May 28 21:04:56.315199 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 316/616] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:55 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1390 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:56.318497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a8685a65-52c4-4005-840d-06a54fb8bf6c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:56.319356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a8685a65-52c4-4005-840d-06a54fb8bf6c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:56.327415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8685a65-52c4-4005-840d-06a54fb8bf6c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:56.328133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Getting quotas for project 56e1dc5556624e2fb8de8a030c34c334. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:04:56.328465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8685a65-52c4-4005-840d-06a54fb8bf6c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:56.329871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8685a65-52c4-4005-840d-06a54fb8bf6c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:56.330503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8685a65-52c4-4005-840d-06a54fb8bf6c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:56.350543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Getting quotas for user 478d1609aa114d16b338e07d2d4c05c9 and project 56e1dc5556624e2fb8de8a030c34c334. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:04:56.368176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:04:56.374723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:04:56.522597 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-353a8536-667c-4b46-b228-d11e826d065f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.075063 May 28 21:04:56.525159 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 301/617] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:04:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1079 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:04:56.556422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7a029b54-afcc-448f-a19c-298bc30d16ae tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:56.564336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7a029b54-afcc-448f-a19c-298bc30d16ae tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:56.589120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a029b54-afcc-448f-a19c-298bc30d16ae tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:56.589590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a029b54-afcc-448f-a19c-298bc30d16ae tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:56.593891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a029b54-afcc-448f-a19c-298bc30d16ae tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:56.594440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a029b54-afcc-448f-a19c-298bc30d16ae tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:56.627025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a8685a65-52c4-4005-840d-06a54fb8bf6c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:56.637346 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a8685a65-52c4-4005-840d-06a54fb8bf6c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1321 microversion: 2.1 time: 0.322453 May 28 21:04:56.638782 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 317/618] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:56 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:56.651492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-04050863-17a7-4433-a572-788efdb45172 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:56.652065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-04050863-17a7-4433-a572-788efdb45172 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:56.664966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04050863-17a7-4433-a572-788efdb45172 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:56.665593 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04050863-17a7-4433-a572-788efdb45172 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:56.666575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04050863-17a7-4433-a572-788efdb45172 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:56.667018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04050863-17a7-4433-a572-788efdb45172 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:56.670363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:04:57.331899 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7a029b54-afcc-448f-a19c-298bc30d16ae tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:57.344642 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7a029b54-afcc-448f-a19c-298bc30d16ae tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1462 microversion: 2.1 time: 0.815691 May 28 21:04:57.350209 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 302/619] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:56 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1462 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:57.367892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6b0c88e4-0b89-4b53-8698-44e5273ea339 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:57.372989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6b0c88e4-0b89-4b53-8698-44e5273ea339 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:57.501067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6b0c88e4-0b89-4b53-8698-44e5273ea339 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:57.507875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-04050863-17a7-4433-a572-788efdb45172 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:57.537176 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6b0c88e4-0b89-4b53-8698-44e5273ea339 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1214 microversion: 2.1 time: 0.181525 May 28 21:04:57.549107 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 303/620] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:57 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:57.561366 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-04050863-17a7-4433-a572-788efdb45172 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1503 microversion: 2.1 time: 0.921200 May 28 21:04:57.565679 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 318/621] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:56 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1503 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:57.576157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2384a7f3-75ca-4e51-b20d-81d02d771fda tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:57.576911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2384a7f3-75ca-4e51-b20d-81d02d771fda tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:57.586294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5718ba12-bc11-4942-94ed-ac2dfca29e8d tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:57.587819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5718ba12-bc11-4942-94ed-ac2dfca29e8d tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:57.593234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2384a7f3-75ca-4e51-b20d-81d02d771fda tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:57.593706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2384a7f3-75ca-4e51-b20d-81d02d771fda tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:57.594533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2384a7f3-75ca-4e51-b20d-81d02d771fda tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:57.594986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2384a7f3-75ca-4e51-b20d-81d02d771fda tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:57.610680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5718ba12-bc11-4942-94ed-ac2dfca29e8d tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:57.613992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5718ba12-bc11-4942-94ed-ac2dfca29e8d tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:57.615538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5718ba12-bc11-4942-94ed-ac2dfca29e8d tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:57.618251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5718ba12-bc11-4942-94ed-ac2dfca29e8d tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:58.185425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2384a7f3-75ca-4e51-b20d-81d02d771fda tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:58.186633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5718ba12-bc11-4942-94ed-ac2dfca29e8d tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:58.200724 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5718ba12-bc11-4942-94ed-ac2dfca29e8d tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1390 microversion: 2.1 time: 0.630956 May 28 21:04:58.204198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2384a7f3-75ca-4e51-b20d-81d02d771fda tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:58.204684 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 319/622] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:57 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1390 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:58.210247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2384a7f3-75ca-4e51-b20d-81d02d771fda tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:58.213273 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2384a7f3-75ca-4e51-b20d-81d02d771fda tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1566 microversion: 2.25 time: 0.662215 May 28 21:04:58.216279 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 304/623] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:57 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1566 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:04:58.224337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7e5c17eb-9b7e-4b6c-9c16-ccd11bbe3202 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:58.224337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7e5c17eb-9b7e-4b6c-9c16-ccd11bbe3202 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:58.228344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e10d77ec-53b0-4f8a-9e86-3f17c45e46fd tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:58.231323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e10d77ec-53b0-4f8a-9e86-3f17c45e46fd tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:58.245178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e5c17eb-9b7e-4b6c-9c16-ccd11bbe3202 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:58.245741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e5c17eb-9b7e-4b6c-9c16-ccd11bbe3202 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:58.246612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e5c17eb-9b7e-4b6c-9c16-ccd11bbe3202 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:58.256505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e5c17eb-9b7e-4b6c-9c16-ccd11bbe3202 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:58.256663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e10d77ec-53b0-4f8a-9e86-3f17c45e46fd tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:58.256663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e10d77ec-53b0-4f8a-9e86-3f17c45e46fd tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:58.256663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e10d77ec-53b0-4f8a-9e86-3f17c45e46fd tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:58.256663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e10d77ec-53b0-4f8a-9e86-3f17c45e46fd tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:58.422454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7e5c17eb-9b7e-4b6c-9c16-ccd11bbe3202 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:58.440441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7e5c17eb-9b7e-4b6c-9c16-ccd11bbe3202 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Old instance type m1.heat2, new instance type m1.heat {{(pid=143128) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 21:04:58.458471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-7e5c17eb-9b7e-4b6c-9c16-ccd11bbe3202 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:04:58.459155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-7e5c17eb-9b7e-4b6c-9c16-ccd11bbe3202 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:04:58.459834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-7e5c17eb-9b7e-4b6c-9c16-ccd11bbe3202 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:04:58.460414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-7e5c17eb-9b7e-4b6c-9c16-ccd11bbe3202 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:04:58.461701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-7e5c17eb-9b7e-4b6c-9c16-ccd11bbe3202 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:04:58.560056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e10d77ec-53b0-4f8a-9e86-3f17c45e46fd tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:58.572448 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e10d77ec-53b0-4f8a-9e86-3f17c45e46fd tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1321 microversion: 2.1 time: 0.354353 May 28 21:04:58.575365 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 305/624] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:58 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1321 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:58.842075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e1b85729-53ba-4d10-8e3a-9f0750849cec tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Action: 'update', calling method: .version_select at 0x7f4d64541670>, body: {"quota_set": {"ram": "5120"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:58.855414 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7e5c17eb-9b7e-4b6c-9c16-ccd11bbe3202 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "POST /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2/action" status: 202 len: 0 microversion: 2.1 time: 0.648515 May 28 21:04:58.856232 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 320/625] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:04:58 2022] POST /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2/action => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:04:58.862117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5467b0e3-e02e-4b15-82f7-9117727704bc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:58.863001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5467b0e3-e02e-4b15-82f7-9117727704bc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:58.876489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5467b0e3-e02e-4b15-82f7-9117727704bc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:58.879684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5467b0e3-e02e-4b15-82f7-9117727704bc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:58.881044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5467b0e3-e02e-4b15-82f7-9117727704bc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:58.881491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5467b0e3-e02e-4b15-82f7-9117727704bc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:58.987388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1b85729-53ba-4d10-8e3a-9f0750849cec tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:58.988027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1b85729-53ba-4d10-8e3a-9f0750849cec tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:58.995223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1b85729-53ba-4d10-8e3a-9f0750849cec tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:58.995874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1b85729-53ba-4d10-8e3a-9f0750849cec tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:59.043393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5467b0e3-e02e-4b15-82f7-9117727704bc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:59.053956 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5467b0e3-e02e-4b15-82f7-9117727704bc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1210 microversion: 2.1 time: 0.196283 May 28 21:04:59.054512 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 321/626] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:58 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1210 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:59.090620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6504cdc0-b99c-458a-b78d-afb707170e07 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:59.091447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6504cdc0-b99c-458a-b78d-afb707170e07 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:59.099181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6504cdc0-b99c-458a-b78d-afb707170e07 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:59.100249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6504cdc0-b99c-458a-b78d-afb707170e07 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:59.102138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6504cdc0-b99c-458a-b78d-afb707170e07 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:59.102753 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6504cdc0-b99c-458a-b78d-afb707170e07 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:59.204327 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e1b85729-53ba-4d10-8e3a-9f0750849cec tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/97cc6006cd664e18a879e467b5165cc9" status: 200 len: 148 microversion: 2.57 time: 0.627333 May 28 21:04:59.205021 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 306/627] 10.222.0.33 () {62 vars in 1302 bytes} [Sat May 28 21:04:58 2022] PUT /compute/v2.1/os-quota-sets/97cc6006cd664e18a879e467b5165cc9 => generated 148 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:04:59.220440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5bb53c79-bbdf-47b3-be61-35b6eda24640 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:59.229735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5bb53c79-bbdf-47b3-be61-35b6eda24640 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:59.229735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bb53c79-bbdf-47b3-be61-35b6eda24640 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:59.229735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bb53c79-bbdf-47b3-be61-35b6eda24640 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:59.231808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bb53c79-bbdf-47b3-be61-35b6eda24640 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:59.232443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bb53c79-bbdf-47b3-be61-35b6eda24640 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:59.545693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6504cdc0-b99c-458a-b78d-afb707170e07 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:59.558271 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6504cdc0-b99c-458a-b78d-afb707170e07 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1503 microversion: 2.1 time: 0.475163 May 28 21:04:59.559198 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 322/628] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:59 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1503 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:59.571189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-044c1b21-9a0e-4f7a-8ac1-7eae3257d573 req-59d6cfd7-8cfa-4b46-8732-edbe8672e36f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f19324c9-92b9-4a31-9651-20be6957922c", "tag": "5ca6fb40-a20e-42cd-8bfc-50276010ce4a"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:04:59.580484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-044c1b21-9a0e-4f7a-8ac1-7eae3257d573 req-59d6cfd7-8cfa-4b46-8732-edbe8672e36f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:59.581215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-044c1b21-9a0e-4f7a-8ac1-7eae3257d573 req-59d6cfd7-8cfa-4b46-8732-edbe8672e36f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:59.598102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5bb53c79-bbdf-47b3-be61-35b6eda24640 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:59.599673 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-044c1b21-9a0e-4f7a-8ac1-7eae3257d573 req-59d6cfd7-8cfa-4b46-8732-edbe8672e36f service nova] Creating event network-changed:5ca6fb40-a20e-42cd-8bfc-50276010ce4a for instance f19324c9-92b9-4a31-9651-20be6957922c on nch1-master-1 May 28 21:04:59.606348 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-044c1b21-9a0e-4f7a-8ac1-7eae3257d573 req-59d6cfd7-8cfa-4b46-8732-edbe8672e36f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045845 May 28 21:04:59.609831 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5bb53c79-bbdf-47b3-be61-35b6eda24640 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1471 microversion: 2.1 time: 0.394334 May 28 21:04:59.611475 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 307/629] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:59 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1471 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:59.615846 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 323/630] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:04:59.624807 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-462ccb47-8d8a-45b8-9fe1-41c75e6f08ed tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Calling method '.version_select at 0x7f4d6466fdc0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:59.629054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-313bcec7-8ebc-49cb-b250-a53368803953 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:59.629542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-313bcec7-8ebc-49cb-b250-a53368803953 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:59.643093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-313bcec7-8ebc-49cb-b250-a53368803953 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:59.643751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-313bcec7-8ebc-49cb-b250-a53368803953 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:59.644556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-313bcec7-8ebc-49cb-b250-a53368803953 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:59.645009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-313bcec7-8ebc-49cb-b250-a53368803953 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:59.761749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-462ccb47-8d8a-45b8-9fe1-41c75e6f08ed tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:59.766056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-462ccb47-8d8a-45b8-9fe1-41c75e6f08ed tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:59.768163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-462ccb47-8d8a-45b8-9fe1-41c75e6f08ed tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:59.774274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-462ccb47-8d8a-45b8-9fe1-41c75e6f08ed tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:59.834990 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-462ccb47-8d8a-45b8-9fe1-41c75e6f08ed tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/97cc6006cd664e18a879e467b5165cc9/detail" status: 200 len: 463 microversion: 2.57 time: 0.222370 May 28 21:04:59.837159 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 308/631] 10.222.0.33 () {60 vars in 1303 bytes} [Sat May 28 21:04:59 2022] GET /compute/v2.1/os-quota-sets/97cc6006cd664e18a879e467b5165cc9/detail => generated 463 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:04:59.875691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0c332a64-7afa-4ebe-a453-71ba6d429577 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:59.878708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0c332a64-7afa-4ebe-a453-71ba6d429577 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:59.907124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c332a64-7afa-4ebe-a453-71ba6d429577 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:59.908810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c332a64-7afa-4ebe-a453-71ba6d429577 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:59.908810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c332a64-7afa-4ebe-a453-71ba6d429577 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:59.909021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c332a64-7afa-4ebe-a453-71ba6d429577 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:59.930965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-313bcec7-8ebc-49cb-b250-a53368803953 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:04:59.942539 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-313bcec7-8ebc-49cb-b250-a53368803953 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1588 microversion: 2.1 time: 0.324816 May 28 21:04:59.943611 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 324/632] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:59 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1588 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:04:59.948695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-13ad6527-8c05-43cd-be5e-d57d335a9450 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:04:59.949449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-13ad6527-8c05-43cd-be5e-d57d335a9450 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:04:59.956442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13ad6527-8c05-43cd-be5e-d57d335a9450 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:59.957005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13ad6527-8c05-43cd-be5e-d57d335a9450 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:04:59.958659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13ad6527-8c05-43cd-be5e-d57d335a9450 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:04:59.959351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13ad6527-8c05-43cd-be5e-d57d335a9450 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:00.197126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=10,nova_cell0:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:00.324017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0c332a64-7afa-4ebe-a453-71ba6d429577 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:00.335852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0c332a64-7afa-4ebe-a453-71ba6d429577 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:00.340585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0c332a64-7afa-4ebe-a453-71ba6d429577 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:00.344213 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0c332a64-7afa-4ebe-a453-71ba6d429577 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1541 microversion: 2.25 time: 0.503569 May 28 21:05:00.345634 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 309/633] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:04:59 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1541 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:00.355346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-52a542d6-e864-45fa-ae14-d5e06c8858d0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:00.358045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-52a542d6-e864-45fa-ae14-d5e06c8858d0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:00.377122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52a542d6-e864-45fa-ae14-d5e06c8858d0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:00.377122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52a542d6-e864-45fa-ae14-d5e06c8858d0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:00.377122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52a542d6-e864-45fa-ae14-d5e06c8858d0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:00.379675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52a542d6-e864-45fa-ae14-d5e06c8858d0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:00.601361 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-52a542d6-e864-45fa-ae14-d5e06c8858d0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.255106 May 28 21:05:00.603682 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 310/634] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:05:00 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11/os-interface => generated 284 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:00.612085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7eedad2e-f1fc-41b1-a450-46c9349a5ad8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:00.614835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7eedad2e-f1fc-41b1-a450-46c9349a5ad8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:00.645000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7eedad2e-f1fc-41b1-a450-46c9349a5ad8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:00.648889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7eedad2e-f1fc-41b1-a450-46c9349a5ad8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:00.649985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7eedad2e-f1fc-41b1-a450-46c9349a5ad8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:00.650597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7eedad2e-f1fc-41b1-a450-46c9349a5ad8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:00.757440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-13ad6527-8c05-43cd-be5e-d57d335a9450 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:00.786583 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-13ad6527-8c05-43cd-be5e-d57d335a9450 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1321 microversion: 2.1 time: 0.840479 May 28 21:05:00.795580 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 325/635] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:04:59 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1321 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:00.821060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-36f71238-602b-4dda-a887-73e74e140a5a tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Action: 'update', calling method: .version_select at 0x7f4d649e69d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:00.907720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7eedad2e-f1fc-41b1-a450-46c9349a5ad8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:00.937914 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7eedad2e-f1fc-41b1-a450-46c9349a5ad8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1284 microversion: 2.1 time: 0.332174 May 28 21:05:00.954456 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 311/636] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:00 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1284 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:00.964694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d5ec5182-863e-4582-8fa4-f160bd5365dd tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '.version_select at 0x7f4d64622c10>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:00.975017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5ec5182-863e-4582-8fa4-f160bd5365dd tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:00.979457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5ec5182-863e-4582-8fa4-f160bd5365dd tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:01.016796 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d5ec5182-863e-4582-8fa4-f160bd5365dd tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2558 microversion: 2.25 time: 0.060703 May 28 21:05:01.022616 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 312/637] 10.222.0.33 () {60 vars in 1183 bytes} [Sat May 28 21:05:00 2022] GET /compute/v2.1/os-migrations => generated 2558 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:01.028443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:UPDATE=14,nova_api:SELECT=84,nova_api:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:01.035519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d045a7c6-2943-4d1f-954a-538c6bf49e41 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:01.040764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36f71238-602b-4dda-a887-73e74e140a5a tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:01.041336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d045a7c6-2943-4d1f-954a-538c6bf49e41 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:01.041635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36f71238-602b-4dda-a887-73e74e140a5a tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:01.043239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36f71238-602b-4dda-a887-73e74e140a5a tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:01.043860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36f71238-602b-4dda-a887-73e74e140a5a tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:01.055325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d045a7c6-2943-4d1f-954a-538c6bf49e41 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:01.056225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d045a7c6-2943-4d1f-954a-538c6bf49e41 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:01.057336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d045a7c6-2943-4d1f-954a-538c6bf49e41 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:01.060446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d045a7c6-2943-4d1f-954a-538c6bf49e41 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:01.117938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36f71238-602b-4dda-a887-73e74e140a5a tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:01.119871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36f71238-602b-4dda-a887-73e74e140a5a tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:01.120886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36f71238-602b-4dda-a887-73e74e140a5a tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:01.121480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36f71238-602b-4dda-a887-73e74e140a5a tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:01.372049 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-36f71238-602b-4dda-a887-73e74e140a5a tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/97cc6006cd664e18a879e467b5165cc9?user_id=86ab50d819c84293ae34c398177ed855" status: 200 len: 148 microversion: 2.57 time: 0.571162 May 28 21:05:01.373362 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 326/638] 10.222.0.33 () {62 vars in 1383 bytes} [Sat May 28 21:05:00 2022] PUT /compute/v2.1/os-quota-sets/97cc6006cd664e18a879e467b5165cc9?user_id=86ab50d819c84293ae34c398177ed855 => generated 148 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:05:01.378790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2c4113b9-8542-4d1b-ada5-7e53dc62996e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:01.380830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2c4113b9-8542-4d1b-ada5-7e53dc62996e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:01.381176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d045a7c6-2943-4d1f-954a-538c6bf49e41 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:01.388361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c4113b9-8542-4d1b-ada5-7e53dc62996e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:01.389150 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c4113b9-8542-4d1b-ada5-7e53dc62996e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:01.393145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c4113b9-8542-4d1b-ada5-7e53dc62996e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:01.394380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c4113b9-8542-4d1b-ada5-7e53dc62996e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:01.403979 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d045a7c6-2943-4d1f-954a-538c6bf49e41 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1503 microversion: 2.1 time: 0.377992 May 28 21:05:01.410182 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 313/639] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:01 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:01.431637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3fdae818-55e2-46ce-985f-8a8b529b6226 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:01.432566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3fdae818-55e2-46ce-985f-8a8b529b6226 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:01.449108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fdae818-55e2-46ce-985f-8a8b529b6226 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:01.450874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fdae818-55e2-46ce-985f-8a8b529b6226 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:01.453659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fdae818-55e2-46ce-985f-8a8b529b6226 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:01.454393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fdae818-55e2-46ce-985f-8a8b529b6226 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:01.546092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:02.289446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-3fdae818-55e2-46ce-985f-8a8b529b6226 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'services' on Instance uuid 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:05:02.295674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2c4113b9-8542-4d1b-ada5-7e53dc62996e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:02.308246 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2c4113b9-8542-4d1b-ada5-7e53dc62996e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1471 microversion: 2.1 time: 0.933381 May 28 21:05:02.323084 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 327/640] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:01 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1471 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:02.342998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f474c950-0019-4f44-b2d2-66ca62902478 tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] Calling method '.version_select at 0x7f4d647320d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:02.358123 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3fdae818-55e2-46ce-985f-8a8b529b6226 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 2033 microversion: 2.25 time: 0.938899 May 28 21:05:02.376985 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 314/641] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:01 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 2033 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:02.411267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7cdb14b0-8aa5-488e-ae64-25d30d451014 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:02.447734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7cdb14b0-8aa5-488e-ae64-25d30d451014 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:02.465203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cdb14b0-8aa5-488e-ae64-25d30d451014 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:02.470470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cdb14b0-8aa5-488e-ae64-25d30d451014 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:02.474212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cdb14b0-8aa5-488e-ae64-25d30d451014 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:02.477063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cdb14b0-8aa5-488e-ae64-25d30d451014 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:02.691364 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f474c950-0019-4f44-b2d2-66ca62902478 tempest-QuotasAdminTestV257-843138382 tempest-QuotasAdminTestV257-843138382-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/97cc6006cd664e18a879e467b5165cc9?user_id=86ab50d819c84293ae34c398177ed855" status: 200 len: 190 microversion: 2.57 time: 0.366553 May 28 21:05:02.698285 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 328/642] 10.222.0.33 () {60 vars in 1363 bytes} [Sat May 28 21:05:02 2022] GET /compute/v2.1/os-quota-sets/97cc6006cd664e18a879e467b5165cc9?user_id=86ab50d819c84293ae34c398177ed855 => generated 190 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:05:02.719645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2034c5f8-be61-4e8b-8109-bcb2d10cba32 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:02.720327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2034c5f8-be61-4e8b-8109-bcb2d10cba32 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:02.742272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2034c5f8-be61-4e8b-8109-bcb2d10cba32 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:02.745742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2034c5f8-be61-4e8b-8109-bcb2d10cba32 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:02.749743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2034c5f8-be61-4e8b-8109-bcb2d10cba32 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:02.750553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2034c5f8-be61-4e8b-8109-bcb2d10cba32 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:03.193758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7cdb14b0-8aa5-488e-ae64-25d30d451014 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:03.214328 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7cdb14b0-8aa5-488e-ae64-25d30d451014 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1321 microversion: 2.1 time: 0.838760 May 28 21:05:03.215620 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 315/643] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:02 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1321 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:03.236119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1947199c-eb5d-42ea-8979-18e5e6bcdd52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:03.236929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1947199c-eb5d-42ea-8979-18e5e6bcdd52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:03.255537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1947199c-eb5d-42ea-8979-18e5e6bcdd52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:03.257383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1947199c-eb5d-42ea-8979-18e5e6bcdd52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:03.258527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1947199c-eb5d-42ea-8979-18e5e6bcdd52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:03.260389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1947199c-eb5d-42ea-8979-18e5e6bcdd52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:03.531918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2034c5f8-be61-4e8b-8109-bcb2d10cba32 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:03.544586 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2034c5f8-be61-4e8b-8109-bcb2d10cba32 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1314 microversion: 2.1 time: 0.839960 May 28 21:05:03.554889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1947199c-eb5d-42ea-8979-18e5e6bcdd52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:03.556714 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1947199c-eb5d-42ea-8979-18e5e6bcdd52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1493 microversion: 2.1 time: 0.333114 May 28 21:05:03.556937 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 329/644] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:02 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1314 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:03.557281 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 316/645] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:03 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1493 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:03.563064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e277799e-c2ba-4dee-a8df-8219bdcc3349 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:03.563981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e277799e-c2ba-4dee-a8df-8219bdcc3349 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:03.571401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e277799e-c2ba-4dee-a8df-8219bdcc3349 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:03.572128 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e277799e-c2ba-4dee-a8df-8219bdcc3349 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:03.573098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e277799e-c2ba-4dee-a8df-8219bdcc3349 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:03.573750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e277799e-c2ba-4dee-a8df-8219bdcc3349 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:03.581178 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1215013503", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "a8cad774-f5d9-4630-8882-1fcbf23ca116"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:03.696632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] validate_networks() for [('a8cad774-f5d9-4630-8882-1fcbf23ca116', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:05:04.508726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e277799e-c2ba-4dee-a8df-8219bdcc3349 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:04.526431 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e277799e-c2ba-4dee-a8df-8219bdcc3349 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1471 microversion: 2.1 time: 0.965052 May 28 21:05:04.535806 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 330/646] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:03 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1471 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:04.558879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-881fda37-d434-42ae-921c-aaf20d8a79e5 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '.version_select at 0x7f4d64732940>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:04.571368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-881fda37-d434-42ae-921c-aaf20d8a79e5 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:04.588721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-881fda37-d434-42ae-921c-aaf20d8a79e5 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:04.621582 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-881fda37-d434-42ae-921c-aaf20d8a79e5 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 1956 microversion: 2.1 time: 0.076612 May 28 21:05:04.642818 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 331/647] 10.222.0.33 () {58 vars in 1142 bytes} [Sat May 28 21:05:04 2022] GET /compute/v2.1/os-migrations => generated 1956 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:04.648385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-db42f558-69ae-4688-b955-f8222f5e9c89 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:04.649325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-db42f558-69ae-4688-b955-f8222f5e9c89 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:04.666273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db42f558-69ae-4688-b955-f8222f5e9c89 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:04.668114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db42f558-69ae-4688-b955-f8222f5e9c89 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:04.670125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db42f558-69ae-4688-b955-f8222f5e9c89 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:04.671832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db42f558-69ae-4688-b955-f8222f5e9c89 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:06.105372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-db42f558-69ae-4688-b955-f8222f5e9c89 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:06.122832 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-db42f558-69ae-4688-b955-f8222f5e9c89 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1321 microversion: 2.1 time: 1.477912 May 28 21:05:06.132452 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 332/648] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:04 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1321 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:06.134515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1ae90c5f-4b47-4912-b401-1c9de0d48837 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:06.135321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1ae90c5f-4b47-4912-b401-1c9de0d48837 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:06.166451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ae90c5f-4b47-4912-b401-1c9de0d48837 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:06.168163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ae90c5f-4b47-4912-b401-1c9de0d48837 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:06.172616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ae90c5f-4b47-4912-b401-1c9de0d48837 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:06.173259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ae90c5f-4b47-4912-b401-1c9de0d48837 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:06.731559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:05:06.732146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:05:06.732474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:05:06.732903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:05:06.733338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:05:06.761589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:06.762191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:06.763032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:06.763489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:06.809413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Getting quotas for project 45a2b4e7e1484ea3807bc8d8bc31296c. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:05:06.815330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Getting quotas for user fc6ee6dba5d24e90bff48384539fcd7f and project 45a2b4e7e1484ea3807bc8d8bc31296c. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:05:06.832496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:05:06.835084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:05:06.962681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1ae90c5f-4b47-4912-b401-1c9de0d48837 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:06.983364 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1ae90c5f-4b47-4912-b401-1c9de0d48837 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1314 microversion: 2.1 time: 0.857424 May 28 21:05:07.002704 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 333/649] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:06 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1314 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:07.011375 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eb82ec5f-1ce5-4252-b921-75000813c8ce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.434914 May 28 21:05:07.017501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-daf346c9-daee-421f-81ee-2fddfa16fa5a tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:07.020080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-daf346c9-daee-421f-81ee-2fddfa16fa5a tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:07.029747 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 317/650] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:05:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3466 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 21:05:07.080937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-daf346c9-daee-421f-81ee-2fddfa16fa5a tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:07.100488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f89ecf80-384c-47cb-95db-feaf09067cd8 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:07.104372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-daf346c9-daee-421f-81ee-2fddfa16fa5a tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:07.105648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-daf346c9-daee-421f-81ee-2fddfa16fa5a tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:07.107454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-daf346c9-daee-421f-81ee-2fddfa16fa5a tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:07.107601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f89ecf80-384c-47cb-95db-feaf09067cd8 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:07.122084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:07.132296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f89ecf80-384c-47cb-95db-feaf09067cd8 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:07.140266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f89ecf80-384c-47cb-95db-feaf09067cd8 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:07.145654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f89ecf80-384c-47cb-95db-feaf09067cd8 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:07.146897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f89ecf80-384c-47cb-95db-feaf09067cd8 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:07.731779 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-daf346c9-daee-421f-81ee-2fddfa16fa5a tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1644 microversion: 2.1 time: 0.727759 May 28 21:05:07.751749 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 334/651] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:07 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1644 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:07.809024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-103aa63b-3efa-410e-983b-893df9a93a3d req-971dfa24-d4d6-4f6d-b7b2-f4d160159924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11", "tag": "a8cbb2e6-44eb-497a-b75f-b22790446b3f"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:07.846820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f89ecf80-384c-47cb-95db-feaf09067cd8 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:07.856205 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f89ecf80-384c-47cb-95db-feaf09067cd8 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1588 microversion: 2.1 time: 0.822642 May 28 21:05:07.865050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-103aa63b-3efa-410e-983b-893df9a93a3d req-971dfa24-d4d6-4f6d-b7b2-f4d160159924 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:07.865050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-103aa63b-3efa-410e-983b-893df9a93a3d req-971dfa24-d4d6-4f6d-b7b2-f4d160159924 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:07.865443 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 318/652] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:07 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1588 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:07.874966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-502cfdfb-ced8-43c0-a643-7ab7ff9f2b91 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:07.888785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-502cfdfb-ced8-43c0-a643-7ab7ff9f2b91 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:07.906920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-502cfdfb-ced8-43c0-a643-7ab7ff9f2b91 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:07.911630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-502cfdfb-ced8-43c0-a643-7ab7ff9f2b91 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:07.913257 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-103aa63b-3efa-410e-983b-893df9a93a3d req-971dfa24-d4d6-4f6d-b7b2-f4d160159924 service nova] Creating event network-changed:a8cbb2e6-44eb-497a-b75f-b22790446b3f for instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 on nch2-master-1 May 28 21:05:07.914037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-502cfdfb-ced8-43c0-a643-7ab7ff9f2b91 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:07.918783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-502cfdfb-ced8-43c0-a643-7ab7ff9f2b91 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:07.935392 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-103aa63b-3efa-410e-983b-893df9a93a3d req-971dfa24-d4d6-4f6d-b7b2-f4d160159924 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178448 May 28 21:05:07.951146 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 335/653] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:07.967490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-b30da77d-c0fc-453e-8903-1a860dd7ee68 req-e2aa400a-b5a7-4f38-9302-5d4e3d072320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f19324c9-92b9-4a31-9651-20be6957922c", "name": "network-vif-plugged", "status": "completed", "tag": "5ca6fb40-a20e-42cd-8bfc-50276010ce4a"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:07.982138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b30da77d-c0fc-453e-8903-1a860dd7ee68 req-e2aa400a-b5a7-4f38-9302-5d4e3d072320 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:07.983553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b30da77d-c0fc-453e-8903-1a860dd7ee68 req-e2aa400a-b5a7-4f38-9302-5d4e3d072320 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:08.007563 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-b30da77d-c0fc-453e-8903-1a860dd7ee68 req-e2aa400a-b5a7-4f38-9302-5d4e3d072320 service nova] Creating event network-vif-plugged:5ca6fb40-a20e-42cd-8bfc-50276010ce4a for instance f19324c9-92b9-4a31-9651-20be6957922c on nch1-master-1 May 28 21:05:08.024872 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-b30da77d-c0fc-453e-8903-1a860dd7ee68 req-e2aa400a-b5a7-4f38-9302-5d4e3d072320 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073583 May 28 21:05:08.029409 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 336/654] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:08.070957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8357524f-861b-4599-9713-76bd2e12024d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:08.072483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8357524f-861b-4599-9713-76bd2e12024d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:08.525120 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8357524f-861b-4599-9713-76bd2e12024d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:08.536507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8357524f-861b-4599-9713-76bd2e12024d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:08.538272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8357524f-861b-4599-9713-76bd2e12024d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:08.540030 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8357524f-861b-4599-9713-76bd2e12024d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1262 microversion: 2.25 time: 0.489105 May 28 21:05:08.544685 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 337/655] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:08 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1262 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:08.549368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b5651870-a374-40fb-b63e-24c618c63b61 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:08.554053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b5651870-a374-40fb-b63e-24c618c63b61 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:08.574510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5651870-a374-40fb-b63e-24c618c63b61 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:08.575016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5651870-a374-40fb-b63e-24c618c63b61 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:08.575862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5651870-a374-40fb-b63e-24c618c63b61 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:08.576375 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5651870-a374-40fb-b63e-24c618c63b61 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:08.606312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:08.668550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-502cfdfb-ced8-43c0-a643-7ab7ff9f2b91 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:08.679124 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-502cfdfb-ced8-43c0-a643-7ab7ff9f2b91 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1476 microversion: 2.1 time: 0.815131 May 28 21:05:08.683141 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 319/656] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:07 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1476 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:08.695927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-db6433c2-cfe1-4854-8e35-7b448b6c8b0f req-ad536326-bba0-4961-9bd8-6f9a1b17c233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a766b99-b948-437d-bfa4-c52ecacf655b", "tag": "3fdc6be3-cd61-493b-9106-470af1db7080"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:08.736477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-db6433c2-cfe1-4854-8e35-7b448b6c8b0f req-ad536326-bba0-4961-9bd8-6f9a1b17c233 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:08.742719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-db6433c2-cfe1-4854-8e35-7b448b6c8b0f req-ad536326-bba0-4961-9bd8-6f9a1b17c233 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:08.764452 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-db6433c2-cfe1-4854-8e35-7b448b6c8b0f req-ad536326-bba0-4961-9bd8-6f9a1b17c233 service nova] Creating event network-changed:3fdc6be3-cd61-493b-9106-470af1db7080 for instance 8a766b99-b948-437d-bfa4-c52ecacf655b on nch2-master-1 May 28 21:05:08.796231 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-db6433c2-cfe1-4854-8e35-7b448b6c8b0f req-ad536326-bba0-4961-9bd8-6f9a1b17c233 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106057 May 28 21:05:08.800014 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 320/657] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:08.812926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3a16aa07-44ef-4ef8-b0ef-b54b4b72e48b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:08.816553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3a16aa07-44ef-4ef8-b0ef-b54b4b72e48b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:08.831714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a16aa07-44ef-4ef8-b0ef-b54b4b72e48b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:08.835480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a16aa07-44ef-4ef8-b0ef-b54b4b72e48b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:08.836748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a16aa07-44ef-4ef8-b0ef-b54b4b72e48b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:08.837979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a16aa07-44ef-4ef8-b0ef-b54b4b72e48b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:08.850119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b5651870-a374-40fb-b63e-24c618c63b61 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:08.858647 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b5651870-a374-40fb-b63e-24c618c63b61 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1321 microversion: 2.1 time: 0.312824 May 28 21:05:08.859215 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 338/658] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:08 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:08.866556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-247034712", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "153ab96f-260d-4085-99e8-0491f645a707"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:08.978416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] validate_networks() for [('153ab96f-260d-4085-99e8-0491f645a707', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:05:09.420176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3a16aa07-44ef-4ef8-b0ef-b54b4b72e48b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:09.429670 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3a16aa07-44ef-4ef8-b0ef-b54b4b72e48b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1314 microversion: 2.1 time: 0.626600 May 28 21:05:09.437662 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 321/659] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:08 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:09.577383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3fd0c292-0667-4f4a-8660-5dc83cead1d7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:09.585220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3fd0c292-0667-4f4a-8660-5dc83cead1d7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:09.597341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fd0c292-0667-4f4a-8660-5dc83cead1d7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:09.598141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fd0c292-0667-4f4a-8660-5dc83cead1d7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:09.599313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fd0c292-0667-4f4a-8660-5dc83cead1d7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:09.599933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fd0c292-0667-4f4a-8660-5dc83cead1d7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:09.684588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3fd0c292-0667-4f4a-8660-5dc83cead1d7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:09.696131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3fd0c292-0667-4f4a-8660-5dc83cead1d7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:09.698061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3fd0c292-0667-4f4a-8660-5dc83cead1d7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:09.699294 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3fd0c292-0667-4f4a-8660-5dc83cead1d7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1314 microversion: 2.25 time: 0.135605 May 28 21:05:09.700115 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 322/660] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:09 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1314 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:05:09.705311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-14780c11-457a-460b-beb8-108c13e4be1a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:09.706926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-14780c11-457a-460b-beb8-108c13e4be1a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:09.715362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-14780c11-457a-460b-beb8-108c13e4be1a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:09.717252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-14780c11-457a-460b-beb8-108c13e4be1a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:09.717252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-14780c11-457a-460b-beb8-108c13e4be1a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:09.718566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-14780c11-457a-460b-beb8-108c13e4be1a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:09.737464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:05:09.739571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:05:09.740410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:05:09.741242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:05:09.742030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:05:09.759401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:09.760750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:09.762474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:09.763333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:09.787494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Getting quotas for project 2f5c3054461d4d07861a1685cfeba36a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:05:09.798641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Getting quotas for user 7b44b524592e4a57a26681767b9c4541 and project 2f5c3054461d4d07861a1685cfeba36a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:05:09.846536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:05:09.859407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:05:10.153710 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-68421acd-8d09-4615-a01f-c0cf20927590 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.293374 May 28 21:05:10.155650 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 339/661] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:05:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:05:10.168578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f16ecfd0-c442-4a92-aa9c-787c2191a9cf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:10.172180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f16ecfd0-c442-4a92-aa9c-787c2191a9cf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:10.180000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f16ecfd0-c442-4a92-aa9c-787c2191a9cf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:10.180783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f16ecfd0-c442-4a92-aa9c-787c2191a9cf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:10.182358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f16ecfd0-c442-4a92-aa9c-787c2191a9cf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:10.183500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f16ecfd0-c442-4a92-aa9c-787c2191a9cf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:10.729681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-14780c11-457a-460b-beb8-108c13e4be1a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:10.742668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f16ecfd0-c442-4a92-aa9c-787c2191a9cf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:10.743368 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-14780c11-457a-460b-beb8-108c13e4be1a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1476 microversion: 2.1 time: 1.041844 May 28 21:05:10.750184 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 323/662] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:09 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1476 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:10.778907 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f16ecfd0-c442-4a92-aa9c-787c2191a9cf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1471 microversion: 2.1 time: 0.619670 May 28 21:05:10.794683 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 340/663] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:10 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1471 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:10.796834 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7f31a94e-1478-4cbd-9b56-951f6f1f3b25 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:10.798387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7f31a94e-1478-4cbd-9b56-951f6f1f3b25 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:10.813252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1a753a6b-6a23-4261-9645-359ec7dc87f9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:10.821722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1a753a6b-6a23-4261-9645-359ec7dc87f9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:10.842971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a753a6b-6a23-4261-9645-359ec7dc87f9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:10.843852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a753a6b-6a23-4261-9645-359ec7dc87f9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:10.844811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a753a6b-6a23-4261-9645-359ec7dc87f9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:10.845697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a753a6b-6a23-4261-9645-359ec7dc87f9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:10.877398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7f31a94e-1478-4cbd-9b56-951f6f1f3b25 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:10.886497 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7f31a94e-1478-4cbd-9b56-951f6f1f3b25 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1210 microversion: 2.1 time: 0.129952 May 28 21:05:10.887068 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 324/664] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:10 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1210 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:10.903590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2d098c6f-bf9e-442c-a331-195f42408af6 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:10.904538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2d098c6f-bf9e-442c-a331-195f42408af6 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:10.918895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d098c6f-bf9e-442c-a331-195f42408af6 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:10.918895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d098c6f-bf9e-442c-a331-195f42408af6 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:10.919770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d098c6f-bf9e-442c-a331-195f42408af6 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:10.920228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d098c6f-bf9e-442c-a331-195f42408af6 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:11.023995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2d098c6f-bf9e-442c-a331-195f42408af6 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:11.041507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2d098c6f-bf9e-442c-a331-195f42408af6 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:11.044015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2d098c6f-bf9e-442c-a331-195f42408af6 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:11.046934 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2d098c6f-bf9e-442c-a331-195f42408af6 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1314 microversion: 2.25 time: 0.149102 May 28 21:05:11.078634 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 325/665] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:10 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:11.118054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1a753a6b-6a23-4261-9645-359ec7dc87f9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:11.124892 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1a753a6b-6a23-4261-9645-359ec7dc87f9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1314 microversion: 2.1 time: 0.328843 May 28 21:05:11.137004 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 341/666] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:10 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:11.482604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e1208748-65d7-4534-b9e8-ba41021d4d92 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:11.483201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e1208748-65d7-4534-b9e8-ba41021d4d92 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] [instance: 0213125f-1a1b-4b12-bf01-9ecd6bf583ef] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:11.499442 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-e1208748-65d7-4534-b9e8-ba41021d4d92 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] HTTP exception thrown: Instance 0213125f-1a1b-4b12-bf01-9ecd6bf583ef could not be found. May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e1208748-65d7-4534-b9e8-ba41021d4d92 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Request method failure captured: May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/0213125f-1a1b-4b12-bf01-9ecd6bf583ef/action HTTP/1.1 May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 15 May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko5wwRdgNQwjaGekRmfkSQFbcLYemXkiQcgfzQyAGi2KTvKSJRN19kH0FH193AcsymvfMgkTz5Xq1AdBL3VL1JM6Hq7EF22iBA6DthcOAlNYbjBXqiYjDoGCQuzv7Aqzr1SuMUiKMmwjuC5O2L2R_TBoyOTLnAr2l4GjHujAqqqqG9E May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 7c6c7fd995bf4b41873c30015cbc85a4 May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1533899629 May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:05:11.507548 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:05:11.509000 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c6c7fd995bf4b41873c30015cbc85a4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c6c7fd995bf4b41873c30015cbc85a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c6c7fd995bf4b41873c30015cbc85a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c6c7fd995bf4b41873c30015cbc85a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:11.509000 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1533899629 May 28 21:05:11.509000 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 7c6c7fd995bf4b41873c30015cbc85a4 May 28 21:05:11.509000 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1533899629 May 28 21:05:11.509000 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersAdminNegativeTestJSON-1533899629-project-admin May 28 21:05:11.509000 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:05:11.509000 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:05:11.509000 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 1edb01ef9d394c9da5086206d3033403 May 28 21:05:11.509000 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1533899629-project-admin May 28 21:05:11.509000 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:05:11.509000 ncdv-master-1 devstack@n-api.service[143129]: {"migrate": {}} May 28 21:05:11.509000 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:05:11.509000 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 0213125f-1a1b-4b12-bf01-9ecd6bf583ef could not be found. May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '0213125f-1a1b-4b12-bf01-9ecd6bf583ef', 'body': {'migrate': {}}} May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0213125f-1a1b-4b12-bf01-9ecd6bf583ef could not be found. May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:11.510015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0213125f-1a1b-4b12-bf01-9ecd6bf583ef could not be found. May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0213125f-1a1b-4b12-bf01-9ecd6bf583ef could not be found. May 28 21:05:11.511303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:11.512417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e1208748-65d7-4534-b9e8-ba41021d4d92 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Returning 404 to user: Instance 0213125f-1a1b-4b12-bf01-9ecd6bf583ef could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:11.512417 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e1208748-65d7-4534-b9e8-ba41021d4d92 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/0213125f-1a1b-4b12-bf01-9ecd6bf583ef/action" status: 404 len: 111 microversion: 2.1 time: 0.430708 May 28 21:05:11.514312 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 326/667] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:05:11 2022] POST /compute/v2.1/servers/0213125f-1a1b-4b12-bf01-9ecd6bf583ef/action => generated 111 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:05:11.708679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1916547043", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:11.790186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:05:11.990559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ca46516b-7179-4409-b292-3832016ded13 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Calling method '.version_select at 0x7f4d64528c10>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:12.107429 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ca46516b-7179-4409-b292-3832016ded13 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0" status: 200 len: 371 microversion: 2.1 time: 0.437530 May 28 21:05:12.109989 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 342/668] 10.222.0.33 () {58 vars in 1241 bytes} [Sat May 28 21:05:11 2022] GET /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0 => generated 371 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:12.115843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e0ca492e-e790-49f7-a62b-b84f1b686957 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:12.118300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e0ca492e-e790-49f7-a62b-b84f1b686957 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:12.124880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0ca492e-e790-49f7-a62b-b84f1b686957 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:12.125616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0ca492e-e790-49f7-a62b-b84f1b686957 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:12.126723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0ca492e-e790-49f7-a62b-b84f1b686957 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:12.127376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0ca492e-e790-49f7-a62b-b84f1b686957 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:12.205910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:05:12.206584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:05:12.207067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:05:12.207485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:05:12.208566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:05:12.223127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:12.229906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:12.230904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:12.231392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:12.263504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Getting quotas for project 8058694a4ecb467783677e687e16ecb6. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:05:12.274832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Getting quotas for user 3b044baceddf49219485bd14aa914e35 and project 8058694a4ecb467783677e687e16ecb6. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:05:12.305195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:05:12.309924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:05:12.354153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e0ca492e-e790-49f7-a62b-b84f1b686957 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:12.381122 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e0ca492e-e790-49f7-a62b-b84f1b686957 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1476 microversion: 2.1 time: 0.252438 May 28 21:05:12.383949 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 343/669] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:12 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1476 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:12.398837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4be3b1d9-3e0b-4422-a3ba-716c0fd685d7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:12.399458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4be3b1d9-3e0b-4422-a3ba-716c0fd685d7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:12.405991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4be3b1d9-3e0b-4422-a3ba-716c0fd685d7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:12.408724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4be3b1d9-3e0b-4422-a3ba-716c0fd685d7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:12.408724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4be3b1d9-3e0b-4422-a3ba-716c0fd685d7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:12.408724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4be3b1d9-3e0b-4422-a3ba-716c0fd685d7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:12.469615 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e2f2ef9d-43e5-45b1-b7ec-1aca49be46dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765334 May 28 21:05:12.470830 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 327/670] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:05:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:05:12.479391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2f44bd62-3680-49f0-b80a-4082204bea5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:12.485621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2f44bd62-3680-49f0-b80a-4082204bea5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:12.513669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f44bd62-3680-49f0-b80a-4082204bea5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:12.516580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f44bd62-3680-49f0-b80a-4082204bea5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:12.519182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f44bd62-3680-49f0-b80a-4082204bea5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:12.520618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f44bd62-3680-49f0-b80a-4082204bea5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:12.556537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4be3b1d9-3e0b-4422-a3ba-716c0fd685d7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:12.568081 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4be3b1d9-3e0b-4422-a3ba-716c0fd685d7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1262 microversion: 2.1 time: 0.181617 May 28 21:05:12.582734 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 344/671] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:12 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1262 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:12.592532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5de89810-a768-405d-8575-c7bbca6525db tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Action: 'update', calling method: .version_select at 0x7f4d6495c9d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:12.683483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2f44bd62-3680-49f0-b80a-4082204bea5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:12.698201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2f44bd62-3680-49f0-b80a-4082204bea5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:12.699867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2f44bd62-3680-49f0-b80a-4082204bea5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:12.703149 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2f44bd62-3680-49f0-b80a-4082204bea5f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1320 microversion: 2.25 time: 0.231049 May 28 21:05:12.704418 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 328/672] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:12 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1320 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:12.710094 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-82d3e895-e1b7-4e67-a664-97eb95fd0d11 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:12.711465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-82d3e895-e1b7-4e67-a664-97eb95fd0d11 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:12.719798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5de89810-a768-405d-8575-c7bbca6525db tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:12.720672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5de89810-a768-405d-8575-c7bbca6525db tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:12.722853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5de89810-a768-405d-8575-c7bbca6525db tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:12.728006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5de89810-a768-405d-8575-c7bbca6525db tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:12.748984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82d3e895-e1b7-4e67-a664-97eb95fd0d11 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:12.751652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82d3e895-e1b7-4e67-a664-97eb95fd0d11 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:12.753751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82d3e895-e1b7-4e67-a664-97eb95fd0d11 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:12.754283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82d3e895-e1b7-4e67-a664-97eb95fd0d11 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:12.921035 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5de89810-a768-405d-8575-c7bbca6525db tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0" status: 200 len: 328 microversion: 2.1 time: 0.336892 May 28 21:05:12.923884 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 345/673] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:05:12 2022] PUT /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0 => generated 328 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:12.932613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-512e8cfb-15ae-4b1e-88dd-5588ef6c2016 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:12.943243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-512e8cfb-15ae-4b1e-88dd-5588ef6c2016 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:13.212210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-512e8cfb-15ae-4b1e-88dd-5588ef6c2016 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:13.276837 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-512e8cfb-15ae-4b1e-88dd-5588ef6c2016 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1222 microversion: 2.1 time: 0.351598 May 28 21:05:13.289332 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 346/674] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:12 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1222 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:13.316309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-82d3e895-e1b7-4e67-a664-97eb95fd0d11 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:13.328525 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-82d3e895-e1b7-4e67-a664-97eb95fd0d11 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1314 microversion: 2.1 time: 0.622936 May 28 21:05:13.329740 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 329/675] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:12 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:13.403521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-02ea90ba-7efe-405c-972e-cb14389abcf0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:13.404498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-02ea90ba-7efe-405c-972e-cb14389abcf0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:13.418449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02ea90ba-7efe-405c-972e-cb14389abcf0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:13.419239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02ea90ba-7efe-405c-972e-cb14389abcf0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:13.420261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02ea90ba-7efe-405c-972e-cb14389abcf0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:13.421410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02ea90ba-7efe-405c-972e-cb14389abcf0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:13.456461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1824198819", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:13.543082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:05:13.793201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-02ea90ba-7efe-405c-972e-cb14389abcf0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:13.803409 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-02ea90ba-7efe-405c-972e-cb14389abcf0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1476 microversion: 2.1 time: 0.405596 May 28 21:05:13.804221 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 330/676] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:13 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1476 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:13.809950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e3ed8bff-a82b-4979-9032-0c13f5dfa886 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:13.810733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e3ed8bff-a82b-4979-9032-0c13f5dfa886 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:13.817634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3ed8bff-a82b-4979-9032-0c13f5dfa886 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:13.818115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3ed8bff-a82b-4979-9032-0c13f5dfa886 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:13.819327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3ed8bff-a82b-4979-9032-0c13f5dfa886 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:13.819720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3ed8bff-a82b-4979-9032-0c13f5dfa886 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:13.922756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e3ed8bff-a82b-4979-9032-0c13f5dfa886 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:13.949378 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e3ed8bff-a82b-4979-9032-0c13f5dfa886 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1268 microversion: 2.1 time: 0.133117 May 28 21:05:13.951902 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 331/677] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:13 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1268 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:13.974725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-68c51b4b-8c4b-4eb2-bda9-593ac997fbb8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:13.975656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-68c51b4b-8c4b-4eb2-bda9-593ac997fbb8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:13.984288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68c51b4b-8c4b-4eb2-bda9-593ac997fbb8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:13.984750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68c51b4b-8c4b-4eb2-bda9-593ac997fbb8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:13.994523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:05:13.995153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:05:13.995844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:05:13.996459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:05:13.996687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68c51b4b-8c4b-4eb2-bda9-593ac997fbb8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:13.997480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:05:13.997689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68c51b4b-8c4b-4eb2-bda9-593ac997fbb8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.004547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:14.010920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.011568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.012624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.013372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.036331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Getting quotas for project df867107e50e446d8cbca00826c28cd0. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:05:14.042674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Getting quotas for user ff0177f6b0bc486d89d2bd33dcfb62d7 and project df867107e50e446d8cbca00826c28cd0. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:05:14.078638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.utils [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] cores quota exceeded for df867107e50e446d8cbca00826c28cd0, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=143128) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 28 21:05:14.079928 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Request method failure captured: May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 145 May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko6GGlZlhJnir74kgtr0fNtFlaA5IchK7-6XQ_lcHfBPN3wLEDOnpoy_vx5VGo186YConPky8aykwDFIhjiXMPDpRq14TgHTAu8gOAfT6Aih57pvkrozZ35QVs_wmsB2iuFFPPcLylKqzOrTs499Oe8RY0ufe4tzNlh3qjShGq8jljA May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: df867107e50e446d8cbca00826c28cd0 May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-QuotasAdminNegativeTest-1776620119 May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:05:14.085430 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:05:14.089722 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_df867107e50e446d8cbca00826c28cd0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df867107e50e446d8cbca00826c28cd0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/df867107e50e446d8cbca00826c28cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df867107e50e446d8cbca00826c28cd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:14.089722 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-QuotasAdminNegativeTest-1776620119 May 28 21:05:14.089722 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: df867107e50e446d8cbca00826c28cd0 May 28 21:05:14.089722 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1776620119 May 28 21:05:14.089722 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-QuotasAdminNegativeTest-1776620119-project May 28 21:05:14.089722 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:05:14.089722 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:05:14.089722 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ff0177f6b0bc486d89d2bd33dcfb62d7 May 28 21:05:14.089722 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-QuotasAdminNegativeTest-1776620119-project May 28 21:05:14.089722 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:05:14.089722 ncdv-master-1 devstack@n-api.service[143128]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1824198819", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} May 28 21:05:14.089722 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1824198819', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452'}}} May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 28 21:05:14.090654 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:14.091973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:14.094042 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:14.095277 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:14.095277 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:14.095277 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:05:14.095277 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:05:14.095277 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores May 28 21:05:14.095277 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:14.095277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:14.096468 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-278b1f93-af50-4b0f-9bde-c0eb6fc3200e tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.796575 May 28 21:05:14.100959 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 347/678] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:05:13 2022] POST /compute/v2.1/servers => generated 111 bytes in 811 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:05:14.106150 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-219d3d92-7e93-4705-8b5c-50edd1a08460 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Action: 'update', calling method: .version_select at 0x7f4d64c9bee0>, body: {"quota_set": {"cores": 20}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:14.198989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-219d3d92-7e93-4705-8b5c-50edd1a08460 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.201822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-219d3d92-7e93-4705-8b5c-50edd1a08460 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.201822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-219d3d92-7e93-4705-8b5c-50edd1a08460 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.202218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-219d3d92-7e93-4705-8b5c-50edd1a08460 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.264649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-68c51b4b-8c4b-4eb2-bda9-593ac997fbb8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:14.273630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-68c51b4b-8c4b-4eb2-bda9-593ac997fbb8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:14.275208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-68c51b4b-8c4b-4eb2-bda9-593ac997fbb8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:14.276818 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-68c51b4b-8c4b-4eb2-bda9-593ac997fbb8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1362 microversion: 2.25 time: 0.323400 May 28 21:05:14.277454 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 332/679] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:13 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:14.322545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a1866408-c96e-465d-9aca-7fee3e52ab01 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:14.323406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a1866408-c96e-465d-9aca-7fee3e52ab01 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:14.329589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a1866408-c96e-465d-9aca-7fee3e52ab01 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.330083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a1866408-c96e-465d-9aca-7fee3e52ab01 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.330866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a1866408-c96e-465d-9aca-7fee3e52ab01 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.331334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a1866408-c96e-465d-9aca-7fee3e52ab01 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.409078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a1866408-c96e-465d-9aca-7fee3e52ab01 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:14.417928 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a1866408-c96e-465d-9aca-7fee3e52ab01 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1226 microversion: 2.1 time: 0.101195 May 28 21:05:14.428217 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 333/680] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:14 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1226 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:14.431195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e886142b-f5f4-4db3-aa65-2e6aff94e76b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:14.431859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e886142b-f5f4-4db3-aa65-2e6aff94e76b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:14.438068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e886142b-f5f4-4db3-aa65-2e6aff94e76b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.440189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e886142b-f5f4-4db3-aa65-2e6aff94e76b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.440189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e886142b-f5f4-4db3-aa65-2e6aff94e76b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.440189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e886142b-f5f4-4db3-aa65-2e6aff94e76b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.441198 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-219d3d92-7e93-4705-8b5c-50edd1a08460 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0" status: 200 len: 329 microversion: 2.1 time: 0.338866 May 28 21:05:14.448331 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 348/681] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:05:14 2022] PUT /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0 => generated 329 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:14.448331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-aec63bcf-e713-46ca-ae13-69ffbb7cbb5c req-6df81465-7f58-4c1a-a176-9c0cc7bc7f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "502fcad4-754e-4627-96fa-80843f774f47", "tag": "4a538780-a868-4e2b-a232-0afe1eda360e"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:14.458392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:14.463621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-aec63bcf-e713-46ca-ae13-69ffbb7cbb5c req-6df81465-7f58-4c1a-a176-9c0cc7bc7f48 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.464944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-aec63bcf-e713-46ca-ae13-69ffbb7cbb5c req-6df81465-7f58-4c1a-a176-9c0cc7bc7f48 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.481472 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-aec63bcf-e713-46ca-ae13-69ffbb7cbb5c req-6df81465-7f58-4c1a-a176-9c0cc7bc7f48 service nova] Creating event network-changed:4a538780-a868-4e2b-a232-0afe1eda360e for instance 502fcad4-754e-4627-96fa-80843f774f47 on nch2-master-1 May 28 21:05:14.487960 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-aec63bcf-e713-46ca-ae13-69ffbb7cbb5c req-6df81465-7f58-4c1a-a176-9c0cc7bc7f48 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044364 May 28 21:05:14.488657 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 349/682] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:14.500627 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d2942fe0-663a-44d3-8fb2-2768055eed14 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Calling method '.version_select at 0x7f4d6455dd30>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:14.663862 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d2942fe0-663a-44d3-8fb2-2768055eed14 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0" status: 200 len: 371 microversion: 2.1 time: 0.172463 May 28 21:05:14.665282 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 350/683] 10.222.0.33 () {58 vars in 1241 bytes} [Sat May 28 21:05:14 2022] GET /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0 => generated 371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:14.676064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bbc97a94-9bdc-46f7-bc9a-26ba5376229a tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Action: 'update', calling method: .version_select at 0x7f4d64615a60>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:14.735937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e886142b-f5f4-4db3-aa65-2e6aff94e76b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:14.753769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbc97a94-9bdc-46f7-bc9a-26ba5376229a tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.754327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbc97a94-9bdc-46f7-bc9a-26ba5376229a tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.754723 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e886142b-f5f4-4db3-aa65-2e6aff94e76b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1314 microversion: 2.1 time: 0.330606 May 28 21:05:14.755573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbc97a94-9bdc-46f7-bc9a-26ba5376229a tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.756086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbc97a94-9bdc-46f7-bc9a-26ba5376229a tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.766128 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 334/684] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:14 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:14.783492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-5683d323-9374-4dfd-897e-64946b0751d2 req-2246a748-a790-4dd3-bf01-d031cc63955c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a766b99-b948-437d-bfa4-c52ecacf655b", "name": "network-vif-plugged", "status": "completed", "tag": "3fdc6be3-cd61-493b-9106-470af1db7080"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:14.811063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5683d323-9374-4dfd-897e-64946b0751d2 req-2246a748-a790-4dd3-bf01-d031cc63955c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.811871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5683d323-9374-4dfd-897e-64946b0751d2 req-2246a748-a790-4dd3-bf01-d031cc63955c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.825669 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-5683d323-9374-4dfd-897e-64946b0751d2 req-2246a748-a790-4dd3-bf01-d031cc63955c service nova] Creating event network-vif-plugged:3fdc6be3-cd61-493b-9106-470af1db7080 for instance 8a766b99-b948-437d-bfa4-c52ecacf655b on nch2-master-1 May 28 21:05:14.838143 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-5683d323-9374-4dfd-897e-64946b0751d2 req-2246a748-a790-4dd3-bf01-d031cc63955c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070355 May 28 21:05:14.839638 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 335/685] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:14.857534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-22a191b2-f41b-404f-b793-1b03a9733d92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:14.863225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-22a191b2-f41b-404f-b793-1b03a9733d92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:14.877520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22a191b2-f41b-404f-b793-1b03a9733d92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.881658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22a191b2-f41b-404f-b793-1b03a9733d92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.882896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22a191b2-f41b-404f-b793-1b03a9733d92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.883623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22a191b2-f41b-404f-b793-1b03a9733d92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.939853 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bbc97a94-9bdc-46f7-bc9a-26ba5376229a tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0" status: 200 len: 328 microversion: 2.1 time: 0.268350 May 28 21:05:14.940581 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 351/686] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:05:14 2022] PUT /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0 => generated 328 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:14.975153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-070d49b0-ecae-489c-9851-573eabeb6c16 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:14.976330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-070d49b0-ecae-489c-9851-573eabeb6c16 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:14.991540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-070d49b0-ecae-489c-9851-573eabeb6c16 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.993521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-070d49b0-ecae-489c-9851-573eabeb6c16 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:14.996126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-070d49b0-ecae-489c-9851-573eabeb6c16 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:14.996893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-070d49b0-ecae-489c-9851-573eabeb6c16 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:15.435073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-22a191b2-f41b-404f-b793-1b03a9733d92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:15.452815 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-22a191b2-f41b-404f-b793-1b03a9733d92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1476 microversion: 2.1 time: 0.611610 May 28 21:05:15.453982 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 336/687] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:14 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1476 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:15.459685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1118858462", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:15.527162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-070d49b0-ecae-489c-9851-573eabeb6c16 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:15.539952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:05:15.540793 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-070d49b0-ecae-489c-9851-573eabeb6c16 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1310 microversion: 2.1 time: 0.567450 May 28 21:05:15.541420 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 352/688] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:14 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1310 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:15.546721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f9489543-18af-4e77-8207-b70ab8f85695 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:15.547504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f9489543-18af-4e77-8207-b70ab8f85695 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:15.555475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9489543-18af-4e77-8207-b70ab8f85695 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:15.556240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9489543-18af-4e77-8207-b70ab8f85695 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:15.557090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9489543-18af-4e77-8207-b70ab8f85695 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:15.557606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9489543-18af-4e77-8207-b70ab8f85695 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:15.896687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f9489543-18af-4e77-8207-b70ab8f85695 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:15.906446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f9489543-18af-4e77-8207-b70ab8f85695 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:15.907964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f9489543-18af-4e77-8207-b70ab8f85695 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:15.909155 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f9489543-18af-4e77-8207-b70ab8f85695 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1362 microversion: 2.25 time: 0.366619 May 28 21:05:15.909974 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 353/689] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:15 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:15.918091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d92d87df-ec9f-431e-87df-ed23d94c16ed tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:15.918740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d92d87df-ec9f-431e-87df-ed23d94c16ed tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:15.932693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d92d87df-ec9f-431e-87df-ed23d94c16ed tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:15.933647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d92d87df-ec9f-431e-87df-ed23d94c16ed tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:15.934673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d92d87df-ec9f-431e-87df-ed23d94c16ed tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:15.935123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d92d87df-ec9f-431e-87df-ed23d94c16ed tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:15.956845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:05:15.958515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:05:15.960420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:05:15.961079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:05:15.962337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:05:15.978145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:15.979395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:15.980546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:15.981323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:16.017216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d92d87df-ec9f-431e-87df-ed23d94c16ed tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:16.021283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Getting quotas for project df867107e50e446d8cbca00826c28cd0. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:05:16.032549 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d92d87df-ec9f-431e-87df-ed23d94c16ed tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1282 microversion: 2.1 time: 0.121667 May 28 21:05:16.042976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Getting quotas for user ff0177f6b0bc486d89d2bd33dcfb62d7 and project df867107e50e446d8cbca00826c28cd0. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:05:16.047052 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 354/690] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:15 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1282 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:16.048038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-518d3c78-c304-4967-8e6c-2241312eb3c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:16.048656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-518d3c78-c304-4967-8e6c-2241312eb3c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:16.075800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-518d3c78-c304-4967-8e6c-2241312eb3c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:16.077512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-518d3c78-c304-4967-8e6c-2241312eb3c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:16.078402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-518d3c78-c304-4967-8e6c-2241312eb3c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:16.082127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-518d3c78-c304-4967-8e6c-2241312eb3c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:16.094665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.utils [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] instances quota exceeded for df867107e50e446d8cbca00826c28cd0, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=143129) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 28 21:05:16.095521 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Request method failure captured: May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 145 May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko6GGlZlhJnir74kgtr0fNtFlaA5IchK7-6XQ_lcHfBPN3wLEDOnpoy_vx5VGo186YConPky8aykwDFIhjiXMPDpRq14TgHTAu8gOAfT6Aih57pvkrozZ35QVs_wmsB2iuFFPPcLylKqzOrTs499Oe8RY0ufe4tzNlh3qjShGq8jljA May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: df867107e50e446d8cbca00826c28cd0 May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-QuotasAdminNegativeTest-1776620119 May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:05:16.099697 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:05:16.101237 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_df867107e50e446d8cbca00826c28cd0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df867107e50e446d8cbca00826c28cd0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/df867107e50e446d8cbca00826c28cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df867107e50e446d8cbca00826c28cd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:16.101237 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-QuotasAdminNegativeTest-1776620119 May 28 21:05:16.101237 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: df867107e50e446d8cbca00826c28cd0 May 28 21:05:16.101237 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1776620119 May 28 21:05:16.101237 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-QuotasAdminNegativeTest-1776620119-project May 28 21:05:16.101237 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:05:16.101237 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:05:16.101237 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ff0177f6b0bc486d89d2bd33dcfb62d7 May 28 21:05:16.101237 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-QuotasAdminNegativeTest-1776620119-project May 28 21:05:16.101237 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:05:16.101237 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1118858462", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} May 28 21:05:16.101237 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1118858462', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452'}}} May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 28 21:05:16.102069 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:16.103301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:16.104747 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:16.106595 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:16.106595 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:16.106595 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:05:16.106595 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:05:16.106595 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances May 28 21:05:16.106595 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:16.106595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:16.106595 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c81a2c46-ab51-4f74-b65c-6e50ca9e5a4c tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.645968 May 28 21:05:16.112951 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 337/691] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:05:15 2022] POST /compute/v2.1/servers => generated 119 bytes in 658 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:05:16.122206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8424521c-1c46-472f-8836-89d53710dc7d tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Action: 'update', calling method: .version_select at 0x7f4d6465d1f0>, body: {"quota_set": {"instances": 10}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:16.220277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8424521c-1c46-472f-8836-89d53710dc7d tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:16.220988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8424521c-1c46-472f-8836-89d53710dc7d tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:16.222492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8424521c-1c46-472f-8836-89d53710dc7d tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:16.224311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8424521c-1c46-472f-8836-89d53710dc7d tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:16.315703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-518d3c78-c304-4967-8e6c-2241312eb3c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:16.326693 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-518d3c78-c304-4967-8e6c-2241312eb3c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1314 microversion: 2.1 time: 0.282448 May 28 21:05:16.328063 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 355/692] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:16 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:16.408903 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8424521c-1c46-472f-8836-89d53710dc7d tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0" status: 200 len: 329 microversion: 2.1 time: 0.290766 May 28 21:05:16.409611 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 338/693] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:05:16 2022] PUT /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0 => generated 329 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:05:16.421738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1ba59827-70c0-467e-8bb6-dc9073e06bee tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Calling method '.version_select at 0x7f4d644648b0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:16.470802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-71a8ab33-ac54-4c3f-a9f1-b706d98697d0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:16.471367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-71a8ab33-ac54-4c3f-a9f1-b706d98697d0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:16.480937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71a8ab33-ac54-4c3f-a9f1-b706d98697d0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:16.482089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71a8ab33-ac54-4c3f-a9f1-b706d98697d0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:16.482735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71a8ab33-ac54-4c3f-a9f1-b706d98697d0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:16.483366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71a8ab33-ac54-4c3f-a9f1-b706d98697d0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:16.493644 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1ba59827-70c0-467e-8bb6-dc9073e06bee tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0" status: 200 len: 371 microversion: 2.1 time: 0.075580 May 28 21:05:16.494639 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 356/694] 10.222.0.33 () {58 vars in 1241 bytes} [Sat May 28 21:05:16 2022] GET /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0 => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:16.504852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f152a1f9-4045-4998-87e3-3a250c909af5 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Action: 'update', calling method: .version_select at 0x7f4d64c0e4c0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:16.583773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f152a1f9-4045-4998-87e3-3a250c909af5 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:16.585012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f152a1f9-4045-4998-87e3-3a250c909af5 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:16.586064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f152a1f9-4045-4998-87e3-3a250c909af5 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:16.586589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f152a1f9-4045-4998-87e3-3a250c909af5 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:16.735333 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f152a1f9-4045-4998-87e3-3a250c909af5 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0" status: 200 len: 325 microversion: 2.1 time: 0.234098 May 28 21:05:16.747178 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 357/695] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:05:16 2022] PUT /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0 => generated 325 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:05:16.747178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d7996cb8-4d18-4dd2-aabf-9dfe19f91b71 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:16.747178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d7996cb8-4d18-4dd2-aabf-9dfe19f91b71 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:16.767543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d7996cb8-4d18-4dd2-aabf-9dfe19f91b71 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:16.770979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d7996cb8-4d18-4dd2-aabf-9dfe19f91b71 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:16.772792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d7996cb8-4d18-4dd2-aabf-9dfe19f91b71 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:16.775433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d7996cb8-4d18-4dd2-aabf-9dfe19f91b71 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:17.175827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-71a8ab33-ac54-4c3f-a9f1-b706d98697d0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:17.202428 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-71a8ab33-ac54-4c3f-a9f1-b706d98697d0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1476 microversion: 2.1 time: 0.736141 May 28 21:05:17.203015 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 339/696] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:16 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1476 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:17.217437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-452379300", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:17.231688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d7996cb8-4d18-4dd2-aabf-9dfe19f91b71 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:17.245110 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d7996cb8-4d18-4dd2-aabf-9dfe19f91b71 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1310 microversion: 2.1 time: 0.504568 May 28 21:05:17.252148 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 358/697] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:16 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1310 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:17.259410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a85a8fe0-4f7c-46f8-9f8f-2e67855280b5 req-a4085230-9a52-4872-b843-3111e384da69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b8d752-edaa-40bc-b38f-1d1441231d82", "tag": "2f2ef26b-3762-4660-9c11-d7af1c1c3ef4"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:17.283240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a85a8fe0-4f7c-46f8-9f8f-2e67855280b5 req-a4085230-9a52-4872-b843-3111e384da69 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:17.283240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a85a8fe0-4f7c-46f8-9f8f-2e67855280b5 req-a4085230-9a52-4872-b843-3111e384da69 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:17.298245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:05:17.299056 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a85a8fe0-4f7c-46f8-9f8f-2e67855280b5 req-a4085230-9a52-4872-b843-3111e384da69 service nova] Creating event network-changed:2f2ef26b-3762-4660-9c11-d7af1c1c3ef4 for instance 45b8d752-edaa-40bc-b38f-1d1441231d82 on nch1-master-1 May 28 21:05:17.319803 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a85a8fe0-4f7c-46f8-9f8f-2e67855280b5 req-a4085230-9a52-4872-b843-3111e384da69 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066046 May 28 21:05:17.320341 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 359/698] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:17.325466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-18cb65c4-01af-423d-9548-361028f62230 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:17.326189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-18cb65c4-01af-423d-9548-361028f62230 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:17.334480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18cb65c4-01af-423d-9548-361028f62230 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:17.334932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18cb65c4-01af-423d-9548-361028f62230 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:17.335711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18cb65c4-01af-423d-9548-361028f62230 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:17.336140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18cb65c4-01af-423d-9548-361028f62230 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:17.717682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-18cb65c4-01af-423d-9548-361028f62230 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:17.729523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-18cb65c4-01af-423d-9548-361028f62230 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:17.731352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-18cb65c4-01af-423d-9548-361028f62230 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:17.732850 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-18cb65c4-01af-423d-9548-361028f62230 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1362 microversion: 2.25 time: 0.411339 May 28 21:05:17.746363 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 360/699] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:17 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1362 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:17.751779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4e7a5da3-1bda-4fe4-b2f7-e86be4cba439 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:17.753656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4e7a5da3-1bda-4fe4-b2f7-e86be4cba439 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:17.761080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e7a5da3-1bda-4fe4-b2f7-e86be4cba439 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:17.761662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e7a5da3-1bda-4fe4-b2f7-e86be4cba439 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:17.762723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e7a5da3-1bda-4fe4-b2f7-e86be4cba439 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:17.763279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e7a5da3-1bda-4fe4-b2f7-e86be4cba439 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:17.795031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:05:17.795606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:05:17.795944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:05:17.796381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:05:17.796788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:05:17.817940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:17.818406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:17.830928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:17.831400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:17.857262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Getting quotas for project df867107e50e446d8cbca00826c28cd0. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:05:17.862969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Getting quotas for user ff0177f6b0bc486d89d2bd33dcfb62d7 and project df867107e50e446d8cbca00826c28cd0. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:05:17.882441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.utils [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] ram quota exceeded for df867107e50e446d8cbca00826c28cd0, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=143129) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} May 28 21:05:17.883152 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Request method failure captured: May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 144 May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko6GGlZlhJnir74kgtr0fNtFlaA5IchK7-6XQ_lcHfBPN3wLEDOnpoy_vx5VGo186YConPky8aykwDFIhjiXMPDpRq14TgHTAu8gOAfT6Aih57pvkrozZ35QVs_wmsB2iuFFPPcLylKqzOrTs499Oe8RY0ufe4tzNlh3qjShGq8jljA May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: df867107e50e446d8cbca00826c28cd0 May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-QuotasAdminNegativeTest-1776620119 May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:05:17.885501 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:05:17.886889 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_df867107e50e446d8cbca00826c28cd0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df867107e50e446d8cbca00826c28cd0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/df867107e50e446d8cbca00826c28cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df867107e50e446d8cbca00826c28cd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:17.886889 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-QuotasAdminNegativeTest-1776620119 May 28 21:05:17.886889 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: df867107e50e446d8cbca00826c28cd0 May 28 21:05:17.886889 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1776620119 May 28 21:05:17.886889 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-QuotasAdminNegativeTest-1776620119-project May 28 21:05:17.886889 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:05:17.886889 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:05:17.886889 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ff0177f6b0bc486d89d2bd33dcfb62d7 May 28 21:05:17.886889 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-QuotasAdminNegativeTest-1776620119-project May 28 21:05:17.886889 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:05:17.886889 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-452379300", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} May 28 21:05:17.886889 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-452379300', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452'}}} May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 28 21:05:17.887657 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:17.888708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:17.891385 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:17.894337 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:17.894337 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:17.894337 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:05:17.894337 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:05:17.894337 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram May 28 21:05:17.894337 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:17.894337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:17.894337 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1a754d5d-01f8-45c7-9676-a5e4c32fad05 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.683103 May 28 21:05:17.894337 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 340/700] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:05:17 2022] POST /compute/v2.1/servers => generated 110 bytes in 684 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:05:17.896141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f9b4e316-94a3-444c-b08a-e12c65258d03 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:17.896141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f9b4e316-94a3-444c-b08a-e12c65258d03 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:17.914566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9b4e316-94a3-444c-b08a-e12c65258d03 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:17.916302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9b4e316-94a3-444c-b08a-e12c65258d03 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:17.918494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9b4e316-94a3-444c-b08a-e12c65258d03 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:17.918630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4e7a5da3-1bda-4fe4-b2f7-e86be4cba439 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:17.922048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9b4e316-94a3-444c-b08a-e12c65258d03 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:17.931111 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4e7a5da3-1bda-4fe4-b2f7-e86be4cba439 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1292 microversion: 2.1 time: 0.181273 May 28 21:05:17.944628 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 361/701] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:17 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1292 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:17.949913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1a8b0267-b760-4cdf-baf6-872b110e5f62 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Action: 'update', calling method: .version_select at 0x7f4d64464280>, body: {"quota_set": {"ram": 51200}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:18.120307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a8b0267-b760-4cdf-baf6-872b110e5f62 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:18.123676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a8b0267-b760-4cdf-baf6-872b110e5f62 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:18.125471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a8b0267-b760-4cdf-baf6-872b110e5f62 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:18.126231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a8b0267-b760-4cdf-baf6-872b110e5f62 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:18.212118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f9b4e316-94a3-444c-b08a-e12c65258d03 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:18.219844 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f9b4e316-94a3-444c-b08a-e12c65258d03 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1314 microversion: 2.1 time: 0.330498 May 28 21:05:18.220530 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 341/702] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:17 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:18.227622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-456a4ba8-87d0-465c-afdb-b8415ae9c21a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:18.228570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-456a4ba8-87d0-465c-afdb-b8415ae9c21a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:18.235710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-456a4ba8-87d0-465c-afdb-b8415ae9c21a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:18.236420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-456a4ba8-87d0-465c-afdb-b8415ae9c21a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:18.237214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-456a4ba8-87d0-465c-afdb-b8415ae9c21a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:18.237880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-456a4ba8-87d0-465c-afdb-b8415ae9c21a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:18.465285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-456a4ba8-87d0-465c-afdb-b8415ae9c21a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:18.474806 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-456a4ba8-87d0-465c-afdb-b8415ae9c21a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1476 microversion: 2.1 time: 0.252583 May 28 21:05:18.475724 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 342/703] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:18 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1476 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:18.481802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-798ba4b2-6e97-459b-bd86-e81650bc4b2e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:18.482465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-798ba4b2-6e97-459b-bd86-e81650bc4b2e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:18.488132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:18.491128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-798ba4b2-6e97-459b-bd86-e81650bc4b2e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:18.491831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-798ba4b2-6e97-459b-bd86-e81650bc4b2e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:18.492960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-798ba4b2-6e97-459b-bd86-e81650bc4b2e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:18.493419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-798ba4b2-6e97-459b-bd86-e81650bc4b2e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:18.714966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-798ba4b2-6e97-459b-bd86-e81650bc4b2e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:18.722520 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-798ba4b2-6e97-459b-bd86-e81650bc4b2e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1310 microversion: 2.1 time: 0.245143 May 28 21:05:18.725586 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 343/704] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:18 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1310 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:18.751205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6aa19140-30e2-4aa0-9910-9a9a9e871d0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:18.751847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6aa19140-30e2-4aa0-9910-9a9a9e871d0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:18.757667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6aa19140-30e2-4aa0-9910-9a9a9e871d0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:18.758154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6aa19140-30e2-4aa0-9910-9a9a9e871d0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:18.758913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6aa19140-30e2-4aa0-9910-9a9a9e871d0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:18.759354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6aa19140-30e2-4aa0-9910-9a9a9e871d0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:18.814656 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1a8b0267-b760-4cdf-baf6-872b110e5f62 tempest-QuotasAdminNegativeTest-441086635 tempest-QuotasAdminNegativeTest-441086635-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0" status: 200 len: 329 microversion: 2.1 time: 0.868391 May 28 21:05:18.821934 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 362/705] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:05:17 2022] PUT /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0 => generated 329 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:18.827937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c3eebb7-0566-48f4-809d-49d0f936d364 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Action: 'update', calling method: .version_select at 0x7f4d6455d160>, body: {"quota_set": {"ram": 0}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:18.830222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8c3eebb7-0566-48f4-809d-49d0f936d364 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'ff0177f6b0bc486d89d2bd33dcfb62d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df867107e50e446d8cbca00826c28cd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c3eebb7-0566-48f4-809d-49d0f936d364 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Request method failure captured: May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: request: PUT /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0 HTTP/1.1 May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 25 May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko6GGlZlhJnir74kgtr0fNtFlaA5IchK7-6XQ_lcHfBPN3wLEDOnpoy_vx5VGo186YConPky8aykwDFIhjiXMPDpRq14TgHTAu8gOAfT6Aih57pvkrozZ35QVs_wmsB2iuFFPPcLylKqzOrTs499Oe8RY0ufe4tzNlh3qjShGq8jljA May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: df867107e50e446d8cbca00826c28cd0 May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-QuotasAdminNegativeTest-1776620119 May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:05:18.833309 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:05:18.834857 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_df867107e50e446d8cbca00826c28cd0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df867107e50e446d8cbca00826c28cd0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/df867107e50e446d8cbca00826c28cd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/df867107e50e446d8cbca00826c28cd0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:18.834857 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-QuotasAdminNegativeTest-1776620119 May 28 21:05:18.834857 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: df867107e50e446d8cbca00826c28cd0 May 28 21:05:18.834857 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1776620119 May 28 21:05:18.834857 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-QuotasAdminNegativeTest-1776620119-project May 28 21:05:18.834857 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:05:18.834857 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:05:18.834857 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ff0177f6b0bc486d89d2bd33dcfb62d7 May 28 21:05:18.834857 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-QuotasAdminNegativeTest-1776620119-project May 28 21:05:18.834857 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:05:18.834857 ncdv-master-1 devstack@n-api.service[143128]: {"quota_set": {"ram": 0}} May 28 21:05:18.834857 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:05:18.834857 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 28 21:05:18.834857 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'df867107e50e446d8cbca00826c28cd0', 'body': {'quota_set': {'ram': 0}}} May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:05:18.835850 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:18.837143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:18.839498 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:18.839498 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:18.839498 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:05:18.839498 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:05:18.839498 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. May 28 21:05:18.839498 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:18.839498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c3eebb7-0566-48f4-809d-49d0f936d364 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:18.839498 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8c3eebb7-0566-48f4-809d-49d0f936d364 tempest-QuotasAdminNegativeTest-1776620119 tempest-QuotasAdminNegativeTest-1776620119-project] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0" status: 403 len: 116 microversion: 2.1 time: 0.013831 May 28 21:05:18.839498 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 363/706] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:05:18 2022] PUT /compute/v2.1/os-quota-sets/df867107e50e446d8cbca00826c28cd0 => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:05:18.948634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e3aecd24-c1db-49c0-ad62-8adf2a5d4de1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:18.949269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e3aecd24-c1db-49c0-ad62-8adf2a5d4de1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:18.965989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3aecd24-c1db-49c0-ad62-8adf2a5d4de1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:18.966717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3aecd24-c1db-49c0-ad62-8adf2a5d4de1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:18.973812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3aecd24-c1db-49c0-ad62-8adf2a5d4de1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:18.974530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3aecd24-c1db-49c0-ad62-8adf2a5d4de1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:18.983755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6aa19140-30e2-4aa0-9910-9a9a9e871d0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:19.050109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6aa19140-30e2-4aa0-9910-9a9a9e871d0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:19.064102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6aa19140-30e2-4aa0-9910-9a9a9e871d0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:19.081655 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6aa19140-30e2-4aa0-9910-9a9a9e871d0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1362 microversion: 2.25 time: 0.319560 May 28 21:05:19.082475 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 344/707] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:18 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:05:19.244755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f5731e5c-c8f7-4870-a707-bdc88c83f574 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:19.245824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f5731e5c-c8f7-4870-a707-bdc88c83f574 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:19.269849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5731e5c-c8f7-4870-a707-bdc88c83f574 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:19.280228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5731e5c-c8f7-4870-a707-bdc88c83f574 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:19.280228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5731e5c-c8f7-4870-a707-bdc88c83f574 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:19.280228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5731e5c-c8f7-4870-a707-bdc88c83f574 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:19.290442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e3aecd24-c1db-49c0-ad62-8adf2a5d4de1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:19.303907 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e3aecd24-c1db-49c0-ad62-8adf2a5d4de1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1322 microversion: 2.1 time: 0.361531 May 28 21:05:19.306721 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 364/708] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:18 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1322 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:19.492763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-efb144cd-0e68-4532-ad43-f3584da59931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:19.493798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-efb144cd-0e68-4532-ad43-f3584da59931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:19.505348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efb144cd-0e68-4532-ad43-f3584da59931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:19.505946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efb144cd-0e68-4532-ad43-f3584da59931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:19.506858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efb144cd-0e68-4532-ad43-f3584da59931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:19.512963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efb144cd-0e68-4532-ad43-f3584da59931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:19.739200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f5731e5c-c8f7-4870-a707-bdc88c83f574 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:19.758516 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f5731e5c-c8f7-4870-a707-bdc88c83f574 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1464 microversion: 2.1 time: 0.520005 May 28 21:05:19.761607 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 345/709] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:19 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1464 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:19.776030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ad171758-25b2-4c1c-a171-67a9b32f37d0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:19.776030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ad171758-25b2-4c1c-a171-67a9b32f37d0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:19.786208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad171758-25b2-4c1c-a171-67a9b32f37d0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:19.788656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad171758-25b2-4c1c-a171-67a9b32f37d0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:19.789714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad171758-25b2-4c1c-a171-67a9b32f37d0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:19.791470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad171758-25b2-4c1c-a171-67a9b32f37d0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:19.810354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-efb144cd-0e68-4532-ad43-f3584da59931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:19.820312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:19.824598 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-efb144cd-0e68-4532-ad43-f3584da59931 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1476 microversion: 2.1 time: 0.337055 May 28 21:05:19.825503 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 365/710] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:19 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1476 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:20.193981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1861f879-c7cd-4f0e-a028-97c905d48370 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:20.201043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1861f879-c7cd-4f0e-a028-97c905d48370 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Searching by: {'deleted': False, 'project_id': '1283a7c356b74d8086558ea4217b0d20'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:05:20.211626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:20.228784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ad171758-25b2-4c1c-a171-67a9b32f37d0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:20.229430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1861f879-c7cd-4f0e-a028-97c905d48370 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:20.231795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1861f879-c7cd-4f0e-a028-97c905d48370 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:20.233456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1861f879-c7cd-4f0e-a028-97c905d48370 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:20.234191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1861f879-c7cd-4f0e-a028-97c905d48370 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:20.237658 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ad171758-25b2-4c1c-a171-67a9b32f37d0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1310 microversion: 2.1 time: 0.474671 May 28 21:05:20.248667 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 346/711] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:19 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1310 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:20.253787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-293de3c8-1719-4076-a93f-7190f381165d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:20.255276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-293de3c8-1719-4076-a93f-7190f381165d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:20.263699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-293de3c8-1719-4076-a93f-7190f381165d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:20.272110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-293de3c8-1719-4076-a93f-7190f381165d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:20.273326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-293de3c8-1719-4076-a93f-7190f381165d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:20.273983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-293de3c8-1719-4076-a93f-7190f381165d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:20.378022 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1861f879-c7cd-4f0e-a028-97c905d48370 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.551224 May 28 21:05:20.379000 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 366/712] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:05:19 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:05:20.384986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-87c5c789-10c7-4444-8b0d-6f4e67dfe496 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:20.385919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-87c5c789-10c7-4444-8b0d-6f4e67dfe496 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:20.393520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87c5c789-10c7-4444-8b0d-6f4e67dfe496 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:20.394319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87c5c789-10c7-4444-8b0d-6f4e67dfe496 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:20.395353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87c5c789-10c7-4444-8b0d-6f4e67dfe496 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:20.395959 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87c5c789-10c7-4444-8b0d-6f4e67dfe496 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:20.626573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-293de3c8-1719-4076-a93f-7190f381165d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:20.640213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-293de3c8-1719-4076-a93f-7190f381165d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:20.641785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-293de3c8-1719-4076-a93f-7190f381165d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:20.646327 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-293de3c8-1719-4076-a93f-7190f381165d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1362 microversion: 2.25 time: 0.397235 May 28 21:05:20.647222 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 347/713] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:20 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1362 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:20.682217 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bd78d6db-ba82-429e-9fde-93329695f827 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:20.695818 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bd78d6db-ba82-429e-9fde-93329695f827 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Searching by: {'deleted': False} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:05:20.715471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-87c5c789-10c7-4444-8b0d-6f4e67dfe496 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:20.727695 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-87c5c789-10c7-4444-8b0d-6f4e67dfe496 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1322 microversion: 2.1 time: 0.346215 May 28 21:05:20.731217 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 367/714] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:20 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:20.733489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd78d6db-ba82-429e-9fde-93329695f827 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:20.737004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd78d6db-ba82-429e-9fde-93329695f827 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:20.739536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd78d6db-ba82-429e-9fde-93329695f827 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:20.742495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-e5a6b395-b515-4dee-8bcc-7dfe8b484daa req-b7a4890d-4313-487c-af73-ed148e44d20c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a538e54e-1c93-4369-baff-d514f9ce5eb7", "tag": "f8b668d3-2d67-4cc2-984f-30259dbe36a4"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:20.743209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd78d6db-ba82-429e-9fde-93329695f827 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:20.771590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e5a6b395-b515-4dee-8bcc-7dfe8b484daa req-b7a4890d-4313-487c-af73-ed148e44d20c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:20.772040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e5a6b395-b515-4dee-8bcc-7dfe8b484daa req-b7a4890d-4313-487c-af73-ed148e44d20c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:20.795726 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e5a6b395-b515-4dee-8bcc-7dfe8b484daa req-b7a4890d-4313-487c-af73-ed148e44d20c service nova] Creating event network-changed:f8b668d3-2d67-4cc2-984f-30259dbe36a4 for instance a538e54e-1c93-4369-baff-d514f9ce5eb7 on nch2-master-1 May 28 21:05:20.809476 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-e5a6b395-b515-4dee-8bcc-7dfe8b484daa req-b7a4890d-4313-487c-af73-ed148e44d20c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073887 May 28 21:05:20.810486 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 368/715] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:20.845808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1ae01fe4-150e-4d43-96b6-244b98c8b261 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:20.846550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1ae01fe4-150e-4d43-96b6-244b98c8b261 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:20.863100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ae01fe4-150e-4d43-96b6-244b98c8b261 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:20.863556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ae01fe4-150e-4d43-96b6-244b98c8b261 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:20.865196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ae01fe4-150e-4d43-96b6-244b98c8b261 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:20.865572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ae01fe4-150e-4d43-96b6-244b98c8b261 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:21.053660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-bd78d6db-ba82-429e-9fde-93329695f827 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Listed batch of 13 results from cell out of 1000 limit. Returned 13 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:05:21.152081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1ae01fe4-150e-4d43-96b6-244b98c8b261 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:21.172870 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1ae01fe4-150e-4d43-96b6-244b98c8b261 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1476 microversion: 2.1 time: 0.331484 May 28 21:05:21.174517 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 369/716] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:20 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1476 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:21.249804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=60 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:21.257294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2ad6fff6-cdd4-42b2-9509-67b804e682d6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:21.258339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2ad6fff6-cdd4-42b2-9509-67b804e682d6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:21.287445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ad6fff6-cdd4-42b2-9509-67b804e682d6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:21.289875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ad6fff6-cdd4-42b2-9509-67b804e682d6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:21.291089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ad6fff6-cdd4-42b2-9509-67b804e682d6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:21.291771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ad6fff6-cdd4-42b2-9509-67b804e682d6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:21.296522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd78d6db-ba82-429e-9fde-93329695f827 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:21.298175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd78d6db-ba82-429e-9fde-93329695f827 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:21.611530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2ad6fff6-cdd4-42b2-9509-67b804e682d6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:21.622920 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2ad6fff6-cdd4-42b2-9509-67b804e682d6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1310 microversion: 2.1 time: 0.371201 May 28 21:05:21.623868 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 370/717] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:21 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1310 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:21.629643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-6e8495fc-9ead-4f78-a80f-970ad9b40bab req-c10f3597-b40f-48f1-9fe6-0f1400f24ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502fcad4-754e-4627-96fa-80843f774f47", "name": "network-vif-plugged", "status": "completed", "tag": "4a538780-a868-4e2b-a232-0afe1eda360e"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:21.640219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6e8495fc-9ead-4f78-a80f-970ad9b40bab req-c10f3597-b40f-48f1-9fe6-0f1400f24ad0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:21.641063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6e8495fc-9ead-4f78-a80f-970ad9b40bab req-c10f3597-b40f-48f1-9fe6-0f1400f24ad0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:21.657459 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-6e8495fc-9ead-4f78-a80f-970ad9b40bab req-c10f3597-b40f-48f1-9fe6-0f1400f24ad0 service nova] Creating event network-vif-plugged:4a538780-a868-4e2b-a232-0afe1eda360e for instance 502fcad4-754e-4627-96fa-80843f774f47 on nch2-master-1 May 28 21:05:21.666007 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-6e8495fc-9ead-4f78-a80f-970ad9b40bab req-c10f3597-b40f-48f1-9fe6-0f1400f24ad0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040503 May 28 21:05:21.667426 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 371/718] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:21.675633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f9051ee9-f676-4db3-8474-4a4ad8f4e1d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:21.676463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f9051ee9-f676-4db3-8474-4a4ad8f4e1d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:21.683275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9051ee9-f676-4db3-8474-4a4ad8f4e1d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:21.684017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9051ee9-f676-4db3-8474-4a4ad8f4e1d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:21.684899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9051ee9-f676-4db3-8474-4a4ad8f4e1d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:21.685409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9051ee9-f676-4db3-8474-4a4ad8f4e1d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:21.921937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f9051ee9-f676-4db3-8474-4a4ad8f4e1d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:21.933296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f9051ee9-f676-4db3-8474-4a4ad8f4e1d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:21.934941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f9051ee9-f676-4db3-8474-4a4ad8f4e1d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:21.936094 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f9051ee9-f676-4db3-8474-4a4ad8f4e1d5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1362 microversion: 2.25 time: 0.267254 May 28 21:05:21.947031 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 372/719] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:21 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:21.950092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-99f85336-8b69-4463-99a8-8e572e072bef tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:21.952171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-99f85336-8b69-4463-99a8-8e572e072bef tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:21.971482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99f85336-8b69-4463-99a8-8e572e072bef tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:21.971861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99f85336-8b69-4463-99a8-8e572e072bef tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:21.972660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99f85336-8b69-4463-99a8-8e572e072bef tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:21.973152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99f85336-8b69-4463-99a8-8e572e072bef tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:22.108536 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bd78d6db-ba82-429e-9fde-93329695f827 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 20824 microversion: 2.1 time: 1.460026 May 28 21:05:22.121865 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 348/720] 10.222.0.33 () {58 vars in 1170 bytes} [Sat May 28 21:05:20 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 20824 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:05:22.142040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-20549eb8-031b-4870-9073-1eace3a05953 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:22.147406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-20549eb8-031b-4870-9073-1eace3a05953 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Searching by: {'deleted': False, 'project_id': '1283a7c356b74d8086558ea4217b0d20'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:05:22.155481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20549eb8-031b-4870-9073-1eace3a05953 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:22.155481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20549eb8-031b-4870-9073-1eace3a05953 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:22.155481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20549eb8-031b-4870-9073-1eace3a05953 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:22.155481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20549eb8-031b-4870-9073-1eace3a05953 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:22.187383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=21 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:22.215020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-99f85336-8b69-4463-99a8-8e572e072bef tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:22.224877 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-99f85336-8b69-4463-99a8-8e572e072bef tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1322 microversion: 2.1 time: 0.278477 May 28 21:05:22.225471 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 373/721] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:21 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1322 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:22.239823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7a8da554-8f97-466a-b7a0-3eabea549658 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:22.240433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7a8da554-8f97-466a-b7a0-3eabea549658 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:22.247610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a8da554-8f97-466a-b7a0-3eabea549658 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:22.248070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a8da554-8f97-466a-b7a0-3eabea549658 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:22.248779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a8da554-8f97-466a-b7a0-3eabea549658 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:22.249213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a8da554-8f97-466a-b7a0-3eabea549658 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:22.260072 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-20549eb8-031b-4870-9073-1eace3a05953 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?tenant_id=56e1dc5556624e2fb8de8a030c34c334" status: 200 len: 15 microversion: 2.1 time: 0.122068 May 28 21:05:22.261975 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 349/722] 10.222.0.33 () {58 vars in 1230 bytes} [Sat May 28 21:05:22 2022] GET /compute/v2.1/servers/detail?tenant_id=56e1dc5556624e2fb8de8a030c34c334 => generated 15 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 21:05:22.278813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a423c55a-67fb-4870-a5ad-5a96dbfaf0df tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:22.285055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a423c55a-67fb-4870-a5ad-5a96dbfaf0df tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Searching by: {'tenant_id': '56e1dc5556624e2fb8de8a030c34c334', 'deleted': False} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:05:22.290751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a423c55a-67fb-4870-a5ad-5a96dbfaf0df tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:22.291291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a423c55a-67fb-4870-a5ad-5a96dbfaf0df tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:22.292345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a423c55a-67fb-4870-a5ad-5a96dbfaf0df tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:22.292990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a423c55a-67fb-4870-a5ad-5a96dbfaf0df tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:22.334530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-a423c55a-67fb-4870-a5ad-5a96dbfaf0df tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:05:22.421704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7a8da554-8f97-466a-b7a0-3eabea549658 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:22.437587 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7a8da554-8f97-466a-b7a0-3eabea549658 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1476 microversion: 2.1 time: 0.200603 May 28 21:05:22.438294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a423c55a-67fb-4870-a5ad-5a96dbfaf0df tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:22.438821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a423c55a-67fb-4870-a5ad-5a96dbfaf0df tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:22.439264 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 374/723] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:22 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1476 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:22.580070 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a423c55a-67fb-4870-a5ad-5a96dbfaf0df tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=56e1dc5556624e2fb8de8a030c34c334" status: 200 len: 4826 microversion: 2.1 time: 0.306014 May 28 21:05:22.581087 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 350/724] 10.222.0.33 () {58 vars in 1256 bytes} [Sat May 28 21:05:22 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=56e1dc5556624e2fb8de8a030c34c334 => generated 4826 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:22.600479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bb4335c0-620b-45c7-9bcb-909fb723d3db tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:22.608513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bb4335c0-620b-45c7-9bcb-909fb723d3db tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Searching by: {'tenant_id': '1283a7c356b74d8086558ea4217b0d20', 'deleted': False} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:05:22.625056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb4335c0-620b-45c7-9bcb-909fb723d3db tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:22.625056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb4335c0-620b-45c7-9bcb-909fb723d3db tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:22.625056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb4335c0-620b-45c7-9bcb-909fb723d3db tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:22.625056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb4335c0-620b-45c7-9bcb-909fb723d3db tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:22.641071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eed9876a-3529-46d3-a1d0-e46cc207d677 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:22.641793 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eed9876a-3529-46d3-a1d0-e46cc207d677 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:22.652226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eed9876a-3529-46d3-a1d0-e46cc207d677 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:22.652688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eed9876a-3529-46d3-a1d0-e46cc207d677 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:22.653826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eed9876a-3529-46d3-a1d0-e46cc207d677 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:22.654488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eed9876a-3529-46d3-a1d0-e46cc207d677 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:22.658518 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bb4335c0-620b-45c7-9bcb-909fb723d3db tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1283a7c356b74d8086558ea4217b0d20" status: 200 len: 15 microversion: 2.1 time: 0.062266 May 28 21:05:22.669864 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 375/725] 10.222.0.33 () {58 vars in 1256 bytes} [Sat May 28 21:05:22 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1283a7c356b74d8086558ea4217b0d20 => generated 15 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:05:22.676983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fb6d90cb-5636-453e-b255-93a4e3b27f04 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:22.681139 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fb6d90cb-5636-453e-b255-93a4e3b27f04 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.008394 May 28 21:05:22.682547 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 376/726] 10.222.0.33 () {58 vars in 1188 bytes} [Sat May 28 21:05:22 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 21:05:22.702064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-381c55c3-fa3d-4daf-9b25-37c6cc1b0570 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:22.705431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-381c55c3-fa3d-4daf-9b25-37c6cc1b0570 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:22.717992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-381c55c3-fa3d-4daf-9b25-37c6cc1b0570 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:22.718462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-381c55c3-fa3d-4daf-9b25-37c6cc1b0570 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:22.719246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-381c55c3-fa3d-4daf-9b25-37c6cc1b0570 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:22.719864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-381c55c3-fa3d-4daf-9b25-37c6cc1b0570 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:22.920709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eed9876a-3529-46d3-a1d0-e46cc207d677 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:22.941916 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eed9876a-3529-46d3-a1d0-e46cc207d677 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1310 microversion: 2.1 time: 0.298028 May 28 21:05:22.942491 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 351/727] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:22 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1310 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:22.954566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-33b7d5ac-cfcd-4765-b455-0307e94b33ef tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:22.955190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-33b7d5ac-cfcd-4765-b455-0307e94b33ef tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:22.965810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33b7d5ac-cfcd-4765-b455-0307e94b33ef tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:22.968683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33b7d5ac-cfcd-4765-b455-0307e94b33ef tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:22.970066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33b7d5ac-cfcd-4765-b455-0307e94b33ef tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:22.970565 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33b7d5ac-cfcd-4765-b455-0307e94b33ef tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:23.204350 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-381c55c3-fa3d-4daf-9b25-37c6cc1b0570 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec/action" status: 202 len: 0 microversion: 2.1 time: 0.508018 May 28 21:05:23.206579 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 377/728] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:05:22 2022] POST /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:05:23.220508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-838fca87-cb11-47a4-81a3-edced6ff1519 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:23.224487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-33b7d5ac-cfcd-4765-b455-0307e94b33ef tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:23.234674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-838fca87-cb11-47a4-81a3-edced6ff1519 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:23.235421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-838fca87-cb11-47a4-81a3-edced6ff1519 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '56e1dc5556624e2fb8de8a030c34c334'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:05:23.241493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-33b7d5ac-cfcd-4765-b455-0307e94b33ef tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:23.243526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-33b7d5ac-cfcd-4765-b455-0307e94b33ef tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:23.246738 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-33b7d5ac-cfcd-4765-b455-0307e94b33ef tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1362 microversion: 2.25 time: 0.294622 May 28 21:05:23.257901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-838fca87-cb11-47a4-81a3-edced6ff1519 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:23.257901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-838fca87-cb11-47a4-81a3-edced6ff1519 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:23.258213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-838fca87-cb11-47a4-81a3-edced6ff1519 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:23.259185 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 352/729] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:22 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1362 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:05:23.260851 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-838fca87-cb11-47a4-81a3-edced6ff1519 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:23.265614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-739043da-eee1-4516-9511-5faa8a2ea0ca tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:23.267895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-739043da-eee1-4516-9511-5faa8a2ea0ca tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:23.276382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-739043da-eee1-4516-9511-5faa8a2ea0ca tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:23.277184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-739043da-eee1-4516-9511-5faa8a2ea0ca tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:23.278341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-739043da-eee1-4516-9511-5faa8a2ea0ca tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:23.279452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-739043da-eee1-4516-9511-5faa8a2ea0ca tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:23.282723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:23.420802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-838fca87-cb11-47a4-81a3-edced6ff1519 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:05:23.532343 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-838fca87-cb11-47a4-81a3-edced6ff1519 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.320632 May 28 21:05:23.533683 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 378/730] 10.222.0.33 () {58 vars in 1149 bytes} [Sat May 28 21:05:23 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:05:23.538828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-72c2b81e-76d4-4459-9437-eb6db3b1255f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:23.539635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-72c2b81e-76d4-4459-9437-eb6db3b1255f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:23.546417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72c2b81e-76d4-4459-9437-eb6db3b1255f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:23.547105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72c2b81e-76d4-4459-9437-eb6db3b1255f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:23.548069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72c2b81e-76d4-4459-9437-eb6db3b1255f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:23.548692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72c2b81e-76d4-4459-9437-eb6db3b1255f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:23.549451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-739043da-eee1-4516-9511-5faa8a2ea0ca tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:23.566644 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-739043da-eee1-4516-9511-5faa8a2ea0ca tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1322 microversion: 2.1 time: 0.305425 May 28 21:05:23.585565 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 353/731] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:23 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1322 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:23.591517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3ff5f622-71e6-44bd-a583-052e982d8cb4 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:23.595396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3ff5f622-71e6-44bd-a583-052e982d8cb4 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:23.607909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ff5f622-71e6-44bd-a583-052e982d8cb4 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:23.612892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ff5f622-71e6-44bd-a583-052e982d8cb4 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:23.614322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ff5f622-71e6-44bd-a583-052e982d8cb4 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:23.614954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ff5f622-71e6-44bd-a583-052e982d8cb4 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:23.782449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-72c2b81e-76d4-4459-9437-eb6db3b1255f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:23.792902 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-72c2b81e-76d4-4459-9437-eb6db3b1255f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1476 microversion: 2.1 time: 0.257814 May 28 21:05:23.795058 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 379/732] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:23 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1476 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:23.802289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-3b9195d2-8425-47ce-8a7c-3543908bfcc7 req-dc300b10-c7bf-4576-9e69-8e07ff343747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b8d752-edaa-40bc-b38f-1d1441231d82", "name": "network-vif-plugged", "status": "completed", "tag": "2f2ef26b-3762-4660-9c11-d7af1c1c3ef4"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:23.814045 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3b9195d2-8425-47ce-8a7c-3543908bfcc7 req-dc300b10-c7bf-4576-9e69-8e07ff343747 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:23.814847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3b9195d2-8425-47ce-8a7c-3543908bfcc7 req-dc300b10-c7bf-4576-9e69-8e07ff343747 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:23.830175 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-3b9195d2-8425-47ce-8a7c-3543908bfcc7 req-dc300b10-c7bf-4576-9e69-8e07ff343747 service nova] Creating event network-vif-plugged:2f2ef26b-3762-4660-9c11-d7af1c1c3ef4 for instance 45b8d752-edaa-40bc-b38f-1d1441231d82 on nch1-master-1 May 28 21:05:23.837558 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-3b9195d2-8425-47ce-8a7c-3543908bfcc7 req-dc300b10-c7bf-4576-9e69-8e07ff343747 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040183 May 28 21:05:23.837558 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 380/733] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:23.966597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aa659ee6-b06f-4b17-a87a-e48a83fbf7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:23.970181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aa659ee6-b06f-4b17-a87a-e48a83fbf7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:23.981495 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3ff5f622-71e6-44bd-a583-052e982d8cb4 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec/action" status: 202 len: 0 microversion: 2.1 time: 0.394173 May 28 21:05:23.982652 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 354/734] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:05:23 2022] POST /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:05:23.983255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa659ee6-b06f-4b17-a87a-e48a83fbf7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:23.983754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa659ee6-b06f-4b17-a87a-e48a83fbf7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:23.984716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa659ee6-b06f-4b17-a87a-e48a83fbf7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:23.985381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa659ee6-b06f-4b17-a87a-e48a83fbf7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:23.991555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-82c5d30f-f015-44c1-ba2c-ee49f3a012e2 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:23.992346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-82c5d30f-f015-44c1-ba2c-ee49f3a012e2 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:24.006070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82c5d30f-f015-44c1-ba2c-ee49f3a012e2 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:24.006070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82c5d30f-f015-44c1-ba2c-ee49f3a012e2 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:24.006395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82c5d30f-f015-44c1-ba2c-ee49f3a012e2 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:24.006682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82c5d30f-f015-44c1-ba2c-ee49f3a012e2 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:24.417773 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-82c5d30f-f015-44c1-ba2c-ee49f3a012e2 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1614 microversion: 2.1 time: 0.430901 May 28 21:05:24.418436 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 355/735] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:23 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1614 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:24.424521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aa659ee6-b06f-4b17-a87a-e48a83fbf7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:24.426899 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bb63cfc5-5fc4-48e9-a0c5-e45eb8ef602c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:24.427713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bb63cfc5-5fc4-48e9-a0c5-e45eb8ef602c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:24.434605 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aa659ee6-b06f-4b17-a87a-e48a83fbf7fd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1310 microversion: 2.1 time: 0.477201 May 28 21:05:24.435205 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 381/736] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:23 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1310 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:24.435933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb63cfc5-5fc4-48e9-a0c5-e45eb8ef602c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:24.436458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb63cfc5-5fc4-48e9-a0c5-e45eb8ef602c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:24.437453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb63cfc5-5fc4-48e9-a0c5-e45eb8ef602c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:24.437931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb63cfc5-5fc4-48e9-a0c5-e45eb8ef602c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:24.439654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b84e8c68-c3dd-4c63-ba32-97b85d1d1f93 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:24.440558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b84e8c68-c3dd-4c63-ba32-97b85d1d1f93 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:24.446500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b84e8c68-c3dd-4c63-ba32-97b85d1d1f93 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:24.447132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b84e8c68-c3dd-4c63-ba32-97b85d1d1f93 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:24.448063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b84e8c68-c3dd-4c63-ba32-97b85d1d1f93 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:24.448497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b84e8c68-c3dd-4c63-ba32-97b85d1d1f93 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:24.672905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bb63cfc5-5fc4-48e9-a0c5-e45eb8ef602c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:24.690736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bb63cfc5-5fc4-48e9-a0c5-e45eb8ef602c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:24.692287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bb63cfc5-5fc4-48e9-a0c5-e45eb8ef602c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:24.697721 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b84e8c68-c3dd-4c63-ba32-97b85d1d1f93 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1614 microversion: 2.1 time: 0.261282 May 28 21:05:24.711273 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 382/737] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:24 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1614 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:24.711273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6ef86ee4-c169-4147-bcfe-eb683df3aadf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:24.711273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6ef86ee4-c169-4147-bcfe-eb683df3aadf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:24.711993 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bb63cfc5-5fc4-48e9-a0c5-e45eb8ef602c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1362 microversion: 2.25 time: 0.282195 May 28 21:05:24.711993 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 356/738] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:24 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1362 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:24.717472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bf5595c3-a34d-4cf3-99c5-34c2e8ca4b82 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:24.719252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ef86ee4-c169-4147-bcfe-eb683df3aadf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:24.719907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ef86ee4-c169-4147-bcfe-eb683df3aadf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:24.720852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ef86ee4-c169-4147-bcfe-eb683df3aadf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:24.721446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ef86ee4-c169-4147-bcfe-eb683df3aadf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:24.726324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bf5595c3-a34d-4cf3-99c5-34c2e8ca4b82 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:05:24.737354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf5595c3-a34d-4cf3-99c5-34c2e8ca4b82 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:24.737819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf5595c3-a34d-4cf3-99c5-34c2e8ca4b82 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:24.744401 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf5595c3-a34d-4cf3-99c5-34c2e8ca4b82 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:24.746074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf5595c3-a34d-4cf3-99c5-34c2e8ca4b82 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:24.931265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-bf5595c3-a34d-4cf3-99c5-34c2e8ca4b82 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:05:24.999557 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6ef86ee4-c169-4147-bcfe-eb683df3aadf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:25.009513 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6ef86ee4-c169-4147-bcfe-eb683df3aadf tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1322 microversion: 2.1 time: 0.308915 May 28 21:05:25.011100 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bf5595c3-a34d-4cf3-99c5-34c2e8ca4b82 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 2646 microversion: 2.1 time: 0.298653 May 28 21:05:25.011220 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 383/739] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:24 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:25.023240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1ee2e56c-e296-4ea0-ac07-8e70f8184ca0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:25.025672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1ee2e56c-e296-4ea0-ac07-8e70f8184ca0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:25.025902 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 357/740] 10.222.0.33 () {58 vars in 1189 bytes} [Sat May 28 21:05:24 2022] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 2646 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:25.035704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ee2e56c-e296-4ea0-ac07-8e70f8184ca0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:25.038247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ee2e56c-e296-4ea0-ac07-8e70f8184ca0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:25.038396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-62116280-9497-4d5d-9b87-e17c528e55c6 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:25.039203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ee2e56c-e296-4ea0-ac07-8e70f8184ca0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:25.039662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ee2e56c-e296-4ea0-ac07-8e70f8184ca0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:25.065381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-62116280-9497-4d5d-9b87-e17c528e55c6 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:05:25.079743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62116280-9497-4d5d-9b87-e17c528e55c6 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:25.080497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62116280-9497-4d5d-9b87-e17c528e55c6 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:25.081606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62116280-9497-4d5d-9b87-e17c528e55c6 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:25.083570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62116280-9497-4d5d-9b87-e17c528e55c6 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:25.125360 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-62116280-9497-4d5d-9b87-e17c528e55c6 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.091626 May 28 21:05:25.126016 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 358/741] 10.222.0.33 () {58 vars in 1195 bytes} [Sat May 28 21:05:25 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 21:05:25.139604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a41083e5-d9d1-4001-b0df-d13147f42fd5 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:25.140456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a41083e5-d9d1-4001-b0df-d13147f42fd5 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:25.147361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a41083e5-d9d1-4001-b0df-d13147f42fd5 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:25.147823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a41083e5-d9d1-4001-b0df-d13147f42fd5 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:25.148612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a41083e5-d9d1-4001-b0df-d13147f42fd5 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:25.149206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a41083e5-d9d1-4001-b0df-d13147f42fd5 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:25.248753 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1ee2e56c-e296-4ea0-ac07-8e70f8184ca0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:25.263738 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1ee2e56c-e296-4ea0-ac07-8e70f8184ca0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1476 microversion: 2.1 time: 0.249635 May 28 21:05:25.264364 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 384/742] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:25 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1476 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:25.453381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2601366f-15ea-48f7-ba1e-cfd1748e8eec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:25.456214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2601366f-15ea-48f7-ba1e-cfd1748e8eec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:25.474390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2601366f-15ea-48f7-ba1e-cfd1748e8eec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:25.476696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2601366f-15ea-48f7-ba1e-cfd1748e8eec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:25.480905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2601366f-15ea-48f7-ba1e-cfd1748e8eec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:25.481899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2601366f-15ea-48f7-ba1e-cfd1748e8eec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:25.498931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:25.564908 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a41083e5-d9d1-4001-b0df-d13147f42fd5 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec/action" status: 202 len: 0 microversion: 2.1 time: 0.429230 May 28 21:05:25.566741 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 359/743] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:05:25 2022] POST /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:05:25.583981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:25.585651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:25.593340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:25.594503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:25.595453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:25.596372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:25.739566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2601366f-15ea-48f7-ba1e-cfd1748e8eec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:25.744357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:05:25.744800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:05:25.745283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:05:25.745699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:05:25.746146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:05:25.750526 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2601366f-15ea-48f7-ba1e-cfd1748e8eec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1310 microversion: 2.1 time: 0.302379 May 28 21:05:25.752641 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 385/744] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:25 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1310 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:25.768483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9f40f1fe-aa94-4849-91ec-03a9ced0ed91 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:25.772272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9f40f1fe-aa94-4849-91ec-03a9ced0ed91 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:25.778256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f40f1fe-aa94-4849-91ec-03a9ced0ed91 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:25.778744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f40f1fe-aa94-4849-91ec-03a9ced0ed91 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:25.779522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f40f1fe-aa94-4849-91ec-03a9ced0ed91 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:25.779962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f40f1fe-aa94-4849-91ec-03a9ced0ed91 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:25.959583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9f40f1fe-aa94-4849-91ec-03a9ced0ed91 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:25.970460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9f40f1fe-aa94-4849-91ec-03a9ced0ed91 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:25.972564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9f40f1fe-aa94-4849-91ec-03a9ced0ed91 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:25.974830 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9f40f1fe-aa94-4849-91ec-03a9ced0ed91 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1557 microversion: 2.25 time: 0.217714 May 28 21:05:25.975778 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 386/745] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:25 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1557 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:25.997333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8e2bd283-2384-4419-bd0c-41f787f4e8e8 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:25.997975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8e2bd283-2384-4419-bd0c-41f787f4e8e8 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:26.008360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e2bd283-2384-4419-bd0c-41f787f4e8e8 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:26.008857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e2bd283-2384-4419-bd0c-41f787f4e8e8 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:26.009960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e2bd283-2384-4419-bd0c-41f787f4e8e8 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:26.010151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e2bd283-2384-4419-bd0c-41f787f4e8e8 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:26.031900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:26.046523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:26.048201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:26.049138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:26.049603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:26.088916 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1d8f63d8-9900-46fd-81d7-26cc102b5bc8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "POST /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec/action" status: 202 len: 1067 microversion: 2.1 time: 0.513309 May 28 21:05:26.089948 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 360/746] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:05:25 2022] POST /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec/action => generated 1067 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 28 21:05:26.095026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5cfa86b3-7e8e-43bd-90c9-95856c42f7d1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:26.096550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5cfa86b3-7e8e-43bd-90c9-95856c42f7d1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:26.105324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cfa86b3-7e8e-43bd-90c9-95856c42f7d1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:26.109625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cfa86b3-7e8e-43bd-90c9-95856c42f7d1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:26.109625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cfa86b3-7e8e-43bd-90c9-95856c42f7d1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:26.109625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cfa86b3-7e8e-43bd-90c9-95856c42f7d1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:26.293336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-8e2bd283-2384-4419-bd0c-41f787f4e8e8 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'services' on Instance uuid 502fcad4-754e-4627-96fa-80843f774f47 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:05:26.324729 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8e2bd283-2384-4419-bd0c-41f787f4e8e8 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 2050 microversion: 2.25 time: 0.332025 May 28 21:05:26.325340 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 387/747] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:25 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 2050 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:05:26.335457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c4b844b6-75d6-40f7-ac6c-0cc761b6c5e2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:26.336163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c4b844b6-75d6-40f7-ac6c-0cc761b6c5e2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:26.355276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4b844b6-75d6-40f7-ac6c-0cc761b6c5e2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:26.355637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4b844b6-75d6-40f7-ac6c-0cc761b6c5e2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:26.356455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4b844b6-75d6-40f7-ac6c-0cc761b6c5e2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:26.356904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4b844b6-75d6-40f7-ac6c-0cc761b6c5e2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:26.396351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5cfa86b3-7e8e-43bd-90c9-95856c42f7d1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:26.418479 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5cfa86b3-7e8e-43bd-90c9-95856c42f7d1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1322 microversion: 2.1 time: 0.325128 May 28 21:05:26.419752 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 361/748] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:26 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:26.445159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-4bbefeac-fe48-48cc-9137-8313b1a21ba9 req-51954c25-538a-4894-993a-aa48f469e2fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "569b037d-ace0-4ce6-8182-ddac69d2b2e2", "name": "network-vif-unplugged", "status": "completed", "tag": "04dfc232-ea06-4928-bc0e-827e83fc3bda"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:26.498827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4bbefeac-fe48-48cc-9137-8313b1a21ba9 req-51954c25-538a-4894-993a-aa48f469e2fe service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:26.499400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4bbefeac-fe48-48cc-9137-8313b1a21ba9 req-51954c25-538a-4894-993a-aa48f469e2fe service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:26.531428 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-4bbefeac-fe48-48cc-9137-8313b1a21ba9 req-51954c25-538a-4894-993a-aa48f469e2fe service nova] Creating event network-vif-unplugged:04dfc232-ea06-4928-bc0e-827e83fc3bda for instance 569b037d-ace0-4ce6-8182-ddac69d2b2e2 on nch2-master-1 May 28 21:05:26.544011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-4bbefeac-fe48-48cc-9137-8313b1a21ba9 req-51954c25-538a-4894-993a-aa48f469e2fe service nova] Instance 569b037d-ace0-4ce6-8182-ddac69d2b2e2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:05:26.561953 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-4bbefeac-fe48-48cc-9137-8313b1a21ba9 req-51954c25-538a-4894-993a-aa48f469e2fe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136245 May 28 21:05:26.562699 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 362/749] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:26.586071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-303027c3-2fed-4e78-92e5-5da24ef507e7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:26.589583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-303027c3-2fed-4e78-92e5-5da24ef507e7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:26.603262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c4b844b6-75d6-40f7-ac6c-0cc761b6c5e2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:26.614992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-303027c3-2fed-4e78-92e5-5da24ef507e7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:26.615523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-303027c3-2fed-4e78-92e5-5da24ef507e7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:26.616024 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c4b844b6-75d6-40f7-ac6c-0cc761b6c5e2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1471 microversion: 2.1 time: 0.287869 May 28 21:05:26.616929 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 388/750] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:26 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:26.619731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-303027c3-2fed-4e78-92e5-5da24ef507e7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:26.620354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-303027c3-2fed-4e78-92e5-5da24ef507e7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:26.626736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4fe46522-98c4-4a71-8200-88cccce37294 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:26.633465 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:05:26.633465 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:05:26.635819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fe46522-98c4-4a71-8200-88cccce37294 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:26.637760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fe46522-98c4-4a71-8200-88cccce37294 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:26.640406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fe46522-98c4-4a71-8200-88cccce37294 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:26.641741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fe46522-98c4-4a71-8200-88cccce37294 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:26.657512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=26 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:26.698676 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4fe46522-98c4-4a71-8200-88cccce37294 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.077863 May 28 21:05:26.699750 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 389/751] 10.222.0.33 () {60 vars in 1216 bytes} [Sat May 28 21:05:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:05:26.773250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f2693dfb-2e46-4839-838d-f8515dcbbe56 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:26.782015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f2693dfb-2e46-4839-838d-f8515dcbbe56 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:26.798955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2693dfb-2e46-4839-838d-f8515dcbbe56 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:26.800257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2693dfb-2e46-4839-838d-f8515dcbbe56 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:26.801286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2693dfb-2e46-4839-838d-f8515dcbbe56 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:26.805377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2693dfb-2e46-4839-838d-f8515dcbbe56 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:26.928868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-303027c3-2fed-4e78-92e5-5da24ef507e7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:26.940356 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-303027c3-2fed-4e78-92e5-5da24ef507e7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1475 microversion: 2.1 time: 0.376335 May 28 21:05:26.944370 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 363/752] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:26 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1475 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:26.962774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-80897ea9-b129-448e-9cfd-33100189c809 req-775878bd-4649-45ce-9654-80fb628c9e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a538e54e-1c93-4369-baff-d514f9ce5eb7", "name": "network-vif-plugged", "status": "completed", "tag": "f8b668d3-2d67-4cc2-984f-30259dbe36a4"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:27.006393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-80897ea9-b129-448e-9cfd-33100189c809 req-775878bd-4649-45ce-9654-80fb628c9e86 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:27.006703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-80897ea9-b129-448e-9cfd-33100189c809 req-775878bd-4649-45ce-9654-80fb628c9e86 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:27.046836 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-80897ea9-b129-448e-9cfd-33100189c809 req-775878bd-4649-45ce-9654-80fb628c9e86 service nova] Creating event network-vif-plugged:f8b668d3-2d67-4cc2-984f-30259dbe36a4 for instance a538e54e-1c93-4369-baff-d514f9ce5eb7 on nch2-master-1 May 28 21:05:27.083697 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-80897ea9-b129-448e-9cfd-33100189c809 req-775878bd-4649-45ce-9654-80fb628c9e86 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136473 May 28 21:05:27.085608 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 364/753] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:27.229737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f2693dfb-2e46-4839-838d-f8515dcbbe56 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:27.245772 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f2693dfb-2e46-4839-838d-f8515dcbbe56 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1492 microversion: 2.1 time: 0.480978 May 28 21:05:27.256542 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 390/754] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:26 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1492 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:27.267787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-600cfea8-52a9-47dd-9eee-3311d8d44661 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:27.269013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-600cfea8-52a9-47dd-9eee-3311d8d44661 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:27.297521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-600cfea8-52a9-47dd-9eee-3311d8d44661 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:27.298170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-600cfea8-52a9-47dd-9eee-3311d8d44661 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:27.299037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-600cfea8-52a9-47dd-9eee-3311d8d44661 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:27.299424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-600cfea8-52a9-47dd-9eee-3311d8d44661 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:27.448139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6e3eb240-595f-4aa1-9cd6-17b1a9daf8fb tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:27.453114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6e3eb240-595f-4aa1-9cd6-17b1a9daf8fb tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:27.516304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e3eb240-595f-4aa1-9cd6-17b1a9daf8fb tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:27.523732 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e3eb240-595f-4aa1-9cd6-17b1a9daf8fb tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:27.524615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e3eb240-595f-4aa1-9cd6-17b1a9daf8fb tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:27.525055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e3eb240-595f-4aa1-9cd6-17b1a9daf8fb tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:27.810104 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-600cfea8-52a9-47dd-9eee-3311d8d44661 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1643 microversion: 2.1 time: 0.550627 May 28 21:05:27.825628 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 365/755] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:27 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1643 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:27.852574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c3ce9fe4-6c0e-4dad-86c9-60950c854888 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:27.856244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c3ce9fe4-6c0e-4dad-86c9-60950c854888 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:27.893024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3ce9fe4-6c0e-4dad-86c9-60950c854888 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:27.893639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3ce9fe4-6c0e-4dad-86c9-60950c854888 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:27.894396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3ce9fe4-6c0e-4dad-86c9-60950c854888 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:27.894881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3ce9fe4-6c0e-4dad-86c9-60950c854888 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:27.909339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:28.214596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6e3eb240-595f-4aa1-9cd6-17b1a9daf8fb tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:28.231815 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6e3eb240-595f-4aa1-9cd6-17b1a9daf8fb tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1322 microversion: 2.1 time: 0.796598 May 28 21:05:28.232798 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 391/756] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:27 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1322 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:28.243245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8e420713-fcc0-4612-8124-b32f996d72e1 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:28.251135 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8e420713-fcc0-4612-8124-b32f996d72e1 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:28.258684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e420713-fcc0-4612-8124-b32f996d72e1 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:28.262479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e420713-fcc0-4612-8124-b32f996d72e1 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:28.263514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e420713-fcc0-4612-8124-b32f996d72e1 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:28.265248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e420713-fcc0-4612-8124-b32f996d72e1 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:28.405199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c3ce9fe4-6c0e-4dad-86c9-60950c854888 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:28.421344 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c3ce9fe4-6c0e-4dad-86c9-60950c854888 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1471 microversion: 2.1 time: 0.590755 May 28 21:05:28.421694 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 366/757] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:27 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1471 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:28.432228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-61411f4c-b4cd-4299-ad7c-f3a6b6876983 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:28.436280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-61411f4c-b4cd-4299-ad7c-f3a6b6876983 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:28.450123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61411f4c-b4cd-4299-ad7c-f3a6b6876983 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:28.450649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61411f4c-b4cd-4299-ad7c-f3a6b6876983 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:28.453618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61411f4c-b4cd-4299-ad7c-f3a6b6876983 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:28.454240 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61411f4c-b4cd-4299-ad7c-f3a6b6876983 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:28.805424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=78 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:28.835944 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8e420713-fcc0-4612-8124-b32f996d72e1 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1643 microversion: 2.1 time: 0.601616 May 28 21:05:28.836809 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 392/758] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:28 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1643 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:28.851381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-35e30ea2-b35a-460a-a34e-f626b054011e req-cf966eca-1b9a-444f-b152-1e84667c8ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "569b037d-ace0-4ce6-8182-ddac69d2b2e2", "tag": "04dfc232-ea06-4928-bc0e-827e83fc3bda"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:28.866751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-35e30ea2-b35a-460a-a34e-f626b054011e req-cf966eca-1b9a-444f-b152-1e84667c8ca4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:28.870744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-35e30ea2-b35a-460a-a34e-f626b054011e req-cf966eca-1b9a-444f-b152-1e84667c8ca4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:28.900715 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-35e30ea2-b35a-460a-a34e-f626b054011e req-cf966eca-1b9a-444f-b152-1e84667c8ca4 service nova] Creating event network-changed:04dfc232-ea06-4928-bc0e-827e83fc3bda for instance 569b037d-ace0-4ce6-8182-ddac69d2b2e2 on nch2-master-1 May 28 21:05:28.916984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-35e30ea2-b35a-460a-a34e-f626b054011e req-cf966eca-1b9a-444f-b152-1e84667c8ca4 service nova] Instance 569b037d-ace0-4ce6-8182-ddac69d2b2e2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:05:28.927625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-61411f4c-b4cd-4299-ad7c-f3a6b6876983 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:28.938012 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-61411f4c-b4cd-4299-ad7c-f3a6b6876983 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1475 microversion: 2.1 time: 0.515171 May 28 21:05:28.943280 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 367/759] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:28 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1475 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:28.949747 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-35e30ea2-b35a-460a-a34e-f626b054011e req-cf966eca-1b9a-444f-b152-1e84667c8ca4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111499 May 28 21:05:28.961368 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 393/760] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:28.961518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-79f3b473-3bc7-4998-a766-cf9c15edf3a9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:28.961518 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:05:28.961518 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:05:28.961518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79f3b473-3bc7-4998-a766-cf9c15edf3a9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:28.962640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79f3b473-3bc7-4998-a766-cf9c15edf3a9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:28.963692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79f3b473-3bc7-4998-a766-cf9c15edf3a9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:28.964299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79f3b473-3bc7-4998-a766-cf9c15edf3a9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:28.995983 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-79f3b473-3bc7-4998-a766-cf9c15edf3a9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.051117 May 28 21:05:28.996908 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 368/761] 10.222.0.33 () {58 vars in 1175 bytes} [Sat May 28 21:05:28 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:29.012227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-93a36e7f-e4e4-4bc6-b617-2fd28f09689e tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:29.013803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-93a36e7f-e4e4-4bc6-b617-2fd28f09689e tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:29.023477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93a36e7f-e4e4-4bc6-b617-2fd28f09689e tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:29.024326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93a36e7f-e4e4-4bc6-b617-2fd28f09689e tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:29.025286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93a36e7f-e4e4-4bc6-b617-2fd28f09689e tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:29.025913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93a36e7f-e4e4-4bc6-b617-2fd28f09689e tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:29.253139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0ed7ed52-a76b-4a14-bb49-5683a6efb26f tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:29.253918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0ed7ed52-a76b-4a14-bb49-5683a6efb26f tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:29.281484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ed7ed52-a76b-4a14-bb49-5683a6efb26f tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:29.282446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ed7ed52-a76b-4a14-bb49-5683a6efb26f tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:29.286710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ed7ed52-a76b-4a14-bb49-5683a6efb26f tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:29.289427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ed7ed52-a76b-4a14-bb49-5683a6efb26f tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:29.375028 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-93a36e7f-e4e4-4bc6-b617-2fd28f09689e tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82/action" status: 202 len: 0 microversion: 2.1 time: 0.370601 May 28 21:05:29.376415 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 394/762] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:05:29 2022] POST /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:05:29.392318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1bf9854b-720a-4d00-b2a5-51e2b0f67433 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:29.393423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1bf9854b-720a-4d00-b2a5-51e2b0f67433 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:29.413629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1bf9854b-720a-4d00-b2a5-51e2b0f67433 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:29.414448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1bf9854b-720a-4d00-b2a5-51e2b0f67433 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:29.425308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1bf9854b-720a-4d00-b2a5-51e2b0f67433 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:29.425308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1bf9854b-720a-4d00-b2a5-51e2b0f67433 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:29.654753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0ed7ed52-a76b-4a14-bb49-5683a6efb26f tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:29.670796 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0ed7ed52-a76b-4a14-bb49-5683a6efb26f tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1322 microversion: 2.1 time: 0.419799 May 28 21:05:29.671918 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 369/763] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:29 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:29.689007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-192a9c5f-cad0-49cb-a0a7-10a936c9cf0a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:29.690093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-192a9c5f-cad0-49cb-a0a7-10a936c9cf0a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:29.721737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-192a9c5f-cad0-49cb-a0a7-10a936c9cf0a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:29.724914 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-192a9c5f-cad0-49cb-a0a7-10a936c9cf0a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:29.728874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-192a9c5f-cad0-49cb-a0a7-10a936c9cf0a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:29.729551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-192a9c5f-cad0-49cb-a0a7-10a936c9cf0a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:29.764881 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1bf9854b-720a-4d00-b2a5-51e2b0f67433 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1648 microversion: 2.1 time: 0.381903 May 28 21:05:29.775871 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 395/764] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:29 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1648 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:29.964668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7f6d6d44-2a72-4afe-b84e-2b39f2eaf9b0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:29.965790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7f6d6d44-2a72-4afe-b84e-2b39f2eaf9b0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:29.983540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f6d6d44-2a72-4afe-b84e-2b39f2eaf9b0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:29.984125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f6d6d44-2a72-4afe-b84e-2b39f2eaf9b0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:29.985288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f6d6d44-2a72-4afe-b84e-2b39f2eaf9b0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:29.988144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f6d6d44-2a72-4afe-b84e-2b39f2eaf9b0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:30.074540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-192a9c5f-cad0-49cb-a0a7-10a936c9cf0a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:30.090892 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-192a9c5f-cad0-49cb-a0a7-10a936c9cf0a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1471 microversion: 2.1 time: 0.405570 May 28 21:05:30.095988 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 370/765] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:29 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1471 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:30.200293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7f6d6d44-2a72-4afe-b84e-2b39f2eaf9b0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:30.208454 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7f6d6d44-2a72-4afe-b84e-2b39f2eaf9b0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1473 microversion: 2.1 time: 0.249139 May 28 21:05:30.209020 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 396/766] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:29 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1473 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:30.689663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a987790-e6eb-4286-a3b3-dff92bbd57dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:30.690602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6a987790-e6eb-4286-a3b3-dff92bbd57dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:30.698618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a987790-e6eb-4286-a3b3-dff92bbd57dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:30.699092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a987790-e6eb-4286-a3b3-dff92bbd57dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:30.699865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a987790-e6eb-4286-a3b3-dff92bbd57dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:30.700500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a987790-e6eb-4286-a3b3-dff92bbd57dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:30.785515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ba950365-46ac-4e7d-86ff-c7537db89cb3 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:30.791132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ba950365-46ac-4e7d-86ff-c7537db89cb3 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:30.805623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba950365-46ac-4e7d-86ff-c7537db89cb3 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:30.807571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba950365-46ac-4e7d-86ff-c7537db89cb3 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:30.808788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba950365-46ac-4e7d-86ff-c7537db89cb3 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:30.809444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba950365-46ac-4e7d-86ff-c7537db89cb3 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:30.941905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a987790-e6eb-4286-a3b3-dff92bbd57dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:30.952644 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6a987790-e6eb-4286-a3b3-dff92bbd57dc tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1472 microversion: 2.1 time: 0.267762 May 28 21:05:30.953533 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 371/767] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:30 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1472 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:30.974181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-56e83a01-dd8c-4ecb-bf62-c478f9bba39f tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:30.975104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-56e83a01-dd8c-4ecb-bf62-c478f9bba39f tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:30.982130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56e83a01-dd8c-4ecb-bf62-c478f9bba39f tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:30.982908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56e83a01-dd8c-4ecb-bf62-c478f9bba39f tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:30.983987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56e83a01-dd8c-4ecb-bf62-c478f9bba39f tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:30.984687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56e83a01-dd8c-4ecb-bf62-c478f9bba39f tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:31.019511 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ba950365-46ac-4e7d-86ff-c7537db89cb3 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1628 microversion: 2.1 time: 0.239159 May 28 21:05:31.037589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-56e83a01-dd8c-4ecb-bf62-c478f9bba39f tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lazy-loading 'flavor' on Instance uuid a538e54e-1c93-4369-baff-d514f9ce5eb7 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:05:31.037891 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 397/768] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:30 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1628 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:31.046381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6c057fcb-6e4e-4123-9714-2e8349583866 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:31.048907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6c057fcb-6e4e-4123-9714-2e8349583866 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:31.058351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c057fcb-6e4e-4123-9714-2e8349583866 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:31.058849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c057fcb-6e4e-4123-9714-2e8349583866 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:31.059651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c057fcb-6e4e-4123-9714-2e8349583866 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:31.060102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c057fcb-6e4e-4123-9714-2e8349583866 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:31.107581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-6c057fcb-6e4e-4123-9714-2e8349583866 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lazy-loading 'flavor' on Instance uuid 45b8d752-edaa-40bc-b38f-1d1441231d82 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:05:31.121060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6c057fcb-6e4e-4123-9714-2e8349583866 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Going to try to live migrate instance to nch2-master-1 {{(pid=143128) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 21:05:31.586162 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-56e83a01-dd8c-4ecb-bf62-c478f9bba39f tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7/action" status: 202 len: 0 microversion: 2.1 time: 0.619225 May 28 21:05:31.586973 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 372/769] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:05:30 2022] POST /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7/action => generated 0 bytes in 621 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:05:31.592545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9933fde5-03bc-453f-9800-820c6aaa1ac2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:31.593244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9933fde5-03bc-453f-9800-820c6aaa1ac2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:31.600252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9933fde5-03bc-453f-9800-820c6aaa1ac2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:31.600790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9933fde5-03bc-453f-9800-820c6aaa1ac2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:31.601653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9933fde5-03bc-453f-9800-820c6aaa1ac2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:31.602110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9933fde5-03bc-453f-9800-820c6aaa1ac2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:31.752575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9933fde5-03bc-453f-9800-820c6aaa1ac2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:31.760667 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9933fde5-03bc-453f-9800-820c6aaa1ac2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1471 microversion: 2.1 time: 0.172357 May 28 21:05:31.761280 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 373/770] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:31 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:31.765603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-167aa14e-c470-42b6-97fc-525c4e2bb0cd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:31.766270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-167aa14e-c470-42b6-97fc-525c4e2bb0cd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:31.772430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-167aa14e-c470-42b6-97fc-525c4e2bb0cd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:31.772916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-167aa14e-c470-42b6-97fc-525c4e2bb0cd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:31.773987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-167aa14e-c470-42b6-97fc-525c4e2bb0cd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:31.774585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-167aa14e-c470-42b6-97fc-525c4e2bb0cd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:31.921537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-167aa14e-c470-42b6-97fc-525c4e2bb0cd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:31.930932 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-167aa14e-c470-42b6-97fc-525c4e2bb0cd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1473 microversion: 2.1 time: 0.168564 May 28 21:05:31.937183 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 374/771] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:31 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1473 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:31.944201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eacc24a1-2f8e-4583-998a-fb8f03532511 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:31.947276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eacc24a1-2f8e-4583-998a-fb8f03532511 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:31.957253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eacc24a1-2f8e-4583-998a-fb8f03532511 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:31.958315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eacc24a1-2f8e-4583-998a-fb8f03532511 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:31.961554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eacc24a1-2f8e-4583-998a-fb8f03532511 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:31.961554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eacc24a1-2f8e-4583-998a-fb8f03532511 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:32.429493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:32.464608 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eacc24a1-2f8e-4583-998a-fb8f03532511 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1631 microversion: 2.1 time: 0.526330 May 28 21:05:32.465200 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 375/772] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:31 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1631 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:32.477434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d9ae8113-5013-42e8-a3f1-514606707e41 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96682203-c2c9-4aeb-9901-07faacbd380d", "device": "/dev/xvdb"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:32.477434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d9ae8113-5013-42e8-a3f1-514606707e41 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:32.483450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9ae8113-5013-42e8-a3f1-514606707e41 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:32.483916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9ae8113-5013-42e8-a3f1-514606707e41 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:32.484701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9ae8113-5013-42e8-a3f1-514606707e41 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:32.485152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9ae8113-5013-42e8-a3f1-514606707e41 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:33.339193 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d9ae8113-5013-42e8-a3f1-514606707e41 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "POST /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.872089 May 28 21:05:33.339832 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 376/773] 10.222.0.33 () {62 vars in 1363 bytes} [Sat May 28 21:05:32 2022] POST /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47/os-volume_attachments => generated 194 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:05:33.518272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9d93274a-4f49-4b07-9449-548068764311 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Action: 'create', calling method: .version_select at 0x7f4d64251ca0>, body: {"keypair": {"name": "tempest-keypair-694297558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtjiH6A0TGJ6aTEio5SL1Tblk1m4CCeG5aAZoKaKCqr2Uiq75Pez5Mb4kw5RGObfkQ6dhrE72x8qoWsZ2EGegzxv4qJUFC/TG8MKcYlp4ujoShIMcXbjFFUGxXUqd1i7A=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:33.533203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9d93274a-4f49-4b07-9449-548068764311 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Getting quotas for project b059b8b9ea6e4afbb5d034c9d1a036d2. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:05:33.538584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9d93274a-4f49-4b07-9449-548068764311 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Getting quotas for user 77a6068e4dc34fb6b8d1447472692e55 and project b059b8b9ea6e4afbb5d034c9d1a036d2. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:05:33.633657 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9d93274a-4f49-4b07-9449-548068764311 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.292527 May 28 21:05:33.634413 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 377/774] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:05:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:33.687554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a6646fbb-4df2-4db1-a1ed-5f46acd746a1 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:33.688860 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:05:33.688860 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:05:33.690107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6646fbb-4df2-4db1-a1ed-5f46acd746a1 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:33.690571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6646fbb-4df2-4db1-a1ed-5f46acd746a1 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:33.691387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6646fbb-4df2-4db1-a1ed-5f46acd746a1 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:33.692446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6646fbb-4df2-4db1-a1ed-5f46acd746a1 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:33.716904 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a6646fbb-4df2-4db1-a1ed-5f46acd746a1 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.081276 May 28 21:05:33.717540 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 378/775] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:05:33 2022] GET /compute/v2.1/os-services => generated 947 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:33.722064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-85574f60-faf7-4d1a-a3d1-2a465a99500e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:33.722810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-85574f60-faf7-4d1a-a3d1-2a465a99500e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:33.730452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85574f60-faf7-4d1a-a3d1-2a465a99500e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:33.730915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85574f60-faf7-4d1a-a3d1-2a465a99500e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:33.731703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85574f60-faf7-4d1a-a3d1-2a465a99500e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:33.732150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85574f60-faf7-4d1a-a3d1-2a465a99500e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:33.961347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-85574f60-faf7-4d1a-a3d1-2a465a99500e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:33.974718 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-85574f60-faf7-4d1a-a3d1-2a465a99500e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1471 microversion: 2.1 time: 0.256080 May 28 21:05:33.975314 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 379/776] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:33 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:33.980869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-494f658c-0ab2-4c49-8cfa-7439bd10f0c4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:33.981744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-494f658c-0ab2-4c49-8cfa-7439bd10f0c4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:33.989605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-494f658c-0ab2-4c49-8cfa-7439bd10f0c4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:33.990140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-494f658c-0ab2-4c49-8cfa-7439bd10f0c4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:33.990982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-494f658c-0ab2-4c49-8cfa-7439bd10f0c4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:33.991429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-494f658c-0ab2-4c49-8cfa-7439bd10f0c4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.177006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-494f658c-0ab2-4c49-8cfa-7439bd10f0c4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:34.185124 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-494f658c-0ab2-4c49-8cfa-7439bd10f0c4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1470 microversion: 2.1 time: 0.208535 May 28 21:05:34.185718 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 380/777] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:33 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1470 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:34.190146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-80def877-e34f-4bfe-9b87-f50d5296c9ae tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:34.190753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-80def877-e34f-4bfe-9b87-f50d5296c9ae tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:34.192630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:34.197772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80def877-e34f-4bfe-9b87-f50d5296c9ae tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.198571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80def877-e34f-4bfe-9b87-f50d5296c9ae tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.199336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80def877-e34f-4bfe-9b87-f50d5296c9ae tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.199774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80def877-e34f-4bfe-9b87-f50d5296c9ae tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.359752 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-80def877-e34f-4bfe-9b87-f50d5296c9ae tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1614 microversion: 2.1 time: 0.172854 May 28 21:05:34.361949 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 381/778] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:34 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1614 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:34.369904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-099c3820-bc92-4c72-822e-9e70d3355309 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:34.369904 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:05:34.369904 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:05:34.369904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-099c3820-bc92-4c72-822e-9e70d3355309 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.369904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-099c3820-bc92-4c72-822e-9e70d3355309 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.370408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-099c3820-bc92-4c72-822e-9e70d3355309 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.370408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-099c3820-bc92-4c72-822e-9e70d3355309 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.374960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:34.394429 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-099c3820-bc92-4c72-822e-9e70d3355309 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.032428 May 28 21:05:34.395792 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 382/779] 10.222.0.33 () {58 vars in 1173 bytes} [Sat May 28 21:05:34 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:34.407643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fcdd3323-857e-4df4-a790-c304f97b2dd4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:34.416834 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fcdd3323-857e-4df4-a790-c304f97b2dd4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:34.423613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcdd3323-857e-4df4-a790-c304f97b2dd4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.424074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcdd3323-857e-4df4-a790-c304f97b2dd4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.424863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcdd3323-857e-4df4-a790-c304f97b2dd4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.425314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcdd3323-857e-4df4-a790-c304f97b2dd4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.506085 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6c057fcb-6e4e-4123-9714-2e8349583866 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82/action" status: 202 len: 0 microversion: 2.1 time: 3.466846 May 28 21:05:34.507828 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 398/780] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:05:31 2022] POST /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82/action => generated 0 bytes in 3470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:05:34.513728 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f728143a-64aa-4e32-a324-f15dd5612a5b tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:34.515314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f728143a-64aa-4e32-a324-f15dd5612a5b tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:34.531897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f728143a-64aa-4e32-a324-f15dd5612a5b tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.532346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f728143a-64aa-4e32-a324-f15dd5612a5b tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.533135 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f728143a-64aa-4e32-a324-f15dd5612a5b tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.533579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f728143a-64aa-4e32-a324-f15dd5612a5b tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.554696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:34.563278 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-f728143a-64aa-4e32-a324-f15dd5612a5b tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] HTTP exception thrown: Cannot 'migrate' instance a538e54e-1c93-4369-baff-d514f9ce5eb7 while it is in vm_state suspended May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f728143a-64aa-4e32-a324-f15dd5612a5b tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Request method failure captured: May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7/action HTTP/1.1 May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 15 May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5wwRdgNQwjaGekRmfkSQFbcLYemXkiQcgfzQyAGi2KTvKSJRN19kH0FH193AcsymvfMgkTz5Xq1AdBL3VL1JM6Hq7EF22iBA6DthcOAlNYbjBXqiYjDoGCQuzv7Aqzr1SuMUiKMmwjuC5O2L2R_TBoyOTLnAr2l4GjHujAqqqqG9E May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 7c6c7fd995bf4b41873c30015cbc85a4 May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1533899629 May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:05:34.565676 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:05:34.567858 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c6c7fd995bf4b41873c30015cbc85a4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c6c7fd995bf4b41873c30015cbc85a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c6c7fd995bf4b41873c30015cbc85a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c6c7fd995bf4b41873c30015cbc85a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:34.567858 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1533899629 May 28 21:05:34.567858 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 7c6c7fd995bf4b41873c30015cbc85a4 May 28 21:05:34.567858 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1533899629 May 28 21:05:34.567858 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersAdminNegativeTestJSON-1533899629-project-admin May 28 21:05:34.567858 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:05:34.567858 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:05:34.567858 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 1edb01ef9d394c9da5086206d3033403 May 28 21:05:34.567858 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1533899629-project-admin May 28 21:05:34.567858 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:05:34.567858 ncdv-master-1 devstack@n-api.service[143128]: {"migrate": {}} May 28 21:05:34.567858 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:05:34.567858 ncdv-master-1 devstack@n-api.service[143128]: exception: Cannot 'migrate' instance a538e54e-1c93-4369-baff-d514f9ce5eb7 while it is in vm_state suspended May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'a538e54e-1c93-4369-baff-d514f9ce5eb7', 'body': {'migrate': {}}} May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a538e54e-1c93-4369-baff-d514f9ce5eb7 in vm_state suspended. Cannot resize while the instance is in this state. May 28 21:05:34.568919 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance a538e54e-1c93-4369-baff-d514f9ce5eb7 while it is in vm_state suspended May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:34.570283 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:34.571650 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:34.571650 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:34.571650 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:05:34.571650 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:05:34.571650 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance a538e54e-1c93-4369-baff-d514f9ce5eb7 while it is in vm_state suspended May 28 21:05:34.571650 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:34.572981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f728143a-64aa-4e32-a324-f15dd5612a5b tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Returning 409 to user: Cannot 'migrate' instance a538e54e-1c93-4369-baff-d514f9ce5eb7 while it is in vm_state suspended {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:34.573794 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f728143a-64aa-4e32-a324-f15dd5612a5b tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7/action" status: 409 len: 148 microversion: 2.1 time: 0.064825 May 28 21:05:34.574734 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 399/781] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:05:34 2022] POST /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7/action => generated 148 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:05:34.579445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b214742f-5f79-4750-a571-abb8cd1d7643 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:34.580950 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:05:34.580950 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:05:34.583032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b214742f-5f79-4750-a571-abb8cd1d7643 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.586016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b214742f-5f79-4750-a571-abb8cd1d7643 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.586016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b214742f-5f79-4750-a571-abb8cd1d7643 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.586016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b214742f-5f79-4750-a571-abb8cd1d7643 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.615485 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b214742f-5f79-4750-a571-abb8cd1d7643 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039729 May 28 21:05:34.616102 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 400/782] 10.222.0.33 () {58 vars in 1175 bytes} [Sat May 28 21:05:34 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:34.622093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dc948e10-53ad-4c0c-9426-16bc614d1608 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:34.622938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dc948e10-53ad-4c0c-9426-16bc614d1608 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:34.633160 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fcdd3323-857e-4df4-a790-c304f97b2dd4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "POST /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2/action" status: 204 len: 0 microversion: 2.1 time: 0.235026 May 28 21:05:34.634399 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 383/783] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:05:34 2022] POST /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2/action => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:05:34.638342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc948e10-53ad-4c0c-9426-16bc614d1608 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.639164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc948e10-53ad-4c0c-9426-16bc614d1608 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.640171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc948e10-53ad-4c0c-9426-16bc614d1608 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.640744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc948e10-53ad-4c0c-9426-16bc614d1608 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.641079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-97363f3c-1ea3-46ea-b026-cf3421859b08 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-97363f3c-1ea3-46ea-b026-cf3421859b08 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Request method failure captured: May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c/action HTTP/1.1 May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 39 May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko5wwRdgNQwjaGekRmfkSQFbcLYemXkiQcgfzQyAGi2KTvKSJRN19kH0FH193AcsymvfMgkTz5Xq1AdBL3VL1JM6Hq7EF22iBA6DthcOAlNYbjBXqiYjDoGCQuzv7Aqzr1SuMUiKMmwjuC5O2L2R_TBoyOTLnAr2l4GjHujAqqqqG9E May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 7c6c7fd995bf4b41873c30015cbc85a4 May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1533899629 May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:05:34.643681 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:05:34.645765 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c6c7fd995bf4b41873c30015cbc85a4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c6c7fd995bf4b41873c30015cbc85a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c6c7fd995bf4b41873c30015cbc85a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c6c7fd995bf4b41873c30015cbc85a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:34.645765 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1533899629 May 28 21:05:34.645765 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 7c6c7fd995bf4b41873c30015cbc85a4 May 28 21:05:34.645765 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1533899629 May 28 21:05:34.645765 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersAdminNegativeTestJSON-1533899629-project-admin May 28 21:05:34.645765 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:05:34.645765 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:05:34.645765 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 1edb01ef9d394c9da5086206d3033403 May 28 21:05:34.645765 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1533899629-project-admin May 28 21:05:34.645765 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:05:34.645765 ncdv-master-1 devstack@n-api.service[143129]: {"os-resetState": {"state": "invalid"}} May 28 21:05:34.645765 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'f19324c9-92b9-4a31-9651-20be6957922c', 'body': {'os-resetState': {'state': 'invalid'}}} May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'invalid' May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:34.646608 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:05:34.648100 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] May 28 21:05:34.649324 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.650272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-97363f3c-1ea3-46ea-b026-cf3421859b08 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:34.651281 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-97363f3c-1ea3-46ea-b026-cf3421859b08 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c/action" status: 400 len: 144 microversion: 2.1 time: 0.015637 May 28 21:05:34.652005 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 384/784] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:05:34 2022] POST /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c/action => generated 144 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:05:34.656877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c0537f80-ec30-47a0-afc2-c40ef0303915 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:34.660142 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:05:34.660142 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:05:34.661668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0537f80-ec30-47a0-afc2-c40ef0303915 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.662336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0537f80-ec30-47a0-afc2-c40ef0303915 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.663732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0537f80-ec30-47a0-afc2-c40ef0303915 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.664461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0537f80-ec30-47a0-afc2-c40ef0303915 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.692956 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c0537f80-ec30-47a0-afc2-c40ef0303915 tempest-ServicesAdminTestJSON-646149636 tempest-ServicesAdminTestJSON-646149636-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.038575 May 28 21:05:34.693875 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 385/785] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:05:34 2022] GET /compute/v2.1/os-services => generated 947 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:34.699232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b78d7699-0db9-4bf4-a42f-ac63ff4ff32d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:34.700196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b78d7699-0db9-4bf4-a42f-ac63ff4ff32d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:34.708388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b78d7699-0db9-4bf4-a42f-ac63ff4ff32d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.709060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b78d7699-0db9-4bf4-a42f-ac63ff4ff32d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.715281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b78d7699-0db9-4bf4-a42f-ac63ff4ff32d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:34.715281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b78d7699-0db9-4bf4-a42f-ac63ff4ff32d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:34.952503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b78d7699-0db9-4bf4-a42f-ac63ff4ff32d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:34.962539 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b78d7699-0db9-4bf4-a42f-ac63ff4ff32d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1470 microversion: 2.1 time: 0.267437 May 28 21:05:34.963696 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 386/786] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:34 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1470 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:34.968497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-57233e54-7770-4fa5-a112-88e214c6cd3a tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-57233e54-7770-4fa5-a112-88e214c6cd3a tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Request method failure captured: May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c/action HTTP/1.1 May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 31 May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko5wwRdgNQwjaGekRmfkSQFbcLYemXkiQcgfzQyAGi2KTvKSJRN19kH0FH193AcsymvfMgkTz5Xq1AdBL3VL1JM6Hq7EF22iBA6DthcOAlNYbjBXqiYjDoGCQuzv7Aqzr1SuMUiKMmwjuC5O2L2R_TBoyOTLnAr2l4GjHujAqqqqG9E May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 7c6c7fd995bf4b41873c30015cbc85a4 May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1533899629 May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:05:34.970853 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:05:34.972210 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c6c7fd995bf4b41873c30015cbc85a4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c6c7fd995bf4b41873c30015cbc85a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c6c7fd995bf4b41873c30015cbc85a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c6c7fd995bf4b41873c30015cbc85a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:34.972210 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1533899629 May 28 21:05:34.972210 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 7c6c7fd995bf4b41873c30015cbc85a4 May 28 21:05:34.972210 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1533899629 May 28 21:05:34.972210 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersAdminNegativeTestJSON-1533899629-project-admin May 28 21:05:34.972210 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:05:34.972210 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:05:34.972210 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 1edb01ef9d394c9da5086206d3033403 May 28 21:05:34.972210 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1533899629-project-admin May 28 21:05:34.972210 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:05:34.972210 ncdv-master-1 devstack@n-api.service[143129]: {"os-resetState": {"state": 1}} May 28 21:05:34.972210 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:05:34.972210 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'f19324c9-92b9-4a31-9651-20be6957922c', 'body': {'os-resetState': {'state': 1}}} May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 1 May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:34.973010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' May 28 21:05:34.974423 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.975697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-57233e54-7770-4fa5-a112-88e214c6cd3a tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:34.975697 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-57233e54-7770-4fa5-a112-88e214c6cd3a tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c/action" status: 400 len: 120 microversion: 2.1 time: 0.007906 May 28 21:05:34.977042 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 387/787] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:05:34 2022] POST /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c/action => generated 120 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:05:34.981955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e739980c-22f6-4be9-ba1c-be3f8353fda2 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:34.982883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e739980c-22f6-4be9-ba1c-be3f8353fda2 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Failed to fetch instance by id 999 {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2926}} May 28 21:05:34.983398 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-e739980c-22f6-4be9-ba1c-be3f8353fda2 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] HTTP exception thrown: Instance 999 could not be found. May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e739980c-22f6-4be9-ba1c-be3f8353fda2 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Request method failure captured: May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 37 May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko5wwRdgNQwjaGekRmfkSQFbcLYemXkiQcgfzQyAGi2KTvKSJRN19kH0FH193AcsymvfMgkTz5Xq1AdBL3VL1JM6Hq7EF22iBA6DthcOAlNYbjBXqiYjDoGCQuzv7Aqzr1SuMUiKMmwjuC5O2L2R_TBoyOTLnAr2l4GjHujAqqqqG9E May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 7c6c7fd995bf4b41873c30015cbc85a4 May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1533899629 May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:05:34.986008 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:05:34.989187 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7c6c7fd995bf4b41873c30015cbc85a4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c6c7fd995bf4b41873c30015cbc85a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7c6c7fd995bf4b41873c30015cbc85a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7c6c7fd995bf4b41873c30015cbc85a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:34.989187 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1533899629 May 28 21:05:34.989187 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 7c6c7fd995bf4b41873c30015cbc85a4 May 28 21:05:34.989187 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1533899629 May 28 21:05:34.989187 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersAdminNegativeTestJSON-1533899629-project-admin May 28 21:05:34.989187 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:05:34.989187 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:05:34.989187 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 1edb01ef9d394c9da5086206d3033403 May 28 21:05:34.989187 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1533899629-project-admin May 28 21:05:34.989187 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:05:34.989187 ncdv-master-1 devstack@n-api.service[143129]: {"os-resetState": {"state": "error"}} May 28 21:05:34.989187 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:05:34.989187 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 999 could not be found. May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:05:34.996545 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state May 28 21:05:34.997977 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 28 21:05:34.997977 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:05:34.997977 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:05:34.997977 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 28 21:05:34.997977 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.997977 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:34.997977 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.997977 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:34.997977 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:34.997977 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:34.997977 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:05:34.997977 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:05:34.997977 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 28 21:05:34.997977 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:34.997977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e739980c-22f6-4be9-ba1c-be3f8353fda2 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:35.001884 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e739980c-22f6-4be9-ba1c-be3f8353fda2 tempest-ServersAdminNegativeTestJSON-1533899629 tempest-ServersAdminNegativeTestJSON-1533899629-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.009354 May 28 21:05:35.002550 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 388/788] 10.222.0.33 () {60 vars in 1178 bytes} [Sat May 28 21:05:34 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:05:35.003101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dc948e10-53ad-4c0c-9426-16bc614d1608 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:35.013507 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dc948e10-53ad-4c0c-9426-16bc614d1608 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.395816 May 28 21:05:35.015282 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 401/789] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:34 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:35.029423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-88f59141-ad85-4c76-a7e5-3ffbb94a6a7d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:35.029423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-88f59141-ad85-4c76-a7e5-3ffbb94a6a7d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:35.031235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-67027a13-32ea-48d9-a7be-1980522b4be0 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:35.032099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-67027a13-32ea-48d9-a7be-1980522b4be0 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:35.032218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88f59141-ad85-4c76-a7e5-3ffbb94a6a7d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:35.032675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88f59141-ad85-4c76-a7e5-3ffbb94a6a7d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:35.033578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88f59141-ad85-4c76-a7e5-3ffbb94a6a7d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:35.034131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88f59141-ad85-4c76-a7e5-3ffbb94a6a7d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:35.043804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67027a13-32ea-48d9-a7be-1980522b4be0 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:35.052866 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67027a13-32ea-48d9-a7be-1980522b4be0 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:35.053981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67027a13-32ea-48d9-a7be-1980522b4be0 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:35.054687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67027a13-32ea-48d9-a7be-1980522b4be0 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:35.090399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-67027a13-32ea-48d9-a7be-1980522b4be0 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:05:35.319537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-88f59141-ad85-4c76-a7e5-3ffbb94a6a7d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:35.329245 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-88f59141-ad85-4c76-a7e5-3ffbb94a6a7d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1471 microversion: 2.1 time: 0.321318 May 28 21:05:35.329872 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 389/790] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:35 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1471 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:35.600743 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-67027a13-32ea-48d9-a7be-1980522b4be0 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 204 len: 0 microversion: 2.1 time: 0.582093 May 28 21:05:35.613310 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 402/791] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:05:35 2022] DELETE /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:05:35.613623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a9dfd163-4314-4bb5-9867-c815f10b4cae tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:35.613623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a9dfd163-4314-4bb5-9867-c815f10b4cae tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:35.622188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9dfd163-4314-4bb5-9867-c815f10b4cae tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:35.622662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9dfd163-4314-4bb5-9867-c815f10b4cae tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:35.623429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9dfd163-4314-4bb5-9867-c815f10b4cae tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:35.624083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9dfd163-4314-4bb5-9867-c815f10b4cae tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:35.818535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a9dfd163-4314-4bb5-9867-c815f10b4cae tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:35.826963 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a9dfd163-4314-4bb5-9867-c815f10b4cae tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1469 microversion: 2.1 time: 0.220539 May 28 21:05:35.827714 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 390/792] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:35 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1469 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:35.981198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9791e1dc-40ff-439d-97e5-2c05d9c77978 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:35.981872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9791e1dc-40ff-439d-97e5-2c05d9c77978 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:35.990106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9791e1dc-40ff-439d-97e5-2c05d9c77978 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:35.990565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9791e1dc-40ff-439d-97e5-2c05d9c77978 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:35.991349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9791e1dc-40ff-439d-97e5-2c05d9c77978 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:35.991792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9791e1dc-40ff-439d-97e5-2c05d9c77978 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:36.036836 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-543cac4f-2ac9-4f94-a647-5673a697df54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:36.037810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-543cac4f-2ac9-4f94-a647-5673a697df54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:36.045670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-543cac4f-2ac9-4f94-a647-5673a697df54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:36.046444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-543cac4f-2ac9-4f94-a647-5673a697df54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:36.047473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-543cac4f-2ac9-4f94-a647-5673a697df54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:36.048174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-543cac4f-2ac9-4f94-a647-5673a697df54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:36.167223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9791e1dc-40ff-439d-97e5-2c05d9c77978 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:36.182306 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9791e1dc-40ff-439d-97e5-2c05d9c77978 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1470 microversion: 2.1 time: 0.205415 May 28 21:05:36.183060 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 403/793] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:35 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1470 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:36.232177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-543cac4f-2ac9-4f94-a647-5673a697df54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:36.240433 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-543cac4f-2ac9-4f94-a647-5673a697df54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.207430 May 28 21:05:36.241013 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 391/794] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:36 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:36.349146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-19089448-e4ab-4a26-8c9b-6c443c22c9c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:36.349768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-19089448-e4ab-4a26-8c9b-6c443c22c9c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:36.359506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19089448-e4ab-4a26-8c9b-6c443c22c9c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:36.359506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19089448-e4ab-4a26-8c9b-6c443c22c9c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:36.359506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19089448-e4ab-4a26-8c9b-6c443c22c9c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:36.359506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19089448-e4ab-4a26-8c9b-6c443c22c9c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:36.499782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-19089448-e4ab-4a26-8c9b-6c443c22c9c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:36.507763 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-19089448-e4ab-4a26-8c9b-6c443c22c9c4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1471 microversion: 2.1 time: 0.163364 May 28 21:05:36.508341 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 404/795] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:36 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:36.684247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1077510135", "imageRef": "83e94911-7673-4e6d-9a64-b2a23ea8f47a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "7c15e4b8-6110-407c-850d-1cd154197a03"}], "security_groups": [{"name": "tempest-securitygroup--1276303765"}], "key_name": "tempest-keypair-694297558", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:36.787888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] validate_networks() for [('7c15e4b8-6110-407c-850d-1cd154197a03', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:05:36.845200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-02aa8d99-eb9e-487e-a2d2-6f8cd26f0322 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:36.846191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-02aa8d99-eb9e-487e-a2d2-6f8cd26f0322 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:36.853933 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-02aa8d99-eb9e-487e-a2d2-6f8cd26f0322 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:36.854736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-02aa8d99-eb9e-487e-a2d2-6f8cd26f0322 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:36.855967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-02aa8d99-eb9e-487e-a2d2-6f8cd26f0322 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:36.856720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-02aa8d99-eb9e-487e-a2d2-6f8cd26f0322 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:37.067640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-02aa8d99-eb9e-487e-a2d2-6f8cd26f0322 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:37.088526 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-02aa8d99-eb9e-487e-a2d2-6f8cd26f0322 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1469 microversion: 2.1 time: 0.239035 May 28 21:05:37.097299 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 405/796] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:36 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1469 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:37.102352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-de5bc0ac-6bbf-4be1-905a-b87c337554f6 req-2ab48942-4412-4106-b878-8a95c6efdffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "569b037d-ace0-4ce6-8182-ddac69d2b2e2", "name": "network-vif-plugged", "status": "completed", "tag": "04dfc232-ea06-4928-bc0e-827e83fc3bda"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:37.111008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-de5bc0ac-6bbf-4be1-905a-b87c337554f6 req-2ab48942-4412-4106-b878-8a95c6efdffb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:37.111715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-de5bc0ac-6bbf-4be1-905a-b87c337554f6 req-2ab48942-4412-4106-b878-8a95c6efdffb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:37.125884 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-de5bc0ac-6bbf-4be1-905a-b87c337554f6 req-2ab48942-4412-4106-b878-8a95c6efdffb service nova] Creating event network-vif-plugged:04dfc232-ea06-4928-bc0e-827e83fc3bda for instance 569b037d-ace0-4ce6-8182-ddac69d2b2e2 on nch2-master-1 May 28 21:05:37.132237 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-de5bc0ac-6bbf-4be1-905a-b87c337554f6 req-2ab48942-4412-4106-b878-8a95c6efdffb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033445 May 28 21:05:37.133481 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 406/797] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:37.200869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b803992c-3a25-4fc9-8651-7f1842220a46 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:37.201793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b803992c-3a25-4fc9-8651-7f1842220a46 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:37.209204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b803992c-3a25-4fc9-8651-7f1842220a46 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:37.209745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b803992c-3a25-4fc9-8651-7f1842220a46 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:37.210625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b803992c-3a25-4fc9-8651-7f1842220a46 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:37.211180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b803992c-3a25-4fc9-8651-7f1842220a46 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:37.514899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b803992c-3a25-4fc9-8651-7f1842220a46 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:37.522702 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b803992c-3a25-4fc9-8651-7f1842220a46 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1462 microversion: 2.1 time: 0.326233 May 28 21:05:37.523287 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 407/798] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:37 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1462 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:37.527894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-853b49a8-6dbd-4ed3-bf8e-0bf0508d9b29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:37.528559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-853b49a8-6dbd-4ed3-bf8e-0bf0508d9b29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:37.534848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-853b49a8-6dbd-4ed3-bf8e-0bf0508d9b29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:37.535311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-853b49a8-6dbd-4ed3-bf8e-0bf0508d9b29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:37.536073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-853b49a8-6dbd-4ed3-bf8e-0bf0508d9b29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:37.536515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-853b49a8-6dbd-4ed3-bf8e-0bf0508d9b29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:37.639289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:05:37.640322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:05:37.640858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:05:37.641272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:05:37.642417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:05:37.661356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:37.661814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:37.662946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:37.663523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:37.689703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Getting quotas for project b059b8b9ea6e4afbb5d034c9d1a036d2. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:05:37.696879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Getting quotas for user 77a6068e4dc34fb6b8d1447472692e55 and project b059b8b9ea6e4afbb5d034c9d1a036d2. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:05:37.710538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:05:37.717563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='83e94911-7673-4e6d-9a64-b2a23ea8f47a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:05:37.721522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-853b49a8-6dbd-4ed3-bf8e-0bf0508d9b29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:37.732098 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-853b49a8-6dbd-4ed3-bf8e-0bf0508d9b29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.207793 May 28 21:05:37.734394 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 408/799] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:37 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:37.739690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c91b6049-2dce-455e-a51c-61e38f7b39d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:37.740374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c91b6049-2dce-455e-a51c-61e38f7b39d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:37.743902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:37.747663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c91b6049-2dce-455e-a51c-61e38f7b39d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:37.748190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c91b6049-2dce-455e-a51c-61e38f7b39d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:37.748967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c91b6049-2dce-455e-a51c-61e38f7b39d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:37.749408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c91b6049-2dce-455e-a51c-61e38f7b39d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:37.877655 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a388178f-87f7-4ec7-82b3-e8c2a18f5e38 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.197136 May 28 21:05:37.880291 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 392/800] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:05:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:05:37.905528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-44db078c-a960-45b9-98bf-cf739316d3c0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:37.905528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-44db078c-a960-45b9-98bf-cf739316d3c0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:37.912641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44db078c-a960-45b9-98bf-cf739316d3c0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:37.913103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44db078c-a960-45b9-98bf-cf739316d3c0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:37.913930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44db078c-a960-45b9-98bf-cf739316d3c0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:37.914934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44db078c-a960-45b9-98bf-cf739316d3c0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:37.954903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c91b6049-2dce-455e-a51c-61e38f7b39d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:37.965682 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c91b6049-2dce-455e-a51c-61e38f7b39d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1471 microversion: 2.1 time: 0.230317 May 28 21:05:37.967476 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 409/801] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:37 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1471 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:37.974886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a2ec8009-bbd8-464d-afd2-3059562e79be tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:37.976344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a2ec8009-bbd8-464d-afd2-3059562e79be tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:38.082245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a2ec8009-bbd8-464d-afd2-3059562e79be tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:38.087230 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a2ec8009-bbd8-464d-afd2-3059562e79be tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1245 microversion: 2.1 time: 0.118563 May 28 21:05:38.096940 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 410/802] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:37 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1245 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:38.132073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3488fcca-15d0-4a0a-be7a-787974a27bd8 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:38.134336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3488fcca-15d0-4a0a-be7a-787974a27bd8 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:38.159018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3488fcca-15d0-4a0a-be7a-787974a27bd8 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:38.161243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3488fcca-15d0-4a0a-be7a-787974a27bd8 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:38.162934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3488fcca-15d0-4a0a-be7a-787974a27bd8 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:38.163640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3488fcca-15d0-4a0a-be7a-787974a27bd8 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:38.190026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-44db078c-a960-45b9-98bf-cf739316d3c0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:38.199185 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-44db078c-a960-45b9-98bf-cf739316d3c0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1462 microversion: 2.1 time: 0.316716 May 28 21:05:38.210402 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 393/803] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:37 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1462 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:38.215248 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9da1849c-4d49-4469-a800-465877264e06 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Calling method '.version_select at 0x7f4d642594c0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:38.224230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9da1849c-4d49-4469-a800-465877264e06 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:38.224230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9da1849c-4d49-4469-a800-465877264e06 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:38.239699 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9da1849c-4d49-4469-a800-465877264e06 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2338 microversion: 2.1 time: 0.028507 May 28 21:05:38.240632 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 394/804] 10.222.0.33 () {58 vars in 1142 bytes} [Sat May 28 21:05:38 2022] GET /compute/v2.1/os-migrations => generated 2338 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:38.272178 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-df29f544-5ae9-4990-bcc3-adcfbd3c3955 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:38.279765 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-df29f544-5ae9-4990-bcc3-adcfbd3c3955 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012143 May 28 21:05:38.282880 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 395/805] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:05:38 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:05:38.291138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f898f01e-c72c-4734-ad04-c1cd9440e594 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1359734471", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:38.292580 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:05:38.292580 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:05:38.397616 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f898f01e-c72c-4734-ad04-c1cd9440e594 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.093063 May 28 21:05:38.406326 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 396/806] 10.222.0.33 () {60 vars in 1145 bytes} [Sat May 28 21:05:38 2022] POST /compute/v2.1/flavors => generated 499 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:38.421681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2423bb42-3ef8-42b7-b11f-5c759f6b2ccd tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:38.439240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3488fcca-15d0-4a0a-be7a-787974a27bd8 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:38.446305 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2423bb42-3ef8-42b7-b11f-5c759f6b2ccd tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.037297 May 28 21:05:38.447200 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 397/807] 10.222.0.33 () {58 vars in 1181 bytes} [Sat May 28 21:05:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:05:38.464207 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3488fcca-15d0-4a0a-be7a-787974a27bd8 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1469 microversion: 2.1 time: 0.339766 May 28 21:05:38.464207 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 411/808] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:38 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1469 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:38.532004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-ed8b7928-ea93-43be-bc90-5518124fe7d2 req-e9605c20-18cc-4866-9ac1-bcb4709d1885 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a538e54e-1c93-4369-baff-d514f9ce5eb7", "name": "network-vif-deleted", "tag": "f8b668d3-2d67-4cc2-984f-30259dbe36a4"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:38.548879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ed8b7928-ea93-43be-bc90-5518124fe7d2 req-e9605c20-18cc-4866-9ac1-bcb4709d1885 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:38.552212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ed8b7928-ea93-43be-bc90-5518124fe7d2 req-e9605c20-18cc-4866-9ac1-bcb4709d1885 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:38.569917 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-ed8b7928-ea93-43be-bc90-5518124fe7d2 req-e9605c20-18cc-4866-9ac1-bcb4709d1885 service nova] Creating event network-vif-deleted:f8b668d3-2d67-4cc2-984f-30259dbe36a4 for instance a538e54e-1c93-4369-baff-d514f9ce5eb7 on nch2-master-1 May 28 21:05:38.576325 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-ed8b7928-ea93-43be-bc90-5518124fe7d2 req-e9605c20-18cc-4866-9ac1-bcb4709d1885 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049787 May 28 21:05:38.577804 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 412/809] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:38.721071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1556359395", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "16150357-3f84-4cbe-8c22-7225331e95af"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:38.757116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6819c872-4dc7-43d6-b710-cde0c93ab367 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:38.757924 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6819c872-4dc7-43d6-b710-cde0c93ab367 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:38.772360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6819c872-4dc7-43d6-b710-cde0c93ab367 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:38.772965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6819c872-4dc7-43d6-b710-cde0c93ab367 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:38.773749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6819c872-4dc7-43d6-b710-cde0c93ab367 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:38.774452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6819c872-4dc7-43d6-b710-cde0c93ab367 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:38.811739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:05:39.079940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6819c872-4dc7-43d6-b710-cde0c93ab367 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:39.088629 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6819c872-4dc7-43d6-b710-cde0c93ab367 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.338179 May 28 21:05:39.098600 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 413/810] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:38 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:39.103737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-623635cf-35ed-43e3-a4e9-f9d6087864ba req-eac2499e-d972-481b-9b16-6dd3d6c0767b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b8d752-edaa-40bc-b38f-1d1441231d82", "name": "network-vif-unplugged", "status": "completed", "tag": "2f2ef26b-3762-4660-9c11-d7af1c1c3ef4"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:39.112296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-623635cf-35ed-43e3-a4e9-f9d6087864ba req-eac2499e-d972-481b-9b16-6dd3d6c0767b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:39.112767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-623635cf-35ed-43e3-a4e9-f9d6087864ba req-eac2499e-d972-481b-9b16-6dd3d6c0767b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:39.124399 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-623635cf-35ed-43e3-a4e9-f9d6087864ba req-eac2499e-d972-481b-9b16-6dd3d6c0767b service nova] Creating event network-vif-unplugged:2f2ef26b-3762-4660-9c11-d7af1c1c3ef4 for instance 45b8d752-edaa-40bc-b38f-1d1441231d82 on nch1-master-1 May 28 21:05:39.133322 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-623635cf-35ed-43e3-a4e9-f9d6087864ba req-eac2499e-d972-481b-9b16-6dd3d6c0767b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030643 May 28 21:05:39.133322 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 414/811] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:39.136365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3b8d88e7-42a7-4f08-81a0-a37e603e614a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:39.137006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3b8d88e7-42a7-4f08-81a0-a37e603e614a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:39.143253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b8d88e7-42a7-4f08-81a0-a37e603e614a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:39.143706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b8d88e7-42a7-4f08-81a0-a37e603e614a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:39.144471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b8d88e7-42a7-4f08-81a0-a37e603e614a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:39.145490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b8d88e7-42a7-4f08-81a0-a37e603e614a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:39.302180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:05:39.302615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:05:39.303121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:05:39.303558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:05:39.303966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:05:39.313224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:39.313688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:39.314614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:39.324872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:39.333214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Getting quotas for project d6c38a96a96b4fba9e41ac58f5054803. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:05:39.338526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Getting quotas for user c14b965da64c40e382c69050ba01b183 and project d6c38a96a96b4fba9e41ac58f5054803. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:05:39.351226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:05:39.362222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:05:39.384074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3b8d88e7-42a7-4f08-81a0-a37e603e614a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:39.396269 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3b8d88e7-42a7-4f08-81a0-a37e603e614a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1471 microversion: 2.1 time: 0.259426 May 28 21:05:39.396269 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 415/812] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:39 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1471 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:39.397526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2a03e71e-73b9-4119-9e52-caa46bf80553 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:39.398165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2a03e71e-73b9-4119-9e52-caa46bf80553 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:39.404417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a03e71e-73b9-4119-9e52-caa46bf80553 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:39.405076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a03e71e-73b9-4119-9e52-caa46bf80553 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:39.405867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a03e71e-73b9-4119-9e52-caa46bf80553 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:39.406322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a03e71e-73b9-4119-9e52-caa46bf80553 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:39.465539 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f0f5b20b-dc9f-4dfe-928b-4cc19c3e6060 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751115 May 28 21:05:39.467021 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 398/813] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:05:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:05:39.469001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2a03e71e-73b9-4119-9e52-caa46bf80553 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:39.477518 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2a03e71e-73b9-4119-9e52-caa46bf80553 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1249 microversion: 2.1 time: 0.083971 May 28 21:05:39.478132 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 416/814] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:39 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:39.483326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f63adfbe-db18-49f2-bdf5-c3caf609c0b1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:39.488917 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f63adfbe-db18-49f2-bdf5-c3caf609c0b1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:39.492504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f63adfbe-db18-49f2-bdf5-c3caf609c0b1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:39.493464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f63adfbe-db18-49f2-bdf5-c3caf609c0b1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:39.494135 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f63adfbe-db18-49f2-bdf5-c3caf609c0b1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:39.494611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f63adfbe-db18-49f2-bdf5-c3caf609c0b1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:39.530975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f63adfbe-db18-49f2-bdf5-c3caf609c0b1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:39.531529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f63adfbe-db18-49f2-bdf5-c3caf609c0b1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:39.532335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-f63adfbe-db18-49f2-bdf5-c3caf609c0b1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lazy-loading 'fault' on Instance uuid a538e54e-1c93-4369-baff-d514f9ce5eb7 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:05:39.625553 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e5553a0e-cd88-47a1-bd03-c6f1a056bb5a tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] 10.222.0.33 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.155470 May 28 21:05:39.625553 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 399/815] 10.222.0.33 () {58 vars in 1127 bytes} [Sat May 28 21:05:39 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 28 21:05:39.629963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ad3a8ded-fc49-49b8-9162-bc19b77690d5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:39.630585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ad3a8ded-fc49-49b8-9162-bc19b77690d5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:39.641222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f63adfbe-db18-49f2-bdf5-c3caf609c0b1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:39.661193 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f63adfbe-db18-49f2-bdf5-c3caf609c0b1 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1312 microversion: 2.1 time: 0.180698 May 28 21:05:39.662411 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 417/816] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:39 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1312 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:39.678810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6bad65a1-27b9-417f-ae42-147eb97e3d1e tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] Calling method '.version_select at 0x7f4d643ac790>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:39.713253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ad3a8ded-fc49-49b8-9162-bc19b77690d5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:39.720458 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ad3a8ded-fc49-49b8-9162-bc19b77690d5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1279 microversion: 2.1 time: 0.095530 May 28 21:05:39.721101 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 400/817] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:39 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:39.733360 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-6bad65a1-27b9-417f-ae42-147eb97e3d1e tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] HTTP exception thrown: Image not found. May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6bad65a1-27b9-417f-ae42-147eb97e3d1e tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] Request method failure captured: May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko6jpYPem-pEpzis1RtoRL03t1XcpebJBGrhfffhqSmEehujcMNJQ124m_lyrnE7FVTQv2RrG6fRI_m0r81gakYYQGvTD6LU13wXZKqAm37Df7JmMBY0xVct0hbpb6IExny_o_3crSvIUZl9ySHIQm7l9_Q1Iz6q-CAM2ZCxIaZ1tFI May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 60bc9878b797401baef0263dbce27503 May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-705009426 May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:05:39.757071 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:05:39.758923 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60bc9878b797401baef0263dbce27503", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60bc9878b797401baef0263dbce27503"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60bc9878b797401baef0263dbce27503"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60bc9878b797401baef0263dbce27503"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:39.758923 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-705009426 May 28 21:05:39.758923 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 60bc9878b797401baef0263dbce27503 May 28 21:05:39.758923 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-705009426 May 28 21:05:39.758923 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesDeleteNegativeTestJSON-705009426-project May 28 21:05:39.758923 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:05:39.758923 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:05:39.758923 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: d7448caf7fcf424c93e0450e251829aa May 28 21:05:39.758923 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-705009426-project May 28 21:05:39.758923 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:05:39.758923 ncdv-master-1 devstack@n-api.service[143128]: exception: Image not found. May 28 21:05:39.758923 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '-1'} May 28 21:05:39.758923 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:39.758923 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.759955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:39.761367 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 21:05:39.762885 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:05:39.762885 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:05:39.762885 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.762885 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:39.762885 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.762885 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.762885 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:39.762885 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:39.762885 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:05:39.762885 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:05:39.762885 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:05:39.762885 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.762885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6bad65a1-27b9-417f-ae42-147eb97e3d1e tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] Returning 404 to user: Image not found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:39.762885 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6bad65a1-27b9-417f-ae42-147eb97e3d1e tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] 10.222.0.33 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.095281 May 28 21:05:39.762885 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 418/818] 10.222.0.33 () {58 vars in 1133 bytes} [Sat May 28 21:05:39 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:05:39.769139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-75685f52-7639-46ec-baf9-f2040a15f14c tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] Calling method '.version_select at 0x7f4d64259040>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:39.799214 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-75685f52-7639-46ec-baf9-f2040a15f14c tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] HTTP exception thrown: Image not found. May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-75685f52-7639-46ec-baf9-f2040a15f14c tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] Request method failure captured: May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/images/00e899fb-8244-445b-a6b4-e9af1ee3253j HTTP/1.1 May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko6jpYPem-pEpzis1RtoRL03t1XcpebJBGrhfffhqSmEehujcMNJQ124m_lyrnE7FVTQv2RrG6fRI_m0r81gakYYQGvTD6LU13wXZKqAm37Df7JmMBY0xVct0hbpb6IExny_o_3crSvIUZl9ySHIQm7l9_Q1Iz6q-CAM2ZCxIaZ1tFI May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 60bc9878b797401baef0263dbce27503 May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-705009426 May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:05:39.802974 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:05:39.809491 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60bc9878b797401baef0263dbce27503", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60bc9878b797401baef0263dbce27503"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60bc9878b797401baef0263dbce27503"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60bc9878b797401baef0263dbce27503"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:39.809491 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-705009426 May 28 21:05:39.809491 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 60bc9878b797401baef0263dbce27503 May 28 21:05:39.809491 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-705009426 May 28 21:05:39.809491 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesDeleteNegativeTestJSON-705009426-project May 28 21:05:39.809491 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:05:39.809491 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:05:39.809491 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: d7448caf7fcf424c93e0450e251829aa May 28 21:05:39.809491 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-705009426-project May 28 21:05:39.809491 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:05:39.809491 ncdv-master-1 devstack@n-api.service[143129]: exception: Image not found. May 28 21:05:39.809491 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '00e899fb-8244-445b-a6b4-e9af1ee3253j'} May 28 21:05:39.809491 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 00e899fb-8244-445b-a6b4-e9af1ee3253j to delete May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:39.810925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 00e899fb-8244-445b-a6b4-e9af1ee3253j could not be found. May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:39.812469 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:39.813970 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 21:05:39.813970 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:05:39.813970 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:05:39.813970 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:39.813970 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:39.813970 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:39.813970 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.813970 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:39.813970 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:39.813970 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:05:39.813970 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:05:39.813970 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:05:39.813970 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:39.813970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-75685f52-7639-46ec-baf9-f2040a15f14c tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] Returning 404 to user: Image not found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:39.813970 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-75685f52-7639-46ec-baf9-f2040a15f14c tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] 10.222.0.33 "DELETE /compute/v2.1/images/00e899fb-8244-445b-a6b4-e9af1ee3253j" status: 404 len: 62 microversion: 2.1 time: 0.039865 May 28 21:05:39.815277 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 401/819] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:39 2022] DELETE /compute/v2.1/images/00e899fb-8244-445b-a6b4-e9af1ee3253j => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:05:39.818669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-93eac084-597a-4f64-a83e-a300081f98d3 tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] Calling method '.version_select at 0x7f4d64276b80>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:39.839265 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-93eac084-597a-4f64-a83e-a300081f98d3 tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] HTTP exception thrown: Image not found. May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-93eac084-597a-4f64-a83e-a300081f98d3 tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] Request method failure captured: May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/images/b7f710e1-44d0-4338-9b5d-237c305577ef1 HTTP/1.1 May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko6jpYPem-pEpzis1RtoRL03t1XcpebJBGrhfffhqSmEehujcMNJQ124m_lyrnE7FVTQv2RrG6fRI_m0r81gakYYQGvTD6LU13wXZKqAm37Df7JmMBY0xVct0hbpb6IExny_o_3crSvIUZl9ySHIQm7l9_Q1Iz6q-CAM2ZCxIaZ1tFI May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 60bc9878b797401baef0263dbce27503 May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-705009426 May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:05:39.841103 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:05:39.842598 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60bc9878b797401baef0263dbce27503", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60bc9878b797401baef0263dbce27503"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60bc9878b797401baef0263dbce27503"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60bc9878b797401baef0263dbce27503"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:39.842598 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-705009426 May 28 21:05:39.842598 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 60bc9878b797401baef0263dbce27503 May 28 21:05:39.842598 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-705009426 May 28 21:05:39.842598 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesDeleteNegativeTestJSON-705009426-project May 28 21:05:39.842598 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:05:39.842598 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:05:39.842598 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: d7448caf7fcf424c93e0450e251829aa May 28 21:05:39.842598 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-705009426-project May 28 21:05:39.842598 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:05:39.842598 ncdv-master-1 devstack@n-api.service[143128]: exception: Image not found. May 28 21:05:39.842598 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'b7f710e1-44d0-4338-9b5d-237c305577ef1'} May 28 21:05:39.842598 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b7f710e1-44d0-4338-9b5d-237c305577ef1 to delete May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:39.843397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b7f710e1-44d0-4338-9b5d-237c305577ef1 could not be found. May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:39.845760 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:39.849335 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 21:05:39.849335 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:05:39.849335 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:05:39.849335 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.849335 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:39.849335 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.849335 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.849335 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:39.849335 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:39.849335 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:05:39.849335 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:05:39.849335 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:05:39.849335 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.849335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-93eac084-597a-4f64-a83e-a300081f98d3 tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] Returning 404 to user: Image not found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:39.849335 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-93eac084-597a-4f64-a83e-a300081f98d3 tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] 10.222.0.33 "DELETE /compute/v2.1/images/b7f710e1-44d0-4338-9b5d-237c305577ef1" status: 404 len: 62 microversion: 2.1 time: 0.030173 May 28 21:05:39.851452 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 419/820] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:05:39 2022] DELETE /compute/v2.1/images/b7f710e1-44d0-4338-9b5d-237c305577ef1 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:05:39.855398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-52e4ed09-113d-4f09-829b-95aae3e927ab tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] Calling method '.version_select at 0x7f4d64b32ca0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-52e4ed09-113d-4f09-829b-95aae3e927ab tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] HTTP exception thrown: Image not found. May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-52e4ed09-113d-4f09-829b-95aae3e927ab tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] Request method failure captured: May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/images/tempest-invalid-2023994292 HTTP/1.1 May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko6jpYPem-pEpzis1RtoRL03t1XcpebJBGrhfffhqSmEehujcMNJQ124m_lyrnE7FVTQv2RrG6fRI_m0r81gakYYQGvTD6LU13wXZKqAm37Df7JmMBY0xVct0hbpb6IExny_o_3crSvIUZl9ySHIQm7l9_Q1Iz6q-CAM2ZCxIaZ1tFI May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 60bc9878b797401baef0263dbce27503 May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-705009426 May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:05:39.888546 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:05:39.890457 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60bc9878b797401baef0263dbce27503", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60bc9878b797401baef0263dbce27503"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60bc9878b797401baef0263dbce27503"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60bc9878b797401baef0263dbce27503"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:39.890457 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-705009426 May 28 21:05:39.890457 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 60bc9878b797401baef0263dbce27503 May 28 21:05:39.890457 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-705009426 May 28 21:05:39.890457 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesDeleteNegativeTestJSON-705009426-project May 28 21:05:39.890457 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:05:39.890457 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:05:39.890457 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: d7448caf7fcf424c93e0450e251829aa May 28 21:05:39.890457 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-705009426-project May 28 21:05:39.890457 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:05:39.890457 ncdv-master-1 devstack@n-api.service[143129]: exception: Image not found. May 28 21:05:39.890457 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'tempest-invalid-2023994292'} May 28 21:05:39.890457 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-2023994292 to delete May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:39.892387 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-2023994292 could not be found. May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:39.894038 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:39.895972 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 21:05:39.895972 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:05:39.895972 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:05:39.895972 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:39.895972 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:39.895972 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:39.895972 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.895972 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:39.895972 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:39.895972 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:05:39.895972 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:05:39.895972 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:05:39.895972 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:39.895972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-52e4ed09-113d-4f09-829b-95aae3e927ab tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] Returning 404 to user: Image not found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:39.895972 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-52e4ed09-113d-4f09-829b-95aae3e927ab tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] 10.222.0.33 "DELETE /compute/v2.1/images/tempest-invalid-2023994292" status: 404 len: 62 microversion: 2.1 time: 0.039460 May 28 21:05:39.897599 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 402/821] 10.222.0.33 () {58 vars in 1205 bytes} [Sat May 28 21:05:39 2022] DELETE /compute/v2.1/images/tempest-invalid-2023994292 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:05:39.900896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-15267208-7ca1-4d52-b78d-7949e5b124b5 tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] Calling method '.version_select at 0x7f4d643ac700>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:39.921566 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-15267208-7ca1-4d52-b78d-7949e5b124b5 tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] HTTP exception thrown: Image not found. May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-15267208-7ca1-4d52-b78d-7949e5b124b5 tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] Request method failure captured: May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/images/5582313b-f1d8-4e0f-98ba-610c7e19ecfe HTTP/1.1 May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko6jpYPem-pEpzis1RtoRL03t1XcpebJBGrhfffhqSmEehujcMNJQ124m_lyrnE7FVTQv2RrG6fRI_m0r81gakYYQGvTD6LU13wXZKqAm37Df7JmMBY0xVct0hbpb6IExny_o_3crSvIUZl9ySHIQm7l9_Q1Iz6q-CAM2ZCxIaZ1tFI May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 60bc9878b797401baef0263dbce27503 May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-705009426 May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:05:39.923545 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:05:39.939739 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_60bc9878b797401baef0263dbce27503", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60bc9878b797401baef0263dbce27503"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/60bc9878b797401baef0263dbce27503"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/60bc9878b797401baef0263dbce27503"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:39.939739 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-705009426 May 28 21:05:39.939739 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 60bc9878b797401baef0263dbce27503 May 28 21:05:39.939739 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-705009426 May 28 21:05:39.939739 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesDeleteNegativeTestJSON-705009426-project May 28 21:05:39.939739 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:05:39.939739 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:05:39.939739 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: d7448caf7fcf424c93e0450e251829aa May 28 21:05:39.939739 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-705009426-project May 28 21:05:39.939739 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:05:39.939739 ncdv-master-1 devstack@n-api.service[143128]: exception: Image not found. May 28 21:05:39.939739 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '5582313b-f1d8-4e0f-98ba-610c7e19ecfe'} May 28 21:05:39.939739 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5582313b-f1d8-4e0f-98ba-610c7e19ecfe to delete May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:39.941089 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5582313b-f1d8-4e0f-98ba-610c7e19ecfe could not be found. May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:39.942958 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:39.945371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 21:05:39.945371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:05:39.945371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:05:39.945371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.945371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:39.945371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.945371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:39.945371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:39.945371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:39.945371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:05:39.945371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:05:39.945371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:05:39.945371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:39.945371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-15267208-7ca1-4d52-b78d-7949e5b124b5 tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] Returning 404 to user: Image not found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:39.945371 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-15267208-7ca1-4d52-b78d-7949e5b124b5 tempest-ImagesDeleteNegativeTestJSON-705009426 tempest-ImagesDeleteNegativeTestJSON-705009426-project] 10.222.0.33 "DELETE /compute/v2.1/images/5582313b-f1d8-4e0f-98ba-610c7e19ecfe" status: 404 len: 62 microversion: 2.1 time: 0.028532 May 28 21:05:39.946478 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 420/822] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:39 2022] DELETE /compute/v2.1/images/5582313b-f1d8-4e0f-98ba-610c7e19ecfe => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 21:05:40.105478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c6d472d1-1c13-4c50-84ee-47b584a28c29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:40.106132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c6d472d1-1c13-4c50-84ee-47b584a28c29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:40.112369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6d472d1-1c13-4c50-84ee-47b584a28c29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:40.112837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6d472d1-1c13-4c50-84ee-47b584a28c29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:40.114366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6d472d1-1c13-4c50-84ee-47b584a28c29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:40.114760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6d472d1-1c13-4c50-84ee-47b584a28c29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:40.246879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c6d472d1-1c13-4c50-84ee-47b584a28c29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:40.254484 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c6d472d1-1c13-4c50-84ee-47b584a28c29 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.153296 May 28 21:05:40.255049 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 403/823] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:40 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:40.411161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5457b547-721e-41c9-96f7-f00dc11421b2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:40.411725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5457b547-721e-41c9-96f7-f00dc11421b2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:40.420588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5457b547-721e-41c9-96f7-f00dc11421b2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:40.421047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5457b547-721e-41c9-96f7-f00dc11421b2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:40.421870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5457b547-721e-41c9-96f7-f00dc11421b2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:40.422311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5457b547-721e-41c9-96f7-f00dc11421b2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:40.425151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:40.500944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-928d9faf-5917-4dda-a200-69e24b0b729f tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:40.500944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-928d9faf-5917-4dda-a200-69e24b0b729f tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:40.502735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-928d9faf-5917-4dda-a200-69e24b0b729f tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:40.503398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-928d9faf-5917-4dda-a200-69e24b0b729f tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:40.504295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-928d9faf-5917-4dda-a200-69e24b0b729f tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:40.505129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-928d9faf-5917-4dda-a200-69e24b0b729f tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:40.600631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-928d9faf-5917-4dda-a200-69e24b0b729f tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:40.605489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5457b547-721e-41c9-96f7-f00dc11421b2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:40.616183 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5457b547-721e-41c9-96f7-f00dc11421b2 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1471 microversion: 2.1 time: 0.209869 May 28 21:05:40.616410 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-928d9faf-5917-4dda-a200-69e24b0b729f tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1297 microversion: 2.1 time: 0.125865 May 28 21:05:40.617538 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 421/824] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:40 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:40.618493 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 404/825] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:40 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1297 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:40.679043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f8096f35-2868-448a-b762-6a496c9fc091 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:40.681872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f8096f35-2868-448a-b762-6a496c9fc091 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:40.687054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8096f35-2868-448a-b762-6a496c9fc091 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:40.687503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8096f35-2868-448a-b762-6a496c9fc091 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:40.688293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8096f35-2868-448a-b762-6a496c9fc091 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:40.688736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8096f35-2868-448a-b762-6a496c9fc091 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:40.722648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8096f35-2868-448a-b762-6a496c9fc091 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:40.723105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8096f35-2868-448a-b762-6a496c9fc091 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:40.723566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-f8096f35-2868-448a-b762-6a496c9fc091 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lazy-loading 'fault' on Instance uuid a538e54e-1c93-4369-baff-d514f9ce5eb7 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:05:40.738458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6c848a89-c426-433e-9678-2ad4b503966b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:40.740189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6c848a89-c426-433e-9678-2ad4b503966b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:40.747708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c848a89-c426-433e-9678-2ad4b503966b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:40.748881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c848a89-c426-433e-9678-2ad4b503966b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:40.750210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c848a89-c426-433e-9678-2ad4b503966b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:40.751150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c848a89-c426-433e-9678-2ad4b503966b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:40.773905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f8096f35-2868-448a-b762-6a496c9fc091 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:40.803730 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f8096f35-2868-448a-b762-6a496c9fc091 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 200 len: 1312 microversion: 2.1 time: 0.128576 May 28 21:05:40.804335 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 422/826] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:40 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 1312 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:40.834370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6c848a89-c426-433e-9678-2ad4b503966b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:40.843026 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6c848a89-c426-433e-9678-2ad4b503966b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1283 microversion: 2.1 time: 0.108405 May 28 21:05:40.843608 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 405/827] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:40 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1283 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:41.149047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-53b20ee9-ba73-45e7-8304-380576f880c2 req-f7fcc363-8f91-474b-b229-42109b3516bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45b8d752-edaa-40bc-b38f-1d1441231d82", "tag": "2f2ef26b-3762-4660-9c11-d7af1c1c3ef4"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:41.159735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-53b20ee9-ba73-45e7-8304-380576f880c2 req-f7fcc363-8f91-474b-b229-42109b3516bf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:41.160510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-53b20ee9-ba73-45e7-8304-380576f880c2 req-f7fcc363-8f91-474b-b229-42109b3516bf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:41.173058 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-53b20ee9-ba73-45e7-8304-380576f880c2 req-f7fcc363-8f91-474b-b229-42109b3516bf service nova] Creating event network-changed:2f2ef26b-3762-4660-9c11-d7af1c1c3ef4 for instance 45b8d752-edaa-40bc-b38f-1d1441231d82 on nch1-master-1 May 28 21:05:41.183326 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-53b20ee9-ba73-45e7-8304-380576f880c2 req-f7fcc363-8f91-474b-b229-42109b3516bf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036314 May 28 21:05:41.183326 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 423/828] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:41.272276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc762c41-2707-4bab-aa70-900befe1cee8 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:41.273180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc762c41-2707-4bab-aa70-900befe1cee8 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:41.286778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc762c41-2707-4bab-aa70-900befe1cee8 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:41.290415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc762c41-2707-4bab-aa70-900befe1cee8 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:41.291562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc762c41-2707-4bab-aa70-900befe1cee8 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:41.292186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc762c41-2707-4bab-aa70-900befe1cee8 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:41.513261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc762c41-2707-4bab-aa70-900befe1cee8 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:41.520788 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc762c41-2707-4bab-aa70-900befe1cee8 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.254022 May 28 21:05:41.522497 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 406/829] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:41 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:41.638135 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3ab6c856-78f9-435a-93e7-473959897aa7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:41.638990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3ab6c856-78f9-435a-93e7-473959897aa7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:41.647830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b114f731-8393-4190-9ebb-766c011abea0 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:41.648455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b114f731-8393-4190-9ebb-766c011abea0 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:41.668338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b114f731-8393-4190-9ebb-766c011abea0 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:41.672192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b114f731-8393-4190-9ebb-766c011abea0 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:41.673632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ab6c856-78f9-435a-93e7-473959897aa7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:41.677445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ab6c856-78f9-435a-93e7-473959897aa7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:41.681461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ab6c856-78f9-435a-93e7-473959897aa7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:41.681461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ab6c856-78f9-435a-93e7-473959897aa7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:41.682652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b114f731-8393-4190-9ebb-766c011abea0 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:41.683469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b114f731-8393-4190-9ebb-766c011abea0 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:42.186731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b114f731-8393-4190-9ebb-766c011abea0 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:42.194691 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b114f731-8393-4190-9ebb-766c011abea0 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.551018 May 28 21:05:42.195666 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 407/830] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:41 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:42.201382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2068a89d-15a2-4cfd-b506-2d4524176c22 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:42.202040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2068a89d-15a2-4cfd-b506-2d4524176c22 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: a538e54e-1c93-4369-baff-d514f9ce5eb7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:42.208829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3ab6c856-78f9-435a-93e7-473959897aa7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:42.216641 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3ab6c856-78f9-435a-93e7-473959897aa7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1471 microversion: 2.1 time: 0.586421 May 28 21:05:42.217488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2068a89d-15a2-4cfd-b506-2d4524176c22 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:42.217705 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 424/831] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:41 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1471 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:42.219017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2068a89d-15a2-4cfd-b506-2d4524176c22 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:42.220055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2068a89d-15a2-4cfd-b506-2d4524176c22 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:42.222099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-21f83c5e-151a-40b6-aeb5-6f49e787f88e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:42.223564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-21f83c5e-151a-40b6-aeb5-6f49e787f88e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:42.226471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2068a89d-15a2-4cfd-b506-2d4524176c22 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:42.235362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21f83c5e-151a-40b6-aeb5-6f49e787f88e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:42.235988 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21f83c5e-151a-40b6-aeb5-6f49e787f88e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:42.237065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21f83c5e-151a-40b6-aeb5-6f49e787f88e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:42.237546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21f83c5e-151a-40b6-aeb5-6f49e787f88e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:42.253234 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-2068a89d-15a2-4cfd-b506-2d4524176c22 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] HTTP exception thrown: Instance a538e54e-1c93-4369-baff-d514f9ce5eb7 could not be found. May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2068a89d-15a2-4cfd-b506-2d4524176c22 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Request method failure captured: May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 HTTP/1.1 May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko5v1tfQZ8CCJ1XfS30U2chDr6YsenimuBdZFl4nLaGw2uXeOL1zM_3QOdSMqEtuIPESo1aNDpDBEwqA0sWpzCb9U0thHwh0d_4qlLia1naX8zl6yiqqbUiWx4NQVoMAQIgHgXsDBdLcy4oVgOa_pfXpoFBJubozsWDorrCRs-Xbm_g May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 8058694a4ecb467783677e687e16ecb6 May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-727463323 May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:05:42.265051 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:05:42.266719 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8058694a4ecb467783677e687e16ecb6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8058694a4ecb467783677e687e16ecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8058694a4ecb467783677e687e16ecb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8058694a4ecb467783677e687e16ecb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:42.266719 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersAdminNegativeTestJSON-727463323 May 28 21:05:42.266719 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 8058694a4ecb467783677e687e16ecb6 May 28 21:05:42.266719 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-727463323 May 28 21:05:42.266719 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersAdminNegativeTestJSON-727463323-project May 28 21:05:42.266719 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:05:42.266719 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:05:42.266719 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 3b044baceddf49219485bd14aa914e35 May 28 21:05:42.266719 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersAdminNegativeTestJSON-727463323-project May 28 21:05:42.266719 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:05:42.266719 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance a538e54e-1c93-4369-baff-d514f9ce5eb7 could not be found. May 28 21:05:42.266719 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'a538e54e-1c93-4369-baff-d514f9ce5eb7'} May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a538e54e-1c93-4369-baff-d514f9ce5eb7 could not be found. May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:42.267594 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a538e54e-1c93-4369-baff-d514f9ce5eb7 could not be found. May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a538e54e-1c93-4369-baff-d514f9ce5eb7 could not be found. May 28 21:05:42.268858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:05:42.272350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2068a89d-15a2-4cfd-b506-2d4524176c22 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Returning 404 to user: Instance a538e54e-1c93-4369-baff-d514f9ce5eb7 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:42.273417 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2068a89d-15a2-4cfd-b506-2d4524176c22 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7" status: 404 len: 111 microversion: 2.1 time: 0.076671 May 28 21:05:42.276765 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 408/832] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:42 2022] GET /compute/v2.1/servers/a538e54e-1c93-4369-baff-d514f9ce5eb7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:05:42.283869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a3383de4-2812-468a-8cf8-d940d778db2a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:42.285946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a3383de4-2812-468a-8cf8-d940d778db2a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:42.295443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3383de4-2812-468a-8cf8-d940d778db2a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:42.295889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3383de4-2812-468a-8cf8-d940d778db2a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:42.301296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3383de4-2812-468a-8cf8-d940d778db2a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:42.301504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3383de4-2812-468a-8cf8-d940d778db2a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:42.358957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-21f83c5e-151a-40b6-aeb5-6f49e787f88e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:42.375408 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-21f83c5e-151a-40b6-aeb5-6f49e787f88e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1339 microversion: 2.1 time: 0.155078 May 28 21:05:42.375408 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 425/833] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:42 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1339 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:42.387681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cfdaf396-e547-4fff-b17f-e3709a0dc0a7 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:42.388585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cfdaf396-e547-4fff-b17f-e3709a0dc0a7 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:42.401762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cfdaf396-e547-4fff-b17f-e3709a0dc0a7 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:42.407432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cfdaf396-e547-4fff-b17f-e3709a0dc0a7 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:42.407432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cfdaf396-e547-4fff-b17f-e3709a0dc0a7 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:42.407432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cfdaf396-e547-4fff-b17f-e3709a0dc0a7 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:42.441640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cfdaf396-e547-4fff-b17f-e3709a0dc0a7 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:05:42.496002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-a3383de4-2812-468a-8cf8-d940d778db2a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'services' on Instance uuid 502fcad4-754e-4627-96fa-80843f774f47 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:05:42.510887 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a3383de4-2812-468a-8cf8-d940d778db2a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 2128 microversion: 2.25 time: 0.230897 May 28 21:05:42.516535 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 409/834] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:42 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 2128 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:42.536910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9c9f81b7-8018-41b4-971c-e075172d8f2f tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:42.538804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9c9f81b7-8018-41b4-971c-e075172d8f2f tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:42.545344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c9f81b7-8018-41b4-971c-e075172d8f2f tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:42.545782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c9f81b7-8018-41b4-971c-e075172d8f2f tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:42.546634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c9f81b7-8018-41b4-971c-e075172d8f2f tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:42.547337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c9f81b7-8018-41b4-971c-e075172d8f2f tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:42.619278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-9c9f81b7-8018-41b4-971c-e075172d8f2f tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'flavor' on Instance uuid 502fcad4-754e-4627-96fa-80843f774f47 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:05:42.643671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9c9f81b7-8018-41b4-971c-e075172d8f2f tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Going to try to live migrate instance to nch1-master-1 {{(pid=143129) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 21:05:42.650649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:42.746915 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cfdaf396-e547-4fff-b17f-e3709a0dc0a7 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 204 len: 0 microversion: 2.1 time: 0.370482 May 28 21:05:42.750497 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 426/835] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:05:42 2022] DELETE /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:05:42.753657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b4369a17-a334-4765-b2a3-65bce7928f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:42.754524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b4369a17-a334-4765-b2a3-65bce7928f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:42.760929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b4369a17-a334-4765-b2a3-65bce7928f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:42.761397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b4369a17-a334-4765-b2a3-65bce7928f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:42.762233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b4369a17-a334-4765-b2a3-65bce7928f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:42.762663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b4369a17-a334-4765-b2a3-65bce7928f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:42.947256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b4369a17-a334-4765-b2a3-65bce7928f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:42.957758 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b4369a17-a334-4765-b2a3-65bce7928f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.207273 May 28 21:05:42.957758 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 427/836] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:42 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:42.970976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fcce5f64-f08b-454b-8c27-e7cd5806bc46 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:42.972200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fcce5f64-f08b-454b-8c27-e7cd5806bc46 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:42.990654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fcce5f64-f08b-454b-8c27-e7cd5806bc46 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:42.991286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fcce5f64-f08b-454b-8c27-e7cd5806bc46 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:42.992420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fcce5f64-f08b-454b-8c27-e7cd5806bc46 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:43.006095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fcce5f64-f08b-454b-8c27-e7cd5806bc46 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:43.241110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fcce5f64-f08b-454b-8c27-e7cd5806bc46 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:43.254900 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fcce5f64-f08b-454b-8c27-e7cd5806bc46 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1477 microversion: 2.1 time: 0.294407 May 28 21:05:43.257890 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 428/837] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:42 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1477 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:43.267994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fccc2d77-d1bb-414f-bbf3-09b581a5ea4d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:43.268622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fccc2d77-d1bb-414f-bbf3-09b581a5ea4d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:43.288856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fccc2d77-d1bb-414f-bbf3-09b581a5ea4d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:43.289440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fccc2d77-d1bb-414f-bbf3-09b581a5ea4d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:43.290315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fccc2d77-d1bb-414f-bbf3-09b581a5ea4d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:43.290759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fccc2d77-d1bb-414f-bbf3-09b581a5ea4d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:43.462167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fccc2d77-d1bb-414f-bbf3-09b581a5ea4d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:43.477397 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fccc2d77-d1bb-414f-bbf3-09b581a5ea4d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.218277 May 28 21:05:43.495998 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 429/838] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:43 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:43.496799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b32817ac-6f82-4512-bbc3-c612ea10f866 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:43.498620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b32817ac-6f82-4512-bbc3-c612ea10f866 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:43.512125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b32817ac-6f82-4512-bbc3-c612ea10f866 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:43.512125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b32817ac-6f82-4512-bbc3-c612ea10f866 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:43.512125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b32817ac-6f82-4512-bbc3-c612ea10f866 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:43.512508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b32817ac-6f82-4512-bbc3-c612ea10f866 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:43.731637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b32817ac-6f82-4512-bbc3-c612ea10f866 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:43.746056 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b32817ac-6f82-4512-bbc3-c612ea10f866 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1471 microversion: 2.1 time: 0.255016 May 28 21:05:43.746998 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 430/839] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:43 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:43.755386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b7da6e9e-d541-43f4-a685-6c0811c8ec17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:43.756554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b7da6e9e-d541-43f4-a685-6c0811c8ec17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:43.765348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7da6e9e-d541-43f4-a685-6c0811c8ec17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:43.766357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7da6e9e-d541-43f4-a685-6c0811c8ec17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:43.767201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7da6e9e-d541-43f4-a685-6c0811c8ec17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:43.767693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7da6e9e-d541-43f4-a685-6c0811c8ec17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:43.879481 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b7da6e9e-d541-43f4-a685-6c0811c8ec17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:43.887875 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b7da6e9e-d541-43f4-a685-6c0811c8ec17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1339 microversion: 2.1 time: 0.138348 May 28 21:05:43.888727 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 431/840] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:43 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1339 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:43.975202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-213fea49-fa52-4570-8de0-430105087d69 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:43.975978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-213fea49-fa52-4570-8de0-430105087d69 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:43.986507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-213fea49-fa52-4570-8de0-430105087d69 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:43.987254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-213fea49-fa52-4570-8de0-430105087d69 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:43.988274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-213fea49-fa52-4570-8de0-430105087d69 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:43.989417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-213fea49-fa52-4570-8de0-430105087d69 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:44.197209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-213fea49-fa52-4570-8de0-430105087d69 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:44.206610 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-213fea49-fa52-4570-8de0-430105087d69 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.235836 May 28 21:05:44.208215 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 432/841] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:43 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:44.273144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-14807a58-ca83-41f2-892c-ce291325aed3 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:44.274118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-14807a58-ca83-41f2-892c-ce291325aed3 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:44.281461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14807a58-ca83-41f2-892c-ce291325aed3 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:44.282612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14807a58-ca83-41f2-892c-ce291325aed3 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:44.283568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14807a58-ca83-41f2-892c-ce291325aed3 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:44.284185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14807a58-ca83-41f2-892c-ce291325aed3 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:44.435270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-14807a58-ca83-41f2-892c-ce291325aed3 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:44.444456 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-14807a58-ca83-41f2-892c-ce291325aed3 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1477 microversion: 2.1 time: 0.175642 May 28 21:05:44.445621 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 433/842] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:44 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1477 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:44.511921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eb298a2b-989b-4340-bcb5-7eba569b235d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:44.512693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eb298a2b-989b-4340-bcb5-7eba569b235d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:44.530655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb298a2b-989b-4340-bcb5-7eba569b235d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:44.531117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb298a2b-989b-4340-bcb5-7eba569b235d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:44.536852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb298a2b-989b-4340-bcb5-7eba569b235d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:44.537941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb298a2b-989b-4340-bcb5-7eba569b235d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:44.599600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:44.748619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eb298a2b-989b-4340-bcb5-7eba569b235d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:44.758902 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eb298a2b-989b-4340-bcb5-7eba569b235d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.255543 May 28 21:05:44.761936 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 434/843] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:44 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:44.773691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-883c194d-5444-48d7-ac9a-028acbb7f3b4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:44.774565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-883c194d-5444-48d7-ac9a-028acbb7f3b4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:44.781343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-883c194d-5444-48d7-ac9a-028acbb7f3b4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:44.781990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-883c194d-5444-48d7-ac9a-028acbb7f3b4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:44.782810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-883c194d-5444-48d7-ac9a-028acbb7f3b4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:44.783249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-883c194d-5444-48d7-ac9a-028acbb7f3b4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:44.984852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-883c194d-5444-48d7-ac9a-028acbb7f3b4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:44.996895 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-883c194d-5444-48d7-ac9a-028acbb7f3b4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1477 microversion: 2.1 time: 0.235608 May 28 21:05:44.999101 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 435/844] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:44 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1477 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:45.004439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8b104d5f-8d1a-4aee-a293-6b14e5d60ae7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:45.005501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8b104d5f-8d1a-4aee-a293-6b14e5d60ae7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:45.014131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8b104d5f-8d1a-4aee-a293-6b14e5d60ae7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:45.020154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8b104d5f-8d1a-4aee-a293-6b14e5d60ae7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:45.020154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8b104d5f-8d1a-4aee-a293-6b14e5d60ae7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:45.020154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8b104d5f-8d1a-4aee-a293-6b14e5d60ae7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:45.037620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:45.129311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8b104d5f-8d1a-4aee-a293-6b14e5d60ae7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:45.140056 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8b104d5f-8d1a-4aee-a293-6b14e5d60ae7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1339 microversion: 2.1 time: 0.139441 May 28 21:05:45.140956 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 436/845] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:44 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1339 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:45.290631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1213056414", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "5bc429f4-a7fa-4b56-a7a6-1b807068de27"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:45.343825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] validate_networks() for [('5bc429f4-a7fa-4b56-a7a6-1b807068de27', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:05:45.719974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:05:45.720409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:05:45.720899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:05:45.721319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:05:45.721739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:05:45.732778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:45.733236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:45.734088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:45.734538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:45.754034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Getting quotas for project ab0c1d6a9fc44de4af61822849b3bf8d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:05:45.759521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Getting quotas for user dc48535b672d4d1190ecfefe6cb02720 and project ab0c1d6a9fc44de4af61822849b3bf8d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:05:45.774397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:05:45.776760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:05:45.934465 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-14b56143-1140-420a-ad4b-8d5bfcb2a317 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792431 May 28 21:05:45.940145 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 437/846] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:05:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:05:45.945609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e2a14731-73cf-458c-872f-d3a46c55e061 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:45.946983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e2a14731-73cf-458c-872f-d3a46c55e061 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:45.958995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e2a14731-73cf-458c-872f-d3a46c55e061 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:45.959533 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e2a14731-73cf-458c-872f-d3a46c55e061 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:45.960197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e2a14731-73cf-458c-872f-d3a46c55e061 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:45.960630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e2a14731-73cf-458c-872f-d3a46c55e061 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:46.156630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e2a14731-73cf-458c-872f-d3a46c55e061 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:46.178534 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e2a14731-73cf-458c-872f-d3a46c55e061 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.229720 May 28 21:05:46.188792 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 438/847] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:45 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:46.194160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c3e67fe6-2917-461a-ae84-6809f55d318e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:46.194783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c3e67fe6-2917-461a-ae84-6809f55d318e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:46.201026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3e67fe6-2917-461a-ae84-6809f55d318e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:46.201482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3e67fe6-2917-461a-ae84-6809f55d318e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:46.205957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3e67fe6-2917-461a-ae84-6809f55d318e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:46.205957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3e67fe6-2917-461a-ae84-6809f55d318e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:46.337312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c3e67fe6-2917-461a-ae84-6809f55d318e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:46.344960 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c3e67fe6-2917-461a-ae84-6809f55d318e tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1477 microversion: 2.1 time: 0.155053 May 28 21:05:46.345537 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 439/848] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:46 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1477 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:46.350262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ccfea31c-fe05-4c63-87d9-efcfd55a772e tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:46.350925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ccfea31c-fe05-4c63-87d9-efcfd55a772e tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:46.357692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccfea31c-fe05-4c63-87d9-efcfd55a772e tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:46.361089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccfea31c-fe05-4c63-87d9-efcfd55a772e tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:46.361089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccfea31c-fe05-4c63-87d9-efcfd55a772e tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:46.361089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccfea31c-fe05-4c63-87d9-efcfd55a772e tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:46.543024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ccfea31c-fe05-4c63-87d9-efcfd55a772e tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:46.551249 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ccfea31c-fe05-4c63-87d9-efcfd55a772e tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.204078 May 28 21:05:46.553543 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 440/849] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:46 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:46.569657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1ef35a14-95bd-4692-b636-734d96af8efa tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:46.569657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1ef35a14-95bd-4692-b636-734d96af8efa tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:46.626528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1ef35a14-95bd-4692-b636-734d96af8efa tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:46.634086 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1ef35a14-95bd-4692-b636-734d96af8efa tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1225 microversion: 2.1 time: 0.079329 May 28 21:05:46.634850 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 441/850] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:46 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:46.644777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4492cdf5-5bf5-482c-b7fb-49b517c6ccba tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:46.645492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4492cdf5-5bf5-482c-b7fb-49b517c6ccba tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:46.668067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4492cdf5-5bf5-482c-b7fb-49b517c6ccba tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:46.668742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4492cdf5-5bf5-482c-b7fb-49b517c6ccba tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:46.669867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4492cdf5-5bf5-482c-b7fb-49b517c6ccba tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:46.670344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4492cdf5-5bf5-482c-b7fb-49b517c6ccba tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:46.818141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4492cdf5-5bf5-482c-b7fb-49b517c6ccba tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:46.825910 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4492cdf5-5bf5-482c-b7fb-49b517c6ccba tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1477 microversion: 2.1 time: 0.185048 May 28 21:05:46.826501 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 442/851] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:46 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1477 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:46.831109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-df9c8a40-3573-4145-a73c-f2a0b30d0292 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:46.832035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-df9c8a40-3573-4145-a73c-f2a0b30d0292 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:46.838562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df9c8a40-3573-4145-a73c-f2a0b30d0292 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:46.839313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df9c8a40-3573-4145-a73c-f2a0b30d0292 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:46.840555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df9c8a40-3573-4145-a73c-f2a0b30d0292 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:46.841224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df9c8a40-3573-4145-a73c-f2a0b30d0292 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:46.922265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-df9c8a40-3573-4145-a73c-f2a0b30d0292 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:46.931048 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-df9c8a40-3573-4145-a73c-f2a0b30d0292 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1339 microversion: 2.1 time: 0.103494 May 28 21:05:46.940691 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 443/852] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:46 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1339 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:47.196118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-39d246c7-c7cb-48fa-9b9a-2824d67edb23 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:47.196637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-39d246c7-c7cb-48fa-9b9a-2824d67edb23 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:47.203628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39d246c7-c7cb-48fa-9b9a-2824d67edb23 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:47.204125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39d246c7-c7cb-48fa-9b9a-2824d67edb23 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:47.204937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39d246c7-c7cb-48fa-9b9a-2824d67edb23 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:47.205364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39d246c7-c7cb-48fa-9b9a-2824d67edb23 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:47.348431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-39d246c7-c7cb-48fa-9b9a-2824d67edb23 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:47.357994 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-39d246c7-c7cb-48fa-9b9a-2824d67edb23 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.165478 May 28 21:05:47.358597 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 444/853] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:47 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:47.365913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b25ddf74-510f-4806-a90f-748b7be4822c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:47.366543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b25ddf74-510f-4806-a90f-748b7be4822c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:47.373280 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b25ddf74-510f-4806-a90f-748b7be4822c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:47.373730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b25ddf74-510f-4806-a90f-748b7be4822c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:47.379384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b25ddf74-510f-4806-a90f-748b7be4822c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:47.379384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b25ddf74-510f-4806-a90f-748b7be4822c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:47.536970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b25ddf74-510f-4806-a90f-748b7be4822c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:47.544797 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b25ddf74-510f-4806-a90f-748b7be4822c tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1477 microversion: 2.1 time: 0.185227 May 28 21:05:47.545369 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 445/854] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:47 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1477 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:47.585574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-078a7a74-c5ec-489f-b7f3-d39b2e002978 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:47.586351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-078a7a74-c5ec-489f-b7f3-d39b2e002978 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:47.594709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-078a7a74-c5ec-489f-b7f3-d39b2e002978 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:47.595712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-078a7a74-c5ec-489f-b7f3-d39b2e002978 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:47.596542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-078a7a74-c5ec-489f-b7f3-d39b2e002978 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:47.596976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-078a7a74-c5ec-489f-b7f3-d39b2e002978 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:47.749970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-078a7a74-c5ec-489f-b7f3-d39b2e002978 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:47.759578 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-078a7a74-c5ec-489f-b7f3-d39b2e002978 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.178798 May 28 21:05:47.760519 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 446/855] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:47 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:47.766113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6314b3bc-82af-4986-b00b-988566c522a2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:47.767326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6314b3bc-82af-4986-b00b-988566c522a2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:47.777144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6314b3bc-82af-4986-b00b-988566c522a2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:47.778037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6314b3bc-82af-4986-b00b-988566c522a2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:47.778875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6314b3bc-82af-4986-b00b-988566c522a2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:47.779318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6314b3bc-82af-4986-b00b-988566c522a2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:47.870238 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6314b3bc-82af-4986-b00b-988566c522a2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:47.870911 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6314b3bc-82af-4986-b00b-988566c522a2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1277 microversion: 2.1 time: 0.108464 May 28 21:05:47.875294 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 447/856] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:47 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1277 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:47.880392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bf1ba13b-4a84-4f95-b87e-2fd224ddd8e8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:47.881025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bf1ba13b-4a84-4f95-b87e-2fd224ddd8e8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:47.884125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:47.887658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf1ba13b-4a84-4f95-b87e-2fd224ddd8e8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:47.888390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf1ba13b-4a84-4f95-b87e-2fd224ddd8e8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:47.889015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf1ba13b-4a84-4f95-b87e-2fd224ddd8e8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:47.889441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf1ba13b-4a84-4f95-b87e-2fd224ddd8e8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:48.041022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bf1ba13b-4a84-4f95-b87e-2fd224ddd8e8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:48.050013 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bf1ba13b-4a84-4f95-b87e-2fd224ddd8e8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1477 microversion: 2.1 time: 0.173814 May 28 21:05:48.051285 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 448/857] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:47 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1477 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:48.056823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-05770cfd-f597-4ee3-8edd-b08462c11f26 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:48.057498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-05770cfd-f597-4ee3-8edd-b08462c11f26 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:48.063656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-05770cfd-f597-4ee3-8edd-b08462c11f26 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:48.064108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-05770cfd-f597-4ee3-8edd-b08462c11f26 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:48.064881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-05770cfd-f597-4ee3-8edd-b08462c11f26 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:48.065363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-05770cfd-f597-4ee3-8edd-b08462c11f26 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:48.134521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-05770cfd-f597-4ee3-8edd-b08462c11f26 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:48.142847 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-05770cfd-f597-4ee3-8edd-b08462c11f26 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1339 microversion: 2.1 time: 0.090255 May 28 21:05:48.143434 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 449/858] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:48 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1339 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:48.376952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a91b1711-ee97-43da-a885-8ae19ed5cef5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:48.377733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a91b1711-ee97-43da-a885-8ae19ed5cef5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:48.384920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a91b1711-ee97-43da-a885-8ae19ed5cef5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:48.388783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a91b1711-ee97-43da-a885-8ae19ed5cef5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:48.388783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a91b1711-ee97-43da-a885-8ae19ed5cef5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:48.388783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a91b1711-ee97-43da-a885-8ae19ed5cef5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:48.604511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a91b1711-ee97-43da-a885-8ae19ed5cef5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:48.620680 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a91b1711-ee97-43da-a885-8ae19ed5cef5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.248579 May 28 21:05:48.630355 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 450/859] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:48 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:48.638124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2b069075-ec3a-4cca-b734-18b8c7e973d6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:48.638124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2b069075-ec3a-4cca-b734-18b8c7e973d6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:48.656703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b069075-ec3a-4cca-b734-18b8c7e973d6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:48.662183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b069075-ec3a-4cca-b734-18b8c7e973d6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:48.663049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b069075-ec3a-4cca-b734-18b8c7e973d6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:48.663501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b069075-ec3a-4cca-b734-18b8c7e973d6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:48.884646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2b069075-ec3a-4cca-b734-18b8c7e973d6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:48.892984 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2b069075-ec3a-4cca-b734-18b8c7e973d6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1477 microversion: 2.1 time: 0.261294 May 28 21:05:48.902832 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 451/860] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:48 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1477 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:48.903716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6d558d86-a942-4e1d-bc74-5e153ed72f5b tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:48.904476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6d558d86-a942-4e1d-bc74-5e153ed72f5b tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:48.911088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d558d86-a942-4e1d-bc74-5e153ed72f5b tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:48.911547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d558d86-a942-4e1d-bc74-5e153ed72f5b tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:48.912421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d558d86-a942-4e1d-bc74-5e153ed72f5b tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:48.912881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d558d86-a942-4e1d-bc74-5e153ed72f5b tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:49.323709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=19 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:49.387940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6d558d86-a942-4e1d-bc74-5e153ed72f5b tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:49.399459 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6d558d86-a942-4e1d-bc74-5e153ed72f5b tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.499451 May 28 21:05:49.400471 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 452/861] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:48 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:49.404742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-72df0d6c-3c1d-40b1-849f-a4a67bcf49b9 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:49.405359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-72df0d6c-3c1d-40b1-849f-a4a67bcf49b9 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:49.414811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72df0d6c-3c1d-40b1-849f-a4a67bcf49b9 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:49.415407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72df0d6c-3c1d-40b1-849f-a4a67bcf49b9 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:49.416090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72df0d6c-3c1d-40b1-849f-a4a67bcf49b9 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:49.416645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72df0d6c-3c1d-40b1-849f-a4a67bcf49b9 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:49.528819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-72df0d6c-3c1d-40b1-849f-a4a67bcf49b9 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:49.546546 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-72df0d6c-3c1d-40b1-849f-a4a67bcf49b9 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1283 microversion: 2.1 time: 0.133623 May 28 21:05:49.546546 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 453/862] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:49 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1283 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:49.546546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-c0a84410-cfe0-4dce-956e-b2393048e3a1 req-f266c004-067f-4bd3-b16b-12d110e78b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd95c29-a1f5-4f51-bc41-28015bfd2bec", "name": "network-vif-unplugged", "status": "completed", "tag": "7b9b3936-54e0-461a-9a4b-6152d1b72738"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:49.549989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c0a84410-cfe0-4dce-956e-b2393048e3a1 req-f266c004-067f-4bd3-b16b-12d110e78b06 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:49.558630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c0a84410-cfe0-4dce-956e-b2393048e3a1 req-f266c004-067f-4bd3-b16b-12d110e78b06 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:49.564947 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-c0a84410-cfe0-4dce-956e-b2393048e3a1 req-f266c004-067f-4bd3-b16b-12d110e78b06 service nova] Creating event network-vif-unplugged:7b9b3936-54e0-461a-9a4b-6152d1b72738 for instance edd95c29-a1f5-4f51-bc41-28015bfd2bec on nch2-master-1 May 28 21:05:49.571990 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-c0a84410-cfe0-4dce-956e-b2393048e3a1 req-f266c004-067f-4bd3-b16b-12d110e78b06 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034660 May 28 21:05:49.573111 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 454/863] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:49.583595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f43232fe-01db-4c01-95c9-c7f7c3347ff4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:49.584313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f43232fe-01db-4c01-95c9-c7f7c3347ff4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:49.591730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f43232fe-01db-4c01-95c9-c7f7c3347ff4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:49.592195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f43232fe-01db-4c01-95c9-c7f7c3347ff4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:49.593258 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f43232fe-01db-4c01-95c9-c7f7c3347ff4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:49.593735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f43232fe-01db-4c01-95c9-c7f7c3347ff4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:49.626690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:49.717440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=18 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:49.780570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f43232fe-01db-4c01-95c9-c7f7c3347ff4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:49.789181 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f43232fe-01db-4c01-95c9-c7f7c3347ff4 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1477 microversion: 2.1 time: 0.214820 May 28 21:05:49.797994 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 455/864] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:49 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1477 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:49.803957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9b489480-5ae4-4769-85b8-103803d0524a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:49.804579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9b489480-5ae4-4769-85b8-103803d0524a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:49.811626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b489480-5ae4-4769-85b8-103803d0524a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:49.812085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b489480-5ae4-4769-85b8-103803d0524a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:49.812872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b489480-5ae4-4769-85b8-103803d0524a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:49.813315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b489480-5ae4-4769-85b8-103803d0524a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:49.889947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9b489480-5ae4-4769-85b8-103803d0524a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:49.898349 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9b489480-5ae4-4769-85b8-103803d0524a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1339 microversion: 2.1 time: 0.098785 May 28 21:05:49.908243 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 456/865] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:49 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1339 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:49.908243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-008ee398-1acc-43cc-945f-0656f7bfc85e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:49.908243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-008ee398-1acc-43cc-945f-0656f7bfc85e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:49.913932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-008ee398-1acc-43cc-945f-0656f7bfc85e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:49.914475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-008ee398-1acc-43cc-945f-0656f7bfc85e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:49.915870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-008ee398-1acc-43cc-945f-0656f7bfc85e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:49.916120 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-008ee398-1acc-43cc-945f-0656f7bfc85e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:50.091731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-008ee398-1acc-43cc-945f-0656f7bfc85e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:50.100286 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-008ee398-1acc-43cc-945f-0656f7bfc85e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.199791 May 28 21:05:50.101001 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 457/866] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:49 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:50.106487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-338605d1-14b4-4c0a-a964-7b394b4180b6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:50.107197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-338605d1-14b4-4c0a-a964-7b394b4180b6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:50.113932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-338605d1-14b4-4c0a-a964-7b394b4180b6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:50.114379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-338605d1-14b4-4c0a-a964-7b394b4180b6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:50.115255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-338605d1-14b4-4c0a-a964-7b394b4180b6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:50.115596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-338605d1-14b4-4c0a-a964-7b394b4180b6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:50.335589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-338605d1-14b4-4c0a-a964-7b394b4180b6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:50.343033 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-338605d1-14b4-4c0a-a964-7b394b4180b6 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1477 microversion: 2.1 time: 0.241009 May 28 21:05:50.343606 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 458/867] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:50 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1477 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:50.416662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-42917795-3e38-421c-ba76-a7147dd8bf63 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:50.417408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-42917795-3e38-421c-ba76-a7147dd8bf63 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:50.423940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42917795-3e38-421c-ba76-a7147dd8bf63 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:50.424392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42917795-3e38-421c-ba76-a7147dd8bf63 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:50.425159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42917795-3e38-421c-ba76-a7147dd8bf63 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:50.425598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42917795-3e38-421c-ba76-a7147dd8bf63 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:50.763831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-42917795-3e38-421c-ba76-a7147dd8bf63 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:50.771476 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-42917795-3e38-421c-ba76-a7147dd8bf63 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.358806 May 28 21:05:50.772096 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 459/868] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:50 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:50.778075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5b07ec44-6eda-4330-aced-40da4a790a7f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:50.778901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5b07ec44-6eda-4330-aced-40da4a790a7f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:50.786264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b07ec44-6eda-4330-aced-40da4a790a7f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:50.786729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b07ec44-6eda-4330-aced-40da4a790a7f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:50.787511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b07ec44-6eda-4330-aced-40da4a790a7f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:50.788328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b07ec44-6eda-4330-aced-40da4a790a7f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:50.929788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5b07ec44-6eda-4330-aced-40da4a790a7f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:50.938226 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5b07ec44-6eda-4330-aced-40da4a790a7f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1325 microversion: 2.1 time: 0.165038 May 28 21:05:50.948431 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 460/869] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:50 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1325 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:50.948431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-66ae2c15-37da-4673-91fc-493f07214f10 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:50.948431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-66ae2c15-37da-4673-91fc-493f07214f10 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:50.951131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-66ae2c15-37da-4673-91fc-493f07214f10 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:50.951932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-66ae2c15-37da-4673-91fc-493f07214f10 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:50.953114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-66ae2c15-37da-4673-91fc-493f07214f10 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:50.953561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-66ae2c15-37da-4673-91fc-493f07214f10 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:51.187081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-66ae2c15-37da-4673-91fc-493f07214f10 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:51.195493 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-66ae2c15-37da-4673-91fc-493f07214f10 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1477 microversion: 2.1 time: 0.255527 May 28 21:05:51.205674 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 461/870] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:50 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1477 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:51.211263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-137705d6-0f79-4b68-bc10-f9e1556adddf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:51.212203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-137705d6-0f79-4b68-bc10-f9e1556adddf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:51.219492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-137705d6-0f79-4b68-bc10-f9e1556adddf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:51.220307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-137705d6-0f79-4b68-bc10-f9e1556adddf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:51.221610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-137705d6-0f79-4b68-bc10-f9e1556adddf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:51.222326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-137705d6-0f79-4b68-bc10-f9e1556adddf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:51.297735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-137705d6-0f79-4b68-bc10-f9e1556adddf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:51.306866 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-137705d6-0f79-4b68-bc10-f9e1556adddf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1339 microversion: 2.1 time: 0.099293 May 28 21:05:51.307505 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 462/871] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:51 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:51.312248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eeaab583-233a-4ac3-883b-1174906ae609 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:51.316485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eeaab583-233a-4ac3-883b-1174906ae609 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:51.320712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eeaab583-233a-4ac3-883b-1174906ae609 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:51.321865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eeaab583-233a-4ac3-883b-1174906ae609 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:51.322823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eeaab583-233a-4ac3-883b-1174906ae609 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:51.324286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eeaab583-233a-4ac3-883b-1174906ae609 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:51.507061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eeaab583-233a-4ac3-883b-1174906ae609 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:51.516026 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eeaab583-233a-4ac3-883b-1174906ae609 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.207327 May 28 21:05:51.527181 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 463/872] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:51 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:51.532119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1447de3e-edab-4921-b6b7-fb9b95a4fa55 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:51.532739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1447de3e-edab-4921-b6b7-fb9b95a4fa55 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:51.539579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1447de3e-edab-4921-b6b7-fb9b95a4fa55 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:51.540040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1447de3e-edab-4921-b6b7-fb9b95a4fa55 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:51.540824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1447de3e-edab-4921-b6b7-fb9b95a4fa55 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:51.541266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1447de3e-edab-4921-b6b7-fb9b95a4fa55 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:51.972361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1447de3e-edab-4921-b6b7-fb9b95a4fa55 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:51.981455 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1447de3e-edab-4921-b6b7-fb9b95a4fa55 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1477 microversion: 2.1 time: 0.453192 May 28 21:05:51.982723 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 464/873] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:51 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1477 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:51.990230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-67f713b2-92d0-4989-881d-35426e586d28 req-bd3ee32b-b8a6-435e-93be-3a86e8af0ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f", "tag": "a39a803a-353e-40f7-a80b-ec88a266af5e"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:52.001474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-67f713b2-92d0-4989-881d-35426e586d28 req-bd3ee32b-b8a6-435e-93be-3a86e8af0ddb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:52.002053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-67f713b2-92d0-4989-881d-35426e586d28 req-bd3ee32b-b8a6-435e-93be-3a86e8af0ddb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:52.015936 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-67f713b2-92d0-4989-881d-35426e586d28 req-bd3ee32b-b8a6-435e-93be-3a86e8af0ddb service nova] Creating event network-changed:a39a803a-353e-40f7-a80b-ec88a266af5e for instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f on nch2-master-1 May 28 21:05:52.024200 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-67f713b2-92d0-4989-881d-35426e586d28 req-bd3ee32b-b8a6-435e-93be-3a86e8af0ddb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039677 May 28 21:05:52.025967 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 465/874] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:52.033026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-5996ff24-5d28-4660-95f1-0dc3acbf4657 req-f632f5a2-59e0-401d-a3fb-841f45b13beb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8268d1-36f2-4747-aa81-f6181ea36c35", "tag": "5edb3137-f693-41e6-8acc-86951c804f80"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:52.048822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5996ff24-5d28-4660-95f1-0dc3acbf4657 req-f632f5a2-59e0-401d-a3fb-841f45b13beb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:52.053405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5996ff24-5d28-4660-95f1-0dc3acbf4657 req-f632f5a2-59e0-401d-a3fb-841f45b13beb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:52.063543 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-5996ff24-5d28-4660-95f1-0dc3acbf4657 req-f632f5a2-59e0-401d-a3fb-841f45b13beb service nova] Creating event network-changed:5edb3137-f693-41e6-8acc-86951c804f80 for instance df8268d1-36f2-4747-aa81-f6181ea36c35 on nch1-master-1 May 28 21:05:52.074106 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-5996ff24-5d28-4660-95f1-0dc3acbf4657 req-f632f5a2-59e0-401d-a3fb-841f45b13beb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046318 May 28 21:05:52.075638 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 466/875] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:52.086576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e21d6271-0899-4752-b8f7-c65af024bb14 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:52.087139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e21d6271-0899-4752-b8f7-c65af024bb14 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:52.094140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e21d6271-0899-4752-b8f7-c65af024bb14 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:52.095277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e21d6271-0899-4752-b8f7-c65af024bb14 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:52.095739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e21d6271-0899-4752-b8f7-c65af024bb14 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:52.096455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e21d6271-0899-4752-b8f7-c65af024bb14 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:52.126302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e21d6271-0899-4752-b8f7-c65af024bb14 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:05:52.433363 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e21d6271-0899-4752-b8f7-c65af024bb14 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 204 len: 0 microversion: 2.1 time: 0.355788 May 28 21:05:52.438099 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 467/876] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:05:52 2022] DELETE /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:05:52.445394 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f9a23f05-36ce-4f7c-b563-a34d69d4648c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:52.446671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f9a23f05-36ce-4f7c-b563-a34d69d4648c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:52.454371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9a23f05-36ce-4f7c-b563-a34d69d4648c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:52.455131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9a23f05-36ce-4f7c-b563-a34d69d4648c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:52.455908 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9a23f05-36ce-4f7c-b563-a34d69d4648c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:52.456347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9a23f05-36ce-4f7c-b563-a34d69d4648c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:52.665803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:52.687184 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f9a23f05-36ce-4f7c-b563-a34d69d4648c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:52.697523 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f9a23f05-36ce-4f7c-b563-a34d69d4648c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.257669 May 28 21:05:52.702186 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 468/877] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:52 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:52.713673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4879ec69-fc60-437d-9911-ea696815b266 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:52.714518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4879ec69-fc60-437d-9911-ea696815b266 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:52.721445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4879ec69-fc60-437d-9911-ea696815b266 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:52.722025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4879ec69-fc60-437d-9911-ea696815b266 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:52.723565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4879ec69-fc60-437d-9911-ea696815b266 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:52.724102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4879ec69-fc60-437d-9911-ea696815b266 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:52.866987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4879ec69-fc60-437d-9911-ea696815b266 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:52.875112 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4879ec69-fc60-437d-9911-ea696815b266 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1325 microversion: 2.1 time: 0.171637 May 28 21:05:52.875893 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 469/878] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:52 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1325 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:52.886931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fffee6e9-fa79-434c-ad03-d0ab42d9174c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:52.887571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fffee6e9-fa79-434c-ad03-d0ab42d9174c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:52.893595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fffee6e9-fa79-434c-ad03-d0ab42d9174c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:52.900946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fffee6e9-fa79-434c-ad03-d0ab42d9174c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:52.900946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fffee6e9-fa79-434c-ad03-d0ab42d9174c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:52.900946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fffee6e9-fa79-434c-ad03-d0ab42d9174c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.043123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fffee6e9-fa79-434c-ad03-d0ab42d9174c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:53.052453 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fffee6e9-fa79-434c-ad03-d0ab42d9174c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1477 microversion: 2.1 time: 0.168894 May 28 21:05:53.053150 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 470/879] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:52 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1477 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:53.067698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d70f5283-f2d9-4d98-9261-09bdeb5bc652 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:53.068324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d70f5283-f2d9-4d98-9261-09bdeb5bc652 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:53.075658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d70f5283-f2d9-4d98-9261-09bdeb5bc652 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:53.076117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d70f5283-f2d9-4d98-9261-09bdeb5bc652 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.077766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d70f5283-f2d9-4d98-9261-09bdeb5bc652 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:53.079383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d70f5283-f2d9-4d98-9261-09bdeb5bc652 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.267755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=7,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:53.271553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d70f5283-f2d9-4d98-9261-09bdeb5bc652 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:53.274098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:53.280592 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d70f5283-f2d9-4d98-9261-09bdeb5bc652 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1379 microversion: 2.1 time: 0.216476 May 28 21:05:53.286636 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 471/880] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:53 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1379 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:53.286832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-07a5771f-c520-41d8-8ddb-0ef9996e90c7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:53.287458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-07a5771f-c520-41d8-8ddb-0ef9996e90c7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:53.294014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07a5771f-c520-41d8-8ddb-0ef9996e90c7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:53.294471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07a5771f-c520-41d8-8ddb-0ef9996e90c7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.295249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07a5771f-c520-41d8-8ddb-0ef9996e90c7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:53.295684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07a5771f-c520-41d8-8ddb-0ef9996e90c7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.354355 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9c9f81b7-8018-41b4-971c-e075172d8f2f tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47/action" status: 202 len: 0 microversion: 2.25 time: 10.822804 May 28 21:05:53.354919 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 410/881] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:05:42 2022] POST /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47/action => generated 0 bytes in 10824 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 28 21:05:53.360008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5f6ee4fc-4ce2-4eaf-9f07-86b36f281f0b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:53.360624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5f6ee4fc-4ce2-4eaf-9f07-86b36f281f0b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:53.367937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f6ee4fc-4ce2-4eaf-9f07-86b36f281f0b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:53.368680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f6ee4fc-4ce2-4eaf-9f07-86b36f281f0b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.369450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f6ee4fc-4ce2-4eaf-9f07-86b36f281f0b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:53.369927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f6ee4fc-4ce2-4eaf-9f07-86b36f281f0b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.506266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-07a5771f-c520-41d8-8ddb-0ef9996e90c7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:53.514126 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-07a5771f-c520-41d8-8ddb-0ef9996e90c7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1713 microversion: 2.1 time: 0.231529 May 28 21:05:53.514708 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 472/882] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:53 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1713 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:53.528452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-d8f6201c-88c9-4d11-a2aa-8d89f4586e73 req-c40f4223-7f12-4ead-b0df-d99ca67c32af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd95c29-a1f5-4f51-bc41-28015bfd2bec", "name": "network-vif-plugged", "status": "completed", "tag": "7b9b3936-54e0-461a-9a4b-6152d1b72738"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:53.536052 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5f6ee4fc-4ce2-4eaf-9f07-86b36f281f0b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:53.537845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d8f6201c-88c9-4d11-a2aa-8d89f4586e73 req-c40f4223-7f12-4ead-b0df-d99ca67c32af service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:53.538312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d8f6201c-88c9-4d11-a2aa-8d89f4586e73 req-c40f4223-7f12-4ead-b0df-d99ca67c32af service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.543579 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5f6ee4fc-4ce2-4eaf-9f07-86b36f281f0b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.187660 May 28 21:05:53.544205 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 411/883] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:53 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:53.548772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2ebfd455-afc6-47bf-b13a-293b4c9c0819 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:53.549443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2ebfd455-afc6-47bf-b13a-293b4c9c0819 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:53.555878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ebfd455-afc6-47bf-b13a-293b4c9c0819 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:53.556898 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-d8f6201c-88c9-4d11-a2aa-8d89f4586e73 req-c40f4223-7f12-4ead-b0df-d99ca67c32af service nova] Creating event network-vif-plugged:7b9b3936-54e0-461a-9a4b-6152d1b72738 for instance edd95c29-a1f5-4f51-bc41-28015bfd2bec on nch2-master-1 May 28 21:05:53.557019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ebfd455-afc6-47bf-b13a-293b4c9c0819 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.557180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ebfd455-afc6-47bf-b13a-293b4c9c0819 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:53.557632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ebfd455-afc6-47bf-b13a-293b4c9c0819 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.561023 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-d8f6201c-88c9-4d11-a2aa-8d89f4586e73 req-c40f4223-7f12-4ead-b0df-d99ca67c32af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045116 May 28 21:05:53.561769 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 473/884] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:53.568005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-335c28ed-b07c-46f4-8b99-92a952b92b02 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:53.568713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-335c28ed-b07c-46f4-8b99-92a952b92b02 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:53.581404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-335c28ed-b07c-46f4-8b99-92a952b92b02 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:53.583174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-335c28ed-b07c-46f4-8b99-92a952b92b02 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.584209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-335c28ed-b07c-46f4-8b99-92a952b92b02 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:53.584542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-335c28ed-b07c-46f4-8b99-92a952b92b02 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.646855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2ebfd455-afc6-47bf-b13a-293b4c9c0819 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b044baceddf49219485bd14aa914e35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8058694a4ecb467783677e687e16ecb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:53.654594 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2ebfd455-afc6-47bf-b13a-293b4c9c0819 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 200 len: 1435 microversion: 2.1 time: 0.109332 May 28 21:05:53.656203 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 412/885] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:53 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 1435 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:53.722666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-90dbedb7-1137-491d-bf13-cd4770394018 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:53.724253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-90dbedb7-1137-491d-bf13-cd4770394018 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:53.731999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90dbedb7-1137-491d-bf13-cd4770394018 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:53.732773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90dbedb7-1137-491d-bf13-cd4770394018 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.733731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90dbedb7-1137-491d-bf13-cd4770394018 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:53.734445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90dbedb7-1137-491d-bf13-cd4770394018 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.799290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-335c28ed-b07c-46f4-8b99-92a952b92b02 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:53.809613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-335c28ed-b07c-46f4-8b99-92a952b92b02 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:53.811330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-335c28ed-b07c-46f4-8b99-92a952b92b02 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:53.812753 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-335c28ed-b07c-46f4-8b99-92a952b92b02 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.249619 May 28 21:05:53.813376 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 474/886] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:53 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:53.894338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4b8f23da-835c-4c9d-9961-0486ff9d6c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:53.894977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4b8f23da-835c-4c9d-9961-0486ff9d6c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:53.903175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b8f23da-835c-4c9d-9961-0486ff9d6c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:53.903569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b8f23da-835c-4c9d-9961-0486ff9d6c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.904360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b8f23da-835c-4c9d-9961-0486ff9d6c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:53.905379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b8f23da-835c-4c9d-9961-0486ff9d6c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:53.926428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-90dbedb7-1137-491d-bf13-cd4770394018 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:53.937462 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-90dbedb7-1137-491d-bf13-cd4770394018 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.219774 May 28 21:05:53.938548 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 413/887] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:53 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:54.076533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-425ecc8c-a5c5-4261-8843-e4d8411c1cf7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:54.077229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-425ecc8c-a5c5-4261-8843-e4d8411c1cf7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:54.083819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-425ecc8c-a5c5-4261-8843-e4d8411c1cf7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:54.084657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-425ecc8c-a5c5-4261-8843-e4d8411c1cf7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:54.085562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-425ecc8c-a5c5-4261-8843-e4d8411c1cf7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:54.086382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-425ecc8c-a5c5-4261-8843-e4d8411c1cf7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:54.364313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4b8f23da-835c-4c9d-9961-0486ff9d6c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:54.372316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-425ecc8c-a5c5-4261-8843-e4d8411c1cf7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:54.373689 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4b8f23da-835c-4c9d-9961-0486ff9d6c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1325 microversion: 2.1 time: 0.483946 May 28 21:05:54.374340 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 475/888] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:53 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1325 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:54.379001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-c446dacf-b809-42ac-ae4a-16fea702dbb5 req-4dece54c-a724-4f4a-9ef3-78f51cb97ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f19324c9-92b9-4a31-9651-20be6957922c", "name": "network-vif-deleted", "tag": "5ca6fb40-a20e-42cd-8bfc-50276010ce4a"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:54.382949 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-425ecc8c-a5c5-4261-8843-e4d8411c1cf7 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1477 microversion: 2.1 time: 0.316643 May 28 21:05:54.395344 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 414/889] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:54 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1477 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:54.395344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-10b09f81-ab68-4006-8029-9ff5f34415ff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:54.395344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-10b09f81-ab68-4006-8029-9ff5f34415ff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:54.397954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c446dacf-b809-42ac-ae4a-16fea702dbb5 req-4dece54c-a724-4f4a-9ef3-78f51cb97ad6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:54.398621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c446dacf-b809-42ac-ae4a-16fea702dbb5 req-4dece54c-a724-4f4a-9ef3-78f51cb97ad6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:54.400563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10b09f81-ab68-4006-8029-9ff5f34415ff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:54.401226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10b09f81-ab68-4006-8029-9ff5f34415ff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:54.402052 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10b09f81-ab68-4006-8029-9ff5f34415ff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:54.402787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10b09f81-ab68-4006-8029-9ff5f34415ff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:54.411068 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-c446dacf-b809-42ac-ae4a-16fea702dbb5 req-4dece54c-a724-4f4a-9ef3-78f51cb97ad6 service nova] Creating event network-vif-deleted:5ca6fb40-a20e-42cd-8bfc-50276010ce4a for instance f19324c9-92b9-4a31-9651-20be6957922c on nch1-master-1 May 28 21:05:54.416558 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-c446dacf-b809-42ac-ae4a-16fea702dbb5 req-4dece54c-a724-4f4a-9ef3-78f51cb97ad6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040684 May 28 21:05:54.417428 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 476/890] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:54.534031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cfa9e56d-8272-41db-90df-42331cffa0da tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:54.534751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cfa9e56d-8272-41db-90df-42331cffa0da tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:54.541700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cfa9e56d-8272-41db-90df-42331cffa0da tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:54.542343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cfa9e56d-8272-41db-90df-42331cffa0da tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:54.543140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cfa9e56d-8272-41db-90df-42331cffa0da tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:54.543588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cfa9e56d-8272-41db-90df-42331cffa0da tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:54.551440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-10b09f81-ab68-4006-8029-9ff5f34415ff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:54.565472 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-10b09f81-ab68-4006-8029-9ff5f34415ff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1379 microversion: 2.1 time: 0.180574 May 28 21:05:54.576920 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 415/891] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:54 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1379 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:54.582799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-740ff005-60ac-4c1a-8cce-f4986190ce8d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:54.583485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-740ff005-60ac-4c1a-8cce-f4986190ce8d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:54.591569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-740ff005-60ac-4c1a-8cce-f4986190ce8d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:54.592179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-740ff005-60ac-4c1a-8cce-f4986190ce8d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:54.592978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-740ff005-60ac-4c1a-8cce-f4986190ce8d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:54.593502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-740ff005-60ac-4c1a-8cce-f4986190ce8d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:54.812856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cfa9e56d-8272-41db-90df-42331cffa0da tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:54.824426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-740ff005-60ac-4c1a-8cce-f4986190ce8d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:54.824908 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cfa9e56d-8272-41db-90df-42331cffa0da tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1713 microversion: 2.1 time: 0.295923 May 28 21:05:54.825538 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 477/892] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:54 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1713 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:54.830153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d6b91897-28f5-4eaa-96d5-9ff5a36d4504 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:54.830872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d6b91897-28f5-4eaa-96d5-9ff5a36d4504 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] [instance: f19324c9-92b9-4a31-9651-20be6957922c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:54.837781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6b91897-28f5-4eaa-96d5-9ff5a36d4504 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:54.838381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6b91897-28f5-4eaa-96d5-9ff5a36d4504 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:54.839599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6b91897-28f5-4eaa-96d5-9ff5a36d4504 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:54.839717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6b91897-28f5-4eaa-96d5-9ff5a36d4504 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:54.846349 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-740ff005-60ac-4c1a-8cce-f4986190ce8d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.266737 May 28 21:05:54.855979 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 416/893] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:54 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-d6b91897-28f5-4eaa-96d5-9ff5a36d4504 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] HTTP exception thrown: Instance f19324c9-92b9-4a31-9651-20be6957922c could not be found. May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d6b91897-28f5-4eaa-96d5-9ff5a36d4504 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Request method failure captured: May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c HTTP/1.1 May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5v1tfQZ8CCJ1XfS30U2chDr6YsenimuBdZFl4nLaGw2uXeOL1zM_3QOdSMqEtuIPESo1aNDpDBEwqA0sWpzCb9U0thHwh0d_4qlLia1naX8zl6yiqqbUiWx4NQVoMAQIgHgXsDBdLcy4oVgOa_pfXpoFBJubozsWDorrCRs-Xbm_g May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 8058694a4ecb467783677e687e16ecb6 May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-727463323 May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:05:54.900607 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:05:54.902199 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8058694a4ecb467783677e687e16ecb6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8058694a4ecb467783677e687e16ecb6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8058694a4ecb467783677e687e16ecb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8058694a4ecb467783677e687e16ecb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:05:54.902199 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersAdminNegativeTestJSON-727463323 May 28 21:05:54.902199 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 8058694a4ecb467783677e687e16ecb6 May 28 21:05:54.902199 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-727463323 May 28 21:05:54.902199 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersAdminNegativeTestJSON-727463323-project May 28 21:05:54.902199 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:05:54.902199 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:05:54.902199 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 3b044baceddf49219485bd14aa914e35 May 28 21:05:54.902199 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersAdminNegativeTestJSON-727463323-project May 28 21:05:54.902199 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:05:54.902199 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance f19324c9-92b9-4a31-9651-20be6957922c could not be found. May 28 21:05:54.902199 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'f19324c9-92b9-4a31-9651-20be6957922c'} May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f19324c9-92b9-4a31-9651-20be6957922c could not be found. May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:05:54.902953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f19324c9-92b9-4a31-9651-20be6957922c could not be found. May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f19324c9-92b9-4a31-9651-20be6957922c could not be found. May 28 21:05:54.904177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:05:54.905253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d6b91897-28f5-4eaa-96d5-9ff5a36d4504 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] Returning 404 to user: Instance f19324c9-92b9-4a31-9651-20be6957922c could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:05:54.905253 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d6b91897-28f5-4eaa-96d5-9ff5a36d4504 tempest-ServersAdminNegativeTestJSON-727463323 tempest-ServersAdminNegativeTestJSON-727463323-project] 10.222.0.33 "GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c" status: 404 len: 111 microversion: 2.1 time: 0.034070 May 28 21:05:54.905253 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 478/894] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:54 2022] GET /compute/v2.1/servers/f19324c9-92b9-4a31-9651-20be6957922c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:05:54.905462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-edeef515-6eed-4572-8a82-6744844ef4e0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:54.905462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-edeef515-6eed-4572-8a82-6744844ef4e0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:54.905462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edeef515-6eed-4572-8a82-6744844ef4e0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:54.905462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edeef515-6eed-4572-8a82-6744844ef4e0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:54.905751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edeef515-6eed-4572-8a82-6744844ef4e0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:54.905751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edeef515-6eed-4572-8a82-6744844ef4e0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:55.021236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-82225cba-1f33-44cd-882c-78b551aabcf8 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:55.023005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-82225cba-1f33-44cd-882c-78b551aabcf8 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:55.030090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82225cba-1f33-44cd-882c-78b551aabcf8 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:55.030551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82225cba-1f33-44cd-882c-78b551aabcf8 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:55.031334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82225cba-1f33-44cd-882c-78b551aabcf8 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:55.031781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82225cba-1f33-44cd-882c-78b551aabcf8 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:55.033936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-edeef515-6eed-4572-8a82-6744844ef4e0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:55.046741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-edeef515-6eed-4572-8a82-6744844ef4e0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:55.048248 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-edeef515-6eed-4572-8a82-6744844ef4e0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:55.052710 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-edeef515-6eed-4572-8a82-6744844ef4e0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.194998 May 28 21:05:55.069219 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 417/895] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:54 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:55.315914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-82225cba-1f33-44cd-882c-78b551aabcf8 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:55.324454 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-82225cba-1f33-44cd-882c-78b551aabcf8 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.307737 May 28 21:05:55.325043 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 479/896] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:55 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:55.395903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5d81fe62-9ef9-4f07-a025-e253324fa3b5 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:55.396548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5d81fe62-9ef9-4f07-a025-e253324fa3b5 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:55.403158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d81fe62-9ef9-4f07-a025-e253324fa3b5 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:55.403621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d81fe62-9ef9-4f07-a025-e253324fa3b5 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:55.404396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d81fe62-9ef9-4f07-a025-e253324fa3b5 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:55.404844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d81fe62-9ef9-4f07-a025-e253324fa3b5 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:55.405422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6d7df5d8-3cbe-4728-84cc-ff7894505722 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:55.406568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6d7df5d8-3cbe-4728-84cc-ff7894505722 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:55.414370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d7df5d8-3cbe-4728-84cc-ff7894505722 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:55.414931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d7df5d8-3cbe-4728-84cc-ff7894505722 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:55.415905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d7df5d8-3cbe-4728-84cc-ff7894505722 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:55.416421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d7df5d8-3cbe-4728-84cc-ff7894505722 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:55.682794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5d81fe62-9ef9-4f07-a025-e253324fa3b5 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:55.696963 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5d81fe62-9ef9-4f07-a025-e253324fa3b5 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1325 microversion: 2.1 time: 0.310342 May 28 21:05:55.699102 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 418/897] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:55 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1325 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:55.707044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ea323471-3a76-44c7-9154-20853f5bef5a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:55.707686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ea323471-3a76-44c7-9154-20853f5bef5a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:55.720085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea323471-3a76-44c7-9154-20853f5bef5a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:55.720656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea323471-3a76-44c7-9154-20853f5bef5a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:55.721716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea323471-3a76-44c7-9154-20853f5bef5a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:55.722232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea323471-3a76-44c7-9154-20853f5bef5a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:55.728079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6d7df5d8-3cbe-4728-84cc-ff7894505722 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:55.737593 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6d7df5d8-3cbe-4728-84cc-ff7894505722 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1477 microversion: 2.1 time: 0.338484 May 28 21:05:55.741687 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 480/898] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:55 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1477 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:55.842955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84450f60-a937-4446-9bc4-2d25e3303b81 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:55.843574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-84450f60-a937-4446-9bc4-2d25e3303b81 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:55.845551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:55.852369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84450f60-a937-4446-9bc4-2d25e3303b81 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:55.852828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84450f60-a937-4446-9bc4-2d25e3303b81 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:55.853664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84450f60-a937-4446-9bc4-2d25e3303b81 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:55.854326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84450f60-a937-4446-9bc4-2d25e3303b81 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:55.881185 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ea323471-3a76-44c7-9154-20853f5bef5a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:55.891813 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ea323471-3a76-44c7-9154-20853f5bef5a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1379 microversion: 2.1 time: 0.191520 May 28 21:05:55.908690 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 419/899] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:55 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1379 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:55.917974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5fe1a9e5-3b89-4ba4-9ef9-c88695f5cf7f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:55.917974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5fe1a9e5-3b89-4ba4-9ef9-c88695f5cf7f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:55.927329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5fe1a9e5-3b89-4ba4-9ef9-c88695f5cf7f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:55.927977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5fe1a9e5-3b89-4ba4-9ef9-c88695f5cf7f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:55.931380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5fe1a9e5-3b89-4ba4-9ef9-c88695f5cf7f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:55.931952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5fe1a9e5-3b89-4ba4-9ef9-c88695f5cf7f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:56.047157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-84450f60-a937-4446-9bc4-2d25e3303b81 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:56.061829 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-84450f60-a937-4446-9bc4-2d25e3303b81 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1713 microversion: 2.1 time: 0.222356 May 28 21:05:56.063507 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 481/900] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:55 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1713 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:56.086512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-684958cc-0fd4-48ad-9215-9ff993e6e137 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:56.087256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-684958cc-0fd4-48ad-9215-9ff993e6e137 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:56.097501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-684958cc-0fd4-48ad-9215-9ff993e6e137 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:56.097989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-684958cc-0fd4-48ad-9215-9ff993e6e137 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:56.098784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-684958cc-0fd4-48ad-9215-9ff993e6e137 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:56.102178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-684958cc-0fd4-48ad-9215-9ff993e6e137 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:56.176021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5fe1a9e5-3b89-4ba4-9ef9-c88695f5cf7f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:56.188111 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5fe1a9e5-3b89-4ba4-9ef9-c88695f5cf7f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.276266 May 28 21:05:56.203269 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 420/901] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:55 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:56.340748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-684958cc-0fd4-48ad-9215-9ff993e6e137 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:56.348234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fda7b000-cfb0-4249-bd28-14b9d5d27282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:56.349442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fda7b000-cfb0-4249-bd28-14b9d5d27282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:56.351845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-684958cc-0fd4-48ad-9215-9ff993e6e137 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:56.353379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-684958cc-0fd4-48ad-9215-9ff993e6e137 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:56.354867 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-684958cc-0fd4-48ad-9215-9ff993e6e137 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.285912 May 28 21:05:56.359958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fda7b000-cfb0-4249-bd28-14b9d5d27282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:56.361928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fda7b000-cfb0-4249-bd28-14b9d5d27282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:56.361928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fda7b000-cfb0-4249-bd28-14b9d5d27282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:56.362605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fda7b000-cfb0-4249-bd28-14b9d5d27282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:56.366832 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 482/902] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:56 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:56.445277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-b2d763d5-7dc8-49b1-9503-bc4dc853d070 req-f83f8219-e00b-43c4-8b35-036b9fcb9dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394fe269-dd5e-4d4e-8f49-de1df1812e6a", "tag": "e413ef97-3a02-48d0-ae33-341fafd919b8"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:56.454602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b2d763d5-7dc8-49b1-9503-bc4dc853d070 req-f83f8219-e00b-43c4-8b35-036b9fcb9dcb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:56.455595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b2d763d5-7dc8-49b1-9503-bc4dc853d070 req-f83f8219-e00b-43c4-8b35-036b9fcb9dcb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:56.467673 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-b2d763d5-7dc8-49b1-9503-bc4dc853d070 req-f83f8219-e00b-43c4-8b35-036b9fcb9dcb service nova] Creating event network-changed:e413ef97-3a02-48d0-ae33-341fafd919b8 for instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a on nch1-master-1 May 28 21:05:56.473721 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-b2d763d5-7dc8-49b1-9503-bc4dc853d070 req-f83f8219-e00b-43c4-8b35-036b9fcb9dcb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032212 May 28 21:05:56.475029 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 483/903] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:56.516181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fda7b000-cfb0-4249-bd28-14b9d5d27282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:56.524811 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fda7b000-cfb0-4249-bd28-14b9d5d27282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.184791 May 28 21:05:56.526169 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 421/904] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:56 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:56.711807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=10 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:56.717914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8067296c-5cf3-4c4d-b761-7d9c9048833e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:56.719256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8067296c-5cf3-4c4d-b761-7d9c9048833e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:56.727398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8067296c-5cf3-4c4d-b761-7d9c9048833e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:56.728063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8067296c-5cf3-4c4d-b761-7d9c9048833e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:56.729793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8067296c-5cf3-4c4d-b761-7d9c9048833e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:56.730257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8067296c-5cf3-4c4d-b761-7d9c9048833e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:56.762042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f4cf439c-d812-4c99-81f6-ea34c22e15b9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:56.762042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f4cf439c-d812-4c99-81f6-ea34c22e15b9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:56.780689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4cf439c-d812-4c99-81f6-ea34c22e15b9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:56.781151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4cf439c-d812-4c99-81f6-ea34c22e15b9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:56.788711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4cf439c-d812-4c99-81f6-ea34c22e15b9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:56.795159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4cf439c-d812-4c99-81f6-ea34c22e15b9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:57.084249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8067296c-5cf3-4c4d-b761-7d9c9048833e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:57.094486 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8067296c-5cf3-4c4d-b761-7d9c9048833e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1325 microversion: 2.1 time: 0.383614 May 28 21:05:57.095083 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 484/905] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:56 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1325 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:57.109394 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-843fe655-3092-4a23-b108-9606cbe04297 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:57.110214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-843fe655-3092-4a23-b108-9606cbe04297 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:57.117756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-843fe655-3092-4a23-b108-9606cbe04297 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:57.118308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-843fe655-3092-4a23-b108-9606cbe04297 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:57.119631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-843fe655-3092-4a23-b108-9606cbe04297 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:57.120170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-843fe655-3092-4a23-b108-9606cbe04297 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:57.210446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f4cf439c-d812-4c99-81f6-ea34c22e15b9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:57.225468 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f4cf439c-d812-4c99-81f6-ea34c22e15b9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1477 microversion: 2.1 time: 0.468352 May 28 21:05:57.229258 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 422/906] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:56 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1477 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:57.240039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4208e03b-594f-4bd7-ac82-63b6b0be63f0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:57.241219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4208e03b-594f-4bd7-ac82-63b6b0be63f0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:57.251740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4208e03b-594f-4bd7-ac82-63b6b0be63f0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:57.252848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4208e03b-594f-4bd7-ac82-63b6b0be63f0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:57.254416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4208e03b-594f-4bd7-ac82-63b6b0be63f0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:57.255098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4208e03b-594f-4bd7-ac82-63b6b0be63f0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:57.297246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-843fe655-3092-4a23-b108-9606cbe04297 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:57.314552 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-843fe655-3092-4a23-b108-9606cbe04297 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1379 microversion: 2.1 time: 0.218410 May 28 21:05:57.315167 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 485/907] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:57 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1379 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:57.321319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5d7d737f-3023-4ca4-aaf2-e9014e6ff857 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:57.321705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5d7d737f-3023-4ca4-aaf2-e9014e6ff857 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:57.334217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d7d737f-3023-4ca4-aaf2-e9014e6ff857 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:57.334673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d7d737f-3023-4ca4-aaf2-e9014e6ff857 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:57.335667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d7d737f-3023-4ca4-aaf2-e9014e6ff857 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:57.336104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d7d737f-3023-4ca4-aaf2-e9014e6ff857 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:57.533240 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4208e03b-594f-4bd7-ac82-63b6b0be63f0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:57.551000 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4208e03b-594f-4bd7-ac82-63b6b0be63f0 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1713 microversion: 2.1 time: 0.319644 May 28 21:05:57.560773 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 423/908] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:57 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1713 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:57.560773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cef8118a-3883-4162-b023-f707796ce65b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:57.560773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cef8118a-3883-4162-b023-f707796ce65b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:57.567094 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cef8118a-3883-4162-b023-f707796ce65b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:57.567893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cef8118a-3883-4162-b023-f707796ce65b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:57.568703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cef8118a-3883-4162-b023-f707796ce65b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:57.569158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cef8118a-3883-4162-b023-f707796ce65b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:57.591859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5d7d737f-3023-4ca4-aaf2-e9014e6ff857 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:57.603560 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5d7d737f-3023-4ca4-aaf2-e9014e6ff857 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1502 microversion: 2.1 time: 0.287196 May 28 21:05:57.604265 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 486/909] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:57 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1502 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:57.619835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0c286175-47a2-4495-84da-bf072ad03628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:57.620551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0c286175-47a2-4495-84da-bf072ad03628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:57.629494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c286175-47a2-4495-84da-bf072ad03628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:57.630099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c286175-47a2-4495-84da-bf072ad03628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:57.630934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c286175-47a2-4495-84da-bf072ad03628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:57.631896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c286175-47a2-4495-84da-bf072ad03628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:57.760964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cef8118a-3883-4162-b023-f707796ce65b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:57.770869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cef8118a-3883-4162-b023-f707796ce65b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:57.773152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cef8118a-3883-4162-b023-f707796ce65b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:57.774960 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cef8118a-3883-4162-b023-f707796ce65b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.221031 May 28 21:05:57.780340 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 424/910] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:57 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:57.889277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c286175-47a2-4495-84da-bf072ad03628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:57.896955 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0c286175-47a2-4495-84da-bf072ad03628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.281352 May 28 21:05:57.897623 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 487/911] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:57 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:58.112471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ba4ef213-ac9c-4b52-8f54-efe028a874bb tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:58.113753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ba4ef213-ac9c-4b52-8f54-efe028a874bb tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:58.129339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba4ef213-ac9c-4b52-8f54-efe028a874bb tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:58.129948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba4ef213-ac9c-4b52-8f54-efe028a874bb tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:58.130810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba4ef213-ac9c-4b52-8f54-efe028a874bb tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:58.131266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba4ef213-ac9c-4b52-8f54-efe028a874bb tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:58.251325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-93224536-8c92-4888-a480-259a47c16f13 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:58.252103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-93224536-8c92-4888-a480-259a47c16f13 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:58.278205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93224536-8c92-4888-a480-259a47c16f13 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:58.281170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93224536-8c92-4888-a480-259a47c16f13 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:58.283437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93224536-8c92-4888-a480-259a47c16f13 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:58.285586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93224536-8c92-4888-a480-259a47c16f13 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:58.341867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ba4ef213-ac9c-4b52-8f54-efe028a874bb tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:58.355167 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ba4ef213-ac9c-4b52-8f54-efe028a874bb tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1325 microversion: 2.1 time: 0.245721 May 28 21:05:58.358858 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 425/912] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:58 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1325 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:58.369479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3f3da7d2-e5e3-4cf5-89f3-87c73579bb84 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:58.370161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3f3da7d2-e5e3-4cf5-89f3-87c73579bb84 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:58.382095 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f3da7d2-e5e3-4cf5-89f3-87c73579bb84 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:58.382560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f3da7d2-e5e3-4cf5-89f3-87c73579bb84 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:58.390533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f3da7d2-e5e3-4cf5-89f3-87c73579bb84 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:58.391474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f3da7d2-e5e3-4cf5-89f3-87c73579bb84 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:58.543300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-93224536-8c92-4888-a480-259a47c16f13 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:58.553518 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-93224536-8c92-4888-a480-259a47c16f13 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1463 microversion: 2.1 time: 0.312077 May 28 21:05:58.566209 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 488/913] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:58 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1463 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:05:58.570318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b0f9977f-1e0c-4179-8395-033bd56c6c5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:58.571017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b0f9977f-1e0c-4179-8395-033bd56c6c5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:58.578587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0f9977f-1e0c-4179-8395-033bd56c6c5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:58.579799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0f9977f-1e0c-4179-8395-033bd56c6c5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:58.580796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0f9977f-1e0c-4179-8395-033bd56c6c5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:58.581438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0f9977f-1e0c-4179-8395-033bd56c6c5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:58.607823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3f3da7d2-e5e3-4cf5-89f3-87c73579bb84 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:58.619665 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3f3da7d2-e5e3-4cf5-89f3-87c73579bb84 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1379 microversion: 2.1 time: 0.258821 May 28 21:05:58.624262 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 426/914] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:58 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1379 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:58.627531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0a6acf73-5e8f-4c10-92fc-4e71af5b3dca tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:58.629139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0a6acf73-5e8f-4c10-92fc-4e71af5b3dca tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:58.630521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0f9977f-1e0c-4179-8395-033bd56c6c5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:58.631061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0f9977f-1e0c-4179-8395-033bd56c6c5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:58.631628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-b0f9977f-1e0c-4179-8395-033bd56c6c5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lazy-loading 'fault' on Instance uuid fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:05:58.637303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a6acf73-5e8f-4c10-92fc-4e71af5b3dca tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:58.638135 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a6acf73-5e8f-4c10-92fc-4e71af5b3dca tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:58.639083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a6acf73-5e8f-4c10-92fc-4e71af5b3dca tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:58.639869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a6acf73-5e8f-4c10-92fc-4e71af5b3dca tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:58.672496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:58.717076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b0f9977f-1e0c-4179-8395-033bd56c6c5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdeaa660f8ec465bba68096d0ed4b1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e60b122ef584254b06fd8258c987f8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:58.736492 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b0f9977f-1e0c-4179-8395-033bd56c6c5f tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 200 len: 1354 microversion: 2.1 time: 0.171322 May 28 21:05:58.739281 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 489/915] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:58 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 1354 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:58.752887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-26ee36a1-c20d-4c30-91df-f0483ceab03c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:58.755462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-26ee36a1-c20d-4c30-91df-f0483ceab03c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:58.763414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26ee36a1-c20d-4c30-91df-f0483ceab03c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:58.766662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26ee36a1-c20d-4c30-91df-f0483ceab03c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:58.766662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26ee36a1-c20d-4c30-91df-f0483ceab03c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:58.766662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26ee36a1-c20d-4c30-91df-f0483ceab03c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:58.970033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0a6acf73-5e8f-4c10-92fc-4e71af5b3dca tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:58.984807 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0a6acf73-5e8f-4c10-92fc-4e71af5b3dca tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1463 microversion: 2.1 time: 0.361058 May 28 21:05:58.986561 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 427/916] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:58 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1463 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:59.002032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-bbc8a5c7-22f3-4748-b5c5-2b0c93a023e8 req-76430355-f85f-4d6e-ad2a-c92ef4ca2f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11", "name": "network-vif-deleted", "tag": "a8cbb2e6-44eb-497a-b75f-b22790446b3f"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:59.014484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-bbc8a5c7-22f3-4748-b5c5-2b0c93a023e8 req-76430355-f85f-4d6e-ad2a-c92ef4ca2f7a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.014484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-bbc8a5c7-22f3-4748-b5c5-2b0c93a023e8 req-76430355-f85f-4d6e-ad2a-c92ef4ca2f7a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.043836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-26ee36a1-c20d-4c30-91df-f0483ceab03c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:59.044093 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-bbc8a5c7-22f3-4748-b5c5-2b0c93a023e8 req-76430355-f85f-4d6e-ad2a-c92ef4ca2f7a service nova] Creating event network-vif-deleted:a8cbb2e6-44eb-497a-b75f-b22790446b3f for instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 on nch2-master-1 May 28 21:05:59.046084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:59.050103 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-bbc8a5c7-22f3-4748-b5c5-2b0c93a023e8 req-76430355-f85f-4d6e-ad2a-c92ef4ca2f7a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062299 May 28 21:05:59.053738 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 428/917] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:59.054738 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-26ee36a1-c20d-4c30-91df-f0483ceab03c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1477 microversion: 2.1 time: 0.315549 May 28 21:05:59.066933 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 490/918] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:58 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1477 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:59.073718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-77764c89-2434-4621-ad5e-9f45a4636f6c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:59.074947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-606715d6-15b4-463f-bcda-a521259f1300 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:59.075755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-606715d6-15b4-463f-bcda-a521259f1300 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:59.076963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-77764c89-2434-4621-ad5e-9f45a4636f6c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:59.083267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-606715d6-15b4-463f-bcda-a521259f1300 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.083974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-606715d6-15b4-463f-bcda-a521259f1300 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.085083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-606715d6-15b4-463f-bcda-a521259f1300 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.085666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-606715d6-15b4-463f-bcda-a521259f1300 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.103214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77764c89-2434-4621-ad5e-9f45a4636f6c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.103692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77764c89-2434-4621-ad5e-9f45a4636f6c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.104511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77764c89-2434-4621-ad5e-9f45a4636f6c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.110738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77764c89-2434-4621-ad5e-9f45a4636f6c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.409245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-77764c89-2434-4621-ad5e-9f45a4636f6c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:59.423888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-77764c89-2434-4621-ad5e-9f45a4636f6c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:59.436256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-77764c89-2434-4621-ad5e-9f45a4636f6c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:59.437663 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-77764c89-2434-4621-ad5e-9f45a4636f6c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.382669 May 28 21:05:59.438277 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 429/919] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:05:59 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:05:59.455572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:59.457686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:59.469110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-606715d6-15b4-463f-bcda-a521259f1300 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:59.479831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.480024 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-606715d6-15b4-463f-bcda-a521259f1300 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.411455 May 28 21:05:59.480296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.482137 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 491/920] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:59 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:59.482657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.483114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.488153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-18780bf7-7d9f-4f39-974e-a22168545842 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '.version_select at 0x7f4d642a4820>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:59.492679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18780bf7-7d9f-4f39-974e-a22168545842 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.496033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18780bf7-7d9f-4f39-974e-a22168545842 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.516167 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-18780bf7-7d9f-4f39-974e-a22168545842 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2720 microversion: 2.1 time: 0.030156 May 28 21:05:59.516167 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 492/921] 10.222.0.33 () {58 vars in 1142 bytes} [Sat May 28 21:05:59 2022] GET /compute/v2.1/os-migrations => generated 2720 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:59.521942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f026f50e-9bb4-46b8-a2ec-4aa61f249345 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:59.522688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f026f50e-9bb4-46b8-a2ec-4aa61f249345 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:59.529436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f026f50e-9bb4-46b8-a2ec-4aa61f249345 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.530224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f026f50e-9bb4-46b8-a2ec-4aa61f249345 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.531202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f026f50e-9bb4-46b8-a2ec-4aa61f249345 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.531886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f026f50e-9bb4-46b8-a2ec-4aa61f249345 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.604229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:05:59.604806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:05:59.605361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:05:59.606027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:05:59.606568 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:05:59.770066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f026f50e-9bb4-46b8-a2ec-4aa61f249345 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:05:59.783249 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f026f50e-9bb4-46b8-a2ec-4aa61f249345 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1325 microversion: 2.1 time: 0.265772 May 28 21:05:59.785141 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 493/922] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:59 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1325 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:05:59.804026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-5471e05b-0143-401e-85cb-a920b7a4ea17 req-b03821fe-bc21-4446-b08b-42c08c822dbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f", "name": "network-vif-plugged", "status": "completed", "tag": "a39a803a-353e-40f7-a80b-ec88a266af5e"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:05:59.824245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5471e05b-0143-401e-85cb-a920b7a4ea17 req-b03821fe-bc21-4446-b08b-42c08c822dbf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.825059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5471e05b-0143-401e-85cb-a920b7a4ea17 req-b03821fe-bc21-4446-b08b-42c08c822dbf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.841935 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-5471e05b-0143-401e-85cb-a920b7a4ea17 req-b03821fe-bc21-4446-b08b-42c08c822dbf service nova] Creating event network-vif-plugged:a39a803a-353e-40f7-a80b-ec88a266af5e for instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f on nch2-master-1 May 28 21:05:59.843304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:59.848415 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-5471e05b-0143-401e-85cb-a920b7a4ea17 req-b03821fe-bc21-4446-b08b-42c08c822dbf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061357 May 28 21:05:59.849461 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 494/923] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:05:59.851413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.852119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.853255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.856034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fdee66b5-5885-4345-8d28-9b3d16b57c46 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:59.856698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fdee66b5-5885-4345-8d28-9b3d16b57c46 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:59.868636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.869298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:05:59.870652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdee66b5-5885-4345-8d28-9b3d16b57c46 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.871501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdee66b5-5885-4345-8d28-9b3d16b57c46 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.871960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdee66b5-5885-4345-8d28-9b3d16b57c46 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.872621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdee66b5-5885-4345-8d28-9b3d16b57c46 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.946268 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8e981426-f8d2-4366-9382-a9a4f7c63db5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "POST /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec/action" status: 202 len: 1067 microversion: 2.1 time: 0.506831 May 28 21:05:59.952830 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 430/924] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:05:59 2022] POST /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec/action => generated 1067 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 28 21:05:59.966300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-551d94a2-a59e-48ab-a9ad-df53b48a60f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:05:59.966922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-551d94a2-a59e-48ab-a9ad-df53b48a60f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:05:59.975485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-551d94a2-a59e-48ab-a9ad-df53b48a60f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.976326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-551d94a2-a59e-48ab-a9ad-df53b48a60f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:05:59.977366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-551d94a2-a59e-48ab-a9ad-df53b48a60f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:05:59.978517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-551d94a2-a59e-48ab-a9ad-df53b48a60f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:00.246563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-551d94a2-a59e-48ab-a9ad-df53b48a60f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:00.255466 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-551d94a2-a59e-48ab-a9ad-df53b48a60f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1379 microversion: 2.1 time: 0.301286 May 28 21:06:00.256051 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 431/925] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:59 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1379 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:00.261740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9b15b2de-9443-4139-bf67-0c4a86e499f6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:00.262544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9b15b2de-9443-4139-bf67-0c4a86e499f6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:00.271592 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fdee66b5-5885-4345-8d28-9b3d16b57c46 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1628 microversion: 2.1 time: 0.420699 May 28 21:06:00.272182 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 495/926] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:05:59 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1628 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:00.275959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b15b2de-9443-4139-bf67-0c4a86e499f6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:00.276598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b15b2de-9443-4139-bf67-0c4a86e499f6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:00.277698 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b15b2de-9443-4139-bf67-0c4a86e499f6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:00.277811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5f3fb7dc-c470-4675-9d35-fbb7e5cd4005 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:00.278456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5f3fb7dc-c470-4675-9d35-fbb7e5cd4005 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:00.278631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b15b2de-9443-4139-bf67-0c4a86e499f6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:00.301782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f3fb7dc-c470-4675-9d35-fbb7e5cd4005 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:00.302435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f3fb7dc-c470-4675-9d35-fbb7e5cd4005 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:00.305987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f3fb7dc-c470-4675-9d35-fbb7e5cd4005 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:00.305987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f3fb7dc-c470-4675-9d35-fbb7e5cd4005 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:00.321598 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-9b15b2de-9443-4139-bf67-0c4a86e499f6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] HTTP exception thrown: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9b15b2de-9443-4139-bf67-0c4a86e499f6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Request method failure captured: May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 HTTP/1.1 May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4GMS89Deqs81YcKX944W0Ci9CFAJJqces9rAddfaO8Z2Pj85dSj4RIYjo1KMON6L9Z6gNAV-UjaVkfvPhE6FS0xsjO9IESWhyahkmyJcQGdc6M2u86feysZFail1bLx0drtwl1Dx0oCAWIBtp50wGAkCGNHOJT6Sb3FEQ0-eJTbFM May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 0e60b122ef584254b06fd8258c987f8d May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:06:00.323451 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:06:00.324824 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e60b122ef584254b06fd8258c987f8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:00.324824 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:00.324824 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 0e60b122ef584254b06fd8258c987f8d May 28 21:06:00.324824 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:00.324824 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1243493620-project May 28 21:06:00.324824 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:00.324824 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:00.324824 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: cdeaa660f8ec465bba68096d0ed4b1ae May 28 21:06:00.324824 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620-project May 28 21:06:00.324824 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:06:00.324824 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. May 28 21:06:00.324824 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11'} May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:00.325643 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. May 28 21:06:00.326880 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:00.327907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9b15b2de-9443-4139-bf67-0c4a86e499f6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Returning 404 to user: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:00.327907 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9b15b2de-9443-4139-bf67-0c4a86e499f6 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 404 len: 111 microversion: 2.1 time: 0.066926 May 28 21:06:00.327907 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 432/927] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:00 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:00.341373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7f3309d-e253-4127-b2ce-6891c6f9612b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:00.348299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d7f3309d-e253-4127-b2ce-6891c6f9612b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:00.366559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7f3309d-e253-4127-b2ce-6891c6f9612b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:00.367486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7f3309d-e253-4127-b2ce-6891c6f9612b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:00.368871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7f3309d-e253-4127-b2ce-6891c6f9612b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:00.369489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7f3309d-e253-4127-b2ce-6891c6f9612b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:00.393337 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-d7f3309d-e253-4127-b2ce-6891c6f9612b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] HTTP exception thrown: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7f3309d-e253-4127-b2ce-6891c6f9612b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Request method failure captured: May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 HTTP/1.1 May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4GMS89Deqs81YcKX944W0Ci9CFAJJqces9rAddfaO8Z2Pj85dSj4RIYjo1KMON6L9Z6gNAV-UjaVkfvPhE6FS0xsjO9IESWhyahkmyJcQGdc6M2u86feysZFail1bLx0drtwl1Dx0oCAWIBtp50wGAkCGNHOJT6Sb3FEQ0-eJTbFM May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 0e60b122ef584254b06fd8258c987f8d May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:06:00.395959 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:06:00.397641 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e60b122ef584254b06fd8258c987f8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:00.397641 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:00.397641 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 0e60b122ef584254b06fd8258c987f8d May 28 21:06:00.397641 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:00.397641 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1243493620-project May 28 21:06:00.397641 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:00.397641 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:00.397641 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: cdeaa660f8ec465bba68096d0ed4b1ae May 28 21:06:00.397641 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620-project May 28 21:06:00.397641 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:06:00.397641 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:00.397641 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '02214efd-8392-465b-bd6a-d658850d4f15'} May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:00.398541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:00.400032 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:00.403486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7f3309d-e253-4127-b2ce-6891c6f9612b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Returning 404 to user: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:00.405906 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d7f3309d-e253-4127-b2ce-6891c6f9612b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "DELETE /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 404 len: 111 microversion: 2.1 time: 0.069102 May 28 21:06:00.408235 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 433/928] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:06:00 2022] DELETE /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:06:00.427886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a6138b5-9aa4-482f-8a13-f01b0b7597a3 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:00.428523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6a6138b5-9aa4-482f-8a13-f01b0b7597a3 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:00.449911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a6138b5-9aa4-482f-8a13-f01b0b7597a3 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:00.450562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a6138b5-9aa4-482f-8a13-f01b0b7597a3 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:00.451393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a6138b5-9aa4-482f-8a13-f01b0b7597a3 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:00.452247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a6138b5-9aa4-482f-8a13-f01b0b7597a3 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:00.468454 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-6a6138b5-9aa4-482f-8a13-f01b0b7597a3 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] HTTP exception thrown: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a6138b5-9aa4-482f-8a13-f01b0b7597a3 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Request method failure captured: May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 HTTP/1.1 May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4GMS89Deqs81YcKX944W0Ci9CFAJJqces9rAddfaO8Z2Pj85dSj4RIYjo1KMON6L9Z6gNAV-UjaVkfvPhE6FS0xsjO9IESWhyahkmyJcQGdc6M2u86feysZFail1bLx0drtwl1Dx0oCAWIBtp50wGAkCGNHOJT6Sb3FEQ0-eJTbFM May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 0e60b122ef584254b06fd8258c987f8d May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:06:00.470504 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:06:00.471746 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e60b122ef584254b06fd8258c987f8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:00.471746 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:00.471746 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 0e60b122ef584254b06fd8258c987f8d May 28 21:06:00.471746 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:00.471746 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1243493620-project May 28 21:06:00.471746 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:00.471746 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:00.471746 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: cdeaa660f8ec465bba68096d0ed4b1ae May 28 21:06:00.471746 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620-project May 28 21:06:00.471746 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:06:00.471746 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:00.471746 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '02214efd-8392-465b-bd6a-d658850d4f15'} May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:00.473028 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:00.474202 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:00.483148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a6138b5-9aa4-482f-8a13-f01b0b7597a3 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Returning 404 to user: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:00.486447 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6a6138b5-9aa4-482f-8a13-f01b0b7597a3 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 404 len: 111 microversion: 2.1 time: 0.071270 May 28 21:06:00.491246 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 434/929] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:00 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:00.504791 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5f3fb7dc-c470-4675-9d35-fbb7e5cd4005 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:00.514489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1564035913", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "153ab96f-260d-4085-99e8-0491f645a707"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:00.514972 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5f3fb7dc-c470-4675-9d35-fbb7e5cd4005 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.241187 May 28 21:06:00.516082 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 496/930] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:00 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:00.521952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4b6700fb-4ecd-4091-9587-cba9a495ec0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:00.523280 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4b6700fb-4ecd-4091-9587-cba9a495ec0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:00.529540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b6700fb-4ecd-4091-9587-cba9a495ec0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:00.530956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b6700fb-4ecd-4091-9587-cba9a495ec0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:00.531393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b6700fb-4ecd-4091-9587-cba9a495ec0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:00.532066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b6700fb-4ecd-4091-9587-cba9a495ec0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:00.636551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] validate_networks() for [('153ab96f-260d-4085-99e8-0491f645a707', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:06:00.794267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4b6700fb-4ecd-4091-9587-cba9a495ec0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:00.807836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4b6700fb-4ecd-4091-9587-cba9a495ec0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:00.811853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4b6700fb-4ecd-4091-9587-cba9a495ec0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:00.814069 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4b6700fb-4ecd-4091-9587-cba9a495ec0c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.296236 May 28 21:06:00.815202 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 497/931] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:00 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:00.821719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5a6708ee-ce69-407e-aeb8-ad265fd0230b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '.version_select at 0x7f4d641adee0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:00.910571 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5a6708ee-ce69-407e-aeb8-ad265fd0230b tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501955601" status: 202 len: 0 microversion: 2.1 time: 0.092295 May 28 21:06:00.911889 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 498/932] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 21:06:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1501955601 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:00.935307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-780fd4a5-2d9e-42cf-8243-8647a6e16887 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:00.936287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-780fd4a5-2d9e-42cf-8243-8647a6e16887 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:00.961334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-780fd4a5-2d9e-42cf-8243-8647a6e16887 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:00.961804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-780fd4a5-2d9e-42cf-8243-8647a6e16887 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:00.964182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-780fd4a5-2d9e-42cf-8243-8647a6e16887 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:00.964648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-780fd4a5-2d9e-42cf-8243-8647a6e16887 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:01.234756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-780fd4a5-2d9e-42cf-8243-8647a6e16887 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:01.247111 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-780fd4a5-2d9e-42cf-8243-8647a6e16887 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.333219 May 28 21:06:01.257590 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 499/933] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:00 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:01.272090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:06:01.272703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:06:01.273363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:06:01.274054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:06:01.274659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:06:01.296419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ff719c1e-7122-4cf4-aba1-06b860e08012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:01.296419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ff719c1e-7122-4cf4-aba1-06b860e08012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:01.297052 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:01.297513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:01.298858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:01.306104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:01.311393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ff719c1e-7122-4cf4-aba1-06b860e08012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:01.311841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ff719c1e-7122-4cf4-aba1-06b860e08012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:01.312623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ff719c1e-7122-4cf4-aba1-06b860e08012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:01.313063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ff719c1e-7122-4cf4-aba1-06b860e08012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:01.369216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Getting quotas for project 2f5c3054461d4d07861a1685cfeba36a. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:01.374652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Getting quotas for user 7b44b524592e4a57a26681767b9c4541 and project 2f5c3054461d4d07861a1685cfeba36a. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:01.406918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:06:01.409504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:06:01.574955 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a46ffa2e-e8ca-453e-994d-fda50bf06be5 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.086752 May 28 21:06:01.576377 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 435/934] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:06:01.581744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6c663505-43fb-46d9-be2c-364599779a17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:01.582873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6c663505-43fb-46d9-be2c-364599779a17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:01.589905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c663505-43fb-46d9-be2c-364599779a17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:01.590594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c663505-43fb-46d9-be2c-364599779a17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:01.591385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c663505-43fb-46d9-be2c-364599779a17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:01.591832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c663505-43fb-46d9-be2c-364599779a17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:01.629715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ff719c1e-7122-4cf4-aba1-06b860e08012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:01.640648 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ff719c1e-7122-4cf4-aba1-06b860e08012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1325 microversion: 2.1 time: 0.381748 May 28 21:06:01.641456 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 500/935] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:01 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:01.785784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1263036564", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:01.819645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6c663505-43fb-46d9-be2c-364599779a17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:01.831482 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6c663505-43fb-46d9-be2c-364599779a17 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1379 microversion: 2.1 time: 0.253833 May 28 21:06:01.832091 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 436/936] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:01 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1379 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:01.850431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:06:01.854572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8b67ab84-670c-4e67-8051-c5121efd835d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:01.855216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8b67ab84-670c-4e67-8051-c5121efd835d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:01.862101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b67ab84-670c-4e67-8051-c5121efd835d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:01.862563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b67ab84-670c-4e67-8051-c5121efd835d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:01.864010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b67ab84-670c-4e67-8051-c5121efd835d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:01.864643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b67ab84-670c-4e67-8051-c5121efd835d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:02.164420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8b67ab84-670c-4e67-8051-c5121efd835d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:02.172410 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8b67ab84-670c-4e67-8051-c5121efd835d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.337991 May 28 21:06:02.174306 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 437/937] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:01 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:02.179243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c3e1a586-9e04-48ff-b854-ee0f21c14a33 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:02.179859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c3e1a586-9e04-48ff-b854-ee0f21c14a33 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:02.458905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:06:02.459422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:06:02.460062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:06:02.460632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:06:02.460771 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c3e1a586-9e04-48ff-b854-ee0f21c14a33 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:02.461393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:06:02.468120 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c3e1a586-9e04-48ff-b854-ee0f21c14a33 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1211 microversion: 2.1 time: 0.293030 May 28 21:06:02.468696 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 438/938] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:02 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1211 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:02.470901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:02.471546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:02.473107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:02.473725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-62541222-8ce0-42b2-b7ba-48dbcd72cdd0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:02.473879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:02.474418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-62541222-8ce0-42b2-b7ba-48dbcd72cdd0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:02.481160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62541222-8ce0-42b2-b7ba-48dbcd72cdd0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:02.481625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62541222-8ce0-42b2-b7ba-48dbcd72cdd0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:02.482747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62541222-8ce0-42b2-b7ba-48dbcd72cdd0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:02.483209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62541222-8ce0-42b2-b7ba-48dbcd72cdd0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:02.491994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:02.497530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:02.510610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:06:02.512907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:06:02.615892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-62541222-8ce0-42b2-b7ba-48dbcd72cdd0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:02.624932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-62541222-8ce0-42b2-b7ba-48dbcd72cdd0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:02.626469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-62541222-8ce0-42b2-b7ba-48dbcd72cdd0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:02.628069 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-62541222-8ce0-42b2-b7ba-48dbcd72cdd0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.157998 May 28 21:06:02.628664 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 439/939] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:02 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:02.633086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-8de4fab7-dc9f-4066-b218-ab734b680ebd req-766c8b86-fa4d-40f6-9939-564ed7fa7025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8268d1-36f2-4747-aa81-f6181ea36c35", "name": "network-vif-plugged", "status": "completed", "tag": "5edb3137-f693-41e6-8acc-86951c804f80"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:02.641499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8de4fab7-dc9f-4066-b218-ab734b680ebd req-766c8b86-fa4d-40f6-9939-564ed7fa7025 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:02.641973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8de4fab7-dc9f-4066-b218-ab734b680ebd req-766c8b86-fa4d-40f6-9939-564ed7fa7025 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:02.654713 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-8de4fab7-dc9f-4066-b218-ab734b680ebd req-766c8b86-fa4d-40f6-9939-564ed7fa7025 service nova] Creating event network-vif-plugged:5edb3137-f693-41e6-8acc-86951c804f80 for instance df8268d1-36f2-4747-aa81-f6181ea36c35 on nch1-master-1 May 28 21:06:02.660248 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-8de4fab7-dc9f-4066-b218-ab734b680ebd req-766c8b86-fa4d-40f6-9939-564ed7fa7025 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029854 May 28 21:06:02.660863 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 440/940] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:02.665795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eb95637a-cfa7-41dd-bdd7-df342c84ce1f tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:02.666642 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:02.666642 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:02.695274 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8185208e-acc1-4dc8-90d6-71c766fc30f8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.052543 May 28 21:06:02.700971 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 501/941] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:06:02.700971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8f97e75d-ccd9-47b0-8480-99cb69a8c97c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:02.701244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8f97e75d-ccd9-47b0-8480-99cb69a8c97c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:02.707581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f97e75d-ccd9-47b0-8480-99cb69a8c97c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:02.707961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f97e75d-ccd9-47b0-8480-99cb69a8c97c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:02.708742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f97e75d-ccd9-47b0-8480-99cb69a8c97c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:02.709185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f97e75d-ccd9-47b0-8480-99cb69a8c97c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:02.775183 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eb95637a-cfa7-41dd-bdd7-df342c84ce1f tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1455677346" status: 202 len: 0 microversion: 2.1 time: 0.112923 May 28 21:06:02.775897 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 441/942] 10.222.0.33 () {58 vars in 1160 bytes} [Sat May 28 21:06:02 2022] DELETE /compute/v2.1/flavors/1455677346 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:02.783687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2d3cb916-6d71-407f-8995-395859363f89 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:02.784308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2d3cb916-6d71-407f-8995-395859363f89 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:02.796176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d3cb916-6d71-407f-8995-395859363f89 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:02.796879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d3cb916-6d71-407f-8995-395859363f89 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:02.797686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d3cb916-6d71-407f-8995-395859363f89 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:02.798174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d3cb916-6d71-407f-8995-395859363f89 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:02.940159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8f97e75d-ccd9-47b0-8480-99cb69a8c97c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:02.950234 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8f97e75d-ccd9-47b0-8480-99cb69a8c97c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.253213 May 28 21:06:02.950829 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 502/943] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:02 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:02.955316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cfa42788-f3a1-45ea-91fa-fb4ce25f99b7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:02.957814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cfa42788-f3a1-45ea-91fa-fb4ce25f99b7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:03.024380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cfa42788-f3a1-45ea-91fa-fb4ce25f99b7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:03.028308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2d3cb916-6d71-407f-8995-395859363f89 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:03.031624 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cfa42788-f3a1-45ea-91fa-fb4ce25f99b7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1217 microversion: 2.1 time: 0.079797 May 28 21:06:03.032215 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 503/944] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:02 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:03.036800 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2d3cb916-6d71-407f-8995-395859363f89 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1523 microversion: 2.1 time: 0.257870 May 28 21:06:03.037401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0cc2d16c-2195-4267-9081-7e4761a796e8 tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.037537 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 442/945] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:02 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:03.042156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-90d89153-d17f-4092-8da6-75de12b8db98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.042879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-90d89153-d17f-4092-8da6-75de12b8db98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:03.048835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90d89153-d17f-4092-8da6-75de12b8db98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.049414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90d89153-d17f-4092-8da6-75de12b8db98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.051061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90d89153-d17f-4092-8da6-75de12b8db98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.051575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90d89153-d17f-4092-8da6-75de12b8db98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.065579 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0cc2d16c-2195-4267-9081-7e4761a796e8 tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5895 microversion: 2.1 time: 0.032108 May 28 21:06:03.066246 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 504/946] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:03 2022] GET /compute/v2.1/flavors/detail => generated 5895 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:03.077873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1828aa7d-d936-455b-b580-da05e6ea2134 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.080316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1828aa7d-d936-455b-b580-da05e6ea2134 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:03.088446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1828aa7d-d936-455b-b580-da05e6ea2134 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.088910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1828aa7d-d936-455b-b580-da05e6ea2134 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.089692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1828aa7d-d936-455b-b580-da05e6ea2134 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.090168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1828aa7d-d936-455b-b580-da05e6ea2134 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.276402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-90d89153-d17f-4092-8da6-75de12b8db98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:03.280703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1828aa7d-d936-455b-b580-da05e6ea2134 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:03.284736 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-90d89153-d17f-4092-8da6-75de12b8db98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1379 microversion: 2.1 time: 0.246103 May 28 21:06:03.285313 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 443/947] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:03 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1379 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:03.288569 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1828aa7d-d936-455b-b580-da05e6ea2134 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1523 microversion: 2.1 time: 0.221148 May 28 21:06:03.289131 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 505/948] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:03 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:03.289597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4cf1205b-9b06-4f7e-addd-b62e73d2d703 tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.290535 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:03.290535 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:03.294917 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d41d40e4-2700-4fc4-a53b-de911c43e038 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.299038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d41d40e4-2700-4fc4-a53b-de911c43e038 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:03.301734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d41d40e4-2700-4fc4-a53b-de911c43e038 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.302232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d41d40e4-2700-4fc4-a53b-de911c43e038 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.303006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d41d40e4-2700-4fc4-a53b-de911c43e038 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.303699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d41d40e4-2700-4fc4-a53b-de911c43e038 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.381556 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4cf1205b-9b06-4f7e-addd-b62e73d2d703 tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1952902279" status: 202 len: 0 microversion: 2.1 time: 0.095104 May 28 21:06:03.382508 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 444/949] 10.222.0.33 () {58 vars in 1160 bytes} [Sat May 28 21:06:03 2022] DELETE /compute/v2.1/flavors/1952902279 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:03.387813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-debba2ae-ebc9-4c44-b28f-4307bceb68cd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-243014", "metadata": {"": ""}}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-debba2ae-ebc9-4c44-b28f-4307bceb68cd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Request method failure captured: May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f/action HTTP/1.1 May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 103 May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko6oq10ya0vKA7Lzgzw7qEixBB6oq9XwAAqnALDB3LxJ0Ou3iq7_g4aSSk-6F4p6-_hIGxM22vsmPp1vD-bx8iQQTYyEkSHfzi2JWR2mENOMe6ss5h_-1Ay7OrAERWJEEuMTwxRxM1yb64UuFpXocdkERI-wAfMoU5j69oLSNr7C4nA May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:06:03.390580 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:06:03.396977 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab0c1d6a9fc44de4af61822849b3bf8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:03.396977 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:03.396977 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:06:03.396977 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:03.396977 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:06:03.396977 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:03.396977 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:03.396977 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: dc48535b672d4d1190ecfefe6cb02720 May 28 21:06:03.396977 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:06:03.396977 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:06:03.396977 ncdv-master-1 devstack@n-api.service[143129]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-243014", "metadata": {"": ""}}} May 28 21:06:03.396977 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-243014', 'metadata': {'': ''}}}} May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'': ''} May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:03.398023 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.399520 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.400878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:03.400878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:03.400878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:06:03.400878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:06:03.400878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:06:03.400878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.400878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-debba2ae-ebc9-4c44-b28f-4307bceb68cd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:03.400878 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-debba2ae-ebc9-4c44-b28f-4307bceb68cd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "POST /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f/action" status: 400 len: 170 microversion: 2.1 time: 0.008343 May 28 21:06:03.400878 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 445/950] 10.222.0.33 () {60 vars in 1278 bytes} [Sat May 28 21:06:03 2022] POST /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f/action => generated 170 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:06:03.402221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-05758cf5-bd43-4805-a8ee-32ed359bbcfb tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.403734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:03.417154 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-05758cf5-bd43-4805-a8ee-32ed359bbcfb tempest-ServersWithSpecificFlavorTestJSON-1312507192 tempest-ServersWithSpecificFlavorTestJSON-1312507192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.023693 May 28 21:06:03.417741 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 446/951] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:03 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:03.425561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c715a3c5-b966-4e60-b5b3-5111c7945586 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.425561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c715a3c5-b966-4e60-b5b3-5111c7945586 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:03.429671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c715a3c5-b966-4e60-b5b3-5111c7945586 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.430336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c715a3c5-b966-4e60-b5b3-5111c7945586 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.431115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c715a3c5-b966-4e60-b5b3-5111c7945586 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.431564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c715a3c5-b966-4e60-b5b3-5111c7945586 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.447470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d41d40e4-2700-4fc4-a53b-de911c43e038 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:03.456385 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d41d40e4-2700-4fc4-a53b-de911c43e038 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.166083 May 28 21:06:03.457752 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 506/952] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:03 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:03.463503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c14465c-3cae-4a7d-b5a9-8a0f4bd791e7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.464187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3c14465c-3cae-4a7d-b5a9-8a0f4bd791e7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:03.471911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c14465c-3cae-4a7d-b5a9-8a0f4bd791e7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.473336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c14465c-3cae-4a7d-b5a9-8a0f4bd791e7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.474368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c14465c-3cae-4a7d-b5a9-8a0f4bd791e7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.474976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c14465c-3cae-4a7d-b5a9-8a0f4bd791e7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.494826 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-3c14465c-3cae-4a7d-b5a9-8a0f4bd791e7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] HTTP exception thrown: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c14465c-3cae-4a7d-b5a9-8a0f4bd791e7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Request method failure captured: May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 HTTP/1.1 May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4GMS89Deqs81YcKX944W0Ci9CFAJJqces9rAddfaO8Z2Pj85dSj4RIYjo1KMON6L9Z6gNAV-UjaVkfvPhE6FS0xsjO9IESWhyahkmyJcQGdc6M2u86feysZFail1bLx0drtwl1Dx0oCAWIBtp50wGAkCGNHOJT6Sb3FEQ0-eJTbFM May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0e60b122ef584254b06fd8258c987f8d May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:06:03.499384 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:06:03.500853 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e60b122ef584254b06fd8258c987f8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:03.500853 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:03.500853 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0e60b122ef584254b06fd8258c987f8d May 28 21:06:03.500853 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:03.500853 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1243493620-project May 28 21:06:03.500853 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:06:03.500853 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:06:03.500853 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: cdeaa660f8ec465bba68096d0ed4b1ae May 28 21:06:03.500853 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620-project May 28 21:06:03.500853 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:06:03.500853 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. May 28 21:06:03.500853 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11'} May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:03.501666 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. May 28 21:06:03.503073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.505098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c14465c-3cae-4a7d-b5a9-8a0f4bd791e7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Returning 404 to user: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:03.505098 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3c14465c-3cae-4a7d-b5a9-8a0f4bd791e7 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 404 len: 111 microversion: 2.1 time: 0.045855 May 28 21:06:03.506232 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 507/953] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:06:03 2022] DELETE /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:03.512736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f8566af3-1df7-4141-b6cc-aa1d5be28202 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.513958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f8566af3-1df7-4141-b6cc-aa1d5be28202 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:03.522479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8566af3-1df7-4141-b6cc-aa1d5be28202 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.522944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8566af3-1df7-4141-b6cc-aa1d5be28202 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.523732 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8566af3-1df7-4141-b6cc-aa1d5be28202 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.524237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8566af3-1df7-4141-b6cc-aa1d5be28202 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.604417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f8566af3-1df7-4141-b6cc-aa1d5be28202 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:03.607532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c715a3c5-b966-4e60-b5b3-5111c7945586 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:03.612366 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f8566af3-1df7-4141-b6cc-aa1d5be28202 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1207 microversion: 2.1 time: 0.103542 May 28 21:06:03.613492 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 508/954] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:03 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1207 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:03.616141 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c715a3c5-b966-4e60-b5b3-5111c7945586 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1523 microversion: 2.1 time: 0.197398 May 28 21:06:03.616704 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 447/955] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:03 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1523 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:03.618528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e30c3f71-dfb6-46d2-a41e-4624552c8002 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.619080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e30c3f71-dfb6-46d2-a41e-4624552c8002 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:03.626074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e30c3f71-dfb6-46d2-a41e-4624552c8002 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.626537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e30c3f71-dfb6-46d2-a41e-4624552c8002 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.627317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e30c3f71-dfb6-46d2-a41e-4624552c8002 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.627767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e30c3f71-dfb6-46d2-a41e-4624552c8002 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.635366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c5590152-c70c-4b5d-a496-5dbc812eac4f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.636058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c5590152-c70c-4b5d-a496-5dbc812eac4f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:03.643688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5590152-c70c-4b5d-a496-5dbc812eac4f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.643889 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-e30c3f71-dfb6-46d2-a41e-4624552c8002 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] HTTP exception thrown: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. May 28 21:06:03.644734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5590152-c70c-4b5d-a496-5dbc812eac4f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.645516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5590152-c70c-4b5d-a496-5dbc812eac4f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e30c3f71-dfb6-46d2-a41e-4624552c8002 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Request method failure captured: May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 HTTP/1.1 May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4GMS89Deqs81YcKX944W0Ci9CFAJJqces9rAddfaO8Z2Pj85dSj4RIYjo1KMON6L9Z6gNAV-UjaVkfvPhE6FS0xsjO9IESWhyahkmyJcQGdc6M2u86feysZFail1bLx0drtwl1Dx0oCAWIBtp50wGAkCGNHOJT6Sb3FEQ0-eJTbFM May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0e60b122ef584254b06fd8258c987f8d May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:06:03.645865 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:06:03.647333 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e60b122ef584254b06fd8258c987f8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:03.647333 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:03.647333 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0e60b122ef584254b06fd8258c987f8d May 28 21:06:03.647333 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:03.647333 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1243493620-project May 28 21:06:03.647333 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:06:03.647333 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:06:03.647333 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: cdeaa660f8ec465bba68096d0ed4b1ae May 28 21:06:03.647333 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620-project May 28 21:06:03.647333 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:06:03.647333 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. May 28 21:06:03.647333 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11'} May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:03.648166 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. May 28 21:06:03.649463 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.650815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5590152-c70c-4b5d-a496-5dbc812eac4f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.650910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e30c3f71-dfb6-46d2-a41e-4624552c8002 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Returning 404 to user: Instance fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:03.650910 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e30c3f71-dfb6-46d2-a41e-4624552c8002 tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11" status: 404 len: 111 microversion: 2.1 time: 0.032752 May 28 21:06:03.651046 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 509/956] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:03 2022] GET /compute/v2.1/servers/fc7c5cc5-0c46-4477-abb3-fb1ebfcfac11 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:03.655779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9e607bbb-3cce-4049-a13a-adca0157a8b5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.656404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9e607bbb-3cce-4049-a13a-adca0157a8b5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:03.663183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e607bbb-3cce-4049-a13a-adca0157a8b5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.663691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e607bbb-3cce-4049-a13a-adca0157a8b5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.664479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e607bbb-3cce-4049-a13a-adca0157a8b5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.664927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e607bbb-3cce-4049-a13a-adca0157a8b5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.835447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c5590152-c70c-4b5d-a496-5dbc812eac4f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:03.843245 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c5590152-c70c-4b5d-a496-5dbc812eac4f tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1523 microversion: 2.1 time: 0.212627 May 28 21:06:03.844052 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 448/957] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:03 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1523 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:03.849448 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e1736e11-64fc-4c53-866c-e309b2a97dee tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.850064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e1736e11-64fc-4c53-866c-e309b2a97dee tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:03.856071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1736e11-64fc-4c53-866c-e309b2a97dee tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.856526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1736e11-64fc-4c53-866c-e309b2a97dee tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.857313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1736e11-64fc-4c53-866c-e309b2a97dee tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.857764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1736e11-64fc-4c53-866c-e309b2a97dee tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.859634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9e607bbb-3cce-4049-a13a-adca0157a8b5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:03.869408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9e607bbb-3cce-4049-a13a-adca0157a8b5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:03.870970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9e607bbb-3cce-4049-a13a-adca0157a8b5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:03.872289 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9e607bbb-3cce-4049-a13a-adca0157a8b5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.220126 May 28 21:06:03.872721 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 510/958] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:03 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-e1736e11-64fc-4c53-866c-e309b2a97dee tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] HTTP exception thrown: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e1736e11-64fc-4c53-866c-e309b2a97dee tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Request method failure captured: May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 HTTP/1.1 May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4GMS89Deqs81YcKX944W0Ci9CFAJJqces9rAddfaO8Z2Pj85dSj4RIYjo1KMON6L9Z6gNAV-UjaVkfvPhE6FS0xsjO9IESWhyahkmyJcQGdc6M2u86feysZFail1bLx0drtwl1Dx0oCAWIBtp50wGAkCGNHOJT6Sb3FEQ0-eJTbFM May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 0e60b122ef584254b06fd8258c987f8d May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:06:03.883282 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:06:03.884865 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e60b122ef584254b06fd8258c987f8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:03.884865 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:03.884865 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 0e60b122ef584254b06fd8258c987f8d May 28 21:06:03.884865 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:03.884865 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1243493620-project May 28 21:06:03.884865 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:03.884865 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:03.884865 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: cdeaa660f8ec465bba68096d0ed4b1ae May 28 21:06:03.884865 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620-project May 28 21:06:03.884865 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:06:03.884865 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:03.884865 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '02214efd-8392-465b-bd6a-d658850d4f15'} May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:03.885712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:03.887122 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.888495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e1736e11-64fc-4c53-866c-e309b2a97dee tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Returning 404 to user: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:03.888495 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e1736e11-64fc-4c53-866c-e309b2a97dee tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "DELETE /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 404 len: 111 microversion: 2.1 time: 0.030995 May 28 21:06:03.888495 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 449/959] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:06:03 2022] DELETE /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-396f0a7a-727b-44a8-acce-68f25a44fa28 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1404683363", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-396f0a7a-727b-44a8-acce-68f25a44fa28 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Request method failure captured: May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f/action HTTP/1.1 May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 619 May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko6oq10ya0vKA7Lzgzw7qEixBB6oq9XwAAqnALDB3LxJ0Ou3iq7_g4aSSk-6F4p6-_hIGxM22vsmPp1vD-bx8iQQTYyEkSHfzi2JWR2mENOMe6ss5h_-1Ay7OrAERWJEEuMTwxRxM1yb64UuFpXocdkERI-wAfMoU5j69oLSNr7C4nA May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:06:03.888742 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:06:03.895471 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:06:03.895471 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:06:03.895471 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:03.895471 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:06:03.895471 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:06:03.895471 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab0c1d6a9fc44de4af61822849b3bf8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:03.895471 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:03.895471 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:06:03.895471 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:03.895471 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:06:03.895471 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:06:03.895471 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:06:03.895471 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: dc48535b672d4d1190ecfefe6cb02720 May 28 21:06:03.895471 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:06:03.895471 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:06:03.896571 ncdv-master-1 devstack@n-api.service[143128]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1404683363", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} May 28 21:06:03.896571 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:06:03.896571 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:06:03.896790 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1404683363', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} May 28 21:06:03.896790 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:03.896790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.896790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:06:03.896790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:06:03.896790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:06:03.896790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise error May 28 21:06:03.896790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:06:03.896790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.896790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: May 28 21:06:03.896790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:03.897450 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:06:03.898552 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:06:03.898552 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:06:03.898552 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:06:03.898552 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:06:03.898552 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:06:03.898552 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:06:03.898552 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:06:03.898552 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:06:03.898552 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.898552 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:03.898552 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.898552 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.899883 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:03.899883 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:03.899883 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:06:03.899883 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:06:03.899883 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:06:03.899883 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:03.900737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-396f0a7a-727b-44a8-acce-68f25a44fa28 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:03.900737 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-396f0a7a-727b-44a8-acce-68f25a44fa28 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "POST /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f/action" status: 400 len: 938 microversion: 2.1 time: 0.009321 May 28 21:06:03.900737 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 511/960] 10.222.0.33 () {60 vars in 1278 bytes} [Sat May 28 21:06:03 2022] POST /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f/action => generated 938 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:06:03.900958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c4e6adc4-1e83-4b9d-890f-d094f809f3bf tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.900958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c4e6adc4-1e83-4b9d-890f-d094f809f3bf tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] [instance: 02214efd-8392-465b-bd6a-d658850d4f15] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:03.900958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4e6adc4-1e83-4b9d-890f-d094f809f3bf tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.900958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4e6adc4-1e83-4b9d-890f-d094f809f3bf tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.901674 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4e6adc4-1e83-4b9d-890f-d094f809f3bf tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.901674 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4e6adc4-1e83-4b9d-890f-d094f809f3bf tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.904361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-90f28770-501e-464f-bc4f-1890db465e4c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.905020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-90f28770-501e-464f-bc4f-1890db465e4c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:03.908672 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-c4e6adc4-1e83-4b9d-890f-d094f809f3bf tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] HTTP exception thrown: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c4e6adc4-1e83-4b9d-890f-d094f809f3bf tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Request method failure captured: May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 HTTP/1.1 May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4GMS89Deqs81YcKX944W0Ci9CFAJJqces9rAddfaO8Z2Pj85dSj4RIYjo1KMON6L9Z6gNAV-UjaVkfvPhE6FS0xsjO9IESWhyahkmyJcQGdc6M2u86feysZFail1bLx0drtwl1Dx0oCAWIBtp50wGAkCGNHOJT6Sb3FEQ0-eJTbFM May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 0e60b122ef584254b06fd8258c987f8d May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:06:03.910425 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:06:03.911725 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0e60b122ef584254b06fd8258c987f8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0e60b122ef584254b06fd8258c987f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:03.911725 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:03.911725 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 0e60b122ef584254b06fd8258c987f8d May 28 21:06:03.911725 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620 May 28 21:06:03.911725 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1243493620-project May 28 21:06:03.911725 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:03.911725 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:03.911725 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: cdeaa660f8ec465bba68096d0ed4b1ae May 28 21:06:03.911725 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1243493620-project May 28 21:06:03.911725 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:06:03.911725 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:03.911725 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '02214efd-8392-465b-bd6a-d658850d4f15'} May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:03.912439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. May 28 21:06:03.913557 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:03.914621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c4e6adc4-1e83-4b9d-890f-d094f809f3bf tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] Returning 404 to user: Instance 02214efd-8392-465b-bd6a-d658850d4f15 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:03.914621 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c4e6adc4-1e83-4b9d-890f-d094f809f3bf tempest-ServersWithSpecificFlavorTestJSON-1243493620 tempest-ServersWithSpecificFlavorTestJSON-1243493620-project] 10.222.0.33 "GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15" status: 404 len: 111 microversion: 2.1 time: 0.030408 May 28 21:06:03.914767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90f28770-501e-464f-bc4f-1890db465e4c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.914853 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 450/961] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:03 2022] GET /compute/v2.1/servers/02214efd-8392-465b-bd6a-d658850d4f15 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:03.914927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90f28770-501e-464f-bc4f-1890db465e4c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.914927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90f28770-501e-464f-bc4f-1890db465e4c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.914927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90f28770-501e-464f-bc4f-1890db465e4c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.967980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f01fa84a-c8b5-40eb-8344-6c250ca7f282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:03.968710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f01fa84a-c8b5-40eb-8344-6c250ca7f282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:03.975006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f01fa84a-c8b5-40eb-8344-6c250ca7f282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.975540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f01fa84a-c8b5-40eb-8344-6c250ca7f282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:03.976417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f01fa84a-c8b5-40eb-8344-6c250ca7f282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:03.976925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f01fa84a-c8b5-40eb-8344-6c250ca7f282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:04.161138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-90f28770-501e-464f-bc4f-1890db465e4c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:04.169256 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-90f28770-501e-464f-bc4f-1890db465e4c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1523 microversion: 2.1 time: 0.270741 May 28 21:06:04.169980 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 512/962] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:03 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:04.181264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7594cef8-2b40-410d-87e8-d6ad5b6d9f29 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:04.181264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7594cef8-2b40-410d-87e8-d6ad5b6d9f29 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:04.181868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7594cef8-2b40-410d-87e8-d6ad5b6d9f29 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:04.182541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7594cef8-2b40-410d-87e8-d6ad5b6d9f29 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:04.183393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7594cef8-2b40-410d-87e8-d6ad5b6d9f29 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:04.183872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7594cef8-2b40-410d-87e8-d6ad5b6d9f29 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:04.257965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f01fa84a-c8b5-40eb-8344-6c250ca7f282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:04.265722 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f01fa84a-c8b5-40eb-8344-6c250ca7f282 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.301826 May 28 21:06:04.274024 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 451/963] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:03 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:04.274024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ffbbaab4-1e00-4500-89ee-5764ecbb59b6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:04.274024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ffbbaab4-1e00-4500-89ee-5764ecbb59b6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:04.277189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7594cef8-2b40-410d-87e8-d6ad5b6d9f29 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:04.277466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffbbaab4-1e00-4500-89ee-5764ecbb59b6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:04.277956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffbbaab4-1e00-4500-89ee-5764ecbb59b6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:04.278728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffbbaab4-1e00-4500-89ee-5764ecbb59b6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:04.279168 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffbbaab4-1e00-4500-89ee-5764ecbb59b6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:04.287693 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7594cef8-2b40-410d-87e8-d6ad5b6d9f29 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1221 microversion: 2.1 time: 0.115783 May 28 21:06:04.287693 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 513/964] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:04 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1221 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:04.299525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:04.302635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-79a6e6ef-1cae-4f73-b38e-c3f8954c577b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:04.303498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-79a6e6ef-1cae-4f73-b38e-c3f8954c577b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:04.310294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-79a6e6ef-1cae-4f73-b38e-c3f8954c577b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:04.311018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-79a6e6ef-1cae-4f73-b38e-c3f8954c577b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:04.312911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-79a6e6ef-1cae-4f73-b38e-c3f8954c577b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:04.312911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-79a6e6ef-1cae-4f73-b38e-c3f8954c577b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:04.582361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ffbbaab4-1e00-4500-89ee-5764ecbb59b6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:04.589958 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ffbbaab4-1e00-4500-89ee-5764ecbb59b6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1523 microversion: 2.1 time: 0.322454 May 28 21:06:04.590546 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 452/965] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:04 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:04.594981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-456e256d-6705-46a7-a11d-4925eb08b4bb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:04.595598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-456e256d-6705-46a7-a11d-4925eb08b4bb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:04.602164 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-456e256d-6705-46a7-a11d-4925eb08b4bb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:04.602626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-456e256d-6705-46a7-a11d-4925eb08b4bb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:04.603475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-456e256d-6705-46a7-a11d-4925eb08b4bb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:04.603925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-456e256d-6705-46a7-a11d-4925eb08b4bb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:04.625154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-79a6e6ef-1cae-4f73-b38e-c3f8954c577b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:04.627427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:04.634583 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-79a6e6ef-1cae-4f73-b38e-c3f8954c577b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1379 microversion: 2.1 time: 0.337374 May 28 21:06:04.635476 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 514/966] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:04 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1379 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:04.641214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2c79492a-5e97-45df-80b8-820233913dd3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2c79492a-5e97-45df-80b8-820233913dd3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Request method failure captured: May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f/action HTTP/1.1 May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 285 May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko6oq10ya0vKA7Lzgzw7qEixBB6oq9XwAAqnALDB3LxJ0Ou3iq7_g4aSSk-6F4p6-_hIGxM22vsmPp1vD-bx8iQQTYyEkSHfzi2JWR2mENOMe6ss5h_-1Ay7OrAERWJEEuMTwxRxM1yb64UuFpXocdkERI-wAfMoU5j69oLSNr7C4nA May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:06:04.644058 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:06:04.645326 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab0c1d6a9fc44de4af61822849b3bf8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:04.645326 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:04.645326 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:06:04.645326 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:04.645326 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:06:04.645326 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:06:04.645326 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:06:04.645326 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: dc48535b672d4d1190ecfefe6cb02720 May 28 21:06:04.645326 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:06:04.645326 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:06:04.645326 ncdv-master-1 devstack@n-api.service[143128]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 28 21:06:04.646276 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:06:04.646276 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:06:04.646276 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 28 21:06:04.646276 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:04.646276 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:04.646276 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:06:04.646276 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:06:04.646276 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:06:04.646276 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise error May 28 21:06:04.646276 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi On instance['createImage']: May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:06:04.646859 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:06:04.648012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:06:04.648012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:06:04.648012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:06:04.648012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:06:04.648012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:06:04.648012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:04.648012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:04.648012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:04.648012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:04.648012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:04.648012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:04.648012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:06:04.648012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:06:04.648743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:06:04.648743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:04.648743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2c79492a-5e97-45df-80b8-820233913dd3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:04.648743 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2c79492a-5e97-45df-80b8-820233913dd3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "POST /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f/action" status: 400 len: 619 microversion: 2.1 time: 0.008776 May 28 21:06:04.649778 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 515/967] 10.222.0.33 () {60 vars in 1278 bytes} [Sat May 28 21:06:04 2022] POST /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f/action => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:06:04.653754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-07451cdd-46c2-480b-81fe-d3d58e3e87ac tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:04.654393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-07451cdd-46c2-480b-81fe-d3d58e3e87ac tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:04.662493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07451cdd-46c2-480b-81fe-d3d58e3e87ac tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:04.662937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07451cdd-46c2-480b-81fe-d3d58e3e87ac tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:04.663739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07451cdd-46c2-480b-81fe-d3d58e3e87ac tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:04.664182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07451cdd-46c2-480b-81fe-d3d58e3e87ac tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:04.793337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-07451cdd-46c2-480b-81fe-d3d58e3e87ac tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:04.801394 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-07451cdd-46c2-480b-81fe-d3d58e3e87ac tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1263 microversion: 2.1 time: 0.151264 May 28 21:06:04.802012 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 516/968] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:04 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:04.806479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2f190c27-f184-4625-9b38-8bdfe672cb6e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:04.807121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2f190c27-f184-4625-9b38-8bdfe672cb6e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:04.813087 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f190c27-f184-4625-9b38-8bdfe672cb6e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:04.813537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f190c27-f184-4625-9b38-8bdfe672cb6e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:04.814333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f190c27-f184-4625-9b38-8bdfe672cb6e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:04.814772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f190c27-f184-4625-9b38-8bdfe672cb6e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:04.884399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-456e256d-6705-46a7-a11d-4925eb08b4bb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:04.892184 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-456e256d-6705-46a7-a11d-4925eb08b4bb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.300641 May 28 21:06:04.892759 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 453/969] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:04 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:04.897357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-cf4d8189-d495-45e8-850b-f5526fdcf81c req-2ad7510b-ff67-4431-a03c-320fcf4fc39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394fe269-dd5e-4d4e-8f49-de1df1812e6a", "name": "network-vif-plugged", "status": "completed", "tag": "e413ef97-3a02-48d0-ae33-341fafd919b8"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:04.905536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cf4d8189-d495-45e8-850b-f5526fdcf81c req-2ad7510b-ff67-4431-a03c-320fcf4fc39d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:04.908207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cf4d8189-d495-45e8-850b-f5526fdcf81c req-2ad7510b-ff67-4431-a03c-320fcf4fc39d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:04.917681 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-cf4d8189-d495-45e8-850b-f5526fdcf81c req-2ad7510b-ff67-4431-a03c-320fcf4fc39d service nova] Creating event network-vif-plugged:e413ef97-3a02-48d0-ae33-341fafd919b8 for instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a on nch1-master-1 May 28 21:06:04.922691 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-cf4d8189-d495-45e8-850b-f5526fdcf81c req-2ad7510b-ff67-4431-a03c-320fcf4fc39d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028640 May 28 21:06:04.923610 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 454/970] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:04.929267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dd513412-0d5b-4b08-adb7-25a430568936 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:04.930015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dd513412-0d5b-4b08-adb7-25a430568936 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:04.936176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd513412-0d5b-4b08-adb7-25a430568936 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:04.936636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd513412-0d5b-4b08-adb7-25a430568936 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:04.937408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd513412-0d5b-4b08-adb7-25a430568936 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:04.937862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd513412-0d5b-4b08-adb7-25a430568936 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:05.153665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2f190c27-f184-4625-9b38-8bdfe672cb6e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:05.162239 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2f190c27-f184-4625-9b38-8bdfe672cb6e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1523 microversion: 2.1 time: 0.359207 May 28 21:06:05.162825 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 517/971] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:04 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1523 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:05.179616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1030673a-2082-4116-9546-28431436a618 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:05.180230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1030673a-2082-4116-9546-28431436a618 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:05.186149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1030673a-2082-4116-9546-28431436a618 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:05.186841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1030673a-2082-4116-9546-28431436a618 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:05.187613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1030673a-2082-4116-9546-28431436a618 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:05.188199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1030673a-2082-4116-9546-28431436a618 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:05.201724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dd513412-0d5b-4b08-adb7-25a430568936 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:05.216090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dd513412-0d5b-4b08-adb7-25a430568936 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:05.218475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dd513412-0d5b-4b08-adb7-25a430568936 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:05.221413 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dd513412-0d5b-4b08-adb7-25a430568936 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.295133 May 28 21:06:05.222357 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 455/972] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:04 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:05.282869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-29cca407-091e-4639-9e37-df2bcc519e6c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:05.283493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-29cca407-091e-4639-9e37-df2bcc519e6c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:05.290400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29cca407-091e-4639-9e37-df2bcc519e6c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:05.290854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29cca407-091e-4639-9e37-df2bcc519e6c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:05.291623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29cca407-091e-4639-9e37-df2bcc519e6c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:05.292459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29cca407-091e-4639-9e37-df2bcc519e6c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:05.397534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1030673a-2082-4116-9546-28431436a618 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:05.406243 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1030673a-2082-4116-9546-28431436a618 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1523 microversion: 2.1 time: 0.230148 May 28 21:06:05.418242 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 518/973] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:05 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1523 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:05.423213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-54225fbc-f6ee-4177-a8cd-d7f0f37df5b0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:05.423860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-54225fbc-f6ee-4177-a8cd-d7f0f37df5b0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:05.430300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54225fbc-f6ee-4177-a8cd-d7f0f37df5b0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:05.430760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54225fbc-f6ee-4177-a8cd-d7f0f37df5b0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:05.431536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54225fbc-f6ee-4177-a8cd-d7f0f37df5b0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:05.432162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54225fbc-f6ee-4177-a8cd-d7f0f37df5b0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:05.544049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-54225fbc-f6ee-4177-a8cd-d7f0f37df5b0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:05.551554 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-54225fbc-f6ee-4177-a8cd-d7f0f37df5b0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1213 microversion: 2.1 time: 0.132189 May 28 21:06:05.552142 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 519/974] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:05 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1213 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:05.556782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a4733c79-2a68-4a3f-9ec4-dc7b46881234 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-313233086"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:05.557878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a4733c79-2a68-4a3f-9ec4-dc7b46881234 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:05.563891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4733c79-2a68-4a3f-9ec4-dc7b46881234 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:05.564331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4733c79-2a68-4a3f-9ec4-dc7b46881234 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:05.565116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4733c79-2a68-4a3f-9ec4-dc7b46881234 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:05.565565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4733c79-2a68-4a3f-9ec4-dc7b46881234 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:05.576398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-29cca407-091e-4639-9e37-df2bcc519e6c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:05.586098 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-29cca407-091e-4639-9e37-df2bcc519e6c tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1371 microversion: 2.1 time: 0.306630 May 28 21:06:05.595395 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 456/975] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:05 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:05.653656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-982db1f8-6f58-4130-b3e9-c8e8e65c1a16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:05.654422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-982db1f8-6f58-4130-b3e9-c8e8e65c1a16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:05.661327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-982db1f8-6f58-4130-b3e9-c8e8e65c1a16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:05.661818 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-982db1f8-6f58-4130-b3e9-c8e8e65c1a16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:05.662699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-982db1f8-6f58-4130-b3e9-c8e8e65c1a16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:05.663206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-982db1f8-6f58-4130-b3e9-c8e8e65c1a16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:06.010332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-982db1f8-6f58-4130-b3e9-c8e8e65c1a16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:06.019472 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-982db1f8-6f58-4130-b3e9-c8e8e65c1a16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1379 microversion: 2.1 time: 0.369817 May 28 21:06:06.022553 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 457/976] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:05 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1379 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:06.039599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-17b15fe5-c169-4808-b3f4-4290703a2cb6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:06.041570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-17b15fe5-c169-4808-b3f4-4290703a2cb6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:06.047536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17b15fe5-c169-4808-b3f4-4290703a2cb6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:06.048670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17b15fe5-c169-4808-b3f4-4290703a2cb6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:06.048818 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17b15fe5-c169-4808-b3f4-4290703a2cb6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:06.049236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17b15fe5-c169-4808-b3f4-4290703a2cb6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:06.237076 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a4733c79-2a68-4a3f-9ec4-dc7b46881234 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "POST /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f/action" status: 202 len: 0 microversion: 2.1 time: 0.683649 May 28 21:06:06.243933 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 520/977] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:06:05 2022] POST /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 21:06:06.245495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4bf9ed4f-5844-4d7d-a7b8-52fa9c381b64 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:06.246448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4bf9ed4f-5844-4d7d-a7b8-52fa9c381b64 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:06.255495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bf9ed4f-5844-4d7d-a7b8-52fa9c381b64 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:06.256762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bf9ed4f-5844-4d7d-a7b8-52fa9c381b64 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:06.258327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bf9ed4f-5844-4d7d-a7b8-52fa9c381b64 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:06.258919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bf9ed4f-5844-4d7d-a7b8-52fa9c381b64 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:06.444864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-17b15fe5-c169-4808-b3f4-4290703a2cb6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:06.453792 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-17b15fe5-c169-4808-b3f4-4290703a2cb6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1271 microversion: 2.1 time: 0.418537 May 28 21:06:06.455130 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 458/978] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:06 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1271 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:06.462427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e8c3b605-ea2f-4bee-a1a1-cd6664259c0a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:06.462427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e8c3b605-ea2f-4bee-a1a1-cd6664259c0a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:06.468237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8c3b605-ea2f-4bee-a1a1-cd6664259c0a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:06.468808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8c3b605-ea2f-4bee-a1a1-cd6664259c0a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:06.469685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8c3b605-ea2f-4bee-a1a1-cd6664259c0a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:06.470254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8c3b605-ea2f-4bee-a1a1-cd6664259c0a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:06.665350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4bf9ed4f-5844-4d7d-a7b8-52fa9c381b64 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:06.673539 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4bf9ed4f-5844-4d7d-a7b8-52fa9c381b64 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.433331 May 28 21:06:06.674353 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 521/979] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:06 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:06.679707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cf9e318d-d1ac-4a6f-94a2-b0c55b72173a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1626923948"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:06.681005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cf9e318d-d1ac-4a6f-94a2-b0c55b72173a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:06.692434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf9e318d-d1ac-4a6f-94a2-b0c55b72173a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:06.694617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf9e318d-d1ac-4a6f-94a2-b0c55b72173a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:06.694617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf9e318d-d1ac-4a6f-94a2-b0c55b72173a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:06.695426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf9e318d-d1ac-4a6f-94a2-b0c55b72173a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:06.733210 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-cf9e318d-d1ac-4a6f-94a2-b0c55b72173a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] HTTP exception thrown: Cannot 'createImage' instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f while it is in task_state image_snapshot May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cf9e318d-d1ac-4a6f-94a2-b0c55b72173a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Request method failure captured: May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f/action HTTP/1.1 May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 85 May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko6oq10ya0vKA7Lzgzw7qEixBB6oq9XwAAqnALDB3LxJ0Ou3iq7_g4aSSk-6F4p6-_hIGxM22vsmPp1vD-bx8iQQTYyEkSHfzi2JWR2mENOMe6ss5h_-1Ay7OrAERWJEEuMTwxRxM1yb64UuFpXocdkERI-wAfMoU5j69oLSNr7C4nA May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:06:06.735034 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:06:06.736616 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab0c1d6a9fc44de4af61822849b3bf8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:06.736616 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:06.736616 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:06:06.736616 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:06.736616 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:06:06.736616 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:06:06.736616 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:06:06.736616 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: dc48535b672d4d1190ecfefe6cb02720 May 28 21:06:06.736616 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:06:06.736616 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:06:06.736616 ncdv-master-1 devstack@n-api.service[143128]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1626923948"}} May 28 21:06:06.736616 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: exception: Cannot 'createImage' instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f while it is in task_state image_snapshot May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1626923948'}}} May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f in task_state image_snapshot. Cannot snapshot while the instance is in this state. May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:06.737493 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f while it is in task_state image_snapshot May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f while it is in task_state image_snapshot May 28 21:06:06.738996 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:06.740224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cf9e318d-d1ac-4a6f-94a2-b0c55b72173a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Returning 409 to user: Cannot 'createImage' instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f while it is in task_state image_snapshot {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:06.740224 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cf9e318d-d1ac-4a6f-94a2-b0c55b72173a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "POST /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f/action" status: 409 len: 159 microversion: 2.1 time: 0.063161 May 28 21:06:06.740224 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 522/980] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:06:06 2022] POST /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f/action => generated 159 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:06:06.744766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e8c3b605-ea2f-4bee-a1a1-cd6664259c0a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:06.745672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-aeba1b7a-8e29-4a09-a2eb-160f7ac9271b req-07bd3d17-b2fe-4e0d-92a6-385f2e0659a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502fcad4-754e-4627-96fa-80843f774f47", "name": "network-vif-unplugged", "status": "completed", "tag": "4a538780-a868-4e2b-a232-0afe1eda360e"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:06.755646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-aeba1b7a-8e29-4a09-a2eb-160f7ac9271b req-07bd3d17-b2fe-4e0d-92a6-385f2e0659a8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:06.756077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-aeba1b7a-8e29-4a09-a2eb-160f7ac9271b req-07bd3d17-b2fe-4e0d-92a6-385f2e0659a8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:06.758868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e8c3b605-ea2f-4bee-a1a1-cd6664259c0a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:06.761112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e8c3b605-ea2f-4bee-a1a1-cd6664259c0a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:06.764072 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e8c3b605-ea2f-4bee-a1a1-cd6664259c0a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.308653 May 28 21:06:06.764774 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 459/981] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:06 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:06.770053 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-aeba1b7a-8e29-4a09-a2eb-160f7ac9271b req-07bd3d17-b2fe-4e0d-92a6-385f2e0659a8 service nova] Creating event network-vif-unplugged:4a538780-a868-4e2b-a232-0afe1eda360e for instance 502fcad4-754e-4627-96fa-80843f774f47 on nch2-master-1 May 28 21:06:06.770378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8bbc11c0-2c91-42cb-977f-46020b420856 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:06.771164 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8bbc11c0-2c91-42cb-977f-46020b420856 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:06.775397 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-aeba1b7a-8e29-4a09-a2eb-160f7ac9271b req-07bd3d17-b2fe-4e0d-92a6-385f2e0659a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034262 May 28 21:06:06.777003 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 523/982] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:06.783736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bbc11c0-2c91-42cb-977f-46020b420856 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:06.783736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bbc11c0-2c91-42cb-977f-46020b420856 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:06.783736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bbc11c0-2c91-42cb-977f-46020b420856 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:06.784321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bbc11c0-2c91-42cb-977f-46020b420856 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:06.787428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4e9beeaf-63d2-4327-9e14-f0b8f21bf693 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:06.788503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4e9beeaf-63d2-4327-9e14-f0b8f21bf693 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:06.802256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e9beeaf-63d2-4327-9e14-f0b8f21bf693 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:06.802714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e9beeaf-63d2-4327-9e14-f0b8f21bf693 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:06.803681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e9beeaf-63d2-4327-9e14-f0b8f21bf693 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:06.804505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e9beeaf-63d2-4327-9e14-f0b8f21bf693 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:06.912637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8bbc11c0-2c91-42cb-977f-46020b420856 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:06.926203 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8bbc11c0-2c91-42cb-977f-46020b420856 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1269 microversion: 2.1 time: 0.160168 May 28 21:06:06.927830 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 460/983] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:06 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:06.933669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4de9d55d-dd8e-4200-b4bb-0302d67e5b21 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '.version_select at 0x7f4d6424ea60>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:07.086084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4e9beeaf-63d2-4327-9e14-f0b8f21bf693 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:07.093947 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4e9beeaf-63d2-4327-9e14-f0b8f21bf693 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1557 microversion: 2.1 time: 0.315361 May 28 21:06:07.095091 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 524/984] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:06 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1557 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:07.099858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d1d5be70-a686-4c7e-9404-3a4e8e68b5b8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:07.100688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d1d5be70-a686-4c7e-9404-3a4e8e68b5b8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:07.108482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d1d5be70-a686-4c7e-9404-3a4e8e68b5b8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:07.109172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d1d5be70-a686-4c7e-9404-3a4e8e68b5b8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:07.109971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d1d5be70-a686-4c7e-9404-3a4e8e68b5b8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:07.110591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d1d5be70-a686-4c7e-9404-3a4e8e68b5b8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:07.284536 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4de9d55d-dd8e-4200-b4bb-0302d67e5b21 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "DELETE /compute/v2.1/images/b0bf15b9-c392-4a8e-b7d4-2543b8d01e52" status: 204 len: 0 microversion: 2.1 time: 0.354743 May 28 21:06:07.287809 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 461/985] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:06 2022] DELETE /compute/v2.1/images/b0bf15b9-c392-4a8e-b7d4-2543b8d01e52 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:06:07.303670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0cedee24-92c3-4213-a4ed-b3c609e8bded tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:07.305105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0cedee24-92c3-4213-a4ed-b3c609e8bded tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:07.315370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cedee24-92c3-4213-a4ed-b3c609e8bded tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:07.316765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cedee24-92c3-4213-a4ed-b3c609e8bded tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:07.319030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cedee24-92c3-4213-a4ed-b3c609e8bded tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:07.319660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cedee24-92c3-4213-a4ed-b3c609e8bded tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:07.341665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d1d5be70-a686-4c7e-9404-3a4e8e68b5b8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:07.351743 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d1d5be70-a686-4c7e-9404-3a4e8e68b5b8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1379 microversion: 2.1 time: 0.255405 May 28 21:06:07.354569 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 525/986] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:07 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1379 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:07.368005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-53ff0286-92ea-4bed-8247-bf4a110523d6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:07.368904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-53ff0286-92ea-4bed-8247-bf4a110523d6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:07.377542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53ff0286-92ea-4bed-8247-bf4a110523d6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:07.382261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53ff0286-92ea-4bed-8247-bf4a110523d6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:07.384053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53ff0286-92ea-4bed-8247-bf4a110523d6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:07.384708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53ff0286-92ea-4bed-8247-bf4a110523d6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:07.567825 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0cedee24-92c3-4213-a4ed-b3c609e8bded tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.227036 May 28 21:06:07.567825 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 462/987] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:06:07 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35/os-interface => generated 285 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:07.567825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fd13b3c9-f356-44f6-a9a4-b67c5c3577bf tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:07.567825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fd13b3c9-f356-44f6-a9a4-b67c5c3577bf tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:07.567825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd13b3c9-f356-44f6-a9a4-b67c5c3577bf tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:07.568446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd13b3c9-f356-44f6-a9a4-b67c5c3577bf tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:07.568446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd13b3c9-f356-44f6-a9a4-b67c5c3577bf tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:07.568446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd13b3c9-f356-44f6-a9a4-b67c5c3577bf tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:07.695848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-53ff0286-92ea-4bed-8247-bf4a110523d6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:07.709289 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-53ff0286-92ea-4bed-8247-bf4a110523d6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1535 microversion: 2.1 time: 0.352830 May 28 21:06:07.718254 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 526/988] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:07 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1535 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:07.725577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e83748bf-4e36-404a-9997-82ba916287ee tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:07.729742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e83748bf-4e36-404a-9997-82ba916287ee tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:07.744226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e83748bf-4e36-404a-9997-82ba916287ee tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:07.744688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e83748bf-4e36-404a-9997-82ba916287ee tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:07.745579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e83748bf-4e36-404a-9997-82ba916287ee tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:07.746060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e83748bf-4e36-404a-9997-82ba916287ee tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:08.032148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fd13b3c9-f356-44f6-a9a4-b67c5c3577bf tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:08.041170 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fd13b3c9-f356-44f6-a9a4-b67c5c3577bf tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1311 microversion: 2.1 time: 0.515496 May 28 21:06:08.051827 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 463/989] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:07 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1311 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:08.063280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-412b2fbd-eff3-44a4-9835-4e8c5aeb2383 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:08.072109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-412b2fbd-eff3-44a4-9835-4e8c5aeb2383 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:08.080493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-412b2fbd-eff3-44a4-9835-4e8c5aeb2383 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:08.081333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-412b2fbd-eff3-44a4-9835-4e8c5aeb2383 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:08.082927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-412b2fbd-eff3-44a4-9835-4e8c5aeb2383 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:08.083601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-412b2fbd-eff3-44a4-9835-4e8c5aeb2383 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:08.245632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e83748bf-4e36-404a-9997-82ba916287ee tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:08.249703 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e83748bf-4e36-404a-9997-82ba916287ee tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.533852 May 28 21:06:08.260125 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 527/990] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:07 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:08.264702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-88de0d57-3c62-4e75-b624-93b8da498fb7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:08.265549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-88de0d57-3c62-4e75-b624-93b8da498fb7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:08.272881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88de0d57-3c62-4e75-b624-93b8da498fb7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:08.274422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88de0d57-3c62-4e75-b624-93b8da498fb7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:08.274422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88de0d57-3c62-4e75-b624-93b8da498fb7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:08.274626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88de0d57-3c62-4e75-b624-93b8da498fb7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:08.325776 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-412b2fbd-eff3-44a4-9835-4e8c5aeb2383 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:08.335862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-412b2fbd-eff3-44a4-9835-4e8c5aeb2383 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:08.337401 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-412b2fbd-eff3-44a4-9835-4e8c5aeb2383 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:08.338637 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-412b2fbd-eff3-44a4-9835-4e8c5aeb2383 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.285351 May 28 21:06:08.339216 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 464/991] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:08 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:08.372605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0227a97a-61af-4c40-b919-0ed311df87d2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:08.373344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0227a97a-61af-4c40-b919-0ed311df87d2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:08.380945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0227a97a-61af-4c40-b919-0ed311df87d2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:08.381899 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0227a97a-61af-4c40-b919-0ed311df87d2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:08.382961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0227a97a-61af-4c40-b919-0ed311df87d2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:08.383536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0227a97a-61af-4c40-b919-0ed311df87d2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:08.388290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-88de0d57-3c62-4e75-b624-93b8da498fb7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:08.400465 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-88de0d57-3c62-4e75-b624-93b8da498fb7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1275 microversion: 2.1 time: 0.139347 May 28 21:06:08.408850 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 528/992] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:08 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1275 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:08.606320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0227a97a-61af-4c40-b919-0ed311df87d2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:08.619467 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0227a97a-61af-4c40-b919-0ed311df87d2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1528 microversion: 2.1 time: 0.251387 May 28 21:06:08.620581 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 465/993] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:08 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1528 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:08.643153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cd0e776c-409e-4ee4-bff8-70a7e3c95ed3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:08.643153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cd0e776c-409e-4ee4-bff8-70a7e3c95ed3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:08.649262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd0e776c-409e-4ee4-bff8-70a7e3c95ed3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:08.649720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd0e776c-409e-4ee4-bff8-70a7e3c95ed3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:08.650533 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd0e776c-409e-4ee4-bff8-70a7e3c95ed3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:08.650983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd0e776c-409e-4ee4-bff8-70a7e3c95ed3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:08.733330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2e569361-824f-40fd-9ab5-f0cb37bd1a38 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:08.734457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2e569361-824f-40fd-9ab5-f0cb37bd1a38 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:08.742454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e569361-824f-40fd-9ab5-f0cb37bd1a38 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:08.744035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e569361-824f-40fd-9ab5-f0cb37bd1a38 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:08.745373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e569361-824f-40fd-9ab5-f0cb37bd1a38 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:08.746125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e569361-824f-40fd-9ab5-f0cb37bd1a38 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:08.913774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cd0e776c-409e-4ee4-bff8-70a7e3c95ed3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:08.936077 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cd0e776c-409e-4ee4-bff8-70a7e3c95ed3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1528 microversion: 2.1 time: 0.301371 May 28 21:06:08.936684 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 529/994] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:08 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1528 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:08.946953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-daf9ca6d-557d-433f-a4d1-fcc248b7b950 req-92160f73-820c-4bdc-b4a8-e1ccad0d3eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "502fcad4-754e-4627-96fa-80843f774f47", "tag": "4a538780-a868-4e2b-a232-0afe1eda360e"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:08.963313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-daf9ca6d-557d-433f-a4d1-fcc248b7b950 req-92160f73-820c-4bdc-b4a8-e1ccad0d3eae service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:08.969438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-daf9ca6d-557d-433f-a4d1-fcc248b7b950 req-92160f73-820c-4bdc-b4a8-e1ccad0d3eae service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:08.976706 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-daf9ca6d-557d-433f-a4d1-fcc248b7b950 req-92160f73-820c-4bdc-b4a8-e1ccad0d3eae service nova] Creating event network-changed:4a538780-a868-4e2b-a232-0afe1eda360e for instance 502fcad4-754e-4627-96fa-80843f774f47 on nch2-master-1 May 28 21:06:08.982605 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-daf9ca6d-557d-433f-a4d1-fcc248b7b950 req-92160f73-820c-4bdc-b4a8-e1ccad0d3eae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038977 May 28 21:06:08.983214 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 530/995] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:08.989382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eb9ce971-6069-4d7f-b187-ccd688df9585 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:08.990469 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:08.990469 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:06:09.062272 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eb9ce971-6069-4d7f-b187-ccd688df9585 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/16150357-3f84-4cbe-8c22-7225331e95af" status: 202 len: 0 microversion: 2.1 time: 0.076556 May 28 21:06:09.063681 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 531/996] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:06:08 2022] DELETE /compute/v2.1/flavors/16150357-3f84-4cbe-8c22-7225331e95af => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:09.073703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-31617f48-d822-4c17-a009-7f756d457516 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:09.075262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-31617f48-d822-4c17-a009-7f756d457516 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:09.083326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31617f48-d822-4c17-a009-7f756d457516 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:09.084048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31617f48-d822-4c17-a009-7f756d457516 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:09.085207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31617f48-d822-4c17-a009-7f756d457516 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:09.085737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31617f48-d822-4c17-a009-7f756d457516 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:09.093150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2e569361-824f-40fd-9ab5-f0cb37bd1a38 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:09.105568 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2e569361-824f-40fd-9ab5-f0cb37bd1a38 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1541 microversion: 2.1 time: 0.380716 May 28 21:06:09.106396 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 466/997] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:08 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1541 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:09.110602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9c8d574f-0eb6-4556-abf0-6b066286ebf0 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:09.137684 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9c8d574f-0eb6-4556-abf0-6b066286ebf0 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030290 May 28 21:06:09.138280 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 467/998] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:09.152878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b31c3e50-6a06-450c-b707-a392114cf11a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:09.153858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b31c3e50-6a06-450c-b707-a392114cf11a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:09.167049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b31c3e50-6a06-450c-b707-a392114cf11a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:09.167504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b31c3e50-6a06-450c-b707-a392114cf11a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:09.168349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b31c3e50-6a06-450c-b707-a392114cf11a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:09.168824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b31c3e50-6a06-450c-b707-a392114cf11a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:09.282859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b31c3e50-6a06-450c-b707-a392114cf11a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:09.290266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b31c3e50-6a06-450c-b707-a392114cf11a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Old instance type tempest-test_resize_flavor_-1359734471, new instance type m1.heat {{(pid=143129) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 21:06:09.297958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-b31c3e50-6a06-450c-b707-a392114cf11a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:06:09.298409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-b31c3e50-6a06-450c-b707-a392114cf11a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:06:09.298926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-b31c3e50-6a06-450c-b707-a392114cf11a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:06:09.299774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-b31c3e50-6a06-450c-b707-a392114cf11a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:06:09.299774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-b31c3e50-6a06-450c-b707-a392114cf11a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:06:09.370643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-31617f48-d822-4c17-a009-7f756d457516 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:09.386136 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-31617f48-d822-4c17-a009-7f756d457516 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1311 microversion: 2.1 time: 0.318519 May 28 21:06:09.388634 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 532/999] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:09 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1311 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:09.397673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d4f4b0f3-3d5d-4214-8a9c-0a031ddce7ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:09.398489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d4f4b0f3-3d5d-4214-8a9c-0a031ddce7ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:09.405746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4f4b0f3-3d5d-4214-8a9c-0a031ddce7ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:09.406767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4f4b0f3-3d5d-4214-8a9c-0a031ddce7ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:09.412530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4f4b0f3-3d5d-4214-8a9c-0a031ddce7ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:09.412530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4f4b0f3-3d5d-4214-8a9c-0a031ddce7ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:09.425159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:09.552639 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d4f4b0f3-3d5d-4214-8a9c-0a031ddce7ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:09.560409 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d4f4b0f3-3d5d-4214-8a9c-0a031ddce7ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.168603 May 28 21:06:09.561650 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 533/1000] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:09 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:09.566658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c7bdf1d0-6978-46ec-b3b7-6e1d0a5ab8aa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:09.567567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c7bdf1d0-6978-46ec-b3b7-6e1d0a5ab8aa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:09.576220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7bdf1d0-6978-46ec-b3b7-6e1d0a5ab8aa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:09.577412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7bdf1d0-6978-46ec-b3b7-6e1d0a5ab8aa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:09.578886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7bdf1d0-6978-46ec-b3b7-6e1d0a5ab8aa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:09.579745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7bdf1d0-6978-46ec-b3b7-6e1d0a5ab8aa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:09.655001 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b31c3e50-6a06-450c-b707-a392114cf11a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "POST /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a/action" status: 202 len: 0 microversion: 2.1 time: 0.506048 May 28 21:06:09.661220 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 468/1001] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:06:09 2022] POST /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:06:09.669136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-50235e68-8b97-4049-a1a5-6b82998a30a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:09.670127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-50235e68-8b97-4049-a1a5-6b82998a30a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:09.683820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50235e68-8b97-4049-a1a5-6b82998a30a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:09.685987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50235e68-8b97-4049-a1a5-6b82998a30a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:09.686864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50235e68-8b97-4049-a1a5-6b82998a30a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:09.687326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50235e68-8b97-4049-a1a5-6b82998a30a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:10.002405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-50235e68-8b97-4049-a1a5-6b82998a30a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:10.012936 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-50235e68-8b97-4049-a1a5-6b82998a30a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1275 microversion: 2.1 time: 0.349999 May 28 21:06:10.014664 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 469/1002] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:09 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1275 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:10.038065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7d2ae023-9554-45fb-ae0a-a807837439a6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:10.038065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7d2ae023-9554-45fb-ae0a-a807837439a6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:10.048897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d2ae023-9554-45fb-ae0a-a807837439a6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:10.049348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d2ae023-9554-45fb-ae0a-a807837439a6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:10.050431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d2ae023-9554-45fb-ae0a-a807837439a6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:10.051068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d2ae023-9554-45fb-ae0a-a807837439a6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:10.232168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c7bdf1d0-6978-46ec-b3b7-6e1d0a5ab8aa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:10.255279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c7bdf1d0-6978-46ec-b3b7-6e1d0a5ab8aa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:10.256940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c7bdf1d0-6978-46ec-b3b7-6e1d0a5ab8aa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:10.264795 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c7bdf1d0-6978-46ec-b3b7-6e1d0a5ab8aa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.701825 May 28 21:06:10.265425 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 534/1003] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:09 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:10.282025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-256152b7-3df9-4c9d-9cf2-a6a58b9c27e8 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:10.282025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-256152b7-3df9-4c9d-9cf2-a6a58b9c27e8 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:10.287925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-256152b7-3df9-4c9d-9cf2-a6a58b9c27e8 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:10.288690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-256152b7-3df9-4c9d-9cf2-a6a58b9c27e8 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:10.289656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-256152b7-3df9-4c9d-9cf2-a6a58b9c27e8 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:10.290309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-256152b7-3df9-4c9d-9cf2-a6a58b9c27e8 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:10.621011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7d2ae023-9554-45fb-ae0a-a807837439a6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:10.624002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:10.662188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-256152b7-3df9-4c9d-9cf2-a6a58b9c27e8 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:10.674627 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7d2ae023-9554-45fb-ae0a-a807837439a6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1537 microversion: 2.1 time: 0.633542 May 28 21:06:10.676057 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-256152b7-3df9-4c9d-9cf2-a6a58b9c27e8 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1541 microversion: 2.1 time: 0.404092 May 28 21:06:10.689339 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 535/1005] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:10 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1541 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:10.689462 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 470/1005] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:10 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1537 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:10.693513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d2f245c5-a386-497d-ac2c-f006b2d265eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:10.694173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d2f245c5-a386-497d-ac2c-f006b2d265eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:10.706954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:10.709791 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d2f245c5-a386-497d-ac2c-f006b2d265eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:10.711327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d2f245c5-a386-497d-ac2c-f006b2d265eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:10.712828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d2f245c5-a386-497d-ac2c-f006b2d265eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:10.717057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ddb3114b-1d9f-4467-9960-16e606ac7514 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:10.720185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d2f245c5-a386-497d-ac2c-f006b2d265eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:10.720553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ddb3114b-1d9f-4467-9960-16e606ac7514 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:10.764949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddb3114b-1d9f-4467-9960-16e606ac7514 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:10.770642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddb3114b-1d9f-4467-9960-16e606ac7514 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:10.780614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddb3114b-1d9f-4467-9960-16e606ac7514 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:10.780614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddb3114b-1d9f-4467-9960-16e606ac7514 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:11.176584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d2f245c5-a386-497d-ac2c-f006b2d265eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:11.193465 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d2f245c5-a386-497d-ac2c-f006b2d265eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1311 microversion: 2.1 time: 0.506666 May 28 21:06:11.196419 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 536/1006] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:10 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1311 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:11.215996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4df86e82-d7cd-4a74-9463-0a2453b59805 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:11.217129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4df86e82-d7cd-4a74-9463-0a2453b59805 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:11.232178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4df86e82-d7cd-4a74-9463-0a2453b59805 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:11.234791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ddb3114b-1d9f-4467-9960-16e606ac7514 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:11.239638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4df86e82-d7cd-4a74-9463-0a2453b59805 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:11.240853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4df86e82-d7cd-4a74-9463-0a2453b59805 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:11.244154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4df86e82-d7cd-4a74-9463-0a2453b59805 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:11.260774 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ddb3114b-1d9f-4467-9960-16e606ac7514 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.570378 May 28 21:06:11.262351 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 471/1007] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:10 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:11.272026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-e45bb681-beca-4f83-99d8-8c1d22b447a9 req-92931093-058e-4ccb-a981-605afa55e68b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8268d1-36f2-4747-aa81-f6181ea36c35", "tag": "5edb3137-f693-41e6-8acc-86951c804f80"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:11.307291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e45bb681-beca-4f83-99d8-8c1d22b447a9 req-92931093-058e-4ccb-a981-605afa55e68b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:11.309075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e45bb681-beca-4f83-99d8-8c1d22b447a9 req-92931093-058e-4ccb-a981-605afa55e68b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:11.370250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:11.370250 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e45bb681-beca-4f83-99d8-8c1d22b447a9 req-92931093-058e-4ccb-a981-605afa55e68b service nova] Creating event network-changed:5edb3137-f693-41e6-8acc-86951c804f80 for instance df8268d1-36f2-4747-aa81-f6181ea36c35 on nch1-master-1 May 28 21:06:11.383890 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-e45bb681-beca-4f83-99d8-8c1d22b447a9 req-92931093-058e-4ccb-a981-605afa55e68b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120187 May 28 21:06:11.388179 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 472/1008] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:11.408477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bae46cdc-688c-43fe-a373-1500a014fd2b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:11.409886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bae46cdc-688c-43fe-a373-1500a014fd2b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:11.432394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bae46cdc-688c-43fe-a373-1500a014fd2b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:11.433831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bae46cdc-688c-43fe-a373-1500a014fd2b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:11.434714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bae46cdc-688c-43fe-a373-1500a014fd2b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:11.435162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bae46cdc-688c-43fe-a373-1500a014fd2b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:11.712338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bae46cdc-688c-43fe-a373-1500a014fd2b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:11.722645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bae46cdc-688c-43fe-a373-1500a014fd2b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:11.724407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bae46cdc-688c-43fe-a373-1500a014fd2b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:11.725770 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bae46cdc-688c-43fe-a373-1500a014fd2b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.336411 May 28 21:06:11.736094 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 473/1009] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:11 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:11.740262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-548d9f9e-1766-4664-b0ab-b69a369a6ca1 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:11.742861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-548d9f9e-1766-4664-b0ab-b69a369a6ca1 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:11.752090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4df86e82-d7cd-4a74-9463-0a2453b59805 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:11.754693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-548d9f9e-1766-4664-b0ab-b69a369a6ca1 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:11.755695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-548d9f9e-1766-4664-b0ab-b69a369a6ca1 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:11.756988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-548d9f9e-1766-4664-b0ab-b69a369a6ca1 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:11.759846 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-548d9f9e-1766-4664-b0ab-b69a369a6ca1 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:11.765943 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4df86e82-d7cd-4a74-9463-0a2453b59805 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1317 microversion: 2.1 time: 0.566265 May 28 21:06:11.781188 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 537/1010] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:11 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:11.788150 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-058f7a1b-6ddd-4e18-bc2f-8b84dca18964 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:11.790610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-058f7a1b-6ddd-4e18-bc2f-8b84dca18964 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:11.809718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-058f7a1b-6ddd-4e18-bc2f-8b84dca18964 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:11.811425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-058f7a1b-6ddd-4e18-bc2f-8b84dca18964 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:11.813727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-058f7a1b-6ddd-4e18-bc2f-8b84dca18964 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:11.814761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-058f7a1b-6ddd-4e18-bc2f-8b84dca18964 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:12.212372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-548d9f9e-1766-4664-b0ab-b69a369a6ca1 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:12.228696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-058f7a1b-6ddd-4e18-bc2f-8b84dca18964 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:12.243965 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-548d9f9e-1766-4664-b0ab-b69a369a6ca1 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1523 microversion: 2.1 time: 0.512109 May 28 21:06:12.244571 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 474/1011] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:11 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1523 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:12.246185 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-058f7a1b-6ddd-4e18-bc2f-8b84dca18964 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1537 microversion: 2.1 time: 0.465957 May 28 21:06:12.247468 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 538/1012] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:11 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1537 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:12.252648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7dd58db4-333f-4958-a53c-56d06c370a0a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:12.255797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7dd58db4-333f-4958-a53c-56d06c370a0a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:12.269088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-21c803a5-ed28-4b11-b210-be1c2dd6453e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:12.270093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-21c803a5-ed28-4b11-b210-be1c2dd6453e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:12.270580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7dd58db4-333f-4958-a53c-56d06c370a0a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:12.271122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7dd58db4-333f-4958-a53c-56d06c370a0a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:12.271911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7dd58db4-333f-4958-a53c-56d06c370a0a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:12.273060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7dd58db4-333f-4958-a53c-56d06c370a0a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:12.285732 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21c803a5-ed28-4b11-b210-be1c2dd6453e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:12.287256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21c803a5-ed28-4b11-b210-be1c2dd6453e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:12.288331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21c803a5-ed28-4b11-b210-be1c2dd6453e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:12.289113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21c803a5-ed28-4b11-b210-be1c2dd6453e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:12.367951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-21c803a5-ed28-4b11-b210-be1c2dd6453e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:06:12.468173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=8 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:12.482152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:12.606687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7dd58db4-333f-4958-a53c-56d06c370a0a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:12.614895 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7dd58db4-333f-4958-a53c-56d06c370a0a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1311 microversion: 2.1 time: 0.369182 May 28 21:06:12.625454 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 475/1013] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:12 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1311 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:12.625454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-71748ff2-0194-4219-83d6-5311d38d644c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:12.625454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-71748ff2-0194-4219-83d6-5311d38d644c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:12.636451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71748ff2-0194-4219-83d6-5311d38d644c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:12.637180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71748ff2-0194-4219-83d6-5311d38d644c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:12.638454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71748ff2-0194-4219-83d6-5311d38d644c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:12.639096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71748ff2-0194-4219-83d6-5311d38d644c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:12.695426 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-21c803a5-ed28-4b11-b210-be1c2dd6453e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "DELETE /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 204 len: 0 microversion: 2.1 time: 0.430795 May 28 21:06:12.696445 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 539/1014] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:06:12 2022] DELETE /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:06:12.706984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0b099244-1339-4961-91bb-39ea1325eede tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:12.709028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0b099244-1339-4961-91bb-39ea1325eede tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:12.718570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b099244-1339-4961-91bb-39ea1325eede tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:12.720745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b099244-1339-4961-91bb-39ea1325eede tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:12.722665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b099244-1339-4961-91bb-39ea1325eede tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:12.723393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b099244-1339-4961-91bb-39ea1325eede tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:13.029581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:13.079301 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-71748ff2-0194-4219-83d6-5311d38d644c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:13.080962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0b099244-1339-4961-91bb-39ea1325eede tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:13.095385 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-71748ff2-0194-4219-83d6-5311d38d644c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.474494 May 28 21:06:13.096937 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 476/1015] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:12 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:13.107751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5fa1dd5d-f8d1-46fe-8406-73b171426c2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:13.108588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5fa1dd5d-f8d1-46fe-8406-73b171426c2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:13.111465 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0b099244-1339-4961-91bb-39ea1325eede tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1529 microversion: 2.1 time: 0.409943 May 28 21:06:13.123310 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 540/1016] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:12 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1529 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:13.127538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5fa1dd5d-f8d1-46fe-8406-73b171426c2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:13.134107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5fa1dd5d-f8d1-46fe-8406-73b171426c2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:13.134107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5fa1dd5d-f8d1-46fe-8406-73b171426c2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:13.134107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5fa1dd5d-f8d1-46fe-8406-73b171426c2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:13.134984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ecce755c-8cd0-4cc6-9a7a-d9dd2c4c2371 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:13.135459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ecce755c-8cd0-4cc6-9a7a-d9dd2c4c2371 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:13.148156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecce755c-8cd0-4cc6-9a7a-d9dd2c4c2371 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:13.148615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecce755c-8cd0-4cc6-9a7a-d9dd2c4c2371 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:13.150447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecce755c-8cd0-4cc6-9a7a-d9dd2c4c2371 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:13.153963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecce755c-8cd0-4cc6-9a7a-d9dd2c4c2371 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:13.432994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ecce755c-8cd0-4cc6-9a7a-d9dd2c4c2371 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:13.444971 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ecce755c-8cd0-4cc6-9a7a-d9dd2c4c2371 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1317 microversion: 2.1 time: 0.317756 May 28 21:06:13.457158 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 541/1017] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:13 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:13.461268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5fa1dd5d-f8d1-46fe-8406-73b171426c2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:13.465433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fdcdc240-0a37-4c84-b094-8af2da12f1cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:13.466378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fdcdc240-0a37-4c84-b094-8af2da12f1cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:13.471734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5fa1dd5d-f8d1-46fe-8406-73b171426c2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:13.473241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5fa1dd5d-f8d1-46fe-8406-73b171426c2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:13.474466 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5fa1dd5d-f8d1-46fe-8406-73b171426c2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.373162 May 28 21:06:13.475037 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 477/1018] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:13 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:13.480191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdcdc240-0a37-4c84-b094-8af2da12f1cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:13.481015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdcdc240-0a37-4c84-b094-8af2da12f1cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:13.482004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdcdc240-0a37-4c84-b094-8af2da12f1cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:13.482621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdcdc240-0a37-4c84-b094-8af2da12f1cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:13.485293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-20bed8d6-1327-474b-a2f3-5920e49fbda2 req-c4f35741-5d41-46fd-85f8-fd2268540601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a102552-9f3f-417b-a587-72cf6ee45088", "tag": "e96b3cab-4dc1-4d01-a789-0983f750f285"}, {"name": "network-changed", "server_uuid": "9fd99f38-0c1f-4ec7-9ec6-03463939ec67", "tag": "22d3cc7c-e5d2-4836-b3d4-9cf47f95e009"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:13.505361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-20bed8d6-1327-474b-a2f3-5920e49fbda2 req-c4f35741-5d41-46fd-85f8-fd2268540601 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:13.506019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-20bed8d6-1327-474b-a2f3-5920e49fbda2 req-c4f35741-5d41-46fd-85f8-fd2268540601 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:13.526722 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-20bed8d6-1327-474b-a2f3-5920e49fbda2 req-c4f35741-5d41-46fd-85f8-fd2268540601 service nova] Creating event network-changed:e96b3cab-4dc1-4d01-a789-0983f750f285 for instance 6a102552-9f3f-417b-a587-72cf6ee45088 on nch1-master-1 May 28 21:06:13.533325 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-20bed8d6-1327-474b-a2f3-5920e49fbda2 req-c4f35741-5d41-46fd-85f8-fd2268540601 service nova] Creating event network-changed:22d3cc7c-e5d2-4836-b3d4-9cf47f95e009 for instance 9fd99f38-0c1f-4ec7-9ec6-03463939ec67 on nch1-master-1 May 28 21:06:13.534020 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-20bed8d6-1327-474b-a2f3-5920e49fbda2 req-c4f35741-5d41-46fd-85f8-fd2268540601 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053338 May 28 21:06:13.534746 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 478/1019] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:13.541047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-a7bd1664-a093-4a13-98c5-c1ba82648dab req-7d84c796-6e87-4c98-9a4b-ab6d2d4642f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f", "name": "network-vif-plugged", "status": "completed", "tag": "a39a803a-353e-40f7-a80b-ec88a266af5e"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:13.549571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a7bd1664-a093-4a13-98c5-c1ba82648dab req-7d84c796-6e87-4c98-9a4b-ab6d2d4642f8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:13.550590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a7bd1664-a093-4a13-98c5-c1ba82648dab req-7d84c796-6e87-4c98-9a4b-ab6d2d4642f8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:13.561702 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a7bd1664-a093-4a13-98c5-c1ba82648dab req-7d84c796-6e87-4c98-9a4b-ab6d2d4642f8 service nova] Creating event network-vif-plugged:a39a803a-353e-40f7-a80b-ec88a266af5e for instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f on nch2-master-1 May 28 21:06:13.567527 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-a7bd1664-a093-4a13-98c5-c1ba82648dab req-7d84c796-6e87-4c98-9a4b-ab6d2d4642f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031255 May 28 21:06:13.568268 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 479/1020] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:13.634747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-baaaf984-d4c2-4a9a-951c-45a40da5e036 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:13.635566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-baaaf984-d4c2-4a9a-951c-45a40da5e036 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:13.637921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fdcdc240-0a37-4c84-b094-8af2da12f1cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:13.643078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-baaaf984-d4c2-4a9a-951c-45a40da5e036 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:13.643674 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-baaaf984-d4c2-4a9a-951c-45a40da5e036 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:13.644666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-baaaf984-d4c2-4a9a-951c-45a40da5e036 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:13.645183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-baaaf984-d4c2-4a9a-951c-45a40da5e036 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:13.650019 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fdcdc240-0a37-4c84-b094-8af2da12f1cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1537 microversion: 2.1 time: 0.191947 May 28 21:06:13.660396 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 542/1021] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:13 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:13.941404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-baaaf984-d4c2-4a9a-951c-45a40da5e036 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:13.967637 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-baaaf984-d4c2-4a9a-951c-45a40da5e036 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1311 microversion: 2.1 time: 0.339010 May 28 21:06:13.974217 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 480/1022] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:13 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1311 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:14.114282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8146cc85-bd5e-40b4-bb07-053512316322 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:14.116327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8146cc85-bd5e-40b4-bb07-053512316322 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:14.129562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ae2876c2-f46e-4da5-a9bd-ac058f70b497 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:14.130212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8146cc85-bd5e-40b4-bb07-053512316322 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:14.130394 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8146cc85-bd5e-40b4-bb07-053512316322 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:14.131186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ae2876c2-f46e-4da5-a9bd-ac058f70b497 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:14.131346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8146cc85-bd5e-40b4-bb07-053512316322 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:14.131631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8146cc85-bd5e-40b4-bb07-053512316322 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:14.137962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae2876c2-f46e-4da5-a9bd-ac058f70b497 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:14.138691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae2876c2-f46e-4da5-a9bd-ac058f70b497 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:14.145950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae2876c2-f46e-4da5-a9bd-ac058f70b497 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:14.145950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae2876c2-f46e-4da5-a9bd-ac058f70b497 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:14.535472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ae2876c2-f46e-4da5-a9bd-ac058f70b497 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:14.542098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8146cc85-bd5e-40b4-bb07-053512316322 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:14.543625 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ae2876c2-f46e-4da5-a9bd-ac058f70b497 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1529 microversion: 2.1 time: 0.418556 May 28 21:06:14.544207 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 481/1023] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:14 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1529 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:14.549441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7a0a0e0d-ab81-4e3f-8026-29d194065591 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:14.550107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7a0a0e0d-ab81-4e3f-8026-29d194065591 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:14.550510 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8146cc85-bd5e-40b4-bb07-053512316322 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.440342 May 28 21:06:14.551450 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 543/1024] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:14 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:14.569116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-64642141-2d7f-46a6-9498-eb1209ff10b0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:14.571072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a0a0e0d-ab81-4e3f-8026-29d194065591 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:14.571807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-64642141-2d7f-46a6-9498-eb1209ff10b0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:14.573925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a0a0e0d-ab81-4e3f-8026-29d194065591 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:14.575136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a0a0e0d-ab81-4e3f-8026-29d194065591 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:14.576806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a0a0e0d-ab81-4e3f-8026-29d194065591 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:14.585430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64642141-2d7f-46a6-9498-eb1209ff10b0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:14.585906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64642141-2d7f-46a6-9498-eb1209ff10b0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:14.586696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64642141-2d7f-46a6-9498-eb1209ff10b0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:14.587140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64642141-2d7f-46a6-9498-eb1209ff10b0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:14.855439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-64642141-2d7f-46a6-9498-eb1209ff10b0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:14.860063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7a0a0e0d-ab81-4e3f-8026-29d194065591 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:14.871090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-64642141-2d7f-46a6-9498-eb1209ff10b0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:14.874710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-64642141-2d7f-46a6-9498-eb1209ff10b0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:14.879947 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-64642141-2d7f-46a6-9498-eb1209ff10b0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.323409 May 28 21:06:14.879947 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 544/1025] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:14 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:14.880748 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7a0a0e0d-ab81-4e3f-8026-29d194065591 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1317 microversion: 2.1 time: 0.333418 May 28 21:06:14.881347 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 482/1026] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:14 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:14.891829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-542ba7a7-2534-4666-9006-22501616c12f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:14.892628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-542ba7a7-2534-4666-9006-22501616c12f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:14.900164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-542ba7a7-2534-4666-9006-22501616c12f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:14.900769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-542ba7a7-2534-4666-9006-22501616c12f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:14.902504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-542ba7a7-2534-4666-9006-22501616c12f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:14.903043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-542ba7a7-2534-4666-9006-22501616c12f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:14.984740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f9867ed4-282c-47ef-a2c8-78433534c416 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:14.985694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f9867ed4-282c-47ef-a2c8-78433534c416 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:14.997117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9867ed4-282c-47ef-a2c8-78433534c416 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:14.998281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9867ed4-282c-47ef-a2c8-78433534c416 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:15.002585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9867ed4-282c-47ef-a2c8-78433534c416 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:15.003059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9867ed4-282c-47ef-a2c8-78433534c416 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:15.123148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-542ba7a7-2534-4666-9006-22501616c12f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:15.133297 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-542ba7a7-2534-4666-9006-22501616c12f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1537 microversion: 2.1 time: 0.254977 May 28 21:06:15.143066 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 545/1027] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:14 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1537 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:15.186624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f9867ed4-282c-47ef-a2c8-78433534c416 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:15.195358 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f9867ed4-282c-47ef-a2c8-78433534c416 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1311 microversion: 2.1 time: 0.214550 May 28 21:06:15.195946 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 483/1028] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:14 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1311 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:15.560804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7e61fa4f-8e53-4606-9ea1-f26da5696a73 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:15.567888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-604bbd48-f055-4af6-bf0d-66d6bf1c4992 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:15.568463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-604bbd48-f055-4af6-bf0d-66d6bf1c4992 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:15.572265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7e61fa4f-8e53-4606-9ea1-f26da5696a73 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:15.578421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-604bbd48-f055-4af6-bf0d-66d6bf1c4992 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:15.578881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-604bbd48-f055-4af6-bf0d-66d6bf1c4992 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:15.579671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-604bbd48-f055-4af6-bf0d-66d6bf1c4992 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:15.580126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-604bbd48-f055-4af6-bf0d-66d6bf1c4992 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:15.588476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e61fa4f-8e53-4606-9ea1-f26da5696a73 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:15.588936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e61fa4f-8e53-4606-9ea1-f26da5696a73 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:15.589727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e61fa4f-8e53-4606-9ea1-f26da5696a73 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:15.590204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e61fa4f-8e53-4606-9ea1-f26da5696a73 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:15.823485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-604bbd48-f055-4af6-bf0d-66d6bf1c4992 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:15.832511 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-604bbd48-f055-4af6-bf0d-66d6bf1c4992 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.268607 May 28 21:06:15.839221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7e61fa4f-8e53-4606-9ea1-f26da5696a73 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:15.843524 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 484/1029] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:15 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:15.848401 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7e61fa4f-8e53-4606-9ea1-f26da5696a73 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1529 microversion: 2.1 time: 0.291550 May 28 21:06:15.848983 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 546/1030] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:15 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1529 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:15.895825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9747b2bb-355d-4612-b805-37e95b3bd9f8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:15.896932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9747b2bb-355d-4612-b805-37e95b3bd9f8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:15.898417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a034bc3c-62d4-4053-a5b4-1644129dd3ff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:15.899071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a034bc3c-62d4-4053-a5b4-1644129dd3ff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:15.904195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9747b2bb-355d-4612-b805-37e95b3bd9f8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:15.905011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9747b2bb-355d-4612-b805-37e95b3bd9f8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:15.906242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9747b2bb-355d-4612-b805-37e95b3bd9f8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:15.906561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a034bc3c-62d4-4053-a5b4-1644129dd3ff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:15.907019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a034bc3c-62d4-4053-a5b4-1644129dd3ff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:15.907431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9747b2bb-355d-4612-b805-37e95b3bd9f8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:15.907802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a034bc3c-62d4-4053-a5b4-1644129dd3ff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:15.908243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a034bc3c-62d4-4053-a5b4-1644129dd3ff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:16.149651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9747b2bb-355d-4612-b805-37e95b3bd9f8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:16.150782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a034bc3c-62d4-4053-a5b4-1644129dd3ff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:16.165343 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a034bc3c-62d4-4053-a5b4-1644129dd3ff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1317 microversion: 2.1 time: 0.271612 May 28 21:06:16.165701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9747b2bb-355d-4612-b805-37e95b3bd9f8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:16.178313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9747b2bb-355d-4612-b805-37e95b3bd9f8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:16.178313 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9747b2bb-355d-4612-b805-37e95b3bd9f8 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.277909 May 28 21:06:16.178510 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 547/1031] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:15 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:16.178614 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 485/1032] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:15 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:16.178696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4a6459cb-6754-4d37-a38e-4a85c15d61a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:16.178696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4a6459cb-6754-4d37-a38e-4a85c15d61a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:16.184215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a6459cb-6754-4d37-a38e-4a85c15d61a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:16.184887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a6459cb-6754-4d37-a38e-4a85c15d61a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:16.185682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a6459cb-6754-4d37-a38e-4a85c15d61a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:16.186316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a6459cb-6754-4d37-a38e-4a85c15d61a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:16.202761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:16.214189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8eb3e11e-88e8-43a5-9e9c-8f0d5fa793eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:16.214974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8eb3e11e-88e8-43a5-9e9c-8f0d5fa793eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:16.222962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8eb3e11e-88e8-43a5-9e9c-8f0d5fa793eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:16.223179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8eb3e11e-88e8-43a5-9e9c-8f0d5fa793eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:16.224045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8eb3e11e-88e8-43a5-9e9c-8f0d5fa793eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:16.224601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8eb3e11e-88e8-43a5-9e9c-8f0d5fa793eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:16.410673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4a6459cb-6754-4d37-a38e-4a85c15d61a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:16.415133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8eb3e11e-88e8-43a5-9e9c-8f0d5fa793eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:16.419868 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4a6459cb-6754-4d37-a38e-4a85c15d61a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1537 microversion: 2.1 time: 0.248424 May 28 21:06:16.420355 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 548/1033] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:16 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1537 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:16.428685 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8eb3e11e-88e8-43a5-9e9c-8f0d5fa793eb tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1311 microversion: 2.1 time: 0.219479 May 28 21:06:16.429411 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 486/1034] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:16 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1311 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:16.658800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-1190d302-7135-44b9-972a-94085bd74ca3 req-2475c36f-da69-4f6b-899f-c24f19bfb4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f", "name": "network-vif-deleted", "tag": "a39a803a-353e-40f7-a80b-ec88a266af5e"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:16.668339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1190d302-7135-44b9-972a-94085bd74ca3 req-2475c36f-da69-4f6b-899f-c24f19bfb4f0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:16.668874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1190d302-7135-44b9-972a-94085bd74ca3 req-2475c36f-da69-4f6b-899f-c24f19bfb4f0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:16.680772 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-1190d302-7135-44b9-972a-94085bd74ca3 req-2475c36f-da69-4f6b-899f-c24f19bfb4f0 service nova] Creating event network-vif-deleted:a39a803a-353e-40f7-a80b-ec88a266af5e for instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f on nch2-master-1 May 28 21:06:16.687436 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-1190d302-7135-44b9-972a-94085bd74ca3 req-2475c36f-da69-4f6b-899f-c24f19bfb4f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032342 May 28 21:06:16.689323 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 549/1035] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:06:16.850773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-02d62d6c-cc66-4f8c-8f1b-c86d51de07a9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:16.851412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-02d62d6c-cc66-4f8c-8f1b-c86d51de07a9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:16.859019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02d62d6c-cc66-4f8c-8f1b-c86d51de07a9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:16.860190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02d62d6c-cc66-4f8c-8f1b-c86d51de07a9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:16.861196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02d62d6c-cc66-4f8c-8f1b-c86d51de07a9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:16.861996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02d62d6c-cc66-4f8c-8f1b-c86d51de07a9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:16.871293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-927ba7aa-7844-491b-a6a8-2970d738607d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:16.872407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-927ba7aa-7844-491b-a6a8-2970d738607d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:16.887992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-927ba7aa-7844-491b-a6a8-2970d738607d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:16.888549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-927ba7aa-7844-491b-a6a8-2970d738607d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:16.889438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-927ba7aa-7844-491b-a6a8-2970d738607d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:16.890191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-927ba7aa-7844-491b-a6a8-2970d738607d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:16.960256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-927ba7aa-7844-491b-a6a8-2970d738607d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:16.960916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-927ba7aa-7844-491b-a6a8-2970d738607d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:16.961454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-927ba7aa-7844-491b-a6a8-2970d738607d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lazy-loading 'fault' on Instance uuid baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:06:17.020522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-927ba7aa-7844-491b-a6a8-2970d738607d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:17.034761 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-927ba7aa-7844-491b-a6a8-2970d738607d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 200 len: 1315 microversion: 2.1 time: 0.172158 May 28 21:06:17.035776 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 550/1036] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:16 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:17.099713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-02d62d6c-cc66-4f8c-8f1b-c86d51de07a9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:17.107932 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-02d62d6c-cc66-4f8c-8f1b-c86d51de07a9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.261488 May 28 21:06:17.108523 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 487/1037] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:16 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:17.189362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6197e17b-cd09-4e0d-b0b4-5b32cab218de tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:17.192273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6197e17b-cd09-4e0d-b0b4-5b32cab218de tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:17.194579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ebba3c0e-4424-4c73-bf33-1c1c429bd01c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:17.195512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ebba3c0e-4424-4c73-bf33-1c1c429bd01c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:17.198940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6197e17b-cd09-4e0d-b0b4-5b32cab218de tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:17.199396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6197e17b-cd09-4e0d-b0b4-5b32cab218de tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:17.200342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6197e17b-cd09-4e0d-b0b4-5b32cab218de tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:17.201099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6197e17b-cd09-4e0d-b0b4-5b32cab218de tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:17.206166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ebba3c0e-4424-4c73-bf33-1c1c429bd01c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:17.206980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ebba3c0e-4424-4c73-bf33-1c1c429bd01c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:17.207945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ebba3c0e-4424-4c73-bf33-1c1c429bd01c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:17.208404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ebba3c0e-4424-4c73-bf33-1c1c429bd01c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:17.443860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6197e17b-cd09-4e0d-b0b4-5b32cab218de tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:17.452504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ebba3c0e-4424-4c73-bf33-1c1c429bd01c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:17.469521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ebba3c0e-4424-4c73-bf33-1c1c429bd01c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:17.470566 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6197e17b-cd09-4e0d-b0b4-5b32cab218de tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1317 microversion: 2.1 time: 0.289369 May 28 21:06:17.471277 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 551/1038] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:17 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:17.475000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ebba3c0e-4424-4c73-bf33-1c1c429bd01c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:17.478850 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ebba3c0e-4424-4c73-bf33-1c1c429bd01c tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.292417 May 28 21:06:17.486073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-69f77a36-b31f-4dfb-8bb1-d3a6e83879ca tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:17.486785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-69f77a36-b31f-4dfb-8bb1-d3a6e83879ca tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:17.490340 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 488/1039] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:17 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:17.494500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69f77a36-b31f-4dfb-8bb1-d3a6e83879ca tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:17.494963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69f77a36-b31f-4dfb-8bb1-d3a6e83879ca tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:17.495758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69f77a36-b31f-4dfb-8bb1-d3a6e83879ca tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:17.496159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-78993f39-51ae-46ba-b21e-e9175d5448bc tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:17.496274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69f77a36-b31f-4dfb-8bb1-d3a6e83879ca tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:17.496955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-78993f39-51ae-46ba-b21e-e9175d5448bc tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:17.511146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78993f39-51ae-46ba-b21e-e9175d5448bc tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:17.512305 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78993f39-51ae-46ba-b21e-e9175d5448bc tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:17.513405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78993f39-51ae-46ba-b21e-e9175d5448bc tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:17.514050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78993f39-51ae-46ba-b21e-e9175d5448bc tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:17.554713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:17.731976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-69f77a36-b31f-4dfb-8bb1-d3a6e83879ca tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:17.741108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-78993f39-51ae-46ba-b21e-e9175d5448bc tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:17.747375 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-69f77a36-b31f-4dfb-8bb1-d3a6e83879ca tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1537 microversion: 2.1 time: 0.274218 May 28 21:06:17.750034 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 552/1040] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:17 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1537 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:17.753627 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-78993f39-51ae-46ba-b21e-e9175d5448bc tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1311 microversion: 2.1 time: 0.261550 May 28 21:06:17.754099 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 489/1041] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:17 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1311 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:18.053351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e49f611c-7d42-4db6-936d-2cbd91411242 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:18.054324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e49f611c-7d42-4db6-936d-2cbd91411242 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:18.060768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e49f611c-7d42-4db6-936d-2cbd91411242 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:18.061466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e49f611c-7d42-4db6-936d-2cbd91411242 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:18.062444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e49f611c-7d42-4db6-936d-2cbd91411242 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:18.063051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e49f611c-7d42-4db6-936d-2cbd91411242 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:18.078890 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-e49f611c-7d42-4db6-936d-2cbd91411242 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] HTTP exception thrown: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e49f611c-7d42-4db6-936d-2cbd91411242 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Request method failure captured: May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f HTTP/1.1 May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko6oq10ya0vKA7Lzgzw7qEixBB6oq9XwAAqnALDB3LxJ0Ou3iq7_g4aSSk-6F4p6-_hIGxM22vsmPp1vD-bx8iQQTYyEkSHfzi2JWR2mENOMe6ss5h_-1Ay7OrAERWJEEuMTwxRxM1yb64UuFpXocdkERI-wAfMoU5j69oLSNr7C4nA May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:06:18.081812 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:06:18.083524 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab0c1d6a9fc44de4af61822849b3bf8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:18.083524 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:18.083524 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:06:18.083524 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:18.083524 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:06:18.083524 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:06:18.083524 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:06:18.083524 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: dc48535b672d4d1190ecfefe6cb02720 May 28 21:06:18.083524 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:06:18.083524 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:06:18.083524 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. May 28 21:06:18.083524 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f'} May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:18.084703 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. May 28 21:06:18.086569 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:18.087836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e49f611c-7d42-4db6-936d-2cbd91411242 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Returning 404 to user: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:18.087836 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e49f611c-7d42-4db6-936d-2cbd91411242 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 404 len: 111 microversion: 2.1 time: 0.034308 May 28 21:06:18.090142 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 553/1042] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:18 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:18.095508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-01da12e5-e201-4ce6-b571-c1e05a0a1d48 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Action: 'create', calling method: .version_select at 0x7f4d64061670>, body: {"keypair": {"name": "tempest-keypair-324017669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCPok2xDiEqK9AVMxqR1efHObarlkqgZKO71PlAPl+0vpyklVmirpRyTgWFVb1z5jN0fup/bct7QksCUevgPqW8vutlhyh0+F1FuLRG6m8ZCyrpc6dWJ1Kc+zM5wgAGSg=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:18.111300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-01da12e5-e201-4ce6-b571-c1e05a0a1d48 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Getting quotas for project ab0c1d6a9fc44de4af61822849b3bf8d. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:18.116799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-01da12e5-e201-4ce6-b571-c1e05a0a1d48 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Getting quotas for user dc48535b672d4d1190ecfefe6cb02720 and project ab0c1d6a9fc44de4af61822849b3bf8d. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:18.126303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f9f30d16-5274-467c-b011-bc96989b6588 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:18.126926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f9f30d16-5274-467c-b011-bc96989b6588 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:18.135165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9f30d16-5274-467c-b011-bc96989b6588 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:18.136277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9f30d16-5274-467c-b011-bc96989b6588 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:18.136906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:18.137083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9f30d16-5274-467c-b011-bc96989b6588 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:18.138188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9f30d16-5274-467c-b011-bc96989b6588 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:18.195375 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-01da12e5-e201-4ce6-b571-c1e05a0a1d48 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.103746 May 28 21:06:18.196391 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 490/1043] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:06:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:06:18.297020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f9f30d16-5274-467c-b011-bc96989b6588 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:18.305905 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f9f30d16-5274-467c-b011-bc96989b6588 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.183561 May 28 21:06:18.306486 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 554/1044] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:18 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:18.489669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3db9f193-7d4b-4911-8310-02a96262396b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:18.491412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3db9f193-7d4b-4911-8310-02a96262396b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:18.500176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-adcb67ae-341f-4f28-bd4a-0cc5e0601a54 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:18.500916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-adcb67ae-341f-4f28-bd4a-0cc5e0601a54 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:18.503850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3db9f193-7d4b-4911-8310-02a96262396b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:18.503850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3db9f193-7d4b-4911-8310-02a96262396b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:18.503850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3db9f193-7d4b-4911-8310-02a96262396b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:18.503850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3db9f193-7d4b-4911-8310-02a96262396b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:18.522220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-adcb67ae-341f-4f28-bd4a-0cc5e0601a54 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:18.522585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-adcb67ae-341f-4f28-bd4a-0cc5e0601a54 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:18.523572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-adcb67ae-341f-4f28-bd4a-0cc5e0601a54 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:18.524419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-adcb67ae-341f-4f28-bd4a-0cc5e0601a54 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:18.851611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3db9f193-7d4b-4911-8310-02a96262396b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:18.856286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-adcb67ae-341f-4f28-bd4a-0cc5e0601a54 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:18.861560 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3db9f193-7d4b-4911-8310-02a96262396b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1317 microversion: 2.1 time: 0.377091 May 28 21:06:18.864319 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 491/1045] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:18 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:18.869694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5110adbc-e4a8-4993-9987-34e09e8e17ad tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:18.871019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5110adbc-e4a8-4993-9987-34e09e8e17ad tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:18.875173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-adcb67ae-341f-4f28-bd4a-0cc5e0601a54 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:18.877357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-adcb67ae-341f-4f28-bd4a-0cc5e0601a54 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:18.879480 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-adcb67ae-341f-4f28-bd4a-0cc5e0601a54 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1645 microversion: 2.25 time: 0.386744 May 28 21:06:18.879639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5110adbc-e4a8-4993-9987-34e09e8e17ad tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:18.880229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5110adbc-e4a8-4993-9987-34e09e8e17ad tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:18.881096 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 555/1046] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:18 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1645 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:18.881497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5110adbc-e4a8-4993-9987-34e09e8e17ad tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:18.881990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5110adbc-e4a8-4993-9987-34e09e8e17ad tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:18.886501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-de77f879-3b99-4712-9559-4288c4a8a314 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:18.891362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-de77f879-3b99-4712-9559-4288c4a8a314 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:18.894316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de77f879-3b99-4712-9559-4288c4a8a314 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:18.895023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de77f879-3b99-4712-9559-4288c4a8a314 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:18.896091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de77f879-3b99-4712-9559-4288c4a8a314 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:18.896740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de77f879-3b99-4712-9559-4288c4a8a314 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:19.273750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-de77f879-3b99-4712-9559-4288c4a8a314 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:19.276921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5110adbc-e4a8-4993-9987-34e09e8e17ad tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:19.283646 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-de77f879-3b99-4712-9559-4288c4a8a314 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1311 microversion: 2.1 time: 0.400537 May 28 21:06:19.285146 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5110adbc-e4a8-4993-9987-34e09e8e17ad tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.419005 May 28 21:06:19.294243 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 556/1047] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:18 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1311 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:19.302016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-02c118c3-8c6d-475d-bc9d-67556475a297 req-1208b2eb-0478-4de0-bbbf-1272a2b65296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a102552-9f3f-417b-a587-72cf6ee45088", "name": "network-vif-plugged", "status": "completed", "tag": "e96b3cab-4dc1-4d01-a789-0983f750f285"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:19.302727 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 492/1048] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:18 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:19.313205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-02c118c3-8c6d-475d-bc9d-67556475a297 req-1208b2eb-0478-4de0-bbbf-1272a2b65296 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:19.314555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-02c118c3-8c6d-475d-bc9d-67556475a297 req-1208b2eb-0478-4de0-bbbf-1272a2b65296 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:19.328296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1bd3fcdc-3ca7-4124-a299-6c961811c646 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:19.329147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1bd3fcdc-3ca7-4124-a299-6c961811c646 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:19.338180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1bd3fcdc-3ca7-4124-a299-6c961811c646 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:19.339034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1bd3fcdc-3ca7-4124-a299-6c961811c646 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:19.339969 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-02c118c3-8c6d-475d-bc9d-67556475a297 req-1208b2eb-0478-4de0-bbbf-1272a2b65296 service nova] Creating event network-vif-plugged:e96b3cab-4dc1-4d01-a789-0983f750f285 for instance 6a102552-9f3f-417b-a587-72cf6ee45088 on nch1-master-1 May 28 21:06:19.340208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1bd3fcdc-3ca7-4124-a299-6c961811c646 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:19.340805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1bd3fcdc-3ca7-4124-a299-6c961811c646 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:19.346690 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-02c118c3-8c6d-475d-bc9d-67556475a297 req-1208b2eb-0478-4de0-bbbf-1272a2b65296 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058389 May 28 21:06:19.350015 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 557/1049] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:19.504086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1bd3fcdc-3ca7-4124-a299-6c961811c646 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:19.512200 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1bd3fcdc-3ca7-4124-a299-6c961811c646 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.188561 May 28 21:06:19.512779 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 493/1050] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:19 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:19.881142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9736cbb4-0abd-40c8-98e0-a7f3b5102070 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:19.881913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9736cbb4-0abd-40c8-98e0-a7f3b5102070 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:19.888284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9736cbb4-0abd-40c8-98e0-a7f3b5102070 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:19.888744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9736cbb4-0abd-40c8-98e0-a7f3b5102070 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:19.889514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9736cbb4-0abd-40c8-98e0-a7f3b5102070 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:19.890148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9736cbb4-0abd-40c8-98e0-a7f3b5102070 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:19.899213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bac34378-39c9-4987-bbda-eeeca806c218 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:19.900037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bac34378-39c9-4987-bbda-eeeca806c218 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:19.908625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bac34378-39c9-4987-bbda-eeeca806c218 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:19.909123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bac34378-39c9-4987-bbda-eeeca806c218 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:19.910868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bac34378-39c9-4987-bbda-eeeca806c218 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:19.911513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bac34378-39c9-4987-bbda-eeeca806c218 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:20.135488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9736cbb4-0abd-40c8-98e0-a7f3b5102070 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:20.145274 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9736cbb4-0abd-40c8-98e0-a7f3b5102070 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1317 microversion: 2.1 time: 0.268375 May 28 21:06:20.146539 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 558/1051] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:19 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:20.168408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bac34378-39c9-4987-bbda-eeeca806c218 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:20.177230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bac34378-39c9-4987-bbda-eeeca806c218 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:20.178870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bac34378-39c9-4987-bbda-eeeca806c218 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:20.180044 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bac34378-39c9-4987-bbda-eeeca806c218 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1635 microversion: 2.25 time: 0.285616 May 28 21:06:20.180613 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 494/1052] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:19 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1635 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:20.198577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4f7e5753-74f8-41cf-8c8d-38a35e603bb6 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '.version_select at 0x7f4d641b0790>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:20.202106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f7e5753-74f8-41cf-8c8d-38a35e603bb6 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:20.202569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f7e5753-74f8-41cf-8c8d-38a35e603bb6 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:20.215274 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4f7e5753-74f8-41cf-8c8d-38a35e603bb6 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 3626 microversion: 2.25 time: 0.020365 May 28 21:06:20.224720 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 559/1053] 10.222.0.33 () {60 vars in 1183 bytes} [Sat May 28 21:06:20 2022] GET /compute/v2.1/os-migrations => generated 3626 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:20.229590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0c9171de-92b5-4b37-9eac-5af05faa261b tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:20.232415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0c9171de-92b5-4b37-9eac-5af05faa261b tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:20.244260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c9171de-92b5-4b37-9eac-5af05faa261b tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:20.244721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c9171de-92b5-4b37-9eac-5af05faa261b tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:20.245504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c9171de-92b5-4b37-9eac-5af05faa261b tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:20.245975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c9171de-92b5-4b37-9eac-5af05faa261b tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:20.303765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dd54af9b-7c74-4dde-a5eb-b35dca1f8b9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:20.304902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dd54af9b-7c74-4dde-a5eb-b35dca1f8b9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:20.313478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd54af9b-7c74-4dde-a5eb-b35dca1f8b9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:20.315167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd54af9b-7c74-4dde-a5eb-b35dca1f8b9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:20.316274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd54af9b-7c74-4dde-a5eb-b35dca1f8b9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:20.317277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd54af9b-7c74-4dde-a5eb-b35dca1f8b9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:20.419097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-0c9171de-92b5-4b37-9eac-5af05faa261b tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'services' on Instance uuid 502fcad4-754e-4627-96fa-80843f774f47 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:06:20.437591 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0c9171de-92b5-4b37-9eac-5af05faa261b tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 2128 microversion: 2.25 time: 0.211823 May 28 21:06:20.438901 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 495/1054] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:20 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 2128 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:06:20.466772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-702d5307-2b5b-44a7-83d7-87760b1ea6a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:20.467538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-702d5307-2b5b-44a7-83d7-87760b1ea6a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:20.475940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-702d5307-2b5b-44a7-83d7-87760b1ea6a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:20.476685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-702d5307-2b5b-44a7-83d7-87760b1ea6a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:20.477717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-702d5307-2b5b-44a7-83d7-87760b1ea6a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:20.479395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-702d5307-2b5b-44a7-83d7-87760b1ea6a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:20.505032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dd54af9b-7c74-4dde-a5eb-b35dca1f8b9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:20.516284 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dd54af9b-7c74-4dde-a5eb-b35dca1f8b9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1311 microversion: 2.1 time: 0.217486 May 28 21:06:20.518894 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 560/1055] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:20 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1311 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:20.532311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-94f06c86-7087-4117-be65-1eab7944670a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:20.532966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-94f06c86-7087-4117-be65-1eab7944670a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:20.543805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94f06c86-7087-4117-be65-1eab7944670a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:20.544848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94f06c86-7087-4117-be65-1eab7944670a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:20.545757 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94f06c86-7087-4117-be65-1eab7944670a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:20.546350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94f06c86-7087-4117-be65-1eab7944670a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:20.711502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-702d5307-2b5b-44a7-83d7-87760b1ea6a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:20.722574 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-702d5307-2b5b-44a7-83d7-87760b1ea6a8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.282443 May 28 21:06:20.733802 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 496/1056] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:20 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:20.741173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7eaf737d-47a9-4460-b5c3-2f0417abc1e5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:20.742969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7eaf737d-47a9-4460-b5c3-2f0417abc1e5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:20.748400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-94f06c86-7087-4117-be65-1eab7944670a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'services' on Instance uuid 502fcad4-754e-4627-96fa-80843f774f47 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:06:20.751988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7eaf737d-47a9-4460-b5c3-2f0417abc1e5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:20.754715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7eaf737d-47a9-4460-b5c3-2f0417abc1e5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:20.762693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7eaf737d-47a9-4460-b5c3-2f0417abc1e5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:20.763559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7eaf737d-47a9-4460-b5c3-2f0417abc1e5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:20.763708 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-94f06c86-7087-4117-be65-1eab7944670a tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 2128 microversion: 2.25 time: 0.242925 May 28 21:06:20.764378 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 561/1057] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:06:20 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 2128 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:06:20.883384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3bf46771-7e11-4f56-9f44-aa08a136add0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:20.885893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3bf46771-7e11-4f56-9f44-aa08a136add0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:20.922260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3bf46771-7e11-4f56-9f44-aa08a136add0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:20.923991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3bf46771-7e11-4f56-9f44-aa08a136add0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:20.927080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3bf46771-7e11-4f56-9f44-aa08a136add0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:20.927664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3bf46771-7e11-4f56-9f44-aa08a136add0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:20.951118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7eaf737d-47a9-4460-b5c3-2f0417abc1e5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:20.960053 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7eaf737d-47a9-4460-b5c3-2f0417abc1e5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.224573 May 28 21:06:20.969485 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 497/1058] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:20 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:21.102906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-3bf46771-7e11-4f56-9f44-aa08a136add0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lazy-loading 'services' on Instance uuid 502fcad4-754e-4627-96fa-80843f774f47 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:06:21.164033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6636ba1c-2783-4e18-ad79-284ca7758007 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:21.164659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6636ba1c-2783-4e18-ad79-284ca7758007 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:21.171337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6636ba1c-2783-4e18-ad79-284ca7758007 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:21.171861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6636ba1c-2783-4e18-ad79-284ca7758007 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:21.172580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6636ba1c-2783-4e18-ad79-284ca7758007 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:21.173023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6636ba1c-2783-4e18-ad79-284ca7758007 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:21.346856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6636ba1c-2783-4e18-ad79-284ca7758007 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:21.356540 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6636ba1c-2783-4e18-ad79-284ca7758007 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1317 microversion: 2.1 time: 0.197021 May 28 21:06:21.358629 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 498/1059] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:21 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:21.375843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-81a24f5d-00ae-4ac7-a058-ff74e80c6fd7 req-afa7d38c-4cf1-440a-8794-6e0eada16d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd99f38-0c1f-4ec7-9ec6-03463939ec67", "name": "network-vif-plugged", "status": "completed", "tag": "22d3cc7c-e5d2-4836-b3d4-9cf47f95e009"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:21.386637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-81a24f5d-00ae-4ac7-a058-ff74e80c6fd7 req-afa7d38c-4cf1-440a-8794-6e0eada16d4c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:21.387655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-81a24f5d-00ae-4ac7-a058-ff74e80c6fd7 req-afa7d38c-4cf1-440a-8794-6e0eada16d4c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:21.398783 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-81a24f5d-00ae-4ac7-a058-ff74e80c6fd7 req-afa7d38c-4cf1-440a-8794-6e0eada16d4c service nova] Creating event network-vif-plugged:22d3cc7c-e5d2-4836-b3d4-9cf47f95e009 for instance 9fd99f38-0c1f-4ec7-9ec6-03463939ec67 on nch1-master-1 May 28 21:06:21.410233 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-81a24f5d-00ae-4ac7-a058-ff74e80c6fd7 req-afa7d38c-4cf1-440a-8794-6e0eada16d4c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033081 May 28 21:06:21.410233 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 499/1060] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:06:21.426800 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3bf46771-7e11-4f56-9f44-aa08a136add0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "DELETE /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47/os-volume_attachments/96682203-c2c9-4aeb-9901-07faacbd380d" status: 202 len: 0 microversion: 2.25 time: 0.544571 May 28 21:06:21.429571 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 562/1061] 10.222.0.33 () {60 vars in 1456 bytes} [Sat May 28 21:06:20 2022] DELETE /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47/os-volume_attachments/96682203-c2c9-4aeb-9901-07faacbd380d => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 21:06:21.444081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d94db32b-fbc2-4334-aacd-127559fcffd7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:21.445461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d94db32b-fbc2-4334-aacd-127559fcffd7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:21.453546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d94db32b-fbc2-4334-aacd-127559fcffd7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:21.454613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d94db32b-fbc2-4334-aacd-127559fcffd7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:21.457000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d94db32b-fbc2-4334-aacd-127559fcffd7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:21.457797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d94db32b-fbc2-4334-aacd-127559fcffd7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:21.500001 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d94db32b-fbc2-4334-aacd-127559fcffd7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.064284 May 28 21:06:21.505133 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 500/1062] 10.222.0.33 () {60 vars in 1342 bytes} [Sat May 28 21:06:21 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:06:21.537953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1d52b63e-c18f-4a32-88d1-cf897784cada tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:21.539183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1d52b63e-c18f-4a32-88d1-cf897784cada tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:21.550967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-585639948", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:21.551161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d52b63e-c18f-4a32-88d1-cf897784cada tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:21.551477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d52b63e-c18f-4a32-88d1-cf897784cada tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:21.552448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d52b63e-c18f-4a32-88d1-cf897784cada tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:21.553068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d52b63e-c18f-4a32-88d1-cf897784cada tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:21.618739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] validate_networks() for [('5bc429f4-a7fa-4b56-a7a6-1b807068de27', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:06:21.863568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1d52b63e-c18f-4a32-88d1-cf897784cada tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:21.866831 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1d52b63e-c18f-4a32-88d1-cf897784cada tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1493 microversion: 2.1 time: 0.336025 May 28 21:06:21.867733 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 563/1063] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:21 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1493 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:21.872538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f23a4f43-40cb-46b6-aae2-a06c1220285e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:21.873152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f23a4f43-40cb-46b6-aae2-a06c1220285e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:21.880319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f23a4f43-40cb-46b6-aae2-a06c1220285e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:21.880829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f23a4f43-40cb-46b6-aae2-a06c1220285e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:21.881629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f23a4f43-40cb-46b6-aae2-a06c1220285e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:21.882095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f23a4f43-40cb-46b6-aae2-a06c1220285e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:22.335823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f23a4f43-40cb-46b6-aae2-a06c1220285e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:22.349426 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f23a4f43-40cb-46b6-aae2-a06c1220285e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.480289 May 28 21:06:22.354774 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 564/1064] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:21 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:22.358754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c46bb948-1359-4a0d-a4c5-8da4ecfe47be tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:22.359375 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c46bb948-1359-4a0d-a4c5-8da4ecfe47be tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:22.366579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c46bb948-1359-4a0d-a4c5-8da4ecfe47be tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:22.368546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c46bb948-1359-4a0d-a4c5-8da4ecfe47be tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:22.369038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c46bb948-1359-4a0d-a4c5-8da4ecfe47be tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:22.369684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c46bb948-1359-4a0d-a4c5-8da4ecfe47be tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:22.452070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:06:22.452569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:06:22.452975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:06:22.453395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:06:22.453813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:06:22.466581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:22.466581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:22.466581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:22.466581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:22.483010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Getting quotas for project ab0c1d6a9fc44de4af61822849b3bf8d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:22.489069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Getting quotas for user dc48535b672d4d1190ecfefe6cb02720 and project ab0c1d6a9fc44de4af61822849b3bf8d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:22.502132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:06:22.506682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:06:22.518981 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c46bb948-1359-4a0d-a4c5-8da4ecfe47be tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1644 microversion: 2.1 time: 0.167788 May 28 21:06:22.519849 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 565/1065] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:22 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1644 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:22.527007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-47687196-d1cc-4a91-808a-f8ee3512def0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:22.531819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-47687196-d1cc-4a91-808a-f8ee3512def0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:22.534947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47687196-d1cc-4a91-808a-f8ee3512def0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:22.535402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47687196-d1cc-4a91-808a-f8ee3512def0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:22.536172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47687196-d1cc-4a91-808a-f8ee3512def0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:22.536740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47687196-d1cc-4a91-808a-f8ee3512def0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:22.553215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:22.644253 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-80eda6fc-cfc3-4fce-b917-a0eff311d1ab tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.099087 May 28 21:06:22.644912 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 501/1066] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1100 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:06:22.649684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7bd7372d-4cf5-4acd-a7d6-fb103845aab6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:22.650764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7bd7372d-4cf5-4acd-a7d6-fb103845aab6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:22.658259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bd7372d-4cf5-4acd-a7d6-fb103845aab6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:22.658758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bd7372d-4cf5-4acd-a7d6-fb103845aab6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:22.660057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bd7372d-4cf5-4acd-a7d6-fb103845aab6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:22.660508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bd7372d-4cf5-4acd-a7d6-fb103845aab6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:22.676320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-47687196-d1cc-4a91-808a-f8ee3512def0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:22.684716 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-47687196-d1cc-4a91-808a-f8ee3512def0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.162998 May 28 21:06:22.685298 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 566/1067] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:22 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:22.690415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-757a3a48-9e56-4157-8064-ccbe656192d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:22.691411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-757a3a48-9e56-4157-8064-ccbe656192d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:22.697368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-757a3a48-9e56-4157-8064-ccbe656192d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:22.698073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-757a3a48-9e56-4157-8064-ccbe656192d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:22.698846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-757a3a48-9e56-4157-8064-ccbe656192d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:22.699284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-757a3a48-9e56-4157-8064-ccbe656192d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:22.749486 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-757a3a48-9e56-4157-8064-ccbe656192d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.053622 May 28 21:06:22.749486 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 567/1068] 10.222.0.33 () {60 vars in 1342 bytes} [Sat May 28 21:06:22 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:06:22.751071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-52995f55-ba35-48d4-beec-63de611e9d6c tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:22.752490 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:22.752490 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:06:22.753778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52995f55-ba35-48d4-beec-63de611e9d6c tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:22.754263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52995f55-ba35-48d4-beec-63de611e9d6c tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:22.755112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52995f55-ba35-48d4-beec-63de611e9d6c tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:22.756155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52995f55-ba35-48d4-beec-63de611e9d6c tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:22.789139 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-52995f55-ba35-48d4-beec-63de611e9d6c tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046069 May 28 21:06:22.795592 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 568/1069] 10.222.0.33 () {58 vars in 1175 bytes} [Sat May 28 21:06:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:22.801359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-903fe571-8997-40b5-8114-d8a9e3403c38 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:22.802009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-903fe571-8997-40b5-8114-d8a9e3403c38 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:22.851637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7bd7372d-4cf5-4acd-a7d6-fb103845aab6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:22.862406 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7bd7372d-4cf5-4acd-a7d6-fb103845aab6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1317 microversion: 2.1 time: 0.216209 May 28 21:06:22.866391 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 502/1070] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:22 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:22.890048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-903fe571-8997-40b5-8114-d8a9e3403c38 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:22.897334 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-903fe571-8997-40b5-8114-d8a9e3403c38 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1224 microversion: 2.1 time: 0.100698 May 28 21:06:22.898482 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 569/1071] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:22 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:23.366656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d023e274-adfe-4851-a766-18a83d72edef tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:23.367279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d023e274-adfe-4851-a766-18a83d72edef tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:23.375164 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d023e274-adfe-4851-a766-18a83d72edef tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:23.375623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d023e274-adfe-4851-a766-18a83d72edef tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:23.376400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d023e274-adfe-4851-a766-18a83d72edef tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:23.376843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d023e274-adfe-4851-a766-18a83d72edef tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:23.538940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d023e274-adfe-4851-a766-18a83d72edef tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:23.546539 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d023e274-adfe-4851-a766-18a83d72edef tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.184003 May 28 21:06:23.549276 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 503/1072] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:23 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:23.709655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3fa3c2a4-4ae8-4716-aba1-e5af4c5431e9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:23.710362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3fa3c2a4-4ae8-4716-aba1-e5af4c5431e9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:23.722085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fa3c2a4-4ae8-4716-aba1-e5af4c5431e9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:23.728047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fa3c2a4-4ae8-4716-aba1-e5af4c5431e9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:23.728047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fa3c2a4-4ae8-4716-aba1-e5af4c5431e9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:23.728047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fa3c2a4-4ae8-4716-aba1-e5af4c5431e9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:23.758981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-109bbdab-c7b3-41b4-8e2d-a4cd024064af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:23.761070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-109bbdab-c7b3-41b4-8e2d-a4cd024064af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:23.774885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-109bbdab-c7b3-41b4-8e2d-a4cd024064af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:23.775376 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-109bbdab-c7b3-41b4-8e2d-a4cd024064af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:23.776562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-109bbdab-c7b3-41b4-8e2d-a4cd024064af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:23.776930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-109bbdab-c7b3-41b4-8e2d-a4cd024064af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:23.830594 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-109bbdab-c7b3-41b4-8e2d-a4cd024064af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.077855 May 28 21:06:23.831531 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 504/1073] 10.222.0.33 () {60 vars in 1342 bytes} [Sat May 28 21:06:23 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:23.881800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f19a2865-3a68-41b4-9e06-8a1542b88050 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:23.882689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f19a2865-3a68-41b4-9e06-8a1542b88050 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:23.891596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f19a2865-3a68-41b4-9e06-8a1542b88050 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:23.895610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f19a2865-3a68-41b4-9e06-8a1542b88050 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:23.896519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f19a2865-3a68-41b4-9e06-8a1542b88050 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:23.897082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f19a2865-3a68-41b4-9e06-8a1542b88050 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:23.919612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3fa3c2a4-4ae8-4716-aba1-e5af4c5431e9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:23.930702 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3fa3c2a4-4ae8-4716-aba1-e5af4c5431e9 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.232539 May 28 21:06:23.931312 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 570/1074] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:23 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:23.939312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e62ddde9-fd97-4dfd-966b-34d2af969e7e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:23.940110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e62ddde9-fd97-4dfd-966b-34d2af969e7e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:23.951801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e62ddde9-fd97-4dfd-966b-34d2af969e7e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:23.952695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e62ddde9-fd97-4dfd-966b-34d2af969e7e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:23.953747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e62ddde9-fd97-4dfd-966b-34d2af969e7e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:23.954467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e62ddde9-fd97-4dfd-966b-34d2af969e7e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:24.063746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e62ddde9-fd97-4dfd-966b-34d2af969e7e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:24.078151 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e62ddde9-fd97-4dfd-966b-34d2af969e7e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1228 microversion: 2.1 time: 0.145127 May 28 21:06:24.088078 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 571/1075] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:23 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1228 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:24.131886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f19a2865-3a68-41b4-9e06-8a1542b88050 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:24.148803 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f19a2865-3a68-41b4-9e06-8a1542b88050 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1467 microversion: 2.1 time: 0.265447 May 28 21:06:24.148803 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 505/1076] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:23 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1467 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:24.361251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6c0e121c-c137-4ba2-ad33-dc2b1669e8a4 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-606096923", "id": 1750014728, "os-flavor-access:is_public": "True"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:24.361251 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:24.361251 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:24.400398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9dadaef2-70ab-4b27-b1c9-c3ae602d68e9 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:24.401025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9dadaef2-70ab-4b27-b1c9-c3ae602d68e9 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:24.407222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9dadaef2-70ab-4b27-b1c9-c3ae602d68e9 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:24.407687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9dadaef2-70ab-4b27-b1c9-c3ae602d68e9 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:24.408463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9dadaef2-70ab-4b27-b1c9-c3ae602d68e9 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:24.408904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9dadaef2-70ab-4b27-b1c9-c3ae602d68e9 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:24.420414 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6c0e121c-c137-4ba2-ad33-dc2b1669e8a4 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.225196 May 28 21:06:24.421027 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 506/1077] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:24 2022] POST /compute/v2.1/flavors => generated 429 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:06:24.432387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1f6a41b8-a377-41f2-984b-08e378d37a12 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:24.433293 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:24.433293 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:24.506167 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1f6a41b8-a377-41f2-984b-08e378d37a12 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1750014728" status: 202 len: 0 microversion: 2.1 time: 0.077512 May 28 21:06:24.506763 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 507/1078] 10.222.0.33 () {58 vars in 1160 bytes} [Sat May 28 21:06:24 2022] DELETE /compute/v2.1/flavors/1750014728 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:06:24.514292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e52cf5df-ce69-48ee-8c38-bb8f864bc9dd tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:24.532499 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e52cf5df-ce69-48ee-8c38-bb8f864bc9dd tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021609 May 28 21:06:24.533072 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 508/1079] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:24 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:24.548700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-39806a6a-56a6-4478-aa25-b5bd3494de10 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1625856989", "id": 528084228, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:24.642965 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-39806a6a-56a6-4478-aa25-b5bd3494de10 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.097801 May 28 21:06:24.643565 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 509/1080] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:24 2022] POST /compute/v2.1/flavors => generated 414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:06:24.648729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9bc2daf9-c830-434d-814b-74be9d3701e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:24.649437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9bc2daf9-c830-434d-814b-74be9d3701e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:24.655393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bc2daf9-c830-434d-814b-74be9d3701e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:24.655849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bc2daf9-c830-434d-814b-74be9d3701e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:24.656646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bc2daf9-c830-434d-814b-74be9d3701e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:24.657106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bc2daf9-c830-434d-814b-74be9d3701e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:24.730390 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9dadaef2-70ab-4b27-b1c9-c3ae602d68e9 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1618 microversion: 2.1 time: 0.570639 May 28 21:06:24.730973 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 572/1081] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:24 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1618 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:24.753537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-71d73c40-3b8c-454c-bb5e-84cc035fb1e3 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:24.790670 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-71d73c40-3b8c-454c-bb5e-84cc035fb1e3 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.047589 May 28 21:06:24.798162 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 573/1082] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:24 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:24.813134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cb9b361b-336c-4b62-992d-6bfaa05f7da8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Action: 'create', calling method: .version_select at 0x7f4d640775e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1631770481", "policies": ["affinity"]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:24.836451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-cb9b361b-336c-4b62-992d-6bfaa05f7da8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'server_groups'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:24.842079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-cb9b361b-336c-4b62-992d-6bfaa05f7da8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'server_groups'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:24.854765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9bc2daf9-c830-434d-814b-74be9d3701e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:24.863926 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9bc2daf9-c830-434d-814b-74be9d3701e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.218753 May 28 21:06:24.864805 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 510/1083] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:24 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:24.868963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:24.870437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4416df41-d466-49ef-af79-cd3be18b273e tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:24.871775 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:24.871775 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:24.974432 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4416df41-d466-49ef-af79-cd3be18b273e tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/528084228" status: 202 len: 0 microversion: 2.1 time: 0.108314 May 28 21:06:24.975032 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 511/1084] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:06:24 2022] DELETE /compute/v2.1/flavors/528084228 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:24.980124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-483c2d28-c6ec-4281-bd03-4fcbe61900a2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b107b45a-f2d1-4795-8559-3836162f6660", "device": "/dev/xvdb"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:24.982227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-483c2d28-c6ec-4281-bd03-4fcbe61900a2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:24.987280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-483c2d28-c6ec-4281-bd03-4fcbe61900a2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:24.988077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-483c2d28-c6ec-4281-bd03-4fcbe61900a2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:24.988816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-483c2d28-c6ec-4281-bd03-4fcbe61900a2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:24.989262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-483c2d28-c6ec-4281-bd03-4fcbe61900a2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:24.996739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-cb9b361b-336c-4b62-992d-6bfaa05f7da8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'server_groups'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:25.007808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-cb9b361b-336c-4b62-992d-6bfaa05f7da8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'server_groups'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:25.034260 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cb9b361b-336c-4b62-992d-6bfaa05f7da8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.223907 May 28 21:06:25.034260 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 574/1085] 10.222.0.33 () {60 vars in 1173 bytes} [Sat May 28 21:06:24 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:25.034260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a244e972-b038-479e-9707-b52dcd17ccb0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:25.034260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a244e972-b038-479e-9707-b52dcd17ccb0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:25.036561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a244e972-b038-479e-9707-b52dcd17ccb0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:25.037127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a244e972-b038-479e-9707-b52dcd17ccb0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:25.039091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a244e972-b038-479e-9707-b52dcd17ccb0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:25.039600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a244e972-b038-479e-9707-b52dcd17ccb0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:25.220309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a244e972-b038-479e-9707-b52dcd17ccb0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:25.228367 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a244e972-b038-479e-9707-b52dcd17ccb0 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.203076 May 28 21:06:25.229578 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 575/1086] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:25 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:25.241248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8bcc7ed2-9b26-4d01-a62f-4863f318ce4f tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:25.256613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:25.273706 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8bcc7ed2-9b26-4d01-a62f-4863f318ce4f tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042721 May 28 21:06:25.274625 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 576/1087] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:25.279662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-20efe2f2-47e8-45ff-8d6f-f07b5d211c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:25.280417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-20efe2f2-47e8-45ff-8d6f-f07b5d211c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:25.286730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20efe2f2-47e8-45ff-8d6f-f07b5d211c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:25.287363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20efe2f2-47e8-45ff-8d6f-f07b5d211c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:25.288141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20efe2f2-47e8-45ff-8d6f-f07b5d211c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:25.288652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20efe2f2-47e8-45ff-8d6f-f07b5d211c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:25.360810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-20efe2f2-47e8-45ff-8d6f-f07b5d211c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:25.369807 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-20efe2f2-47e8-45ff-8d6f-f07b5d211c0d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1294 microversion: 2.1 time: 0.093775 May 28 21:06:25.370422 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 577/1088] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:25 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:25.375204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1839499469", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "05891d77-14b5-4196-bc2a-53cd5da97ab2"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:25.434336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:06:25.669209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:06:25.669706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:06:25.670219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:06:25.670638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:06:25.671274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:06:25.701397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:25.702686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:25.704593 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:25.705501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:25.728638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:25.734053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:25.748611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Going to run 2 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:06:25.751285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: c8294ac6-8d71-482c-8c67-67109bb03a2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:06:25.830519 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-483c2d28-c6ec-4281-bd03-4fcbe61900a2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "POST /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.853990 May 28 21:06:25.831360 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 512/1089] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:06:24 2022] POST /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088/os-volume_attachments => generated 194 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:25.853823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f89e687d-ebae-407e-9b95-359510e813c7 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1720200725", "id": 652406495, "os-flavor-access:is_public": "True"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:25.863727 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:25.863727 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:25.875799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=143128) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} May 28 21:06:25.898840 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:25.909213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:25.959800 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f89e687d-ebae-407e-9b95-359510e813c7 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.126887 May 28 21:06:25.960434 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 513/1090] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:25 2022] POST /compute/v2.1/flavors => generated 426 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:25.965185 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7655bd42-b347-42c8-a00e-4d6d3ca6029c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:25.966003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7655bd42-b347-42c8-a00e-4d6d3ca6029c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:25.972740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7655bd42-b347-42c8-a00e-4d6d3ca6029c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:25.973203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7655bd42-b347-42c8-a00e-4d6d3ca6029c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:25.974054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7655bd42-b347-42c8-a00e-4d6d3ca6029c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:25.974500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7655bd42-b347-42c8-a00e-4d6d3ca6029c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:26.034331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:26.042036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:26.059106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=c8294ac6-8d71-482c-8c67-67109bb03a2c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:06:26.183226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7655bd42-b347-42c8-a00e-4d6d3ca6029c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:26.191650 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7655bd42-b347-42c8-a00e-4d6d3ca6029c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.229953 May 28 21:06:26.192354 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 514/1091] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:25 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:26.205693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9e3edad5-e052-4568-8031-0f069674f22e tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:26.207316 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:26.207316 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:26.234463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:26.241854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:26.317036 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9e3edad5-e052-4568-8031-0f069674f22e tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/652406495" status: 202 len: 0 microversion: 2.1 time: 0.122080 May 28 21:06:26.317934 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 515/1092] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:06:26 2022] DELETE /compute/v2.1/flavors/652406495 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:26.323447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2d02861b-ff7b-468d-81a0-ee88466624c5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:26.324522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2d02861b-ff7b-468d-81a0-ee88466624c5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:26.332825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d02861b-ff7b-468d-81a0-ee88466624c5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:26.333571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d02861b-ff7b-468d-81a0-ee88466624c5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:26.334697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d02861b-ff7b-468d-81a0-ee88466624c5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:26.335290 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d02861b-ff7b-468d-81a0-ee88466624c5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:26.359886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:26.366611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:26.420902 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c158963e-a558-4b68-a421-e0f227fd9d8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.048769 May 28 21:06:26.421891 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 578/1093] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:25 2022] POST /compute/v2.1/servers => generated 32 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 28 21:06:26.426651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e07f5d0b-bccb-46fa-9266-ae52208727ca tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:26.473474 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e07f5d0b-bccb-46fa-9266-ae52208727ca tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050424 May 28 21:06:26.474404 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 579/1094] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:26.481401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-69415aca-5b60-4200-96ac-8050a368b012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:26.482091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-69415aca-5b60-4200-96ac-8050a368b012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:26.500953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69415aca-5b60-4200-96ac-8050a368b012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:26.501411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69415aca-5b60-4200-96ac-8050a368b012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:26.502254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69415aca-5b60-4200-96ac-8050a368b012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:26.502746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69415aca-5b60-4200-96ac-8050a368b012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:26.607971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2d02861b-ff7b-468d-81a0-ee88466624c5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:26.617203 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2d02861b-ff7b-468d-81a0-ee88466624c5 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.297901 May 28 21:06:26.619562 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 516/1095] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:26 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:26.642077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1f777027-e332-4460-b9ac-b59d414aeb8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:26.642077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1f777027-e332-4460-b9ac-b59d414aeb8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:26.642077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1f777027-e332-4460-b9ac-b59d414aeb8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Searching by: {'deleted': False, 'project_id': '348fbbc628b44152b05362657c11230d'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:06:26.649505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f777027-e332-4460-b9ac-b59d414aeb8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:26.651187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f777027-e332-4460-b9ac-b59d414aeb8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:26.652530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f777027-e332-4460-b9ac-b59d414aeb8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:26.653203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f777027-e332-4460-b9ac-b59d414aeb8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:26.699260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-69415aca-5b60-4200-96ac-8050a368b012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:26.710679 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-69415aca-5b60-4200-96ac-8050a368b012 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1324 microversion: 2.1 time: 0.233774 May 28 21:06:26.712255 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 580/1096] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:26 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1324 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:26.717020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-17af7668-83b3-44b9-b35b-6a93dea975e8 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1050195210", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:26.718968 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:26.718968 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:06:26.761175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-1f777027-e332-4460-b9ac-b59d414aeb8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:06:26.807165 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-17af7668-83b3-44b9-b35b-6a93dea975e8 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.088602 May 28 21:06:26.810741 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 581/1097] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:26 2022] POST /compute/v2.1/flavors => generated 507 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:26.820029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-26643d8c-d06d-463f-9db7-3198bb06f53a tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:26.821028 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:26.821028 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:06:26.825071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:26.854124 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1f777027-e332-4460-b9ac-b59d414aeb8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.233115 May 28 21:06:26.856100 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 517/1098] 10.222.0.33 () {58 vars in 1124 bytes} [Sat May 28 21:06:26 2022] GET /compute/v2.1/servers => generated 1004 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:26.869443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-27911992-7560-4cd4-8cf7-8123388296d5 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:26.870449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-27911992-7560-4cd4-8cf7-8123388296d5 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:26.931947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-27911992-7560-4cd4-8cf7-8123388296d5 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:26.951449 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-27911992-7560-4cd4-8cf7-8123388296d5 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1219 microversion: 2.1 time: 0.087313 May 28 21:06:26.968512 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 518/1099] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:26 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:26.985696 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-26643d8c-d06d-463f-9db7-3198bb06f53a tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/27c6b81a-4a58-48d1-8b00-f3a866832095" status: 202 len: 0 microversion: 2.1 time: 0.173117 May 28 21:06:26.987171 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 582/1100] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:06:26 2022] DELETE /compute/v2.1/flavors/27c6b81a-4a58-48d1-8b00-f3a866832095 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:26.995189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-34cd005d-7cde-424c-a41f-3cf482870e47 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:27.026662 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-34cd005d-7cde-424c-a41f-3cf482870e47 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.035270 May 28 21:06:27.034918 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 519/1101] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:26 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:27.053253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cb970de2-2132-42f5-adfa-489efaf0a212 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-598828342", "id": "c35ba329-462f-412e-a5a1-2361ae5767cb", "os-flavor-access:is_public": "True"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:27.119747 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cb970de2-2132-42f5-adfa-489efaf0a212 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.073410 May 28 21:06:27.120876 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 583/1102] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:27 2022] POST /compute/v2.1/flavors => generated 506 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:27.140309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-49af5866-95f7-4a75-87c9-fe5d94f8ca53 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:27.145076 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:27.145076 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:27.162762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=11 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:27.211157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0c55fa7a-c644-409c-a272-a7981df5eb47 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:27.220133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0c55fa7a-c644-409c-a272-a7981df5eb47 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:27.220133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c55fa7a-c644-409c-a272-a7981df5eb47 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:27.220133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c55fa7a-c644-409c-a272-a7981df5eb47 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:27.220133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c55fa7a-c644-409c-a272-a7981df5eb47 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:27.221299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c55fa7a-c644-409c-a272-a7981df5eb47 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:27.231984 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-49af5866-95f7-4a75-87c9-fe5d94f8ca53 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/c35ba329-462f-412e-a5a1-2361ae5767cb" status: 202 len: 0 microversion: 2.1 time: 0.102484 May 28 21:06:27.234436 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 520/1103] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:06:27 2022] DELETE /compute/v2.1/flavors/c35ba329-462f-412e-a5a1-2361ae5767cb => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:27.243384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-47efc5b1-e547-476e-8ac0-d86859b1a1de req-9a4c0ada-c6d0-48ea-be4e-2b3aaaca0add service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c", "tag": "2269f399-6b32-420b-a415-074be4afe7f1"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:27.256797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-47efc5b1-e547-476e-8ac0-d86859b1a1de req-9a4c0ada-c6d0-48ea-be4e-2b3aaaca0add service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:27.257470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-47efc5b1-e547-476e-8ac0-d86859b1a1de req-9a4c0ada-c6d0-48ea-be4e-2b3aaaca0add service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:27.270195 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-47efc5b1-e547-476e-8ac0-d86859b1a1de req-9a4c0ada-c6d0-48ea-be4e-2b3aaaca0add service nova] Creating event network-changed:2269f399-6b32-420b-a415-074be4afe7f1 for instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c on nch2-master-1 May 28 21:06:27.277805 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-47efc5b1-e547-476e-8ac0-d86859b1a1de req-9a4c0ada-c6d0-48ea-be4e-2b3aaaca0add service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043096 May 28 21:06:27.281561 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 521/1104] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:27.297769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ae3bbe9b-278e-44c8-a277-d842e2003a18 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:27.324736 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ae3bbe9b-278e-44c8-a277-d842e2003a18 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041170 May 28 21:06:27.326134 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 522/1105] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:27.342334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-33cfccb2-1499-4235-928d-b4cea2c551e5 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1784651487", "id": 1453492428, "os-flavor-access:is_public": "True"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:27.344491 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:27.344491 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:27.391608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c55fa7a-c644-409c-a272-a7981df5eb47 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:27.401792 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0c55fa7a-c644-409c-a272-a7981df5eb47 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.196939 May 28 21:06:27.403821 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 584/1106] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:27 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:27.491883 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-33cfccb2-1499-4235-928d-b4cea2c551e5 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.151288 May 28 21:06:27.493236 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 523/1107] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:27 2022] POST /compute/v2.1/flavors => generated 414 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:06:27.503385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f1afe18e-2287-45f0-89ab-066fc47403b8 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:27.511117 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f1afe18e-2287-45f0-89ab-066fc47403b8 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/1453492428" status: 200 len: 414 microversion: 2.1 time: 0.011379 May 28 21:06:27.517800 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 585/1108] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:06:27 2022] GET /compute/v2.1/flavors/1453492428 => generated 414 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:27.636682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-29069c78-3489-4fa5-9203-cd7763aeb0ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:27.637253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-29069c78-3489-4fa5-9203-cd7763aeb0ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:27.645347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29069c78-3489-4fa5-9203-cd7763aeb0ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:27.646101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29069c78-3489-4fa5-9203-cd7763aeb0ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:27.647315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29069c78-3489-4fa5-9203-cd7763aeb0ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:27.648105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29069c78-3489-4fa5-9203-cd7763aeb0ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:27.661018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb0fa8ab-7782-4dfc-8e2f-b84d60089148 tempest-FlavorsAdminTestJSON-1234991056 tempest-FlavorsAdminTestJSON-1234991056-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:27.685384 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb0fa8ab-7782-4dfc-8e2f-b84d60089148 tempest-FlavorsAdminTestJSON-1234991056 tempest-FlavorsAdminTestJSON-1234991056-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.166737 May 28 21:06:27.686590 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 524/1109] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:27 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:27.703888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7cb97d15-8000-4df7-9ccd-4fcfa11ee700 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:27.705043 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:27.705043 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:27.786417 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7cb97d15-8000-4df7-9ccd-4fcfa11ee700 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1453492428" status: 202 len: 0 microversion: 2.1 time: 0.086181 May 28 21:06:27.787947 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 525/1110] 10.222.0.33 () {58 vars in 1160 bytes} [Sat May 28 21:06:27 2022] DELETE /compute/v2.1/flavors/1453492428 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:27.793492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-da898b6a-e248-4a78-9df2-e16714233fe2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:27.794293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-da898b6a-e248-4a78-9df2-e16714233fe2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:27.802807 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da898b6a-e248-4a78-9df2-e16714233fe2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:27.803531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da898b6a-e248-4a78-9df2-e16714233fe2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:27.804702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da898b6a-e248-4a78-9df2-e16714233fe2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:27.805317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da898b6a-e248-4a78-9df2-e16714233fe2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:27.897693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-29069c78-3489-4fa5-9203-cd7763aeb0ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:27.910363 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-29069c78-3489-4fa5-9203-cd7763aeb0ae tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.277511 May 28 21:06:27.920494 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 586/1111] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:27 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:27.928119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ac2fe78f-87eb-4f81-8182-ac8247c97e45 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:27.948835 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ac2fe78f-87eb-4f81-8182-ac8247c97e45 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026815 May 28 21:06:27.949433 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 587/1112] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:27.966714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-70b4395d-06c0-485a-afac-7a99953ff347 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1594123632", "id": 1201811866, "os-flavor-access:is_public": "False"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:27.968443 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:27.968443 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:06:28.009592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-da898b6a-e248-4a78-9df2-e16714233fe2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:28.024180 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-da898b6a-e248-4a78-9df2-e16714233fe2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1324 microversion: 2.1 time: 0.234846 May 28 21:06:28.024770 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 526/1113] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:27 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1324 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:28.032537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dd314d38-b3a4-4f1d-84c7-51143348c487 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:28.033336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dd314d38-b3a4-4f1d-84c7-51143348c487 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:28.056752 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-70b4395d-06c0-485a-afac-7a99953ff347 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.091237 May 28 21:06:28.056752 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 588/1114] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:27 2022] POST /compute/v2.1/flavors => generated 430 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:28.094794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-25ad13a7-1d1b-4612-b8f6-dd1a8c3aa6ee tempest-FlavorsAdminTestJSON-1234991056 tempest-FlavorsAdminTestJSON-1234991056-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "1201811866"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:28.122446 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-25ad13a7-1d1b-4612-b8f6-dd1a8c3aa6ee tempest-FlavorsAdminTestJSON-1234991056 tempest-FlavorsAdminTestJSON-1234991056-project] HTTP exception thrown: Flavor 1201811866 could not be found. May 28 21:06:28.123575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dd314d38-b3a4-4f1d-84c7-51143348c487 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-25ad13a7-1d1b-4612-b8f6-dd1a8c3aa6ee tempest-FlavorsAdminTestJSON-1234991056 tempest-FlavorsAdminTestJSON-1234991056-project] Request method failure captured: May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 107 May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko7P0g3t3rzRezH8avrqy7j40XEndZx9I7bhwJl_lsEu1XoCnPnLA8yvvjCQgn2CplH5cVOJA5UT8M6IZSV0sdzp8gT44N28mI-B-zxGaDLqBvSZVPsFmED0kVye3GnIgvHloYGBFPf8ZZ9pIbwBy9c9deWt_RKJK8u3-tkyaToEPwE May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: b6bd508b87e84bbea09ac7a1042eda02 May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-FlavorsAdminTestJSON-1234991056 May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:06:28.132355 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:06:28.138785 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b6bd508b87e84bbea09ac7a1042eda02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b6bd508b87e84bbea09ac7a1042eda02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b6bd508b87e84bbea09ac7a1042eda02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b6bd508b87e84bbea09ac7a1042eda02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:28.138785 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-FlavorsAdminTestJSON-1234991056 May 28 21:06:28.138785 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: b6bd508b87e84bbea09ac7a1042eda02 May 28 21:06:28.138785 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1234991056 May 28 21:06:28.138785 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-FlavorsAdminTestJSON-1234991056-project May 28 21:06:28.138785 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:06:28.138785 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:06:28.138785 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebe3922bb60c40a58cc5ae376ce9d220 May 28 21:06:28.138785 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-FlavorsAdminTestJSON-1234991056-project May 28 21:06:28.138785 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:06:28.138785 ncdv-master-1 devstack@n-api.service[143128]: {"server": {"name": "test", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "1201811866"}} May 28 21:06:28.138785 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:06:28.138785 ncdv-master-1 devstack@n-api.service[143128]: exception: Flavor 1201811866 could not be found. May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '1201811866'}}} May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1201811866 could not be found. May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:28.139710 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1201811866 could not be found. May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:28.141211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:28.144562 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:28.144562 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:28.144562 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:28.144562 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1201811866 could not be found. May 28 21:06:28.144562 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:28.144562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-25ad13a7-1d1b-4612-b8f6-dd1a8c3aa6ee tempest-FlavorsAdminTestJSON-1234991056 tempest-FlavorsAdminTestJSON-1234991056-project] Returning 400 to user: Flavor 1201811866 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:28.144562 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-25ad13a7-1d1b-4612-b8f6-dd1a8c3aa6ee tempest-FlavorsAdminTestJSON-1234991056 tempest-FlavorsAdminTestJSON-1234991056-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.058614 May 28 21:06:28.144562 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 589/1115] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:28 2022] POST /compute/v2.1/servers => generated 81 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 21:06:28.145596 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dd314d38-b3a4-4f1d-84c7-51143348c487 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1219 microversion: 2.1 time: 0.107507 May 28 21:06:28.146643 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 527/1116] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:28 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:28.148894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-61a3ac1e-0625-4859-8642-cf716e74be46 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:28.150633 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:28.150633 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:06:28.231987 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-61a3ac1e-0625-4859-8642-cf716e74be46 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1201811866" status: 202 len: 0 microversion: 2.1 time: 0.092696 May 28 21:06:28.236740 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 590/1117] 10.222.0.33 () {58 vars in 1160 bytes} [Sat May 28 21:06:28 2022] DELETE /compute/v2.1/flavors/1201811866 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:28.243644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-64cc53cd-5e02-4485-bf89-acd9d4280ff3 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:28.272423 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-64cc53cd-5e02-4485-bf89-acd9d4280ff3 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034156 May 28 21:06:28.273514 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 528/1118] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:28.292492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-51d44c97-bdf2-4d20-b9e8-b75ad5dad966 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1892338866", "id": 229965751, "os-flavor-access:is_public": "False"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:28.396037 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-51d44c97-bdf2-4d20-b9e8-b75ad5dad966 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.107246 May 28 21:06:28.403136 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 591/1119] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:28 2022] POST /compute/v2.1/flavors => generated 412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:28.408328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-93879a4d-0048-45e8-b2ae-81612428bbe2 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1284847614", "id": 391758474, "os-flavor-access:is_public": "True"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:28.410112 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:28.410112 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:28.422121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c36f32f5-b395-48f2-9a13-acea6fc918ed tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:28.422749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c36f32f5-b395-48f2-9a13-acea6fc918ed tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:28.432420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c36f32f5-b395-48f2-9a13-acea6fc918ed tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:28.433311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c36f32f5-b395-48f2-9a13-acea6fc918ed tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:28.434139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c36f32f5-b395-48f2-9a13-acea6fc918ed tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:28.434778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c36f32f5-b395-48f2-9a13-acea6fc918ed tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:28.519777 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-93879a4d-0048-45e8-b2ae-81612428bbe2 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.115360 May 28 21:06:28.524487 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 529/1120] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:28 2022] POST /compute/v2.1/flavors => generated 411 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:06:28.531054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1f25fa77-d1d1-4805-aaac-96d74a2976c5 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:28.568917 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1f25fa77-d1d1-4805-aaac-96d74a2976c5 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.041225 May 28 21:06:28.570308 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 530/1121] 10.222.0.33 () {58 vars in 1168 bytes} [Sat May 28 21:06:28 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:28.582992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-16addac3-390a-4c78-b20c-efda853cc2ef tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:28.594640 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-16addac3-390a-4c78-b20c-efda853cc2ef tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.016429 May 28 21:06:28.595660 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 531/1122] 10.222.0.33 () {58 vars in 1176 bytes} [Sat May 28 21:06:28 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:06:28.607554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7363eaab-a462-4a51-a42d-8963fc5e1e9a tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:28.618856 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7363eaab-a462-4a51-a42d-8963fc5e1e9a tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.014857 May 28 21:06:28.619984 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 532/1123] 10.222.0.33 () {58 vars in 1170 bytes} [Sat May 28 21:06:28 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:28.635615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-778805a0-3f19-481f-8d02-1c31cad180e9 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:28.650199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c36f32f5-b395-48f2-9a13-acea6fc918ed tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:28.652354 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-778805a0-3f19-481f-8d02-1c31cad180e9 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.025327 May 28 21:06:28.658051 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 533/1124] 10.222.0.33 () {58 vars in 1168 bytes} [Sat May 28 21:06:28 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:06:28.660345 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c36f32f5-b395-48f2-9a13-acea6fc918ed tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.241648 May 28 21:06:28.664174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f156c048-4b99-4353-b320-ca83543205fc tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:28.672894 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 592/1125] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:28 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:28.690073 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f156c048-4b99-4353-b320-ca83543205fc tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.029053 May 28 21:06:28.693958 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 534/1126] 10.222.0.33 () {58 vars in 1168 bytes} [Sat May 28 21:06:28 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:28.705812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-de432cfa-382c-4a44-a190-6efa2aeb2299 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:28.741535 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-de432cfa-382c-4a44-a190-6efa2aeb2299 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.039744 May 28 21:06:28.742552 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 593/1127] 10.222.0.33 () {58 vars in 1174 bytes} [Sat May 28 21:06:28 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:28.763586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bbdff731-67b1-4299-89ec-71e9260cd885 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:28.789513 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bbdff731-67b1-4299-89ec-71e9260cd885 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.030345 May 28 21:06:28.790663 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 535/1128] 10.222.0.33 () {58 vars in 1172 bytes} [Sat May 28 21:06:28 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:28.806144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-06fb901e-af2e-48a6-aa80-d9fc52c8a775 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:28.829456 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-06fb901e-af2e-48a6-aa80-d9fc52c8a775 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.027777 May 28 21:06:28.830487 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 594/1129] 10.222.0.33 () {58 vars in 1168 bytes} [Sat May 28 21:06:28 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:28.844803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e8243563-d32f-4929-8aab-8991e30685fa tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:28.845604 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:28.845604 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:28.928437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bb150861-eb09-46b2-8d09-9941049dea09 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:28.928970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bb150861-eb09-46b2-8d09-9941049dea09 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:28.935945 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb150861-eb09-46b2-8d09-9941049dea09 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:28.936629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb150861-eb09-46b2-8d09-9941049dea09 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:28.937412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb150861-eb09-46b2-8d09-9941049dea09 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:28.938042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb150861-eb09-46b2-8d09-9941049dea09 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:28.951661 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e8243563-d32f-4929-8aab-8991e30685fa tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/391758474" status: 202 len: 0 microversion: 2.1 time: 0.110640 May 28 21:06:28.952447 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 536/1130] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:06:28 2022] DELETE /compute/v2.1/flavors/391758474 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:28.961734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2b188b44-c187-46eb-89a8-6db5b4fd634e tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:28.982471 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2b188b44-c187-46eb-89a8-6db5b4fd634e tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024325 May 28 21:06:28.983291 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 537/1131] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:28.998774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f06d3259-2c04-4a0f-b07c-0b45b2858c33 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:29.101029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bb150861-eb09-46b2-8d09-9941049dea09 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:29.112102 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f06d3259-2c04-4a0f-b07c-0b45b2858c33 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/229965751" status: 202 len: 0 microversion: 2.1 time: 0.117812 May 28 21:06:29.112739 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 538/1132] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:06:28 2022] DELETE /compute/v2.1/flavors/229965751 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:06:29.119779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-51360dde-de12-4e56-8440-b7de295915b3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:29.120539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-51360dde-de12-4e56-8440-b7de295915b3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:29.130687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51360dde-de12-4e56-8440-b7de295915b3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:29.131387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51360dde-de12-4e56-8440-b7de295915b3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:29.132510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51360dde-de12-4e56-8440-b7de295915b3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:29.132834 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bb150861-eb09-46b2-8d09-9941049dea09 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.204356 May 28 21:06:29.133068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51360dde-de12-4e56-8440-b7de295915b3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:29.134031 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 595/1133] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:28 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:29.141416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-18e4b0d8-a765-4e92-bea7-ae6f17d2511b tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:29.181793 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-18e4b0d8-a765-4e92-bea7-ae6f17d2511b tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046478 May 28 21:06:29.193665 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 596/1134] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:29.201476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-054c6b54-fe79-4ca1-af7d-e6a81a41d98d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:29.202388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-054c6b54-fe79-4ca1-af7d-e6a81a41d98d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:29.214129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-054c6b54-fe79-4ca1-af7d-e6a81a41d98d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:29.214129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-054c6b54-fe79-4ca1-af7d-e6a81a41d98d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:29.214946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-054c6b54-fe79-4ca1-af7d-e6a81a41d98d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:29.215492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-054c6b54-fe79-4ca1-af7d-e6a81a41d98d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:29.319248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-054c6b54-fe79-4ca1-af7d-e6a81a41d98d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:29.329232 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-054c6b54-fe79-4ca1-af7d-e6a81a41d98d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1215 microversion: 2.1 time: 0.133449 May 28 21:06:29.330316 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 597/1135] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:29 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1215 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:29.334672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-51360dde-de12-4e56-8440-b7de295915b3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:29.345878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f631cd17-09d0-41d2-b709-d72f3ebb983f tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-816441635", "id": 1976753258, "os-flavor-access:is_public": "False"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:29.345878 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:29.345878 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:06:29.346352 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-51360dde-de12-4e56-8440-b7de295915b3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1324 microversion: 2.1 time: 0.230165 May 28 21:06:29.346352 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 539/1136] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:29 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1324 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:29.444552 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f631cd17-09d0-41d2-b709-d72f3ebb983f tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.112989 May 28 21:06:29.445074 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 598/1137] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:29 2022] POST /compute/v2.1/flavors => generated 414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:29.455990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-99592c4c-6151-4bf5-9bae-a00a17b4ed2d tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:29.480247 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-99592c4c-6151-4bf5-9bae-a00a17b4ed2d tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028129 May 28 21:06:29.480837 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 540/1138] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:29.495424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e38c2b18-1c5b-4adf-bb34-cd8407dac1db tempest-FlavorsAdminTestJSON-1234991056 tempest-FlavorsAdminTestJSON-1234991056-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:29.516270 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e38c2b18-1c5b-4adf-bb34-cd8407dac1db tempest-FlavorsAdminTestJSON-1234991056 tempest-FlavorsAdminTestJSON-1234991056-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024917 May 28 21:06:29.517127 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 599/1139] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:29.531734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-97a253c3-87d5-4811-867d-ac24073be888 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:29.534129 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:29.534129 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:29.609068 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-97a253c3-87d5-4811-867d-ac24073be888 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1976753258" status: 202 len: 0 microversion: 2.1 time: 0.080907 May 28 21:06:29.609980 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 541/1140] 10.222.0.33 () {58 vars in 1160 bytes} [Sat May 28 21:06:29 2022] DELETE /compute/v2.1/flavors/1976753258 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:29.624324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ddd8d201-f06a-430b-94a7-b0162e8ba651 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:29.644710 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ddd8d201-f06a-430b-94a7-b0162e8ba651 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023601 May 28 21:06:29.645585 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 600/1141] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:29.663024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b17b0b4f-cc48-4d26-86bd-356fe7e74ad1 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-40840465", "id": 1074884135, "os-flavor-access:is_public": "True"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:29.664899 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:29.664899 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:29.677188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-45c9ae09-b8bb-45e9-bb0c-7bb2832ca73c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:29.677938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-45c9ae09-b8bb-45e9-bb0c-7bb2832ca73c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:29.685575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45c9ae09-b8bb-45e9-bb0c-7bb2832ca73c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:29.686113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45c9ae09-b8bb-45e9-bb0c-7bb2832ca73c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:29.689189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45c9ae09-b8bb-45e9-bb0c-7bb2832ca73c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:29.689189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45c9ae09-b8bb-45e9-bb0c-7bb2832ca73c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:29.741526 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b17b0b4f-cc48-4d26-86bd-356fe7e74ad1 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.082255 May 28 21:06:29.742164 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 542/1142] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:29 2022] POST /compute/v2.1/flavors => generated 412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:29.756138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ecfe683a-e0ff-4ff2-84a4-d18973710cd5 tempest-FlavorsAdminTestJSON-1234991056 tempest-FlavorsAdminTestJSON-1234991056-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:29.776552 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ecfe683a-e0ff-4ff2-84a4-d18973710cd5 tempest-FlavorsAdminTestJSON-1234991056 tempest-FlavorsAdminTestJSON-1234991056-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5393 microversion: 2.1 time: 0.027638 May 28 21:06:29.777247 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 543/1143] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:29 2022] GET /compute/v2.1/flavors/detail => generated 5393 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:29.793336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-204e9f7d-a80b-43c0-9007-30e0573c96a4 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:29.840779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-45c9ae09-b8bb-45e9-bb0c-7bb2832ca73c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:29.849009 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-45c9ae09-b8bb-45e9-bb0c-7bb2832ca73c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.175809 May 28 21:06:29.849776 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 601/1144] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:29 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:29.871712 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-204e9f7d-a80b-43c0-9007-30e0573c96a4 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1074884135" status: 202 len: 0 microversion: 2.1 time: 0.083906 May 28 21:06:29.872299 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 544/1145] 10.222.0.33 () {58 vars in 1160 bytes} [Sat May 28 21:06:29 2022] DELETE /compute/v2.1/flavors/1074884135 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:29.881494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a7e131ad-7b5e-4737-9bde-ecb0453c2ab2 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:29.901362 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a7e131ad-7b5e-4737-9bde-ecb0453c2ab2 tempest-FlavorsAdminTestJSON-1152204192 tempest-FlavorsAdminTestJSON-1152204192-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024387 May 28 21:06:29.901977 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 602/1146] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:30.150514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a38ae157-f4e8-40cb-8246-6adba27a4f83 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:30.151139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a38ae157-f4e8-40cb-8246-6adba27a4f83 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:30.158165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a38ae157-f4e8-40cb-8246-6adba27a4f83 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:30.158619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a38ae157-f4e8-40cb-8246-6adba27a4f83 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:30.159909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a38ae157-f4e8-40cb-8246-6adba27a4f83 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:30.160390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a38ae157-f4e8-40cb-8246-6adba27a4f83 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:30.307951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a38ae157-f4e8-40cb-8246-6adba27a4f83 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:30.321219 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a38ae157-f4e8-40cb-8246-6adba27a4f83 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.174403 May 28 21:06:30.322177 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 545/1147] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:30 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:30.354092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b90cb43b-89f9-44ac-b0a0-070cd54d1c6f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:30.354718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b90cb43b-89f9-44ac-b0a0-070cd54d1c6f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:30.365803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b3100c9f-7867-4f14-ab2c-bc81b0788b26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:30.366837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b3100c9f-7867-4f14-ab2c-bc81b0788b26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:30.369413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b90cb43b-89f9-44ac-b0a0-070cd54d1c6f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:30.369914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b90cb43b-89f9-44ac-b0a0-070cd54d1c6f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:30.371159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b90cb43b-89f9-44ac-b0a0-070cd54d1c6f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:30.371864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b90cb43b-89f9-44ac-b0a0-070cd54d1c6f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:30.377244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3100c9f-7867-4f14-ab2c-bc81b0788b26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:30.382401 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3100c9f-7867-4f14-ab2c-bc81b0788b26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:30.383577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3100c9f-7867-4f14-ab2c-bc81b0788b26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:30.384951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3100c9f-7867-4f14-ab2c-bc81b0788b26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:30.463533 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b90cb43b-89f9-44ac-b0a0-070cd54d1c6f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:30.477067 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b90cb43b-89f9-44ac-b0a0-070cd54d1c6f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1271 microversion: 2.1 time: 0.127019 May 28 21:06:30.486414 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 603/1148] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:30 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1271 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:30.492634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-161a9e15-69ec-4e27-984f-2cb46babf130 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:30.494392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-161a9e15-69ec-4e27-984f-2cb46babf130 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:30.501859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-161a9e15-69ec-4e27-984f-2cb46babf130 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:30.502384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-161a9e15-69ec-4e27-984f-2cb46babf130 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:30.503261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-161a9e15-69ec-4e27-984f-2cb46babf130 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:30.503761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-161a9e15-69ec-4e27-984f-2cb46babf130 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:30.618784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b3100c9f-7867-4f14-ab2c-bc81b0788b26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:30.627111 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b3100c9f-7867-4f14-ab2c-bc81b0788b26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1324 microversion: 2.1 time: 0.268353 May 28 21:06:30.637294 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 546/1149] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:30 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1324 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:30.696061 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-161a9e15-69ec-4e27-984f-2cb46babf130 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1690 microversion: 2.1 time: 0.208394 May 28 21:06:30.696774 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 604/1150] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:30 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1690 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:30.713406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-30afda66-414b-4254-84b1-4414c5b85c37 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:30.714881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-30afda66-414b-4254-84b1-4414c5b85c37 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:30.723346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30afda66-414b-4254-84b1-4414c5b85c37 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:30.723808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30afda66-414b-4254-84b1-4414c5b85c37 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:30.731270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30afda66-414b-4254-84b1-4414c5b85c37 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:30.731270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30afda66-414b-4254-84b1-4414c5b85c37 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:30.750454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-30afda66-414b-4254-84b1-4414c5b85c37 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lazy-loading 'flavor' on Instance uuid 6a102552-9f3f-417b-a587-72cf6ee45088 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:06:30.764446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-30afda66-414b-4254-84b1-4414c5b85c37 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Going to try to live migrate instance to nch2-master-1 {{(pid=143129) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 21:06:30.871533 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-341eea89-3fe4-416f-aa67-b6307c90b41a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:30.875966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-341eea89-3fe4-416f-aa67-b6307c90b41a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:30.895637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-341eea89-3fe4-416f-aa67-b6307c90b41a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:30.896112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-341eea89-3fe4-416f-aa67-b6307c90b41a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:30.899432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-341eea89-3fe4-416f-aa67-b6307c90b41a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:30.899923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-341eea89-3fe4-416f-aa67-b6307c90b41a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:30.920641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:31.159212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-341eea89-3fe4-416f-aa67-b6307c90b41a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:31.176783 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-341eea89-3fe4-416f-aa67-b6307c90b41a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.313245 May 28 21:06:31.177941 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 605/1151] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:30 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:31.346090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bc1222ee-3982-48ae-8a0c-114ba89bfe5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:31.346090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bc1222ee-3982-48ae-8a0c-114ba89bfe5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:31.353335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc1222ee-3982-48ae-8a0c-114ba89bfe5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:31.354038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc1222ee-3982-48ae-8a0c-114ba89bfe5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:31.354897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc1222ee-3982-48ae-8a0c-114ba89bfe5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:31.355493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc1222ee-3982-48ae-8a0c-114ba89bfe5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:31.506859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bc1222ee-3982-48ae-8a0c-114ba89bfe5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:31.514820 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bc1222ee-3982-48ae-8a0c-114ba89bfe5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.177201 May 28 21:06:31.515369 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 606/1152] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:31 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:31.544232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a8ff32d8-217e-4d3f-b74e-a67b4fb48fa6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:31.546117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a8ff32d8-217e-4d3f-b74e-a67b4fb48fa6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:31.563515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8ff32d8-217e-4d3f-b74e-a67b4fb48fa6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:31.564310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8ff32d8-217e-4d3f-b74e-a67b4fb48fa6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:31.567645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8ff32d8-217e-4d3f-b74e-a67b4fb48fa6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:31.568179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8ff32d8-217e-4d3f-b74e-a67b4fb48fa6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:31.670951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a8ff32d8-217e-4d3f-b74e-a67b4fb48fa6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:31.681149 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a8ff32d8-217e-4d3f-b74e-a67b4fb48fa6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1279 microversion: 2.1 time: 0.163556 May 28 21:06:31.681515 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 607/1153] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:31 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:31.700081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-159b1535-201c-4238-bcb9-001278da958e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:31.702443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-159b1535-201c-4238-bcb9-001278da958e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:31.720004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-159b1535-201c-4238-bcb9-001278da958e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:31.720973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-159b1535-201c-4238-bcb9-001278da958e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:31.728148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-159b1535-201c-4238-bcb9-001278da958e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:31.728148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-159b1535-201c-4238-bcb9-001278da958e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:31.914734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-159b1535-201c-4238-bcb9-001278da958e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:31.925822 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-159b1535-201c-4238-bcb9-001278da958e tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1324 microversion: 2.1 time: 0.242289 May 28 21:06:31.926582 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 608/1154] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:31 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1324 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:32.196301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-269d3d63-fcd5-47da-b422-32d77ba4c589 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:32.197042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-269d3d63-fcd5-47da-b422-32d77ba4c589 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:32.205577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-269d3d63-fcd5-47da-b422-32d77ba4c589 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:32.206658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-269d3d63-fcd5-47da-b422-32d77ba4c589 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:32.207521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-269d3d63-fcd5-47da-b422-32d77ba4c589 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:32.208050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-269d3d63-fcd5-47da-b422-32d77ba4c589 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:32.546685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-269d3d63-fcd5-47da-b422-32d77ba4c589 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:32.582952 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-269d3d63-fcd5-47da-b422-32d77ba4c589 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.392572 May 28 21:06:32.584043 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 609/1155] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:32 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:32.590570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ce2a3db5-aef5-4ff3-9583-277add93f8d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:32.591322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ce2a3db5-aef5-4ff3-9583-277add93f8d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:32.598460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce2a3db5-aef5-4ff3-9583-277add93f8d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:32.599274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce2a3db5-aef5-4ff3-9583-277add93f8d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:32.600588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce2a3db5-aef5-4ff3-9583-277add93f8d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:32.601040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce2a3db5-aef5-4ff3-9583-277add93f8d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:32.939967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ce2a3db5-aef5-4ff3-9583-277add93f8d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:32.961788 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ce2a3db5-aef5-4ff3-9583-277add93f8d6 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1472 microversion: 2.1 time: 0.376557 May 28 21:06:32.977797 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 610/1156] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:32 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:32.986787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cf6d80ad-a1df-487f-951d-3c96f97fe350 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:32.990050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cf6d80ad-a1df-487f-951d-3c96f97fe350 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:32.998042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf6d80ad-a1df-487f-951d-3c96f97fe350 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:32.998891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf6d80ad-a1df-487f-951d-3c96f97fe350 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:33.004336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf6d80ad-a1df-487f-951d-3c96f97fe350 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:33.005693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf6d80ad-a1df-487f-951d-3c96f97fe350 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:33.448010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cf6d80ad-a1df-487f-951d-3c96f97fe350 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:33.459184 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cf6d80ad-a1df-487f-951d-3c96f97fe350 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1319 microversion: 2.1 time: 0.479193 May 28 21:06:33.459973 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 611/1157] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:32 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:33.467443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fb71f60e-240e-4a52-8ada-0d3ad34cd098 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:33.468378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fb71f60e-240e-4a52-8ada-0d3ad34cd098 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:33.478560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb71f60e-240e-4a52-8ada-0d3ad34cd098 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:33.479499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb71f60e-240e-4a52-8ada-0d3ad34cd098 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:33.480393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb71f60e-240e-4a52-8ada-0d3ad34cd098 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:33.480967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb71f60e-240e-4a52-8ada-0d3ad34cd098 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:33.699279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fb71f60e-240e-4a52-8ada-0d3ad34cd098 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:33.707870 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fb71f60e-240e-4a52-8ada-0d3ad34cd098 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1324 microversion: 2.1 time: 0.246566 May 28 21:06:33.709030 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 612/1158] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:33 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1324 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:33.714288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-521e79fe-6dc0-4eea-a1e5-4e279415144e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:33.717885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-521e79fe-6dc0-4eea-a1e5-4e279415144e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:33.725402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-521e79fe-6dc0-4eea-a1e5-4e279415144e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:33.726115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-521e79fe-6dc0-4eea-a1e5-4e279415144e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:33.727082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-521e79fe-6dc0-4eea-a1e5-4e279415144e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:33.727936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-521e79fe-6dc0-4eea-a1e5-4e279415144e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:33.949080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-521e79fe-6dc0-4eea-a1e5-4e279415144e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:33.963837 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-521e79fe-6dc0-4eea-a1e5-4e279415144e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.252285 May 28 21:06:33.966278 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 613/1159] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:33 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:33.986027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b3f1bd6b-ce48-4686-b027-4f9722c224c8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:33.986956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b3f1bd6b-ce48-4686-b027-4f9722c224c8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:34.005474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3f1bd6b-ce48-4686-b027-4f9722c224c8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:34.006168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3f1bd6b-ce48-4686-b027-4f9722c224c8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:34.007005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3f1bd6b-ce48-4686-b027-4f9722c224c8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:34.007451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3f1bd6b-ce48-4686-b027-4f9722c224c8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:34.136440 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-30afda66-414b-4254-84b1-4414c5b85c37 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088/action" status: 202 len: 0 microversion: 2.1 time: 3.422673 May 28 21:06:34.136440 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 547/1160] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:06:30 2022] POST /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088/action => generated 0 bytes in 3424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:34.142452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7a0213d2-1d87-4518-96e2-dde92afa9030 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:34.143384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7a0213d2-1d87-4518-96e2-dde92afa9030 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:34.176075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a0213d2-1d87-4518-96e2-dde92afa9030 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:34.176573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a0213d2-1d87-4518-96e2-dde92afa9030 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:34.177662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a0213d2-1d87-4518-96e2-dde92afa9030 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:34.178194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a0213d2-1d87-4518-96e2-dde92afa9030 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:34.298464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b3f1bd6b-ce48-4686-b027-4f9722c224c8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:34.326710 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b3f1bd6b-ce48-4686-b027-4f9722c224c8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1478 microversion: 2.1 time: 0.351426 May 28 21:06:34.328688 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 614/1161] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:33 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1478 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:34.336633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2bc23c04-94b8-4adc-89ec-fa6d4598f374 req-7a37fd85-7f9b-4f9a-9810-9ffa57c0dda5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8294ac6-8d71-482c-8c67-67109bb03a2c", "tag": "570755cc-4cb9-4e9c-bf46-99cfda81d1b3"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:34.362110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2bc23c04-94b8-4adc-89ec-fa6d4598f374 req-7a37fd85-7f9b-4f9a-9810-9ffa57c0dda5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:34.363708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2bc23c04-94b8-4adc-89ec-fa6d4598f374 req-7a37fd85-7f9b-4f9a-9810-9ffa57c0dda5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:34.396429 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2bc23c04-94b8-4adc-89ec-fa6d4598f374 req-7a37fd85-7f9b-4f9a-9810-9ffa57c0dda5 service nova] Creating event network-changed:570755cc-4cb9-4e9c-bf46-99cfda81d1b3 for instance c8294ac6-8d71-482c-8c67-67109bb03a2c on nch2-master-1 May 28 21:06:34.409566 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2bc23c04-94b8-4adc-89ec-fa6d4598f374 req-7a37fd85-7f9b-4f9a-9810-9ffa57c0dda5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078530 May 28 21:06:34.413051 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 615/1162] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:34.488087 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1ebc240f-c9ea-4257-8771-572d9c2336cb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:34.489412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1ebc240f-c9ea-4257-8771-572d9c2336cb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:34.499092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ebc240f-c9ea-4257-8771-572d9c2336cb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:34.500767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ebc240f-c9ea-4257-8771-572d9c2336cb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:34.501695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ebc240f-c9ea-4257-8771-572d9c2336cb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:34.502502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ebc240f-c9ea-4257-8771-572d9c2336cb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:34.806902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7a0213d2-1d87-4518-96e2-dde92afa9030 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:34.820227 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7a0213d2-1d87-4518-96e2-dde92afa9030 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.682747 May 28 21:06:34.833472 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 548/1163] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:34 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:34.841084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-87322c2b-7476-4a09-8b6c-f0a3fbf68b54 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:34.841084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-87322c2b-7476-4a09-8b6c-f0a3fbf68b54 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:34.848730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87322c2b-7476-4a09-8b6c-f0a3fbf68b54 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:34.849503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87322c2b-7476-4a09-8b6c-f0a3fbf68b54 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:34.850640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87322c2b-7476-4a09-8b6c-f0a3fbf68b54 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:34.852270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87322c2b-7476-4a09-8b6c-f0a3fbf68b54 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:35.051440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1ebc240f-c9ea-4257-8771-572d9c2336cb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:35.071523 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1ebc240f-c9ea-4257-8771-572d9c2336cb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1319 microversion: 2.1 time: 0.589494 May 28 21:06:35.072130 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 616/1164] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:34 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1319 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:35.077766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-87796364-a3d1-4abb-9f16-0676a6278791 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:35.082226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-87796364-a3d1-4abb-9f16-0676a6278791 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:35.100970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87796364-a3d1-4abb-9f16-0676a6278791 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:35.106096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87796364-a3d1-4abb-9f16-0676a6278791 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:35.106096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87796364-a3d1-4abb-9f16-0676a6278791 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:35.106096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87796364-a3d1-4abb-9f16-0676a6278791 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:35.401941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-87322c2b-7476-4a09-8b6c-f0a3fbf68b54 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:35.411001 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-87322c2b-7476-4a09-8b6c-f0a3fbf68b54 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1324 microversion: 2.1 time: 0.575909 May 28 21:06:35.423490 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 549/1165] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:34 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1324 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:35.429276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-41363c19-7427-404e-a0f6-a2b6307fa7d8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:35.430065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-41363c19-7427-404e-a0f6-a2b6307fa7d8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:35.449971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41363c19-7427-404e-a0f6-a2b6307fa7d8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:35.452773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41363c19-7427-404e-a0f6-a2b6307fa7d8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:35.457240 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41363c19-7427-404e-a0f6-a2b6307fa7d8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:35.458890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41363c19-7427-404e-a0f6-a2b6307fa7d8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:35.539062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-87796364-a3d1-4abb-9f16-0676a6278791 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:35.550775 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-87796364-a3d1-4abb-9f16-0676a6278791 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.473926 May 28 21:06:35.551477 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 617/1166] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:35 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:35.839326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-43a6981f-7873-47db-aac2-9e2dc9afb87d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:35.840159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-43a6981f-7873-47db-aac2-9e2dc9afb87d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:35.842411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:35.857943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43a6981f-7873-47db-aac2-9e2dc9afb87d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:35.858584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-41363c19-7427-404e-a0f6-a2b6307fa7d8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:35.859014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43a6981f-7873-47db-aac2-9e2dc9afb87d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:35.860304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43a6981f-7873-47db-aac2-9e2dc9afb87d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:35.861563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43a6981f-7873-47db-aac2-9e2dc9afb87d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:35.871727 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-41363c19-7427-404e-a0f6-a2b6307fa7d8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1478 microversion: 2.1 time: 0.454012 May 28 21:06:35.873050 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 550/1167] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:35 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1478 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:35.918122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-b4bacb40-2518-4116-9ed0-d856730c4e45 req-91cde9e0-0a9f-4ee8-9c59-80de1e6fadfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c", "name": "network-vif-plugged", "status": "completed", "tag": "2269f399-6b32-420b-a415-074be4afe7f1"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:35.945741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b4bacb40-2518-4116-9ed0-d856730c4e45 req-91cde9e0-0a9f-4ee8-9c59-80de1e6fadfe service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:35.945741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b4bacb40-2518-4116-9ed0-d856730c4e45 req-91cde9e0-0a9f-4ee8-9c59-80de1e6fadfe service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:35.966159 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b4bacb40-2518-4116-9ed0-d856730c4e45 req-91cde9e0-0a9f-4ee8-9c59-80de1e6fadfe service nova] Creating event network-vif-plugged:2269f399-6b32-420b-a415-074be4afe7f1 for instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c on nch2-master-1 May 28 21:06:35.974061 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-b4bacb40-2518-4116-9ed0-d856730c4e45 req-91cde9e0-0a9f-4ee8-9c59-80de1e6fadfe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060914 May 28 21:06:35.975338 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 551/1168] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:36.097333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c73ecf49-755f-4b16-ad27-3a8431810808 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:36.098116 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c73ecf49-755f-4b16-ad27-3a8431810808 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:36.100468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=16,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:36.113082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c73ecf49-755f-4b16-ad27-3a8431810808 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:36.114206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c73ecf49-755f-4b16-ad27-3a8431810808 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:36.117236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c73ecf49-755f-4b16-ad27-3a8431810808 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:36.117736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c73ecf49-755f-4b16-ad27-3a8431810808 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:36.228888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-43a6981f-7873-47db-aac2-9e2dc9afb87d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:36.251580 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-43a6981f-7873-47db-aac2-9e2dc9afb87d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.416887 May 28 21:06:36.263230 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 618/1169] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:35 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:36.354614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c73ecf49-755f-4b16-ad27-3a8431810808 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:36.363649 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c73ecf49-755f-4b16-ad27-3a8431810808 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1319 microversion: 2.1 time: 0.272123 May 28 21:06:36.365187 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 552/1170] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:36 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:36.433072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-497c3983-a6d6-4417-849e-bf469284f626 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:36.434764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-497c3983-a6d6-4417-849e-bf469284f626 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:36.444679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=32 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:36.449475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-497c3983-a6d6-4417-849e-bf469284f626 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:36.450498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-497c3983-a6d6-4417-849e-bf469284f626 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:36.451505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-497c3983-a6d6-4417-849e-bf469284f626 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:36.452240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-497c3983-a6d6-4417-849e-bf469284f626 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:36.479442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-8e4bd04f-f043-486d-b310-f0ad202cacc6 req-7aecf1a9-d550-4c78-85f2-88dec76eebcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e00995a1-4fea-46e2-b9c9-7e0fd95d60dc", "tag": "13c4db0b-f2f9-4929-aa11-0599f0e9d8da"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:36.494817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8e4bd04f-f043-486d-b310-f0ad202cacc6 req-7aecf1a9-d550-4c78-85f2-88dec76eebcb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:36.495535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8e4bd04f-f043-486d-b310-f0ad202cacc6 req-7aecf1a9-d550-4c78-85f2-88dec76eebcb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:36.511501 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-8e4bd04f-f043-486d-b310-f0ad202cacc6 req-7aecf1a9-d550-4c78-85f2-88dec76eebcb service nova] Creating event network-changed:13c4db0b-f2f9-4929-aa11-0599f0e9d8da for instance e00995a1-4fea-46e2-b9c9-7e0fd95d60dc on nch2-master-1 May 28 21:06:36.517291 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-8e4bd04f-f043-486d-b310-f0ad202cacc6 req-7aecf1a9-d550-4c78-85f2-88dec76eebcb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042428 May 28 21:06:36.518462 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 553/1171] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:06:36.631609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-497c3983-a6d6-4417-849e-bf469284f626 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:36.640462 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-497c3983-a6d6-4417-849e-bf469284f626 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1324 microversion: 2.1 time: 0.212966 May 28 21:06:36.641260 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 619/1172] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:36 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1324 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:36.647027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bcc94b50-59c8-484e-9e9f-0868ee492328 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:36.647719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bcc94b50-59c8-484e-9e9f-0868ee492328 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:36.654909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bcc94b50-59c8-484e-9e9f-0868ee492328 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:36.655456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bcc94b50-59c8-484e-9e9f-0868ee492328 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:36.656307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bcc94b50-59c8-484e-9e9f-0868ee492328 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:36.656843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bcc94b50-59c8-484e-9e9f-0868ee492328 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:36.676768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6ba566a8-1654-4da9-8fd9-80148f8ba070 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-438774447", "ram": 512, "vcpus": 1, "disk": 10, "id": 736539574, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:36.679299 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:36.679299 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:36.683934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:36.788235 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6ba566a8-1654-4da9-8fd9-80148f8ba070 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.268140 May 28 21:06:36.789213 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 554/1173] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:36 2022] POST /compute/v2.1/flavors => generated 412 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:36.925499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bcc94b50-59c8-484e-9e9f-0868ee492328 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:36.937645 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bcc94b50-59c8-484e-9e9f-0868ee492328 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.292754 May 28 21:06:36.944767 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 620/1174] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:36 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:36.952799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-088efc02-e6ad-47ce-8553-909202d08b23 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:36.953722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-088efc02-e6ad-47ce-8553-909202d08b23 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:36.955806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5e213c47-05a3-42f7-8681-34e997557e93 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:36.962148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-088efc02-e6ad-47ce-8553-909202d08b23 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:36.962148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-088efc02-e6ad-47ce-8553-909202d08b23 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:36.962148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-088efc02-e6ad-47ce-8553-909202d08b23 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:36.963092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-088efc02-e6ad-47ce-8553-909202d08b23 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:36.967145 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-5e213c47-05a3-42f7-8681-34e997557e93 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] HTTP exception thrown: Flavor 736539574 has no extra specs with key hw:cpu_thread_policy. May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5e213c47-05a3-42f7-8681-34e997557e93 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] Request method failure captured: May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/flavors/736539574/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko7bmAMCiaha8zU8XVjl0CWt0F7Zb-oWr9HtKsl3Z1FyYulaO-04GW7EjX5MGTtkTIK775dTl9rP8-sakEuGeWhXL07D85OZ-jaHk5rTG9K55fo6NWY5jMMrFEs8nUspsVI7V1AgjWwWcdlquI7IYQOd9vSYzOryfG4SfKrL9h-OlZ0 May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 86bbd17227e84055827b4eff8bdac369 May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:06:36.972525 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:06:36.974145 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_86bbd17227e84055827b4eff8bdac369", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/86bbd17227e84055827b4eff8bdac369"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/86bbd17227e84055827b4eff8bdac369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/86bbd17227e84055827b4eff8bdac369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:36.974145 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 May 28 21:06:36.974145 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 86bbd17227e84055827b4eff8bdac369 May 28 21:06:36.974145 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 May 28 21:06:36.974145 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project May 28 21:06:36.974145 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:36.974145 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:36.974145 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 8910a38cbd6048f4a9ced613a0cea707 May 28 21:06:36.974145 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project May 28 21:06:36.974145 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:06:36.974145 ncdv-master-1 devstack@n-api.service[143129]: exception: Flavor 736539574 has no extra specs with key hw:cpu_thread_policy. May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'flavor_id': '736539574', 'id': 'hw:cpu_thread_policy'} May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 736539574 has no extra specs with key hw:cpu_thread_policy. May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:36.974973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:36.986304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:36.986304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:36.986304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:36.986304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:36.986304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:36.986304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 736539574 has no extra specs with key hw:cpu_thread_policy. May 28 21:06:36.986304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:36.986304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5e213c47-05a3-42f7-8681-34e997557e93 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] Returning 404 to user: Flavor 736539574 has no extra specs with key hw:cpu_thread_policy. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:36.986304 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5e213c47-05a3-42f7-8681-34e997557e93 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] 10.222.0.33 "GET /compute/v2.1/flavors/736539574/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.175447 May 28 21:06:36.986304 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 555/1175] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:06:36 2022] GET /compute/v2.1/flavors/736539574/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:36.987023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b0c09cad-05f9-4df5-a78e-3f1de584d176 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:36.988654 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:36.988654 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:36.990358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b0c09cad-05f9-4df5-a78e-3f1de584d176 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '8910a38cbd6048f4a9ced613a0cea707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bbd17227e84055827b4eff8bdac369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b0c09cad-05f9-4df5-a78e-3f1de584d176 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] Request method failure captured: May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/flavors/736539574/os-extra_specs HTTP/1.1 May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 66 May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko7bmAMCiaha8zU8XVjl0CWt0F7Zb-oWr9HtKsl3Z1FyYulaO-04GW7EjX5MGTtkTIK775dTl9rP8-sakEuGeWhXL07D85OZ-jaHk5rTG9K55fo6NWY5jMMrFEs8nUspsVI7V1AgjWwWcdlquI7IYQOd9vSYzOryfG4SfKrL9h-OlZ0 May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 86bbd17227e84055827b4eff8bdac369 May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:06:36.992523 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:06:36.994628 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_86bbd17227e84055827b4eff8bdac369", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/86bbd17227e84055827b4eff8bdac369"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/86bbd17227e84055827b4eff8bdac369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/86bbd17227e84055827b4eff8bdac369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:36.994628 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 May 28 21:06:36.994628 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 86bbd17227e84055827b4eff8bdac369 May 28 21:06:36.994628 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 May 28 21:06:36.994628 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project May 28 21:06:36.994628 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:36.994628 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:36.994628 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 8910a38cbd6048f4a9ced613a0cea707 May 28 21:06:36.994628 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project May 28 21:06:36.994628 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:06:36.994628 ncdv-master-1 devstack@n-api.service[143129]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} May 28 21:06:36.994628 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'flavor_id': '736539574', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:06:36.995497 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. May 28 21:06:36.996879 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:36.998348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b0c09cad-05f9-4df5-a78e-3f1de584d176 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:36.998348 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b0c09cad-05f9-4df5-a78e-3f1de584d176 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] 10.222.0.33 "POST /compute/v2.1/flavors/736539574/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.014396 May 28 21:06:37.002369 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 556/1176] 10.222.0.33 () {60 vars in 1220 bytes} [Sat May 28 21:06:36 2022] POST /compute/v2.1/flavors/736539574/os-extra_specs => generated 124 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 28 21:06:37.008561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c5ae5b49-7961-477b-92c7-5bb595cd3497 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:37.126626 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c5ae5b49-7961-477b-92c7-5bb595cd3497 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/736539574/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.123048 May 28 21:06:37.131984 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 557/1177] 10.222.0.33 () {60 vars in 1220 bytes} [Sat May 28 21:06:37 2022] POST /compute/v2.1/flavors/736539574/os-extra_specs => generated 66 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:06:37.137522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bfdd7574-23ba-411f-a562-27573d761925 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:37.140905 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:37.140905 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:37.142745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bfdd7574-23ba-411f-a562-27573d761925 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '8910a38cbd6048f4a9ced613a0cea707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bbd17227e84055827b4eff8bdac369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bfdd7574-23ba-411f-a562-27573d761925 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] Request method failure captured: May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/flavors/736539574/os-extra_specs/hw:numa_nodes HTTP/1.1 May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko7bmAMCiaha8zU8XVjl0CWt0F7Zb-oWr9HtKsl3Z1FyYulaO-04GW7EjX5MGTtkTIK775dTl9rP8-sakEuGeWhXL07D85OZ-jaHk5rTG9K55fo6NWY5jMMrFEs8nUspsVI7V1AgjWwWcdlquI7IYQOd9vSYzOryfG4SfKrL9h-OlZ0 May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 86bbd17227e84055827b4eff8bdac369 May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:06:37.144920 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:06:37.153664 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_86bbd17227e84055827b4eff8bdac369", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/86bbd17227e84055827b4eff8bdac369"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/86bbd17227e84055827b4eff8bdac369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/86bbd17227e84055827b4eff8bdac369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:37.153664 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 May 28 21:06:37.153664 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 86bbd17227e84055827b4eff8bdac369 May 28 21:06:37.153664 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 May 28 21:06:37.153664 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project May 28 21:06:37.153664 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:37.153664 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:37.153664 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 8910a38cbd6048f4a9ced613a0cea707 May 28 21:06:37.153664 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project May 28 21:06:37.153664 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:06:37.153664 ncdv-master-1 devstack@n-api.service[143129]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'flavor_id': '736539574', 'id': 'hw:numa_nodes'} May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:06:37.154803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.156340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bfdd7574-23ba-411f-a562-27573d761925 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:37.157554 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bfdd7574-23ba-411f-a562-27573d761925 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] 10.222.0.33 "DELETE /compute/v2.1/flavors/736539574/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.013330 May 28 21:06:37.157554 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 558/1178] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:06:37 2022] DELETE /compute/v2.1/flavors/736539574/os-extra_specs/hw:numa_nodes => generated 124 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:37.157554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6035e742-17b3-4151-b2d3-bd33693dcaab tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:37.183402 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6035e742-17b3-4151-b2d3-bd33693dcaab tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors/736539574/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.029956 May 28 21:06:37.186467 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 559/1179] 10.222.0.33 () {60 vars in 1220 bytes} [Sat May 28 21:06:37 2022] POST /compute/v2.1/flavors/736539574/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:06:37.196056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7e0f5db-1309-4a6d-9ad0-d9fb7de68f2f tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:37.197599 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:37.197599 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:37.198839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d7e0f5db-1309-4a6d-9ad0-d9fb7de68f2f tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '8910a38cbd6048f4a9ced613a0cea707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bbd17227e84055827b4eff8bdac369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7e0f5db-1309-4a6d-9ad0-d9fb7de68f2f tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] Request method failure captured: May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: request: PUT /compute/v2.1/flavors/736539574/os-extra_specs/hw:numa_nodes HTTP/1.1 May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 22 May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko7bmAMCiaha8zU8XVjl0CWt0F7Zb-oWr9HtKsl3Z1FyYulaO-04GW7EjX5MGTtkTIK775dTl9rP8-sakEuGeWhXL07D85OZ-jaHk5rTG9K55fo6NWY5jMMrFEs8nUspsVI7V1AgjWwWcdlquI7IYQOd9vSYzOryfG4SfKrL9h-OlZ0 May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 86bbd17227e84055827b4eff8bdac369 May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:06:37.200990 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:06:37.210159 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_86bbd17227e84055827b4eff8bdac369", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/86bbd17227e84055827b4eff8bdac369"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/86bbd17227e84055827b4eff8bdac369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/86bbd17227e84055827b4eff8bdac369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:37.210159 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 May 28 21:06:37.210159 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 86bbd17227e84055827b4eff8bdac369 May 28 21:06:37.210159 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 May 28 21:06:37.210159 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project May 28 21:06:37.210159 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:37.210159 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:37.210159 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 8910a38cbd6048f4a9ced613a0cea707 May 28 21:06:37.210159 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project May 28 21:06:37.210159 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:06:37.210159 ncdv-master-1 devstack@n-api.service[143129]: {"hw:numa_nodes": "1"} May 28 21:06:37.210159 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:06:37.210159 ncdv-master-1 devstack@n-api.service[143129]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'flavor_id': '736539574', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:06:37.211013 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. May 28 21:06:37.212214 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.213285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7e0f5db-1309-4a6d-9ad0-d9fb7de68f2f tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:37.213285 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d7e0f5db-1309-4a6d-9ad0-d9fb7de68f2f tempest-FlavorsExtraSpecsNegativeTestJSON-827663626 tempest-FlavorsExtraSpecsNegativeTestJSON-827663626-project] 10.222.0.33 "PUT /compute/v2.1/flavors/736539574/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.010798 May 28 21:06:37.213285 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 560/1180] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:06:37 2022] PUT /compute/v2.1/flavors/736539574/os-extra_specs/hw:numa_nodes => generated 124 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) May 28 21:06:37.217200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d2989dc5-b8b1-473d-af8a-b68d435af593 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:37.226658 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-d2989dc5-b8b1-473d-af8a-b68d435af593 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] HTTP exception thrown: Flavor 736539574 has no extra specs with key hw:cpu_thread_policy. May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d2989dc5-b8b1-473d-af8a-b68d435af593 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] Request method failure captured: May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/flavors/736539574/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko7c7U3TDE9s9X1JL9cTYKtrvs4Jy3q4IulEvmDgb_twxfTbIJVm_P9f9zVmSUZiEpmXVe-D-rv9yiBL2C2FwJtxBUuRcAmYcTtG5lmCO9ojTpeuL_w_rbJHXxgMJwI2fh3s1ES4au4Mit7fvQal_yeMFxEPc9XiHJbi3t8DR6rMwzA May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 77d7e5834b944f059157c4cf0e8a4017 May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:06:37.228192 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:06:37.229497 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77d7e5834b944f059157c4cf0e8a4017", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77d7e5834b944f059157c4cf0e8a4017"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77d7e5834b944f059157c4cf0e8a4017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77d7e5834b944f059157c4cf0e8a4017"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:37.229497 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 May 28 21:06:37.229497 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 77d7e5834b944f059157c4cf0e8a4017 May 28 21:06:37.229497 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 May 28 21:06:37.229497 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin May 28 21:06:37.229497 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:37.229497 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:37.229497 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 0cf7dccf6c4442c58dbdca800b88fcfa May 28 21:06:37.229497 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin May 28 21:06:37.229497 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:06:37.229497 ncdv-master-1 devstack@n-api.service[143129]: exception: Flavor 736539574 has no extra specs with key hw:cpu_thread_policy. May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'flavor_id': '736539574', 'id': 'hw:cpu_thread_policy'} May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 736539574 has no extra specs with key hw:cpu_thread_policy. May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:37.230221 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.231591 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:37.231591 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:37.231591 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:37.231591 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:37.231591 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:37.231591 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 736539574 has no extra specs with key hw:cpu_thread_policy. May 28 21:06:37.231591 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.231591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d2989dc5-b8b1-473d-af8a-b68d435af593 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] Returning 404 to user: Flavor 736539574 has no extra specs with key hw:cpu_thread_policy. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:37.231591 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d2989dc5-b8b1-473d-af8a-b68d435af593 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/736539574/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.018072 May 28 21:06:37.231591 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 561/1181] 10.222.0.33 () {58 vars in 1265 bytes} [Sat May 28 21:06:37 2022] DELETE /compute/v2.1/flavors/736539574/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:37.240468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7b0ea8dc-4a48-4c5c-a5a7-764ba38e507f tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:37.242369 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-7b0ea8dc-4a48-4c5c-a5a7-764ba38e507f tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] HTTP exception thrown: Request body and URI mismatch May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7b0ea8dc-4a48-4c5c-a5a7-764ba38e507f tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] Request method failure captured: May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: request: PUT /compute/v2.1/flavors/736539574/os-extra_specs/hw:numa_nodes HTTP/1.1 May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 27 May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko7c7U3TDE9s9X1JL9cTYKtrvs4Jy3q4IulEvmDgb_twxfTbIJVm_P9f9zVmSUZiEpmXVe-D-rv9yiBL2C2FwJtxBUuRcAmYcTtG5lmCO9ojTpeuL_w_rbJHXxgMJwI2fh3s1ES4au4Mit7fvQal_yeMFxEPc9XiHJbi3t8DR6rMwzA May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 77d7e5834b944f059157c4cf0e8a4017 May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:06:37.243995 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:06:37.245287 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77d7e5834b944f059157c4cf0e8a4017", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77d7e5834b944f059157c4cf0e8a4017"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77d7e5834b944f059157c4cf0e8a4017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77d7e5834b944f059157c4cf0e8a4017"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:37.245287 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 May 28 21:06:37.245287 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 77d7e5834b944f059157c4cf0e8a4017 May 28 21:06:37.245287 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 May 28 21:06:37.245287 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin May 28 21:06:37.245287 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:37.245287 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:37.245287 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 0cf7dccf6c4442c58dbdca800b88fcfa May 28 21:06:37.245287 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin May 28 21:06:37.245287 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:06:37.245287 ncdv-master-1 devstack@n-api.service[143129]: {"hw:cpu_policy": "shared"} May 28 21:06:37.245287 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:06:37.245287 ncdv-master-1 devstack@n-api.service[143129]: exception: Request body and URI mismatch May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'flavor_id': '736539574', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:37.246081 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:37.247243 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:37.247243 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:37.247243 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch May 28 21:06:37.247243 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.247243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7b0ea8dc-4a48-4c5c-a5a7-764ba38e507f tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:37.247243 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7b0ea8dc-4a48-4c5c-a5a7-764ba38e507f tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/736539574/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.010106 May 28 21:06:37.251000 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 562/1182] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:06:37 2022] PUT /compute/v2.1/flavors/736539574/os-extra_specs/hw:numa_nodes => generated 73 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 21:06:37.256407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e09423ee-9483-4d6f-875e-5501348ee952 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e09423ee-9483-4d6f-875e-5501348ee952 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] Request method failure captured: May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: request: PUT /compute/v2.1/flavors/736539574/os-extra_specs/hw:numa_nodes HTTP/1.1 May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 49 May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko7c7U3TDE9s9X1JL9cTYKtrvs4Jy3q4IulEvmDgb_twxfTbIJVm_P9f9zVmSUZiEpmXVe-D-rv9yiBL2C2FwJtxBUuRcAmYcTtG5lmCO9ojTpeuL_w_rbJHXxgMJwI2fh3s1ES4au4Mit7fvQal_yeMFxEPc9XiHJbi3t8DR6rMwzA May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 77d7e5834b944f059157c4cf0e8a4017 May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:06:37.258971 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:06:37.260290 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77d7e5834b944f059157c4cf0e8a4017", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77d7e5834b944f059157c4cf0e8a4017"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77d7e5834b944f059157c4cf0e8a4017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77d7e5834b944f059157c4cf0e8a4017"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:37.260290 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 May 28 21:06:37.260290 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 77d7e5834b944f059157c4cf0e8a4017 May 28 21:06:37.260290 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 May 28 21:06:37.260290 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin May 28 21:06:37.260290 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:37.260290 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:37.260290 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 0cf7dccf6c4442c58dbdca800b88fcfa May 28 21:06:37.260290 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin May 28 21:06:37.260290 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:06:37.260290 ncdv-master-1 devstack@n-api.service[143129]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} May 28 21:06:37.260290 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'flavor_id': '736539574', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'minProperties': 1, May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': ['string', May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'number']}}, May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance: May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} May 28 21:06:37.261015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.262511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:37.265165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:37.265165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:37.265165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:06:37.265165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:06:37.265165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties May 28 21:06:37.265165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:37.265165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e09423ee-9483-4d6f-875e-5501348ee952 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:37.265165 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e09423ee-9483-4d6f-875e-5501348ee952 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] 10.222.0.33 "PUT /compute/v2.1/flavors/736539574/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.008315 May 28 21:06:37.265165 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 563/1183] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:06:37 2022] PUT /compute/v2.1/flavors/736539574/os-extra_specs/hw:numa_nodes => generated 117 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 21:06:37.271662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-df695480-c0c4-4c2d-9148-d7cc3df50e34 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:37.272431 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:37.272431 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:37.433680 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-df695480-c0c4-4c2d-9148-d7cc3df50e34 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/736539574" status: 202 len: 0 microversion: 2.1 time: 0.166275 May 28 21:06:37.434484 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 564/1184] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:06:37 2022] DELETE /compute/v2.1/flavors/736539574 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:37.441657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-282c01a3-390a-4ae5-a9c1-3ab3692f1b78 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:37.442789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-282c01a3-390a-4ae5-a9c1-3ab3692f1b78 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:37.450342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-282c01a3-390a-4ae5-a9c1-3ab3692f1b78 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:37.450886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-282c01a3-390a-4ae5-a9c1-3ab3692f1b78 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:37.452154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-282c01a3-390a-4ae5-a9c1-3ab3692f1b78 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:37.452670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-282c01a3-390a-4ae5-a9c1-3ab3692f1b78 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:37.458188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:37.663317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-088efc02-e6ad-47ce-8553-909202d08b23 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:37.681231 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-088efc02-e6ad-47ce-8553-909202d08b23 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1478 microversion: 2.1 time: 0.725603 May 28 21:06:37.682218 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 621/1185] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:36 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1478 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:37.698871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0ce51ae3-7215-41db-9ed4-687a0155b2dc tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:37.699749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0ce51ae3-7215-41db-9ed4-687a0155b2dc tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:37.708338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ce51ae3-7215-41db-9ed4-687a0155b2dc tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:37.708802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ce51ae3-7215-41db-9ed4-687a0155b2dc tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:37.709612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ce51ae3-7215-41db-9ed4-687a0155b2dc tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:37.710217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ce51ae3-7215-41db-9ed4-687a0155b2dc tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:37.744986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-282c01a3-390a-4ae5-a9c1-3ab3692f1b78 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:37.754038 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-282c01a3-390a-4ae5-a9c1-3ab3692f1b78 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.318062 May 28 21:06:37.757961 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 565/1186] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:37 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:37.764583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-179c8036-429e-418e-946d-b7df221b03ed tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:37.786306 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-179c8036-429e-418e-946d-b7df221b03ed tempest-FlavorsExtraSpecsNegativeTestJSON-114000195 tempest-FlavorsExtraSpecsNegativeTestJSON-114000195-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029747 May 28 21:06:37.787247 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 566/1187] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:37.792323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b20dff19-ae4d-452c-b4bc-9ce9dfcc7cb4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:37.793147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b20dff19-ae4d-452c-b4bc-9ce9dfcc7cb4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:37.800645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b20dff19-ae4d-452c-b4bc-9ce9dfcc7cb4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:37.801287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b20dff19-ae4d-452c-b4bc-9ce9dfcc7cb4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:37.805922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b20dff19-ae4d-452c-b4bc-9ce9dfcc7cb4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:37.805922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b20dff19-ae4d-452c-b4bc-9ce9dfcc7cb4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:37.977069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0ce51ae3-7215-41db-9ed4-687a0155b2dc tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:37.982596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:37.988934 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0ce51ae3-7215-41db-9ed4-687a0155b2dc tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1319 microversion: 2.1 time: 0.294144 May 28 21:06:37.992647 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 622/1188] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:37 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:38.009869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a608eb0a-de0e-4d89-9db1-b0c78e9d5534 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:38.013199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a608eb0a-de0e-4d89-9db1-b0c78e9d5534 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:38.046685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:38.054930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a608eb0a-de0e-4d89-9db1-b0c78e9d5534 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:38.057144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a608eb0a-de0e-4d89-9db1-b0c78e9d5534 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:38.060358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a608eb0a-de0e-4d89-9db1-b0c78e9d5534 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:38.062458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a608eb0a-de0e-4d89-9db1-b0c78e9d5534 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:38.117625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b20dff19-ae4d-452c-b4bc-9ce9dfcc7cb4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:38.130567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=14 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:38.135588 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b20dff19-ae4d-452c-b4bc-9ce9dfcc7cb4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1324 microversion: 2.1 time: 0.347068 May 28 21:06:38.145328 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 567/1189] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:37 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1324 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:38.150445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-c1dcab7e-08ab-475b-ac95-bff661cfb976 req-728fc078-3712-4baa-b879-4c6dc634fdc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd95c29-a1f5-4f51-bc41-28015bfd2bec", "name": "network-vif-unplugged", "status": "completed", "tag": "7b9b3936-54e0-461a-9a4b-6152d1b72738"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:38.162849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c1dcab7e-08ab-475b-ac95-bff661cfb976 req-728fc078-3712-4baa-b879-4c6dc634fdc6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:38.163313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c1dcab7e-08ab-475b-ac95-bff661cfb976 req-728fc078-3712-4baa-b879-4c6dc634fdc6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:38.175685 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-c1dcab7e-08ab-475b-ac95-bff661cfb976 req-728fc078-3712-4baa-b879-4c6dc634fdc6 service nova] Creating event network-vif-unplugged:7b9b3936-54e0-461a-9a4b-6152d1b72738 for instance edd95c29-a1f5-4f51-bc41-28015bfd2bec on nch2-master-1 May 28 21:06:38.181312 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-c1dcab7e-08ab-475b-ac95-bff661cfb976 req-728fc078-3712-4baa-b879-4c6dc634fdc6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034554 May 28 21:06:38.182191 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 568/1190] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:38.398709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a608eb0a-de0e-4d89-9db1-b0c78e9d5534 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:38.398709 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a608eb0a-de0e-4d89-9db1-b0c78e9d5534 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.399292 May 28 21:06:38.398709 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 623/1191] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:37 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:38.701302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-041f4073-44ba-4de0-8a12-f500f8814f21 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:38.702344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-041f4073-44ba-4de0-8a12-f500f8814f21 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:38.709252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-041f4073-44ba-4de0-8a12-f500f8814f21 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:38.710643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-041f4073-44ba-4de0-8a12-f500f8814f21 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:38.710643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-041f4073-44ba-4de0-8a12-f500f8814f21 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:38.711025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-041f4073-44ba-4de0-8a12-f500f8814f21 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:38.775942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f3d99343-3f72-4023-a826-b5f68b8f2fbd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:38.777217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f3d99343-3f72-4023-a826-b5f68b8f2fbd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:38.794384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3d99343-3f72-4023-a826-b5f68b8f2fbd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:38.795160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3d99343-3f72-4023-a826-b5f68b8f2fbd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:38.796157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3d99343-3f72-4023-a826-b5f68b8f2fbd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:38.796797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3d99343-3f72-4023-a826-b5f68b8f2fbd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:38.964972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-041f4073-44ba-4de0-8a12-f500f8814f21 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:38.977479 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-041f4073-44ba-4de0-8a12-f500f8814f21 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1478 microversion: 2.1 time: 0.281042 May 28 21:06:38.978074 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 569/1192] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:38 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1478 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:39.013929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-326af686-94c4-47c5-b660-e4d1d06819a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:39.019685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-326af686-94c4-47c5-b660-e4d1d06819a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:39.032497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-326af686-94c4-47c5-b660-e4d1d06819a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:39.035029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-326af686-94c4-47c5-b660-e4d1d06819a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:39.035620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-326af686-94c4-47c5-b660-e4d1d06819a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:39.036289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-326af686-94c4-47c5-b660-e4d1d06819a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:39.306161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f3d99343-3f72-4023-a826-b5f68b8f2fbd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:39.321396 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f3d99343-3f72-4023-a826-b5f68b8f2fbd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.545525 May 28 21:06:39.321396 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 624/1193] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:38 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:39.321667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-326af686-94c4-47c5-b660-e4d1d06819a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:39.327423 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-326af686-94c4-47c5-b660-e4d1d06819a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1319 microversion: 2.1 time: 0.322520 May 28 21:06:39.328248 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 570/1194] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:39 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:39.333765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6a5f3143-6b1d-4475-ac37-ddb68d80ef83 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:39.334651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6a5f3143-6b1d-4475-ac37-ddb68d80ef83 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:39.341225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a5f3143-6b1d-4475-ac37-ddb68d80ef83 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:39.341679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a5f3143-6b1d-4475-ac37-ddb68d80ef83 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:39.342875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a5f3143-6b1d-4475-ac37-ddb68d80ef83 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:39.343326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a5f3143-6b1d-4475-ac37-ddb68d80ef83 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:39.412203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-386802fd-d875-48c6-887f-89c220b18c93 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:39.419339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-386802fd-d875-48c6-887f-89c220b18c93 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:39.423450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-386802fd-d875-48c6-887f-89c220b18c93 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:39.424775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-386802fd-d875-48c6-887f-89c220b18c93 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:39.425581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-386802fd-d875-48c6-887f-89c220b18c93 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:39.426065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-386802fd-d875-48c6-887f-89c220b18c93 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:39.548547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6a5f3143-6b1d-4475-ac37-ddb68d80ef83 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:39.562825 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6a5f3143-6b1d-4475-ac37-ddb68d80ef83 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1521 microversion: 2.1 time: 0.243357 May 28 21:06:39.566141 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 625/1195] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:39 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:39.586026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-450c19cf-8362-4c3d-9566-2b27da54b71a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:39.586650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-450c19cf-8362-4c3d-9566-2b27da54b71a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:39.594028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-450c19cf-8362-4c3d-9566-2b27da54b71a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:39.594744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-450c19cf-8362-4c3d-9566-2b27da54b71a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:39.596964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-450c19cf-8362-4c3d-9566-2b27da54b71a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:39.599388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-450c19cf-8362-4c3d-9566-2b27da54b71a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:39.633909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-386802fd-d875-48c6-887f-89c220b18c93 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:39.649942 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-386802fd-d875-48c6-887f-89c220b18c93 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1542 microversion: 2.1 time: 0.234731 May 28 21:06:39.653998 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 571/1196] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:39 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1542 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:39.757347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-450c19cf-8362-4c3d-9566-2b27da54b71a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:39.778010 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-450c19cf-8362-4c3d-9566-2b27da54b71a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1521 microversion: 2.1 time: 0.184915 May 28 21:06:39.778010 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 626/1197] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:39 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:39.786310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f9af8cb9-8091-4eb7-8ebf-53c699726eda tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1457958539"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:39.788996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f9af8cb9-8091-4eb7-8ebf-53c699726eda tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:39.795892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9af8cb9-8091-4eb7-8ebf-53c699726eda tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:39.796619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9af8cb9-8091-4eb7-8ebf-53c699726eda tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:39.797468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9af8cb9-8091-4eb7-8ebf-53c699726eda tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:39.797998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9af8cb9-8091-4eb7-8ebf-53c699726eda tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:39.995306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d3a0b04a-71f6-45fd-9a19-179270680b34 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:39.996122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d3a0b04a-71f6-45fd-9a19-179270680b34 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:40.009887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3a0b04a-71f6-45fd-9a19-179270680b34 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:40.014876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3a0b04a-71f6-45fd-9a19-179270680b34 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:40.014876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3a0b04a-71f6-45fd-9a19-179270680b34 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:40.014876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3a0b04a-71f6-45fd-9a19-179270680b34 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:40.184262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d3a0b04a-71f6-45fd-9a19-179270680b34 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:40.192692 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d3a0b04a-71f6-45fd-9a19-179270680b34 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1478 microversion: 2.1 time: 0.201586 May 28 21:06:40.193281 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 627/1198] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:39 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1478 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:40.210389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-ff3ca3bb-1612-4763-88fa-f11b8da46f66 req-88712061-e1fc-4ac2-8674-aa71b8a4ed82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edd95c29-a1f5-4f51-bc41-28015bfd2bec", "name": "network-vif-plugged", "status": "completed", "tag": "7b9b3936-54e0-461a-9a4b-6152d1b72738"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:40.219290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ff3ca3bb-1612-4763-88fa-f11b8da46f66 req-88712061-e1fc-4ac2-8674-aa71b8a4ed82 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:40.219741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ff3ca3bb-1612-4763-88fa-f11b8da46f66 req-88712061-e1fc-4ac2-8674-aa71b8a4ed82 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:40.231785 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-ff3ca3bb-1612-4763-88fa-f11b8da46f66 req-88712061-e1fc-4ac2-8674-aa71b8a4ed82 service nova] Creating event network-vif-plugged:7b9b3936-54e0-461a-9a4b-6152d1b72738 for instance edd95c29-a1f5-4f51-bc41-28015bfd2bec on nch2-master-1 May 28 21:06:40.236631 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-ff3ca3bb-1612-4763-88fa-f11b8da46f66 req-88712061-e1fc-4ac2-8674-aa71b8a4ed82 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030640 May 28 21:06:40.238176 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 628/1199] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:40.338963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-405f4cb9-e7dd-454c-847d-7e6b43027b0c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:40.340654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-405f4cb9-e7dd-454c-847d-7e6b43027b0c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:40.354370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-405f4cb9-e7dd-454c-847d-7e6b43027b0c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:40.354857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-405f4cb9-e7dd-454c-847d-7e6b43027b0c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:40.355647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-405f4cb9-e7dd-454c-847d-7e6b43027b0c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:40.356101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-405f4cb9-e7dd-454c-847d-7e6b43027b0c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:40.593775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-405f4cb9-e7dd-454c-847d-7e6b43027b0c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:40.604127 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-405f4cb9-e7dd-454c-847d-7e6b43027b0c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.273131 May 28 21:06:40.604710 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 629/1200] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:40 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:40.619923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7fbfab36-eb16-42c7-92e9-80b771ddf3be tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:40.620550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7fbfab36-eb16-42c7-92e9-80b771ddf3be tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:40.627547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7fbfab36-eb16-42c7-92e9-80b771ddf3be tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:40.628667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7fbfab36-eb16-42c7-92e9-80b771ddf3be tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:40.629460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7fbfab36-eb16-42c7-92e9-80b771ddf3be tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:40.629936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7fbfab36-eb16-42c7-92e9-80b771ddf3be tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:40.701360 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f9af8cb9-8091-4eb7-8ebf-53c699726eda tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "POST /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c/action" status: 202 len: 0 microversion: 2.1 time: 0.921133 May 28 21:06:40.708681 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 572/1201] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:06:39 2022] POST /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c/action => generated 0 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 21:06:40.711243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-50d4f256-1258-4afa-882d-d7456f28defd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:40.712173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-50d4f256-1258-4afa-882d-d7456f28defd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:40.719545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50d4f256-1258-4afa-882d-d7456f28defd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:40.720153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50d4f256-1258-4afa-882d-d7456f28defd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:40.721360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50d4f256-1258-4afa-882d-d7456f28defd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:40.721627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50d4f256-1258-4afa-882d-d7456f28defd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:40.837714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7fbfab36-eb16-42c7-92e9-80b771ddf3be tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:40.846190 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7fbfab36-eb16-42c7-92e9-80b771ddf3be tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1319 microversion: 2.1 time: 0.230441 May 28 21:06:40.847097 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 630/1202] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:40 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:40.860170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8b158693-948c-4415-9e47-3c5d0ee5b4cd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '.version_select at 0x7f4d57fc0430>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:40.912596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-50d4f256-1258-4afa-882d-d7456f28defd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:40.921057 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-50d4f256-1258-4afa-882d-d7456f28defd tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1541 microversion: 2.1 time: 0.215724 May 28 21:06:40.921648 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 573/1203] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:40 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1541 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:41.210628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1eb59699-54b0-40d6-90b0-269513cd9ef8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:41.211294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1eb59699-54b0-40d6-90b0-269513cd9ef8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:41.219086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1eb59699-54b0-40d6-90b0-269513cd9ef8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:41.219893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1eb59699-54b0-40d6-90b0-269513cd9ef8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:41.220726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1eb59699-54b0-40d6-90b0-269513cd9ef8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:41.221286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1eb59699-54b0-40d6-90b0-269513cd9ef8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:41.370515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1eb59699-54b0-40d6-90b0-269513cd9ef8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:41.380519 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1eb59699-54b0-40d6-90b0-269513cd9ef8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1478 microversion: 2.1 time: 0.173897 May 28 21:06:41.386100 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 574/1204] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:41 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1478 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:41.509518 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8b158693-948c-4415-9e47-3c5d0ee5b4cd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "DELETE /compute/v2.1/images/b5268c12-e54c-4fb6-a607-9dd4c4b9a0b6" status: 204 len: 0 microversion: 2.1 time: 0.661031 May 28 21:06:41.510751 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 631/1205] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:40 2022] DELETE /compute/v2.1/images/b5268c12-e54c-4fb6-a607-9dd4c4b9a0b6 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:06:41.518842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e01b40b2-0578-42dc-b87b-e855da6e2ba2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '.version_select at 0x7f4d57ec6940>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:41.555484 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-e01b40b2-0578-42dc-b87b-e855da6e2ba2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] HTTP exception thrown: Image not found. May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e01b40b2-0578-42dc-b87b-e855da6e2ba2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Request method failure captured: May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/images/b5268c12-e54c-4fb6-a607-9dd4c4b9a0b6 HTTP/1.1 May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko6oq10ya0vKA7Lzgzw7qEixBB6oq9XwAAqnALDB3LxJ0Ou3iq7_g4aSSk-6F4p6-_hIGxM22vsmPp1vD-bx8iQQTYyEkSHfzi2JWR2mENOMe6ss5h_-1Ay7OrAERWJEEuMTwxRxM1yb64UuFpXocdkERI-wAfMoU5j69oLSNr7C4nA May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:06:41.556779 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:06:41.558597 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab0c1d6a9fc44de4af61822849b3bf8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:41.558597 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:41.558597 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:06:41.558597 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:41.558597 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:06:41.558597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:41.558597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:41.558597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: dc48535b672d4d1190ecfefe6cb02720 May 28 21:06:41.558597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:06:41.558597 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:06:41.558597 ncdv-master-1 devstack@n-api.service[143129]: exception: Image not found. May 28 21:06:41.558597 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'b5268c12-e54c-4fb6-a607-9dd4c4b9a0b6'} May 28 21:06:41.558597 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:06:41.559596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b5268c12-e54c-4fb6-a607-9dd4c4b9a0b6 May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:06:41.561000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b5268c12-e54c-4fb6-a607-9dd4c4b9a0b6 could not be found. May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:06:41.562925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:06:41.564321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:41.564321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:41.564321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 28 21:06:41.564321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:06:41.564321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:06:41.564321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:41.564321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:41.564321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:41.564321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:41.564321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:41.564321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:41.564321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:41.564321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:41.564321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:06:41.564321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:41.567900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e01b40b2-0578-42dc-b87b-e855da6e2ba2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Returning 404 to user: Image not found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:41.569157 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e01b40b2-0578-42dc-b87b-e855da6e2ba2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/images/b5268c12-e54c-4fb6-a607-9dd4c4b9a0b6" status: 404 len: 62 microversion: 2.1 time: 0.054262 May 28 21:06:41.570582 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 575/1206] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:06:41 2022] GET /compute/v2.1/images/b5268c12-e54c-4fb6-a607-9dd4c4b9a0b6 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:06:41.580594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f982a6aa-aed8-4ae1-812a-b9413c08fd0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:41.584205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f982a6aa-aed8-4ae1-812a-b9413c08fd0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:41.589531 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f982a6aa-aed8-4ae1-812a-b9413c08fd0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:41.590534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f982a6aa-aed8-4ae1-812a-b9413c08fd0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:41.591710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f982a6aa-aed8-4ae1-812a-b9413c08fd0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:41.592596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f982a6aa-aed8-4ae1-812a-b9413c08fd0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:41.621440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b9b17446-4ad3-4769-8a91-3c137edad22d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:41.622749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b9b17446-4ad3-4769-8a91-3c137edad22d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:41.637871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9b17446-4ad3-4769-8a91-3c137edad22d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:41.637871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9b17446-4ad3-4769-8a91-3c137edad22d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:41.637871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9b17446-4ad3-4769-8a91-3c137edad22d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:41.637871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9b17446-4ad3-4769-8a91-3c137edad22d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:41.979440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b9b17446-4ad3-4769-8a91-3c137edad22d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:41.980907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f982a6aa-aed8-4ae1-812a-b9413c08fd0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:41.990877 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f982a6aa-aed8-4ae1-812a-b9413c08fd0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1533 microversion: 2.1 time: 0.415777 May 28 21:06:41.994642 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 632/1207] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:41 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1533 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:42.003999 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b9b17446-4ad3-4769-8a91-3c137edad22d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.386672 May 28 21:06:42.006597 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 576/1208] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:41 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:42.010548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8f9b1e82-0fd9-452d-b208-1339700bc071 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:42.013313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8f9b1e82-0fd9-452d-b208-1339700bc071 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:42.018059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dea36510-f38c-454d-b2d1-8147a49aa2da tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:42.021179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dea36510-f38c-454d-b2d1-8147a49aa2da tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:42.033398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f9b1e82-0fd9-452d-b208-1339700bc071 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:42.034760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f9b1e82-0fd9-452d-b208-1339700bc071 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:42.036074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dea36510-f38c-454d-b2d1-8147a49aa2da tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:42.037435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f9b1e82-0fd9-452d-b208-1339700bc071 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:42.038186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f9b1e82-0fd9-452d-b208-1339700bc071 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:42.038865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dea36510-f38c-454d-b2d1-8147a49aa2da tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:42.043482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dea36510-f38c-454d-b2d1-8147a49aa2da tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:42.044181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dea36510-f38c-454d-b2d1-8147a49aa2da tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:42.417086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8f9b1e82-0fd9-452d-b208-1339700bc071 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:42.418087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dea36510-f38c-454d-b2d1-8147a49aa2da tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:42.425624 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dea36510-f38c-454d-b2d1-8147a49aa2da tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1541 microversion: 2.1 time: 0.417678 May 28 21:06:42.425904 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8f9b1e82-0fd9-452d-b208-1339700bc071 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1319 microversion: 2.1 time: 0.429763 May 28 21:06:42.438332 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 577/1209] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:42 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1541 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:42.438596 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 633/1210] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:41 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1319 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:42.438747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-7f432038-d8a7-4f5a-a40c-ed1bc391aa71 req-d03105b7-ceac-4a19-85fb-8aff5dbe3efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8294ac6-8d71-482c-8c67-67109bb03a2c", "name": "network-vif-plugged", "status": "completed", "tag": "570755cc-4cb9-4e9c-bf46-99cfda81d1b3"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:42.438873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3e89f0ba-53f2-46df-b609-27f853edb48f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:42.438873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3e89f0ba-53f2-46df-b609-27f853edb48f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:42.439146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e89f0ba-53f2-46df-b609-27f853edb48f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:42.439503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7f432038-d8a7-4f5a-a40c-ed1bc391aa71 req-d03105b7-ceac-4a19-85fb-8aff5dbe3efa service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:42.439964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7f432038-d8a7-4f5a-a40c-ed1bc391aa71 req-d03105b7-ceac-4a19-85fb-8aff5dbe3efa service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:42.440960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e89f0ba-53f2-46df-b609-27f853edb48f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:42.441751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e89f0ba-53f2-46df-b609-27f853edb48f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:42.442233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e89f0ba-53f2-46df-b609-27f853edb48f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:42.451698 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-7f432038-d8a7-4f5a-a40c-ed1bc391aa71 req-d03105b7-ceac-4a19-85fb-8aff5dbe3efa service nova] Creating event network-vif-plugged:570755cc-4cb9-4e9c-bf46-99cfda81d1b3 for instance c8294ac6-8d71-482c-8c67-67109bb03a2c on nch2-master-1 May 28 21:06:42.458384 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-7f432038-d8a7-4f5a-a40c-ed1bc391aa71 req-d03105b7-ceac-4a19-85fb-8aff5dbe3efa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029709 May 28 21:06:42.458384 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 578/1211] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:42.574486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-5a9613a1-cebc-424e-a224-d80956d9f1c2 req-b982c5a7-2e1d-4a72-bd36-4667b5b839bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394fe269-dd5e-4d4e-8f49-de1df1812e6a", "name": "network-vif-unplugged", "status": "completed", "tag": "e413ef97-3a02-48d0-ae33-341fafd919b8"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:42.584487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5a9613a1-cebc-424e-a224-d80956d9f1c2 req-b982c5a7-2e1d-4a72-bd36-4667b5b839bd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:42.633349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5a9613a1-cebc-424e-a224-d80956d9f1c2 req-b982c5a7-2e1d-4a72-bd36-4667b5b839bd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:42.633349 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-5a9613a1-cebc-424e-a224-d80956d9f1c2 req-b982c5a7-2e1d-4a72-bd36-4667b5b839bd service nova] Creating event network-vif-unplugged:e413ef97-3a02-48d0-ae33-341fafd919b8 for instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a on nch2-master-1 May 28 21:06:42.633349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-5a9613a1-cebc-424e-a224-d80956d9f1c2 req-b982c5a7-2e1d-4a72-bd36-4667b5b839bd service nova] Instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:06:42.633349 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-5a9613a1-cebc-424e-a224-d80956d9f1c2 req-b982c5a7-2e1d-4a72-bd36-4667b5b839bd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045384 May 28 21:06:42.633349 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 579/1212] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:06:42.637256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3e89f0ba-53f2-46df-b609-27f853edb48f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:42.646798 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3e89f0ba-53f2-46df-b609-27f853edb48f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1478 microversion: 2.1 time: 0.219048 May 28 21:06:42.647693 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 634/1213] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:42 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1478 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:43.012938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7f5dffc-a57a-4adf-9f7b-5d03307074f4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:43.018772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d7f5dffc-a57a-4adf-9f7b-5d03307074f4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:43.027817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7f5dffc-a57a-4adf-9f7b-5d03307074f4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:43.028033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cc51ce27-3941-4dad-9ffc-5a3471c52dd6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:43.029437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7f5dffc-a57a-4adf-9f7b-5d03307074f4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:43.029754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cc51ce27-3941-4dad-9ffc-5a3471c52dd6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:43.031321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7f5dffc-a57a-4adf-9f7b-5d03307074f4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:43.032279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7f5dffc-a57a-4adf-9f7b-5d03307074f4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:43.047796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc51ce27-3941-4dad-9ffc-5a3471c52dd6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:43.048517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc51ce27-3941-4dad-9ffc-5a3471c52dd6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:43.053267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc51ce27-3941-4dad-9ffc-5a3471c52dd6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:43.053267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc51ce27-3941-4dad-9ffc-5a3471c52dd6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:43.723724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d7f5dffc-a57a-4adf-9f7b-5d03307074f4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:43.731301 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d7f5dffc-a57a-4adf-9f7b-5d03307074f4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1533 microversion: 2.1 time: 0.723879 May 28 21:06:43.732574 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 580/1214] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:43 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1533 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:43.737746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eee94474-c891-4b09-90dc-49e9b534f9fb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:43.738652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eee94474-c891-4b09-90dc-49e9b534f9fb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:43.753668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eee94474-c891-4b09-90dc-49e9b534f9fb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:43.754164 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eee94474-c891-4b09-90dc-49e9b534f9fb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:43.756642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eee94474-c891-4b09-90dc-49e9b534f9fb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:43.758006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eee94474-c891-4b09-90dc-49e9b534f9fb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:43.766824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cc51ce27-3941-4dad-9ffc-5a3471c52dd6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:43.778640 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cc51ce27-3941-4dad-9ffc-5a3471c52dd6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.758575 May 28 21:06:43.793692 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 635/1215] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:43 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:43.793692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-41934d35-3fae-4bd2-a1e3-46eb7b6ef2c9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:43.793692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-41934d35-3fae-4bd2-a1e3-46eb7b6ef2c9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:43.824882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41934d35-3fae-4bd2-a1e3-46eb7b6ef2c9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:43.825381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41934d35-3fae-4bd2-a1e3-46eb7b6ef2c9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:43.826227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41934d35-3fae-4bd2-a1e3-46eb7b6ef2c9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:43.826685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41934d35-3fae-4bd2-a1e3-46eb7b6ef2c9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:44.147889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eee94474-c891-4b09-90dc-49e9b534f9fb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:44.150544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-41934d35-3fae-4bd2-a1e3-46eb7b6ef2c9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:44.158329 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eee94474-c891-4b09-90dc-49e9b534f9fb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1319 microversion: 2.1 time: 0.424467 May 28 21:06:44.159076 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-41934d35-3fae-4bd2-a1e3-46eb7b6ef2c9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1541 microversion: 2.1 time: 0.377858 May 28 21:06:44.160204 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 636/1216] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:43 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1541 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:44.170612 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 581/1217] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:43 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1319 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:44.175205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1f9715bf-345c-4918-85ad-8bada75c041d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:44.176069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1f9715bf-345c-4918-85ad-8bada75c041d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:44.180113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ac89d3dd-d975-4055-981b-6c6bd84848dc req-49af378d-fbdd-4c18-a4d4-b9e899f55df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a102552-9f3f-417b-a587-72cf6ee45088", "name": "network-vif-unplugged", "status": "completed", "tag": "e96b3cab-4dc1-4d01-a789-0983f750f285"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:44.183092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f9715bf-345c-4918-85ad-8bada75c041d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:44.183796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f9715bf-345c-4918-85ad-8bada75c041d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:44.184802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f9715bf-345c-4918-85ad-8bada75c041d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:44.185573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f9715bf-345c-4918-85ad-8bada75c041d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:44.210174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ac89d3dd-d975-4055-981b-6c6bd84848dc req-49af378d-fbdd-4c18-a4d4-b9e899f55df0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:44.210625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ac89d3dd-d975-4055-981b-6c6bd84848dc req-49af378d-fbdd-4c18-a4d4-b9e899f55df0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:44.263337 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ac89d3dd-d975-4055-981b-6c6bd84848dc req-49af378d-fbdd-4c18-a4d4-b9e899f55df0 service nova] Creating event network-vif-unplugged:e96b3cab-4dc1-4d01-a789-0983f750f285 for instance 6a102552-9f3f-417b-a587-72cf6ee45088 on nch1-master-1 May 28 21:06:44.275376 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ac89d3dd-d975-4055-981b-6c6bd84848dc req-49af378d-fbdd-4c18-a4d4-b9e899f55df0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110003 May 28 21:06:44.288615 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 582/1218] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:44.357278 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1f9715bf-345c-4918-85ad-8bada75c041d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:44.365909 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1f9715bf-345c-4918-85ad-8bada75c041d tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1463 microversion: 2.1 time: 0.204527 May 28 21:06:44.366531 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 637/1219] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:44 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1463 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:44.392965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-92e9c723-f45c-4847-842f-845507a69f60 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:44.394596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-92e9c723-f45c-4847-842f-845507a69f60 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:44.403472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92e9c723-f45c-4847-842f-845507a69f60 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:44.406519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92e9c723-f45c-4847-842f-845507a69f60 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:44.406519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92e9c723-f45c-4847-842f-845507a69f60 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:44.406519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92e9c723-f45c-4847-842f-845507a69f60 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:44.491892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a3b0ec28-81ed-4672-8b25-46c95ae9cc82 req-c31e124b-da55-4350-ad89-77a599b711cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00995a1-4fea-46e2-b9c9-7e0fd95d60dc", "name": "network-vif-plugged", "status": "completed", "tag": "13c4db0b-f2f9-4929-aa11-0599f0e9d8da"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:44.509548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a3b0ec28-81ed-4672-8b25-46c95ae9cc82 req-c31e124b-da55-4350-ad89-77a599b711cd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:44.511070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a3b0ec28-81ed-4672-8b25-46c95ae9cc82 req-c31e124b-da55-4350-ad89-77a599b711cd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:44.516828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:44.528426 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a3b0ec28-81ed-4672-8b25-46c95ae9cc82 req-c31e124b-da55-4350-ad89-77a599b711cd service nova] Creating event network-vif-plugged:13c4db0b-f2f9-4929-aa11-0599f0e9d8da for instance e00995a1-4fea-46e2-b9c9-7e0fd95d60dc on nch2-master-1 May 28 21:06:44.533338 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a3b0ec28-81ed-4672-8b25-46c95ae9cc82 req-c31e124b-da55-4350-ad89-77a599b711cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051326 May 28 21:06:44.534592 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 638/1220] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:44.635662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-083e9a62-1695-40d5-af13-06b525595e3e req-ac8a1b0d-ef46-4cc0-be3a-b26fa51b19a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394fe269-dd5e-4d4e-8f49-de1df1812e6a", "tag": "e413ef97-3a02-48d0-ae33-341fafd919b8"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:44.654179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-083e9a62-1695-40d5-af13-06b525595e3e req-ac8a1b0d-ef46-4cc0-be3a-b26fa51b19a0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:44.654179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-083e9a62-1695-40d5-af13-06b525595e3e req-ac8a1b0d-ef46-4cc0-be3a-b26fa51b19a0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:44.676013 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-083e9a62-1695-40d5-af13-06b525595e3e req-ac8a1b0d-ef46-4cc0-be3a-b26fa51b19a0 service nova] Creating event network-changed:e413ef97-3a02-48d0-ae33-341fafd919b8 for instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a on nch2-master-1 May 28 21:06:44.689287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-083e9a62-1695-40d5-af13-06b525595e3e req-ac8a1b0d-ef46-4cc0-be3a-b26fa51b19a0 service nova] Instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:06:44.699259 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-92e9c723-f45c-4847-842f-845507a69f60 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec/action" status: 202 len: 0 microversion: 2.1 time: 0.310761 May 28 21:06:44.700282 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 583/1221] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:06:44 2022] POST /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:44.711226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8da7d163-d569-4b7d-a224-9a5609f874fb tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:44.717313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8da7d163-d569-4b7d-a224-9a5609f874fb tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:44.724503 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-083e9a62-1695-40d5-af13-06b525595e3e req-ac8a1b0d-ef46-4cc0-be3a-b26fa51b19a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083456 May 28 21:06:44.726392 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 639/1222] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:44.732565 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8da7d163-d569-4b7d-a224-9a5609f874fb tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:44.732993 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8da7d163-d569-4b7d-a224-9a5609f874fb tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:44.733874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8da7d163-d569-4b7d-a224-9a5609f874fb tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:44.741360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8da7d163-d569-4b7d-a224-9a5609f874fb tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:44.765719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ec644252-a0d7-44f2-be29-4e5cbb7383da tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:44.772225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ec644252-a0d7-44f2-be29-4e5cbb7383da tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:44.790425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec644252-a0d7-44f2-be29-4e5cbb7383da tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:44.791541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec644252-a0d7-44f2-be29-4e5cbb7383da tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:44.798273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec644252-a0d7-44f2-be29-4e5cbb7383da tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:44.798273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec644252-a0d7-44f2-be29-4e5cbb7383da tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:44.818789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8da7d163-d569-4b7d-a224-9a5609f874fb tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:44.821653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8da7d163-d569-4b7d-a224-9a5609f874fb tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:44.823577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-8da7d163-d569-4b7d-a224-9a5609f874fb tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lazy-loading 'fault' on Instance uuid edd95c29-a1f5-4f51-bc41-28015bfd2bec {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:06:45.181802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ec644252-a0d7-44f2-be29-4e5cbb7383da tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:45.182342 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8da7d163-d569-4b7d-a224-9a5609f874fb tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1597 microversion: 2.1 time: 0.477649 May 28 21:06:45.183283 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 584/1223] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:44 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1597 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:45.188310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-078b08fe-a483-401e-993e-22572c1fa30d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:45.189090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-078b08fe-a483-401e-993e-22572c1fa30d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:45.191249 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ec644252-a0d7-44f2-be29-4e5cbb7383da tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1539 microversion: 2.1 time: 0.437011 May 28 21:06:45.196416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-078b08fe-a483-401e-993e-22572c1fa30d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.198862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-078b08fe-a483-401e-993e-22572c1fa30d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.198862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-078b08fe-a483-401e-993e-22572c1fa30d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.199844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-078b08fe-a483-401e-993e-22572c1fa30d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.201796 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 640/1224] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:44 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1539 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:45.400848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-feadd610-bb39-4935-b9fe-63a1d2ce1b6d tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Calling method '.version_select at 0x7f4d57f79a60>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:45.402009 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:45.402009 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:06:45.403700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-feadd610-bb39-4935-b9fe-63a1d2ce1b6d tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.404277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-feadd610-bb39-4935-b9fe-63a1d2ce1b6d tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.422582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-feadd610-bb39-4935-b9fe-63a1d2ce1b6d tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.424378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-feadd610-bb39-4935-b9fe-63a1d2ce1b6d tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.433528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-078b08fe-a483-401e-993e-22572c1fa30d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:45.453342 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-078b08fe-a483-401e-993e-22572c1fa30d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.262747 May 28 21:06:45.453342 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 585/1225] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:45 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:45.454411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ec5a663f-f959-447c-ba67-ef46c6162c19 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:45.455141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ec5a663f-f959-447c-ba67-ef46c6162c19 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:45.460736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-feadd610-bb39-4935-b9fe-63a1d2ce1b6d tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.461307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-feadd610-bb39-4935-b9fe-63a1d2ce1b6d tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.485612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec5a663f-f959-447c-ba67-ef46c6162c19 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.485760 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-feadd610-bb39-4935-b9fe-63a1d2ce1b6d tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.280738 May 28 21:06:45.487999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec5a663f-f959-447c-ba67-ef46c6162c19 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.493174 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 641/1226] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:45.493494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec5a663f-f959-447c-ba67-ef46c6162c19 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.493494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec5a663f-f959-447c-ba67-ef46c6162c19 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.501282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9068ea77-6a88-4ec9-a1c8-c6c377e8607d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:45.502314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9068ea77-6a88-4ec9-a1c8-c6c377e8607d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:45.509919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9068ea77-6a88-4ec9-a1c8-c6c377e8607d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.516298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9068ea77-6a88-4ec9-a1c8-c6c377e8607d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.516298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9068ea77-6a88-4ec9-a1c8-c6c377e8607d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.516298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9068ea77-6a88-4ec9-a1c8-c6c377e8607d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.518045 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:45.805379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ec5a663f-f959-447c-ba67-ef46c6162c19 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:45.809863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9068ea77-6a88-4ec9-a1c8-c6c377e8607d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:45.814485 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ec5a663f-f959-447c-ba67-ef46c6162c19 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1541 microversion: 2.1 time: 0.365461 May 28 21:06:45.815179 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 586/1227] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:45 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1541 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:45.819840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f6a337aa-573e-49d6-8b50-200925d39415 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:45.821067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f6a337aa-573e-49d6-8b50-200925d39415 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:45.825428 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9068ea77-6a88-4ec9-a1c8-c6c377e8607d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1319 microversion: 2.1 time: 0.335680 May 28 21:06:45.826232 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 642/1228] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:45 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:45.827579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6a337aa-573e-49d6-8b50-200925d39415 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.828113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6a337aa-573e-49d6-8b50-200925d39415 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.828991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6a337aa-573e-49d6-8b50-200925d39415 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.829536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6a337aa-573e-49d6-8b50-200925d39415 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.848868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-46f8ce09-bc39-41bd-baff-d48aa7dbaaf7 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Calling method '.version_select at 0x7f4d57fab160>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:45.848868 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:45.848868 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:06:45.848868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46f8ce09-bc39-41bd-baff-d48aa7dbaaf7 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.848868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46f8ce09-bc39-41bd-baff-d48aa7dbaaf7 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.861930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46f8ce09-bc39-41bd-baff-d48aa7dbaaf7 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.862639 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46f8ce09-bc39-41bd-baff-d48aa7dbaaf7 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.905477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46f8ce09-bc39-41bd-baff-d48aa7dbaaf7 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.905816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46f8ce09-bc39-41bd-baff-d48aa7dbaaf7 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.913336 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-46f8ce09-bc39-41bd-baff-d48aa7dbaaf7 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 591 microversion: 2.1 time: 0.074203 May 28 21:06:45.913976 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 643/1229] 10.222.0.33 () {58 vars in 1211 bytes} [Sat May 28 21:06:45 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 591 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:45.934794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-06c1d115-d2c8-4ea0-a060-930511455137 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Calling method '.version_select at 0x7f4d57fab040>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:45.945561 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:45.945561 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:06:45.945561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06c1d115-d2c8-4ea0-a060-930511455137 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.945561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06c1d115-d2c8-4ea0-a060-930511455137 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.954216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06c1d115-d2c8-4ea0-a060-930511455137 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.956901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06c1d115-d2c8-4ea0-a060-930511455137 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.968064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06c1d115-d2c8-4ea0-a060-930511455137 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.968517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06c1d115-d2c8-4ea0-a060-930511455137 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:45.975361 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-06c1d115-d2c8-4ea0-a060-930511455137 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.051705 May 28 21:06:45.976197 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 644/1230] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:45 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:45.989641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-30f98190-366b-4fd4-8c28-62f0b73105a4 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Calling method '.version_select at 0x7f4d57f4eca0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:45.991160 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:45.991160 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:06:45.993698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30f98190-366b-4fd4-8c28-62f0b73105a4 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:45.994659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30f98190-366b-4fd4-8c28-62f0b73105a4 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:46.009572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30f98190-366b-4fd4-8c28-62f0b73105a4 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:46.010076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30f98190-366b-4fd4-8c28-62f0b73105a4 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:46.028973 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-30f98190-366b-4fd4-8c28-62f0b73105a4 tempest-HypervisorAdminUnderV252Test-741287895 tempest-HypervisorAdminUnderV252Test-741287895-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.043138 May 28 21:06:46.030883 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 645/1231] 10.222.0.33 () {58 vars in 1208 bytes} [Sat May 28 21:06:45 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:06:46.085017 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f6a337aa-573e-49d6-8b50-200925d39415 tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec/action" status: 202 len: 0 microversion: 2.1 time: 0.268384 May 28 21:06:46.087175 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 587/1232] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:06:45 2022] POST /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:46.101969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-53af339f-03d4-410c-bffe-20bdc783607d tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:46.102605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-53af339f-03d4-410c-bffe-20bdc783607d tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:46.116776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53af339f-03d4-410c-bffe-20bdc783607d tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:46.117507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53af339f-03d4-410c-bffe-20bdc783607d tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:46.120217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53af339f-03d4-410c-bffe-20bdc783607d tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:46.121113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53af339f-03d4-410c-bffe-20bdc783607d tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:46.209537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-45d4a548-2e87-49a5-97c2-cb6c6945eb74 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:46.214392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-45d4a548-2e87-49a5-97c2-cb6c6945eb74 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:46.224608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-45d4a548-2e87-49a5-97c2-cb6c6945eb74 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:46.228163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-45d4a548-2e87-49a5-97c2-cb6c6945eb74 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:46.229070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-45d4a548-2e87-49a5-97c2-cb6c6945eb74 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:46.232947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-45d4a548-2e87-49a5-97c2-cb6c6945eb74 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:46.484597 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-53af339f-03d4-410c-bffe-20bdc783607d tempest-ServersAdminTestJSON-716552175 tempest-ServersAdminTestJSON-716552175-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1614 microversion: 2.1 time: 0.387838 May 28 21:06:46.498349 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 646/1233] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:46 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1614 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:46.504932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-ca116794-75b2-4453-80a5-3138a7488a60 req-a7a2cb20-e8a2-4b50-ab0b-3c8c51feb93d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a102552-9f3f-417b-a587-72cf6ee45088", "tag": "e96b3cab-4dc1-4d01-a789-0983f750f285"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:46.513364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ca116794-75b2-4453-80a5-3138a7488a60 req-a7a2cb20-e8a2-4b50-ab0b-3c8c51feb93d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:46.517761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ca116794-75b2-4453-80a5-3138a7488a60 req-a7a2cb20-e8a2-4b50-ab0b-3c8c51feb93d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:46.537407 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-ca116794-75b2-4453-80a5-3138a7488a60 req-a7a2cb20-e8a2-4b50-ab0b-3c8c51feb93d service nova] Creating event network-changed:e96b3cab-4dc1-4d01-a789-0983f750f285 for instance 6a102552-9f3f-417b-a587-72cf6ee45088 on nch1-master-1 May 28 21:06:46.543348 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-ca116794-75b2-4453-80a5-3138a7488a60 req-a7a2cb20-e8a2-4b50-ab0b-3c8c51feb93d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043598 May 28 21:06:46.548927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-45d4a548-2e87-49a5-97c2-cb6c6945eb74 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:46.550115 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 647/1234] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:46.559987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cc02ece1-7b5e-4f0b-886a-d130aa132407 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:46.560716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cc02ece1-7b5e-4f0b-886a-d130aa132407 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:46.570241 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-45d4a548-2e87-49a5-97c2-cb6c6945eb74 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1534 microversion: 2.1 time: 0.358944 May 28 21:06:46.576004 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 588/1235] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:46 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1534 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:46.580862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc02ece1-7b5e-4f0b-886a-d130aa132407 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:46.581345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc02ece1-7b5e-4f0b-886a-d130aa132407 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:46.582206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc02ece1-7b5e-4f0b-886a-d130aa132407 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:46.582654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc02ece1-7b5e-4f0b-886a-d130aa132407 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:46.591410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9b318e71-f117-4651-b8e3-db0d4701023f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:46.591939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9b318e71-f117-4651-b8e3-db0d4701023f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:46.616042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b318e71-f117-4651-b8e3-db0d4701023f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:46.616478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b318e71-f117-4651-b8e3-db0d4701023f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:46.618845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b318e71-f117-4651-b8e3-db0d4701023f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:46.619325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b318e71-f117-4651-b8e3-db0d4701023f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:46.731328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9b318e71-f117-4651-b8e3-db0d4701023f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:06:46.863071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cc02ece1-7b5e-4f0b-886a-d130aa132407 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:46.878387 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cc02ece1-7b5e-4f0b-886a-d130aa132407 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.326992 May 28 21:06:46.887917 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 648/1236] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:46 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:46.893239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0c4d3e23-d1ea-443c-8416-01dec9c7212c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:46.893922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0c4d3e23-d1ea-443c-8416-01dec9c7212c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:46.900401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c4d3e23-d1ea-443c-8416-01dec9c7212c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:46.900858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c4d3e23-d1ea-443c-8416-01dec9c7212c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:46.901700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c4d3e23-d1ea-443c-8416-01dec9c7212c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:46.902274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c4d3e23-d1ea-443c-8416-01dec9c7212c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:47.032440 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9b318e71-f117-4651-b8e3-db0d4701023f tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 204 len: 0 microversion: 2.1 time: 0.459759 May 28 21:06:47.035127 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 589/1237] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:06:46 2022] DELETE /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:06:47.048535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9dfa8d94-c07d-4cfb-8d32-c4348753f1fa tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:47.052148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9dfa8d94-c07d-4cfb-8d32-c4348753f1fa tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:47.067283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9dfa8d94-c07d-4cfb-8d32-c4348753f1fa tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:47.068956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9dfa8d94-c07d-4cfb-8d32-c4348753f1fa tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:47.070288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9dfa8d94-c07d-4cfb-8d32-c4348753f1fa tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:47.076460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9dfa8d94-c07d-4cfb-8d32-c4348753f1fa tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:47.214790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c4d3e23-d1ea-443c-8416-01dec9c7212c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:47.224784 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0c4d3e23-d1ea-443c-8416-01dec9c7212c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1473 microversion: 2.1 time: 0.335513 May 28 21:06:47.235569 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 649/1238] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:46 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1473 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:47.240610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5ad45d71-99a1-42e1-ac57-09d75d92008a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:47.241226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5ad45d71-99a1-42e1-ac57-09d75d92008a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:47.247989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ad45d71-99a1-42e1-ac57-09d75d92008a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:47.248377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ad45d71-99a1-42e1-ac57-09d75d92008a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:47.249155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ad45d71-99a1-42e1-ac57-09d75d92008a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:47.249596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ad45d71-99a1-42e1-ac57-09d75d92008a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:47.405333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9dfa8d94-c07d-4cfb-8d32-c4348753f1fa tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:47.420950 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9dfa8d94-c07d-4cfb-8d32-c4348753f1fa tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1468 microversion: 2.1 time: 0.382544 May 28 21:06:47.421720 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 590/1239] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:47 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1468 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:47.441955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b9853b2f-c2bb-46c3-a2c0-005f0c364c2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:47.443314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b9853b2f-c2bb-46c3-a2c0-005f0c364c2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: c8294ac6-8d71-482c-8c67-67109bb03a2c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:47.450721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:47.457195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9853b2f-c2bb-46c3-a2c0-005f0c364c2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:47.457815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9853b2f-c2bb-46c3-a2c0-005f0c364c2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:47.459324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9853b2f-c2bb-46c3-a2c0-005f0c364c2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:47.459932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9853b2f-c2bb-46c3-a2c0-005f0c364c2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:47.573444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5ad45d71-99a1-42e1-ac57-09d75d92008a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:47.584012 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5ad45d71-99a1-42e1-ac57-09d75d92008a tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1470 microversion: 2.1 time: 0.346605 May 28 21:06:47.585361 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 650/1240] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:47 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1470 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:47.592154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-54a2fd70-bf7a-4543-822e-519cc43c5118 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:47.593045 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-54a2fd70-bf7a-4543-822e-519cc43c5118 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:47.601109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54a2fd70-bf7a-4543-822e-519cc43c5118 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:47.605255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54a2fd70-bf7a-4543-822e-519cc43c5118 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:47.605255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54a2fd70-bf7a-4543-822e-519cc43c5118 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:47.605255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54a2fd70-bf7a-4543-822e-519cc43c5118 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:47.687494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b9853b2f-c2bb-46c3-a2c0-005f0c364c2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:47.718139 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b9853b2f-c2bb-46c3-a2c0-005f0c364c2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c" status: 200 len: 1469 microversion: 2.1 time: 0.281652 May 28 21:06:47.732908 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 591/1241] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:47 2022] GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c => generated 1469 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:47.756753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f761687e-353d-4399-ac29-1be62d49023b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:47.761527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f761687e-353d-4399-ac29-1be62d49023b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:47.762449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f761687e-353d-4399-ac29-1be62d49023b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Searching by: {'reservation_id': 'r-asy90hfn', 'deleted': False, 'project_id': '348fbbc628b44152b05362657c11230d'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:06:47.782159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f761687e-353d-4399-ac29-1be62d49023b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:47.782778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f761687e-353d-4399-ac29-1be62d49023b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:47.783819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f761687e-353d-4399-ac29-1be62d49023b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:47.784402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f761687e-353d-4399-ac29-1be62d49023b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:47.785383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-54a2fd70-bf7a-4543-822e-519cc43c5118 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:47.796832 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-54a2fd70-bf7a-4543-822e-519cc43c5118 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1521 microversion: 2.1 time: 0.208354 May 28 21:06:47.810288 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 651/1242] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:47 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:47.818223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6c4cf3bb-1505-4a56-aae8-cfac01269f8a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:47.819244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6c4cf3bb-1505-4a56-aae8-cfac01269f8a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:47.825376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c4cf3bb-1505-4a56-aae8-cfac01269f8a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:47.825878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c4cf3bb-1505-4a56-aae8-cfac01269f8a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:47.828123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c4cf3bb-1505-4a56-aae8-cfac01269f8a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:47.828968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c4cf3bb-1505-4a56-aae8-cfac01269f8a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:47.856928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6c4cf3bb-1505-4a56-aae8-cfac01269f8a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:06:47.945423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-f761687e-353d-4399-ac29-1be62d49023b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:06:48.043234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f761687e-353d-4399-ac29-1be62d49023b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:48.053460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f761687e-353d-4399-ac29-1be62d49023b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:48.054260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f761687e-353d-4399-ac29-1be62d49023b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:48.157625 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6c4cf3bb-1505-4a56-aae8-cfac01269f8a tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 204 len: 0 microversion: 2.1 time: 0.338007 May 28 21:06:48.157625 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 652/1243] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:06:47 2022] DELETE /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:06:48.175580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-11b1fe61-a8b2-489b-b9d1-4e586912a124 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:48.179858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-11b1fe61-a8b2-489b-b9d1-4e586912a124 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:48.195699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11b1fe61-a8b2-489b-b9d1-4e586912a124 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:48.197143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11b1fe61-a8b2-489b-b9d1-4e586912a124 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:48.200431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11b1fe61-a8b2-489b-b9d1-4e586912a124 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:48.200979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11b1fe61-a8b2-489b-b9d1-4e586912a124 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:48.213978 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f761687e-353d-4399-ac29-1be62d49023b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-asy90hfn" status: 200 len: 2930 microversion: 2.1 time: 0.464765 May 28 21:06:48.214703 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 592/1244] 10.222.0.33 () {58 vars in 1196 bytes} [Sat May 28 21:06:47 2022] GET /compute/v2.1/servers/detail?reservation_id=r-asy90hfn => generated 2930 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:48.230526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-6bebfd67-68fc-4b9c-95c4-e2cb50e220aa req-d2c94743-0ed6-4c48-bc76-48154e459993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c", "name": "network-vif-plugged", "status": "completed", "tag": "2269f399-6b32-420b-a415-074be4afe7f1"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:48.252601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6bebfd67-68fc-4b9c-95c4-e2cb50e220aa req-d2c94743-0ed6-4c48-bc76-48154e459993 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:48.252601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6bebfd67-68fc-4b9c-95c4-e2cb50e220aa req-d2c94743-0ed6-4c48-bc76-48154e459993 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:48.267489 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-6bebfd67-68fc-4b9c-95c4-e2cb50e220aa req-d2c94743-0ed6-4c48-bc76-48154e459993 service nova] Creating event network-vif-plugged:2269f399-6b32-420b-a415-074be4afe7f1 for instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c on nch2-master-1 May 28 21:06:48.274936 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-6bebfd67-68fc-4b9c-95c4-e2cb50e220aa req-d2c94743-0ed6-4c48-bc76-48154e459993 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058729 May 28 21:06:48.275960 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 593/1245] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:48.282642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7ea69612-39a8-4b91-ae47-2a3335891844 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:48.284487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7ea69612-39a8-4b91-ae47-2a3335891844 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:48.291048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ea69612-39a8-4b91-ae47-2a3335891844 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:48.291998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ea69612-39a8-4b91-ae47-2a3335891844 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:48.293189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ea69612-39a8-4b91-ae47-2a3335891844 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:48.294120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ea69612-39a8-4b91-ae47-2a3335891844 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:48.480020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-11b1fe61-a8b2-489b-b9d1-4e586912a124 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:48.483155 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7ea69612-39a8-4b91-ae47-2a3335891844 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:48.499014 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-11b1fe61-a8b2-489b-b9d1-4e586912a124 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.339738 May 28 21:06:48.501657 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7ea69612-39a8-4b91-ae47-2a3335891844 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1527 microversion: 2.1 time: 0.224138 May 28 21:06:48.506025 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 594/1246] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:48 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1527 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:48.506242 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 653/1247] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:48 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:48.513946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d54c1238-d447-4d73-a4a8-f0371d083a8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:48.514666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-df8a30b2-b632-4b8b-b4cd-48eb01a65473 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:48.515316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-df8a30b2-b632-4b8b-b4cd-48eb01a65473 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:48.530698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df8a30b2-b632-4b8b-b4cd-48eb01a65473 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:48.531222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df8a30b2-b632-4b8b-b4cd-48eb01a65473 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:48.532046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df8a30b2-b632-4b8b-b4cd-48eb01a65473 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:48.532493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df8a30b2-b632-4b8b-b4cd-48eb01a65473 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:48.559646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.compute.server_groups [None req-d54c1238-d447-4d73-a4a8-f0371d083a8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Querying cell fc53a60a-e345-4363-abb1-87c4d33bcbf6(cell1) for 2 instances {{(pid=143129) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 28 21:06:48.561006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d54c1238-d447-4d73-a4a8-f0371d083a8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:48.561456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d54c1238-d447-4d73-a4a8-f0371d083a8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:48.730916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-df8a30b2-b632-4b8b-b4cd-48eb01a65473 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:48.739400 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-df8a30b2-b632-4b8b-b4cd-48eb01a65473 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1473 microversion: 2.1 time: 0.234856 May 28 21:06:48.740009 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 654/1248] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:48 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1473 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:48.754688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-60902b66-1a89-40b0-b2b8-927942c73e4a tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b87de5c2-3b39-474a-950a-0a50a6da60be"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:48.756242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-60902b66-1a89-40b0-b2b8-927942c73e4a tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:48.763818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60902b66-1a89-40b0-b2b8-927942c73e4a tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:48.764630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60902b66-1a89-40b0-b2b8-927942c73e4a tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:48.765582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60902b66-1a89-40b0-b2b8-927942c73e4a tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:48.766155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60902b66-1a89-40b0-b2b8-927942c73e4a tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:48.847883 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d54c1238-d447-4d73-a4a8-f0371d083a8a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/05891d77-14b5-4196-bc2a-53cd5da97ab2" status: 200 len: 266 microversion: 2.1 time: 0.344511 May 28 21:06:48.853585 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 595/1249] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:06:48 2022] GET /compute/v2.1/os-server-groups/05891d77-14b5-4196-bc2a-53cd5da97ab2 => generated 266 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:48.859327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9e8e7b7f-bb89-4543-853c-9f755a5c7861 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:48.860549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9e8e7b7f-bb89-4543-853c-9f755a5c7861 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:48.866985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e8e7b7f-bb89-4543-853c-9f755a5c7861 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:48.868828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e8e7b7f-bb89-4543-853c-9f755a5c7861 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:48.869183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e8e7b7f-bb89-4543-853c-9f755a5c7861 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:48.869853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e8e7b7f-bb89-4543-853c-9f755a5c7861 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:49.030673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9e8e7b7f-bb89-4543-853c-9f755a5c7861 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:49.036281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:49.041220 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9e8e7b7f-bb89-4543-853c-9f755a5c7861 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1470 microversion: 2.1 time: 0.185912 May 28 21:06:49.042220 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 596/1250] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:48 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1470 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:49.055567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8c8eeb24-a5f2-4875-ba7e-23efda6d019d tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:49.058773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8c8eeb24-a5f2-4875-ba7e-23efda6d019d tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:49.063053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c8eeb24-a5f2-4875-ba7e-23efda6d019d tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:49.063525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c8eeb24-a5f2-4875-ba7e-23efda6d019d tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:49.064591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c8eeb24-a5f2-4875-ba7e-23efda6d019d tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:49.065043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c8eeb24-a5f2-4875-ba7e-23efda6d019d tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:49.304575 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8c8eeb24-a5f2-4875-ba7e-23efda6d019d tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 200 len: 1619 microversion: 2.1 time: 0.252622 May 28 21:06:49.305156 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 597/1251] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:49 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 1619 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:49.321309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5a5dbc6e-e260-447e-b995-ee7de7f9727d tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:49.321966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5a5dbc6e-e260-447e-b995-ee7de7f9727d tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] [instance: c8294ac6-8d71-482c-8c67-67109bb03a2c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:49.328228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a5dbc6e-e260-447e-b995-ee7de7f9727d tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:49.328691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a5dbc6e-e260-447e-b995-ee7de7f9727d tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:49.329470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a5dbc6e-e260-447e-b995-ee7de7f9727d tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:49.329943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a5dbc6e-e260-447e-b995-ee7de7f9727d tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:49.460499 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5a5dbc6e-e260-447e-b995-ee7de7f9727d tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c" status: 200 len: 1620 microversion: 2.1 time: 0.142679 May 28 21:06:49.461079 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 598/1252] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:49 2022] GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c => generated 1620 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:49.484107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ead56fd6-02d8-45fe-8021-dd05b3535d3b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Action: 'create', calling method: .version_select at 0x7f4d640515e0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-833362590", "policies": ["anti-affinity"]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:49.510208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ead56fd6-02d8-45fe-8021-dd05b3535d3b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:49.514722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ead56fd6-02d8-45fe-8021-dd05b3535d3b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:49.616182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ead56fd6-02d8-45fe-8021-dd05b3535d3b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:49.621852 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-60902b66-1a89-40b0-b2b8-927942c73e4a tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "POST /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.880578 May 28 21:06:49.624567 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 655/1253] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:06:48 2022] POST /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35/os-volume_attachments => generated 194 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:49.624705 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ead56fd6-02d8-45fe-8021-dd05b3535d3b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:49.644457 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ead56fd6-02d8-45fe-8021-dd05b3535d3b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.166189 May 28 21:06:49.645278 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 599/1254] 10.222.0.33 () {60 vars in 1173 bytes} [Sat May 28 21:06:49 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:06:49.648523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0d201206-94e6-47cc-948a-81d95bbe20a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:49.649805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0d201206-94e6-47cc-948a-81d95bbe20a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:49.659526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d201206-94e6-47cc-948a-81d95bbe20a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:49.660714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d201206-94e6-47cc-948a-81d95bbe20a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:49.661778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d201206-94e6-47cc-948a-81d95bbe20a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:49.662416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d201206-94e6-47cc-948a-81d95bbe20a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:49.673044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d99ee2ed-8e92-4ec9-8241-336dba14f23c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:49.673434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d99ee2ed-8e92-4ec9-8241-336dba14f23c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:49.682888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:49.686613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d99ee2ed-8e92-4ec9-8241-336dba14f23c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:49.687075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d99ee2ed-8e92-4ec9-8241-336dba14f23c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:49.687857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d99ee2ed-8e92-4ec9-8241-336dba14f23c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:49.690026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d99ee2ed-8e92-4ec9-8241-336dba14f23c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:49.962467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d99ee2ed-8e92-4ec9-8241-336dba14f23c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:49.978020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0d201206-94e6-47cc-948a-81d95bbe20a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:49.981636 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d99ee2ed-8e92-4ec9-8241-336dba14f23c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.310021 May 28 21:06:49.988496 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0d201206-94e6-47cc-948a-81d95bbe20a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1527 microversion: 2.1 time: 0.360746 May 28 21:06:49.992248 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 600/1255] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:49 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:49.998628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3ea14981-7382-442e-99b9-f12b071b86be tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:49.999397 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 656/1256] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:49 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1527 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:49.999932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3ea14981-7382-442e-99b9-f12b071b86be tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:50.004676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-445804354", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "76eccd07-0c0f-48cd-978a-907ba89aa17f"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:50.008745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ea14981-7382-442e-99b9-f12b071b86be tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:50.009322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ea14981-7382-442e-99b9-f12b071b86be tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:50.010272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ea14981-7382-442e-99b9-f12b071b86be tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:50.010786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ea14981-7382-442e-99b9-f12b071b86be tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:50.081692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:06:50.284791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3ea14981-7382-442e-99b9-f12b071b86be tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:50.304107 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3ea14981-7382-442e-99b9-f12b071b86be tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1473 microversion: 2.1 time: 0.309410 May 28 21:06:50.304685 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 601/1257] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:49 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1473 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:50.309204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e168e96e-d58b-4a3f-b099-d584dab81fd8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:50.309818 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e168e96e-d58b-4a3f-b099-d584dab81fd8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:50.328198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e168e96e-d58b-4a3f-b099-d584dab81fd8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:50.328670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e168e96e-d58b-4a3f-b099-d584dab81fd8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:50.329524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e168e96e-d58b-4a3f-b099-d584dab81fd8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:50.329996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e168e96e-d58b-4a3f-b099-d584dab81fd8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:50.451033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:06:50.451588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:06:50.452085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:06:50.452868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:06:50.453349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:06:50.486391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:50.486775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:50.490351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:50.492295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:50.532907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:50.543480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:50.574232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Going to run 2 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:06:50.579500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 65edf30b-24d4-4341-b899-05f4e390d727] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:06:50.631934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e168e96e-d58b-4a3f-b099-d584dab81fd8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:50.641209 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e168e96e-d58b-4a3f-b099-d584dab81fd8 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1470 microversion: 2.1 time: 0.335372 May 28 21:06:50.651464 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 602/1258] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:50 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1470 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:50.715535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:50.718381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:50.722504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:50.813237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:50.820378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:50.835616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=65edf30b-24d4-4341-b899-05f4e390d727,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:06:50.982025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:50.988899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:51.006884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5cc0e3ff-47b1-45c5-9d3f-5e35c7684eee tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:51.009816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5cc0e3ff-47b1-45c5-9d3f-5e35c7684eee tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:51.018414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cc0e3ff-47b1-45c5-9d3f-5e35c7684eee tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:51.018964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cc0e3ff-47b1-45c5-9d3f-5e35c7684eee tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:51.019814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cc0e3ff-47b1-45c5-9d3f-5e35c7684eee tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:51.020269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cc0e3ff-47b1-45c5-9d3f-5e35c7684eee tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:51.173937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:51.182345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:51.209549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5cc0e3ff-47b1-45c5-9d3f-5e35c7684eee tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:51.223151 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5cc0e3ff-47b1-45c5-9d3f-5e35c7684eee tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.227297 May 28 21:06:51.226398 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 603/1259] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:50 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:51.237864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7b2d5a85-a41e-4f89-b4a1-1fbf931ab981 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:51.238792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7b2d5a85-a41e-4f89-b4a1-1fbf931ab981 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:51.247020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b2d5a85-a41e-4f89-b4a1-1fbf931ab981 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:51.247977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b2d5a85-a41e-4f89-b4a1-1fbf931ab981 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:51.248991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b2d5a85-a41e-4f89-b4a1-1fbf931ab981 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:51.249448 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b2d5a85-a41e-4f89-b4a1-1fbf931ab981 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:51.254490 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b92c1827-548c-4449-ba33-0fe261cadc39 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.253746 May 28 21:06:51.255445 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 657/1260] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:49 2022] POST /compute/v2.1/servers => generated 32 bytes in 1255 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 28 21:06:51.269529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2c444287-79f0-4157-9b8e-c03e80790cff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:51.275225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2c444287-79f0-4157-9b8e-c03e80790cff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:51.276401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2c444287-79f0-4157-9b8e-c03e80790cff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Searching by: {'deleted': False, 'project_id': '348fbbc628b44152b05362657c11230d'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:06:51.301248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c444287-79f0-4157-9b8e-c03e80790cff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:51.301821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c444287-79f0-4157-9b8e-c03e80790cff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:51.304152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c444287-79f0-4157-9b8e-c03e80790cff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:51.304688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c444287-79f0-4157-9b8e-c03e80790cff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:51.415255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-2c444287-79f0-4157-9b8e-c03e80790cff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:06:51.516539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7b2d5a85-a41e-4f89-b4a1-1fbf931ab981 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:51.520010 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2c444287-79f0-4157-9b8e-c03e80790cff tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.255961 May 28 21:06:51.526996 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 658/1261] 10.222.0.33 () {58 vars in 1124 bytes} [Sat May 28 21:06:51 2022] GET /compute/v2.1/servers => generated 1664 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:51.528434 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7b2d5a85-a41e-4f89-b4a1-1fbf931ab981 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1527 microversion: 2.1 time: 0.300149 May 28 21:06:51.529106 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 604/1262] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:51 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1527 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:51.533476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ddf22b47-8aa3-4a67-83a3-09a1f08679e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:51.535081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ddf22b47-8aa3-4a67-83a3-09a1f08679e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:51.542687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddf22b47-8aa3-4a67-83a3-09a1f08679e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:51.543281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddf22b47-8aa3-4a67-83a3-09a1f08679e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:51.544429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddf22b47-8aa3-4a67-83a3-09a1f08679e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:51.545946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddf22b47-8aa3-4a67-83a3-09a1f08679e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:51.546304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-60918b7f-d3d3-4df3-84eb-5320141df54e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:51.547002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-60918b7f-d3d3-4df3-84eb-5320141df54e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:51.627132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-60918b7f-d3d3-4df3-84eb-5320141df54e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:51.635590 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-60918b7f-d3d3-4df3-84eb-5320141df54e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1218 microversion: 2.1 time: 0.094154 May 28 21:06:51.636517 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 605/1263] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:51 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:51.741028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ddf22b47-8aa3-4a67-83a3-09a1f08679e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:51.750527 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ddf22b47-8aa3-4a67-83a3-09a1f08679e2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1473 microversion: 2.1 time: 0.226163 May 28 21:06:51.760142 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 659/1264] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:51 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1473 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:51.760142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-435c1672-1bbf-46da-81ce-73d5257458db tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:51.760142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-435c1672-1bbf-46da-81ce-73d5257458db tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:51.768872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-435c1672-1bbf-46da-81ce-73d5257458db tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:51.769451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-435c1672-1bbf-46da-81ce-73d5257458db tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:51.775083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-435c1672-1bbf-46da-81ce-73d5257458db tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:51.775083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-435c1672-1bbf-46da-81ce-73d5257458db tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:51.852174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-720c8fca-635e-431e-a8ae-57895c27f746 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Calling method '.version_select at 0x7f4d64101550>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:51.853360 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:51.853360 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:51.861944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-720c8fca-635e-431e-a8ae-57895c27f746 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:51.861944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-720c8fca-635e-431e-a8ae-57895c27f746 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:51.887473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-720c8fca-635e-431e-a8ae-57895c27f746 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:51.887961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-720c8fca-635e-431e-a8ae-57895c27f746 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:51.914564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-720c8fca-635e-431e-a8ae-57895c27f746 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:51.915195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-720c8fca-635e-431e-a8ae-57895c27f746 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:51.934748 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-720c8fca-635e-431e-a8ae-57895c27f746 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.296968 May 28 21:06:51.943039 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 606/1265] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:52.133657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-435c1672-1bbf-46da-81ce-73d5257458db tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:52.133657 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-435c1672-1bbf-46da-81ce-73d5257458db tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1470 microversion: 2.1 time: 0.307646 May 28 21:06:52.133657 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 660/1266] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:51 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:52.136742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bcbbd89d-969b-4f19-aae0-df10976f2144 tempest-HypervisorAdminNegativeUnderV252Test-824048707 tempest-HypervisorAdminNegativeUnderV252Test-824048707-project] Calling method '.version_select at 0x7f4d640ae280>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:52.136742 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:52.136742 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:52.136742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bcbbd89d-969b-4f19-aae0-df10976f2144 tempest-HypervisorAdminNegativeUnderV252Test-824048707 tempest-HypervisorAdminNegativeUnderV252Test-824048707-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '2c5305ed9fd24f47837af1bba69fc591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee29dc0114c40db834365213c650e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:52.136742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bcbbd89d-969b-4f19-aae0-df10976f2144 tempest-HypervisorAdminNegativeUnderV252Test-824048707 tempest-HypervisorAdminNegativeUnderV252Test-824048707-project] Request method failure captured: May 28 21:06:52.136742 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/os-hypervisors/nch1-master-1/search HTTP/1.1 May 28 21:06:52.136742 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:52.136742 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:52.136742 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko7qdq92CqnjILLxGYjfMm7IdLxGAa_z60yPSCCzByuaziL99eUGK5sscEUktvF0njEw_m_pD-SUGHk902iNGREuF25NCIafCXRZq9YMeid0ln450lwQFqBkcQ49JaqWMREZVM95b67H8_-CH86I9TuxxhYFSkXytV0JoC2ADUSUHOM May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 0ee29dc0114c40db834365213c650e4f May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-824048707 May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:06:52.137649 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0ee29dc0114c40db834365213c650e4f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ee29dc0114c40db834365213c650e4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0ee29dc0114c40db834365213c650e4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ee29dc0114c40db834365213c650e4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-824048707 May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 0ee29dc0114c40db834365213c650e4f May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-824048707 May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-824048707-project May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 2c5305ed9fd24f47837af1bba69fc591 May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-824048707-project May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'nch1-master-1'} May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) May 28 21:06:52.139033 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:52.141056 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:52.142832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:06:52.142832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:06:52.142832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. May 28 21:06:52.142832 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:52.142832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bcbbd89d-969b-4f19-aae0-df10976f2144 tempest-HypervisorAdminNegativeUnderV252Test-824048707 tempest-HypervisorAdminNegativeUnderV252Test-824048707-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:52.142832 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bcbbd89d-969b-4f19-aae0-df10976f2144 tempest-HypervisorAdminNegativeUnderV252Test-824048707 tempest-HypervisorAdminNegativeUnderV252Test-824048707-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.174916 May 28 21:06:52.142832 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 607/1267] 10.222.0.33 () {58 vars in 1208 bytes} [Sat May 28 21:06:51 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 176 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:52.143964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-64672da1-e868-4098-ba62-fef4b1798b6c tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Calling method '.version_select at 0x7f4d57f79310>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:52.143964 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:52.143964 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:06:52.143964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64672da1-e868-4098-ba62-fef4b1798b6c tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:52.143964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64672da1-e868-4098-ba62-fef4b1798b6c tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:52.149620 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-64672da1-e868-4098-ba62-fef4b1798b6c tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-64672da1-e868-4098-ba62-fef4b1798b6c tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Request method failure captured: May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko7r0SWehk_zZWBgT5Uz0ObbaZ8FtkOJbkiTPcGDatk_3ccKZVg8QsNAfPJeBuU1FajFXosPBnr9pGwteHGXquz_ajew8XxzDwP2hX5-fLYfO7oAz9fLuN3WL8kKK3SitxZenufKEwHsaRGa2uGgyBszynMxRsjLEZYg6puZC22x0MM May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 4d1e18a0cfbd4121a5ba7029a17a2b69 May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-153748745 May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:06:52.151277 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:06:52.153222 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4d1e18a0cfbd4121a5ba7029a17a2b69", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d1e18a0cfbd4121a5ba7029a17a2b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4d1e18a0cfbd4121a5ba7029a17a2b69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d1e18a0cfbd4121a5ba7029a17a2b69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:52.153222 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-153748745 May 28 21:06:52.153222 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 4d1e18a0cfbd4121a5ba7029a17a2b69 May 28 21:06:52.153222 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-153748745 May 28 21:06:52.153222 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin May 28 21:06:52.153222 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:06:52.153222 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:06:52.153222 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 06a07acde5ee46d399370f77db5ba5c9 May 28 21:06:52.153222 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin May 28 21:06:52.153222 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:06:52.153222 ncdv-master-1 devstack@n-api.service[143128]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 28 21:06:52.153222 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'nonexistent_hypervisor_name'} May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:52.154675 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:52.159081 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:52.159081 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:52.159081 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:52.159081 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. May 28 21:06:52.159081 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:52.159081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-64672da1-e868-4098-ba62-fef4b1798b6c tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:52.159081 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-64672da1-e868-4098-ba62-fef4b1798b6c tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.021580 May 28 21:06:52.159081 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 661/1268] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 21:06:52 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:52.166159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d61b6472-d6d0-4b37-9393-2b00a3c57999 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Calling method '.version_select at 0x7f4d57f05940>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:52.167182 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:52.167182 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:52.169961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d61b6472-d6d0-4b37-9393-2b00a3c57999 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:52.170450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d61b6472-d6d0-4b37-9393-2b00a3c57999 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:52.192391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d61b6472-d6d0-4b37-9393-2b00a3c57999 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:52.192862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d61b6472-d6d0-4b37-9393-2b00a3c57999 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:52.208756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d61b6472-d6d0-4b37-9393-2b00a3c57999 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:52.209625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d61b6472-d6d0-4b37-9393-2b00a3c57999 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:52.219738 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d61b6472-d6d0-4b37-9393-2b00a3c57999 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.059366 May 28 21:06:52.221399 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 608/1269] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:06:52 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:52.231880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aba54181-3281-4b52-8269-b8f8f1323b08 tempest-HypervisorAdminNegativeUnderV252Test-824048707 tempest-HypervisorAdminNegativeUnderV252Test-824048707-project] Calling method '.version_select at 0x7f4d6419d160>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:52.232775 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:52.232775 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:06:52.234739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aba54181-3281-4b52-8269-b8f8f1323b08 tempest-HypervisorAdminNegativeUnderV252Test-824048707 tempest-HypervisorAdminNegativeUnderV252Test-824048707-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '2c5305ed9fd24f47837af1bba69fc591', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee29dc0114c40db834365213c650e4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aba54181-3281-4b52-8269-b8f8f1323b08 tempest-HypervisorAdminNegativeUnderV252Test-824048707 tempest-HypervisorAdminNegativeUnderV252Test-824048707-project] Request method failure captured: May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko7qdq92CqnjILLxGYjfMm7IdLxGAa_z60yPSCCzByuaziL99eUGK5sscEUktvF0njEw_m_pD-SUGHk902iNGREuF25NCIafCXRZq9YMeid0ln450lwQFqBkcQ49JaqWMREZVM95b67H8_-CH86I9TuxxhYFSkXytV0JoC2ADUSUHOM May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0ee29dc0114c40db834365213c650e4f May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-824048707 May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:06:52.236785 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:06:52.239037 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0ee29dc0114c40db834365213c650e4f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ee29dc0114c40db834365213c650e4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0ee29dc0114c40db834365213c650e4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ee29dc0114c40db834365213c650e4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:52.239037 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-824048707 May 28 21:06:52.239037 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0ee29dc0114c40db834365213c650e4f May 28 21:06:52.239037 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-824048707 May 28 21:06:52.239037 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-824048707-project May 28 21:06:52.239037 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:06:52.239037 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:06:52.239037 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 2c5305ed9fd24f47837af1bba69fc591 May 28 21:06:52.239037 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-824048707-project May 28 21:06:52.239037 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:06:52.239037 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 28 21:06:52.239037 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '1'} May 28 21:06:52.239037 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:06:52.239922 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. May 28 21:06:52.241076 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:52.243849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aba54181-3281-4b52-8269-b8f8f1323b08 tempest-HypervisorAdminNegativeUnderV252Test-824048707 tempest-HypervisorAdminNegativeUnderV252Test-824048707-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:52.244836 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aba54181-3281-4b52-8269-b8f8f1323b08 tempest-HypervisorAdminNegativeUnderV252Test-824048707 tempest-HypervisorAdminNegativeUnderV252Test-824048707-project] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.017270 May 28 21:06:52.249386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ce7b4aef-505b-4a16-bed1-2be1f354fa5e req-5e23621c-eb2a-4077-b0a2-01cf540ea6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c", "name": "network-vif-unplugged", "status": "completed", "tag": "2269f399-6b32-420b-a415-074be4afe7f1"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:52.253396 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 662/1270] 10.222.0.33 () {58 vars in 1175 bytes} [Sat May 28 21:06:52 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:52.259871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ce7b4aef-505b-4a16-bed1-2be1f354fa5e req-5e23621c-eb2a-4077-b0a2-01cf540ea6e1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:52.271499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ce7b4aef-505b-4a16-bed1-2be1f354fa5e req-5e23621c-eb2a-4077-b0a2-01cf540ea6e1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:52.271795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f956aea5-9730-4dac-904c-aef3d0bae2fa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:52.271795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f956aea5-9730-4dac-904c-aef3d0bae2fa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:52.272387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f956aea5-9730-4dac-904c-aef3d0bae2fa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:52.272747 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ce7b4aef-505b-4a16-bed1-2be1f354fa5e req-5e23621c-eb2a-4077-b0a2-01cf540ea6e1 service nova] Creating event network-vif-unplugged:2269f399-6b32-420b-a415-074be4afe7f1 for instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c on nch2-master-1 May 28 21:06:52.272972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f956aea5-9730-4dac-904c-aef3d0bae2fa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:52.274015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f956aea5-9730-4dac-904c-aef3d0bae2fa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:52.274475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f956aea5-9730-4dac-904c-aef3d0bae2fa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:52.278286 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ce7b4aef-505b-4a16-bed1-2be1f354fa5e req-5e23621c-eb2a-4077-b0a2-01cf540ea6e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034631 May 28 21:06:52.278911 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 609/1271] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:52.285493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7e20e39a-7631-4d41-bbbb-eef6bbead4e5 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Calling method '.version_select at 0x7f4d640aeee0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:52.286428 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:06:52.286428 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:06:52.287631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e20e39a-7631-4d41-bbbb-eef6bbead4e5 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:52.288099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e20e39a-7631-4d41-bbbb-eef6bbead4e5 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:52.302825 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-7e20e39a-7631-4d41-bbbb-eef6bbead4e5 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] HTTP exception thrown: No hypervisor matching '553aaf4b-7478-4498-bb87-2c79daa22116' could be found. May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7e20e39a-7631-4d41-bbbb-eef6bbead4e5 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Request method failure captured: May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/os-hypervisors/553aaf4b-7478-4498-bb87-2c79daa22116/servers HTTP/1.1 May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko7r0SWehk_zZWBgT5Uz0ObbaZ8FtkOJbkiTPcGDatk_3ccKZVg8QsNAfPJeBuU1FajFXosPBnr9pGwteHGXquz_ajew8XxzDwP2hX5-fLYfO7oAz9fLuN3WL8kKK3SitxZenufKEwHsaRGa2uGgyBszynMxRsjLEZYg6puZC22x0MM May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 4d1e18a0cfbd4121a5ba7029a17a2b69 May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-153748745 May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:06:52.304385 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:06:52.305698 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4d1e18a0cfbd4121a5ba7029a17a2b69", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d1e18a0cfbd4121a5ba7029a17a2b69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4d1e18a0cfbd4121a5ba7029a17a2b69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4d1e18a0cfbd4121a5ba7029a17a2b69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:52.305698 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-153748745 May 28 21:06:52.305698 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 4d1e18a0cfbd4121a5ba7029a17a2b69 May 28 21:06:52.305698 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-153748745 May 28 21:06:52.305698 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin May 28 21:06:52.305698 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:06:52.305698 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:06:52.305698 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 06a07acde5ee46d399370f77db5ba5c9 May 28 21:06:52.305698 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin May 28 21:06:52.305698 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:06:52.305698 ncdv-master-1 devstack@n-api.service[143129]: exception: No hypervisor matching '553aaf4b-7478-4498-bb87-2c79daa22116' could be found. May 28 21:06:52.305698 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '553aaf4b-7478-4498-bb87-2c79daa22116'} May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '553aaf4b-7478-4498-bb87-2c79daa22116' could be found. May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:52.306487 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:52.307867 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:52.307867 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:52.307867 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:52.307867 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:52.307867 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '553aaf4b-7478-4498-bb87-2c79daa22116' could be found. May 28 21:06:52.307867 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:06:52.307867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7e20e39a-7631-4d41-bbbb-eef6bbead4e5 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] Returning 404 to user: No hypervisor matching '553aaf4b-7478-4498-bb87-2c79daa22116' could be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:52.307867 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7e20e39a-7631-4d41-bbbb-eef6bbead4e5 tempest-HypervisorAdminNegativeUnderV252Test-153748745 tempest-HypervisorAdminNegativeUnderV252Test-153748745-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors/553aaf4b-7478-4498-bb87-2c79daa22116/servers" status: 404 len: 123 microversion: 2.1 time: 0.025570 May 28 21:06:52.307867 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 610/1272] 10.222.0.33 () {58 vars in 1280 bytes} [Sat May 28 21:06:52 2022] GET /compute/v2.1/os-hypervisors/553aaf4b-7478-4498-bb87-2c79daa22116/servers => generated 123 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:52.447822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f956aea5-9730-4dac-904c-aef3d0bae2fa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:52.456248 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f956aea5-9730-4dac-904c-aef3d0bae2fa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.200726 May 28 21:06:52.456828 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 663/1273] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:52 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:52.546769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a8e1de5f-a09d-418c-a8e1-9cda94e45845 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:52.547545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a8e1de5f-a09d-418c-a8e1-9cda94e45845 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:52.555179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8e1de5f-a09d-418c-a8e1-9cda94e45845 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:52.555672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8e1de5f-a09d-418c-a8e1-9cda94e45845 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:52.556671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8e1de5f-a09d-418c-a8e1-9cda94e45845 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:52.557126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8e1de5f-a09d-418c-a8e1-9cda94e45845 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:52.669261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6a8c7dbc-ac75-4076-826e-dcbcd0eda7ac tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:52.671438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6a8c7dbc-ac75-4076-826e-dcbcd0eda7ac tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:52.870044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6a8c7dbc-ac75-4076-826e-dcbcd0eda7ac tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:52.885297 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6a8c7dbc-ac75-4076-826e-dcbcd0eda7ac tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1218 microversion: 2.1 time: 0.232753 May 28 21:06:52.895324 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 664/1274] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:52 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1218 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:52.895324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aa20e40e-edec-479b-9323-f92319ed6647 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:52.895324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aa20e40e-edec-479b-9323-f92319ed6647 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:52.910720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa20e40e-edec-479b-9323-f92319ed6647 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:52.911189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa20e40e-edec-479b-9323-f92319ed6647 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:52.912141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa20e40e-edec-479b-9323-f92319ed6647 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:52.912595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa20e40e-edec-479b-9323-f92319ed6647 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:52.920045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a8e1de5f-a09d-418c-a8e1-9cda94e45845 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:52.933661 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a8e1de5f-a09d-418c-a8e1-9cda94e45845 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1527 microversion: 2.1 time: 0.390645 May 28 21:06:52.942213 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 611/1275] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:52 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1527 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:53.083155 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-75c027a9-0e85-4c86-a79a-7e35acb9545e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:53.083983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-75c027a9-0e85-4c86-a79a-7e35acb9545e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:53.093125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75c027a9-0e85-4c86-a79a-7e35acb9545e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:53.093542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75c027a9-0e85-4c86-a79a-7e35acb9545e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:53.094798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75c027a9-0e85-4c86-a79a-7e35acb9545e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:53.095450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75c027a9-0e85-4c86-a79a-7e35acb9545e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:53.500699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aa20e40e-edec-479b-9323-f92319ed6647 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:53.511877 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aa20e40e-edec-479b-9323-f92319ed6647 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1470 microversion: 2.1 time: 0.624375 May 28 21:06:53.526834 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 665/1276] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:52 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1470 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:53.532274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-64649ff6-4cf0-4b6d-9c6e-4677451a927c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:53.537947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-64649ff6-4cf0-4b6d-9c6e-4677451a927c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:53.540005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64649ff6-4cf0-4b6d-9c6e-4677451a927c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:53.540705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64649ff6-4cf0-4b6d-9c6e-4677451a927c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:53.541771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64649ff6-4cf0-4b6d-9c6e-4677451a927c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:53.542471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64649ff6-4cf0-4b6d-9c6e-4677451a927c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:53.578076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-75c027a9-0e85-4c86-a79a-7e35acb9545e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:53.593164 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-75c027a9-0e85-4c86-a79a-7e35acb9545e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1470 microversion: 2.1 time: 0.515758 May 28 21:06:53.594182 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 612/1277] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:53 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1470 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:53.611576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-21d82237-2a98-458f-8869-90951ed7575b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:53.612739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-21d82237-2a98-458f-8869-90951ed7575b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:53.619816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21d82237-2a98-458f-8869-90951ed7575b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:53.620348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21d82237-2a98-458f-8869-90951ed7575b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:53.621146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21d82237-2a98-458f-8869-90951ed7575b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:53.621596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21d82237-2a98-458f-8869-90951ed7575b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:53.663957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21d82237-2a98-458f-8869-90951ed7575b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:53.664817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21d82237-2a98-458f-8869-90951ed7575b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:53.665906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21d82237-2a98-458f-8869-90951ed7575b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:53.666571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21d82237-2a98-458f-8869-90951ed7575b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:53.694531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-21d82237-2a98-458f-8869-90951ed7575b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Getting quotas for project d6c38a96a96b4fba9e41ac58f5054803. Resources: {'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:53.700440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-21d82237-2a98-458f-8869-90951ed7575b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Getting quotas for user c14b965da64c40e382c69050ba01b183 and project d6c38a96a96b4fba9e41ac58f5054803. Resources: {'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:53.804121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-64649ff6-4cf0-4b6d-9c6e-4677451a927c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:53.816922 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-64649ff6-4cf0-4b6d-9c6e-4677451a927c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.288510 May 28 21:06:53.818696 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 666/1278] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:53 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:53.907088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-045d90a2-9dfc-47af-a77f-2a56e6d81777 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:53.908152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-045d90a2-9dfc-47af-a77f-2a56e6d81777 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:53.998404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-045d90a2-9dfc-47af-a77f-2a56e6d81777 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:54.009889 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-045d90a2-9dfc-47af-a77f-2a56e6d81777 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1218 microversion: 2.1 time: 0.111243 May 28 21:06:54.014899 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 667/1279] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:53 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:54.035043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f7b8a107-3b05-4dac-bc27-c892527f7ddd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:54.036205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f7b8a107-3b05-4dac-bc27-c892527f7ddd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:54.043867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7b8a107-3b05-4dac-bc27-c892527f7ddd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:54.045279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7b8a107-3b05-4dac-bc27-c892527f7ddd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:54.046145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7b8a107-3b05-4dac-bc27-c892527f7ddd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:54.046600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7b8a107-3b05-4dac-bc27-c892527f7ddd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:54.151510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f7b8a107-3b05-4dac-bc27-c892527f7ddd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:54.162387 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f7b8a107-3b05-4dac-bc27-c892527f7ddd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1485 microversion: 2.1 time: 0.145379 May 28 21:06:54.165705 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 668/1280] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:54 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1485 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:54.191068 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-21d82237-2a98-458f-8869-90951ed7575b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "POST /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a/action" status: 202 len: 0 microversion: 2.1 time: 0.595137 May 28 21:06:54.192516 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 613/1281] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:06:53 2022] POST /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:54.213307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5d092464-97f1-43a5-9931-2b531f9d6502 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:54.215050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5d092464-97f1-43a5-9931-2b531f9d6502 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:54.220281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-cd8700d1-421c-4986-a05a-6d6c46eb6631 req-0be8e1cf-22f8-4684-81fa-6bd12e38f34b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c", "name": "network-vif-deleted", "tag": "2269f399-6b32-420b-a415-074be4afe7f1"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:54.235359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d092464-97f1-43a5-9931-2b531f9d6502 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:54.235359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d092464-97f1-43a5-9931-2b531f9d6502 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:54.247297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d092464-97f1-43a5-9931-2b531f9d6502 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:54.249063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d092464-97f1-43a5-9931-2b531f9d6502 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:54.261582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cd8700d1-421c-4986-a05a-6d6c46eb6631 req-0be8e1cf-22f8-4684-81fa-6bd12e38f34b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:54.262074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cd8700d1-421c-4986-a05a-6d6c46eb6631 req-0be8e1cf-22f8-4684-81fa-6bd12e38f34b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:54.291200 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-cd8700d1-421c-4986-a05a-6d6c46eb6631 req-0be8e1cf-22f8-4684-81fa-6bd12e38f34b service nova] Creating event network-vif-deleted:2269f399-6b32-420b-a415-074be4afe7f1 for instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c on nch2-master-1 May 28 21:06:54.310065 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-cd8700d1-421c-4986-a05a-6d6c46eb6631 req-0be8e1cf-22f8-4684-81fa-6bd12e38f34b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109212 May 28 21:06:54.311395 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 669/1282] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:54.335277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-80d98161-8702-48a9-92d7-2e8c5c340d85 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:54.336167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-80d98161-8702-48a9-92d7-2e8c5c340d85 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:54.344230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80d98161-8702-48a9-92d7-2e8c5c340d85 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:54.344963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80d98161-8702-48a9-92d7-2e8c5c340d85 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:54.345831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80d98161-8702-48a9-92d7-2e8c5c340d85 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:54.347007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80d98161-8702-48a9-92d7-2e8c5c340d85 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:54.410238 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-80d98161-8702-48a9-92d7-2e8c5c340d85 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082940 May 28 21:06:54.411283 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 670/1283] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:06:54 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:54.416694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-f3b2a688-19c2-4ff1-a4b2-a3a0f0d794e0 req-4a838da8-73f7-42da-af47-6556ab0ed03d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a766b99-b948-437d-bfa4-c52ecacf655b", "name": "network-vif-deleted", "tag": "3fdc6be3-cd61-493b-9106-470af1db7080"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:54.425719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f3b2a688-19c2-4ff1-a4b2-a3a0f0d794e0 req-4a838da8-73f7-42da-af47-6556ab0ed03d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:54.430389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f3b2a688-19c2-4ff1-a4b2-a3a0f0d794e0 req-4a838da8-73f7-42da-af47-6556ab0ed03d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:54.453979 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-f3b2a688-19c2-4ff1-a4b2-a3a0f0d794e0 req-4a838da8-73f7-42da-af47-6556ab0ed03d service nova] Creating event network-vif-deleted:3fdc6be3-cd61-493b-9106-470af1db7080 for instance 8a766b99-b948-437d-bfa4-c52ecacf655b on nch2-master-1 May 28 21:06:54.460605 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-f3b2a688-19c2-4ff1-a4b2-a3a0f0d794e0 req-4a838da8-73f7-42da-af47-6556ab0ed03d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048035 May 28 21:06:54.464609 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 671/1284] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:54.477620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0ca69edc-c752-4d97-9c48-ba70e58d5813 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:54.478260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0ca69edc-c752-4d97-9c48-ba70e58d5813 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:54.498606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ca69edc-c752-4d97-9c48-ba70e58d5813 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:54.499143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ca69edc-c752-4d97-9c48-ba70e58d5813 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:54.499756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ca69edc-c752-4d97-9c48-ba70e58d5813 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:54.500198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ca69edc-c752-4d97-9c48-ba70e58d5813 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:54.641425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5d092464-97f1-43a5-9931-2b531f9d6502 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:54.646374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:54.654095 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5d092464-97f1-43a5-9931-2b531f9d6502 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1469 microversion: 2.1 time: 0.457926 May 28 21:06:54.656029 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 614/1285] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:54 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1469 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:54.660691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-0ca69edc-c752-4d97-9c48-ba70e58d5813 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lazy-loading 'services' on Instance uuid df8268d1-36f2-4747-aa81-f6181ea36c35 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:06:54.667929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-32a0d46e-798c-4426-b68b-90edbf7d65fc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:54.670564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-32a0d46e-798c-4426-b68b-90edbf7d65fc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:54.687628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32a0d46e-798c-4426-b68b-90edbf7d65fc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:54.688996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32a0d46e-798c-4426-b68b-90edbf7d65fc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:54.692149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32a0d46e-798c-4426-b68b-90edbf7d65fc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:54.693096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32a0d46e-798c-4426-b68b-90edbf7d65fc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:55.036402 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0ca69edc-c752-4d97-9c48-ba70e58d5813 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35/os-volume_attachments/b87de5c2-3b39-474a-950a-0a50a6da60be" status: 202 len: 0 microversion: 2.1 time: 0.570224 May 28 21:06:55.037483 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 672/1286] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:06:54 2022] DELETE /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35/os-volume_attachments/b87de5c2-3b39-474a-950a-0a50a6da60be => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:06:55.043776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-61631428-228d-4cb4-a5ee-55f9d7f747d1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:55.044984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-61631428-228d-4cb4-a5ee-55f9d7f747d1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:55.054426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61631428-228d-4cb4-a5ee-55f9d7f747d1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:55.058907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61631428-228d-4cb4-a5ee-55f9d7f747d1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:55.060293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61631428-228d-4cb4-a5ee-55f9d7f747d1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:55.060948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61631428-228d-4cb4-a5ee-55f9d7f747d1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:55.152573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-32a0d46e-798c-4426-b68b-90edbf7d65fc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:55.167055 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-32a0d46e-798c-4426-b68b-90edbf7d65fc tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 200 len: 1299 microversion: 2.1 time: 0.509774 May 28 21:06:55.177309 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 615/1287] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:54 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 1299 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:55.182760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-118f567f-70d5-40d3-8ed9-2345f5efeef3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:55.184663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-118f567f-70d5-40d3-8ed9-2345f5efeef3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:55.191000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-118f567f-70d5-40d3-8ed9-2345f5efeef3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:55.192310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-118f567f-70d5-40d3-8ed9-2345f5efeef3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:55.193781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-118f567f-70d5-40d3-8ed9-2345f5efeef3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:55.194416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-118f567f-70d5-40d3-8ed9-2345f5efeef3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:55.440750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-118f567f-70d5-40d3-8ed9-2345f5efeef3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:55.449649 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-118f567f-70d5-40d3-8ed9-2345f5efeef3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1270 microversion: 2.1 time: 0.270872 May 28 21:06:55.450268 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 616/1288] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:55 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1270 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:55.455011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-9a2b7999-da51-4ce7-bed8-16803c4feadb req-689e90f1-482b-479b-aa13-cc776060d4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394fe269-dd5e-4d4e-8f49-de1df1812e6a", "name": "network-vif-plugged", "status": "completed", "tag": "e413ef97-3a02-48d0-ae33-341fafd919b8"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:55.463165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9a2b7999-da51-4ce7-bed8-16803c4feadb req-689e90f1-482b-479b-aa13-cc776060d4e7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:55.463616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9a2b7999-da51-4ce7-bed8-16803c4feadb req-689e90f1-482b-479b-aa13-cc776060d4e7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:55.475628 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-9a2b7999-da51-4ce7-bed8-16803c4feadb req-689e90f1-482b-479b-aa13-cc776060d4e7 service nova] Creating event network-vif-plugged:e413ef97-3a02-48d0-ae33-341fafd919b8 for instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a on nch2-master-1 May 28 21:06:55.478774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-61631428-228d-4cb4-a5ee-55f9d7f747d1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:55.481109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-9a2b7999-da51-4ce7-bed8-16803c4feadb req-689e90f1-482b-479b-aa13-cc776060d4e7 service nova] Instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:06:55.487933 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-61631428-228d-4cb4-a5ee-55f9d7f747d1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.449126 May 28 21:06:55.488535 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 673/1289] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:55 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:55.492402 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-9a2b7999-da51-4ce7-bed8-16803c4feadb req-689e90f1-482b-479b-aa13-cc776060d4e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040962 May 28 21:06:55.493262 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 617/1290] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:06:55.498049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9d044d3f-53bd-417a-a34a-cee8702afebf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:55.498670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9d044d3f-53bd-417a-a34a-cee8702afebf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:55.505347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d044d3f-53bd-417a-a34a-cee8702afebf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:55.505828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d044d3f-53bd-417a-a34a-cee8702afebf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:55.506655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d044d3f-53bd-417a-a34a-cee8702afebf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:55.507094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d044d3f-53bd-417a-a34a-cee8702afebf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:55.540378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d044d3f-53bd-417a-a34a-cee8702afebf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:55.540833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d044d3f-53bd-417a-a34a-cee8702afebf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:55.541348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-9d044d3f-53bd-417a-a34a-cee8702afebf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lazy-loading 'fault' on Instance uuid 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:06:55.585956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9d044d3f-53bd-417a-a34a-cee8702afebf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:55.593959 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9d044d3f-53bd-417a-a34a-cee8702afebf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 200 len: 1314 microversion: 2.1 time: 0.104245 May 28 21:06:55.594586 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 674/1291] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:55 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 1314 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:55.673604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ce503b22-909e-4a64-a474-9bc7797cc16d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:55.675165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ce503b22-909e-4a64-a474-9bc7797cc16d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:55.678830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:55.683096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce503b22-909e-4a64-a474-9bc7797cc16d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:55.689391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce503b22-909e-4a64-a474-9bc7797cc16d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:55.689391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce503b22-909e-4a64-a474-9bc7797cc16d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:55.689391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce503b22-909e-4a64-a474-9bc7797cc16d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:55.886309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ce503b22-909e-4a64-a474-9bc7797cc16d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:55.894120 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ce503b22-909e-4a64-a474-9bc7797cc16d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1469 microversion: 2.1 time: 0.225346 May 28 21:06:55.894704 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 618/1292] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:55 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1469 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:56.185891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ac0e1a2c-de86-48b6-a6ea-bb38e99b4d12 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:56.186665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ac0e1a2c-de86-48b6-a6ea-bb38e99b4d12 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: 8a766b99-b948-437d-bfa4-c52ecacf655b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:56.199971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac0e1a2c-de86-48b6-a6ea-bb38e99b4d12 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:56.201412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac0e1a2c-de86-48b6-a6ea-bb38e99b4d12 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:56.203723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac0e1a2c-de86-48b6-a6ea-bb38e99b4d12 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:56.213453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac0e1a2c-de86-48b6-a6ea-bb38e99b4d12 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:56.223132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cd46d04c-a9c2-42d9-9264-d374ca043d2e tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:56.224933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cd46d04c-a9c2-42d9-9264-d374ca043d2e tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:56.234724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd46d04c-a9c2-42d9-9264-d374ca043d2e tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:56.235766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd46d04c-a9c2-42d9-9264-d374ca043d2e tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:56.236727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd46d04c-a9c2-42d9-9264-d374ca043d2e tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:56.237365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd46d04c-a9c2-42d9-9264-d374ca043d2e tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:56.253047 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-ac0e1a2c-de86-48b6-a6ea-bb38e99b4d12 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] HTTP exception thrown: Instance 8a766b99-b948-437d-bfa4-c52ecacf655b could not be found. May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ac0e1a2c-de86-48b6-a6ea-bb38e99b4d12 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Request method failure captured: May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b HTTP/1.1 May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5b4uBTSgdPdO3qaKB0CFqOB9VgPoqLFeq3stVjxdwuLJxpegESGQBrjvjdTRm3DSkH1r9IZEbISnNIg_2y_ycYn_e2V0eWYnitfWdawTtr3ROXwppCWOzRt_X9kPmxY857RYe0NWPwWMjVbxqyyRNenNSmMIgujt5rqZN7mk0AZY4 May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 56e1dc5556624e2fb8de8a030c34c334 May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersAdminTestJSON-191015418 May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:06:56.260363 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:06:56.261753 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56e1dc5556624e2fb8de8a030c34c334", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56e1dc5556624e2fb8de8a030c34c334"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56e1dc5556624e2fb8de8a030c34c334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56e1dc5556624e2fb8de8a030c34c334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:56.261753 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersAdminTestJSON-191015418 May 28 21:06:56.261753 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 56e1dc5556624e2fb8de8a030c34c334 May 28 21:06:56.261753 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersAdminTestJSON-191015418 May 28 21:06:56.261753 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersAdminTestJSON-191015418-project May 28 21:06:56.261753 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:06:56.261753 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:06:56.261753 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 478d1609aa114d16b338e07d2d4c05c9 May 28 21:06:56.261753 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersAdminTestJSON-191015418-project May 28 21:06:56.261753 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:06:56.261753 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 8a766b99-b948-437d-bfa4-c52ecacf655b could not be found. May 28 21:06:56.261753 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '8a766b99-b948-437d-bfa4-c52ecacf655b'} May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a766b99-b948-437d-bfa4-c52ecacf655b could not be found. May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:56.263153 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a766b99-b948-437d-bfa4-c52ecacf655b could not be found. May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a766b99-b948-437d-bfa4-c52ecacf655b could not be found. May 28 21:06:56.264345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:56.265487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ac0e1a2c-de86-48b6-a6ea-bb38e99b4d12 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Returning 404 to user: Instance 8a766b99-b948-437d-bfa4-c52ecacf655b could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:56.265487 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ac0e1a2c-de86-48b6-a6ea-bb38e99b4d12 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b" status: 404 len: 111 microversion: 2.1 time: 0.084815 May 28 21:06:56.269097 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 675/1293] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:56 2022] GET /compute/v2.1/servers/8a766b99-b948-437d-bfa4-c52ecacf655b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:56.282144 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cd46d04c-a9c2-42d9-9264-d374ca043d2e tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064944 May 28 21:06:56.284896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-af2b10cf-c6b6-4364-a39e-3f8a7d31bc5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:56.285724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-af2b10cf-c6b6-4364-a39e-3f8a7d31bc5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:56.288042 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 619/1294] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:06:56 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:06:56.296502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af2b10cf-c6b6-4364-a39e-3f8a7d31bc5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:56.297322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af2b10cf-c6b6-4364-a39e-3f8a7d31bc5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:56.298561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af2b10cf-c6b6-4364-a39e-3f8a7d31bc5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:56.299468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af2b10cf-c6b6-4364-a39e-3f8a7d31bc5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:56.332699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-af2b10cf-c6b6-4364-a39e-3f8a7d31bc5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:06:56.467171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-706ce10b-dede-4598-b362-66e6109870c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:56.467975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-706ce10b-dede-4598-b362-66e6109870c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:56.475002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-706ce10b-dede-4598-b362-66e6109870c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:56.475588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-706ce10b-dede-4598-b362-66e6109870c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:56.476633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-706ce10b-dede-4598-b362-66e6109870c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:56.477266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-706ce10b-dede-4598-b362-66e6109870c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:56.506390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:56.624199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-706ce10b-dede-4598-b362-66e6109870c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:56.635454 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-706ce10b-dede-4598-b362-66e6109870c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1278 microversion: 2.1 time: 0.172193 May 28 21:06:56.648162 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 620/1295] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:56 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1278 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:06:56.656823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b40853b8-4007-4d80-bec4-fcaf7062d922 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:56.657519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b40853b8-4007-4d80-bec4-fcaf7062d922 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:56.673694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b40853b8-4007-4d80-bec4-fcaf7062d922 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:56.681108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b40853b8-4007-4d80-bec4-fcaf7062d922 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:56.681108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b40853b8-4007-4d80-bec4-fcaf7062d922 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:56.681108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b40853b8-4007-4d80-bec4-fcaf7062d922 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:56.702348 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-af2b10cf-c6b6-4364-a39e-3f8a7d31bc5e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "DELETE /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 204 len: 0 microversion: 2.1 time: 0.428640 May 28 21:06:56.717138 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 676/1296] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:06:56 2022] DELETE /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:06:56.719681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4511adb7-f50f-4128-a21f-67a758d26319 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:56.720588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4511adb7-f50f-4128-a21f-67a758d26319 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:56.730523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4511adb7-f50f-4128-a21f-67a758d26319 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:56.734419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4511adb7-f50f-4128-a21f-67a758d26319 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:56.734419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4511adb7-f50f-4128-a21f-67a758d26319 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:56.734419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4511adb7-f50f-4128-a21f-67a758d26319 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:56.752007 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-4511adb7-f50f-4128-a21f-67a758d26319 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] HTTP exception thrown: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4511adb7-f50f-4128-a21f-67a758d26319 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Request method failure captured: May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c HTTP/1.1 May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko6oq10ya0vKA7Lzgzw7qEixBB6oq9XwAAqnALDB3LxJ0Ou3iq7_g4aSSk-6F4p6-_hIGxM22vsmPp1vD-bx8iQQTYyEkSHfzi2JWR2mENOMe6ss5h_-1Ay7OrAERWJEEuMTwxRxM1yb64UuFpXocdkERI-wAfMoU5j69oLSNr7C4nA May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:06:56.753744 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:06:56.759437 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab0c1d6a9fc44de4af61822849b3bf8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:06:56.759437 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:56.759437 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:06:56.759437 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:06:56.759437 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:06:56.759437 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:06:56.759437 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:06:56.759437 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: dc48535b672d4d1190ecfefe6cb02720 May 28 21:06:56.759437 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:06:56.759437 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:06:56.759437 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. May 28 21:06:56.759437 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c'} May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:06:56.760321 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. May 28 21:06:56.761822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:06:56.763141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4511adb7-f50f-4128-a21f-67a758d26319 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Returning 404 to user: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:06:56.763141 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4511adb7-f50f-4128-a21f-67a758d26319 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 404 len: 111 microversion: 2.1 time: 0.041418 May 28 21:06:56.763141 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 677/1297] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:56 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:06:56.779167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0c0b1566-cb38-4bc0-a460-5430c99dddab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:56.781209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0c0b1566-cb38-4bc0-a460-5430c99dddab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:56.799138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c0b1566-cb38-4bc0-a460-5430c99dddab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:56.800731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c0b1566-cb38-4bc0-a460-5430c99dddab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:56.801652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c0b1566-cb38-4bc0-a460-5430c99dddab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:56.804963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c0b1566-cb38-4bc0-a460-5430c99dddab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:56.981605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b40853b8-4007-4d80-bec4-fcaf7062d922 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:56.991645 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b40853b8-4007-4d80-bec4-fcaf7062d922 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1549 microversion: 2.1 time: 0.342146 May 28 21:06:56.992296 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 621/1298] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:56 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1549 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:56.998009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c84a877c-6690-42bd-a721-82521ab34ba2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:56.999674 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c84a877c-6690-42bd-a721-82521ab34ba2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:57.008092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c84a877c-6690-42bd-a721-82521ab34ba2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:57.009041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c84a877c-6690-42bd-a721-82521ab34ba2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:57.010269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c84a877c-6690-42bd-a721-82521ab34ba2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:57.011059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c84a877c-6690-42bd-a721-82521ab34ba2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:57.011505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c0b1566-cb38-4bc0-a460-5430c99dddab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:57.021689 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0c0b1566-cb38-4bc0-a460-5430c99dddab tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 200 len: 1469 microversion: 2.1 time: 0.263948 May 28 21:06:57.022542 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 678/1299] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:56 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 1469 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:57.028597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2083319104", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:06:57.120773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] validate_networks() for [('5bc429f4-a7fa-4b56-a7a6-1b807068de27', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:06:57.285738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c84a877c-6690-42bd-a721-82521ab34ba2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:06:57.293968 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c84a877c-6690-42bd-a721-82521ab34ba2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1469 microversion: 2.1 time: 0.299835 May 28 21:06:57.294650 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 622/1300] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:06:56 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1469 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:06:57.300573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9a2f4c0f-1870-47c3-86f0-217b5501ff47 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:57.301758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9a2f4c0f-1870-47c3-86f0-217b5501ff47 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:57.309564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a2f4c0f-1870-47c3-86f0-217b5501ff47 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:57.310337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a2f4c0f-1870-47c3-86f0-217b5501ff47 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:57.311191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a2f4c0f-1870-47c3-86f0-217b5501ff47 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:57.311806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a2f4c0f-1870-47c3-86f0-217b5501ff47 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:57.385514 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9a2f4c0f-1870-47c3-86f0-217b5501ff47 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054071 May 28 21:06:57.385514 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 623/1301] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:06:57 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:06:57.452906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b6a0efd3-08fa-40b9-8a59-e14821d53453 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:57.455433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b6a0efd3-08fa-40b9-8a59-e14821d53453 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:57.463184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b6a0efd3-08fa-40b9-8a59-e14821d53453 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:57.463770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b6a0efd3-08fa-40b9-8a59-e14821d53453 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:57.464799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b6a0efd3-08fa-40b9-8a59-e14821d53453 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:57.465250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b6a0efd3-08fa-40b9-8a59-e14821d53453 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:57.511542 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b6a0efd3-08fa-40b9-8a59-e14821d53453 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063034 May 28 21:06:57.512309 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 624/1302] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:06:57 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:06:57.576675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-814d6223-9297-4856-b72e-80bd6b86f010 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:06:57.577184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-814d6223-9297-4856-b72e-80bd6b86f010 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:06:57.584487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-814d6223-9297-4856-b72e-80bd6b86f010 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:57.584954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-814d6223-9297-4856-b72e-80bd6b86f010 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:57.586399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-814d6223-9297-4856-b72e-80bd6b86f010 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:57.587035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-814d6223-9297-4856-b72e-80bd6b86f010 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:57.599397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:06:57.600423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:06:57.601425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:06:57.601965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:06:57.602512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:06:57.606131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:06:57.617178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:57.617955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:57.618855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:06:57.619527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:06:57.625786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-814d6223-9297-4856-b72e-80bd6b86f010 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:06:57.648020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Getting quotas for project ab0c1d6a9fc44de4af61822849b3bf8d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:06:57.656804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Getting quotas for user dc48535b672d4d1190ecfefe6cb02720 and project ab0c1d6a9fc44de4af61822849b3bf8d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:06:57.674001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:06:57.677229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:07:00.121010 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5ae2d2ab-7821-40ed-a318-84378a66cfb6 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.097168 May 28 21:07:00.126986 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 679/1303] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:06:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 3104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:07:00.132354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-25ec773e-d45c-4fc9-b8af-c689324f284c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:00.133118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-25ec773e-d45c-4fc9-b8af-c689324f284c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:00.139551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25ec773e-d45c-4fc9-b8af-c689324f284c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:00.140005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25ec773e-d45c-4fc9-b8af-c689324f284c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:00.140776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25ec773e-d45c-4fc9-b8af-c689324f284c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:00.141216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25ec773e-d45c-4fc9-b8af-c689324f284c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:00.346043 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-814d6223-9297-4856-b72e-80bd6b86f010 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 204 len: 0 microversion: 2.1 time: 2.771663 May 28 21:07:00.350552 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 625/1304] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:06:57 2022] DELETE /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 0 bytes in 2775 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:07:00.353077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-25ec773e-d45c-4fc9-b8af-c689324f284c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:00.362852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f96d01c1-ba8f-4cc3-8bd3-3711890378e1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:00.378579 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-25ec773e-d45c-4fc9-b8af-c689324f284c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1288 microversion: 2.1 time: 0.243338 May 28 21:07:00.378579 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 680/1305] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:00 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1288 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:00.382581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f96d01c1-ba8f-4cc3-8bd3-3711890378e1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:00.384332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eb84c272-4764-43be-b3c7-256e66196d7b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:00.387891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eb84c272-4764-43be-b3c7-256e66196d7b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:00.402731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f96d01c1-ba8f-4cc3-8bd3-3711890378e1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:00.403205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f96d01c1-ba8f-4cc3-8bd3-3711890378e1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:00.404015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f96d01c1-ba8f-4cc3-8bd3-3711890378e1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:00.404544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f96d01c1-ba8f-4cc3-8bd3-3711890378e1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:00.406611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb84c272-4764-43be-b3c7-256e66196d7b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:00.407146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb84c272-4764-43be-b3c7-256e66196d7b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:00.408326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb84c272-4764-43be-b3c7-256e66196d7b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:00.408814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb84c272-4764-43be-b3c7-256e66196d7b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:00.513746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eb84c272-4764-43be-b3c7-256e66196d7b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:00.523943 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eb84c272-4764-43be-b3c7-256e66196d7b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 200 len: 1427 microversion: 2.1 time: 0.148742 May 28 21:07:00.524891 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 681/1306] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:00 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 1427 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:00.530389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d5ec4067-7aa4-49f5-8adb-0ba5d1005989 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:00.531055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d5ec4067-7aa4-49f5-8adb-0ba5d1005989 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:00.545345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d5ec4067-7aa4-49f5-8adb-0ba5d1005989 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:00.545799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d5ec4067-7aa4-49f5-8adb-0ba5d1005989 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:00.546717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d5ec4067-7aa4-49f5-8adb-0ba5d1005989 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:00.547158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d5ec4067-7aa4-49f5-8adb-0ba5d1005989 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:00.842150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f96d01c1-ba8f-4cc3-8bd3-3711890378e1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:00.856398 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f96d01c1-ba8f-4cc3-8bd3-3711890378e1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1539 microversion: 2.1 time: 0.506076 May 28 21:07:00.861227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d5ec4067-7aa4-49f5-8adb-0ba5d1005989 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:00.871991 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 626/1307] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:00 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1539 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:00.880808 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d5ec4067-7aa4-49f5-8adb-0ba5d1005989 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1469 microversion: 2.1 time: 0.354619 May 28 21:07:00.881412 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 682/1308] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:00 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1469 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:00.883423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7a7c418e-8b8a-4fce-a33d-7a40e1a331a3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:00.885661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7a7c418e-8b8a-4fce-a33d-7a40e1a331a3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:00.896352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-17926b4f-17ab-48e3-a29a-6d52a4490628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:00.897383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-17926b4f-17ab-48e3-a29a-6d52a4490628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:00.917689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-17926b4f-17ab-48e3-a29a-6d52a4490628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:00.919935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-17926b4f-17ab-48e3-a29a-6d52a4490628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:00.924087 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-17926b4f-17ab-48e3-a29a-6d52a4490628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:00.925666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-17926b4f-17ab-48e3-a29a-6d52a4490628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:01.085132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7a7c418e-8b8a-4fce-a33d-7a40e1a331a3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:01.110724 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7a7c418e-8b8a-4fce-a33d-7a40e1a331a3 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1225 microversion: 2.1 time: 0.235807 May 28 21:07:01.115292 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 627/1309] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:00 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1225 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:01.130766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-0ca5de9b-9a22-4ab7-a5bc-544afb48ede1 req-b168bf6d-2992-41ba-b6bf-77a4487bb645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df5a24ed-101d-4ca1-a87e-e81c12b6d167", "name": "network-vif-deleted", "tag": "ab017b92-2fd2-43c0-8352-ef3dbe3b47d3"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:01.147411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0ca5de9b-9a22-4ab7-a5bc-544afb48ede1 req-b168bf6d-2992-41ba-b6bf-77a4487bb645 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:01.147873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0ca5de9b-9a22-4ab7-a5bc-544afb48ede1 req-b168bf6d-2992-41ba-b6bf-77a4487bb645 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:01.162629 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-0ca5de9b-9a22-4ab7-a5bc-544afb48ede1 req-b168bf6d-2992-41ba-b6bf-77a4487bb645 service nova] Creating event network-vif-deleted:ab017b92-2fd2-43c0-8352-ef3dbe3b47d3 for instance df5a24ed-101d-4ca1-a87e-e81c12b6d167 on nch2-master-1 May 28 21:07:01.168969 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-0ca5de9b-9a22-4ab7-a5bc-544afb48ede1 req-b168bf6d-2992-41ba-b6bf-77a4487bb645 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051987 May 28 21:07:01.170267 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 628/1310] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:01.176293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3c26d95e-3acc-45e3-9695-55caf3632045 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '.version_select at 0x7f4d6416ef70>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:01.179326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c26d95e-3acc-45e3-9695-55caf3632045 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:01.180006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c26d95e-3acc-45e3-9695-55caf3632045 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:01.194842 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3c26d95e-3acc-45e3-9695-55caf3632045 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 3496 microversion: 2.1 time: 0.022387 May 28 21:07:01.203519 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 629/1311] 10.222.0.33 () {58 vars in 1142 bytes} [Sat May 28 21:07:01 2022] GET /compute/v2.1/os-migrations => generated 3496 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:01.208389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0bdd6f9b-4a2e-420c-9e34-69b659e4fef9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:01.209146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0bdd6f9b-4a2e-420c-9e34-69b659e4fef9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:01.215915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0bdd6f9b-4a2e-420c-9e34-69b659e4fef9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:01.216394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0bdd6f9b-4a2e-420c-9e34-69b659e4fef9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:01.217317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0bdd6f9b-4a2e-420c-9e34-69b659e4fef9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:01.217812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0bdd6f9b-4a2e-420c-9e34-69b659e4fef9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:01.379573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-17926b4f-17ab-48e3-a29a-6d52a4490628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:01.434721 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-17926b4f-17ab-48e3-a29a-6d52a4490628 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1682 microversion: 2.1 time: 0.543052 May 28 21:07:01.447979 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 683/1312] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:00 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1682 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:01.459807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f4cad1eb-207a-4957-9ed1-73637ee1271c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:01.461832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f4cad1eb-207a-4957-9ed1-73637ee1271c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:01.470163 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0bdd6f9b-4a2e-420c-9e34-69b659e4fef9 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1690 microversion: 2.1 time: 0.265381 May 28 21:07:01.474697 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 630/1313] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:01 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1690 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:01.488243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f429ed5a-4a1f-467e-81b2-e6ca80afa4cd tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:01.490687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f429ed5a-4a1f-467e-81b2-e6ca80afa4cd tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:01.493249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f4cad1eb-207a-4957-9ed1-73637ee1271c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:01.493704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f4cad1eb-207a-4957-9ed1-73637ee1271c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:01.494548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f4cad1eb-207a-4957-9ed1-73637ee1271c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:01.495072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f4cad1eb-207a-4957-9ed1-73637ee1271c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:01.511909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f429ed5a-4a1f-467e-81b2-e6ca80afa4cd tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:01.523792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f429ed5a-4a1f-467e-81b2-e6ca80afa4cd tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:01.523792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f429ed5a-4a1f-467e-81b2-e6ca80afa4cd tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:01.523792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f429ed5a-4a1f-467e-81b2-e6ca80afa4cd tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:01.589510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f4cad1eb-207a-4957-9ed1-73637ee1271c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:01.600152 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f4cad1eb-207a-4957-9ed1-73637ee1271c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1276 microversion: 2.1 time: 0.150531 May 28 21:07:01.600834 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 684/1314] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:01 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1276 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:01.606315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c2bed7e2-6ffc-4632-bb19-43e663642c16 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:01.607367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c2bed7e2-6ffc-4632-bb19-43e663642c16 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:01.616538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2bed7e2-6ffc-4632-bb19-43e663642c16 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:01.616986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2bed7e2-6ffc-4632-bb19-43e663642c16 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:01.619651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2bed7e2-6ffc-4632-bb19-43e663642c16 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:01.619651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2bed7e2-6ffc-4632-bb19-43e663642c16 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:01.667010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2bed7e2-6ffc-4632-bb19-43e663642c16 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:01.667718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2bed7e2-6ffc-4632-bb19-43e663642c16 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:01.668382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-c2bed7e2-6ffc-4632-bb19-43e663642c16 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lazy-loading 'fault' on Instance uuid df5a24ed-101d-4ca1-a87e-e81c12b6d167 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:07:01.774090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c2bed7e2-6ffc-4632-bb19-43e663642c16 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:01.785799 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c2bed7e2-6ffc-4632-bb19-43e663642c16 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 200 len: 1304 microversion: 2.1 time: 0.183721 May 28 21:07:01.788711 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 685/1315] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:01 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:01.909243 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f429ed5a-4a1f-467e-81b2-e6ca80afa4cd tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1690 microversion: 2.1 time: 0.413235 May 28 21:07:01.909473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d4132f9f-481b-4d4f-bb0a-57e0eb7b972d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:01.909473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d4132f9f-481b-4d4f-bb0a-57e0eb7b972d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:01.926020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4132f9f-481b-4d4f-bb0a-57e0eb7b972d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:01.926250 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 631/1316] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:01 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1690 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:01.927518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4132f9f-481b-4d4f-bb0a-57e0eb7b972d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:01.928393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4132f9f-481b-4d4f-bb0a-57e0eb7b972d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:01.928843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4132f9f-481b-4d4f-bb0a-57e0eb7b972d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:02.104325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6f891289-95e9-4044-bd81-56f333deec53 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:02.105198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6f891289-95e9-4044-bd81-56f333deec53 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:02.129478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f891289-95e9-4044-bd81-56f333deec53 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:02.130719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f891289-95e9-4044-bd81-56f333deec53 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:02.133664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f891289-95e9-4044-bd81-56f333deec53 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:02.136510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f891289-95e9-4044-bd81-56f333deec53 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:02.413868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:02.518334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-6f891289-95e9-4044-bd81-56f333deec53 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lazy-loading 'services' on Instance uuid 6a102552-9f3f-417b-a587-72cf6ee45088 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:07:02.617781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d4132f9f-481b-4d4f-bb0a-57e0eb7b972d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:02.627633 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d4132f9f-481b-4d4f-bb0a-57e0eb7b972d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1469 microversion: 2.1 time: 0.732838 May 28 21:07:02.638391 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 686/1317] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:01 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1469 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:02.644682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ca54c760-c43b-4ca0-9c9e-a3f9dd4e670c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:02.645319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ca54c760-c43b-4ca0-9c9e-a3f9dd4e670c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:02.652488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca54c760-c43b-4ca0-9c9e-a3f9dd4e670c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:02.652949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca54c760-c43b-4ca0-9c9e-a3f9dd4e670c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:02.653729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca54c760-c43b-4ca0-9c9e-a3f9dd4e670c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:02.654243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca54c760-c43b-4ca0-9c9e-a3f9dd4e670c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:02.779387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ca54c760-c43b-4ca0-9c9e-a3f9dd4e670c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:02.802716 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ca54c760-c43b-4ca0-9c9e-a3f9dd4e670c tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1221 microversion: 2.1 time: 0.158898 May 28 21:07:02.803980 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 687/1318] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:02 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1221 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:02.903536 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6f891289-95e9-4044-bd81-56f333deec53 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088/os-volume_attachments/b107b45a-f2d1-4795-8559-3836162f6660" status: 202 len: 0 microversion: 2.1 time: 0.803613 May 28 21:07:02.905024 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 632/1319] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:07:02 2022] DELETE /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088/os-volume_attachments/b107b45a-f2d1-4795-8559-3836162f6660 => generated 0 bytes in 807 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:07:02.917329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e224913d-9f4a-4d7d-a5c3-95f46c908e89 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:02.918522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e224913d-9f4a-4d7d-a5c3-95f46c908e89 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:02.942285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e224913d-9f4a-4d7d-a5c3-95f46c908e89 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:02.943642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e224913d-9f4a-4d7d-a5c3-95f46c908e89 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:02.948076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e224913d-9f4a-4d7d-a5c3-95f46c908e89 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:02.948762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e224913d-9f4a-4d7d-a5c3-95f46c908e89 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:03.096882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-43c2b2bc-22a8-4c0d-aac0-3ecac8ac2e05 tempest-InstanceUsageAuditLogNegativeTestJSON-678099609 tempest-InstanceUsageAuditLogNegativeTestJSON-678099609-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:03.109443 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:07:03.109443 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:07:03.113987 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-43c2b2bc-22a8-4c0d-aac0-3ecac8ac2e05 tempest-InstanceUsageAuditLogNegativeTestJSON-678099609 tempest-InstanceUsageAuditLogNegativeTestJSON-678099609-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-43c2b2bc-22a8-4c0d-aac0-3ecac8ac2e05 tempest-InstanceUsageAuditLogNegativeTestJSON-678099609 tempest-InstanceUsageAuditLogNegativeTestJSON-678099609-project-admin] Request method failure captured: May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko72Hr7MNY0AjdNnMxEukg5-9we-fhN4xXiNOD6yKq6TPdFUfoZLnAH69HzhtMK5rfamlZdG7neV9-hRV1Od2_udfkoWcVIXLVkqKGWOFykRPH0ralWzynzfPPCxtUL0Bi0z7SDtAZKTyW0rjCQg3nf81-FMVQBhnbJhinJpDIHj4kw May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 78a7f2aa3f7849f3b2f5dd0a06801899 May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-678099609 May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:07:03.133106 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:07:03.137614 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_78a7f2aa3f7849f3b2f5dd0a06801899", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78a7f2aa3f7849f3b2f5dd0a06801899"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/78a7f2aa3f7849f3b2f5dd0a06801899"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/78a7f2aa3f7849f3b2f5dd0a06801899"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:03.137614 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-678099609 May 28 21:07:03.137614 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 78a7f2aa3f7849f3b2f5dd0a06801899 May 28 21:07:03.137614 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-678099609 May 28 21:07:03.137614 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-678099609-project-admin May 28 21:07:03.137614 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:07:03.137614 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:07:03.137614 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 717861b3356e469197cafbd14b71a02d May 28 21:07:03.137614 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-678099609-project-admin May 28 21:07:03.137614 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:07:03.137614 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid timestamp for date invalid_time May 28 21:07:03.137614 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'invalid_time'} May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:03.138495 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show May 28 21:07:03.139741 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) May 28 21:07:03.139741 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time May 28 21:07:03.139741 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:03.139741 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:03.139741 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:03.139741 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:03.139741 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:03.139741 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:03.139741 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:03.139741 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:03.139741 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time May 28 21:07:03.139741 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:03.139741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-43c2b2bc-22a8-4c0d-aac0-3ecac8ac2e05 tempest-InstanceUsageAuditLogNegativeTestJSON-678099609 tempest-InstanceUsageAuditLogNegativeTestJSON-678099609-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:03.139741 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-43c2b2bc-22a8-4c0d-aac0-3ecac8ac2e05 tempest-InstanceUsageAuditLogNegativeTestJSON-678099609 tempest-InstanceUsageAuditLogNegativeTestJSON-678099609-project-admin] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.329139 May 28 21:07:03.140592 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 688/1320] 10.222.0.33 () {58 vars in 1223 bytes} [Sat May 28 21:07:02 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 331 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 21:07:03.140675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-993953dc-3911-4b48-be3b-3f5a58ae3302 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:03.141279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-993953dc-3911-4b48-be3b-3f5a58ae3302 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:03.161468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-993953dc-3911-4b48-be3b-3f5a58ae3302 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:03.162196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-993953dc-3911-4b48-be3b-3f5a58ae3302 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:03.163162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-993953dc-3911-4b48-be3b-3f5a58ae3302 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:03.164690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-993953dc-3911-4b48-be3b-3f5a58ae3302 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:03.334521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e224913d-9f4a-4d7d-a5c3-95f46c908e89 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:03.344022 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e224913d-9f4a-4d7d-a5c3-95f46c908e89 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1682 microversion: 2.1 time: 0.436978 May 28 21:07:03.350091 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 633/1321] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:02 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1682 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:03.351332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-28bb3b77-2938-49ff-8dba-c5cec011e8a2 req-96a188c5-a651-48d5-9d7f-37785788431d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394fe269-dd5e-4d4e-8f49-de1df1812e6a", "name": "network-vif-unplugged", "status": "completed", "tag": "e413ef97-3a02-48d0-ae33-341fafd919b8"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:03.360187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-28bb3b77-2938-49ff-8dba-c5cec011e8a2 req-96a188c5-a651-48d5-9d7f-37785788431d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:03.360638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-28bb3b77-2938-49ff-8dba-c5cec011e8a2 req-96a188c5-a651-48d5-9d7f-37785788431d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:03.374400 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-28bb3b77-2938-49ff-8dba-c5cec011e8a2 req-96a188c5-a651-48d5-9d7f-37785788431d service nova] Creating event network-vif-unplugged:e413ef97-3a02-48d0-ae33-341fafd919b8 for instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a on nch1-master-1 May 28 21:07:03.381067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-28bb3b77-2938-49ff-8dba-c5cec011e8a2 req-96a188c5-a651-48d5-9d7f-37785788431d service nova] Instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:07:03.393751 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-28bb3b77-2938-49ff-8dba-c5cec011e8a2 req-96a188c5-a651-48d5-9d7f-37785788431d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046154 May 28 21:07:03.394444 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 634/1322] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:03.400868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d1811cdb-eefa-41d2-9129-421d40c5325c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:03.401586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d1811cdb-eefa-41d2-9129-421d40c5325c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: df5a24ed-101d-4ca1-a87e-e81c12b6d167] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:03.407985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d1811cdb-eefa-41d2-9129-421d40c5325c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:03.408821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d1811cdb-eefa-41d2-9129-421d40c5325c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:03.409614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d1811cdb-eefa-41d2-9129-421d40c5325c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:03.410294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d1811cdb-eefa-41d2-9129-421d40c5325c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:03.431276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-993953dc-3911-4b48-be3b-3f5a58ae3302 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:03.438092 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-d1811cdb-eefa-41d2-9129-421d40c5325c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] HTTP exception thrown: Instance df5a24ed-101d-4ca1-a87e-e81c12b6d167 could not be found. May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d1811cdb-eefa-41d2-9129-421d40c5325c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Request method failure captured: May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 HTTP/1.1 May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko5b4uBTSgdPdO3qaKB0CFqOB9VgPoqLFeq3stVjxdwuLJxpegESGQBrjvjdTRm3DSkH1r9IZEbISnNIg_2y_ycYn_e2V0eWYnitfWdawTtr3ROXwppCWOzRt_X9kPmxY857RYe0NWPwWMjVbxqyyRNenNSmMIgujt5rqZN7mk0AZY4 May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 56e1dc5556624e2fb8de8a030c34c334 May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersAdminTestJSON-191015418 May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:07:03.440958 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:07:03.447523 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56e1dc5556624e2fb8de8a030c34c334", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56e1dc5556624e2fb8de8a030c34c334"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56e1dc5556624e2fb8de8a030c34c334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56e1dc5556624e2fb8de8a030c34c334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:03.447523 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersAdminTestJSON-191015418 May 28 21:07:03.447523 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 56e1dc5556624e2fb8de8a030c34c334 May 28 21:07:03.447523 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersAdminTestJSON-191015418 May 28 21:07:03.447523 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersAdminTestJSON-191015418-project May 28 21:07:03.447523 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:07:03.447523 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:07:03.447523 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 478d1609aa114d16b338e07d2d4c05c9 May 28 21:07:03.447523 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersAdminTestJSON-191015418-project May 28 21:07:03.447523 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:07:03.447523 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance df5a24ed-101d-4ca1-a87e-e81c12b6d167 could not be found. May 28 21:07:03.447523 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'df5a24ed-101d-4ca1-a87e-e81c12b6d167'} May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df5a24ed-101d-4ca1-a87e-e81c12b6d167 could not be found. May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:03.448258 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df5a24ed-101d-4ca1-a87e-e81c12b6d167 could not be found. May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df5a24ed-101d-4ca1-a87e-e81c12b6d167 could not be found. May 28 21:07:03.449427 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:03.450527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d1811cdb-eefa-41d2-9129-421d40c5325c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Returning 404 to user: Instance df5a24ed-101d-4ca1-a87e-e81c12b6d167 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:03.450527 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d1811cdb-eefa-41d2-9129-421d40c5325c tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167" status: 404 len: 111 microversion: 2.1 time: 0.046778 May 28 21:07:03.450527 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 635/1323] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:03 2022] GET /compute/v2.1/servers/df5a24ed-101d-4ca1-a87e-e81c12b6d167 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:07:03.450736 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-993953dc-3911-4b48-be3b-3f5a58ae3302 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1318 microversion: 2.1 time: 0.308507 May 28 21:07:03.450736 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 689/1324] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:03 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:03.453537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c3548056-ce34-424a-9526-91e39e0adfec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:03.455316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c3548056-ce34-424a-9526-91e39e0adfec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:03.462573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3548056-ce34-424a-9526-91e39e0adfec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:03.470729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3548056-ce34-424a-9526-91e39e0adfec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:03.470729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3548056-ce34-424a-9526-91e39e0adfec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:03.470729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3548056-ce34-424a-9526-91e39e0adfec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:03.517149 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c3548056-ce34-424a-9526-91e39e0adfec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072414 May 28 21:07:03.522382 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 636/1325] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:07:03 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:03.533603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-4ed50c11-ea78-4e21-ae8e-840902c2447d req-4202514c-f8af-43fc-9dc1-81e33a1e8cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65edf30b-24d4-4341-b899-05f4e390d727", "tag": "2a3deb72-2842-4aed-b050-ff0c3043c594"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:03.546300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4ed50c11-ea78-4e21-ae8e-840902c2447d req-4202514c-f8af-43fc-9dc1-81e33a1e8cc4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:03.547023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4ed50c11-ea78-4e21-ae8e-840902c2447d req-4202514c-f8af-43fc-9dc1-81e33a1e8cc4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:03.570412 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-4ed50c11-ea78-4e21-ae8e-840902c2447d req-4202514c-f8af-43fc-9dc1-81e33a1e8cc4 service nova] Creating event network-changed:2a3deb72-2842-4aed-b050-ff0c3043c594 for instance 65edf30b-24d4-4341-b899-05f4e390d727 on nch1-master-1 May 28 21:07:03.583458 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-4ed50c11-ea78-4e21-ae8e-840902c2447d req-4202514c-f8af-43fc-9dc1-81e33a1e8cc4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054774 May 28 21:07:03.583458 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 637/1326] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:03.588000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7e9252b-dc24-4fe0-9d54-a7caeb8b73eb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:03.589041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d7e9252b-dc24-4fe0-9d54-a7caeb8b73eb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:03.603536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7e9252b-dc24-4fe0-9d54-a7caeb8b73eb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:03.604004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7e9252b-dc24-4fe0-9d54-a7caeb8b73eb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:03.604804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7e9252b-dc24-4fe0-9d54-a7caeb8b73eb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:03.605260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7e9252b-dc24-4fe0-9d54-a7caeb8b73eb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:03.606739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-58e6df99-9e9d-48d6-a01e-89a22987ce9f tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 tempest-InstanceUsageAuditLogNegativeTestJSON-842477169-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:03.611498 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:07:03.611498 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:07:03.611498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-58e6df99-9e9d-48d6-a01e-89a22987ce9f tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 tempest-InstanceUsageAuditLogNegativeTestJSON-842477169-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '5b8e5137419744f79eab638c4d3abff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c460c2c90640fa972c1c17fb41644a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-58e6df99-9e9d-48d6-a01e-89a22987ce9f tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 tempest-InstanceUsageAuditLogNegativeTestJSON-842477169-project] Request method failure captured: May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko70NSg2ITo_xZ8egBXCjNu2o4EncHywGL5EMvOAS0G-KXR4_cz5a-4FbQmAJ3ma-Jgs-LPdCauJG2ixnE0FCOpnESxgoIxEPLYCyV2OqA1KoAVJ4Nc6J8hCs79j99sSJveRsdqmSOTOUR__qg59GYwt05SqH_IOEjLBIii3UrvzA6k May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 42c460c2c90640fa972c1c17fb41644a May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:07:03.614938 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:07:03.616338 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42c460c2c90640fa972c1c17fb41644a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42c460c2c90640fa972c1c17fb41644a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42c460c2c90640fa972c1c17fb41644a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42c460c2c90640fa972c1c17fb41644a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:03.616338 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 May 28 21:07:03.616338 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 42c460c2c90640fa972c1c17fb41644a May 28 21:07:03.616338 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 May 28 21:07:03.616338 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-842477169-project May 28 21:07:03.616338 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:07:03.616338 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:07:03.616338 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 5b8e5137419744f79eab638c4d3abff7 May 28 21:07:03.616338 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-842477169-project May 28 21:07:03.616338 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:07:03.616338 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: action_args: {} May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:07:03.617239 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. May 28 21:07:03.619409 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:03.622737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-58e6df99-9e9d-48d6-a01e-89a22987ce9f tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 tempest-InstanceUsageAuditLogNegativeTestJSON-842477169-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:03.623952 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-58e6df99-9e9d-48d6-a01e-89a22987ce9f tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 tempest-InstanceUsageAuditLogNegativeTestJSON-842477169-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.176575 May 28 21:07:03.625080 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 690/1327] 10.222.0.33 () {58 vars in 1184 bytes} [Sat May 28 21:07:03 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 178 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:07:03.648411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d7e9252b-dc24-4fe0-9d54-a7caeb8b73eb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:07:03.649801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d3ab5c3e-bd5d-4082-b047-8522ed2b5212 tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 tempest-InstanceUsageAuditLogNegativeTestJSON-842477169-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:03.653618 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:07:03.653618 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:07:03.655385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d3ab5c3e-bd5d-4082-b047-8522ed2b5212 tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 tempest-InstanceUsageAuditLogNegativeTestJSON-842477169-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '5b8e5137419744f79eab638c4d3abff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42c460c2c90640fa972c1c17fb41644a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d3ab5c3e-bd5d-4082-b047-8522ed2b5212 tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 tempest-InstanceUsageAuditLogNegativeTestJSON-842477169-project] Request method failure captured: May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-05-28%2021:07:03 HTTP/1.1 May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko70NSg2ITo_xZ8egBXCjNu2o4EncHywGL5EMvOAS0G-KXR4_cz5a-4FbQmAJ3ma-Jgs-LPdCauJG2ixnE0FCOpnESxgoIxEPLYCyV2OqA1KoAVJ4Nc6J8hCs79j99sSJveRsdqmSOTOUR__qg59GYwt05SqH_IOEjLBIii3UrvzA6k May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 42c460c2c90640fa972c1c17fb41644a May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:07:03.657957 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:07:03.667169 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_42c460c2c90640fa972c1c17fb41644a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42c460c2c90640fa972c1c17fb41644a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/42c460c2c90640fa972c1c17fb41644a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/42c460c2c90640fa972c1c17fb41644a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:03.667169 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 May 28 21:07:03.667169 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 42c460c2c90640fa972c1c17fb41644a May 28 21:07:03.667169 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 May 28 21:07:03.667169 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-842477169-project May 28 21:07:03.667169 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:07:03.667169 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:07:03.667169 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 5b8e5137419744f79eab638c4d3abff7 May 28 21:07:03.667169 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-842477169-project May 28 21:07:03.667169 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:07:03.667169 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '2022-05-28 21:07:03'} May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:07:03.668038 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:03.669401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d3ab5c3e-bd5d-4082-b047-8522ed2b5212 tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 tempest-InstanceUsageAuditLogNegativeTestJSON-842477169-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:03.673076 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d3ab5c3e-bd5d-4082-b047-8522ed2b5212 tempest-InstanceUsageAuditLogNegativeTestJSON-842477169 tempest-InstanceUsageAuditLogNegativeTestJSON-842477169-project] 10.222.0.33 "GET /compute/v2.1/os-instance_usage_audit_log/2022-05-28 21:07:03" status: 403 len: 128 microversion: 2.1 time: 0.027611 May 28 21:07:03.673076 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 691/1328] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 21:07:03 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-05-28%2021%3A07%3A03 => generated 128 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:07:03.686316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4ef8b3b5-f06e-466b-8faf-9add749f8dc5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:03.691356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=5 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:03.694262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4ef8b3b5-f06e-466b-8faf-9add749f8dc5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:03.709136 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ef8b3b5-f06e-466b-8faf-9add749f8dc5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:03.709136 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ef8b3b5-f06e-466b-8faf-9add749f8dc5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:03.715181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ef8b3b5-f06e-466b-8faf-9add749f8dc5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:03.715910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ef8b3b5-f06e-466b-8faf-9add749f8dc5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:04.012702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4ef8b3b5-f06e-466b-8faf-9add749f8dc5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:04.039049 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4ef8b3b5-f06e-466b-8faf-9add749f8dc5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1535 microversion: 2.1 time: 0.369558 May 28 21:07:04.039049 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 692/1329] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:03 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1535 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:04.041715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8425ca7c-a881-4fbe-853d-b704cba1d09d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:04.042406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8425ca7c-a881-4fbe-853d-b704cba1d09d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:04.050041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8425ca7c-a881-4fbe-853d-b704cba1d09d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:04.050762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8425ca7c-a881-4fbe-853d-b704cba1d09d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:04.051737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8425ca7c-a881-4fbe-853d-b704cba1d09d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:04.052428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8425ca7c-a881-4fbe-853d-b704cba1d09d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:04.163707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8425ca7c-a881-4fbe-853d-b704cba1d09d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:04.173870 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8425ca7c-a881-4fbe-853d-b704cba1d09d tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1285 microversion: 2.1 time: 0.139709 May 28 21:07:04.175848 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 693/1330] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:04 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:04.181292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-9d3c6de8-8805-4982-9f55-0b697e42a8db req-5e004a2b-e2e5-424d-b6e7-1ab892abd268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06501745-d6e0-43da-b96c-8713586a5d92", "tag": "ac98e234-98a5-42f5-ad66-6406e87566fa"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:04.187201 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d7e9252b-dc24-4fe0-9d54-a7caeb8b73eb tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "DELETE /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 204 len: 0 microversion: 2.1 time: 0.605673 May 28 21:07:04.192011 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 638/1331] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:07:03 2022] DELETE /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 0 bytes in 611 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:07:04.192842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9d3c6de8-8805-4982-9f55-0b697e42a8db req-5e004a2b-e2e5-424d-b6e7-1ab892abd268 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:04.193518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9d3c6de8-8805-4982-9f55-0b697e42a8db req-5e004a2b-e2e5-424d-b6e7-1ab892abd268 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:04.202575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3c141d86-cd98-4452-9456-147671f0c69b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:04.203629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3c141d86-cd98-4452-9456-147671f0c69b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:04.207571 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-9d3c6de8-8805-4982-9f55-0b697e42a8db req-5e004a2b-e2e5-424d-b6e7-1ab892abd268 service nova] Creating event network-changed:ac98e234-98a5-42f5-ad66-6406e87566fa for instance 06501745-d6e0-43da-b96c-8713586a5d92 on nch2-master-1 May 28 21:07:04.214387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c141d86-cd98-4452-9456-147671f0c69b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:04.216542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c141d86-cd98-4452-9456-147671f0c69b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:04.218044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c141d86-cd98-4452-9456-147671f0c69b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:04.218694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c141d86-cd98-4452-9456-147671f0c69b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:04.220719 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-9d3c6de8-8805-4982-9f55-0b697e42a8db req-5e004a2b-e2e5-424d-b6e7-1ab892abd268 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041069 May 28 21:07:04.222529 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 694/1332] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:04.368351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a5165044-44da-4226-b569-b20853c0d56d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:04.369448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a5165044-44da-4226-b569-b20853c0d56d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:04.410854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5165044-44da-4226-b569-b20853c0d56d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:04.414508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5165044-44da-4226-b569-b20853c0d56d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:04.420956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5165044-44da-4226-b569-b20853c0d56d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:04.421760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5165044-44da-4226-b569-b20853c0d56d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:04.467759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3c141d86-cd98-4452-9456-147671f0c69b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:04.482002 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3c141d86-cd98-4452-9456-147671f0c69b tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1469 microversion: 2.1 time: 0.285302 May 28 21:07:04.486863 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 639/1333] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:04 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1469 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:04.507176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3039a893-2313-490c-9142-23b7fbbc3752 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:04.508109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3039a893-2313-490c-9142-23b7fbbc3752 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:04.517676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3039a893-2313-490c-9142-23b7fbbc3752 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:04.519003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3039a893-2313-490c-9142-23b7fbbc3752 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:04.526961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3039a893-2313-490c-9142-23b7fbbc3752 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:04.526961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3039a893-2313-490c-9142-23b7fbbc3752 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:04.617774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a5165044-44da-4226-b569-b20853c0d56d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77a6068e4dc34fb6b8d1447472692e55', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b059b8b9ea6e4afbb5d034c9d1a036d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:04.632181 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a5165044-44da-4226-b569-b20853c0d56d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 200 len: 1614 microversion: 2.1 time: 0.272129 May 28 21:07:04.634808 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 695/1334] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:04 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 1614 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:04.649312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7480f4f2-ace8-4211-82d6-d448e4a01b69 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:04.650694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7480f4f2-ace8-4211-82d6-d448e4a01b69 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:04.664351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7480f4f2-ace8-4211-82d6-d448e4a01b69 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:04.666440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7480f4f2-ace8-4211-82d6-d448e4a01b69 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:04.667533 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7480f4f2-ace8-4211-82d6-d448e4a01b69 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:04.670026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7480f4f2-ace8-4211-82d6-d448e4a01b69 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:04.759473 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7480f4f2-ace8-4211-82d6-d448e4a01b69 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122168 May 28 21:07:04.765093 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 696/1335] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:07:04 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:04.818483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3039a893-2313-490c-9142-23b7fbbc3752 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:04.834023 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3039a893-2313-490c-9142-23b7fbbc3752 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1318 microversion: 2.1 time: 0.346637 May 28 21:07:04.843272 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 640/1336] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:04 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:05.054423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c9b3f860-7ed9-42e3-980a-c9c957245094 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:05.055798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c9b3f860-7ed9-42e3-980a-c9c957245094 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:05.079588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9b3f860-7ed9-42e3-980a-c9c957245094 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:05.080500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9b3f860-7ed9-42e3-980a-c9c957245094 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:05.084065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9b3f860-7ed9-42e3-980a-c9c957245094 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:05.084065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9b3f860-7ed9-42e3-980a-c9c957245094 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:05.196894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4c941811-4134-4976-9f25-0b2f6910f4dd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:05.197968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4c941811-4134-4976-9f25-0b2f6910f4dd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:05.205608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c941811-4134-4976-9f25-0b2f6910f4dd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:05.206365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c941811-4134-4976-9f25-0b2f6910f4dd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:05.207328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c941811-4134-4976-9f25-0b2f6910f4dd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:05.208649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c941811-4134-4976-9f25-0b2f6910f4dd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:05.680449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4c941811-4134-4976-9f25-0b2f6910f4dd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:05.692722 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4c941811-4134-4976-9f25-0b2f6910f4dd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1283 microversion: 2.1 time: 0.499251 May 28 21:07:05.702498 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 641/1337] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:05 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1283 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:05.708810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-379de165-510c-43f9-9cac-b5e24fe27f85 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:05.709462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-379de165-510c-43f9-9cac-b5e24fe27f85 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:05.716724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-379de165-510c-43f9-9cac-b5e24fe27f85 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:05.717193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-379de165-510c-43f9-9cac-b5e24fe27f85 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:05.718074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-379de165-510c-43f9-9cac-b5e24fe27f85 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:05.718524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-379de165-510c-43f9-9cac-b5e24fe27f85 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:05.722810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c9b3f860-7ed9-42e3-980a-c9c957245094 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:05.726599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:05.741023 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c9b3f860-7ed9-42e3-980a-c9c957245094 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1535 microversion: 2.1 time: 0.691712 May 28 21:07:05.752683 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 697/1338] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:05 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1535 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:05.758058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c932ae87-50ad-41e3-8eaf-632359fdfd60 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:05.759202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c932ae87-50ad-41e3-8eaf-632359fdfd60 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:05.767823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c932ae87-50ad-41e3-8eaf-632359fdfd60 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:05.769080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c932ae87-50ad-41e3-8eaf-632359fdfd60 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:05.770090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c932ae87-50ad-41e3-8eaf-632359fdfd60 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:05.770739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c932ae87-50ad-41e3-8eaf-632359fdfd60 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:05.795860 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-c932ae87-50ad-41e3-8eaf-632359fdfd60 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] HTTP exception thrown: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c932ae87-50ad-41e3-8eaf-632359fdfd60 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Request method failure captured: May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 HTTP/1.1 May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5uh1h6B0TVqGR54p6HZUAreLAkksxbuzxNlxuoQDiCfDgLgrPNVWJDdWCixuPZFxmNMfkOOayIrOByXvJEAgCIjrys5icdBXBC6wNKpuZecqRJo9FZ2y7GQDeNe0nUaP-eZPhP7Ga8M6dc-IT0ZkZWanSncsHKhuybOIwa7bHXuMM May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: b059b8b9ea6e4afbb5d034c9d1a036d2 May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1219301458 May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:07:05.798149 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:07:05.799696 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b059b8b9ea6e4afbb5d034c9d1a036d2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b059b8b9ea6e4afbb5d034c9d1a036d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b059b8b9ea6e4afbb5d034c9d1a036d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b059b8b9ea6e4afbb5d034c9d1a036d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:05.799696 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1219301458 May 28 21:07:05.799696 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: b059b8b9ea6e4afbb5d034c9d1a036d2 May 28 21:07:05.799696 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1219301458 May 28 21:07:05.799696 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AttachSCSIVolumeTestJSON-1219301458-project May 28 21:07:05.799696 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:07:05.799696 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:07:05.799696 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 77a6068e4dc34fb6b8d1447472692e55 May 28 21:07:05.799696 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1219301458-project May 28 21:07:05.799696 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:07:05.799696 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. May 28 21:07:05.799696 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'df8268d1-36f2-4747-aa81-f6181ea36c35'} May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:05.800600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. May 28 21:07:05.802127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:05.804315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c932ae87-50ad-41e3-8eaf-632359fdfd60 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Returning 404 to user: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:05.805511 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c932ae87-50ad-41e3-8eaf-632359fdfd60 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 404 len: 111 microversion: 2.1 time: 0.051616 May 28 21:07:05.806645 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 698/1339] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:05 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:07:05.812400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2bbd2024-4bc7-4194-b90f-0e49d508499b req-4892ed41-9983-48be-bb17-806509172999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8268d1-36f2-4747-aa81-f6181ea36c35", "name": "network-vif-deleted", "tag": "5edb3137-f693-41e6-8acc-86951c804f80"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:05.821675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2bbd2024-4bc7-4194-b90f-0e49d508499b req-4892ed41-9983-48be-bb17-806509172999 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:05.822453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2bbd2024-4bc7-4194-b90f-0e49d508499b req-4892ed41-9983-48be-bb17-806509172999 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:05.846821 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2bbd2024-4bc7-4194-b90f-0e49d508499b req-4892ed41-9983-48be-bb17-806509172999 service nova] Creating event network-vif-deleted:5edb3137-f693-41e6-8acc-86951c804f80 for instance df8268d1-36f2-4747-aa81-f6181ea36c35 on nch1-master-1 May 28 21:07:05.853973 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2bbd2024-4bc7-4194-b90f-0e49d508499b req-4892ed41-9983-48be-bb17-806509172999 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045238 May 28 21:07:05.855224 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 699/1340] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:05.861976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ed91495-3b1f-46a8-8497-2c345467e0f7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:05.864144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8ed91495-3b1f-46a8-8497-2c345467e0f7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:05.872168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ed91495-3b1f-46a8-8497-2c345467e0f7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:05.872855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ed91495-3b1f-46a8-8497-2c345467e0f7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:05.873883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ed91495-3b1f-46a8-8497-2c345467e0f7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:05.874678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ed91495-3b1f-46a8-8497-2c345467e0f7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:05.918372 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8ed91495-3b1f-46a8-8497-2c345467e0f7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060914 May 28 21:07:05.924822 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 700/1341] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:07:05 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:07:05.931772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eed44208-7b45-458e-ac09-e1d69a7f0380 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '.version_select at 0x7f4d64c9b1f0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:06.028838 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eed44208-7b45-458e-ac09-e1d69a7f0380 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-694297558" status: 202 len: 0 microversion: 2.1 time: 0.099682 May 28 21:07:06.028838 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 701/1342] 10.222.0.33 () {58 vars in 1217 bytes} [Sat May 28 21:07:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-694297558 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:07:06.033054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-126c9e44-859f-4c65-99ff-b99c5e3d8c5a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:06.035285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-126c9e44-859f-4c65-99ff-b99c5e3d8c5a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:06.069193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-126c9e44-859f-4c65-99ff-b99c5e3d8c5a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:06.070181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-126c9e44-859f-4c65-99ff-b99c5e3d8c5a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:06.072252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-126c9e44-859f-4c65-99ff-b99c5e3d8c5a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:06.076037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-126c9e44-859f-4c65-99ff-b99c5e3d8c5a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:06.282495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-379de165-510c-43f9-9cac-b5e24fe27f85 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:06.317451 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-379de165-510c-43f9-9cac-b5e24fe27f85 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1469 microversion: 2.1 time: 0.622510 May 28 21:07:06.318732 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 642/1343] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:05 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1469 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:06.468022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-126c9e44-859f-4c65-99ff-b99c5e3d8c5a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:06.477936 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-126c9e44-859f-4c65-99ff-b99c5e3d8c5a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1318 microversion: 2.1 time: 0.449675 May 28 21:07:06.480527 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 702/1344] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:06 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:06.711271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8b89694e-afe5-40c1-9197-49b66c24c5bd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:06.712598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8b89694e-afe5-40c1-9197-49b66c24c5bd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:06.719394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b89694e-afe5-40c1-9197-49b66c24c5bd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:06.720088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b89694e-afe5-40c1-9197-49b66c24c5bd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:06.721073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b89694e-afe5-40c1-9197-49b66c24c5bd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:06.721684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b89694e-afe5-40c1-9197-49b66c24c5bd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:06.761870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a046ceea-0e67-4d7c-8445-c37265f1bc23 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:06.762692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a046ceea-0e67-4d7c-8445-c37265f1bc23 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:06.771336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a046ceea-0e67-4d7c-8445-c37265f1bc23 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:06.771931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a046ceea-0e67-4d7c-8445-c37265f1bc23 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:06.773625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a046ceea-0e67-4d7c-8445-c37265f1bc23 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:06.774336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a046ceea-0e67-4d7c-8445-c37265f1bc23 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:06.813446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8b89694e-afe5-40c1-9197-49b66c24c5bd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:06.827648 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8b89694e-afe5-40c1-9197-49b66c24c5bd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1283 microversion: 2.1 time: 0.121123 May 28 21:07:06.839142 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 643/1345] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:06 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1283 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:06.940227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a046ceea-0e67-4d7c-8445-c37265f1bc23 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:06.948158 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a046ceea-0e67-4d7c-8445-c37265f1bc23 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1535 microversion: 2.1 time: 0.192941 May 28 21:07:06.948742 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 703/1346] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:06 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1535 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:07.335850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c85478b9-0e50-41b7-a787-f640d33bd19e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:07.336495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c85478b9-0e50-41b7-a787-f640d33bd19e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:07.356850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c85478b9-0e50-41b7-a787-f640d33bd19e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:07.357331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c85478b9-0e50-41b7-a787-f640d33bd19e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:07.358251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c85478b9-0e50-41b7-a787-f640d33bd19e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:07.358707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c85478b9-0e50-41b7-a787-f640d33bd19e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:07.499927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-58e757f0-d82c-4094-b45f-aacd26c93f2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:07.500864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-58e757f0-d82c-4094-b45f-aacd26c93f2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:07.509179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-58e757f0-d82c-4094-b45f-aacd26c93f2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:07.510111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-58e757f0-d82c-4094-b45f-aacd26c93f2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:07.510916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-58e757f0-d82c-4094-b45f-aacd26c93f2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:07.511364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-58e757f0-d82c-4094-b45f-aacd26c93f2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:07.632695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:07.663975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c85478b9-0e50-41b7-a787-f640d33bd19e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:07.667359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=32 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:07.681526 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c85478b9-0e50-41b7-a787-f640d33bd19e tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1469 microversion: 2.1 time: 0.348068 May 28 21:07:07.682175 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 644/1347] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:07 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1469 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:07.756269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-58e757f0-d82c-4094-b45f-aacd26c93f2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:07.770108 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-58e757f0-d82c-4094-b45f-aacd26c93f2b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1318 microversion: 2.1 time: 0.274045 May 28 21:07:07.771130 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 704/1348] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:07 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:07.844799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9cfed87c-0081-4395-af4c-7af1ee261e19 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:07.845712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9cfed87c-0081-4395-af4c-7af1ee261e19 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:07.854303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9cfed87c-0081-4395-af4c-7af1ee261e19 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:07.854906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9cfed87c-0081-4395-af4c-7af1ee261e19 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:07.856194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9cfed87c-0081-4395-af4c-7af1ee261e19 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:07.857357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9cfed87c-0081-4395-af4c-7af1ee261e19 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:07.913207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-d68822be-f62e-4434-8a62-7e4646db05ce req-3f843f8c-9613-4211-949d-8789e05ba659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394fe269-dd5e-4d4e-8f49-de1df1812e6a", "tag": "e413ef97-3a02-48d0-ae33-341fafd919b8"}, {"server_uuid": "edd95c29-a1f5-4f51-bc41-28015bfd2bec", "name": "network-vif-deleted", "tag": "7b9b3936-54e0-461a-9a4b-6152d1b72738"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:07.926589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d68822be-f62e-4434-8a62-7e4646db05ce req-3f843f8c-9613-4211-949d-8789e05ba659 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:07.927370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d68822be-f62e-4434-8a62-7e4646db05ce req-3f843f8c-9613-4211-949d-8789e05ba659 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:07.948014 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-d68822be-f62e-4434-8a62-7e4646db05ce req-3f843f8c-9613-4211-949d-8789e05ba659 service nova] Creating event network-changed:e413ef97-3a02-48d0-ae33-341fafd919b8 for instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a on nch1-master-1 May 28 21:07:07.948934 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-d68822be-f62e-4434-8a62-7e4646db05ce req-3f843f8c-9613-4211-949d-8789e05ba659 service nova] Creating event network-vif-deleted:7b9b3936-54e0-461a-9a4b-6152d1b72738 for instance edd95c29-a1f5-4f51-bc41-28015bfd2bec on nch2-master-1 May 28 21:07:07.956240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-d68822be-f62e-4434-8a62-7e4646db05ce req-3f843f8c-9613-4211-949d-8789e05ba659 service nova] Instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:07:07.974261 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-d68822be-f62e-4434-8a62-7e4646db05ce req-3f843f8c-9613-4211-949d-8789e05ba659 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.064716 May 28 21:07:07.975536 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 705/1349] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:07:07.981350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cd26ed2a-158c-4d59-833e-4cd156ffeec2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:07.983496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cd26ed2a-158c-4d59-833e-4cd156ffeec2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:07.991625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd26ed2a-158c-4d59-833e-4cd156ffeec2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:07.993097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd26ed2a-158c-4d59-833e-4cd156ffeec2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:07.994651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd26ed2a-158c-4d59-833e-4cd156ffeec2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:07.995132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd26ed2a-158c-4d59-833e-4cd156ffeec2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:08.167092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9cfed87c-0081-4395-af4c-7af1ee261e19 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:08.177707 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9cfed87c-0081-4395-af4c-7af1ee261e19 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1325 microversion: 2.1 time: 0.336895 May 28 21:07:08.178679 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 645/1350] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:07 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1325 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:08.193073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cd26ed2a-158c-4d59-833e-4cd156ffeec2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:08.204284 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cd26ed2a-158c-4d59-833e-4cd156ffeec2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1535 microversion: 2.1 time: 0.227352 May 28 21:07:08.205656 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 706/1351] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:07 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1535 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:08.701269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6b44f676-c6a0-418b-94a7-f1b79b848464 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:08.701926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6b44f676-c6a0-418b-94a7-f1b79b848464 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:08.744128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b44f676-c6a0-418b-94a7-f1b79b848464 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:08.745097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b44f676-c6a0-418b-94a7-f1b79b848464 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:08.746158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b44f676-c6a0-418b-94a7-f1b79b848464 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:08.747356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b44f676-c6a0-418b-94a7-f1b79b848464 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:08.793143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-28d35e66-33a3-4c06-b261-0cd03483e768 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:08.793709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b44f676-c6a0-418b-94a7-f1b79b848464 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:08.793709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b44f676-c6a0-418b-94a7-f1b79b848464 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:08.793902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-28d35e66-33a3-4c06-b261-0cd03483e768 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:08.794226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-6b44f676-c6a0-418b-94a7-f1b79b848464 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lazy-loading 'fault' on Instance uuid edd95c29-a1f5-4f51-bc41-28015bfd2bec {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:07:08.809467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28d35e66-33a3-4c06-b261-0cd03483e768 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:08.809966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28d35e66-33a3-4c06-b261-0cd03483e768 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:08.813717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28d35e66-33a3-4c06-b261-0cd03483e768 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:08.815243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28d35e66-33a3-4c06-b261-0cd03483e768 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:08.864527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6b44f676-c6a0-418b-94a7-f1b79b848464 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '478d1609aa114d16b338e07d2d4c05c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e1dc5556624e2fb8de8a030c34c334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:08.873715 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6b44f676-c6a0-418b-94a7-f1b79b848464 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 200 len: 1304 microversion: 2.1 time: 0.176235 May 28 21:07:08.874858 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 646/1352] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:08 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 1304 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:09.053621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-28d35e66-33a3-4c06-b261-0cd03483e768 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:09.066962 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-28d35e66-33a3-4c06-b261-0cd03483e768 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1318 microversion: 2.1 time: 0.279816 May 28 21:07:09.068082 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 707/1353] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:08 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:09.194178 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-958947de-405e-477e-9e34-dc5fb4d85f51 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:09.194810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-958947de-405e-477e-9e34-dc5fb4d85f51 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:09.201344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-958947de-405e-477e-9e34-dc5fb4d85f51 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:09.201804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-958947de-405e-477e-9e34-dc5fb4d85f51 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:09.202787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-958947de-405e-477e-9e34-dc5fb4d85f51 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:09.203243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-958947de-405e-477e-9e34-dc5fb4d85f51 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:09.231984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c2f9754-67ca-434d-a5ab-5cca2583f51b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:09.236606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8c2f9754-67ca-434d-a5ab-5cca2583f51b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:09.257521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c2f9754-67ca-434d-a5ab-5cca2583f51b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:09.262745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c2f9754-67ca-434d-a5ab-5cca2583f51b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:09.263868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c2f9754-67ca-434d-a5ab-5cca2583f51b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:09.264484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c2f9754-67ca-434d-a5ab-5cca2583f51b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:09.597648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8c2f9754-67ca-434d-a5ab-5cca2583f51b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:09.616032 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8c2f9754-67ca-434d-a5ab-5cca2583f51b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1535 microversion: 2.1 time: 0.390156 May 28 21:07:09.618155 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 708/1354] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:09 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1535 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:09.632541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-958947de-405e-477e-9e34-dc5fb4d85f51 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:09.637591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-8cd44668-6907-4d6b-8aba-89c5b9f5f7ad req-e1c8e200-678c-4cca-a745-1f08f971134b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65edf30b-24d4-4341-b899-05f4e390d727", "name": "network-vif-plugged", "status": "completed", "tag": "2a3deb72-2842-4aed-b050-ff0c3043c594"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:09.644879 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-958947de-405e-477e-9e34-dc5fb4d85f51 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1325 microversion: 2.1 time: 0.455059 May 28 21:07:09.652239 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 647/1355] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:09 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1325 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:09.669550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8cd44668-6907-4d6b-8aba-89c5b9f5f7ad req-e1c8e200-678c-4cca-a745-1f08f971134b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:09.670053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8cd44668-6907-4d6b-8aba-89c5b9f5f7ad req-e1c8e200-678c-4cca-a745-1f08f971134b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:09.684803 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-8cd44668-6907-4d6b-8aba-89c5b9f5f7ad req-e1c8e200-678c-4cca-a745-1f08f971134b service nova] Creating event network-vif-plugged:2a3deb72-2842-4aed-b050-ff0c3043c594 for instance 65edf30b-24d4-4341-b899-05f4e390d727 on nch1-master-1 May 28 21:07:09.692384 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-8cd44668-6907-4d6b-8aba-89c5b9f5f7ad req-e1c8e200-678c-4cca-a745-1f08f971134b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071878 May 28 21:07:09.693789 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 709/1356] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:09.892078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-057c036f-2469-471f-8f59-d6dcbe88c1c3 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:09.892882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-057c036f-2469-471f-8f59-d6dcbe88c1c3 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] [instance: edd95c29-a1f5-4f51-bc41-28015bfd2bec] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:09.902789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-057c036f-2469-471f-8f59-d6dcbe88c1c3 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:09.903398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-057c036f-2469-471f-8f59-d6dcbe88c1c3 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:09.904451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-057c036f-2469-471f-8f59-d6dcbe88c1c3 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:09.904997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-057c036f-2469-471f-8f59-d6dcbe88c1c3 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:09.912090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:09.926476 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-057c036f-2469-471f-8f59-d6dcbe88c1c3 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] HTTP exception thrown: Instance edd95c29-a1f5-4f51-bc41-28015bfd2bec could not be found. May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-057c036f-2469-471f-8f59-d6dcbe88c1c3 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Request method failure captured: May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec HTTP/1.1 May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko5b4uBTSgdPdO3qaKB0CFqOB9VgPoqLFeq3stVjxdwuLJxpegESGQBrjvjdTRm3DSkH1r9IZEbISnNIg_2y_ycYn_e2V0eWYnitfWdawTtr3ROXwppCWOzRt_X9kPmxY857RYe0NWPwWMjVbxqyyRNenNSmMIgujt5rqZN7mk0AZY4 May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 56e1dc5556624e2fb8de8a030c34c334 May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersAdminTestJSON-191015418 May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:07:09.929269 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:07:09.930751 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_56e1dc5556624e2fb8de8a030c34c334", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56e1dc5556624e2fb8de8a030c34c334"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/56e1dc5556624e2fb8de8a030c34c334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/56e1dc5556624e2fb8de8a030c34c334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:09.930751 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersAdminTestJSON-191015418 May 28 21:07:09.930751 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 56e1dc5556624e2fb8de8a030c34c334 May 28 21:07:09.930751 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersAdminTestJSON-191015418 May 28 21:07:09.930751 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersAdminTestJSON-191015418-project May 28 21:07:09.930751 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:07:09.930751 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:07:09.930751 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 478d1609aa114d16b338e07d2d4c05c9 May 28 21:07:09.930751 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersAdminTestJSON-191015418-project May 28 21:07:09.930751 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:07:09.930751 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance edd95c29-a1f5-4f51-bc41-28015bfd2bec could not be found. May 28 21:07:09.930751 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'edd95c29-a1f5-4f51-bc41-28015bfd2bec'} May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edd95c29-a1f5-4f51-bc41-28015bfd2bec could not be found. May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:09.932017 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edd95c29-a1f5-4f51-bc41-28015bfd2bec could not be found. May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edd95c29-a1f5-4f51-bc41-28015bfd2bec could not be found. May 28 21:07:09.933401 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:09.950352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-057c036f-2469-471f-8f59-d6dcbe88c1c3 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] Returning 404 to user: Instance edd95c29-a1f5-4f51-bc41-28015bfd2bec could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:09.952167 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-057c036f-2469-471f-8f59-d6dcbe88c1c3 tempest-ServersAdminTestJSON-191015418 tempest-ServersAdminTestJSON-191015418-project] 10.222.0.33 "GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec" status: 404 len: 111 microversion: 2.1 time: 0.064204 May 28 21:07:09.952833 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 648/1357] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:09 2022] GET /compute/v2.1/servers/edd95c29-a1f5-4f51-bc41-28015bfd2bec => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:07:09.998931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-e9f60f7c-6664-4578-b9f8-efdcfbd24b91 req-a57de4fc-2f9e-4962-a4fb-60f46fd975f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbf5dac4-559d-41fb-a402-c9225810fc82", "tag": "c501832c-f99f-4cca-bfa2-7dfbb896762c"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:10.019707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e9f60f7c-6664-4578-b9f8-efdcfbd24b91 req-a57de4fc-2f9e-4962-a4fb-60f46fd975f4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:10.020675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e9f60f7c-6664-4578-b9f8-efdcfbd24b91 req-a57de4fc-2f9e-4962-a4fb-60f46fd975f4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:10.042686 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e9f60f7c-6664-4578-b9f8-efdcfbd24b91 req-a57de4fc-2f9e-4962-a4fb-60f46fd975f4 service nova] Creating event network-changed:c501832c-f99f-4cca-bfa2-7dfbb896762c for instance fbf5dac4-559d-41fb-a402-c9225810fc82 on nch1-master-1 May 28 21:07:10.050814 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-e9f60f7c-6664-4578-b9f8-efdcfbd24b91 req-a57de4fc-2f9e-4962-a4fb-60f46fd975f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059462 May 28 21:07:10.052463 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 710/1358] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:07:10.084493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-262ef247-0514-42e6-b88c-ad25993adb8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:10.084870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-262ef247-0514-42e6-b88c-ad25993adb8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:10.093200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-262ef247-0514-42e6-b88c-ad25993adb8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:10.093657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-262ef247-0514-42e6-b88c-ad25993adb8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:10.094476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-262ef247-0514-42e6-b88c-ad25993adb8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:10.094922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-262ef247-0514-42e6-b88c-ad25993adb8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:10.259500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-262ef247-0514-42e6-b88c-ad25993adb8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:10.270540 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-262ef247-0514-42e6-b88c-ad25993adb8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1318 microversion: 2.1 time: 0.190133 May 28 21:07:10.271139 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 649/1359] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:10 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:10.635505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-60e1f36d-08c3-4474-8286-f3862015bb97 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:10.636263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-60e1f36d-08c3-4474-8286-f3862015bb97 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:10.644119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60e1f36d-08c3-4474-8286-f3862015bb97 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:10.644584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60e1f36d-08c3-4474-8286-f3862015bb97 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:10.645400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60e1f36d-08c3-4474-8286-f3862015bb97 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:10.646226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60e1f36d-08c3-4474-8286-f3862015bb97 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:10.671845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-27d44a0a-2ffb-41c9-a918-495afab67b84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:10.672469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-27d44a0a-2ffb-41c9-a918-495afab67b84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:10.681018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27d44a0a-2ffb-41c9-a918-495afab67b84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:10.686019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27d44a0a-2ffb-41c9-a918-495afab67b84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:10.686019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27d44a0a-2ffb-41c9-a918-495afab67b84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:10.686019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27d44a0a-2ffb-41c9-a918-495afab67b84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:10.884980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-60e1f36d-08c3-4474-8286-f3862015bb97 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:10.894166 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-60e1f36d-08c3-4474-8286-f3862015bb97 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1528 microversion: 2.1 time: 0.262683 May 28 21:07:10.905568 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 711/1360] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:10 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1528 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:10.912071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c81e44fe-4ae4-4437-b444-31bf4afa70c3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:10.912880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c81e44fe-4ae4-4437-b444-31bf4afa70c3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:10.919754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c81e44fe-4ae4-4437-b444-31bf4afa70c3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:10.920680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c81e44fe-4ae4-4437-b444-31bf4afa70c3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:10.921644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c81e44fe-4ae4-4437-b444-31bf4afa70c3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:10.923683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c81e44fe-4ae4-4437-b444-31bf4afa70c3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:10.941696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-27d44a0a-2ffb-41c9-a918-495afab67b84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:10.949780 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-27d44a0a-2ffb-41c9-a918-495afab67b84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1325 microversion: 2.1 time: 0.291644 May 28 21:07:10.953408 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 650/1361] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:10 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1325 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:11.141647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c81e44fe-4ae4-4437-b444-31bf4afa70c3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:11.153371 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c81e44fe-4ae4-4437-b444-31bf4afa70c3 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1528 microversion: 2.1 time: 0.246321 May 28 21:07:11.156177 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 712/1362] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:10 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1528 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:11.179022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0e7e51a1-5c84-41d8-b205-16d58a39e26b tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:11.179941 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:07:11.179941 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:07:11.186359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=14 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:11.199862 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-0e7e51a1-5c84-41d8-b205-16d58a39e26b tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] HTTP exception thrown: Flavor 16150357-3f84-4cbe-8c22-7225331e95af could not be found. May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0e7e51a1-5c84-41d8-b205-16d58a39e26b tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Request method failure captured: May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/flavors/16150357-3f84-4cbe-8c22-7225331e95af HTTP/1.1 May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4jV2mgj86GlHsVQpwwmnSPCNJBhEBDwZXnBEIIWcoOd5JM1ewdFbHp4lGxNCcCcIAdcPl3vjYCLs9awFQ8UzJbTvul3t1HGEuog-5kcmUO2-q3jkUy38ZTVivFgwzFqy-L1gXBLO8CKyJS6S5GUlMxcGpcIbsyUeMeJpDNs0Rlbww May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01b8421c635c440eaec446bfb659bd22 May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-MigrationsAdminTest-108067223 May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:07:11.210815 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:07:11.212491 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01b8421c635c440eaec446bfb659bd22", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01b8421c635c440eaec446bfb659bd22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01b8421c635c440eaec446bfb659bd22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01b8421c635c440eaec446bfb659bd22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:11.212491 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-MigrationsAdminTest-108067223 May 28 21:07:11.212491 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01b8421c635c440eaec446bfb659bd22 May 28 21:07:11.212491 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-MigrationsAdminTest-108067223 May 28 21:07:11.212491 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-MigrationsAdminTest-108067223-project-admin May 28 21:07:11.212491 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:07:11.212491 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:07:11.212491 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: a43b061d4e864c289ac541d11e46c4de May 28 21:07:11.212491 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-MigrationsAdminTest-108067223-project-admin May 28 21:07:11.212491 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:07:11.212491 ncdv-master-1 devstack@n-api.service[143129]: exception: Flavor 16150357-3f84-4cbe-8c22-7225331e95af could not be found. May 28 21:07:11.212491 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '16150357-3f84-4cbe-8c22-7225331e95af'} May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi flavor.destroy() May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 16150357-3f84-4cbe-8c22-7225331e95af could not be found. May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:11.213389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 16150357-3f84-4cbe-8c22-7225331e95af could not be found. May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 16150357-3f84-4cbe-8c22-7225331e95af could not be found. May 28 21:07:11.214714 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:11.216238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0e7e51a1-5c84-41d8-b205-16d58a39e26b tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Returning 404 to user: Flavor 16150357-3f84-4cbe-8c22-7225331e95af could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:11.217228 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0e7e51a1-5c84-41d8-b205-16d58a39e26b tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/16150357-3f84-4cbe-8c22-7225331e95af" status: 404 len: 109 microversion: 2.1 time: 0.043145 May 28 21:07:11.218473 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 651/1363] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:07:11 2022] DELETE /compute/v2.1/flavors/16150357-3f84-4cbe-8c22-7225331e95af => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:07:11.290995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-355cf89f-4790-4287-ac07-171b16707a77 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:11.291763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-355cf89f-4790-4287-ac07-171b16707a77 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:11.314392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-355cf89f-4790-4287-ac07-171b16707a77 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:11.315776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-355cf89f-4790-4287-ac07-171b16707a77 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:11.316834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-355cf89f-4790-4287-ac07-171b16707a77 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:11.317437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-355cf89f-4790-4287-ac07-171b16707a77 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:11.539169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-355cf89f-4790-4287-ac07-171b16707a77 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:11.551590 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-355cf89f-4790-4287-ac07-171b16707a77 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1318 microversion: 2.1 time: 0.267899 May 28 21:07:11.552281 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 713/1364] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:11 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:11.573979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1256272649", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:11.661318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:07:11.669254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-801413311", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:11.754532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:07:12.019266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:07:12.019694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:07:12.020171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:07:12.020606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:07:12.021021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:07:12.038592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:12.038956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:12.039822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:12.040263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:12.060710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Getting quotas for project d6c38a96a96b4fba9e41ac58f5054803. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:07:12.064475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:07:12.064984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:07:12.065425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:07:12.065872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:07:12.066295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:07:12.066784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Getting quotas for user c14b965da64c40e382c69050ba01b183 and project d6c38a96a96b4fba9e41ac58f5054803. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:07:12.076311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:12.076778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:12.077595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:12.078125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:12.081800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:07:12.084817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:07:12.097030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Getting quotas for project 72d0adc19fe145caa50c8a0767765092. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:07:12.102437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Getting quotas for user d1b349adf52040d1822953c96514ff7e and project 72d0adc19fe145caa50c8a0767765092. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:07:12.115505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:07:12.118085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:07:12.220050 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-64ef3c94-c926-4a00-aefa-58db3689d6c2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666348 May 28 21:07:12.220884 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 714/1365] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:07:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:07:12.225453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-1075457f-9cf5-45c4-ae5c-d4f0e1dc9fc2 req-ee9698d3-9ccb-4429-a2aa-2f6ce3144bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06501745-d6e0-43da-b96c-8713586a5d92", "name": "network-vif-plugged", "status": "completed", "tag": "ac98e234-98a5-42f5-ad66-6406e87566fa"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:12.234375 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1075457f-9cf5-45c4-ae5c-d4f0e1dc9fc2 req-ee9698d3-9ccb-4429-a2aa-2f6ce3144bed service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:12.235561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1075457f-9cf5-45c4-ae5c-d4f0e1dc9fc2 req-ee9698d3-9ccb-4429-a2aa-2f6ce3144bed service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:12.246518 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-1075457f-9cf5-45c4-ae5c-d4f0e1dc9fc2 req-ee9698d3-9ccb-4429-a2aa-2f6ce3144bed service nova] Creating event network-vif-plugged:ac98e234-98a5-42f5-ad66-6406e87566fa for instance 06501745-d6e0-43da-b96c-8713586a5d92 on nch2-master-1 May 28 21:07:12.251272 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-1075457f-9cf5-45c4-ae5c-d4f0e1dc9fc2 req-ee9698d3-9ccb-4429-a2aa-2f6ce3144bed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029179 May 28 21:07:12.251885 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 715/1366] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:12.257544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2e69cb34-638e-48bc-877a-4e2d4c0956a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:12.258284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2e69cb34-638e-48bc-877a-4e2d4c0956a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:12.265014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e69cb34-638e-48bc-877a-4e2d4c0956a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:12.265484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e69cb34-638e-48bc-877a-4e2d4c0956a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:12.266306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e69cb34-638e-48bc-877a-4e2d4c0956a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:12.267275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e69cb34-638e-48bc-877a-4e2d4c0956a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:12.319913 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-40f64ce9-9a65-4e1b-8e0c-2b2987a63247 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.946362 May 28 21:07:12.321033 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 652/1367] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:07:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:07:12.330015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-94a65de2-0b46-4614-b342-e6ed29f2891f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:12.334790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-94a65de2-0b46-4614-b342-e6ed29f2891f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:12.340148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:12.461536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-94a65de2-0b46-4614-b342-e6ed29f2891f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:12.476713 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-94a65de2-0b46-4614-b342-e6ed29f2891f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1213 microversion: 2.1 time: 0.154256 May 28 21:07:12.487895 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 653/1368] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:12 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1213 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:12.487895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3c843513-6509-4b70-ac40-ef086b8c896b tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:12.487895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3c843513-6509-4b70-ac40-ef086b8c896b tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:12.563896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3c843513-6509-4b70-ac40-ef086b8c896b tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:12.581127 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3c843513-6509-4b70-ac40-ef086b8c896b tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1222 microversion: 2.1 time: 0.094558 May 28 21:07:12.581127 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 654/1369] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:12 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:12.586199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2e69cb34-638e-48bc-877a-4e2d4c0956a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:12.590115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0970e818-b6ad-49af-93ee-cce2963e21d3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:12.591163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0970e818-b6ad-49af-93ee-cce2963e21d3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:12.597303 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2e69cb34-638e-48bc-877a-4e2d4c0956a4 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1325 microversion: 2.1 time: 0.341605 May 28 21:07:12.598524 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 716/1370] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:12 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1325 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:12.612175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0970e818-b6ad-49af-93ee-cce2963e21d3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:12.612659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0970e818-b6ad-49af-93ee-cce2963e21d3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:12.613540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0970e818-b6ad-49af-93ee-cce2963e21d3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:12.614029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0970e818-b6ad-49af-93ee-cce2963e21d3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:12.776742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0970e818-b6ad-49af-93ee-cce2963e21d3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:12.785216 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0970e818-b6ad-49af-93ee-cce2963e21d3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1318 microversion: 2.1 time: 0.206237 May 28 21:07:12.794915 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 655/1371] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:12 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:13.494601 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c1669d8b-291e-49be-8185-418670724f65 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:13.496989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c1669d8b-291e-49be-8185-418670724f65 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:13.499244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:13.502935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1669d8b-291e-49be-8185-418670724f65 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:13.503919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1669d8b-291e-49be-8185-418670724f65 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:13.504348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1669d8b-291e-49be-8185-418670724f65 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:13.504785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1669d8b-291e-49be-8185-418670724f65 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:13.569166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c1669d8b-291e-49be-8185-418670724f65 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:13.577282 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c1669d8b-291e-49be-8185-418670724f65 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1217 microversion: 2.1 time: 0.086881 May 28 21:07:13.577884 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 717/1372] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:13 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:13.595618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e2c0647f-1528-4f76-8ba0-21bba14dd762 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:13.596915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e2c0647f-1528-4f76-8ba0-21bba14dd762 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:13.614689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-96fb996d-defe-464f-b522-3020f5220700 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:13.616970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-96fb996d-defe-464f-b522-3020f5220700 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:13.621570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96fb996d-defe-464f-b522-3020f5220700 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:13.622376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96fb996d-defe-464f-b522-3020f5220700 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:13.623363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96fb996d-defe-464f-b522-3020f5220700 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:13.624048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96fb996d-defe-464f-b522-3020f5220700 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:13.674154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e2c0647f-1528-4f76-8ba0-21bba14dd762 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:13.684666 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e2c0647f-1528-4f76-8ba0-21bba14dd762 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1222 microversion: 2.1 time: 0.092876 May 28 21:07:13.685771 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 656/1373] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:13 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:13.803176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-98a37207-e31a-4878-a820-8d0bb41b2694 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:13.803977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-98a37207-e31a-4878-a820-8d0bb41b2694 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:13.805550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-96fb996d-defe-464f-b522-3020f5220700 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:13.814413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98a37207-e31a-4878-a820-8d0bb41b2694 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:13.815381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98a37207-e31a-4878-a820-8d0bb41b2694 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:13.816035 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-96fb996d-defe-464f-b522-3020f5220700 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1325 microversion: 2.1 time: 0.205070 May 28 21:07:13.816167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98a37207-e31a-4878-a820-8d0bb41b2694 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:13.822738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98a37207-e31a-4878-a820-8d0bb41b2694 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:13.826191 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 718/1374] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:13 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1325 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:13.964802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-98a37207-e31a-4878-a820-8d0bb41b2694 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:13.974571 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-98a37207-e31a-4878-a820-8d0bb41b2694 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1318 microversion: 2.1 time: 0.176263 May 28 21:07:13.975339 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 657/1375] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:13 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:14.270940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-464f3cfa-5d09-4f3b-87f2-88eeb4610bb1 req-f0e40702-c905-4e3c-aa93-2cc044820ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394fe269-dd5e-4d4e-8f49-de1df1812e6a", "name": "network-vif-plugged", "status": "completed", "tag": "e413ef97-3a02-48d0-ae33-341fafd919b8"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:14.277317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-464f3cfa-5d09-4f3b-87f2-88eeb4610bb1 req-f0e40702-c905-4e3c-aa93-2cc044820ca7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:14.277777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-464f3cfa-5d09-4f3b-87f2-88eeb4610bb1 req-f0e40702-c905-4e3c-aa93-2cc044820ca7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:14.289109 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-464f3cfa-5d09-4f3b-87f2-88eeb4610bb1 req-f0e40702-c905-4e3c-aa93-2cc044820ca7 service nova] Creating event network-vif-plugged:e413ef97-3a02-48d0-ae33-341fafd919b8 for instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a on nch1-master-1 May 28 21:07:14.299835 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-464f3cfa-5d09-4f3b-87f2-88eeb4610bb1 req-f0e40702-c905-4e3c-aa93-2cc044820ca7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034402 May 28 21:07:14.300444 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 719/1376] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:14.595045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-99b35ca2-8d8a-4459-9dc8-8beef7673734 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:14.595673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-99b35ca2-8d8a-4459-9dc8-8beef7673734 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:14.602926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-99b35ca2-8d8a-4459-9dc8-8beef7673734 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:14.603425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-99b35ca2-8d8a-4459-9dc8-8beef7673734 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:14.604204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-99b35ca2-8d8a-4459-9dc8-8beef7673734 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:14.604652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-99b35ca2-8d8a-4459-9dc8-8beef7673734 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:14.705627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-99b35ca2-8d8a-4459-9dc8-8beef7673734 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:14.707734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-43f757c3-1a12-41c5-b3c8-138fb5baa257 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:14.708799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-43f757c3-1a12-41c5-b3c8-138fb5baa257 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:14.727976 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-99b35ca2-8d8a-4459-9dc8-8beef7673734 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1265 microversion: 2.1 time: 0.136706 May 28 21:07:14.728537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43f757c3-1a12-41c5-b3c8-138fb5baa257 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:14.728679 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 658/1377] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:14 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1265 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:14.729002 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43f757c3-1a12-41c5-b3c8-138fb5baa257 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:14.737487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43f757c3-1a12-41c5-b3c8-138fb5baa257 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:14.737984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43f757c3-1a12-41c5-b3c8-138fb5baa257 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:14.765027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:14.833992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-707993d0-af3d-471e-9ddf-74a11cc15f84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:14.834678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-707993d0-af3d-471e-9ddf-74a11cc15f84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:14.842067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-707993d0-af3d-471e-9ddf-74a11cc15f84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:14.842554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-707993d0-af3d-471e-9ddf-74a11cc15f84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:14.846737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-43f757c3-1a12-41c5-b3c8-138fb5baa257 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:14.847578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-707993d0-af3d-471e-9ddf-74a11cc15f84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:14.848128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-707993d0-af3d-471e-9ddf-74a11cc15f84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:14.854490 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-43f757c3-1a12-41c5-b3c8-138fb5baa257 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1274 microversion: 2.1 time: 0.152254 May 28 21:07:14.855345 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 720/1378] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:14 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1274 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:15.001400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2e21928e-4770-4a51-a92b-c422f8ff3e7a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:15.002121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2e21928e-4770-4a51-a92b-c422f8ff3e7a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:15.039268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e21928e-4770-4a51-a92b-c422f8ff3e7a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:15.040067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e21928e-4770-4a51-a92b-c422f8ff3e7a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:15.047488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e21928e-4770-4a51-a92b-c422f8ff3e7a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:15.051049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e21928e-4770-4a51-a92b-c422f8ff3e7a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:15.059748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-707993d0-af3d-471e-9ddf-74a11cc15f84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:15.069211 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-707993d0-af3d-471e-9ddf-74a11cc15f84 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1325 microversion: 2.1 time: 0.240155 May 28 21:07:15.070678 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 659/1379] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:14 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:15.254846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2e21928e-4770-4a51-a92b-c422f8ff3e7a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:15.268295 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2e21928e-4770-4a51-a92b-c422f8ff3e7a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1468 microversion: 2.1 time: 0.270096 May 28 21:07:15.269075 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 721/1380] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:14 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1468 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:15.284932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ccdfc9b8-d22d-4a3c-a16b-57b430dc5453 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:15.290021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ccdfc9b8-d22d-4a3c-a16b-57b430dc5453 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 65edf30b-24d4-4341-b899-05f4e390d727] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:15.291807 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ccdfc9b8-d22d-4a3c-a16b-57b430dc5453 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:15.292454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ccdfc9b8-d22d-4a3c-a16b-57b430dc5453 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:15.293253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ccdfc9b8-d22d-4a3c-a16b-57b430dc5453 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:15.293702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ccdfc9b8-d22d-4a3c-a16b-57b430dc5453 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:15.482657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ccdfc9b8-d22d-4a3c-a16b-57b430dc5453 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:15.503709 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ccdfc9b8-d22d-4a3c-a16b-57b430dc5453 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727" status: 200 len: 1468 microversion: 2.1 time: 0.219339 May 28 21:07:15.503709 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 660/1381] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:15 2022] GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727 => generated 1468 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:15.519409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4fbc32c8-e778-4e68-b0d4-bf60532071a1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:15.526943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4fbc32c8-e778-4e68-b0d4-bf60532071a1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:15.538646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4fbc32c8-e778-4e68-b0d4-bf60532071a1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Searching by: {'reservation_id': 'r-vww0cjp1', 'deleted': False, 'project_id': '348fbbc628b44152b05362657c11230d'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:07:15.542459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fbc32c8-e778-4e68-b0d4-bf60532071a1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:15.544608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fbc32c8-e778-4e68-b0d4-bf60532071a1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:15.545663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fbc32c8-e778-4e68-b0d4-bf60532071a1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:15.552521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fbc32c8-e778-4e68-b0d4-bf60532071a1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:15.666131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-4fbc32c8-e778-4e68-b0d4-bf60532071a1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:07:15.755877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-56d20cd9-ec71-461d-b947-ef517b994c0a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:15.756619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-56d20cd9-ec71-461d-b947-ef517b994c0a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:15.772791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56d20cd9-ec71-461d-b947-ef517b994c0a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:15.773646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56d20cd9-ec71-461d-b947-ef517b994c0a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:15.774996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56d20cd9-ec71-461d-b947-ef517b994c0a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:15.776091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56d20cd9-ec71-461d-b947-ef517b994c0a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:15.795726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4fbc32c8-e778-4e68-b0d4-bf60532071a1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:15.809956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fbc32c8-e778-4e68-b0d4-bf60532071a1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:15.826239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fbc32c8-e778-4e68-b0d4-bf60532071a1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:15.907023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-56d20cd9-ec71-461d-b947-ef517b994c0a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:15.925584 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-56d20cd9-ec71-461d-b947-ef517b994c0a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1271 microversion: 2.1 time: 0.177398 May 28 21:07:15.935979 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 661/1382] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:15 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:15.949247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-91bb6f53-e6fe-40ef-a9da-d67e32eea711 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:15.953284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-91bb6f53-e6fe-40ef-a9da-d67e32eea711 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:15.968784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91bb6f53-e6fe-40ef-a9da-d67e32eea711 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:15.982961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91bb6f53-e6fe-40ef-a9da-d67e32eea711 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:15.982961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91bb6f53-e6fe-40ef-a9da-d67e32eea711 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:15.982961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91bb6f53-e6fe-40ef-a9da-d67e32eea711 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:16.063537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-91bb6f53-e6fe-40ef-a9da-d67e32eea711 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:16.083354 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4fbc32c8-e778-4e68-b0d4-bf60532071a1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?reservation_id=r-vww0cjp1" status: 200 len: 2929 microversion: 2.1 time: 0.569948 May 28 21:07:16.084237 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 722/1383] 10.222.0.33 () {58 vars in 1196 bytes} [Sat May 28 21:07:15 2022] GET /compute/v2.1/servers/detail?reservation_id=r-vww0cjp1 => generated 2929 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:16.089263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-356fed87-8604-4dbf-9cc6-95d73384a8ff tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:16.089628 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-91bb6f53-e6fe-40ef-a9da-d67e32eea711 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1292 microversion: 2.1 time: 0.150896 May 28 21:07:16.089900 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-356fed87-8604-4dbf-9cc6-95d73384a8ff tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:16.090501 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 662/1384] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:15 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1292 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:16.097468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-356fed87-8604-4dbf-9cc6-95d73384a8ff tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:16.098322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-356fed87-8604-4dbf-9cc6-95d73384a8ff tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:16.099266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-356fed87-8604-4dbf-9cc6-95d73384a8ff tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:16.099715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-356fed87-8604-4dbf-9cc6-95d73384a8ff tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:16.110241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6eef54f0-b8cd-463d-ad1a-51a7dfa12635 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:16.134084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.compute.server_groups [None req-6eef54f0-b8cd-463d-ad1a-51a7dfa12635 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Querying cell fc53a60a-e345-4363-abb1-87c4d33bcbf6(cell1) for 2 instances {{(pid=143129) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 28 21:07:16.140196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6eef54f0-b8cd-463d-ad1a-51a7dfa12635 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:16.140196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6eef54f0-b8cd-463d-ad1a-51a7dfa12635 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:16.157663 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6eef54f0-b8cd-463d-ad1a-51a7dfa12635 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/76eccd07-0c0f-48cd-978a-907ba89aa17f" status: 200 len: 270 microversion: 2.1 time: 0.060196 May 28 21:07:16.161946 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 663/1385] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:07:16 2022] GET /compute/v2.1/os-server-groups/76eccd07-0c0f-48cd-978a-907ba89aa17f => generated 270 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:07:16.172858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dbc37632-f0b3-49fb-b949-8dfd9dbb7d11 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:16.172858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dbc37632-f0b3-49fb-b949-8dfd9dbb7d11 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:16.178508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbc37632-f0b3-49fb-b949-8dfd9dbb7d11 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:16.179088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbc37632-f0b3-49fb-b949-8dfd9dbb7d11 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:16.180366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbc37632-f0b3-49fb-b949-8dfd9dbb7d11 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:16.180923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbc37632-f0b3-49fb-b949-8dfd9dbb7d11 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:16.389552 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dbc37632-f0b3-49fb-b949-8dfd9dbb7d11 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 200 len: 1619 microversion: 2.1 time: 0.224990 May 28 21:07:16.394603 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 664/1386] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:16 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 1619 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:16.421022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc5e4852-52a4-4e32-bfee-1a92bdb0b063 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:16.421658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc5e4852-52a4-4e32-bfee-1a92bdb0b063 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] [instance: 65edf30b-24d4-4341-b899-05f4e390d727] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:16.437050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-356fed87-8604-4dbf-9cc6-95d73384a8ff tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:16.438578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc5e4852-52a4-4e32-bfee-1a92bdb0b063 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:16.439543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc5e4852-52a4-4e32-bfee-1a92bdb0b063 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:16.442121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc5e4852-52a4-4e32-bfee-1a92bdb0b063 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:16.442951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc5e4852-52a4-4e32-bfee-1a92bdb0b063 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:16.446550 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-356fed87-8604-4dbf-9cc6-95d73384a8ff tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1325 microversion: 2.1 time: 0.361063 May 28 21:07:16.447219 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 723/1387] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:16 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1325 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:16.689594 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc5e4852-52a4-4e32-bfee-1a92bdb0b063 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727" status: 200 len: 1619 microversion: 2.1 time: 0.278388 May 28 21:07:16.690293 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 665/1388] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:16 2022] GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727 => generated 1619 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:16.912823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1268939391", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "9fd99f38-0c1f-4ec7-9ec6-03463939ec67"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:16.943928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0ce5a61c-5f9b-4134-80ce-b768e1ba15a2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:16.943928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0ce5a61c-5f9b-4134-80ce-b768e1ba15a2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:16.964935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ce5a61c-5f9b-4134-80ce-b768e1ba15a2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:16.964935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ce5a61c-5f9b-4134-80ce-b768e1ba15a2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:16.964935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ce5a61c-5f9b-4134-80ce-b768e1ba15a2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:16.964935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ce5a61c-5f9b-4134-80ce-b768e1ba15a2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:17.010991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:07:17.332006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0ce5a61c-5f9b-4134-80ce-b768e1ba15a2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:17.343369 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0ce5a61c-5f9b-4134-80ce-b768e1ba15a2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1313 microversion: 2.1 time: 0.404154 May 28 21:07:17.348103 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 666/1389] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:16 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:17.353246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-df72f7ec-0ce2-4f1d-9a88-c8f5111c40ac tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:17.354100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-df72f7ec-0ce2-4f1d-9a88-c8f5111c40ac tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:17.360825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df72f7ec-0ce2-4f1d-9a88-c8f5111c40ac tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:17.361603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df72f7ec-0ce2-4f1d-9a88-c8f5111c40ac tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:17.362607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df72f7ec-0ce2-4f1d-9a88-c8f5111c40ac tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:17.363394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df72f7ec-0ce2-4f1d-9a88-c8f5111c40ac tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:17.418226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:07:17.419133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:07:17.419734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:07:17.422534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:07:17.422534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:07:17.431316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:17.432304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:17.433470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:17.434645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:17.456422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:07:17.464505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:07:17.481607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:07:17.484727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:07:17.538487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-df72f7ec-0ce2-4f1d-9a88-c8f5111c40ac tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:17.548311 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-df72f7ec-0ce2-4f1d-9a88-c8f5111c40ac tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1322 microversion: 2.1 time: 0.199093 May 28 21:07:17.550338 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 667/1390] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:17 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:17.558288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ab8d806f-238c-4a83-a522-95b39377b2a0 req-86794abd-0520-4f1a-afa0-23a002a4d173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf5dac4-559d-41fb-a402-c9225810fc82", "name": "network-vif-plugged", "status": "completed", "tag": "c501832c-f99f-4cca-bfa2-7dfbb896762c"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:17.569351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ab8d806f-238c-4a83-a522-95b39377b2a0 req-86794abd-0520-4f1a-afa0-23a002a4d173 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:17.570159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ab8d806f-238c-4a83-a522-95b39377b2a0 req-86794abd-0520-4f1a-afa0-23a002a4d173 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:17.585304 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ab8d806f-238c-4a83-a522-95b39377b2a0 req-86794abd-0520-4f1a-afa0-23a002a4d173 service nova] Creating event network-vif-plugged:c501832c-f99f-4cca-bfa2-7dfbb896762c for instance fbf5dac4-559d-41fb-a402-c9225810fc82 on nch1-master-1 May 28 21:07:17.591839 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ab8d806f-238c-4a83-a522-95b39377b2a0 req-86794abd-0520-4f1a-afa0-23a002a4d173 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039178 May 28 21:07:17.593569 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 668/1391] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:17.599697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-15c66c0a-57b1-4bf8-8d56-aa59c72e9d24 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:17.600628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-15c66c0a-57b1-4bf8-8d56-aa59c72e9d24 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:17.610456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15c66c0a-57b1-4bf8-8d56-aa59c72e9d24 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:17.611751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15c66c0a-57b1-4bf8-8d56-aa59c72e9d24 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:17.612562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15c66c0a-57b1-4bf8-8d56-aa59c72e9d24 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:17.613682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15c66c0a-57b1-4bf8-8d56-aa59c72e9d24 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:17.704042 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6aa6e017-a291-4790-b843-d6f614990664 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797058 May 28 21:07:17.714936 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 724/1392] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:07:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:07:17.724666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8586637a-fa78-433a-a0d1-da2271457363 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:17.741741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8586637a-fa78-433a-a0d1-da2271457363 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:17.907709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-15c66c0a-57b1-4bf8-8d56-aa59c72e9d24 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:17.919355 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-15c66c0a-57b1-4bf8-8d56-aa59c72e9d24 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1325 microversion: 2.1 time: 0.323940 May 28 21:07:17.923196 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 669/1393] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:17 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1325 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:17.928319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8586637a-fa78-433a-a0d1-da2271457363 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:17.964059 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8586637a-fa78-433a-a0d1-da2271457363 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1217 microversion: 2.1 time: 0.245422 May 28 21:07:17.964879 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 725/1394] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:17 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1217 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:18.360739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-924402e6-3b3e-4024-b32d-afd6b67b2a92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:18.362037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-924402e6-3b3e-4024-b32d-afd6b67b2a92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:18.369571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-924402e6-3b3e-4024-b32d-afd6b67b2a92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:18.370066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-924402e6-3b3e-4024-b32d-afd6b67b2a92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:18.370976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-924402e6-3b3e-4024-b32d-afd6b67b2a92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:18.371453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-924402e6-3b3e-4024-b32d-afd6b67b2a92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:18.507993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-bb3f8622-28ba-432b-8f24-01e8ff43d7b5 req-ec7e09b8-8c21-4b64-90ae-37600530ab94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "801b7889-1935-4bb4-8e8a-c34c2cf3c100", "tag": "0e646b8c-f3f2-4ee5-91b0-aea5324fcf34"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:18.522017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-bb3f8622-28ba-432b-8f24-01e8ff43d7b5 req-ec7e09b8-8c21-4b64-90ae-37600530ab94 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:18.522474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-bb3f8622-28ba-432b-8f24-01e8ff43d7b5 req-ec7e09b8-8c21-4b64-90ae-37600530ab94 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:18.538938 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-bb3f8622-28ba-432b-8f24-01e8ff43d7b5 req-ec7e09b8-8c21-4b64-90ae-37600530ab94 service nova] Creating event network-changed:0e646b8c-f3f2-4ee5-91b0-aea5324fcf34 for instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 on nch1-master-1 May 28 21:07:18.545197 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-bb3f8622-28ba-432b-8f24-01e8ff43d7b5 req-ec7e09b8-8c21-4b64-90ae-37600530ab94 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040817 May 28 21:07:18.546206 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 726/1395] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:18.558970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-924402e6-3b3e-4024-b32d-afd6b67b2a92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:18.574234 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-924402e6-3b3e-4024-b32d-afd6b67b2a92 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1313 microversion: 2.1 time: 0.217345 May 28 21:07:18.575020 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 670/1396] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:18 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:18.589671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-37dbbca7-b678-4ef7-bde4-09fb3825f401 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:18.594462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-37dbbca7-b678-4ef7-bde4-09fb3825f401 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:18.599913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37dbbca7-b678-4ef7-bde4-09fb3825f401 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:18.600586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37dbbca7-b678-4ef7-bde4-09fb3825f401 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:18.601629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37dbbca7-b678-4ef7-bde4-09fb3825f401 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:18.602194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37dbbca7-b678-4ef7-bde4-09fb3825f401 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:18.936968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5b385bb0-5a23-4e8e-8b2d-52db5f14d563 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:18.938102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5b385bb0-5a23-4e8e-8b2d-52db5f14d563 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:18.947148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b385bb0-5a23-4e8e-8b2d-52db5f14d563 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:18.947922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b385bb0-5a23-4e8e-8b2d-52db5f14d563 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:18.949070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b385bb0-5a23-4e8e-8b2d-52db5f14d563 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:18.949686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b385bb0-5a23-4e8e-8b2d-52db5f14d563 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:18.990670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:19.169162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-37dbbca7-b678-4ef7-bde4-09fb3825f401 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:19.180473 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-37dbbca7-b678-4ef7-bde4-09fb3825f401 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1322 microversion: 2.1 time: 0.615113 May 28 21:07:19.183058 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 727/1397] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:18 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1322 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:19.195169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-337e3fbe-6210-406f-8002-3452cdcf8a76 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:19.198490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-337e3fbe-6210-406f-8002-3452cdcf8a76 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:19.211383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-337e3fbe-6210-406f-8002-3452cdcf8a76 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:19.212171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-337e3fbe-6210-406f-8002-3452cdcf8a76 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:19.213313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-337e3fbe-6210-406f-8002-3452cdcf8a76 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:19.214051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-337e3fbe-6210-406f-8002-3452cdcf8a76 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:19.331692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5b385bb0-5a23-4e8e-8b2d-52db5f14d563 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:19.340821 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5b385bb0-5a23-4e8e-8b2d-52db5f14d563 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1325 microversion: 2.1 time: 0.407673 May 28 21:07:19.352293 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 671/1398] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:18 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1325 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:19.362245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-337e3fbe-6210-406f-8002-3452cdcf8a76 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:19.373276 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-337e3fbe-6210-406f-8002-3452cdcf8a76 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1221 microversion: 2.1 time: 0.186368 May 28 21:07:19.374168 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 728/1399] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:19 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1221 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:19.592140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-85e2c4df-1aca-4810-b022-59625b093381 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:19.592774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-85e2c4df-1aca-4810-b022-59625b093381 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:19.600337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85e2c4df-1aca-4810-b022-59625b093381 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:19.600808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85e2c4df-1aca-4810-b022-59625b093381 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:19.604106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85e2c4df-1aca-4810-b022-59625b093381 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:19.604106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85e2c4df-1aca-4810-b022-59625b093381 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:19.767649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-85e2c4df-1aca-4810-b022-59625b093381 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:19.777541 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-85e2c4df-1aca-4810-b022-59625b093381 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1313 microversion: 2.1 time: 0.189312 May 28 21:07:19.778693 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 672/1400] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:19 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:20.190331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1621695048", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "a8b32fbe-2efc-4d44-9401-a7ba6c57fae6"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:20.200925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1b2bbe69-5b50-46b7-b23c-bd9f66c2a635 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:20.201479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1b2bbe69-5b50-46b7-b23c-bd9f66c2a635 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:20.218949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b2bbe69-5b50-46b7-b23c-bd9f66c2a635 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:20.218949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b2bbe69-5b50-46b7-b23c-bd9f66c2a635 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:20.218949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b2bbe69-5b50-46b7-b23c-bd9f66c2a635 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:20.218949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b2bbe69-5b50-46b7-b23c-bd9f66c2a635 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:20.254249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] validate_networks() for [('a8b32fbe-2efc-4d44-9401-a7ba6c57fae6', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:07:20.452151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1b2bbe69-5b50-46b7-b23c-bd9f66c2a635 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:20.460586 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1b2bbe69-5b50-46b7-b23c-bd9f66c2a635 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1322 microversion: 2.1 time: 0.264135 May 28 21:07:20.467211 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 673/1401] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:20 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:20.471532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-803d219a-2abb-445c-8fdc-97ac5703ec0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:20.472186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-803d219a-2abb-445c-8fdc-97ac5703ec0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:20.478240 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-803d219a-2abb-445c-8fdc-97ac5703ec0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:20.478688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-803d219a-2abb-445c-8fdc-97ac5703ec0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:20.479507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-803d219a-2abb-445c-8fdc-97ac5703ec0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:20.480097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-803d219a-2abb-445c-8fdc-97ac5703ec0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:20.700958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-803d219a-2abb-445c-8fdc-97ac5703ec0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:20.709506 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-803d219a-2abb-445c-8fdc-97ac5703ec0b tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1522 microversion: 2.1 time: 0.241861 May 28 21:07:20.710065 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 674/1402] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:20 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:20.715181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a57745bd-cdc0-4a5c-8d3c-492baa1300a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:20.717286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a57745bd-cdc0-4a5c-8d3c-492baa1300a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:20.722162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a57745bd-cdc0-4a5c-8d3c-492baa1300a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:20.722638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a57745bd-cdc0-4a5c-8d3c-492baa1300a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:20.723559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a57745bd-cdc0-4a5c-8d3c-492baa1300a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:20.724029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a57745bd-cdc0-4a5c-8d3c-492baa1300a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:20.755780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:07:20.756430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:07:20.756916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:07:20.757404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:07:20.762409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:07:20.767326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:20.767986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:20.768966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:20.769452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:20.793253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Getting quotas for project f7a9c4408ec1432cb05c5256657886d4. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:07:20.801830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Getting quotas for user be94d10c650645658c755b7fc1595370 and project f7a9c4408ec1432cb05c5256657886d4. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:07:20.803265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a57745bd-cdc0-4a5c-8d3c-492baa1300a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:20.813890 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a57745bd-cdc0-4a5c-8d3c-492baa1300a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1277 microversion: 2.1 time: 0.102624 May 28 21:07:20.826006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:07:20.826207 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 675/1403] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:20 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1277 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:20.826337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:07:20.826451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-6829459b-f338-4223-b485-cc911c6321e9 req-7c11faff-8954-47cd-b31b-d9eee40a226d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc08f458-df9b-447b-8b5e-31407d2f80c4", "tag": "e0393585-b244-4d62-8666-a6f0f9316dc5"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:20.834844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6829459b-f338-4223-b485-cc911c6321e9 req-7c11faff-8954-47cd-b31b-d9eee40a226d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:20.835453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6829459b-f338-4223-b485-cc911c6321e9 req-7c11faff-8954-47cd-b31b-d9eee40a226d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:20.849936 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-6829459b-f338-4223-b485-cc911c6321e9 req-7c11faff-8954-47cd-b31b-d9eee40a226d service nova] Creating event network-changed:e0393585-b244-4d62-8666-a6f0f9316dc5 for instance bc08f458-df9b-447b-8b5e-31407d2f80c4 on nch1-master-1 May 28 21:07:20.855470 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-6829459b-f338-4223-b485-cc911c6321e9 req-7c11faff-8954-47cd-b31b-d9eee40a226d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036578 May 28 21:07:20.856175 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 676/1404] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:20.863774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-78f1e84b-5db4-4dae-add6-bd07b4f6ccfd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:20.864490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-78f1e84b-5db4-4dae-add6-bd07b4f6ccfd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:20.872747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78f1e84b-5db4-4dae-add6-bd07b4f6ccfd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:20.874902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78f1e84b-5db4-4dae-add6-bd07b4f6ccfd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:20.874902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78f1e84b-5db4-4dae-add6-bd07b4f6ccfd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:20.874902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78f1e84b-5db4-4dae-add6-bd07b4f6ccfd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:20.907840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-78f1e84b-5db4-4dae-add6-bd07b4f6ccfd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:07:20.980811 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-03c5f192-0a0d-4ede-b588-4ae26075bceb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.906830 May 28 21:07:20.982098 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 729/1405] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:07:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:07:21.004248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-abfc9fb6-36b7-46a1-992e-f93b5c6cc4dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:21.004248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-abfc9fb6-36b7-46a1-992e-f93b5c6cc4dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:21.004248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abfc9fb6-36b7-46a1-992e-f93b5c6cc4dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:21.004248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abfc9fb6-36b7-46a1-992e-f93b5c6cc4dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:21.004701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abfc9fb6-36b7-46a1-992e-f93b5c6cc4dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:21.004701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abfc9fb6-36b7-46a1-992e-f93b5c6cc4dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:21.193884 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-abfc9fb6-36b7-46a1-992e-f93b5c6cc4dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:21.214289 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-abfc9fb6-36b7-46a1-992e-f93b5c6cc4dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1313 microversion: 2.1 time: 0.227299 May 28 21:07:21.214289 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 730/1406] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:20 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:21.221173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fa153e09-c703-4f18-aff8-cac017e581ee tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:21.221903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fa153e09-c703-4f18-aff8-cac017e581ee tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:21.279575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fa153e09-c703-4f18-aff8-cac017e581ee tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:21.289471 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fa153e09-c703-4f18-aff8-cac017e581ee tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1218 microversion: 2.1 time: 0.076818 May 28 21:07:21.290117 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 731/1407] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:21 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:21.362963 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-78f1e84b-5db4-4dae-add6-bd07b4f6ccfd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 204 len: 0 microversion: 2.1 time: 0.504961 May 28 21:07:21.368252 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 677/1408] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:07:20 2022] DELETE /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:07:21.372025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0ae8941f-1bfc-4f86-af46-b5a689f2d9b7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:21.372651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0ae8941f-1bfc-4f86-af46-b5a689f2d9b7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:21.378660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ae8941f-1bfc-4f86-af46-b5a689f2d9b7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:21.379116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ae8941f-1bfc-4f86-af46-b5a689f2d9b7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:21.379882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ae8941f-1bfc-4f86-af46-b5a689f2d9b7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:21.380323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ae8941f-1bfc-4f86-af46-b5a689f2d9b7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:21.479144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-18b1a1ac-dac2-48ed-bf59-c4af5f3485e8 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:21.479898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-18b1a1ac-dac2-48ed-bf59-c4af5f3485e8 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:21.487685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-18b1a1ac-dac2-48ed-bf59-c4af5f3485e8 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:21.488143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-18b1a1ac-dac2-48ed-bf59-c4af5f3485e8 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:21.488924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-18b1a1ac-dac2-48ed-bf59-c4af5f3485e8 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:21.489538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-18b1a1ac-dac2-48ed-bf59-c4af5f3485e8 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:21.524977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0ae8941f-1bfc-4f86-af46-b5a689f2d9b7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:21.533244 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0ae8941f-1bfc-4f86-af46-b5a689f2d9b7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1528 microversion: 2.1 time: 0.164922 May 28 21:07:21.534548 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 732/1409] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:21 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1528 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:21.634583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-18b1a1ac-dac2-48ed-bf59-c4af5f3485e8 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:21.642277 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-18b1a1ac-dac2-48ed-bf59-c4af5f3485e8 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1322 microversion: 2.1 time: 0.168498 May 28 21:07:21.643405 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 678/1410] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:21 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:21.833669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9a57ca01-15b2-459d-bda7-20329cfb93ea tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:21.834317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9a57ca01-15b2-459d-bda7-20329cfb93ea tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:21.840367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a57ca01-15b2-459d-bda7-20329cfb93ea tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:21.840816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a57ca01-15b2-459d-bda7-20329cfb93ea tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:21.841578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a57ca01-15b2-459d-bda7-20329cfb93ea tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:21.842048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a57ca01-15b2-459d-bda7-20329cfb93ea tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:22.022902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9a57ca01-15b2-459d-bda7-20329cfb93ea tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:22.032942 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9a57ca01-15b2-459d-bda7-20329cfb93ea tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1317 microversion: 2.1 time: 0.202076 May 28 21:07:22.045617 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 733/1411] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:21 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:22.231192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1846e9b1-0dc1-48fe-9834-868764761005 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:22.234190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1846e9b1-0dc1-48fe-9834-868764761005 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:22.234190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:22.240251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1846e9b1-0dc1-48fe-9834-868764761005 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:22.240934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1846e9b1-0dc1-48fe-9834-868764761005 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:22.241908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1846e9b1-0dc1-48fe-9834-868764761005 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:22.242769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1846e9b1-0dc1-48fe-9834-868764761005 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:22.306571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e6bd8616-d3d4-4904-8406-3feff3b93df0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:22.307266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e6bd8616-d3d4-4904-8406-3feff3b93df0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:22.450839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e6bd8616-d3d4-4904-8406-3feff3b93df0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:22.459050 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e6bd8616-d3d4-4904-8406-3feff3b93df0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1218 microversion: 2.1 time: 0.156424 May 28 21:07:22.471211 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 734/1412] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:22 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1218 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:22.522488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1846e9b1-0dc1-48fe-9834-868764761005 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:22.530504 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1846e9b1-0dc1-48fe-9834-868764761005 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1313 microversion: 2.1 time: 0.303989 May 28 21:07:22.531473 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 679/1413] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:22 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:22.552125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b875e6c6-830d-409e-9094-449b27ecd2e0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:22.552774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b875e6c6-830d-409e-9094-449b27ecd2e0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:22.565251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b875e6c6-830d-409e-9094-449b27ecd2e0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:22.565251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b875e6c6-830d-409e-9094-449b27ecd2e0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:22.565251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b875e6c6-830d-409e-9094-449b27ecd2e0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:22.565251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b875e6c6-830d-409e-9094-449b27ecd2e0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:22.674726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-17c5880c-b9f2-4c85-a8f3-d33006bea780 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:22.675470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-17c5880c-b9f2-4c85-a8f3-d33006bea780 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:22.681878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17c5880c-b9f2-4c85-a8f3-d33006bea780 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:22.682349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17c5880c-b9f2-4c85-a8f3-d33006bea780 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:22.683137 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17c5880c-b9f2-4c85-a8f3-d33006bea780 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:22.683607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17c5880c-b9f2-4c85-a8f3-d33006bea780 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:22.734525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b875e6c6-830d-409e-9094-449b27ecd2e0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:22.743308 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b875e6c6-830d-409e-9094-449b27ecd2e0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1528 microversion: 2.1 time: 0.196117 May 28 21:07:22.743975 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 735/1414] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:22 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1528 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:22.839357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-17c5880c-b9f2-4c85-a8f3-d33006bea780 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:22.848016 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-17c5880c-b9f2-4c85-a8f3-d33006bea780 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1322 microversion: 2.1 time: 0.190160 May 28 21:07:22.848780 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 680/1415] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:22 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:23.052721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-de337fb1-30e8-4ffd-99c2-0471dc566063 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:23.053348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-de337fb1-30e8-4ffd-99c2-0471dc566063 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:23.063566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de337fb1-30e8-4ffd-99c2-0471dc566063 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:23.064021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de337fb1-30e8-4ffd-99c2-0471dc566063 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:23.064858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de337fb1-30e8-4ffd-99c2-0471dc566063 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:23.065353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de337fb1-30e8-4ffd-99c2-0471dc566063 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:23.128088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8825b8b8-5c27-4988-927c-89feff3baa8d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:23.128594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8825b8b8-5c27-4988-927c-89feff3baa8d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:23.147030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8825b8b8-5c27-4988-927c-89feff3baa8d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:23.148961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8825b8b8-5c27-4988-927c-89feff3baa8d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:23.151206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8825b8b8-5c27-4988-927c-89feff3baa8d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:23.152098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8825b8b8-5c27-4988-927c-89feff3baa8d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:23.185901 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-8825b8b8-5c27-4988-927c-89feff3baa8d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] HTTP exception thrown: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8825b8b8-5c27-4988-927c-89feff3baa8d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Request method failure captured: May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 HTTP/1.1 May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko5uh1h6B0TVqGR54p6HZUAreLAkksxbuzxNlxuoQDiCfDgLgrPNVWJDdWCixuPZFxmNMfkOOayIrOByXvJEAgCIjrys5icdBXBC6wNKpuZecqRJo9FZ2y7GQDeNe0nUaP-eZPhP7Ga8M6dc-IT0ZkZWanSncsHKhuybOIwa7bHXuMM May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: b059b8b9ea6e4afbb5d034c9d1a036d2 May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1219301458 May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:07:23.187074 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:07:23.188694 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b059b8b9ea6e4afbb5d034c9d1a036d2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b059b8b9ea6e4afbb5d034c9d1a036d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b059b8b9ea6e4afbb5d034c9d1a036d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b059b8b9ea6e4afbb5d034c9d1a036d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:23.188694 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1219301458 May 28 21:07:23.188694 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: b059b8b9ea6e4afbb5d034c9d1a036d2 May 28 21:07:23.188694 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1219301458 May 28 21:07:23.188694 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AttachSCSIVolumeTestJSON-1219301458-project May 28 21:07:23.188694 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:07:23.188694 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:07:23.188694 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 77a6068e4dc34fb6b8d1447472692e55 May 28 21:07:23.188694 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1219301458-project May 28 21:07:23.188694 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:07:23.188694 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. May 28 21:07:23.188694 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'df8268d1-36f2-4747-aa81-f6181ea36c35'} May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:23.189620 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. May 28 21:07:23.191108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:23.192512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8825b8b8-5c27-4988-927c-89feff3baa8d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Returning 404 to user: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:23.193124 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8825b8b8-5c27-4988-927c-89feff3baa8d tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 404 len: 111 microversion: 2.1 time: 0.067241 May 28 21:07:23.194263 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 681/1416] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:07:23 2022] DELETE /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:07:23.199717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-4e9093b5-bb24-44f1-8b56-6fbcf9824cef req-d31903cc-20ff-497b-ad51-1f97a7cef64f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d7a590-6a27-4730-8a64-ba9898a28ff6", "tag": "142929bc-54fb-4100-8abc-ae7844c539b5"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:23.209868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4e9093b5-bb24-44f1-8b56-6fbcf9824cef req-d31903cc-20ff-497b-ad51-1f97a7cef64f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:23.212382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4e9093b5-bb24-44f1-8b56-6fbcf9824cef req-d31903cc-20ff-497b-ad51-1f97a7cef64f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:23.230487 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-4e9093b5-bb24-44f1-8b56-6fbcf9824cef req-d31903cc-20ff-497b-ad51-1f97a7cef64f service nova] Creating event network-changed:142929bc-54fb-4100-8abc-ae7844c539b5 for instance 99d7a590-6a27-4730-8a64-ba9898a28ff6 on nch2-master-1 May 28 21:07:23.237416 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-4e9093b5-bb24-44f1-8b56-6fbcf9824cef req-d31903cc-20ff-497b-ad51-1f97a7cef64f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041700 May 28 21:07:23.242012 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 682/1417] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:23.249536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-07477b25-df62-468d-bd72-796be5e45079 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:23.250751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-07477b25-df62-468d-bd72-796be5e45079 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] [instance: df8268d1-36f2-4747-aa81-f6181ea36c35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:23.260295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07477b25-df62-468d-bd72-796be5e45079 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:23.261691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07477b25-df62-468d-bd72-796be5e45079 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:23.262658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07477b25-df62-468d-bd72-796be5e45079 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:23.263268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07477b25-df62-468d-bd72-796be5e45079 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:23.281829 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-07477b25-df62-468d-bd72-796be5e45079 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] HTTP exception thrown: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-07477b25-df62-468d-bd72-796be5e45079 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Request method failure captured: May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 HTTP/1.1 May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko5uh1h6B0TVqGR54p6HZUAreLAkksxbuzxNlxuoQDiCfDgLgrPNVWJDdWCixuPZFxmNMfkOOayIrOByXvJEAgCIjrys5icdBXBC6wNKpuZecqRJo9FZ2y7GQDeNe0nUaP-eZPhP7Ga8M6dc-IT0ZkZWanSncsHKhuybOIwa7bHXuMM May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: b059b8b9ea6e4afbb5d034c9d1a036d2 May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1219301458 May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:07:23.290809 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:07:23.292393 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b059b8b9ea6e4afbb5d034c9d1a036d2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b059b8b9ea6e4afbb5d034c9d1a036d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b059b8b9ea6e4afbb5d034c9d1a036d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b059b8b9ea6e4afbb5d034c9d1a036d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:23.292393 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1219301458 May 28 21:07:23.292393 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: b059b8b9ea6e4afbb5d034c9d1a036d2 May 28 21:07:23.292393 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1219301458 May 28 21:07:23.292393 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AttachSCSIVolumeTestJSON-1219301458-project May 28 21:07:23.292393 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:07:23.292393 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:07:23.292393 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 77a6068e4dc34fb6b8d1447472692e55 May 28 21:07:23.292393 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1219301458-project May 28 21:07:23.292393 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:07:23.292393 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. May 28 21:07:23.292393 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'df8268d1-36f2-4747-aa81-f6181ea36c35'} May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:23.293354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. May 28 21:07:23.294796 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:23.296083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-07477b25-df62-468d-bd72-796be5e45079 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] Returning 404 to user: Instance df8268d1-36f2-4747-aa81-f6181ea36c35 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:23.296083 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-07477b25-df62-468d-bd72-796be5e45079 tempest-AttachSCSIVolumeTestJSON-1219301458 tempest-AttachSCSIVolumeTestJSON-1219301458-project] 10.222.0.33 "GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35" status: 404 len: 111 microversion: 2.1 time: 0.043178 May 28 21:07:23.296083 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 683/1418] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:23 2022] GET /compute/v2.1/servers/df8268d1-36f2-4747-aa81-f6181ea36c35 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:07:23.309882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-de337fb1-30e8-4ffd-99c2-0471dc566063 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:23.320726 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-de337fb1-30e8-4ffd-99c2-0471dc566063 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1317 microversion: 2.1 time: 0.271900 May 28 21:07:23.321993 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 736/1419] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:23 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:23.479336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc6cf435-5d09-4da1-97e8-6584cd1425d0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:23.479964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc6cf435-5d09-4da1-97e8-6584cd1425d0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:23.499501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc6cf435-5d09-4da1-97e8-6584cd1425d0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:23.499963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc6cf435-5d09-4da1-97e8-6584cd1425d0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:23.500773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc6cf435-5d09-4da1-97e8-6584cd1425d0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:23.501219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc6cf435-5d09-4da1-97e8-6584cd1425d0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:23.554221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-86075357-91e5-49ad-a620-00202cd971db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:23.555625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-86075357-91e5-49ad-a620-00202cd971db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:23.565377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86075357-91e5-49ad-a620-00202cd971db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:23.566222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86075357-91e5-49ad-a620-00202cd971db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:23.567789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86075357-91e5-49ad-a620-00202cd971db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:23.568449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86075357-91e5-49ad-a620-00202cd971db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:23.623978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc6cf435-5d09-4da1-97e8-6584cd1425d0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:23.637008 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc6cf435-5d09-4da1-97e8-6584cd1425d0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1270 microversion: 2.1 time: 0.161583 May 28 21:07:23.638120 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 684/1420] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:23 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:23.760988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a9189bfe-df36-480c-94cb-066d88fd8a26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:23.761627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a9189bfe-df36-480c-94cb-066d88fd8a26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:23.764483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=12 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:23.771175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9189bfe-df36-480c-94cb-066d88fd8a26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:23.771889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9189bfe-df36-480c-94cb-066d88fd8a26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:23.772687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9189bfe-df36-480c-94cb-066d88fd8a26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:23.773379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9189bfe-df36-480c-94cb-066d88fd8a26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:23.908490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-86075357-91e5-49ad-a620-00202cd971db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:23.923220 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-86075357-91e5-49ad-a620-00202cd971db tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1313 microversion: 2.1 time: 0.375965 May 28 21:07:23.937284 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 737/1421] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:23 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:23.945236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5428fe2a-3d62-4072-892d-e11fd97fba96 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:23.946140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5428fe2a-3d62-4072-892d-e11fd97fba96 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:23.955842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5428fe2a-3d62-4072-892d-e11fd97fba96 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:23.955842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5428fe2a-3d62-4072-892d-e11fd97fba96 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:23.956844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5428fe2a-3d62-4072-892d-e11fd97fba96 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:23.958199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5428fe2a-3d62-4072-892d-e11fd97fba96 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:24.208558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a9189bfe-df36-480c-94cb-066d88fd8a26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:24.217170 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a9189bfe-df36-480c-94cb-066d88fd8a26 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1528 microversion: 2.1 time: 0.459814 May 28 21:07:24.217757 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 685/1422] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:23 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1528 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:24.343204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-911f0f4b-6383-45b0-9509-a61637997eac tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:24.343851 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-911f0f4b-6383-45b0-9509-a61637997eac tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:24.355261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-911f0f4b-6383-45b0-9509-a61637997eac tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:24.355786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-911f0f4b-6383-45b0-9509-a61637997eac tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:24.356640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-911f0f4b-6383-45b0-9509-a61637997eac tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:24.357440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-911f0f4b-6383-45b0-9509-a61637997eac tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:24.379204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5428fe2a-3d62-4072-892d-e11fd97fba96 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:24.394906 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5428fe2a-3d62-4072-892d-e11fd97fba96 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1322 microversion: 2.1 time: 0.455758 May 28 21:07:24.396283 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 738/1423] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:23 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1322 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:24.661234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cc69a8f3-d8e9-4495-94b4-e4b85b643fb4 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:24.662118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cc69a8f3-d8e9-4495-94b4-e4b85b643fb4 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:24.668379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc69a8f3-d8e9-4495-94b4-e4b85b643fb4 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:24.668770 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc69a8f3-d8e9-4495-94b4-e4b85b643fb4 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:24.669772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc69a8f3-d8e9-4495-94b4-e4b85b643fb4 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:24.670312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc69a8f3-d8e9-4495-94b4-e4b85b643fb4 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:24.682734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-911f0f4b-6383-45b0-9509-a61637997eac tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:24.694381 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-911f0f4b-6383-45b0-9509-a61637997eac tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1317 microversion: 2.1 time: 0.358796 May 28 21:07:24.696280 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 686/1424] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:24 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1317 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:24.777811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cc69a8f3-d8e9-4495-94b4-e4b85b643fb4 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:24.789729 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cc69a8f3-d8e9-4495-94b4-e4b85b643fb4 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1276 microversion: 2.1 time: 0.132287 May 28 21:07:24.791177 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 739/1425] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:24 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1276 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:24.943391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2ff06c51-33b7-4afe-95ef-98e56779e760 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:24.944048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2ff06c51-33b7-4afe-95ef-98e56779e760 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:24.950919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ff06c51-33b7-4afe-95ef-98e56779e760 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:24.951425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ff06c51-33b7-4afe-95ef-98e56779e760 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:24.952279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ff06c51-33b7-4afe-95ef-98e56779e760 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:24.952725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ff06c51-33b7-4afe-95ef-98e56779e760 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:25.235266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-083c9474-e488-47f5-838b-29c881e9d8f2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:25.235847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-083c9474-e488-47f5-838b-29c881e9d8f2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:25.250449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-083c9474-e488-47f5-838b-29c881e9d8f2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:25.252630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-083c9474-e488-47f5-838b-29c881e9d8f2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:25.252630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-083c9474-e488-47f5-838b-29c881e9d8f2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:25.253246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-083c9474-e488-47f5-838b-29c881e9d8f2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:25.540636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2ff06c51-33b7-4afe-95ef-98e56779e760 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:25.553900 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2ff06c51-33b7-4afe-95ef-98e56779e760 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1313 microversion: 2.1 time: 0.614339 May 28 21:07:25.554511 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 687/1426] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:24 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1313 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:25.571833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-f60cb6d3-31cc-4f6a-bd1c-c11ac0a05d61 req-710fa661-a199-484f-9af7-543ec78bba84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbf5dac4-559d-41fb-a402-c9225810fc82", "name": "network-vif-deleted", "tag": "c501832c-f99f-4cca-bfa2-7dfbb896762c"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:25.575440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-083c9474-e488-47f5-838b-29c881e9d8f2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:25.581383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f60cb6d3-31cc-4f6a-bd1c-c11ac0a05d61 req-710fa661-a199-484f-9af7-543ec78bba84 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:25.582238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f60cb6d3-31cc-4f6a-bd1c-c11ac0a05d61 req-710fa661-a199-484f-9af7-543ec78bba84 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:25.583311 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-083c9474-e488-47f5-838b-29c881e9d8f2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1486 microversion: 2.1 time: 0.351942 May 28 21:07:25.583884 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 740/1427] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:25 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1486 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:25.597141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b3520581-7423-46ed-b7a1-38e5a867af18 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:25.597141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b3520581-7423-46ed-b7a1-38e5a867af18 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:25.597141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3520581-7423-46ed-b7a1-38e5a867af18 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:25.597141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3520581-7423-46ed-b7a1-38e5a867af18 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:25.597754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3520581-7423-46ed-b7a1-38e5a867af18 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:25.597754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3520581-7423-46ed-b7a1-38e5a867af18 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:25.611253 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-f60cb6d3-31cc-4f6a-bd1c-c11ac0a05d61 req-710fa661-a199-484f-9af7-543ec78bba84 service nova] Creating event network-vif-deleted:c501832c-f99f-4cca-bfa2-7dfbb896762c for instance fbf5dac4-559d-41fb-a402-c9225810fc82 on nch1-master-1 May 28 21:07:25.615078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:25.620046 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-f60cb6d3-31cc-4f6a-bd1c-c11ac0a05d61 req-710fa661-a199-484f-9af7-543ec78bba84 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064035 May 28 21:07:25.631571 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 688/1428] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:25.631571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-183d6a2f-97a7-4dc5-bfcb-947e67d00701 req-8553ef32-c0b8-4de6-9cff-d8dd15321a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc08f458-df9b-447b-8b5e-31407d2f80c4", "name": "network-vif-plugged", "status": "completed", "tag": "e0393585-b244-4d62-8666-a6f0f9316dc5"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:25.643717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-183d6a2f-97a7-4dc5-bfcb-947e67d00701 req-8553ef32-c0b8-4de6-9cff-d8dd15321a7e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:25.644192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-183d6a2f-97a7-4dc5-bfcb-947e67d00701 req-8553ef32-c0b8-4de6-9cff-d8dd15321a7e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:25.656025 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-183d6a2f-97a7-4dc5-bfcb-947e67d00701 req-8553ef32-c0b8-4de6-9cff-d8dd15321a7e service nova] Creating event network-vif-plugged:e0393585-b244-4d62-8666-a6f0f9316dc5 for instance bc08f458-df9b-447b-8b5e-31407d2f80c4 on nch1-master-1 May 28 21:07:25.661683 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-183d6a2f-97a7-4dc5-bfcb-947e67d00701 req-8553ef32-c0b8-4de6-9cff-d8dd15321a7e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039689 May 28 21:07:25.664225 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 689/1429] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:25.720050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b3e9de21-c810-406a-a81c-d58fbf5e93bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:25.721830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b3e9de21-c810-406a-a81c-d58fbf5e93bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:25.728843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3e9de21-c810-406a-a81c-d58fbf5e93bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:25.729405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3e9de21-c810-406a-a81c-d58fbf5e93bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:25.730747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3e9de21-c810-406a-a81c-d58fbf5e93bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:25.731285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3e9de21-c810-406a-a81c-d58fbf5e93bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:25.736260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:26.043769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b3520581-7423-46ed-b7a1-38e5a867af18 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:26.053151 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b3520581-7423-46ed-b7a1-38e5a867af18 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1322 microversion: 2.1 time: 0.468143 May 28 21:07:26.053864 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 741/1430] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:25 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1322 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:26.060064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ddd36c53-7ba0-48b8-85bf-9fe2a73047ca tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:26.060688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ddd36c53-7ba0-48b8-85bf-9fe2a73047ca tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:26.074433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddd36c53-7ba0-48b8-85bf-9fe2a73047ca tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:26.079683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddd36c53-7ba0-48b8-85bf-9fe2a73047ca tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:26.079683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddd36c53-7ba0-48b8-85bf-9fe2a73047ca tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:26.079683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddd36c53-7ba0-48b8-85bf-9fe2a73047ca tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:26.217644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b3e9de21-c810-406a-a81c-d58fbf5e93bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:26.225788 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b3e9de21-c810-406a-a81c-d58fbf5e93bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1317 microversion: 2.1 time: 0.510185 May 28 21:07:26.226404 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 690/1431] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:25 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:26.340418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ddd36c53-7ba0-48b8-85bf-9fe2a73047ca tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:26.349333 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ddd36c53-7ba0-48b8-85bf-9fe2a73047ca tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1318 microversion: 2.1 time: 0.293984 May 28 21:07:26.352881 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 742/1432] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:26 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:26.572007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb8608a4-4692-4250-9d16-01de4a086cce tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:26.572743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fb8608a4-4692-4250-9d16-01de4a086cce tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:26.581045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb8608a4-4692-4250-9d16-01de4a086cce tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:26.581523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb8608a4-4692-4250-9d16-01de4a086cce tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:26.582363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb8608a4-4692-4250-9d16-01de4a086cce tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:26.582810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb8608a4-4692-4250-9d16-01de4a086cce tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:26.603303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0078e428-dfac-4bfc-a124-757b491304d2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:26.604630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0078e428-dfac-4bfc-a124-757b491304d2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:26.614546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0078e428-dfac-4bfc-a124-757b491304d2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:26.615117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0078e428-dfac-4bfc-a124-757b491304d2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:26.616225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0078e428-dfac-4bfc-a124-757b491304d2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:26.616996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0078e428-dfac-4bfc-a124-757b491304d2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:26.652267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0078e428-dfac-4bfc-a124-757b491304d2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:26.652840 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0078e428-dfac-4bfc-a124-757b491304d2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:26.653370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-0078e428-dfac-4bfc-a124-757b491304d2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lazy-loading 'fault' on Instance uuid fbf5dac4-559d-41fb-a402-c9225810fc82 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:07:26.741514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0078e428-dfac-4bfc-a124-757b491304d2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc48535b672d4d1190ecfefe6cb02720', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab0c1d6a9fc44de4af61822849b3bf8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:26.749892 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0078e428-dfac-4bfc-a124-757b491304d2 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 200 len: 1315 microversion: 2.1 time: 0.152813 May 28 21:07:26.750850 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 743/1433] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:26 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:26.923112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fb8608a4-4692-4250-9d16-01de4a086cce tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:26.930393 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb8608a4-4692-4250-9d16-01de4a086cce tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1313 microversion: 2.1 time: 0.362511 May 28 21:07:26.942377 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 691/1434] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:26 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:27.087979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ea14e2e8-530e-4cc1-ae68-07fecdf56511 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:27.088638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ea14e2e8-530e-4cc1-ae68-07fecdf56511 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:27.095180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea14e2e8-530e-4cc1-ae68-07fecdf56511 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:27.096441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea14e2e8-530e-4cc1-ae68-07fecdf56511 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:27.097340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea14e2e8-530e-4cc1-ae68-07fecdf56511 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:27.098059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea14e2e8-530e-4cc1-ae68-07fecdf56511 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:27.248150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-353f945f-4a2f-4036-b8b0-f9add300504b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:27.248150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-353f945f-4a2f-4036-b8b0-f9add300504b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:27.255322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-353f945f-4a2f-4036-b8b0-f9add300504b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:27.256129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-353f945f-4a2f-4036-b8b0-f9add300504b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:27.257364 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-353f945f-4a2f-4036-b8b0-f9add300504b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:27.258021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-353f945f-4a2f-4036-b8b0-f9add300504b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:27.413300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ea14e2e8-530e-4cc1-ae68-07fecdf56511 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:27.421189 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ea14e2e8-530e-4cc1-ae68-07fecdf56511 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1322 microversion: 2.1 time: 0.351186 May 28 21:07:27.421786 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 744/1435] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:27 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:27.438843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fcfea70a-aea8-4251-a12c-61ae6cb436f6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:27.439502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fcfea70a-aea8-4251-a12c-61ae6cb436f6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:27.445755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fcfea70a-aea8-4251-a12c-61ae6cb436f6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:27.450384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fcfea70a-aea8-4251-a12c-61ae6cb436f6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:27.450384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fcfea70a-aea8-4251-a12c-61ae6cb436f6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:27.450384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fcfea70a-aea8-4251-a12c-61ae6cb436f6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:27.575252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-353f945f-4a2f-4036-b8b0-f9add300504b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:27.584810 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-353f945f-4a2f-4036-b8b0-f9add300504b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1317 microversion: 2.1 time: 0.344685 May 28 21:07:27.587370 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 692/1436] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:27 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:27.716038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fcfea70a-aea8-4251-a12c-61ae6cb436f6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:27.725346 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fcfea70a-aea8-4251-a12c-61ae6cb436f6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1318 microversion: 2.1 time: 0.290289 May 28 21:07:27.738526 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 745/1437] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:27 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:27.769556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-da2cece0-dbdd-49b9-bd05-7bcc8e2adedf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:27.770211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-da2cece0-dbdd-49b9-bd05-7bcc8e2adedf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: fbf5dac4-559d-41fb-a402-c9225810fc82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:27.778508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da2cece0-dbdd-49b9-bd05-7bcc8e2adedf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:27.779221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da2cece0-dbdd-49b9-bd05-7bcc8e2adedf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:27.780241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da2cece0-dbdd-49b9-bd05-7bcc8e2adedf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:27.780898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da2cece0-dbdd-49b9-bd05-7bcc8e2adedf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:27.808717 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-da2cece0-dbdd-49b9-bd05-7bcc8e2adedf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] HTTP exception thrown: Instance fbf5dac4-559d-41fb-a402-c9225810fc82 could not be found. May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-da2cece0-dbdd-49b9-bd05-7bcc8e2adedf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Request method failure captured: May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 HTTP/1.1 May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko6oq10ya0vKA7Lzgzw7qEixBB6oq9XwAAqnALDB3LxJ0Ou3iq7_g4aSSk-6F4p6-_hIGxM22vsmPp1vD-bx8iQQTYyEkSHfzi2JWR2mENOMe6ss5h_-1Ay7OrAERWJEEuMTwxRxM1yb64UuFpXocdkERI-wAfMoU5j69oLSNr7C4nA May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:07:27.810545 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:07:27.811947 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab0c1d6a9fc44de4af61822849b3bf8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:27.811947 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:27.811947 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:07:27.811947 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:27.811947 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:07:27.811947 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:07:27.811947 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:07:27.811947 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: dc48535b672d4d1190ecfefe6cb02720 May 28 21:07:27.811947 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:07:27.811947 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:07:27.811947 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance fbf5dac4-559d-41fb-a402-c9225810fc82 could not be found. May 28 21:07:27.811947 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'fbf5dac4-559d-41fb-a402-c9225810fc82'} May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbf5dac4-559d-41fb-a402-c9225810fc82 could not be found. May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:27.812853 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbf5dac4-559d-41fb-a402-c9225810fc82 could not be found. May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbf5dac4-559d-41fb-a402-c9225810fc82 could not be found. May 28 21:07:27.814323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:27.826783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-da2cece0-dbdd-49b9-bd05-7bcc8e2adedf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Returning 404 to user: Instance fbf5dac4-559d-41fb-a402-c9225810fc82 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:27.831437 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-da2cece0-dbdd-49b9-bd05-7bcc8e2adedf tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82" status: 404 len: 111 microversion: 2.1 time: 0.066958 May 28 21:07:27.832739 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 693/1438] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:27 2022] GET /compute/v2.1/servers/fbf5dac4-559d-41fb-a402-c9225810fc82 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:07:27.840787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fdade835-1fae-4398-bc28-c4489799b660 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '.version_select at 0x7f4d6455d1f0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:27.873658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-def5ce9c-0da4-4eff-959c-5b277eb78b8e req-1e02ba3a-85fa-4fda-b467-ca814322bac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801b7889-1935-4bb4-8e8a-c34c2cf3c100", "name": "network-vif-plugged", "status": "completed", "tag": "0e646b8c-f3f2-4ee5-91b0-aea5324fcf34"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:27.884806 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-fdade835-1fae-4398-bc28-c4489799b660 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] HTTP exception thrown: Image not found. May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fdade835-1fae-4398-bc28-c4489799b660 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Request method failure captured: May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/images/b5268c12-e54c-4fb6-a607-9dd4c4b9a0b6 HTTP/1.1 May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko6oq10ya0vKA7Lzgzw7qEixBB6oq9XwAAqnALDB3LxJ0Ou3iq7_g4aSSk-6F4p6-_hIGxM22vsmPp1vD-bx8iQQTYyEkSHfzi2JWR2mENOMe6ss5h_-1Ay7OrAERWJEEuMTwxRxM1yb64UuFpXocdkERI-wAfMoU5j69oLSNr7C4nA May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:07:27.888526 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:07:27.897031 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab0c1d6a9fc44de4af61822849b3bf8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:27.897031 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:27.897031 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:07:27.897031 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:27.897031 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:07:27.897031 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:07:27.897031 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:07:27.897031 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: dc48535b672d4d1190ecfefe6cb02720 May 28 21:07:27.897031 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:07:27.897031 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:07:27.897031 ncdv-master-1 devstack@n-api.service[143128]: exception: Image not found. May 28 21:07:27.897031 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'b5268c12-e54c-4fb6-a607-9dd4c4b9a0b6'} May 28 21:07:27.897031 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b5268c12-e54c-4fb6-a607-9dd4c4b9a0b6 to delete May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:27.898360 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b5268c12-e54c-4fb6-a607-9dd4c4b9a0b6 could not be found. May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:27.900035 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:27.901999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 21:07:27.901999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:07:27.901999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:07:27.901999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:27.901999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:27.901999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:27.901999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:27.901999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:27.901999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:27.901999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:27.901999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:27.901999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:07:27.901999 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:27.903217 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-def5ce9c-0da4-4eff-959c-5b277eb78b8e req-1e02ba3a-85fa-4fda-b467-ca814322bac0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:27.903217 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-def5ce9c-0da4-4eff-959c-5b277eb78b8e req-1e02ba3a-85fa-4fda-b467-ca814322bac0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:27.903416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fdade835-1fae-4398-bc28-c4489799b660 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Returning 404 to user: Image not found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:27.903416 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fdade835-1fae-4398-bc28-c4489799b660 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "DELETE /compute/v2.1/images/b5268c12-e54c-4fb6-a607-9dd4c4b9a0b6" status: 404 len: 62 microversion: 2.1 time: 0.055173 May 28 21:07:27.903416 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 746/1439] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:27 2022] DELETE /compute/v2.1/images/b5268c12-e54c-4fb6-a607-9dd4c4b9a0b6 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:07:27.905202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-27e00a47-7deb-442c-b146-a20d1d9af2b0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:27.905740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-27e00a47-7deb-442c-b146-a20d1d9af2b0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:27.909570 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-def5ce9c-0da4-4eff-959c-5b277eb78b8e req-1e02ba3a-85fa-4fda-b467-ca814322bac0 service nova] Creating event network-vif-plugged:0e646b8c-f3f2-4ee5-91b0-aea5324fcf34 for instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 on nch1-master-1 May 28 21:07:27.915579 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-def5ce9c-0da4-4eff-959c-5b277eb78b8e req-1e02ba3a-85fa-4fda-b467-ca814322bac0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045772 May 28 21:07:27.918037 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 694/1440] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:27.925652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-27e00a47-7deb-442c-b146-a20d1d9af2b0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:27.925652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-27e00a47-7deb-442c-b146-a20d1d9af2b0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:27.925652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-27e00a47-7deb-442c-b146-a20d1d9af2b0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:27.925652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-27e00a47-7deb-442c-b146-a20d1d9af2b0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:27.926466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-c892f1a4-07ae-45bb-a154-e0e97d61fa65 req-20819965-6d85-4a1c-aef8-2e93cf6026fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "688d4d8f-9b8f-4201-909c-8e3627dd1711", "tag": "80c50feb-6a2d-4c2a-a587-eb16fefb5793"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:27.932699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c892f1a4-07ae-45bb-a154-e0e97d61fa65 req-20819965-6d85-4a1c-aef8-2e93cf6026fd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:27.933930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c892f1a4-07ae-45bb-a154-e0e97d61fa65 req-20819965-6d85-4a1c-aef8-2e93cf6026fd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:27.960040 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-c892f1a4-07ae-45bb-a154-e0e97d61fa65 req-20819965-6d85-4a1c-aef8-2e93cf6026fd service nova] Creating event network-changed:80c50feb-6a2d-4c2a-a587-eb16fefb5793 for instance 688d4d8f-9b8f-4201-909c-8e3627dd1711 on nch2-master-1 May 28 21:07:27.962897 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-27e00a47-7deb-442c-b146-a20d1d9af2b0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] HTTP exception thrown: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. May 28 21:07:27.966240 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-c892f1a4-07ae-45bb-a154-e0e97d61fa65 req-20819965-6d85-4a1c-aef8-2e93cf6026fd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046330 May 28 21:07:27.966892 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 695/1441] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-27e00a47-7deb-442c-b146-a20d1d9af2b0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Request method failure captured: May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c HTTP/1.1 May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko6oq10ya0vKA7Lzgzw7qEixBB6oq9XwAAqnALDB3LxJ0Ou3iq7_g4aSSk-6F4p6-_hIGxM22vsmPp1vD-bx8iQQTYyEkSHfzi2JWR2mENOMe6ss5h_-1Ay7OrAERWJEEuMTwxRxM1yb64UuFpXocdkERI-wAfMoU5j69oLSNr7C4nA May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:07:27.972047 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:07:27.973576 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab0c1d6a9fc44de4af61822849b3bf8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:27.973576 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:27.973576 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:07:27.973576 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:27.973576 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:07:27.973576 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:07:27.973576 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:07:27.973576 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: dc48535b672d4d1190ecfefe6cb02720 May 28 21:07:27.973576 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:07:27.973576 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:07:27.973576 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. May 28 21:07:27.973576 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c'} May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:27.974515 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. May 28 21:07:27.976414 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:27.978029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5141c5cc-8657-4d6d-824b-864f00fcf517 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:27.978029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5141c5cc-8657-4d6d-824b-864f00fcf517 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:27.983145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-27e00a47-7deb-442c-b146-a20d1d9af2b0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Returning 404 to user: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:27.983145 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-27e00a47-7deb-442c-b146-a20d1d9af2b0 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 404 len: 111 microversion: 2.1 time: 0.077785 May 28 21:07:27.983145 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 747/1442] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:07:27 2022] DELETE /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:07:27.984047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5141c5cc-8657-4d6d-824b-864f00fcf517 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:27.984809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5141c5cc-8657-4d6d-824b-864f00fcf517 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:27.985648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5141c5cc-8657-4d6d-824b-864f00fcf517 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:27.986299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5141c5cc-8657-4d6d-824b-864f00fcf517 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:27.990856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-de00cd5e-235a-45e1-9dc9-ee3fc8412f08 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:27.992754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-de00cd5e-235a-45e1-9dc9-ee3fc8412f08 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:27.999545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de00cd5e-235a-45e1-9dc9-ee3fc8412f08 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:28.000280 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de00cd5e-235a-45e1-9dc9-ee3fc8412f08 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:28.001157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de00cd5e-235a-45e1-9dc9-ee3fc8412f08 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:28.001700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de00cd5e-235a-45e1-9dc9-ee3fc8412f08 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:28.041687 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-de00cd5e-235a-45e1-9dc9-ee3fc8412f08 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] HTTP exception thrown: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-de00cd5e-235a-45e1-9dc9-ee3fc8412f08 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Request method failure captured: May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c HTTP/1.1 May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko6oq10ya0vKA7Lzgzw7qEixBB6oq9XwAAqnALDB3LxJ0Ou3iq7_g4aSSk-6F4p6-_hIGxM22vsmPp1vD-bx8iQQTYyEkSHfzi2JWR2mENOMe6ss5h_-1Ay7OrAERWJEEuMTwxRxM1yb64UuFpXocdkERI-wAfMoU5j69oLSNr7C4nA May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:07:28.044355 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:07:28.045924 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab0c1d6a9fc44de4af61822849b3bf8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:28.045924 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:28.045924 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:07:28.045924 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:28.045924 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:07:28.045924 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:07:28.045924 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:07:28.045924 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: dc48535b672d4d1190ecfefe6cb02720 May 28 21:07:28.045924 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:07:28.045924 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:07:28.045924 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. May 28 21:07:28.045924 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c'} May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:28.046770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. May 28 21:07:28.048012 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:28.050357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-de00cd5e-235a-45e1-9dc9-ee3fc8412f08 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Returning 404 to user: Instance 2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:28.050357 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-de00cd5e-235a-45e1-9dc9-ee3fc8412f08 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c" status: 404 len: 111 microversion: 2.1 time: 0.060817 May 28 21:07:28.051696 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 748/1443] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:27 2022] GET /compute/v2.1/servers/2d28c4d6-0a0c-4dcd-a1e7-ea8732c6530c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:07:28.056638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c2248bd1-989d-4560-a705-5f0c5c0c0909 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '.version_select at 0x7f4d646d8d30>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:28.079620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:28.175769 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c2248bd1-989d-4560-a705-5f0c5c0c0909 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-324017669" status: 202 len: 0 microversion: 2.1 time: 0.122872 May 28 21:07:28.180624 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 749/1444] 10.222.0.33 () {58 vars in 1217 bytes} [Sat May 28 21:07:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-324017669 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:07:28.370293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5141c5cc-8657-4d6d-824b-864f00fcf517 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:28.386444 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5141c5cc-8657-4d6d-824b-864f00fcf517 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1313 microversion: 2.1 time: 0.415591 May 28 21:07:28.387333 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 696/1445] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:27 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1313 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:28.440711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0c0e48e6-83c0-4345-bfc1-85df70968eaa tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:28.441356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0c0e48e6-83c0-4345-bfc1-85df70968eaa tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:28.458845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c0e48e6-83c0-4345-bfc1-85df70968eaa tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:28.460109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c0e48e6-83c0-4345-bfc1-85df70968eaa tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:28.461161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c0e48e6-83c0-4345-bfc1-85df70968eaa tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:28.461900 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c0e48e6-83c0-4345-bfc1-85df70968eaa tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:28.607529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2badc2de-f932-47ee-8176-b932f2586d8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:28.608978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2badc2de-f932-47ee-8176-b932f2586d8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:28.613197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:28.617740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2badc2de-f932-47ee-8176-b932f2586d8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:28.619310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2badc2de-f932-47ee-8176-b932f2586d8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:28.620528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2badc2de-f932-47ee-8176-b932f2586d8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:28.621179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2badc2de-f932-47ee-8176-b932f2586d8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:28.682694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c0e48e6-83c0-4345-bfc1-85df70968eaa tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:28.692503 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0c0e48e6-83c0-4345-bfc1-85df70968eaa tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1471 microversion: 2.1 time: 0.257370 May 28 21:07:28.693422 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 750/1446] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:28 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1471 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:28.728237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c1f31508-318e-484c-9421-8ed714fbafd0 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:28.728791 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c1f31508-318e-484c-9421-8ed714fbafd0 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:28.737262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1f31508-318e-484c-9421-8ed714fbafd0 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:28.737262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1f31508-318e-484c-9421-8ed714fbafd0 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:28.744798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1f31508-318e-484c-9421-8ed714fbafd0 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:28.745256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1f31508-318e-484c-9421-8ed714fbafd0 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:28.789481 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c1f31508-318e-484c-9421-8ed714fbafd0 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c1f31508-318e-484c-9421-8ed714fbafd0 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Request method failure captured: May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4/diagnostics HTTP/1.1 May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko79-OSSbmB2GJ9DfqILE9RDP9K3ULnId_qmstnvcdaQWrxcKuvg_elHjz1Rot97fjx7M9Rymjkgpge2kLNLTR5HPkkxAgvEXx3-hyCyq9vCOHhXcxMjYalTRJ2OBNygpia9IKnuw3XB578_4inh2s8BhR5n-fvcwJ0fit-ACFIjSTQ May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 72d0adc19fe145caa50c8a0767765092 May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1803339619 May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:07:28.803386 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:07:28.805025 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_72d0adc19fe145caa50c8a0767765092", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72d0adc19fe145caa50c8a0767765092"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/72d0adc19fe145caa50c8a0767765092"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72d0adc19fe145caa50c8a0767765092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:28.805025 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1803339619 May 28 21:07:28.805025 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 72d0adc19fe145caa50c8a0767765092 May 28 21:07:28.805025 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1803339619 May 28 21:07:28.805025 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerDiagnosticsNegativeTest-1803339619-project May 28 21:07:28.805025 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:07:28.805025 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:07:28.805025 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: d1b349adf52040d1822953c96514ff7e May 28 21:07:28.805025 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1803339619-project May 28 21:07:28.805025 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:07:28.805025 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'server_id': 'bc08f458-df9b-447b-8b5e-31407d2f80c4'} May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:07:28.805900 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:28.807155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c1f31508-318e-484c-9421-8ed714fbafd0 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:28.808189 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c1f31508-318e-484c-9421-8ed714fbafd0 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.098383 May 28 21:07:28.808189 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 751/1447] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:07:28 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4/diagnostics => generated 117 bytes in 100 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:07:28.815561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1d992be2-24e4-4291-9cf9-1b0ac64de6be tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:28.816277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1d992be2-24e4-4291-9cf9-1b0ac64de6be tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:28.828108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d992be2-24e4-4291-9cf9-1b0ac64de6be tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:28.828108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d992be2-24e4-4291-9cf9-1b0ac64de6be tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:28.828108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d992be2-24e4-4291-9cf9-1b0ac64de6be tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:28.828108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d992be2-24e4-4291-9cf9-1b0ac64de6be tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:29.356792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2badc2de-f932-47ee-8176-b932f2586d8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:29.365296 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2badc2de-f932-47ee-8176-b932f2586d8c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1317 microversion: 2.1 time: 0.761624 May 28 21:07:29.375226 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 697/1448] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:28 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1317 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:29.375226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-12555ea8-ad2b-4e46-b39c-6ffa980da46f tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:29.375226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-12555ea8-ad2b-4e46-b39c-6ffa980da46f tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:29.382229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12555ea8-ad2b-4e46-b39c-6ffa980da46f tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:29.382784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12555ea8-ad2b-4e46-b39c-6ffa980da46f tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:29.383901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12555ea8-ad2b-4e46-b39c-6ffa980da46f tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:29.384512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12555ea8-ad2b-4e46-b39c-6ffa980da46f tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:29.417389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-12555ea8-ad2b-4e46-b39c-6ffa980da46f tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:07:29.526399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1d992be2-24e4-4291-9cf9-1b0ac64de6be tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:29.540305 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1d992be2-24e4-4291-9cf9-1b0ac64de6be tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1318 microversion: 2.1 time: 0.730479 May 28 21:07:29.549045 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 752/1449] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:28 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1318 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:29.554738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d9994988-7d99-47be-8739-760da7897f98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:29.555363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d9994988-7d99-47be-8739-760da7897f98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:29.581637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9994988-7d99-47be-8739-760da7897f98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:29.581637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9994988-7d99-47be-8739-760da7897f98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:29.581637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9994988-7d99-47be-8739-760da7897f98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:29.581637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9994988-7d99-47be-8739-760da7897f98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:29.873714 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-12555ea8-ad2b-4e46-b39c-6ffa980da46f tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 204 len: 0 microversion: 2.1 time: 0.497445 May 28 21:07:29.874261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d9994988-7d99-47be-8739-760da7897f98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:29.874637 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 698/1450] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:07:29 2022] DELETE /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:07:29.875659 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d9994988-7d99-47be-8739-760da7897f98 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1313 microversion: 2.1 time: 0.328562 May 28 21:07:29.876332 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 753/1451] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:29 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:29.881988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-204754f9-a700-48e6-a9c6-ee21b28667c5 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:29.882707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-204754f9-a700-48e6-a9c6-ee21b28667c5 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:29.889985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-204754f9-a700-48e6-a9c6-ee21b28667c5 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:29.897014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-204754f9-a700-48e6-a9c6-ee21b28667c5 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:29.897014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-204754f9-a700-48e6-a9c6-ee21b28667c5 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:29.897014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-204754f9-a700-48e6-a9c6-ee21b28667c5 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:30.109674 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-204754f9-a700-48e6-a9c6-ee21b28667c5 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:30.133572 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-204754f9-a700-48e6-a9c6-ee21b28667c5 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1477 microversion: 2.1 time: 0.256079 May 28 21:07:30.134547 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 699/1452] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:29 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1477 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:30.205484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-18c70f34-3b89-4167-a5e7-e6f38d4210da req-51542e8e-93bf-4edc-ac49-84136d13668f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d7a590-6a27-4730-8a64-ba9898a28ff6", "name": "network-vif-plugged", "status": "completed", "tag": "142929bc-54fb-4100-8abc-ae7844c539b5"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:30.207795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3aa9d610-ac1a-4c9c-8f04-468d4bc99dfd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '.version_select at 0x7f4d6439c670>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:30.216436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-18c70f34-3b89-4167-a5e7-e6f38d4210da req-51542e8e-93bf-4edc-ac49-84136d13668f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:30.216764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-18c70f34-3b89-4167-a5e7-e6f38d4210da req-51542e8e-93bf-4edc-ac49-84136d13668f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:30.231814 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-3aa9d610-ac1a-4c9c-8f04-468d4bc99dfd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] HTTP exception thrown: Image not found. May 28 21:07:30.235627 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-18c70f34-3b89-4167-a5e7-e6f38d4210da req-51542e8e-93bf-4edc-ac49-84136d13668f service nova] Creating event network-vif-plugged:142929bc-54fb-4100-8abc-ae7844c539b5 for instance 99d7a590-6a27-4730-8a64-ba9898a28ff6 on nch2-master-1 May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3aa9d610-ac1a-4c9c-8f04-468d4bc99dfd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Request method failure captured: May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/images/b0bf15b9-c392-4a8e-b7d4-2543b8d01e52 HTTP/1.1 May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko6oq10ya0vKA7Lzgzw7qEixBB6oq9XwAAqnALDB3LxJ0Ou3iq7_g4aSSk-6F4p6-_hIGxM22vsmPp1vD-bx8iQQTYyEkSHfzi2JWR2mENOMe6ss5h_-1Ay7OrAERWJEEuMTwxRxM1yb64UuFpXocdkERI-wAfMoU5j69oLSNr7C4nA May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:07:30.235767 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:07:30.238833 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab0c1d6a9fc44de4af61822849b3bf8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:30.238833 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:30.238833 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:07:30.238833 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:30.238833 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:07:30.238833 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:07:30.238833 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:07:30.238833 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: dc48535b672d4d1190ecfefe6cb02720 May 28 21:07:30.238833 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:07:30.238833 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:07:30.238833 ncdv-master-1 devstack@n-api.service[143129]: exception: Image not found. May 28 21:07:30.238833 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'b0bf15b9-c392-4a8e-b7d4-2543b8d01e52'} May 28 21:07:30.238833 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b0bf15b9-c392-4a8e-b7d4-2543b8d01e52 to delete May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:30.239765 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b0bf15b9-c392-4a8e-b7d4-2543b8d01e52 could not be found. May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:30.240994 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:30.243379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 21:07:30.243379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:07:30.243379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:07:30.243379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:30.243379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:30.243379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:30.243379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:30.243379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:30.243379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:30.243379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:30.243379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:30.243379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:07:30.243379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:30.244538 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-18c70f34-3b89-4167-a5e7-e6f38d4210da req-51542e8e-93bf-4edc-ac49-84136d13668f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041886 May 28 21:07:30.244538 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 754/1453] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:30.247010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3aa9d610-ac1a-4c9c-8f04-468d4bc99dfd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Returning 404 to user: Image not found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:30.247010 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3aa9d610-ac1a-4c9c-8f04-468d4bc99dfd tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "DELETE /compute/v2.1/images/b0bf15b9-c392-4a8e-b7d4-2543b8d01e52" status: 404 len: 62 microversion: 2.1 time: 0.042945 May 28 21:07:30.248029 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 700/1454] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:30 2022] DELETE /compute/v2.1/images/b0bf15b9-c392-4a8e-b7d4-2543b8d01e52 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:07:30.265611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f5bd7800-f008-48ec-a7b1-e842e1221b94 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:30.265611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f5bd7800-f008-48ec-a7b1-e842e1221b94 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:30.268828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5bd7800-f008-48ec-a7b1-e842e1221b94 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:30.269746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5bd7800-f008-48ec-a7b1-e842e1221b94 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:30.270276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5bd7800-f008-48ec-a7b1-e842e1221b94 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:30.270794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5bd7800-f008-48ec-a7b1-e842e1221b94 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:30.286739 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-f5bd7800-f008-48ec-a7b1-e842e1221b94 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] HTTP exception thrown: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f5bd7800-f008-48ec-a7b1-e842e1221b94 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Request method failure captured: May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f HTTP/1.1 May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko6oq10ya0vKA7Lzgzw7qEixBB6oq9XwAAqnALDB3LxJ0Ou3iq7_g4aSSk-6F4p6-_hIGxM22vsmPp1vD-bx8iQQTYyEkSHfzi2JWR2mENOMe6ss5h_-1Ay7OrAERWJEEuMTwxRxM1yb64UuFpXocdkERI-wAfMoU5j69oLSNr7C4nA May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:07:30.288502 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:07:30.290067 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab0c1d6a9fc44de4af61822849b3bf8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:30.290067 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:30.290067 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:07:30.290067 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:30.290067 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:07:30.290067 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:07:30.290067 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:07:30.290067 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: dc48535b672d4d1190ecfefe6cb02720 May 28 21:07:30.290067 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:07:30.290067 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:07:30.290067 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. May 28 21:07:30.290067 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f'} May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:30.291003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. May 28 21:07:30.292793 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:30.296966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f5bd7800-f008-48ec-a7b1-e842e1221b94 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Returning 404 to user: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:30.296966 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f5bd7800-f008-48ec-a7b1-e842e1221b94 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "DELETE /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 404 len: 111 microversion: 2.1 time: 0.036770 May 28 21:07:30.296966 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 755/1455] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:07:30 2022] DELETE /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:07:30.306088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e96d3cae-7ce0-4583-898c-99a96406fca7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:30.306789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e96d3cae-7ce0-4583-898c-99a96406fca7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] [instance: baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:30.322772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e96d3cae-7ce0-4583-898c-99a96406fca7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:30.323248 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e96d3cae-7ce0-4583-898c-99a96406fca7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:30.324170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e96d3cae-7ce0-4583-898c-99a96406fca7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:30.324696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e96d3cae-7ce0-4583-898c-99a96406fca7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:30.341913 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-e96d3cae-7ce0-4583-898c-99a96406fca7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] HTTP exception thrown: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e96d3cae-7ce0-4583-898c-99a96406fca7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Request method failure captured: May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f HTTP/1.1 May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko6oq10ya0vKA7Lzgzw7qEixBB6oq9XwAAqnALDB3LxJ0Ou3iq7_g4aSSk-6F4p6-_hIGxM22vsmPp1vD-bx8iQQTYyEkSHfzi2JWR2mENOMe6ss5h_-1Ay7OrAERWJEEuMTwxRxM1yb64UuFpXocdkERI-wAfMoU5j69oLSNr7C4nA May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:07:30.343608 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:07:30.345138 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ab0c1d6a9fc44de4af61822849b3bf8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ab0c1d6a9fc44de4af61822849b3bf8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:30.345138 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:30.345138 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: ab0c1d6a9fc44de4af61822849b3bf8d May 28 21:07:30.345138 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-234479497 May 28 21:07:30.345138 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:07:30.345138 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:07:30.345138 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:07:30.345138 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: dc48535b672d4d1190ecfefe6cb02720 May 28 21:07:30.345138 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-234479497-project May 28 21:07:30.345138 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:07:30.345138 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. May 28 21:07:30.345138 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f'} May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:30.346462 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. May 28 21:07:30.347711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:30.348770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e96d3cae-7ce0-4583-898c-99a96406fca7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] Returning 404 to user: Instance baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:30.348770 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e96d3cae-7ce0-4583-898c-99a96406fca7 tempest-ImagesOneServerNegativeTestJSON-234479497 tempest-ImagesOneServerNegativeTestJSON-234479497-project] 10.222.0.33 "GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f" status: 404 len: 111 microversion: 2.1 time: 0.046813 May 28 21:07:30.348770 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 701/1456] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:30 2022] GET /compute/v2.1/servers/baa0a1a7-df43-4d1d-bf8a-ac2fc3e6f53f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:07:30.382979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-966dd52d-1912-4bb1-92f3-4934f46cc7b2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:30.383985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-966dd52d-1912-4bb1-92f3-4934f46cc7b2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:30.398074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-966dd52d-1912-4bb1-92f3-4934f46cc7b2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:30.398797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-966dd52d-1912-4bb1-92f3-4934f46cc7b2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:30.399590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-966dd52d-1912-4bb1-92f3-4934f46cc7b2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:30.400630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-966dd52d-1912-4bb1-92f3-4934f46cc7b2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:30.561158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9962a686-8cf9-4bf2-9038-97d3d5d2c7d1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:30.561811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9962a686-8cf9-4bf2-9038-97d3d5d2c7d1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:30.569727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9962a686-8cf9-4bf2-9038-97d3d5d2c7d1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:30.570224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9962a686-8cf9-4bf2-9038-97d3d5d2c7d1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:30.571036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9962a686-8cf9-4bf2-9038-97d3d5d2c7d1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:30.571488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9962a686-8cf9-4bf2-9038-97d3d5d2c7d1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:30.724017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-966dd52d-1912-4bb1-92f3-4934f46cc7b2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:30.731475 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-966dd52d-1912-4bb1-92f3-4934f46cc7b2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1317 microversion: 2.1 time: 0.352888 May 28 21:07:30.732047 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 756/1457] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:30 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:30.806521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9962a686-8cf9-4bf2-9038-97d3d5d2c7d1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:30.815863 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9962a686-8cf9-4bf2-9038-97d3d5d2c7d1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1318 microversion: 2.1 time: 0.258681 May 28 21:07:30.816444 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 702/1458] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:30 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:30.892970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2df5e2d2-59a1-461b-95df-18a04c8e12d4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:30.894273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2df5e2d2-59a1-461b-95df-18a04c8e12d4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:30.896279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:30.911437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2df5e2d2-59a1-461b-95df-18a04c8e12d4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:30.912556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2df5e2d2-59a1-461b-95df-18a04c8e12d4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:30.913567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2df5e2d2-59a1-461b-95df-18a04c8e12d4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:30.914125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2df5e2d2-59a1-461b-95df-18a04c8e12d4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:31.158565 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b110b7b0-b335-40e3-9de7-ed8b6e67b286 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:31.159257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b110b7b0-b335-40e3-9de7-ed8b6e67b286 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:31.165620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b110b7b0-b335-40e3-9de7-ed8b6e67b286 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:31.166920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b110b7b0-b335-40e3-9de7-ed8b6e67b286 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:31.168093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b110b7b0-b335-40e3-9de7-ed8b6e67b286 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:31.168732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b110b7b0-b335-40e3-9de7-ed8b6e67b286 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:31.191454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2df5e2d2-59a1-461b-95df-18a04c8e12d4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:31.205593 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2df5e2d2-59a1-461b-95df-18a04c8e12d4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1463 microversion: 2.1 time: 0.315637 May 28 21:07:31.211155 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 757/1459] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:30 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1463 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:31.226335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d5583465-8125-4998-9005-d6a940c972fb tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:31.227056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d5583465-8125-4998-9005-d6a940c972fb tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:31.233677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d5583465-8125-4998-9005-d6a940c972fb tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:31.234266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d5583465-8125-4998-9005-d6a940c972fb tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:31.236735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d5583465-8125-4998-9005-d6a940c972fb tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:31.237247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d5583465-8125-4998-9005-d6a940c972fb tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:31.499136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b110b7b0-b335-40e3-9de7-ed8b6e67b286 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:31.509277 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b110b7b0-b335-40e3-9de7-ed8b6e67b286 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1477 microversion: 2.1 time: 0.355436 May 28 21:07:31.510862 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 703/1460] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:31 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1477 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:31.577389 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d5583465-8125-4998-9005-d6a940c972fb tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1614 microversion: 2.1 time: 0.354673 May 28 21:07:31.589090 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 758/1461] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:31 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1614 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:31.596402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-19feb8c0-9de8-4794-b585-1797eed5f702 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:31.597387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-19feb8c0-9de8-4794-b585-1797eed5f702 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:31.603937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19feb8c0-9de8-4794-b585-1797eed5f702 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:31.604642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19feb8c0-9de8-4794-b585-1797eed5f702 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:31.605666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19feb8c0-9de8-4794-b585-1797eed5f702 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:31.606255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19feb8c0-9de8-4794-b585-1797eed5f702 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:31.689691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-19feb8c0-9de8-4794-b585-1797eed5f702 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'a43b061d4e864c289ac541d11e46c4de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01b8421c635c440eaec446bfb659bd22', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:31.690969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-19feb8c0-9de8-4794-b585-1797eed5f702 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] flavor_id is None. Assuming migration. {{(pid=143129) resize /opt/stack/nova/nova/compute/api.py:4142}} May 28 21:07:31.691142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-19feb8c0-9de8-4794-b585-1797eed5f702 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=143129) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 21:07:31.748746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-57433d77-b5e7-40bb-98ed-82a5cbdb9860 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:31.754053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-57433d77-b5e7-40bb-98ed-82a5cbdb9860 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:31.757155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57433d77-b5e7-40bb-98ed-82a5cbdb9860 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:31.757778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57433d77-b5e7-40bb-98ed-82a5cbdb9860 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:31.758781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57433d77-b5e7-40bb-98ed-82a5cbdb9860 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:31.759384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57433d77-b5e7-40bb-98ed-82a5cbdb9860 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:32.032012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-57433d77-b5e7-40bb-98ed-82a5cbdb9860 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:32.054132 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-57433d77-b5e7-40bb-98ed-82a5cbdb9860 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1317 microversion: 2.1 time: 0.302844 May 28 21:07:32.057722 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 759/1462] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:31 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:32.078392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e08850be-b688-4548-83f5-2540bb22319a tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:32.079095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e08850be-b688-4548-83f5-2540bb22319a tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:32.086785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e08850be-b688-4548-83f5-2540bb22319a tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:32.087497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e08850be-b688-4548-83f5-2540bb22319a tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:32.088460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e08850be-b688-4548-83f5-2540bb22319a tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:32.089134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e08850be-b688-4548-83f5-2540bb22319a tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:32.345968 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-19feb8c0-9de8-4794-b585-1797eed5f702 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100/action" status: 202 len: 0 microversion: 2.1 time: 0.740335 May 28 21:07:32.351772 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 704/1463] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:07:31 2022] POST /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100/action => generated 0 bytes in 761 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:07:32.378937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-75d4e047-dd39-4b56-b748-879d88316685 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:32.379854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-75d4e047-dd39-4b56-b748-879d88316685 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:32.403562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75d4e047-dd39-4b56-b748-879d88316685 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:32.410739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75d4e047-dd39-4b56-b748-879d88316685 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:32.413969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75d4e047-dd39-4b56-b748-879d88316685 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:32.414717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75d4e047-dd39-4b56-b748-879d88316685 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:32.456174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=26 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:32.594936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e08850be-b688-4548-83f5-2540bb22319a tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:32.604124 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e08850be-b688-4548-83f5-2540bb22319a tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1318 microversion: 2.1 time: 0.548018 May 28 21:07:32.605424 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 760/1464] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:32 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1318 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:32.625527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-c91a8116-c351-4166-b1b9-0f976639f261 req-8cb699e1-faf7-4acb-8a88-bb1decf9e453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc08f458-df9b-447b-8b5e-31407d2f80c4", "name": "network-vif-deleted", "tag": "e0393585-b244-4d62-8666-a6f0f9316dc5"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:32.643253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c91a8116-c351-4166-b1b9-0f976639f261 req-8cb699e1-faf7-4acb-8a88-bb1decf9e453 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:32.644110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c91a8116-c351-4166-b1b9-0f976639f261 req-8cb699e1-faf7-4acb-8a88-bb1decf9e453 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:32.662638 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-c91a8116-c351-4166-b1b9-0f976639f261 req-8cb699e1-faf7-4acb-8a88-bb1decf9e453 service nova] Creating event network-vif-deleted:e0393585-b244-4d62-8666-a6f0f9316dc5 for instance bc08f458-df9b-447b-8b5e-31407d2f80c4 on nch1-master-1 May 28 21:07:32.674789 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-c91a8116-c351-4166-b1b9-0f976639f261 req-8cb699e1-faf7-4acb-8a88-bb1decf9e453 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066453 May 28 21:07:32.677382 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 761/1465] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:32.683796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4f7a3b5a-1fae-4237-927e-7bf76fb3d0e3 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:32.684867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4f7a3b5a-1fae-4237-927e-7bf76fb3d0e3 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:32.692407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f7a3b5a-1fae-4237-927e-7bf76fb3d0e3 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:32.693122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f7a3b5a-1fae-4237-927e-7bf76fb3d0e3 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:32.694254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f7a3b5a-1fae-4237-927e-7bf76fb3d0e3 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:32.695119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f7a3b5a-1fae-4237-927e-7bf76fb3d0e3 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:32.791566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4f7a3b5a-1fae-4237-927e-7bf76fb3d0e3 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:32.800113 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4f7a3b5a-1fae-4237-927e-7bf76fb3d0e3 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1307 microversion: 2.1 time: 0.121273 May 28 21:07:32.807003 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 762/1466] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:32 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1307 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:32.816146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-75d4e047-dd39-4b56-b748-879d88316685 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:32.828143 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-75d4e047-dd39-4b56-b748-879d88316685 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1472 microversion: 2.1 time: 0.474972 May 28 21:07:32.838094 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 705/1467] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:32 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1472 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:33.077597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dafae87b-4126-4c61-8fce-abd9a18d1e49 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:33.078621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dafae87b-4126-4c61-8fce-abd9a18d1e49 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:33.088188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dafae87b-4126-4c61-8fce-abd9a18d1e49 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:33.088653 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dafae87b-4126-4c61-8fce-abd9a18d1e49 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:33.089453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dafae87b-4126-4c61-8fce-abd9a18d1e49 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:33.089921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dafae87b-4126-4c61-8fce-abd9a18d1e49 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:33.113768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:33.354956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dafae87b-4126-4c61-8fce-abd9a18d1e49 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:33.363041 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dafae87b-4126-4c61-8fce-abd9a18d1e49 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1317 microversion: 2.1 time: 0.294156 May 28 21:07:33.372980 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 763/1468] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:33 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:33.623319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-61d2fb9f-7842-420c-b2a6-0a37b5228814 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:33.626244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-61d2fb9f-7842-420c-b2a6-0a37b5228814 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:33.661297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61d2fb9f-7842-420c-b2a6-0a37b5228814 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:33.680462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61d2fb9f-7842-420c-b2a6-0a37b5228814 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:33.684774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61d2fb9f-7842-420c-b2a6-0a37b5228814 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:33.685912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61d2fb9f-7842-420c-b2a6-0a37b5228814 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:33.819116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-942b4c9a-1ff9-4543-9853-cd08347c3003 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:33.819745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-942b4c9a-1ff9-4543-9853-cd08347c3003 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:33.827440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-942b4c9a-1ff9-4543-9853-cd08347c3003 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:33.827896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-942b4c9a-1ff9-4543-9853-cd08347c3003 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:33.828901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-942b4c9a-1ff9-4543-9853-cd08347c3003 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:33.829514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-942b4c9a-1ff9-4543-9853-cd08347c3003 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:33.902710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-942b4c9a-1ff9-4543-9853-cd08347c3003 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:33.902710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-942b4c9a-1ff9-4543-9853-cd08347c3003 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:33.902710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-942b4c9a-1ff9-4543-9853-cd08347c3003 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lazy-loading 'fault' on Instance uuid bc08f458-df9b-447b-8b5e-31407d2f80c4 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:07:34.001521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-942b4c9a-1ff9-4543-9853-cd08347c3003 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b349adf52040d1822953c96514ff7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72d0adc19fe145caa50c8a0767765092', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:34.016414 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-942b4c9a-1ff9-4543-9853-cd08347c3003 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 200 len: 1312 microversion: 2.1 time: 0.202432 May 28 21:07:34.017363 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 764/1469] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:33 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 1312 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:34.023038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ab65bff2-f9c6-401c-b500-00213f893007 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:34.023665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ab65bff2-f9c6-401c-b500-00213f893007 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:34.030257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab65bff2-f9c6-401c-b500-00213f893007 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:34.030778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab65bff2-f9c6-401c-b500-00213f893007 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:34.032123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab65bff2-f9c6-401c-b500-00213f893007 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:34.032659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab65bff2-f9c6-401c-b500-00213f893007 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:34.123526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-61d2fb9f-7842-420c-b2a6-0a37b5228814 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:34.140442 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-61d2fb9f-7842-420c-b2a6-0a37b5228814 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1318 microversion: 2.1 time: 0.521997 May 28 21:07:34.142102 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 706/1470] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:33 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:34.380886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6ae207f6-4009-4ebc-a884-2269c4a8763e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:34.381777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6ae207f6-4009-4ebc-a884-2269c4a8763e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:34.393620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ae207f6-4009-4ebc-a884-2269c4a8763e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:34.394125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ae207f6-4009-4ebc-a884-2269c4a8763e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:34.394935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ae207f6-4009-4ebc-a884-2269c4a8763e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:34.395385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ae207f6-4009-4ebc-a884-2269c4a8763e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:34.408686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:34.412539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ab65bff2-f9c6-401c-b500-00213f893007 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:34.423194 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ab65bff2-f9c6-401c-b500-00213f893007 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1472 microversion: 2.1 time: 0.404215 May 28 21:07:34.427514 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 765/1471] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:34 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1472 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:34.618616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6ae207f6-4009-4ebc-a884-2269c4a8763e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:34.627480 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6ae207f6-4009-4ebc-a884-2269c4a8763e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1466 microversion: 2.1 time: 0.250966 May 28 21:07:34.629892 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 707/1472] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:34 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1466 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:34.644924 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7b1c4059-4af2-4a48-b2c5-0e5faf5ccfa8 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:34.645622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7b1c4059-4af2-4a48-b2c5-0e5faf5ccfa8 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:34.651943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b1c4059-4af2-4a48-b2c5-0e5faf5ccfa8 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:34.652702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b1c4059-4af2-4a48-b2c5-0e5faf5ccfa8 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:34.653480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b1c4059-4af2-4a48-b2c5-0e5faf5ccfa8 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:34.654006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b1c4059-4af2-4a48-b2c5-0e5faf5ccfa8 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:34.846287 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7b1c4059-4af2-4a48-b2c5-0e5faf5ccfa8 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1617 microversion: 2.1 time: 0.205133 May 28 21:07:34.847002 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 766/1473] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:34 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1617 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:34.973091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1465014529", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["9fd99f38-0c1f-4ec7-9ec6-03463939ec67"]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:35.031486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:07:35.036388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5f3b7534-3879-4c64-b7ee-73cb828fe2a9 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:35.037292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5f3b7534-3879-4c64-b7ee-73cb828fe2a9 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] [instance: bc08f458-df9b-447b-8b5e-31407d2f80c4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:35.050206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f3b7534-3879-4c64-b7ee-73cb828fe2a9 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:35.050907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f3b7534-3879-4c64-b7ee-73cb828fe2a9 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:35.051708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f3b7534-3879-4c64-b7ee-73cb828fe2a9 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:35.052878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f3b7534-3879-4c64-b7ee-73cb828fe2a9 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:35.075442 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-5f3b7534-3879-4c64-b7ee-73cb828fe2a9 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] HTTP exception thrown: Instance bc08f458-df9b-447b-8b5e-31407d2f80c4 could not be found. May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5f3b7534-3879-4c64-b7ee-73cb828fe2a9 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Request method failure captured: May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 HTTP/1.1 May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko79-OSSbmB2GJ9DfqILE9RDP9K3ULnId_qmstnvcdaQWrxcKuvg_elHjz1Rot97fjx7M9Rymjkgpge2kLNLTR5HPkkxAgvEXx3-hyCyq9vCOHhXcxMjYalTRJ2OBNygpia9IKnuw3XB578_4inh2s8BhR5n-fvcwJ0fit-ACFIjSTQ May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 72d0adc19fe145caa50c8a0767765092 May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1803339619 May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:07:35.077345 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:07:35.078837 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_72d0adc19fe145caa50c8a0767765092", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72d0adc19fe145caa50c8a0767765092"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/72d0adc19fe145caa50c8a0767765092"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/72d0adc19fe145caa50c8a0767765092"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:35.078837 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1803339619 May 28 21:07:35.078837 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 72d0adc19fe145caa50c8a0767765092 May 28 21:07:35.078837 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1803339619 May 28 21:07:35.078837 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerDiagnosticsNegativeTest-1803339619-project May 28 21:07:35.078837 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:07:35.078837 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:07:35.078837 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: d1b349adf52040d1822953c96514ff7e May 28 21:07:35.078837 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1803339619-project May 28 21:07:35.078837 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:07:35.078837 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance bc08f458-df9b-447b-8b5e-31407d2f80c4 could not be found. May 28 21:07:35.078837 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'bc08f458-df9b-447b-8b5e-31407d2f80c4'} May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc08f458-df9b-447b-8b5e-31407d2f80c4 could not be found. May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:35.079598 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc08f458-df9b-447b-8b5e-31407d2f80c4 could not be found. May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc08f458-df9b-447b-8b5e-31407d2f80c4 could not be found. May 28 21:07:35.082004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:35.083614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5f3b7534-3879-4c64-b7ee-73cb828fe2a9 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] Returning 404 to user: Instance bc08f458-df9b-447b-8b5e-31407d2f80c4 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:35.083614 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5f3b7534-3879-4c64-b7ee-73cb828fe2a9 tempest-ServerDiagnosticsNegativeTest-1803339619 tempest-ServerDiagnosticsNegativeTest-1803339619-project] 10.222.0.33 "GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4" status: 404 len: 111 microversion: 2.1 time: 0.047112 May 28 21:07:35.083614 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 767/1474] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:35 2022] GET /compute/v2.1/servers/bc08f458-df9b-447b-8b5e-31407d2f80c4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:07:35.167562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2897c58b-3f2a-4525-a51a-d1034b62a03c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:35.170275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2897c58b-3f2a-4525-a51a-d1034b62a03c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:35.185717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2897c58b-3f2a-4525-a51a-d1034b62a03c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:35.186430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2897c58b-3f2a-4525-a51a-d1034b62a03c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:35.187491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2897c58b-3f2a-4525-a51a-d1034b62a03c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:35.188085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2897c58b-3f2a-4525-a51a-d1034b62a03c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:35.555071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2897c58b-3f2a-4525-a51a-d1034b62a03c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:35.569438 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2897c58b-3f2a-4525-a51a-d1034b62a03c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1318 microversion: 2.1 time: 0.413841 May 28 21:07:35.570050 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 768/1475] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:35 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:35.575024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7a78a96a-0d49-4b87-bf37-e91e1b8ae34b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:35.575848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7a78a96a-0d49-4b87-bf37-e91e1b8ae34b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:35.582809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a78a96a-0d49-4b87-bf37-e91e1b8ae34b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:35.586776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a78a96a-0d49-4b87-bf37-e91e1b8ae34b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:35.586776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a78a96a-0d49-4b87-bf37-e91e1b8ae34b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:35.586776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a78a96a-0d49-4b87-bf37-e91e1b8ae34b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:35.651775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:07:35.655617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:07:35.655617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:07:35.655617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:07:35.655617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:07:35.665064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:35.665509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:35.666365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:35.666833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:35.692725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:07:35.701553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:07:35.715830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:07:35.718615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:07:35.836311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7a78a96a-0d49-4b87-bf37-e91e1b8ae34b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:35.878488 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7a78a96a-0d49-4b87-bf37-e91e1b8ae34b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1472 microversion: 2.1 time: 0.289521 May 28 21:07:35.880865 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-95fd9c79-8161-4c49-8677-e70fb3b3f073 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904088 May 28 21:07:35.887174 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 769/1476] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:35 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1472 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:35.899795 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 708/1477] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:07:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:07:35.899795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-300b77ca-a65f-49de-a3fb-7ed4ffc849e3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:35.899795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-300b77ca-a65f-49de-a3fb-7ed4ffc849e3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:36.069482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-300b77ca-a65f-49de-a3fb-7ed4ffc849e3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:36.083023 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-300b77ca-a65f-49de-a3fb-7ed4ffc849e3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1217 microversion: 2.1 time: 0.192131 May 28 21:07:36.093222 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 709/1478] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:35 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1217 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:36.239906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-88a433cb-2084-476d-a244-74824aa38db6 req-1433cda2-f283-4cbc-9172-62431d694113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688d4d8f-9b8f-4201-909c-8e3627dd1711", "name": "network-vif-plugged", "status": "completed", "tag": "80c50feb-6a2d-4c2a-a587-eb16fefb5793"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:36.262185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-88a433cb-2084-476d-a244-74824aa38db6 req-1433cda2-f283-4cbc-9172-62431d694113 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:36.264346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-88a433cb-2084-476d-a244-74824aa38db6 req-1433cda2-f283-4cbc-9172-62431d694113 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:36.297066 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-88a433cb-2084-476d-a244-74824aa38db6 req-1433cda2-f283-4cbc-9172-62431d694113 service nova] Creating event network-vif-plugged:80c50feb-6a2d-4c2a-a587-eb16fefb5793 for instance 688d4d8f-9b8f-4201-909c-8e3627dd1711 on nch2-master-1 May 28 21:07:36.304589 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-88a433cb-2084-476d-a244-74824aa38db6 req-1433cda2-f283-4cbc-9172-62431d694113 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069478 May 28 21:07:36.306987 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 770/1479] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:36.588296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8fe36b2c-c846-4a34-bfbe-0f8f94119ac1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:36.588931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8fe36b2c-c846-4a34-bfbe-0f8f94119ac1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:36.598124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fe36b2c-c846-4a34-bfbe-0f8f94119ac1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:36.598583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fe36b2c-c846-4a34-bfbe-0f8f94119ac1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:36.600209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fe36b2c-c846-4a34-bfbe-0f8f94119ac1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:36.600836 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fe36b2c-c846-4a34-bfbe-0f8f94119ac1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:36.843879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8fe36b2c-c846-4a34-bfbe-0f8f94119ac1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:36.854884 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8fe36b2c-c846-4a34-bfbe-0f8f94119ac1 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1318 microversion: 2.1 time: 0.270819 May 28 21:07:36.855559 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 710/1480] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:36 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:36.916199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d3a27a55-8084-4ed5-a533-b6e43ff9430f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:36.916860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d3a27a55-8084-4ed5-a533-b6e43ff9430f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:36.926415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3a27a55-8084-4ed5-a533-b6e43ff9430f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:36.927215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3a27a55-8084-4ed5-a533-b6e43ff9430f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:36.928267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3a27a55-8084-4ed5-a533-b6e43ff9430f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:36.929183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3a27a55-8084-4ed5-a533-b6e43ff9430f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:37.101243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-00c3af47-dad5-4158-a48f-e0075a6bc7cb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:37.103250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-00c3af47-dad5-4158-a48f-e0075a6bc7cb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:37.196865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d3a27a55-8084-4ed5-a533-b6e43ff9430f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:37.208130 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d3a27a55-8084-4ed5-a533-b6e43ff9430f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1472 microversion: 2.1 time: 0.296598 May 28 21:07:37.208749 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 771/1481] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:36 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:37.241263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-00c3af47-dad5-4158-a48f-e0075a6bc7cb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:37.253950 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-00c3af47-dad5-4158-a48f-e0075a6bc7cb tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1217 microversion: 2.1 time: 0.156719 May 28 21:07:37.255097 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 711/1482] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:37 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:37.878121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-577af04e-591b-4150-bc22-a371f3ba9ee7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:37.879047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-577af04e-591b-4150-bc22-a371f3ba9ee7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:37.887109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-577af04e-591b-4150-bc22-a371f3ba9ee7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:37.887933 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-577af04e-591b-4150-bc22-a371f3ba9ee7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:37.888949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-577af04e-591b-4150-bc22-a371f3ba9ee7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:37.889618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-577af04e-591b-4150-bc22-a371f3ba9ee7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:38.247670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-21f2c517-d126-4baf-907a-f0c3b876cb83 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:38.249113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-21f2c517-d126-4baf-907a-f0c3b876cb83 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:38.258146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-577af04e-591b-4150-bc22-a371f3ba9ee7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:38.261378 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-577af04e-591b-4150-bc22-a371f3ba9ee7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1318 microversion: 2.1 time: 0.392510 May 28 21:07:38.262780 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 772/1483] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:37 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:38.266438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21f2c517-d126-4baf-907a-f0c3b876cb83 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:38.267156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21f2c517-d126-4baf-907a-f0c3b876cb83 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:38.273790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21f2c517-d126-4baf-907a-f0c3b876cb83 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:38.277039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21f2c517-d126-4baf-907a-f0c3b876cb83 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:38.282449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d031587b-03aa-4373-a2cc-d6bee4fde39a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:38.283236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d031587b-03aa-4373-a2cc-d6bee4fde39a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:38.290491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d031587b-03aa-4373-a2cc-d6bee4fde39a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:38.291095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d031587b-03aa-4373-a2cc-d6bee4fde39a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:38.291945 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d031587b-03aa-4373-a2cc-d6bee4fde39a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:38.292399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d031587b-03aa-4373-a2cc-d6bee4fde39a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:38.488142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d031587b-03aa-4373-a2cc-d6bee4fde39a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:38.498702 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d031587b-03aa-4373-a2cc-d6bee4fde39a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1269 microversion: 2.1 time: 0.225485 May 28 21:07:38.499801 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 773/1484] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:38 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:38.980857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-21f2c517-d126-4baf-907a-f0c3b876cb83 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:38.993476 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-21f2c517-d126-4baf-907a-f0c3b876cb83 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.770663 May 28 21:07:38.995162 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 712/1485] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:38 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:39.279908 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-38adafb9-f2ce-492f-9ea8-a3d165ca589c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:39.280586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-38adafb9-f2ce-492f-9ea8-a3d165ca589c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:39.299075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-38adafb9-f2ce-492f-9ea8-a3d165ca589c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:39.308466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-38adafb9-f2ce-492f-9ea8-a3d165ca589c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:39.314763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-38adafb9-f2ce-492f-9ea8-a3d165ca589c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:39.314763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-38adafb9-f2ce-492f-9ea8-a3d165ca589c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:39.526775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4e2e49b0-14ae-4fac-85f3-93f46c018885 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:39.529147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4e2e49b0-14ae-4fac-85f3-93f46c018885 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:39.544393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e2e49b0-14ae-4fac-85f3-93f46c018885 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:39.547044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e2e49b0-14ae-4fac-85f3-93f46c018885 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:39.552779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e2e49b0-14ae-4fac-85f3-93f46c018885 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:39.557781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e2e49b0-14ae-4fac-85f3-93f46c018885 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:39.758455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-38adafb9-f2ce-492f-9ea8-a3d165ca589c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:39.770849 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-38adafb9-f2ce-492f-9ea8-a3d165ca589c tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1507 microversion: 2.1 time: 0.494800 May 28 21:07:39.772487 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 774/1486] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:39 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1507 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:39.789022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4e2e49b0-14ae-4fac-85f3-93f46c018885 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:39.806254 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4e2e49b0-14ae-4fac-85f3-93f46c018885 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1275 microversion: 2.1 time: 0.290743 May 28 21:07:39.808687 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 713/1487] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:39 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1275 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:40.017391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a62ca5e2-ea73-475a-80b2-42538b921617 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:40.018234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a62ca5e2-ea73-475a-80b2-42538b921617 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:40.035670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a62ca5e2-ea73-475a-80b2-42538b921617 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:40.035670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a62ca5e2-ea73-475a-80b2-42538b921617 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:40.035670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a62ca5e2-ea73-475a-80b2-42538b921617 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:40.035670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a62ca5e2-ea73-475a-80b2-42538b921617 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:40.414637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a62ca5e2-ea73-475a-80b2-42538b921617 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:40.423652 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a62ca5e2-ea73-475a-80b2-42538b921617 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.415679 May 28 21:07:40.435255 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 775/1488] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:40 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:40.846939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-66671874-7c93-411a-81e4-8deaefb9511e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:40.846939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-66671874-7c93-411a-81e4-8deaefb9511e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:40.855589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66671874-7c93-411a-81e4-8deaefb9511e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:40.860995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66671874-7c93-411a-81e4-8deaefb9511e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:40.867193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66671874-7c93-411a-81e4-8deaefb9511e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:40.874902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66671874-7c93-411a-81e4-8deaefb9511e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:41.321916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-66671874-7c93-411a-81e4-8deaefb9511e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:41.333853 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-66671874-7c93-411a-81e4-8deaefb9511e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1317 microversion: 2.1 time: 0.511340 May 28 21:07:41.335022 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 714/1489] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:40 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:41.444090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ed547849-ef4d-4d0b-a6fa-6c7798510996 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:41.459556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ed547849-ef4d-4d0b-a6fa-6c7798510996 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:41.473602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed547849-ef4d-4d0b-a6fa-6c7798510996 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:41.476196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed547849-ef4d-4d0b-a6fa-6c7798510996 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:41.478222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed547849-ef4d-4d0b-a6fa-6c7798510996 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:41.479283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed547849-ef4d-4d0b-a6fa-6c7798510996 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:41.739813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-53109860-2ea6-4531-a9c4-0feaab2fb91f tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:41.749572 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-53109860-2ea6-4531-a9c4-0feaab2fb91f tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.545324 May 28 21:07:41.750526 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 776/1490] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:07:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:41.766822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3a22cf81-7fab-47c6-a638-ce5fb72d8074 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:41.830306 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3a22cf81-7fab-47c6-a638-ce5fb72d8074 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.069514 May 28 21:07:41.838388 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 777/1491] 10.222.0.33 () {58 vars in 1124 bytes} [Sat May 28 21:07:41 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:41.843396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-763be250-1345-4c68-889f-62aa25aee71e tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:41.863914 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ed547849-ef4d-4d0b-a6fa-6c7798510996 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:41.868046 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-763be250-1345-4c68-889f-62aa25aee71e tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028593 May 28 21:07:41.874001 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 778/1492] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:07:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:07:41.885709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6be00862-c455-4f44-a9b4-2c145fae553f tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:41.901924 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6be00862-c455-4f44-a9b4-2c145fae553f tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022236 May 28 21:07:41.906872 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 779/1493] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:07:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:41.913649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f57ff30e-891a-4e33-92c4-b37415863ffb tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:41.920162 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ed547849-ef4d-4d0b-a6fa-6c7798510996 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.478721 May 28 21:07:41.924843 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 715/1494] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:41 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:41.963383 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f57ff30e-891a-4e33-92c4-b37415863ffb tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.053401 May 28 21:07:41.964340 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 780/1495] 10.222.0.33 () {58 vars in 1164 bytes} [Sat May 28 21:07:41 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:41.979888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5fce1bcd-1d21-4202-8a6f-c420816eadf4 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.005139 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5fce1bcd-1d21-4202-8a6f-c420816eadf4 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030199 May 28 21:07:42.006071 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 716/1496] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:07:41 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:42.020459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b4cc0be7-f4bd-46e5-a223-861d95a9e69a tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.070028 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b4cc0be7-f4bd-46e5-a223-861d95a9e69a tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.056637 May 28 21:07:42.071234 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 781/1497] 10.222.0.33 () {58 vars in 1168 bytes} [Sat May 28 21:07:42 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:42.086352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e189900b-cbc2-4ea4-9eee-0f0ec416cdc8 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.119342 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e189900b-cbc2-4ea4-9eee-0f0ec416cdc8 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.037142 May 28 21:07:42.129105 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 717/1498] 10.222.0.33 () {58 vars in 1160 bytes} [Sat May 28 21:07:42 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:42.135026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0f769cf0-e15a-4c44-aab3-d12e027b32f4 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.150810 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0f769cf0-e15a-4c44-aab3-d12e027b32f4 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020017 May 28 21:07:42.165393 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 782/1499] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:07:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:42.173149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb4506b7-c2d4-4232-89f8-9da2d883207a tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.253919 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb4506b7-c2d4-4232-89f8-9da2d883207a tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.087580 May 28 21:07:42.254529 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 718/1500] 10.222.0.33 () {58 vars in 1166 bytes} [Sat May 28 21:07:42 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:42.268168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-189c0985-f3bd-4536-9069-1003946a2e20 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.283689 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-189c0985-f3bd-4536-9069-1003946a2e20 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018738 May 28 21:07:42.284991 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 783/1501] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:07:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:42.297509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1184c875-1ffc-4b5c-b363-a3cc1301fd00 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.352459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-10552dc9-4c88-4976-8367-8b255e2943d8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.353094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-10552dc9-4c88-4976-8367-8b255e2943d8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:42.359235 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1184c875-1ffc-4b5c-b363-a3cc1301fd00 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.067050 May 28 21:07:42.362553 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 719/1502] 10.222.0.33 () {58 vars in 1143 bytes} [Sat May 28 21:07:42 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:42.364064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10552dc9-4c88-4976-8367-8b255e2943d8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:42.364710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10552dc9-4c88-4976-8367-8b255e2943d8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:42.365955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10552dc9-4c88-4976-8367-8b255e2943d8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:42.367407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10552dc9-4c88-4976-8367-8b255e2943d8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:42.380948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-75e86487-6641-4e00-a2f5-edf223b1f8aa tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.403950 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-75e86487-6641-4e00-a2f5-edf223b1f8aa tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028473 May 28 21:07:42.428620 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 720/1503] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:07:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:07:42.442500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b22b5e34-6207-47cb-98d0-b651bf6e2370 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.474678 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b22b5e34-6207-47cb-98d0-b651bf6e2370 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.039046 May 28 21:07:42.475855 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 721/1504] 10.222.0.33 () {58 vars in 1147 bytes} [Sat May 28 21:07:42 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:42.505360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-550ac334-c4ae-43fc-abe0-7162b5a296a7 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.521394 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-550ac334-c4ae-43fc-abe0-7162b5a296a7 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.037386 May 28 21:07:42.522649 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 722/1505] 10.222.0.33 () {58 vars in 1139 bytes} [Sat May 28 21:07:42 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:07:42.548085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2a8f9604-1f4f-47de-9cc4-25c7ff9f44e4 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.575008 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2a8f9604-1f4f-47de-9cc4-25c7ff9f44e4 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037749 May 28 21:07:42.578538 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 723/1506] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:07:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:42.594532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-de90b892-7a64-48d5-8555-f631227c8c7d req-55ba873a-5508-4605-b231-555c34108d42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc6c2f13-ac6f-47e9-b104-cf1fadc55f14", "tag": "fceaa8d6-4e66-44d1-bffb-f7ab021ef0ae"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:42.617309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-de90b892-7a64-48d5-8555-f631227c8c7d req-55ba873a-5508-4605-b231-555c34108d42 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:42.617309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-de90b892-7a64-48d5-8555-f631227c8c7d req-55ba873a-5508-4605-b231-555c34108d42 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:42.645562 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-de90b892-7a64-48d5-8555-f631227c8c7d req-55ba873a-5508-4605-b231-555c34108d42 service nova] Creating event network-changed:fceaa8d6-4e66-44d1-bffb-f7ab021ef0ae for instance dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 on nch2-master-1 May 28 21:07:42.649280 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-de90b892-7a64-48d5-8555-f631227c8c7d req-55ba873a-5508-4605-b231-555c34108d42 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067992 May 28 21:07:42.651304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-10552dc9-4c88-4976-8367-8b255e2943d8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:42.651478 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 724/1507] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:42.666712 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-10552dc9-4c88-4976-8367-8b255e2943d8 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1317 microversion: 2.1 time: 0.318806 May 28 21:07:42.670183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ea8a48f5-2620-449b-9371-43ffc1ee3543 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.691494 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 784/1508] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:42 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:42.703007 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ea8a48f5-2620-449b-9371-43ffc1ee3543 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.049637 May 28 21:07:42.703598 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 725/1509] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:07:42 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:42.717232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c783d1ff-8d43-43ca-b049-2dbea81ae43a tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.780176 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c783d1ff-8d43-43ca-b049-2dbea81ae43a tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.067404 May 28 21:07:42.781148 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 785/1510] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:07:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:42.807474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-10e489dc-70ac-41d1-aa92-63b59e4db991 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.823042 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-10e489dc-70ac-41d1-aa92-63b59e4db991 tempest-FlavorsV2TestJSON-757464437 tempest-FlavorsV2TestJSON-757464437-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030269 May 28 21:07:42.832223 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 726/1511] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:07:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:42.938134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-07665db4-0fc0-4379-b822-67b782dfc858 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:42.939887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-07665db4-0fc0-4379-b822-67b782dfc858 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:42.957213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07665db4-0fc0-4379-b822-67b782dfc858 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:42.958204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07665db4-0fc0-4379-b822-67b782dfc858 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:42.959438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07665db4-0fc0-4379-b822-67b782dfc858 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:42.960120 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07665db4-0fc0-4379-b822-67b782dfc858 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:43.234502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-07665db4-0fc0-4379-b822-67b782dfc858 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:43.246546 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-07665db4-0fc0-4379-b822-67b782dfc858 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.313620 May 28 21:07:43.260578 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 786/1512] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:42 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:43.700852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5de7258b-0451-44d7-b413-2bac8f9a4a7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:43.702163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5de7258b-0451-44d7-b413-2bac8f9a4a7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:43.713908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5de7258b-0451-44d7-b413-2bac8f9a4a7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:43.714396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5de7258b-0451-44d7-b413-2bac8f9a4a7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:43.715201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5de7258b-0451-44d7-b413-2bac8f9a4a7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:43.715982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5de7258b-0451-44d7-b413-2bac8f9a4a7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:44.025505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5de7258b-0451-44d7-b413-2bac8f9a4a7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:44.038739 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5de7258b-0451-44d7-b413-2bac8f9a4a7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1317 microversion: 2.1 time: 0.343969 May 28 21:07:44.039325 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 727/1513] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:43 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:44.141878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-61ef832e-17b4-46d8-8edd-ec1ab8d5e787 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "497e0018-ccb8-45cf-b799-e98400f1ef6f"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:44.158235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-61ef832e-17b4-46d8-8edd-ec1ab8d5e787 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:44.166305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61ef832e-17b4-46d8-8edd-ec1ab8d5e787 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:44.167047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61ef832e-17b4-46d8-8edd-ec1ab8d5e787 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:44.168050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61ef832e-17b4-46d8-8edd-ec1ab8d5e787 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:44.168694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61ef832e-17b4-46d8-8edd-ec1ab8d5e787 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:44.264950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7e37d3cb-8762-4a74-9d7a-a2a40abeb952 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:44.265882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7e37d3cb-8762-4a74-9d7a-a2a40abeb952 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:44.279113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e37d3cb-8762-4a74-9d7a-a2a40abeb952 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:44.301425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e37d3cb-8762-4a74-9d7a-a2a40abeb952 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:44.305394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e37d3cb-8762-4a74-9d7a-a2a40abeb952 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:44.305975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e37d3cb-8762-4a74-9d7a-a2a40abeb952 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:44.581036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7e37d3cb-8762-4a74-9d7a-a2a40abeb952 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:44.592722 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7e37d3cb-8762-4a74-9d7a-a2a40abeb952 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.329935 May 28 21:07:44.592722 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 728/1514] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:44 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:44.950743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b584f8ea-85d2-4a13-a1b0-defe4a7e904b tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Action: 'create', calling method: .version_select at 0x7f4d645611f0>, body: {"keypair": {"name": "tempest-keypair-1148369027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7ZMbRsVYqIdBD1ZLGYmYyc6RM8NK8DpQHkjUD8WQ4My/CMYqSfITIw9yfNQsuLneNCHMEowLPe6BdNoCCEIcqO6qfQa5ZZlc8Jm64LsPsw/UuKW6a6ULhzCuI4iTVQ0Q=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:44.969349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-b584f8ea-85d2-4a13-a1b0-defe4a7e904b tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Getting quotas for project caacba1610f44c5ca8057b10a2dd483a. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:07:44.976127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-b584f8ea-85d2-4a13-a1b0-defe4a7e904b tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Getting quotas for user bf67d3b90f7642c2b23020958f14e53b and project caacba1610f44c5ca8057b10a2dd483a. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:07:44.998071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:45.071624 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b584f8ea-85d2-4a13-a1b0-defe4a7e904b tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.479388 May 28 21:07:45.072769 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 729/1515] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:07:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:45.077616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-83950aee-b6f9-4269-a47f-f9c3c82fdb0d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:45.078849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-83950aee-b6f9-4269-a47f-f9c3c82fdb0d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:45.089093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-83950aee-b6f9-4269-a47f-f9c3c82fdb0d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:45.089560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-83950aee-b6f9-4269-a47f-f9c3c82fdb0d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:45.090453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-83950aee-b6f9-4269-a47f-f9c3c82fdb0d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:45.090907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-83950aee-b6f9-4269-a47f-f9c3c82fdb0d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:45.304143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-83950aee-b6f9-4269-a47f-f9c3c82fdb0d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:45.334862 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-83950aee-b6f9-4269-a47f-f9c3c82fdb0d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1317 microversion: 2.1 time: 0.252484 May 28 21:07:45.334862 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 730/1516] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:45 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:45.679400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:45.730348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1660442402", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "1d1e95b4-31c7-4a87-a450-6b766dbdbce1"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:45.790847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] validate_networks() for [('1d1e95b4-31c7-4a87-a450-6b766dbdbce1', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:07:45.828798 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-61ef832e-17b4-46d8-8edd-ec1ab8d5e787 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "POST /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.690683 May 28 21:07:45.829803 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 787/1517] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:07:44 2022] POST /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments => generated 194 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:45.835972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e9cbb998-5875-4bd9-a1ad-7102652eb3ba tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:45.836915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e9cbb998-5875-4bd9-a1ad-7102652eb3ba tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:45.856029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9cbb998-5875-4bd9-a1ad-7102652eb3ba tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:45.856649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9cbb998-5875-4bd9-a1ad-7102652eb3ba tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:45.857829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9cbb998-5875-4bd9-a1ad-7102652eb3ba tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:45.858464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9cbb998-5875-4bd9-a1ad-7102652eb3ba tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:46.617432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e9cbb998-5875-4bd9-a1ad-7102652eb3ba tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:46.624583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:46.631353 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e9cbb998-5875-4bd9-a1ad-7102652eb3ba tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.800067 May 28 21:07:46.632565 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 788/1518] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:45 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:46.762831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ebccd975-7fc3-4645-82ee-6b393742e530 tempest-ListImagesTestJSON-207023214 tempest-ListImagesTestJSON-207023214-project] Calling method '.version_select at 0x7f4d641ada60>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:46.826988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:07:46.827552 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:07:46.827967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:07:46.828397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:07:46.828822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:07:46.835169 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ebccd975-7fc3-4645-82ee-6b393742e530 tempest-ListImagesTestJSON-207023214 tempest-ListImagesTestJSON-207023214-project] 10.222.0.33 "GET /compute/v2.1/images/9586d0d3-c540-4636-bb36-06bb4b16c195" status: 200 len: 784 microversion: 2.1 time: 0.191993 May 28 21:07:46.835815 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 789/1519] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:07:46 2022] GET /compute/v2.1/images/9586d0d3-c540-4636-bb36-06bb4b16c195 => generated 784 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:46.841618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:46.842404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:46.843540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:46.844184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:46.850340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a9f76c98-1470-4013-8846-fdedf750eb57 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:46.857105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a9f76c98-1470-4013-8846-fdedf750eb57 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:46.871318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a9f76c98-1470-4013-8846-fdedf750eb57 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:46.871794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a9f76c98-1470-4013-8846-fdedf750eb57 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:46.872572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a9f76c98-1470-4013-8846-fdedf750eb57 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:46.873027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a9f76c98-1470-4013-8846-fdedf750eb57 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:46.874197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Getting quotas for project 158c1665476643cda0976e68ab5e595a. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:07:46.882567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Getting quotas for user 04e5b86f94914df085b76e0d89b2230e and project 158c1665476643cda0976e68ab5e595a. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:07:46.899058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:07:46.902270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:07:47.043337 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-64222ac0-e0a3-4d6c-af20-535ae37285a8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.601193 May 28 21:07:47.045118 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 731/1520] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:07:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:07:47.050815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5ad622cf-2121-412a-80bb-85c7e7a25f0e tempest-ListImagesTestJSON-207023214 tempest-ListImagesTestJSON-207023214-project] Calling method '.version_select at 0x7f4d640618b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:47.222619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a9f76c98-1470-4013-8846-fdedf750eb57 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:47.232869 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a9f76c98-1470-4013-8846-fdedf750eb57 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1317 microversion: 2.1 time: 0.395665 May 28 21:07:47.233403 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 790/1521] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:46 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:47.243748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7037b7a3-88ff-4fea-96bd-c092edd52c50 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:47.252022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7037b7a3-88ff-4fea-96bd-c092edd52c50 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:47.268196 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5ad622cf-2121-412a-80bb-85c7e7a25f0e tempest-ListImagesTestJSON-207023214 tempest-ListImagesTestJSON-207023214-project] 10.222.0.33 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.221836 May 28 21:07:47.274981 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 732/1522] 10.222.0.33 () {58 vars in 1121 bytes} [Sat May 28 21:07:47 2022] GET /compute/v2.1/images => generated 445 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:47.287550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c4a2b05b-e4d4-4359-9ed1-a290f846ae11 tempest-ListImagesTestJSON-207023214 tempest-ListImagesTestJSON-207023214-project] Calling method '.version_select at 0x7f4d64116c10>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:47.376468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7037b7a3-88ff-4fea-96bd-c092edd52c50 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:47.383605 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7037b7a3-88ff-4fea-96bd-c092edd52c50 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 200 len: 1208 microversion: 2.1 time: 0.144699 May 28 21:07:47.384246 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 791/1523] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:47 2022] GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 1208 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:47.387881 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c4a2b05b-e4d4-4359-9ed1-a290f846ae11 tempest-ListImagesTestJSON-207023214 tempest-ListImagesTestJSON-207023214-project] 10.222.0.33 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.111732 May 28 21:07:47.393079 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 733/1524] 10.222.0.33 () {58 vars in 1142 bytes} [Sat May 28 21:07:47 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:47.650316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cc070970-f2c1-4542-bc2e-8f523cab89f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:47.651274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cc070970-f2c1-4542-bc2e-8f523cab89f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:47.661472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc070970-f2c1-4542-bc2e-8f523cab89f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:47.662313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc070970-f2c1-4542-bc2e-8f523cab89f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:47.664179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc070970-f2c1-4542-bc2e-8f523cab89f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:47.664867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc070970-f2c1-4542-bc2e-8f523cab89f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:47.900349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cc070970-f2c1-4542-bc2e-8f523cab89f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:47.914076 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cc070970-f2c1-4542-bc2e-8f523cab89f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.268609 May 28 21:07:47.925019 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 792/1525] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:47 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:48.253163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c5b3c43a-a409-404d-868b-a2a35a4ad746 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:48.253904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c5b3c43a-a409-404d-868b-a2a35a4ad746 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:48.265060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5b3c43a-a409-404d-868b-a2a35a4ad746 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:48.265516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5b3c43a-a409-404d-868b-a2a35a4ad746 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:48.266370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5b3c43a-a409-404d-868b-a2a35a4ad746 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:48.266799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5b3c43a-a409-404d-868b-a2a35a4ad746 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:48.403768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eb1581eb-ba6a-4946-b3f6-4434c5f91034 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:48.404543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eb1581eb-ba6a-4946-b3f6-4434c5f91034 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:48.509400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eb1581eb-ba6a-4946-b3f6-4434c5f91034 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:48.518115 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eb1581eb-ba6a-4946-b3f6-4434c5f91034 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 200 len: 1208 microversion: 2.1 time: 0.120813 May 28 21:07:48.519183 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 793/1526] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:48 2022] GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 1208 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:48.632357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c5b3c43a-a409-404d-868b-a2a35a4ad746 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:48.640396 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c5b3c43a-a409-404d-868b-a2a35a4ad746 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1317 microversion: 2.1 time: 0.393596 May 28 21:07:48.641737 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 734/1527] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:48 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:48.727264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "ab41efdf-dfab-4cc7-9476-59ba83441a15"}], "security_groups": [{"name": "tempest-securitygroup--64659893"}], "key_name": "tempest-keypair-1148369027", "user_data": "}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:48.843772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] validate_networks() for [('ab41efdf-dfab-4cc7-9476-59ba83441a15', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:07:48.941746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e673c7dd-acd3-4279-9b36-e077985594f9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:48.942644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e673c7dd-acd3-4279-9b36-e077985594f9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:48.950547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e673c7dd-acd3-4279-9b36-e077985594f9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:48.951247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e673c7dd-acd3-4279-9b36-e077985594f9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:48.952118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e673c7dd-acd3-4279-9b36-e077985594f9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:48.952850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e673c7dd-acd3-4279-9b36-e077985594f9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:49.155505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e673c7dd-acd3-4279-9b36-e077985594f9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:49.166348 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e673c7dd-acd3-4279-9b36-e077985594f9 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.229556 May 28 21:07:49.167424 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 735/1528] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:48 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:49.348835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:07:49.349337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:07:49.349740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:07:49.350246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:07:49.355753 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:07:49.357337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:49.364219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:49.364681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:49.365489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:49.365965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:49.384863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Getting quotas for project caacba1610f44c5ca8057b10a2dd483a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:07:49.390265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Getting quotas for user bf67d3b90f7642c2b23020958f14e53b and project caacba1610f44c5ca8057b10a2dd483a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:07:49.403975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:07:49.406357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:07:49.535482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-13dd17e0-83f7-4bd0-9128-624e4b9cf3ee tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:49.536239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-13dd17e0-83f7-4bd0-9128-624e4b9cf3ee tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:49.542923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13dd17e0-83f7-4bd0-9128-624e4b9cf3ee tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:49.543384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13dd17e0-83f7-4bd0-9128-624e4b9cf3ee tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:49.544153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13dd17e0-83f7-4bd0-9128-624e4b9cf3ee tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:49.544598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13dd17e0-83f7-4bd0-9128-624e4b9cf3ee tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:49.580384 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8f57e41f-e478-4e4f-890b-c257742951e0 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.858544 May 28 21:07:49.581051 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 794/1529] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:07:48 2022] POST /compute/v2.1/servers => generated 407 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:07:49.591535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c79de848-84e1-4da5-ae34-aa61c9c38798 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:49.592272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c79de848-84e1-4da5-ae34-aa61c9c38798 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:49.611565 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-13dd17e0-83f7-4bd0-9128-624e4b9cf3ee tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:49.621897 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-13dd17e0-83f7-4bd0-9128-624e4b9cf3ee tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 200 len: 1260 microversion: 2.1 time: 0.090625 May 28 21:07:49.627034 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 736/1530] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:49 2022] GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 1260 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:49.662037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c79de848-84e1-4da5-ae34-aa61c9c38798 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:49.665081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-67336421-1f65-4169-b22b-c972b1b21390 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:49.673286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-67336421-1f65-4169-b22b-c972b1b21390 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:49.673400 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c79de848-84e1-4da5-ae34-aa61c9c38798 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1226 microversion: 2.1 time: 0.085385 May 28 21:07:49.679128 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 795/1531] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:49 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:49.685697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67336421-1f65-4169-b22b-c972b1b21390 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:49.686362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67336421-1f65-4169-b22b-c972b1b21390 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:49.687720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67336421-1f65-4169-b22b-c972b1b21390 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:49.689428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67336421-1f65-4169-b22b-c972b1b21390 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:49.875770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-67336421-1f65-4169-b22b-c972b1b21390 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:49.884174 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-67336421-1f65-4169-b22b-c972b1b21390 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1317 microversion: 2.1 time: 0.229487 May 28 21:07:49.884890 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 737/1532] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:49 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1317 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:50.188673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-857332ee-b676-41a7-bd10-c5949ac8e077 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:50.190312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-857332ee-b676-41a7-bd10-c5949ac8e077 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:50.205001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-857332ee-b676-41a7-bd10-c5949ac8e077 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:50.206264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-857332ee-b676-41a7-bd10-c5949ac8e077 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:50.207728 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-857332ee-b676-41a7-bd10-c5949ac8e077 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:50.208555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-857332ee-b676-41a7-bd10-c5949ac8e077 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:50.400395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-857332ee-b676-41a7-bd10-c5949ac8e077 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:50.420601 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-857332ee-b676-41a7-bd10-c5949ac8e077 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.240185 May 28 21:07:50.422195 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 796/1533] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:50 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:50.471606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d2ce2e56-10e4-4b83-a3d8-4d2892d21aa5 req-d3d1b737-89ed-44d5-bbc2-5b346e78e77c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6c2f13-ac6f-47e9-b104-cf1fadc55f14", "name": "network-vif-plugged", "status": "completed", "tag": "fceaa8d6-4e66-44d1-bffb-f7ab021ef0ae"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:50.485385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d2ce2e56-10e4-4b83-a3d8-4d2892d21aa5 req-d3d1b737-89ed-44d5-bbc2-5b346e78e77c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:50.486878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d2ce2e56-10e4-4b83-a3d8-4d2892d21aa5 req-d3d1b737-89ed-44d5-bbc2-5b346e78e77c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:50.505651 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d2ce2e56-10e4-4b83-a3d8-4d2892d21aa5 req-d3d1b737-89ed-44d5-bbc2-5b346e78e77c service nova] Creating event network-vif-plugged:fceaa8d6-4e66-44d1-bffb-f7ab021ef0ae for instance dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 on nch2-master-1 May 28 21:07:50.512334 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d2ce2e56-10e4-4b83-a3d8-4d2892d21aa5 req-d3d1b737-89ed-44d5-bbc2-5b346e78e77c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046822 May 28 21:07:50.513379 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 738/1534] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:50.644768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cce1ef2d-27e9-45a7-be7d-b3cb25c80207 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:50.647622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cce1ef2d-27e9-45a7-be7d-b3cb25c80207 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:50.652927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cce1ef2d-27e9-45a7-be7d-b3cb25c80207 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:50.653640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cce1ef2d-27e9-45a7-be7d-b3cb25c80207 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:50.654668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cce1ef2d-27e9-45a7-be7d-b3cb25c80207 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:50.655194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cce1ef2d-27e9-45a7-be7d-b3cb25c80207 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:50.693313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bdedbb56-0144-4e8e-b89f-5d1e85bde57e tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:50.694685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bdedbb56-0144-4e8e-b89f-5d1e85bde57e tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:50.801985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cce1ef2d-27e9-45a7-be7d-b3cb25c80207 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:50.815801 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cce1ef2d-27e9-45a7-be7d-b3cb25c80207 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 200 len: 1266 microversion: 2.1 time: 0.174929 May 28 21:07:50.816609 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 797/1535] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:50 2022] GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:50.842553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bdedbb56-0144-4e8e-b89f-5d1e85bde57e tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:50.862154 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bdedbb56-0144-4e8e-b89f-5d1e85bde57e tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1226 microversion: 2.1 time: 0.170876 May 28 21:07:50.862154 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 739/1536] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:50 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1226 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:50.902014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e622493e-da20-4d97-bf5d-996389ba8471 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:50.902744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e622493e-da20-4d97-bf5d-996389ba8471 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:50.910101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e622493e-da20-4d97-bf5d-996389ba8471 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:50.910626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e622493e-da20-4d97-bf5d-996389ba8471 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:50.911921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e622493e-da20-4d97-bf5d-996389ba8471 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:50.912032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e622493e-da20-4d97-bf5d-996389ba8471 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:51.109944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e622493e-da20-4d97-bf5d-996389ba8471 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:51.119002 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e622493e-da20-4d97-bf5d-996389ba8471 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1317 microversion: 2.1 time: 0.221149 May 28 21:07:51.120442 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 798/1537] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:50 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:51.440500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-39ae9ff1-a043-409d-80fc-1f80ac1a5322 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:51.441822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-39ae9ff1-a043-409d-80fc-1f80ac1a5322 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:51.460334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39ae9ff1-a043-409d-80fc-1f80ac1a5322 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:51.461050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39ae9ff1-a043-409d-80fc-1f80ac1a5322 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:51.462231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39ae9ff1-a043-409d-80fc-1f80ac1a5322 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:51.462841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39ae9ff1-a043-409d-80fc-1f80ac1a5322 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:51.609313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-39ae9ff1-a043-409d-80fc-1f80ac1a5322 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:51.618639 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-39ae9ff1-a043-409d-80fc-1f80ac1a5322 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.182927 May 28 21:07:51.619722 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 799/1538] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:51 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:51.654614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cce45630-f8f5-462c-8e25-167e7ca557e2 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0d8a1256-3599-44d3-9238-ee3b52179cf3"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:51.655710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cce45630-f8f5-462c-8e25-167e7ca557e2 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:51.663298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cce45630-f8f5-462c-8e25-167e7ca557e2 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:51.663761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cce45630-f8f5-462c-8e25-167e7ca557e2 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:51.664588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cce45630-f8f5-462c-8e25-167e7ca557e2 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:51.664976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cce45630-f8f5-462c-8e25-167e7ca557e2 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:51.776133 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-cce45630-f8f5-462c-8e25-167e7ca557e2 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] HTTP exception thrown: Volume 0d8a1256-3599-44d3-9238-ee3b52179cf3 could not be found. May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cce45630-f8f5-462c-8e25-167e7ca557e2 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] Request method failure captured: May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: request: PUT /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments/497e0018-ccb8-45cf-b799-e98400f1ef6f HTTP/1.1 May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 74 May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko8HleIkMAYJ16d7vAdhj4QnzfBFFf_fTQCqfw88CxDXBYP_IYtTeWSEp0FdaESD-B2-wHKs7wefAZNJsD5-MS1Eb4bc9QyQneILmPxnbPl3JNNPYvfuKJfBmxJA7DzkBoQKwhH53kByfhESVXpDpo4gEBTSNDGBIe2C1rtvAK9jhzw May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: dcf954165a95433eb89884d6dc4c7feb May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-VolumesAdminNegativeTest-956902144 May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:07:51.803177 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:07:51.804839 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcf954165a95433eb89884d6dc4c7feb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcf954165a95433eb89884d6dc4c7feb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcf954165a95433eb89884d6dc4c7feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcf954165a95433eb89884d6dc4c7feb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:51.804839 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-VolumesAdminNegativeTest-956902144 May 28 21:07:51.804839 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: dcf954165a95433eb89884d6dc4c7feb May 28 21:07:51.804839 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-956902144 May 28 21:07:51.804839 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-VolumesAdminNegativeTest-956902144-project-admin May 28 21:07:51.804839 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:07:51.804839 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:07:51.804839 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 3b3b0064f12e43cd8069165fe4c370bc May 28 21:07:51.804839 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-VolumesAdminNegativeTest-956902144-project-admin May 28 21:07:51.804839 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:07:51.804839 ncdv-master-1 devstack@n-api.service[143129]: {"volumeAttachment": {"volumeId": "0d8a1256-3599-44d3-9238-ee3b52179cf3"}} May 28 21:07:51.804839 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:07:51.804839 ncdv-master-1 devstack@n-api.service[143129]: exception: Volume 0d8a1256-3599-44d3-9238-ee3b52179cf3 could not be found. May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'server_id': '688d4d8f-9b8f-4201-909c-8e3627dd1711', 'id': '497e0018-ccb8-45cf-b799-e98400f1ef6f', 'body': {'volumeAttachment': {'volumeId': '0d8a1256-3599-44d3-9238-ee3b52179cf3'}}} May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:07:51.805947 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0d8a1256-3599-44d3-9238-ee3b52179cf3 could not be found. (HTTP 404) (Request-ID: req-21d04469-123c-4fe7-9cb5-f4e9016bfdff) May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 21:07:51.807275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0d8a1256-3599-44d3-9238-ee3b52179cf3 could not be found. May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:51.808980 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 0d8a1256-3599-44d3-9238-ee3b52179cf3 could not be found. May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0d8a1256-3599-44d3-9238-ee3b52179cf3 could not be found. May 28 21:07:51.810406 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:07:51.812593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cce45630-f8f5-462c-8e25-167e7ca557e2 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] Returning 400 to user: Volume 0d8a1256-3599-44d3-9238-ee3b52179cf3 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:51.812593 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cce45630-f8f5-462c-8e25-167e7ca557e2 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] 10.222.0.33 "PUT /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments/497e0018-ccb8-45cf-b799-e98400f1ef6f" status: 400 len: 107 microversion: 2.1 time: 0.394589 May 28 21:07:51.812593 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 740/1539] 10.222.0.33 () {60 vars in 1432 bytes} [Sat May 28 21:07:51 2022] PUT /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments/497e0018-ccb8-45cf-b799-e98400f1ef6f => generated 107 bytes in 396 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:07:51.843558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fb26b523-cc7d-473a-b7d9-d86868a8a029 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:51.846859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fb26b523-cc7d-473a-b7d9-d86868a8a029 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:51.856520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb26b523-cc7d-473a-b7d9-d86868a8a029 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:51.857300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb26b523-cc7d-473a-b7d9-d86868a8a029 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:51.859023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb26b523-cc7d-473a-b7d9-d86868a8a029 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:51.859780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb26b523-cc7d-473a-b7d9-d86868a8a029 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:51.877336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3b393220-7efd-4f31-850a-6800bf529272 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:51.878004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3b393220-7efd-4f31-850a-6800bf529272 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:51.896785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b393220-7efd-4f31-850a-6800bf529272 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:51.904850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b393220-7efd-4f31-850a-6800bf529272 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:51.905951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b393220-7efd-4f31-850a-6800bf529272 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:51.907292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b393220-7efd-4f31-850a-6800bf529272 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:52.003440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3b393220-7efd-4f31-850a-6800bf529272 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:52.014754 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3b393220-7efd-4f31-850a-6800bf529272 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1278 microversion: 2.1 time: 0.141729 May 28 21:07:52.025376 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 741/1540] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:51 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:52.034342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-afa4fe71-c57f-4332-9ccc-a90f47cdb774 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:52.035183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-afa4fe71-c57f-4332-9ccc-a90f47cdb774 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:52.042576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afa4fe71-c57f-4332-9ccc-a90f47cdb774 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:52.043041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afa4fe71-c57f-4332-9ccc-a90f47cdb774 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:52.043849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afa4fe71-c57f-4332-9ccc-a90f47cdb774 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:52.044357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afa4fe71-c57f-4332-9ccc-a90f47cdb774 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:52.075261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fb26b523-cc7d-473a-b7d9-d86868a8a029 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:52.087785 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fb26b523-cc7d-473a-b7d9-d86868a8a029 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 200 len: 1308 microversion: 2.1 time: 0.246485 May 28 21:07:52.087785 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 800/1541] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:51 2022] GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:52.138038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-52eaa9ee-1aee-4be4-9942-18eeedd87d66 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:52.138953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-52eaa9ee-1aee-4be4-9942-18eeedd87d66 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:52.140331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:52.144740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-afa4fe71-c57f-4332-9ccc-a90f47cdb774 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lazy-loading 'services' on Instance uuid 688d4d8f-9b8f-4201-909c-8e3627dd1711 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:07:52.147272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52eaa9ee-1aee-4be4-9942-18eeedd87d66 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:52.150010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52eaa9ee-1aee-4be4-9942-18eeedd87d66 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:52.150958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52eaa9ee-1aee-4be4-9942-18eeedd87d66 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:52.151478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52eaa9ee-1aee-4be4-9942-18eeedd87d66 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:52.413326 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-afa4fe71-c57f-4332-9ccc-a90f47cdb774 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments/497e0018-ccb8-45cf-b799-e98400f1ef6f" status: 202 len: 0 microversion: 2.1 time: 0.383106 May 28 21:07:52.415618 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 742/1542] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:07:52 2022] DELETE /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments/497e0018-ccb8-45cf-b799-e98400f1ef6f => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:07:52.435017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-cadb81a2-cb21-4297-a7f3-853f25d797f1 req-178f70f6-21c3-453d-8f3c-d3864ac1957f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f837cef-04b0-4491-8edf-c10423944be0", "tag": "f9af25ca-e630-49f5-9345-5a9075542855"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:52.435726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-52eaa9ee-1aee-4be4-9942-18eeedd87d66 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:52.449165 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-52eaa9ee-1aee-4be4-9942-18eeedd87d66 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1317 microversion: 2.1 time: 0.314058 May 28 21:07:52.451162 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 801/1543] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:52 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1317 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:52.463209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cadb81a2-cb21-4297-a7f3-853f25d797f1 req-178f70f6-21c3-453d-8f3c-d3864ac1957f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:52.465432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cadb81a2-cb21-4297-a7f3-853f25d797f1 req-178f70f6-21c3-453d-8f3c-d3864ac1957f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:52.465898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-46287063-7e9a-46f4-9c19-9ca7eec0a620 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:52.467817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-46287063-7e9a-46f4-9c19-9ca7eec0a620 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:52.483029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46287063-7e9a-46f4-9c19-9ca7eec0a620 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:52.487368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46287063-7e9a-46f4-9c19-9ca7eec0a620 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:52.490780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46287063-7e9a-46f4-9c19-9ca7eec0a620 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:52.494299 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-cadb81a2-cb21-4297-a7f3-853f25d797f1 req-178f70f6-21c3-453d-8f3c-d3864ac1957f service nova] Creating event network-changed:f9af25ca-e630-49f5-9345-5a9075542855 for instance 1f837cef-04b0-4491-8edf-c10423944be0 on nch1-master-1 May 28 21:07:52.495023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46287063-7e9a-46f4-9c19-9ca7eec0a620 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:52.501828 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-cadb81a2-cb21-4297-a7f3-853f25d797f1 req-178f70f6-21c3-453d-8f3c-d3864ac1957f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082212 May 28 21:07:52.502482 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 743/1544] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:52.563060 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-46287063-7e9a-46f4-9c19-9ca7eec0a620 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110607 May 28 21:07:52.563669 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 802/1545] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:07:52 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:52.638311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-182f2906-197a-4040-908e-d9a4ee5d346f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:52.643862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-182f2906-197a-4040-908e-d9a4ee5d346f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:52.657097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-182f2906-197a-4040-908e-d9a4ee5d346f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:52.657609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-182f2906-197a-4040-908e-d9a4ee5d346f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:52.660711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-182f2906-197a-4040-908e-d9a4ee5d346f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:52.666970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-182f2906-197a-4040-908e-d9a4ee5d346f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:52.883315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-182f2906-197a-4040-908e-d9a4ee5d346f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:52.903088 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-182f2906-197a-4040-908e-d9a4ee5d346f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.268472 May 28 21:07:52.904133 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 744/1546] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:52 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:53.033463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8e0b1049-7f95-41b0-807e-6af09e3b86c8 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:53.034276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8e0b1049-7f95-41b0-807e-6af09e3b86c8 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:53.041649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e0b1049-7f95-41b0-807e-6af09e3b86c8 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:53.042283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e0b1049-7f95-41b0-807e-6af09e3b86c8 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:53.043173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e0b1049-7f95-41b0-807e-6af09e3b86c8 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:53.043722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e0b1049-7f95-41b0-807e-6af09e3b86c8 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:53.101830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dd9322a9-1fd3-4160-835d-58fff036a759 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:53.102834 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dd9322a9-1fd3-4160-835d-58fff036a759 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:53.110231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd9322a9-1fd3-4160-835d-58fff036a759 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:53.111367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd9322a9-1fd3-4160-835d-58fff036a759 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:53.112378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd9322a9-1fd3-4160-835d-58fff036a759 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:53.114017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd9322a9-1fd3-4160-835d-58fff036a759 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:53.135974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8e0b1049-7f95-41b0-807e-6af09e3b86c8 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:53.146148 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8e0b1049-7f95-41b0-807e-6af09e3b86c8 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1284 microversion: 2.1 time: 0.117192 May 28 21:07:53.147415 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 803/1547] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:53 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:53.356004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dd9322a9-1fd3-4160-835d-58fff036a759 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:53.364962 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dd9322a9-1fd3-4160-835d-58fff036a759 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 200 len: 1308 microversion: 2.1 time: 0.267802 May 28 21:07:53.392456 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 745/1548] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:53 2022] GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 1308 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:53.473625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-462a1632-80e9-44a7-8d9f-948437cbd676 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:53.473625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-462a1632-80e9-44a7-8d9f-948437cbd676 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:53.476694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-462a1632-80e9-44a7-8d9f-948437cbd676 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:53.477497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-462a1632-80e9-44a7-8d9f-948437cbd676 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:53.478631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-462a1632-80e9-44a7-8d9f-948437cbd676 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:53.479156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-462a1632-80e9-44a7-8d9f-948437cbd676 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:53.578728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6d5b9004-c15f-4bf0-929b-c760b6e0daf0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:53.579806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6d5b9004-c15f-4bf0-929b-c760b6e0daf0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:53.587703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d5b9004-c15f-4bf0-929b-c760b6e0daf0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:53.588154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d5b9004-c15f-4bf0-929b-c760b6e0daf0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:53.588943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d5b9004-c15f-4bf0-929b-c760b6e0daf0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:53.589684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d5b9004-c15f-4bf0-929b-c760b6e0daf0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:53.624449 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6d5b9004-c15f-4bf0-929b-c760b6e0daf0 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049682 May 28 21:07:53.625043 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 746/1549] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:07:53 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:53.658950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-462a1632-80e9-44a7-8d9f-948437cbd676 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:53.667041 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-462a1632-80e9-44a7-8d9f-948437cbd676 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1466 microversion: 2.1 time: 0.203930 May 28 21:07:53.673142 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 804/1550] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:53 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1466 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:53.684089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0b75e070-3ea4-40f0-a78d-4450aea48d18 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:53.684782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0b75e070-3ea4-40f0-a78d-4450aea48d18 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:53.692015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b75e070-3ea4-40f0-a78d-4450aea48d18 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:53.692481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b75e070-3ea4-40f0-a78d-4450aea48d18 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:53.693235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b75e070-3ea4-40f0-a78d-4450aea48d18 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:53.693676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b75e070-3ea4-40f0-a78d-4450aea48d18 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:53.920968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4b2c6097-9936-4ca2-ba9c-0a1dbfabadee tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:53.921923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4b2c6097-9936-4ca2-ba9c-0a1dbfabadee tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:53.935345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b2c6097-9936-4ca2-ba9c-0a1dbfabadee tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:53.936613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b2c6097-9936-4ca2-ba9c-0a1dbfabadee tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:53.942167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b2c6097-9936-4ca2-ba9c-0a1dbfabadee tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:53.943125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b2c6097-9936-4ca2-ba9c-0a1dbfabadee tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:53.976628 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0b75e070-3ea4-40f0-a78d-4450aea48d18 tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1617 microversion: 2.1 time: 0.296293 May 28 21:07:53.991115 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 747/1551] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:53 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1617 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:54.163731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ab26b54c-4b1d-4f74-bbee-61fe8990ae43 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:54.164606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ab26b54c-4b1d-4f74-bbee-61fe8990ae43 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:54.176861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab26b54c-4b1d-4f74-bbee-61fe8990ae43 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:54.178650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab26b54c-4b1d-4f74-bbee-61fe8990ae43 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:54.178650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab26b54c-4b1d-4f74-bbee-61fe8990ae43 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:54.182444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab26b54c-4b1d-4f74-bbee-61fe8990ae43 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:54.352495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4b2c6097-9936-4ca2-ba9c-0a1dbfabadee tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:54.370681 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4b2c6097-9936-4ca2-ba9c-0a1dbfabadee tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.452111 May 28 21:07:54.371658 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 805/1552] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:53 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:54.391517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-25c75bc4-72ef-49e4-a06c-e0ccee0ef2c1 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:54.400468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-25c75bc4-72ef-49e4-a06c-e0ccee0ef2c1 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:54.401471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25c75bc4-72ef-49e4-a06c-e0ccee0ef2c1 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:54.401966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25c75bc4-72ef-49e4-a06c-e0ccee0ef2c1 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:54.403044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25c75bc4-72ef-49e4-a06c-e0ccee0ef2c1 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:54.403660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25c75bc4-72ef-49e4-a06c-e0ccee0ef2c1 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:54.597738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ab26b54c-4b1d-4f74-bbee-61fe8990ae43 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:54.609748 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ab26b54c-4b1d-4f74-bbee-61fe8990ae43 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1350 microversion: 2.1 time: 0.449758 May 28 21:07:54.615975 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 748/1553] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:54 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1350 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:54.631247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-57070373", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9fd99f38-0c1f-4ec7-9ec6-03463939ec67"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:54.668868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-25c75bc4-72ef-49e4-a06c-e0ccee0ef2c1 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:54.679581 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-25c75bc4-72ef-49e4-a06c-e0ccee0ef2c1 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 200 len: 1308 microversion: 2.1 time: 0.291901 May 28 21:07:54.680646 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 806/1554] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:54 2022] GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 1308 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:54.686049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-de7136d3-524e-4b6c-b431-880a494a89c9 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:54.687544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-de7136d3-524e-4b6c-b431-880a494a89c9 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:54.695511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de7136d3-524e-4b6c-b431-880a494a89c9 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:54.696278 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de7136d3-524e-4b6c-b431-880a494a89c9 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:54.697289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de7136d3-524e-4b6c-b431-880a494a89c9 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:54.698204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de7136d3-524e-4b6c-b431-880a494a89c9 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:54.712624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:07:54.740525 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-de7136d3-524e-4b6c-b431-880a494a89c9 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058521 May 28 21:07:54.741968 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 807/1555] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:07:54 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:55.210672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-10104523", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "a8cad774-f5d9-4630-8882-1fcbf23ca116"}], "block_device_mapping_v2": [{"uuid": "bdc702a5-c0fa-423b-b6bf-14c735b9af34", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:55.314429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] validate_networks() for [('a8cad774-f5d9-4630-8882-1fcbf23ca116', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:07:55.489199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:07:55.489694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:07:55.490233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:07:55.490656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:07:55.491100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:07:55.500638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:55.501105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:55.501950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:55.502392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:55.522076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for project 348fbbc628b44152b05362657c11230d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:07:55.528637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Getting quotas for user 5e54b51913be4a2bab74aae347785727 and project 348fbbc628b44152b05362657c11230d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:07:55.542747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:07:55.545392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:07:55.787380 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-086b5e59-1bb8-4c0b-9b27-30e18ede224a tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167597 May 28 21:07:55.789731 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 749/1556] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:07:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1178 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:07:55.794713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1ea179f9-0d3c-47d7-8bef-5653a917aff7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:55.795785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1ea179f9-0d3c-47d7-8bef-5653a917aff7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:55.802786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ea179f9-0d3c-47d7-8bef-5653a917aff7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:55.803554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ea179f9-0d3c-47d7-8bef-5653a917aff7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:55.804669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ea179f9-0d3c-47d7-8bef-5653a917aff7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:55.805226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ea179f9-0d3c-47d7-8bef-5653a917aff7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:56.071529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:07:56.078547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:07:56.079794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:07:56.086414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:07:56.087112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:07:56.111296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:56.111755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:56.207779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:56.207779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:56.209749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1ea179f9-0d3c-47d7-8bef-5653a917aff7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:56.209749 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1ea179f9-0d3c-47d7-8bef-5653a917aff7 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.349819 May 28 21:07:56.209749 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 750/1557] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:55 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:56.209749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-07420141-d3c3-4bd9-975c-9d8060e408e4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:56.210653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-07420141-d3c3-4bd9-975c-9d8060e408e4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:56.210653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07420141-d3c3-4bd9-975c-9d8060e408e4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:56.210653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07420141-d3c3-4bd9-975c-9d8060e408e4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:56.210653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07420141-d3c3-4bd9-975c-9d8060e408e4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:56.211594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07420141-d3c3-4bd9-975c-9d8060e408e4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:56.211831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Getting quotas for project 45a2b4e7e1484ea3807bc8d8bc31296c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:07:56.211831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Getting quotas for user fc6ee6dba5d24e90bff48384539fcd7f and project 45a2b4e7e1484ea3807bc8d8bc31296c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:07:56.258871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:07:56.261863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bdc702a5-c0fa-423b-b6bf-14c735b9af34',volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:07:56.347789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-07420141-d3c3-4bd9-975c-9d8060e408e4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:56.355650 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-07420141-d3c3-4bd9-975c-9d8060e408e4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1350 microversion: 2.1 time: 0.212858 May 28 21:07:56.356231 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 751/1558] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:56 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1350 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:56.362142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d5364b26-db38-4023-9c45-199db6200405 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:56.362739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d5364b26-db38-4023-9c45-199db6200405 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:56.369220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5364b26-db38-4023-9c45-199db6200405 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:56.380072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5364b26-db38-4023-9c45-199db6200405 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:56.380072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5364b26-db38-4023-9c45-199db6200405 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:56.380072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5364b26-db38-4023-9c45-199db6200405 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:56.537245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d5364b26-db38-4023-9c45-199db6200405 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:56.551279 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d5364b26-db38-4023-9c45-199db6200405 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 200 len: 1308 microversion: 2.1 time: 0.193809 May 28 21:07:56.558376 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 752/1559] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:56 2022] GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:56.563686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a9f61668-404a-4d5e-800f-d8a88c0321eb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:56.571939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a9f61668-404a-4d5e-800f-d8a88c0321eb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:56.584348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9f61668-404a-4d5e-800f-d8a88c0321eb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:56.584821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9f61668-404a-4d5e-800f-d8a88c0321eb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:56.585865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9f61668-404a-4d5e-800f-d8a88c0321eb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:56.586639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9f61668-404a-4d5e-800f-d8a88c0321eb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:56.625730 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a9f61668-404a-4d5e-800f-d8a88c0321eb tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065875 May 28 21:07:56.626388 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 753/1560] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:07:56 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:07:56.633138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-780f92f7-63c5-4b4f-81e8-03f418a1c2f7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:56.633138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-780f92f7-63c5-4b4f-81e8-03f418a1c2f7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:56.712744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-780f92f7-63c5-4b4f-81e8-03f418a1c2f7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:56.723075 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-780f92f7-63c5-4b4f-81e8-03f418a1c2f7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1215 microversion: 2.1 time: 0.094040 May 28 21:07:56.723075 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 754/1561] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:56 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:56.728020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-7620ab5a-600c-4f5a-a884-d0c2eb093816 req-0d7303fb-34ce-4676-9ca1-28b2c2717f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2332865a-7f64-4b42-bef6-75a5d7c6c77f", "tag": "75b54983-d107-4ad1-a9f9-b77effb39ba3"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:56.765930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7620ab5a-600c-4f5a-a884-d0c2eb093816 req-0d7303fb-34ce-4676-9ca1-28b2c2717f76 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:56.766400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7620ab5a-600c-4f5a-a884-d0c2eb093816 req-0d7303fb-34ce-4676-9ca1-28b2c2717f76 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:56.799294 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-7620ab5a-600c-4f5a-a884-d0c2eb093816 req-0d7303fb-34ce-4676-9ca1-28b2c2717f76 service nova] Creating event network-changed:75b54983-d107-4ad1-a9f9-b77effb39ba3 for instance 2332865a-7f64-4b42-bef6-75a5d7c6c77f on nch1-master-1 May 28 21:07:56.810931 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-7620ab5a-600c-4f5a-a884-d0c2eb093816 req-0d7303fb-34ce-4676-9ca1-28b2c2717f76 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084265 May 28 21:07:56.814389 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 755/1562] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:56.853886 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-685dc7ea-2081-43a0-811f-fd8cf0174aa3 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.648268 May 28 21:07:56.856939 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 808/1563] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:07:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1652 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 21:07:56.867622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-be41a4b1-3a90-41b5-8531-0ce424653f6a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:56.870745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-be41a4b1-3a90-41b5-8531-0ce424653f6a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:56.945085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-be41a4b1-3a90-41b5-8531-0ce424653f6a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:56.955557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-be41a4b1-3a90-41b5-8531-0ce424653f6a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:56.957421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-be41a4b1-3a90-41b5-8531-0ce424653f6a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:56.958993 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-be41a4b1-3a90-41b5-8531-0ce424653f6a tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1102 microversion: 2.25 time: 0.096094 May 28 21:07:56.960667 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 756/1564] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:07:56 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1102 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:07:57.203302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-014cd035-912f-4498-b3db-0dd341fae55e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:57.205261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-014cd035-912f-4498-b3db-0dd341fae55e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:57.214503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-014cd035-912f-4498-b3db-0dd341fae55e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:57.215621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-014cd035-912f-4498-b3db-0dd341fae55e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:57.217353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-014cd035-912f-4498-b3db-0dd341fae55e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:57.217904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-014cd035-912f-4498-b3db-0dd341fae55e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:57.378650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4b6fdad9-4050-4cde-b0ce-c1a5515b9495 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:57.379299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4b6fdad9-4050-4cde-b0ce-c1a5515b9495 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:57.420783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4b6fdad9-4050-4cde-b0ce-c1a5515b9495 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:57.422999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4b6fdad9-4050-4cde-b0ce-c1a5515b9495 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:57.423901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4b6fdad9-4050-4cde-b0ce-c1a5515b9495 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:57.429323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4b6fdad9-4050-4cde-b0ce-c1a5515b9495 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:57.535723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-014cd035-912f-4498-b3db-0dd341fae55e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:57.547630 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-014cd035-912f-4498-b3db-0dd341fae55e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.345773 May 28 21:07:57.548789 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 809/1565] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:57 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:57.562749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-904518927", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "153ab96f-260d-4085-99e8-0491f645a707"}], "block_device_mapping_v2": [{"uuid": "69bfe0ab-8925-40f5-bc39-33e09bf78a5e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:57.713575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] validate_networks() for [('153ab96f-260d-4085-99e8-0491f645a707', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:07:57.831434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4b6fdad9-4050-4cde-b0ce-c1a5515b9495 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:57.854780 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4b6fdad9-4050-4cde-b0ce-c1a5515b9495 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1350 microversion: 2.1 time: 0.485510 May 28 21:07:57.859888 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 757/1566] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:57 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1350 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:57.873828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-98a10b7f-255e-4c99-b62d-c54ba97a735f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:57.874707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-98a10b7f-255e-4c99-b62d-c54ba97a735f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:57.904303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98a10b7f-255e-4c99-b62d-c54ba97a735f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:57.905166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98a10b7f-255e-4c99-b62d-c54ba97a735f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:57.908359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98a10b7f-255e-4c99-b62d-c54ba97a735f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:57.912498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98a10b7f-255e-4c99-b62d-c54ba97a735f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:58.363347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-98a10b7f-255e-4c99-b62d-c54ba97a735f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:58.386016 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-98a10b7f-255e-4c99-b62d-c54ba97a735f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 200 len: 1308 microversion: 2.1 time: 0.520944 May 28 21:07:58.387260 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 758/1567] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:57 2022] GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 1308 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:58.399463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3f94cc9c-cb5c-434a-acbf-de2bc6ec7a0b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:58.399463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3f94cc9c-cb5c-434a-acbf-de2bc6ec7a0b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:58.412338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f94cc9c-cb5c-434a-acbf-de2bc6ec7a0b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:58.414222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f94cc9c-cb5c-434a-acbf-de2bc6ec7a0b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:58.415104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f94cc9c-cb5c-434a-acbf-de2bc6ec7a0b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:58.417816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f94cc9c-cb5c-434a-acbf-de2bc6ec7a0b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:58.429736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:07:58.430749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:07:58.431609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:07:58.432200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:07:58.432910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:07:58.444029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:58.444756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:58.445740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:58.446363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:58.469536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Getting quotas for project 2f5c3054461d4d07861a1685cfeba36a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:07:58.492666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Getting quotas for user 7b44b524592e4a57a26681767b9c4541 and project 2f5c3054461d4d07861a1685cfeba36a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:07:58.511327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3f94cc9c-cb5c-434a-acbf-de2bc6ec7a0b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:58.523320 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3f94cc9c-cb5c-434a-acbf-de2bc6ec7a0b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1211 microversion: 2.1 time: 0.133940 May 28 21:07:58.534582 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 759/1568] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:58 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1211 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:58.541635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-986554ba-45a0-4e84-a4eb-4b98b801a2d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:58.542664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-986554ba-45a0-4e84-a4eb-4b98b801a2d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:58.560652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-986554ba-45a0-4e84-a4eb-4b98b801a2d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:58.560652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-986554ba-45a0-4e84-a4eb-4b98b801a2d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:58.560652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-986554ba-45a0-4e84-a4eb-4b98b801a2d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:58.560652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-986554ba-45a0-4e84-a4eb-4b98b801a2d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:58.595448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:07:58.597891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69bfe0ab-8925-40f5-bc39-33e09bf78a5e',volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:07:58.684947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-986554ba-45a0-4e84-a4eb-4b98b801a2d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:58.697060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-986554ba-45a0-4e84-a4eb-4b98b801a2d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:58.698567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-986554ba-45a0-4e84-a4eb-4b98b801a2d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:58.699751 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-986554ba-45a0-4e84-a4eb-4b98b801a2d4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1183 microversion: 2.25 time: 0.163932 May 28 21:07:58.700326 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 760/1569] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:07:58 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:07:58.705732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-357dc6ea-1420-4601-a492-229fe00b0612 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:58.706396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-357dc6ea-1420-4601-a492-229fe00b0612 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:58.715138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-357dc6ea-1420-4601-a492-229fe00b0612 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:58.715612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-357dc6ea-1420-4601-a492-229fe00b0612 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:58.716399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-357dc6ea-1420-4601-a492-229fe00b0612 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:58.716839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-357dc6ea-1420-4601-a492-229fe00b0612 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:58.893458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-357dc6ea-1420-4601-a492-229fe00b0612 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:58.903143 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-357dc6ea-1420-4601-a492-229fe00b0612 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.201665 May 28 21:07:58.904245 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 761/1570] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:58 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:58.909037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d8dcfffe-a106-427f-9023-7f729aca28a2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:58.909788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d8dcfffe-a106-427f-9023-7f729aca28a2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:58.917699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8dcfffe-a106-427f-9023-7f729aca28a2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:58.918403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8dcfffe-a106-427f-9023-7f729aca28a2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:58.923144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8dcfffe-a106-427f-9023-7f729aca28a2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:58.923144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8dcfffe-a106-427f-9023-7f729aca28a2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:59.167133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d8dcfffe-a106-427f-9023-7f729aca28a2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:59.171447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:59.181259 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d8dcfffe-a106-427f-9023-7f729aca28a2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1350 microversion: 2.1 time: 0.275747 May 28 21:07:59.182208 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 762/1571] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:58 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1350 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:59.277138 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c815e37f-7eb2-420a-8c22-c2e4603c955f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.724970 May 28 21:07:59.280496 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 810/1572] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:07:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:07:59.290839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-84c3e6cc-dc03-4d6d-bf9d-e40de7fdfb1b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:59.294759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-84c3e6cc-dc03-4d6d-bf9d-e40de7fdfb1b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:59.301515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:59.385290 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-84c3e6cc-dc03-4d6d-bf9d-e40de7fdfb1b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:59.400537 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-84c3e6cc-dc03-4d6d-bf9d-e40de7fdfb1b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1052 microversion: 2.1 time: 0.108990 May 28 21:07:59.400756 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 763/1573] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:59 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1052 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:59.411935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ded69f1f-4451-4144-bdb7-8d7a8dda695e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:59.412830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ded69f1f-4451-4144-bdb7-8d7a8dda695e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:59.441125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ded69f1f-4451-4144-bdb7-8d7a8dda695e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:59.443844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ded69f1f-4451-4144-bdb7-8d7a8dda695e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:59.443844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ded69f1f-4451-4144-bdb7-8d7a8dda695e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:59.447841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ded69f1f-4451-4144-bdb7-8d7a8dda695e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:59.485498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:07:59.540718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2be99458-7ff7-4703-80d9-25fac36a29c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:59.541387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2be99458-7ff7-4703-80d9-25fac36a29c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:59.552300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2be99458-7ff7-4703-80d9-25fac36a29c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:59.559585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2be99458-7ff7-4703-80d9-25fac36a29c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:59.559585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2be99458-7ff7-4703-80d9-25fac36a29c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:59.559585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2be99458-7ff7-4703-80d9-25fac36a29c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:59.681496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2be99458-7ff7-4703-80d9-25fac36a29c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:59.690298 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2be99458-7ff7-4703-80d9-25fac36a29c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1267 microversion: 2.1 time: 0.153354 May 28 21:07:59.705223 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 764/1574] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:59 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:07:59.730120 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ded69f1f-4451-4144-bdb7-8d7a8dda695e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:07:59.738851 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ded69f1f-4451-4144-bdb7-8d7a8dda695e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 200 len: 1308 microversion: 2.1 time: 0.336691 May 28 21:07:59.739441 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 811/1575] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:59 2022] GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:07:59.744710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-6331b864-44ee-4af7-b706-a2d47b6c8dc6 req-5ffcb385-a3bd-4c1c-8d11-4d530681d475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f837cef-04b0-4491-8edf-c10423944be0", "name": "network-vif-plugged", "status": "completed", "tag": "f9af25ca-e630-49f5-9345-5a9075542855"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:59.753411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6331b864-44ee-4af7-b706-a2d47b6c8dc6 req-5ffcb385-a3bd-4c1c-8d11-4d530681d475 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:59.753888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6331b864-44ee-4af7-b706-a2d47b6c8dc6 req-5ffcb385-a3bd-4c1c-8d11-4d530681d475 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:59.765128 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-6331b864-44ee-4af7-b706-a2d47b6c8dc6 req-5ffcb385-a3bd-4c1c-8d11-4d530681d475 service nova] Creating event network-vif-plugged:f9af25ca-e630-49f5-9345-5a9075542855 for instance 1f837cef-04b0-4491-8edf-c10423944be0 on nch1-master-1 May 28 21:07:59.770981 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-6331b864-44ee-4af7-b706-a2d47b6c8dc6 req-5ffcb385-a3bd-4c1c-8d11-4d530681d475 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029896 May 28 21:07:59.771614 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 812/1576] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:59.776053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b04cf226-8ce0-4dfb-842a-fdb90f981ba1 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Action: 'create', calling method: .version_select at 0x7f4d64568280>, body: {"keypair": {"name": "tempest-keypair-1400624290", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSfHA4GO5PA9q6zL625SElRI4HoMX2XSzB5m4GBEnwRcEKP5qp36jQ1MqzSdRZCxk7JHuWsWgQmoHwEprdPnVrF1Y2IxPFLETtmjJSrtGTR8lH6sZ8s3IUkcgiN4g/tvA=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:59.777182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6e92e3a5-b6f4-47a5-86fd-56cda0c298f8 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e112d418-9504-4ab3-93ed-83997b63a15b"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:07:59.778386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6e92e3a5-b6f4-47a5-86fd-56cda0c298f8 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:59.785480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e92e3a5-b6f4-47a5-86fd-56cda0c298f8 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:59.785969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e92e3a5-b6f4-47a5-86fd-56cda0c298f8 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:59.786822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e92e3a5-b6f4-47a5-86fd-56cda0c298f8 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:59.787263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e92e3a5-b6f4-47a5-86fd-56cda0c298f8 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:59.791015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-b04cf226-8ce0-4dfb-842a-fdb90f981ba1 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Getting quotas for project cde8dbaabafe47dc9aca37d9ef370819. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:07:59.797160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-b04cf226-8ce0-4dfb-842a-fdb90f981ba1 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Getting quotas for user 121de134dc0c4e148d09ef9d764c29c6 and project cde8dbaabafe47dc9aca37d9ef370819. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:07:59.868713 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-6e92e3a5-b6f4-47a5-86fd-56cda0c298f8 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] HTTP exception thrown: Volume 24145737-05ed-4e3d-a8f0-4142412ddc07 could not be found. May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6e92e3a5-b6f4-47a5-86fd-56cda0c298f8 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] Request method failure captured: May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: request: PUT /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments/24145737-05ed-4e3d-a8f0-4142412ddc07 HTTP/1.1 May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 74 May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko8HleIkMAYJ16d7vAdhj4QnzfBFFf_fTQCqfw88CxDXBYP_IYtTeWSEp0FdaESD-B2-wHKs7wefAZNJsD5-MS1Eb4bc9QyQneILmPxnbPl3JNNPYvfuKJfBmxJA7DzkBoQKwhH53kByfhESVXpDpo4gEBTSNDGBIe2C1rtvAK9jhzw May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: dcf954165a95433eb89884d6dc4c7feb May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-VolumesAdminNegativeTest-956902144 May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:07:59.873602 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:07:59.879417 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_dcf954165a95433eb89884d6dc4c7feb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcf954165a95433eb89884d6dc4c7feb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/dcf954165a95433eb89884d6dc4c7feb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/dcf954165a95433eb89884d6dc4c7feb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:07:59.879417 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-VolumesAdminNegativeTest-956902144 May 28 21:07:59.879417 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: dcf954165a95433eb89884d6dc4c7feb May 28 21:07:59.879417 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-956902144 May 28 21:07:59.879417 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-VolumesAdminNegativeTest-956902144-project-admin May 28 21:07:59.879417 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:07:59.879417 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:07:59.879417 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 3b3b0064f12e43cd8069165fe4c370bc May 28 21:07:59.879417 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-VolumesAdminNegativeTest-956902144-project-admin May 28 21:07:59.879417 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:07:59.879417 ncdv-master-1 devstack@n-api.service[143128]: {"volumeAttachment": {"volumeId": "e112d418-9504-4ab3-93ed-83997b63a15b"}} May 28 21:07:59.879417 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:07:59.879417 ncdv-master-1 devstack@n-api.service[143128]: exception: Volume 24145737-05ed-4e3d-a8f0-4142412ddc07 could not be found. May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'server_id': '688d4d8f-9b8f-4201-909c-8e3627dd1711', 'id': '24145737-05ed-4e3d-a8f0-4142412ddc07', 'body': {'volumeAttachment': {'volumeId': 'e112d418-9504-4ab3-93ed-83997b63a15b'}}} May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:07:59.880615 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 24145737-05ed-4e3d-a8f0-4142412ddc07 could not be found. (HTTP 404) (Request-ID: req-436d5134-2876-4883-8975-bbaa4d2a45cd) May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 21:07:59.881802 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 24145737-05ed-4e3d-a8f0-4142412ddc07 could not be found. May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:07:59.883232 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 24145737-05ed-4e3d-a8f0-4142412ddc07 could not be found. May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 24145737-05ed-4e3d-a8f0-4142412ddc07 could not be found. May 28 21:07:59.884624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:07:59.886130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6e92e3a5-b6f4-47a5-86fd-56cda0c298f8 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] Returning 404 to user: Volume 24145737-05ed-4e3d-a8f0-4142412ddc07 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:07:59.886130 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6e92e3a5-b6f4-47a5-86fd-56cda0c298f8 tempest-VolumesAdminNegativeTest-956902144 tempest-VolumesAdminNegativeTest-956902144-project-admin] 10.222.0.33 "PUT /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments/24145737-05ed-4e3d-a8f0-4142412ddc07" status: 404 len: 109 microversion: 2.1 time: 0.104609 May 28 21:07:59.890535 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 813/1577] 10.222.0.33 () {60 vars in 1432 bytes} [Sat May 28 21:07:59 2022] PUT /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711/os-volume_attachments/24145737-05ed-4e3d-a8f0-4142412ddc07 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:07:59.894754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b1877791-467c-4da6-99f7-bdd70b73d608 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:59.902376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b1877791-467c-4da6-99f7-bdd70b73d608 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:59.911959 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b04cf226-8ce0-4dfb-842a-fdb90f981ba1 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.218780 May 28 21:07:59.918190 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 765/1578] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:07:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:07:59.918898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b1877791-467c-4da6-99f7-bdd70b73d608 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:59.918898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b1877791-467c-4da6-99f7-bdd70b73d608 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:59.918898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b1877791-467c-4da6-99f7-bdd70b73d608 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:59.918898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b1877791-467c-4da6-99f7-bdd70b73d608 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:59.926772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ba4be35d-eb79-4de8-97a3-5458b6c03c51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:07:59.928347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ba4be35d-eb79-4de8-97a3-5458b6c03c51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:07:59.946995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba4be35d-eb79-4de8-97a3-5458b6c03c51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:59.947586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba4be35d-eb79-4de8-97a3-5458b6c03c51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:07:59.948600 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba4be35d-eb79-4de8-97a3-5458b6c03c51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:07:59.949113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba4be35d-eb79-4de8-97a3-5458b6c03c51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:00.057538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b1877791-467c-4da6-99f7-bdd70b73d608 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:00.082312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b1877791-467c-4da6-99f7-bdd70b73d608 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:00.088798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b1877791-467c-4da6-99f7-bdd70b73d608 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:00.092734 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b1877791-467c-4da6-99f7-bdd70b73d608 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1231 microversion: 2.25 time: 0.203516 May 28 21:08:00.093322 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 814/1579] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:07:59 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1231 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:00.207841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5bd4d9c2-abd7-4881-8661-b1768cb5b8ff tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:00.208443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5bd4d9c2-abd7-4881-8661-b1768cb5b8ff tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:00.223143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bd4d9c2-abd7-4881-8661-b1768cb5b8ff tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:00.223823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bd4d9c2-abd7-4881-8661-b1768cb5b8ff tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:00.226275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bd4d9c2-abd7-4881-8661-b1768cb5b8ff tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:00.229050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bd4d9c2-abd7-4881-8661-b1768cb5b8ff tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:00.373633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ba4be35d-eb79-4de8-97a3-5458b6c03c51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:00.384590 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ba4be35d-eb79-4de8-97a3-5458b6c03c51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.467352 May 28 21:08:00.387491 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 766/1580] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:07:59 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:00.419536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ff3d0f47-8d68-41bd-b490-8d41ca132002 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:00.420186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ff3d0f47-8d68-41bd-b490-8d41ca132002 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:00.536179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ff3d0f47-8d68-41bd-b490-8d41ca132002 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:00.544775 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ff3d0f47-8d68-41bd-b490-8d41ca132002 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1052 microversion: 2.1 time: 0.131732 May 28 21:08:00.548437 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 767/1581] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:00 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1052 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:00.559477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5bd4d9c2-abd7-4881-8661-b1768cb5b8ff tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:00.570530 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5bd4d9c2-abd7-4881-8661-b1768cb5b8ff tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1350 microversion: 2.1 time: 0.373544 May 28 21:08:00.582085 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 815/1582] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:00 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1350 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:00.714029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d80453f6-5181-4292-8313-a9ec462fe6a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:00.714663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d80453f6-5181-4292-8313-a9ec462fe6a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:00.724854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d80453f6-5181-4292-8313-a9ec462fe6a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:00.725506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d80453f6-5181-4292-8313-a9ec462fe6a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:00.729995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d80453f6-5181-4292-8313-a9ec462fe6a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:00.729995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d80453f6-5181-4292-8313-a9ec462fe6a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:00.759113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-19abbbdb-94bd-49b6-9b6e-f3205a22f7cc tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:00.759950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-19abbbdb-94bd-49b6-9b6e-f3205a22f7cc tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:00.769438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19abbbdb-94bd-49b6-9b6e-f3205a22f7cc tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:00.770305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19abbbdb-94bd-49b6-9b6e-f3205a22f7cc tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:00.771329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19abbbdb-94bd-49b6-9b6e-f3205a22f7cc tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:00.771956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19abbbdb-94bd-49b6-9b6e-f3205a22f7cc tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:00.984520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d80453f6-5181-4292-8313-a9ec462fe6a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:00.994608 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d80453f6-5181-4292-8313-a9ec462fe6a6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1273 microversion: 2.1 time: 0.285385 May 28 21:08:00.995201 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 768/1583] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:00 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1273 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:01.106194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-19abbbdb-94bd-49b6-9b6e-f3205a22f7cc tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:01.114880 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-19abbbdb-94bd-49b6-9b6e-f3205a22f7cc tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 200 len: 1308 microversion: 2.1 time: 0.362598 May 28 21:08:01.115823 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 816/1584] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:00 2022] GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 1308 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:01.117998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e3a3224a-e433-4b5d-8fb6-a4786a8a5393 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:01.118628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e3a3224a-e433-4b5d-8fb6-a4786a8a5393 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:01.132126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3a3224a-e433-4b5d-8fb6-a4786a8a5393 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:01.134754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3a3224a-e433-4b5d-8fb6-a4786a8a5393 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:01.137287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3a3224a-e433-4b5d-8fb6-a4786a8a5393 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:01.137797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3a3224a-e433-4b5d-8fb6-a4786a8a5393 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:01.260802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e3a3224a-e433-4b5d-8fb6-a4786a8a5393 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:01.272520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e3a3224a-e433-4b5d-8fb6-a4786a8a5393 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:01.278965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e3a3224a-e433-4b5d-8fb6-a4786a8a5393 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:01.288505 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e3a3224a-e433-4b5d-8fb6-a4786a8a5393 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1249 microversion: 2.25 time: 0.178131 May 28 21:08:01.304580 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 769/1585] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:01 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1249 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:08:01.416089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ecd51da3-1da3-4366-8a63-0f5bce8d9ab5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:01.417772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ecd51da3-1da3-4366-8a63-0f5bce8d9ab5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:01.426791 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecd51da3-1da3-4366-8a63-0f5bce8d9ab5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:01.428451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecd51da3-1da3-4366-8a63-0f5bce8d9ab5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:01.429505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecd51da3-1da3-4366-8a63-0f5bce8d9ab5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:01.430409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecd51da3-1da3-4366-8a63-0f5bce8d9ab5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:01.563387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f11ccf82-ba89-424a-8b3d-da69b0136702 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:01.564918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f11ccf82-ba89-424a-8b3d-da69b0136702 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:01.571378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f11ccf82-ba89-424a-8b3d-da69b0136702 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:01.571820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f11ccf82-ba89-424a-8b3d-da69b0136702 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:01.581079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f11ccf82-ba89-424a-8b3d-da69b0136702 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:01.590028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f11ccf82-ba89-424a-8b3d-da69b0136702 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:01.685298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ecd51da3-1da3-4366-8a63-0f5bce8d9ab5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:01.699138 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ecd51da3-1da3-4366-8a63-0f5bce8d9ab5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.297392 May 28 21:08:01.707333 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 817/1586] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:01 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:01.716579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-751517b3-bfef-4134-8156-6c1fe55ac310 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:01.719843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-751517b3-bfef-4134-8156-6c1fe55ac310 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:01.740752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-751517b3-bfef-4134-8156-6c1fe55ac310 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:01.741748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-751517b3-bfef-4134-8156-6c1fe55ac310 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:01.742635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-751517b3-bfef-4134-8156-6c1fe55ac310 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:01.743080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-751517b3-bfef-4134-8156-6c1fe55ac310 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:01.769766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f11ccf82-ba89-424a-8b3d-da69b0136702 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:01.779952 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f11ccf82-ba89-424a-8b3d-da69b0136702 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1094 microversion: 2.1 time: 0.220663 May 28 21:08:01.780829 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 770/1587] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:01 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1094 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:01.972097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-751517b3-bfef-4134-8156-6c1fe55ac310 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:02.002910 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-751517b3-bfef-4134-8156-6c1fe55ac310 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1350 microversion: 2.1 time: 0.296589 May 28 21:08:02.004048 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 818/1588] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:01 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1350 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:02.013475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7c868c47-9afb-4d1f-8086-e5389102c502 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:02.014139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7c868c47-9afb-4d1f-8086-e5389102c502 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:02.042547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c868c47-9afb-4d1f-8086-e5389102c502 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:02.043050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c868c47-9afb-4d1f-8086-e5389102c502 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:02.044149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c868c47-9afb-4d1f-8086-e5389102c502 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:02.050314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c868c47-9afb-4d1f-8086-e5389102c502 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:02.132775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-586f683b-36e5-466e-a48d-cd6cf7298773 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:02.133398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-586f683b-36e5-466e-a48d-cd6cf7298773 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:02.159283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-586f683b-36e5-466e-a48d-cd6cf7298773 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:02.159823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-586f683b-36e5-466e-a48d-cd6cf7298773 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:02.160756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-586f683b-36e5-466e-a48d-cd6cf7298773 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:02.161319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-586f683b-36e5-466e-a48d-cd6cf7298773 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:02.186570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7c868c47-9afb-4d1f-8086-e5389102c502 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:02.195502 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7c868c47-9afb-4d1f-8086-e5389102c502 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1273 microversion: 2.1 time: 0.185767 May 28 21:08:02.196720 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 771/1589] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:02 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:02.312060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ef05d176-2586-418f-ba1b-e74f138d23c0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:02.314507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ef05d176-2586-418f-ba1b-e74f138d23c0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:02.326487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef05d176-2586-418f-ba1b-e74f138d23c0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:02.328409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef05d176-2586-418f-ba1b-e74f138d23c0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:02.329347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef05d176-2586-418f-ba1b-e74f138d23c0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:02.330000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef05d176-2586-418f-ba1b-e74f138d23c0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:02.663560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-586f683b-36e5-466e-a48d-cd6cf7298773 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:02.685830 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-586f683b-36e5-466e-a48d-cd6cf7298773 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 200 len: 1489 microversion: 2.1 time: 0.556908 May 28 21:08:02.688111 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 819/1590] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:02 2022] GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 1489 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:02.705701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ef05d176-2586-418f-ba1b-e74f138d23c0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:02.710645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-931516dc-fddd-4e4c-b4a4-edc73e326072 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:02.711182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-931516dc-fddd-4e4c-b4a4-edc73e326072 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:02.721442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ef05d176-2586-418f-ba1b-e74f138d23c0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:02.723884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ef05d176-2586-418f-ba1b-e74f138d23c0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:02.725107 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ef05d176-2586-418f-ba1b-e74f138d23c0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1291 microversion: 2.25 time: 0.418339 May 28 21:08:02.725687 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 772/1591] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:02 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1291 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:08:02.731052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-931516dc-fddd-4e4c-b4a4-edc73e326072 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:02.731511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-931516dc-fddd-4e4c-b4a4-edc73e326072 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:02.735210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-931516dc-fddd-4e4c-b4a4-edc73e326072 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:02.738860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-931516dc-fddd-4e4c-b4a4-edc73e326072 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:02.747817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e13eea33-a878-46cc-9783-59035c36f337 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:02.756715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e13eea33-a878-46cc-9783-59035c36f337 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:02.775622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e13eea33-a878-46cc-9783-59035c36f337 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:02.776094 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e13eea33-a878-46cc-9783-59035c36f337 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:02.777610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e13eea33-a878-46cc-9783-59035c36f337 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:02.779819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e13eea33-a878-46cc-9783-59035c36f337 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:03.126286 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-931516dc-fddd-4e4c-b4a4-edc73e326072 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "POST /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0/action" status: 202 len: 0 microversion: 2.1 time: 0.421906 May 28 21:08:03.127746 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 820/1592] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:08:02 2022] POST /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:08:03.140322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-405cf599-06e8-4e8e-9178-d923c4f7364e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:03.143673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-405cf599-06e8-4e8e-9178-d923c4f7364e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:03.159432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-405cf599-06e8-4e8e-9178-d923c4f7364e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:03.160155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-405cf599-06e8-4e8e-9178-d923c4f7364e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:03.163590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-405cf599-06e8-4e8e-9178-d923c4f7364e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:03.164320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-405cf599-06e8-4e8e-9178-d923c4f7364e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:03.179323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e13eea33-a878-46cc-9783-59035c36f337 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:03.188983 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e13eea33-a878-46cc-9783-59035c36f337 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.449012 May 28 21:08:03.200616 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 773/1593] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:02 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:03.210407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bdb55ed3-dcd7-4120-9a53-1197f3ede60a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:03.211562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bdb55ed3-dcd7-4120-9a53-1197f3ede60a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:03.237777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bdb55ed3-dcd7-4120-9a53-1197f3ede60a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:03.240549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bdb55ed3-dcd7-4120-9a53-1197f3ede60a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:03.244397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bdb55ed3-dcd7-4120-9a53-1197f3ede60a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:03.249180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bdb55ed3-dcd7-4120-9a53-1197f3ede60a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:03.544963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-405cf599-06e8-4e8e-9178-d923c4f7364e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:03.556311 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-405cf599-06e8-4e8e-9178-d923c4f7364e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1168 microversion: 2.1 time: 0.427157 May 28 21:08:03.562569 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 821/1594] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:03 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1168 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:03.585854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-629f3bd1-048d-4a2e-8535-5cdad5357b20 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:03.586949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-629f3bd1-048d-4a2e-8535-5cdad5357b20 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:03.616870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-629f3bd1-048d-4a2e-8535-5cdad5357b20 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:03.617615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-629f3bd1-048d-4a2e-8535-5cdad5357b20 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:03.622194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-629f3bd1-048d-4a2e-8535-5cdad5357b20 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:03.622898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-629f3bd1-048d-4a2e-8535-5cdad5357b20 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:03.812545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bdb55ed3-dcd7-4120-9a53-1197f3ede60a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:03.846184 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bdb55ed3-dcd7-4120-9a53-1197f3ede60a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1350 microversion: 2.1 time: 0.633034 May 28 21:08:03.846184 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 774/1595] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:03 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1350 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:03.850295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c30bff5f-5425-401f-a851-9a055362a4e0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:03.850981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c30bff5f-5425-401f-a851-9a055362a4e0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:03.859442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c30bff5f-5425-401f-a851-9a055362a4e0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:03.859904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c30bff5f-5425-401f-a851-9a055362a4e0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:03.861296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c30bff5f-5425-401f-a851-9a055362a4e0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:03.869332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c30bff5f-5425-401f-a851-9a055362a4e0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:03.963117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-629f3bd1-048d-4a2e-8535-5cdad5357b20 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:03.972878 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-629f3bd1-048d-4a2e-8535-5cdad5357b20 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 200 len: 1474 microversion: 2.1 time: 0.409089 May 28 21:08:03.976751 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 822/1596] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:03 2022] GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 1474 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:03.993999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8529c6c4-3395-419f-9a6d-7f8dd8cbaa2d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:03.999007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8529c6c4-3395-419f-9a6d-7f8dd8cbaa2d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:04.008896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:04.013252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8529c6c4-3395-419f-9a6d-7f8dd8cbaa2d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:04.015371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8529c6c4-3395-419f-9a6d-7f8dd8cbaa2d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:04.021857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8529c6c4-3395-419f-9a6d-7f8dd8cbaa2d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:04.021857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8529c6c4-3395-419f-9a6d-7f8dd8cbaa2d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:04.683468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8529c6c4-3395-419f-9a6d-7f8dd8cbaa2d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:04.707019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8529c6c4-3395-419f-9a6d-7f8dd8cbaa2d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:04.708724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8529c6c4-3395-419f-9a6d-7f8dd8cbaa2d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:04.709817 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8529c6c4-3395-419f-9a6d-7f8dd8cbaa2d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1279 microversion: 2.25 time: 0.731856 May 28 21:08:04.710430 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 823/1597] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:03 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1279 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:04.721737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5d97f738-c15b-4787-a8fa-2dbaee39e4a5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-784497348"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:04.724717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5d97f738-c15b-4787-a8fa-2dbaee39e4a5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:04.742703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d97f738-c15b-4787-a8fa-2dbaee39e4a5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:04.744819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d97f738-c15b-4787-a8fa-2dbaee39e4a5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:04.748862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d97f738-c15b-4787-a8fa-2dbaee39e4a5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:04.749660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d97f738-c15b-4787-a8fa-2dbaee39e4a5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:04.758402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c30bff5f-5425-401f-a851-9a055362a4e0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:04.769635 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c30bff5f-5425-401f-a851-9a055362a4e0 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1315 microversion: 2.1 time: 0.932368 May 28 21:08:04.770386 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 775/1598] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:03 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1315 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:04.777120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-19fdd0e0-8ea1-4ee8-82f7-69ddf6d6fbcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:04.778506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-19fdd0e0-8ea1-4ee8-82f7-69ddf6d6fbcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:04.792519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19fdd0e0-8ea1-4ee8-82f7-69ddf6d6fbcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:04.793521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19fdd0e0-8ea1-4ee8-82f7-69ddf6d6fbcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:04.794728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19fdd0e0-8ea1-4ee8-82f7-69ddf6d6fbcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:04.796389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19fdd0e0-8ea1-4ee8-82f7-69ddf6d6fbcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:05.034414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-19fdd0e0-8ea1-4ee8-82f7-69ddf6d6fbcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:05.046199 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-19fdd0e0-8ea1-4ee8-82f7-69ddf6d6fbcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.272698 May 28 21:08:05.048105 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 776/1599] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:04 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:05.068606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a3a33808-e46f-4c14-9f67-e59b555dc45a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:05.069598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a3a33808-e46f-4c14-9f67-e59b555dc45a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:05.084953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3a33808-e46f-4c14-9f67-e59b555dc45a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:05.089028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3a33808-e46f-4c14-9f67-e59b555dc45a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:05.091934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3a33808-e46f-4c14-9f67-e59b555dc45a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:05.092607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3a33808-e46f-4c14-9f67-e59b555dc45a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:05.356257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a3a33808-e46f-4c14-9f67-e59b555dc45a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:05.364681 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a3a33808-e46f-4c14-9f67-e59b555dc45a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1210 microversion: 2.1 time: 0.315357 May 28 21:08:05.381458 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 777/1600] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:05 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1210 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:05.381458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-76e46c35-a000-4f87-af05-691eaa81702a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:05.381458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-76e46c35-a000-4f87-af05-691eaa81702a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:05.385074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76e46c35-a000-4f87-af05-691eaa81702a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:05.385534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76e46c35-a000-4f87-af05-691eaa81702a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:05.386375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76e46c35-a000-4f87-af05-691eaa81702a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:05.386873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76e46c35-a000-4f87-af05-691eaa81702a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:05.504402 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5d97f738-c15b-4787-a8fa-2dbaee39e4a5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "POST /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0/action" status: 202 len: 0 microversion: 2.1 time: 0.792672 May 28 21:08:05.509752 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 824/1601] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:08:04 2022] POST /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0/action => generated 0 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 21:08:05.512350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:05.523296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-933386899", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e237e3fe-ab0b-4a71-955f-80dd33fe865b"}], "security_groups": [{"name": "tempest-securitygroup--756429918"}], "key_name": "tempest-keypair-1400624290", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:05.573246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-76e46c35-a000-4f87-af05-691eaa81702a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:05.601122 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-76e46c35-a000-4f87-af05-691eaa81702a tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1350 microversion: 2.1 time: 0.227308 May 28 21:08:05.603847 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 778/1602] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:05 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1350 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:05.608409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9edec339-8af5-4755-9531-8cd10d5652b3 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d57f3f3a0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:05.695496 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9edec339-8af5-4755-9531-8cd10d5652b3 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1411 microversion: 2.1 time: 0.090615 May 28 21:08:05.696099 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 779/1603] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:05 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1411 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:05.708787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] validate_networks() for [('e237e3fe-ab0b-4a71-955f-80dd33fe865b', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:08:05.731061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-702d6ac7-f739-470e-800c-21ff01640b8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:05.731061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-702d6ac7-f739-470e-800c-21ff01640b8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:05.748954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-702d6ac7-f739-470e-800c-21ff01640b8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:05.749466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-702d6ac7-f739-470e-800c-21ff01640b8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:05.750246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-702d6ac7-f739-470e-800c-21ff01640b8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:05.750696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-702d6ac7-f739-470e-800c-21ff01640b8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:06.470587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-702d6ac7-f739-470e-800c-21ff01640b8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:06.481076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-702d6ac7-f739-470e-800c-21ff01640b8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:06.483040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-702d6ac7-f739-470e-800c-21ff01640b8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:06.495506 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-702d6ac7-f739-470e-800c-21ff01640b8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1279 microversion: 2.25 time: 0.763536 May 28 21:08:06.507568 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 780/1604] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:05 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1279 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:06.515471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5da56e7c-b991-4ab7-af19-3db23d6e1e7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:06.516103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5da56e7c-b991-4ab7-af19-3db23d6e1e7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:06.523004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5da56e7c-b991-4ab7-af19-3db23d6e1e7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:06.523711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5da56e7c-b991-4ab7-af19-3db23d6e1e7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:06.524728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5da56e7c-b991-4ab7-af19-3db23d6e1e7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:06.525414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5da56e7c-b991-4ab7-af19-3db23d6e1e7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:06.735908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5da56e7c-b991-4ab7-af19-3db23d6e1e7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:06.749514 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5da56e7c-b991-4ab7-af19-3db23d6e1e7e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1315 microversion: 2.1 time: 0.239637 May 28 21:08:06.761148 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 781/1605] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:06 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:06.766753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-0f2acafb-df4f-4e03-bf36-6e0bba3553cd req-996a91d7-3c18-4d4c-a372-652a7f172af4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2332865a-7f64-4b42-bef6-75a5d7c6c77f", "name": "network-vif-plugged", "status": "completed", "tag": "75b54983-d107-4ad1-a9f9-b77effb39ba3"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:06.775691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0f2acafb-df4f-4e03-bf36-6e0bba3553cd req-996a91d7-3c18-4d4c-a372-652a7f172af4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:06.776376 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0f2acafb-df4f-4e03-bf36-6e0bba3553cd req-996a91d7-3c18-4d4c-a372-652a7f172af4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:06.795159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Getting quotas for project cde8dbaabafe47dc9aca37d9ef370819. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:08:06.800955 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-0f2acafb-df4f-4e03-bf36-6e0bba3553cd req-996a91d7-3c18-4d4c-a372-652a7f172af4 service nova] Creating event network-vif-plugged:75b54983-d107-4ad1-a9f9-b77effb39ba3 for instance 2332865a-7f64-4b42-bef6-75a5d7c6c77f on nch1-master-1 May 28 21:08:06.801796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Getting quotas for user 121de134dc0c4e148d09ef9d764c29c6 and project cde8dbaabafe47dc9aca37d9ef370819. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:08:06.807534 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-0f2acafb-df4f-4e03-bf36-6e0bba3553cd req-996a91d7-3c18-4d4c-a372-652a7f172af4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044709 May 28 21:08:06.810008 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 782/1606] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:06.819703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-e6c32ba5-d311-4fe2-ad35-78d128102923 req-6885194c-827c-4654-b789-36daea4e52b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1", "tag": "5af24189-413e-4d8f-814a-44d91619c0c7"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:06.830302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e6c32ba5-d311-4fe2-ad35-78d128102923 req-6885194c-827c-4654-b789-36daea4e52b5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:06.831369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e6c32ba5-d311-4fe2-ad35-78d128102923 req-6885194c-827c-4654-b789-36daea4e52b5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:06.832830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:08:06.833609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:08:06.834385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:08:06.836599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:08:06.847986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:08:06.848216 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e6c32ba5-d311-4fe2-ad35-78d128102923 req-6885194c-827c-4654-b789-36daea4e52b5 service nova] Creating event network-changed:5af24189-413e-4d8f-814a-44d91619c0c7 for instance 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 on nch1-master-1 May 28 21:08:06.853909 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-e6c32ba5-d311-4fe2-ad35-78d128102923 req-6885194c-827c-4654-b789-36daea4e52b5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039958 May 28 21:08:06.855165 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 783/1607] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:06.863532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-09c3f70c-a068-44e0-971b-e1825b363d52 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:06.865126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-09c3f70c-a068-44e0-971b-e1825b363d52 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:06.874922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-09c3f70c-a068-44e0-971b-e1825b363d52 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:06.875392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-09c3f70c-a068-44e0-971b-e1825b363d52 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:06.876248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:06.876564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:06.876802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-09c3f70c-a068-44e0-971b-e1825b363d52 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:06.877255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-09c3f70c-a068-44e0-971b-e1825b363d52 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:06.877606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:06.878143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:06.903070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Getting quotas for project cde8dbaabafe47dc9aca37d9ef370819. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:08:06.911022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Getting quotas for user 121de134dc0c4e148d09ef9d764c29c6 and project cde8dbaabafe47dc9aca37d9ef370819. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:08:06.927011 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:08:06.929792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:08:07.109506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-09c3f70c-a068-44e0-971b-e1825b363d52 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:07.116946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:07.124491 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-595f2d52-5d14-4a67-bb7a-cc7f88ca0831 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.617267 May 28 21:08:07.127066 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 825/1608] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:08:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:08:07.127191 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-09c3f70c-a068-44e0-971b-e1825b363d52 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.268710 May 28 21:08:07.138687 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 784/1609] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:06 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:07.144114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ce4e792-cfa0-4723-b720-5e2b81d325d3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:07.146310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4c8f6276-b64b-4036-a085-7f1a1ba5dbfd tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:07.147808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4c8f6276-b64b-4036-a085-7f1a1ba5dbfd tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:07.148201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8ce4e792-cfa0-4723-b720-5e2b81d325d3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:07.159022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ce4e792-cfa0-4723-b720-5e2b81d325d3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:07.161605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ce4e792-cfa0-4723-b720-5e2b81d325d3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:07.162408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ce4e792-cfa0-4723-b720-5e2b81d325d3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:07.163583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ce4e792-cfa0-4723-b720-5e2b81d325d3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:07.174420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c8f6276-b64b-4036-a085-7f1a1ba5dbfd tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:07.175761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c8f6276-b64b-4036-a085-7f1a1ba5dbfd tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:07.177722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c8f6276-b64b-4036-a085-7f1a1ba5dbfd tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:07.178417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c8f6276-b64b-4036-a085-7f1a1ba5dbfd tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:07.476879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4c8f6276-b64b-4036-a085-7f1a1ba5dbfd tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:07.486332 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4c8f6276-b64b-4036-a085-7f1a1ba5dbfd tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1350 microversion: 2.1 time: 0.345616 May 28 21:08:07.487401 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 785/1610] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:07 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1350 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:07.492840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-90600bb7-8fc2-41b0-9b7e-2dcff3ed3572 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d57e8eaf0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:07.551058 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-90600bb7-8fc2-41b0-9b7e-2dcff3ed3572 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1411 microversion: 2.1 time: 0.062390 May 28 21:08:07.552860 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 786/1611] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:07 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:07.557381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8ce4e792-cfa0-4723-b720-5e2b81d325d3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:07.561896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-63f8efa4-9b7e-433c-a935-e3381829669f tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:07.561896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-63f8efa4-9b7e-433c-a935-e3381829669f tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:07.566614 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8ce4e792-cfa0-4723-b720-5e2b81d325d3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1198 microversion: 2.1 time: 0.432761 May 28 21:08:07.571166 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 826/1612] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:07 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1198 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:07.575996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-78f943be-c6fa-40dd-861a-6e7f314a1fce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:07.576798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-78f943be-c6fa-40dd-861a-6e7f314a1fce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:07.584172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78f943be-c6fa-40dd-861a-6e7f314a1fce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:07.584811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78f943be-c6fa-40dd-861a-6e7f314a1fce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:07.585779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78f943be-c6fa-40dd-861a-6e7f314a1fce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:07.586403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78f943be-c6fa-40dd-861a-6e7f314a1fce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:07.602825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:07.640742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-63f8efa4-9b7e-433c-a935-e3381829669f tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:07.643149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=41 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:07.649289 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-63f8efa4-9b7e-433c-a935-e3381829669f tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1269 microversion: 2.1 time: 0.094757 May 28 21:08:07.650274 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 787/1613] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:07 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1269 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:07.749206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-78f943be-c6fa-40dd-861a-6e7f314a1fce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:07.757718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-78f943be-c6fa-40dd-861a-6e7f314a1fce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:07.759472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-78f943be-c6fa-40dd-861a-6e7f314a1fce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:07.760612 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-78f943be-c6fa-40dd-861a-6e7f314a1fce tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1279 microversion: 2.25 time: 0.188436 May 28 21:08:07.768973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2988be95-346d-4a52-89d8-424016254610 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:07.770241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2988be95-346d-4a52-89d8-424016254610 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:07.775654 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 827/1614] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:07 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1279 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:07.779794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2988be95-346d-4a52-89d8-424016254610 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:07.780257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2988be95-346d-4a52-89d8-424016254610 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:07.781210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2988be95-346d-4a52-89d8-424016254610 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:07.781567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2988be95-346d-4a52-89d8-424016254610 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:07.914074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2988be95-346d-4a52-89d8-424016254610 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:07.923352 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2988be95-346d-4a52-89d8-424016254610 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1315 microversion: 2.1 time: 0.158431 May 28 21:08:07.924150 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 788/1615] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:07 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:08.144518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d0bb4175-f04b-4c8b-9c56-6d0d04dea463 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:08.147165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d0bb4175-f04b-4c8b-9c56-6d0d04dea463 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:08.152255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0bb4175-f04b-4c8b-9c56-6d0d04dea463 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:08.152743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0bb4175-f04b-4c8b-9c56-6d0d04dea463 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:08.153507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0bb4175-f04b-4c8b-9c56-6d0d04dea463 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:08.153968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0bb4175-f04b-4c8b-9c56-6d0d04dea463 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:08.298266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d0bb4175-f04b-4c8b-9c56-6d0d04dea463 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:08.305729 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d0bb4175-f04b-4c8b-9c56-6d0d04dea463 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.166144 May 28 21:08:08.306405 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 828/1616] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:08 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:08.505159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0ab2ef72-9f68-42f5-8c38-f17828a94342 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:08.505811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0ab2ef72-9f68-42f5-8c38-f17828a94342 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:08.514283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ab2ef72-9f68-42f5-8c38-f17828a94342 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:08.514732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ab2ef72-9f68-42f5-8c38-f17828a94342 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:08.515548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ab2ef72-9f68-42f5-8c38-f17828a94342 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:08.515987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ab2ef72-9f68-42f5-8c38-f17828a94342 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:08.569414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-18aefd2d-86f3-4ac3-b7f5-e9c19585181b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d69c7bdc0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:08.619855 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-18aefd2d-86f3-4ac3-b7f5-e9c19585181b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1411 microversion: 2.1 time: 0.054303 May 28 21:08:08.620828 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 829/1617] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:08 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1411 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:08.625371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-52fed506-83f9-46b9-9aaa-00fb2c834f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:08.626814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-52fed506-83f9-46b9-9aaa-00fb2c834f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:08.633358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52fed506-83f9-46b9-9aaa-00fb2c834f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:08.634376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52fed506-83f9-46b9-9aaa-00fb2c834f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:08.634921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52fed506-83f9-46b9-9aaa-00fb2c834f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:08.635510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52fed506-83f9-46b9-9aaa-00fb2c834f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:08.664224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0ab2ef72-9f68-42f5-8c38-f17828a94342 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:08.672101 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0ab2ef72-9f68-42f5-8c38-f17828a94342 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1350 microversion: 2.1 time: 0.171808 May 28 21:08:08.672683 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 789/1618] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:08 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1350 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:08.677110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d95fbb2e-e53a-4dc5-8a20-5fa802cdcf77 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:08.680164 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d95fbb2e-e53a-4dc5-8a20-5fa802cdcf77 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:08.683759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d95fbb2e-e53a-4dc5-8a20-5fa802cdcf77 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:08.684216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d95fbb2e-e53a-4dc5-8a20-5fa802cdcf77 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:08.684993 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d95fbb2e-e53a-4dc5-8a20-5fa802cdcf77 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:08.685437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d95fbb2e-e53a-4dc5-8a20-5fa802cdcf77 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:08.764610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d95fbb2e-e53a-4dc5-8a20-5fa802cdcf77 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:08.772852 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d95fbb2e-e53a-4dc5-8a20-5fa802cdcf77 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1273 microversion: 2.1 time: 0.099150 May 28 21:08:08.773723 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 790/1619] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:08 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:08.778262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-66739e4e-70f9-4082-8118-3da2f9e35232 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:08.778875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-66739e4e-70f9-4082-8118-3da2f9e35232 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:08.785178 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66739e4e-70f9-4082-8118-3da2f9e35232 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:08.785641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66739e4e-70f9-4082-8118-3da2f9e35232 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:08.786502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66739e4e-70f9-4082-8118-3da2f9e35232 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:08.786950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66739e4e-70f9-4082-8118-3da2f9e35232 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:08.800469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-52fed506-83f9-46b9-9aaa-00fb2c834f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:08.808755 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-52fed506-83f9-46b9-9aaa-00fb2c834f36 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1198 microversion: 2.1 time: 0.186793 May 28 21:08:08.809585 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 830/1620] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:08 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1198 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:08.870821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-b881798f-9dd1-43eb-9833-01f0494ac761 req-bbc488cf-3198-44dd-8333-95b3510522c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86838d0c-e2da-4d31-92e8-94fd9b6345a6", "tag": "90dbd5de-6ef5-4258-8dc2-8e5a1f5600b0"}, {"name": "network-changed", "server_uuid": "7f0a48ef-bb58-4c86-82af-49c2023e022e", "tag": "883b584c-6f2d-4a9a-8b63-5dee79943508"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:08.881815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b881798f-9dd1-43eb-9833-01f0494ac761 req-bbc488cf-3198-44dd-8333-95b3510522c0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:08.882617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b881798f-9dd1-43eb-9833-01f0494ac761 req-bbc488cf-3198-44dd-8333-95b3510522c0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:08.897613 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-b881798f-9dd1-43eb-9833-01f0494ac761 req-bbc488cf-3198-44dd-8333-95b3510522c0 service nova] Creating event network-changed:90dbd5de-6ef5-4258-8dc2-8e5a1f5600b0 for instance 86838d0c-e2da-4d31-92e8-94fd9b6345a6 on nch1-master-1 May 28 21:08:08.898161 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-b881798f-9dd1-43eb-9833-01f0494ac761 req-bbc488cf-3198-44dd-8333-95b3510522c0 service nova] Creating event network-changed:883b584c-6f2d-4a9a-8b63-5dee79943508 for instance 7f0a48ef-bb58-4c86-82af-49c2023e022e on nch1-master-1 May 28 21:08:08.904917 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-b881798f-9dd1-43eb-9833-01f0494ac761 req-bbc488cf-3198-44dd-8333-95b3510522c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038450 May 28 21:08:08.905799 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 831/1621] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:08:08.929265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-66739e4e-70f9-4082-8118-3da2f9e35232 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:08.937550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-66739e4e-70f9-4082-8118-3da2f9e35232 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:08.939773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-66739e4e-70f9-4082-8118-3da2f9e35232 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:08.940886 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-66739e4e-70f9-4082-8118-3da2f9e35232 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1279 microversion: 2.25 time: 0.166209 May 28 21:08:08.941449 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 791/1622] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:08 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1279 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:08.941568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-90666674-c856-40f6-b9f8-f2a95cd80420 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:08.942237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-90666674-c856-40f6-b9f8-f2a95cd80420 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:08.951153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90666674-c856-40f6-b9f8-f2a95cd80420 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:08.951612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90666674-c856-40f6-b9f8-f2a95cd80420 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:08.952443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90666674-c856-40f6-b9f8-f2a95cd80420 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:08.952895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90666674-c856-40f6-b9f8-f2a95cd80420 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:09.084911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-90666674-c856-40f6-b9f8-f2a95cd80420 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:09.092666 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-90666674-c856-40f6-b9f8-f2a95cd80420 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1315 microversion: 2.1 time: 0.156004 May 28 21:08:09.093238 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 832/1623] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:08 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:09.322933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7864f3e2-e31a-48ab-9e16-c2a847b7a917 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:09.324393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7864f3e2-e31a-48ab-9e16-c2a847b7a917 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:09.330811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7864f3e2-e31a-48ab-9e16-c2a847b7a917 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:09.331276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7864f3e2-e31a-48ab-9e16-c2a847b7a917 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:09.332247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7864f3e2-e31a-48ab-9e16-c2a847b7a917 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:09.332780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7864f3e2-e31a-48ab-9e16-c2a847b7a917 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:09.475063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7864f3e2-e31a-48ab-9e16-c2a847b7a917 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:09.484389 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7864f3e2-e31a-48ab-9e16-c2a847b7a917 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.164771 May 28 21:08:09.484982 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 792/1624] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:09 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:09.633061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1da72390-ac39-47a5-a921-b31a9aa394be tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d640a75e0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:09.681374 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1da72390-ac39-47a5-a921-b31a9aa394be tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1411 microversion: 2.1 time: 0.052252 May 28 21:08:09.684542 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 833/1625] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:09 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1411 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:09.692648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a196c82-1f8f-495b-a19e-fc5a40e03ac4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:09.693454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6a196c82-1f8f-495b-a19e-fc5a40e03ac4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:09.699917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a196c82-1f8f-495b-a19e-fc5a40e03ac4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:09.700380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a196c82-1f8f-495b-a19e-fc5a40e03ac4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:09.701571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a196c82-1f8f-495b-a19e-fc5a40e03ac4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:09.702014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a196c82-1f8f-495b-a19e-fc5a40e03ac4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:09.789499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cea86b14-359e-4ac3-becc-cebe2cea777d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:09.790302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cea86b14-359e-4ac3-becc-cebe2cea777d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:09.819464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cea86b14-359e-4ac3-becc-cebe2cea777d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:09.819849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cea86b14-359e-4ac3-becc-cebe2cea777d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:09.822493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cea86b14-359e-4ac3-becc-cebe2cea777d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:09.822954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cea86b14-359e-4ac3-becc-cebe2cea777d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:09.855477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a196c82-1f8f-495b-a19e-fc5a40e03ac4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:09.864487 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6a196c82-1f8f-495b-a19e-fc5a40e03ac4 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1350 microversion: 2.1 time: 0.175322 May 28 21:08:09.865777 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 793/1626] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:09 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1350 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:09.871007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e4119b30-b233-4d1f-a1f2-615571b1271b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:09.871877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e4119b30-b233-4d1f-a1f2-615571b1271b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:09.879030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e4119b30-b233-4d1f-a1f2-615571b1271b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:09.879868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e4119b30-b233-4d1f-a1f2-615571b1271b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:09.880656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e4119b30-b233-4d1f-a1f2-615571b1271b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:09.881348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e4119b30-b233-4d1f-a1f2-615571b1271b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:09.914396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cea86b14-359e-4ac3-becc-cebe2cea777d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:09.922716 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cea86b14-359e-4ac3-becc-cebe2cea777d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1329 microversion: 2.1 time: 0.137118 May 28 21:08:09.928649 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 834/1627] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:09 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1329 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:09.962499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c202fd20-2b35-414e-95c8-747807d4af85 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:09.963631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c202fd20-2b35-414e-95c8-747807d4af85 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:09.973545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c202fd20-2b35-414e-95c8-747807d4af85 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:09.974324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c202fd20-2b35-414e-95c8-747807d4af85 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:09.976488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c202fd20-2b35-414e-95c8-747807d4af85 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:09.977110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c202fd20-2b35-414e-95c8-747807d4af85 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:10.056419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e4119b30-b233-4d1f-a1f2-615571b1271b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:10.065283 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e4119b30-b233-4d1f-a1f2-615571b1271b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1198 microversion: 2.1 time: 0.197847 May 28 21:08:10.067051 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 794/1628] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:09 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1198 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:10.119426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b56e0300-b3a2-4dfc-83d5-ea7b844af830 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:10.120125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b56e0300-b3a2-4dfc-83d5-ea7b844af830 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:10.132847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b56e0300-b3a2-4dfc-83d5-ea7b844af830 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:10.133463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b56e0300-b3a2-4dfc-83d5-ea7b844af830 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:10.134434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b56e0300-b3a2-4dfc-83d5-ea7b844af830 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:10.135117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b56e0300-b3a2-4dfc-83d5-ea7b844af830 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:10.159973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c202fd20-2b35-414e-95c8-747807d4af85 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:10.168632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c202fd20-2b35-414e-95c8-747807d4af85 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:10.171049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c202fd20-2b35-414e-95c8-747807d4af85 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:10.173183 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c202fd20-2b35-414e-95c8-747807d4af85 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1279 microversion: 2.25 time: 0.216850 May 28 21:08:10.174949 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 835/1629] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:09 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1279 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:10.284417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b56e0300-b3a2-4dfc-83d5-ea7b844af830 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:10.299335 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b56e0300-b3a2-4dfc-83d5-ea7b844af830 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1315 microversion: 2.1 time: 0.189207 May 28 21:08:10.299935 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 795/1630] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:10 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:10.354697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-75e30da2-d7fa-4bcc-b41c-c704c47d3241 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:10.355310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-75e30da2-d7fa-4bcc-b41c-c704c47d3241 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:10.362749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75e30da2-d7fa-4bcc-b41c-c704c47d3241 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:10.363663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75e30da2-d7fa-4bcc-b41c-c704c47d3241 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:10.364287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75e30da2-d7fa-4bcc-b41c-c704c47d3241 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:10.364803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75e30da2-d7fa-4bcc-b41c-c704c47d3241 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:10.392204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-75e30da2-d7fa-4bcc-b41c-c704c47d3241 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:10.507645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c2349062-d3a1-4c84-9fdf-236ce3e9de16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:10.508496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c2349062-d3a1-4c84-9fdf-236ce3e9de16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:10.515571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2349062-d3a1-4c84-9fdf-236ce3e9de16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:10.516035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2349062-d3a1-4c84-9fdf-236ce3e9de16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:10.539202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2349062-d3a1-4c84-9fdf-236ce3e9de16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:10.539202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2349062-d3a1-4c84-9fdf-236ce3e9de16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:10.661725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c2349062-d3a1-4c84-9fdf-236ce3e9de16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:10.670300 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c2349062-d3a1-4c84-9fdf-236ce3e9de16 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.171594 May 28 21:08:10.670891 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 796/1631] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:10 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:10.694936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-12e3f355-b899-4dd2-ab50-355671d17ae4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d645919d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:10.715461 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-75e30da2-d7fa-4bcc-b41c-c704c47d3241 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "DELETE /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 204 len: 0 microversion: 2.1 time: 0.364383 May 28 21:08:10.717356 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 836/1632] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:08:10 2022] DELETE /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:10.730323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9d616228-9283-417f-a434-1039f5222cb7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:10.731444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9d616228-9283-417f-a434-1039f5222cb7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:10.738979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d616228-9283-417f-a434-1039f5222cb7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:10.739497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d616228-9283-417f-a434-1039f5222cb7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:10.740341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d616228-9283-417f-a434-1039f5222cb7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:10.740782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d616228-9283-417f-a434-1039f5222cb7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:10.757583 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-12e3f355-b899-4dd2-ab50-355671d17ae4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1411 microversion: 2.1 time: 0.066412 May 28 21:08:10.763613 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 797/1633] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:10 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1411 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:10.883138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-517a187b-199b-4b95-b3e0-0fd1c9349bad tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:10.883822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-517a187b-199b-4b95-b3e0-0fd1c9349bad tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:10.890320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-517a187b-199b-4b95-b3e0-0fd1c9349bad tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:10.891003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-517a187b-199b-4b95-b3e0-0fd1c9349bad tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:10.892162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-517a187b-199b-4b95-b3e0-0fd1c9349bad tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:10.892620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-517a187b-199b-4b95-b3e0-0fd1c9349bad tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:10.905998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9d616228-9283-417f-a434-1039f5222cb7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:10.916109 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9d616228-9283-417f-a434-1039f5222cb7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1513 microversion: 2.1 time: 0.191757 May 28 21:08:10.917108 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 837/1634] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:10 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:10.948022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7bad5034-a7c5-477d-a195-5027655358fd tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:10.948888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7bad5034-a7c5-477d-a195-5027655358fd tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:10.955196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bad5034-a7c5-477d-a195-5027655358fd tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:10.955876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bad5034-a7c5-477d-a195-5027655358fd tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:10.956809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bad5034-a7c5-477d-a195-5027655358fd tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:10.957406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bad5034-a7c5-477d-a195-5027655358fd tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:11.160900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-517a187b-199b-4b95-b3e0-0fd1c9349bad tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:11.163052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7bad5034-a7c5-477d-a195-5027655358fd tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:11.171322 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7bad5034-a7c5-477d-a195-5027655358fd tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1394 microversion: 2.1 time: 0.227696 May 28 21:08:11.172162 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-517a187b-199b-4b95-b3e0-0fd1c9349bad tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1350 microversion: 2.1 time: 0.294887 May 28 21:08:11.182538 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 838/1635] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:10 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1394 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:11.183569 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 798/1636] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:10 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1350 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:11.186205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f6a1eccd-fd4d-4390-9ab3-ccd8a4ccf29e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:11.190348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f6a1eccd-fd4d-4390-9ab3-ccd8a4ccf29e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:11.208287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-176af808-9df5-496f-8538-4ec0d18b3943 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:11.213721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-176af808-9df5-496f-8538-4ec0d18b3943 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:11.216773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-176af808-9df5-496f-8538-4ec0d18b3943 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:11.216929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6a1eccd-fd4d-4390-9ab3-ccd8a4ccf29e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:11.217231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-176af808-9df5-496f-8538-4ec0d18b3943 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:11.217421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6a1eccd-fd4d-4390-9ab3-ccd8a4ccf29e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:11.218187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-176af808-9df5-496f-8538-4ec0d18b3943 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:11.218632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-176af808-9df5-496f-8538-4ec0d18b3943 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:11.222517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6a1eccd-fd4d-4390-9ab3-ccd8a4ccf29e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:11.224150 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6a1eccd-fd4d-4390-9ab3-ccd8a4ccf29e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:11.579232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-176af808-9df5-496f-8538-4ec0d18b3943 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:11.580284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f6a1eccd-fd4d-4390-9ab3-ccd8a4ccf29e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:11.592620 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f6a1eccd-fd4d-4390-9ab3-ccd8a4ccf29e tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1198 microversion: 2.1 time: 0.417835 May 28 21:08:11.603829 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 839/1637] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:11 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1198 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:11.605855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-73ef7704-6ce0-4c96-abcf-55ff1e5fbe23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:11.606510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-73ef7704-6ce0-4c96-abcf-55ff1e5fbe23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:11.609170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-176af808-9df5-496f-8538-4ec0d18b3943 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:11.616095 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-176af808-9df5-496f-8538-4ec0d18b3943 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:11.616792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-73ef7704-6ce0-4c96-abcf-55ff1e5fbe23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:11.617259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-73ef7704-6ce0-4c96-abcf-55ff1e5fbe23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:11.618124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-73ef7704-6ce0-4c96-abcf-55ff1e5fbe23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:11.618572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-73ef7704-6ce0-4c96-abcf-55ff1e5fbe23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:11.619487 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-176af808-9df5-496f-8538-4ec0d18b3943 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1279 microversion: 2.25 time: 0.417145 May 28 21:08:11.620063 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 799/1638] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:11 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1279 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:11.688354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-07b7aba0-097b-4ded-9be3-ae3f25a80494 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:11.689009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-07b7aba0-097b-4ded-9be3-ae3f25a80494 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:11.704558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07b7aba0-097b-4ded-9be3-ae3f25a80494 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:11.705918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07b7aba0-097b-4ded-9be3-ae3f25a80494 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:11.706967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07b7aba0-097b-4ded-9be3-ae3f25a80494 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:11.707612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07b7aba0-097b-4ded-9be3-ae3f25a80494 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:12.088336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-07b7aba0-097b-4ded-9be3-ae3f25a80494 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:12.097682 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-07b7aba0-097b-4ded-9be3-ae3f25a80494 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1477 microversion: 2.1 time: 0.413222 May 28 21:08:12.102588 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 800/1639] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:11 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1477 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:12.115772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-44c87ce1-2909-4c26-92b7-76f98a28f2f4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d69cbf820>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:12.191793 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-44c87ce1-2909-4c26-92b7-76f98a28f2f4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1411 microversion: 2.1 time: 0.087754 May 28 21:08:12.193111 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 801/1640] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:12 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1411 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:12.202004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-73e1c035-02d4-4559-a1e7-e1d7dca1bcad tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:12.203262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-73ef7704-6ce0-4c96-abcf-55ff1e5fbe23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:12.206094 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-73e1c035-02d4-4559-a1e7-e1d7dca1bcad tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:12.215151 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-73ef7704-6ce0-4c96-abcf-55ff1e5fbe23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1315 microversion: 2.1 time: 0.619958 May 28 21:08:12.216171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73e1c035-02d4-4559-a1e7-e1d7dca1bcad tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:12.220767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73e1c035-02d4-4559-a1e7-e1d7dca1bcad tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:12.221704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73e1c035-02d4-4559-a1e7-e1d7dca1bcad tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:12.222179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73e1c035-02d4-4559-a1e7-e1d7dca1bcad tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:12.227178 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 840/1641] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:11 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:12.238962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-7de9c602-fce6-4b87-9b5d-dc368cf1acc0 req-445e017d-fcb6-4f17-9947-26b71ba73fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f837cef-04b0-4491-8edf-c10423944be0", "name": "network-vif-plugged", "status": "completed", "tag": "f9af25ca-e630-49f5-9345-5a9075542855"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:12.248665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7de9c602-fce6-4b87-9b5d-dc368cf1acc0 req-445e017d-fcb6-4f17-9947-26b71ba73fd8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:12.249288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7de9c602-fce6-4b87-9b5d-dc368cf1acc0 req-445e017d-fcb6-4f17-9947-26b71ba73fd8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:12.262877 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-7de9c602-fce6-4b87-9b5d-dc368cf1acc0 req-445e017d-fcb6-4f17-9947-26b71ba73fd8 service nova] Creating event network-vif-plugged:f9af25ca-e630-49f5-9345-5a9075542855 for instance 1f837cef-04b0-4491-8edf-c10423944be0 on nch1-master-1 May 28 21:08:12.269203 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-7de9c602-fce6-4b87-9b5d-dc368cf1acc0 req-445e017d-fcb6-4f17-9947-26b71ba73fd8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040574 May 28 21:08:12.270180 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 841/1642] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:12.276480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dc7e09f0-cb67-4f5c-9bda-6cf2bfd5e829 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:12.279511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dc7e09f0-cb67-4f5c-9bda-6cf2bfd5e829 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:12.288772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc7e09f0-cb67-4f5c-9bda-6cf2bfd5e829 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:12.289246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc7e09f0-cb67-4f5c-9bda-6cf2bfd5e829 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:12.290097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc7e09f0-cb67-4f5c-9bda-6cf2bfd5e829 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:12.290549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc7e09f0-cb67-4f5c-9bda-6cf2bfd5e829 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:12.687832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dc7e09f0-cb67-4f5c-9bda-6cf2bfd5e829 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:12.690371 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-73e1c035-02d4-4559-a1e7-e1d7dca1bcad tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:12.699424 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-73e1c035-02d4-4559-a1e7-e1d7dca1bcad tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1513 microversion: 2.1 time: 0.504930 May 28 21:08:12.700044 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 802/1643] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:12 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1513 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:12.702729 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dc7e09f0-cb67-4f5c-9bda-6cf2bfd5e829 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1394 microversion: 2.1 time: 0.431334 May 28 21:08:12.703776 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 842/1644] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:12 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1394 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:12.712307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2ddd58df-cea9-432c-9db6-2f94c7fc0623 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:12.717138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2ddd58df-cea9-432c-9db6-2f94c7fc0623 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:12.737338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ddd58df-cea9-432c-9db6-2f94c7fc0623 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:12.737798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ddd58df-cea9-432c-9db6-2f94c7fc0623 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:12.738622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ddd58df-cea9-432c-9db6-2f94c7fc0623 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:12.739068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ddd58df-cea9-432c-9db6-2f94c7fc0623 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:12.839009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-f6ab539d-e39f-4555-a63f-3e2ca24fd699 req-cfb524b2-31c8-40a4-a1de-ff5f9640d5ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "112841b9-f573-4e02-9bc8-40a32da993a8", "tag": "40a3af66-b200-42b6-8260-9397f158a0db"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:12.852217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f6ab539d-e39f-4555-a63f-3e2ca24fd699 req-cfb524b2-31c8-40a4-a1de-ff5f9640d5ed service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:12.853000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f6ab539d-e39f-4555-a63f-3e2ca24fd699 req-cfb524b2-31c8-40a4-a1de-ff5f9640d5ed service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:12.868633 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-f6ab539d-e39f-4555-a63f-3e2ca24fd699 req-cfb524b2-31c8-40a4-a1de-ff5f9640d5ed service nova] Creating event network-changed:40a3af66-b200-42b6-8260-9397f158a0db for instance 112841b9-f573-4e02-9bc8-40a32da993a8 on nch2-master-1 May 28 21:08:12.874919 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-f6ab539d-e39f-4555-a63f-3e2ca24fd699 req-cfb524b2-31c8-40a4-a1de-ff5f9640d5ed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168501 May 28 21:08:12.876373 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 843/1645] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:12.882114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aa34697f-31b6-4805-bf14-5f32787e9333 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:12.883087 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aa34697f-31b6-4805-bf14-5f32787e9333 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:12.890680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa34697f-31b6-4805-bf14-5f32787e9333 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:12.891514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa34697f-31b6-4805-bf14-5f32787e9333 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:12.892554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa34697f-31b6-4805-bf14-5f32787e9333 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:12.893200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa34697f-31b6-4805-bf14-5f32787e9333 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:13.356758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2ddd58df-cea9-432c-9db6-2f94c7fc0623 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:13.396099 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2ddd58df-cea9-432c-9db6-2f94c7fc0623 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1539 microversion: 2.1 time: 0.686574 May 28 21:08:13.401665 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 803/1646] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:12 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1539 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:13.422634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a94f68cf-6d34-48fd-8ea6-b10da42758d9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:13.427662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a94f68cf-6d34-48fd-8ea6-b10da42758d9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:13.438723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a94f68cf-6d34-48fd-8ea6-b10da42758d9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:13.439613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a94f68cf-6d34-48fd-8ea6-b10da42758d9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:13.440726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a94f68cf-6d34-48fd-8ea6-b10da42758d9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:13.441570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a94f68cf-6d34-48fd-8ea6-b10da42758d9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:13.452169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aa34697f-31b6-4805-bf14-5f32787e9333 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:13.466361 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aa34697f-31b6-4805-bf14-5f32787e9333 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1198 microversion: 2.1 time: 0.588445 May 28 21:08:13.477619 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 844/1647] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:12 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1198 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:13.485868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-07d61e45-3a77-461c-a016-5e576ba00072 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:13.486496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-07d61e45-3a77-461c-a016-5e576ba00072 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:13.497910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07d61e45-3a77-461c-a016-5e576ba00072 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:13.498377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07d61e45-3a77-461c-a016-5e576ba00072 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:13.499174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07d61e45-3a77-461c-a016-5e576ba00072 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:13.499632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07d61e45-3a77-461c-a016-5e576ba00072 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:13.897471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a94f68cf-6d34-48fd-8ea6-b10da42758d9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:13.908764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a94f68cf-6d34-48fd-8ea6-b10da42758d9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:13.910340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a94f68cf-6d34-48fd-8ea6-b10da42758d9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:13.915147 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a94f68cf-6d34-48fd-8ea6-b10da42758d9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1279 microversion: 2.25 time: 0.509772 May 28 21:08:13.916344 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 804/1648] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:13 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1279 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:13.922408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4b08d1a8-d310-43ff-9d38-40b18ee4d9d5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d69cbf430>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:13.995818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-07d61e45-3a77-461c-a016-5e576ba00072 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:14.031874 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-07d61e45-3a77-461c-a016-5e576ba00072 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1476 microversion: 2.1 time: 0.552985 May 28 21:08:14.032551 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 845/1649] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:13 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1476 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:14.049395 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4b08d1a8-d310-43ff-9d38-40b18ee4d9d5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1411 microversion: 2.1 time: 0.131494 May 28 21:08:14.053995 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 805/1650] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:13 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1411 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:14.060690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c14f2753-ad59-46a8-92e6-ef632699c87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:14.068420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c14f2753-ad59-46a8-92e6-ef632699c87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:14.081646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a6947b37-f0da-450c-bb99-f3bf895d966f tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:14.083278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a6947b37-f0da-450c-bb99-f3bf895d966f tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:14.094171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c14f2753-ad59-46a8-92e6-ef632699c87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:14.095314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c14f2753-ad59-46a8-92e6-ef632699c87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:14.109668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c14f2753-ad59-46a8-92e6-ef632699c87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:14.111127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6947b37-f0da-450c-bb99-f3bf895d966f tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:14.111907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c14f2753-ad59-46a8-92e6-ef632699c87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:14.112642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6947b37-f0da-450c-bb99-f3bf895d966f tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:14.123831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6947b37-f0da-450c-bb99-f3bf895d966f tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:14.123831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6947b37-f0da-450c-bb99-f3bf895d966f tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:14.148835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:14.161096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:14.295911 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a6947b37-f0da-450c-bb99-f3bf895d966f tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.233216 May 28 21:08:14.296492 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 806/1651] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:08:14 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f/os-interface => generated 284 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:14.307079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-91f890ee-4806-4212-833b-e621321951e7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:14.307962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-91f890ee-4806-4212-833b-e621321951e7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:14.319235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91f890ee-4806-4212-833b-e621321951e7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:14.320288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91f890ee-4806-4212-833b-e621321951e7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:14.321786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91f890ee-4806-4212-833b-e621321951e7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:14.322445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91f890ee-4806-4212-833b-e621321951e7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:14.405001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91f890ee-4806-4212-833b-e621321951e7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:14.405713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91f890ee-4806-4212-833b-e621321951e7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:14.406627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-91f890ee-4806-4212-833b-e621321951e7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lazy-loading 'fault' on Instance uuid 688d4d8f-9b8f-4201-909c-8e3627dd1711 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:14.858048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-91f890ee-4806-4212-833b-e621321951e7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be94d10c650645658c755b7fc1595370', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a9c4408ec1432cb05c5256657886d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:14.868029 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-91f890ee-4806-4212-833b-e621321951e7 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 200 len: 1308 microversion: 2.1 time: 0.570175 May 28 21:08:14.882143 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 807/1652] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:14 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 1308 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:14.889167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-35dfb6e0-cfb3-49c0-91b5-b6d62e36ef23 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:14.892723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-35dfb6e0-cfb3-49c0-91b5-b6d62e36ef23 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:14.901480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35dfb6e0-cfb3-49c0-91b5-b6d62e36ef23 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:14.902183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35dfb6e0-cfb3-49c0-91b5-b6d62e36ef23 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:14.903191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35dfb6e0-cfb3-49c0-91b5-b6d62e36ef23 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:14.903731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35dfb6e0-cfb3-49c0-91b5-b6d62e36ef23 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:14.967180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c14f2753-ad59-46a8-92e6-ef632699c87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:14.977048 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c14f2753-ad59-46a8-92e6-ef632699c87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1315 microversion: 2.1 time: 0.937630 May 28 21:08:14.977646 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 846/1653] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:14 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1315 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:14.988055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-051ea410-9448-4ad7-bf56-22f40393edc6 req-d02604f5-45e5-4725-84d8-678ce640809c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801b7889-1935-4bb4-8e8a-c34c2cf3c100", "name": "network-vif-unplugged", "status": "completed", "tag": "0e646b8c-f3f2-4ee5-91b0-aea5324fcf34"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:14.997313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-051ea410-9448-4ad7-bf56-22f40393edc6 req-d02604f5-45e5-4725-84d8-678ce640809c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:15.002050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-051ea410-9448-4ad7-bf56-22f40393edc6 req-d02604f5-45e5-4725-84d8-678ce640809c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:15.015804 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-051ea410-9448-4ad7-bf56-22f40393edc6 req-d02604f5-45e5-4725-84d8-678ce640809c service nova] Creating event network-vif-unplugged:0e646b8c-f3f2-4ee5-91b0-aea5324fcf34 for instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 on nch2-master-1 May 28 21:08:15.022295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-051ea410-9448-4ad7-bf56-22f40393edc6 req-d02604f5-45e5-4725-84d8-678ce640809c service nova] Instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:08:15.039253 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-051ea410-9448-4ad7-bf56-22f40393edc6 req-d02604f5-45e5-4725-84d8-678ce640809c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060095 May 28 21:08:15.040322 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 847/1654] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:15.046058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-4dd79f48-4e6b-484e-b745-44188a5dbfcd req-c5803e0f-bda1-4832-bb6f-6d8b57083243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1", "name": "network-vif-plugged", "status": "completed", "tag": "5af24189-413e-4d8f-814a-44d91619c0c7"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:15.061240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-4dd79f48-4e6b-484e-b745-44188a5dbfcd req-c5803e0f-bda1-4832-bb6f-6d8b57083243 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:15.065032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-4dd79f48-4e6b-484e-b745-44188a5dbfcd req-c5803e0f-bda1-4832-bb6f-6d8b57083243 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:15.083085 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-4dd79f48-4e6b-484e-b745-44188a5dbfcd req-c5803e0f-bda1-4832-bb6f-6d8b57083243 service nova] Creating event network-vif-plugged:5af24189-413e-4d8f-814a-44d91619c0c7 for instance 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 on nch1-master-1 May 28 21:08:15.091335 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-4dd79f48-4e6b-484e-b745-44188a5dbfcd req-c5803e0f-bda1-4832-bb6f-6d8b57083243 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049448 May 28 21:08:15.092562 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 848/1655] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:15.101182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dcddad40-d5d8-462e-b746-7788c50edc28 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:15.102316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dcddad40-d5d8-462e-b746-7788c50edc28 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:15.111477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcddad40-d5d8-462e-b746-7788c50edc28 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:15.112129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcddad40-d5d8-462e-b746-7788c50edc28 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:15.113630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcddad40-d5d8-462e-b746-7788c50edc28 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:15.113967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcddad40-d5d8-462e-b746-7788c50edc28 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:15.461519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-35dfb6e0-cfb3-49c0-91b5-b6d62e36ef23 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:15.476219 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-35dfb6e0-cfb3-49c0-91b5-b6d62e36ef23 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1394 microversion: 2.1 time: 0.589168 May 28 21:08:15.478248 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 808/1656] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:14 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1394 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:15.491586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-c9a8c201-a2f6-472f-bcb4-a836cb49ffb2 req-cdef5423-0d16-4361-8d45-a540581d021c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "688d4d8f-9b8f-4201-909c-8e3627dd1711", "name": "network-vif-deleted", "tag": "80c50feb-6a2d-4c2a-a587-eb16fefb5793"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:15.508473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c9a8c201-a2f6-472f-bcb4-a836cb49ffb2 req-cdef5423-0d16-4361-8d45-a540581d021c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:15.511569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c9a8c201-a2f6-472f-bcb4-a836cb49ffb2 req-cdef5423-0d16-4361-8d45-a540581d021c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:15.525911 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-c9a8c201-a2f6-472f-bcb4-a836cb49ffb2 req-cdef5423-0d16-4361-8d45-a540581d021c service nova] Creating event network-vif-deleted:80c50feb-6a2d-4c2a-a587-eb16fefb5793 for instance 688d4d8f-9b8f-4201-909c-8e3627dd1711 on nch2-master-1 May 28 21:08:15.534920 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-c9a8c201-a2f6-472f-bcb4-a836cb49ffb2 req-cdef5423-0d16-4361-8d45-a540581d021c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053065 May 28 21:08:15.536414 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 809/1657] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:15.547094 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0d4626ca-5b2a-46c3-8aab-7e1d1508393e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:15.548773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0d4626ca-5b2a-46c3-8aab-7e1d1508393e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:15.556646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:15.559607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d4626ca-5b2a-46c3-8aab-7e1d1508393e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:15.560315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d4626ca-5b2a-46c3-8aab-7e1d1508393e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:15.562259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d4626ca-5b2a-46c3-8aab-7e1d1508393e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:15.563086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d4626ca-5b2a-46c3-8aab-7e1d1508393e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:15.632290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dcddad40-d5d8-462e-b746-7788c50edc28 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:15.650753 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dcddad40-d5d8-462e-b746-7788c50edc28 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1198 microversion: 2.1 time: 0.556738 May 28 21:08:15.651365 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 849/1658] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:15 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1198 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:15.655957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2626fc0d-265e-4141-8c4d-5dcdda8bfa51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:15.656583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2626fc0d-265e-4141-8c4d-5dcdda8bfa51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:15.678068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2626fc0d-265e-4141-8c4d-5dcdda8bfa51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:15.678549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2626fc0d-265e-4141-8c4d-5dcdda8bfa51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:15.679379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2626fc0d-265e-4141-8c4d-5dcdda8bfa51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:15.679829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2626fc0d-265e-4141-8c4d-5dcdda8bfa51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:16.292434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0d4626ca-5b2a-46c3-8aab-7e1d1508393e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:16.301726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0d4626ca-5b2a-46c3-8aab-7e1d1508393e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:16.311058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0d4626ca-5b2a-46c3-8aab-7e1d1508393e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:16.316825 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0d4626ca-5b2a-46c3-8aab-7e1d1508393e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1279 microversion: 2.25 time: 0.778309 May 28 21:08:16.318280 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 810/1659] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:15 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1279 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:16.323667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1c3b5b32-ac86-4cd5-95e8-5b78765ff2a5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d57f3f280>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:16.361585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2626fc0d-265e-4141-8c4d-5dcdda8bfa51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:16.378646 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2626fc0d-265e-4141-8c4d-5dcdda8bfa51 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1476 microversion: 2.1 time: 0.726126 May 28 21:08:16.388933 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 850/1660] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:15 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1476 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:16.394165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f78d26b6-6948-40ae-a605-6a56b1a7a2c6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:16.397392 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1c3b5b32-ac86-4cd5-95e8-5b78765ff2a5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1411 microversion: 2.1 time: 0.076469 May 28 21:08:16.398263 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 811/1661] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:16 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1411 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:16.403221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f78d26b6-6948-40ae-a605-6a56b1a7a2c6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] [instance: 688d4d8f-9b8f-4201-909c-8e3627dd1711] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:16.404430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0850bf4e-5995-4b15-9c94-157657a565c7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:16.405828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0850bf4e-5995-4b15-9c94-157657a565c7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:16.413226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0850bf4e-5995-4b15-9c94-157657a565c7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:16.414030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0850bf4e-5995-4b15-9c94-157657a565c7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:16.415059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0850bf4e-5995-4b15-9c94-157657a565c7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:16.415659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0850bf4e-5995-4b15-9c94-157657a565c7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:16.417614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f78d26b6-6948-40ae-a605-6a56b1a7a2c6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:16.418126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f78d26b6-6948-40ae-a605-6a56b1a7a2c6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:16.418925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f78d26b6-6948-40ae-a605-6a56b1a7a2c6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:16.419375 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f78d26b6-6948-40ae-a605-6a56b1a7a2c6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:16.447039 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-f78d26b6-6948-40ae-a605-6a56b1a7a2c6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] HTTP exception thrown: Instance 688d4d8f-9b8f-4201-909c-8e3627dd1711 could not be found. May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f78d26b6-6948-40ae-a605-6a56b1a7a2c6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Request method failure captured: May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 HTTP/1.1 May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko8ED7czS6wR_IbtUqPs5sdqRl3tkgBJOzKsCyQ9UNmWnwntUDBRtdOCbvCfnpB6ftWbSqfvEQbCYpJdaetGYb8C11YjVgXnN9uoP34gLCViBjC8wFlTQ9XZgxd5Vl-17-JICertVJ2pFqN_rj0liZjhfSvb8IZsb8fFioApTmoY-B0 May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: f7a9c4408ec1432cb05c5256657886d4 May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-VolumesAdminNegativeTest-1934144314 May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:08:16.453071 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:08:16.454780 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f7a9c4408ec1432cb05c5256657886d4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f7a9c4408ec1432cb05c5256657886d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f7a9c4408ec1432cb05c5256657886d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f7a9c4408ec1432cb05c5256657886d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:08:16.454780 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-VolumesAdminNegativeTest-1934144314 May 28 21:08:16.454780 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: f7a9c4408ec1432cb05c5256657886d4 May 28 21:08:16.454780 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1934144314 May 28 21:08:16.454780 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-VolumesAdminNegativeTest-1934144314-project May 28 21:08:16.454780 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:08:16.454780 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:08:16.454780 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: be94d10c650645658c755b7fc1595370 May 28 21:08:16.454780 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-VolumesAdminNegativeTest-1934144314-project May 28 21:08:16.454780 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:08:16.454780 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 688d4d8f-9b8f-4201-909c-8e3627dd1711 could not be found. May 28 21:08:16.454780 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '688d4d8f-9b8f-4201-909c-8e3627dd1711'} May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 688d4d8f-9b8f-4201-909c-8e3627dd1711 could not be found. May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:08:16.455725 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 688d4d8f-9b8f-4201-909c-8e3627dd1711 could not be found. May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 688d4d8f-9b8f-4201-909c-8e3627dd1711 could not be found. May 28 21:08:16.457213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:16.458651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f78d26b6-6948-40ae-a605-6a56b1a7a2c6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] Returning 404 to user: Instance 688d4d8f-9b8f-4201-909c-8e3627dd1711 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:08:16.458651 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f78d26b6-6948-40ae-a605-6a56b1a7a2c6 tempest-VolumesAdminNegativeTest-1934144314 tempest-VolumesAdminNegativeTest-1934144314-project] 10.222.0.33 "GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711" status: 404 len: 111 microversion: 2.1 time: 0.064445 May 28 21:08:16.458651 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 851/1662] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:16 2022] GET /compute/v2.1/servers/688d4d8f-9b8f-4201-909c-8e3627dd1711 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:08:16.495144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8cb343be-098f-4a4e-a20b-bb905a23dcfc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:16.495773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8cb343be-098f-4a4e-a20b-bb905a23dcfc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:16.503950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cb343be-098f-4a4e-a20b-bb905a23dcfc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:16.504418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cb343be-098f-4a4e-a20b-bb905a23dcfc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:16.505208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cb343be-098f-4a4e-a20b-bb905a23dcfc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:16.505656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cb343be-098f-4a4e-a20b-bb905a23dcfc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:16.889929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:16.920063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=34 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:17.113711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0850bf4e-5995-4b15-9c94-157657a565c7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:17.113711 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0850bf4e-5995-4b15-9c94-157657a565c7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1315 microversion: 2.1 time: 0.606560 May 28 21:08:17.113711 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 812/1663] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:16 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:17.113711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-35f45ce2-8194-4e20-8417-e128fe519a54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:17.114631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-35f45ce2-8194-4e20-8417-e128fe519a54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:17.114631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35f45ce2-8194-4e20-8417-e128fe519a54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:17.114631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35f45ce2-8194-4e20-8417-e128fe519a54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:17.114631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35f45ce2-8194-4e20-8417-e128fe519a54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:17.115115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35f45ce2-8194-4e20-8417-e128fe519a54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:17.115310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8cb343be-098f-4a4e-a20b-bb905a23dcfc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:17.115310 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8cb343be-098f-4a4e-a20b-bb905a23dcfc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1394 microversion: 2.1 time: 0.609246 May 28 21:08:17.115310 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 852/1664] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:16 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1394 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:17.131605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-f869135f-46a0-4065-a0a9-09c2daeda02c req-448585ce-199e-48fe-9cb3-f99389076809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "801b7889-1935-4bb4-8e8a-c34c2cf3c100", "tag": "0e646b8c-f3f2-4ee5-91b0-aea5324fcf34"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:17.141055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f869135f-46a0-4065-a0a9-09c2daeda02c req-448585ce-199e-48fe-9cb3-f99389076809 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:17.142105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f869135f-46a0-4065-a0a9-09c2daeda02c req-448585ce-199e-48fe-9cb3-f99389076809 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:17.155824 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-f869135f-46a0-4065-a0a9-09c2daeda02c req-448585ce-199e-48fe-9cb3-f99389076809 service nova] Creating event network-changed:0e646b8c-f3f2-4ee5-91b0-aea5324fcf34 for instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 on nch2-master-1 May 28 21:08:17.163452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-f869135f-46a0-4065-a0a9-09c2daeda02c req-448585ce-199e-48fe-9cb3-f99389076809 service nova] Instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:08:17.176284 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-f869135f-46a0-4065-a0a9-09c2daeda02c req-448585ce-199e-48fe-9cb3-f99389076809 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048528 May 28 21:08:17.176937 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 853/1665] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:08:17.341143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e5b451ed-60ae-4db8-9c9b-e752a06fef7b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:17.342418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e5b451ed-60ae-4db8-9c9b-e752a06fef7b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:17.354435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5b451ed-60ae-4db8-9c9b-e752a06fef7b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:17.355237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5b451ed-60ae-4db8-9c9b-e752a06fef7b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:17.356470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5b451ed-60ae-4db8-9c9b-e752a06fef7b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:17.356996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5b451ed-60ae-4db8-9c9b-e752a06fef7b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:17.791349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-35f45ce2-8194-4e20-8417-e128fe519a54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:17.802769 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-35f45ce2-8194-4e20-8417-e128fe519a54 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1198 microversion: 2.1 time: 0.790132 May 28 21:08:17.811859 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 813/1666] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:17 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1198 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:17.814052 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ebabefc1-2af8-4821-894f-6a9d9b88b72b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:17.814684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ebabefc1-2af8-4821-894f-6a9d9b88b72b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:17.833956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ebabefc1-2af8-4821-894f-6a9d9b88b72b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:17.833956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ebabefc1-2af8-4821-894f-6a9d9b88b72b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:17.839033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ebabefc1-2af8-4821-894f-6a9d9b88b72b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:17.839512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ebabefc1-2af8-4821-894f-6a9d9b88b72b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:17.940575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e5b451ed-60ae-4db8-9c9b-e752a06fef7b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:17.953746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e5b451ed-60ae-4db8-9c9b-e752a06fef7b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:17.956157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e5b451ed-60ae-4db8-9c9b-e752a06fef7b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:17.956455 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e5b451ed-60ae-4db8-9c9b-e752a06fef7b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1279 microversion: 2.25 time: 0.622728 May 28 21:08:17.974229 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 854/1667] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:17 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1279 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:08:17.979245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fa656e16-2361-4d1b-8b3b-da805fc7adcd tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d69c9bca0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:18.082176 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fa656e16-2361-4d1b-8b3b-da805fc7adcd tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1411 microversion: 2.1 time: 0.106658 May 28 21:08:18.083185 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 855/1668] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:17 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1411 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:18.099511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d909b24f-dff0-4a37-8faa-d42a078ea87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:18.100527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d909b24f-dff0-4a37-8faa-d42a078ea87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:18.115280 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d909b24f-dff0-4a37-8faa-d42a078ea87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:18.119620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d909b24f-dff0-4a37-8faa-d42a078ea87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:18.120738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d909b24f-dff0-4a37-8faa-d42a078ea87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:18.123762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d909b24f-dff0-4a37-8faa-d42a078ea87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:18.507056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ebabefc1-2af8-4821-894f-6a9d9b88b72b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:18.510968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:18.515711 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ebabefc1-2af8-4821-894f-6a9d9b88b72b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1476 microversion: 2.1 time: 0.708732 May 28 21:08:18.519812 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 814/1669] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:17 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1476 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:18.528223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-78cf3de4-12d2-4ffc-acda-d9212fb0d8c2 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:18.529150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-78cf3de4-12d2-4ffc-acda-d9212fb0d8c2 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:18.552879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78cf3de4-12d2-4ffc-acda-d9212fb0d8c2 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:18.553709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78cf3de4-12d2-4ffc-acda-d9212fb0d8c2 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:18.554798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78cf3de4-12d2-4ffc-acda-d9212fb0d8c2 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:18.555446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78cf3de4-12d2-4ffc-acda-d9212fb0d8c2 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:18.755228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d909b24f-dff0-4a37-8faa-d42a078ea87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:18.763760 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d909b24f-dff0-4a37-8faa-d42a078ea87e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1464 microversion: 2.1 time: 0.679373 May 28 21:08:18.767341 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 856/1670] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:18 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1464 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:18.787453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-08c0dcf8-0972-4117-a3cb-c958a15a724f req-cda01280-a639-4dd7-a626-1078d1883e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86838d0c-e2da-4d31-92e8-94fd9b6345a6", "name": "network-vif-plugged", "status": "completed", "tag": "90dbd5de-6ef5-4258-8dc2-8e5a1f5600b0"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:18.805920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-08c0dcf8-0972-4117-a3cb-c958a15a724f req-cda01280-a639-4dd7-a626-1078d1883e98 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:18.810167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-08c0dcf8-0972-4117-a3cb-c958a15a724f req-cda01280-a639-4dd7-a626-1078d1883e98 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:18.834615 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-08c0dcf8-0972-4117-a3cb-c958a15a724f req-cda01280-a639-4dd7-a626-1078d1883e98 service nova] Creating event network-vif-plugged:90dbd5de-6ef5-4258-8dc2-8e5a1f5600b0 for instance 86838d0c-e2da-4d31-92e8-94fd9b6345a6 on nch1-master-1 May 28 21:08:18.845303 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-08c0dcf8-0972-4117-a3cb-c958a15a724f req-cda01280-a639-4dd7-a626-1078d1883e98 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065474 May 28 21:08:18.846124 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 857/1671] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:18.851235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-88fe829c-80ad-4f19-b6dd-609f294a0fcf tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:18.852007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-88fe829c-80ad-4f19-b6dd-609f294a0fcf tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:18.859894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88fe829c-80ad-4f19-b6dd-609f294a0fcf tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:18.861003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88fe829c-80ad-4f19-b6dd-609f294a0fcf tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:18.861994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88fe829c-80ad-4f19-b6dd-609f294a0fcf tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:18.862511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88fe829c-80ad-4f19-b6dd-609f294a0fcf tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:18.988092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-78cf3de4-12d2-4ffc-acda-d9212fb0d8c2 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:19.000035 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-78cf3de4-12d2-4ffc-acda-d9212fb0d8c2 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1394 microversion: 2.1 time: 0.477609 May 28 21:08:19.000675 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 815/1672] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:18 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1394 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:19.016092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2c018b8a-68ba-4400-8aff-199bb58c431a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:19.016932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2c018b8a-68ba-4400-8aff-199bb58c431a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:19.024620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2c018b8a-68ba-4400-8aff-199bb58c431a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:19.025449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2c018b8a-68ba-4400-8aff-199bb58c431a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:19.026522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2c018b8a-68ba-4400-8aff-199bb58c431a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:19.027197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2c018b8a-68ba-4400-8aff-199bb58c431a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:19.114286 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-88fe829c-80ad-4f19-b6dd-609f294a0fcf tempest-ServersOnMultiNodesTest-498653481 tempest-ServersOnMultiNodesTest-498653481-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1615 microversion: 2.1 time: 0.266709 May 28 21:08:19.117507 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 858/1673] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:18 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1615 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:19.125084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-303bcb89-8118-4437-8bcf-977903248d2e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:19.129715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-303bcb89-8118-4437-8bcf-977903248d2e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:19.160083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-303bcb89-8118-4437-8bcf-977903248d2e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:19.164037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-303bcb89-8118-4437-8bcf-977903248d2e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:19.169160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-303bcb89-8118-4437-8bcf-977903248d2e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:19.170716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-303bcb89-8118-4437-8bcf-977903248d2e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:19.462200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2c018b8a-68ba-4400-8aff-199bb58c431a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:19.475377 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2c018b8a-68ba-4400-8aff-199bb58c431a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1198 microversion: 2.1 time: 0.468099 May 28 21:08:19.475977 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 816/1674] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:19 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1198 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:19.488905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-71ba7e2a-bebc-4ecb-b0bc-33d6477401d4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d57f3fee0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:19.516027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-303bcb89-8118-4437-8bcf-977903248d2e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:19.535421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-303bcb89-8118-4437-8bcf-977903248d2e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:19.538116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-303bcb89-8118-4437-8bcf-977903248d2e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:19.541524 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-303bcb89-8118-4437-8bcf-977903248d2e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1279 microversion: 2.25 time: 0.422654 May 28 21:08:19.557272 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 859/1675] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:19 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1279 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:19.564146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-02559b87-4a82-4728-82a8-efecec395f53 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:19.566686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-02559b87-4a82-4728-82a8-efecec395f53 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:19.596932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-02559b87-4a82-4728-82a8-efecec395f53 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:19.599732 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-71ba7e2a-bebc-4ecb-b0bc-33d6477401d4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1411 microversion: 2.1 time: 0.120117 May 28 21:08:19.600333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-02559b87-4a82-4728-82a8-efecec395f53 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:19.600484 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 817/1676] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:19 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1411 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:19.601733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-02559b87-4a82-4728-82a8-efecec395f53 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:19.602456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-02559b87-4a82-4728-82a8-efecec395f53 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:19.610696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-972d68d1-6a57-40ac-b876-61e0fc3669dd req-50ad8ebd-ff4d-4a6a-8e63-e6a5adbc46ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2332865a-7f64-4b42-bef6-75a5d7c6c77f", "tag": "75b54983-d107-4ad1-a9f9-b77effb39ba3"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:19.638495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-972d68d1-6a57-40ac-b876-61e0fc3669dd req-50ad8ebd-ff4d-4a6a-8e63-e6a5adbc46ae service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:19.638936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-972d68d1-6a57-40ac-b876-61e0fc3669dd req-50ad8ebd-ff4d-4a6a-8e63-e6a5adbc46ae service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:19.675132 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-972d68d1-6a57-40ac-b876-61e0fc3669dd req-50ad8ebd-ff4d-4a6a-8e63-e6a5adbc46ae service nova] Creating event network-changed:75b54983-d107-4ad1-a9f9-b77effb39ba3 for instance 2332865a-7f64-4b42-bef6-75a5d7c6c77f on nch1-master-1 May 28 21:08:19.677691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-02559b87-4a82-4728-82a8-efecec395f53 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:19.694523 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-972d68d1-6a57-40ac-b876-61e0fc3669dd req-50ad8ebd-ff4d-4a6a-8e63-e6a5adbc46ae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092865 May 28 21:08:19.702959 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 818/1677] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:19.711817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aea365dd-6311-4899-bf74-511b8b9da565 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:19.713131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aea365dd-6311-4899-bf74-511b8b9da565 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:19.730480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea365dd-6311-4899-bf74-511b8b9da565 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:19.731620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea365dd-6311-4899-bf74-511b8b9da565 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:19.732642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea365dd-6311-4899-bf74-511b8b9da565 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:19.737894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea365dd-6311-4899-bf74-511b8b9da565 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:19.998603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:20.026456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aea365dd-6311-4899-bf74-511b8b9da565 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:20.054711 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aea365dd-6311-4899-bf74-511b8b9da565 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1476 microversion: 2.1 time: 0.346972 May 28 21:08:20.077573 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 819/1678] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:19 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1476 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:20.086191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-29e6b3fd-124d-442f-badb-20f9e559e94d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:20.087103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-29e6b3fd-124d-442f-badb-20f9e559e94d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:20.098162 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-02559b87-4a82-4728-82a8-efecec395f53 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 204 len: 0 microversion: 2.1 time: 0.539110 May 28 21:08:20.101063 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 860/1679] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:08:19 2022] DELETE /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:20.107379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3fc4945a-2b03-4130-bc98-f7518a6be898 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:20.108413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3fc4945a-2b03-4130-bc98-f7518a6be898 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:20.117933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29e6b3fd-124d-442f-badb-20f9e559e94d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:20.124320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29e6b3fd-124d-442f-badb-20f9e559e94d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:20.127239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29e6b3fd-124d-442f-badb-20f9e559e94d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:20.129164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fc4945a-2b03-4130-bc98-f7518a6be898 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:20.130229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29e6b3fd-124d-442f-badb-20f9e559e94d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:20.134510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fc4945a-2b03-4130-bc98-f7518a6be898 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:20.136841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fc4945a-2b03-4130-bc98-f7518a6be898 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:20.138212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fc4945a-2b03-4130-bc98-f7518a6be898 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:20.443477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-29e6b3fd-124d-442f-badb-20f9e559e94d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:20.461418 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-29e6b3fd-124d-442f-badb-20f9e559e94d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1394 microversion: 2.1 time: 0.381998 May 28 21:08:20.462069 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 820/1680] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:20 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1394 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:20.493670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-71bca364-157b-4262-ac3b-38ba7b56e639 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:20.494333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-71bca364-157b-4262-ac3b-38ba7b56e639 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:20.506004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71bca364-157b-4262-ac3b-38ba7b56e639 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:20.506469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71bca364-157b-4262-ac3b-38ba7b56e639 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:20.507844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71bca364-157b-4262-ac3b-38ba7b56e639 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:20.513123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71bca364-157b-4262-ac3b-38ba7b56e639 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:20.584633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3fc4945a-2b03-4130-bc98-f7518a6be898 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:20.593012 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3fc4945a-2b03-4130-bc98-f7518a6be898 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1470 microversion: 2.1 time: 0.489615 May 28 21:08:20.604866 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 861/1681] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:20 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1470 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:20.618238 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-091c6750-0595-4dd0-a6d5-a3c12e225403 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:20.619329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-091c6750-0595-4dd0-a6d5-a3c12e225403 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:20.638287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-091c6750-0595-4dd0-a6d5-a3c12e225403 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:20.639053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-091c6750-0595-4dd0-a6d5-a3c12e225403 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:20.640610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-091c6750-0595-4dd0-a6d5-a3c12e225403 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:20.643532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-091c6750-0595-4dd0-a6d5-a3c12e225403 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:20.860849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-71bca364-157b-4262-ac3b-38ba7b56e639 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:20.871970 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-71bca364-157b-4262-ac3b-38ba7b56e639 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1198 microversion: 2.1 time: 0.382999 May 28 21:08:20.882255 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 821/1682] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:20 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1198 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:20.887994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-38eac670-9f59-412d-888e-65a6c3d16aef tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d647efc10>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:20.922287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-091c6750-0595-4dd0-a6d5-a3c12e225403 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:20.934800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-091c6750-0595-4dd0-a6d5-a3c12e225403 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:20.936801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-091c6750-0595-4dd0-a6d5-a3c12e225403 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:20.939046 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-091c6750-0595-4dd0-a6d5-a3c12e225403 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1279 microversion: 2.25 time: 0.331912 May 28 21:08:20.940360 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 862/1683] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:20 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1279 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:20.942311 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-38eac670-9f59-412d-888e-65a6c3d16aef tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1411 microversion: 2.1 time: 0.058748 May 28 21:08:20.946502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-e7dec758-6fb2-44c0-a786-cf50f3946fa6 req-ea22f385-03b2-4c1f-a740-6ca4dd48fc3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112841b9-f573-4e02-9bc8-40a32da993a8", "name": "network-vif-plugged", "status": "completed", "tag": "40a3af66-b200-42b6-8260-9397f158a0db"}, {"server_uuid": "7f0a48ef-bb58-4c86-82af-49c2023e022e", "name": "network-vif-plugged", "status": "completed", "tag": "883b584c-6f2d-4a9a-8b63-5dee79943508"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:20.948185 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 822/1684] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:20 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:20.956717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e7dec758-6fb2-44c0-a786-cf50f3946fa6 req-ea22f385-03b2-4c1f-a740-6ca4dd48fc3b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:20.957265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e7dec758-6fb2-44c0-a786-cf50f3946fa6 req-ea22f385-03b2-4c1f-a740-6ca4dd48fc3b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:20.972241 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e7dec758-6fb2-44c0-a786-cf50f3946fa6 req-ea22f385-03b2-4c1f-a740-6ca4dd48fc3b service nova] Creating event network-vif-plugged:40a3af66-b200-42b6-8260-9397f158a0db for instance 112841b9-f573-4e02-9bc8-40a32da993a8 on nch2-master-1 May 28 21:08:20.972884 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e7dec758-6fb2-44c0-a786-cf50f3946fa6 req-ea22f385-03b2-4c1f-a740-6ca4dd48fc3b service nova] Creating event network-vif-plugged:883b584c-6f2d-4a9a-8b63-5dee79943508 for instance 7f0a48ef-bb58-4c86-82af-49c2023e022e on nch1-master-1 May 28 21:08:20.981238 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-e7dec758-6fb2-44c0-a786-cf50f3946fa6 req-ea22f385-03b2-4c1f-a740-6ca4dd48fc3b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038908 May 28 21:08:20.981967 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 863/1685] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:21.080731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f885b802-c6cf-4842-b5aa-501a7c806b3c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:21.082189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f885b802-c6cf-4842-b5aa-501a7c806b3c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:21.089157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f885b802-c6cf-4842-b5aa-501a7c806b3c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:21.089653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f885b802-c6cf-4842-b5aa-501a7c806b3c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:21.090489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f885b802-c6cf-4842-b5aa-501a7c806b3c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:21.090942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f885b802-c6cf-4842-b5aa-501a7c806b3c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:21.304819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f885b802-c6cf-4842-b5aa-501a7c806b3c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:21.325009 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f885b802-c6cf-4842-b5aa-501a7c806b3c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1474 microversion: 2.1 time: 0.255365 May 28 21:08:21.328157 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 823/1686] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:21 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1474 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:21.490096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0bb74ad8-23d2-47c9-9214-512ee680e45b tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:21.490705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0bb74ad8-23d2-47c9-9214-512ee680e45b tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:21.523040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0bb74ad8-23d2-47c9-9214-512ee680e45b tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:21.523506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0bb74ad8-23d2-47c9-9214-512ee680e45b tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:21.530960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0bb74ad8-23d2-47c9-9214-512ee680e45b tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:21.544928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0bb74ad8-23d2-47c9-9214-512ee680e45b tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:21.613959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1dd99493-ce11-491b-bf17-1fa5423e08a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:21.615087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1dd99493-ce11-491b-bf17-1fa5423e08a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:21.636454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1dd99493-ce11-491b-bf17-1fa5423e08a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:21.640032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1dd99493-ce11-491b-bf17-1fa5423e08a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:21.641035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1dd99493-ce11-491b-bf17-1fa5423e08a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:21.642861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1dd99493-ce11-491b-bf17-1fa5423e08a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:22.101463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0bb74ad8-23d2-47c9-9214-512ee680e45b tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:22.120374 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0bb74ad8-23d2-47c9-9214-512ee680e45b tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1394 microversion: 2.1 time: 0.644894 May 28 21:08:22.126553 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 864/1687] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:21 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1394 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:22.151130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a7a230b7-76f5-40d0-a11f-688179969cab tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:22.151751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a7a230b7-76f5-40d0-a11f-688179969cab tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:22.171796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7a230b7-76f5-40d0-a11f-688179969cab tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:22.172623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7a230b7-76f5-40d0-a11f-688179969cab tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:22.173671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7a230b7-76f5-40d0-a11f-688179969cab tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:22.174407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7a230b7-76f5-40d0-a11f-688179969cab tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:22.257802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1dd99493-ce11-491b-bf17-1fa5423e08a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:22.265817 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1dd99493-ce11-491b-bf17-1fa5423e08a7 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1470 microversion: 2.1 time: 0.657590 May 28 21:08:22.266520 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 824/1688] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:21 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1470 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:22.278162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a5156b3d-321f-4fa8-8e5d-eb66365995fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d69cbf430>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:22.354186 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a5156b3d-321f-4fa8-8e5d-eb66365995fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1411 microversion: 2.1 time: 0.086584 May 28 21:08:22.354769 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 825/1689] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:22 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:22.364322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e0dd1756-1b98-4e74-ad67-d3112d62ced1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:22.364951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e0dd1756-1b98-4e74-ad67-d3112d62ced1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:22.385599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0dd1756-1b98-4e74-ad67-d3112d62ced1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:22.386869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0dd1756-1b98-4e74-ad67-d3112d62ced1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:22.388350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0dd1756-1b98-4e74-ad67-d3112d62ced1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:22.389487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0dd1756-1b98-4e74-ad67-d3112d62ced1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:22.534243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a7a230b7-76f5-40d0-a11f-688179969cab tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:22.537324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:22.544076 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a7a230b7-76f5-40d0-a11f-688179969cab tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1198 microversion: 2.1 time: 0.404877 May 28 21:08:22.553446 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 865/1690] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:22 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1198 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:22.566453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2bed5f98-a2e5-4f3e-98f9-35d8588aba7e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:22.567365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2bed5f98-a2e5-4f3e-98f9-35d8588aba7e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:22.575800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bed5f98-a2e5-4f3e-98f9-35d8588aba7e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:22.589788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bed5f98-a2e5-4f3e-98f9-35d8588aba7e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:22.590764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bed5f98-a2e5-4f3e-98f9-35d8588aba7e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:22.591423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bed5f98-a2e5-4f3e-98f9-35d8588aba7e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:22.658840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e0dd1756-1b98-4e74-ad67-d3112d62ced1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:22.674295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e0dd1756-1b98-4e74-ad67-d3112d62ced1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:22.676252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e0dd1756-1b98-4e74-ad67-d3112d62ced1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:22.679129 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e0dd1756-1b98-4e74-ad67-d3112d62ced1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1474 microversion: 2.25 time: 0.323357 May 28 21:08:22.683930 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 826/1691] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:22 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1474 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:22.704917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-350d144a-989b-4e19-b985-f3205a6ad5fd tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:22.705699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-350d144a-989b-4e19-b985-f3205a6ad5fd tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:22.714637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-350d144a-989b-4e19-b985-f3205a6ad5fd tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:22.717028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-350d144a-989b-4e19-b985-f3205a6ad5fd tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:22.721058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-350d144a-989b-4e19-b985-f3205a6ad5fd tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:22.721922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-350d144a-989b-4e19-b985-f3205a6ad5fd tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:22.852778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2bed5f98-a2e5-4f3e-98f9-35d8588aba7e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:22.858933 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2bed5f98-a2e5-4f3e-98f9-35d8588aba7e tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1471 microversion: 2.1 time: 0.304099 May 28 21:08:22.864624 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 866/1692] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:22 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1471 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:22.875905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e8367394-cbdb-4322-b2a1-101b86a3790f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:22.876458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e8367394-cbdb-4322-b2a1-101b86a3790f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:22.889004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e8367394-cbdb-4322-b2a1-101b86a3790f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:22.889787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e8367394-cbdb-4322-b2a1-101b86a3790f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:22.890799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e8367394-cbdb-4322-b2a1-101b86a3790f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:22.891474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e8367394-cbdb-4322-b2a1-101b86a3790f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:23.012046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-350d144a-989b-4e19-b985-f3205a6ad5fd tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'services' on Instance uuid 86838d0c-e2da-4d31-92e8-94fd9b6345a6 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:23.027186 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-350d144a-989b-4e19-b985-f3205a6ad5fd tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1965 microversion: 2.25 time: 0.326137 May 28 21:08:23.027790 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 827/1693] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:22 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1965 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:23.044512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-614008db-97f8-4082-aba2-cec3d7792bad tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:23.045153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-614008db-97f8-4082-aba2-cec3d7792bad tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:23.053118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-614008db-97f8-4082-aba2-cec3d7792bad tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:23.053619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-614008db-97f8-4082-aba2-cec3d7792bad tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:23.054447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-614008db-97f8-4082-aba2-cec3d7792bad tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:23.054918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-614008db-97f8-4082-aba2-cec3d7792bad tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:23.078568 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:23.224781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-614008db-97f8-4082-aba2-cec3d7792bad tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'services' on Instance uuid 86838d0c-e2da-4d31-92e8-94fd9b6345a6 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:23.243141 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-614008db-97f8-4082-aba2-cec3d7792bad tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1965 microversion: 2.25 time: 0.202348 May 28 21:08:23.243932 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 828/1694] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:23 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1965 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:08:23.252739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-50ab62ac-5725-4778-b478-f154e78c88bc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:23.256484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-50ab62ac-5725-4778-b478-f154e78c88bc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:23.261954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50ab62ac-5725-4778-b478-f154e78c88bc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:23.263341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50ab62ac-5725-4778-b478-f154e78c88bc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:23.264321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50ab62ac-5725-4778-b478-f154e78c88bc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:23.264936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50ab62ac-5725-4778-b478-f154e78c88bc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:23.459919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-50ab62ac-5725-4778-b478-f154e78c88bc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:23.471660 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-50ab62ac-5725-4778-b478-f154e78c88bc tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1394 microversion: 2.1 time: 0.226736 May 28 21:08:23.473136 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 829/1695] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:23 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1394 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:23.479342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b16dc47d-1f2d-4456-84c4-ff1334a0963e tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:23.481251 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:08:23.481251 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:08:23.483250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b16dc47d-1f2d-4456-84c4-ff1334a0963e tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:23.483821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b16dc47d-1f2d-4456-84c4-ff1334a0963e tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:23.484768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b16dc47d-1f2d-4456-84c4-ff1334a0963e tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:23.485793 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b16dc47d-1f2d-4456-84c4-ff1334a0963e tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:23.519322 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b16dc47d-1f2d-4456-84c4-ff1334a0963e tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.044649 May 28 21:08:23.520046 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 830/1696] 10.222.0.33 () {60 vars in 1216 bytes} [Sat May 28 21:08:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:08:23.541535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f7f5ba28-554b-43b4-b904-c13f2a068715 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:23.542133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f7f5ba28-554b-43b4-b904-c13f2a068715 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:23.562721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba28-554b-43b4-b904-c13f2a068715 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:23.563765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba28-554b-43b4-b904-c13f2a068715 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:23.564850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba28-554b-43b4-b904-c13f2a068715 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:23.565362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba28-554b-43b4-b904-c13f2a068715 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:23.640789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f7f5ba28-554b-43b4-b904-c13f2a068715 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:23.649132 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f7f5ba28-554b-43b4-b904-c13f2a068715 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 200 len: 1428 microversion: 2.1 time: 0.111951 May 28 21:08:23.649880 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 831/1697] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:23 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 1428 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:23.654441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-4e0c9a2a-06c2-49b7-ac0d-c93cd609558f req-6181ad06-2641-406e-baaf-b7fffbc3f31a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1", "name": "network-vif-deleted", "tag": "5af24189-413e-4d8f-814a-44d91619c0c7"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:23.663733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4e0c9a2a-06c2-49b7-ac0d-c93cd609558f req-6181ad06-2641-406e-baaf-b7fffbc3f31a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:23.664189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4e0c9a2a-06c2-49b7-ac0d-c93cd609558f req-6181ad06-2641-406e-baaf-b7fffbc3f31a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:23.675946 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-4e0c9a2a-06c2-49b7-ac0d-c93cd609558f req-6181ad06-2641-406e-baaf-b7fffbc3f31a service nova] Creating event network-vif-deleted:5af24189-413e-4d8f-814a-44d91619c0c7 for instance 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 on nch1-master-1 May 28 21:08:23.686586 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-4e0c9a2a-06c2-49b7-ac0d-c93cd609558f req-6181ad06-2641-406e-baaf-b7fffbc3f31a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035065 May 28 21:08:23.690756 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 832/1698] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:23.695939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-389f6e60-bde7-4c14-af1b-ec3fd599e44c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d69ccadc0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:23.747154 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-389f6e60-bde7-4c14-af1b-ec3fd599e44c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1411 microversion: 2.1 time: 0.054948 May 28 21:08:23.747850 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 833/1699] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:23 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1411 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:23.817029 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e8367394-cbdb-4322-b2a1-101b86a3790f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "POST /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100/action" status: 202 len: 0 microversion: 2.1 time: 0.944731 May 28 21:08:23.819798 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 867/1700] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:08:22 2022] POST /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100/action => generated 0 bytes in 948 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:08:23.825737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-41817c2a-e50d-48e8-99f8-a64e6506cb6c tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:23.827537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-41817c2a-e50d-48e8-99f8-a64e6506cb6c tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:23.836611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41817c2a-e50d-48e8-99f8-a64e6506cb6c tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:23.837133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41817c2a-e50d-48e8-99f8-a64e6506cb6c tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:23.848214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41817c2a-e50d-48e8-99f8-a64e6506cb6c tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:23.848214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41817c2a-e50d-48e8-99f8-a64e6506cb6c tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:23.868724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-41817c2a-e50d-48e8-99f8-a64e6506cb6c tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'flavor' on Instance uuid 86838d0c-e2da-4d31-92e8-94fd9b6345a6 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:23.884399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-41817c2a-e50d-48e8-99f8-a64e6506cb6c tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Going to try to live migrate instance to nch2-master-1 {{(pid=143128) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 21:08:23.921467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d908b630-5410-420b-bef5-38e94ade7fc4 tempest-FlavorsV2NegativeTest-1485428266 tempest-FlavorsV2NegativeTest-1485428266-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:23.943317 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d908b630-5410-420b-bef5-38e94ade7fc4 tempest-FlavorsV2NegativeTest-1485428266 tempest-FlavorsV2NegativeTest-1485428266-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.193131 May 28 21:08:23.944913 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 834/1701] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:08:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:23.949896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-94c52e45-ff56-49e9-89b1-bdd60567c71f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:23.950871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-94c52e45-ff56-49e9-89b1-bdd60567c71f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:23.976480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94c52e45-ff56-49e9-89b1-bdd60567c71f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:23.977316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94c52e45-ff56-49e9-89b1-bdd60567c71f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:23.978400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94c52e45-ff56-49e9-89b1-bdd60567c71f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:23.979075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94c52e45-ff56-49e9-89b1-bdd60567c71f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:24.294494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-94c52e45-ff56-49e9-89b1-bdd60567c71f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:24.308083 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-94c52e45-ff56-49e9-89b1-bdd60567c71f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1198 microversion: 2.1 time: 0.361272 May 28 21:08:24.310317 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 835/1702] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:23 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1198 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:24.326318 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9b7451fe-c27b-4334-b182-6227b2340769 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:24.331314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9b7451fe-c27b-4334-b182-6227b2340769 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:24.354211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b7451fe-c27b-4334-b182-6227b2340769 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:24.355249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b7451fe-c27b-4334-b182-6227b2340769 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:24.356570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b7451fe-c27b-4334-b182-6227b2340769 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:24.358574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b7451fe-c27b-4334-b182-6227b2340769 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:24.798532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9b7451fe-c27b-4334-b182-6227b2340769 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:24.811776 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9b7451fe-c27b-4334-b182-6227b2340769 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1470 microversion: 2.1 time: 0.498980 May 28 21:08:24.812665 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 836/1703] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:24 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1470 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:24.825382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9adf587b-b936-4c65-8bd5-c253a93fd8d8 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:24.826175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9adf587b-b936-4c65-8bd5-c253a93fd8d8 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:24.840065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9adf587b-b936-4c65-8bd5-c253a93fd8d8 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:24.843551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9adf587b-b936-4c65-8bd5-c253a93fd8d8 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:24.846762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9adf587b-b936-4c65-8bd5-c253a93fd8d8 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:24.849214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9adf587b-b936-4c65-8bd5-c253a93fd8d8 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:25.094870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9adf587b-b936-4c65-8bd5-c253a93fd8d8 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:25.103755 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9adf587b-b936-4c65-8bd5-c253a93fd8d8 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1574 microversion: 2.1 time: 0.282573 May 28 21:08:25.115499 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 837/1704] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:24 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1574 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:25.115499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-eb70f98f-2729-4261-903e-4826b1a60655 req-232d1282-ac04-4e34-9ee5-c53805629855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801b7889-1935-4bb4-8e8a-c34c2cf3c100", "name": "network-vif-plugged", "status": "completed", "tag": "0e646b8c-f3f2-4ee5-91b0-aea5324fcf34"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:25.123811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-eb70f98f-2729-4261-903e-4826b1a60655 req-232d1282-ac04-4e34-9ee5-c53805629855 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:25.124277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-eb70f98f-2729-4261-903e-4826b1a60655 req-232d1282-ac04-4e34-9ee5-c53805629855 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:25.140846 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-eb70f98f-2729-4261-903e-4826b1a60655 req-232d1282-ac04-4e34-9ee5-c53805629855 service nova] Creating event network-vif-plugged:0e646b8c-f3f2-4ee5-91b0-aea5324fcf34 for instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 on nch2-master-1 May 28 21:08:25.157233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-eb70f98f-2729-4261-903e-4826b1a60655 req-232d1282-ac04-4e34-9ee5-c53805629855 service nova] Instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:08:25.173367 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-eb70f98f-2729-4261-903e-4826b1a60655 req-232d1282-ac04-4e34-9ee5-c53805629855 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065500 May 28 21:08:25.175156 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 838/1705] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:25.180780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-08298f32-4922-4a26-bb9c-fd2dc20c3bc6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:25.181548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-08298f32-4922-4a26-bb9c-fd2dc20c3bc6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:25.188467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-08298f32-4922-4a26-bb9c-fd2dc20c3bc6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:25.189953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-08298f32-4922-4a26-bb9c-fd2dc20c3bc6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:25.190506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-08298f32-4922-4a26-bb9c-fd2dc20c3bc6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:25.190964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-08298f32-4922-4a26-bb9c-fd2dc20c3bc6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:25.232626 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-08298f32-4922-4a26-bb9c-fd2dc20c3bc6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] HTTP exception thrown: Instance 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 could not be found. May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-08298f32-4922-4a26-bb9c-fd2dc20c3bc6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Request method failure captured: May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 HTTP/1.1 May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko63S9ujoNVjbzSlNBIwxVY2Q5AFVR-UVWhYbJi9Uiz9UekTK1o7epqZDk_tlmvIuDTjLXkNiU6RvYy3hBvVwxyKeaMPOH_83uAwKWRKNsWK0H3fAptxoBUiyHKBpK0QoDLUjvemfYQiLZUDVHKOGwFy9SUG4nZTopFdtw5NG2wjQOc May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 348fbbc628b44152b05362657c11230d May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:08:25.248316 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:08:25.250300 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_348fbbc628b44152b05362657c11230d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/348fbbc628b44152b05362657c11230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:08:25.250300 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:25.250300 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 348fbbc628b44152b05362657c11230d May 28 21:08:25.250300 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:25.250300 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:08:25.250300 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:08:25.250300 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:08:25.250300 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 5e54b51913be4a2bab74aae347785727 May 28 21:08:25.250300 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:08:25.250300 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:08:25.250300 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 could not be found. May 28 21:08:25.250300 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1'} May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 could not be found. May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:08:25.251148 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 could not be found. May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 could not be found. May 28 21:08:25.252424 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:25.254965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-08298f32-4922-4a26-bb9c-fd2dc20c3bc6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Returning 404 to user: Instance 4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:08:25.254965 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-08298f32-4922-4a26-bb9c-fd2dc20c3bc6 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1" status: 404 len: 111 microversion: 2.1 time: 0.073681 May 28 21:08:25.257204 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 839/1706] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:25 2022] GET /compute/v2.1/servers/4ed5e3e8-c86b-4d6d-b78e-5e497f76d1b1 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:08:25.264483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d8b0b39c-da3c-43df-aa96-06d053ce0c02 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d69c71af0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:25.377148 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d8b0b39c-da3c-43df-aa96-06d053ce0c02 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1411 microversion: 2.1 time: 0.118709 May 28 21:08:25.377771 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 840/1707] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:25 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1411 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:25.388025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-76d42a2d-7221-411b-a20e-b3ca24f0d29a tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:25.388530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-76d42a2d-7221-411b-a20e-b3ca24f0d29a tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:25.397503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76d42a2d-7221-411b-a20e-b3ca24f0d29a tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:25.398000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76d42a2d-7221-411b-a20e-b3ca24f0d29a tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:25.400391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76d42a2d-7221-411b-a20e-b3ca24f0d29a tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:25.400391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76d42a2d-7221-411b-a20e-b3ca24f0d29a tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:25.486904 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-76d42a2d-7221-411b-a20e-b3ca24f0d29a tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106409 May 28 21:08:25.487903 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 841/1708] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:08:25 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:25.506200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a358f1bf-c912-430f-b6e5-20428847dfb4 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:25.511267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a358f1bf-c912-430f-b6e5-20428847dfb4 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:25.523185 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a358f1bf-c912-430f-b6e5-20428847dfb4 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:25.523659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a358f1bf-c912-430f-b6e5-20428847dfb4 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:25.532775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a358f1bf-c912-430f-b6e5-20428847dfb4 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:25.533253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a358f1bf-c912-430f-b6e5-20428847dfb4 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:25.582243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a358f1bf-c912-430f-b6e5-20428847dfb4 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:25.857495 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a358f1bf-c912-430f-b6e5-20428847dfb4 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 204 len: 0 microversion: 2.1 time: 0.368231 May 28 21:08:25.858472 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 842/1709] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:08:25 2022] DELETE /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:25.865748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5e3c0f6e-0a06-4a22-9920-c0260a2ada9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:25.868405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5e3c0f6e-0a06-4a22-9920-c0260a2ada9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:25.887347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5e3c0f6e-0a06-4a22-9920-c0260a2ada9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:25.887822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5e3c0f6e-0a06-4a22-9920-c0260a2ada9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:25.888635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5e3c0f6e-0a06-4a22-9920-c0260a2ada9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:25.889223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5e3c0f6e-0a06-4a22-9920-c0260a2ada9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:26.072021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5e3c0f6e-0a06-4a22-9920-c0260a2ada9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:26.086269 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5e3c0f6e-0a06-4a22-9920-c0260a2ada9b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1380 microversion: 2.1 time: 0.226699 May 28 21:08:26.087314 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 843/1710] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:25 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1380 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:26.092152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c30db2c9-263b-4813-9119-c351b201920a tempest-FlavorsV2NegativeTest-1485428266 tempest-FlavorsV2NegativeTest-1485428266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-244722196", "imageRef": "d41149ed-51d1-40b2-a24d-9f5d9f0adf55", "flavorRef": "452"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:26.158122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-c30db2c9-263b-4813-9119-c351b201920a tempest-FlavorsV2NegativeTest-1485428266 tempest-FlavorsV2NegativeTest-1485428266-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:08:26.419287 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-c30db2c9-263b-4813-9119-c351b201920a tempest-FlavorsV2NegativeTest-1485428266 tempest-FlavorsV2NegativeTest-1485428266-project] HTTP exception thrown: Flavor's memory is too small for requested image. May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c30db2c9-263b-4813-9119-c351b201920a tempest-FlavorsV2NegativeTest-1485428266 tempest-FlavorsV2NegativeTest-1485428266-project] Request method failure captured: May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 142 May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko9HP7xm8Gtn_ZYZU6l6HfK33XLO8o_eNN9D6BZ4a-Er359odjlWjwrwFtSVcZYahAeSaDyBg4Ru5EfVQaOkv6G0beVc5itkJx7doXOCe81SgBzRPLVITHOBkqWESHfwAtzidQz5Eq6bAMD7k-Is4nwNqKZQ3OIJMltVwAoUTbYAwnA May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: a11903b0e9b1485d9f27e6ee742d8b97 May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-FlavorsV2NegativeTest-1485428266 May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:08:26.421610 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:08:26.426381 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a11903b0e9b1485d9f27e6ee742d8b97", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a11903b0e9b1485d9f27e6ee742d8b97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a11903b0e9b1485d9f27e6ee742d8b97"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a11903b0e9b1485d9f27e6ee742d8b97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:08:26.426381 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-FlavorsV2NegativeTest-1485428266 May 28 21:08:26.426381 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: a11903b0e9b1485d9f27e6ee742d8b97 May 28 21:08:26.426381 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1485428266 May 28 21:08:26.426381 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-FlavorsV2NegativeTest-1485428266-project May 28 21:08:26.426381 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:08:26.426381 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:08:26.426381 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 372d1e7ed7e44a2d80bd7b76be7c4c42 May 28 21:08:26.426381 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-FlavorsV2NegativeTest-1485428266-project May 28 21:08:26.426381 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:08:26.426381 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-244722196", "imageRef": "d41149ed-51d1-40b2-a24d-9f5d9f0adf55", "flavorRef": "452"}} May 28 21:08:26.426381 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:08:26.426381 ncdv-master-1 devstack@n-api.service[143129]: exception: Flavor's memory is too small for requested image. May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-244722196', 'imageRef': 'd41149ed-51d1-40b2-a24d-9f5d9f0adf55', 'flavorRef': '452'}}} May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:26.427490 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:26.428885 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:26.430477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:26.430477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:26.430477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:08:26.430477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:08:26.430477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. May 28 21:08:26.430477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:26.430477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c30db2c9-263b-4813-9119-c351b201920a tempest-FlavorsV2NegativeTest-1485428266 tempest-FlavorsV2NegativeTest-1485428266-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:08:26.430477 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c30db2c9-263b-4813-9119-c351b201920a tempest-FlavorsV2NegativeTest-1485428266 tempest-FlavorsV2NegativeTest-1485428266-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.335366 May 28 21:08:26.430477 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 844/1711] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:08:26 2022] POST /compute/v2.1/servers => generated 93 bytes in 337 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 21:08:26.445300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4492111d-3bac-4104-91c6-48009cdf1a29 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:26.447642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4492111d-3bac-4104-91c6-48009cdf1a29 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:26.453020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4492111d-3bac-4104-91c6-48009cdf1a29 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:26.453893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4492111d-3bac-4104-91c6-48009cdf1a29 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:26.454650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4492111d-3bac-4104-91c6-48009cdf1a29 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:26.455273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4492111d-3bac-4104-91c6-48009cdf1a29 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:26.633729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4492111d-3bac-4104-91c6-48009cdf1a29 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:26.652762 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4492111d-3bac-4104-91c6-48009cdf1a29 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1470 microversion: 2.1 time: 0.222391 May 28 21:08:26.666487 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 845/1712] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:26 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:26.675111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2d6f5b39-82ba-4764-8ae1-85d293eebef9 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:26.676475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2d6f5b39-82ba-4764-8ae1-85d293eebef9 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:26.684443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d6f5b39-82ba-4764-8ae1-85d293eebef9 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:26.684918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d6f5b39-82ba-4764-8ae1-85d293eebef9 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:26.686498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d6f5b39-82ba-4764-8ae1-85d293eebef9 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:26.687302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d6f5b39-82ba-4764-8ae1-85d293eebef9 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:26.867697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2d6f5b39-82ba-4764-8ae1-85d293eebef9 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:26.899442 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2d6f5b39-82ba-4764-8ae1-85d293eebef9 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1472 microversion: 2.1 time: 0.230017 May 28 21:08:26.904832 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 846/1713] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:26 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1472 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:26.916551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f118a053-101b-414f-954d-e7ca3bfea20d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:26.918480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f118a053-101b-414f-954d-e7ca3bfea20d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:26.927637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f118a053-101b-414f-954d-e7ca3bfea20d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:26.928456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f118a053-101b-414f-954d-e7ca3bfea20d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:26.929867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f118a053-101b-414f-954d-e7ca3bfea20d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:26.930779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f118a053-101b-414f-954d-e7ca3bfea20d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:27.163711 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f118a053-101b-414f-954d-e7ca3bfea20d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1531 microversion: 2.1 time: 0.191091 May 28 21:08:27.163711 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 847/1714] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:26 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1531 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:27.163711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ec92ca74-37c8-49d5-85ee-c5541b882428 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d69c8a5e0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:27.257757 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ec92ca74-37c8-49d5-85ee-c5541b882428 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1411 microversion: 2.1 time: 0.104361 May 28 21:08:27.257757 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 848/1715] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:27 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1411 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:27.257757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d6337106-0290-40ae-817a-916f629295b5 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:27.257757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d6337106-0290-40ae-817a-916f629295b5 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:27.257757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6337106-0290-40ae-817a-916f629295b5 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:27.258942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6337106-0290-40ae-817a-916f629295b5 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:27.258942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6337106-0290-40ae-817a-916f629295b5 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:27.260521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6337106-0290-40ae-817a-916f629295b5 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:27.451793 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d6337106-0290-40ae-817a-916f629295b5 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:27.463579 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d6337106-0290-40ae-817a-916f629295b5 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1574 microversion: 2.1 time: 0.233891 May 28 21:08:27.464622 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 849/1716] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:27 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1574 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:27.469733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-b774bc04-8b7c-40a0-812a-2141959c9900 req-2744c510-5a10-4049-867a-c5bf16aac661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "112841b9-f573-4e02-9bc8-40a32da993a8", "tag": "40a3af66-b200-42b6-8260-9397f158a0db"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:27.482110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b774bc04-8b7c-40a0-812a-2141959c9900 req-2744c510-5a10-4049-867a-c5bf16aac661 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:27.482681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b774bc04-8b7c-40a0-812a-2141959c9900 req-2744c510-5a10-4049-867a-c5bf16aac661 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:27.495182 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b774bc04-8b7c-40a0-812a-2141959c9900 req-2744c510-5a10-4049-867a-c5bf16aac661 service nova] Creating event network-changed:40a3af66-b200-42b6-8260-9397f158a0db for instance 112841b9-f573-4e02-9bc8-40a32da993a8 on nch2-master-1 May 28 21:08:27.501589 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-b774bc04-8b7c-40a0-812a-2141959c9900 req-2744c510-5a10-4049-867a-c5bf16aac661 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035042 May 28 21:08:27.502926 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 850/1717] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:27.508414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ecd1cbb2-16f2-4268-86ea-8ef3c36146bf tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:27.512044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ecd1cbb2-16f2-4268-86ea-8ef3c36146bf tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:27.515646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecd1cbb2-16f2-4268-86ea-8ef3c36146bf tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:27.516481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecd1cbb2-16f2-4268-86ea-8ef3c36146bf tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:27.517367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecd1cbb2-16f2-4268-86ea-8ef3c36146bf tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:27.517946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecd1cbb2-16f2-4268-86ea-8ef3c36146bf tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:27.523552 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:27.681903 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ecd1cbb2-16f2-4268-86ea-8ef3c36146bf tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1531 microversion: 2.1 time: 0.177799 May 28 21:08:27.682838 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 851/1718] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:27 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1531 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:27.687706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c6a1a3a3-bdda-4b77-824d-6e5edebef33c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:27.688932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c6a1a3a3-bdda-4b77-824d-6e5edebef33c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:27.695929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6a1a3a3-bdda-4b77-824d-6e5edebef33c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:27.696562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6a1a3a3-bdda-4b77-824d-6e5edebef33c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:27.697295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6a1a3a3-bdda-4b77-824d-6e5edebef33c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:27.697740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6a1a3a3-bdda-4b77-824d-6e5edebef33c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:27.913142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c6a1a3a3-bdda-4b77-824d-6e5edebef33c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:27.921234 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c6a1a3a3-bdda-4b77-824d-6e5edebef33c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1470 microversion: 2.1 time: 0.237346 May 28 21:08:27.921877 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 852/1719] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:27 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1470 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:27.930366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6023a772-2b14-4adc-8207-4f3c56deef71 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:27.931824 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:08:27.931824 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:08:27.933046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6023a772-2b14-4adc-8207-4f3c56deef71 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:27.933645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6023a772-2b14-4adc-8207-4f3c56deef71 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:27.934334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6023a772-2b14-4adc-8207-4f3c56deef71 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:27.934780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6023a772-2b14-4adc-8207-4f3c56deef71 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:27.969869 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6023a772-2b14-4adc-8207-4f3c56deef71 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042536 May 28 21:08:27.969869 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 853/1720] 10.222.0.33 () {58 vars in 1175 bytes} [Sat May 28 21:08:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:27.972195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8830cb43-88ba-4544-832f-5375d735ed4f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:27.972823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8830cb43-88ba-4544-832f-5375d735ed4f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:27.993378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8830cb43-88ba-4544-832f-5375d735ed4f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:27.993590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8830cb43-88ba-4544-832f-5375d735ed4f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:27.994416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8830cb43-88ba-4544-832f-5375d735ed4f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:27.994869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8830cb43-88ba-4544-832f-5375d735ed4f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:28.271953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8830cb43-88ba-4544-832f-5375d735ed4f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:28.281075 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8830cb43-88ba-4544-832f-5375d735ed4f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1472 microversion: 2.1 time: 0.313004 May 28 21:08:28.282985 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 854/1721] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:27 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1472 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:28.299141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-55a27350-416e-4740-9283-983437eb2c0d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:28.300657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-55a27350-416e-4740-9283-983437eb2c0d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:28.307616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-55a27350-416e-4740-9283-983437eb2c0d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:28.308291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-55a27350-416e-4740-9283-983437eb2c0d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:28.309822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-55a27350-416e-4740-9283-983437eb2c0d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:28.310421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-55a27350-416e-4740-9283-983437eb2c0d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:28.341280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-55a27350-416e-4740-9283-983437eb2c0d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lazy-loading 'flavor' on Instance uuid 7f0a48ef-bb58-4c86-82af-49c2023e022e {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:28.361983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-55a27350-416e-4740-9283-983437eb2c0d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Going to try to live migrate instance to nch2-master-1 {{(pid=143129) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 21:08:30.020727 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-41817c2a-e50d-48e8-99f8-a64e6506cb6c tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6/action" status: 202 len: 0 microversion: 2.25 time: 6.193498 May 28 21:08:30.020727 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 868/1722] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:08:23 2022] POST /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6/action => generated 0 bytes in 6195 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:30.025567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dc14b7d0-a6a3-42ab-8d23-83a19015f5b9 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d579f18b0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:30.091914 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dc14b7d0-a6a3-42ab-8d23-83a19015f5b9 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1420 microversion: 2.1 time: 0.070814 May 28 21:08:30.093207 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 869/1723] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:30 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:30.099222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3a6cd7ec-06ed-459f-bdaa-49ef88b81cea tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:30.113756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3a6cd7ec-06ed-459f-bdaa-49ef88b81cea tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:30.122489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a6cd7ec-06ed-459f-bdaa-49ef88b81cea tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:30.123134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a6cd7ec-06ed-459f-bdaa-49ef88b81cea tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:30.124480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a6cd7ec-06ed-459f-bdaa-49ef88b81cea tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:30.125095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a6cd7ec-06ed-459f-bdaa-49ef88b81cea tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:30.425523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3a6cd7ec-06ed-459f-bdaa-49ef88b81cea tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:30.434767 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3a6cd7ec-06ed-459f-bdaa-49ef88b81cea tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1470 microversion: 2.1 time: 0.339405 May 28 21:08:30.445113 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 870/1724] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:30 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1470 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:30.445113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3b49d5be-c866-4e4b-bfed-752a71d55f82 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:30.445113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3b49d5be-c866-4e4b-bfed-752a71d55f82 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:30.466005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b49d5be-c866-4e4b-bfed-752a71d55f82 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:30.467580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b49d5be-c866-4e4b-bfed-752a71d55f82 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:30.468632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b49d5be-c866-4e4b-bfed-752a71d55f82 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:30.469310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b49d5be-c866-4e4b-bfed-752a71d55f82 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:30.512381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b49d5be-c866-4e4b-bfed-752a71d55f82 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:30.513127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b49d5be-c866-4e4b-bfed-752a71d55f82 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:30.513596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-3b49d5be-c866-4e4b-bfed-752a71d55f82 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lazy-loading 'fault' on Instance uuid dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:30.566960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3b49d5be-c866-4e4b-bfed-752a71d55f82 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:30.575814 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3b49d5be-c866-4e4b-bfed-752a71d55f82 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 200 len: 1307 microversion: 2.1 time: 0.139369 May 28 21:08:30.576434 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 871/1725] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:30 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 1307 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:30.581862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-095feaea-521c-460d-92b3-4a96c8f10663 req-49aaf007-7e32-4270-bacf-4ea63715497b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc6c2f13-ac6f-47e9-b104-cf1fadc55f14", "name": "network-vif-deleted", "tag": "fceaa8d6-4e66-44d1-bffb-f7ab021ef0ae"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:30.590784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-095feaea-521c-460d-92b3-4a96c8f10663 req-49aaf007-7e32-4270-bacf-4ea63715497b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:30.591156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-095feaea-521c-460d-92b3-4a96c8f10663 req-49aaf007-7e32-4270-bacf-4ea63715497b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:30.604667 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-095feaea-521c-460d-92b3-4a96c8f10663 req-49aaf007-7e32-4270-bacf-4ea63715497b service nova] Creating event network-vif-deleted:fceaa8d6-4e66-44d1-bffb-f7ab021ef0ae for instance dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 on nch2-master-1 May 28 21:08:30.610408 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-095feaea-521c-460d-92b3-4a96c8f10663 req-49aaf007-7e32-4270-bacf-4ea63715497b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031989 May 28 21:08:30.611205 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 872/1726] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:30.617937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c8a82e1f-257a-4320-8394-2cd088275791 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:30.618661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c8a82e1f-257a-4320-8394-2cd088275791 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:30.626408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8a82e1f-257a-4320-8394-2cd088275791 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:30.628331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8a82e1f-257a-4320-8394-2cd088275791 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:30.628331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8a82e1f-257a-4320-8394-2cd088275791 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:30.628331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8a82e1f-257a-4320-8394-2cd088275791 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:30.837493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c8a82e1f-257a-4320-8394-2cd088275791 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:30.847454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c8a82e1f-257a-4320-8394-2cd088275791 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:30.849187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c8a82e1f-257a-4320-8394-2cd088275791 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:30.850417 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c8a82e1f-257a-4320-8394-2cd088275791 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1484 microversion: 2.25 time: 0.237754 May 28 21:08:30.851459 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 873/1727] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:30 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1484 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:30.856116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-092a7bc6-ed18-4455-bdc7-a6e49e5723bd tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d57a12af0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:30.909309 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-092a7bc6-ed18-4455-bdc7-a6e49e5723bd tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 200 len: 1420 microversion: 2.1 time: 0.056591 May 28 21:08:30.909934 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 874/1728] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:08:30 2022] GET /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:31.053226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a066180e-d7f4-492a-91e9-3091f0c0aa47 tempest-AbsoluteLimitsNegativeTestJSON-445041294 tempest-AbsoluteLimitsNegativeTestJSON-445041294-project] Calling method '.version_select at 0x7f4d645663a0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:31.066086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a066180e-d7f4-492a-91e9-3091f0c0aa47 tempest-AbsoluteLimitsNegativeTestJSON-445041294 tempest-AbsoluteLimitsNegativeTestJSON-445041294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:31.067025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a066180e-d7f4-492a-91e9-3091f0c0aa47 tempest-AbsoluteLimitsNegativeTestJSON-445041294 tempest-AbsoluteLimitsNegativeTestJSON-445041294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:31.068119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a066180e-d7f4-492a-91e9-3091f0c0aa47 tempest-AbsoluteLimitsNegativeTestJSON-445041294 tempest-AbsoluteLimitsNegativeTestJSON-445041294-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:31.068630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a066180e-d7f4-492a-91e9-3091f0c0aa47 tempest-AbsoluteLimitsNegativeTestJSON-445041294 tempest-AbsoluteLimitsNegativeTestJSON-445041294-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:31.092072 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a066180e-d7f4-492a-91e9-3091f0c0aa47 tempest-AbsoluteLimitsNegativeTestJSON-445041294 tempest-AbsoluteLimitsNegativeTestJSON-445041294-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.180912 May 28 21:08:31.094779 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 875/1729] 10.222.0.33 () {58 vars in 1121 bytes} [Sat May 28 21:08:30 2022] GET /compute/v2.1/limits => generated 511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:31.098218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-69b34e5a-461e-4485-9770-2988923936b5 req-b9331798-a332-4f08-ba36-032c75589a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801b7889-1935-4bb4-8e8a-c34c2cf3c100", "name": "network-vif-unplugged", "status": "completed", "tag": "0e646b8c-f3f2-4ee5-91b0-aea5324fcf34"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:31.117496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-69b34e5a-461e-4485-9770-2988923936b5 req-b9331798-a332-4f08-ba36-032c75589a0e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:31.118401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-69b34e5a-461e-4485-9770-2988923936b5 req-b9331798-a332-4f08-ba36-032c75589a0e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:31.134295 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-69b34e5a-461e-4485-9770-2988923936b5 req-b9331798-a332-4f08-ba36-032c75589a0e service nova] Creating event network-vif-unplugged:0e646b8c-f3f2-4ee5-91b0-aea5324fcf34 for instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 on nch1-master-1 May 28 21:08:31.140216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-69b34e5a-461e-4485-9770-2988923936b5 req-b9331798-a332-4f08-ba36-032c75589a0e service nova] Instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:08:31.154929 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-69b34e5a-461e-4485-9770-2988923936b5 req-b9331798-a332-4f08-ba36-032c75589a0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060888 May 28 21:08:31.155983 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 876/1730] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:31.161896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8e15e095-9ed0-4d94-bbec-73461d98fdae tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d579ed3a0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:31.741779 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-55a27350-416e-4740-9283-983437eb2c0d tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e/action" status: 202 len: 0 microversion: 2.1 time: 3.448633 May 28 21:08:31.743337 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 855/1731] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:08:28 2022] POST /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e/action => generated 0 bytes in 3460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:08:31.750207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89325cf6-a558-415f-8235-3d0f54102420 tempest-AbsoluteLimitsNegativeTestJSON-445041294 tempest-AbsoluteLimitsNegativeTestJSON-445041294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1256984722", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:31.833804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-89325cf6-a558-415f-8235-3d0f54102420 tempest-AbsoluteLimitsNegativeTestJSON-445041294 tempest-AbsoluteLimitsNegativeTestJSON-445041294-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:08:32.122332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-89325cf6-a558-415f-8235-3d0f54102420 tempest-AbsoluteLimitsNegativeTestJSON-445041294 tempest-AbsoluteLimitsNegativeTestJSON-445041294-project] Getting quotas for project 301f910ecee3465e8c6e8055ef99cf8d. Resources: dict_keys(['metadata_items']) {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:08:32.128901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-89325cf6-a558-415f-8235-3d0f54102420 tempest-AbsoluteLimitsNegativeTestJSON-445041294 tempest-AbsoluteLimitsNegativeTestJSON-445041294-project] Getting quotas for user b8d6261a1bea4c7a89df60b092f068ea and project 301f910ecee3465e8c6e8055ef99cf8d. Resources: dict_keys(['metadata_items']) {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:08:32.143026 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-89325cf6-a558-415f-8235-3d0f54102420 tempest-AbsoluteLimitsNegativeTestJSON-445041294 tempest-AbsoluteLimitsNegativeTestJSON-445041294-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89325cf6-a558-415f-8235-3d0f54102420 tempest-AbsoluteLimitsNegativeTestJSON-445041294 tempest-AbsoluteLimitsNegativeTestJSON-445041294-project] Request method failure captured: May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 1752 May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko9OsRk9ZLLxzFe3bncj30kSqBCIoZ_1vzLbwGiLeaj-U8JAAvCa4wHnY69xLYPQirb-lMkxVGGHsH4yMzO1UQtoDHGIhb4PrSiS1MuUyy2ch6sdtUst1iQhMMCjDrOfejX5LX3n7ea3Z0Pd5ih8Tbq2jzqsWpAdc9wBUMvYRr5VbSc May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 301f910ecee3465e8c6e8055ef99cf8d May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-445041294 May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_301f910ecee3465e8c6e8055ef99cf8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/301f910ecee3465e8c6e8055ef99cf8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/301f910ecee3465e8c6e8055ef99cf8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/301f910ecee3465e8c6e8055ef99cf8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-445041294 May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 301f910ecee3465e8c6e8055ef99cf8d May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-445041294 May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-445041294-project May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: b8d6261a1bea4c7a89df60b092f068ea May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-445041294-project May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1256984722", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:08:32.145096 ncdv-master-1 devstack@n-api.service[143129]: exception: Maximum number of metadata items exceeds 128 May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1256984722', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:08:32.147596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89325cf6-a558-415f-8235-3d0f54102420 tempest-AbsoluteLimitsNegativeTestJSON-445041294 tempest-AbsoluteLimitsNegativeTestJSON-445041294-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-89325cf6-a558-415f-8235-3d0f54102420 tempest-AbsoluteLimitsNegativeTestJSON-445041294 tempest-AbsoluteLimitsNegativeTestJSON-445041294-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.401994 May 28 21:08:32.150556 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 856/1732] 10.222.0.33 () {60 vars in 1147 bytes} [Sat May 28 21:08:31 2022] POST /compute/v2.1/servers => generated 87 bytes in 403 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) May 28 21:08:32.283742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-325eed00-9c91-4887-8201-67c88f04c6b2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:32.284566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-325eed00-9c91-4887-8201-67c88f04c6b2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:32.292341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:32.298066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-325eed00-9c91-4887-8201-67c88f04c6b2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:32.298538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-325eed00-9c91-4887-8201-67c88f04c6b2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:32.300319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-325eed00-9c91-4887-8201-67c88f04c6b2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:32.301041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-325eed00-9c91-4887-8201-67c88f04c6b2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:32.464860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-325eed00-9c91-4887-8201-67c88f04c6b2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:32.473339 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-325eed00-9c91-4887-8201-67c88f04c6b2 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1470 microversion: 2.1 time: 0.324928 May 28 21:08:32.474793 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 857/1733] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:32 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1470 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:32.479822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1bc1db63-37e5-48b5-9f4e-dde57318ed7c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:32.480750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1bc1db63-37e5-48b5-9f4e-dde57318ed7c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: dc6c2f13-ac6f-47e9-b104-cf1fadc55f14] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:32.488099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1bc1db63-37e5-48b5-9f4e-dde57318ed7c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:32.488551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1bc1db63-37e5-48b5-9f4e-dde57318ed7c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:32.489346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1bc1db63-37e5-48b5-9f4e-dde57318ed7c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:32.489787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1bc1db63-37e5-48b5-9f4e-dde57318ed7c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:32.505831 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-1bc1db63-37e5-48b5-9f4e-dde57318ed7c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] HTTP exception thrown: Instance dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 could not be found. May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1bc1db63-37e5-48b5-9f4e-dde57318ed7c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Request method failure captured: May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 HTTP/1.1 May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko63S9ujoNVjbzSlNBIwxVY2Q5AFVR-UVWhYbJi9Uiz9UekTK1o7epqZDk_tlmvIuDTjLXkNiU6RvYy3hBvVwxyKeaMPOH_83uAwKWRKNsWK0H3fAptxoBUiyHKBpK0QoDLUjvemfYQiLZUDVHKOGwFy9SUG4nZTopFdtw5NG2wjQOc May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 348fbbc628b44152b05362657c11230d May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_348fbbc628b44152b05362657c11230d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/348fbbc628b44152b05362657c11230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 348fbbc628b44152b05362657c11230d May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 5e54b51913be4a2bab74aae347785727 May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 could not be found. May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'dc6c2f13-ac6f-47e9-b104-cf1fadc55f14'} May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 could not be found. May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 could not be found. May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:32.507414 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:32.512647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:32.512647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:32.512647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:32.512647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:08:32.512647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:08:32.512647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 could not be found. May 28 21:08:32.512647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:32.512647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1bc1db63-37e5-48b5-9f4e-dde57318ed7c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Returning 404 to user: Instance dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:08:32.512647 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1bc1db63-37e5-48b5-9f4e-dde57318ed7c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14" status: 404 len: 111 microversion: 2.1 time: 0.032790 May 28 21:08:32.512647 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 858/1734] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:32 2022] GET /compute/v2.1/servers/dc6c2f13-ac6f-47e9-b104-cf1fadc55f14 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:08:32.514587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2b62a6ab-7e41-4db8-b45d-b04064967f88 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:32.515708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2b62a6ab-7e41-4db8-b45d-b04064967f88 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:32.522542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b62a6ab-7e41-4db8-b45d-b04064967f88 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:32.523229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b62a6ab-7e41-4db8-b45d-b04064967f88 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:32.524226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b62a6ab-7e41-4db8-b45d-b04064967f88 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:32.524858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b62a6ab-7e41-4db8-b45d-b04064967f88 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:32.553462 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8e15e095-9ed0-4d94-bbec-73461d98fdae tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 204 len: 0 microversion: 2.1 time: 1.395509 May 28 21:08:32.554720 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 877/1735] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:31 2022] DELETE /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 0 bytes in 1398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:32.562148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d9a62b5f-9d5b-4832-a753-33b0f739f277 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:32.563764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d9a62b5f-9d5b-4832-a753-33b0f739f277 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:32.571053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9a62b5f-9d5b-4832-a753-33b0f739f277 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:32.571820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9a62b5f-9d5b-4832-a753-33b0f739f277 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:32.572602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9a62b5f-9d5b-4832-a753-33b0f739f277 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:32.573045 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9a62b5f-9d5b-4832-a753-33b0f739f277 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:32.731836 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2b62a6ab-7e41-4db8-b45d-b04064967f88 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:32.758227 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2b62a6ab-7e41-4db8-b45d-b04064967f88 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.245424 May 28 21:08:32.759964 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 859/1736] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:32 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:32.765500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-13835a73-be31-4a8e-8621-5c5b56e1da6c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:32.770088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-13835a73-be31-4a8e-8621-5c5b56e1da6c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:32.773027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d9a62b5f-9d5b-4832-a753-33b0f739f277 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:32.783145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13835a73-be31-4a8e-8621-5c5b56e1da6c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:32.784103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13835a73-be31-4a8e-8621-5c5b56e1da6c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:32.785288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13835a73-be31-4a8e-8621-5c5b56e1da6c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:32.785912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13835a73-be31-4a8e-8621-5c5b56e1da6c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:32.800919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d9a62b5f-9d5b-4832-a753-33b0f739f277 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:32.803132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d9a62b5f-9d5b-4832-a753-33b0f739f277 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:32.804662 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d9a62b5f-9d5b-4832-a753-33b0f739f277 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1484 microversion: 2.25 time: 0.248737 May 28 21:08:32.805578 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 878/1737] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:32 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1484 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:32.810846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b55151d3-7daf-4e2e-b8d8-b528da606370 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:32.811642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b55151d3-7daf-4e2e-b8d8-b528da606370 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:32.822525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-13835a73-be31-4a8e-8621-5c5b56e1da6c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:32.823369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b55151d3-7daf-4e2e-b8d8-b528da606370 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:32.824055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b55151d3-7daf-4e2e-b8d8-b528da606370 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:32.825054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b55151d3-7daf-4e2e-b8d8-b528da606370 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:32.825708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b55151d3-7daf-4e2e-b8d8-b528da606370 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:32.853108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b55151d3-7daf-4e2e-b8d8-b528da606370 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:33.184129 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b55151d3-7daf-4e2e-b8d8-b528da606370 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 204 len: 0 microversion: 2.1 time: 0.376310 May 28 21:08:33.184828 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 879/1738] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:08:32 2022] DELETE /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:33.187558 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-13835a73-be31-4a8e-8621-5c5b56e1da6c tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "DELETE /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 204 len: 0 microversion: 2.1 time: 0.423568 May 28 21:08:33.191010 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 860/1739] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:08:32 2022] DELETE /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:33.198048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-1f144428-37e6-4e5a-8696-6d5fe1b580c6 req-f3f881ed-ae19-4434-9112-ea66d6d1587d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "801b7889-1935-4bb4-8e8a-c34c2cf3c100", "tag": "0e646b8c-f3f2-4ee5-91b0-aea5324fcf34"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:33.208022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1f144428-37e6-4e5a-8696-6d5fe1b580c6 req-f3f881ed-ae19-4434-9112-ea66d6d1587d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:33.208488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1f144428-37e6-4e5a-8696-6d5fe1b580c6 req-f3f881ed-ae19-4434-9112-ea66d6d1587d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:33.236077 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-1f144428-37e6-4e5a-8696-6d5fe1b580c6 req-f3f881ed-ae19-4434-9112-ea66d6d1587d service nova] Creating event network-changed:0e646b8c-f3f2-4ee5-91b0-aea5324fcf34 for instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 on nch1-master-1 May 28 21:08:33.249102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-1f144428-37e6-4e5a-8696-6d5fe1b580c6 req-f3f881ed-ae19-4434-9112-ea66d6d1587d service nova] Instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:08:33.269779 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-1f144428-37e6-4e5a-8696-6d5fe1b580c6 req-f3f881ed-ae19-4434-9112-ea66d6d1587d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076113 May 28 21:08:33.270782 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 861/1740] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:33.278546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9a9e755b-0554-454a-8487-cdfb03a92674 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:33.279270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9a9e755b-0554-454a-8487-cdfb03a92674 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:33.290131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a9e755b-0554-454a-8487-cdfb03a92674 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:33.290646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a9e755b-0554-454a-8487-cdfb03a92674 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:33.291447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a9e755b-0554-454a-8487-cdfb03a92674 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:33.291898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a9e755b-0554-454a-8487-cdfb03a92674 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:33.374883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-29e95475-67b2-4914-b71c-cbbeee7017d3 req-8e0b1af0-d052-4742-96dd-e55fbbe3c1e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f837cef-04b0-4491-8edf-c10423944be0", "name": "network-vif-unplugged", "status": "completed", "tag": "f9af25ca-e630-49f5-9345-5a9075542855"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:33.385647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-29e95475-67b2-4914-b71c-cbbeee7017d3 req-8e0b1af0-d052-4742-96dd-e55fbbe3c1e2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:33.386308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-29e95475-67b2-4914-b71c-cbbeee7017d3 req-8e0b1af0-d052-4742-96dd-e55fbbe3c1e2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:33.402368 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-29e95475-67b2-4914-b71c-cbbeee7017d3 req-8e0b1af0-d052-4742-96dd-e55fbbe3c1e2 service nova] Creating event network-vif-unplugged:f9af25ca-e630-49f5-9345-5a9075542855 for instance 1f837cef-04b0-4491-8edf-c10423944be0 on nch1-master-1 May 28 21:08:33.408875 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-29e95475-67b2-4914-b71c-cbbeee7017d3 req-8e0b1af0-d052-4742-96dd-e55fbbe3c1e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.222285 May 28 21:08:33.410894 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 880/1741] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:33.415981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1684984242", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "1d1e95b4-31c7-4a87-a450-6b766dbdbce1"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:33.458246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9a9e755b-0554-454a-8487-cdfb03a92674 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:33.467967 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9a9e755b-0554-454a-8487-cdfb03a92674 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1472 microversion: 2.1 time: 0.194219 May 28 21:08:33.468657 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 862/1742] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:33 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1472 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:33.492053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-143d6c99-3e35-44a6-9f3c-f959b29a920c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:33.492672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-143d6c99-3e35-44a6-9f3c-f959b29a920c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:33.494188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] validate_networks() for [('1d1e95b4-31c7-4a87-a450-6b766dbdbce1', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:08:33.498725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-143d6c99-3e35-44a6-9f3c-f959b29a920c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:33.499208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-143d6c99-3e35-44a6-9f3c-f959b29a920c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:33.499976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-143d6c99-3e35-44a6-9f3c-f959b29a920c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:33.501033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-143d6c99-3e35-44a6-9f3c-f959b29a920c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:33.700281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-143d6c99-3e35-44a6-9f3c-f959b29a920c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:33.709962 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-143d6c99-3e35-44a6-9f3c-f959b29a920c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1470 microversion: 2.1 time: 0.222202 May 28 21:08:33.711113 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 863/1743] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:33 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1470 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:33.777370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-66d48d4c-1a61-45c1-bbd3-b2a85ee601e2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:33.777958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-66d48d4c-1a61-45c1-bbd3-b2a85ee601e2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:33.787060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66d48d4c-1a61-45c1-bbd3-b2a85ee601e2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:33.787603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66d48d4c-1a61-45c1-bbd3-b2a85ee601e2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:33.788407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66d48d4c-1a61-45c1-bbd3-b2a85ee601e2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:33.788855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66d48d4c-1a61-45c1-bbd3-b2a85ee601e2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:34.035926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-66d48d4c-1a61-45c1-bbd3-b2a85ee601e2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:34.045703 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-66d48d4c-1a61-45c1-bbd3-b2a85ee601e2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.271671 May 28 21:08:34.049976 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 864/1744] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:33 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:34.053322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-67be17b6-3240-43d2-b5ea-3ffea5e5087f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:34.054212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-67be17b6-3240-43d2-b5ea-3ffea5e5087f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:34.068712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67be17b6-3240-43d2-b5ea-3ffea5e5087f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:34.069552 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67be17b6-3240-43d2-b5ea-3ffea5e5087f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:34.070737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67be17b6-3240-43d2-b5ea-3ffea5e5087f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:34.078066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67be17b6-3240-43d2-b5ea-3ffea5e5087f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:34.086946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:08:34.087941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:08:34.088420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:08:34.089046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:08:34.089694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:08:34.103912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:34.104368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:34.105167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:34.105611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:34.144115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Getting quotas for project 158c1665476643cda0976e68ab5e595a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:08:34.150915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Getting quotas for user 04e5b86f94914df085b76e0d89b2230e and project 158c1665476643cda0976e68ab5e595a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:08:34.170602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:08:34.170602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:08:34.226754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-67be17b6-3240-43d2-b5ea-3ffea5e5087f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:34.236879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-67be17b6-3240-43d2-b5ea-3ffea5e5087f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:34.238602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-67be17b6-3240-43d2-b5ea-3ffea5e5087f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:34.239824 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-67be17b6-3240-43d2-b5ea-3ffea5e5087f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1484 microversion: 2.25 time: 0.191064 May 28 21:08:34.240445 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 865/1745] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:34 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1484 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:34.323169 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c4ffcba0-736d-4de8-a8fb-446463b66632 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911142 May 28 21:08:34.323879 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 881/1746] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:08:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:08:34.334619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5e074ef6-d8cd-48f9-a3e3-68c8023813d1 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:34.335252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5e074ef6-d8cd-48f9-a3e3-68c8023813d1 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:34.389356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5e074ef6-d8cd-48f9-a3e3-68c8023813d1 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:34.396987 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5e074ef6-d8cd-48f9-a3e3-68c8023813d1 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1208 microversion: 2.1 time: 0.066438 May 28 21:08:34.397643 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 866/1747] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:34 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1208 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:34.490195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-67bd7d71-c4be-4bff-8a00-f91d09e6ac03 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:34.491225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-67bd7d71-c4be-4bff-8a00-f91d09e6ac03 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:34.513411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67bd7d71-c4be-4bff-8a00-f91d09e6ac03 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:34.513762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67bd7d71-c4be-4bff-8a00-f91d09e6ac03 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:34.515078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67bd7d71-c4be-4bff-8a00-f91d09e6ac03 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:34.515717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67bd7d71-c4be-4bff-8a00-f91d09e6ac03 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:34.541496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:34.724144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-67bd7d71-c4be-4bff-8a00-f91d09e6ac03 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:34.726622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2e66ec78-8803-4d36-9897-f340a5563548 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:34.727508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2e66ec78-8803-4d36-9897-f340a5563548 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:34.732533 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-67bd7d71-c4be-4bff-8a00-f91d09e6ac03 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1472 microversion: 2.1 time: 0.248549 May 28 21:08:34.733504 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 882/1748] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:34 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:34.734492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e66ec78-8803-4d36-9897-f340a5563548 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:34.735150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e66ec78-8803-4d36-9897-f340a5563548 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:34.735929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e66ec78-8803-4d36-9897-f340a5563548 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:34.736369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e66ec78-8803-4d36-9897-f340a5563548 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:34.888160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2e66ec78-8803-4d36-9897-f340a5563548 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:34.893663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:34.898909 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2e66ec78-8803-4d36-9897-f340a5563548 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1470 microversion: 2.1 time: 0.176473 May 28 21:08:34.899498 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 867/1749] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:34 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:35.064128 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9ade2c7a-0815-473b-947c-d784c249ad4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:35.065142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9ade2c7a-0815-473b-947c-d784c249ad4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:35.073050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ade2c7a-0815-473b-947c-d784c249ad4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:35.073881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ade2c7a-0815-473b-947c-d784c249ad4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:35.074886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ade2c7a-0815-473b-947c-d784c249ad4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:35.075583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ade2c7a-0815-473b-947c-d784c249ad4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:35.263274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e954dde7-55eb-4358-ae7f-98ff53e1299e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:35.264937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e954dde7-55eb-4358-ae7f-98ff53e1299e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:35.275619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e954dde7-55eb-4358-ae7f-98ff53e1299e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:35.276935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e954dde7-55eb-4358-ae7f-98ff53e1299e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:35.277789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e954dde7-55eb-4358-ae7f-98ff53e1299e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:35.278334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e954dde7-55eb-4358-ae7f-98ff53e1299e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:35.472508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9ade2c7a-0815-473b-947c-d784c249ad4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:35.482355 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9ade2c7a-0815-473b-947c-d784c249ad4d tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.422781 May 28 21:08:35.486849 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 883/1750] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:35 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:35.492686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4bef38a7-10d6-4337-bacd-4f9b8fa6300b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:35.494473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4bef38a7-10d6-4337-bacd-4f9b8fa6300b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:35.501706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bef38a7-10d6-4337-bacd-4f9b8fa6300b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:35.502744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bef38a7-10d6-4337-bacd-4f9b8fa6300b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:35.503757 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bef38a7-10d6-4337-bacd-4f9b8fa6300b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:35.504306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bef38a7-10d6-4337-bacd-4f9b8fa6300b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:35.859876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4bef38a7-10d6-4337-bacd-4f9b8fa6300b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:35.876917 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4bef38a7-10d6-4337-bacd-4f9b8fa6300b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1212 microversion: 2.1 time: 0.384703 May 28 21:08:35.876917 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 884/1751] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:35 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1212 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:35.881393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-21a17518-0971-430f-9cd8-3e0c46aa678f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:35.882275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-21a17518-0971-430f-9cd8-3e0c46aa678f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:35.889867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21a17518-0971-430f-9cd8-3e0c46aa678f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:35.890275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21a17518-0971-430f-9cd8-3e0c46aa678f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:35.892229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21a17518-0971-430f-9cd8-3e0c46aa678f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:35.892896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21a17518-0971-430f-9cd8-3e0c46aa678f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:35.906287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e954dde7-55eb-4358-ae7f-98ff53e1299e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:35.923421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e954dde7-55eb-4358-ae7f-98ff53e1299e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:35.925397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e954dde7-55eb-4358-ae7f-98ff53e1299e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:35.926847 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e954dde7-55eb-4358-ae7f-98ff53e1299e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1484 microversion: 2.25 time: 0.671645 May 28 21:08:35.938745 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 868/1752] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:35 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1484 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:08:35.947417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-635a1a99-a99f-4268-99c0-144e7581de6a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:35.949048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-635a1a99-a99f-4268-99c0-144e7581de6a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:35.968446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-635a1a99-a99f-4268-99c0-144e7581de6a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:35.969856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-635a1a99-a99f-4268-99c0-144e7581de6a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:35.970835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-635a1a99-a99f-4268-99c0-144e7581de6a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:35.971484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-635a1a99-a99f-4268-99c0-144e7581de6a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:36.302268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-21a17518-0971-430f-9cd8-3e0c46aa678f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:36.310704 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-21a17518-0971-430f-9cd8-3e0c46aa678f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1472 microversion: 2.1 time: 0.434357 May 28 21:08:36.311278 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 885/1753] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:35 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1472 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:36.350133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-635a1a99-a99f-4268-99c0-144e7581de6a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:36.359118 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-635a1a99-a99f-4268-99c0-144e7581de6a tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1470 microversion: 2.1 time: 0.418923 May 28 21:08:36.359755 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 869/1754] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:35 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1470 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:36.482360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6fefbfcf-d40d-406a-8f57-8e7e45957804 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'create', calling method: .version_select at 0x7f4d579dcca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-922010646", "description": "tempest-description-822432653"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:36.503804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dd26ca73-3d23-4ae9-b166-2280f06866b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:36.504432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dd26ca73-3d23-4ae9-b166-2280f06866b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:36.510921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd26ca73-3d23-4ae9-b166-2280f06866b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:36.511378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd26ca73-3d23-4ae9-b166-2280f06866b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:36.512504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd26ca73-3d23-4ae9-b166-2280f06866b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:36.512945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd26ca73-3d23-4ae9-b166-2280f06866b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:36.754926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dd26ca73-3d23-4ae9-b166-2280f06866b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:36.767056 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dd26ca73-3d23-4ae9-b166-2280f06866b0 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.267827 May 28 21:08:36.779755 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 870/1755] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:36 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:36.785433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-a00e6267-b38b-43fb-bbcc-7681aeff73d8 req-8f8dd6b5-19f7-462b-af9d-11e0b8dfa970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d7a590-6a27-4730-8a64-ba9898a28ff6", "name": "network-vif-deleted", "tag": "142929bc-54fb-4100-8abc-ae7844c539b5"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:36.831739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a00e6267-b38b-43fb-bbcc-7681aeff73d8 req-8f8dd6b5-19f7-462b-af9d-11e0b8dfa970 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:36.833188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a00e6267-b38b-43fb-bbcc-7681aeff73d8 req-8f8dd6b5-19f7-462b-af9d-11e0b8dfa970 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:36.857932 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a00e6267-b38b-43fb-bbcc-7681aeff73d8 req-8f8dd6b5-19f7-462b-af9d-11e0b8dfa970 service nova] Creating event network-vif-deleted:142929bc-54fb-4100-8abc-ae7844c539b5 for instance 99d7a590-6a27-4730-8a64-ba9898a28ff6 on nch2-master-1 May 28 21:08:36.863683 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-a00e6267-b38b-43fb-bbcc-7681aeff73d8 req-8f8dd6b5-19f7-462b-af9d-11e0b8dfa970 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090563 May 28 21:08:36.865054 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 871/1756] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:36.893951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bbdec5ed-afec-4fa3-8547-87cab87663b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:36.894979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bbdec5ed-afec-4fa3-8547-87cab87663b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:36.902742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bbdec5ed-afec-4fa3-8547-87cab87663b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:36.904188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bbdec5ed-afec-4fa3-8547-87cab87663b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:36.905233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bbdec5ed-afec-4fa3-8547-87cab87663b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:36.905862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bbdec5ed-afec-4fa3-8547-87cab87663b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:37.100615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bbdec5ed-afec-4fa3-8547-87cab87663b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:37.133973 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bbdec5ed-afec-4fa3-8547-87cab87663b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1204 microversion: 2.1 time: 0.245706 May 28 21:08:37.135501 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 872/1757] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:36 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1204 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:37.142739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f30323aa-0040-466a-b0cb-f73eca111685 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:37.143952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f30323aa-0040-466a-b0cb-f73eca111685 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:37.150294 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6fefbfcf-d40d-406a-8f57-8e7e45957804 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.837652 May 28 21:08:37.151035 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 886/1758] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:08:36 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:37.164663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-56f16484-68f8-4b9d-9ad3-73b53c81a768 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'create', calling method: .version_select at 0x7f4d579edca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-221291577", "description": "tempest-description-1592097994"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:37.164992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f30323aa-0040-466a-b0cb-f73eca111685 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:37.165705 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f30323aa-0040-466a-b0cb-f73eca111685 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:37.167616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f30323aa-0040-466a-b0cb-f73eca111685 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:37.168235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f30323aa-0040-466a-b0cb-f73eca111685 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:37.383514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f30323aa-0040-466a-b0cb-f73eca111685 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:37.424997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f30323aa-0040-466a-b0cb-f73eca111685 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:37.427091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f30323aa-0040-466a-b0cb-f73eca111685 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:37.428996 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f30323aa-0040-466a-b0cb-f73eca111685 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1484 microversion: 2.25 time: 0.292352 May 28 21:08:37.429817 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 873/1759] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:37 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1484 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:37.443434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6f499105-9499-4744-8521-205c03f57e91 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:37.447578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6f499105-9499-4744-8521-205c03f57e91 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:37.456243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f499105-9499-4744-8521-205c03f57e91 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:37.456787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f499105-9499-4744-8521-205c03f57e91 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:37.457706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f499105-9499-4744-8521-205c03f57e91 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:37.458250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f499105-9499-4744-8521-205c03f57e91 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:37.492262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f499105-9499-4744-8521-205c03f57e91 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:37.492795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f499105-9499-4744-8521-205c03f57e91 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:37.493348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-6f499105-9499-4744-8521-205c03f57e91 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lazy-loading 'fault' on Instance uuid 99d7a590-6a27-4730-8a64-ba9898a28ff6 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:37.551222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6f499105-9499-4744-8521-205c03f57e91 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:37.561014 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6f499105-9499-4744-8521-205c03f57e91 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 200 len: 1307 microversion: 2.1 time: 0.129957 May 28 21:08:37.561594 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 874/1760] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:37 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 1307 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:37.567702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e819c972-5471-4e65-a9c7-c2fdc5ab3bdc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:37.568768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e819c972-5471-4e65-a9c7-c2fdc5ab3bdc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:37.578272 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-56f16484-68f8-4b9d-9ad3-73b53c81a768 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.414400 May 28 21:08:37.578272 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 887/1761] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:08:37 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:08:37.579304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e819c972-5471-4e65-a9c7-c2fdc5ab3bdc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:37.579304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e819c972-5471-4e65-a9c7-c2fdc5ab3bdc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:37.579304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e819c972-5471-4e65-a9c7-c2fdc5ab3bdc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:37.579304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e819c972-5471-4e65-a9c7-c2fdc5ab3bdc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:37.631268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-88380649", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "73533db2-8435-4fc2-907c-813db64c480b"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:37.702707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] validate_networks() for [('73533db2-8435-4fc2-907c-813db64c480b', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:08:37.853438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e819c972-5471-4e65-a9c7-c2fdc5ab3bdc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:37.863976 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e819c972-5471-4e65-a9c7-c2fdc5ab3bdc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1463 microversion: 2.1 time: 0.301287 May 28 21:08:37.864845 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 875/1762] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:37 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1463 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:37.873348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-224f2e28-9d36-4df5-89de-4928f2d58aeb req-7c17281e-22eb-4cf5-b3c7-49228788742a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86838d0c-e2da-4d31-92e8-94fd9b6345a6", "name": "network-vif-unplugged", "status": "completed", "tag": "90dbd5de-6ef5-4258-8dc2-8e5a1f5600b0"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:37.883192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-224f2e28-9d36-4df5-89de-4928f2d58aeb req-7c17281e-22eb-4cf5-b3c7-49228788742a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:37.883942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-224f2e28-9d36-4df5-89de-4928f2d58aeb req-7c17281e-22eb-4cf5-b3c7-49228788742a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:37.901189 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-224f2e28-9d36-4df5-89de-4928f2d58aeb req-7c17281e-22eb-4cf5-b3c7-49228788742a service nova] Creating event network-vif-unplugged:90dbd5de-6ef5-4258-8dc2-8e5a1f5600b0 for instance 86838d0c-e2da-4d31-92e8-94fd9b6345a6 on nch1-master-1 May 28 21:08:37.911392 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-224f2e28-9d36-4df5-89de-4928f2d58aeb req-7c17281e-22eb-4cf5-b3c7-49228788742a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043556 May 28 21:08:37.912334 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 876/1763] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:37.924298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-00cf48b5-7181-476b-af16-78210f3f0588 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:37.930515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-00cf48b5-7181-476b-af16-78210f3f0588 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:37.934644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00cf48b5-7181-476b-af16-78210f3f0588 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:37.935392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00cf48b5-7181-476b-af16-78210f3f0588 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:37.936361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00cf48b5-7181-476b-af16-78210f3f0588 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:37.938294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00cf48b5-7181-476b-af16-78210f3f0588 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:37.971155 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:38.331863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-00cf48b5-7181-476b-af16-78210f3f0588 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:38.354840 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-00cf48b5-7181-476b-af16-78210f3f0588 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.441062 May 28 21:08:38.362106 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 877/1764] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:37 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:38.369980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-58d82c41-428b-4acc-88bf-a5fe947abbb2 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:38.370751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-58d82c41-428b-4acc-88bf-a5fe947abbb2 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:38.412763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-58d82c41-428b-4acc-88bf-a5fe947abbb2 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:38.413755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-58d82c41-428b-4acc-88bf-a5fe947abbb2 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:38.415918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-58d82c41-428b-4acc-88bf-a5fe947abbb2 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:38.416615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-58d82c41-428b-4acc-88bf-a5fe947abbb2 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:38.532563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:08:38.533585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:08:38.534428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:08:38.535137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:08:38.536180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:08:38.550343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:38.550805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:38.551637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:38.552418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:38.589737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Getting quotas for project e96bf6518d66430399de823144f7bea8. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:08:38.596673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Getting quotas for user f08e71479f9d4ef0a30681cdfdd6fef8 and project e96bf6518d66430399de823144f7bea8. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:08:38.608028 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-58d82c41-428b-4acc-88bf-a5fe947abbb2 tempest-MigrationsAdminTest-108067223 tempest-MigrationsAdminTest-108067223-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1614 microversion: 2.1 time: 0.244521 May 28 21:08:38.608763 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 878/1765] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:38 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1614 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:38.613790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-37c33891-0587-4f9d-a188-44024282bd5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:38.614665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-37c33891-0587-4f9d-a188-44024282bd5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:38.618373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:08:38.621716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:08:38.632028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37c33891-0587-4f9d-a188-44024282bd5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:38.632702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37c33891-0587-4f9d-a188-44024282bd5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:38.633704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37c33891-0587-4f9d-a188-44024282bd5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:38.635213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37c33891-0587-4f9d-a188-44024282bd5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:38.738121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-37c33891-0587-4f9d-a188-44024282bd5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:38.749187 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-37c33891-0587-4f9d-a188-44024282bd5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1266 microversion: 2.1 time: 0.138998 May 28 21:08:38.761158 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 879/1766] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:38 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:38.868044 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0d0e20d0-3bc3-467c-b7bf-dd780c2babe7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.238419 May 28 21:08:38.871041 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 888/1767] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:08:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:08:38.883415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dfbaa5e8-811c-4118-a03d-76ff12cb361b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:38.888372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dfbaa5e8-811c-4118-a03d-76ff12cb361b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 99d7a590-6a27-4730-8a64-ba9898a28ff6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:38.902884 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfbaa5e8-811c-4118-a03d-76ff12cb361b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:38.903397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfbaa5e8-811c-4118-a03d-76ff12cb361b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:38.904742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfbaa5e8-811c-4118-a03d-76ff12cb361b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:38.905300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfbaa5e8-811c-4118-a03d-76ff12cb361b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:38.942846 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-dfbaa5e8-811c-4118-a03d-76ff12cb361b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] HTTP exception thrown: Instance 99d7a590-6a27-4730-8a64-ba9898a28ff6 could not be found. May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dfbaa5e8-811c-4118-a03d-76ff12cb361b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Request method failure captured: May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 HTTP/1.1 May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko63S9ujoNVjbzSlNBIwxVY2Q5AFVR-UVWhYbJi9Uiz9UekTK1o7epqZDk_tlmvIuDTjLXkNiU6RvYy3hBvVwxyKeaMPOH_83uAwKWRKNsWK0H3fAptxoBUiyHKBpK0QoDLUjvemfYQiLZUDVHKOGwFy9SUG4nZTopFdtw5NG2wjQOc May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 348fbbc628b44152b05362657c11230d May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_348fbbc628b44152b05362657c11230d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/348fbbc628b44152b05362657c11230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 348fbbc628b44152b05362657c11230d May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 5e54b51913be4a2bab74aae347785727 May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 99d7a590-6a27-4730-8a64-ba9898a28ff6 could not be found. May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '99d7a590-6a27-4730-8a64-ba9898a28ff6'} May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d7a590-6a27-4730-8a64-ba9898a28ff6 could not be found. May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d7a590-6a27-4730-8a64-ba9898a28ff6 could not be found. May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:38.946315 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:38.951165 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:38.951165 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:38.951165 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:38.951165 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:08:38.951165 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:08:38.951165 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d7a590-6a27-4730-8a64-ba9898a28ff6 could not be found. May 28 21:08:38.951165 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:38.952475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dfbaa5e8-811c-4118-a03d-76ff12cb361b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Returning 404 to user: Instance 99d7a590-6a27-4730-8a64-ba9898a28ff6 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:08:38.953693 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dfbaa5e8-811c-4118-a03d-76ff12cb361b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6" status: 404 len: 111 microversion: 2.1 time: 0.081162 May 28 21:08:38.959188 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 889/1768] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:38 2022] GET /compute/v2.1/servers/99d7a590-6a27-4730-8a64-ba9898a28ff6 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:08:38.977324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b7c56598-bf98-46fc-a0ab-c5b89f6f18cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:38.980057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b7c56598-bf98-46fc-a0ab-c5b89f6f18cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:38.988084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:39.002354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7c56598-bf98-46fc-a0ab-c5b89f6f18cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:39.004019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7c56598-bf98-46fc-a0ab-c5b89f6f18cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:39.009422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7c56598-bf98-46fc-a0ab-c5b89f6f18cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:39.010707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7c56598-bf98-46fc-a0ab-c5b89f6f18cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:39.072718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b87136a6-157d-48d8-83dc-fafd3b1a33e4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:39.072718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b87136a6-157d-48d8-83dc-fafd3b1a33e4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:39.082950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b7c56598-bf98-46fc-a0ab-c5b89f6f18cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:39.087266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b87136a6-157d-48d8-83dc-fafd3b1a33e4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:39.087957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b87136a6-157d-48d8-83dc-fafd3b1a33e4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:39.090046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b87136a6-157d-48d8-83dc-fafd3b1a33e4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:39.090549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b87136a6-157d-48d8-83dc-fafd3b1a33e4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:39.297928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b87136a6-157d-48d8-83dc-fafd3b1a33e4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:39.307113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b87136a6-157d-48d8-83dc-fafd3b1a33e4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:39.308631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b87136a6-157d-48d8-83dc-fafd3b1a33e4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:39.310383 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b87136a6-157d-48d8-83dc-fafd3b1a33e4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1484 microversion: 2.25 time: 0.546093 May 28 21:08:39.321077 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 880/1769] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:38 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1484 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:39.326207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-51d4e412-fe47-4946-acb3-6d8e9bd211c5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:39.326830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-51d4e412-fe47-4946-acb3-6d8e9bd211c5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:39.391652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-51d4e412-fe47-4946-acb3-6d8e9bd211c5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:39.398281 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-51d4e412-fe47-4946-acb3-6d8e9bd211c5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1214 microversion: 2.1 time: 0.075949 May 28 21:08:39.398884 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 881/1770] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:39 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:39.403405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-37d1580d-d82c-4a47-94d2-b679fe5f65ed tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:39.403908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-37d1580d-d82c-4a47-94d2-b679fe5f65ed tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 65edf30b-24d4-4341-b899-05f4e390d727] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:39.410823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37d1580d-d82c-4a47-94d2-b679fe5f65ed tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:39.411283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37d1580d-d82c-4a47-94d2-b679fe5f65ed tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:39.412058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37d1580d-d82c-4a47-94d2-b679fe5f65ed tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:39.412503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37d1580d-d82c-4a47-94d2-b679fe5f65ed tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:39.439062 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-37d1580d-d82c-4a47-94d2-b679fe5f65ed tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 65edf30b-24d4-4341-b899-05f4e390d727] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:39.508645 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b7c56598-bf98-46fc-a0ab-c5b89f6f18cf tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "DELETE /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 204 len: 0 microversion: 2.1 time: 0.547635 May 28 21:08:39.509344 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 890/1771] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:08:38 2022] DELETE /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:39.514845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-066c71c3-3a07-476d-bba5-b0a433d7089c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:39.515554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-066c71c3-3a07-476d-bba5-b0a433d7089c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:39.522102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-066c71c3-3a07-476d-bba5-b0a433d7089c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:39.522551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-066c71c3-3a07-476d-bba5-b0a433d7089c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:39.523502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-066c71c3-3a07-476d-bba5-b0a433d7089c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:39.523947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-066c71c3-3a07-476d-bba5-b0a433d7089c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:39.747293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-066c71c3-3a07-476d-bba5-b0a433d7089c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:39.755762 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-066c71c3-3a07-476d-bba5-b0a433d7089c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.245024 May 28 21:08:39.760067 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 891/1772] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:39 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:39.761982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c39434a2-7d2a-47cf-8612-5934cdd752dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:39.762671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c39434a2-7d2a-47cf-8612-5934cdd752dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:39.769205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c39434a2-7d2a-47cf-8612-5934cdd752dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:39.769662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c39434a2-7d2a-47cf-8612-5934cdd752dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:39.770449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c39434a2-7d2a-47cf-8612-5934cdd752dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:39.770883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c39434a2-7d2a-47cf-8612-5934cdd752dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:39.777653 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-37d1580d-d82c-4a47-94d2-b679fe5f65ed tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "DELETE /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727" status: 204 len: 0 microversion: 2.1 time: 0.377338 May 28 21:08:39.781308 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 882/1773] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:08:39 2022] DELETE /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:39.784914 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f5bd53ad-2c08-4cd4-85ed-149dbb129542 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:39.788330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f5bd53ad-2c08-4cd4-85ed-149dbb129542 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:39.792466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5bd53ad-2c08-4cd4-85ed-149dbb129542 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:39.792933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5bd53ad-2c08-4cd4-85ed-149dbb129542 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:39.793724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5bd53ad-2c08-4cd4-85ed-149dbb129542 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:39.794754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5bd53ad-2c08-4cd4-85ed-149dbb129542 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:40.055876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c39434a2-7d2a-47cf-8612-5934cdd752dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:40.063576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f5bd53ad-2c08-4cd4-85ed-149dbb129542 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:40.065246 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c39434a2-7d2a-47cf-8612-5934cdd752dc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1469 microversion: 2.1 time: 0.307032 May 28 21:08:40.065848 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 892/1774] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:39 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1469 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:40.073455 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f5bd53ad-2c08-4cd4-85ed-149dbb129542 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1308 microversion: 2.1 time: 0.293838 May 28 21:08:40.076815 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 883/1775] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:39 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1308 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:40.080623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3f45fafa-9995-4371-b24c-12a5f9b572bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:40.080999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3f45fafa-9995-4371-b24c-12a5f9b572bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:40.088207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f45fafa-9995-4371-b24c-12a5f9b572bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:40.091098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f45fafa-9995-4371-b24c-12a5f9b572bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:40.091216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-6832e09d-0b61-4b5b-9cf1-e7c7487f6e93 req-e13c3b50-63cb-4c39-8f4b-5755a7317ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f837cef-04b0-4491-8edf-c10423944be0", "name": "network-vif-deleted", "tag": "f9af25ca-e630-49f5-9345-5a9075542855"}, {"name": "network-changed", "server_uuid": "86838d0c-e2da-4d31-92e8-94fd9b6345a6", "tag": "90dbd5de-6ef5-4258-8dc2-8e5a1f5600b0"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:40.091372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f45fafa-9995-4371-b24c-12a5f9b572bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:40.091372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f45fafa-9995-4371-b24c-12a5f9b572bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:40.099194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6832e09d-0b61-4b5b-9cf1-e7c7487f6e93 req-e13c3b50-63cb-4c39-8f4b-5755a7317ef1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:40.099669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6832e09d-0b61-4b5b-9cf1-e7c7487f6e93 req-e13c3b50-63cb-4c39-8f4b-5755a7317ef1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:40.112693 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-6832e09d-0b61-4b5b-9cf1-e7c7487f6e93 req-e13c3b50-63cb-4c39-8f4b-5755a7317ef1 service nova] Creating event network-vif-deleted:f9af25ca-e630-49f5-9345-5a9075542855 for instance 1f837cef-04b0-4491-8edf-c10423944be0 on nch1-master-1 May 28 21:08:40.115630 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-6832e09d-0b61-4b5b-9cf1-e7c7487f6e93 req-e13c3b50-63cb-4c39-8f4b-5755a7317ef1 service nova] Creating event network-changed:90dbd5de-6ef5-4258-8dc2-8e5a1f5600b0 for instance 86838d0c-e2da-4d31-92e8-94fd9b6345a6 on nch1-master-1 May 28 21:08:40.120487 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-6832e09d-0b61-4b5b-9cf1-e7c7487f6e93 req-e13c3b50-63cb-4c39-8f4b-5755a7317ef1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.041764 May 28 21:08:40.121095 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 884/1776] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:40.128730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3f45fafa-9995-4371-b24c-12a5f9b572bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:40.329113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9d5e835b-99e0-4743-9e32-5e7ebbdb9911 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:40.329813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9d5e835b-99e0-4743-9e32-5e7ebbdb9911 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:40.336415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d5e835b-99e0-4743-9e32-5e7ebbdb9911 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:40.336868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d5e835b-99e0-4743-9e32-5e7ebbdb9911 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:40.337650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d5e835b-99e0-4743-9e32-5e7ebbdb9911 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:40.338120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d5e835b-99e0-4743-9e32-5e7ebbdb9911 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:40.356574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:40.395373 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3f45fafa-9995-4371-b24c-12a5f9b572bf tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "DELETE /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 204 len: 0 microversion: 2.1 time: 0.328198 May 28 21:08:40.396109 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 893/1777] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:08:40 2022] DELETE /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:40.405162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-78d0cbe5-364b-4fa3-9700-c99f408b3852 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:40.405988 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-78d0cbe5-364b-4fa3-9700-c99f408b3852 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 65edf30b-24d4-4341-b899-05f4e390d727] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:40.414162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78d0cbe5-364b-4fa3-9700-c99f408b3852 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:40.414847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78d0cbe5-364b-4fa3-9700-c99f408b3852 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:40.415621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78d0cbe5-364b-4fa3-9700-c99f408b3852 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:40.416057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78d0cbe5-364b-4fa3-9700-c99f408b3852 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:40.590135 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9d5e835b-99e0-4743-9e32-5e7ebbdb9911 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:40.599265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9d5e835b-99e0-4743-9e32-5e7ebbdb9911 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:40.600845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9d5e835b-99e0-4743-9e32-5e7ebbdb9911 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:40.602069 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9d5e835b-99e0-4743-9e32-5e7ebbdb9911 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1484 microversion: 2.25 time: 0.277217 May 28 21:08:40.602663 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 885/1778] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:40 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1484 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:08:40.613304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-443853ad-419f-403f-9d5b-739f22d41e82 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:40.613304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-443853ad-419f-403f-9d5b-739f22d41e82 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:40.617934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-443853ad-419f-403f-9d5b-739f22d41e82 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:40.618401 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-443853ad-419f-403f-9d5b-739f22d41e82 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:40.619175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-443853ad-419f-403f-9d5b-739f22d41e82 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:40.619619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-443853ad-419f-403f-9d5b-739f22d41e82 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:40.628144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-78d0cbe5-364b-4fa3-9700-c99f408b3852 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:40.638918 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-78d0cbe5-364b-4fa3-9700-c99f408b3852 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727" status: 200 len: 1474 microversion: 2.1 time: 0.238058 May 28 21:08:40.639500 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 894/1779] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:40 2022] GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727 => generated 1474 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:40.662896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-486f8159-d214-45bd-bcc6-130a334b6600 req-3c0816af-f87d-4d05-80d0-97a0ef134e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92d5e5e3-2837-4e11-9b7f-636490b41a93", "tag": "946cf242-8860-4934-a2dc-34a9739fa767"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:40.671451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-486f8159-d214-45bd-bcc6-130a334b6600 req-3c0816af-f87d-4d05-80d0-97a0ef134e02 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:40.672780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-486f8159-d214-45bd-bcc6-130a334b6600 req-3c0816af-f87d-4d05-80d0-97a0ef134e02 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:40.686001 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-486f8159-d214-45bd-bcc6-130a334b6600 req-3c0816af-f87d-4d05-80d0-97a0ef134e02 service nova] Creating event network-changed:946cf242-8860-4934-a2dc-34a9739fa767 for instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 on nch2-master-1 May 28 21:08:40.691202 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-486f8159-d214-45bd-bcc6-130a334b6600 req-3c0816af-f87d-4d05-80d0-97a0ef134e02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032708 May 28 21:08:40.692287 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 895/1780] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:08:40.707857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-443853ad-419f-403f-9d5b-739f22d41e82 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:40.716725 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-443853ad-419f-403f-9d5b-739f22d41e82 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1218 microversion: 2.1 time: 0.112993 May 28 21:08:40.717351 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 886/1781] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:40 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:40.773475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b732e6c1-d27c-41e6-abb7-61740ac44e96 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:40.774207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b732e6c1-d27c-41e6-abb7-61740ac44e96 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:40.779130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-5296beca-b8f9-49ea-9d49-90123ad0f0b9 req-150e3001-03dc-49d1-b0ee-c0f26455fb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801b7889-1935-4bb4-8e8a-c34c2cf3c100", "name": "network-vif-plugged", "status": "completed", "tag": "0e646b8c-f3f2-4ee5-91b0-aea5324fcf34"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:40.781206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b732e6c1-d27c-41e6-abb7-61740ac44e96 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:40.785287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b732e6c1-d27c-41e6-abb7-61740ac44e96 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:40.785287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b732e6c1-d27c-41e6-abb7-61740ac44e96 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:40.785287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b732e6c1-d27c-41e6-abb7-61740ac44e96 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:40.788209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5296beca-b8f9-49ea-9d49-90123ad0f0b9 req-150e3001-03dc-49d1-b0ee-c0f26455fb84 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:40.788745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5296beca-b8f9-49ea-9d49-90123ad0f0b9 req-150e3001-03dc-49d1-b0ee-c0f26455fb84 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:40.800312 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-5296beca-b8f9-49ea-9d49-90123ad0f0b9 req-150e3001-03dc-49d1-b0ee-c0f26455fb84 service nova] Creating event network-vif-plugged:0e646b8c-f3f2-4ee5-91b0-aea5324fcf34 for instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 on nch1-master-1 May 28 21:08:40.805673 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-5296beca-b8f9-49ea-9d49-90123ad0f0b9 req-150e3001-03dc-49d1-b0ee-c0f26455fb84 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030171 May 28 21:08:40.806309 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 887/1782] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:40.919295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b732e6c1-d27c-41e6-abb7-61740ac44e96 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:40.927083 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b732e6c1-d27c-41e6-abb7-61740ac44e96 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.157871 May 28 21:08:40.927657 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 896/1783] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:40 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:41.083280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9257746b-dd92-4635-8228-b41007881a38 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:41.084194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9257746b-dd92-4635-8228-b41007881a38 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:41.092164 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9257746b-dd92-4635-8228-b41007881a38 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:41.092930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9257746b-dd92-4635-8228-b41007881a38 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:41.093186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b6eeb324-94d3-49ce-b8f9-8475dcbac303 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:41.093567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b6eeb324-94d3-49ce-b8f9-8475dcbac303 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:41.093964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9257746b-dd92-4635-8228-b41007881a38 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:41.094498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9257746b-dd92-4635-8228-b41007881a38 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:41.100680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6eeb324-94d3-49ce-b8f9-8475dcbac303 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:41.101879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6eeb324-94d3-49ce-b8f9-8475dcbac303 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:41.102067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6eeb324-94d3-49ce-b8f9-8475dcbac303 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:41.102377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6eeb324-94d3-49ce-b8f9-8475dcbac303 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:41.285688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9257746b-dd92-4635-8228-b41007881a38 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:41.293585 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9257746b-dd92-4635-8228-b41007881a38 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1469 microversion: 2.1 time: 0.214723 May 28 21:08:41.294229 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 888/1784] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:41 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1469 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:41.297633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b6eeb324-94d3-49ce-b8f9-8475dcbac303 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:41.305270 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b6eeb324-94d3-49ce-b8f9-8475dcbac303 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1308 microversion: 2.1 time: 0.216563 May 28 21:08:41.305832 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 897/1785] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:41 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:41.621426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d662ef45-878d-47ef-8c83-0632e87e2627 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:41.622081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d662ef45-878d-47ef-8c83-0632e87e2627 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:41.628403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d662ef45-878d-47ef-8c83-0632e87e2627 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:41.628860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d662ef45-878d-47ef-8c83-0632e87e2627 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:41.629626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d662ef45-878d-47ef-8c83-0632e87e2627 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:41.647785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d662ef45-878d-47ef-8c83-0632e87e2627 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:41.656299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-deb803fd-b6e0-4724-a252-de147d78638f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:41.657425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-deb803fd-b6e0-4724-a252-de147d78638f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 65edf30b-24d4-4341-b899-05f4e390d727] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:41.663755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-deb803fd-b6e0-4724-a252-de147d78638f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:41.664211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-deb803fd-b6e0-4724-a252-de147d78638f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:41.664978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-deb803fd-b6e0-4724-a252-de147d78638f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:41.665417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-deb803fd-b6e0-4724-a252-de147d78638f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:41.820885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d662ef45-878d-47ef-8c83-0632e87e2627 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:41.829648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d662ef45-878d-47ef-8c83-0632e87e2627 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:41.831321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d662ef45-878d-47ef-8c83-0632e87e2627 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:41.832582 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d662ef45-878d-47ef-8c83-0632e87e2627 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1484 microversion: 2.25 time: 0.215147 May 28 21:08:41.833238 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 889/1786] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:41 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1484 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:41.837876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0aa2329d-694f-408b-8a14-b092b79225cd tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:41.838597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0aa2329d-694f-408b-8a14-b092b79225cd tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:41.838735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-deb803fd-b6e0-4724-a252-de147d78638f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:41.845463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0aa2329d-694f-408b-8a14-b092b79225cd tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:41.845956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0aa2329d-694f-408b-8a14-b092b79225cd tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:41.846739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0aa2329d-694f-408b-8a14-b092b79225cd tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:41.846851 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-deb803fd-b6e0-4724-a252-de147d78638f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727" status: 200 len: 1474 microversion: 2.1 time: 0.194371 May 28 21:08:41.847183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0aa2329d-694f-408b-8a14-b092b79225cd tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:41.847464 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 898/1787] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:41 2022] GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727 => generated 1474 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:41.911101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0aa2329d-694f-408b-8a14-b092b79225cd tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:41.918596 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0aa2329d-694f-408b-8a14-b092b79225cd tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1210 microversion: 2.1 time: 0.084323 May 28 21:08:41.919174 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 890/1788] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:41 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:41.943336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-890f9140-da2d-4a35-b4e3-c70920f1a7c2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:41.943953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-890f9140-da2d-4a35-b4e3-c70920f1a7c2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:41.949936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-890f9140-da2d-4a35-b4e3-c70920f1a7c2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:41.950335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-890f9140-da2d-4a35-b4e3-c70920f1a7c2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:41.951093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-890f9140-da2d-4a35-b4e3-c70920f1a7c2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:41.951528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-890f9140-da2d-4a35-b4e3-c70920f1a7c2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:42.078147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-890f9140-da2d-4a35-b4e3-c70920f1a7c2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:42.082286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:42.086688 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-890f9140-da2d-4a35-b4e3-c70920f1a7c2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.147169 May 28 21:08:42.087259 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 899/1789] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:41 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:42.311422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0cef4165-cb43-43f7-9fac-28bd480a85f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:42.312470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0cef4165-cb43-43f7-9fac-28bd480a85f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:42.321567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cef4165-cb43-43f7-9fac-28bd480a85f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:42.322049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cef4165-cb43-43f7-9fac-28bd480a85f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:42.323045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cef4165-cb43-43f7-9fac-28bd480a85f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:42.323498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cef4165-cb43-43f7-9fac-28bd480a85f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:42.324722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bf38c246-d5b0-48d7-bb01-dad8a8e597dd tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:42.325345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bf38c246-d5b0-48d7-bb01-dad8a8e597dd tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:42.339841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf38c246-d5b0-48d7-bb01-dad8a8e597dd tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:42.340240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf38c246-d5b0-48d7-bb01-dad8a8e597dd tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:42.340995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf38c246-d5b0-48d7-bb01-dad8a8e597dd tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:42.341438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf38c246-d5b0-48d7-bb01-dad8a8e597dd tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:42.551114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bf38c246-d5b0-48d7-bb01-dad8a8e597dd tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:42.559040 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bf38c246-d5b0-48d7-bb01-dad8a8e597dd tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1308 microversion: 2.1 time: 0.239703 May 28 21:08:42.559623 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 900/1790] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:42 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:42.569484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0cef4165-cb43-43f7-9fac-28bd480a85f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:42.577195 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0cef4165-cb43-43f7-9fac-28bd480a85f5 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1469 microversion: 2.1 time: 0.269726 May 28 21:08:42.577893 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 891/1791] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:42 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1469 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:42.851688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0f129859-aee4-40e9-afec-255dfafa7ee0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:42.853456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0f129859-aee4-40e9-afec-255dfafa7ee0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:42.859231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f129859-aee4-40e9-afec-255dfafa7ee0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:42.860820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f129859-aee4-40e9-afec-255dfafa7ee0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:42.861694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f129859-aee4-40e9-afec-255dfafa7ee0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:42.862484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f129859-aee4-40e9-afec-255dfafa7ee0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:42.864862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0fb0800e-9e9f-48f5-b35a-5db10af3adde tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:42.865492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0fb0800e-9e9f-48f5-b35a-5db10af3adde tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 65edf30b-24d4-4341-b899-05f4e390d727] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:42.875085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0fb0800e-9e9f-48f5-b35a-5db10af3adde tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:42.875871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0fb0800e-9e9f-48f5-b35a-5db10af3adde tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:42.876820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0fb0800e-9e9f-48f5-b35a-5db10af3adde tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:42.877534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0fb0800e-9e9f-48f5-b35a-5db10af3adde tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:43.156205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0f129859-aee4-40e9-afec-255dfafa7ee0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:43.170423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0f129859-aee4-40e9-afec-255dfafa7ee0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:43.171619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0f129859-aee4-40e9-afec-255dfafa7ee0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:43.173051 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0f129859-aee4-40e9-afec-255dfafa7ee0 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1484 microversion: 2.25 time: 0.325297 May 28 21:08:43.173726 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 901/1792] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:42 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1484 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:08:43.182340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c12464a1-99f3-4eba-bbf7-7dc13f1fdff7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:43.183040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c12464a1-99f3-4eba-bbf7-7dc13f1fdff7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:43.191236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c12464a1-99f3-4eba-bbf7-7dc13f1fdff7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:43.191885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c12464a1-99f3-4eba-bbf7-7dc13f1fdff7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:43.192795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c12464a1-99f3-4eba-bbf7-7dc13f1fdff7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:43.193309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c12464a1-99f3-4eba-bbf7-7dc13f1fdff7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:43.519685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c12464a1-99f3-4eba-bbf7-7dc13f1fdff7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:43.526108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0fb0800e-9e9f-48f5-b35a-5db10af3adde tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:43.546042 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c12464a1-99f3-4eba-bbf7-7dc13f1fdff7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1266 microversion: 2.1 time: 0.367132 May 28 21:08:43.548012 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0fb0800e-9e9f-48f5-b35a-5db10af3adde tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727" status: 200 len: 1474 microversion: 2.1 time: 0.686298 May 28 21:08:43.548504 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 902/1793] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:43 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1266 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:43.561469 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 892/1794] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:42 2022] GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727 => generated 1474 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:43.565869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-54b53460-18fe-4a13-a186-511d07dd1363 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:43.566734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-54b53460-18fe-4a13-a186-511d07dd1363 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:43.580844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eeceb04b-7d96-4710-9de4-90a51e5d3c17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:43.580985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eeceb04b-7d96-4710-9de4-90a51e5d3c17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:43.597769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eeceb04b-7d96-4710-9de4-90a51e5d3c17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:43.597769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eeceb04b-7d96-4710-9de4-90a51e5d3c17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:43.597769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eeceb04b-7d96-4710-9de4-90a51e5d3c17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:43.598445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eeceb04b-7d96-4710-9de4-90a51e5d3c17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:43.604807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54b53460-18fe-4a13-a186-511d07dd1363 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:43.606663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54b53460-18fe-4a13-a186-511d07dd1363 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:43.611231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54b53460-18fe-4a13-a186-511d07dd1363 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:43.614115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54b53460-18fe-4a13-a186-511d07dd1363 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:43.941305 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eeceb04b-7d96-4710-9de4-90a51e5d3c17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:43.951676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-54b53460-18fe-4a13-a186-511d07dd1363 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:43.962771 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-54b53460-18fe-4a13-a186-511d07dd1363 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.401849 May 28 21:08:43.963487 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 903/1795] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:43 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:43.965577 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eeceb04b-7d96-4710-9de4-90a51e5d3c17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1308 microversion: 2.1 time: 0.392842 May 28 21:08:43.971024 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 893/1796] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:43 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1308 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:43.976355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c677daa1-bbf0-44c6-ad45-c84059aeb930 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:43.977112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c677daa1-bbf0-44c6-ad45-c84059aeb930 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:44.010124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c677daa1-bbf0-44c6-ad45-c84059aeb930 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:44.029099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c677daa1-bbf0-44c6-ad45-c84059aeb930 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:44.031325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c677daa1-bbf0-44c6-ad45-c84059aeb930 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:44.034233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c677daa1-bbf0-44c6-ad45-c84059aeb930 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:44.164446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-49079f11-eb40-47d8-97d0-ef9650f36344 req-a6247b97-d998-4302-a3b2-a38bcb15951b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06501745-d6e0-43da-b96c-8713586a5d92", "name": "network-vif-deleted", "tag": "ac98e234-98a5-42f5-ad66-6406e87566fa"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:44.179390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-49079f11-eb40-47d8-97d0-ef9650f36344 req-a6247b97-d998-4302-a3b2-a38bcb15951b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:44.179849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-49079f11-eb40-47d8-97d0-ef9650f36344 req-a6247b97-d998-4302-a3b2-a38bcb15951b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:44.195154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c677daa1-bbf0-44c6-ad45-c84059aeb930 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:44.207880 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-49079f11-eb40-47d8-97d0-ef9650f36344 req-a6247b97-d998-4302-a3b2-a38bcb15951b service nova] Creating event network-vif-deleted:ac98e234-98a5-42f5-ad66-6406e87566fa for instance 06501745-d6e0-43da-b96c-8713586a5d92 on nch2-master-1 May 28 21:08:44.210018 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c677daa1-bbf0-44c6-ad45-c84059aeb930 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1427 microversion: 2.1 time: 0.237506 May 28 21:08:44.211752 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 894/1797] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:43 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1427 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:44.223821 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-49079f11-eb40-47d8-97d0-ef9650f36344 req-a6247b97-d998-4302-a3b2-a38bcb15951b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062653 May 28 21:08:44.225040 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 904/1798] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:44.237527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e7969163-68fc-4baf-bc5f-224954c358a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:44.238505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e7969163-68fc-4baf-bc5f-224954c358a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:44.256928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7969163-68fc-4baf-bc5f-224954c358a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:44.257676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7969163-68fc-4baf-bc5f-224954c358a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:44.258494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7969163-68fc-4baf-bc5f-224954c358a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:44.259055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7969163-68fc-4baf-bc5f-224954c358a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:44.565532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c6425c2-1348-4364-8ce1-a1ce477120e7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:44.573490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8c6425c2-1348-4364-8ce1-a1ce477120e7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:44.580040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c6425c2-1348-4364-8ce1-a1ce477120e7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:44.586835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c6425c2-1348-4364-8ce1-a1ce477120e7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:44.588459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c6425c2-1348-4364-8ce1-a1ce477120e7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:44.590154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c6425c2-1348-4364-8ce1-a1ce477120e7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:44.594083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e7969163-68fc-4baf-bc5f-224954c358a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:44.609346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e7969163-68fc-4baf-bc5f-224954c358a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:44.611740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e7969163-68fc-4baf-bc5f-224954c358a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:44.613294 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e7969163-68fc-4baf-bc5f-224954c358a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1484 microversion: 2.25 time: 0.400302 May 28 21:08:44.614473 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 895/1799] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:44 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1484 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:44.620179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-21bf6c61-7f23-4078-bbaa-3801453e81a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:44.621039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-21bf6c61-7f23-4078-bbaa-3801453e81a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 65edf30b-24d4-4341-b899-05f4e390d727] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:44.631686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21bf6c61-7f23-4078-bbaa-3801453e81a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:44.632459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21bf6c61-7f23-4078-bbaa-3801453e81a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:44.633583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21bf6c61-7f23-4078-bbaa-3801453e81a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:44.634806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21bf6c61-7f23-4078-bbaa-3801453e81a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:44.800894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8c6425c2-1348-4364-8ce1-a1ce477120e7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:44.809644 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8c6425c2-1348-4364-8ce1-a1ce477120e7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1272 microversion: 2.1 time: 0.249950 May 28 21:08:44.820202 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 905/1800] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:44 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:44.836360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-21bf6c61-7f23-4078-bbaa-3801453e81a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:44.845883 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-21bf6c61-7f23-4078-bbaa-3801453e81a3 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727" status: 200 len: 1432 microversion: 2.1 time: 0.230163 May 28 21:08:44.846637 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 896/1801] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:44 2022] GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727 => generated 1432 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:44.951032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-0642f2ad-6775-4beb-8945-1ceed8229510 req-f8929a78-bb71-42ff-8230-c16025ce4d91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65edf30b-24d4-4341-b899-05f4e390d727", "name": "network-vif-deleted", "tag": "2a3deb72-2842-4aed-b050-ff0c3043c594"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:44.972004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0642f2ad-6775-4beb-8945-1ceed8229510 req-f8929a78-bb71-42ff-8230-c16025ce4d91 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:44.976051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0642f2ad-6775-4beb-8945-1ceed8229510 req-f8929a78-bb71-42ff-8230-c16025ce4d91 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:44.984842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5f8641cf-bf0b-4c8c-909a-293387b5e80e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:44.985462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5f8641cf-bf0b-4c8c-909a-293387b5e80e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:44.992585 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-0642f2ad-6775-4beb-8945-1ceed8229510 req-f8929a78-bb71-42ff-8230-c16025ce4d91 service nova] Creating event network-vif-deleted:2a3deb72-2842-4aed-b050-ff0c3043c594 for instance 65edf30b-24d4-4341-b899-05f4e390d727 on nch1-master-1 May 28 21:08:44.995741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f8641cf-bf0b-4c8c-909a-293387b5e80e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:44.997345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f8641cf-bf0b-4c8c-909a-293387b5e80e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:44.998424 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-0642f2ad-6775-4beb-8945-1ceed8229510 req-f8929a78-bb71-42ff-8230-c16025ce4d91 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120703 May 28 21:08:44.998902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f8641cf-bf0b-4c8c-909a-293387b5e80e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:44.999274 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 906/1802] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:44.999396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f8641cf-bf0b-4c8c-909a-293387b5e80e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:45.007619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-55d08189-6a23-4831-beb9-5d8fef67133c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:45.008454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-55d08189-6a23-4831-beb9-5d8fef67133c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:45.017968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55d08189-6a23-4831-beb9-5d8fef67133c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:45.021022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55d08189-6a23-4831-beb9-5d8fef67133c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:45.021022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55d08189-6a23-4831-beb9-5d8fef67133c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:45.021022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55d08189-6a23-4831-beb9-5d8fef67133c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:45.415557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5f8641cf-bf0b-4c8c-909a-293387b5e80e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:45.434992 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5f8641cf-bf0b-4c8c-909a-293387b5e80e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1308 microversion: 2.1 time: 0.451876 May 28 21:08:45.436298 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 897/1803] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:44 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:45.442675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-75ea743d-6962-4341-aeb4-15bf8bd4cfcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:45.443511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-75ea743d-6962-4341-aeb4-15bf8bd4cfcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:45.449463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:45.458034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75ea743d-6962-4341-aeb4-15bf8bd4cfcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:45.458979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75ea743d-6962-4341-aeb4-15bf8bd4cfcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:45.460532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75ea743d-6962-4341-aeb4-15bf8bd4cfcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:45.461523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75ea743d-6962-4341-aeb4-15bf8bd4cfcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:45.511062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-55d08189-6a23-4831-beb9-5d8fef67133c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:45.521801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75ea743d-6962-4341-aeb4-15bf8bd4cfcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:45.522342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75ea743d-6962-4341-aeb4-15bf8bd4cfcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:45.527536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-75ea743d-6962-4341-aeb4-15bf8bd4cfcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lazy-loading 'fault' on Instance uuid 801b7889-1935-4bb4-8e8a-c34c2cf3c100 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:45.527677 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-55d08189-6a23-4831-beb9-5d8fef67133c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.526349 May 28 21:08:45.539528 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 907/1804] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:44 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:45.593279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-75ea743d-6962-4341-aeb4-15bf8bd4cfcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:45.605005 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-75ea743d-6962-4341-aeb4-15bf8bd4cfcc tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 200 len: 1303 microversion: 2.1 time: 0.166806 May 28 21:08:45.617783 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 898/1805] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:45 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 1303 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:45.636193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8e78b6bc-f97e-42ba-9671-b15524c234b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:45.638256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8e78b6bc-f97e-42ba-9671-b15524c234b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:45.649218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e78b6bc-f97e-42ba-9671-b15524c234b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:45.649998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e78b6bc-f97e-42ba-9671-b15524c234b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:45.653442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e78b6bc-f97e-42ba-9671-b15524c234b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:45.653442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e78b6bc-f97e-42ba-9671-b15524c234b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:45.830439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d28bc145-f49c-4b8d-ac58-120c6d5379b3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:45.831228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d28bc145-f49c-4b8d-ac58-120c6d5379b3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:45.836817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8e78b6bc-f97e-42ba-9671-b15524c234b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:45.837680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d28bc145-f49c-4b8d-ac58-120c6d5379b3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:45.838189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d28bc145-f49c-4b8d-ac58-120c6d5379b3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:45.838987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d28bc145-f49c-4b8d-ac58-120c6d5379b3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:45.839459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d28bc145-f49c-4b8d-ac58-120c6d5379b3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:45.844823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8e78b6bc-f97e-42ba-9671-b15524c234b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:45.846466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8e78b6bc-f97e-42ba-9671-b15524c234b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:45.847674 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8e78b6bc-f97e-42ba-9671-b15524c234b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1484 microversion: 2.25 time: 0.219174 May 28 21:08:45.848264 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 908/1806] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:45 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1484 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:45.862780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2bd7c71e-1191-4c01-9a98-ea928e0a4845 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:45.863576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2bd7c71e-1191-4c01-9a98-ea928e0a4845 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 65edf30b-24d4-4341-b899-05f4e390d727] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:45.870362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bd7c71e-1191-4c01-9a98-ea928e0a4845 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:45.870921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bd7c71e-1191-4c01-9a98-ea928e0a4845 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:45.871776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bd7c71e-1191-4c01-9a98-ea928e0a4845 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:45.872291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bd7c71e-1191-4c01-9a98-ea928e0a4845 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:45.905186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bd7c71e-1191-4c01-9a98-ea928e0a4845 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:45.910556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bd7c71e-1191-4c01-9a98-ea928e0a4845 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:45.911568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-2bd7c71e-1191-4c01-9a98-ea928e0a4845 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lazy-loading 'fault' on Instance uuid 65edf30b-24d4-4341-b899-05f4e390d727 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:45.969565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2bd7c71e-1191-4c01-9a98-ea928e0a4845 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:45.977766 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2bd7c71e-1191-4c01-9a98-ea928e0a4845 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727" status: 200 len: 1308 microversion: 2.1 time: 0.119492 May 28 21:08:45.978492 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 909/1807] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:45 2022] GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727 => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:46.002832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d28bc145-f49c-4b8d-ac58-120c6d5379b3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:46.011121 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d28bc145-f49c-4b8d-ac58-120c6d5379b3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1314 microversion: 2.1 time: 0.185261 May 28 21:08:46.012128 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 899/1808] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:45 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:46.265595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-b7fdb00b-bfc6-4694-8337-9e3da7c4a463 req-ae5da3be-f22a-4129-919c-7e3e4d52fb67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801b7889-1935-4bb4-8e8a-c34c2cf3c100", "name": "network-vif-deleted", "tag": "0e646b8c-f3f2-4ee5-91b0-aea5324fcf34"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:46.274492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b7fdb00b-bfc6-4694-8337-9e3da7c4a463 req-ae5da3be-f22a-4129-919c-7e3e4d52fb67 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:46.274951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b7fdb00b-bfc6-4694-8337-9e3da7c4a463 req-ae5da3be-f22a-4129-919c-7e3e4d52fb67 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:46.286844 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-b7fdb00b-bfc6-4694-8337-9e3da7c4a463 req-ae5da3be-f22a-4129-919c-7e3e4d52fb67 service nova] Creating event network-vif-deleted:0e646b8c-f3f2-4ee5-91b0-aea5324fcf34 for instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 on nch1-master-1 May 28 21:08:46.291537 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-b7fdb00b-bfc6-4694-8337-9e3da7c4a463 req-ae5da3be-f22a-4129-919c-7e3e4d52fb67 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029687 May 28 21:08:46.292121 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 910/1809] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:46.453596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7834595d-cad0-4b1b-8949-5d5cdfcd0699 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:46.454363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7834595d-cad0-4b1b-8949-5d5cdfcd0699 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:46.462755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7834595d-cad0-4b1b-8949-5d5cdfcd0699 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:46.463285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7834595d-cad0-4b1b-8949-5d5cdfcd0699 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:46.464270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7834595d-cad0-4b1b-8949-5d5cdfcd0699 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:46.464901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7834595d-cad0-4b1b-8949-5d5cdfcd0699 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:46.545756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3e26bd35-73e5-41b6-8907-b690d0fa675f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:46.546603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3e26bd35-73e5-41b6-8907-b690d0fa675f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:46.558818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e26bd35-73e5-41b6-8907-b690d0fa675f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:46.559296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e26bd35-73e5-41b6-8907-b690d0fa675f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:46.560217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e26bd35-73e5-41b6-8907-b690d0fa675f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:46.560511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e26bd35-73e5-41b6-8907-b690d0fa675f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:46.631654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7834595d-cad0-4b1b-8949-5d5cdfcd0699 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:46.641686 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7834595d-cad0-4b1b-8949-5d5cdfcd0699 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1308 microversion: 2.1 time: 0.193079 May 28 21:08:46.651791 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 900/1810] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:46 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1308 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:46.658067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-62f56dd0-1c30-4194-9014-b28414696b80 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:46.659101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-62f56dd0-1c30-4194-9014-b28414696b80 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 801b7889-1935-4bb4-8e8a-c34c2cf3c100] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:46.671392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62f56dd0-1c30-4194-9014-b28414696b80 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:46.672047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62f56dd0-1c30-4194-9014-b28414696b80 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:46.673539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62f56dd0-1c30-4194-9014-b28414696b80 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:46.674044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62f56dd0-1c30-4194-9014-b28414696b80 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:46.688417 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-62f56dd0-1c30-4194-9014-b28414696b80 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] HTTP exception thrown: Instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 could not be found. May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-62f56dd0-1c30-4194-9014-b28414696b80 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Request method failure captured: May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 HTTP/1.1 May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4hWC4_EcvC2XsuVnnxNz_dxJImgpsbJWZ_PXp7PUILknItQzKVH6ehVtbER1cKjMBABmFNx8Yg1K7b5juXvEfJe5ZW6e3Pt_gRCgUjKi44Z7ADai4URx_ueJHdGc21HB-XZZ6BKlcRkw3l4WxtcD6IwN6BgTB7bxQwZoEYJKJ1w9c May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: d6c38a96a96b4fba9e41ac58f5054803 May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-MigrationsAdminTest-1239768997 May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d6c38a96a96b4fba9e41ac58f5054803", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6c38a96a96b4fba9e41ac58f5054803"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d6c38a96a96b4fba9e41ac58f5054803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6c38a96a96b4fba9e41ac58f5054803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-MigrationsAdminTest-1239768997 May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: d6c38a96a96b4fba9e41ac58f5054803 May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-MigrationsAdminTest-1239768997 May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-MigrationsAdminTest-1239768997-project May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: c14b965da64c40e382c69050ba01b183 May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-MigrationsAdminTest-1239768997-project May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 could not be found. May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '801b7889-1935-4bb4-8e8a-c34c2cf3c100'} May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 could not be found. May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 could not be found. May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:46.690488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:46.696420 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:46.696420 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:46.696420 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:46.696420 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:08:46.696420 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:08:46.696420 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 could not be found. May 28 21:08:46.696420 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:46.696420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-62f56dd0-1c30-4194-9014-b28414696b80 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Returning 404 to user: Instance 801b7889-1935-4bb4-8e8a-c34c2cf3c100 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:08:46.696420 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-62f56dd0-1c30-4194-9014-b28414696b80 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100" status: 404 len: 111 microversion: 2.1 time: 0.038773 May 28 21:08:46.696420 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 901/1811] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:46 2022] GET /compute/v2.1/servers/801b7889-1935-4bb4-8e8a-c34c2cf3c100 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:08:46.700458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-58465055-15e3-43ed-8dea-22a33eae7177 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:46.700964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-58465055-15e3-43ed-8dea-22a33eae7177 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:46.707567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-58465055-15e3-43ed-8dea-22a33eae7177 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:46.708028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-58465055-15e3-43ed-8dea-22a33eae7177 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:46.708817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-58465055-15e3-43ed-8dea-22a33eae7177 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:46.711029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-58465055-15e3-43ed-8dea-22a33eae7177 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:46.744169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-58465055-15e3-43ed-8dea-22a33eae7177 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:46.750341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3e26bd35-73e5-41b6-8907-b690d0fa675f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:46.759107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:46.760882 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3e26bd35-73e5-41b6-8907-b690d0fa675f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.219553 May 28 21:08:46.761811 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 911/1812] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:46 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:46.867351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f7a8cfb1-579a-461a-9d21-0eabc4f18aaa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:46.868292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f7a8cfb1-579a-461a-9d21-0eabc4f18aaa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:46.875174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7a8cfb1-579a-461a-9d21-0eabc4f18aaa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:46.877601 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7a8cfb1-579a-461a-9d21-0eabc4f18aaa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:46.877601 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7a8cfb1-579a-461a-9d21-0eabc4f18aaa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:46.877601 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7a8cfb1-579a-461a-9d21-0eabc4f18aaa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.087107 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-58465055-15e3-43ed-8dea-22a33eae7177 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "DELETE /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 204 len: 0 microversion: 2.1 time: 0.388664 May 28 21:08:47.087107 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 902/1813] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:08:46 2022] DELETE /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:47.091515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a2c6e102-1a65-4121-b3d4-55c99bc8e86b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:47.092256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a2c6e102-1a65-4121-b3d4-55c99bc8e86b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 65edf30b-24d4-4341-b899-05f4e390d727] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:47.098870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2c6e102-1a65-4121-b3d4-55c99bc8e86b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.099341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2c6e102-1a65-4121-b3d4-55c99bc8e86b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.100306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2c6e102-1a65-4121-b3d4-55c99bc8e86b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.100862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2c6e102-1a65-4121-b3d4-55c99bc8e86b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.102413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f7a8cfb1-579a-461a-9d21-0eabc4f18aaa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:47.114772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f7a8cfb1-579a-461a-9d21-0eabc4f18aaa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:47.116818 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-a2c6e102-1a65-4121-b3d4-55c99bc8e86b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] HTTP exception thrown: Instance 65edf30b-24d4-4341-b899-05f4e390d727 could not be found. May 28 21:08:47.117768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f7a8cfb1-579a-461a-9d21-0eabc4f18aaa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a2c6e102-1a65-4121-b3d4-55c99bc8e86b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Request method failure captured: May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727 HTTP/1.1 May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko63S9ujoNVjbzSlNBIwxVY2Q5AFVR-UVWhYbJi9Uiz9UekTK1o7epqZDk_tlmvIuDTjLXkNiU6RvYy3hBvVwxyKeaMPOH_83uAwKWRKNsWK0H3fAptxoBUiyHKBpK0QoDLUjvemfYQiLZUDVHKOGwFy9SUG4nZTopFdtw5NG2wjQOc May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 348fbbc628b44152b05362657c11230d May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_348fbbc628b44152b05362657c11230d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/348fbbc628b44152b05362657c11230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 348fbbc628b44152b05362657c11230d May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 5e54b51913be4a2bab74aae347785727 May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 65edf30b-24d4-4341-b899-05f4e390d727 could not be found. May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '65edf30b-24d4-4341-b899-05f4e390d727'} May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65edf30b-24d4-4341-b899-05f4e390d727 could not be found. May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65edf30b-24d4-4341-b899-05f4e390d727 could not be found. May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:47.118751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:47.123210 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:47.123210 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:47.123210 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:47.123210 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:08:47.123210 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:08:47.123210 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65edf30b-24d4-4341-b899-05f4e390d727 could not be found. May 28 21:08:47.123210 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:47.123663 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f7a8cfb1-579a-461a-9d21-0eabc4f18aaa tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1484 microversion: 2.25 time: 0.257371 May 28 21:08:47.123663 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 912/1814] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:46 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1484 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:08:47.124485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a2c6e102-1a65-4121-b3d4-55c99bc8e86b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Returning 404 to user: Instance 65edf30b-24d4-4341-b899-05f4e390d727 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:08:47.124799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d8ca6e15-165f-4c7e-8f81-c48956a0da08 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:47.126036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d8ca6e15-165f-4c7e-8f81-c48956a0da08 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:47.126570 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a2c6e102-1a65-4121-b3d4-55c99bc8e86b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727" status: 404 len: 111 microversion: 2.1 time: 0.038984 May 28 21:08:47.127516 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 903/1815] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:47 2022] GET /compute/v2.1/servers/65edf30b-24d4-4341-b899-05f4e390d727 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:08:47.132123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a4731788-f750-4367-ba70-84af372ff15d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:47.132647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8ca6e15-165f-4c7e-8f81-c48956a0da08 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.133098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8ca6e15-165f-4c7e-8f81-c48956a0da08 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.133245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a4731788-f750-4367-ba70-84af372ff15d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:47.133899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8ca6e15-165f-4c7e-8f81-c48956a0da08 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.135261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8ca6e15-165f-4c7e-8f81-c48956a0da08 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.140286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4731788-f750-4367-ba70-84af372ff15d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.140775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4731788-f750-4367-ba70-84af372ff15d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.141567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4731788-f750-4367-ba70-84af372ff15d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.142052 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4731788-f750-4367-ba70-84af372ff15d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.363992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a4731788-f750-4367-ba70-84af372ff15d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:47.369316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d8ca6e15-165f-4c7e-8f81-c48956a0da08 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:47.372277 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a4731788-f750-4367-ba70-84af372ff15d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1534 microversion: 2.1 time: 0.243591 May 28 21:08:47.372860 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 904/1816] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:47 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1534 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:47.377710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-383259b3-b8a4-4709-979a-616520cb6975 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:47.379124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-383259b3-b8a4-4709-979a-616520cb6975 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 06501745-d6e0-43da-b96c-8713586a5d92] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:47.386769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-383259b3-b8a4-4709-979a-616520cb6975 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.393480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-383259b3-b8a4-4709-979a-616520cb6975 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.393480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-383259b3-b8a4-4709-979a-616520cb6975 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.393480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-383259b3-b8a4-4709-979a-616520cb6975 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.394028 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d8ca6e15-165f-4c7e-8f81-c48956a0da08 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1314 microversion: 2.1 time: 0.268190 May 28 21:08:47.394028 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 913/1817] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:47 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:47.403270 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-383259b3-b8a4-4709-979a-616520cb6975 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] HTTP exception thrown: Instance 06501745-d6e0-43da-b96c-8713586a5d92 could not be found. May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-383259b3-b8a4-4709-979a-616520cb6975 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Request method failure captured: May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 HTTP/1.1 May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko63S9ujoNVjbzSlNBIwxVY2Q5AFVR-UVWhYbJi9Uiz9UekTK1o7epqZDk_tlmvIuDTjLXkNiU6RvYy3hBvVwxyKeaMPOH_83uAwKWRKNsWK0H3fAptxoBUiyHKBpK0QoDLUjvemfYQiLZUDVHKOGwFy9SUG4nZTopFdtw5NG2wjQOc May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 348fbbc628b44152b05362657c11230d May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_348fbbc628b44152b05362657c11230d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/348fbbc628b44152b05362657c11230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 348fbbc628b44152b05362657c11230d May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 5e54b51913be4a2bab74aae347785727 May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 06501745-d6e0-43da-b96c-8713586a5d92 could not be found. May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '06501745-d6e0-43da-b96c-8713586a5d92'} May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06501745-d6e0-43da-b96c-8713586a5d92 could not be found. May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06501745-d6e0-43da-b96c-8713586a5d92 could not be found. May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:47.404937 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:47.410642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:47.410642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:47.410642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:47.410642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:08:47.410642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:08:47.410642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06501745-d6e0-43da-b96c-8713586a5d92 could not be found. May 28 21:08:47.410642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:47.410642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-383259b3-b8a4-4709-979a-616520cb6975 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Returning 404 to user: Instance 06501745-d6e0-43da-b96c-8713586a5d92 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:08:47.410642 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-383259b3-b8a4-4709-979a-616520cb6975 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92" status: 404 len: 111 microversion: 2.1 time: 0.032387 May 28 21:08:47.410642 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 905/1818] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:47 2022] GET /compute/v2.1/servers/06501745-d6e0-43da-b96c-8713586a5d92 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:08:47.415670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-69dda7a1-ad1c-4903-a097-2d1e85aea346 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:47.521888 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-69dda7a1-ad1c-4903-a097-2d1e85aea346 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/76eccd07-0c0f-48cd-978a-907ba89aa17f" status: 204 len: 0 microversion: 2.1 time: 0.109981 May 28 21:08:47.522488 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 914/1819] 10.222.0.33 () {58 vars in 1265 bytes} [Sat May 28 21:08:47 2022] DELETE /compute/v2.1/os-server-groups/76eccd07-0c0f-48cd-978a-907ba89aa17f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:47.530676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-79a442fe-cad2-4188-98b4-f48738b7fa40 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:47.531198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-79a442fe-cad2-4188-98b4-f48738b7fa40 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: c8294ac6-8d71-482c-8c67-67109bb03a2c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:47.539175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79a442fe-cad2-4188-98b4-f48738b7fa40 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.540141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79a442fe-cad2-4188-98b4-f48738b7fa40 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.540433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79a442fe-cad2-4188-98b4-f48738b7fa40 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.540848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79a442fe-cad2-4188-98b4-f48738b7fa40 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.567004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-79a442fe-cad2-4188-98b4-f48738b7fa40 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: c8294ac6-8d71-482c-8c67-67109bb03a2c] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:47.659603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5410e4a5-2272-43dd-a467-9914b255deeb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:47.660291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5410e4a5-2272-43dd-a467-9914b255deeb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:47.666562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5410e4a5-2272-43dd-a467-9914b255deeb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.667010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5410e4a5-2272-43dd-a467-9914b255deeb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.667785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5410e4a5-2272-43dd-a467-9914b255deeb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.668228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5410e4a5-2272-43dd-a467-9914b255deeb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.811288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5410e4a5-2272-43dd-a467-9914b255deeb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:47.819172 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5410e4a5-2272-43dd-a467-9914b255deeb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1308 microversion: 2.1 time: 0.164838 May 28 21:08:47.819742 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 915/1820] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:47 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1308 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:47.824181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c50d0d84-786c-41ad-b723-d177ee7ccad6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:47.824790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c50d0d84-786c-41ad-b723-d177ee7ccad6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:47.831219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c50d0d84-786c-41ad-b723-d177ee7ccad6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.832657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c50d0d84-786c-41ad-b723-d177ee7ccad6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.832657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c50d0d84-786c-41ad-b723-d177ee7ccad6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.832878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c50d0d84-786c-41ad-b723-d177ee7ccad6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.925696 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-79a442fe-cad2-4188-98b4-f48738b7fa40 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c" status: 204 len: 0 microversion: 2.1 time: 0.398238 May 28 21:08:47.926235 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 906/1821] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:08:47 2022] DELETE /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:47.934565 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5c29fdec-e2a8-4f82-8512-3fce38dbe1c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:47.935164 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5c29fdec-e2a8-4f82-8512-3fce38dbe1c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:47.941465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c29fdec-e2a8-4f82-8512-3fce38dbe1c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.941948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c29fdec-e2a8-4f82-8512-3fce38dbe1c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.942739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c29fdec-e2a8-4f82-8512-3fce38dbe1c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:47.943228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c29fdec-e2a8-4f82-8512-3fce38dbe1c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:47.964223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c50d0d84-786c-41ad-b723-d177ee7ccad6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:47.970440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5c29fdec-e2a8-4f82-8512-3fce38dbe1c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:47.972423 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c50d0d84-786c-41ad-b723-d177ee7ccad6 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.151687 May 28 21:08:47.977234 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 916/1822] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:47 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:48.138980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dc82ed85-db9e-431d-819b-a485138db15d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:48.139631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dc82ed85-db9e-431d-819b-a485138db15d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:48.146364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc82ed85-db9e-431d-819b-a485138db15d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.146819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc82ed85-db9e-431d-819b-a485138db15d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.147580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc82ed85-db9e-431d-819b-a485138db15d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.148024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc82ed85-db9e-431d-819b-a485138db15d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.182786 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5c29fdec-e2a8-4f82-8512-3fce38dbe1c1 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 204 len: 0 microversion: 2.1 time: 0.252122 May 28 21:08:48.183413 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 907/1823] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:08:47 2022] DELETE /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:08:48.192154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1b1baa41-6290-422e-bb25-505dd6f069c2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:48.192859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1b1baa41-6290-422e-bb25-505dd6f069c2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: c8294ac6-8d71-482c-8c67-67109bb03a2c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:48.199072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b1baa41-6290-422e-bb25-505dd6f069c2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.199533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b1baa41-6290-422e-bb25-505dd6f069c2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.200310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b1baa41-6290-422e-bb25-505dd6f069c2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.200755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b1baa41-6290-422e-bb25-505dd6f069c2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.333218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dc82ed85-db9e-431d-819b-a485138db15d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:48.343378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dc82ed85-db9e-431d-819b-a485138db15d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:48.345032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dc82ed85-db9e-431d-819b-a485138db15d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:48.346356 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dc82ed85-db9e-431d-819b-a485138db15d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1474 microversion: 2.25 time: 0.211419 May 28 21:08:48.347430 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 917/1824] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:48 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1474 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:08:48.352676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-4359a60d-a171-4fa0-a408-2f6761b367aa req-37ff859d-be89-46d2-b883-fdacb31e472b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a805a0-9660-4656-9fe5-2cd72fb96be9", "tag": "05e9b5fc-2b1f-4708-b1bf-2810843a11ba"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:48.361790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-4359a60d-a171-4fa0-a408-2f6761b367aa req-37ff859d-be89-46d2-b883-fdacb31e472b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.362522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-4359a60d-a171-4fa0-a408-2f6761b367aa req-37ff859d-be89-46d2-b883-fdacb31e472b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.369613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1b1baa41-6290-422e-bb25-505dd6f069c2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:48.374959 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-4359a60d-a171-4fa0-a408-2f6761b367aa req-37ff859d-be89-46d2-b883-fdacb31e472b service nova] Creating event network-changed:05e9b5fc-2b1f-4708-b1bf-2810843a11ba for instance 21a805a0-9660-4656-9fe5-2cd72fb96be9 on nch1-master-1 May 28 21:08:48.378166 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1b1baa41-6290-422e-bb25-505dd6f069c2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c" status: 200 len: 1475 microversion: 2.1 time: 0.190286 May 28 21:08:48.378852 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 908/1825] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:48 2022] GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c => generated 1475 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:48.381297 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-4359a60d-a171-4fa0-a408-2f6761b367aa req-37ff859d-be89-46d2-b883-fdacb31e472b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032657 May 28 21:08:48.381914 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 918/1826] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:48.384202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d8bda68a-5b91-4469-94d0-dbd91c655bb6 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '.version_select at 0x7f4d57819280>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:48.387262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8bda68a-5b91-4469-94d0-dbd91c655bb6 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.388004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8bda68a-5b91-4469-94d0-dbd91c655bb6 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.390104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e0ab3047-a10a-4267-99a1-2ed40a9b9865 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:48.392582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e0ab3047-a10a-4267-99a1-2ed40a9b9865 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:48.399607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0ab3047-a10a-4267-99a1-2ed40a9b9865 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.403474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0ab3047-a10a-4267-99a1-2ed40a9b9865 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.403474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0ab3047-a10a-4267-99a1-2ed40a9b9865 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.403474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0ab3047-a10a-4267-99a1-2ed40a9b9865 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.404282 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d8bda68a-5b91-4469-94d0-dbd91c655bb6 tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 5134 microversion: 2.25 time: 0.024032 May 28 21:08:48.413158 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 909/1827] 10.222.0.33 () {60 vars in 1183 bytes} [Sat May 28 21:08:48 2022] GET /compute/v2.1/os-migrations => generated 5134 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:48.418010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-28bfb5db-fb35-4029-aa76-44d3c42bb898 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:48.418613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-28bfb5db-fb35-4029-aa76-44d3c42bb898 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:48.424607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28bfb5db-fb35-4029-aa76-44d3c42bb898 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.437261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28bfb5db-fb35-4029-aa76-44d3c42bb898 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.437261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28bfb5db-fb35-4029-aa76-44d3c42bb898 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.437261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28bfb5db-fb35-4029-aa76-44d3c42bb898 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.573052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:48.604688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=14 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:48.612728 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e0ab3047-a10a-4267-99a1-2ed40a9b9865 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:48.617283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:48.622946 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e0ab3047-a10a-4267-99a1-2ed40a9b9865 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1534 microversion: 2.1 time: 0.236866 May 28 21:08:48.623960 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 919/1828] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:48 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1534 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:48.628847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d0fe89e6-8249-44e2-9bd9-396a0db3ea0e tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:48.629578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d0fe89e6-8249-44e2-9bd9-396a0db3ea0e tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:48.636094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0fe89e6-8249-44e2-9bd9-396a0db3ea0e tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.636653 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0fe89e6-8249-44e2-9bd9-396a0db3ea0e tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.637529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0fe89e6-8249-44e2-9bd9-396a0db3ea0e tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.638110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0fe89e6-8249-44e2-9bd9-396a0db3ea0e tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.638468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-28bfb5db-fb35-4029-aa76-44d3c42bb898 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:48.650388 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-28bfb5db-fb35-4029-aa76-44d3c42bb898 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1314 microversion: 2.1 time: 0.235740 May 28 21:08:48.651668 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 910/1829] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:48 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:48.658732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-436e1aa5-9595-4b59-9ce2-2f1151c03c25 req-08266311-ae38-48f3-ac97-b350285c5d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d5e5e3-2837-4e11-9b7f-636490b41a93", "name": "network-vif-plugged", "status": "completed", "tag": "946cf242-8860-4934-a2dc-34a9739fa767"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:48.671061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-436e1aa5-9595-4b59-9ce2-2f1151c03c25 req-08266311-ae38-48f3-ac97-b350285c5d75 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.671820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-436e1aa5-9595-4b59-9ce2-2f1151c03c25 req-08266311-ae38-48f3-ac97-b350285c5d75 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.687353 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-436e1aa5-9595-4b59-9ce2-2f1151c03c25 req-08266311-ae38-48f3-ac97-b350285c5d75 service nova] Creating event network-vif-plugged:946cf242-8860-4934-a2dc-34a9739fa767 for instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 on nch2-master-1 May 28 21:08:48.692640 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-436e1aa5-9595-4b59-9ce2-2f1151c03c25 req-08266311-ae38-48f3-ac97-b350285c5d75 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039574 May 28 21:08:48.693239 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 911/1830] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:48.824850 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-d0fe89e6-8249-44e2-9bd9-396a0db3ea0e tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] Lazy-loading 'services' on Instance uuid 86838d0c-e2da-4d31-92e8-94fd9b6345a6 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:48.843900 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d0fe89e6-8249-44e2-9bd9-396a0db3ea0e tempest-LiveAutoBlockMigrationV225Test-664987053 tempest-LiveAutoBlockMigrationV225Test-664987053-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1965 microversion: 2.25 time: 0.218547 May 28 21:08:48.845221 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 920/1831] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:48 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1965 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:48.862419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5bea612c-6a10-4587-b16d-612a3e8f304e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:48.862419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5bea612c-6a10-4587-b16d-612a3e8f304e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:48.862419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bea612c-6a10-4587-b16d-612a3e8f304e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.862419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bea612c-6a10-4587-b16d-612a3e8f304e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.862419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bea612c-6a10-4587-b16d-612a3e8f304e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.862419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bea612c-6a10-4587-b16d-612a3e8f304e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.902832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-29f7c8e4-6b2f-46e9-a867-57138fe66a3b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:48.903606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-29f7c8e4-6b2f-46e9-a867-57138fe66a3b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:48.918844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29f7c8e4-6b2f-46e9-a867-57138fe66a3b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.919606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29f7c8e4-6b2f-46e9-a867-57138fe66a3b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.921799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29f7c8e4-6b2f-46e9-a867-57138fe66a3b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:48.922495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29f7c8e4-6b2f-46e9-a867-57138fe66a3b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:48.960072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-29f7c8e4-6b2f-46e9-a867-57138fe66a3b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:49.150353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5bea612c-6a10-4587-b16d-612a3e8f304e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:49.168070 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5bea612c-6a10-4587-b16d-612a3e8f304e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1308 microversion: 2.1 time: 0.333018 May 28 21:08:49.169695 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 912/1832] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:48 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1308 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:49.176673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-36055f83-882a-47ae-9fbb-6f9094078384 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:49.183938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-36055f83-882a-47ae-9fbb-6f9094078384 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:49.190946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36055f83-882a-47ae-9fbb-6f9094078384 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:49.192496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36055f83-882a-47ae-9fbb-6f9094078384 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:49.194148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36055f83-882a-47ae-9fbb-6f9094078384 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:49.195163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36055f83-882a-47ae-9fbb-6f9094078384 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:49.262996 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-29f7c8e4-6b2f-46e9-a867-57138fe66a3b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "DELETE /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 204 len: 0 microversion: 2.25 time: 0.374841 May 28 21:08:49.264574 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 921/1833] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:08:48 2022] DELETE /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:08:49.280418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-de5bebe5-03b4-46cb-b920-f5c254bbeb0e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:49.281151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-de5bebe5-03b4-46cb-b920-f5c254bbeb0e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:49.291736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de5bebe5-03b4-46cb-b920-f5c254bbeb0e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:49.297540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de5bebe5-03b4-46cb-b920-f5c254bbeb0e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:49.297540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de5bebe5-03b4-46cb-b920-f5c254bbeb0e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:49.297540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de5bebe5-03b4-46cb-b920-f5c254bbeb0e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:49.396987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=8 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:49.505217 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-36055f83-882a-47ae-9fbb-6f9094078384 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:49.513583 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-36055f83-882a-47ae-9fbb-6f9094078384 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.342559 May 28 21:08:49.513860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-de5bebe5-03b4-46cb-b920-f5c254bbeb0e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:49.514513 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 913/1834] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:49 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:49.519267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0b5750d1-4eb0-4e11-ad20-9cb26d3da300 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:49.519975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0b5750d1-4eb0-4e11-ad20-9cb26d3da300 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: c8294ac6-8d71-482c-8c67-67109bb03a2c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:49.522713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-de5bebe5-03b4-46cb-b920-f5c254bbeb0e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:49.524345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-de5bebe5-03b4-46cb-b920-f5c254bbeb0e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:49.525773 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-de5bebe5-03b4-46cb-b920-f5c254bbeb0e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1480 microversion: 2.25 time: 0.249668 May 28 21:08:49.526793 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 922/1835] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:49 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1480 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:08:49.528505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b5750d1-4eb0-4e11-ad20-9cb26d3da300 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:49.529055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b5750d1-4eb0-4e11-ad20-9cb26d3da300 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:49.530012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b5750d1-4eb0-4e11-ad20-9cb26d3da300 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:49.530599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b5750d1-4eb0-4e11-ad20-9cb26d3da300 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:49.642025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1f136fa3-c521-467a-b16b-b47ee78e058b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:49.642560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1f136fa3-c521-467a-b16b-b47ee78e058b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:49.651501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f136fa3-c521-467a-b16b-b47ee78e058b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:49.657426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f136fa3-c521-467a-b16b-b47ee78e058b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:49.658348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f136fa3-c521-467a-b16b-b47ee78e058b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:49.658982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f136fa3-c521-467a-b16b-b47ee78e058b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:49.772559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1f136fa3-c521-467a-b16b-b47ee78e058b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:49.781058 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1f136fa3-c521-467a-b16b-b47ee78e058b tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1492 microversion: 2.1 time: 0.144195 May 28 21:08:49.782532 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 923/1836] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:49 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1492 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:49.787269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1c2ac446-1b14-4d00-aa42-fda546b82775 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:49.788335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1c2ac446-1b14-4d00-aa42-fda546b82775 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:49.796529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c2ac446-1b14-4d00-aa42-fda546b82775 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:49.797889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c2ac446-1b14-4d00-aa42-fda546b82775 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:49.798867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c2ac446-1b14-4d00-aa42-fda546b82775 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:49.799488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c2ac446-1b14-4d00-aa42-fda546b82775 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:49.812409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0b5750d1-4eb0-4e11-ad20-9cb26d3da300 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:49.825148 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0b5750d1-4eb0-4e11-ad20-9cb26d3da300 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c" status: 200 len: 1475 microversion: 2.1 time: 0.309151 May 28 21:08:49.826730 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 914/1837] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:49 2022] GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c => generated 1475 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:49.832451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-600e8118-40f2-4750-9cce-09293efeaf7c req-3ebebe9a-9056-44c0-8dcb-9176a0a28884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394fe269-dd5e-4d4e-8f49-de1df1812e6a", "name": "network-vif-deleted", "tag": "e413ef97-3a02-48d0-ae33-341fafd919b8"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:49.848298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-600e8118-40f2-4750-9cce-09293efeaf7c req-3ebebe9a-9056-44c0-8dcb-9176a0a28884 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:49.853125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-600e8118-40f2-4750-9cce-09293efeaf7c req-3ebebe9a-9056-44c0-8dcb-9176a0a28884 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:49.867615 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-600e8118-40f2-4750-9cce-09293efeaf7c req-3ebebe9a-9056-44c0-8dcb-9176a0a28884 service nova] Creating event network-vif-deleted:e413ef97-3a02-48d0-ae33-341fafd919b8 for instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a on nch1-master-1 May 28 21:08:49.874780 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-600e8118-40f2-4750-9cce-09293efeaf7c req-3ebebe9a-9056-44c0-8dcb-9176a0a28884 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046256 May 28 21:08:49.876770 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 915/1838] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:49.946050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1c2ac446-1b14-4d00-aa42-fda546b82775 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:49.954257 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1c2ac446-1b14-4d00-aa42-fda546b82775 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1314 microversion: 2.1 time: 0.170402 May 28 21:08:49.954931 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 924/1839] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:49 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:50.186095 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-daf5022a-9db9-4db3-be6c-4e9cee16aed8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:50.186694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-daf5022a-9db9-4db3-be6c-4e9cee16aed8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:50.193089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-daf5022a-9db9-4db3-be6c-4e9cee16aed8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:50.193542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-daf5022a-9db9-4db3-be6c-4e9cee16aed8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:50.194331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-daf5022a-9db9-4db3-be6c-4e9cee16aed8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:50.194773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-daf5022a-9db9-4db3-be6c-4e9cee16aed8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:50.325149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-daf5022a-9db9-4db3-be6c-4e9cee16aed8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:50.333309 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-daf5022a-9db9-4db3-be6c-4e9cee16aed8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1308 microversion: 2.1 time: 0.151709 May 28 21:08:50.333895 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 916/1840] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:50 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1308 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:50.530939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0b30fecc-c690-4726-a8de-642766341846 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:50.531562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0b30fecc-c690-4726-a8de-642766341846 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:50.537741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b30fecc-c690-4726-a8de-642766341846 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:50.538227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b30fecc-c690-4726-a8de-642766341846 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:50.539079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b30fecc-c690-4726-a8de-642766341846 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:50.539522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b30fecc-c690-4726-a8de-642766341846 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:50.543619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aa932986-5fc4-472b-aa69-45bd2e1e15af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:50.544242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aa932986-5fc4-472b-aa69-45bd2e1e15af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:50.551015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa932986-5fc4-472b-aa69-45bd2e1e15af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:50.551521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa932986-5fc4-472b-aa69-45bd2e1e15af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:50.552354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa932986-5fc4-472b-aa69-45bd2e1e15af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:50.552798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa932986-5fc4-472b-aa69-45bd2e1e15af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:50.741175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0b30fecc-c690-4726-a8de-642766341846 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:50.745107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aa932986-5fc4-472b-aa69-45bd2e1e15af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:50.749209 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0b30fecc-c690-4726-a8de-642766341846 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.222115 May 28 21:08:50.749800 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 925/1841] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:50 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:50.755188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-bd9663aa-fe5e-46c8-abea-2e0f507ff821 req-851bd42a-93ae-47a2-9fe4-6411be26fd67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394fe269-dd5e-4d4e-8f49-de1df1812e6a", "name": "network-vif-unplugged", "status": "completed", "tag": "e413ef97-3a02-48d0-ae33-341fafd919b8"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:50.755655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aa932986-5fc4-472b-aa69-45bd2e1e15af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:50.761425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aa932986-5fc4-472b-aa69-45bd2e1e15af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:50.761425 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aa932986-5fc4-472b-aa69-45bd2e1e15af tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1480 microversion: 2.25 time: 0.218736 May 28 21:08:50.761425 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 917/1842] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:50 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1480 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:08:50.764902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-bd9663aa-fe5e-46c8-abea-2e0f507ff821 req-851bd42a-93ae-47a2-9fe4-6411be26fd67 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:50.765525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-bd9663aa-fe5e-46c8-abea-2e0f507ff821 req-851bd42a-93ae-47a2-9fe4-6411be26fd67 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:50.780032 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-bd9663aa-fe5e-46c8-abea-2e0f507ff821 req-851bd42a-93ae-47a2-9fe4-6411be26fd67 service nova] Creating event network-vif-unplugged:e413ef97-3a02-48d0-ae33-341fafd919b8 for instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a on nch1-master-1 May 28 21:08:50.785569 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-bd9663aa-fe5e-46c8-abea-2e0f507ff821 req-851bd42a-93ae-47a2-9fe4-6411be26fd67 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033568 May 28 21:08:50.785987 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 926/1843] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:50.799411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-07edf900-4ded-4904-b5b9-66067453dfab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:50.800126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-07edf900-4ded-4904-b5b9-66067453dfab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:50.806379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07edf900-4ded-4904-b5b9-66067453dfab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:50.807498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07edf900-4ded-4904-b5b9-66067453dfab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:50.807607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07edf900-4ded-4904-b5b9-66067453dfab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:50.808034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07edf900-4ded-4904-b5b9-66067453dfab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:50.812159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:50.843813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-54cea2aa-c85a-4c63-bc8e-0e86df8bfa23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:50.844773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-54cea2aa-c85a-4c63-bc8e-0e86df8bfa23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: c8294ac6-8d71-482c-8c67-67109bb03a2c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:50.848000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:50.851780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54cea2aa-c85a-4c63-bc8e-0e86df8bfa23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:50.852238 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54cea2aa-c85a-4c63-bc8e-0e86df8bfa23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:50.853024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54cea2aa-c85a-4c63-bc8e-0e86df8bfa23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:50.853460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-54cea2aa-c85a-4c63-bc8e-0e86df8bfa23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:50.872431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-07edf900-4ded-4904-b5b9-66067453dfab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:50.880817 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-07edf900-4ded-4904-b5b9-66067453dfab tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 200 len: 1364 microversion: 2.1 time: 0.085408 May 28 21:08:50.881454 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 918/1844] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:50 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 1364 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:50.972172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-63b365c6-f837-43cc-a8e7-cd09c21657f6 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:50.973124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-63b365c6-f837-43cc-a8e7-cd09c21657f6 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:50.979808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63b365c6-f837-43cc-a8e7-cd09c21657f6 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:50.980409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63b365c6-f837-43cc-a8e7-cd09c21657f6 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:50.981105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63b365c6-f837-43cc-a8e7-cd09c21657f6 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:50.981548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63b365c6-f837-43cc-a8e7-cd09c21657f6 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:50.998204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-54cea2aa-c85a-4c63-bc8e-0e86df8bfa23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:51.007715 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-54cea2aa-c85a-4c63-bc8e-0e86df8bfa23 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c" status: 200 len: 1475 microversion: 2.1 time: 0.167948 May 28 21:08:51.017352 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 927/1845] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:50 2022] GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c => generated 1475 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:51.167268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-63b365c6-f837-43cc-a8e7-cd09c21657f6 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:51.175683 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-63b365c6-f837-43cc-a8e7-cd09c21657f6 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1314 microversion: 2.1 time: 0.208282 May 28 21:08:51.176279 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 919/1846] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:50 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:51.350208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cdd73e3e-62f1-46c0-b9fb-6c5b25c9ca60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:51.351281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cdd73e3e-62f1-46c0-b9fb-6c5b25c9ca60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:51.360629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cdd73e3e-62f1-46c0-b9fb-6c5b25c9ca60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:51.361095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cdd73e3e-62f1-46c0-b9fb-6c5b25c9ca60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:51.362176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cdd73e3e-62f1-46c0-b9fb-6c5b25c9ca60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:51.364779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cdd73e3e-62f1-46c0-b9fb-6c5b25c9ca60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:51.685008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cdd73e3e-62f1-46c0-b9fb-6c5b25c9ca60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:51.694956 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cdd73e3e-62f1-46c0-b9fb-6c5b25c9ca60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1308 microversion: 2.1 time: 0.348602 May 28 21:08:51.695607 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 928/1847] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:51 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1308 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:51.777885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d39a6bc2-968c-4729-ab8d-f4891942a762 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:51.778505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d39a6bc2-968c-4729-ab8d-f4891942a762 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:51.780663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b6405493-5cfa-4e38-9608-3247b309ed72 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:51.782442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b6405493-5cfa-4e38-9608-3247b309ed72 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:51.786646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d39a6bc2-968c-4729-ab8d-f4891942a762 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:51.789541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d39a6bc2-968c-4729-ab8d-f4891942a762 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:51.790432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d39a6bc2-968c-4729-ab8d-f4891942a762 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:51.791035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d39a6bc2-968c-4729-ab8d-f4891942a762 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:51.794349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6405493-5cfa-4e38-9608-3247b309ed72 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:51.801859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6405493-5cfa-4e38-9608-3247b309ed72 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:51.801859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6405493-5cfa-4e38-9608-3247b309ed72 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:51.801859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6405493-5cfa-4e38-9608-3247b309ed72 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:52.458676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b6405493-5cfa-4e38-9608-3247b309ed72 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:52.462253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d39a6bc2-968c-4729-ab8d-f4891942a762 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:52.467190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b6405493-5cfa-4e38-9608-3247b309ed72 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:52.468934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b6405493-5cfa-4e38-9608-3247b309ed72 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:52.470230 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b6405493-5cfa-4e38-9608-3247b309ed72 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1480 microversion: 2.25 time: 0.694628 May 28 21:08:52.470668 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d39a6bc2-968c-4729-ab8d-f4891942a762 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.696791 May 28 21:08:52.471265 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 929/1848] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:51 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1480 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:52.471620 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 920/1849] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:51 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:52.481891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-784c7bd1-b195-4101-9ae8-397b2b479878 req-228d6c32-8471-4eb3-8a9d-cce124bf873b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e00995a1-4fea-46e2-b9c9-7e0fd95d60dc", "name": "network-vif-deleted", "tag": "13c4db0b-f2f9-4929-aa11-0599f0e9d8da"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:52.482073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f816cc4d-35b6-48cb-bf65-3d8f1668b7e6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:52.482073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f816cc4d-35b6-48cb-bf65-3d8f1668b7e6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 394fe269-dd5e-4d4e-8f49-de1df1812e6a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:52.485704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-784c7bd1-b195-4101-9ae8-397b2b479878 req-228d6c32-8471-4eb3-8a9d-cce124bf873b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:52.486204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-784c7bd1-b195-4101-9ae8-397b2b479878 req-228d6c32-8471-4eb3-8a9d-cce124bf873b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:52.488812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f816cc4d-35b6-48cb-bf65-3d8f1668b7e6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:52.489267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f816cc4d-35b6-48cb-bf65-3d8f1668b7e6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:52.490147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f816cc4d-35b6-48cb-bf65-3d8f1668b7e6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:52.490596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f816cc4d-35b6-48cb-bf65-3d8f1668b7e6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:52.498233 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-784c7bd1-b195-4101-9ae8-397b2b479878 req-228d6c32-8471-4eb3-8a9d-cce124bf873b service nova] Creating event network-vif-deleted:13c4db0b-f2f9-4929-aa11-0599f0e9d8da for instance e00995a1-4fea-46e2-b9c9-7e0fd95d60dc on nch2-master-1 May 28 21:08:52.503885 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-784c7bd1-b195-4101-9ae8-397b2b479878 req-228d6c32-8471-4eb3-8a9d-cce124bf873b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031151 May 28 21:08:52.504476 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 921/1850] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:52.506361 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-f816cc4d-35b6-48cb-bf65-3d8f1668b7e6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] HTTP exception thrown: Instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a could not be found. May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f816cc4d-35b6-48cb-bf65-3d8f1668b7e6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Request method failure captured: May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a HTTP/1.1 May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4hWC4_EcvC2XsuVnnxNz_dxJImgpsbJWZ_PXp7PUILknItQzKVH6ehVtbER1cKjMBABmFNx8Yg1K7b5juXvEfJe5ZW6e3Pt_gRCgUjKi44Z7ADai4URx_ueJHdGc21HB-XZZ6BKlcRkw3l4WxtcD6IwN6BgTB7bxQwZoEYJKJ1w9c May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: d6c38a96a96b4fba9e41ac58f5054803 May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-MigrationsAdminTest-1239768997 May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d6c38a96a96b4fba9e41ac58f5054803", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6c38a96a96b4fba9e41ac58f5054803"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d6c38a96a96b4fba9e41ac58f5054803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6c38a96a96b4fba9e41ac58f5054803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-MigrationsAdminTest-1239768997 May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: d6c38a96a96b4fba9e41ac58f5054803 May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-MigrationsAdminTest-1239768997 May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-MigrationsAdminTest-1239768997-project May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: c14b965da64c40e382c69050ba01b183 May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-MigrationsAdminTest-1239768997-project May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a could not be found. May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '394fe269-dd5e-4d4e-8f49-de1df1812e6a'} May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a could not be found. May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a could not be found. May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:52.508055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:52.512605 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:52.512605 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:52.512605 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:52.512605 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:08:52.512605 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:08:52.512605 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a could not be found. May 28 21:08:52.512605 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:52.512605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f816cc4d-35b6-48cb-bf65-3d8f1668b7e6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Returning 404 to user: Instance 394fe269-dd5e-4d4e-8f49-de1df1812e6a could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:08:52.512605 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f816cc4d-35b6-48cb-bf65-3d8f1668b7e6 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a" status: 404 len: 111 microversion: 2.1 time: 0.036071 May 28 21:08:52.512605 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 930/1851] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:52 2022] GET /compute/v2.1/servers/394fe269-dd5e-4d4e-8f49-de1df1812e6a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:08:52.514418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d62c4b68-d690-4744-bf99-5be676845030 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:52.514418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d62c4b68-d690-4744-bf99-5be676845030 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: c8294ac6-8d71-482c-8c67-67109bb03a2c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:52.514806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-02bb1100-60c1-48f6-a4ce-e01c6c397e16 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:52.515439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-02bb1100-60c1-48f6-a4ce-e01c6c397e16 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:52.520590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d62c4b68-d690-4744-bf99-5be676845030 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:52.525894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d62c4b68-d690-4744-bf99-5be676845030 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:52.525894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d62c4b68-d690-4744-bf99-5be676845030 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:52.525894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d62c4b68-d690-4744-bf99-5be676845030 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:52.542912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-02bb1100-60c1-48f6-a4ce-e01c6c397e16 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:52.543395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-02bb1100-60c1-48f6-a4ce-e01c6c397e16 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:52.544205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-02bb1100-60c1-48f6-a4ce-e01c6c397e16 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:52.544657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-02bb1100-60c1-48f6-a4ce-e01c6c397e16 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:52.639560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d62c4b68-d690-4744-bf99-5be676845030 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:52.660400 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d62c4b68-d690-4744-bf99-5be676845030 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c" status: 200 len: 1433 microversion: 2.1 time: 0.154440 May 28 21:08:52.661941 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 922/1852] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:52 2022] GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c => generated 1433 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:52.669742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a12f529f-f811-41e0-b208-69924424a14d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:52.670653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a12f529f-f811-41e0-b208-69924424a14d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:52.697473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a12f529f-f811-41e0-b208-69924424a14d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:52.698208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a12f529f-f811-41e0-b208-69924424a14d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:52.699342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a12f529f-f811-41e0-b208-69924424a14d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:52.700416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a12f529f-f811-41e0-b208-69924424a14d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:52.766299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a12f529f-f811-41e0-b208-69924424a14d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:52.812268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-02bb1100-60c1-48f6-a4ce-e01c6c397e16 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:52.820294 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-02bb1100-60c1-48f6-a4ce-e01c6c397e16 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1314 microversion: 2.1 time: 0.308989 May 28 21:08:52.820875 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 931/1853] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:52 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:52.825771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1b66b410-c49c-479b-95c1-e429104b0377 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:52.826416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1b66b410-c49c-479b-95c1-e429104b0377 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:52.832739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b66b410-c49c-479b-95c1-e429104b0377 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:52.834669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b66b410-c49c-479b-95c1-e429104b0377 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:52.834983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b66b410-c49c-479b-95c1-e429104b0377 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:52.835637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b66b410-c49c-479b-95c1-e429104b0377 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:53.124305 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a12f529f-f811-41e0-b208-69924424a14d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "DELETE /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 204 len: 0 microversion: 2.1 time: 0.457012 May 28 21:08:53.124799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1b66b410-c49c-479b-95c1-e429104b0377 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:53.124985 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 923/1854] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:08:52 2022] DELETE /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:53.128140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-9a8ca5b8-a7d6-4194-924c-80a8c44e681f req-b695bbc5-50a7-4baa-b26b-300f17ea5144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8294ac6-8d71-482c-8c67-67109bb03a2c", "name": "network-vif-deleted", "tag": "570755cc-4cb9-4e9c-bf46-99cfda81d1b3"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:53.134506 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1b66b410-c49c-479b-95c1-e429104b0377 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1489 microversion: 2.1 time: 0.312492 May 28 21:08:53.135741 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 932/1855] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:52 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1489 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:53.139003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9a8ca5b8-a7d6-4194-924c-80a8c44e681f req-b695bbc5-50a7-4baa-b26b-300f17ea5144 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:53.139763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9a8ca5b8-a7d6-4194-924c-80a8c44e681f req-b695bbc5-50a7-4baa-b26b-300f17ea5144 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:53.141402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f20d6e3e-5e7b-4d88-96a8-26cd3ca13a74 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:53.141932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f20d6e3e-5e7b-4d88-96a8-26cd3ca13a74 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:53.149605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f20d6e3e-5e7b-4d88-96a8-26cd3ca13a74 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:53.151939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f20d6e3e-5e7b-4d88-96a8-26cd3ca13a74 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:53.154938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f20d6e3e-5e7b-4d88-96a8-26cd3ca13a74 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:53.155717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f20d6e3e-5e7b-4d88-96a8-26cd3ca13a74 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:53.161224 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-9a8ca5b8-a7d6-4194-924c-80a8c44e681f req-b695bbc5-50a7-4baa-b26b-300f17ea5144 service nova] Creating event network-vif-deleted:570755cc-4cb9-4e9c-bf46-99cfda81d1b3 for instance c8294ac6-8d71-482c-8c67-67109bb03a2c on nch2-master-1 May 28 21:08:53.166755 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-9a8ca5b8-a7d6-4194-924c-80a8c44e681f req-b695bbc5-50a7-4baa-b26b-300f17ea5144 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043610 May 28 21:08:53.168083 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 924/1856] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:53.179235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fad1dc52-8c43-4869-99f4-9a7f4c26467f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:53.180008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fad1dc52-8c43-4869-99f4-9a7f4c26467f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:53.187414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fad1dc52-8c43-4869-99f4-9a7f4c26467f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:53.187919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fad1dc52-8c43-4869-99f4-9a7f4c26467f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:53.188703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fad1dc52-8c43-4869-99f4-9a7f4c26467f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:53.189335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fad1dc52-8c43-4869-99f4-9a7f4c26467f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:53.192642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f20d6e3e-5e7b-4d88-96a8-26cd3ca13a74 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:53.332627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fad1dc52-8c43-4869-99f4-9a7f4c26467f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:53.340645 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fad1dc52-8c43-4869-99f4-9a7f4c26467f tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1468 microversion: 2.1 time: 0.167326 May 28 21:08:53.341227 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 925/1857] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:53 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1468 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:53.346980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c8400551-c37c-4905-85e6-2c672bcdbf31 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:53.353028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8400551-c37c-4905-85e6-2c672bcdbf31 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:53.362526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8400551-c37c-4905-85e6-2c672bcdbf31 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:53.415151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c8400551-c37c-4905-85e6-2c672bcdbf31 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Going to try to stop instance {{(pid=143129) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 21:08:53.669118 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f20d6e3e-5e7b-4d88-96a8-26cd3ca13a74 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 204 len: 0 microversion: 2.1 time: 0.531827 May 28 21:08:53.669762 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 933/1858] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:08:53 2022] DELETE /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:53.676016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a02cbfce-8ce9-4bdf-adc9-d7c0eb13ec5b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:53.677041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a02cbfce-8ce9-4bdf-adc9-d7c0eb13ec5b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:53.683831 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c8400551-c37c-4905-85e6-2c672bcdbf31 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "POST /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93/action" status: 202 len: 0 microversion: 2.1 time: 0.340832 May 28 21:08:53.684457 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 926/1859] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:08:53 2022] POST /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:08:53.694325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e5534845-d85c-4640-a8b9-abd276598caf tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:53.695403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e5534845-d85c-4640-a8b9-abd276598caf tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:53.702042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a02cbfce-8ce9-4bdf-adc9-d7c0eb13ec5b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:53.702400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5534845-d85c-4640-a8b9-abd276598caf tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:53.702636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a02cbfce-8ce9-4bdf-adc9-d7c0eb13ec5b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:53.702923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5534845-d85c-4640-a8b9-abd276598caf tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:53.704199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a02cbfce-8ce9-4bdf-adc9-d7c0eb13ec5b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:53.704323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5534845-d85c-4640-a8b9-abd276598caf tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:53.704718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a02cbfce-8ce9-4bdf-adc9-d7c0eb13ec5b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:53.704823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5534845-d85c-4640-a8b9-abd276598caf tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:53.710835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:53.805909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e5534845-d85c-4640-a8b9-abd276598caf tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:53.817352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e5534845-d85c-4640-a8b9-abd276598caf tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:53.818977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e5534845-d85c-4640-a8b9-abd276598caf tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:53.830824 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e5534845-d85c-4640-a8b9-abd276598caf tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1264 microversion: 2.25 time: 0.130609 May 28 21:08:53.830824 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 927/1860] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:53 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:53.832865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-72846df9-9fc1-4af6-b40b-5478ed9d29d2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:53.833500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-72846df9-9fc1-4af6-b40b-5478ed9d29d2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:53.839996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72846df9-9fc1-4af6-b40b-5478ed9d29d2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:53.840583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72846df9-9fc1-4af6-b40b-5478ed9d29d2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:53.841358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72846df9-9fc1-4af6-b40b-5478ed9d29d2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:53.841797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72846df9-9fc1-4af6-b40b-5478ed9d29d2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:53.913522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a02cbfce-8ce9-4bdf-adc9-d7c0eb13ec5b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:53.921321 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a02cbfce-8ce9-4bdf-adc9-d7c0eb13ec5b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.250277 May 28 21:08:53.922427 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 934/1861] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:53 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:53.926824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ee34043-156b-4325-b54a-e44743463d4b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:53.927426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8ee34043-156b-4325-b54a-e44743463d4b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: c8294ac6-8d71-482c-8c67-67109bb03a2c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:53.933583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ee34043-156b-4325-b54a-e44743463d4b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:53.934154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ee34043-156b-4325-b54a-e44743463d4b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:53.939443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ee34043-156b-4325-b54a-e44743463d4b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:53.939443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ee34043-156b-4325-b54a-e44743463d4b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:54.006079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8ee34043-156b-4325-b54a-e44743463d4b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:54.009245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-72846df9-9fc1-4af6-b40b-5478ed9d29d2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:54.013918 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8ee34043-156b-4325-b54a-e44743463d4b tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c" status: 200 len: 1304 microversion: 2.1 time: 0.090500 May 28 21:08:54.014490 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 935/1862] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:53 2022] GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:54.017253 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-72846df9-9fc1-4af6-b40b-5478ed9d29d2 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1664 microversion: 2.1 time: 0.195226 May 28 21:08:54.018219 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 928/1863] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:53 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1664 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:54.019183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4c0369d7-853d-4389-a10d-357df8e56a0c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:54.019790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4c0369d7-853d-4389-a10d-357df8e56a0c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:54.023363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-54d0baaf-ede6-4fa5-a620-f8901d112c2e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:54.024030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-54d0baaf-ede6-4fa5-a620-f8901d112c2e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:54.030709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54d0baaf-ede6-4fa5-a620-f8901d112c2e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:54.031201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54d0baaf-ede6-4fa5-a620-f8901d112c2e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:54.032334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54d0baaf-ede6-4fa5-a620-f8901d112c2e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:54.032812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54d0baaf-ede6-4fa5-a620-f8901d112c2e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:54.033929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c0369d7-853d-4389-a10d-357df8e56a0c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:54.034396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c0369d7-853d-4389-a10d-357df8e56a0c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:54.035163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c0369d7-853d-4389-a10d-357df8e56a0c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:54.035631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c0369d7-853d-4389-a10d-357df8e56a0c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:54.284199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-54d0baaf-ede6-4fa5-a620-f8901d112c2e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:54.293823 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-54d0baaf-ede6-4fa5-a620-f8901d112c2e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1314 microversion: 2.1 time: 0.274780 May 28 21:08:54.295844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4c0369d7-853d-4389-a10d-357df8e56a0c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:54.299258 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 929/1864] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:54 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:54.308463 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4c0369d7-853d-4389-a10d-357df8e56a0c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.292882 May 28 21:08:54.309325 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 936/1865] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:54 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:54.358319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d195e162-6f5c-465a-b3a8-fd02d691554c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:54.358975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d195e162-6f5c-465a-b3a8-fd02d691554c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:54.366316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d195e162-6f5c-465a-b3a8-fd02d691554c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:54.366781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d195e162-6f5c-465a-b3a8-fd02d691554c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:54.367557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d195e162-6f5c-465a-b3a8-fd02d691554c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:54.368002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d195e162-6f5c-465a-b3a8-fd02d691554c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:54.501098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d195e162-6f5c-465a-b3a8-fd02d691554c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:54.509204 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d195e162-6f5c-465a-b3a8-fd02d691554c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1468 microversion: 2.1 time: 0.154481 May 28 21:08:54.518931 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 930/1866] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:54 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1468 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:54.519483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-4fede1af-b2fe-44fe-8624-5359f12860bf req-b89d318b-9eb5-4302-8360-23402b818577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86838d0c-e2da-4d31-92e8-94fd9b6345a6", "name": "network-vif-deleted", "tag": "90dbd5de-6ef5-4258-8dc2-8e5a1f5600b0"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:54.528641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-4fede1af-b2fe-44fe-8624-5359f12860bf req-b89d318b-9eb5-4302-8360-23402b818577 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:54.529123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-4fede1af-b2fe-44fe-8624-5359f12860bf req-b89d318b-9eb5-4302-8360-23402b818577 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:54.542456 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-4fede1af-b2fe-44fe-8624-5359f12860bf req-b89d318b-9eb5-4302-8360-23402b818577 service nova] Creating event network-vif-deleted:90dbd5de-6ef5-4258-8dc2-8e5a1f5600b0 for instance 86838d0c-e2da-4d31-92e8-94fd9b6345a6 on nch2-master-1 May 28 21:08:54.551122 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-4fede1af-b2fe-44fe-8624-5359f12860bf req-b89d318b-9eb5-4302-8360-23402b818577 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032165 May 28 21:08:54.551122 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 937/1867] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:54.838544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-76778c51-2535-46ca-bb56-4587c684b05d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:54.839263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-76778c51-2535-46ca-bb56-4587c684b05d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:54.860479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76778c51-2535-46ca-bb56-4587c684b05d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:54.861037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76778c51-2535-46ca-bb56-4587c684b05d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:54.862086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76778c51-2535-46ca-bb56-4587c684b05d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:54.862531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76778c51-2535-46ca-bb56-4587c684b05d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:54.908549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76778c51-2535-46ca-bb56-4587c684b05d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:54.909289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76778c51-2535-46ca-bb56-4587c684b05d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:54.909748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-76778c51-2535-46ca-bb56-4587c684b05d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lazy-loading 'fault' on Instance uuid 86838d0c-e2da-4d31-92e8-94fd9b6345a6 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:54.942332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9ffa5369-e503-43a3-88be-60061f82b76f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:54.945793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9ffa5369-e503-43a3-88be-60061f82b76f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:54.952799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ffa5369-e503-43a3-88be-60061f82b76f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:54.954130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ffa5369-e503-43a3-88be-60061f82b76f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:54.955031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ffa5369-e503-43a3-88be-60061f82b76f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:54.955478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ffa5369-e503-43a3-88be-60061f82b76f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:54.999346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-76778c51-2535-46ca-bb56-4587c684b05d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:55.008707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-76778c51-2535-46ca-bb56-4587c684b05d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:55.010641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-76778c51-2535-46ca-bb56-4587c684b05d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:55.017460 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-76778c51-2535-46ca-bb56-4587c684b05d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 200 len: 1269 microversion: 2.25 time: 0.177344 May 28 21:08:55.017460 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 931/1868] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:54 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:08:55.031711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ee11f098-a568-4b7f-9773-1f601bbc0a5e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:55.032337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ee11f098-a568-4b7f-9773-1f601bbc0a5e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: c8294ac6-8d71-482c-8c67-67109bb03a2c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:55.039427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee11f098-a568-4b7f-9773-1f601bbc0a5e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:55.048689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee11f098-a568-4b7f-9773-1f601bbc0a5e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:55.049640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee11f098-a568-4b7f-9773-1f601bbc0a5e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:55.050181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee11f098-a568-4b7f-9773-1f601bbc0a5e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:55.104752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee11f098-a568-4b7f-9773-1f601bbc0a5e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:55.105465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee11f098-a568-4b7f-9773-1f601bbc0a5e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:55.106803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-ee11f098-a568-4b7f-9773-1f601bbc0a5e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lazy-loading 'fault' on Instance uuid c8294ac6-8d71-482c-8c67-67109bb03a2c {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:55.139186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9ffa5369-e503-43a3-88be-60061f82b76f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:55.150230 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9ffa5369-e503-43a3-88be-60061f82b76f tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.214352 May 28 21:08:55.160935 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 938/1869] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:54 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:55.166236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-de226844-811d-4997-8fc3-a0b807d35384 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:55.168233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-de226844-811d-4997-8fc3-a0b807d35384 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:55.182877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de226844-811d-4997-8fc3-a0b807d35384 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:55.187174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ee11f098-a568-4b7f-9773-1f601bbc0a5e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:55.191993 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:55.194224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de226844-811d-4997-8fc3-a0b807d35384 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:55.195978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de226844-811d-4997-8fc3-a0b807d35384 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:55.197505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de226844-811d-4997-8fc3-a0b807d35384 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:55.201156 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ee11f098-a568-4b7f-9773-1f601bbc0a5e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c" status: 200 len: 1309 microversion: 2.1 time: 0.174076 May 28 21:08:55.206577 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 932/1870] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:55 2022] GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c => generated 1309 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:55.237421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-5129eb27-9258-4516-8837-a074eacf825d req-7eba7932-026c-4d1f-af0d-bb3b9ba8bda9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a805a0-9660-4656-9fe5-2cd72fb96be9", "name": "network-vif-plugged", "status": "completed", "tag": "05e9b5fc-2b1f-4708-b1bf-2810843a11ba"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:55.270172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5129eb27-9258-4516-8837-a074eacf825d req-7eba7932-026c-4d1f-af0d-bb3b9ba8bda9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:55.272291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5129eb27-9258-4516-8837-a074eacf825d req-7eba7932-026c-4d1f-af0d-bb3b9ba8bda9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:55.312269 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-5129eb27-9258-4516-8837-a074eacf825d req-7eba7932-026c-4d1f-af0d-bb3b9ba8bda9 service nova] Creating event network-vif-plugged:05e9b5fc-2b1f-4708-b1bf-2810843a11ba for instance 21a805a0-9660-4656-9fe5-2cd72fb96be9 on nch1-master-1 May 28 21:08:55.319531 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-5129eb27-9258-4516-8837-a074eacf825d req-7eba7932-026c-4d1f-af0d-bb3b9ba8bda9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090007 May 28 21:08:55.320710 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 933/1871] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:55.326544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d67b5c63-5636-4966-9efd-214349b143e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:55.327468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d67b5c63-5636-4966-9efd-214349b143e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:55.335248 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:55.337879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d67b5c63-5636-4966-9efd-214349b143e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:55.338550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d67b5c63-5636-4966-9efd-214349b143e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:55.340133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d67b5c63-5636-4966-9efd-214349b143e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:55.340737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d67b5c63-5636-4966-9efd-214349b143e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:55.703505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d67b5c63-5636-4966-9efd-214349b143e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:55.713473 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d67b5c63-5636-4966-9efd-214349b143e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1314 microversion: 2.1 time: 0.391172 May 28 21:08:55.717567 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 934/1872] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:55 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:55.727903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-3cd77d86-3970-45fc-944c-be055e8c03e8 req-de77a8bc-03af-4ede-925e-5ffd4710b0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "569b037d-ace0-4ce6-8182-ddac69d2b2e2", "name": "network-vif-deleted", "tag": "04dfc232-ea06-4928-bc0e-827e83fc3bda"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:55.740387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-de226844-811d-4997-8fc3-a0b807d35384 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:55.746982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3cd77d86-3970-45fc-944c-be055e8c03e8 req-de77a8bc-03af-4ede-925e-5ffd4710b0c0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:55.750537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3cd77d86-3970-45fc-944c-be055e8c03e8 req-de77a8bc-03af-4ede-925e-5ffd4710b0c0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:55.762275 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-de226844-811d-4997-8fc3-a0b807d35384 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1664 microversion: 2.1 time: 0.599946 May 28 21:08:55.765350 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 939/1873] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:55 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1664 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:55.773601 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-3cd77d86-3970-45fc-944c-be055e8c03e8 req-de77a8bc-03af-4ede-925e-5ffd4710b0c0 service nova] Creating event network-vif-deleted:04dfc232-ea06-4928-bc0e-827e83fc3bda for instance 569b037d-ace0-4ce6-8182-ddac69d2b2e2 on nch2-master-1 May 28 21:08:55.773775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8be4a43a-e660-47b9-ac6c-fd8a8d91b6a4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:55.778930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8be4a43a-e660-47b9-ac6c-fd8a8d91b6a4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:55.779658 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-3cd77d86-3970-45fc-944c-be055e8c03e8 req-de77a8bc-03af-4ede-925e-5ffd4710b0c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057700 May 28 21:08:55.781095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8be4a43a-e660-47b9-ac6c-fd8a8d91b6a4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:55.782245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8be4a43a-e660-47b9-ac6c-fd8a8d91b6a4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:55.783112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8be4a43a-e660-47b9-ac6c-fd8a8d91b6a4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:55.783726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8be4a43a-e660-47b9-ac6c-fd8a8d91b6a4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:55.784880 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 935/1874] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:55.790592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-33b4060d-da60-4535-89f0-f3f61da5a713 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:55.791366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-33b4060d-da60-4535-89f0-f3f61da5a713 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:55.798992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33b4060d-da60-4535-89f0-f3f61da5a713 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:55.799504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33b4060d-da60-4535-89f0-f3f61da5a713 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:55.800289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33b4060d-da60-4535-89f0-f3f61da5a713 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:55.800905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33b4060d-da60-4535-89f0-f3f61da5a713 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:55.848878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33b4060d-da60-4535-89f0-f3f61da5a713 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:55.849418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33b4060d-da60-4535-89f0-f3f61da5a713 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:55.849945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-33b4060d-da60-4535-89f0-f3f61da5a713 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lazy-loading 'fault' on Instance uuid 569b037d-ace0-4ce6-8182-ddac69d2b2e2 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:55.914948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-33b4060d-da60-4535-89f0-f3f61da5a713 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:55.924022 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-33b4060d-da60-4535-89f0-f3f61da5a713 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 200 len: 1302 microversion: 2.1 time: 0.137876 May 28 21:08:55.924855 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 936/1875] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:55 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 1302 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:55.960234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8be4a43a-e660-47b9-ac6c-fd8a8d91b6a4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:55.968019 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8be4a43a-e660-47b9-ac6c-fd8a8d91b6a4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.201137 May 28 21:08:55.968590 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 940/1876] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:55 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:56.035610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d5523d74-0be5-41f9-b1f2-247028d8235b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:56.043464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d5523d74-0be5-41f9-b1f2-247028d8235b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 86838d0c-e2da-4d31-92e8-94fd9b6345a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:56.051082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5523d74-0be5-41f9-b1f2-247028d8235b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.051649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5523d74-0be5-41f9-b1f2-247028d8235b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.053718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5523d74-0be5-41f9-b1f2-247028d8235b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.054337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5523d74-0be5-41f9-b1f2-247028d8235b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.072243 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-d5523d74-0be5-41f9-b1f2-247028d8235b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] HTTP exception thrown: Instance 86838d0c-e2da-4d31-92e8-94fd9b6345a6 could not be found. May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d5523d74-0be5-41f9-b1f2-247028d8235b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Request method failure captured: May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 HTTP/1.1 May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko4m_yuyHzvqC91VltrUFawrFyN1GH0LlLIsSZFHSVsTaygt8GhV27n4HRJmKadeemEy4RYn9GtbL_1S8hrY0tpflIz4SUfEMoN660eHY344t3Nyyge7oEtVXZVoWvi42TWW6OLLkGKCMuSxJsh5tVUSLXhyZlDU2XwN3iDE9-ou06M May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Openstack-Nova-Api-Version: 2.25 May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 45a2b4e7e1484ea3807bc8d8bc31296c May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-605147657 May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_45a2b4e7e1484ea3807bc8d8bc31296c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/45a2b4e7e1484ea3807bc8d8bc31296c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/45a2b4e7e1484ea3807bc8d8bc31296c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/45a2b4e7e1484ea3807bc8d8bc31296c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-605147657 May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 45a2b4e7e1484ea3807bc8d8bc31296c May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-605147657 May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-LiveAutoBlockMigrationV225Test-605147657-project May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: fc6ee6dba5d24e90bff48384539fcd7f May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-605147657-project May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 86838d0c-e2da-4d31-92e8-94fd9b6345a6 could not be found. May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '86838d0c-e2da-4d31-92e8-94fd9b6345a6'} May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86838d0c-e2da-4d31-92e8-94fd9b6345a6 could not be found. May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86838d0c-e2da-4d31-92e8-94fd9b6345a6 could not be found. May 28 21:08:56.074251 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:56.079494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:56.079494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:56.079494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:56.079494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:56.079494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:56.079494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:08:56.079494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:08:56.079494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86838d0c-e2da-4d31-92e8-94fd9b6345a6 could not be found. May 28 21:08:56.079494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:56.081012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d5523d74-0be5-41f9-b1f2-247028d8235b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Returning 404 to user: Instance 86838d0c-e2da-4d31-92e8-94fd9b6345a6 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:08:56.081968 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d5523d74-0be5-41f9-b1f2-247028d8235b tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6" status: 404 len: 111 microversion: 2.25 time: 0.052430 May 28 21:08:56.082609 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 937/1877] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:08:56 2022] GET /compute/v2.1/servers/86838d0c-e2da-4d31-92e8-94fd9b6345a6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:08:56.168176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-63e7f3cc-13d0-49da-bf89-4e8151647e9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:56.173116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-63e7f3cc-13d0-49da-bf89-4e8151647e9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:56.185323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63e7f3cc-13d0-49da-bf89-4e8151647e9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.188430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63e7f3cc-13d0-49da-bf89-4e8151647e9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.190576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63e7f3cc-13d0-49da-bf89-4e8151647e9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.190576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63e7f3cc-13d0-49da-bf89-4e8151647e9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.223718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b2964469-3b89-4bd6-a455-38295fc5e716 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:56.224442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b2964469-3b89-4bd6-a455-38295fc5e716 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: c8294ac6-8d71-482c-8c67-67109bb03a2c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:56.230646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2964469-3b89-4bd6-a455-38295fc5e716 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.231220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2964469-3b89-4bd6-a455-38295fc5e716 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.232240 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2964469-3b89-4bd6-a455-38295fc5e716 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.232894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2964469-3b89-4bd6-a455-38295fc5e716 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.247647 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-b2964469-3b89-4bd6-a455-38295fc5e716 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] HTTP exception thrown: Instance c8294ac6-8d71-482c-8c67-67109bb03a2c could not be found. May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b2964469-3b89-4bd6-a455-38295fc5e716 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Request method failure captured: May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c HTTP/1.1 May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko63S9ujoNVjbzSlNBIwxVY2Q5AFVR-UVWhYbJi9Uiz9UekTK1o7epqZDk_tlmvIuDTjLXkNiU6RvYy3hBvVwxyKeaMPOH_83uAwKWRKNsWK0H3fAptxoBUiyHKBpK0QoDLUjvemfYQiLZUDVHKOGwFy9SUG4nZTopFdtw5NG2wjQOc May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 348fbbc628b44152b05362657c11230d May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_348fbbc628b44152b05362657c11230d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/348fbbc628b44152b05362657c11230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 348fbbc628b44152b05362657c11230d May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 5e54b51913be4a2bab74aae347785727 May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance c8294ac6-8d71-482c-8c67-67109bb03a2c could not be found. May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'c8294ac6-8d71-482c-8c67-67109bb03a2c'} May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8294ac6-8d71-482c-8c67-67109bb03a2c could not be found. May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8294ac6-8d71-482c-8c67-67109bb03a2c could not be found. May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:56.249327 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:56.254606 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:56.254606 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:56.254606 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:56.254606 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:08:56.254606 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:08:56.254606 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8294ac6-8d71-482c-8c67-67109bb03a2c could not be found. May 28 21:08:56.254606 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:56.254606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b2964469-3b89-4bd6-a455-38295fc5e716 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Returning 404 to user: Instance c8294ac6-8d71-482c-8c67-67109bb03a2c could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:08:56.254606 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b2964469-3b89-4bd6-a455-38295fc5e716 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c" status: 404 len: 111 microversion: 2.1 time: 0.031205 May 28 21:08:56.255664 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 938/1878] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:56 2022] GET /compute/v2.1/servers/c8294ac6-8d71-482c-8c67-67109bb03a2c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:08:56.260079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c7b2ec76-29cf-4520-b4f2-e92d173cfed2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:56.260577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c7b2ec76-29cf-4520-b4f2-e92d173cfed2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: e00995a1-4fea-46e2-b9c9-7e0fd95d60dc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:56.266793 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7b2ec76-29cf-4520-b4f2-e92d173cfed2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.267247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7b2ec76-29cf-4520-b4f2-e92d173cfed2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.268018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7b2ec76-29cf-4520-b4f2-e92d173cfed2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.268792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7b2ec76-29cf-4520-b4f2-e92d173cfed2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.290494 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-c7b2ec76-29cf-4520-b4f2-e92d173cfed2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] HTTP exception thrown: Instance e00995a1-4fea-46e2-b9c9-7e0fd95d60dc could not be found. May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c7b2ec76-29cf-4520-b4f2-e92d173cfed2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Request method failure captured: May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc HTTP/1.1 May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko63S9ujoNVjbzSlNBIwxVY2Q5AFVR-UVWhYbJi9Uiz9UekTK1o7epqZDk_tlmvIuDTjLXkNiU6RvYy3hBvVwxyKeaMPOH_83uAwKWRKNsWK0H3fAptxoBUiyHKBpK0QoDLUjvemfYQiLZUDVHKOGwFy9SUG4nZTopFdtw5NG2wjQOc May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 348fbbc628b44152b05362657c11230d May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_348fbbc628b44152b05362657c11230d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/348fbbc628b44152b05362657c11230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 348fbbc628b44152b05362657c11230d May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 5e54b51913be4a2bab74aae347785727 May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance e00995a1-4fea-46e2-b9c9-7e0fd95d60dc could not be found. May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'e00995a1-4fea-46e2-b9c9-7e0fd95d60dc'} May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e00995a1-4fea-46e2-b9c9-7e0fd95d60dc could not be found. May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e00995a1-4fea-46e2-b9c9-7e0fd95d60dc could not be found. May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:56.292245 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:56.297132 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:56.297132 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:56.297132 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:56.297132 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:08:56.297132 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:08:56.297132 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e00995a1-4fea-46e2-b9c9-7e0fd95d60dc could not be found. May 28 21:08:56.297132 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:56.299181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c7b2ec76-29cf-4520-b4f2-e92d173cfed2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Returning 404 to user: Instance e00995a1-4fea-46e2-b9c9-7e0fd95d60dc could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:08:56.300078 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c7b2ec76-29cf-4520-b4f2-e92d173cfed2 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc" status: 404 len: 111 microversion: 2.1 time: 0.044119 May 28 21:08:56.300810 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 939/1879] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:56 2022] GET /compute/v2.1/servers/e00995a1-4fea-46e2-b9c9-7e0fd95d60dc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:08:56.308981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4f9eb7d2-90d9-4aeb-807f-29ff5731434f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:56.363438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-63e7f3cc-13d0-49da-bf89-4e8151647e9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:56.372186 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-63e7f3cc-13d0-49da-bf89-4e8151647e9c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.207904 May 28 21:08:56.372766 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 941/1880] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:56 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:56.427816 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4f9eb7d2-90d9-4aeb-807f-29ff5731434f tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/05891d77-14b5-4196-bc2a-53cd5da97ab2" status: 204 len: 0 microversion: 2.1 time: 0.122695 May 28 21:08:56.431147 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 940/1881] 10.222.0.33 () {58 vars in 1265 bytes} [Sat May 28 21:08:56 2022] DELETE /compute/v2.1/os-server-groups/05891d77-14b5-4196-bc2a-53cd5da97ab2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:08:56.439817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ed35098d-2852-41a9-9918-1aa6f82a988e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:56.440324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ed35098d-2852-41a9-9918-1aa6f82a988e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:56.447851 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed35098d-2852-41a9-9918-1aa6f82a988e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.448304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed35098d-2852-41a9-9918-1aa6f82a988e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.449317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed35098d-2852-41a9-9918-1aa6f82a988e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.449816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed35098d-2852-41a9-9918-1aa6f82a988e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.506193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ed35098d-2852-41a9-9918-1aa6f82a988e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:56.573082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-cac50c2d-8e6f-45c8-8873-711a39ef725f req-b026a2f6-fbea-4fe2-87f6-fcdef92ae7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2332865a-7f64-4b42-bef6-75a5d7c6c77f", "name": "network-vif-deleted", "tag": "75b54983-d107-4ad1-a9f9-b77effb39ba3"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:56.590650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cac50c2d-8e6f-45c8-8873-711a39ef725f req-b026a2f6-fbea-4fe2-87f6-fcdef92ae7f3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.604752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cac50c2d-8e6f-45c8-8873-711a39ef725f req-b026a2f6-fbea-4fe2-87f6-fcdef92ae7f3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.632276 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-cac50c2d-8e6f-45c8-8873-711a39ef725f req-b026a2f6-fbea-4fe2-87f6-fcdef92ae7f3 service nova] Creating event network-vif-deleted:75b54983-d107-4ad1-a9f9-b77effb39ba3 for instance 2332865a-7f64-4b42-bef6-75a5d7c6c77f on nch1-master-1 May 28 21:08:56.638522 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-cac50c2d-8e6f-45c8-8873-711a39ef725f req-b026a2f6-fbea-4fe2-87f6-fcdef92ae7f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076118 May 28 21:08:56.639448 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 941/1882] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:56.731734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-116bfabc-5465-4ba6-a5f2-40116b563348 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:56.732584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-116bfabc-5465-4ba6-a5f2-40116b563348 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:56.739632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-116bfabc-5465-4ba6-a5f2-40116b563348 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.740920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-116bfabc-5465-4ba6-a5f2-40116b563348 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.741534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-116bfabc-5465-4ba6-a5f2-40116b563348 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.742008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-116bfabc-5465-4ba6-a5f2-40116b563348 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.887222 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ed35098d-2852-41a9-9918-1aa6f82a988e tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 204 len: 0 microversion: 2.1 time: 0.452078 May 28 21:08:56.891720 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 942/1883] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:08:56 2022] DELETE /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:56.895146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-116bfabc-5465-4ba6-a5f2-40116b563348 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:56.898302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-94676660-03e4-41fa-8212-bd50a5a9f388 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:56.899201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-94676660-03e4-41fa-8212-bd50a5a9f388 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:56.902868 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-116bfabc-5465-4ba6-a5f2-40116b563348 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1314 microversion: 2.1 time: 0.175289 May 28 21:08:56.903555 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 942/1884] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:56 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:56.907359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94676660-03e4-41fa-8212-bd50a5a9f388 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.907805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94676660-03e4-41fa-8212-bd50a5a9f388 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.908606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94676660-03e4-41fa-8212-bd50a5a9f388 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.909064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94676660-03e4-41fa-8212-bd50a5a9f388 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.917586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6fdf6a15-c162-4798-8e13-599074e3e55d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:56.918526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6fdf6a15-c162-4798-8e13-599074e3e55d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:56.926815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6fdf6a15-c162-4798-8e13-599074e3e55d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.927483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6fdf6a15-c162-4798-8e13-599074e3e55d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.928700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6fdf6a15-c162-4798-8e13-599074e3e55d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.930306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6fdf6a15-c162-4798-8e13-599074e3e55d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.958698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94676660-03e4-41fa-8212-bd50a5a9f388 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:56.959283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94676660-03e4-41fa-8212-bd50a5a9f388 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:56.960022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-94676660-03e4-41fa-8212-bd50a5a9f388 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lazy-loading 'fault' on Instance uuid 2332865a-7f64-4b42-bef6-75a5d7c6c77f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:57.033350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-94676660-03e4-41fa-8212-bd50a5a9f388 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:57.041652 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-94676660-03e4-41fa-8212-bd50a5a9f388 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1316 microversion: 2.1 time: 0.148577 May 28 21:08:57.043233 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 943/1885] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:56 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:57.049694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9b4a3ec1-2741-4c9f-9015-200cba9544e0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:57.050634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9b4a3ec1-2741-4c9f-9015-200cba9544e0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: 569b037d-ace0-4ce6-8182-ddac69d2b2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:57.059058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b4a3ec1-2741-4c9f-9015-200cba9544e0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:57.059759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b4a3ec1-2741-4c9f-9015-200cba9544e0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:57.060711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b4a3ec1-2741-4c9f-9015-200cba9544e0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:57.061149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b4a3ec1-2741-4c9f-9015-200cba9544e0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:57.082223 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-9b4a3ec1-2741-4c9f-9015-200cba9544e0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] HTTP exception thrown: Instance 569b037d-ace0-4ce6-8182-ddac69d2b2e2 could not be found. May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9b4a3ec1-2741-4c9f-9015-200cba9544e0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Request method failure captured: May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 HTTP/1.1 May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4hWC4_EcvC2XsuVnnxNz_dxJImgpsbJWZ_PXp7PUILknItQzKVH6ehVtbER1cKjMBABmFNx8Yg1K7b5juXvEfJe5ZW6e3Pt_gRCgUjKi44Z7ADai4URx_ueJHdGc21HB-XZZ6BKlcRkw3l4WxtcD6IwN6BgTB7bxQwZoEYJKJ1w9c May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: d6c38a96a96b4fba9e41ac58f5054803 May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-MigrationsAdminTest-1239768997 May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d6c38a96a96b4fba9e41ac58f5054803", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6c38a96a96b4fba9e41ac58f5054803"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d6c38a96a96b4fba9e41ac58f5054803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6c38a96a96b4fba9e41ac58f5054803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-MigrationsAdminTest-1239768997 May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: d6c38a96a96b4fba9e41ac58f5054803 May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-MigrationsAdminTest-1239768997 May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-MigrationsAdminTest-1239768997-project May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: c14b965da64c40e382c69050ba01b183 May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-MigrationsAdminTest-1239768997-project May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 569b037d-ace0-4ce6-8182-ddac69d2b2e2 could not be found. May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '569b037d-ace0-4ce6-8182-ddac69d2b2e2'} May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 569b037d-ace0-4ce6-8182-ddac69d2b2e2 could not be found. May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 569b037d-ace0-4ce6-8182-ddac69d2b2e2 could not be found. May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:57.084019 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:57.088547 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:57.088547 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:57.088547 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:57.088547 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:08:57.088547 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:08:57.088547 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 569b037d-ace0-4ce6-8182-ddac69d2b2e2 could not be found. May 28 21:08:57.088547 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:08:57.088547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9b4a3ec1-2741-4c9f-9015-200cba9544e0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Returning 404 to user: Instance 569b037d-ace0-4ce6-8182-ddac69d2b2e2 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:08:57.088547 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9b4a3ec1-2741-4c9f-9015-200cba9544e0 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2" status: 404 len: 111 microversion: 2.1 time: 0.041939 May 28 21:08:57.088547 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 944/1886] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:57 2022] GET /compute/v2.1/servers/569b037d-ace0-4ce6-8182-ddac69d2b2e2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:08:57.092194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9bea4455-36d8-436b-946b-855e43c9d576 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:57.093562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9bea4455-36d8-436b-946b-855e43c9d576 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:57.100705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bea4455-36d8-436b-946b-855e43c9d576 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:57.101360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bea4455-36d8-436b-946b-855e43c9d576 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:57.102363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bea4455-36d8-436b-946b-855e43c9d576 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:57.102962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bea4455-36d8-436b-946b-855e43c9d576 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:57.137155 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6fdf6a15-c162-4798-8e13-599074e3e55d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:57.145378 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6fdf6a15-c162-4798-8e13-599074e3e55d tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1473 microversion: 2.1 time: 0.240728 May 28 21:08:57.146020 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 943/1887] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:56 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1473 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:57.161412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f10c01e3-b68f-4faf-89d3-f12b04a354e8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:57.162020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f10c01e3-b68f-4faf-89d3-f12b04a354e8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:57.170866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f10c01e3-b68f-4faf-89d3-f12b04a354e8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:57.171982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f10c01e3-b68f-4faf-89d3-f12b04a354e8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:57.172970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f10c01e3-b68f-4faf-89d3-f12b04a354e8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:57.173570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f10c01e3-b68f-4faf-89d3-f12b04a354e8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:57.216742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f10c01e3-b68f-4faf-89d3-f12b04a354e8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:08:57.266965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9bea4455-36d8-436b-946b-855e43c9d576 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:57.275215 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9bea4455-36d8-436b-946b-855e43c9d576 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.186893 May 28 21:08:57.275802 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 945/1888] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:57 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:57.390405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f068c7df-f61a-4269-a20e-96af7c305bf3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:57.391133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f068c7df-f61a-4269-a20e-96af7c305bf3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:57.397807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f068c7df-f61a-4269-a20e-96af7c305bf3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:57.398244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f068c7df-f61a-4269-a20e-96af7c305bf3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:57.399106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f068c7df-f61a-4269-a20e-96af7c305bf3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:57.399558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f068c7df-f61a-4269-a20e-96af7c305bf3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:57.580725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f068c7df-f61a-4269-a20e-96af7c305bf3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:57.581175 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f10c01e3-b68f-4faf-89d3-f12b04a354e8 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "DELETE /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 204 len: 0 microversion: 2.1 time: 0.421945 May 28 21:08:57.582899 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 944/1889] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:08:57 2022] DELETE /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:08:57.591371 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8485ca69-5206-4059-9412-64630d0fe1e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:57.592084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8485ca69-5206-4059-9412-64630d0fe1e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:57.597214 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f068c7df-f61a-4269-a20e-96af7c305bf3 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.211211 May 28 21:08:57.600533 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 946/1890] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:57 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:57.605223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8485ca69-5206-4059-9412-64630d0fe1e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:57.605975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8485ca69-5206-4059-9412-64630d0fe1e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:57.606945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8485ca69-5206-4059-9412-64630d0fe1e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:57.607558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8485ca69-5206-4059-9412-64630d0fe1e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:57.744942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8485ca69-5206-4059-9412-64630d0fe1e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:57.752598 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8485ca69-5206-4059-9412-64630d0fe1e4 tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1469 microversion: 2.1 time: 0.165639 May 28 21:08:57.753165 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 945/1891] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:57 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:57.919740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-86046127-6640-4795-98f0-19c8186f652a tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:57.920356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-86046127-6640-4795-98f0-19c8186f652a tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:57.926530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86046127-6640-4795-98f0-19c8186f652a tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:57.926981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86046127-6640-4795-98f0-19c8186f652a tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:57.927796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86046127-6640-4795-98f0-19c8186f652a tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:57.928235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86046127-6640-4795-98f0-19c8186f652a tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:58.060741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-31a1d680-aab9-4037-a421-bf7ba278f600 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:58.061373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-31a1d680-aab9-4037-a421-bf7ba278f600 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:58.063298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-86046127-6640-4795-98f0-19c8186f652a tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:58.071246 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-86046127-6640-4795-98f0-19c8186f652a tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1501 microversion: 2.1 time: 0.155420 May 28 21:08:58.071423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31a1d680-aab9-4037-a421-bf7ba278f600 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:58.076539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31a1d680-aab9-4037-a421-bf7ba278f600 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:58.076676 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 947/1892] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:57 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:58.076778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31a1d680-aab9-4037-a421-bf7ba278f600 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:58.076778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31a1d680-aab9-4037-a421-bf7ba278f600 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:58.091323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3ca16cca-bea4-4a8c-af61-70faeee08a3e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-922010646"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:58.092042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3ca16cca-bea4-4a8c-af61-70faeee08a3e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:58.099526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ca16cca-bea4-4a8c-af61-70faeee08a3e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:58.100019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ca16cca-bea4-4a8c-af61-70faeee08a3e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:58.100834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ca16cca-bea4-4a8c-af61-70faeee08a3e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:58.101280 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ca16cca-bea4-4a8c-af61-70faeee08a3e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:58.111347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31a1d680-aab9-4037-a421-bf7ba278f600 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:58.111944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31a1d680-aab9-4037-a421-bf7ba278f600 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:58.112467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-31a1d680-aab9-4037-a421-bf7ba278f600 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lazy-loading 'fault' on Instance uuid 2332865a-7f64-4b42-bef6-75a5d7c6c77f {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:58.172411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-31a1d680-aab9-4037-a421-bf7ba278f600 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf67d3b90f7642c2b23020958f14e53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caacba1610f44c5ca8057b10a2dd483a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:58.196921 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-31a1d680-aab9-4037-a421-bf7ba278f600 tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 200 len: 1316 microversion: 2.1 time: 0.124014 May 28 21:08:58.196921 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 946/1893] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:58 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 1316 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:08:58.196921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2343922c-be5f-4cb0-86c6-7b0c57323734 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:58.196921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2343922c-be5f-4cb0-86c6-7b0c57323734 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:58.196921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2343922c-be5f-4cb0-86c6-7b0c57323734 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:58.196921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2343922c-be5f-4cb0-86c6-7b0c57323734 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:58.196921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2343922c-be5f-4cb0-86c6-7b0c57323734 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:58.196921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2343922c-be5f-4cb0-86c6-7b0c57323734 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:58.294941 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.network.security_group_api [None req-3ca16cca-bea4-4a8c-af61-70faeee08a3e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Adding security group 70e12b53-6e92-4a32-9229-6729d50ebb3f to port 05e9b5fc-2b1f-4708-b1bf-2810843a11ba May 28 21:08:58.434527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2343922c-be5f-4cb0-86c6-7b0c57323734 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:58.443734 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2343922c-be5f-4cb0-86c6-7b0c57323734 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1473 microversion: 2.1 time: 0.261969 May 28 21:08:58.444353 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 947/1894] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:58 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1473 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:58.449188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6ffeaa31-ed01-45fb-9cdf-b7d495d6d797 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:58.450506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6ffeaa31-ed01-45fb-9cdf-b7d495d6d797 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:58.455736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ffeaa31-ed01-45fb-9cdf-b7d495d6d797 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:58.456184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ffeaa31-ed01-45fb-9cdf-b7d495d6d797 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:58.457371 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ffeaa31-ed01-45fb-9cdf-b7d495d6d797 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:58.457812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ffeaa31-ed01-45fb-9cdf-b7d495d6d797 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:58.704306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6ffeaa31-ed01-45fb-9cdf-b7d495d6d797 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:58.712447 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6ffeaa31-ed01-45fb-9cdf-b7d495d6d797 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.266929 May 28 21:08:58.713650 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 948/1895] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:58 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:58.718481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-19f49000-8256-49f2-b9c3-71052e76fbaa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:58.722926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-19f49000-8256-49f2-b9c3-71052e76fbaa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:58.725908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19f49000-8256-49f2-b9c3-71052e76fbaa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:58.726371 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19f49000-8256-49f2-b9c3-71052e76fbaa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:58.727469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19f49000-8256-49f2-b9c3-71052e76fbaa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:58.727589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19f49000-8256-49f2-b9c3-71052e76fbaa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:58.888979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-19f49000-8256-49f2-b9c3-71052e76fbaa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:58.896532 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-19f49000-8256-49f2-b9c3-71052e76fbaa tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.181817 May 28 21:08:58.897101 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 949/1896] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:58 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:58.901783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9ae9fc14-f08d-4673-a43e-0115c94f4eff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:58.902423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9ae9fc14-f08d-4673-a43e-0115c94f4eff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:58.909056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ae9fc14-f08d-4673-a43e-0115c94f4eff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:58.909519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ae9fc14-f08d-4673-a43e-0115c94f4eff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:58.910331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ae9fc14-f08d-4673-a43e-0115c94f4eff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:58.910771 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ae9fc14-f08d-4673-a43e-0115c94f4eff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:58.969635 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3ca16cca-bea4-4a8c-af61-70faeee08a3e tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9/action" status: 202 len: 0 microversion: 2.1 time: 0.882082 May 28 21:08:58.974717 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 948/1897] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:08:58 2022] POST /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9/action => generated 0 bytes in 885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:08:58.979589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cb545589-00b8-4b83-8f4f-8d941be0d6d2 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-221291577"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:58.980409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cb545589-00b8-4b83-8f4f-8d941be0d6d2 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:58.987858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb545589-00b8-4b83-8f4f-8d941be0d6d2 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:58.988584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb545589-00b8-4b83-8f4f-8d941be0d6d2 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:58.989543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb545589-00b8-4b83-8f4f-8d941be0d6d2 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:58.990192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb545589-00b8-4b83-8f4f-8d941be0d6d2 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:59.231003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9ae9fc14-f08d-4673-a43e-0115c94f4eff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:59.240020 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9ae9fc14-f08d-4673-a43e-0115c94f4eff tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1469 microversion: 2.1 time: 0.341750 May 28 21:08:59.241559 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 950/1898] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:58 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1469 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:59.248129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-9e7b4155-c631-4ea3-a998-c5ebdc0f25d4 req-b5e3f837-1e0b-4323-8a4d-8a949be8a3aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a805a0-9660-4656-9fe5-2cd72fb96be9", "tag": "05e9b5fc-2b1f-4708-b1bf-2810843a11ba"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:59.257272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9e7b4155-c631-4ea3-a998-c5ebdc0f25d4 req-b5e3f837-1e0b-4323-8a4d-8a949be8a3aa service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:59.257729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9e7b4155-c631-4ea3-a998-c5ebdc0f25d4 req-b5e3f837-1e0b-4323-8a4d-8a949be8a3aa service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:59.271628 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-9e7b4155-c631-4ea3-a998-c5ebdc0f25d4 req-b5e3f837-1e0b-4323-8a4d-8a949be8a3aa service nova] Creating event network-changed:05e9b5fc-2b1f-4708-b1bf-2810843a11ba for instance 21a805a0-9660-4656-9fe5-2cd72fb96be9 on nch1-master-1 May 28 21:08:59.278000 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-9e7b4155-c631-4ea3-a998-c5ebdc0f25d4 req-b5e3f837-1e0b-4323-8a4d-8a949be8a3aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034927 May 28 21:08:59.278843 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 951/1899] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:59.285101 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.network.security_group_api [None req-cb545589-00b8-4b83-8f4f-8d941be0d6d2 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Adding security group 277ccc1c-782b-4085-bdd0-5b872237dd65 to port 05e9b5fc-2b1f-4708-b1bf-2810843a11ba May 28 21:08:59.293169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-5c449417-40c1-4dba-adae-f501acc46a33 req-c06cb6c5-d845-444f-881b-6c3477190e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fd99f38-0c1f-4ec7-9ec6-03463939ec67", "name": "network-vif-deleted", "tag": "22d3cc7c-e5d2-4836-b3d4-9cf47f95e009"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:08:59.303896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5c449417-40c1-4dba-adae-f501acc46a33 req-c06cb6c5-d845-444f-881b-6c3477190e63 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:59.305138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5c449417-40c1-4dba-adae-f501acc46a33 req-c06cb6c5-d845-444f-881b-6c3477190e63 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:59.322630 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-5c449417-40c1-4dba-adae-f501acc46a33 req-c06cb6c5-d845-444f-881b-6c3477190e63 service nova] Creating event network-vif-deleted:22d3cc7c-e5d2-4836-b3d4-9cf47f95e009 for instance 9fd99f38-0c1f-4ec7-9ec6-03463939ec67 on nch1-master-1 May 28 21:08:59.329791 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-5c449417-40c1-4dba-adae-f501acc46a33 req-c06cb6c5-d845-444f-881b-6c3477190e63 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049294 May 28 21:08:59.331217 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 952/1900] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:08:59.339673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ad9de14d-e79e-405f-aedc-f24145086cca tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:59.341700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ad9de14d-e79e-405f-aedc-f24145086cca tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] [instance: 2332865a-7f64-4b42-bef6-75a5d7c6c77f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:59.361243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad9de14d-e79e-405f-aedc-f24145086cca tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:59.362209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad9de14d-e79e-405f-aedc-f24145086cca tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:59.363318 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad9de14d-e79e-405f-aedc-f24145086cca tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:59.364063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad9de14d-e79e-405f-aedc-f24145086cca tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:59.391610 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-ad9de14d-e79e-405f-aedc-f24145086cca tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] HTTP exception thrown: Instance 2332865a-7f64-4b42-bef6-75a5d7c6c77f could not be found. May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ad9de14d-e79e-405f-aedc-f24145086cca tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Request method failure captured: May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f HTTP/1.1 May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko8gzSSwSlPkkuMRaLjUf-NhA_SMjPRq4dLGZMnWtjXwqF_U7DsaZRKEx63R4RcLhIRTAj8eUzbB3WOgzQuO7UXvlnvaUoHf9X9v1E3dCjD6OACYXJdiz7iFWfSJK-bkaY_4tpGvVn81T0xxLA8plf3izGAN684kDbFEzYMCK3E0Ccw May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: caacba1610f44c5ca8057b10a2dd483a May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersTestFqdnHostnames-750486098 May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_caacba1610f44c5ca8057b10a2dd483a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/caacba1610f44c5ca8057b10a2dd483a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/caacba1610f44c5ca8057b10a2dd483a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/caacba1610f44c5ca8057b10a2dd483a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersTestFqdnHostnames-750486098 May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: caacba1610f44c5ca8057b10a2dd483a May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-750486098 May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersTestFqdnHostnames-750486098-project May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: bf67d3b90f7642c2b23020958f14e53b May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersTestFqdnHostnames-750486098-project May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 2332865a-7f64-4b42-bef6-75a5d7c6c77f could not be found. May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '2332865a-7f64-4b42-bef6-75a5d7c6c77f'} May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2332865a-7f64-4b42-bef6-75a5d7c6c77f could not be found. May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2332865a-7f64-4b42-bef6-75a5d7c6c77f could not be found. May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:08:59.393630 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:59.400756 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:08:59.400756 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:08:59.400756 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:08:59.400756 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:08:59.400756 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:08:59.400756 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2332865a-7f64-4b42-bef6-75a5d7c6c77f could not be found. May 28 21:08:59.400756 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:08:59.400756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ad9de14d-e79e-405f-aedc-f24145086cca tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Returning 404 to user: Instance 2332865a-7f64-4b42-bef6-75a5d7c6c77f could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:08:59.400756 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ad9de14d-e79e-405f-aedc-f24145086cca tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f" status: 404 len: 111 microversion: 2.1 time: 0.062330 May 28 21:08:59.400756 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 953/1901] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:59 2022] GET /compute/v2.1/servers/2332865a-7f64-4b42-bef6-75a5d7c6c77f => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:08:59.404602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dcc8d2c6-3973-4858-8a4f-1f2a983e54cd tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] Calling method '.version_select at 0x7f4d5779f8b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:59.498520 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dcc8d2c6-3973-4858-8a4f-1f2a983e54cd tempest-ServersTestFqdnHostnames-750486098 tempest-ServersTestFqdnHostnames-750486098-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148369027" status: 202 len: 0 microversion: 2.1 time: 0.097954 May 28 21:08:59.499126 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 954/1902] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 21:08:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148369027 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:08:59.509090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5bac6173-be29-4230-941c-2f345e112538 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:59.509713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5bac6173-be29-4230-941c-2f345e112538 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:59.523127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bac6173-be29-4230-941c-2f345e112538 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:59.524014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bac6173-be29-4230-941c-2f345e112538 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:59.524819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bac6173-be29-4230-941c-2f345e112538 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:59.525275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bac6173-be29-4230-941c-2f345e112538 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:59.530154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:08:59.579019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bac6173-be29-4230-941c-2f345e112538 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:59.579581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bac6173-be29-4230-941c-2f345e112538 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:59.580175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-5bac6173-be29-4230-941c-2f345e112538 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lazy-loading 'fault' on Instance uuid 9fd99f38-0c1f-4ec7-9ec6-03463939ec67 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:08:59.715602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5bac6173-be29-4230-941c-2f345e112538 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e54b51913be4a2bab74aae347785727', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348fbbc628b44152b05362657c11230d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:08:59.725550 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5bac6173-be29-4230-941c-2f345e112538 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 200 len: 1307 microversion: 2.1 time: 0.218775 May 28 21:08:59.733401 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 955/1903] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:59 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 1307 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:08:59.742516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-240d2168-e1f6-402c-bf0c-76a7609d3356 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:08:59.742516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-240d2168-e1f6-402c-bf0c-76a7609d3356 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:08:59.747046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-240d2168-e1f6-402c-bf0c-76a7609d3356 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:59.747445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-240d2168-e1f6-402c-bf0c-76a7609d3356 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:08:59.747924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-240d2168-e1f6-402c-bf0c-76a7609d3356 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:08:59.748373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-240d2168-e1f6-402c-bf0c-76a7609d3356 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:00.240847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-240d2168-e1f6-402c-bf0c-76a7609d3356 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:00.248635 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-240d2168-e1f6-402c-bf0c-76a7609d3356 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.514086 May 28 21:09:00.249433 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 956/1904] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:08:59 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:00.254022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-21177b17-bab2-45e7-9b99-8e509fe9a315 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:00.254856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-21177b17-bab2-45e7-9b99-8e509fe9a315 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:00.263207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21177b17-bab2-45e7-9b99-8e509fe9a315 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:00.263648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21177b17-bab2-45e7-9b99-8e509fe9a315 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:00.264428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21177b17-bab2-45e7-9b99-8e509fe9a315 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:00.264871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21177b17-bab2-45e7-9b99-8e509fe9a315 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:00.761873 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cb545589-00b8-4b83-8f4f-8d941be0d6d2 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9/action" status: 202 len: 0 microversion: 2.1 time: 1.785587 May 28 21:09:00.767185 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 949/1905] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:08:58 2022] POST /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9/action => generated 0 bytes in 1792 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:09:00.777195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-390ac4fe-863d-4b51-b1f8-9f7a8c997e6d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:00.778218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-390ac4fe-863d-4b51-b1f8-9f7a8c997e6d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:00.794287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-390ac4fe-863d-4b51-b1f8-9f7a8c997e6d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:00.796175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-390ac4fe-863d-4b51-b1f8-9f7a8c997e6d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:00.798067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-390ac4fe-863d-4b51-b1f8-9f7a8c997e6d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:00.800277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-390ac4fe-863d-4b51-b1f8-9f7a8c997e6d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:00.952686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-21177b17-bab2-45e7-9b99-8e509fe9a315 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:00.967273 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-21177b17-bab2-45e7-9b99-8e509fe9a315 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.716538 May 28 21:09:00.969014 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 957/1906] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:00 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:00.977584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-88932434-30d8-42e3-b4f7-2770ed458a75 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:00.978763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-88932434-30d8-42e3-b4f7-2770ed458a75 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] [instance: 9fd99f38-0c1f-4ec7-9ec6-03463939ec67] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:01.004202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88932434-30d8-42e3-b4f7-2770ed458a75 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:01.005219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88932434-30d8-42e3-b4f7-2770ed458a75 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:01.007554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88932434-30d8-42e3-b4f7-2770ed458a75 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:01.008371 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88932434-30d8-42e3-b4f7-2770ed458a75 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:01.029451 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-88932434-30d8-42e3-b4f7-2770ed458a75 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] HTTP exception thrown: Instance 9fd99f38-0c1f-4ec7-9ec6-03463939ec67 could not be found. May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-88932434-30d8-42e3-b4f7-2770ed458a75 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Request method failure captured: May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 HTTP/1.1 May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko63S9ujoNVjbzSlNBIwxVY2Q5AFVR-UVWhYbJi9Uiz9UekTK1o7epqZDk_tlmvIuDTjLXkNiU6RvYy3hBvVwxyKeaMPOH_83uAwKWRKNsWK0H3fAptxoBUiyHKBpK0QoDLUjvemfYQiLZUDVHKOGwFy9SUG4nZTopFdtw5NG2wjQOc May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 348fbbc628b44152b05362657c11230d May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_348fbbc628b44152b05362657c11230d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/348fbbc628b44152b05362657c11230d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/348fbbc628b44152b05362657c11230d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 348fbbc628b44152b05362657c11230d May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-2086789383 May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 5e54b51913be4a2bab74aae347785727 May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersOnMultiNodesTest-2086789383-project May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 9fd99f38-0c1f-4ec7-9ec6-03463939ec67 could not be found. May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '9fd99f38-0c1f-4ec7-9ec6-03463939ec67'} May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fd99f38-0c1f-4ec7-9ec6-03463939ec67 could not be found. May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fd99f38-0c1f-4ec7-9ec6-03463939ec67 could not be found. May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:01.031572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:01.036632 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:01.036632 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:01.036632 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:01.036632 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:01.036632 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:01.036632 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fd99f38-0c1f-4ec7-9ec6-03463939ec67 could not be found. May 28 21:09:01.036632 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:01.040429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-88932434-30d8-42e3-b4f7-2770ed458a75 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] Returning 404 to user: Instance 9fd99f38-0c1f-4ec7-9ec6-03463939ec67 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:01.041526 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-88932434-30d8-42e3-b4f7-2770ed458a75 tempest-ServersOnMultiNodesTest-2086789383 tempest-ServersOnMultiNodesTest-2086789383-project] 10.222.0.33 "GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67" status: 404 len: 111 microversion: 2.1 time: 0.071386 May 28 21:09:01.042691 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 958/1907] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:00 2022] GET /compute/v2.1/servers/9fd99f38-0c1f-4ec7-9ec6-03463939ec67 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:09:01.075912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8942005d-2eed-4bbb-b1ae-7f1164fbe4e8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:01.078711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8942005d-2eed-4bbb-b1ae-7f1164fbe4e8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:01.104839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8942005d-2eed-4bbb-b1ae-7f1164fbe4e8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:01.107198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8942005d-2eed-4bbb-b1ae-7f1164fbe4e8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:01.108788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8942005d-2eed-4bbb-b1ae-7f1164fbe4e8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:01.110604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8942005d-2eed-4bbb-b1ae-7f1164fbe4e8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:01.157007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-390ac4fe-863d-4b51-b1f8-9f7a8c997e6d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:01.162053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:01.169522 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-390ac4fe-863d-4b51-b1f8-9f7a8c997e6d tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1469 microversion: 2.1 time: 0.400635 May 28 21:09:01.179768 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 950/1908] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:00 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1469 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:01.267010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d62e8813-cfd5-4e8a-9ea5-76d156eff7e9 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:01.270577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d62e8813-cfd5-4e8a-9ea5-76d156eff7e9 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:01.274410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d62e8813-cfd5-4e8a-9ea5-76d156eff7e9 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:01.275168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d62e8813-cfd5-4e8a-9ea5-76d156eff7e9 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:01.276016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d62e8813-cfd5-4e8a-9ea5-76d156eff7e9 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:01.276653 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d62e8813-cfd5-4e8a-9ea5-76d156eff7e9 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:01.534675 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8942005d-2eed-4bbb-b1ae-7f1164fbe4e8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.489565 May 28 21:09:01.535728 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 959/1909] 10.222.0.33 () {58 vars in 1292 bytes} [Sat May 28 21:09:01 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9/os-security-groups => generated 1156 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:01.542126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-f3e8693f-17a7-4bd5-b79a-946581304295 req-6be5c1d8-fb4d-40da-afe1-410d263c6128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21a805a0-9660-4656-9fe5-2cd72fb96be9", "tag": "05e9b5fc-2b1f-4708-b1bf-2810843a11ba"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:01.554666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f3e8693f-17a7-4bd5-b79a-946581304295 req-6be5c1d8-fb4d-40da-afe1-410d263c6128 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:01.558032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f3e8693f-17a7-4bd5-b79a-946581304295 req-6be5c1d8-fb4d-40da-afe1-410d263c6128 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:01.570792 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-f3e8693f-17a7-4bd5-b79a-946581304295 req-6be5c1d8-fb4d-40da-afe1-410d263c6128 service nova] Creating event network-changed:05e9b5fc-2b1f-4708-b1bf-2810843a11ba for instance 21a805a0-9660-4656-9fe5-2cd72fb96be9 on nch1-master-1 May 28 21:09:01.587212 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-f3e8693f-17a7-4bd5-b79a-946581304295 req-6be5c1d8-fb4d-40da-afe1-410d263c6128 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040664 May 28 21:09:01.587212 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 960/1910] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:01.594763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d62e8813-cfd5-4e8a-9ea5-76d156eff7e9 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:01.603039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3ea84f4f-aed4-4aa1-b4ad-3968383ce42f tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'create', calling method: .version_select at 0x7f4d5779f940>, body: {"security_group": {"name": " tempest-securitygroup -1276682627 ", "description": "tempest-description-977013688"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:01.611184 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d62e8813-cfd5-4e8a-9ea5-76d156eff7e9 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.348636 May 28 21:09:01.624404 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 951/1911] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:01 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:01.988451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c2fca436-605a-4a0d-a234-60c0c6129fd1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:01.989080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c2fca436-605a-4a0d-a234-60c0c6129fd1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:01.997494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2fca436-605a-4a0d-a234-60c0c6129fd1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:01.998107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2fca436-605a-4a0d-a234-60c0c6129fd1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:01.998990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2fca436-605a-4a0d-a234-60c0c6129fd1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:01.999501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2fca436-605a-4a0d-a234-60c0c6129fd1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:02.245391 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3ea84f4f-aed4-4aa1-b4ad-3968383ce42f tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 0.664715 May 28 21:09:02.246601 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 961/1912] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:09:01 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:02.256066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fd4c75bb-91c7-45f6-a946-88f56994154c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:02.258246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fd4c75bb-91c7-45f6-a946-88f56994154c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:02.272722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd4c75bb-91c7-45f6-a946-88f56994154c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:02.273697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd4c75bb-91c7-45f6-a946-88f56994154c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:02.275552 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd4c75bb-91c7-45f6-a946-88f56994154c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:02.276336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd4c75bb-91c7-45f6-a946-88f56994154c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:02.276744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c2fca436-605a-4a0d-a234-60c0c6129fd1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:02.285809 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c2fca436-605a-4a0d-a234-60c0c6129fd1 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.303260 May 28 21:09:02.302387 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 952/1913] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:01 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:09:02.308321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d0bd3134-0643-4987-b141-9df69d389956 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d5796a310>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:02.347828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd4c75bb-91c7-45f6-a946-88f56994154c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:02.349871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd4c75bb-91c7-45f6-a946-88f56994154c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:02.350648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-fd4c75bb-91c7-45f6-a946-88f56994154c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lazy-loading 'fault' on Instance uuid faaac109-511d-4007-aa35-544196d7db72 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:09:02.431105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fd4c75bb-91c7-45f6-a946-88f56994154c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c14b965da64c40e382c69050ba01b183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6c38a96a96b4fba9e41ac58f5054803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:02.451295 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d0bd3134-0643-4987-b141-9df69d389956 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/30f81452-b35f-4cad-ae9a-4bc049a16c47" status: 200 len: 223 microversion: 2.1 time: 0.147472 May 28 21:09:02.452303 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 953/1914] 10.222.0.33 () {58 vars in 1268 bytes} [Sat May 28 21:09:02 2022] GET /compute/v2.1/os-security-groups/30f81452-b35f-4cad-ae9a-4bc049a16c47 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:02.454559 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fd4c75bb-91c7-45f6-a946-88f56994154c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 200 len: 1303 microversion: 2.1 time: 0.206293 May 28 21:09:02.456123 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 962/1915] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:02 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 1303 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:02.465362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-51798a17-ad1a-419f-b0dc-39edd255e6e2 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d57970ca0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:02.648486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3a94d358-ac73-42a9-99d9-83d11e692cff tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:02.653819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3a94d358-ac73-42a9-99d9-83d11e692cff tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:02.683828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a94d358-ac73-42a9-99d9-83d11e692cff tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:02.689051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a94d358-ac73-42a9-99d9-83d11e692cff tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:02.694021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a94d358-ac73-42a9-99d9-83d11e692cff tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:02.694894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a94d358-ac73-42a9-99d9-83d11e692cff tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:02.889935 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-51798a17-ad1a-419f-b0dc-39edd255e6e2 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/30f81452-b35f-4cad-ae9a-4bc049a16c47" status: 202 len: 0 microversion: 2.1 time: 0.429015 May 28 21:09:02.890591 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 954/1916] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:09:02 2022] DELETE /compute/v2.1/os-security-groups/30f81452-b35f-4cad-ae9a-4bc049a16c47 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:09:02.899031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2bbd8a8c-f8c7-430f-bcef-d94e06668dbb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d57970700>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:02.968275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG neutronclient.v2_0.client [None req-2bbd8a8c-f8c7-430f-bcef-d94e06668dbb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist", "detail": ""}} {{(pid=143128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:09:02.968927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.security_group_api [None req-2bbd8a8c-f8c7-430f-bcef-d94e06668dbb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Neutron security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 not found {{(pid=143128) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:09:02.969505 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-2bbd8a8c-f8c7-430f-bcef-d94e06668dbb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist May 28 21:09:02.969505 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-2a812bf7-1ec3-4622-b06e-5d1ae3fae203'] May 28 21:09:02.979414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3a94d358-ac73-42a9-99d9-83d11e692cff tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:02.988745 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3a94d358-ac73-42a9-99d9-83d11e692cff tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.364082 May 28 21:09:02.990206 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 963/1917] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:02 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2bbd8a8c-f8c7-430f-bcef-d94e06668dbb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-security-groups/30f81452-b35f-4cad-ae9a-4bc049a16c47 HTTP/1.1 May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: exception: Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-2a812bf7-1ec3-4622-b06e-5d1ae3fae203'] May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '30f81452-b35f-4cad-ae9a-4bc049a16c47'} May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:09:03.003261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a812bf7-1ec3-4622-b06e-5d1ae3fae203'] May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a812bf7-1ec3-4622-b06e-5d1ae3fae203'] May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a812bf7-1ec3-4622-b06e-5d1ae3fae203'] May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2a812bf7-1ec3-4622-b06e-5d1ae3fae203'] May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2bbd8a8c-f8c7-430f-bcef-d94e06668dbb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 404 to user: Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-2a812bf7-1ec3-4622-b06e-5d1ae3fae203'] {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2bbd8a8c-f8c7-430f-bcef-d94e06668dbb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/30f81452-b35f-4cad-ae9a-4bc049a16c47" status: 404 len: 194 microversion: 2.1 time: 0.110174 May 28 21:09:03.011453 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 955/1918] 10.222.0.33 () {58 vars in 1268 bytes} [Sat May 28 21:09:02 2022] GET /compute/v2.1/os-security-groups/30f81452-b35f-4cad-ae9a-4bc049a16c47 => generated 194 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:09:03.019869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4f1eb151-9dc2-414c-9ea0-86058394e20d tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'create', calling method: .version_select at 0x7f4d577bd5e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1898141252", "description": "tempest-description-598745280"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:03.307122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f8fc3f14-d224-4d60-83d8-a7f912ba3283 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:03.308056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f8fc3f14-d224-4d60-83d8-a7f912ba3283 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:03.324142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8fc3f14-d224-4d60-83d8-a7f912ba3283 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:03.324607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8fc3f14-d224-4d60-83d8-a7f912ba3283 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:03.325409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8fc3f14-d224-4d60-83d8-a7f912ba3283 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:03.325872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8fc3f14-d224-4d60-83d8-a7f912ba3283 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:03.387221 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4f1eb151-9dc2-414c-9ea0-86058394e20d tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.374597 May 28 21:09:03.388077 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 964/1919] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:09:03 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:03.399344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-85977895-ad9e-44c6-b326-ee721a70b8ce tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'create', calling method: .version_select at 0x7f4d69c2dc10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-201341655", "description": "tempest-description-1685956997"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:03.542154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f8fc3f14-d224-4d60-83d8-a7f912ba3283 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:03.549940 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f8fc3f14-d224-4d60-83d8-a7f912ba3283 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.247664 May 28 21:09:03.550891 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 956/1920] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:03 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:09:03.555624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-042d931b-1cef-4a77-ba5d-745c12cc791c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:03.556314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-042d931b-1cef-4a77-ba5d-745c12cc791c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] [instance: faaac109-511d-4007-aa35-544196d7db72] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:03.562317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-042d931b-1cef-4a77-ba5d-745c12cc791c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:03.562779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-042d931b-1cef-4a77-ba5d-745c12cc791c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:03.563568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-042d931b-1cef-4a77-ba5d-745c12cc791c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:03.564010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-042d931b-1cef-4a77-ba5d-745c12cc791c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:03.578911 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-042d931b-1cef-4a77-ba5d-745c12cc791c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] HTTP exception thrown: Instance faaac109-511d-4007-aa35-544196d7db72 could not be found. May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-042d931b-1cef-4a77-ba5d-745c12cc791c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Request method failure captured: May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 HTTP/1.1 May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4hWC4_EcvC2XsuVnnxNz_dxJImgpsbJWZ_PXp7PUILknItQzKVH6ehVtbER1cKjMBABmFNx8Yg1K7b5juXvEfJe5ZW6e3Pt_gRCgUjKi44Z7ADai4URx_ueJHdGc21HB-XZZ6BKlcRkw3l4WxtcD6IwN6BgTB7bxQwZoEYJKJ1w9c May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: d6c38a96a96b4fba9e41ac58f5054803 May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-MigrationsAdminTest-1239768997 May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d6c38a96a96b4fba9e41ac58f5054803", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6c38a96a96b4fba9e41ac58f5054803"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d6c38a96a96b4fba9e41ac58f5054803"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6c38a96a96b4fba9e41ac58f5054803"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-MigrationsAdminTest-1239768997 May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: d6c38a96a96b4fba9e41ac58f5054803 May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-MigrationsAdminTest-1239768997 May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-MigrationsAdminTest-1239768997-project May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: c14b965da64c40e382c69050ba01b183 May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-MigrationsAdminTest-1239768997-project May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance faaac109-511d-4007-aa35-544196d7db72 could not be found. May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'faaac109-511d-4007-aa35-544196d7db72'} May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faaac109-511d-4007-aa35-544196d7db72 could not be found. May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faaac109-511d-4007-aa35-544196d7db72 could not be found. May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:03.580313 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:03.585940 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:03.585940 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:03.585940 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:03.585940 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:03.585940 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:03.585940 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faaac109-511d-4007-aa35-544196d7db72 could not be found. May 28 21:09:03.585940 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:03.585940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-042d931b-1cef-4a77-ba5d-745c12cc791c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] Returning 404 to user: Instance faaac109-511d-4007-aa35-544196d7db72 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:03.585940 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-042d931b-1cef-4a77-ba5d-745c12cc791c tempest-MigrationsAdminTest-1239768997 tempest-MigrationsAdminTest-1239768997-project] 10.222.0.33 "GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72" status: 404 len: 111 microversion: 2.1 time: 0.029842 May 28 21:09:03.585940 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 957/1921] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:03 2022] GET /compute/v2.1/servers/faaac109-511d-4007-aa35-544196d7db72 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:09:03.607712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2eb69cad-982c-43c4-a4ef-eb0825bacea1 req-7abddeff-0f5a-4a6c-a487-9d8453f3d8af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0a48ef-bb58-4c86-82af-49c2023e022e", "name": "network-vif-unplugged", "status": "completed", "tag": "883b584c-6f2d-4a9a-8b63-5dee79943508"}, {"server_uuid": "faaac109-511d-4007-aa35-544196d7db72", "name": "network-vif-deleted", "tag": "1e6e9239-2ae6-4bf5-87a3-6c2699670420"}, {"name": "network-changed", "server_uuid": "7f0a48ef-bb58-4c86-82af-49c2023e022e", "tag": "883b584c-6f2d-4a9a-8b63-5dee79943508"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:03.617225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2eb69cad-982c-43c4-a4ef-eb0825bacea1 req-7abddeff-0f5a-4a6c-a487-9d8453f3d8af service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:03.617983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2eb69cad-982c-43c4-a4ef-eb0825bacea1 req-7abddeff-0f5a-4a6c-a487-9d8453f3d8af service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:03.633111 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2eb69cad-982c-43c4-a4ef-eb0825bacea1 req-7abddeff-0f5a-4a6c-a487-9d8453f3d8af service nova] Creating event network-vif-unplugged:883b584c-6f2d-4a9a-8b63-5dee79943508 for instance 7f0a48ef-bb58-4c86-82af-49c2023e022e on nch1-master-1 May 28 21:09:03.635855 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2eb69cad-982c-43c4-a4ef-eb0825bacea1 req-7abddeff-0f5a-4a6c-a487-9d8453f3d8af service nova] Creating event network-vif-deleted:1e6e9239-2ae6-4bf5-87a3-6c2699670420 for instance faaac109-511d-4007-aa35-544196d7db72 on nch2-master-1 May 28 21:09:03.635855 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2eb69cad-982c-43c4-a4ef-eb0825bacea1 req-7abddeff-0f5a-4a6c-a487-9d8453f3d8af service nova] Creating event network-changed:883b584c-6f2d-4a9a-8b63-5dee79943508 for instance 7f0a48ef-bb58-4c86-82af-49c2023e022e on nch1-master-1 May 28 21:09:03.647705 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2eb69cad-982c-43c4-a4ef-eb0825bacea1 req-7abddeff-0f5a-4a6c-a487-9d8453f3d8af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.043102 May 28 21:09:03.649490 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 958/1922] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:09:03.900964 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-85977895-ad9e-44c6-b326-ee721a70b8ce tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.505897 May 28 21:09:03.901570 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 965/1923] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:09:03 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:09:03.921628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-054955fd-6c09-4235-9b0c-08b1f9a14667 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'create', calling method: .version_select at 0x7f4d578a8790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-161508472", "description": "tempest-description-613001176"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:04.006687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d2ef31c8-0f7f-4807-bb53-c9176c727f47 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:04.007453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d2ef31c8-0f7f-4807-bb53-c9176c727f47 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:04.015233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d2ef31c8-0f7f-4807-bb53-c9176c727f47 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:04.017414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d2ef31c8-0f7f-4807-bb53-c9176c727f47 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:04.018320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d2ef31c8-0f7f-4807-bb53-c9176c727f47 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:04.018856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d2ef31c8-0f7f-4807-bb53-c9176c727f47 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:04.219089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d2ef31c8-0f7f-4807-bb53-c9176c727f47 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:04.228317 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d2ef31c8-0f7f-4807-bb53-c9176c727f47 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.225325 May 28 21:09:04.230350 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 966/1924] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:04 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:09:04.499633 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-054955fd-6c09-4235-9b0c-08b1f9a14667 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.589695 May 28 21:09:04.503343 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 959/1925] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:09:03 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:04.525743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f45ed8f9-a63e-44ef-9db5-29531667b1f0 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d69cca1f0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:04.573698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-55d6e4e3-3513-45ae-8541-cd50b3468001 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:04.574776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-55d6e4e3-3513-45ae-8541-cd50b3468001 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:04.584526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55d6e4e3-3513-45ae-8541-cd50b3468001 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:04.585655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55d6e4e3-3513-45ae-8541-cd50b3468001 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:04.587283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55d6e4e3-3513-45ae-8541-cd50b3468001 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:04.588284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55d6e4e3-3513-45ae-8541-cd50b3468001 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:04.915616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-55d6e4e3-3513-45ae-8541-cd50b3468001 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:04.933252 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-55d6e4e3-3513-45ae-8541-cd50b3468001 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.359253 May 28 21:09:04.933926 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 960/1926] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:04 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:09:04.998336 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f45ed8f9-a63e-44ef-9db5-29531667b1f0 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.482732 May 28 21:09:04.998941 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 967/1927] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:09:04 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:05.011010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-36baf5d7-9001-42c4-8a06-e9fe4f382a4b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d5796a040>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:05.247489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4d2e085f-ae54-4b6c-b64d-b65e2ffaa5f7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:05.248377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4d2e085f-ae54-4b6c-b64d-b65e2ffaa5f7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:05.258433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d2e085f-ae54-4b6c-b64d-b65e2ffaa5f7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:05.259356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d2e085f-ae54-4b6c-b64d-b65e2ffaa5f7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:05.260376 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d2e085f-ae54-4b6c-b64d-b65e2ffaa5f7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:05.261212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d2e085f-ae54-4b6c-b64d-b65e2ffaa5f7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:05.375526 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-36baf5d7-9001-42c4-8a06-e9fe4f382a4b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/5a0047a7-2ee8-49d2-82a9-2f23f93f0213" status: 202 len: 0 microversion: 2.1 time: 0.357817 May 28 21:09:05.375526 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 961/1928] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:09:05 2022] DELETE /compute/v2.1/os-security-groups/5a0047a7-2ee8-49d2-82a9-2f23f93f0213 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:09:05.376673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dfced7e6-ae65-4a92-a9b8-36bb767ce0af tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d578a85e0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:05.417392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG neutronclient.v2_0.client [None req-dfced7e6-ae65-4a92-a9b8-36bb767ce0af tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist", "detail": ""}} {{(pid=143128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:09:05.418778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.security_group_api [None req-dfced7e6-ae65-4a92-a9b8-36bb767ce0af tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Neutron security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 not found {{(pid=143128) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:09:05.419465 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-dfced7e6-ae65-4a92-a9b8-36bb767ce0af tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist May 28 21:09:05.419465 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-a8adf5d9-6f77-4de0-ae6b-aed17a0ed8c1'] May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dfced7e6-ae65-4a92-a9b8-36bb767ce0af tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-security-groups/5a0047a7-2ee8-49d2-82a9-2f23f93f0213 HTTP/1.1 May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: exception: Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-a8adf5d9-6f77-4de0-ae6b-aed17a0ed8c1'] May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '5a0047a7-2ee8-49d2-82a9-2f23f93f0213'} May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:09:05.422062 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8adf5d9-6f77-4de0-ae6b-aed17a0ed8c1'] May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8adf5d9-6f77-4de0-ae6b-aed17a0ed8c1'] May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8adf5d9-6f77-4de0-ae6b-aed17a0ed8c1'] May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a8adf5d9-6f77-4de0-ae6b-aed17a0ed8c1'] May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dfced7e6-ae65-4a92-a9b8-36bb767ce0af tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 404 to user: Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-a8adf5d9-6f77-4de0-ae6b-aed17a0ed8c1'] {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dfced7e6-ae65-4a92-a9b8-36bb767ce0af tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/5a0047a7-2ee8-49d2-82a9-2f23f93f0213" status: 404 len: 194 microversion: 2.1 time: 0.052920 May 28 21:09:05.436418 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 962/1929] 10.222.0.33 () {58 vars in 1268 bytes} [Sat May 28 21:09:05 2022] GET /compute/v2.1/os-security-groups/5a0047a7-2ee8-49d2-82a9-2f23f93f0213 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:09:05.445716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3f4f4374-f0c3-4e6e-bf6d-f61f8db74739 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d578ba1f0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:05.508675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4d2e085f-ae54-4b6c-b64d-b65e2ffaa5f7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:05.532847 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4d2e085f-ae54-4b6c-b64d-b65e2ffaa5f7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.286944 May 28 21:09:05.538011 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 968/1930] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:05 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:05.883594 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3f4f4374-f0c3-4e6e-bf6d-f61f8db74739 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f76169cb-a58c-46bb-8d45-84239c904081" status: 202 len: 0 microversion: 2.1 time: 0.453828 May 28 21:09:05.887652 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 963/1931] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:09:05 2022] DELETE /compute/v2.1/os-security-groups/f76169cb-a58c-46bb-8d45-84239c904081 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:09:05.892843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ca6f54d0-546f-48ec-a2e5-97a16aa91335 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d577574c0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:05.956342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4b8398cd-e01f-4dbb-91fd-86354353fedd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:05.957290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4b8398cd-e01f-4dbb-91fd-86354353fedd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:05.971631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG neutronclient.v2_0.client [None req-ca6f54d0-546f-48ec-a2e5-97a16aa91335 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist", "detail": ""}} {{(pid=143129) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:09:05.974525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.security_group_api [None req-ca6f54d0-546f-48ec-a2e5-97a16aa91335 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Neutron security group f76169cb-a58c-46bb-8d45-84239c904081 not found {{(pid=143129) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:09:05.975966 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-ca6f54d0-546f-48ec-a2e5-97a16aa91335 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist May 28 21:09:05.975966 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-f7f5c58e-5469-408a-b20c-552713c5b05f'] May 28 21:09:05.981339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b8398cd-e01f-4dbb-91fd-86354353fedd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:05.985113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b8398cd-e01f-4dbb-91fd-86354353fedd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:05.987493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b8398cd-e01f-4dbb-91fd-86354353fedd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ca6f54d0-546f-48ec-a2e5-97a16aa91335 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/os-security-groups/f76169cb-a58c-46bb-8d45-84239c904081 HTTP/1.1 May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: exception: Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-f7f5c58e-5469-408a-b20c-552713c5b05f'] May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'f76169cb-a58c-46bb-8d45-84239c904081'} May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:09:05.988001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7f5c58e-5469-408a-b20c-552713c5b05f'] May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7f5c58e-5469-408a-b20c-552713c5b05f'] May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7f5c58e-5469-408a-b20c-552713c5b05f'] May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7f5c58e-5469-408a-b20c-552713c5b05f'] May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ca6f54d0-546f-48ec-a2e5-97a16aa91335 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 404 to user: Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist May 28 21:09:05.993000 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-f7f5c58e-5469-408a-b20c-552713c5b05f'] {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:06.001654 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ca6f54d0-546f-48ec-a2e5-97a16aa91335 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/f76169cb-a58c-46bb-8d45-84239c904081" status: 404 len: 194 microversion: 2.1 time: 0.105158 May 28 21:09:06.002061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b8398cd-e01f-4dbb-91fd-86354353fedd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:06.002496 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 969/1932] 10.222.0.33 () {58 vars in 1268 bytes} [Sat May 28 21:09:05 2022] GET /compute/v2.1/os-security-groups/f76169cb-a58c-46bb-8d45-84239c904081 => generated 194 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:09:06.009819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-22c9d842-5263-498f-8038-9f5990428d4f tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d576930d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:06.330792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4b8398cd-e01f-4dbb-91fd-86354353fedd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:06.339697 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4b8398cd-e01f-4dbb-91fd-86354353fedd tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.392893 May 28 21:09:06.340381 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 964/1933] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:05 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:06.350697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-daa2ff31-8105-4d91-9d80-1a511e4734b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:06.355990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-daa2ff31-8105-4d91-9d80-1a511e4734b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:06.363930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-daa2ff31-8105-4d91-9d80-1a511e4734b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:06.365902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-daa2ff31-8105-4d91-9d80-1a511e4734b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:06.365902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-daa2ff31-8105-4d91-9d80-1a511e4734b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:06.366272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-daa2ff31-8105-4d91-9d80-1a511e4734b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:06.407624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-daa2ff31-8105-4d91-9d80-1a511e4734b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:09:06.610189 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-22c9d842-5263-498f-8038-9f5990428d4f tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/aada43ca-fd3c-4b1c-938e-fef4028e2939" status: 202 len: 0 microversion: 2.1 time: 0.600911 May 28 21:09:06.610189 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 970/1934] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:09:05 2022] DELETE /compute/v2.1/os-security-groups/aada43ca-fd3c-4b1c-938e-fef4028e2939 => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:09:06.611810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-36f66562-3e02-409b-ab4b-13a3b7b9797d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:06.617206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-36f66562-3e02-409b-ab4b-13a3b7b9797d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:06.620117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-36f66562-3e02-409b-ab4b-13a3b7b9797d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Searching by: {'deleted': False, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:09:06.629176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36f66562-3e02-409b-ab4b-13a3b7b9797d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:06.630452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36f66562-3e02-409b-ab4b-13a3b7b9797d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:06.631901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36f66562-3e02-409b-ab4b-13a3b7b9797d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:06.633635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36f66562-3e02-409b-ab4b-13a3b7b9797d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:06.682555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-36f66562-3e02-409b-ab4b-13a3b7b9797d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:09:06.733349 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-36f66562-3e02-409b-ab4b-13a3b7b9797d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.126771 May 28 21:09:06.734955 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 971/1935] 10.222.0.33 () {58 vars in 1124 bytes} [Sat May 28 21:09:06 2022] GET /compute/v2.1/servers => generated 333 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:06.741540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-82d5408c-8fa5-48c2-94d2-9716e97b2a67 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:06.742634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-82d5408c-8fa5-48c2-94d2-9716e97b2a67 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:06.751438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82d5408c-8fa5-48c2-94d2-9716e97b2a67 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:06.752187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82d5408c-8fa5-48c2-94d2-9716e97b2a67 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:06.753332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82d5408c-8fa5-48c2-94d2-9716e97b2a67 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:06.754147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82d5408c-8fa5-48c2-94d2-9716e97b2a67 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:06.857814 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-daa2ff31-8105-4d91-9d80-1a511e4734b7 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "DELETE /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 204 len: 0 microversion: 2.25 time: 0.515834 May 28 21:09:06.863635 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 965/1936] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:09:06 2022] DELETE /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:09:06.870083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-40a7c9bd-fae9-49d0-be08-b71ea8bfacb3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d579680d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:06.935407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG neutronclient.v2_0.client [None req-40a7c9bd-fae9-49d0-be08-b71ea8bfacb3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist", "detail": ""}} {{(pid=143128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:09:06.937782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.security_group_api [None req-40a7c9bd-fae9-49d0-be08-b71ea8bfacb3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Neutron security group aada43ca-fd3c-4b1c-938e-fef4028e2939 not found {{(pid=143128) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:09:06.938655 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-40a7c9bd-fae9-49d0-be08-b71ea8bfacb3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist May 28 21:09:06.938655 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-2ea49d81-b30d-40aa-b709-eb6de688190f'] May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-40a7c9bd-fae9-49d0-be08-b71ea8bfacb3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-security-groups/aada43ca-fd3c-4b1c-938e-fef4028e2939 HTTP/1.1 May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: exception: Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-2ea49d81-b30d-40aa-b709-eb6de688190f'] May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'aada43ca-fd3c-4b1c-938e-fef4028e2939'} May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:09:06.945663 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ea49d81-b30d-40aa-b709-eb6de688190f'] May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ea49d81-b30d-40aa-b709-eb6de688190f'] May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ea49d81-b30d-40aa-b709-eb6de688190f'] May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ea49d81-b30d-40aa-b709-eb6de688190f'] May 28 21:09:06.949698 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:06.955697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-40a7c9bd-fae9-49d0-be08-b71ea8bfacb3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 404 to user: Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist May 28 21:09:06.955697 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-2ea49d81-b30d-40aa-b709-eb6de688190f'] {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:06.955697 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-40a7c9bd-fae9-49d0-be08-b71ea8bfacb3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/aada43ca-fd3c-4b1c-938e-fef4028e2939" status: 404 len: 194 microversion: 2.1 time: 0.088866 May 28 21:09:06.958232 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 966/1937] 10.222.0.33 () {58 vars in 1268 bytes} [Sat May 28 21:09:06 2022] GET /compute/v2.1/os-security-groups/aada43ca-fd3c-4b1c-938e-fef4028e2939 => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:09:06.964201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ddcecfb4-ce7b-4316-a1ce-6f729ed38195 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:06.968124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ddcecfb4-ce7b-4316-a1ce-6f729ed38195 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:06.971636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ddcecfb4-ce7b-4316-a1ce-6f729ed38195 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Searching by: {'deleted': False, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:09:06.979218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddcecfb4-ce7b-4316-a1ce-6f729ed38195 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:06.980031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddcecfb4-ce7b-4316-a1ce-6f729ed38195 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:06.982065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddcecfb4-ce7b-4316-a1ce-6f729ed38195 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:06.983966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddcecfb4-ce7b-4316-a1ce-6f729ed38195 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:07.019186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-ddcecfb4-ce7b-4316-a1ce-6f729ed38195 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:09:07.101670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-82d5408c-8fa5-48c2-94d2-9716e97b2a67 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:07.108742 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-82d5408c-8fa5-48c2-94d2-9716e97b2a67 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.372498 May 28 21:09:07.112593 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 972/1938] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:06 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:07.124451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1fbe46a9-af55-4951-ae50-2e1975f63934 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:07.126627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1fbe46a9-af55-4951-ae50-2e1975f63934 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:07.139670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ddcecfb4-ce7b-4316-a1ce-6f729ed38195 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:07.144146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1fbe46a9-af55-4951-ae50-2e1975f63934 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:07.144605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1fbe46a9-af55-4951-ae50-2e1975f63934 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:07.147331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1fbe46a9-af55-4951-ae50-2e1975f63934 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:07.149692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1fbe46a9-af55-4951-ae50-2e1975f63934 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:07.156483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddcecfb4-ce7b-4316-a1ce-6f729ed38195 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:07.159538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ddcecfb4-ce7b-4316-a1ce-6f729ed38195 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:07.456959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1fbe46a9-af55-4951-ae50-2e1975f63934 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:07.471373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1fbe46a9-af55-4951-ae50-2e1975f63934 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:07.473466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1fbe46a9-af55-4951-ae50-2e1975f63934 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:07.478468 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1fbe46a9-af55-4951-ae50-2e1975f63934 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1563 microversion: 2.25 time: 0.359701 May 28 21:09:07.487465 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 973/1939] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:07 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1563 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:07.491398 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ddcecfb4-ce7b-4316-a1ce-6f729ed38195 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.531963 May 28 21:09:07.492384 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 967/1940] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:09:06 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:07.493537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-10a01c11-795c-42ef-a218-fde999834621 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d57757940>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:07.508290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ee6cb8d5-36cc-498f-b386-dcd610ea1e64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:07.509047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ee6cb8d5-36cc-498f-b386-dcd610ea1e64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:07.515532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ee6cb8d5-36cc-498f-b386-dcd610ea1e64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:07.515982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ee6cb8d5-36cc-498f-b386-dcd610ea1e64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:07.516773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ee6cb8d5-36cc-498f-b386-dcd610ea1e64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:07.517332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ee6cb8d5-36cc-498f-b386-dcd610ea1e64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:07.884969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ee6cb8d5-36cc-498f-b386-dcd610ea1e64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:07.894811 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ee6cb8d5-36cc-498f-b386-dcd610ea1e64 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.400061 May 28 21:09:07.895757 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 968/1941] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:07 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:07.900736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-003e69c0-cd03-4662-b8bf-c376c7904883 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:07.909686 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-003e69c0-cd03-4662-b8bf-c376c7904883 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012677 May 28 21:09:07.916160 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 969/1942] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:09:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:08.088760 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-10a01c11-795c-42ef-a218-fde999834621 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.599574 May 28 21:09:08.090579 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 974/1943] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:09:07 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:08.107569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd2c1a5c-3762-4166-a63d-0eca69ad5aed tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'create', calling method: .version_select at 0x7f4d57970280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1036180354", "description": "tempest-description-1234582444"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:08.136709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e0d6b294-c73a-4aa7-a16c-f264170c266b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:08.136709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e0d6b294-c73a-4aa7-a16c-f264170c266b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:08.144075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0d6b294-c73a-4aa7-a16c-f264170c266b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:08.144832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0d6b294-c73a-4aa7-a16c-f264170c266b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:08.145935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0d6b294-c73a-4aa7-a16c-f264170c266b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:08.146606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0d6b294-c73a-4aa7-a16c-f264170c266b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:08.487256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e0d6b294-c73a-4aa7-a16c-f264170c266b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:08.532990 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e0d6b294-c73a-4aa7-a16c-f264170c266b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.407753 May 28 21:09:08.538027 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 975/1944] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:08 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:09:08.559559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-b44e35a7-419a-4bcf-a6d2-15c755e14d1b req-4ce4ec20-5354-4974-baca-e6e8e0fc17f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502fcad4-754e-4627-96fa-80843f774f47", "name": "network-vif-deleted", "tag": "4a538780-a868-4e2b-a232-0afe1eda360e"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:08.588010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b44e35a7-419a-4bcf-a6d2-15c755e14d1b req-4ce4ec20-5354-4974-baca-e6e8e0fc17f5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:08.589076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b44e35a7-419a-4bcf-a6d2-15c755e14d1b req-4ce4ec20-5354-4974-baca-e6e8e0fc17f5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:08.619020 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b44e35a7-419a-4bcf-a6d2-15c755e14d1b req-4ce4ec20-5354-4974-baca-e6e8e0fc17f5 service nova] Creating event network-vif-deleted:4a538780-a868-4e2b-a232-0afe1eda360e for instance 502fcad4-754e-4627-96fa-80843f774f47 on nch1-master-1 May 28 21:09:08.629381 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-b44e35a7-419a-4bcf-a6d2-15c755e14d1b req-4ce4ec20-5354-4974-baca-e6e8e0fc17f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083847 May 28 21:09:08.631378 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 976/1945] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:08.648908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b572dc8c-0d28-4270-93f5-f100a73919ad tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:08.649954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b572dc8c-0d28-4270-93f5-f100a73919ad tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:08.662407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b572dc8c-0d28-4270-93f5-f100a73919ad tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:08.662998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b572dc8c-0d28-4270-93f5-f100a73919ad tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:08.664813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b572dc8c-0d28-4270-93f5-f100a73919ad tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:08.665611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b572dc8c-0d28-4270-93f5-f100a73919ad tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:08.746540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b572dc8c-0d28-4270-93f5-f100a73919ad tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:09:08.888002 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bd2c1a5c-3762-4166-a63d-0eca69ad5aed tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.786642 May 28 21:09:08.888877 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 970/1946] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:09:08 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:09:08.895302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-95f9650b-3325-4691-92c4-00c93eecefd4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:08.896165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-95f9650b-3325-4691-92c4-00c93eecefd4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:08.904952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95f9650b-3325-4691-92c4-00c93eecefd4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:08.907200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95f9650b-3325-4691-92c4-00c93eecefd4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:08.908029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95f9650b-3325-4691-92c4-00c93eecefd4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:08.908470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95f9650b-3325-4691-92c4-00c93eecefd4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:09.005896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-95f9650b-3325-4691-92c4-00c93eecefd4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:09.022391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-95f9650b-3325-4691-92c4-00c93eecefd4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:09.028452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-95f9650b-3325-4691-92c4-00c93eecefd4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:09.031663 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-95f9650b-3325-4691-92c4-00c93eecefd4 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 200 len: 1347 microversion: 2.25 time: 0.140377 May 28 21:09:09.053085 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 971/1947] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:08 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 1347 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:09.056120 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f9fcfbab-2ab2-45f0-ba36-f9cdefe68344 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'create', calling method: .version_select at 0x7f4d57903310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1293751971", "description": "tempest-description-81378187"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:09.141999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=4,nova_api:UPDATE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:09.252432 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b572dc8c-0d28-4270-93f5-f100a73919ad tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "DELETE /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 204 len: 0 microversion: 2.1 time: 0.613889 May 28 21:09:09.261213 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 977/1948] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:09:08 2022] DELETE /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:09:09.262673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-33775dce-27d6-4915-912c-6d2ed14393b2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:09.264082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-33775dce-27d6-4915-912c-6d2ed14393b2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:09.282301 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33775dce-27d6-4915-912c-6d2ed14393b2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:09.283049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33775dce-27d6-4915-912c-6d2ed14393b2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:09.284099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33775dce-27d6-4915-912c-6d2ed14393b2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:09.284762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33775dce-27d6-4915-912c-6d2ed14393b2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:09.325237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:09.565932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-33775dce-27d6-4915-912c-6d2ed14393b2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:09.576890 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-33775dce-27d6-4915-912c-6d2ed14393b2 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.320992 May 28 21:09:09.578385 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 978/1949] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:09 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:09.592120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dc900938-9a90-44b8-bb39-211c2c2af5e1 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:09.592754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dc900938-9a90-44b8-bb39-211c2c2af5e1 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:09.599784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc900938-9a90-44b8-bb39-211c2c2af5e1 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:09.600241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc900938-9a90-44b8-bb39-211c2c2af5e1 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:09.601008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc900938-9a90-44b8-bb39-211c2c2af5e1 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:09.601620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc900938-9a90-44b8-bb39-211c2c2af5e1 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:09.633324 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f9fcfbab-2ab2-45f0-ba36-f9cdefe68344 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.580997 May 28 21:09:09.651650 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 972/1950] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:09:09 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:09.668854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bff6d9d3-7bf2-4fa7-9a81-235712e96aa0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:09.689351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bff6d9d3-7bf2-4fa7-9a81-235712e96aa0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:09.730893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bff6d9d3-7bf2-4fa7-9a81-235712e96aa0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:09.731359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bff6d9d3-7bf2-4fa7-9a81-235712e96aa0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:09.732174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bff6d9d3-7bf2-4fa7-9a81-235712e96aa0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:09.732619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bff6d9d3-7bf2-4fa7-9a81-235712e96aa0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:09.837005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dc900938-9a90-44b8-bb39-211c2c2af5e1 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:09.852347 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dc900938-9a90-44b8-bb39-211c2c2af5e1 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1699 microversion: 2.1 time: 0.271335 May 28 21:09:09.856149 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 979/1951] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:09 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1699 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:09.873992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-76929669", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "73533db2-8435-4fc2-907c-813db64c480b"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:09.997267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] validate_networks() for [('73533db2-8435-4fc2-907c-813db64c480b', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:09:10.311597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bff6d9d3-7bf2-4fa7-9a81-235712e96aa0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:10.330725 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bff6d9d3-7bf2-4fa7-9a81-235712e96aa0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.666648 May 28 21:09:10.331473 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 973/1952] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:09 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:10.570661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b2ee557f-271e-4b2b-816f-c78e6588b788 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Action: 'update', calling method: .version_select at 0x7f4d69c9bca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:11.035380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b2ee557f-271e-4b2b-816f-c78e6588b788 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:11.036032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b2ee557f-271e-4b2b-816f-c78e6588b788 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:11.037149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b2ee557f-271e-4b2b-816f-c78e6588b788 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:11.039121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b2ee557f-271e-4b2b-816f-c78e6588b788 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:11.070160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:11.327195 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b2ee557f-271e-4b2b-816f-c78e6588b788 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/472c72ac90f6431990955cade16e8587" status: 200 len: 240 microversion: 2.36 time: 0.989479 May 28 21:09:11.330368 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 974/1953] 10.222.0.33 () {62 vars in 1302 bytes} [Sat May 28 21:09:10 2022] PUT /compute/v2.1/os-quota-sets/472c72ac90f6431990955cade16e8587 => generated 240 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:09:11.338731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-212ea0e2-21a8-4028-8d3d-4779a029fa2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:11.339469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-212ea0e2-21a8-4028-8d3d-4779a029fa2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 502fcad4-754e-4627-96fa-80843f774f47] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:11.347216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-212ea0e2-21a8-4028-8d3d-4779a029fa2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:11.347682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-212ea0e2-21a8-4028-8d3d-4779a029fa2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:11.348474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-212ea0e2-21a8-4028-8d3d-4779a029fa2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:11.348921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-212ea0e2-21a8-4028-8d3d-4779a029fa2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:11.372661 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-212ea0e2-21a8-4028-8d3d-4779a029fa2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] HTTP exception thrown: Instance 502fcad4-754e-4627-96fa-80843f774f47 could not be found. May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-212ea0e2-21a8-4028-8d3d-4779a029fa2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Request method failure captured: May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 HTTP/1.1 May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4m_yuyHzvqC91VltrUFawrFyN1GH0LlLIsSZFHSVsTaygt8GhV27n4HRJmKadeemEy4RYn9GtbL_1S8hrY0tpflIz4SUfEMoN660eHY344t3Nyyge7oEtVXZVoWvi42TWW6OLLkGKCMuSxJsh5tVUSLXhyZlDU2XwN3iDE9-ou06M May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Openstack-Nova-Api-Version: 2.25 May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 45a2b4e7e1484ea3807bc8d8bc31296c May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-605147657 May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_45a2b4e7e1484ea3807bc8d8bc31296c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/45a2b4e7e1484ea3807bc8d8bc31296c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/45a2b4e7e1484ea3807bc8d8bc31296c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/45a2b4e7e1484ea3807bc8d8bc31296c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-605147657 May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 45a2b4e7e1484ea3807bc8d8bc31296c May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-605147657 May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-LiveAutoBlockMigrationV225Test-605147657-project May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: fc6ee6dba5d24e90bff48384539fcd7f May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-605147657-project May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 502fcad4-754e-4627-96fa-80843f774f47 could not be found. May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '502fcad4-754e-4627-96fa-80843f774f47'} May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 502fcad4-754e-4627-96fa-80843f774f47 could not be found. May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 502fcad4-754e-4627-96fa-80843f774f47 could not be found. May 28 21:09:11.374461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:11.380318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:11.380318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:11.380318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:11.380318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:11.380318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:11.380318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:11.380318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:11.380318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 502fcad4-754e-4627-96fa-80843f774f47 could not be found. May 28 21:09:11.380318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:11.382654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-212ea0e2-21a8-4028-8d3d-4779a029fa2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Returning 404 to user: Instance 502fcad4-754e-4627-96fa-80843f774f47 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:11.383726 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-212ea0e2-21a8-4028-8d3d-4779a029fa2f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47" status: 404 len: 111 microversion: 2.25 time: 0.051955 May 28 21:09:11.384977 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 975/1954] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:11 2022] GET /compute/v2.1/servers/502fcad4-754e-4627-96fa-80843f774f47 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:09:11.392273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-121c8f7a-b924-4818-abd8-8318c28a287c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:11.393202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-121c8f7a-b924-4818-abd8-8318c28a287c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:11.399974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-121c8f7a-b924-4818-abd8-8318c28a287c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:11.400676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-121c8f7a-b924-4818-abd8-8318c28a287c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:11.401703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-121c8f7a-b924-4818-abd8-8318c28a287c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:11.402488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-121c8f7a-b924-4818-abd8-8318c28a287c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:11.462801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:09:11.463276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:09:11.464143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:09:11.465593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:09:11.466420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:09:11.484964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:11.485955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:11.486952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:11.487640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:11.522658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Getting quotas for project e96bf6518d66430399de823144f7bea8. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:09:11.531391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Getting quotas for user f08e71479f9d4ef0a30681cdfdd6fef8 and project e96bf6518d66430399de823144f7bea8. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:09:11.554961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:09:11.559272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:09:11.751811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-121c8f7a-b924-4818-abd8-8318c28a287c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:11.762685 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-121c8f7a-b924-4818-abd8-8318c28a287c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1390 microversion: 2.1 time: 0.375305 May 28 21:09:11.764267 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 976/1955] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:11 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1390 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:11.770534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e22cd9e2-0e99-47db-b653-54f96bc02a90 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:11.772315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e22cd9e2-0e99-47db-b653-54f96bc02a90 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:11.784197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e22cd9e2-0e99-47db-b653-54f96bc02a90 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:11.787782 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9c9e0ddb-ffc6-4758-b4ab-9fb29e83a3ae tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.917960 May 28 21:09:11.791452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e22cd9e2-0e99-47db-b653-54f96bc02a90 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:11.791760 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 980/1956] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:09:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:09:11.796165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e22cd9e2-0e99-47db-b653-54f96bc02a90 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:11.796165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e22cd9e2-0e99-47db-b653-54f96bc02a90 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:11.804933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c2fb9532-3130-4fba-b28b-bfc704f9a1e3 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Calling method '.version_select at 0x7f4d5779f8b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:11.898592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2fb9532-3130-4fba-b28b-bfc704f9a1e3 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:11.903005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2fb9532-3130-4fba-b28b-bfc704f9a1e3 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:11.904160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2fb9532-3130-4fba-b28b-bfc704f9a1e3 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:11.904822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2fb9532-3130-4fba-b28b-bfc704f9a1e3 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:11.937866 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c2fb9532-3130-4fba-b28b-bfc704f9a1e3 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/472c72ac90f6431990955cade16e8587/detail" status: 200 len: 672 microversion: 2.36 time: 0.144323 May 28 21:09:11.947459 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 981/1957] 10.222.0.33 () {60 vars in 1303 bytes} [Sat May 28 21:09:11 2022] GET /compute/v2.1/os-quota-sets/472c72ac90f6431990955cade16e8587/detail => generated 672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:09:11.954135 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c114759f-0642-47e6-8268-9e1899ee2b5a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:11.955008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c114759f-0642-47e6-8268-9e1899ee2b5a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:11.965590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c114759f-0642-47e6-8268-9e1899ee2b5a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:11.966402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c114759f-0642-47e6-8268-9e1899ee2b5a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:11.970848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c114759f-0642-47e6-8268-9e1899ee2b5a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:11.971502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c114759f-0642-47e6-8268-9e1899ee2b5a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:12.402189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e22cd9e2-0e99-47db-b653-54f96bc02a90 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:12.418936 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e22cd9e2-0e99-47db-b653-54f96bc02a90 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1699 microversion: 2.1 time: 0.649933 May 28 21:09:12.421450 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 977/1958] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:11 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1699 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:12.439877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4fd707ac-15c8-4d32-8c20-ba221cb348b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:12.442733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4fd707ac-15c8-4d32-8c20-ba221cb348b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:12.445938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c114759f-0642-47e6-8268-9e1899ee2b5a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:12.456493 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c114759f-0642-47e6-8268-9e1899ee2b5a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.507463 May 28 21:09:12.460688 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 982/1959] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:11 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:12.467050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fd707ac-15c8-4d32-8c20-ba221cb348b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:12.470456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fd707ac-15c8-4d32-8c20-ba221cb348b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:12.473352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c3288cf6-73e5-4ada-ac91-ea7d0038c128 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:12.474714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fd707ac-15c8-4d32-8c20-ba221cb348b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:12.475226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c3288cf6-73e5-4ada-ac91-ea7d0038c128 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:12.475365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fd707ac-15c8-4d32-8c20-ba221cb348b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:12.583435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4fd707ac-15c8-4d32-8c20-ba221cb348b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:09:12.601644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:12.796447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c3288cf6-73e5-4ada-ac91-ea7d0038c128 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:12.804735 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c3288cf6-73e5-4ada-ac91-ea7d0038c128 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1214 microversion: 2.1 time: 0.336910 May 28 21:09:12.809926 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 983/1960] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:12 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1214 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:12.816486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fd169577-fbe8-4765-a86a-d7416d8384f7 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Action: 'update', calling method: .version_select at 0x7f4d57693b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:12.946363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd169577-fbe8-4765-a86a-d7416d8384f7 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:12.947121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd169577-fbe8-4765-a86a-d7416d8384f7 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:12.948363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd169577-fbe8-4765-a86a-d7416d8384f7 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:12.949036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd169577-fbe8-4765-a86a-d7416d8384f7 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:13.005375 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4fd707ac-15c8-4d32-8c20-ba221cb348b9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "DELETE /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 204 len: 0 microversion: 2.25 time: 0.581705 May 28 21:09:13.011093 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 978/1961] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:09:12 2022] DELETE /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:09:13.017869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c603ddc8-a489-4fb7-855f-4e165f5cade9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:13.018444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c603ddc8-a489-4fb7-855f-4e165f5cade9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:13.043572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c603ddc8-a489-4fb7-855f-4e165f5cade9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:13.044037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c603ddc8-a489-4fb7-855f-4e165f5cade9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:13.044826 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c603ddc8-a489-4fb7-855f-4e165f5cade9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:13.045264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c603ddc8-a489-4fb7-855f-4e165f5cade9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:13.065109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd169577-fbe8-4765-a86a-d7416d8384f7 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:13.068390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd169577-fbe8-4765-a86a-d7416d8384f7 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:13.069685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd169577-fbe8-4765-a86a-d7416d8384f7 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:13.072473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd169577-fbe8-4765-a86a-d7416d8384f7 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:13.327940 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fd169577-fbe8-4765-a86a-d7416d8384f7 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-quota-sets/472c72ac90f6431990955cade16e8587?user_id=afd688afe7024b38ac279ed221c22de3" status: 200 len: 240 microversion: 2.36 time: 0.515640 May 28 21:09:13.334291 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 984/1962] 10.222.0.33 () {62 vars in 1383 bytes} [Sat May 28 21:09:12 2022] PUT /compute/v2.1/os-quota-sets/472c72ac90f6431990955cade16e8587?user_id=afd688afe7024b38ac279ed221c22de3 => generated 240 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:09:13.342918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c603ddc8-a489-4fb7-855f-4e165f5cade9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:13.347864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6c13dae3-6309-4b79-bcdb-1ec7ec3db8a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:13.352022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6c13dae3-6309-4b79-bcdb-1ec7ec3db8a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:13.354855 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c603ddc8-a489-4fb7-855f-4e165f5cade9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1380 microversion: 2.1 time: 0.342208 May 28 21:09:13.355461 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 979/1963] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:13 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1380 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:13.372247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c13dae3-6309-4b79-bcdb-1ec7ec3db8a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:13.373032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c13dae3-6309-4b79-bcdb-1ec7ec3db8a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:13.374102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c13dae3-6309-4b79-bcdb-1ec7ec3db8a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:13.375430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c13dae3-6309-4b79-bcdb-1ec7ec3db8a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:13.386683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1c5172de-dd0c-49df-a147-ee651a293c50 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] Calling method '.version_select at 0x7f4d579f1c10>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:13.531800 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1c5172de-dd0c-49df-a147-ee651a293c50 tempest-QuotasAdminTestV236-1953530557 tempest-QuotasAdminTestV236-1953530557-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/472c72ac90f6431990955cade16e8587?user_id=afd688afe7024b38ac279ed221c22de3" status: 200 len: 282 microversion: 2.36 time: 0.171080 May 28 21:09:13.538079 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 980/1964] 10.222.0.33 () {60 vars in 1363 bytes} [Sat May 28 21:09:13 2022] GET /compute/v2.1/os-quota-sets/472c72ac90f6431990955cade16e8587?user_id=afd688afe7024b38ac279ed221c22de3 => generated 282 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:09:13.544409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-249f2105-bd9c-463b-a18d-6e534ae3cea7 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '.version_select at 0x7f4d57871040>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:13.552422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-249f2105-bd9c-463b-a18d-6e534ae3cea7 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:13.557513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-249f2105-bd9c-463b-a18d-6e534ae3cea7 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:13.595001 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-249f2105-bd9c-463b-a18d-6e534ae3cea7 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/os-migrations" status: 200 len: 2319 microversion: 2.1 time: 0.055158 May 28 21:09:13.600931 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 981/1965] 10.222.0.33 () {58 vars in 1142 bytes} [Sat May 28 21:09:13 2022] GET /compute/v2.1/os-migrations => generated 2319 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:13.618509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-58e959b1-2750-4bf0-b51f-d023a6cd7969 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:13.620173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-58e959b1-2750-4bf0-b51f-d023a6cd7969 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:13.641477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-58e959b1-2750-4bf0-b51f-d023a6cd7969 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:13.642117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-58e959b1-2750-4bf0-b51f-d023a6cd7969 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:13.643837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-58e959b1-2750-4bf0-b51f-d023a6cd7969 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:13.647095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-58e959b1-2750-4bf0-b51f-d023a6cd7969 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:13.754460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-58e959b1-2750-4bf0-b51f-d023a6cd7969 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:13.763168 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-58e959b1-2750-4bf0-b51f-d023a6cd7969 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1632 microversion: 2.1 time: 0.161059 May 28 21:09:13.763940 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 982/1966] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:13 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1632 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:13.778444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-30516bb7-2abf-488b-ba53-ecccad3f2a27 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:13.778444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-30516bb7-2abf-488b-ba53-ecccad3f2a27 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:13.790929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30516bb7-2abf-488b-ba53-ecccad3f2a27 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:13.794238 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30516bb7-2abf-488b-ba53-ecccad3f2a27 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:13.800107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30516bb7-2abf-488b-ba53-ecccad3f2a27 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:13.801396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30516bb7-2abf-488b-ba53-ecccad3f2a27 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:13.911918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6c13dae3-6309-4b79-bcdb-1ec7ec3db8a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:13.928072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6c13dae3-6309-4b79-bcdb-1ec7ec3db8a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:13.929925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6c13dae3-6309-4b79-bcdb-1ec7ec3db8a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:13.931255 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6c13dae3-6309-4b79-bcdb-1ec7ec3db8a9 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1547 microversion: 2.25 time: 0.594030 May 28 21:09:13.937220 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 985/1967] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:13 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1547 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:13.943019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a63b26b8-5876-4707-9a63-55807b1b6280 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:13.948894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a63b26b8-5876-4707-9a63-55807b1b6280 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:13.964280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a63b26b8-5876-4707-9a63-55807b1b6280 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:13.965890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a63b26b8-5876-4707-9a63-55807b1b6280 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:13.966715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a63b26b8-5876-4707-9a63-55807b1b6280 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:13.967173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a63b26b8-5876-4707-9a63-55807b1b6280 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:14.495419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-30516bb7-2abf-488b-ba53-ecccad3f2a27 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:14.510175 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a63b26b8-5876-4707-9a63-55807b1b6280 tempest-LiveMigrationTest-1002282877 tempest-LiveMigrationTest-1002282877-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1531 microversion: 2.1 time: 0.568486 May 28 21:09:14.510821 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 986/1968] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:13 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1531 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:14.511468 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-30516bb7-2abf-488b-ba53-ecccad3f2a27 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.740515 May 28 21:09:14.525337 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 983/1969] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:13 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:14.531089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-74cfdca2-63b2-459d-a20f-4ad8d2b211f3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:14.531890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-74cfdca2-63b2-459d-a20f-4ad8d2b211f3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:14.550982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-6021941f-04a0-4252-b033-428dab99a9ef req-7956ed36-65af-4d30-9c39-733057f55613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "112841b9-f573-4e02-9bc8-40a32da993a8", "name": "network-vif-deleted", "tag": "40a3af66-b200-42b6-8260-9397f158a0db"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:14.552575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-74cfdca2-63b2-459d-a20f-4ad8d2b211f3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:14.554383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-74cfdca2-63b2-459d-a20f-4ad8d2b211f3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:14.555398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-74cfdca2-63b2-459d-a20f-4ad8d2b211f3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:14.559731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-74cfdca2-63b2-459d-a20f-4ad8d2b211f3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:14.593812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6021941f-04a0-4252-b033-428dab99a9ef req-7956ed36-65af-4d30-9c39-733057f55613 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:14.594622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6021941f-04a0-4252-b033-428dab99a9ef req-7956ed36-65af-4d30-9c39-733057f55613 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:14.627999 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-6021941f-04a0-4252-b033-428dab99a9ef req-7956ed36-65af-4d30-9c39-733057f55613 service nova] Creating event network-vif-deleted:40a3af66-b200-42b6-8260-9397f158a0db for instance 112841b9-f573-4e02-9bc8-40a32da993a8 on nch2-master-1 May 28 21:09:14.648541 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-6021941f-04a0-4252-b033-428dab99a9ef req-7956ed36-65af-4d30-9c39-733057f55613 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129957 May 28 21:09:14.651575 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 987/1970] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:14.680043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c906982d-fadf-4d4a-b5a3-f325af7b2bb9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:14.683180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c906982d-fadf-4d4a-b5a3-f325af7b2bb9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:14.708050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c906982d-fadf-4d4a-b5a3-f325af7b2bb9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:14.709213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c906982d-fadf-4d4a-b5a3-f325af7b2bb9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:14.713716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c906982d-fadf-4d4a-b5a3-f325af7b2bb9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:14.715113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c906982d-fadf-4d4a-b5a3-f325af7b2bb9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:14.794953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-74cfdca2-63b2-459d-a20f-4ad8d2b211f3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:14.803878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c906982d-fadf-4d4a-b5a3-f325af7b2bb9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:09:14.822671 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-74cfdca2-63b2-459d-a20f-4ad8d2b211f3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1266 microversion: 2.1 time: 0.295841 May 28 21:09:14.823279 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 984/1971] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:14 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1266 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:14.853532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ca5b1472-ca92-45eb-8ac6-76f4320aa479 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:14.856199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ca5b1472-ca92-45eb-8ac6-76f4320aa479 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:14.880540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca5b1472-ca92-45eb-8ac6-76f4320aa479 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:14.886621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca5b1472-ca92-45eb-8ac6-76f4320aa479 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:14.887711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca5b1472-ca92-45eb-8ac6-76f4320aa479 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:14.891825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca5b1472-ca92-45eb-8ac6-76f4320aa479 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:14.981734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca5b1472-ca92-45eb-8ac6-76f4320aa479 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:14.983661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca5b1472-ca92-45eb-8ac6-76f4320aa479 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:14.984972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-ca5b1472-ca92-45eb-8ac6-76f4320aa479 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lazy-loading 'fault' on Instance uuid 112841b9-f573-4e02-9bc8-40a32da993a8 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:09:15.112962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ca5b1472-ca92-45eb-8ac6-76f4320aa479 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121de134dc0c4e148d09ef9d764c29c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cde8dbaabafe47dc9aca37d9ef370819', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:15.125015 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ca5b1472-ca92-45eb-8ac6-76f4320aa479 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 200 len: 1359 microversion: 2.1 time: 0.291423 May 28 21:09:15.128482 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 985/1972] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:14 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 1359 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:15.142781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f1a43434-f4c1-4001-b695-8eb581f99fb5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:15.145692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f1a43434-f4c1-4001-b695-8eb581f99fb5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:15.172921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1a43434-f4c1-4001-b695-8eb581f99fb5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:15.176296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1a43434-f4c1-4001-b695-8eb581f99fb5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:15.177325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1a43434-f4c1-4001-b695-8eb581f99fb5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:15.178643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1a43434-f4c1-4001-b695-8eb581f99fb5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:15.233040 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c906982d-fadf-4d4a-b5a3-f325af7b2bb9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 204 len: 0 microversion: 2.1 time: 0.578123 May 28 21:09:15.236874 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 988/1973] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:09:14 2022] DELETE /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:09:15.247128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cc8ae611-2abd-4ae1-ae9b-cddc3dc5518a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:15.251264 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cc8ae611-2abd-4ae1-ae9b-cddc3dc5518a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:15.269934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc8ae611-2abd-4ae1-ae9b-cddc3dc5518a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:15.270419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc8ae611-2abd-4ae1-ae9b-cddc3dc5518a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:15.271235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc8ae611-2abd-4ae1-ae9b-cddc3dc5518a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:15.271684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc8ae611-2abd-4ae1-ae9b-cddc3dc5518a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:15.358063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f1a43434-f4c1-4001-b695-8eb581f99fb5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:15.387840 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f1a43434-f4c1-4001-b695-8eb581f99fb5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:15.394298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f1a43434-f4c1-4001-b695-8eb581f99fb5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:15.400868 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f1a43434-f4c1-4001-b695-8eb581f99fb5 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1505 microversion: 2.25 time: 0.270910 May 28 21:09:15.410349 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 986/1974] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:15 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:15.531438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-67e9e520-c6d0-4c49-9d32-a64867a51681 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:15.532350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-67e9e520-c6d0-4c49-9d32-a64867a51681 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:15.553215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67e9e520-c6d0-4c49-9d32-a64867a51681 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:15.553688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67e9e520-c6d0-4c49-9d32-a64867a51681 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:15.554535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67e9e520-c6d0-4c49-9d32-a64867a51681 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:15.554989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67e9e520-c6d0-4c49-9d32-a64867a51681 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:15.667220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cc8ae611-2abd-4ae1-ae9b-cddc3dc5518a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:15.678818 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cc8ae611-2abd-4ae1-ae9b-cddc3dc5518a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1386 microversion: 2.1 time: 0.436231 May 28 21:09:15.682123 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 989/1975] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:15 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1386 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:15.854433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8bd64b82-5d06-42a6-963b-8fdbe0494f19 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:15.855103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8bd64b82-5d06-42a6-963b-8fdbe0494f19 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:15.888282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bd64b82-5d06-42a6-963b-8fdbe0494f19 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:15.890748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bd64b82-5d06-42a6-963b-8fdbe0494f19 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:15.894926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bd64b82-5d06-42a6-963b-8fdbe0494f19 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:15.895631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bd64b82-5d06-42a6-963b-8fdbe0494f19 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:15.900536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-67e9e520-c6d0-4c49-9d32-a64867a51681 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:15.913868 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-67e9e520-c6d0-4c49-9d32-a64867a51681 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.387796 May 28 21:09:15.915068 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 987/1976] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:15 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:16.008746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8bd64b82-5d06-42a6-963b-8fdbe0494f19 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:16.027080 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8bd64b82-5d06-42a6-963b-8fdbe0494f19 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1284 microversion: 2.1 time: 0.189857 May 28 21:09:16.040571 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 990/1977] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:15 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:09:16.144804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0350e08e-e767-4e27-8dc9-8706ddd06a87 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:16.145790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0350e08e-e767-4e27-8dc9-8706ddd06a87 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] [instance: 112841b9-f573-4e02-9bc8-40a32da993a8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:16.160480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0350e08e-e767-4e27-8dc9-8706ddd06a87 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:16.160944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0350e08e-e767-4e27-8dc9-8706ddd06a87 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:16.161736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0350e08e-e767-4e27-8dc9-8706ddd06a87 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:16.162203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0350e08e-e767-4e27-8dc9-8706ddd06a87 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:16.213298 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-0350e08e-e767-4e27-8dc9-8706ddd06a87 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] HTTP exception thrown: Instance 112841b9-f573-4e02-9bc8-40a32da993a8 could not be found. May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0350e08e-e767-4e27-8dc9-8706ddd06a87 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Request method failure captured: May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 HTTP/1.1 May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko8v4I0mo5xOc3DM842BiuYHpV-S_lGwTPqnKglawADqygmH61u3JjF7dx-n0bP1a40N2sZSU8nVvXTM2PwPJtysuo-aeoWFiRakFVzHaZz2KboZMJtSGMCVg0Osvir51gA_0wo0mzEZTvrARIiQSomCaeaDAXhJUz6tnV08vN2jshc May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cde8dbaabafe47dc9aca37d9ef370819 May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestJSON-709314483 May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cde8dbaabafe47dc9aca37d9ef370819", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cde8dbaabafe47dc9aca37d9ef370819"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cde8dbaabafe47dc9aca37d9ef370819"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cde8dbaabafe47dc9aca37d9ef370819"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestJSON-709314483 May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cde8dbaabafe47dc9aca37d9ef370819 May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestJSON-709314483 May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestJSON-709314483-project May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 121de134dc0c4e148d09ef9d764c29c6 May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestJSON-709314483-project May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 112841b9-f573-4e02-9bc8-40a32da993a8 could not be found. May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '112841b9-f573-4e02-9bc8-40a32da993a8'} May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 112841b9-f573-4e02-9bc8-40a32da993a8 could not be found. May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 112841b9-f573-4e02-9bc8-40a32da993a8 could not be found. May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:16.215021 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:16.219653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:16.219653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:16.219653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:16.219653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:16.219653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 112841b9-f573-4e02-9bc8-40a32da993a8 could not be found. May 28 21:09:16.219653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:16.219653 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0350e08e-e767-4e27-8dc9-8706ddd06a87 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Returning 404 to user: Instance 112841b9-f573-4e02-9bc8-40a32da993a8 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:16.219653 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0350e08e-e767-4e27-8dc9-8706ddd06a87 tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8" status: 404 len: 111 microversion: 2.1 time: 0.076726 May 28 21:09:16.220338 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 988/1978] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:16 2022] GET /compute/v2.1/servers/112841b9-f573-4e02-9bc8-40a32da993a8 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:09:16.228237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a4c1ce6b-a0b2-4e5a-9e25-f8a080513c3d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] Calling method '.version_select at 0x7f4d5769cee0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:16.326553 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a4c1ce6b-a0b2-4e5a-9e25-f8a080513c3d tempest-ServersTestJSON-709314483 tempest-ServersTestJSON-709314483-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400624290" status: 202 len: 0 microversion: 2.1 time: 0.104890 May 28 21:09:16.328597 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 991/1979] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 21:09:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1400624290 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:09:16.419393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6294eaba-f758-4ca4-a026-883486b1d060 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:16.420027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6294eaba-f758-4ca4-a026-883486b1d060 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:16.433929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6294eaba-f758-4ca4-a026-883486b1d060 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:16.434385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6294eaba-f758-4ca4-a026-883486b1d060 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:16.435557 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6294eaba-f758-4ca4-a026-883486b1d060 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:16.436564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6294eaba-f758-4ca4-a026-883486b1d060 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:16.507502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6294eaba-f758-4ca4-a026-883486b1d060 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:16.507969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6294eaba-f758-4ca4-a026-883486b1d060 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:16.508444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-6294eaba-f758-4ca4-a026-883486b1d060 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lazy-loading 'fault' on Instance uuid 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:09:16.765181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ad875e1e-d16e-4f6e-83b8-64149b088967 tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] Action: 'create', calling method: .version_select at 0x7f4d57780b80>, body: {"pool": null} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:16.908252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6294eaba-f758-4ca4-a026-883486b1d060 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:16.931736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6294eaba-f758-4ca4-a026-883486b1d060 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:16.931736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6294eaba-f758-4ca4-a026-883486b1d060 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:16.931736 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6294eaba-f758-4ca4-a026-883486b1d060 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 200 len: 1351 microversion: 2.25 time: 0.512715 May 28 21:09:16.933737 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 989/1980] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:16 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 1351 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:16.947589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f6845d24-c4b3-46ad-bc3b-8144bd81baec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:16.948232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f6845d24-c4b3-46ad-bc3b-8144bd81baec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:16.967204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6845d24-c4b3-46ad-bc3b-8144bd81baec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:16.967525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6845d24-c4b3-46ad-bc3b-8144bd81baec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:16.974181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6845d24-c4b3-46ad-bc3b-8144bd81baec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:16.975087 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6845d24-c4b3-46ad-bc3b-8144bd81baec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:17.419911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f6845d24-c4b3-46ad-bc3b-8144bd81baec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:17.429463 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f6845d24-c4b3-46ad-bc3b-8144bd81baec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1386 microversion: 2.1 time: 0.494459 May 28 21:09:17.430092 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 990/1981] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:16 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1386 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:17.445163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-4b2cd205-d869-487d-bb2a-3fe7f2b2aae1 req-8889296e-5eb0-4145-b510-37c7da16db61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "738ac5a7-1dc6-430e-a5dc-f08d9c5faca6", "name": "network-vif-deleted", "tag": "0b49f1a2-af84-4fdb-9e25-802752a26503"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:17.455620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-4b2cd205-d869-487d-bb2a-3fe7f2b2aae1 req-8889296e-5eb0-4145-b510-37c7da16db61 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:17.459567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-4b2cd205-d869-487d-bb2a-3fe7f2b2aae1 req-8889296e-5eb0-4145-b510-37c7da16db61 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:17.469910 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-4b2cd205-d869-487d-bb2a-3fe7f2b2aae1 req-8889296e-5eb0-4145-b510-37c7da16db61 service nova] Creating event network-vif-deleted:0b49f1a2-af84-4fdb-9e25-802752a26503 for instance 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 on nch1-master-1 May 28 21:09:17.475621 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-4b2cd205-d869-487d-bb2a-3fe7f2b2aae1 req-8889296e-5eb0-4145-b510-37c7da16db61 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042837 May 28 21:09:17.476410 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 991/1982] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:17.482768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7e9a2ebb-5442-41e9-b7ec-e1c0c3e700b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:17.483597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7e9a2ebb-5442-41e9-b7ec-e1c0c3e700b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:17.491227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e9a2ebb-5442-41e9-b7ec-e1c0c3e700b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:17.498572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e9a2ebb-5442-41e9-b7ec-e1c0c3e700b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:17.498572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e9a2ebb-5442-41e9-b7ec-e1c0c3e700b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:17.498572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e9a2ebb-5442-41e9-b7ec-e1c0c3e700b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:18.000272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7e9a2ebb-5442-41e9-b7ec-e1c0c3e700b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:18.018316 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7e9a2ebb-5442-41e9-b7ec-e1c0c3e700b0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.540481 May 28 21:09:18.026129 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 992/1983] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:17 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:18.053956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d8e4b795-6b67-4f9a-adbd-c730364faa2f tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:18.054624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d8e4b795-6b67-4f9a-adbd-c730364faa2f tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:18.096214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8e4b795-6b67-4f9a-adbd-c730364faa2f tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:18.100073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8e4b795-6b67-4f9a-adbd-c730364faa2f tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:18.100932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8e4b795-6b67-4f9a-adbd-c730364faa2f tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:18.109983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8e4b795-6b67-4f9a-adbd-c730364faa2f tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:18.475142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d8e4b795-6b67-4f9a-adbd-c730364faa2f tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:18.487648 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d8e4b795-6b67-4f9a-adbd-c730364faa2f tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1314 microversion: 2.1 time: 0.459791 May 28 21:09:18.499292 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 993/1984] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:18 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:18.507840 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8cf36419-8c9c-447d-91a1-ee9f4cd6c30d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:18.509291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8cf36419-8c9c-447d-91a1-ee9f4cd6c30d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:18.517594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cf36419-8c9c-447d-91a1-ee9f4cd6c30d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:18.518495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cf36419-8c9c-447d-91a1-ee9f4cd6c30d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:18.521365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cf36419-8c9c-447d-91a1-ee9f4cd6c30d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:18.522446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cf36419-8c9c-447d-91a1-ee9f4cd6c30d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:18.540346 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-8cf36419-8c9c-447d-91a1-ee9f4cd6c30d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] HTTP exception thrown: Instance 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 could not be found. May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8cf36419-8c9c-447d-91a1-ee9f4cd6c30d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Request method failure captured: May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 HTTP/1.1 May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4m_yuyHzvqC91VltrUFawrFyN1GH0LlLIsSZFHSVsTaygt8GhV27n4HRJmKadeemEy4RYn9GtbL_1S8hrY0tpflIz4SUfEMoN660eHY344t3Nyyge7oEtVXZVoWvi42TWW6OLLkGKCMuSxJsh5tVUSLXhyZlDU2XwN3iDE9-ou06M May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Openstack-Nova-Api-Version: 2.25 May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 45a2b4e7e1484ea3807bc8d8bc31296c May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-605147657 May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_45a2b4e7e1484ea3807bc8d8bc31296c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/45a2b4e7e1484ea3807bc8d8bc31296c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/45a2b4e7e1484ea3807bc8d8bc31296c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/45a2b4e7e1484ea3807bc8d8bc31296c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-605147657 May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 45a2b4e7e1484ea3807bc8d8bc31296c May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-605147657 May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-LiveAutoBlockMigrationV225Test-605147657-project May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: fc6ee6dba5d24e90bff48384539fcd7f May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-605147657-project May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 could not be found. May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '738ac5a7-1dc6-430e-a5dc-f08d9c5faca6'} May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 could not be found. May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 could not be found. May 28 21:09:18.543608 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:18.550461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:18.550461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:18.550461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:18.550461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:18.550461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:18.550461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:18.550461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:18.550461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 could not be found. May 28 21:09:18.550461 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:18.550461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8cf36419-8c9c-447d-91a1-ee9f4cd6c30d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Returning 404 to user: Instance 738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:18.550461 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8cf36419-8c9c-447d-91a1-ee9f4cd6c30d tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6" status: 404 len: 111 microversion: 2.25 time: 0.048251 May 28 21:09:18.558564 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 994/1985] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:18 2022] GET /compute/v2.1/servers/738ac5a7-1dc6-430e-a5dc-f08d9c5faca6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:09:18.565660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2ea7fbc6-2c7a-45fc-8f21-8903ff6590ec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:18.567743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2ea7fbc6-2c7a-45fc-8f21-8903ff6590ec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:18.577230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ea7fbc6-2c7a-45fc-8f21-8903ff6590ec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:18.578089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ea7fbc6-2c7a-45fc-8f21-8903ff6590ec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:18.579524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ea7fbc6-2c7a-45fc-8f21-8903ff6590ec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:18.580714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ea7fbc6-2c7a-45fc-8f21-8903ff6590ec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:18.677611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2ea7fbc6-2c7a-45fc-8f21-8903ff6590ec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:18.689246 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2ea7fbc6-2c7a-45fc-8f21-8903ff6590ec tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 200 len: 1183 microversion: 2.1 time: 0.131616 May 28 21:09:18.692127 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 995/1986] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:18 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 1183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:18.699765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5db49b4e-ee9b-4d87-a61a-f1fabf06082f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:18.700700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5db49b4e-ee9b-4d87-a61a-f1fabf06082f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:18.712073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5db49b4e-ee9b-4d87-a61a-f1fabf06082f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:18.712900 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5db49b4e-ee9b-4d87-a61a-f1fabf06082f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:18.714103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5db49b4e-ee9b-4d87-a61a-f1fabf06082f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:18.715314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5db49b4e-ee9b-4d87-a61a-f1fabf06082f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:18.760055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5db49b4e-ee9b-4d87-a61a-f1fabf06082f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:09:18.766524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:19.211542 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5db49b4e-ee9b-4d87-a61a-f1fabf06082f tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 204 len: 0 microversion: 2.25 time: 0.517486 May 28 21:09:19.216491 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 996/1987] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:09:18 2022] DELETE /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:09:19.226836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2b839c34-24fd-4a08-9be1-93a88483f669 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:19.229385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2b839c34-24fd-4a08-9be1-93a88483f669 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:19.259340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b839c34-24fd-4a08-9be1-93a88483f669 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:19.259340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b839c34-24fd-4a08-9be1-93a88483f669 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:19.259816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b839c34-24fd-4a08-9be1-93a88483f669 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:19.260297 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b839c34-24fd-4a08-9be1-93a88483f669 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:19.834424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2b839c34-24fd-4a08-9be1-93a88483f669 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:19.846562 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2b839c34-24fd-4a08-9be1-93a88483f669 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.626907 May 28 21:09:19.856013 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 997/1988] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:19 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:19.856013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-05070d56-da3b-412d-b8a9-53b3ac31bb8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:19.856013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-05070d56-da3b-412d-b8a9-53b3ac31bb8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:19.880306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-05070d56-da3b-412d-b8a9-53b3ac31bb8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:19.881906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-05070d56-da3b-412d-b8a9-53b3ac31bb8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:19.883246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-05070d56-da3b-412d-b8a9-53b3ac31bb8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:19.883947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-05070d56-da3b-412d-b8a9-53b3ac31bb8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:20.450484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-05070d56-da3b-412d-b8a9-53b3ac31bb8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:20.476645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-05070d56-da3b-412d-b8a9-53b3ac31bb8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:20.482988 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-05070d56-da3b-412d-b8a9-53b3ac31bb8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:20.493930 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-05070d56-da3b-412d-b8a9-53b3ac31bb8e tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1563 microversion: 2.25 time: 0.645333 May 28 21:09:20.495617 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 998/1989] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:19 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1563 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:20.509827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0a8a8709-ef55-4a08-94de-ceee74e52feb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:20.510747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0a8a8709-ef55-4a08-94de-ceee74e52feb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:20.518947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a8a8709-ef55-4a08-94de-ceee74e52feb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:20.520717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a8a8709-ef55-4a08-94de-ceee74e52feb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:20.520717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a8a8709-ef55-4a08-94de-ceee74e52feb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:20.520717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a8a8709-ef55-4a08-94de-ceee74e52feb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:21.056615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:21.099820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0a8a8709-ef55-4a08-94de-ceee74e52feb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:21.124114 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0a8a8709-ef55-4a08-94de-ceee74e52feb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1314 microversion: 2.1 time: 0.618406 May 28 21:09:21.127401 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 999/1990] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:20 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1314 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:21.134184 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-aa5e2f5c-d670-4c2b-ba5d-0f21676b9bcf req-06bfba40-4a10-441b-9947-d4515459eab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0a48ef-bb58-4c86-82af-49c2023e022e", "name": "network-vif-deleted", "tag": "883b584c-6f2d-4a9a-8b63-5dee79943508"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:21.147656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-aa5e2f5c-d670-4c2b-ba5d-0f21676b9bcf req-06bfba40-4a10-441b-9947-d4515459eab6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:21.148425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-aa5e2f5c-d670-4c2b-ba5d-0f21676b9bcf req-06bfba40-4a10-441b-9947-d4515459eab6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:21.172909 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-aa5e2f5c-d670-4c2b-ba5d-0f21676b9bcf req-06bfba40-4a10-441b-9947-d4515459eab6 service nova] Creating event network-vif-deleted:883b584c-6f2d-4a9a-8b63-5dee79943508 for instance 7f0a48ef-bb58-4c86-82af-49c2023e022e on nch2-master-1 May 28 21:09:21.179417 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-aa5e2f5c-d670-4c2b-ba5d-0f21676b9bcf req-06bfba40-4a10-441b-9947-d4515459eab6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050304 May 28 21:09:21.180660 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1000/1991] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:21.658406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-28339302-12a6-4bbf-821d-22fa990ab4a7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:21.659271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-28339302-12a6-4bbf-821d-22fa990ab4a7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 7f0a48ef-bb58-4c86-82af-49c2023e022e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:21.670178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28339302-12a6-4bbf-821d-22fa990ab4a7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:21.673345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28339302-12a6-4bbf-821d-22fa990ab4a7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:21.674848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28339302-12a6-4bbf-821d-22fa990ab4a7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:21.675719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28339302-12a6-4bbf-821d-22fa990ab4a7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:21.698563 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-28339302-12a6-4bbf-821d-22fa990ab4a7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] HTTP exception thrown: Instance 7f0a48ef-bb58-4c86-82af-49c2023e022e could not be found. May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-28339302-12a6-4bbf-821d-22fa990ab4a7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Request method failure captured: May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e HTTP/1.1 May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5R8_T5eGdX6eZzJm8YrffHhbtGoCRZcU6O2AwDzQIeTZBP6GrzQYtOx4uEO2lPmdRVO666hp641nCiRg0Byat_ttpfQoUeMlQqk_Egahdmg0iZV5JD6pG0wWsheftl5KLHlnpjk6Zqi8-TmeDDfg87lrxkvQ_FWBFzX67a1b65i5M May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 2f5c3054461d4d07861a1685cfeba36a May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-LiveMigrationTest-1347342374 May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f5c3054461d4d07861a1685cfeba36a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f5c3054461d4d07861a1685cfeba36a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f5c3054461d4d07861a1685cfeba36a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f5c3054461d4d07861a1685cfeba36a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-LiveMigrationTest-1347342374 May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 2f5c3054461d4d07861a1685cfeba36a May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-LiveMigrationTest-1347342374 May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-LiveMigrationTest-1347342374-project May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 7b44b524592e4a57a26681767b9c4541 May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-LiveMigrationTest-1347342374-project May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 7f0a48ef-bb58-4c86-82af-49c2023e022e could not be found. May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '7f0a48ef-bb58-4c86-82af-49c2023e022e'} May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f0a48ef-bb58-4c86-82af-49c2023e022e could not be found. May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0a48ef-bb58-4c86-82af-49c2023e022e could not be found. May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:21.700665 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:21.705439 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:21.705439 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:21.705439 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:21.705439 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:21.705439 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:21.705439 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0a48ef-bb58-4c86-82af-49c2023e022e could not be found. May 28 21:09:21.705439 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:21.714695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-28339302-12a6-4bbf-821d-22fa990ab4a7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Returning 404 to user: Instance 7f0a48ef-bb58-4c86-82af-49c2023e022e could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:21.717649 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-28339302-12a6-4bbf-821d-22fa990ab4a7 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e" status: 404 len: 111 microversion: 2.1 time: 0.535559 May 28 21:09:21.720309 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1001/1992] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:21 2022] GET /compute/v2.1/servers/7f0a48ef-bb58-4c86-82af-49c2023e022e => generated 111 bytes in 539 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:09:21.727743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-96861ce8-99c1-4179-93ad-70d1bf8588fa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:21.728477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-96861ce8-99c1-4179-93ad-70d1bf8588fa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:21.755315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96861ce8-99c1-4179-93ad-70d1bf8588fa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:21.755814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96861ce8-99c1-4179-93ad-70d1bf8588fa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:21.756843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96861ce8-99c1-4179-93ad-70d1bf8588fa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:21.757298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96861ce8-99c1-4179-93ad-70d1bf8588fa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:21.947853 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ad875e1e-d16e-4f6e-83b8-64149b088967 tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.378874 May 28 21:09:21.950119 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 992/1993] 10.222.0.33 () {60 vars in 1169 bytes} [Sat May 28 21:09:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:09:21.961822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d8d9d436-3560-4e90-90a1-ce711117d501 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:21.965935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d8d9d436-3560-4e90-90a1-ce711117d501 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:22.021335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8d9d436-3560-4e90-90a1-ce711117d501 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:22.021800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8d9d436-3560-4e90-90a1-ce711117d501 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:22.031415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8d9d436-3560-4e90-90a1-ce711117d501 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:22.038262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8d9d436-3560-4e90-90a1-ce711117d501 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:22.248031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-96861ce8-99c1-4179-93ad-70d1bf8588fa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:22.251121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d8d9d436-3560-4e90-90a1-ce711117d501 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:22.258059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d8d9d436-3560-4e90-90a1-ce711117d501 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:22.264332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d8d9d436-3560-4e90-90a1-ce711117d501 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fc6ee6dba5d24e90bff48384539fcd7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a2b4e7e1484ea3807bc8d8bc31296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:22.267344 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-96861ce8-99c1-4179-93ad-70d1bf8588fa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.540303 May 28 21:09:22.268766 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d8d9d436-3560-4e90-90a1-ce711117d501 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 200 len: 1347 microversion: 2.25 time: 0.316943 May 28 21:09:22.274169 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1002/1994] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:21 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:22.274321 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 993/1995] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:21 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 1347 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:22.281513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-1aa4666c-e55b-48cc-a2e6-70fcb42a9f5e req-f680af1a-1325-4c7f-a93d-833e0fdd75a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9b4edf-f109-4ba9-b543-115b9e68ab8d", "tag": "a0bdfb08-cf00-44f9-b10c-e524cc386207"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:22.290882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1aa4666c-e55b-48cc-a2e6-70fcb42a9f5e req-f680af1a-1325-4c7f-a93d-833e0fdd75a7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:22.291549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1aa4666c-e55b-48cc-a2e6-70fcb42a9f5e req-f680af1a-1325-4c7f-a93d-833e0fdd75a7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:22.299056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2ba1793f-13d4-4dd2-8857-dc57e094119a tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] Calling method '.version_select at 0x7f4d57903820>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:22.324378 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-1aa4666c-e55b-48cc-a2e6-70fcb42a9f5e req-f680af1a-1325-4c7f-a93d-833e0fdd75a7 service nova] Creating event network-changed:a0bdfb08-cf00-44f9-b10c-e524cc386207 for instance de9b4edf-f109-4ba9-b543-115b9e68ab8d on nch1-master-1 May 28 21:09:22.340181 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-1aa4666c-e55b-48cc-a2e6-70fcb42a9f5e req-f680af1a-1325-4c7f-a93d-833e0fdd75a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064837 May 28 21:09:22.341438 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 994/1996] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:22.356967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-68c9510b-103e-4c09-b113-ac39ca8a9231 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:22.358149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-68c9510b-103e-4c09-b113-ac39ca8a9231 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:22.374644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68c9510b-103e-4c09-b113-ac39ca8a9231 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:22.378905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68c9510b-103e-4c09-b113-ac39ca8a9231 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:22.386370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68c9510b-103e-4c09-b113-ac39ca8a9231 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:22.387254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68c9510b-103e-4c09-b113-ac39ca8a9231 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:22.637091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-68c9510b-103e-4c09-b113-ac39ca8a9231 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:22.646511 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-68c9510b-103e-4c09-b113-ac39ca8a9231 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1314 microversion: 2.1 time: 0.303546 May 28 21:09:22.650739 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 995/1997] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:22 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:22.674964 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2ba1793f-13d4-4dd2-8857-dc57e094119a tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/5c7db6b1-217c-4f65-9a3f-d853ef437cdf" status: 200 len: 142 microversion: 2.1 time: 0.402766 May 28 21:09:22.676150 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1003/1998] 10.222.0.33 () {58 vars in 1259 bytes} [Sat May 28 21:09:22 2022] GET /compute/v2.1/os-floating-ips/5c7db6b1-217c-4f65-9a3f-d853ef437cdf => generated 142 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:22.688853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-483ca8f9-9e1a-4d6e-8a1c-0f8b9068ad75 tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] Calling method '.version_select at 0x7f4d576b0430>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:23.095534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=11 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:23.228005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-3ecd3000-df2c-4ffe-b095-24733472cb0d req-c3142c15-0f4b-4149-9b2f-7c064ec99afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a5aeda8-15ad-4cb5-afde-74d2498a22ca", "name": "network-vif-deleted", "tag": "99558272-1b1d-489a-b9a1-76641b7fe979"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:23.239222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3ecd3000-df2c-4ffe-b095-24733472cb0d req-c3142c15-0f4b-4149-9b2f-7c064ec99afe service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:23.239991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3ecd3000-df2c-4ffe-b095-24733472cb0d req-c3142c15-0f4b-4149-9b2f-7c064ec99afe service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:23.255907 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-3ecd3000-df2c-4ffe-b095-24733472cb0d req-c3142c15-0f4b-4149-9b2f-7c064ec99afe service nova] Creating event network-vif-deleted:99558272-1b1d-489a-b9a1-76641b7fe979 for instance 5a5aeda8-15ad-4cb5-afde-74d2498a22ca on nch1-master-1 May 28 21:09:23.269882 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-483ca8f9-9e1a-4d6e-8a1c-0f8b9068ad75 tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.579348 May 28 21:09:23.269882 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 996/1999] 10.222.0.33 () {58 vars in 1148 bytes} [Sat May 28 21:09:22 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:09:23.270210 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-3ecd3000-df2c-4ffe-b095-24733472cb0d req-c3142c15-0f4b-4149-9b2f-7c064ec99afe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046187 May 28 21:09:23.270210 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1004/2000] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:23.276315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7d036fef-78a4-40c2-b595-3ad31da0e41c tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] Calling method '.version_select at 0x7f4d57693f70>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:23.286703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9c80d0ca-04f9-4fd1-9c25-cd077b129a5c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:23.287415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9c80d0ca-04f9-4fd1-9c25-cd077b129a5c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:23.298440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c80d0ca-04f9-4fd1-9c25-cd077b129a5c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:23.298887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c80d0ca-04f9-4fd1-9c25-cd077b129a5c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:23.301362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c80d0ca-04f9-4fd1-9c25-cd077b129a5c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:23.303693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c80d0ca-04f9-4fd1-9c25-cd077b129a5c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:23.319907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=22 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:23.512170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=14 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:23.616780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9c80d0ca-04f9-4fd1-9c25-cd077b129a5c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:23.630102 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9c80d0ca-04f9-4fd1-9c25-cd077b129a5c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1499 microversion: 2.1 time: 0.345322 May 28 21:09:23.632818 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1005/2001] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:23 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1499 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:09:23.644688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-950c5f0b-bdd6-408d-ba13-c0dac8102bd1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:23.645324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-950c5f0b-bdd6-408d-ba13-c0dac8102bd1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] [instance: 5a5aeda8-15ad-4cb5-afde-74d2498a22ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:23.663437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-950c5f0b-bdd6-408d-ba13-c0dac8102bd1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:23.664156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-950c5f0b-bdd6-408d-ba13-c0dac8102bd1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:23.665212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-950c5f0b-bdd6-408d-ba13-c0dac8102bd1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:23.665825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-950c5f0b-bdd6-408d-ba13-c0dac8102bd1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:23.691760 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-950c5f0b-bdd6-408d-ba13-c0dac8102bd1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] HTTP exception thrown: Instance 5a5aeda8-15ad-4cb5-afde-74d2498a22ca could not be found. May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-950c5f0b-bdd6-408d-ba13-c0dac8102bd1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Request method failure captured: May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca HTTP/1.1 May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko4m_yuyHzvqC91VltrUFawrFyN1GH0LlLIsSZFHSVsTaygt8GhV27n4HRJmKadeemEy4RYn9GtbL_1S8hrY0tpflIz4SUfEMoN660eHY344t3Nyyge7oEtVXZVoWvi42TWW6OLLkGKCMuSxJsh5tVUSLXhyZlDU2XwN3iDE9-ou06M May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Openstack-Nova-Api-Version: 2.25 May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 45a2b4e7e1484ea3807bc8d8bc31296c May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-605147657 May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_45a2b4e7e1484ea3807bc8d8bc31296c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/45a2b4e7e1484ea3807bc8d8bc31296c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/45a2b4e7e1484ea3807bc8d8bc31296c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/45a2b4e7e1484ea3807bc8d8bc31296c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-605147657 May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 45a2b4e7e1484ea3807bc8d8bc31296c May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-605147657 May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-LiveAutoBlockMigrationV225Test-605147657-project May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: fc6ee6dba5d24e90bff48384539fcd7f May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-605147657-project May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 5a5aeda8-15ad-4cb5-afde-74d2498a22ca could not be found. May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '5a5aeda8-15ad-4cb5-afde-74d2498a22ca'} May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a5aeda8-15ad-4cb5-afde-74d2498a22ca could not be found. May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a5aeda8-15ad-4cb5-afde-74d2498a22ca could not be found. May 28 21:09:23.694583 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:23.700174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:23.700174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:23.700174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:23.700174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:23.700174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:23.700174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:23.700174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:23.700174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a5aeda8-15ad-4cb5-afde-74d2498a22ca could not be found. May 28 21:09:23.700174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:23.700174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-950c5f0b-bdd6-408d-ba13-c0dac8102bd1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] Returning 404 to user: Instance 5a5aeda8-15ad-4cb5-afde-74d2498a22ca could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:23.701595 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-950c5f0b-bdd6-408d-ba13-c0dac8102bd1 tempest-LiveAutoBlockMigrationV225Test-605147657 tempest-LiveAutoBlockMigrationV225Test-605147657-project] 10.222.0.33 "GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca" status: 404 len: 111 microversion: 2.25 time: 0.065540 May 28 21:09:23.703961 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1006/2002] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:23 2022] GET /compute/v2.1/servers/5a5aeda8-15ad-4cb5-afde-74d2498a22ca => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:09:23.710766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aaac5cfa-0ba7-4b9b-8c4b-848f91449e6d tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:23.711453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aaac5cfa-0ba7-4b9b-8c4b-848f91449e6d tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:23.729014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aaac5cfa-0ba7-4b9b-8c4b-848f91449e6d tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:23.729469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aaac5cfa-0ba7-4b9b-8c4b-848f91449e6d tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:23.730509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aaac5cfa-0ba7-4b9b-8c4b-848f91449e6d tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:23.731041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aaac5cfa-0ba7-4b9b-8c4b-848f91449e6d tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:24.005752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aaac5cfa-0ba7-4b9b-8c4b-848f91449e6d tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:24.020097 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aaac5cfa-0ba7-4b9b-8c4b-848f91449e6d tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1314 microversion: 2.1 time: 0.314387 May 28 21:09:24.020097 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1007/2003] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:23 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:24.294721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-32dcca38-77fd-4b46-8b3c-4f46a7352c52 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-2130552196", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": "none"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:24.379756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-32dcca38-77fd-4b46-8b3c-4f46a7352c52 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:09:24.380488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-32dcca38-77fd-4b46-8b3c-4f46a7352c52 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:09:24.381120 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-32dcca38-77fd-4b46-8b3c-4f46a7352c52 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:09:24.381751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-32dcca38-77fd-4b46-8b3c-4f46a7352c52 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:09:24.382540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-32dcca38-77fd-4b46-8b3c-4f46a7352c52 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:09:24.394921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32dcca38-77fd-4b46-8b3c-4f46a7352c52 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:24.396874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32dcca38-77fd-4b46-8b3c-4f46a7352c52 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:24.398039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32dcca38-77fd-4b46-8b3c-4f46a7352c52 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:24.398739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32dcca38-77fd-4b46-8b3c-4f46a7352c52 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:24.424415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-32dcca38-77fd-4b46-8b3c-4f46a7352c52 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Getting quotas for project 9ccf44d7826045cfa5d4c6e87290d9d2. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:09:24.431024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-32dcca38-77fd-4b46-8b3c-4f46a7352c52 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Getting quotas for user 0cec7231f1c1445f965d620ae70e8463 and project 9ccf44d7826045cfa5d4c6e87290d9d2. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:09:24.436241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:24.453556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-32dcca38-77fd-4b46-8b3c-4f46a7352c52 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:09:24.459545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-32dcca38-77fd-4b46-8b3c-4f46a7352c52 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:09:24.630992 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-32dcca38-77fd-4b46-8b3c-4f46a7352c52 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.609833 May 28 21:09:24.632381 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1008/2004] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:09:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 21:09:24.644424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aff47beb-dbe2-4cd7-8797-b698c3a1cfac tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:24.645916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aff47beb-dbe2-4cd7-8797-b698c3a1cfac tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:24.895200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aff47beb-dbe2-4cd7-8797-b698c3a1cfac tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:24.904767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aff47beb-dbe2-4cd7-8797-b698c3a1cfac tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:24.907442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aff47beb-dbe2-4cd7-8797-b698c3a1cfac tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:24.923424 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aff47beb-dbe2-4cd7-8797-b698c3a1cfac tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "PUT /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1359 microversion: 2.75 time: 0.285102 May 28 21:09:24.924584 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1009/2005] 10.222.0.33 () {62 vars in 1296 bytes} [Sat May 28 21:09:24 2022] PUT /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1359 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:09:24.929784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9e6bed2d-b29c-43b9-a288-8475369e91fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:24.930568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9e6bed2d-b29c-43b9-a288-8475369e91fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:24.939108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e6bed2d-b29c-43b9-a288-8475369e91fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:24.939703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e6bed2d-b29c-43b9-a288-8475369e91fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:24.940659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e6bed2d-b29c-43b9-a288-8475369e91fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:24.941262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e6bed2d-b29c-43b9-a288-8475369e91fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:25.309226 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7d036fef-78a4-40c2-b595-3ad31da0e41c tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/5c7db6b1-217c-4f65-9a3f-d853ef437cdf" status: 202 len: 0 microversion: 2.1 time: 2.037159 May 28 21:09:25.310660 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 997/2006] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:09:23 2022] DELETE /compute/v2.1/os-floating-ips/5c7db6b1-217c-4f65-9a3f-d853ef437cdf => generated 0 bytes in 2039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:09:25.316408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5d42f02c-0cc6-40cf-8e40-cafc6ddc0095 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:25.317663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5d42f02c-0cc6-40cf-8e40-cafc6ddc0095 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:25.385694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9e6bed2d-b29c-43b9-a288-8475369e91fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:25.395682 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9e6bed2d-b29c-43b9-a288-8475369e91fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 200 len: 1476 microversion: 2.1 time: 0.469884 May 28 21:09:25.396285 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1010/2007] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:24 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 1476 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:25.412596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a3decf64-415b-408e-b1b7-d1fa493ce139 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:25.413593 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a3decf64-415b-408e-b1b7-d1fa493ce139 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:25.421176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a3decf64-415b-408e-b1b7-d1fa493ce139 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:25.422052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a3decf64-415b-408e-b1b7-d1fa493ce139 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:25.423116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a3decf64-415b-408e-b1b7-d1fa493ce139 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:25.423791 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a3decf64-415b-408e-b1b7-d1fa493ce139 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:25.464841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5d42f02c-0cc6-40cf-8e40-cafc6ddc0095 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:25.475215 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5d42f02c-0cc6-40cf-8e40-cafc6ddc0095 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:25.477435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5d42f02c-0cc6-40cf-8e40-cafc6ddc0095 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:25.496325 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5d42f02c-0cc6-40cf-8e40-cafc6ddc0095 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1359 microversion: 2.75 time: 0.184049 May 28 21:09:25.510314 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 998/2008] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:25 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:25.517601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b7b25a86-af21-4782-a86b-ed0d9599f9f1 tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] Action: 'create', calling method: .version_select at 0x7f4d57693dc0>, body: {"pool": null} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:25.708663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a3decf64-415b-408e-b1b7-d1fa493ce139 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:25.720861 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a3decf64-415b-408e-b1b7-d1fa493ce139 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1314 microversion: 2.1 time: 0.311912 May 28 21:09:25.741934 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1011/2009] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:25 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:25.751561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e102fd54-f005-4066-af9a-19d10a9072ff tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1720738795"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:25.752974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e102fd54-f005-4066-af9a-19d10a9072ff tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:25.759667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e102fd54-f005-4066-af9a-19d10a9072ff tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:25.760123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e102fd54-f005-4066-af9a-19d10a9072ff tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:25.760969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e102fd54-f005-4066-af9a-19d10a9072ff tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:25.761447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e102fd54-f005-4066-af9a-19d10a9072ff tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:26.404652 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e102fd54-f005-4066-af9a-19d10a9072ff tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "POST /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93/action" status: 202 len: 0 microversion: 2.1 time: 0.640061 May 28 21:09:26.408324 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1012/2010] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:09:25 2022] POST /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93/action => generated 0 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 21:09:26.423865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e3ecd327-efa9-46b3-b742-9955f0715dfa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d578030d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:26.522277 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e3ecd327-efa9-46b3-b742-9955f0715dfa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 200 len: 1412 microversion: 2.1 time: 0.109325 May 28 21:09:26.522877 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1013/2011] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:09:26 2022] GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:26.540508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-93026dfc-3dc6-4aea-9fd0-4a34bf971ca7 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:26.542769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-93026dfc-3dc6-4aea-9fd0-4a34bf971ca7 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:26.566561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93026dfc-3dc6-4aea-9fd0-4a34bf971ca7 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:26.567030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93026dfc-3dc6-4aea-9fd0-4a34bf971ca7 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:26.567855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93026dfc-3dc6-4aea-9fd0-4a34bf971ca7 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:26.579507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93026dfc-3dc6-4aea-9fd0-4a34bf971ca7 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:26.768106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-93026dfc-3dc6-4aea-9fd0-4a34bf971ca7 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:26.781564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-93026dfc-3dc6-4aea-9fd0-4a34bf971ca7 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:26.787197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-93026dfc-3dc6-4aea-9fd0-4a34bf971ca7 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:26.807206 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-93026dfc-3dc6-4aea-9fd0-4a34bf971ca7 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1355 microversion: 2.75 time: 0.276576 May 28 21:09:26.808732 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1014/2012] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:26 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1355 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:26.844815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2e14e6c6-d531-4f3e-a3c3-ecd272de58e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:26.848590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2e14e6c6-d531-4f3e-a3c3-ecd272de58e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:26.864841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e14e6c6-d531-4f3e-a3c3-ecd272de58e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:26.865830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e14e6c6-d531-4f3e-a3c3-ecd272de58e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:26.869936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e14e6c6-d531-4f3e-a3c3-ecd272de58e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:26.869936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e14e6c6-d531-4f3e-a3c3-ecd272de58e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:27.315751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2e14e6c6-d531-4f3e-a3c3-ecd272de58e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:27.334120 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2e14e6c6-d531-4f3e-a3c3-ecd272de58e5 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1314 microversion: 2.1 time: 0.504067 May 28 21:09:27.345744 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1015/2013] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:26 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:27.540189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4b1e7a36-3afb-4c67-919b-6afa0b30837d tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d578ba160>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:27.619401 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4b1e7a36-3afb-4c67-919b-6afa0b30837d tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 200 len: 1412 microversion: 2.1 time: 0.086921 May 28 21:09:27.625048 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1016/2014] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:09:27 2022] GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:27.842812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-df6c12d0-ce54-4c51-91ce-92d4734966f4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:27.842812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-df6c12d0-ce54-4c51-91ce-92d4734966f4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:27.842812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df6c12d0-ce54-4c51-91ce-92d4734966f4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:27.842812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df6c12d0-ce54-4c51-91ce-92d4734966f4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:27.842812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df6c12d0-ce54-4c51-91ce-92d4734966f4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:27.842812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df6c12d0-ce54-4c51-91ce-92d4734966f4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:27.988221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-df6c12d0-ce54-4c51-91ce-92d4734966f4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:28.021425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:28.032705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-df6c12d0-ce54-4c51-91ce-92d4734966f4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:28.037584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-df6c12d0-ce54-4c51-91ce-92d4734966f4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:28.048213 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-df6c12d0-ce54-4c51-91ce-92d4734966f4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1419 microversion: 2.75 time: 0.219845 May 28 21:09:28.048915 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1017/2015] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:27 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1419 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:09:28.351963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4aea01dd-6b36-4b18-98f6-d2e19cec679b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:28.354502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4aea01dd-6b36-4b18-98f6-d2e19cec679b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:28.370227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4aea01dd-6b36-4b18-98f6-d2e19cec679b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:28.370694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4aea01dd-6b36-4b18-98f6-d2e19cec679b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:28.375181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4aea01dd-6b36-4b18-98f6-d2e19cec679b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:28.375993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4aea01dd-6b36-4b18-98f6-d2e19cec679b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:28.668677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4aea01dd-6b36-4b18-98f6-d2e19cec679b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:28.679842 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4aea01dd-6b36-4b18-98f6-d2e19cec679b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1314 microversion: 2.1 time: 0.331413 May 28 21:09:28.681054 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1018/2016] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:28 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:28.685876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ab16208d-bd49-49de-bc88-27203b144a57 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d577fb790>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:28.765618 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ab16208d-bd49-49de-bc88-27203b144a57 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 200 len: 1412 microversion: 2.1 time: 0.083399 May 28 21:09:28.766294 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1019/2017] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:09:28 2022] GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 1412 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:29.074518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d8ecd53f-35e6-4131-9325-9b2550172824 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:29.076271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d8ecd53f-35e6-4131-9325-9b2550172824 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:29.092647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8ecd53f-35e6-4131-9325-9b2550172824 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:29.093933 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8ecd53f-35e6-4131-9325-9b2550172824 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:29.095421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8ecd53f-35e6-4131-9325-9b2550172824 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:29.096351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8ecd53f-35e6-4131-9325-9b2550172824 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:29.564745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d8ecd53f-35e6-4131-9325-9b2550172824 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:29.575279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d8ecd53f-35e6-4131-9325-9b2550172824 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:29.575947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d8ecd53f-35e6-4131-9325-9b2550172824 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:29.582386 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d8ecd53f-35e6-4131-9325-9b2550172824 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1417 microversion: 2.75 time: 0.517207 May 28 21:09:29.594422 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1020/2018] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:29 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1417 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:29.675078 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b7b25a86-af21-4782-a86b-ed0d9599f9f1 tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.162994 May 28 21:09:29.675712 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 999/2019] 10.222.0.33 () {60 vars in 1169 bytes} [Sat May 28 21:09:25 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:29.701889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-620a0ace-2a91-4733-9907-6acf1e73fa4b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:29.702560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-620a0ace-2a91-4733-9907-6acf1e73fa4b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:29.703465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-805715b7-25b4-4164-9415-488fa86a501f tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] Calling method '.version_select at 0x7f4d57970280>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:29.727574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-620a0ace-2a91-4733-9907-6acf1e73fa4b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:29.729983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-620a0ace-2a91-4733-9907-6acf1e73fa4b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:29.730934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-620a0ace-2a91-4733-9907-6acf1e73fa4b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:29.734473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-620a0ace-2a91-4733-9907-6acf1e73fa4b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:30.302068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-620a0ace-2a91-4733-9907-6acf1e73fa4b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:30.315472 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-620a0ace-2a91-4733-9907-6acf1e73fa4b tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1314 microversion: 2.1 time: 0.622322 May 28 21:09:30.317179 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1000/2020] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:29 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:30.324387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0fb1adcc-1166-4853-a9c8-ce1b107bd00b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:30.325159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0fb1adcc-1166-4853-a9c8-ce1b107bd00b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:30.348972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0fb1adcc-1166-4853-a9c8-ce1b107bd00b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:30.349722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0fb1adcc-1166-4853-a9c8-ce1b107bd00b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:30.351874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0fb1adcc-1166-4853-a9c8-ce1b107bd00b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:30.354510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0fb1adcc-1166-4853-a9c8-ce1b107bd00b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:30.437063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0fb1adcc-1166-4853-a9c8-ce1b107bd00b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:09:30.610593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:30.806247 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0fb1adcc-1166-4853-a9c8-ce1b107bd00b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 204 len: 0 microversion: 2.1 time: 0.487529 May 28 21:09:30.807639 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1001/2021] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:09:30 2022] DELETE /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:09:30.817440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9fa8f62b-d05e-43fe-9cc5-399ab1273b7d tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d5765b700>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:30.928686 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9fa8f62b-d05e-43fe-9cc5-399ab1273b7d tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 200 len: 1412 microversion: 2.1 time: 0.114739 May 28 21:09:30.929176 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1002/2022] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:09:30 2022] GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 1412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:30.943361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a5018443-4c77-454b-91bb-9205ecca3373 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:30.944115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a5018443-4c77-454b-91bb-9205ecca3373 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:30.957186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:30.959917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5018443-4c77-454b-91bb-9205ecca3373 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:30.960580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5018443-4c77-454b-91bb-9205ecca3373 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:30.961643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5018443-4c77-454b-91bb-9205ecca3373 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:30.962814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5018443-4c77-454b-91bb-9205ecca3373 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:31.157348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a5018443-4c77-454b-91bb-9205ecca3373 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:31.180314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a5018443-4c77-454b-91bb-9205ecca3373 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:31.184446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a5018443-4c77-454b-91bb-9205ecca3373 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:31.211883 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a5018443-4c77-454b-91bb-9205ecca3373 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1438 microversion: 2.75 time: 0.276288 May 28 21:09:31.231234 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1003/2023] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:30 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1438 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:31.238948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-3076bb5b-ca79-4fbc-8aa6-4d70ed7b8ff7 req-e9aff7e8-6dd2-460c-9cc2-cc713fb1c4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9b4edf-f109-4ba9-b543-115b9e68ab8d", "name": "network-vif-plugged", "status": "completed", "tag": "a0bdfb08-cf00-44f9-b10c-e524cc386207"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:31.248643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3076bb5b-ca79-4fbc-8aa6-4d70ed7b8ff7 req-e9aff7e8-6dd2-460c-9cc2-cc713fb1c4c8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:31.249572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3076bb5b-ca79-4fbc-8aa6-4d70ed7b8ff7 req-e9aff7e8-6dd2-460c-9cc2-cc713fb1c4c8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:31.266199 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-3076bb5b-ca79-4fbc-8aa6-4d70ed7b8ff7 req-e9aff7e8-6dd2-460c-9cc2-cc713fb1c4c8 service nova] Creating event network-vif-plugged:a0bdfb08-cf00-44f9-b10c-e524cc386207 for instance de9b4edf-f109-4ba9-b543-115b9e68ab8d on nch1-master-1 May 28 21:09:31.275660 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-3076bb5b-ca79-4fbc-8aa6-4d70ed7b8ff7 req-e9aff7e8-6dd2-460c-9cc2-cc713fb1c4c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042427 May 28 21:09:31.276674 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1004/2024] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:31.282772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c37de675-1db5-4f81-98b1-3904d5b80e7b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:31.288081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c37de675-1db5-4f81-98b1-3904d5b80e7b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:31.312343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c37de675-1db5-4f81-98b1-3904d5b80e7b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:31.312343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c37de675-1db5-4f81-98b1-3904d5b80e7b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:31.312343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c37de675-1db5-4f81-98b1-3904d5b80e7b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:31.312343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c37de675-1db5-4f81-98b1-3904d5b80e7b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:32.110603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c37de675-1db5-4f81-98b1-3904d5b80e7b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:32.123522 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c37de675-1db5-4f81-98b1-3904d5b80e7b tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1499 microversion: 2.1 time: 0.845366 May 28 21:09:32.129269 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1005/2025] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:31 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1499 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:32.142419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:32.142419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:32.162801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:32.162801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:32.163001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:32.163452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:32.846507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:09:32.849223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:09:32.852156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:09:32.853721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:09:32.857609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:09:32.883442 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-805715b7-25b4-4164-9415-488fa86a501f tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/aa527053-ed7b-4d7d-a52f-20ed5fdbafa1" status: 202 len: 0 microversion: 2.1 time: 3.188846 May 28 21:09:32.883442 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1021/2026] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:09:29 2022] DELETE /compute/v2.1/os-floating-ips/aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 => generated 0 bytes in 3195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:09:32.887121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-08201aac-fb03-46a1-9381-0116513c87ed tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:32.887762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-08201aac-fb03-46a1-9381-0116513c87ed tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:32.915790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08201aac-fb03-46a1-9381-0116513c87ed tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:32.916336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08201aac-fb03-46a1-9381-0116513c87ed tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:32.922957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08201aac-fb03-46a1-9381-0116513c87ed tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:32.923928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08201aac-fb03-46a1-9381-0116513c87ed tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:33.287495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:33.299822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:33.304509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:33.305489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:33.305976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:33.609891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:33.655477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:33.682610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:33.702700 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2f442897-9d47-4bb3-9a0f-151851c9bfbc tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "POST /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f/action" status: 202 len: 1495 microversion: 2.75 time: 1.571948 May 28 21:09:33.705823 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1006/2027] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:09:32 2022] POST /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f/action => generated 1495 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 28 21:09:33.717096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-694750036", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "2b760e6b-d6a2-4e56-8a48-0fa9e865497c"}, {"uuid": "283ab028-d428-4b2b-b12d-70bcc84497b6"}, {"uuid": "2b760e6b-d6a2-4e56-8a48-0fa9e865497c"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:33.775286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-08201aac-fb03-46a1-9381-0116513c87ed tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:33.785586 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-08201aac-fb03-46a1-9381-0116513c87ed tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1314 microversion: 2.1 time: 0.906577 May 28 21:09:33.786457 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1022/2028] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:32 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1314 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:33.796497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f9063dad-e418-4bf0-b64b-1777a25a222b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d5799e3a0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:33.937745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] validate_networks() for [('2b760e6b-d6a2-4e56-8a48-0fa9e865497c', None, None, None, None, None), ('283ab028-d428-4b2b-b12d-70bcc84497b6', None, None, None, None, None), ('2b760e6b-d6a2-4e56-8a48-0fa9e865497c', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:09:33.965360 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f9063dad-e418-4bf0-b64b-1777a25a222b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 200 len: 1412 microversion: 2.1 time: 0.177633 May 28 21:09:33.973152 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1023/2029] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:09:33 2022] GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 1412 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:33.981376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fed640fc-4384-468a-bd6b-ffdd702b2dbb tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] Calling method '.version_select at 0x7f4d57878040>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:34.198962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG neutronclient.v2_0.client [None req-fed640fc-4384-468a-bd6b-ffdd702b2dbb tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 could not be found", "detail": ""}} {{(pid=143128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:09:34.200716 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-fed640fc-4384-468a-bd6b-ffdd702b2dbb tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] HTTP exception thrown: Floating IP not found for ID aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fed640fc-4384-468a-bd6b-ffdd702b2dbb tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] Request method failure captured: May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-floating-ips/aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 HTTP/1.1 May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko98C58tHeiEFYoVllml_Yq52x7sIVNVj6xyUalo2zLAZMnIPhKEtRCbEfWa0kxm0loVq1QOV6EW_EjXKvOdAuCxg31xI55Oq_8Q4sER85gUrJKE8BI-JYhVa9tBB1tUBtgTXOqQ43UIbUEijZAxQLHe-LnL-lDNeRCVVLuo-Chzw24 May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0dd2a795de30463db3d150e44df69489 May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-FloatingIPsTestJSON-1445283070 May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0dd2a795de30463db3d150e44df69489", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0dd2a795de30463db3d150e44df69489"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0dd2a795de30463db3d150e44df69489"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0dd2a795de30463db3d150e44df69489"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-FloatingIPsTestJSON-1445283070 May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0dd2a795de30463db3d150e44df69489 May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1445283070 May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-FloatingIPsTestJSON-1445283070-project May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 5c65140c062f4eedb8bfe963137de014 May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-FloatingIPsTestJSON-1445283070-project May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: exception: Floating IP not found for ID aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'aa527053-ed7b-4d7d-a52f-20ed5fdbafa1'} May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 could not be found May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f84e94d3-2145-4b6b-8411-cba6278de42b'] May 28 21:09:34.209570 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID aa527053-ed7b-4d7d-a52f-20ed5fdbafa1. May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 May 28 21:09:34.219127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:34.227178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fed640fc-4384-468a-bd6b-ffdd702b2dbb tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] Returning 404 to user: Floating IP not found for ID aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:34.228459 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fed640fc-4384-468a-bd6b-ffdd702b2dbb tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/aa527053-ed7b-4d7d-a52f-20ed5fdbafa1" status: 404 len: 111 microversion: 2.1 time: 0.253928 May 28 21:09:34.231129 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1024/2030] 10.222.0.33 () {58 vars in 1259 bytes} [Sat May 28 21:09:33 2022] GET /compute/v2.1/os-floating-ips/aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 => generated 111 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:09:34.773961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-53c79f6f-8996-43fd-9d5b-b19581001699 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:34.774634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-53c79f6f-8996-43fd-9d5b-b19581001699 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:34.785574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:34.787356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53c79f6f-8996-43fd-9d5b-b19581001699 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:34.787815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53c79f6f-8996-43fd-9d5b-b19581001699 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:34.788601 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53c79f6f-8996-43fd-9d5b-b19581001699 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:34.789042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53c79f6f-8996-43fd-9d5b-b19581001699 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:34.859392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53c79f6f-8996-43fd-9d5b-b19581001699 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:34.859681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53c79f6f-8996-43fd-9d5b-b19581001699 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:34.860350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-53c79f6f-8996-43fd-9d5b-b19581001699 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lazy-loading 'fault' on Instance uuid 6a102552-9f3f-417b-a587-72cf6ee45088 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:09:34.901482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:35.196769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-53c79f6f-8996-43fd-9d5b-b19581001699 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:35.211900 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-53c79f6f-8996-43fd-9d5b-b19581001699 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 200 len: 1301 microversion: 2.1 time: 0.977136 May 28 21:09:35.212416 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1025/2031] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:34 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 1301 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:35.230341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-140bfd9c-2f73-4026-9bd1-405ec385f2bb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:35.234024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-140bfd9c-2f73-4026-9bd1-405ec385f2bb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:35.261421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-140bfd9c-2f73-4026-9bd1-405ec385f2bb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:35.263235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-140bfd9c-2f73-4026-9bd1-405ec385f2bb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:35.265431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-140bfd9c-2f73-4026-9bd1-405ec385f2bb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:35.270615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-140bfd9c-2f73-4026-9bd1-405ec385f2bb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:35.471465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:35.521728 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-140bfd9c-2f73-4026-9bd1-405ec385f2bb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:35.544620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-140bfd9c-2f73-4026-9bd1-405ec385f2bb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:35.550299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-140bfd9c-2f73-4026-9bd1-405ec385f2bb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:35.575651 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-140bfd9c-2f73-4026-9bd1-405ec385f2bb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1447 microversion: 2.75 time: 0.350107 May 28 21:09:35.596423 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1026/2032] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:35 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1447 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:35.607624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-05a650e6-a446-4fd9-a008-7a8edefd2985 req-2302ce9a-9193-4e8c-ab25-01e076146c07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a102552-9f3f-417b-a587-72cf6ee45088", "name": "network-vif-deleted", "tag": "e96b3cab-4dc1-4d01-a789-0983f750f285"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:35.628927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-05a650e6-a446-4fd9-a008-7a8edefd2985 req-2302ce9a-9193-4e8c-ab25-01e076146c07 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:35.629383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-05a650e6-a446-4fd9-a008-7a8edefd2985 req-2302ce9a-9193-4e8c-ab25-01e076146c07 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:35.673127 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-05a650e6-a446-4fd9-a008-7a8edefd2985 req-2302ce9a-9193-4e8c-ab25-01e076146c07 service nova] Creating event network-vif-deleted:e96b3cab-4dc1-4d01-a789-0983f750f285 for instance 6a102552-9f3f-417b-a587-72cf6ee45088 on nch2-master-1 May 28 21:09:35.682499 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-05a650e6-a446-4fd9-a008-7a8edefd2985 req-2302ce9a-9193-4e8c-ab25-01e076146c07 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081446 May 28 21:09:35.683104 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1027/2033] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:35.688868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5b42545a-4608-4e03-83a0-6cd7bf208b8e tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] Calling method '.version_select at 0x7f4d57968f70>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:35.856789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG neutronclient.v2_0.client [None req-5b42545a-4608-4e03-83a0-6cd7bf208b8e tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 could not be found", "detail": ""}} {{(pid=143128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:09:35.857578 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-5b42545a-4608-4e03-83a0-6cd7bf208b8e tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] HTTP exception thrown: Floating IP not found for ID aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5b42545a-4608-4e03-83a0-6cd7bf208b8e tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] Request method failure captured: May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-floating-ips/aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 HTTP/1.1 May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko98C58tHeiEFYoVllml_Yq52x7sIVNVj6xyUalo2zLAZMnIPhKEtRCbEfWa0kxm0loVq1QOV6EW_EjXKvOdAuCxg31xI55Oq_8Q4sER85gUrJKE8BI-JYhVa9tBB1tUBtgTXOqQ43UIbUEijZAxQLHe-LnL-lDNeRCVVLuo-Chzw24 May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0dd2a795de30463db3d150e44df69489 May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-FloatingIPsTestJSON-1445283070 May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0dd2a795de30463db3d150e44df69489", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0dd2a795de30463db3d150e44df69489"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0dd2a795de30463db3d150e44df69489"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0dd2a795de30463db3d150e44df69489"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-FloatingIPsTestJSON-1445283070 May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0dd2a795de30463db3d150e44df69489 May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1445283070 May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-FloatingIPsTestJSON-1445283070-project May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 5c65140c062f4eedb8bfe963137de014 May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-FloatingIPsTestJSON-1445283070-project May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: exception: Floating IP not found for ID aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'aa527053-ed7b-4d7d-a52f-20ed5fdbafa1'} May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 could not be found May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a776f7da-c530-4798-b19d-870c6497e319'] May 28 21:09:35.859719 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID aa527053-ed7b-4d7d-a52f-20ed5fdbafa1. May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5b42545a-4608-4e03-83a0-6cd7bf208b8e tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] Returning 404 to user: Floating IP not found for ID aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5b42545a-4608-4e03-83a0-6cd7bf208b8e tempest-FloatingIPsTestJSON-1445283070 tempest-FloatingIPsTestJSON-1445283070-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/aa527053-ed7b-4d7d-a52f-20ed5fdbafa1" status: 404 len: 111 microversion: 2.1 time: 0.176808 May 28 21:09:35.867766 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1028/2034] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:09:35 2022] DELETE /compute/v2.1/os-floating-ips/aa527053-ed7b-4d7d-a52f-20ed5fdbafa1 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:09:35.884766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-e971d5c5-bbf7-45b3-a57f-95cd6e6b4177 req-cae84e12-c485-4999-87a2-a6d6a752dfc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d5e5e3-2837-4e11-9b7f-636490b41a93", "name": "network-vif-plugged", "status": "completed", "tag": "946cf242-8860-4934-a2dc-34a9739fa767"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:35.912652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e971d5c5-bbf7-45b3-a57f-95cd6e6b4177 req-cae84e12-c485-4999-87a2-a6d6a752dfc4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:35.913284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e971d5c5-bbf7-45b3-a57f-95cd6e6b4177 req-cae84e12-c485-4999-87a2-a6d6a752dfc4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:35.941944 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e971d5c5-bbf7-45b3-a57f-95cd6e6b4177 req-cae84e12-c485-4999-87a2-a6d6a752dfc4 service nova] Creating event network-vif-plugged:946cf242-8860-4934-a2dc-34a9739fa767 for instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 on nch2-master-1 May 28 21:09:35.968414 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-e971d5c5-bbf7-45b3-a57f-95cd6e6b4177 req-cae84e12-c485-4999-87a2-a6d6a752dfc4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103118 May 28 21:09:35.976041 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1029/2035] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:35.982575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2f66ae5f-b367-49c9-86d9-75ef81d6b5da tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:35.983959 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2f66ae5f-b367-49c9-86d9-75ef81d6b5da tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:35.994725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f66ae5f-b367-49c9-86d9-75ef81d6b5da tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:35.996212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f66ae5f-b367-49c9-86d9-75ef81d6b5da tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:35.997556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f66ae5f-b367-49c9-86d9-75ef81d6b5da tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:35.998392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f66ae5f-b367-49c9-86d9-75ef81d6b5da tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:36.409333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2f66ae5f-b367-49c9-86d9-75ef81d6b5da tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:36.423072 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2f66ae5f-b367-49c9-86d9-75ef81d6b5da tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1502 microversion: 2.1 time: 0.445053 May 28 21:09:36.426066 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1030/2036] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:35 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1502 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:36.438887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-95939abd-ed73-46c5-837c-6d88877ee18f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d57968af0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:36.534297 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-95939abd-ed73-46c5-837c-6d88877ee18f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 200 len: 1412 microversion: 2.1 time: 0.109526 May 28 21:09:36.534869 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1031/2037] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:09:36 2022] GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:36.884926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:09:36.886280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:09:36.887075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:09:36.887676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:09:36.888290 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:09:36.902072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:36.903106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:36.904119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:36.904832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:36.917193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-848e2333-9e37-4141-9bd4-429961ea07bf tempest-SecurityGroupsTestAdminJSON-158190521 tempest-SecurityGroupsTestAdminJSON-158190521-project] Action: 'create', calling method: .version_select at 0x7f4d5779ad30>, body: {"security_group": {"name": "tempest-securitygroup-386824759", "description": "tempest-description-1875032772"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:36.963041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Getting quotas for project cf209a1ba94046f89ddf62c77b6b0f02. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:09:36.974957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Getting quotas for user 659bd3ebefc348b7a176379bd342f9ed and project cf209a1ba94046f89ddf62c77b6b0f02. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:09:37.000708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:09:37.003379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:09:37.209018 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a88c0f8b-5357-484b-9329-8d8785bb0a3e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.502027 May 28 21:09:37.210833 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1007/2038] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:09:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 3504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:09:37.222481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5bc554da-a2d9-45d0-a0a0-739cdb416c3a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:37.223418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5bc554da-a2d9-45d0-a0a0-739cdb416c3a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 6a102552-9f3f-417b-a587-72cf6ee45088] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:37.231490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bc554da-a2d9-45d0-a0a0-739cdb416c3a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:37.232187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bc554da-a2d9-45d0-a0a0-739cdb416c3a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:37.235198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bc554da-a2d9-45d0-a0a0-739cdb416c3a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:37.235198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bc554da-a2d9-45d0-a0a0-739cdb416c3a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:37.251979 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-5bc554da-a2d9-45d0-a0a0-739cdb416c3a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] HTTP exception thrown: Instance 6a102552-9f3f-417b-a587-72cf6ee45088 could not be found. May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5bc554da-a2d9-45d0-a0a0-739cdb416c3a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Request method failure captured: May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 HTTP/1.1 May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko5R8_T5eGdX6eZzJm8YrffHhbtGoCRZcU6O2AwDzQIeTZBP6GrzQYtOx4uEO2lPmdRVO666hp641nCiRg0Byat_ttpfQoUeMlQqk_Egahdmg0iZV5JD6pG0wWsheftl5KLHlnpjk6Zqi8-TmeDDfg87lrxkvQ_FWBFzX67a1b65i5M May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2f5c3054461d4d07861a1685cfeba36a May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-LiveMigrationTest-1347342374 May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f5c3054461d4d07861a1685cfeba36a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f5c3054461d4d07861a1685cfeba36a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f5c3054461d4d07861a1685cfeba36a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f5c3054461d4d07861a1685cfeba36a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-LiveMigrationTest-1347342374 May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2f5c3054461d4d07861a1685cfeba36a May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-LiveMigrationTest-1347342374 May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-LiveMigrationTest-1347342374-project May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 7b44b524592e4a57a26681767b9c4541 May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-LiveMigrationTest-1347342374-project May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 6a102552-9f3f-417b-a587-72cf6ee45088 could not be found. May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '6a102552-9f3f-417b-a587-72cf6ee45088'} May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a102552-9f3f-417b-a587-72cf6ee45088 could not be found. May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a102552-9f3f-417b-a587-72cf6ee45088 could not be found. May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:37.254211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:37.258766 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:37.258766 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:37.258766 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:37.258766 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:37.258766 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:37.258766 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a102552-9f3f-417b-a587-72cf6ee45088 could not be found. May 28 21:09:37.258766 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:37.261192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5bc554da-a2d9-45d0-a0a0-739cdb416c3a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Returning 404 to user: Instance 6a102552-9f3f-417b-a587-72cf6ee45088 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:37.262345 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5bc554da-a2d9-45d0-a0a0-739cdb416c3a tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088" status: 404 len: 111 microversion: 2.1 time: 0.049827 May 28 21:09:37.266567 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1008/2039] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:37 2022] GET /compute/v2.1/servers/6a102552-9f3f-417b-a587-72cf6ee45088 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:09:37.274480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2aef6abf-2ee5-4d28-b68f-11c180159c90 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1036180354"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:37.275416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2aef6abf-2ee5-4d28-b68f-11c180159c90 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:37.288664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2aef6abf-2ee5-4d28-b68f-11c180159c90 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:37.289624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2aef6abf-2ee5-4d28-b68f-11c180159c90 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:37.290677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2aef6abf-2ee5-4d28-b68f-11c180159c90 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:37.294357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2aef6abf-2ee5-4d28-b68f-11c180159c90 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:37.853440 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.network.security_group_api [None req-2aef6abf-2ee5-4d28-b68f-11c180159c90 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Adding security group e5884834-9505-4eb7-beba-b3bfc7665b47 to port a0bdfb08-cf00-44f9-b10c-e524cc386207 May 28 21:09:37.901614 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-848e2333-9e37-4141-9bd4-429961ea07bf tempest-SecurityGroupsTestAdminJSON-158190521 tempest-SecurityGroupsTestAdminJSON-158190521-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.364604 May 28 21:09:37.903226 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1032/2040] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:09:36 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:37.916138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-016abbc8-485b-493c-98ba-f58e81cf0ea4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:37.920411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-016abbc8-485b-493c-98ba-f58e81cf0ea4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:37.966775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-016abbc8-485b-493c-98ba-f58e81cf0ea4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:37.971504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-016abbc8-485b-493c-98ba-f58e81cf0ea4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:37.972658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-016abbc8-485b-493c-98ba-f58e81cf0ea4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:37.975201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-016abbc8-485b-493c-98ba-f58e81cf0ea4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:38.131816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-016abbc8-485b-493c-98ba-f58e81cf0ea4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:38.144931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-016abbc8-485b-493c-98ba-f58e81cf0ea4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:38.147698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-016abbc8-485b-493c-98ba-f58e81cf0ea4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:38.155656 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-016abbc8-485b-493c-98ba-f58e81cf0ea4 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1447 microversion: 2.75 time: 0.249851 May 28 21:09:38.157206 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1033/2041] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:37 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1447 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:38.166263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-86c4cfed-a111-4ff2-a3f5-af321287408e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:38.167837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-86c4cfed-a111-4ff2-a3f5-af321287408e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:38.345642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-86c4cfed-a111-4ff2-a3f5-af321287408e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:38.353532 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-86c4cfed-a111-4ff2-a3f5-af321287408e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1212 microversion: 2.1 time: 0.192786 May 28 21:09:38.354383 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1034/2042] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:38 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1212 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:38.376202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-214ff621-5cfc-4ce1-9144-71e839a51ca9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:38.377013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-214ff621-5cfc-4ce1-9144-71e839a51ca9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:38.391494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-214ff621-5cfc-4ce1-9144-71e839a51ca9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:38.393433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-214ff621-5cfc-4ce1-9144-71e839a51ca9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:38.397716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-214ff621-5cfc-4ce1-9144-71e839a51ca9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:38.398575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-214ff621-5cfc-4ce1-9144-71e839a51ca9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:38.438456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-214ff621-5cfc-4ce1-9144-71e839a51ca9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:09:38.847773 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-214ff621-5cfc-4ce1-9144-71e839a51ca9 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "DELETE /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 204 len: 0 microversion: 2.1 time: 0.490963 May 28 21:09:38.848741 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1035/2043] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:09:38 2022] DELETE /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:09:38.854793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c221e9ca-4fb1-4cd4-91e2-0c37ed4fa49f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d57871670>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:39.007519 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c221e9ca-4fb1-4cd4-91e2-0c37ed4fa49f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 200 len: 1412 microversion: 2.1 time: 0.157172 May 28 21:09:39.013610 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1036/2044] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:09:38 2022] GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:39.024069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ce8d6333-d757-4eae-83ea-14547170d672 tempest-SecurityGroupsTestAdminJSON-158190521 tempest-SecurityGroupsTestAdminJSON-158190521-project] Action: 'create', calling method: .version_select at 0x7f4d578a8820>, body: {"security_group": {"name": "tempest-securitygroup-692299148", "description": "tempest-description-332780538"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:39.203127 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2aef6abf-2ee5-4d28-b68f-11c180159c90 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d/action" status: 202 len: 0 microversion: 2.1 time: 1.938586 May 28 21:09:39.203721 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1009/2045] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:09:37 2022] POST /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d/action => generated 0 bytes in 1940 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:09:39.210817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eb36aac7-3946-4b05-9541-251abcfb34fe tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:39.211512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eb36aac7-3946-4b05-9541-251abcfb34fe tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:39.228411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb36aac7-3946-4b05-9541-251abcfb34fe tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:39.229040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb36aac7-3946-4b05-9541-251abcfb34fe tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:39.230385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb36aac7-3946-4b05-9541-251abcfb34fe tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:39.231098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb36aac7-3946-4b05-9541-251abcfb34fe tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:40.137156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eb36aac7-3946-4b05-9541-251abcfb34fe tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:40.150896 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eb36aac7-3946-4b05-9541-251abcfb34fe tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1483 microversion: 2.1 time: 0.944136 May 28 21:09:40.165188 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1010/2046] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:39 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1483 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:40.178912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4f85881c-6209-4d01-8cb4-208ef92c2682 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:40.181169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4f85881c-6209-4d01-8cb4-208ef92c2682 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:40.200834 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f85881c-6209-4d01-8cb4-208ef92c2682 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:40.201683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f85881c-6209-4d01-8cb4-208ef92c2682 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:40.204580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f85881c-6209-4d01-8cb4-208ef92c2682 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:40.207999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f85881c-6209-4d01-8cb4-208ef92c2682 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:40.354942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4f85881c-6209-4d01-8cb4-208ef92c2682 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:40.360250 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ce8d6333-d757-4eae-83ea-14547170d672 tempest-SecurityGroupsTestAdminJSON-158190521 tempest-SecurityGroupsTestAdminJSON-158190521-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.348063 May 28 21:09:40.368437 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1037/2047] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:09:39 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:40.374497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-35b95e13-5705-473c-8999-cdbef5cc4392 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d5779f310>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:40.387885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4f85881c-6209-4d01-8cb4-208ef92c2682 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:40.398223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4f85881c-6209-4d01-8cb4-208ef92c2682 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:40.419237 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4f85881c-6209-4d01-8cb4-208ef92c2682 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1447 microversion: 2.75 time: 0.251229 May 28 21:09:40.421898 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1011/2048] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:40 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1447 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:40.433469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-46b8d0b0-1165-4506-8352-efa8b9b5ccc0 req-ca9570d2-775e-4552-b2b9-3705b534dc7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9b4edf-f109-4ba9-b543-115b9e68ab8d", "tag": "a0bdfb08-cf00-44f9-b10c-e524cc386207"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:40.473276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-46b8d0b0-1165-4506-8352-efa8b9b5ccc0 req-ca9570d2-775e-4552-b2b9-3705b534dc7f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:40.478025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-46b8d0b0-1165-4506-8352-efa8b9b5ccc0 req-ca9570d2-775e-4552-b2b9-3705b534dc7f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:40.567017 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-46b8d0b0-1165-4506-8352-efa8b9b5ccc0 req-ca9570d2-775e-4552-b2b9-3705b534dc7f service nova] Creating event network-changed:a0bdfb08-cf00-44f9-b10c-e524cc386207 for instance de9b4edf-f109-4ba9-b543-115b9e68ab8d on nch1-master-1 May 28 21:09:40.582154 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-46b8d0b0-1165-4506-8352-efa8b9b5ccc0 req-ca9570d2-775e-4552-b2b9-3705b534dc7f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154601 May 28 21:09:40.583108 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1012/2049] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:40.593695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1f256381-b3bd-4edc-b09e-8f886a966350 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:40.595423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1f256381-b3bd-4edc-b09e-8f886a966350 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:40.602666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f256381-b3bd-4edc-b09e-8f886a966350 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:40.604164 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f256381-b3bd-4edc-b09e-8f886a966350 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:40.605200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f256381-b3bd-4edc-b09e-8f886a966350 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:40.606246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f256381-b3bd-4edc-b09e-8f886a966350 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:41.171980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1f256381-b3bd-4edc-b09e-8f886a966350 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:41.199586 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1f256381-b3bd-4edc-b09e-8f886a966350 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1264 microversion: 2.1 time: 0.613789 May 28 21:09:41.200208 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1013/2050] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:40 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1264 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:41.228535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2906cb3e-0e49-4276-bc6a-3a1711a66713 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d57819ca0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:41.312890 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2906cb3e-0e49-4276-bc6a-3a1711a66713 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 200 len: 1412 microversion: 2.1 time: 0.111529 May 28 21:09:41.314793 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1014/2051] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:09:41 2022] GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:41.513113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-59a683c2-4ab1-49bf-a9cc-5b05e4fbfe20 tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] Action: 'create', calling method: .version_select at 0x7f4d578194c0>, body: {"security_group": {"name": "tempest-securitygroup-1773967113", "description": "tempest-description-90993712"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:41.655468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG neutronclient.v2_0.client [None req-35b95e13-5705-473c-8999-cdbef5cc4392 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group e5884834-9505-4eb7-beba-b3bfc7665b47 in use.", "detail": ""}} {{(pid=143128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:09:41.656734 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-35b95e13-5705-473c-8999-cdbef5cc4392 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Security Group e5884834-9505-4eb7-beba-b3bfc7665b47 in use. May 28 21:09:41.656734 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-64590ed6-653d-41ca-88eb-e54845e9a4e4'] May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-35b95e13-5705-473c-8999-cdbef5cc4392 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-security-groups/e5884834-9505-4eb7-beba-b3bfc7665b47 HTTP/1.1 May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: exception: Security Group e5884834-9505-4eb7-beba-b3bfc7665b47 in use. May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-64590ed6-653d-41ca-88eb-e54845e9a4e4'] May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'e5884834-9505-4eb7-beba-b3bfc7665b47'} May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:09:41.659877 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group e5884834-9505-4eb7-beba-b3bfc7665b47 in use. May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64590ed6-653d-41ca-88eb-e54845e9a4e4'] May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group e5884834-9505-4eb7-beba-b3bfc7665b47 in use. May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64590ed6-653d-41ca-88eb-e54845e9a4e4'] May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group e5884834-9505-4eb7-beba-b3bfc7665b47 in use. May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64590ed6-653d-41ca-88eb-e54845e9a4e4'] May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group e5884834-9505-4eb7-beba-b3bfc7665b47 in use. May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-64590ed6-653d-41ca-88eb-e54845e9a4e4'] May 28 21:09:41.665206 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:41.670496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-35b95e13-5705-473c-8999-cdbef5cc4392 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 400 to user: Security Group e5884834-9505-4eb7-beba-b3bfc7665b47 in use. May 28 21:09:41.670496 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-64590ed6-653d-41ca-88eb-e54845e9a4e4'] {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:41.671731 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-35b95e13-5705-473c-8999-cdbef5cc4392 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e5884834-9505-4eb7-beba-b3bfc7665b47" status: 400 len: 185 microversion: 2.1 time: 1.302094 May 28 21:09:41.676929 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1038/2052] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:09:40 2022] DELETE /compute/v2.1/os-security-groups/e5884834-9505-4eb7-beba-b3bfc7665b47 => generated 185 bytes in 1303 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:09:41.687712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0b05ba42-75ae-44ed-a630-3d4308d16a7c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:41.691235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0b05ba42-75ae-44ed-a630-3d4308d16a7c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:41.714046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b05ba42-75ae-44ed-a630-3d4308d16a7c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:41.714753 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b05ba42-75ae-44ed-a630-3d4308d16a7c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:41.715729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b05ba42-75ae-44ed-a630-3d4308d16a7c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:41.717397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b05ba42-75ae-44ed-a630-3d4308d16a7c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:41.845685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0b05ba42-75ae-44ed-a630-3d4308d16a7c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:41.856263 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0b05ba42-75ae-44ed-a630-3d4308d16a7c tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 200 len: 1441 microversion: 2.1 time: 0.182171 May 28 21:09:41.858968 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1039/2053] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:41 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 1441 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:41.874743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1b77164a-e816-46fd-9851-0a750402195e tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:41.876219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1b77164a-e816-46fd-9851-0a750402195e tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:41.897103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b77164a-e816-46fd-9851-0a750402195e tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:41.898617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b77164a-e816-46fd-9851-0a750402195e tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:41.900585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b77164a-e816-46fd-9851-0a750402195e tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:41.901160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b77164a-e816-46fd-9851-0a750402195e tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:42.041926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1b77164a-e816-46fd-9851-0a750402195e tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:42.053308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1b77164a-e816-46fd-9851-0a750402195e tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:42.056079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1b77164a-e816-46fd-9851-0a750402195e tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:42.080887 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1b77164a-e816-46fd-9851-0a750402195e tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1447 microversion: 2.75 time: 0.220636 May 28 21:09:42.084041 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1040/2054] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:41 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1447 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:42.097150 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-29cb815d-786b-4139-bf65-415b34f94bd0 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:42.104118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-29cb815d-786b-4139-bf65-415b34f94bd0 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:42.129104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29cb815d-786b-4139-bf65-415b34f94bd0 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:42.129907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29cb815d-786b-4139-bf65-415b34f94bd0 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:42.130985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29cb815d-786b-4139-bf65-415b34f94bd0 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:42.131599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29cb815d-786b-4139-bf65-415b34f94bd0 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:42.569447 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-29cb815d-786b-4139-bf65-415b34f94bd0 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d/action" status: 202 len: 0 microversion: 2.1 time: 0.483726 May 28 21:09:42.573255 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1041/2055] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:09:42 2022] POST /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:09:42.578832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c6e94181-c024-417a-b4e5-c190e3db548c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:42.581651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c6e94181-c024-417a-b4e5-c190e3db548c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:42.596426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c6e94181-c024-417a-b4e5-c190e3db548c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:42.596998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c6e94181-c024-417a-b4e5-c190e3db548c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:42.607073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c6e94181-c024-417a-b4e5-c190e3db548c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:42.607801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c6e94181-c024-417a-b4e5-c190e3db548c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:42.982699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c6e94181-c024-417a-b4e5-c190e3db548c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:42.994842 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c6e94181-c024-417a-b4e5-c190e3db548c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1270 microversion: 2.1 time: 0.420196 May 28 21:09:42.995433 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1042/2056] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:42 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1270 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:43.010358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cf28c141-1bc9-420e-9cf3-cf96fc7dfcd4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d57971a60>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:43.105873 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cf28c141-1bc9-420e-9cf3-cf96fc7dfcd4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 200 len: 1412 microversion: 2.1 time: 0.100355 May 28 21:09:43.112364 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1043/2057] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:09:42 2022] GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:43.128783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7e63ae29-179f-4d3a-87d2-092456cdfa0c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:43.134415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7e63ae29-179f-4d3a-87d2-092456cdfa0c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:43.149878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e63ae29-179f-4d3a-87d2-092456cdfa0c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:43.160246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e63ae29-179f-4d3a-87d2-092456cdfa0c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:43.162787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e63ae29-179f-4d3a-87d2-092456cdfa0c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:43.166218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e63ae29-179f-4d3a-87d2-092456cdfa0c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:43.631029 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-59a683c2-4ab1-49bf-a9cc-5b05e4fbfe20 tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.314902 May 28 21:09:43.632204 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1015/2058] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:09:41 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:43.638431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-e4deeb56-81f6-4d9e-a7ae-70022c1992f5 req-63159eaf-42b0-4bab-b797-6e767f223627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45b8d752-edaa-40bc-b38f-1d1441231d82", "name": "network-vif-deleted", "tag": "2f2ef26b-3762-4660-9c11-d7af1c1c3ef4"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:43.656396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e4deeb56-81f6-4d9e-a7ae-70022c1992f5 req-63159eaf-42b0-4bab-b797-6e767f223627 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:43.670143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e4deeb56-81f6-4d9e-a7ae-70022c1992f5 req-63159eaf-42b0-4bab-b797-6e767f223627 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:43.686002 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e4deeb56-81f6-4d9e-a7ae-70022c1992f5 req-63159eaf-42b0-4bab-b797-6e767f223627 service nova] Creating event network-vif-deleted:2f2ef26b-3762-4660-9c11-d7af1c1c3ef4 for instance 45b8d752-edaa-40bc-b38f-1d1441231d82 on nch2-master-1 May 28 21:09:43.695250 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-e4deeb56-81f6-4d9e-a7ae-70022c1992f5 req-63159eaf-42b0-4bab-b797-6e767f223627 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061596 May 28 21:09:43.706922 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1016/2059] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:43.714226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0bcd48ad-ecc0-4026-97c8-a8620635e559 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:43.716095 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0bcd48ad-ecc0-4026-97c8-a8620635e559 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 45b8d752-edaa-40bc-b38f-1d1441231d82] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:43.734791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0bcd48ad-ecc0-4026-97c8-a8620635e559 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:43.743410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0bcd48ad-ecc0-4026-97c8-a8620635e559 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:43.743410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0bcd48ad-ecc0-4026-97c8-a8620635e559 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:43.743410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0bcd48ad-ecc0-4026-97c8-a8620635e559 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:43.754300 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-0bcd48ad-ecc0-4026-97c8-a8620635e559 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] HTTP exception thrown: Instance 45b8d752-edaa-40bc-b38f-1d1441231d82 could not be found. May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0bcd48ad-ecc0-4026-97c8-a8620635e559 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Request method failure captured: May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 HTTP/1.1 May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko5R8_T5eGdX6eZzJm8YrffHhbtGoCRZcU6O2AwDzQIeTZBP6GrzQYtOx4uEO2lPmdRVO666hp641nCiRg0Byat_ttpfQoUeMlQqk_Egahdmg0iZV5JD6pG0wWsheftl5KLHlnpjk6Zqi8-TmeDDfg87lrxkvQ_FWBFzX67a1b65i5M May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2f5c3054461d4d07861a1685cfeba36a May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-LiveMigrationTest-1347342374 May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f5c3054461d4d07861a1685cfeba36a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f5c3054461d4d07861a1685cfeba36a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f5c3054461d4d07861a1685cfeba36a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f5c3054461d4d07861a1685cfeba36a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-LiveMigrationTest-1347342374 May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2f5c3054461d4d07861a1685cfeba36a May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-LiveMigrationTest-1347342374 May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-LiveMigrationTest-1347342374-project May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 7b44b524592e4a57a26681767b9c4541 May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-LiveMigrationTest-1347342374-project May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 45b8d752-edaa-40bc-b38f-1d1441231d82 could not be found. May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '45b8d752-edaa-40bc-b38f-1d1441231d82'} May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45b8d752-edaa-40bc-b38f-1d1441231d82 could not be found. May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45b8d752-edaa-40bc-b38f-1d1441231d82 could not be found. May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:43.756343 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:43.760829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:43.760829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:43.760829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:43.760829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:43.760829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:43.760829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45b8d752-edaa-40bc-b38f-1d1441231d82 could not be found. May 28 21:09:43.760829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:09:43.762798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0bcd48ad-ecc0-4026-97c8-a8620635e559 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Returning 404 to user: Instance 45b8d752-edaa-40bc-b38f-1d1441231d82 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:43.765048 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0bcd48ad-ecc0-4026-97c8-a8620635e559 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82" status: 404 len: 111 microversion: 2.1 time: 0.056098 May 28 21:09:43.767593 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1017/2060] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:43 2022] GET /compute/v2.1/servers/45b8d752-edaa-40bc-b38f-1d1441231d82 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:09:43.772933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a600cee1-3b9b-4bb3-85cc-24dff07b3a13 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:43.773972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a600cee1-3b9b-4bb3-85cc-24dff07b3a13 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:43.782103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a600cee1-3b9b-4bb3-85cc-24dff07b3a13 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:43.782903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a600cee1-3b9b-4bb3-85cc-24dff07b3a13 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:43.784417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a600cee1-3b9b-4bb3-85cc-24dff07b3a13 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:43.785413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a600cee1-3b9b-4bb3-85cc-24dff07b3a13 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:44.048572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7e63ae29-179f-4d3a-87d2-092456cdfa0c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:44.052205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:44.054583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a600cee1-3b9b-4bb3-85cc-24dff07b3a13 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:44.064181 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7e63ae29-179f-4d3a-87d2-092456cdfa0c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1573 microversion: 2.1 time: 0.950382 May 28 21:09:44.064770 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1044/2061] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:43 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1573 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:44.068202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a600cee1-3b9b-4bb3-85cc-24dff07b3a13 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:44.079857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a600cee1-3b9b-4bb3-85cc-24dff07b3a13 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:44.089564 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a600cee1-3b9b-4bb3-85cc-24dff07b3a13 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1447 microversion: 2.75 time: 0.321707 May 28 21:09:44.090323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bca553ee-6d01-454f-b39f-a52ec8b8ed82 tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] Action: 'create', calling method: .version_select at 0x7f4d579f5f70>, body: {"security_group": {"name": "tempest-securitygroup-1965366023", "description": "tempest-description-727936448"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:44.091025 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1018/2062] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:43 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1447 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:44.111836 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-31628e07-ccab-409d-9f20-04fdf48eeb45 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:44.112631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-31628e07-ccab-409d-9f20-04fdf48eeb45 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:44.131242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31628e07-ccab-409d-9f20-04fdf48eeb45 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:44.131953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31628e07-ccab-409d-9f20-04fdf48eeb45 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:44.132966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31628e07-ccab-409d-9f20-04fdf48eeb45 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:44.133575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31628e07-ccab-409d-9f20-04fdf48eeb45 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:44.174771 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-31628e07-ccab-409d-9f20-04fdf48eeb45 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:09:44.644902 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-31628e07-ccab-409d-9f20-04fdf48eeb45 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "DELETE /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 204 len: 0 microversion: 2.1 time: 0.552242 May 28 21:09:44.646771 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1019/2063] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:09:44 2022] DELETE /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:09:44.653175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8e5400c2-f8c4-47f4-8122-3e991972ab10 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:44.656109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8e5400c2-f8c4-47f4-8122-3e991972ab10 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:44.670638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e5400c2-f8c4-47f4-8122-3e991972ab10 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:44.679644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e5400c2-f8c4-47f4-8122-3e991972ab10 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:44.679644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e5400c2-f8c4-47f4-8122-3e991972ab10 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:44.679644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e5400c2-f8c4-47f4-8122-3e991972ab10 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:44.916567 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bca553ee-6d01-454f-b39f-a52ec8b8ed82 tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.840440 May 28 21:09:44.917499 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1045/2064] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:09:44 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:44.928342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-40af0cec-50b8-44c4-8f4a-6d5184a57bd4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d57878700>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:45.023035 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-40af0cec-50b8-44c4-8f4a-6d5184a57bd4 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 200 len: 1412 microversion: 2.1 time: 0.102705 May 28 21:09:45.035092 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1046/2065] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:09:44 2022] GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:45.048598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9284b331-fc10-4a99-9269-7e0b3a34c017 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:45.048598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9284b331-fc10-4a99-9269-7e0b3a34c017 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:45.072728 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9284b331-fc10-4a99-9269-7e0b3a34c017 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:45.073464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9284b331-fc10-4a99-9269-7e0b3a34c017 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:45.074470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9284b331-fc10-4a99-9269-7e0b3a34c017 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:45.075076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9284b331-fc10-4a99-9269-7e0b3a34c017 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:45.112347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8e5400c2-f8c4-47f4-8122-3e991972ab10 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:45.128709 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8e5400c2-f8c4-47f4-8122-3e991972ab10 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1312 microversion: 2.1 time: 0.480274 May 28 21:09:45.131416 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1020/2066] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:44 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1312 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:45.137436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-42b72aac-a89d-4517-a102-b77f008c39f6 tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] Calling method '.version_select at 0x7f4d577809d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:45.665457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9284b331-fc10-4a99-9269-7e0b3a34c017 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b44b524592e4a57a26681767b9c4541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f5c3054461d4d07861a1685cfeba36a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:45.675541 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9284b331-fc10-4a99-9269-7e0b3a34c017 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 200 len: 1499 microversion: 2.1 time: 0.638990 May 28 21:09:45.688414 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1047/2067] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:45 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 1499 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:45.695929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1b02bf86-b8c9-4ac9-a4da-43ecb670a5b8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:45.696695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1b02bf86-b8c9-4ac9-a4da-43ecb670a5b8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:45.703664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b02bf86-b8c9-4ac9-a4da-43ecb670a5b8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:45.705210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b02bf86-b8c9-4ac9-a4da-43ecb670a5b8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:45.705210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b02bf86-b8c9-4ac9-a4da-43ecb670a5b8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:45.705524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b02bf86-b8c9-4ac9-a4da-43ecb670a5b8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:46.516756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1b02bf86-b8c9-4ac9-a4da-43ecb670a5b8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:46.540880 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1b02bf86-b8c9-4ac9-a4da-43ecb670a5b8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1571 microversion: 2.1 time: 0.850602 May 28 21:09:46.541588 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1048/2068] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:45 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1571 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:46.558416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-579d9417-da36-49ca-945f-4cd7e7d36e15 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:46.559140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-579d9417-da36-49ca-945f-4cd7e7d36e15 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:46.585746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-579d9417-da36-49ca-945f-4cd7e7d36e15 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:46.586249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-579d9417-da36-49ca-945f-4cd7e7d36e15 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:46.587049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-579d9417-da36-49ca-945f-4cd7e7d36e15 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:46.587504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-579d9417-da36-49ca-945f-4cd7e7d36e15 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:46.770449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-579d9417-da36-49ca-945f-4cd7e7d36e15 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:46.779358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-579d9417-da36-49ca-945f-4cd7e7d36e15 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:46.780930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-579d9417-da36-49ca-945f-4cd7e7d36e15 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:46.800686 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-579d9417-da36-49ca-945f-4cd7e7d36e15 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1447 microversion: 2.75 time: 0.258156 May 28 21:09:46.801296 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1049/2069] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:46 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1447 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:46.805911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c393bc3b-46ea-4ff5-95e9-bef5e29114a5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d578a8700>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:46.926007 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c393bc3b-46ea-4ff5-95e9-bef5e29114a5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 200 len: 1412 microversion: 2.1 time: 0.123603 May 28 21:09:46.926595 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1050/2070] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:09:46 2022] GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 1412 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:46.935679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-00eaedf1-9da1-42be-b1a7-71548ea20ced tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:46.940001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:46.943332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-00eaedf1-9da1-42be-b1a7-71548ea20ced tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:46.961054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00eaedf1-9da1-42be-b1a7-71548ea20ced tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:46.961534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00eaedf1-9da1-42be-b1a7-71548ea20ced tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:46.962380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00eaedf1-9da1-42be-b1a7-71548ea20ced tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:46.963397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00eaedf1-9da1-42be-b1a7-71548ea20ced tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:46.995122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:47.317724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-00eaedf1-9da1-42be-b1a7-71548ea20ced tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:47.330393 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-00eaedf1-9da1-42be-b1a7-71548ea20ced tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1333 microversion: 2.1 time: 0.402370 May 28 21:09:47.340692 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1051/2071] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:46 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1333 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:47.346736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f7d20f3c-b144-43ed-923b-ca78f860567c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1293751971"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:47.347587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f7d20f3c-b144-43ed-923b-ca78f860567c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:47.354694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7d20f3c-b144-43ed-923b-ca78f860567c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:47.355498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7d20f3c-b144-43ed-923b-ca78f860567c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:47.356579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7d20f3c-b144-43ed-923b-ca78f860567c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:47.357266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7d20f3c-b144-43ed-923b-ca78f860567c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:48.350717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:48.384592 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.network.security_group_api [None req-f7d20f3c-b144-43ed-923b-ca78f860567c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Adding security group 707b92bb-d209-4935-bb5d-13bc7ebe65fd to port a0bdfb08-cf00-44f9-b10c-e524cc386207 May 28 21:09:50.008972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG neutronclient.v2_0.client [None req-42b72aac-a89d-4517-a102-b77f008c39f6 tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 764cf7f9-5dd4-47fb-a57f-c570f1234406 does not exist", "detail": ""}} {{(pid=143129) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:09:50.009700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.security_group_api [None req-42b72aac-a89d-4517-a102-b77f008c39f6 tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] Neutron security group 764cf7f9-5dd4-47fb-a57f-c570f1234406 not found {{(pid=143129) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:09:50.010261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.compute.security_groups [None req-42b72aac-a89d-4517-a102-b77f008c39f6 tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] Security Group ID 764cf7f9-5dd4-47fb-a57f-c570f1234406 does not exist {{(pid=143129) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} May 28 21:09:50.166444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG neutronclient.v2_0.client [None req-42b72aac-a89d-4517-a102-b77f008c39f6 tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 764cf7f9-5dd4-47fb-a57f-c570f1234406 does not exist", "detail": ""}} {{(pid=143129) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:09:50.167710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.security_group_api [None req-42b72aac-a89d-4517-a102-b77f008c39f6 tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] Neutron security group 764cf7f9-5dd4-47fb-a57f-c570f1234406 not found {{(pid=143129) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:09:50.168437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.compute.security_groups [None req-42b72aac-a89d-4517-a102-b77f008c39f6 tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] Security Group ID 764cf7f9-5dd4-47fb-a57f-c570f1234406 does not exist {{(pid=143129) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} May 28 21:09:50.209948 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f7d20f3c-b144-43ed-923b-ca78f860567c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d/action" status: 202 len: 0 microversion: 2.1 time: 2.865290 May 28 21:09:50.209948 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1052/2072] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:09:47 2022] POST /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d/action => generated 0 bytes in 2867 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:09:50.225689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0f59ee8f-bae7-4ca7-afbc-71b920c09a52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:50.230599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0f59ee8f-bae7-4ca7-afbc-71b920c09a52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] [instance: 94133e8e-365a-46fa-8755-5dc32d37dd83] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:50.244429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f59ee8f-bae7-4ca7-afbc-71b920c09a52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:50.245418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f59ee8f-bae7-4ca7-afbc-71b920c09a52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:50.246836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f59ee8f-bae7-4ca7-afbc-71b920c09a52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:50.248156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f59ee8f-bae7-4ca7-afbc-71b920c09a52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:50.271946 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-0f59ee8f-bae7-4ca7-afbc-71b920c09a52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] HTTP exception thrown: Instance 94133e8e-365a-46fa-8755-5dc32d37dd83 could not be found. May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0f59ee8f-bae7-4ca7-afbc-71b920c09a52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Request method failure captured: May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 HTTP/1.1 May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko5R8_T5eGdX6eZzJm8YrffHhbtGoCRZcU6O2AwDzQIeTZBP6GrzQYtOx4uEO2lPmdRVO666hp641nCiRg0Byat_ttpfQoUeMlQqk_Egahdmg0iZV5JD6pG0wWsheftl5KLHlnpjk6Zqi8-TmeDDfg87lrxkvQ_FWBFzX67a1b65i5M May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 2f5c3054461d4d07861a1685cfeba36a May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-LiveMigrationTest-1347342374 May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f5c3054461d4d07861a1685cfeba36a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f5c3054461d4d07861a1685cfeba36a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f5c3054461d4d07861a1685cfeba36a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f5c3054461d4d07861a1685cfeba36a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-LiveMigrationTest-1347342374 May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 2f5c3054461d4d07861a1685cfeba36a May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-LiveMigrationTest-1347342374 May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-LiveMigrationTest-1347342374-project May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 7b44b524592e4a57a26681767b9c4541 May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-LiveMigrationTest-1347342374-project May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 94133e8e-365a-46fa-8755-5dc32d37dd83 could not be found. May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '94133e8e-365a-46fa-8755-5dc32d37dd83'} May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94133e8e-365a-46fa-8755-5dc32d37dd83 could not be found. May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94133e8e-365a-46fa-8755-5dc32d37dd83 could not be found. May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:50.274825 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:50.288821 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:50.288821 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:50.288821 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:50.288821 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:50.288821 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:50.288821 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94133e8e-365a-46fa-8755-5dc32d37dd83 could not be found. May 28 21:09:50.288821 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:50.288821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0f59ee8f-bae7-4ca7-afbc-71b920c09a52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] Returning 404 to user: Instance 94133e8e-365a-46fa-8755-5dc32d37dd83 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:50.290505 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0f59ee8f-bae7-4ca7-afbc-71b920c09a52 tempest-LiveMigrationTest-1347342374 tempest-LiveMigrationTest-1347342374-project] 10.222.0.33 "GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83" status: 404 len: 111 microversion: 2.1 time: 0.076673 May 28 21:09:50.291307 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1053/2073] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:50 2022] GET /compute/v2.1/servers/94133e8e-365a-46fa-8755-5dc32d37dd83 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:09:50.330386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0aa6d259-efb2-4e6e-b798-6cdfe228ce74 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:50.344637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0aa6d259-efb2-4e6e-b798-6cdfe228ce74 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:50.359767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0aa6d259-efb2-4e6e-b798-6cdfe228ce74 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:50.362641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0aa6d259-efb2-4e6e-b798-6cdfe228ce74 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:50.365927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0aa6d259-efb2-4e6e-b798-6cdfe228ce74 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:50.366656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0aa6d259-efb2-4e6e-b798-6cdfe228ce74 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:50.560355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0aa6d259-efb2-4e6e-b798-6cdfe228ce74 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:50.572051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0aa6d259-efb2-4e6e-b798-6cdfe228ce74 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:50.574862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0aa6d259-efb2-4e6e-b798-6cdfe228ce74 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:50.579901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:50.598720 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0aa6d259-efb2-4e6e-b798-6cdfe228ce74 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1447 microversion: 2.75 time: 0.290585 May 28 21:09:50.617222 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1054/2074] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:50 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1447 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:50.635125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-36cde97d-8fea-4d22-8a9c-3bf6c80a76b6 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d579f15e0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:50.732351 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-36cde97d-8fea-4d22-8a9c-3bf6c80a76b6 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 200 len: 1412 microversion: 2.1 time: 0.113568 May 28 21:09:50.738939 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1055/2075] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:09:50 2022] GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:50.741795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-977915cd-5151-4f8c-884a-c8275904dad8 req-c4142264-986f-4a80-86eb-72ad2b9603e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94133e8e-365a-46fa-8755-5dc32d37dd83", "name": "network-vif-deleted", "tag": "302e794d-9be0-4dec-a52e-1c0380a7606a"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:50.773079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-977915cd-5151-4f8c-884a-c8275904dad8 req-c4142264-986f-4a80-86eb-72ad2b9603e0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:50.776058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-977915cd-5151-4f8c-884a-c8275904dad8 req-c4142264-986f-4a80-86eb-72ad2b9603e0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:50.830011 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-977915cd-5151-4f8c-884a-c8275904dad8 req-c4142264-986f-4a80-86eb-72ad2b9603e0 service nova] Creating event network-vif-deleted:302e794d-9be0-4dec-a52e-1c0380a7606a for instance 94133e8e-365a-46fa-8755-5dc32d37dd83 on nch2-master-1 May 28 21:09:50.861908 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-977915cd-5151-4f8c-884a-c8275904dad8 req-c4142264-986f-4a80-86eb-72ad2b9603e0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110900 May 28 21:09:50.865245 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1056/2076] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:50.885206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2e217b25-d44b-45bd-9c23-7c396b01651a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:50.895516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2e217b25-d44b-45bd-9c23-7c396b01651a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:50.913769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e217b25-d44b-45bd-9c23-7c396b01651a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:50.919093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e217b25-d44b-45bd-9c23-7c396b01651a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:50.929070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e217b25-d44b-45bd-9c23-7c396b01651a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:50.932926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e217b25-d44b-45bd-9c23-7c396b01651a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:51.513438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2e217b25-d44b-45bd-9c23-7c396b01651a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:51.532203 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2e217b25-d44b-45bd-9c23-7c396b01651a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1354 microversion: 2.1 time: 0.663860 May 28 21:09:51.532800 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1057/2077] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:50 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1354 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:51.977518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7011830d-c3c9-4a5d-a241-ff640f9ce4f7 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Action: 'create', calling method: .version_select at 0x7f4d579f1430>, body: {"keypair": {"name": "tempest-keypair-1091687615", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNor/KzOb8SLclOgpEv7l+RzvcwcPzVBHU/ZtSoW2Byits7UKXS30tnhnN6awWKBYmM+AbSPH2Tkq/8HtVZdN9pMPFDUj0Q0UPVPHQGjS2LksjVg/XBDZ/wagi1QQ/t+Lg=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:51.977518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-7011830d-c3c9-4a5d-a241-ff640f9ce4f7 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Getting quotas for project 7e1a1360253a413d8ee275cb1d1fac02. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:09:51.977518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-7011830d-c3c9-4a5d-a241-ff640f9ce4f7 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Getting quotas for user f5df3bc2a59b4d99b81932deac1ece64 and project 7e1a1360253a413d8ee275cb1d1fac02. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:09:52.047304 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7011830d-c3c9-4a5d-a241-ff640f9ce4f7 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.502305 May 28 21:09:52.048367 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1058/2078] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:09:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:52.054336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0981552a-7cc9-426d-a946-f264bb9c7959 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d5779f820>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:52.353817 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-42b72aac-a89d-4517-a102-b77f008c39f6 tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9442 microversion: 2.1 time: 7.223271 May 28 21:09:52.355133 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1021/2079] 10.222.0.33 () {58 vars in 1190 bytes} [Sat May 28 21:09:45 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9442 bytes in 7225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:52.360807 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c255de9f-2ac4-4af6-92d8-5e825c08ee7b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:52.361480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c255de9f-2ac4-4af6-92d8-5e825c08ee7b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:52.383043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c255de9f-2ac4-4af6-92d8-5e825c08ee7b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:52.383752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c255de9f-2ac4-4af6-92d8-5e825c08ee7b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:52.389479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c255de9f-2ac4-4af6-92d8-5e825c08ee7b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:52.389479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c255de9f-2ac4-4af6-92d8-5e825c08ee7b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:52.624348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG neutronclient.v2_0.client [None req-0981552a-7cc9-426d-a946-f264bb9c7959 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 707b92bb-d209-4935-bb5d-13bc7ebe65fd in use.", "detail": ""}} {{(pid=143128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:09:52.625633 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-0981552a-7cc9-426d-a946-f264bb9c7959 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Security Group 707b92bb-d209-4935-bb5d-13bc7ebe65fd in use. May 28 21:09:52.625633 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-52b54641-e27c-4952-b00e-b53ff89c563b'] May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0981552a-7cc9-426d-a946-f264bb9c7959 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-security-groups/707b92bb-d209-4935-bb5d-13bc7ebe65fd HTTP/1.1 May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: exception: Security Group 707b92bb-d209-4935-bb5d-13bc7ebe65fd in use. May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-52b54641-e27c-4952-b00e-b53ff89c563b'] May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '707b92bb-d209-4935-bb5d-13bc7ebe65fd'} May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:09:52.628467 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 707b92bb-d209-4935-bb5d-13bc7ebe65fd in use. May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52b54641-e27c-4952-b00e-b53ff89c563b'] May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 707b92bb-d209-4935-bb5d-13bc7ebe65fd in use. May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52b54641-e27c-4952-b00e-b53ff89c563b'] May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 707b92bb-d209-4935-bb5d-13bc7ebe65fd in use. May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52b54641-e27c-4952-b00e-b53ff89c563b'] May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 707b92bb-d209-4935-bb5d-13bc7ebe65fd in use. May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-52b54641-e27c-4952-b00e-b53ff89c563b'] May 28 21:09:52.632878 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:09:52.638497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0981552a-7cc9-426d-a946-f264bb9c7959 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 400 to user: Security Group 707b92bb-d209-4935-bb5d-13bc7ebe65fd in use. May 28 21:09:52.638497 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-52b54641-e27c-4952-b00e-b53ff89c563b'] {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:09:52.640341 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0981552a-7cc9-426d-a946-f264bb9c7959 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/707b92bb-d209-4935-bb5d-13bc7ebe65fd" status: 400 len: 185 microversion: 2.1 time: 0.590730 May 28 21:09:52.641555 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1059/2080] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:09:52 2022] DELETE /compute/v2.1/os-security-groups/707b92bb-d209-4935-bb5d-13bc7ebe65fd => generated 185 bytes in 592 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:09:52.658864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c255de9f-2ac4-4af6-92d8-5e825c08ee7b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:52.661414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:52.667211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c255de9f-2ac4-4af6-92d8-5e825c08ee7b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:52.669748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-90437e2b-64a7-4c8b-a550-a3c583ae0443 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d579a2b80>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:52.678511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c255de9f-2ac4-4af6-92d8-5e825c08ee7b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:52.703744 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c255de9f-2ac4-4af6-92d8-5e825c08ee7b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1447 microversion: 2.75 time: 0.347495 May 28 21:09:52.717010 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1022/2081] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:52 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1447 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:52.737579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c2ffdaed-5e23-478a-848d-5ee8b49406fe tempest-SecurityGroupsTestAdminJSON-158190521 tempest-SecurityGroupsTestAdminJSON-158190521-project] Calling method '.version_select at 0x7f4d57875040>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:52.769928 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-90437e2b-64a7-4c8b-a550-a3c583ae0443 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 200 len: 1412 microversion: 2.1 time: 0.126811 May 28 21:09:52.775647 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1060/2082] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:09:52 2022] GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 1412 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:52.780579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-41a64129-4504-419b-8687-e8cf6588b52b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:52.785433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-41a64129-4504-419b-8687-e8cf6588b52b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:52.802017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41a64129-4504-419b-8687-e8cf6588b52b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:52.802639 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41a64129-4504-419b-8687-e8cf6588b52b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:52.803540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41a64129-4504-419b-8687-e8cf6588b52b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:52.804080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41a64129-4504-419b-8687-e8cf6588b52b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:53.315138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-41a64129-4504-419b-8687-e8cf6588b52b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:53.332546 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-41a64129-4504-419b-8687-e8cf6588b52b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1354 microversion: 2.1 time: 0.558198 May 28 21:09:53.333145 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1061/2083] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:52 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1354 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:53.347646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b7c68127-6ebb-430c-916e-2b3d39ecfb31 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:53.348155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b7c68127-6ebb-430c-916e-2b3d39ecfb31 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:53.368564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7c68127-6ebb-430c-916e-2b3d39ecfb31 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:53.369879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7c68127-6ebb-430c-916e-2b3d39ecfb31 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:53.371304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7c68127-6ebb-430c-916e-2b3d39ecfb31 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:53.372015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7c68127-6ebb-430c-916e-2b3d39ecfb31 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:53.427757 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b7c68127-6ebb-430c-916e-2b3d39ecfb31 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:09:53.768103 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c2ffdaed-5e23-478a-848d-5ee8b49406fe tempest-SecurityGroupsTestAdminJSON-158190521 tempest-SecurityGroupsTestAdminJSON-158190521-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 1.049704 May 28 21:09:53.768695 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1023/2084] 10.222.0.33 () {58 vars in 1190 bytes} [Sat May 28 21:09:52 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:53.773544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-6ce6c8cf-0c6d-48a2-abf2-c8a0eb044938 req-71e2687b-0072-4d91-b06a-b8d05d9a143f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de9b4edf-f109-4ba9-b543-115b9e68ab8d", "tag": "a0bdfb08-cf00-44f9-b10c-e524cc386207"}, {"name": "network-changed", "server_uuid": "be14fefc-6d15-401c-b5e6-e5edfd7cb9ed", "tag": "a80949ec-2a71-4ba2-b4f6-bff628a09248"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:53.786432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6ce6c8cf-0c6d-48a2-abf2-c8a0eb044938 req-71e2687b-0072-4d91-b06a-b8d05d9a143f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:53.786887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6ce6c8cf-0c6d-48a2-abf2-c8a0eb044938 req-71e2687b-0072-4d91-b06a-b8d05d9a143f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:53.803185 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-6ce6c8cf-0c6d-48a2-abf2-c8a0eb044938 req-71e2687b-0072-4d91-b06a-b8d05d9a143f service nova] Creating event network-changed:a0bdfb08-cf00-44f9-b10c-e524cc386207 for instance de9b4edf-f109-4ba9-b543-115b9e68ab8d on nch1-master-1 May 28 21:09:53.803622 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-6ce6c8cf-0c6d-48a2-abf2-c8a0eb044938 req-71e2687b-0072-4d91-b06a-b8d05d9a143f service nova] Creating event network-changed:a80949ec-2a71-4ba2-b4f6-bff628a09248 for instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed on nch2-master-1 May 28 21:09:53.819820 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-6ce6c8cf-0c6d-48a2-abf2-c8a0eb044938 req-71e2687b-0072-4d91-b06a-b8d05d9a143f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049695 May 28 21:09:53.820822 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1024/2085] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:53.829511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e43cdd0a-2315-412f-95c8-40419bff7715 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:53.830487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e43cdd0a-2315-412f-95c8-40419bff7715 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:53.839890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e43cdd0a-2315-412f-95c8-40419bff7715 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:53.840419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e43cdd0a-2315-412f-95c8-40419bff7715 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:53.841237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e43cdd0a-2315-412f-95c8-40419bff7715 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:53.842003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e43cdd0a-2315-412f-95c8-40419bff7715 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:53.842133 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b7c68127-6ebb-430c-916e-2b3d39ecfb31 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 204 len: 0 microversion: 2.1 time: 0.507574 May 28 21:09:53.845013 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1062/2086] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:09:53 2022] DELETE /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:09:53.854307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0533302d-50e0-4d72-8f31-88ec223ae05c tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] Calling method '.version_select at 0x7f4d578781f0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:54.140822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e43cdd0a-2315-412f-95c8-40419bff7715 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:54.154488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e43cdd0a-2315-412f-95c8-40419bff7715 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:54.158424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e43cdd0a-2315-412f-95c8-40419bff7715 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:54.167253 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e43cdd0a-2315-412f-95c8-40419bff7715 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1447 microversion: 2.75 time: 0.343593 May 28 21:09:54.168017 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1025/2087] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:53 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1447 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:54.173625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-25d0df86-eceb-45c8-9eaf-83457c75618a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d57875f70>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:54.239606 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-25d0df86-eceb-45c8-9eaf-83457c75618a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 200 len: 1421 microversion: 2.1 time: 0.070423 May 28 21:09:54.240697 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1026/2088] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:09:54 2022] GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 1421 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:54.251560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cab9bf92-6a03-4788-8a05-fd4eab4adb86 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:54.252619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cab9bf92-6a03-4788-8a05-fd4eab4adb86 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:54.277100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cab9bf92-6a03-4788-8a05-fd4eab4adb86 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:54.280307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cab9bf92-6a03-4788-8a05-fd4eab4adb86 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:54.280307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cab9bf92-6a03-4788-8a05-fd4eab4adb86 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:54.280307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cab9bf92-6a03-4788-8a05-fd4eab4adb86 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:55.405551 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0533302d-50e0-4d72-8f31-88ec223ae05c tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/fea77245-9ea0-4d2f-9260-362121a20398" status: 202 len: 0 microversion: 2.1 time: 1.556053 May 28 21:09:55.405551 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1063/2089] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:09:53 2022] DELETE /compute/v2.1/os-security-groups/fea77245-9ea0-4d2f-9260-362121a20398 => generated 0 bytes in 1558 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:09:55.412635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2ac23271-59c1-4622-8c15-1a5185cc1b0e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d69c50160>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:55.502446 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2ac23271-59c1-4622-8c15-1a5185cc1b0e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 200 len: 1421 microversion: 2.1 time: 0.097654 May 28 21:09:55.503315 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1064/2090] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:09:55 2022] GET /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 1421 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:55.530736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5290af2a-581e-4d12-9c6e-eb607645c700 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:55.533972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5290af2a-581e-4d12-9c6e-eb607645c700 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:55.542455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5290af2a-581e-4d12-9c6e-eb607645c700 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:55.543292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5290af2a-581e-4d12-9c6e-eb607645c700 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:55.544513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5290af2a-581e-4d12-9c6e-eb607645c700 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:55.545327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5290af2a-581e-4d12-9c6e-eb607645c700 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:55.792502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cab9bf92-6a03-4788-8a05-fd4eab4adb86 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:55.802634 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cab9bf92-6a03-4788-8a05-fd4eab4adb86 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1646 microversion: 2.1 time: 1.560727 May 28 21:09:55.803750 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1027/2091] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:54 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1646 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:55.818063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1cc6c743-9321-4fe8-a3d0-7eca5d2fa3c6 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:55.818864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1cc6c743-9321-4fe8-a3d0-7eca5d2fa3c6 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:55.828228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1cc6c743-9321-4fe8-a3d0-7eca5d2fa3c6 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:55.828692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1cc6c743-9321-4fe8-a3d0-7eca5d2fa3c6 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:55.829482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1cc6c743-9321-4fe8-a3d0-7eca5d2fa3c6 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:55.829950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1cc6c743-9321-4fe8-a3d0-7eca5d2fa3c6 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:56.021312 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1cc6c743-9321-4fe8-a3d0-7eca5d2fa3c6 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:56.039066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1cc6c743-9321-4fe8-a3d0-7eca5d2fa3c6 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:56.041121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1cc6c743-9321-4fe8-a3d0-7eca5d2fa3c6 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:56.054535 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1cc6c743-9321-4fe8-a3d0-7eca5d2fa3c6 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1447 microversion: 2.75 time: 0.249425 May 28 21:09:56.068512 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1028/2092] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:55 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1447 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:56.077067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fd12ffe2-e299-4fab-b696-363423c24d84 tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] Calling method '.version_select at 0x7f4d577428b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:56.090019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5290af2a-581e-4d12-9c6e-eb607645c700 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:56.108565 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5290af2a-581e-4d12-9c6e-eb607645c700 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1354 microversion: 2.1 time: 0.601805 May 28 21:09:56.111006 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1065/2093] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:55 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1354 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:56.117344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8435d44c-0009-44a8-9b2b-18052d817cca tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d579dc1f0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:57.301872 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fd12ffe2-e299-4fab-b696-363423c24d84 tempest-SecurityGroupsTestAdminJSON-143694247 tempest-SecurityGroupsTestAdminJSON-143694247-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/cbb6835b-13bd-4af5-a8e2-c2e0eddc2466" status: 202 len: 0 microversion: 2.1 time: 1.231710 May 28 21:09:57.302474 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1029/2094] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:09:56 2022] DELETE /compute/v2.1/os-security-groups/cbb6835b-13bd-4af5-a8e2-c2e0eddc2466 => generated 0 bytes in 1233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:09:57.313376 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-818a04c9-1b67-48c0-89ea-8a85ec1416a2 req-a0f73a18-dd9c-41c1-8fad-ae984e0d51ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be14fefc-6d15-401c-b5e6-e5edfd7cb9ed", "tag": "6ecc2ca4-9af3-42ba-ac9f-9102e285c0c2"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:57.336068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-818a04c9-1b67-48c0-89ea-8a85ec1416a2 req-a0f73a18-dd9c-41c1-8fad-ae984e0d51ab service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:57.336911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-818a04c9-1b67-48c0-89ea-8a85ec1416a2 req-a0f73a18-dd9c-41c1-8fad-ae984e0d51ab service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:57.350985 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-818a04c9-1b67-48c0-89ea-8a85ec1416a2 req-a0f73a18-dd9c-41c1-8fad-ae984e0d51ab service nova] Creating event network-changed:6ecc2ca4-9af3-42ba-ac9f-9102e285c0c2 for instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed on nch2-master-1 May 28 21:09:57.356763 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-818a04c9-1b67-48c0-89ea-8a85ec1416a2 req-a0f73a18-dd9c-41c1-8fad-ae984e0d51ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049336 May 28 21:09:57.358444 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1030/2095] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:09:57.378254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-42a576b0-e309-46d9-80d6-0d76d4e9a382 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:57.380049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-42a576b0-e309-46d9-80d6-0d76d4e9a382 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:57.387101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42a576b0-e309-46d9-80d6-0d76d4e9a382 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:57.389659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42a576b0-e309-46d9-80d6-0d76d4e9a382 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:57.391015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42a576b0-e309-46d9-80d6-0d76d4e9a382 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:57.391722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42a576b0-e309-46d9-80d6-0d76d4e9a382 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:57.527903 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8435d44c-0009-44a8-9b2b-18052d817cca tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 204 len: 0 microversion: 2.1 time: 1.415441 May 28 21:09:57.528493 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1066/2096] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:56 2022] DELETE /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 0 bytes in 1417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:09:57.533350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-11e129a1-4626-4742-b1bd-96a828896833 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:57.534074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-11e129a1-4626-4742-b1bd-96a828896833 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:57.546118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11e129a1-4626-4742-b1bd-96a828896833 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:57.546581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11e129a1-4626-4742-b1bd-96a828896833 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:57.551621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11e129a1-4626-4742-b1bd-96a828896833 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:57.556640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11e129a1-4626-4742-b1bd-96a828896833 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:57.696890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-42a576b0-e309-46d9-80d6-0d76d4e9a382 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:57.714441 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-42a576b0-e309-46d9-80d6-0d76d4e9a382 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1466 microversion: 2.1 time: 0.354609 May 28 21:09:57.715043 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1031/2097] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:57 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1466 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:57.728866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3a5f4b8e-aedd-4d45-87ec-79bbc3bb33a6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:57.729817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3a5f4b8e-aedd-4d45-87ec-79bbc3bb33a6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:57.736905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a5f4b8e-aedd-4d45-87ec-79bbc3bb33a6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:57.737798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a5f4b8e-aedd-4d45-87ec-79bbc3bb33a6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:57.739184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a5f4b8e-aedd-4d45-87ec-79bbc3bb33a6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:57.739184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a5f4b8e-aedd-4d45-87ec-79bbc3bb33a6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:57.886242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-11e129a1-4626-4742-b1bd-96a828896833 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:57.897799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-11e129a1-4626-4742-b1bd-96a828896833 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:57.904145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-11e129a1-4626-4742-b1bd-96a828896833 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:57.919208 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-11e129a1-4626-4742-b1bd-96a828896833 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1447 microversion: 2.75 time: 0.389618 May 28 21:09:57.919809 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1067/2098] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:57 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1447 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:57.937330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8637e973-62d2-4aec-bbac-a82e50b1a6aa tempest-SecurityGroupsTestAdminJSON-158190521 tempest-SecurityGroupsTestAdminJSON-158190521-project] Calling method '.version_select at 0x7f4d57879820>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:58.296513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3a5f4b8e-aedd-4d45-87ec-79bbc3bb33a6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:58.309969 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3a5f4b8e-aedd-4d45-87ec-79bbc3bb33a6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1354 microversion: 2.1 time: 0.584487 May 28 21:09:58.310591 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1032/2099] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:57 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1354 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:58.318285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2ac5126a-3cb0-450d-8879-173a6b025aaa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:58.318993 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2ac5126a-3cb0-450d-8879-173a6b025aaa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:58.330231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ac5126a-3cb0-450d-8879-173a6b025aaa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:58.331067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ac5126a-3cb0-450d-8879-173a6b025aaa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:58.333156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ac5126a-3cb0-450d-8879-173a6b025aaa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:58.334558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ac5126a-3cb0-450d-8879-173a6b025aaa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:58.397055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2ac5126a-3cb0-450d-8879-173a6b025aaa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:09:58.821656 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2ac5126a-3cb0-450d-8879-173a6b025aaa tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 204 len: 0 microversion: 2.1 time: 0.508359 May 28 21:09:58.826523 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1033/2100] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:09:58 2022] DELETE /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:09:58.843669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d81dd518-af86-4b86-a44e-c161a49ac321 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:58.844341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d81dd518-af86-4b86-a44e-c161a49ac321 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:58.878960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d81dd518-af86-4b86-a44e-c161a49ac321 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:58.879429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d81dd518-af86-4b86-a44e-c161a49ac321 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:58.880233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d81dd518-af86-4b86-a44e-c161a49ac321 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:58.880688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d81dd518-af86-4b86-a44e-c161a49ac321 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:58.911660 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8637e973-62d2-4aec-bbac-a82e50b1a6aa tempest-SecurityGroupsTestAdminJSON-158190521 tempest-SecurityGroupsTestAdminJSON-158190521-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/c50de3fd-9d57-41df-ba6a-da2a1f346b25" status: 202 len: 0 microversion: 2.1 time: 0.978227 May 28 21:09:58.912257 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1068/2101] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:09:57 2022] DELETE /compute/v2.1/os-security-groups/c50de3fd-9d57-41df-ba6a-da2a1f346b25 => generated 0 bytes in 992 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:09:58.921296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c027eef-5f54-4311-b52b-2c86aa5a6007 tempest-SecurityGroupsTestAdminJSON-158190521 tempest-SecurityGroupsTestAdminJSON-158190521-project] Calling method '.version_select at 0x7f4d579f18b0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:58.991544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d81dd518-af86-4b86-a44e-c161a49ac321 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:58.995068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d81dd518-af86-4b86-a44e-c161a49ac321 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:58.999309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-d81dd518-af86-4b86-a44e-c161a49ac321 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lazy-loading 'fault' on Instance uuid de9b4edf-f109-4ba9-b543-115b9e68ab8d {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:09:59.186862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d81dd518-af86-4b86-a44e-c161a49ac321 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:59.195521 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d81dd518-af86-4b86-a44e-c161a49ac321 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 200 len: 1304 microversion: 2.1 time: 0.367173 May 28 21:09:59.227877 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1034/2102] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:58 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 1304 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:09:59.237596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-130ba89d-b50a-4abb-b285-eff888456321 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:59.238322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-130ba89d-b50a-4abb-b285-eff888456321 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:59.247513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-130ba89d-b50a-4abb-b285-eff888456321 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:59.248101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-130ba89d-b50a-4abb-b285-eff888456321 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:59.249058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-130ba89d-b50a-4abb-b285-eff888456321 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:59.250484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-130ba89d-b50a-4abb-b285-eff888456321 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:59.376485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-130ba89d-b50a-4abb-b285-eff888456321 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:59.397262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-130ba89d-b50a-4abb-b285-eff888456321 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:59.408067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-130ba89d-b50a-4abb-b285-eff888456321 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:09:59.409413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:09:59.416258 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-130ba89d-b50a-4abb-b285-eff888456321 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1447 microversion: 2.75 time: 0.186082 May 28 21:09:59.418143 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1035/2103] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:09:59 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1447 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:09:59.435640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-533270193", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "1d1e95b4-31c7-4a87-a450-6b766dbdbce1"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:09:59.534371 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] validate_networks() for [('1d1e95b4-31c7-4a87-a450-6b766dbdbce1', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:09:59.628465 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3c027eef-5f54-4311-b52b-2c86aa5a6007 tempest-SecurityGroupsTestAdminJSON-158190521 tempest-SecurityGroupsTestAdminJSON-158190521-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e957be8c-b208-4b5c-884a-47368d6cf8af" status: 202 len: 0 microversion: 2.1 time: 0.711484 May 28 21:09:59.629429 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1069/2104] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:09:58 2022] DELETE /compute/v2.1/os-security-groups/e957be8c-b208-4b5c-884a-47368d6cf8af => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:09:59.649920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bb4dcc02-088b-4fe4-925b-f9c15453c8cf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:09:59.663507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bb4dcc02-088b-4fe4-925b-f9c15453c8cf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:09:59.682997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb4dcc02-088b-4fe4-925b-f9c15453c8cf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:59.685001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb4dcc02-088b-4fe4-925b-f9c15453c8cf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:09:59.686864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb4dcc02-088b-4fe4-925b-f9c15453c8cf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:09:59.687322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb4dcc02-088b-4fe4-925b-f9c15453c8cf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:00.865336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bb4dcc02-088b-4fe4-925b-f9c15453c8cf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:00.879052 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bb4dcc02-088b-4fe4-925b-f9c15453c8cf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1354 microversion: 2.1 time: 1.247439 May 28 21:10:00.888496 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1070/2105] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:09:59 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1354 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:00.896355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-ea893bc4-40a7-404d-9ab2-2664cf3a88c9 req-26aba9c1-df78-499a-bef4-8afb8d46f6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de9b4edf-f109-4ba9-b543-115b9e68ab8d", "name": "network-vif-deleted", "tag": "a0bdfb08-cf00-44f9-b10c-e524cc386207"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:00.915834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ea893bc4-40a7-404d-9ab2-2664cf3a88c9 req-26aba9c1-df78-499a-bef4-8afb8d46f6d7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:00.916445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ea893bc4-40a7-404d-9ab2-2664cf3a88c9 req-26aba9c1-df78-499a-bef4-8afb8d46f6d7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:00.929090 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-ea893bc4-40a7-404d-9ab2-2664cf3a88c9 req-26aba9c1-df78-499a-bef4-8afb8d46f6d7 service nova] Creating event network-vif-deleted:a0bdfb08-cf00-44f9-b10c-e524cc386207 for instance de9b4edf-f109-4ba9-b543-115b9e68ab8d on nch1-master-1 May 28 21:10:00.936467 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-ea893bc4-40a7-404d-9ab2-2664cf3a88c9 req-26aba9c1-df78-499a-bef4-8afb8d46f6d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054576 May 28 21:10:00.937252 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1071/2106] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:00.950762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-fef84ea4-2ab7-4249-8f38-393865bdb570 req-fcacddbf-d6ea-483d-b3ba-b8c0e8190668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92d5e5e3-2837-4e11-9b7f-636490b41a93", "name": "network-vif-unplugged", "status": "completed", "tag": "946cf242-8860-4934-a2dc-34a9739fa767"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:00.961219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-fef84ea4-2ab7-4249-8f38-393865bdb570 req-fcacddbf-d6ea-483d-b3ba-b8c0e8190668 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:00.961498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-fef84ea4-2ab7-4249-8f38-393865bdb570 req-fcacddbf-d6ea-483d-b3ba-b8c0e8190668 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:00.999753 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-fef84ea4-2ab7-4249-8f38-393865bdb570 req-fcacddbf-d6ea-483d-b3ba-b8c0e8190668 service nova] Creating event network-vif-unplugged:946cf242-8860-4934-a2dc-34a9739fa767 for instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 on nch2-master-1 May 28 21:10:01.006447 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-fef84ea4-2ab7-4249-8f38-393865bdb570 req-fcacddbf-d6ea-483d-b3ba-b8c0e8190668 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067486 May 28 21:10:01.009442 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1072/2107] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:01.021082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4e8a02a6-fcf3-4a29-8840-e7a85abb7825 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:01.026962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4e8a02a6-fcf3-4a29-8840-e7a85abb7825 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:01.039272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e8a02a6-fcf3-4a29-8840-e7a85abb7825 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:01.040025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e8a02a6-fcf3-4a29-8840-e7a85abb7825 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:01.041051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e8a02a6-fcf3-4a29-8840-e7a85abb7825 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:01.041878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e8a02a6-fcf3-4a29-8840-e7a85abb7825 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:01.093075 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-4e8a02a6-fcf3-4a29-8840-e7a85abb7825 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4e8a02a6-fcf3-4a29-8840-e7a85abb7825 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d HTTP/1.1 May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'de9b4edf-f109-4ba9-b543-115b9e68ab8d'} May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:01.099318 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:01.106253 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:01.106253 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:01.106253 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:01.106253 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:01.106253 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:01.106253 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. May 28 21:10:01.106253 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:01.106253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4e8a02a6-fcf3-4a29-8840-e7a85abb7825 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 404 to user: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:01.106253 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4e8a02a6-fcf3-4a29-8840-e7a85abb7825 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 404 len: 111 microversion: 2.1 time: 0.092165 May 28 21:10:01.107944 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1073/2108] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:01 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:10:01.113195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8f327399-cb18-420b-a32c-52335f9807fa tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:01.113963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8f327399-cb18-420b-a32c-52335f9807fa tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:01.122092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f327399-cb18-420b-a32c-52335f9807fa tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:01.122937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f327399-cb18-420b-a32c-52335f9807fa tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:01.124517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f327399-cb18-420b-a32c-52335f9807fa tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:01.125168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f327399-cb18-420b-a32c-52335f9807fa tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:01.276857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8f327399-cb18-420b-a32c-52335f9807fa tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:01.294450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8f327399-cb18-420b-a32c-52335f9807fa tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:01.297053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8f327399-cb18-420b-a32c-52335f9807fa tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:01.347492 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8f327399-cb18-420b-a32c-52335f9807fa tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1447 microversion: 2.75 time: 0.236951 May 28 21:10:01.352723 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1074/2109] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:01 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1447 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:01.370936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1992729157", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d78baffa-f3b1-45ab-921f-b0b4c6fb6477"}], "security_groups": [{"name": "tempest-securitygroup--1969681444"}], "key_name": "tempest-keypair-1091687615", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:01.715239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] validate_networks() for [('d78baffa-f3b1-45ab-921f-b0b4c6fb6477', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:10:01.731134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:10:01.731696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:10:01.732059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:10:01.732473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:10:01.733551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:10:01.749420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:01.751026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:01.752845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:01.753763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:01.781299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Getting quotas for project 158c1665476643cda0976e68ab5e595a. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:10:01.787761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Getting quotas for user 04e5b86f94914df085b76e0d89b2230e and project 158c1665476643cda0976e68ab5e595a. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:10:01.806757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:10:01.815056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:10:01.879859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:01.979391 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4d6f0488-3105-4a91-88f7-7b6ad9ab2856 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.560143 May 28 21:10:01.980676 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1036/2110] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:09:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:10:01.987631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-36c171be-b8fa-4857-a18e-2f2f7012f6f3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d577423a0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:03.021195 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-36c171be-b8fa-4857-a18e-2f2f7012f6f3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e5884834-9505-4eb7-beba-b3bfc7665b47" status: 202 len: 0 microversion: 2.1 time: 1.039183 May 28 21:10:03.028310 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1037/2111] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:10:01 2022] DELETE /compute/v2.1/os-security-groups/e5884834-9505-4eb7-beba-b3bfc7665b47 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:10:03.186644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Getting quotas for project 7e1a1360253a413d8ee275cb1d1fac02. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:10:03.201930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Getting quotas for user f5df3bc2a59b4d99b81932deac1ece64 and project 7e1a1360253a413d8ee275cb1d1fac02. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:10:03.220566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:10:03.221014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:10:03.221827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:10:03.222492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:10:03.223214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:10:03.261875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:03.264570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:03.265607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:03.266275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:03.295049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Getting quotas for project 7e1a1360253a413d8ee275cb1d1fac02. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:10:03.303562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Getting quotas for user f5df3bc2a59b4d99b81932deac1ece64 and project 7e1a1360253a413d8ee275cb1d1fac02. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:10:03.350472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:10:03.355074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:10:03.535668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-504310154", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "a3273f3e-6cca-4a7f-8661-69d984f551ff"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:03.668033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] validate_networks() for [('a3273f3e-6cca-4a7f-8661-69d984f551ff', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:10:03.673735 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aac72f9f-0781-48f5-afb9-61a4c68a2cd2 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.318780 May 28 21:10:03.682815 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1075/2112] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:10:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 2330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:10:03.698509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9079b270-6d17-4b54-a93a-a8625a9e3b54 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:03.698509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9079b270-6d17-4b54-a93a-a8625a9e3b54 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:03.726019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9079b270-6d17-4b54-a93a-a8625a9e3b54 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:03.726019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9079b270-6d17-4b54-a93a-a8625a9e3b54 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:03.726676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9079b270-6d17-4b54-a93a-a8625a9e3b54 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:03.727125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9079b270-6d17-4b54-a93a-a8625a9e3b54 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:03.795955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:04.589651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9079b270-6d17-4b54-a93a-a8625a9e3b54 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:04.603214 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9079b270-6d17-4b54-a93a-a8625a9e3b54 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1354 microversion: 2.1 time: 0.919274 May 28 21:10:04.604397 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1076/2113] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:03 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1354 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:04.617917 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-89dc3433-10d1-4d2e-a451-f8734837b752 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:04.618897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-89dc3433-10d1-4d2e-a451-f8734837b752 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:04.630061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89dc3433-10d1-4d2e-a451-f8734837b752 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:04.630805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89dc3433-10d1-4d2e-a451-f8734837b752 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:04.643532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89dc3433-10d1-4d2e-a451-f8734837b752 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:04.643532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89dc3433-10d1-4d2e-a451-f8734837b752 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:04.764685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89dc3433-10d1-4d2e-a451-f8734837b752 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:04.775062 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-89dc3433-10d1-4d2e-a451-f8734837b752 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293" status: 200 len: 1259 microversion: 2.1 time: 0.169352 May 28 21:10:04.786855 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1077/2114] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:04 2022] GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:04.792747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4489b48d-3ae0-4e6b-b8d4-23a6f93b68a0 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:04.793620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4489b48d-3ae0-4e6b-b8d4-23a6f93b68a0 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:04.801706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4489b48d-3ae0-4e6b-b8d4-23a6f93b68a0 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:04.814679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4489b48d-3ae0-4e6b-b8d4-23a6f93b68a0 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:04.815901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4489b48d-3ae0-4e6b-b8d4-23a6f93b68a0 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:04.816554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4489b48d-3ae0-4e6b-b8d4-23a6f93b68a0 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:04.951609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4489b48d-3ae0-4e6b-b8d4-23a6f93b68a0 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:04.971438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4489b48d-3ae0-4e6b-b8d4-23a6f93b68a0 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:04.974266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4489b48d-3ae0-4e6b-b8d4-23a6f93b68a0 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:04.980413 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4489b48d-3ae0-4e6b-b8d4-23a6f93b68a0 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1438 microversion: 2.75 time: 0.191964 May 28 21:10:04.984057 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1078/2115] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:04 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1438 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:05.000498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-0ea59e79-f1bf-495d-899b-0652ab4bbf53 req-922e684b-e6f3-4a98-bf0f-16a6ad2bd9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be14fefc-6d15-401c-b5e6-e5edfd7cb9ed", "tag": "b8cae7c2-0fcc-4265-9208-066781bc94b7"}, {"server_uuid": "92d5e5e3-2837-4e11-9b7f-636490b41a93", "name": "network-vif-deleted", "tag": "946cf242-8860-4934-a2dc-34a9739fa767"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:05.019597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0ea59e79-f1bf-495d-899b-0652ab4bbf53 req-922e684b-e6f3-4a98-bf0f-16a6ad2bd9f7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:05.025938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0ea59e79-f1bf-495d-899b-0652ab4bbf53 req-922e684b-e6f3-4a98-bf0f-16a6ad2bd9f7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:05.056532 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-0ea59e79-f1bf-495d-899b-0652ab4bbf53 req-922e684b-e6f3-4a98-bf0f-16a6ad2bd9f7 service nova] Creating event network-changed:b8cae7c2-0fcc-4265-9208-066781bc94b7 for instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed on nch2-master-1 May 28 21:10:05.058455 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-0ea59e79-f1bf-495d-899b-0652ab4bbf53 req-922e684b-e6f3-4a98-bf0f-16a6ad2bd9f7 service nova] Creating event network-vif-deleted:946cf242-8860-4934-a2dc-34a9739fa767 for instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 on nch2-master-1 May 28 21:10:05.081491 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-0ea59e79-f1bf-495d-899b-0652ab4bbf53 req-922e684b-e6f3-4a98-bf0f-16a6ad2bd9f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.092927 May 28 21:10:05.084248 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1079/2116] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:05.092082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-37205e85-2d86-4e51-885b-938f3eb8f9e8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d578a8790>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:05.589374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:10:05.590040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:10:05.590691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:10:05.591581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:10:05.591581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:10:05.611649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:05.612960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:05.636847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:05.638571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:05.688641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Getting quotas for project 3450ad991a3943e3a4c4233551a42729. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:10:05.696374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Getting quotas for user 4112534978ba4622b0fbbb9a92791876 and project 3450ad991a3943e3a4c4233551a42729. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:10:05.724239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:10:05.729568 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:10:05.875841 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ab85a6f9-3e08-4d5a-859b-93a82a21ae66 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.846283 May 28 21:10:05.877179 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1038/2117] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:10:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:10:05.883805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cbbe7f56-ee66-43db-a645-7ee17e219c85 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:05.884720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cbbe7f56-ee66-43db-a645-7ee17e219c85 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:05.896850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cbbe7f56-ee66-43db-a645-7ee17e219c85 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:05.902945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cbbe7f56-ee66-43db-a645-7ee17e219c85 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:05.905307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cbbe7f56-ee66-43db-a645-7ee17e219c85 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:05.905786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cbbe7f56-ee66-43db-a645-7ee17e219c85 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:06.040987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cbbe7f56-ee66-43db-a645-7ee17e219c85 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:06.058966 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-37205e85-2d86-4e51-885b-938f3eb8f9e8 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/707b92bb-d209-4935-bb5d-13bc7ebe65fd" status: 202 len: 0 microversion: 2.1 time: 0.971262 May 28 21:10:06.065077 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1080/2118] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:10:05 2022] DELETE /compute/v2.1/os-security-groups/707b92bb-d209-4935-bb5d-13bc7ebe65fd => generated 0 bytes in 980 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:10:06.122582 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cbbe7f56-ee66-43db-a645-7ee17e219c85 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1282 microversion: 2.1 time: 0.243946 May 28 21:10:06.129723 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1039/2119] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:05 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1282 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:06.445857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0e91cf66-0a33-4a22-8d6c-f08f6d25a270 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:06.447389 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:06.447389 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:10:06.449103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0e91cf66-0a33-4a22-8d6c-f08f6d25a270 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:06.450506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0e91cf66-0a33-4a22-8d6c-f08f6d25a270 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:06.451732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0e91cf66-0a33-4a22-8d6c-f08f6d25a270 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:06.453569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0e91cf66-0a33-4a22-8d6c-f08f6d25a270 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:06.528876 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0e91cf66-0a33-4a22-8d6c-f08f6d25a270 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.397596 May 28 21:10:06.531354 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1040/2120] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:10:06 2022] GET /compute/v2.1/os-services => generated 947 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:06.539148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c12a2031-5e8a-4d16-ac7a-a25f8dff782e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:06.549618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c12a2031-5e8a-4d16-ac7a-a25f8dff782e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:06.563713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:06.565548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c12a2031-5e8a-4d16-ac7a-a25f8dff782e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:06.565721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:06.568767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c12a2031-5e8a-4d16-ac7a-a25f8dff782e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:06.571688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c12a2031-5e8a-4d16-ac7a-a25f8dff782e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:06.572510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c12a2031-5e8a-4d16-ac7a-a25f8dff782e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:06.581766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:06.582273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:06.583090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:06.583542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:06.743220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:10:06.747651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:10:06.747928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:10:06.749804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:10:06.750353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:10:07.045977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c12a2031-5e8a-4d16-ac7a-a25f8dff782e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:07.055670 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c12a2031-5e8a-4d16-ac7a-a25f8dff782e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1354 microversion: 2.1 time: 0.520857 May 28 21:10:07.065855 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1041/2121] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:06 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1354 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:07.065855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4aa27f54-9e5c-41d6-b641-fbba7ffed2a7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:07.065855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4aa27f54-9e5c-41d6-b641-fbba7ffed2a7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:07.104848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4aa27f54-9e5c-41d6-b641-fbba7ffed2a7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:07.105938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4aa27f54-9e5c-41d6-b641-fbba7ffed2a7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:07.106978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4aa27f54-9e5c-41d6-b641-fbba7ffed2a7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:07.109009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4aa27f54-9e5c-41d6-b641-fbba7ffed2a7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:07.133572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:07.156500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:07.157038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:07.158017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:07.158330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:07.287112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4aa27f54-9e5c-41d6-b641-fbba7ffed2a7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:07.306725 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4aa27f54-9e5c-41d6-b641-fbba7ffed2a7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293" status: 200 len: 1265 microversion: 2.1 time: 0.247591 May 28 21:10:07.314531 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1042/2122] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:07 2022] GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:07.326825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a1578d8f-9dc6-4108-ba8f-002a33244655 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:07.328005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a1578d8f-9dc6-4108-ba8f-002a33244655 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:07.564205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a1578d8f-9dc6-4108-ba8f-002a33244655 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4112534978ba4622b0fbbb9a92791876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450ad991a3943e3a4c4233551a42729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:07.570376 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a1578d8f-9dc6-4108-ba8f-002a33244655 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 200 len: 1231 microversion: 2.1 time: 0.253999 May 28 21:10:07.572235 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1043/2123] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:07 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 1231 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:07.586925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ade4995c-4e8d-4b5a-a725-442c10f0fd83 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'create', calling method: .version_select at 0x7f4d577428b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1770300626", "description": "tempest-description-312068995"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:07.606707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:07.660201 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-90bfc660-d685-4660-9900-134855244f0b tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f/action" status: 202 len: 1942 microversion: 2.75 time: 1.593899 May 28 21:10:07.661952 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1081/2124] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:10:06 2022] POST /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f/action => generated 1942 bytes in 1596 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 28 21:10:07.674709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-69e187e1-17bb-48ec-b56e-d9c0b04346b2 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:07.677062 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:07.677062 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:10:07.680372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69e187e1-17bb-48ec-b56e-d9c0b04346b2 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:07.681124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69e187e1-17bb-48ec-b56e-d9c0b04346b2 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:07.683307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69e187e1-17bb-48ec-b56e-d9c0b04346b2 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:07.684092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69e187e1-17bb-48ec-b56e-d9c0b04346b2 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:07.768774 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-69e187e1-17bb-48ec-b56e-d9c0b04346b2 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.104644 May 28 21:10:07.770021 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1082/2125] 10.222.0.33 () {58 vars in 1169 bytes} [Sat May 28 21:10:07 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:07.784816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9e6ad2ac-46f8-47e3-aa3b-3d3adfa5fa00 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:07.784816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9e6ad2ac-46f8-47e3-aa3b-3d3adfa5fa00 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:07.790412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e6ad2ac-46f8-47e3-aa3b-3d3adfa5fa00 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:07.790874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e6ad2ac-46f8-47e3-aa3b-3d3adfa5fa00 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:07.792215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e6ad2ac-46f8-47e3-aa3b-3d3adfa5fa00 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:07.792892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e6ad2ac-46f8-47e3-aa3b-3d3adfa5fa00 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:07.957137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9e6ad2ac-46f8-47e3-aa3b-3d3adfa5fa00 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:07.965350 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9e6ad2ac-46f8-47e3-aa3b-3d3adfa5fa00 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1348 microversion: 2.1 time: 0.193522 May 28 21:10:07.982230 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1083/2126] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:07 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1348 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:07.987845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ada39043-f21e-42cc-a3fb-8d4f2da673ac tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:07.988485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ada39043-f21e-42cc-a3fb-8d4f2da673ac tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:08.016383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ada39043-f21e-42cc-a3fb-8d4f2da673ac tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:08.016852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ada39043-f21e-42cc-a3fb-8d4f2da673ac tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:08.017653 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ada39043-f21e-42cc-a3fb-8d4f2da673ac tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:08.018134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ada39043-f21e-42cc-a3fb-8d4f2da673ac tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:08.153619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-ada39043-f21e-42cc-a3fb-8d4f2da673ac tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:08.201997 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ada39043-f21e-42cc-a3fb-8d4f2da673ac tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1929 microversion: 2.75 time: 0.217190 May 28 21:10:08.204880 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1084/2127] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:07 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1929 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:08.223700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5958d70d-52ec-424c-adc5-b5ca4afded44 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:08.223700 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:08.223700 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:10:08.223700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5958d70d-52ec-424c-adc5-b5ca4afded44 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:08.234305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5958d70d-52ec-424c-adc5-b5ca4afded44 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:08.235390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5958d70d-52ec-424c-adc5-b5ca4afded44 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:08.235897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5958d70d-52ec-424c-adc5-b5ca4afded44 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:08.269967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:08.307863 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5958d70d-52ec-424c-adc5-b5ca4afded44 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.080587 May 28 21:10:08.317964 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1085/2128] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:10:08 2022] GET /compute/v2.1/os-services => generated 947 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:08.330910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-30ab4f7d-b136-428c-a131-d46dd611d672 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:08.333567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-30ab4f7d-b136-428c-a131-d46dd611d672 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:08.362584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30ab4f7d-b136-428c-a131-d46dd611d672 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:08.363071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30ab4f7d-b136-428c-a131-d46dd611d672 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:08.363896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30ab4f7d-b136-428c-a131-d46dd611d672 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:08.364349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30ab4f7d-b136-428c-a131-d46dd611d672 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:08.473815 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ade4995c-4e8d-4b5a-a725-442c10f0fd83 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.900371 May 28 21:10:08.474688 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1044/2129] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:10:07 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:08.488810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6be9ebb6-9bb5-4f0f-8468-17e35d9ca4a5 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:08.494289 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:08.494289 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:10:08.497117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6be9ebb6-9bb5-4f0f-8468-17e35d9ca4a5 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:08.497653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6be9ebb6-9bb5-4f0f-8468-17e35d9ca4a5 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:08.498806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6be9ebb6-9bb5-4f0f-8468-17e35d9ca4a5 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:08.501015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6be9ebb6-9bb5-4f0f-8468-17e35d9ca4a5 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:08.585736 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6be9ebb6-9bb5-4f0f-8468-17e35d9ca4a5 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.100579 May 28 21:10:08.587162 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1045/2130] 10.222.0.33 () {58 vars in 1195 bytes} [Sat May 28 21:10:08 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:10:08.598029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fade7497-1604-4c77-b987-25df9cb7e8d5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:08.599225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fade7497-1604-4c77-b987-25df9cb7e8d5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:08.610017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fade7497-1604-4c77-b987-25df9cb7e8d5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:08.610922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fade7497-1604-4c77-b987-25df9cb7e8d5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:08.611951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fade7497-1604-4c77-b987-25df9cb7e8d5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:08.613970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fade7497-1604-4c77-b987-25df9cb7e8d5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:08.725121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-30ab4f7d-b136-428c-a131-d46dd611d672 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:08.741899 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-30ab4f7d-b136-428c-a131-d46dd611d672 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1354 microversion: 2.1 time: 0.422446 May 28 21:10:08.743273 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1086/2131] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:08 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1354 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:08.750038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cf8aeffa-bde9-4ec6-8b97-b2a26fbb8fa3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Action: 'update', calling method: .version_select at 0x7f4d57879820>, body: {"security_group": {"name": "tempest-sg-hth-1461205656", "description": "tempest-description-hth-1895558642"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:08.904536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fade7497-1604-4c77-b987-25df9cb7e8d5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:08.914134 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fade7497-1604-4c77-b987-25df9cb7e8d5 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293" status: 200 len: 1307 microversion: 2.1 time: 0.325035 May 28 21:10:08.921867 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1046/2132] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:08 2022] GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 => generated 1307 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:08.927254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5175628d-bb1c-428c-bdb9-17d1ee8b815f tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:08.928415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5175628d-bb1c-428c-bdb9-17d1ee8b815f tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:08.939096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5175628d-bb1c-428c-bdb9-17d1ee8b815f tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:08.939982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5175628d-bb1c-428c-bdb9-17d1ee8b815f tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:08.943170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5175628d-bb1c-428c-bdb9-17d1ee8b815f tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:08.943170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5175628d-bb1c-428c-bdb9-17d1ee8b815f tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:08.977084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:09.077156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5175628d-bb1c-428c-bdb9-17d1ee8b815f tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4112534978ba4622b0fbbb9a92791876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450ad991a3943e3a4c4233551a42729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:09.086995 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5175628d-bb1c-428c-bdb9-17d1ee8b815f tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 200 len: 1283 microversion: 2.1 time: 0.163591 May 28 21:10:09.089755 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1047/2133] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:08 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 1283 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:09.096748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2712139f-dbea-4bf2-9148-a6b7202b3916 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:09.099107 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:09.099107 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:10:09.101322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2712139f-dbea-4bf2-9148-a6b7202b3916 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:09.102088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2712139f-dbea-4bf2-9148-a6b7202b3916 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:09.103467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2712139f-dbea-4bf2-9148-a6b7202b3916 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:09.111543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2712139f-dbea-4bf2-9148-a6b7202b3916 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:09.184341 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2712139f-dbea-4bf2-9148-a6b7202b3916 tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.092840 May 28 21:10:09.187725 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1048/2134] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:10:09 2022] GET /compute/v2.1/os-services => generated 947 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:09.197526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-050fd4dd-80e8-4e46-b9bc-c3799f76c56c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:09.197526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-050fd4dd-80e8-4e46-b9bc-c3799f76c56c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:09.203741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-050fd4dd-80e8-4e46-b9bc-c3799f76c56c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:09.204329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-050fd4dd-80e8-4e46-b9bc-c3799f76c56c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:09.205461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-050fd4dd-80e8-4e46-b9bc-c3799f76c56c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:09.207110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-050fd4dd-80e8-4e46-b9bc-c3799f76c56c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:09.825927 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cf8aeffa-bde9-4ec6-8b97-b2a26fbb8fa3 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/776707ed-e0a6-432f-aae0-feaaf0c0bd07" status: 200 len: 218 microversion: 2.1 time: 1.081243 May 28 21:10:09.827200 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1087/2135] 10.222.0.33 () {60 vars in 1289 bytes} [Sat May 28 21:10:08 2022] PUT /compute/v2.1/os-security-groups/776707ed-e0a6-432f-aae0-feaaf0c0bd07 => generated 218 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:09.832088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-642ab262-9b33-4faf-ac3c-0beeb469edde tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:09.835108 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:09.835108 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:10:09.837714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-642ab262-9b33-4faf-ac3c-0beeb469edde tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:09.845358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-642ab262-9b33-4faf-ac3c-0beeb469edde tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:09.846417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-642ab262-9b33-4faf-ac3c-0beeb469edde tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:09.850662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-642ab262-9b33-4faf-ac3c-0beeb469edde tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:09.934117 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-642ab262-9b33-4faf-ac3c-0beeb469edde tempest-ServicesAdminNegativeTestJSON-1853745318 tempest-ServicesAdminNegativeTestJSON-1853745318-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.104473 May 28 21:10:09.935705 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1088/2136] 10.222.0.33 () {58 vars in 1197 bytes} [Sat May 28 21:10:09 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:10:09.956610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ff916c16-987a-4d5e-aa3a-125acb680b5a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:09.958284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ff916c16-987a-4d5e-aa3a-125acb680b5a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:09.974031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ff916c16-987a-4d5e-aa3a-125acb680b5a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:09.975427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ff916c16-987a-4d5e-aa3a-125acb680b5a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:09.976392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ff916c16-987a-4d5e-aa3a-125acb680b5a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:09.976944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ff916c16-987a-4d5e-aa3a-125acb680b5a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:10.028178 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-050fd4dd-80e8-4e46-b9bc-c3799f76c56c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:10.037805 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-050fd4dd-80e8-4e46-b9bc-c3799f76c56c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1404 microversion: 2.1 time: 0.848861 May 28 21:10:10.052045 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1049/2137] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:09 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1404 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:10.056876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f30baf4b-aa8d-429c-8137-274e113d7c68 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:10.058092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f30baf4b-aa8d-429c-8137-274e113d7c68 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:10.064780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f30baf4b-aa8d-429c-8137-274e113d7c68 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:10.065462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f30baf4b-aa8d-429c-8137-274e113d7c68 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:10.066546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f30baf4b-aa8d-429c-8137-274e113d7c68 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:10.067224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f30baf4b-aa8d-429c-8137-274e113d7c68 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:10.195843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-ff916c16-987a-4d5e-aa3a-125acb680b5a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:10.231080 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ff916c16-987a-4d5e-aa3a-125acb680b5a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1929 microversion: 2.75 time: 0.293894 May 28 21:10:10.231674 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1089/2138] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:09 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1929 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:10.237092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-20f0ba1c-3d34-4d57-8e86-e45f1c803469 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d57a12ca0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:10.437258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f30baf4b-aa8d-429c-8137-274e113d7c68 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:10.446079 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f30baf4b-aa8d-429c-8137-274e113d7c68 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1354 microversion: 2.1 time: 0.401900 May 28 21:10:10.447035 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1050/2139] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:10 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1354 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:10.457542 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-20f0ba1c-3d34-4d57-8e86-e45f1c803469 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/776707ed-e0a6-432f-aae0-feaaf0c0bd07" status: 200 len: 218 microversion: 2.1 time: 0.218571 May 28 21:10:10.457542 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1090/2140] 10.222.0.33 () {58 vars in 1268 bytes} [Sat May 28 21:10:10 2022] GET /compute/v2.1/os-security-groups/776707ed-e0a6-432f-aae0-feaaf0c0bd07 => generated 218 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:10.459799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8dd184d6-adae-40dc-bae4-3197c27a17bb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:10.462074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8dd184d6-adae-40dc-bae4-3197c27a17bb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:10.480902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8dd184d6-adae-40dc-bae4-3197c27a17bb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:10.481376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8dd184d6-adae-40dc-bae4-3197c27a17bb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:10.489866 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8dd184d6-adae-40dc-bae4-3197c27a17bb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:10.489866 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8dd184d6-adae-40dc-bae4-3197c27a17bb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:10.633106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7919254f-c821-42a4-8eae-6657eeb90758 tempest-ServicesAdminNegativeTestJSON-561282021 tempest-ServicesAdminNegativeTestJSON-561282021-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:10.634605 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:10.634605 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:10:10.636158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7919254f-c821-42a4-8eae-6657eeb90758 tempest-ServicesAdminNegativeTestJSON-561282021 tempest-ServicesAdminNegativeTestJSON-561282021-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '66fe52f7f96e41a5840ec2d4da6a6a1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c46bc156374e6fa5c0e6b514f110c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7919254f-c821-42a4-8eae-6657eeb90758 tempest-ServicesAdminNegativeTestJSON-561282021 tempest-ServicesAdminNegativeTestJSON-561282021-project] Request method failure captured: May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/os-services HTTP/1.1 May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko-rcWVfJOmkUVFeC4rlFqlWVQ8dADXwZ3-pCMyo9Dy_bqakX9vbefZ-VrriSZZYbm1ATwbsG88gUWGjxnE7tRb3yeYhzVPbmLEJe6cTVlPcImcvOcCIGPevQtpxW6IffEJ1LK1dx_ExHRZeZrlgrHc8brO4Jkf92NvjT7LEb1EMj6A May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 66c46bc156374e6fa5c0e6b514f110c5 May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-561282021 May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_66c46bc156374e6fa5c0e6b514f110c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/66c46bc156374e6fa5c0e6b514f110c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/66c46bc156374e6fa5c0e6b514f110c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/66c46bc156374e6fa5c0e6b514f110c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-561282021 May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 66c46bc156374e6fa5c0e6b514f110c5 May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-561282021 May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServicesAdminNegativeTestJSON-561282021-project May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 66fe52f7f96e41a5840ec2d4da6a6a1c May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-561282021-project May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: action_args: {} May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 28 21:10:10.642400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:10.648735 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:10.648735 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:10.648735 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:10.648735 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:10.648735 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:10.648735 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:10:10.648735 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:10:10.648735 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 28 21:10:10.648735 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:10.651284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7919254f-c821-42a4-8eae-6657eeb90758 tempest-ServicesAdminNegativeTestJSON-561282021 tempest-ServicesAdminNegativeTestJSON-561282021-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:10.652432 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7919254f-c821-42a4-8eae-6657eeb90758 tempest-ServicesAdminNegativeTestJSON-561282021 tempest-ServicesAdminNegativeTestJSON-561282021-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.193377 May 28 21:10:10.654909 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1051/2141] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:10:10 2022] GET /compute/v2.1/os-services => generated 112 bytes in 196 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:10:10.677310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0923c939-8779-4926-afa7-31d16360b386 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:10.681275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0923c939-8779-4926-afa7-31d16360b386 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:10.699965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0923c939-8779-4926-afa7-31d16360b386 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:10.700831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0923c939-8779-4926-afa7-31d16360b386 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:10.702816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0923c939-8779-4926-afa7-31d16360b386 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:10.704334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0923c939-8779-4926-afa7-31d16360b386 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:10.870962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0923c939-8779-4926-afa7-31d16360b386 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4112534978ba4622b0fbbb9a92791876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450ad991a3943e3a4c4233551a42729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:10.886447 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0923c939-8779-4926-afa7-31d16360b386 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 200 len: 1289 microversion: 2.1 time: 0.228951 May 28 21:10:10.900158 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1052/2142] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:10 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 1289 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:10.906764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0b979e36-1cff-4bcb-8bb4-2710bee76a30 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d57780af0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:10.971055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8dd184d6-adae-40dc-bae4-3197c27a17bb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:11.007213 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8dd184d6-adae-40dc-bae4-3197c27a17bb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293" status: 200 len: 1307 microversion: 2.1 time: 0.550438 May 28 21:10:11.020616 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1091/2143] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:10 2022] GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 => generated 1307 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:11.027672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-74f269a8-2fcd-48e6-863e-0258b77f303f req-66e3c98c-a453-4bf9-b721-3ff5c325acd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d508d555-a95e-4d29-a6e7-812145ba9293", "tag": "db2ef97b-cc75-4a42-b69e-a29b12d74688"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:11.047717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-74f269a8-2fcd-48e6-863e-0258b77f303f req-66e3c98c-a453-4bf9-b721-3ff5c325acd3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:11.048406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-74f269a8-2fcd-48e6-863e-0258b77f303f req-66e3c98c-a453-4bf9-b721-3ff5c325acd3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:11.081588 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-74f269a8-2fcd-48e6-863e-0258b77f303f req-66e3c98c-a453-4bf9-b721-3ff5c325acd3 service nova] Creating event network-changed:db2ef97b-cc75-4a42-b69e-a29b12d74688 for instance d508d555-a95e-4d29-a6e7-812145ba9293 on nch1-master-1 May 28 21:10:11.089442 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-74f269a8-2fcd-48e6-863e-0258b77f303f req-66e3c98c-a453-4bf9-b721-3ff5c325acd3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066279 May 28 21:10:11.093391 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1092/2144] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:11.115041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-43469f2e-8038-403c-bf5f-77e52c76287a tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:11.116493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-43469f2e-8038-403c-bf5f-77e52c76287a tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:11.128440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43469f2e-8038-403c-bf5f-77e52c76287a tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:11.129708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43469f2e-8038-403c-bf5f-77e52c76287a tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:11.131018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43469f2e-8038-403c-bf5f-77e52c76287a tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:11.131720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43469f2e-8038-403c-bf5f-77e52c76287a tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:11.688320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-43469f2e-8038-403c-bf5f-77e52c76287a tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:11.704488 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-43469f2e-8038-403c-bf5f-77e52c76287a tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1404 microversion: 2.1 time: 0.602140 May 28 21:10:11.706183 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1093/2145] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:11 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1404 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:11.711498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-3508f30e-40d6-4498-b8d0-97a5e1d063e6 req-efcc3a53-727c-4267-afc9-983bd9a64d52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39db2b33-8e94-4b73-8250-695d7ee9508a", "tag": "6d5785f3-ce68-4bfc-8303-f8e086ad50d5"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:11.736372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3508f30e-40d6-4498-b8d0-97a5e1d063e6 req-efcc3a53-727c-4267-afc9-983bd9a64d52 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:11.742465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3508f30e-40d6-4498-b8d0-97a5e1d063e6 req-efcc3a53-727c-4267-afc9-983bd9a64d52 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:11.773157 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-3508f30e-40d6-4498-b8d0-97a5e1d063e6 req-efcc3a53-727c-4267-afc9-983bd9a64d52 service nova] Creating event network-changed:6d5785f3-ce68-4bfc-8303-f8e086ad50d5 for instance 39db2b33-8e94-4b73-8250-695d7ee9508a on nch1-master-1 May 28 21:10:11.791581 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-3508f30e-40d6-4498-b8d0-97a5e1d063e6 req-efcc3a53-727c-4267-afc9-983bd9a64d52 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083949 May 28 21:10:11.796142 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1094/2146] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:11.812093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aa7d2b8e-5b6a-4070-8b04-a24c951a81e2 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:11.813629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aa7d2b8e-5b6a-4070-8b04-a24c951a81e2 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:11.824861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa7d2b8e-5b6a-4070-8b04-a24c951a81e2 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:11.825346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa7d2b8e-5b6a-4070-8b04-a24c951a81e2 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:11.826691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa7d2b8e-5b6a-4070-8b04-a24c951a81e2 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:11.830968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa7d2b8e-5b6a-4070-8b04-a24c951a81e2 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:11.971856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-aa7d2b8e-5b6a-4070-8b04-a24c951a81e2 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:12.013224 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aa7d2b8e-5b6a-4070-8b04-a24c951a81e2 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1929 microversion: 2.75 time: 0.215479 May 28 21:10:12.018526 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1095/2147] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:11 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1929 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:12.022868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-010362c0-81ea-4b75-882a-34a466754827 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:12.024053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-010362c0-81ea-4b75-882a-34a466754827 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:12.033035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-010362c0-81ea-4b75-882a-34a466754827 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:12.034104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-010362c0-81ea-4b75-882a-34a466754827 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:12.035157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-010362c0-81ea-4b75-882a-34a466754827 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:12.036029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-010362c0-81ea-4b75-882a-34a466754827 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:12.041539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:12.154892 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0b979e36-1cff-4bcb-8bb4-2710bee76a30 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/776707ed-e0a6-432f-aae0-feaaf0c0bd07" status: 202 len: 0 microversion: 2.1 time: 1.246734 May 28 21:10:12.154892 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1053/2148] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:10:10 2022] DELETE /compute/v2.1/os-security-groups/776707ed-e0a6-432f-aae0-feaaf0c0bd07 => generated 0 bytes in 1249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:10:12.156229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c6be7657-aaab-4cbf-8e33-91227d7ac9ef tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:12.157233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c6be7657-aaab-4cbf-8e33-91227d7ac9ef tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:12.186584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6be7657-aaab-4cbf-8e33-91227d7ac9ef tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:12.187254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6be7657-aaab-4cbf-8e33-91227d7ac9ef tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:12.188790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6be7657-aaab-4cbf-8e33-91227d7ac9ef tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:12.189512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6be7657-aaab-4cbf-8e33-91227d7ac9ef tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:12.507507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-010362c0-81ea-4b75-882a-34a466754827 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:12.531670 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-010362c0-81ea-4b75-882a-34a466754827 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1354 microversion: 2.1 time: 0.515119 May 28 21:10:12.535659 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1096/2149] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:12 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1354 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:12.541915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-184d7191-a635-486b-bbb3-eb81d3a38d5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:12.554979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c6be7657-aaab-4cbf-8e33-91227d7ac9ef tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4112534978ba4622b0fbbb9a92791876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450ad991a3943e3a4c4233551a42729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:12.571747 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c6be7657-aaab-4cbf-8e33-91227d7ac9ef tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 200 len: 1331 microversion: 2.1 time: 0.420165 May 28 21:10:12.575835 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1054/2150] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:12 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 1331 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:12.582384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-184d7191-a635-486b-bbb3-eb81d3a38d5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:12.592437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-db534f7b-6420-4c33-b999-bcec48a9d412 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:12.592961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-db534f7b-6420-4c33-b999-bcec48a9d412 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:12.596963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-184d7191-a635-486b-bbb3-eb81d3a38d5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:12.597632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-184d7191-a635-486b-bbb3-eb81d3a38d5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:12.598659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-184d7191-a635-486b-bbb3-eb81d3a38d5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:12.602686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-184d7191-a635-486b-bbb3-eb81d3a38d5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:12.618515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-db534f7b-6420-4c33-b999-bcec48a9d412 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:12.619011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-db534f7b-6420-4c33-b999-bcec48a9d412 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:12.619995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-db534f7b-6420-4c33-b999-bcec48a9d412 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:12.621429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-db534f7b-6420-4c33-b999-bcec48a9d412 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:12.646350 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-db534f7b-6420-4c33-b999-bcec48a9d412 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-db534f7b-6420-4c33-b999-bcec48a9d412 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d HTTP/1.1 May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'de9b4edf-f109-4ba9-b543-115b9e68ab8d'} May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:10:12.648967 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:10:12.654511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. May 28 21:10:12.654511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:12.654511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:12.654511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:12.654511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:12.654511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:12.654511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:12.654511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:12.654511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:12.654511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. May 28 21:10:12.654511 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:12.656974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-db534f7b-6420-4c33-b999-bcec48a9d412 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 404 to user: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:12.658143 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-db534f7b-6420-4c33-b999-bcec48a9d412 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 404 len: 111 microversion: 2.1 time: 0.082275 May 28 21:10:12.663427 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1055/2151] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:10:12 2022] DELETE /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:10:12.683842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0d871344-04c6-4a4a-bcd0-27f333ed4a36 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:12.684488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0d871344-04c6-4a4a-bcd0-27f333ed4a36 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: de9b4edf-f109-4ba9-b543-115b9e68ab8d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:12.694547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d871344-04c6-4a4a-bcd0-27f333ed4a36 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:12.695013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d871344-04c6-4a4a-bcd0-27f333ed4a36 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:12.695810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d871344-04c6-4a4a-bcd0-27f333ed4a36 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:12.696266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d871344-04c6-4a4a-bcd0-27f333ed4a36 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:12.714477 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-0d871344-04c6-4a4a-bcd0-27f333ed4a36 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0d871344-04c6-4a4a-bcd0-27f333ed4a36 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d HTTP/1.1 May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'de9b4edf-f109-4ba9-b543-115b9e68ab8d'} May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:12.717405 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:12.727468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:12.727468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:12.727468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:12.727468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:12.727468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:12.727468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. May 28 21:10:12.727468 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:12.727468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0d871344-04c6-4a4a-bcd0-27f333ed4a36 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 404 to user: Instance de9b4edf-f109-4ba9-b543-115b9e68ab8d could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:12.727468 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0d871344-04c6-4a4a-bcd0-27f333ed4a36 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d" status: 404 len: 111 microversion: 2.1 time: 0.046779 May 28 21:10:12.731219 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1056/2152] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:12 2022] GET /compute/v2.1/servers/de9b4edf-f109-4ba9-b543-115b9e68ab8d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:10:12.738108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-88a02254-c584-4946-8449-5d3bc60ed587 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:12.739069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-88a02254-c584-4946-8449-5d3bc60ed587 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:12.752595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88a02254-c584-4946-8449-5d3bc60ed587 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:12.753349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88a02254-c584-4946-8449-5d3bc60ed587 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:12.754612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88a02254-c584-4946-8449-5d3bc60ed587 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:12.755354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88a02254-c584-4946-8449-5d3bc60ed587 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:12.944779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-184d7191-a635-486b-bbb3-eb81d3a38d5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:12.962168 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-184d7191-a635-486b-bbb3-eb81d3a38d5e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293" status: 200 len: 1307 microversion: 2.1 time: 0.426323 May 28 21:10:12.962962 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1097/2153] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:12 2022] GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 => generated 1307 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:12.985349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4198b506-aa36-4a6b-a40d-138a6600a8ac tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d69c7bf70>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:13.076617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG neutronclient.v2_0.client [None req-4198b506-aa36-4a6b-a40d-138a6600a8ac tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 707b92bb-d209-4935-bb5d-13bc7ebe65fd does not exist", "detail": ""}} {{(pid=143128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:10:13.077226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.security_group_api [None req-4198b506-aa36-4a6b-a40d-138a6600a8ac tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Neutron security group 707b92bb-d209-4935-bb5d-13bc7ebe65fd not found {{(pid=143128) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:10:13.077760 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-4198b506-aa36-4a6b-a40d-138a6600a8ac tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Security group 707b92bb-d209-4935-bb5d-13bc7ebe65fd does not exist May 28 21:10:13.077760 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-f8e798b8-7665-4b74-8565-35b0e105b5be'] May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4198b506-aa36-4a6b-a40d-138a6600a8ac tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-security-groups/707b92bb-d209-4935-bb5d-13bc7ebe65fd HTTP/1.1 May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: exception: Security group 707b92bb-d209-4935-bb5d-13bc7ebe65fd does not exist May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-f8e798b8-7665-4b74-8565-35b0e105b5be'] May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '707b92bb-d209-4935-bb5d-13bc7ebe65fd'} May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:10:13.079845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 707b92bb-d209-4935-bb5d-13bc7ebe65fd does not exist May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8e798b8-7665-4b74-8565-35b0e105b5be'] May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 707b92bb-d209-4935-bb5d-13bc7ebe65fd does not exist May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8e798b8-7665-4b74-8565-35b0e105b5be'] May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 707b92bb-d209-4935-bb5d-13bc7ebe65fd does not exist May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8e798b8-7665-4b74-8565-35b0e105b5be'] May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 707b92bb-d209-4935-bb5d-13bc7ebe65fd does not exist May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f8e798b8-7665-4b74-8565-35b0e105b5be'] May 28 21:10:13.085101 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:13.090765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4198b506-aa36-4a6b-a40d-138a6600a8ac tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 404 to user: Security group 707b92bb-d209-4935-bb5d-13bc7ebe65fd does not exist May 28 21:10:13.090765 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-f8e798b8-7665-4b74-8565-35b0e105b5be'] {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:13.090765 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4198b506-aa36-4a6b-a40d-138a6600a8ac tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/707b92bb-d209-4935-bb5d-13bc7ebe65fd" status: 404 len: 194 microversion: 2.1 time: 0.125865 May 28 21:10:13.091502 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1098/2154] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:10:12 2022] DELETE /compute/v2.1/os-security-groups/707b92bb-d209-4935-bb5d-13bc7ebe65fd => generated 194 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:10:13.194766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-88a02254-c584-4946-8449-5d3bc60ed587 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:13.215201 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-88a02254-c584-4946-8449-5d3bc60ed587 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1404 microversion: 2.1 time: 0.482234 May 28 21:10:13.216023 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1057/2155] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:12 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:13.222602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-13798963-2da7-44ed-b2ba-f8a141fea827 req-a00a6f7c-bb13-42e8-ba85-70947ec410ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be14fefc-6d15-401c-b5e6-e5edfd7cb9ed", "name": "network-vif-plugged", "status": "completed", "tag": "b8cae7c2-0fcc-4265-9208-066781bc94b7"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:13.311682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-13798963-2da7-44ed-b2ba-f8a141fea827 req-a00a6f7c-bb13-42e8-ba85-70947ec410ba service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:13.317252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-13798963-2da7-44ed-b2ba-f8a141fea827 req-a00a6f7c-bb13-42e8-ba85-70947ec410ba service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:13.324060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=10 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:13.374106 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-13798963-2da7-44ed-b2ba-f8a141fea827 req-a00a6f7c-bb13-42e8-ba85-70947ec410ba service nova] Creating event network-vif-plugged:b8cae7c2-0fcc-4265-9208-066781bc94b7 for instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed on nch2-master-1 May 28 21:10:13.384612 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-13798963-2da7-44ed-b2ba-f8a141fea827 req-a00a6f7c-bb13-42e8-ba85-70947ec410ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166362 May 28 21:10:13.390069 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1058/2156] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:13.398143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a761eb27-ac9b-4a39-b6dd-4aa144803645 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:13.399458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a761eb27-ac9b-4a39-b6dd-4aa144803645 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:13.414338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a761eb27-ac9b-4a39-b6dd-4aa144803645 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:13.416755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a761eb27-ac9b-4a39-b6dd-4aa144803645 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:13.420310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a761eb27-ac9b-4a39-b6dd-4aa144803645 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:13.423759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a761eb27-ac9b-4a39-b6dd-4aa144803645 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:13.583103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-23e4941f-b7aa-4d22-95a7-1195e80d3e2b tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] Action: 'create', calling method: .version_select at 0x7f4d57970820>, body: {"pool": null} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:13.707984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-a761eb27-ac9b-4a39-b6dd-4aa144803645 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:13.740372 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a761eb27-ac9b-4a39-b6dd-4aa144803645 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1929 microversion: 2.75 time: 0.348566 May 28 21:10:13.742285 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1059/2157] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:13 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1929 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:13.767924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3e38ec42-7507-476b-be0f-27d91a057f83 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d57780940>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:13.860057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG neutronclient.v2_0.client [None req-3e38ec42-7507-476b-be0f-27d91a057f83 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e5884834-9505-4eb7-beba-b3bfc7665b47 does not exist", "detail": ""}} {{(pid=143129) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:10:13.862751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.security_group_api [None req-3e38ec42-7507-476b-be0f-27d91a057f83 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Neutron security group e5884834-9505-4eb7-beba-b3bfc7665b47 not found {{(pid=143129) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:10:13.863318 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-3e38ec42-7507-476b-be0f-27d91a057f83 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Security group e5884834-9505-4eb7-beba-b3bfc7665b47 does not exist May 28 21:10:13.863318 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-d53d36a3-7fc7-4532-a28e-dcf30681f941'] May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3e38ec42-7507-476b-be0f-27d91a057f83 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/os-security-groups/e5884834-9505-4eb7-beba-b3bfc7665b47 HTTP/1.1 May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: exception: Security group e5884834-9505-4eb7-beba-b3bfc7665b47 does not exist May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-d53d36a3-7fc7-4532-a28e-dcf30681f941'] May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'e5884834-9505-4eb7-beba-b3bfc7665b47'} May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:10:13.874224 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e5884834-9505-4eb7-beba-b3bfc7665b47 does not exist May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53d36a3-7fc7-4532-a28e-dcf30681f941'] May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e5884834-9505-4eb7-beba-b3bfc7665b47 does not exist May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53d36a3-7fc7-4532-a28e-dcf30681f941'] May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e5884834-9505-4eb7-beba-b3bfc7665b47 does not exist May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53d36a3-7fc7-4532-a28e-dcf30681f941'] May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e5884834-9505-4eb7-beba-b3bfc7665b47 does not exist May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d53d36a3-7fc7-4532-a28e-dcf30681f941'] May 28 21:10:13.879824 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:13.885561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3e38ec42-7507-476b-be0f-27d91a057f83 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 404 to user: Security group e5884834-9505-4eb7-beba-b3bfc7665b47 does not exist May 28 21:10:13.885561 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-d53d36a3-7fc7-4532-a28e-dcf30681f941'] {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:13.885561 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3e38ec42-7507-476b-be0f-27d91a057f83 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e5884834-9505-4eb7-beba-b3bfc7665b47" status: 404 len: 194 microversion: 2.1 time: 0.141502 May 28 21:10:13.886706 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1060/2158] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:10:13 2022] DELETE /compute/v2.1/os-security-groups/e5884834-9505-4eb7-beba-b3bfc7665b47 => generated 194 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:10:13.893905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-720710f0-432f-4279-b237-c8944cc06ec2 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:13.895818 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-720710f0-432f-4279-b237-c8944cc06ec2 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:13.905132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-720710f0-432f-4279-b237-c8944cc06ec2 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:13.905944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-720710f0-432f-4279-b237-c8944cc06ec2 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:13.906673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-720710f0-432f-4279-b237-c8944cc06ec2 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:13.907283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-720710f0-432f-4279-b237-c8944cc06ec2 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:14.240470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-720710f0-432f-4279-b237-c8944cc06ec2 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:14.251544 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-720710f0-432f-4279-b237-c8944cc06ec2 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1354 microversion: 2.1 time: 0.363520 May 28 21:10:14.252146 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1061/2159] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:13 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1354 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:14.258136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3e737bf3-3f52-4ac4-9884-ea03598e858a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:14.262037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3e737bf3-3f52-4ac4-9884-ea03598e858a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:14.268283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e737bf3-3f52-4ac4-9884-ea03598e858a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:14.268973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e737bf3-3f52-4ac4-9884-ea03598e858a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:14.270183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e737bf3-3f52-4ac4-9884-ea03598e858a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:14.270791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e737bf3-3f52-4ac4-9884-ea03598e858a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:14.866827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3e737bf3-3f52-4ac4-9884-ea03598e858a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4112534978ba4622b0fbbb9a92791876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450ad991a3943e3a4c4233551a42729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:14.900502 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3e737bf3-3f52-4ac4-9884-ea03598e858a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 200 len: 1331 microversion: 2.1 time: 0.632653 May 28 21:10:14.900502 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1062/2160] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:14 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 1331 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:14.901552 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-acc7de3f-9a41-4464-b43f-3c2ece490649 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d69c19430>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:15.377552 ncdv-master-1 devstack@n-api.service[143129]: DEBUG neutronclient.v2_0.client [None req-acc7de3f-9a41-4464-b43f-3c2ece490649 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist", "detail": ""}} {{(pid=143129) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:10:15.378179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.security_group_api [None req-acc7de3f-9a41-4464-b43f-3c2ece490649 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Neutron security group aada43ca-fd3c-4b1c-938e-fef4028e2939 not found {{(pid=143129) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:10:15.378900 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-acc7de3f-9a41-4464-b43f-3c2ece490649 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist May 28 21:10:15.378900 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-14eaeb56-50c9-4531-9dca-24de71839916'] May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-acc7de3f-9a41-4464-b43f-3c2ece490649 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/os-security-groups/aada43ca-fd3c-4b1c-938e-fef4028e2939 HTTP/1.1 May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: exception: Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-14eaeb56-50c9-4531-9dca-24de71839916'] May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'aada43ca-fd3c-4b1c-938e-fef4028e2939'} May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:10:15.381079 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14eaeb56-50c9-4531-9dca-24de71839916'] May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14eaeb56-50c9-4531-9dca-24de71839916'] May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14eaeb56-50c9-4531-9dca-24de71839916'] May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14eaeb56-50c9-4531-9dca-24de71839916'] May 28 21:10:15.387727 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:15.396082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-acc7de3f-9a41-4464-b43f-3c2ece490649 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 404 to user: Security group aada43ca-fd3c-4b1c-938e-fef4028e2939 does not exist May 28 21:10:15.396082 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-14eaeb56-50c9-4531-9dca-24de71839916'] {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:15.396082 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-acc7de3f-9a41-4464-b43f-3c2ece490649 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/aada43ca-fd3c-4b1c-938e-fef4028e2939" status: 404 len: 194 microversion: 2.1 time: 0.500872 May 28 21:10:15.396082 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1063/2161] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:10:14 2022] DELETE /compute/v2.1/os-security-groups/aada43ca-fd3c-4b1c-938e-fef4028e2939 => generated 194 bytes in 502 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:10:15.405272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ad638a16-5d3e-41ee-a837-bd2c12c9429a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:15.410634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ad638a16-5d3e-41ee-a837-bd2c12c9429a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:15.427022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad638a16-5d3e-41ee-a837-bd2c12c9429a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:15.427789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad638a16-5d3e-41ee-a837-bd2c12c9429a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:15.429176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad638a16-5d3e-41ee-a837-bd2c12c9429a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:15.429806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad638a16-5d3e-41ee-a837-bd2c12c9429a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:15.937477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ad638a16-5d3e-41ee-a837-bd2c12c9429a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:15.950229 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ad638a16-5d3e-41ee-a837-bd2c12c9429a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293" status: 200 len: 1307 microversion: 2.1 time: 0.555456 May 28 21:10:15.951101 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1064/2162] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:15 2022] GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 => generated 1307 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:15.959861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-25a55143-24ce-4418-b707-fe4bd0656552 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:15.963018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-25a55143-24ce-4418-b707-fe4bd0656552 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:15.994024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25a55143-24ce-4418-b707-fe4bd0656552 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:15.994493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25a55143-24ce-4418-b707-fe4bd0656552 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:15.996811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25a55143-24ce-4418-b707-fe4bd0656552 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:15.997577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25a55143-24ce-4418-b707-fe4bd0656552 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:16.283264 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-25a55143-24ce-4418-b707-fe4bd0656552 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:16.292177 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-25a55143-24ce-4418-b707-fe4bd0656552 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1404 microversion: 2.1 time: 0.339591 May 28 21:10:16.296409 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1065/2163] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:15 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1404 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:16.307931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-23b8df5d-cb1b-494a-be9c-1643a9522a5a req-a05f150b-7e22-44fd-8edf-f86dd49dfa02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72113f72-3282-428c-b093-b5325dbb5d3e", "tag": "bb2abcc0-24c9-431a-ad3f-f5bbb1586c09"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:16.316957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-23b8df5d-cb1b-494a-be9c-1643a9522a5a req-a05f150b-7e22-44fd-8edf-f86dd49dfa02 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:16.317508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-23b8df5d-cb1b-494a-be9c-1643a9522a5a req-a05f150b-7e22-44fd-8edf-f86dd49dfa02 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:16.333799 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-23b8df5d-cb1b-494a-be9c-1643a9522a5a req-a05f150b-7e22-44fd-8edf-f86dd49dfa02 service nova] Creating event network-changed:bb2abcc0-24c9-431a-ad3f-f5bbb1586c09 for instance 72113f72-3282-428c-b093-b5325dbb5d3e on nch2-master-1 May 28 21:10:16.339537 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-23b8df5d-cb1b-494a-be9c-1643a9522a5a req-a05f150b-7e22-44fd-8edf-f86dd49dfa02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045119 May 28 21:10:16.340745 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1066/2164] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:16.348345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dbc8b53b-e8b8-4d70-8695-46108cfdc4c4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:16.349545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dbc8b53b-e8b8-4d70-8695-46108cfdc4c4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:16.358934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbc8b53b-e8b8-4d70-8695-46108cfdc4c4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:16.359824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbc8b53b-e8b8-4d70-8695-46108cfdc4c4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:16.361336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbc8b53b-e8b8-4d70-8695-46108cfdc4c4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:16.362146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbc8b53b-e8b8-4d70-8695-46108cfdc4c4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:16.480665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-dbc8b53b-e8b8-4d70-8695-46108cfdc4c4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:16.501294 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dbc8b53b-e8b8-4d70-8695-46108cfdc4c4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1929 microversion: 2.75 time: 0.159103 May 28 21:10:16.501919 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1067/2165] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:16 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1929 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:16.506652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0d09fad4-800d-4dce-bc88-34d21bea3caf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:16.507277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0d09fad4-800d-4dce-bc88-34d21bea3caf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:16.517410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d09fad4-800d-4dce-bc88-34d21bea3caf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:16.519788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d09fad4-800d-4dce-bc88-34d21bea3caf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:16.519788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d09fad4-800d-4dce-bc88-34d21bea3caf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:16.519788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d09fad4-800d-4dce-bc88-34d21bea3caf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:16.736433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0d09fad4-800d-4dce-bc88-34d21bea3caf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:16.744822 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0d09fad4-800d-4dce-bc88-34d21bea3caf tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1354 microversion: 2.1 time: 0.241837 May 28 21:10:16.745412 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1068/2166] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:16 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1354 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:16.750785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0867c9b1-3822-48dd-9403-531005ce0fdb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d5765b430>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:16.775863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG neutronclient.v2_0.client [None req-0867c9b1-3822-48dd-9403-531005ce0fdb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist", "detail": ""}} {{(pid=143129) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:10:16.776475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.security_group_api [None req-0867c9b1-3822-48dd-9403-531005ce0fdb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Neutron security group f76169cb-a58c-46bb-8d45-84239c904081 not found {{(pid=143129) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:10:16.777008 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-0867c9b1-3822-48dd-9403-531005ce0fdb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist May 28 21:10:16.777008 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-754019eb-6c24-439a-9f3f-76e88c18095f'] May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0867c9b1-3822-48dd-9403-531005ce0fdb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/os-security-groups/f76169cb-a58c-46bb-8d45-84239c904081 HTTP/1.1 May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: exception: Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-754019eb-6c24-439a-9f3f-76e88c18095f'] May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'f76169cb-a58c-46bb-8d45-84239c904081'} May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:10:16.779597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-754019eb-6c24-439a-9f3f-76e88c18095f'] May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-754019eb-6c24-439a-9f3f-76e88c18095f'] May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-754019eb-6c24-439a-9f3f-76e88c18095f'] May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-754019eb-6c24-439a-9f3f-76e88c18095f'] May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0867c9b1-3822-48dd-9403-531005ce0fdb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 404 to user: Security group f76169cb-a58c-46bb-8d45-84239c904081 does not exist May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-754019eb-6c24-439a-9f3f-76e88c18095f'] {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:16.783785 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0867c9b1-3822-48dd-9403-531005ce0fdb tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f76169cb-a58c-46bb-8d45-84239c904081" status: 404 len: 194 microversion: 2.1 time: 0.034369 May 28 21:10:16.787174 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1069/2167] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:10:16 2022] DELETE /compute/v2.1/os-security-groups/f76169cb-a58c-46bb-8d45-84239c904081 => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:10:16.790041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-be9f86e1-9cf9-44cf-b8c8-2dc4dc3f46e2 req-f630eb92-27e9-4f64-b9d5-9316909f5be1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be14fefc-6d15-401c-b5e6-e5edfd7cb9ed", "name": "network-vif-plugged", "status": "completed", "tag": "6ecc2ca4-9af3-42ba-ac9f-9102e285c0c2"}, {"server_uuid": "be14fefc-6d15-401c-b5e6-e5edfd7cb9ed", "name": "network-vif-plugged", "status": "completed", "tag": "a80949ec-2a71-4ba2-b4f6-bff628a09248"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:16.799829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-be9f86e1-9cf9-44cf-b8c8-2dc4dc3f46e2 req-f630eb92-27e9-4f64-b9d5-9316909f5be1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:16.800396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-be9f86e1-9cf9-44cf-b8c8-2dc4dc3f46e2 req-f630eb92-27e9-4f64-b9d5-9316909f5be1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:16.813896 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-be9f86e1-9cf9-44cf-b8c8-2dc4dc3f46e2 req-f630eb92-27e9-4f64-b9d5-9316909f5be1 service nova] Creating event network-vif-plugged:6ecc2ca4-9af3-42ba-ac9f-9102e285c0c2 for instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed on nch2-master-1 May 28 21:10:16.814430 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-be9f86e1-9cf9-44cf-b8c8-2dc4dc3f46e2 req-f630eb92-27e9-4f64-b9d5-9316909f5be1 service nova] Creating event network-vif-plugged:a80949ec-2a71-4ba2-b4f6-bff628a09248 for instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed on nch2-master-1 May 28 21:10:16.819783 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-be9f86e1-9cf9-44cf-b8c8-2dc4dc3f46e2 req-f630eb92-27e9-4f64-b9d5-9316909f5be1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033552 May 28 21:10:16.820716 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1070/2168] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:16.827670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e85a1ab9-94af-497b-8b69-47a8527140b0 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:16.828576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e85a1ab9-94af-497b-8b69-47a8527140b0 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:16.835308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e85a1ab9-94af-497b-8b69-47a8527140b0 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:16.835746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e85a1ab9-94af-497b-8b69-47a8527140b0 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:16.836690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e85a1ab9-94af-497b-8b69-47a8527140b0 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:16.837148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e85a1ab9-94af-497b-8b69-47a8527140b0 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:17.234655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e85a1ab9-94af-497b-8b69-47a8527140b0 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4112534978ba4622b0fbbb9a92791876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450ad991a3943e3a4c4233551a42729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:17.243203 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e85a1ab9-94af-497b-8b69-47a8527140b0 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 200 len: 1331 microversion: 2.1 time: 0.421236 May 28 21:10:17.244323 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1071/2169] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:16 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 1331 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:17.254081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f763de2b-7c46-4f22-ad2e-fd76e5fcd602 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d577bd3a0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:17.321736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG neutronclient.v2_0.client [None req-f763de2b-7c46-4f22-ad2e-fd76e5fcd602 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist", "detail": ""}} {{(pid=143129) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:10:17.322723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.security_group_api [None req-f763de2b-7c46-4f22-ad2e-fd76e5fcd602 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Neutron security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 not found {{(pid=143129) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:10:17.323475 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-f763de2b-7c46-4f22-ad2e-fd76e5fcd602 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist May 28 21:10:17.323475 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-20652cd1-9c76-49b8-929c-96d5235ae04a'] May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f763de2b-7c46-4f22-ad2e-fd76e5fcd602 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/os-security-groups/5a0047a7-2ee8-49d2-82a9-2f23f93f0213 HTTP/1.1 May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: exception: Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-20652cd1-9c76-49b8-929c-96d5235ae04a'] May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '5a0047a7-2ee8-49d2-82a9-2f23f93f0213'} May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:10:17.325770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20652cd1-9c76-49b8-929c-96d5235ae04a'] May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20652cd1-9c76-49b8-929c-96d5235ae04a'] May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20652cd1-9c76-49b8-929c-96d5235ae04a'] May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-20652cd1-9c76-49b8-929c-96d5235ae04a'] May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f763de2b-7c46-4f22-ad2e-fd76e5fcd602 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 404 to user: Security group 5a0047a7-2ee8-49d2-82a9-2f23f93f0213 does not exist May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-20652cd1-9c76-49b8-929c-96d5235ae04a'] {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:17.333725 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f763de2b-7c46-4f22-ad2e-fd76e5fcd602 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/5a0047a7-2ee8-49d2-82a9-2f23f93f0213" status: 404 len: 194 microversion: 2.1 time: 0.087146 May 28 21:10:17.342844 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1072/2170] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:10:17 2022] DELETE /compute/v2.1/os-security-groups/5a0047a7-2ee8-49d2-82a9-2f23f93f0213 => generated 194 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:10:17.348525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6dc5d3b5-f6c3-4dcd-972f-3d3b63da0710 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:17.349557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6dc5d3b5-f6c3-4dcd-972f-3d3b63da0710 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:17.352157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:17.359602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6dc5d3b5-f6c3-4dcd-972f-3d3b63da0710 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:17.360145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6dc5d3b5-f6c3-4dcd-972f-3d3b63da0710 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:17.361884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6dc5d3b5-f6c3-4dcd-972f-3d3b63da0710 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:17.361884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6dc5d3b5-f6c3-4dcd-972f-3d3b63da0710 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:17.382023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:17.565042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=14 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:17.591093 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-23e4941f-b7aa-4d22-95a7-1195e80d3e2b tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.497716 May 28 21:10:17.592869 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1099/2171] 10.222.0.33 () {60 vars in 1169 bytes} [Sat May 28 21:10:13 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:17.630846 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6dc5d3b5-f6c3-4dcd-972f-3d3b63da0710 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:17.640268 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6dc5d3b5-f6c3-4dcd-972f-3d3b63da0710 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293" status: 200 len: 1307 microversion: 2.1 time: 0.295925 May 28 21:10:17.641124 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1073/2172] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:17 2022] GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 => generated 1307 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:17.645816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eac4d566-e706-4b37-8df6-4dc811194618 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:17.646537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eac4d566-e706-4b37-8df6-4dc811194618 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:17.653217 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eac4d566-e706-4b37-8df6-4dc811194618 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:17.654020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eac4d566-e706-4b37-8df6-4dc811194618 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:17.655576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eac4d566-e706-4b37-8df6-4dc811194618 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:17.656271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eac4d566-e706-4b37-8df6-4dc811194618 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:17.741075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-18b94461-ea85-41b8-acfc-c3af9f9738b9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Action: 'update', calling method: .version_select at 0x7f4d579f1d30>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:17.743224 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:17.743224 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:10:17.744425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18b94461-ea85-41b8-acfc-c3af9f9738b9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:17.744890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18b94461-ea85-41b8-acfc-c3af9f9738b9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:17.760013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18b94461-ea85-41b8-acfc-c3af9f9738b9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:17.760452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18b94461-ea85-41b8-acfc-c3af9f9738b9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:17.768074 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-18b94461-ea85-41b8-acfc-c3af9f9738b9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] HTTP exception thrown: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-18b94461-ea85-41b8-acfc-c3af9f9738b9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Request method failure captured: May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: request: PUT /compute/v2.1/os-services/df598db9-6949-4cdd-a3fc-52610dd3612e HTTP/1.1 May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 56 May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko-5GTeJ9IXwtR3-XAdLYPcmVm9041_HIYi8nGuDl-8KjsfG79SYL_SL1w0UIEs5w88xTvqeY3wgK34dsmFYuUvbdkMSU9UoXjjYoy5S0rjrZ0eqVeLi0pfsxVlmq2X6cS4jEj3Dct7iv8yOc8SZDhdpD0afnvAqkWSxgur-GaLOyJ4 May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Openstack-Nova-Api-Version: 2.53 May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0a1ad739378c4535b40e955f069ea639 May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-963237015 May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a1ad739378c4535b40e955f069ea639", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a1ad739378c4535b40e955f069ea639"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a1ad739378c4535b40e955f069ea639"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a1ad739378c4535b40e955f069ea639"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-963237015 May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0a1ad739378c4535b40e955f069ea639 May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-963237015 May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f6b22ed0543b4ca286cb052fd8278a39 May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: {"status": "disabled", "disabled_reason": "maintenance"} May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: exception: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'df598db9-6949-4cdd-a3fc-52610dd3612e', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:10:17.770784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-18b94461-ea85-41b8-acfc-c3af9f9738b9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Returning 404 to user: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-18b94461-ea85-41b8-acfc-c3af9f9738b9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/df598db9-6949-4cdd-a3fc-52610dd3612e" status: 404 len: 110 microversion: 2.53 time: 0.178189 May 28 21:10:17.775943 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1100/2173] 10.222.0.33 () {62 vars in 1308 bytes} [Sat May 28 21:10:17 2022] PUT /compute/v2.1/os-services/df598db9-6949-4cdd-a3fc-52610dd3612e => generated 110 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:10:17.784082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bc9ce053-7432-4b3c-85b8-c8c98d41dc44 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d57a12430>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:17.813216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG neutronclient.v2_0.client [None req-bc9ce053-7432-4b3c-85b8-c8c98d41dc44 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist", "detail": ""}} {{(pid=143128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:10:17.814548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.security_group_api [None req-bc9ce053-7432-4b3c-85b8-c8c98d41dc44 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Neutron security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 not found {{(pid=143128) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:10:17.815344 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-bc9ce053-7432-4b3c-85b8-c8c98d41dc44 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist May 28 21:10:17.815344 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-ca7845fc-703c-468c-843d-af34e62992d6'] May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bc9ce053-7432-4b3c-85b8-c8c98d41dc44 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-security-groups/30f81452-b35f-4cad-ae9a-4bc049a16c47 HTTP/1.1 May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: exception: Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-ca7845fc-703c-468c-843d-af34e62992d6'] May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '30f81452-b35f-4cad-ae9a-4bc049a16c47'} May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:10:17.818965 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca7845fc-703c-468c-843d-af34e62992d6'] May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca7845fc-703c-468c-843d-af34e62992d6'] May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca7845fc-703c-468c-843d-af34e62992d6'] May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca7845fc-703c-468c-843d-af34e62992d6'] May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bc9ce053-7432-4b3c-85b8-c8c98d41dc44 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 404 to user: Security group 30f81452-b35f-4cad-ae9a-4bc049a16c47 does not exist May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-ca7845fc-703c-468c-843d-af34e62992d6'] {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bc9ce053-7432-4b3c-85b8-c8c98d41dc44 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/30f81452-b35f-4cad-ae9a-4bc049a16c47" status: 404 len: 194 microversion: 2.1 time: 0.045943 May 28 21:10:17.823712 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1101/2174] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:10:17 2022] DELETE /compute/v2.1/os-security-groups/30f81452-b35f-4cad-ae9a-4bc049a16c47 => generated 194 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:10:17.828273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-61e17ec2-8d35-4108-8ba2-c8d717e7eb42 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:17.829365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-61e17ec2-8d35-4108-8ba2-c8d717e7eb42 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:17.836543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61e17ec2-8d35-4108-8ba2-c8d717e7eb42 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:17.837007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61e17ec2-8d35-4108-8ba2-c8d717e7eb42 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:17.837801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61e17ec2-8d35-4108-8ba2-c8d717e7eb42 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:17.840504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61e17ec2-8d35-4108-8ba2-c8d717e7eb42 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:17.856685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eac4d566-e706-4b37-8df6-4dc811194618 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:17.864965 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eac4d566-e706-4b37-8df6-4dc811194618 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1404 microversion: 2.1 time: 0.222507 May 28 21:10:17.865561 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1074/2175] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:17 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:17.878199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d2893262-e19c-461f-bf98-19b9a9404c86 tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] Action: 'create', calling method: .version_select at 0x7f4d5784c4c0>, body: {"pool": null} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:17.952369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-61e17ec2-8d35-4108-8ba2-c8d717e7eb42 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:17.972827 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-61e17ec2-8d35-4108-8ba2-c8d717e7eb42 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1929 microversion: 2.75 time: 0.149063 May 28 21:10:17.973918 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1102/2176] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:17 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1929 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:17.979152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3971539a-bb06-4598-b333-282414766bad tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:17.980047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3971539a-bb06-4598-b333-282414766bad tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:17.987626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3971539a-bb06-4598-b333-282414766bad tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:17.988515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3971539a-bb06-4598-b333-282414766bad tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:17.989935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3971539a-bb06-4598-b333-282414766bad tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:17.990798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3971539a-bb06-4598-b333-282414766bad tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:18.227934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3971539a-bb06-4598-b333-282414766bad tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:18.236337 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3971539a-bb06-4598-b333-282414766bad tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1354 microversion: 2.1 time: 0.261114 May 28 21:10:18.242524 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1103/2177] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:17 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1354 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:18.242524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2c78f981-c210-4492-8a8b-09cb3b2fc984 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Action: 'update', calling method: .version_select at 0x7f4d69cb2c10>, body: {"status": "disabled"} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:18.242961 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:18.242961 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:10:18.244171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c78f981-c210-4492-8a8b-09cb3b2fc984 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:18.244778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c78f981-c210-4492-8a8b-09cb3b2fc984 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:18.250388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c78f981-c210-4492-8a8b-09cb3b2fc984 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:18.250834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c78f981-c210-4492-8a8b-09cb3b2fc984 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:18.257250 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-2c78f981-c210-4492-8a8b-09cb3b2fc984 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] HTTP exception thrown: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2c78f981-c210-4492-8a8b-09cb3b2fc984 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Request method failure captured: May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: request: PUT /compute/v2.1/os-services/df598db9-6949-4cdd-a3fc-52610dd3612e HTTP/1.1 May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 22 May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko-5GTeJ9IXwtR3-XAdLYPcmVm9041_HIYi8nGuDl-8KjsfG79SYL_SL1w0UIEs5w88xTvqeY3wgK34dsmFYuUvbdkMSU9UoXjjYoy5S0rjrZ0eqVeLi0pfsxVlmq2X6cS4jEj3Dct7iv8yOc8SZDhdpD0afnvAqkWSxgur-GaLOyJ4 May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Openstack-Nova-Api-Version: 2.53 May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0a1ad739378c4535b40e955f069ea639 May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-963237015 May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a1ad739378c4535b40e955f069ea639", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a1ad739378c4535b40e955f069ea639"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a1ad739378c4535b40e955f069ea639"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a1ad739378c4535b40e955f069ea639"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-963237015 May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0a1ad739378c4535b40e955f069ea639 May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-963237015 May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f6b22ed0543b4ca286cb052fd8278a39 May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: {"status": "disabled"} May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: exception: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'df598db9-6949-4cdd-a3fc-52610dd3612e', 'body': {'status': 'disabled'}} May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:10:18.259690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2c78f981-c210-4492-8a8b-09cb3b2fc984 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Returning 404 to user: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2c78f981-c210-4492-8a8b-09cb3b2fc984 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/df598db9-6949-4cdd-a3fc-52610dd3612e" status: 404 len: 110 microversion: 2.53 time: 0.023274 May 28 21:10:18.265007 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1104/2178] 10.222.0.33 () {62 vars in 1308 bytes} [Sat May 28 21:10:18 2022] PUT /compute/v2.1/os-services/df598db9-6949-4cdd-a3fc-52610dd3612e => generated 110 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:10:18.270889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c766e1c3-7d1b-464c-85d7-17f191505936 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:18.271503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c766e1c3-7d1b-464c-85d7-17f191505936 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:18.281910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c766e1c3-7d1b-464c-85d7-17f191505936 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:18.282362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c766e1c3-7d1b-464c-85d7-17f191505936 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:18.283179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c766e1c3-7d1b-464c-85d7-17f191505936 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:18.283625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c766e1c3-7d1b-464c-85d7-17f191505936 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:18.312748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c766e1c3-7d1b-464c-85d7-17f191505936 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:10:18.626452 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c766e1c3-7d1b-464c-85d7-17f191505936 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 204 len: 0 microversion: 2.1 time: 0.362756 May 28 21:10:18.627174 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1105/2179] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:10:18 2022] DELETE /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:10:18.632996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-53787a16-6bca-4cdb-a148-03f72f859ddf tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:18.633800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-53787a16-6bca-4cdb-a148-03f72f859ddf tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:18.640624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53787a16-6bca-4cdb-a148-03f72f859ddf tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:18.641145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53787a16-6bca-4cdb-a148-03f72f859ddf tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:18.642086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53787a16-6bca-4cdb-a148-03f72f859ddf tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:18.642543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53787a16-6bca-4cdb-a148-03f72f859ddf tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:18.801376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-53787a16-6bca-4cdb-a148-03f72f859ddf tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4112534978ba4622b0fbbb9a92791876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450ad991a3943e3a4c4233551a42729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:18.808208 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-53787a16-6bca-4cdb-a148-03f72f859ddf tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 200 len: 1331 microversion: 2.1 time: 0.179347 May 28 21:10:18.808790 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1106/2180] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:18 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 1331 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:18.813386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4d22b823-e42b-4163-bec8-6ff7068d8fc9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Action: 'update', calling method: .version_select at 0x7f4d57871e50>, body: {"status": "enabled"} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:18.814943 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:18.814943 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:10:18.816350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d22b823-e42b-4163-bec8-6ff7068d8fc9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:18.816972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d22b823-e42b-4163-bec8-6ff7068d8fc9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:18.823096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d22b823-e42b-4163-bec8-6ff7068d8fc9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:18.826615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d22b823-e42b-4163-bec8-6ff7068d8fc9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:18.831685 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-4d22b823-e42b-4163-bec8-6ff7068d8fc9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] HTTP exception thrown: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4d22b823-e42b-4163-bec8-6ff7068d8fc9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Request method failure captured: May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: request: PUT /compute/v2.1/os-services/df598db9-6949-4cdd-a3fc-52610dd3612e HTTP/1.1 May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 21 May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko-5GTeJ9IXwtR3-XAdLYPcmVm9041_HIYi8nGuDl-8KjsfG79SYL_SL1w0UIEs5w88xTvqeY3wgK34dsmFYuUvbdkMSU9UoXjjYoy5S0rjrZ0eqVeLi0pfsxVlmq2X6cS4jEj3Dct7iv8yOc8SZDhdpD0afnvAqkWSxgur-GaLOyJ4 May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Openstack-Nova-Api-Version: 2.53 May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0a1ad739378c4535b40e955f069ea639 May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-963237015 May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0a1ad739378c4535b40e955f069ea639", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a1ad739378c4535b40e955f069ea639"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0a1ad739378c4535b40e955f069ea639"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0a1ad739378c4535b40e955f069ea639"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-963237015 May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0a1ad739378c4535b40e955f069ea639 May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-963237015 May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f6b22ed0543b4ca286cb052fd8278a39 May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: {"status": "enabled"} May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: exception: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'df598db9-6949-4cdd-a3fc-52610dd3612e', 'body': {'status': 'enabled'}} May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.NotFound() May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:10:18.833649 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:10:18.838174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update May 28 21:10:18.838174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:10:18.838174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. May 28 21:10:18.838174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:18.838174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:18.838174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:18.838174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:18.838174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:18.838174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:18.838174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:18.838174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:18.838174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. May 28 21:10:18.838174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:18.838174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4d22b823-e42b-4163-bec8-6ff7068d8fc9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Returning 404 to user: Service df598db9-6949-4cdd-a3fc-52610dd3612e could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:18.838174 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4d22b823-e42b-4163-bec8-6ff7068d8fc9 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-services/df598db9-6949-4cdd-a3fc-52610dd3612e" status: 404 len: 110 microversion: 2.53 time: 0.025193 May 28 21:10:18.841319 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1107/2181] 10.222.0.33 () {62 vars in 1308 bytes} [Sat May 28 21:10:18 2022] PUT /compute/v2.1/os-services/df598db9-6949-4cdd-a3fc-52610dd3612e => generated 110 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:10:18.846833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2066ee2e-ba5a-4589-aadd-ad3fcc4d7159 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:18.847676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2066ee2e-ba5a-4589-aadd-ad3fcc4d7159 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:18.855606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2066ee2e-ba5a-4589-aadd-ad3fcc4d7159 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:18.856240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2066ee2e-ba5a-4589-aadd-ad3fcc4d7159 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:18.857264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2066ee2e-ba5a-4589-aadd-ad3fcc4d7159 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:18.858600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2066ee2e-ba5a-4589-aadd-ad3fcc4d7159 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:19.046350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2066ee2e-ba5a-4589-aadd-ad3fcc4d7159 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:19.054169 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2066ee2e-ba5a-4589-aadd-ad3fcc4d7159 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1643 microversion: 2.1 time: 0.211235 May 28 21:10:19.054746 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1108/2182] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:18 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1643 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:19.059216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e56a9e7a-9b4c-4b01-a161-04e034d1182a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:19.059838 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e56a9e7a-9b4c-4b01-a161-04e034d1182a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:19.066063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e56a9e7a-9b4c-4b01-a161-04e034d1182a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:19.066526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e56a9e7a-9b4c-4b01-a161-04e034d1182a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:19.067332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e56a9e7a-9b4c-4b01-a161-04e034d1182a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:19.067783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e56a9e7a-9b4c-4b01-a161-04e034d1182a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:19.118010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=10 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:19.294622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e56a9e7a-9b4c-4b01-a161-04e034d1182a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:19.303003 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e56a9e7a-9b4c-4b01-a161-04e034d1182a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293" status: 200 len: 1307 microversion: 2.1 time: 0.247239 May 28 21:10:19.312651 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1109/2183] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:19 2022] GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 => generated 1307 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:19.314689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-7d412281-94d8-4089-9f5f-9a69be231a31 req-f241ebeb-a45f-49b4-9180-c73f5cf7acda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d508d555-a95e-4d29-a6e7-812145ba9293", "name": "network-vif-plugged", "status": "completed", "tag": "db2ef97b-cc75-4a42-b69e-a29b12d74688"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:19.323171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7d412281-94d8-4089-9f5f-9a69be231a31 req-f241ebeb-a45f-49b4-9180-c73f5cf7acda service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:19.323700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7d412281-94d8-4089-9f5f-9a69be231a31 req-f241ebeb-a45f-49b4-9180-c73f5cf7acda service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:19.336690 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-7d412281-94d8-4089-9f5f-9a69be231a31 req-f241ebeb-a45f-49b4-9180-c73f5cf7acda service nova] Creating event network-vif-plugged:db2ef97b-cc75-4a42-b69e-a29b12d74688 for instance d508d555-a95e-4d29-a6e7-812145ba9293 on nch1-master-1 May 28 21:10:19.343558 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-7d412281-94d8-4089-9f5f-9a69be231a31 req-f241ebeb-a45f-49b4-9180-c73f5cf7acda service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038574 May 28 21:10:19.344447 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1110/2184] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:19.350863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-522ed48a-6777-4091-850f-ba45025517c3 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:19.353536 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:19.353536 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:10:19.353536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-522ed48a-6777-4091-850f-ba45025517c3 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:19.354314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-522ed48a-6777-4091-850f-ba45025517c3 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:19.355363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-522ed48a-6777-4091-850f-ba45025517c3 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:19.355811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-522ed48a-6777-4091-850f-ba45025517c3 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:19.386200 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-522ed48a-6777-4091-850f-ba45025517c3 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.040106 May 28 21:10:19.386814 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1111/2185] 10.222.0.33 () {60 vars in 1177 bytes} [Sat May 28 21:10:19 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:19.392360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1c733f4f-b7a4-4bdf-bbd4-1a90408944ff tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:19.393093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1c733f4f-b7a4-4bdf-bbd4-1a90408944ff tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:19.399975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c733f4f-b7a4-4bdf-bbd4-1a90408944ff tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:19.400483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c733f4f-b7a4-4bdf-bbd4-1a90408944ff tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:19.401255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c733f4f-b7a4-4bdf-bbd4-1a90408944ff tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:19.401706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c733f4f-b7a4-4bdf-bbd4-1a90408944ff tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:19.620187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1c733f4f-b7a4-4bdf-bbd4-1a90408944ff tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:19.630762 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1c733f4f-b7a4-4bdf-bbd4-1a90408944ff tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1404 microversion: 2.1 time: 0.242664 May 28 21:10:19.641422 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1112/2186] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:19 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1404 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:19.646465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c648f62c-b7fc-46a9-9571-f8edfee49cd3 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:19.647091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c648f62c-b7fc-46a9-9571-f8edfee49cd3 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:19.653581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c648f62c-b7fc-46a9-9571-f8edfee49cd3 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:19.654616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c648f62c-b7fc-46a9-9571-f8edfee49cd3 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:19.655397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c648f62c-b7fc-46a9-9571-f8edfee49cd3 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:19.655840 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c648f62c-b7fc-46a9-9571-f8edfee49cd3 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:19.754718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-c648f62c-b7fc-46a9-9571-f8edfee49cd3 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:19.771971 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c648f62c-b7fc-46a9-9571-f8edfee49cd3 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1929 microversion: 2.75 time: 0.129384 May 28 21:10:19.785650 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1113/2187] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:19 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1929 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:19.785650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e594235f-34fe-4ea7-a09e-012480eaf8f1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:19.785650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e594235f-34fe-4ea7-a09e-012480eaf8f1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:19.786632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e594235f-34fe-4ea7-a09e-012480eaf8f1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:19.786632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e594235f-34fe-4ea7-a09e-012480eaf8f1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:19.787320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e594235f-34fe-4ea7-a09e-012480eaf8f1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:19.787764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e594235f-34fe-4ea7-a09e-012480eaf8f1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:20.298687 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d2893262-e19c-461f-bf98-19b9a9404c86 tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.431943 May 28 21:10:20.305125 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1075/2188] 10.222.0.33 () {60 vars in 1169 bytes} [Sat May 28 21:10:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:20.311825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a1ce49b0-410f-487e-9653-10c116f13cbc tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:20.311825 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:20.311825 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:10:20.311825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a1ce49b0-410f-487e-9653-10c116f13cbc tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:20.311825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a1ce49b0-410f-487e-9653-10c116f13cbc tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:20.311825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a1ce49b0-410f-487e-9653-10c116f13cbc tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:20.311825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a1ce49b0-410f-487e-9653-10c116f13cbc tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:20.324620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e594235f-34fe-4ea7-a09e-012480eaf8f1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:20.330438 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e594235f-34fe-4ea7-a09e-012480eaf8f1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1805 microversion: 2.1 time: 0.556312 May 28 21:10:20.331033 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1114/2189] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:19 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1805 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:20.335434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b29827d6-2646-40da-83b4-605b45e9c68a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:20.336043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b29827d6-2646-40da-83b4-605b45e9c68a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:20.342338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b29827d6-2646-40da-83b4-605b45e9c68a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:20.342819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b29827d6-2646-40da-83b4-605b45e9c68a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:20.343592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b29827d6-2646-40da-83b4-605b45e9c68a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:20.344028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b29827d6-2646-40da-83b4-605b45e9c68a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:20.346463 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a1ce49b0-410f-487e-9653-10c116f13cbc tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.045874 May 28 21:10:20.347315 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1076/2190] 10.222.0.33 () {60 vars in 1210 bytes} [Sat May 28 21:10:20 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:20.352484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d882a769-cf66-4230-9b40-b31befc67dcf tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:20.353127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d882a769-cf66-4230-9b40-b31befc67dcf tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:20.365058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d882a769-cf66-4230-9b40-b31befc67dcf tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:20.365766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d882a769-cf66-4230-9b40-b31befc67dcf tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:20.366681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d882a769-cf66-4230-9b40-b31befc67dcf tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:20.367284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d882a769-cf66-4230-9b40-b31befc67dcf tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:20.451987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d882a769-cf66-4230-9b40-b31befc67dcf tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:20.469368 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d882a769-cf66-4230-9b40-b31befc67dcf tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1465 microversion: 2.1 time: 0.120823 May 28 21:10:20.470252 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1077/2191] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:20 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1465 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:20.478683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d92bbb63-d08a-47d9-b4a2-bab9e16e551a tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] Action: 'create', calling method: .version_select at 0x7f4d5765b310>, body: {"pool": null} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:20.569718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b29827d6-2646-40da-83b4-605b45e9c68a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4112534978ba4622b0fbbb9a92791876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450ad991a3943e3a4c4233551a42729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:20.577348 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b29827d6-2646-40da-83b4-605b45e9c68a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 200 len: 1331 microversion: 2.1 time: 0.245264 May 28 21:10:20.577880 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1115/2192] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:20 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 1331 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:20.582396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a2bcccbd-5c32-48f5-bcd5-5bf36e8b2235 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:20.582992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a2bcccbd-5c32-48f5-bcd5-5bf36e8b2235 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:20.589635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2bcccbd-5c32-48f5-bcd5-5bf36e8b2235 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:20.590214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2bcccbd-5c32-48f5-bcd5-5bf36e8b2235 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:20.591259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2bcccbd-5c32-48f5-bcd5-5bf36e8b2235 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:20.592299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2bcccbd-5c32-48f5-bcd5-5bf36e8b2235 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:20.773865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a2bcccbd-5c32-48f5-bcd5-5bf36e8b2235 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:20.778173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:20.783451 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a2bcccbd-5c32-48f5-bcd5-5bf36e8b2235 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293" status: 200 len: 1307 microversion: 2.1 time: 0.204565 May 28 21:10:20.784030 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1116/2193] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:20 2022] GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 => generated 1307 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:20.788624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c33f880d-fff2-4c75-a48e-abc87613d61a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:20.789117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c33f880d-fff2-4c75-a48e-abc87613d61a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:20.795065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c33f880d-fff2-4c75-a48e-abc87613d61a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:20.795705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c33f880d-fff2-4c75-a48e-abc87613d61a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:20.796481 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c33f880d-fff2-4c75-a48e-abc87613d61a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:20.796921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c33f880d-fff2-4c75-a48e-abc87613d61a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:20.821386 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c33f880d-fff2-4c75-a48e-abc87613d61a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed/ips" status: 200 len: 219 microversion: 2.1 time: 0.036305 May 28 21:10:20.822002 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1117/2194] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 21:10:20 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed/ips => generated 219 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:20.827626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2f38db17-da3e-4872-854f-ffe33b8c87c0 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:20.828818 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:20.828818 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:10:20.830128 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f38db17-da3e-4872-854f-ffe33b8c87c0 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:20.830570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f38db17-da3e-4872-854f-ffe33b8c87c0 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:20.831790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f38db17-da3e-4872-854f-ffe33b8c87c0 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:20.831924 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f38db17-da3e-4872-854f-ffe33b8c87c0 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:20.856964 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2f38db17-da3e-4872-854f-ffe33b8c87c0 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.033916 May 28 21:10:20.857634 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1118/2195] 10.222.0.33 () {60 vars in 1177 bytes} [Sat May 28 21:10:20 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:20.862037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-537487e4-2c9c-4158-b09f-fcc967e2ed7e req-9a0faf2a-9c31-4541-aa09-0b829bfc5f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21a805a0-9660-4656-9fe5-2cd72fb96be9", "name": "network-vif-deleted", "tag": "05e9b5fc-2b1f-4708-b1bf-2810843a11ba"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:20.870640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-537487e4-2c9c-4158-b09f-fcc967e2ed7e req-9a0faf2a-9c31-4541-aa09-0b829bfc5f24 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:20.871309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-537487e4-2c9c-4158-b09f-fcc967e2ed7e req-9a0faf2a-9c31-4541-aa09-0b829bfc5f24 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:20.884111 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-537487e4-2c9c-4158-b09f-fcc967e2ed7e req-9a0faf2a-9c31-4541-aa09-0b829bfc5f24 service nova] Creating event network-vif-deleted:05e9b5fc-2b1f-4708-b1bf-2810843a11ba for instance 21a805a0-9660-4656-9fe5-2cd72fb96be9 on nch1-master-1 May 28 21:10:20.887875 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-537487e4-2c9c-4158-b09f-fcc967e2ed7e req-9a0faf2a-9c31-4541-aa09-0b829bfc5f24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028951 May 28 21:10:20.889208 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1119/2196] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:20.894283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8fc36740-505c-4a50-be88-431773598800 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:20.894973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8fc36740-505c-4a50-be88-431773598800 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:20.902981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fc36740-505c-4a50-be88-431773598800 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:20.903432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fc36740-505c-4a50-be88-431773598800 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:20.904785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fc36740-505c-4a50-be88-431773598800 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:20.905367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fc36740-505c-4a50-be88-431773598800 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:21.118723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8fc36740-505c-4a50-be88-431773598800 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:21.126224 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8fc36740-505c-4a50-be88-431773598800 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1404 microversion: 2.1 time: 0.235911 May 28 21:10:21.126840 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1120/2197] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:20 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1404 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:21.131470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-825e80eb-d34c-41ba-9641-4483cc474de6 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:21.132444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-825e80eb-d34c-41ba-9641-4483cc474de6 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:21.138481 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-825e80eb-d34c-41ba-9641-4483cc474de6 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:21.139504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-825e80eb-d34c-41ba-9641-4483cc474de6 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:21.140502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-825e80eb-d34c-41ba-9641-4483cc474de6 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:21.140951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-825e80eb-d34c-41ba-9641-4483cc474de6 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:21.223316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-825e80eb-d34c-41ba-9641-4483cc474de6 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:21.241712 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-825e80eb-d34c-41ba-9641-4483cc474de6 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1929 microversion: 2.75 time: 0.113847 May 28 21:10:21.244391 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1121/2198] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:21 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1929 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:21.247357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0aca26ae-32a5-495f-968d-8a08833ada50 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:21.247957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0aca26ae-32a5-495f-968d-8a08833ada50 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:21.255449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0aca26ae-32a5-495f-968d-8a08833ada50 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:21.255869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0aca26ae-32a5-495f-968d-8a08833ada50 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:21.256648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0aca26ae-32a5-495f-968d-8a08833ada50 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:21.257094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0aca26ae-32a5-495f-968d-8a08833ada50 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:21.283561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0aca26ae-32a5-495f-968d-8a08833ada50 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:10:21.600104 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0aca26ae-32a5-495f-968d-8a08833ada50 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "DELETE /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 204 len: 0 microversion: 2.1 time: 0.355940 May 28 21:10:21.601310 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1122/2199] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:10:21 2022] DELETE /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:10:21.607936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-19548fac-2b4a-42a8-829b-696e917d972d tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:21.609290 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:21.609290 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:10:21.611187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19548fac-2b4a-42a8-829b-696e917d972d tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:21.611650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19548fac-2b4a-42a8-829b-696e917d972d tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:21.612512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19548fac-2b4a-42a8-829b-696e917d972d tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:21.612956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19548fac-2b4a-42a8-829b-696e917d972d tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:21.637113 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-19548fac-2b4a-42a8-829b-696e917d972d tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.034573 May 28 21:10:21.637732 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1123/2200] 10.222.0.33 () {60 vars in 1236 bytes} [Sat May 28 21:10:21 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:21.643592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-37525634-91fb-4d2f-a438-041aa656223f req-16111a86-212b-41d0-a5e2-593aaeaf9f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39db2b33-8e94-4b73-8250-695d7ee9508a", "name": "network-vif-plugged", "status": "completed", "tag": "6d5785f3-ce68-4bfc-8303-f8e086ad50d5"}, {"server_uuid": "72113f72-3282-428c-b093-b5325dbb5d3e", "name": "network-vif-plugged", "status": "completed", "tag": "bb2abcc0-24c9-431a-ad3f-f5bbb1586c09"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:21.652557 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-37525634-91fb-4d2f-a438-041aa656223f req-16111a86-212b-41d0-a5e2-593aaeaf9f12 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:21.653482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-37525634-91fb-4d2f-a438-041aa656223f req-16111a86-212b-41d0-a5e2-593aaeaf9f12 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:21.672943 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-37525634-91fb-4d2f-a438-041aa656223f req-16111a86-212b-41d0-a5e2-593aaeaf9f12 service nova] Creating event network-vif-plugged:6d5785f3-ce68-4bfc-8303-f8e086ad50d5 for instance 39db2b33-8e94-4b73-8250-695d7ee9508a on nch1-master-1 May 28 21:10:21.672943 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-37525634-91fb-4d2f-a438-041aa656223f req-16111a86-212b-41d0-a5e2-593aaeaf9f12 service nova] Creating event network-vif-plugged:bb2abcc0-24c9-431a-ad3f-f5bbb1586c09 for instance 72113f72-3282-428c-b093-b5325dbb5d3e on nch2-master-1 May 28 21:10:21.678324 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-37525634-91fb-4d2f-a438-041aa656223f req-16111a86-212b-41d0-a5e2-593aaeaf9f12 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039383 May 28 21:10:21.679385 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1124/2201] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:21.688660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-202cced0-afab-4fc1-8855-05a96b55e115 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:21.689380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-202cced0-afab-4fc1-8855-05a96b55e115 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:21.696321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-202cced0-afab-4fc1-8855-05a96b55e115 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:21.696824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-202cced0-afab-4fc1-8855-05a96b55e115 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:21.697612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-202cced0-afab-4fc1-8855-05a96b55e115 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:21.698090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-202cced0-afab-4fc1-8855-05a96b55e115 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:21.735935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-202cced0-afab-4fc1-8855-05a96b55e115 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:21.736354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-202cced0-afab-4fc1-8855-05a96b55e115 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:21.737288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-202cced0-afab-4fc1-8855-05a96b55e115 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lazy-loading 'fault' on Instance uuid 21a805a0-9660-4656-9fe5-2cd72fb96be9 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:21.784807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-202cced0-afab-4fc1-8855-05a96b55e115 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08e71479f9d4ef0a30681cdfdd6fef8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e96bf6518d66430399de823144f7bea8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:21.792632 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-202cced0-afab-4fc1-8855-05a96b55e115 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 200 len: 1304 microversion: 2.1 time: 0.112515 May 28 21:10:21.793206 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1125/2202] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:21 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:21.798786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fdcfdfc8-1c74-4381-a782-84ef7162c3db tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:21.799408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fdcfdfc8-1c74-4381-a782-84ef7162c3db tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:21.803447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:21.806930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdcfdfc8-1c74-4381-a782-84ef7162c3db tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:21.807536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdcfdfc8-1c74-4381-a782-84ef7162c3db tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:21.808155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdcfdfc8-1c74-4381-a782-84ef7162c3db tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:21.808593 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdcfdfc8-1c74-4381-a782-84ef7162c3db tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:21.993376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fdcfdfc8-1c74-4381-a782-84ef7162c3db tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4112534978ba4622b0fbbb9a92791876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450ad991a3943e3a4c4233551a42729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:22.001351 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fdcfdfc8-1c74-4381-a782-84ef7162c3db tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 200 len: 1331 microversion: 2.1 time: 0.207183 May 28 21:10:22.001953 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1126/2203] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:21 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 1331 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:22.006370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4656ae72-9276-40f9-ae72-cf05dc81433e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:22.006984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4656ae72-9276-40f9-ae72-cf05dc81433e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:22.012662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4656ae72-9276-40f9-ae72-cf05dc81433e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:22.013124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4656ae72-9276-40f9-ae72-cf05dc81433e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:22.014611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4656ae72-9276-40f9-ae72-cf05dc81433e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:22.015078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4656ae72-9276-40f9-ae72-cf05dc81433e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:22.256670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4656ae72-9276-40f9-ae72-cf05dc81433e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:22.263565 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d92bbb63-d08a-47d9-b4a2-bab9e16e551a tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.788372 May 28 21:10:22.264173 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1078/2204] 10.222.0.33 () {60 vars in 1169 bytes} [Sat May 28 21:10:20 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:22.265158 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4656ae72-9276-40f9-ae72-cf05dc81433e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1811 microversion: 2.1 time: 0.262186 May 28 21:10:22.265902 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1127/2205] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:22 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1811 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:22.270531 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1db705bd-bae7-46fd-881f-3ab4bc13006e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:22.271226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1db705bd-bae7-46fd-881f-3ab4bc13006e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:22.277122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-73dd4715-a432-4676-9f23-9000cd20e2eb tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:22.277450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1db705bd-bae7-46fd-881f-3ab4bc13006e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:22.277940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1db705bd-bae7-46fd-881f-3ab4bc13006e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:22.278354 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:22.278354 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:10:22.278751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1db705bd-bae7-46fd-881f-3ab4bc13006e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:22.279235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1db705bd-bae7-46fd-881f-3ab4bc13006e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:22.279559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73dd4715-a432-4676-9f23-9000cd20e2eb tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:22.280020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73dd4715-a432-4676-9f23-9000cd20e2eb tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:22.280835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73dd4715-a432-4676-9f23-9000cd20e2eb tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:22.281282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73dd4715-a432-4676-9f23-9000cd20e2eb tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:22.306143 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-73dd4715-a432-4676-9f23-9000cd20e2eb tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.040897 May 28 21:10:22.306762 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1079/2206] 10.222.0.33 () {60 vars in 1177 bytes} [Sat May 28 21:10:22 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:22.311923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-761f132a-9a1d-4818-bdc0-2698e44e7eb9 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:22.312552 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-761f132a-9a1d-4818-bdc0-2698e44e7eb9 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:22.318978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-761f132a-9a1d-4818-bdc0-2698e44e7eb9 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:22.324140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-761f132a-9a1d-4818-bdc0-2698e44e7eb9 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:22.324140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-761f132a-9a1d-4818-bdc0-2698e44e7eb9 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:22.324140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-761f132a-9a1d-4818-bdc0-2698e44e7eb9 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:22.462065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1db705bd-bae7-46fd-881f-3ab4bc13006e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:22.469996 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1db705bd-bae7-46fd-881f-3ab4bc13006e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293" status: 200 len: 1487 microversion: 2.1 time: 0.203250 May 28 21:10:22.470582 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1128/2207] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:22 2022] GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 => generated 1487 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:22.475151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-208a79a7-068f-43f8-ba70-55e8d0901b76 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:22.475701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-208a79a7-068f-43f8-ba70-55e8d0901b76 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:22.482658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-208a79a7-068f-43f8-ba70-55e8d0901b76 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:22.483107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-208a79a7-068f-43f8-ba70-55e8d0901b76 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:22.483895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-208a79a7-068f-43f8-ba70-55e8d0901b76 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:22.484337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-208a79a7-068f-43f8-ba70-55e8d0901b76 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:22.486065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-761f132a-9a1d-4818-bdc0-2698e44e7eb9 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:22.494049 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-761f132a-9a1d-4818-bdc0-2698e44e7eb9 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1404 microversion: 2.1 time: 0.186293 May 28 21:10:22.494623 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1080/2208] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:22 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1404 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:22.499986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1e4c18ac-4dd1-4db7-9c6a-d4ac56bf3473 tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] Action: 'create', calling method: .version_select at 0x7f4d577bd9d0>, body: {"pool": null} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:22.592894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-208a79a7-068f-43f8-ba70-55e8d0901b76 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:22.610513 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-208a79a7-068f-43f8-ba70-55e8d0901b76 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1929 microversion: 2.75 time: 0.138897 May 28 21:10:22.611100 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1129/2209] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:22 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1929 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:22.615702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5e8ddf56-f0a6-492b-a5fb-f2bf4bfd0380 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:22.617261 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:22.617261 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:10:22.618547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e8ddf56-f0a6-492b-a5fb-f2bf4bfd0380 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:22.618997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e8ddf56-f0a6-492b-a5fb-f2bf4bfd0380 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:22.619801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e8ddf56-f0a6-492b-a5fb-f2bf4bfd0380 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:22.620239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e8ddf56-f0a6-492b-a5fb-f2bf4bfd0380 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:22.643659 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5e8ddf56-f0a6-492b-a5fb-f2bf4bfd0380 tempest-ServicesAdminNegativeV253TestJSON-963237015 tempest-ServicesAdminNegativeV253TestJSON-963237015-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.031522 May 28 21:10:22.645628 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1130/2210] 10.222.0.33 () {60 vars in 1238 bytes} [Sat May 28 21:10:22 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:22.654634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-839ebca2-d20b-4ea0-982e-44735f447f45 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:22.655175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-839ebca2-d20b-4ea0-982e-44735f447f45 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:22.661222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-839ebca2-d20b-4ea0-982e-44735f447f45 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:22.661674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-839ebca2-d20b-4ea0-982e-44735f447f45 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:22.662483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-839ebca2-d20b-4ea0-982e-44735f447f45 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:22.662923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-839ebca2-d20b-4ea0-982e-44735f447f45 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:22.685663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-839ebca2-d20b-4ea0-982e-44735f447f45 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lazy-loading 'flavor' on Instance uuid d508d555-a95e-4d29-a6e7-812145ba9293 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:23.074261 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-839ebca2-d20b-4ea0-982e-44735f447f45 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "POST /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293/action" status: 202 len: 0 microversion: 2.1 time: 0.428600 May 28 21:10:23.075228 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1131/2211] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:10:22 2022] POST /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:10:23.187939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-44bdb268-7b59-48b2-947d-79f986fa3337 tempest-ServicesAdminNegativeV253TestJSON-379464155 tempest-ServicesAdminNegativeV253TestJSON-379464155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:23.191798 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:10:23.191798 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:10:23.191798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-44bdb268-7b59-48b2-947d-79f986fa3337 tempest-ServicesAdminNegativeV253TestJSON-379464155 tempest-ServicesAdminNegativeV253TestJSON-379464155-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '8a131a79139848f9af2b3236cea70185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67c3a0c476941f6a277be14769d6208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-44bdb268-7b59-48b2-947d-79f986fa3337 tempest-ServicesAdminNegativeV253TestJSON-379464155 tempest-ServicesAdminNegativeV253TestJSON-379464155-project] Request method failure captured: May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-services HTTP/1.1 May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko-40-FpBu42igUJ-KBYv8vDLO1l9vzhf9qVuN8G8T2WeqCUlZT2uiHUcLKi6-Ix7rOgnW1HyODJ7MPPnj2778cJY96FqWMZSGhRciJDs3tMIAwE4lmn-gg12LwONLAe0fxz01bdO_oa6RGV4xF17bDG8D4b-hVtfHyL5GjYsAhOW5o May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Openstack-Nova-Api-Version: 2.53 May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: d67c3a0c476941f6a277be14769d6208 May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-379464155 May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d67c3a0c476941f6a277be14769d6208", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d67c3a0c476941f6a277be14769d6208"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d67c3a0c476941f6a277be14769d6208"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d67c3a0c476941f6a277be14769d6208"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-379464155 May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: d67c3a0c476941f6a277be14769d6208 May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-379464155 May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServicesAdminNegativeV253TestJSON-379464155-project May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 8a131a79139848f9af2b3236cea70185 May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-379464155-project May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: action_args: {} May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. May 28 21:10:23.192108 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:23.197553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:23.197553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:23.197553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:23.197553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:23.197553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:23.197553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:10:23.197553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:10:23.197553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. May 28 21:10:23.197553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:23.197553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-44bdb268-7b59-48b2-947d-79f986fa3337 tempest-ServicesAdminNegativeV253TestJSON-379464155 tempest-ServicesAdminNegativeV253TestJSON-379464155-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:23.197553 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-44bdb268-7b59-48b2-947d-79f986fa3337 tempest-ServicesAdminNegativeV253TestJSON-379464155 tempest-ServicesAdminNegativeV253TestJSON-379464155-project] 10.222.0.33 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.117227 May 28 21:10:23.199829 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1132/2212] 10.222.0.33 () {60 vars in 1177 bytes} [Sat May 28 21:10:23 2022] GET /compute/v2.1/os-services => generated 112 bytes in 124 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) May 28 21:10:23.206318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-30173dec-0b8d-4507-9a74-372764bf3b1c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:23.213084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-30173dec-0b8d-4507-9a74-372764bf3b1c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] [instance: 21a805a0-9660-4656-9fe5-2cd72fb96be9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:23.217484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30173dec-0b8d-4507-9a74-372764bf3b1c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:23.218168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30173dec-0b8d-4507-9a74-372764bf3b1c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:23.219118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30173dec-0b8d-4507-9a74-372764bf3b1c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:23.219538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30173dec-0b8d-4507-9a74-372764bf3b1c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:23.235772 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-30173dec-0b8d-4507-9a74-372764bf3b1c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] HTTP exception thrown: Instance 21a805a0-9660-4656-9fe5-2cd72fb96be9 could not be found. May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-30173dec-0b8d-4507-9a74-372764bf3b1c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Request method failure captured: May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 HTTP/1.1 May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko9UAuBYMR5_hwyriFGym60EXIB2IJJLqMSHQJn-jSLgazbkQYE6zibazfJMxQ4NifyF0Xeu9QVMh3uWwLZDAkfxIzdcLBRTuNXlPt9w2EuZouhwGn_IyEL1NqqQTaMzD36BNR_qokGZn5L31-hV7NwKSPKVr1bq4aXMEmOV_9IzuG8 May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e96bf6518d66430399de823144f7bea8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e96bf6518d66430399de823144f7bea8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e96bf6518d66430399de823144f7bea8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e96bf6518d66430399de823144f7bea8 May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-942978443 May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f08e71479f9d4ef0a30681cdfdd6fef8 May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupsTestJSON-942978443-project May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 21a805a0-9660-4656-9fe5-2cd72fb96be9 could not be found. May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '21a805a0-9660-4656-9fe5-2cd72fb96be9'} May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21a805a0-9660-4656-9fe5-2cd72fb96be9 could not be found. May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21a805a0-9660-4656-9fe5-2cd72fb96be9 could not be found. May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:23.237775 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:23.242984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:23.242984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:23.242984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:23.242984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:23.242984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:23.242984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21a805a0-9660-4656-9fe5-2cd72fb96be9 could not be found. May 28 21:10:23.242984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:23.242984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-30173dec-0b8d-4507-9a74-372764bf3b1c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Returning 404 to user: Instance 21a805a0-9660-4656-9fe5-2cd72fb96be9 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:23.242984 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-30173dec-0b8d-4507-9a74-372764bf3b1c tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9" status: 404 len: 111 microversion: 2.1 time: 0.038149 May 28 21:10:23.242984 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1133/2213] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:23 2022] GET /compute/v2.1/servers/21a805a0-9660-4656-9fe5-2cd72fb96be9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:10:23.248802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-682a2203-0bdd-47d6-8e69-4e58f28336ed tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:23.249436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-682a2203-0bdd-47d6-8e69-4e58f28336ed tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:23.255773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-682a2203-0bdd-47d6-8e69-4e58f28336ed tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:23.256229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-682a2203-0bdd-47d6-8e69-4e58f28336ed tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:23.257008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-682a2203-0bdd-47d6-8e69-4e58f28336ed tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:23.257481 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-682a2203-0bdd-47d6-8e69-4e58f28336ed tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:23.307930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:23.608218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-682a2203-0bdd-47d6-8e69-4e58f28336ed tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4112534978ba4622b0fbbb9a92791876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450ad991a3943e3a4c4233551a42729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:23.616496 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-682a2203-0bdd-47d6-8e69-4e58f28336ed tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 200 len: 1331 microversion: 2.1 time: 0.372093 May 28 21:10:23.617460 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1134/2214] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:23 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 1331 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:23.624094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-10cdf1c2-78a9-47df-b00f-c0765cad5ec0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:23.625407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-10cdf1c2-78a9-47df-b00f-c0765cad5ec0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:23.649913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10cdf1c2-78a9-47df-b00f-c0765cad5ec0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:23.650384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10cdf1c2-78a9-47df-b00f-c0765cad5ec0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:23.651195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10cdf1c2-78a9-47df-b00f-c0765cad5ec0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:23.651641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10cdf1c2-78a9-47df-b00f-c0765cad5ec0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:23.997080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-10cdf1c2-78a9-47df-b00f-c0765cad5ec0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:24.005649 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-10cdf1c2-78a9-47df-b00f-c0765cad5ec0 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293" status: 200 len: 1495 microversion: 2.1 time: 0.386592 May 28 21:10:24.006343 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1135/2215] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:23 2022] GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 => generated 1495 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:24.017192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ef2deeb1-771d-4838-9823-49a02f34b3d7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d57971f70>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:24.641543 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ef2deeb1-771d-4838-9823-49a02f34b3d7 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/277ccc1c-782b-4085-bdd0-5b872237dd65" status: 202 len: 0 microversion: 2.1 time: 0.634010 May 28 21:10:24.642776 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1136/2216] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:10:24 2022] DELETE /compute/v2.1/os-security-groups/277ccc1c-782b-4085-bdd0-5b872237dd65 => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:10:24.647661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9109a408-66da-47cc-b5fb-4d75017c35e5 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:24.648105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9109a408-66da-47cc-b5fb-4d75017c35e5 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:24.655106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9109a408-66da-47cc-b5fb-4d75017c35e5 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:24.655584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9109a408-66da-47cc-b5fb-4d75017c35e5 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:24.656367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9109a408-66da-47cc-b5fb-4d75017c35e5 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:24.656812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9109a408-66da-47cc-b5fb-4d75017c35e5 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:24.943855 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1e4c18ac-4dd1-4db7-9c6a-d4ac56bf3473 tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.448120 May 28 21:10:24.952433 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1081/2217] 10.222.0.33 () {60 vars in 1169 bytes} [Sat May 28 21:10:22 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:24.955418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9109a408-66da-47cc-b5fb-4d75017c35e5 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:24.959880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4911456a-0de6-4a9b-afc9-6646e9bc2712 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:24.961041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4911456a-0de6-4a9b-afc9-6646e9bc2712 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:24.967485 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9109a408-66da-47cc-b5fb-4d75017c35e5 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1790 microversion: 2.1 time: 0.323777 May 28 21:10:24.971921 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1137/2218] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:24 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1790 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:24.974487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4911456a-0de6-4a9b-afc9-6646e9bc2712 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:24.976162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4911456a-0de6-4a9b-afc9-6646e9bc2712 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:24.976538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2a4285fb-add1-45ed-b58f-1200bcc8dc8a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:24.978103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4911456a-0de6-4a9b-afc9-6646e9bc2712 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:24.978252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2a4285fb-add1-45ed-b58f-1200bcc8dc8a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:24.978740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4911456a-0de6-4a9b-afc9-6646e9bc2712 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:24.987422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a4285fb-add1-45ed-b58f-1200bcc8dc8a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:24.988162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a4285fb-add1-45ed-b58f-1200bcc8dc8a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:24.989400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a4285fb-add1-45ed-b58f-1200bcc8dc8a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:24.990056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a4285fb-add1-45ed-b58f-1200bcc8dc8a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:25.107311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-2a4285fb-add1-45ed-b58f-1200bcc8dc8a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:25.128508 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2a4285fb-add1-45ed-b58f-1200bcc8dc8a tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1929 microversion: 2.75 time: 0.159408 May 28 21:10:25.141601 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1138/2219] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:24 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1929 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:25.141601 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-5fb2300e-55f0-44d9-9f21-fe64241c335c req-370dcdb0-d373-4552-b640-a842f91f183a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be14fefc-6d15-401c-b5e6-e5edfd7cb9ed", "name": "network-vif-deleted", "tag": "6ecc2ca4-9af3-42ba-ac9f-9102e285c0c2"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:25.143180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5fb2300e-55f0-44d9-9f21-fe64241c335c req-370dcdb0-d373-4552-b640-a842f91f183a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:25.143633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5fb2300e-55f0-44d9-9f21-fe64241c335c req-370dcdb0-d373-4552-b640-a842f91f183a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:25.157324 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-5fb2300e-55f0-44d9-9f21-fe64241c335c req-370dcdb0-d373-4552-b640-a842f91f183a service nova] Creating event network-vif-deleted:6ecc2ca4-9af3-42ba-ac9f-9102e285c0c2 for instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed on nch2-master-1 May 28 21:10:25.163229 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-5fb2300e-55f0-44d9-9f21-fe64241c335c req-370dcdb0-d373-4552-b640-a842f91f183a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032162 May 28 21:10:25.164987 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1139/2220] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:25.169989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a417d003-a47f-431b-ba5a-cc07bff295d9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:25.170684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a417d003-a47f-431b-ba5a-cc07bff295d9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:25.179308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a417d003-a47f-431b-ba5a-cc07bff295d9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:25.180156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a417d003-a47f-431b-ba5a-cc07bff295d9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:25.181739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a417d003-a47f-431b-ba5a-cc07bff295d9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:25.182457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a417d003-a47f-431b-ba5a-cc07bff295d9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:25.203053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4911456a-0de6-4a9b-afc9-6646e9bc2712 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:25.211453 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4911456a-0de6-4a9b-afc9-6646e9bc2712 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1591 microversion: 2.1 time: 0.257426 May 28 21:10:25.216677 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1082/2221] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:24 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1591 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:25.216817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-69bd6285-9ed0-4409-9401-07eee212d9f2 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] Calling method '.version_select at 0x7f4d69c233a0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:25.502627 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a417d003-a47f-431b-ba5a-cc07bff295d9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4112534978ba4622b0fbbb9a92791876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450ad991a3943e3a4c4233551a42729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:25.511195 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a417d003-a47f-431b-ba5a-cc07bff295d9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 200 len: 1534 microversion: 2.1 time: 0.345789 May 28 21:10:25.523768 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1140/2222] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:25 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 1534 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:25.528975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9d44c320-c24b-4e8a-995c-d96df464d3bb tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] Calling method '.version_select at 0x7f4d69d6f550>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:26.149116 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9d44c320-c24b-4e8a-995c-d96df464d3bb tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/560a9d45-2a12-4d49-81b8-06b4c6713b36" status: 200 len: 141 microversion: 2.1 time: 0.623792 May 28 21:10:26.149759 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1141/2223] 10.222.0.33 () {58 vars in 1259 bytes} [Sat May 28 21:10:25 2022] GET /compute/v2.1/os-floating-ips/560a9d45-2a12-4d49-81b8-06b4c6713b36 => generated 141 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:26.155704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6df7eaa6-1872-4c20-9b51-346034ca4f77 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:26.156634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6df7eaa6-1872-4c20-9b51-346034ca4f77 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:26.164082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6df7eaa6-1872-4c20-9b51-346034ca4f77 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:26.164912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6df7eaa6-1872-4c20-9b51-346034ca4f77 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:26.166021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6df7eaa6-1872-4c20-9b51-346034ca4f77 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:26.166675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6df7eaa6-1872-4c20-9b51-346034ca4f77 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:26.194730 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-69bd6285-9ed0-4409-9401-07eee212d9f2 tempest-SecurityGroupsTestJSON-942978443 tempest-SecurityGroupsTestJSON-942978443-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/70e12b53-6e92-4a32-9229-6729d50ebb3f" status: 202 len: 0 microversion: 2.1 time: 0.981580 May 28 21:10:26.195832 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1083/2224] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:10:25 2022] DELETE /compute/v2.1/os-security-groups/70e12b53-6e92-4a32-9229-6729d50ebb3f => generated 0 bytes in 983 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:10:26.202188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aea12f1b-7b01-4469-88c8-479c347cec72 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:26.202709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aea12f1b-7b01-4469-88c8-479c347cec72 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:26.214360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea12f1b-7b01-4469-88c8-479c347cec72 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:26.217281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea12f1b-7b01-4469-88c8-479c347cec72 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:26.217281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea12f1b-7b01-4469-88c8-479c347cec72 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:26.221593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea12f1b-7b01-4469-88c8-479c347cec72 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:26.390263 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aea12f1b-7b01-4469-88c8-479c347cec72 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.191795 May 28 21:10:26.395767 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1084/2225] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:10:26 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a/os-interface => generated 284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:26.398267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a034312b-a332-4942-a800-80588ba2fd08 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Action: 'create', calling method: .version_select at 0x7f4d578759d0>, body: {"pool": "c6a4137f-600a-4b7b-adb7-2b951592ddc4"} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:26.683847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6df7eaa6-1872-4c20-9b51-346034ca4f77 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:26.695567 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6df7eaa6-1872-4c20-9b51-346034ca4f77 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293" status: 200 len: 1478 microversion: 2.1 time: 0.544511 May 28 21:10:26.697166 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1142/2226] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:26 2022] GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 => generated 1478 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:26.709186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e8bfdf68-6352-450a-b633-103d4e6559cb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:26.710342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e8bfdf68-6352-450a-b633-103d4e6559cb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:26.724923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e8bfdf68-6352-450a-b633-103d4e6559cb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:26.727750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e8bfdf68-6352-450a-b633-103d4e6559cb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:26.729260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e8bfdf68-6352-450a-b633-103d4e6559cb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:26.731357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e8bfdf68-6352-450a-b633-103d4e6559cb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:26.937719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e8bfdf68-6352-450a-b633-103d4e6559cb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:26.969036 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e8bfdf68-6352-450a-b633-103d4e6559cb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 200 len: 1568 microversion: 2.1 time: 0.263528 May 28 21:10:26.970137 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1143/2227] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:26 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:26.982971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f29d61ad-8450-4f3c-a3e4-902246e0efcf tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:26.983704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f29d61ad-8450-4f3c-a3e4-902246e0efcf tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:26.993157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f29d61ad-8450-4f3c-a3e4-902246e0efcf tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:26.994160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f29d61ad-8450-4f3c-a3e4-902246e0efcf tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:27.002451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f29d61ad-8450-4f3c-a3e4-902246e0efcf tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:27.003447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f29d61ad-8450-4f3c-a3e4-902246e0efcf tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:27.127578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-f29d61ad-8450-4f3c-a3e4-902246e0efcf tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:27.144836 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f29d61ad-8450-4f3c-a3e4-902246e0efcf tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1929 microversion: 2.75 time: 0.169414 May 28 21:10:27.145427 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1144/2228] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:26 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1929 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:27.149906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f533e677-defa-4371-ba3c-7625058dad6b tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] Calling method '.version_select at 0x7f4d57a12940>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:29.277683 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f533e677-defa-4371-ba3c-7625058dad6b tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/560a9d45-2a12-4d49-81b8-06b4c6713b36" status: 202 len: 0 microversion: 2.1 time: 2.130522 May 28 21:10:29.278592 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1145/2229] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:10:27 2022] DELETE /compute/v2.1/os-floating-ips/560a9d45-2a12-4d49-81b8-06b4c6713b36 => generated 0 bytes in 2133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:10:29.286097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-713ed91a-e179-4068-8ff6-58b04d605c50 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-60515472"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:29.287762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-713ed91a-e179-4068-8ff6-58b04d605c50 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:29.295482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-713ed91a-e179-4068-8ff6-58b04d605c50 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:29.296266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-713ed91a-e179-4068-8ff6-58b04d605c50 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:29.297515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-713ed91a-e179-4068-8ff6-58b04d605c50 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:29.298737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-713ed91a-e179-4068-8ff6-58b04d605c50 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:29.942595 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-713ed91a-e179-4068-8ff6-58b04d605c50 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "POST /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293/action" status: 202 len: 0 microversion: 2.1 time: 0.661260 May 28 21:10:29.946229 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1146/2230] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:10:29 2022] POST /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293/action => generated 0 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 21:10:29.959197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-fe4d45e1-37a4-494c-83ec-01885bb1e6c7 req-d845f6c8-e5dd-4766-bd74-fd77eca78e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be14fefc-6d15-401c-b5e6-e5edfd7cb9ed", "name": "network-vif-deleted", "tag": "b8cae7c2-0fcc-4265-9208-066781bc94b7"}, {"server_uuid": "be14fefc-6d15-401c-b5e6-e5edfd7cb9ed", "name": "network-vif-deleted", "tag": "a80949ec-2a71-4ba2-b4f6-bff628a09248"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:29.976536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-fe4d45e1-37a4-494c-83ec-01885bb1e6c7 req-d845f6c8-e5dd-4766-bd74-fd77eca78e73 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:29.991001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-fe4d45e1-37a4-494c-83ec-01885bb1e6c7 req-d845f6c8-e5dd-4766-bd74-fd77eca78e73 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:30.008922 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-fe4d45e1-37a4-494c-83ec-01885bb1e6c7 req-d845f6c8-e5dd-4766-bd74-fd77eca78e73 service nova] Creating event network-vif-deleted:b8cae7c2-0fcc-4265-9208-066781bc94b7 for instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed on nch2-master-1 May 28 21:10:30.009329 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-fe4d45e1-37a4-494c-83ec-01885bb1e6c7 req-d845f6c8-e5dd-4766-bd74-fd77eca78e73 service nova] Creating event network-vif-deleted:a80949ec-2a71-4ba2-b4f6-bff628a09248 for instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed on nch2-master-1 May 28 21:10:30.019691 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-fe4d45e1-37a4-494c-83ec-01885bb1e6c7 req-d845f6c8-e5dd-4766-bd74-fd77eca78e73 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071920 May 28 21:10:30.020658 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1147/2231] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:30.025915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6fefec15-aa86-4d6d-8b02-2c0783592624 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:30.026644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6fefec15-aa86-4d6d-8b02-2c0783592624 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:30.033540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fefec15-aa86-4d6d-8b02-2c0783592624 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:30.034296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fefec15-aa86-4d6d-8b02-2c0783592624 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:30.035277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fefec15-aa86-4d6d-8b02-2c0783592624 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:30.036003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fefec15-aa86-4d6d-8b02-2c0783592624 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:30.093901 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-6fefec15-aa86-4d6d-8b02-2c0783592624 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] HTTP exception thrown: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6fefec15-aa86-4d6d-8b02-2c0783592624 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Request method failure captured: May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed HTTP/1.1 May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko-GfAmbq19Wzv_IyvJ0froXseFFHax7tRSAMxzOcmJGrgNhnl6GaI4_cqWJ1_mmEzIYwTNYRshjIToYEGaO5q5ats0YCKI_8ETREUpvTBw6IHhnlwFfolTD_fwH7DsbEEqbkIxRvqU_rv_EMuzrUQQcO9LdGvHqdKwJSM18PWYdGQU May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf209a1ba94046f89ddf62c77b6b0f02 May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestMultiNic-1707558365 May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf209a1ba94046f89ddf62c77b6b0f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestMultiNic-1707558365 May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf209a1ba94046f89ddf62c77b6b0f02 May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestMultiNic-1707558365 May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestMultiNic-1707558365-project May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 659bd3ebefc348b7a176379bd342f9ed May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestMultiNic-1707558365-project May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'be14fefc-6d15-401c-b5e6-e5edfd7cb9ed'} May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:30.095992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:30.100553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:30.100553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:30.100553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:30.100553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:30.100553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:30.100553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. May 28 21:10:30.100553 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:30.103232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6fefec15-aa86-4d6d-8b02-2c0783592624 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Returning 404 to user: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:30.105041 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6fefec15-aa86-4d6d-8b02-2c0783592624 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 404 len: 111 microversion: 2.1 time: 0.082815 May 28 21:10:30.108595 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1148/2232] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:30 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:10:30.118612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2eda13e6-9fc8-446f-a8a6-d10d3964bb35 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:30.119564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2eda13e6-9fc8-446f-a8a6-d10d3964bb35 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:30.130423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2eda13e6-9fc8-446f-a8a6-d10d3964bb35 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:30.130890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2eda13e6-9fc8-446f-a8a6-d10d3964bb35 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:30.131944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2eda13e6-9fc8-446f-a8a6-d10d3964bb35 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:30.132442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2eda13e6-9fc8-446f-a8a6-d10d3964bb35 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:30.440882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-2eda13e6-9fc8-446f-a8a6-d10d3964bb35 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:30.461112 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2eda13e6-9fc8-446f-a8a6-d10d3964bb35 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1929 microversion: 2.75 time: 0.351103 May 28 21:10:30.462132 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1149/2233] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:30 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1929 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:30.467456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-674d5811-0d4b-4567-a5ea-71645870bd42 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:30.468322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-674d5811-0d4b-4567-a5ea-71645870bd42 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:30.474580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-674d5811-0d4b-4567-a5ea-71645870bd42 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:30.475341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-674d5811-0d4b-4567-a5ea-71645870bd42 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:30.477177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-674d5811-0d4b-4567-a5ea-71645870bd42 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:30.477921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-674d5811-0d4b-4567-a5ea-71645870bd42 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:30.650875 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a034312b-a332-4942-a800-80588ba2fd08 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.258086 May 28 21:10:30.652113 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1085/2234] 10.222.0.33 () {60 vars in 1169 bytes} [Sat May 28 21:10:26 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:30.660344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-60aea6bd-d893-4fda-8c61-0122c57cdd2a tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] Calling method '.version_select at 0x7f4d5783a1f0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:30.897929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-674d5811-0d4b-4567-a5ea-71645870bd42 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:30.908436 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-674d5811-0d4b-4567-a5ea-71645870bd42 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1591 microversion: 2.1 time: 0.445074 May 28 21:10:30.909028 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1150/2235] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:30 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1591 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:30.914817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d86a89ec-5477-4d33-8f48-6e87db53784e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d579dcd30>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:30.985713 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d86a89ec-5477-4d33-8f48-6e87db53784e tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0" status: 200 len: 1436 microversion: 2.1 time: 0.074580 May 28 21:10:30.995246 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1151/2236] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:10:30 2022] GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 => generated 1436 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:31.002949 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-60aea6bd-d893-4fda-8c61-0122c57cdd2a tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.349556 May 28 21:10:31.003785 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1086/2237] 10.222.0.33 () {58 vars in 1163 bytes} [Sat May 28 21:10:30 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:10:31.010427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-73ecde2a-d8cc-4f5d-9904-a398d698557d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Action: 'action', calling method: .version_select at 0x7f4d66fc35e0>, body: {"addFloatingIp": {"address": "172.35.3.77"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:31.011741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-73ecde2a-d8cc-4f5d-9904-a398d698557d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:31.024202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73ecde2a-d8cc-4f5d-9904-a398d698557d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:31.024677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73ecde2a-d8cc-4f5d-9904-a398d698557d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:31.026531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73ecde2a-d8cc-4f5d-9904-a398d698557d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:31.027182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73ecde2a-d8cc-4f5d-9904-a398d698557d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:31.123940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73ecde2a-d8cc-4f5d-9904-a398d698557d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Acquired lock "refresh_cache-72113f72-3282-428c-b093-b5325dbb5d3e" {{(pid=143129) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 21:10:31.203868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7f615fcb-11f9-45f2-a5bd-f8acaca4d215 tempest-AZV2TestJSON-1202740793 tempest-AZV2TestJSON-1202740793-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:31.207513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f615fcb-11f9-45f2-a5bd-f8acaca4d215 tempest-AZV2TestJSON-1202740793 tempest-AZV2TestJSON-1202740793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:31.208197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f615fcb-11f9-45f2-a5bd-f8acaca4d215 tempest-AZV2TestJSON-1202740793 tempest-AZV2TestJSON-1202740793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:31.214270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f615fcb-11f9-45f2-a5bd-f8acaca4d215 tempest-AZV2TestJSON-1202740793 tempest-AZV2TestJSON-1202740793-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:31.215089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f615fcb-11f9-45f2-a5bd-f8acaca4d215 tempest-AZV2TestJSON-1202740793 tempest-AZV2TestJSON-1202740793-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:31.226989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=23 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:31.260234 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7f615fcb-11f9-45f2-a5bd-f8acaca4d215 tempest-AZV2TestJSON-1202740793 tempest-AZV2TestJSON-1202740793-project] 10.222.0.33 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.262699 May 28 21:10:31.262823 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1152/2238] 10.222.0.33 () {58 vars in 1163 bytes} [Sat May 28 21:10:30 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:10:31.274207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6eb01cab-a24f-4ccd-84bb-e9ac0d30bc28 tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] Calling method '.version_select at 0x7f4d640a7b80>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:31.737462 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6eb01cab-a24f-4ccd-84bb-e9ac0d30bc28 tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.471182 May 28 21:10:31.738805 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1153/2239] 10.222.0.33 () {58 vars in 1148 bytes} [Sat May 28 21:10:31 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:31.745252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f6ceeb89-90a3-43d3-8fb2-6be1cc832c87 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:31.745764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f6ceeb89-90a3-43d3-8fb2-6be1cc832c87 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:31.763045 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6ceeb89-90a3-43d3-8fb2-6be1cc832c87 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:31.763820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6ceeb89-90a3-43d3-8fb2-6be1cc832c87 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:31.768652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6ceeb89-90a3-43d3-8fb2-6be1cc832c87 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:31.769769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6ceeb89-90a3-43d3-8fb2-6be1cc832c87 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:31.891507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-f6ceeb89-90a3-43d3-8fb2-6be1cc832c87 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:31.936307 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f6ceeb89-90a3-43d3-8fb2-6be1cc832c87 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1929 microversion: 2.75 time: 0.196115 May 28 21:10:31.936954 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1154/2240] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:31 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1929 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:31.950402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-859d83be-31fe-43d1-9535-48ec8aef5c44 tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] Calling method '.version_select at 0x7f4d69d6f0d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:32.290105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:34.460925 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-859d83be-31fe-43d1-9535-48ec8aef5c44 tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/7a4f6715-fa8a-4945-abcc-19599b2e68e2" status: 202 len: 0 microversion: 2.1 time: 2.522869 May 28 21:10:34.464622 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1155/2241] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:10:31 2022] DELETE /compute/v2.1/os-floating-ips/7a4f6715-fa8a-4945-abcc-19599b2e68e2 => generated 0 bytes in 2524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:10:34.467204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d7171d60-c1bd-49a4-a491-a5bc061752f7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d640a7160>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:34.556942 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d7171d60-c1bd-49a4-a491-a5bc061752f7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0" status: 200 len: 1436 microversion: 2.1 time: 0.093424 May 28 21:10:34.558637 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1156/2242] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:10:34 2022] GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 => generated 1436 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:34.564636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-c43d6f4e-30a6-44e3-871d-1a3d51e3c0a6 req-4e11afc9-5170-4b58-a6ae-c18b65943eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39db2b33-8e94-4b73-8250-695d7ee9508a", "tag": "6d5785f3-ce68-4bfc-8303-f8e086ad50d5"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:34.577532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c43d6f4e-30a6-44e3-871d-1a3d51e3c0a6 req-4e11afc9-5170-4b58-a6ae-c18b65943eae service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:34.578261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c43d6f4e-30a6-44e3-871d-1a3d51e3c0a6 req-4e11afc9-5170-4b58-a6ae-c18b65943eae service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:34.594795 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-c43d6f4e-30a6-44e3-871d-1a3d51e3c0a6 req-4e11afc9-5170-4b58-a6ae-c18b65943eae service nova] Creating event network-changed:6d5785f3-ce68-4bfc-8303-f8e086ad50d5 for instance 39db2b33-8e94-4b73-8250-695d7ee9508a on nch1-master-1 May 28 21:10:34.601881 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-c43d6f4e-30a6-44e3-871d-1a3d51e3c0a6 req-4e11afc9-5170-4b58-a6ae-c18b65943eae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041398 May 28 21:10:34.603156 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1157/2243] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:34.612423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ae29bb7e-aea5-49ec-91e7-58a80d45aaab tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:34.613510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ae29bb7e-aea5-49ec-91e7-58a80d45aaab tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:34.621031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae29bb7e-aea5-49ec-91e7-58a80d45aaab tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:34.621726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae29bb7e-aea5-49ec-91e7-58a80d45aaab tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:34.622877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae29bb7e-aea5-49ec-91e7-58a80d45aaab tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:34.623485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae29bb7e-aea5-49ec-91e7-58a80d45aaab tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:34.828193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:34.833767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-ae29bb7e-aea5-49ec-91e7-58a80d45aaab tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:34.898354 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ae29bb7e-aea5-49ec-91e7-58a80d45aaab tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1929 microversion: 2.75 time: 0.291251 May 28 21:10:34.899429 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1158/2244] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:34 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1929 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:34.916456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d7704533-4a33-45a8-902e-037cdcca74dc tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] Calling method '.version_select at 0x7f4d69d6f4c0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:35.271454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-73ecde2a-d8cc-4f5d-9904-a398d698557d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Building network info cache for instance {{(pid=143129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 21:10:38.242947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-73ecde2a-d8cc-4f5d-9904-a398d698557d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Updating instance_info_cache with network_info: [{"id": "bb2abcc0-24c9-431a-ad3f-f5bbb1586c09", "address": "fa:16:3e:bc:a4:1a", "network": {"id": "a3273f3e-6cca-4a7f-8661-69d984f551ff", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-84241387-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3450ad991a3943e3a4c4233551a42729", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbb2abcc0-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=143129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 21:10:38.380154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73ecde2a-d8cc-4f5d-9904-a398d698557d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Releasing lock "refresh_cache-72113f72-3282-428c-b093-b5325dbb5d3e" {{(pid=143129) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 21:10:38.381716 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-73ecde2a-d8cc-4f5d-9904-a398d698557d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action" status: 202 len: 0 microversion: 2.1 time: 7.376763 May 28 21:10:38.382972 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1087/2245] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:10:31 2022] POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action => generated 0 bytes in 7378 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 21:10:38.530418 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d7704533-4a33-45a8-902e-037cdcca74dc tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/224f9188-8987-4703-8339-aa8dfc482127" status: 202 len: 0 microversion: 2.1 time: 3.627357 May 28 21:10:38.531090 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1159/2246] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:10:34 2022] DELETE /compute/v2.1/os-floating-ips/224f9188-8987-4703-8339-aa8dfc482127 => generated 0 bytes in 3631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:10:38.536793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ab603672-379d-41f4-8d2e-2e0800d63bb7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d57fb89d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:38.618480 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ab603672-379d-41f4-8d2e-2e0800d63bb7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0" status: 200 len: 1436 microversion: 2.1 time: 0.085818 May 28 21:10:38.627830 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1160/2247] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:10:38 2022] GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 => generated 1436 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:38.655124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cd2706b5-649f-4191-96f5-5f0e5a6273a4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:38.656872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cd2706b5-649f-4191-96f5-5f0e5a6273a4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:38.665806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd2706b5-649f-4191-96f5-5f0e5a6273a4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:38.666577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd2706b5-649f-4191-96f5-5f0e5a6273a4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:38.667631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd2706b5-649f-4191-96f5-5f0e5a6273a4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:38.668303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd2706b5-649f-4191-96f5-5f0e5a6273a4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:38.842982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-91ddf915-e8c2-4973-ad29-6f93da539741 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Action: 'create', calling method: .version_select at 0x7f4d69c25310>, body: {"keypair": {"name": "tempest-keypair-1409767074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhfDwDe49Mo4naWvrf9KBPOV9y2BBbGoeAapj+MyUQqx+hdlx9VE5xTD4ZH+oPehLaVdAE5lfoJJnKXqb0pEEfWt+UMxE7+lMMiwErgDEYJHFFV7zcRHCbnJtJ3Fqr95g=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:38.860544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-91ddf915-e8c2-4973-ad29-6f93da539741 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Getting quotas for project b4be72b7f8c54528b1c0a2a1505416c1. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:10:38.868941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-91ddf915-e8c2-4973-ad29-6f93da539741 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Getting quotas for user 94f224e3fd2142d0991cb173e2a2c880 and project b4be72b7f8c54528b1c0a2a1505416c1. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:10:38.979659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-cd2706b5-649f-4191-96f5-5f0e5a6273a4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:38.989402 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-91ddf915-e8c2-4973-ad29-6f93da539741 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.603943 May 28 21:10:38.990422 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1088/2248] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:10:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:38.996807 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-43a65621-de56-42b7-87fe-9aed1d51f8db req-ece32c9f-32c4-4851-b398-3937f01fe6bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d508d555-a95e-4d29-a6e7-812145ba9293", "name": "network-vif-plugged", "status": "completed", "tag": "db2ef97b-cc75-4a42-b69e-a29b12d74688"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:39.011410 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cd2706b5-649f-4191-96f5-5f0e5a6273a4 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1929 microversion: 2.75 time: 0.382011 May 28 21:10:39.017030 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1161/2249] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:38 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1929 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:39.022160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-f366a256-3eca-43d7-9d14-4a1d0bbe7af5 req-5ed70aa5-d46d-48de-81cb-73845ca88ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72113f72-3282-428c-b093-b5325dbb5d3e", "tag": "bb2abcc0-24c9-431a-ad3f-f5bbb1586c09"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:39.028208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-43a65621-de56-42b7-87fe-9aed1d51f8db req-ece32c9f-32c4-4851-b398-3937f01fe6bf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:39.031833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f366a256-3eca-43d7-9d14-4a1d0bbe7af5 req-5ed70aa5-d46d-48de-81cb-73845ca88ed8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:39.033376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f366a256-3eca-43d7-9d14-4a1d0bbe7af5 req-5ed70aa5-d46d-48de-81cb-73845ca88ed8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:39.033525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-43a65621-de56-42b7-87fe-9aed1d51f8db req-ece32c9f-32c4-4851-b398-3937f01fe6bf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:39.050354 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-f366a256-3eca-43d7-9d14-4a1d0bbe7af5 req-5ed70aa5-d46d-48de-81cb-73845ca88ed8 service nova] Creating event network-changed:bb2abcc0-24c9-431a-ad3f-f5bbb1586c09 for instance 72113f72-3282-428c-b093-b5325dbb5d3e on nch2-master-1 May 28 21:10:39.056631 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-f366a256-3eca-43d7-9d14-4a1d0bbe7af5 req-5ed70aa5-d46d-48de-81cb-73845ca88ed8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038035 May 28 21:10:39.057640 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1162/2250] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:39.063400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e2a98a8b-3398-45ec-9642-83fa7e397105 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Action: 'create', calling method: .version_select at 0x7f4d64545b80>, body: {"pool": "c6a4137f-600a-4b7b-adb7-2b951592ddc4"} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:39.080845 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-43a65621-de56-42b7-87fe-9aed1d51f8db req-ece32c9f-32c4-4851-b398-3937f01fe6bf service nova] Creating event network-vif-plugged:db2ef97b-cc75-4a42-b69e-a29b12d74688 for instance d508d555-a95e-4d29-a6e7-812145ba9293 on nch1-master-1 May 28 21:10:39.099758 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-43a65621-de56-42b7-87fe-9aed1d51f8db req-ece32c9f-32c4-4851-b398-3937f01fe6bf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107231 May 28 21:10:39.102249 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1089/2251] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:39.109555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-464fb97a-a5bd-4373-b3d9-9f748a63490e tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] Calling method '.version_select at 0x7f4d5784c790>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:41.546522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:43.148063 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-464fb97a-a5bd-4373-b3d9-9f748a63490e tempest-FloatingIPDetailsTestJSON-2132298805 tempest-FloatingIPDetailsTestJSON-2132298805-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/8efcef9d-7f5e-4cef-a98c-816f37c0c158" status: 202 len: 0 microversion: 2.1 time: 4.042670 May 28 21:10:43.149982 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1090/2252] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:10:39 2022] DELETE /compute/v2.1/os-floating-ips/8efcef9d-7f5e-4cef-a98c-816f37c0c158 => generated 0 bytes in 4047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:10:43.156965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-693a3013-c9f2-4831-b756-14b438f32091 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d69c254c0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:43.262471 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-693a3013-c9f2-4831-b756-14b438f32091 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0" status: 200 len: 1436 microversion: 2.1 time: 0.111107 May 28 21:10:43.264382 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1091/2253] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:10:43 2022] GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 => generated 1436 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:43.298908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2a6be318-fb51-485f-bb65-abbed37654f9 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:43.300956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2a6be318-fb51-485f-bb65-abbed37654f9 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:43.323480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a6be318-fb51-485f-bb65-abbed37654f9 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:43.342736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a6be318-fb51-485f-bb65-abbed37654f9 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:43.342736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a6be318-fb51-485f-bb65-abbed37654f9 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:43.342736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a6be318-fb51-485f-bb65-abbed37654f9 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:44.041282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-2a6be318-fb51-485f-bb65-abbed37654f9 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] Lazy-loading 'services' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:44.090142 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2a6be318-fb51-485f-bb65-abbed37654f9 tempest-ServersAdmin275Test-447539229 tempest-ServersAdmin275Test-447539229-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1920 microversion: 2.75 time: 0.824416 May 28 21:10:44.091414 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1092/2254] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:43 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1920 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:44.155960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1629349445", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "4688fc3e-7c0b-4b45-bce6-c3e05e995935"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:44.258481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] validate_networks() for [('4688fc3e-7c0b-4b45-bce6-c3e05e995935', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:10:44.638175 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e2a98a8b-3398-45ec-9642-83fa7e397105 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.578936 May 28 21:10:44.639551 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1163/2255] 10.222.0.33 () {60 vars in 1169 bytes} [Sat May 28 21:10:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:44.655376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-514497143", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "542c40ab-5238-4ecb-bdd9-d7706af8d6f2"}, {"uuid": "7310967c-d338-4221-a038-76591cc41bf0"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:44.778800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] validate_networks() for [('542c40ab-5238-4ecb-bdd9-d7706af8d6f2', None, None, None, None, None), ('7310967c-d338-4221-a038-76591cc41bf0', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:10:45.452898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:10:45.452898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:10:45.452898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:10:45.452898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:10:45.452898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:10:45.467118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:45.467588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:45.468420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:45.468941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:45.542643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Getting quotas for project cf04fd760c54473f83980a385252fa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:10:45.552172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Getting quotas for user bf9c8f66e7d24ca9baca835e41546f22 and project cf04fd760c54473f83980a385252fa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:10:45.585586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:10:45.596630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:10:45.771827 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1131c119-d899-40a4-992e-7b9d4a105ef8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.678985 May 28 21:10:45.772457 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1093/2256] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:10:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:10:45.780303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8c9a7506-60f3-4dcd-83a0-3c7d191db8cb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:45.780303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8c9a7506-60f3-4dcd-83a0-3c7d191db8cb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:45.786187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c9a7506-60f3-4dcd-83a0-3c7d191db8cb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:45.786717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c9a7506-60f3-4dcd-83a0-3c7d191db8cb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:45.789063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c9a7506-60f3-4dcd-83a0-3c7d191db8cb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:45.789579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c9a7506-60f3-4dcd-83a0-3c7d191db8cb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:45.831722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8c9a7506-60f3-4dcd-83a0-3c7d191db8cb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:10:46.222285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:10:46.222782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:10:46.223417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:10:46.223951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:10:46.224455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:10:46.262711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:46.269327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:46.272227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:46.273390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:46.351637 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8c9a7506-60f3-4dcd-83a0-3c7d191db8cb tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 204 len: 0 microversion: 2.75 time: 0.577745 May 28 21:10:46.356418 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1094/2257] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:10:45 2022] DELETE /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 0 bytes in 583 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:10:46.375816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-109f21d5-b26a-4321-9482-a95eea39cc40 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d69cbfa60>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:46.393246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Getting quotas for project cf209a1ba94046f89ddf62c77b6b0f02. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:10:46.400225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Getting quotas for user 659bd3ebefc348b7a176379bd342f9ed and project cf209a1ba94046f89ddf62c77b6b0f02. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:10:46.421371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:10:46.435611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:10:46.521243 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-109f21d5-b26a-4321-9482-a95eea39cc40 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0" status: 200 len: 1436 microversion: 2.1 time: 0.160688 May 28 21:10:46.530454 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1095/2258] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:10:46 2022] GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 => generated 1436 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:46.541663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f95fd756-c8d3-4c48-bb6e-b0e072f0f9a9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.102"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:46.549255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f95fd756-c8d3-4c48-bb6e-b0e072f0f9a9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:46.563861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f95fd756-c8d3-4c48-bb6e-b0e072f0f9a9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:46.564334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f95fd756-c8d3-4c48-bb6e-b0e072f0f9a9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:46.565478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f95fd756-c8d3-4c48-bb6e-b0e072f0f9a9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:46.566223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f95fd756-c8d3-4c48-bb6e-b0e072f0f9a9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:46.608991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f95fd756-c8d3-4c48-bb6e-b0e072f0f9a9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Acquired lock "refresh_cache-72113f72-3282-428c-b093-b5325dbb5d3e" {{(pid=143129) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 21:10:46.724241 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-565bd4ca-2a47-4604-a876-c86791d617e6 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.081360 May 28 21:10:46.726853 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1164/2259] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:10:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:10:46.739827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-32b83ab2-f30f-42ab-a4c1-e8ff285b4b2c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:46.741429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-32b83ab2-f30f-42ab-a4c1-e8ff285b4b2c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:47.145356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-32b83ab2-f30f-42ab-a4c1-e8ff285b4b2c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:47.166263 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-32b83ab2-f30f-42ab-a4c1-e8ff285b4b2c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 200 len: 1215 microversion: 2.1 time: 0.436855 May 28 21:10:47.169940 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1165/2260] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:46 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 1215 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:47.184106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f052a8da-c25d-45f0-8ffd-859a9ab6ce6f tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:47.185493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f052a8da-c25d-45f0-8ffd-859a9ab6ce6f tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:47.202725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f052a8da-c25d-45f0-8ffd-859a9ab6ce6f tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:47.202725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f052a8da-c25d-45f0-8ffd-859a9ab6ce6f tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:47.202725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f052a8da-c25d-45f0-8ffd-859a9ab6ce6f tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:47.202725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f052a8da-c25d-45f0-8ffd-859a9ab6ce6f tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:47.555981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f052a8da-c25d-45f0-8ffd-859a9ab6ce6f tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:47.567626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f052a8da-c25d-45f0-8ffd-859a9ab6ce6f tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:47.571124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f052a8da-c25d-45f0-8ffd-859a9ab6ce6f tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:47.612454 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f052a8da-c25d-45f0-8ffd-859a9ab6ce6f tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1444 microversion: 2.75 time: 0.440274 May 28 21:10:47.615979 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1166/2261] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:47 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1444 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:10:47.621761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ba8b851-2e7f-421a-9ec3-e463a71a91fb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:47.640919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8ba8b851-2e7f-421a-9ec3-e463a71a91fb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:47.906028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8ba8b851-2e7f-421a-9ec3-e463a71a91fb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:47.913236 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8ba8b851-2e7f-421a-9ec3-e463a71a91fb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1212 microversion: 2.1 time: 0.295276 May 28 21:10:47.918687 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1167/2262] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:47 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1212 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:47.927268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f999665b-2696-4d9a-94f2-ac55156f813b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d646154c0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:48.012955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG neutronclient.v2_0.client [None req-f95fd756-c8d3-4c48-bb6e-b0e072f0f9a9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.3.102 (8c727a11-25f4-4487-ae7c-1218b45d4f0e) with port bb2abcc0-24c9-431a-ad3f-f5bbb1586c09 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network c6a4137f-600a-4b7b-adb7-2b951592ddc4.", "detail": ""}} {{(pid=143129) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:10:48.012955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f95fd756-c8d3-4c48-bb6e-b0e072f0f9a9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Releasing lock "refresh_cache-72113f72-3282-428c-b093-b5325dbb5d3e" {{(pid=143129) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 21:10:48.013530 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-f95fd756-c8d3-4c48-bb6e-b0e072f0f9a9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] HTTP exception thrown: Cannot associate floating IP 172.35.3.102 (8c727a11-25f4-4487-ae7c-1218b45d4f0e) with port bb2abcc0-24c9-431a-ad3f-f5bbb1586c09 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network c6a4137f-600a-4b7b-adb7-2b951592ddc4. May 28 21:10:48.013530 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-8911413e-60a9-41c4-9e66-ea1c6bc9253d'] May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f95fd756-c8d3-4c48-bb6e-b0e072f0f9a9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Request method failure captured: May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action HTTP/1.1 May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 46 May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko-oacKx8wEbxeovtNO2x7L8G04r2cMzfghbXYI8L3KA7iRtgt1LpnAtzwfnzY8g-CR1ueitDegALDJ8p2eRX-PJAhT6RKF0i-ifIGpBbkWf4IDJzprEwl_BzH0a00f2j8eeAqTGltgVNx-NMvfPU1msLCWB68-eJvw64s1J5APWZWc May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 3450ad991a3943e3a4c4233551a42729 May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3450ad991a3943e3a4c4233551a42729", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3450ad991a3943e3a4c4233551a42729"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3450ad991a3943e3a4c4233551a42729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3450ad991a3943e3a4c4233551a42729"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 3450ad991a3943e3a4c4233551a42729 May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 4112534978ba4622b0fbbb9a92791876 May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: {"addFloatingIp": {"address": "172.35.3.102"}} May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: exception: Cannot associate floating IP 172.35.3.102 (8c727a11-25f4-4487-ae7c-1218b45d4f0e) with port bb2abcc0-24c9-431a-ad3f-f5bbb1586c09 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network c6a4137f-600a-4b7b-adb7-2b951592ddc4. May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-8911413e-60a9-41c4-9e66-ea1c6bc9253d'] May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '72113f72-3282-428c-b093-b5325dbb5d3e', 'body': {'addFloatingIp': {'address': '172.35.3.102'}}} May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2689, in associate_floating_ip May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:10:48.016127 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.3.102 (8c727a11-25f4-4487-ae7c-1218b45d4f0e) with port bb2abcc0-24c9-431a-ad3f-f5bbb1586c09 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network c6a4137f-600a-4b7b-adb7-2b951592ddc4. May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8911413e-60a9-41c4-9e66-ea1c6bc9253d'] May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2691, in associate_floating_ip May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.3.102 (8c727a11-25f4-4487-ae7c-1218b45d4f0e) with port bb2abcc0-24c9-431a-ad3f-f5bbb1586c09 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network c6a4137f-600a-4b7b-adb7-2b951592ddc4. May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8911413e-60a9-41c4-9e66-ea1c6bc9253d'] May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.3.102 (8c727a11-25f4-4487-ae7c-1218b45d4f0e) with port bb2abcc0-24c9-431a-ad3f-f5bbb1586c09 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network c6a4137f-600a-4b7b-adb7-2b951592ddc4. May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8911413e-60a9-41c4-9e66-ea1c6bc9253d'] May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.3.102 (8c727a11-25f4-4487-ae7c-1218b45d4f0e) with port bb2abcc0-24c9-431a-ad3f-f5bbb1586c09 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network c6a4137f-600a-4b7b-adb7-2b951592ddc4. May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8911413e-60a9-41c4-9e66-ea1c6bc9253d'] May 28 21:10:48.020831 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:48.032579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f95fd756-c8d3-4c48-bb6e-b0e072f0f9a9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Returning 400 to user: Cannot associate floating IP 172.35.3.102 (8c727a11-25f4-4487-ae7c-1218b45d4f0e) with port bb2abcc0-24c9-431a-ad3f-f5bbb1586c09 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network c6a4137f-600a-4b7b-adb7-2b951592ddc4. May 28 21:10:48.032579 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-8911413e-60a9-41c4-9e66-ea1c6bc9253d'] {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:48.033314 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f999665b-2696-4d9a-94f2-ac55156f813b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0" status: 200 len: 1436 microversion: 2.1 time: 0.108118 May 28 21:10:48.033489 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f95fd756-c8d3-4c48-bb6e-b0e072f0f9a9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action" status: 400 len: 382 microversion: 2.1 time: 1.500799 May 28 21:10:48.033670 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1168/2263] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:10:47 2022] GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 => generated 1436 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:48.033856 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1096/2264] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:10:46 2022] POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action => generated 382 bytes in 1502 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:10:48.050307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fe0299b9-c20f-46e5-ac24-871fc61e79c9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '.version_select at 0x7f4d643f70d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:48.184400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d811ee58-4ba7-470e-9eb6-f49d6a9aab87 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:48.186171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d811ee58-4ba7-470e-9eb6-f49d6a9aab87 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:48.188543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:48.202505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d811ee58-4ba7-470e-9eb6-f49d6a9aab87 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:48.203081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d811ee58-4ba7-470e-9eb6-f49d6a9aab87 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:48.204058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d811ee58-4ba7-470e-9eb6-f49d6a9aab87 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:48.205608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d811ee58-4ba7-470e-9eb6-f49d6a9aab87 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:48.221109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=74,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:48.359425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d811ee58-4ba7-470e-9eb6-f49d6a9aab87 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:48.375130 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d811ee58-4ba7-470e-9eb6-f49d6a9aab87 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 200 len: 1211 microversion: 2.1 time: 0.194432 May 28 21:10:48.382303 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1097/2265] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:48 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 1211 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:48.633071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cf8e041c-2242-40e4-b3b2-418c7b44de1d tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:48.633706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cf8e041c-2242-40e4-b3b2-418c7b44de1d tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:48.649555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf8e041c-2242-40e4-b3b2-418c7b44de1d tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:48.650064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf8e041c-2242-40e4-b3b2-418c7b44de1d tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:48.651048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf8e041c-2242-40e4-b3b2-418c7b44de1d tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:48.655102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf8e041c-2242-40e4-b3b2-418c7b44de1d tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:48.896723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cf8e041c-2242-40e4-b3b2-418c7b44de1d tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:48.914527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cf8e041c-2242-40e4-b3b2-418c7b44de1d tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:48.917270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cf8e041c-2242-40e4-b3b2-418c7b44de1d tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:48.927427 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cf8e041c-2242-40e4-b3b2-418c7b44de1d tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1444 microversion: 2.75 time: 0.298193 May 28 21:10:48.941053 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1098/2266] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:48 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1444 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:10:48.947230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b83854cb-3829-40d1-bdab-3d2d252f4449 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:48.948100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b83854cb-3829-40d1-bdab-3d2d252f4449 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:48.956775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b83854cb-3829-40d1-bdab-3d2d252f4449 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:48.957544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b83854cb-3829-40d1-bdab-3d2d252f4449 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:48.959217 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b83854cb-3829-40d1-bdab-3d2d252f4449 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:48.959876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b83854cb-3829-40d1-bdab-3d2d252f4449 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:49.135145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b83854cb-3829-40d1-bdab-3d2d252f4449 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:49.155052 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b83854cb-3829-40d1-bdab-3d2d252f4449 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1208 microversion: 2.1 time: 0.212269 May 28 21:10:49.156472 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1099/2267] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:48 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1208 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:49.171580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0ce450f2-4946-42d4-a6ff-6171b47c3983 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d69cca1f0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:49.261197 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0ce450f2-4946-42d4-a6ff-6171b47c3983 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0" status: 200 len: 1436 microversion: 2.1 time: 0.103375 May 28 21:10:49.262138 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1100/2268] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:10:49 2022] GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 => generated 1436 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:49.407486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8fe9b5ba-1998-48fe-af41-a40140bdde0b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:49.410873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8fe9b5ba-1998-48fe-af41-a40140bdde0b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:49.417181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fe9b5ba-1998-48fe-af41-a40140bdde0b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:49.417964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fe9b5ba-1998-48fe-af41-a40140bdde0b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:49.419536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fe9b5ba-1998-48fe-af41-a40140bdde0b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:49.420160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fe9b5ba-1998-48fe-af41-a40140bdde0b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:49.532413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8fe9b5ba-1998-48fe-af41-a40140bdde0b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:49.573595 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8fe9b5ba-1998-48fe-af41-a40140bdde0b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 200 len: 1275 microversion: 2.1 time: 0.173636 May 28 21:10:49.577145 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1101/2269] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:49 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 1275 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:49.873079 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fe0299b9-c20f-46e5-ac24-871fc61e79c9 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/8c727a11-25f4-4487-ae7c-1218b45d4f0e" status: 202 len: 0 microversion: 2.1 time: 1.826578 May 28 21:10:49.877435 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1169/2270] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:10:48 2022] DELETE /compute/v2.1/os-floating-ips/8c727a11-25f4-4487-ae7c-1218b45d4f0e => generated 0 bytes in 1828 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:10:49.883058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ff7356f9-3c7d-4a71-9bbf-64f0f858ec77 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Action: 'action', calling method: .version_select at 0x7f4d66db0b80>, body: {"removeFloatingIp": {"address": "172.35.3.77"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:49.952469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-33d282cb-615a-4066-8476-7927ade3320b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:49.953519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-33d282cb-615a-4066-8476-7927ade3320b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:49.963267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:49.965640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33d282cb-615a-4066-8476-7927ade3320b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:49.967029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33d282cb-615a-4066-8476-7927ade3320b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:49.971937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33d282cb-615a-4066-8476-7927ade3320b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:49.971937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33d282cb-615a-4066-8476-7927ade3320b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:50.043023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33d282cb-615a-4066-8476-7927ade3320b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:50.043619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33d282cb-615a-4066-8476-7927ade3320b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:50.044407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-33d282cb-615a-4066-8476-7927ade3320b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lazy-loading 'fault' on Instance uuid ecc93177-f64d-46b3-894f-ae0e9d88609f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:10:50.162213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-33d282cb-615a-4066-8476-7927ade3320b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:50.172983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-33d282cb-615a-4066-8476-7927ade3320b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:50.174829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-33d282cb-615a-4066-8476-7927ade3320b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0cec7231f1c1445f965d620ae70e8463', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ccf44d7826045cfa5d4c6e87290d9d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:50.180788 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-33d282cb-615a-4066-8476-7927ade3320b tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 200 len: 1449 microversion: 2.75 time: 0.236515 May 28 21:10:50.193504 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1170/2271] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:49 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 1449 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:10:50.193504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6b68eb24-8b37-4210-bc42-81ea552916ae tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:50.193504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6b68eb24-8b37-4210-bc42-81ea552916ae tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:50.198161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b68eb24-8b37-4210-bc42-81ea552916ae tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:50.198630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b68eb24-8b37-4210-bc42-81ea552916ae tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:50.199425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b68eb24-8b37-4210-bc42-81ea552916ae tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:50.199875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b68eb24-8b37-4210-bc42-81ea552916ae tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:50.230351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ff7356f9-3c7d-4a71-9bbf-64f0f858ec77 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:50.335872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff7356f9-3c7d-4a71-9bbf-64f0f858ec77 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:50.335872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff7356f9-3c7d-4a71-9bbf-64f0f858ec77 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:50.335872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff7356f9-3c7d-4a71-9bbf-64f0f858ec77 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:50.335872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff7356f9-3c7d-4a71-9bbf-64f0f858ec77 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:50.338159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6b68eb24-8b37-4210-bc42-81ea552916ae tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:50.338159 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6b68eb24-8b37-4210-bc42-81ea552916ae tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1272 microversion: 2.1 time: 0.140832 May 28 21:10:50.338159 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1171/2272] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:50 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1272 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:50.338159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0d0b0891-5f99-4e89-90cf-3d0bdad67972 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d64846550>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:50.387612 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0d0b0891-5f99-4e89-90cf-3d0bdad67972 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0" status: 200 len: 1436 microversion: 2.1 time: 0.062408 May 28 21:10:50.391020 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1172/2273] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:10:50 2022] GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 => generated 1436 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:50.596204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1431f272-f29a-4ea0-86c8-14671e55020b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:50.597119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1431f272-f29a-4ea0-86c8-14671e55020b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:50.614033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1431f272-f29a-4ea0-86c8-14671e55020b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:50.618427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1431f272-f29a-4ea0-86c8-14671e55020b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:50.630255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1431f272-f29a-4ea0-86c8-14671e55020b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:50.631099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1431f272-f29a-4ea0-86c8-14671e55020b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:51.237613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1431f272-f29a-4ea0-86c8-14671e55020b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:51.248687 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1431f272-f29a-4ea0-86c8-14671e55020b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 200 len: 1273 microversion: 2.1 time: 0.655694 May 28 21:10:51.250650 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1173/2274] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:50 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 1273 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:51.264016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6aae6180-cbfa-4f43-9c9b-d7a70fc1d645 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:51.265500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6aae6180-cbfa-4f43-9c9b-d7a70fc1d645 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] [instance: ecc93177-f64d-46b3-894f-ae0e9d88609f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:51.285689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6aae6180-cbfa-4f43-9c9b-d7a70fc1d645 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:51.286585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6aae6180-cbfa-4f43-9c9b-d7a70fc1d645 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:51.287554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6aae6180-cbfa-4f43-9c9b-d7a70fc1d645 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:51.288327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6aae6180-cbfa-4f43-9c9b-d7a70fc1d645 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:51.316141 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-6aae6180-cbfa-4f43-9c9b-d7a70fc1d645 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] HTTP exception thrown: Instance ecc93177-f64d-46b3-894f-ae0e9d88609f could not be found. May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6aae6180-cbfa-4f43-9c9b-d7a70fc1d645 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Request method failure captured: May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f HTTP/1.1 May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko-Cog3fIY6w70oU50MgRhDcdtt6aZ1l6IJqb1nW71mSGVdyJNkascHQD-_cIUDAcp2NsYKLJuFzGJVYseBxEMWjBJyKSvWs-HUr4Y4pflnn0FHIAmbGORNbnmWTNlNUEPkHH_aSrdxI0LRcCzP1Rnp87cVTFRwBcj11FU5uasichBo May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Openstack-Nova-Api-Version: 2.75 May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 9ccf44d7826045cfa5d4c6e87290d9d2 May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersAdmin275Test-1843836335 May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9ccf44d7826045cfa5d4c6e87290d9d2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9ccf44d7826045cfa5d4c6e87290d9d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9ccf44d7826045cfa5d4c6e87290d9d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9ccf44d7826045cfa5d4c6e87290d9d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersAdmin275Test-1843836335 May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 9ccf44d7826045cfa5d4c6e87290d9d2 May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersAdmin275Test-1843836335 May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersAdmin275Test-1843836335-project May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 0cec7231f1c1445f965d620ae70e8463 May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersAdmin275Test-1843836335-project May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance ecc93177-f64d-46b3-894f-ae0e9d88609f could not be found. May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ecc93177-f64d-46b3-894f-ae0e9d88609f'} May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc93177-f64d-46b3-894f-ae0e9d88609f could not be found. May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc93177-f64d-46b3-894f-ae0e9d88609f could not be found. May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:51.320075 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:51.331520 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:51.331520 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:51.331520 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:51.331520 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:51.331520 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:51.331520 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc93177-f64d-46b3-894f-ae0e9d88609f could not be found. May 28 21:10:51.331520 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:51.331520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6aae6180-cbfa-4f43-9c9b-d7a70fc1d645 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] Returning 404 to user: Instance ecc93177-f64d-46b3-894f-ae0e9d88609f could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:51.331520 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6aae6180-cbfa-4f43-9c9b-d7a70fc1d645 tempest-ServersAdmin275Test-1843836335 tempest-ServersAdmin275Test-1843836335-project] 10.222.0.33 "GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f" status: 404 len: 111 microversion: 2.75 time: 0.073270 May 28 21:10:51.337359 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1174/2275] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:10:51 2022] GET /compute/v2.1/servers/ecc93177-f64d-46b3-894f-ae0e9d88609f => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:10:51.352330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-25831311-001a-4322-aed0-79cfc5e91cf9 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:51.353179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-25831311-001a-4322-aed0-79cfc5e91cf9 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:51.374091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff7356f9-3c7d-4a71-9bbf-64f0f858ec77 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Acquired lock "refresh_cache-72113f72-3282-428c-b093-b5325dbb5d3e" {{(pid=143129) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 21:10:51.379900 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25831311-001a-4322-aed0-79cfc5e91cf9 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:51.380468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25831311-001a-4322-aed0-79cfc5e91cf9 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:51.381148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25831311-001a-4322-aed0-79cfc5e91cf9 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:51.381595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25831311-001a-4322-aed0-79cfc5e91cf9 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:51.539342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-25831311-001a-4322-aed0-79cfc5e91cf9 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:51.554914 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-25831311-001a-4322-aed0-79cfc5e91cf9 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1270 microversion: 2.1 time: 0.203911 May 28 21:10:51.556172 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1175/2276] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:51 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1270 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:10:51.563715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4d78d856-33e0-4378-afad-e0e24fb764d2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d57a364c0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:51.649469 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4d78d856-33e0-4378-afad-e0e24fb764d2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0" status: 200 len: 1436 microversion: 2.1 time: 0.091932 May 28 21:10:51.655922 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1176/2277] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:10:51 2022] GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 => generated 1436 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:52.267300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e6cdbd6e-43d4-40a7-85fe-ce878a047029 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:52.268902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e6cdbd6e-43d4-40a7-85fe-ce878a047029 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:52.276795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6cdbd6e-43d4-40a7-85fe-ce878a047029 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:52.277604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6cdbd6e-43d4-40a7-85fe-ce878a047029 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:52.281980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6cdbd6e-43d4-40a7-85fe-ce878a047029 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:52.281980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6cdbd6e-43d4-40a7-85fe-ce878a047029 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:52.861186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e6cdbd6e-43d4-40a7-85fe-ce878a047029 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:52.870149 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e6cdbd6e-43d4-40a7-85fe-ce878a047029 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 200 len: 1315 microversion: 2.1 time: 0.608185 May 28 21:10:52.885107 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1177/2278] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:52 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 1315 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:10:52.910204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4ec75db5-5c6c-4e5c-9bd3-c8ee2f562927 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:52.911190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4ec75db5-5c6c-4e5c-9bd3-c8ee2f562927 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:52.937531 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ec75db5-5c6c-4e5c-9bd3-c8ee2f562927 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:52.945065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ec75db5-5c6c-4e5c-9bd3-c8ee2f562927 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:52.950453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ec75db5-5c6c-4e5c-9bd3-c8ee2f562927 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:52.952042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ec75db5-5c6c-4e5c-9bd3-c8ee2f562927 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:53.461739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4ec75db5-5c6c-4e5c-9bd3-c8ee2f562927 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:53.471887 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4ec75db5-5c6c-4e5c-9bd3-c8ee2f562927 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1312 microversion: 2.1 time: 0.590663 May 28 21:10:53.474520 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1178/2279] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:52 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1312 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:53.482234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f5277dde-d625-459c-84ab-c53abc958ae7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d64c9bee0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:53.571689 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f5277dde-d625-459c-84ab-c53abc958ae7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0" status: 200 len: 1436 microversion: 2.1 time: 0.093230 May 28 21:10:53.578737 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1179/2280] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:10:53 2022] GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 => generated 1436 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:53.588394 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1972449821", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b9b99dfb-f873-4142-a539-c8e455b5e2e0"}], "security_groups": [{"name": "tempest-securitygroup--1279393674"}], "key_name": "tempest-keypair-1409767074", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "305738dc-96e3-44a1-968b-a25b737a3d47", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:53.921174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] validate_networks() for [('b9b99dfb-f873-4142-a539-c8e455b5e2e0', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:10:54.081803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-ff7356f9-3c7d-4a71-9bbf-64f0f858ec77 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Building network info cache for instance {{(pid=143129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 21:10:55.498041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:55.585552 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=10 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:10:55.937271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Getting quotas for project b4be72b7f8c54528b1c0a2a1505416c1. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:10:55.946597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Getting quotas for user 94f224e3fd2142d0991cb173e2a2c880 and project b4be72b7f8c54528b1c0a2a1505416c1. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:10:55.963403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:10:55.964050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:10:55.965409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:10:55.977487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:10:55.978076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:10:55.989104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:55.989755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:55.990542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:55.990978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:56.024114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Getting quotas for project b4be72b7f8c54528b1c0a2a1505416c1. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:10:56.034895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Getting quotas for user 94f224e3fd2142d0991cb173e2a2c880 and project b4be72b7f8c54528b1c0a2a1505416c1. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:10:56.134676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:10:56.136802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='305738dc-96e3-44a1-968b-a25b737a3d47',volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:10:56.292626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-ff7356f9-3c7d-4a71-9bbf-64f0f858ec77 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Updating instance_info_cache with network_info: [{"id": "bb2abcc0-24c9-431a-ad3f-f5bbb1586c09", "address": "fa:16:3e:bc:a4:1a", "network": {"id": "a3273f3e-6cca-4a7f-8661-69d984f551ff", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-84241387-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "3450ad991a3943e3a4c4233551a42729", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapbb2abcc0-24", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=143129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 21:10:56.438394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff7356f9-3c7d-4a71-9bbf-64f0f858ec77 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Releasing lock "refresh_cache-72113f72-3282-428c-b093-b5325dbb5d3e" {{(pid=143129) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 21:10:56.439333 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ff7356f9-3c7d-4a71-9bbf-64f0f858ec77 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action" status: 202 len: 0 microversion: 2.1 time: 6.560896 May 28 21:10:56.440572 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1102/2281] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:10:49 2022] POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action => generated 0 bytes in 6563 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 21:10:56.445784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0a2ad2d1-881b-420a-98ad-d17e7a9e2c4a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:56.446695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0a2ad2d1-881b-420a-98ad-d17e7a9e2c4a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:56.470968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a2ad2d1-881b-420a-98ad-d17e7a9e2c4a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:56.471660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a2ad2d1-881b-420a-98ad-d17e7a9e2c4a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:56.472670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a2ad2d1-881b-420a-98ad-d17e7a9e2c4a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:56.476072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a2ad2d1-881b-420a-98ad-d17e7a9e2c4a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:56.860749 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-71dad75e-b069-4965-afb2-392395a0540f tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 3.286554 May 28 21:10:56.861428 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1180/2282] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:10:53 2022] POST /compute/v2.1/servers => generated 407 bytes in 3288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:10:56.878095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-b388d520-f05d-4b0b-95a9-ddb37f3763ae req-67b2d89a-721c-4571-83a1-3a6e40634bed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72113f72-3282-428c-b093-b5325dbb5d3e", "tag": "bb2abcc0-24c9-431a-ad3f-f5bbb1586c09"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:56.882566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0a2ad2d1-881b-420a-98ad-d17e7a9e2c4a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:56.885797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b388d520-f05d-4b0b-95a9-ddb37f3763ae req-67b2d89a-721c-4571-83a1-3a6e40634bed service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:56.886565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b388d520-f05d-4b0b-95a9-ddb37f3763ae req-67b2d89a-721c-4571-83a1-3a6e40634bed service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:56.892363 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0a2ad2d1-881b-420a-98ad-d17e7a9e2c4a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 200 len: 1315 microversion: 2.1 time: 0.450433 May 28 21:10:56.902286 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-b388d520-f05d-4b0b-95a9-ddb37f3763ae req-67b2d89a-721c-4571-83a1-3a6e40634bed service nova] Creating event network-changed:bb2abcc0-24c9-431a-ad3f-f5bbb1586c09 for instance 72113f72-3282-428c-b093-b5325dbb5d3e on nch2-master-1 May 28 21:10:56.905763 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1103/2283] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:56 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 1315 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:56.907825 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-b388d520-f05d-4b0b-95a9-ddb37f3763ae req-67b2d89a-721c-4571-83a1-3a6e40634bed service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040273 May 28 21:10:56.908606 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1181/2284] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:56.912458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b4197cfc-b45d-4e1d-b72f-ab5a07c12bfd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:56.913656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b4197cfc-b45d-4e1d-b72f-ab5a07c12bfd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:56.914535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fe93d3e5-75d6-4bd5-9ad3-bc248c2ded24 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d640a7d30>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:56.925050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4197cfc-b45d-4e1d-b72f-ab5a07c12bfd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:56.925975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4197cfc-b45d-4e1d-b72f-ab5a07c12bfd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:56.927048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4197cfc-b45d-4e1d-b72f-ab5a07c12bfd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:56.927712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4197cfc-b45d-4e1d-b72f-ab5a07c12bfd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:56.988039 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fe93d3e5-75d6-4bd5-9ad3-bc248c2ded24 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0" status: 200 len: 1436 microversion: 2.1 time: 0.077989 May 28 21:10:56.989130 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1182/2285] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:10:56 2022] GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 => generated 1436 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:56.999676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f762c572-3c42-45bf-8ba8-b666ed1304cc tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '.version_select at 0x7f4d69d6f820>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:57.413147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b4197cfc-b45d-4e1d-b72f-ab5a07c12bfd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:57.438701 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b4197cfc-b45d-4e1d-b72f-ab5a07c12bfd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1333 microversion: 2.1 time: 0.531296 May 28 21:10:57.439307 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1104/2286] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:56 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1333 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:57.450725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f74bd7d8-42d7-4e6b-a581-d70fcb58fe2e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:57.451293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f74bd7d8-42d7-4e6b-a581-d70fcb58fe2e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:57.607634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f74bd7d8-42d7-4e6b-a581-d70fcb58fe2e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:57.617897 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f74bd7d8-42d7-4e6b-a581-d70fcb58fe2e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 200 len: 1122 microversion: 2.1 time: 0.177224 May 28 21:10:57.618495 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1105/2287] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:57 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 1122 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:58.050165 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5f3ea327-09e0-46bd-8e1f-6369b7af8cde tempest-TenantUsagesNegativeTestJSON-603666048 tempest-TenantUsagesNegativeTestJSON-603666048-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-27T21%3A10%3A57.812011&end=2022-05-29T21%3A10%3A57.812011" status: 404 len: 112 microversion: - time: 0.234286 May 28 21:10:58.055984 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1106/2288] 10.222.0.33 () {58 vars in 1315 bytes} [Sat May 28 21:10:57 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-05-27T21%3A10%3A57.812011&end=2022-05-29T21%3A10%3A57.812011 => generated 112 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 28 21:10:58.062442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-643a35e5-7558-486e-8311-3deb6b6aff38 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:58.063998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-643a35e5-7558-486e-8311-3deb6b6aff38 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:58.083657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-643a35e5-7558-486e-8311-3deb6b6aff38 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:58.084296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-643a35e5-7558-486e-8311-3deb6b6aff38 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:58.085256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-643a35e5-7558-486e-8311-3deb6b6aff38 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:58.085913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-643a35e5-7558-486e-8311-3deb6b6aff38 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:58.591521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-643a35e5-7558-486e-8311-3deb6b6aff38 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:58.605344 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-643a35e5-7558-486e-8311-3deb6b6aff38 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 200 len: 1315 microversion: 2.1 time: 0.542490 May 28 21:10:58.612727 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1107/2289] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:58 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:58.636769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f2ede178-5eb1-4869-9e06-2e8fe9902a76 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d5784c160>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:58.712931 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f2ede178-5eb1-4869-9e06-2e8fe9902a76 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0" status: 200 len: 1445 microversion: 2.1 time: 0.086329 May 28 21:10:58.714276 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1108/2290] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:10:58 2022] GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 => generated 1445 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:58.719598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0c3c5fc5-f75a-4f91-9624-23e0ddbe4dc0 tempest-TenantUsagesNegativeTestJSON-603666048 tempest-TenantUsagesNegativeTestJSON-603666048-project-admin] Calling method '.version_select at 0x7f4d69c255e0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:58.724051 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-0c3c5fc5-f75a-4f91-9624-23e0ddbe4dc0 tempest-TenantUsagesNegativeTestJSON-603666048 tempest-TenantUsagesNegativeTestJSON-603666048-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0c3c5fc5-f75a-4f91-9624-23e0ddbe4dc0 tempest-TenantUsagesNegativeTestJSON-603666048 tempest-TenantUsagesNegativeTestJSON-603666048-project-admin] Request method failure captured: May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/os-simple-tenant-usage/5d0c7dfc47114dffaf4c661dc3d519ab?start=2022-05-29T21%3A10%3A57.812011&end=2022-05-27T21%3A10%3A57.812011 HTTP/1.1 May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko_h2-xpBeLG588Bh8OmdqAYMwGD1pOTTwxZwZ-QZfxg0iID9tivZmMpDOL0VeYcMIm7bobInHKwasb6xndXxYlSyzPfnf0WwKsg4ZW4uWXRtzDjpV8fusjYbmrul4BQ7Hb2wEU-pgPcC7WBJQ7stvffKEqhUBktdTOeP1kt6UDHDIQ May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2aec49aa1d8347eb9d735d79edbdc0b6 May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-603666048 May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2aec49aa1d8347eb9d735d79edbdc0b6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2aec49aa1d8347eb9d735d79edbdc0b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2aec49aa1d8347eb9d735d79edbdc0b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2aec49aa1d8347eb9d735d79edbdc0b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-603666048 May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2aec49aa1d8347eb9d735d79edbdc0b6 May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-603666048 May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TenantUsagesNegativeTestJSON-603666048-project-admin May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 61bcd16913c64e9faecb3dea768cd8e1 May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-603666048-project-admin May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid start time. The start time cannot occur after the end time. May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '5d0c7dfc47114dffaf4c661dc3d519ab'} May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._show(req, id) May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. May 28 21:10:58.733050 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:10:58.741994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0c3c5fc5-f75a-4f91-9624-23e0ddbe4dc0 tempest-TenantUsagesNegativeTestJSON-603666048 tempest-TenantUsagesNegativeTestJSON-603666048-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:58.743645 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0c3c5fc5-f75a-4f91-9624-23e0ddbe4dc0 tempest-TenantUsagesNegativeTestJSON-603666048 tempest-TenantUsagesNegativeTestJSON-603666048-project-admin] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage/5d0c7dfc47114dffaf4c661dc3d519ab?start=2022-05-29T21%3A10%3A57.812011&end=2022-05-27T21%3A10%3A57.812011" status: 400 len: 111 microversion: 2.1 time: 0.027711 May 28 21:10:58.744708 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1109/2291] 10.222.0.33 () {58 vars in 1411 bytes} [Sat May 28 21:10:58 2022] GET /compute/v2.1/os-simple-tenant-usage/5d0c7dfc47114dffaf4c661dc3d519ab?start=2022-05-29T21%3A10%3A57.812011&end=2022-05-27T21%3A10%3A57.812011 => generated 111 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:10:58.755009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-260492ef-4546-41b0-826e-dd5a88600b36 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:58.757425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-260492ef-4546-41b0-826e-dd5a88600b36 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:58.770626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-260492ef-4546-41b0-826e-dd5a88600b36 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:58.771590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-260492ef-4546-41b0-826e-dd5a88600b36 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:58.774062 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-260492ef-4546-41b0-826e-dd5a88600b36 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:58.775802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-260492ef-4546-41b0-826e-dd5a88600b36 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:59.186370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-260492ef-4546-41b0-826e-dd5a88600b36 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:59.199438 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-260492ef-4546-41b0-826e-dd5a88600b36 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1333 microversion: 2.1 time: 0.452171 May 28 21:10:59.202143 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1110/2292] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:58 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1333 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:59.207210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ca00bde8-ab45-497e-8756-aaa7c6d845ac tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:59.207837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ca00bde8-ab45-497e-8756-aaa7c6d845ac tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:59.235136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca00bde8-ab45-497e-8756-aaa7c6d845ac tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:59.237649 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f762c572-3c42-45bf-8ba8-b666ed1304cc tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/2c292acc-d219-4650-b2de-b28d2d50a074" status: 202 len: 0 microversion: 2.1 time: 2.243609 May 28 21:10:59.238341 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1183/2293] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:10:56 2022] DELETE /compute/v2.1/os-floating-ips/2c292acc-d219-4650-b2de-b28d2d50a074 => generated 0 bytes in 2249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:10:59.239260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca00bde8-ab45-497e-8756-aaa7c6d845ac tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:59.240315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca00bde8-ab45-497e-8756-aaa7c6d845ac tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:59.240875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca00bde8-ab45-497e-8756-aaa7c6d845ac tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:59.256208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-07f1fd3d-bee0-4500-8bd3-ad71c431a2fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d57a36f70>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:59.350015 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-07f1fd3d-bee0-4500-8bd3-ad71c431a2fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0" status: 200 len: 1445 microversion: 2.1 time: 0.101242 May 28 21:10:59.351213 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1184/2294] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:10:59 2022] GET /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 => generated 1445 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:59.538659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a6c2130f-478a-41bc-8862-7c662e7f4091 tempest-TenantUsagesNegativeTestJSON-1672953609 tempest-TenantUsagesNegativeTestJSON-1672953609-project] Calling method '.version_select at 0x7f4d649e6a60>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:59.540937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a6c2130f-478a-41bc-8862-7c662e7f4091 tempest-TenantUsagesNegativeTestJSON-1672953609 tempest-TenantUsagesNegativeTestJSON-1672953609-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '293ff74be48d4ae2a5b59ace7bf620c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d0c7dfc47114dffaf4c661dc3d519ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a6c2130f-478a-41bc-8862-7c662e7f4091 tempest-TenantUsagesNegativeTestJSON-1672953609 tempest-TenantUsagesNegativeTestJSON-1672953609-project] Request method failure captured: May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-27T21%3A10%3A57.812011&end=2022-05-29T21%3A10%3A57.812011&detailed=1 HTTP/1.1 May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_g_9KojBx3reLS3ILfOT830wIsssA6UiLKSy4kpHf-8IfLjT9BFWU8CPHSqssSBlazIPllkyGrpyU5Tl1EdsoUCcPoCYk8GxFAQ9SAzViSL4DusntBUOrMpRdfUnUIQXFNPb0Qa9S9KAKPPHUnSsaBfFQ8DzsZdrvKWRmtTd5RZtM May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5d0c7dfc47114dffaf4c661dc3d519ab May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1672953609 May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5d0c7dfc47114dffaf4c661dc3d519ab", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d0c7dfc47114dffaf4c661dc3d519ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5d0c7dfc47114dffaf4c661dc3d519ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5d0c7dfc47114dffaf4c661dc3d519ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1672953609 May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5d0c7dfc47114dffaf4c661dc3d519ab May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1672953609 May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TenantUsagesNegativeTestJSON-1672953609-project May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 293ff74be48d4ae2a5b59ace7bf620c6 May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1672953609-project May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: action_args: {} May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._index(req) May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.enforce( May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce May 28 21:10:59.543040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) May 28 21:10:59.548068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 28 21:10:59.548068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:59.548068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:59.548068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:59.548068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:59.548068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:59.548068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:59.548068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ May 28 21:10:59.548068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( May 28 21:10:59.548068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. May 28 21:10:59.548068 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:59.548068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a6c2130f-478a-41bc-8862-7c662e7f4091 tempest-TenantUsagesNegativeTestJSON-1672953609 tempest-TenantUsagesNegativeTestJSON-1672953609-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:59.548068 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a6c2130f-478a-41bc-8862-7c662e7f4091 tempest-TenantUsagesNegativeTestJSON-1672953609 tempest-TenantUsagesNegativeTestJSON-1672953609-project] 10.222.0.33 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-27T21%3A10%3A57.812011&end=2022-05-29T21%3A10%3A57.812011&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.192374 May 28 21:10:59.551185 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1185/2295] 10.222.0.33 () {58 vars in 1334 bytes} [Sat May 28 21:10:59 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-05-27T21%3A10%3A57.812011&end=2022-05-29T21%3A10%3A57.812011&detailed=1 => generated 123 bytes in 199 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:10:59.557297 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-6820ba69-424d-4678-b3db-6a4a8a145880 req-d07a9133-17f2-4fa7-a83e-bd7209cdac2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2df2686a-ce55-4771-b8e5-a67cf87ee98a", "tag": "3440f263-e0d8-4509-b88c-ae8078d72399"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:59.566806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6820ba69-424d-4678-b3db-6a4a8a145880 req-d07a9133-17f2-4fa7-a83e-bd7209cdac2d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:59.567261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6820ba69-424d-4678-b3db-6a4a8a145880 req-d07a9133-17f2-4fa7-a83e-bd7209cdac2d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:59.579805 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-6820ba69-424d-4678-b3db-6a4a8a145880 req-d07a9133-17f2-4fa7-a83e-bd7209cdac2d service nova] Creating event network-changed:3440f263-e0d8-4509-b88c-ae8078d72399 for instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a on nch2-master-1 May 28 21:10:59.585344 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-6820ba69-424d-4678-b3db-6a4a8a145880 req-d07a9133-17f2-4fa7-a83e-bd7209cdac2d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032661 May 28 21:10:59.586219 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1186/2296] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:10:59.593021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-403a1ae3-a81d-4739-b848-a977034b747d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Action: 'action', calling method: .version_select at 0x7f4d66fc25e0>, body: {"addFloatingIp": {"address": ""}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-403a1ae3-a81d-4739-b848-a977034b747d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Request method failure captured: May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action HTTP/1.1 May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 34 May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko-oacKx8wEbxeovtNO2x7L8G04r2cMzfghbXYI8L3KA7iRtgt1LpnAtzwfnzY8g-CR1ueitDegALDJ8p2eRX-PJAhT6RKF0i-ifIGpBbkWf4IDJzprEwl_BzH0a00f2j8eeAqTGltgVNx-NMvfPU1msLCWB68-eJvw64s1J5APWZWc May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 3450ad991a3943e3a4c4233551a42729 May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3450ad991a3943e3a4c4233551a42729", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3450ad991a3943e3a4c4233551a42729"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3450ad991a3943e3a4c4233551a42729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3450ad991a3943e3a4c4233551a42729"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 3450ad991a3943e3a4c4233551a42729 May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 4112534978ba4622b0fbbb9a92791876 May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: {"addFloatingIp": {"address": ""}} May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '72113f72-3282-428c-b093-b5325dbb5d3e', 'body': {'addFloatingIp': {'address': ''}}} May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise error May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi '' May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:10:59.596407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:10:59.601915 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:10:59.601915 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 28 21:10:59.601915 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:59.601915 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:10:59.601915 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:59.601915 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:10:59.601915 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:10:59.601915 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:10:59.601915 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:10:59.601915 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:10:59.601915 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas May 28 21:10:59.601915 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:10:59.605011 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-403a1ae3-a81d-4739-b848-a977034b747d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:10:59.607117 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-403a1ae3-a81d-4739-b848-a977034b747d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action" status: 400 len: 142 microversion: 2.1 time: 0.018834 May 28 21:10:59.607901 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1187/2297] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:10:59 2022] POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action => generated 142 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:10:59.614235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-897fd109-705f-4580-be23-47a26e9bc1b1 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d69c508b0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:10:59.936166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ca00bde8-ab45-497e-8756-aaa7c6d845ac tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:10:59.949711 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ca00bde8-ab45-497e-8756-aaa7c6d845ac tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 200 len: 1220 microversion: 2.1 time: 0.745827 May 28 21:10:59.951761 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1111/2298] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:59 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 1220 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:10:59.958190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c1c96928-5a8d-4e83-8847-1501eba4f0ae tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:10:59.960198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c1c96928-5a8d-4e83-8847-1501eba4f0ae tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:10:59.969000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c1c96928-5a8d-4e83-8847-1501eba4f0ae tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:59.969687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c1c96928-5a8d-4e83-8847-1501eba4f0ae tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:10:59.970631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c1c96928-5a8d-4e83-8847-1501eba4f0ae tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:10:59.971320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c1c96928-5a8d-4e83-8847-1501eba4f0ae tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:00.070225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c1c96928-5a8d-4e83-8847-1501eba4f0ae tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Acquired lock "refresh_cache-72113f72-3282-428c-b093-b5325dbb5d3e" {{(pid=143129) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 21:11:00.477715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c1c96928-5a8d-4e83-8847-1501eba4f0ae tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Releasing lock "refresh_cache-72113f72-3282-428c-b093-b5325dbb5d3e" {{(pid=143129) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 21:11:00.479943 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-c1c96928-5a8d-4e83-8847-1501eba4f0ae tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] HTTP exception thrown: floating IP not found May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c1c96928-5a8d-4e83-8847-1501eba4f0ae tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Request method failure captured: May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action HTTP/1.1 May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 41 May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko-oacKx8wEbxeovtNO2x7L8G04r2cMzfghbXYI8L3KA7iRtgt1LpnAtzwfnzY8g-CR1ueitDegALDJ8p2eRX-PJAhT6RKF0i-ifIGpBbkWf4IDJzprEwl_BzH0a00f2j8eeAqTGltgVNx-NMvfPU1msLCWB68-eJvw64s1J5APWZWc May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 3450ad991a3943e3a4c4233551a42729 May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3450ad991a3943e3a4c4233551a42729", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3450ad991a3943e3a4c4233551a42729"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3450ad991a3943e3a4c4233551a42729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3450ad991a3943e3a4c4233551a42729"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 3450ad991a3943e3a4c4233551a42729 May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 4112534978ba4622b0fbbb9a92791876 May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: {"addFloatingIp": {"address": "0.0.0.0"}} May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: exception: floating IP not found May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '72113f72-3282-428c-b093-b5325dbb5d3e', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2685, in associate_floating_ip May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2997, in _get_floating_ip_by_address May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found May 28 21:11:00.482869 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:00.489335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:00.489335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:00.489335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:00.489335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:00.489335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:00.489335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:00.489335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:00.489335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found May 28 21:11:00.489335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:00.491543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c1c96928-5a8d-4e83-8847-1501eba4f0ae tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Returning 404 to user: floating IP not found {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:00.492674 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c1c96928-5a8d-4e83-8847-1501eba4f0ae tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action" status: 404 len: 67 microversion: 2.1 time: 0.539617 May 28 21:11:00.493748 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1112/2299] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:10:59 2022] POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action => generated 67 bytes in 541 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:11:00.512901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-81281a88-3907-4e2c-9eb2-93da40899aa7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:00.513545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-81281a88-3907-4e2c-9eb2-93da40899aa7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:00.520574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81281a88-3907-4e2c-9eb2-93da40899aa7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:00.521045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81281a88-3907-4e2c-9eb2-93da40899aa7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:00.521871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81281a88-3907-4e2c-9eb2-93da40899aa7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:00.522315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81281a88-3907-4e2c-9eb2-93da40899aa7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:00.871380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-81281a88-3907-4e2c-9eb2-93da40899aa7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:00.887720 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-81281a88-3907-4e2c-9eb2-93da40899aa7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 200 len: 1315 microversion: 2.1 time: 0.388657 May 28 21:11:00.888184 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1113/2300] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:00 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:00.900503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b0d38a47-39d9-4ae1-a1f6-d4f9d7e00f5a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:00.901132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b0d38a47-39d9-4ae1-a1f6-d4f9d7e00f5a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:00.912764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0d38a47-39d9-4ae1-a1f6-d4f9d7e00f5a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:00.915496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0d38a47-39d9-4ae1-a1f6-d4f9d7e00f5a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:00.915955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0d38a47-39d9-4ae1-a1f6-d4f9d7e00f5a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:00.918445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0d38a47-39d9-4ae1-a1f6-d4f9d7e00f5a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:01.159810 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-897fd109-705f-4580-be23-47a26e9bc1b1 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0" status: 204 len: 0 microversion: 2.1 time: 1.550471 May 28 21:11:01.160868 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1188/2301] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:10:59 2022] DELETE /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 => generated 0 bytes in 1552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:11:01.167507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-44529b14-6a1b-4b5e-a67c-478ff59508a3 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Action: 'action', calling method: .version_select at 0x7f4d66db0b80>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:01.284255 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-44529b14-6a1b-4b5e-a67c-478ff59508a3 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-44529b14-6a1b-4b5e-a67c-478ff59508a3 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Request method failure captured: May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action HTTP/1.1 May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 44 May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko-oacKx8wEbxeovtNO2x7L8G04r2cMzfghbXYI8L3KA7iRtgt1LpnAtzwfnzY8g-CR1ueitDegALDJ8p2eRX-PJAhT6RKF0i-ifIGpBbkWf4IDJzprEwl_BzH0a00f2j8eeAqTGltgVNx-NMvfPU1msLCWB68-eJvw64s1J5APWZWc May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 3450ad991a3943e3a4c4233551a42729 May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3450ad991a3943e3a4c4233551a42729", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3450ad991a3943e3a4c4233551a42729"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3450ad991a3943e3a4c4233551a42729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3450ad991a3943e3a4c4233551a42729"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 3450ad991a3943e3a4c4233551a42729 May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 4112534978ba4622b0fbbb9a92791876 May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: {"removeFloatingIp": {"address": "0.0.0.0"}} May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: exception: Floating IP not found for address 0.0.0.0. May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '72113f72-3282-428c-b093-b5325dbb5d3e', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2913, in get_instance_id_by_floating_address May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2997, in _get_floating_ip_by_address May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr May 28 21:11:01.288331 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) May 28 21:11:01.292853 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. May 28 21:11:01.292853 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:01.292853 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:01.292853 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:01.292853 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:01.292853 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:01.292853 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:01.292853 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:01.292853 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:01.292853 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. May 28 21:11:01.292853 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:01.292853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-44529b14-6a1b-4b5e-a67c-478ff59508a3 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:01.292853 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-44529b14-6a1b-4b5e-a67c-478ff59508a3 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action" status: 404 len: 88 microversion: 2.1 time: 0.129233 May 28 21:11:01.292853 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1189/2302] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:11:01 2022] POST /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e/action => generated 88 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:11:01.303890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-39a4934c-63b2-4dc8-9e00-51adf30a414a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:01.307212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-39a4934c-63b2-4dc8-9e00-51adf30a414a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:01.316630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39a4934c-63b2-4dc8-9e00-51adf30a414a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:01.317419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39a4934c-63b2-4dc8-9e00-51adf30a414a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:01.319300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39a4934c-63b2-4dc8-9e00-51adf30a414a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:01.320093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39a4934c-63b2-4dc8-9e00-51adf30a414a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:01.351433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b0d38a47-39d9-4ae1-a1f6-d4f9d7e00f5a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:01.363061 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b0d38a47-39d9-4ae1-a1f6-d4f9d7e00f5a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1333 microversion: 2.1 time: 0.473397 May 28 21:11:01.364405 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1114/2303] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:00 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1333 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:01.371197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6f3c9c7e-b42a-415a-8c6a-346b2897a5f2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:01.372285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6f3c9c7e-b42a-415a-8c6a-346b2897a5f2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:01.380821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f3c9c7e-b42a-415a-8c6a-346b2897a5f2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:01.381376 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f3c9c7e-b42a-415a-8c6a-346b2897a5f2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:01.382307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f3c9c7e-b42a-415a-8c6a-346b2897a5f2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:01.382868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f3c9c7e-b42a-415a-8c6a-346b2897a5f2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:01.401756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-39a4934c-63b2-4dc8-9e00-51adf30a414a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:01.412771 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6f3c9c7e-b42a-415a-8c6a-346b2897a5f2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:11:01.415382 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-39a4934c-63b2-4dc8-9e00-51adf30a414a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 200 len: 1238 microversion: 2.1 time: 0.117514 May 28 21:11:01.415985 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1190/2304] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:01 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 1238 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:01.437331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-0bb40b8d-8111-4bd1-8e6a-7f2d86f37dd3 req-22dedcde-cac2-4b4c-b5af-b09c22e869f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df2686a-ce55-4771-b8e5-a67cf87ee98a", "name": "network-vif-plugged", "status": "completed", "tag": "3440f263-e0d8-4509-b88c-ae8078d72399"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:01.447765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0bb40b8d-8111-4bd1-8e6a-7f2d86f37dd3 req-22dedcde-cac2-4b4c-b5af-b09c22e869f5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:01.448599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0bb40b8d-8111-4bd1-8e6a-7f2d86f37dd3 req-22dedcde-cac2-4b4c-b5af-b09c22e869f5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:01.469485 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-0bb40b8d-8111-4bd1-8e6a-7f2d86f37dd3 req-22dedcde-cac2-4b4c-b5af-b09c22e869f5 service nova] Creating event network-vif-plugged:3440f263-e0d8-4509-b88c-ae8078d72399 for instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a on nch2-master-1 May 28 21:11:01.478459 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-0bb40b8d-8111-4bd1-8e6a-7f2d86f37dd3 req-22dedcde-cac2-4b4c-b5af-b09c22e869f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059664 May 28 21:11:01.480387 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1191/2305] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:01.502115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-86eb3f49-d006-498d-a972-0df361cfa8be tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:01.540340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-86eb3f49-d006-498d-a972-0df361cfa8be tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:01.565869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86eb3f49-d006-498d-a972-0df361cfa8be tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:01.566809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86eb3f49-d006-498d-a972-0df361cfa8be tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:01.568560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86eb3f49-d006-498d-a972-0df361cfa8be tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:01.570276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86eb3f49-d006-498d-a972-0df361cfa8be tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:01.636436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-86eb3f49-d006-498d-a972-0df361cfa8be tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:11:01.862386 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6f3c9c7e-b42a-415a-8c6a-346b2897a5f2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293" status: 204 len: 0 microversion: 2.1 time: 0.496334 May 28 21:11:01.873043 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1115/2306] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:11:01 2022] DELETE /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:11:01.906994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ec3c6fdf-fa2f-43de-9fc4-28ffb32ed4d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:01.908354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ec3c6fdf-fa2f-43de-9fc4-28ffb32ed4d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:01.924010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec3c6fdf-fa2f-43de-9fc4-28ffb32ed4d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:01.925454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec3c6fdf-fa2f-43de-9fc4-28ffb32ed4d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:01.926528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec3c6fdf-fa2f-43de-9fc4-28ffb32ed4d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:01.931711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec3c6fdf-fa2f-43de-9fc4-28ffb32ed4d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:02.002123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:02.010024 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-86eb3f49-d006-498d-a972-0df361cfa8be tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "DELETE /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 204 len: 0 microversion: 2.1 time: 0.526587 May 28 21:11:02.011744 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1192/2307] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:11:01 2022] DELETE /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:11:02.027332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a5f13447-d880-45d6-b7f8-4750f5b6deba req-826cd802-f39c-4e02-8655-e851dab7305a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75938ae4-dbff-425f-be63-604274ec2263", "tag": "48713bf0-ee86-41b0-8830-df2898fc6280"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:02.056652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a5f13447-d880-45d6-b7f8-4750f5b6deba req-826cd802-f39c-4e02-8655-e851dab7305a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:02.056652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a5f13447-d880-45d6-b7f8-4750f5b6deba req-826cd802-f39c-4e02-8655-e851dab7305a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:02.083062 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a5f13447-d880-45d6-b7f8-4750f5b6deba req-826cd802-f39c-4e02-8655-e851dab7305a service nova] Creating event network-changed:48713bf0-ee86-41b0-8830-df2898fc6280 for instance 75938ae4-dbff-425f-be63-604274ec2263 on nch2-master-1 May 28 21:11:02.089181 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a5f13447-d880-45d6-b7f8-4750f5b6deba req-826cd802-f39c-4e02-8655-e851dab7305a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070191 May 28 21:11:02.089798 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1193/2308] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:02.097994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b27ddf5a-bd17-44a7-ab2b-e4ce8e06b8bb tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:02.101321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b27ddf5a-bd17-44a7-ab2b-e4ce8e06b8bb tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:02.111167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b27ddf5a-bd17-44a7-ab2b-e4ce8e06b8bb tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:02.113510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b27ddf5a-bd17-44a7-ab2b-e4ce8e06b8bb tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:02.113510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b27ddf5a-bd17-44a7-ab2b-e4ce8e06b8bb tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:02.113510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b27ddf5a-bd17-44a7-ab2b-e4ce8e06b8bb tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:02.468146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ec3c6fdf-fa2f-43de-9fc4-28ffb32ed4d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:02.477015 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ec3c6fdf-fa2f-43de-9fc4-28ffb32ed4d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 200 len: 1315 microversion: 2.1 time: 0.578835 May 28 21:11:02.486963 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1116/2309] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:01 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 1315 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:02.492403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-860973017", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "1d1e95b4-31c7-4a87-a450-6b766dbdbce1"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:02.571198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] validate_networks() for [('1d1e95b4-31c7-4a87-a450-6b766dbdbce1', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:11:02.584895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b27ddf5a-bd17-44a7-ab2b-e4ce8e06b8bb tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4112534978ba4622b0fbbb9a92791876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450ad991a3943e3a4c4233551a42729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:02.599215 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b27ddf5a-bd17-44a7-ab2b-e4ce8e06b8bb tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 200 len: 1540 microversion: 2.1 time: 0.507137 May 28 21:11:02.600292 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1194/2310] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:02 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 1540 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:02.606865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ccab5b78-8612-4a96-8e6f-3560865bba07 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:02.607512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ccab5b78-8612-4a96-8e6f-3560865bba07 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:02.615296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccab5b78-8612-4a96-8e6f-3560865bba07 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:02.615759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccab5b78-8612-4a96-8e6f-3560865bba07 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:02.616729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccab5b78-8612-4a96-8e6f-3560865bba07 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:02.617337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccab5b78-8612-4a96-8e6f-3560865bba07 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:02.621725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:03.001700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ccab5b78-8612-4a96-8e6f-3560865bba07 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:03.013620 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ccab5b78-8612-4a96-8e6f-3560865bba07 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1333 microversion: 2.1 time: 0.411861 May 28 21:11:03.014933 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1195/2311] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:02 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1333 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:03.020361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ae6b479d-67eb-4e79-b70d-9a9667523287 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:03.021697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ae6b479d-67eb-4e79-b70d-9a9667523287 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:03.030377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae6b479d-67eb-4e79-b70d-9a9667523287 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:03.031539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae6b479d-67eb-4e79-b70d-9a9667523287 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:03.033448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae6b479d-67eb-4e79-b70d-9a9667523287 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:03.034202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae6b479d-67eb-4e79-b70d-9a9667523287 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:03.383735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ae6b479d-67eb-4e79-b70d-9a9667523287 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:03.401668 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ae6b479d-67eb-4e79-b70d-9a9667523287 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 200 len: 1306 microversion: 2.1 time: 0.385336 May 28 21:11:03.413388 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1196/2312] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:03 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 1306 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:03.497872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-90a109ca-2722-421a-8b69-17a7207177aa tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:03.499536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-90a109ca-2722-421a-8b69-17a7207177aa tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:03.506244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90a109ca-2722-421a-8b69-17a7207177aa tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:03.506987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90a109ca-2722-421a-8b69-17a7207177aa tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:03.508074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90a109ca-2722-421a-8b69-17a7207177aa tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:03.508763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90a109ca-2722-421a-8b69-17a7207177aa tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:04.266897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:11:04.269261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:11:04.269991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:11:04.272376 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:11:04.273148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:11:04.301153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:04.302543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:04.303816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:04.304685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:04.346960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Getting quotas for project 158c1665476643cda0976e68ab5e595a. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:04.356477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Getting quotas for user 04e5b86f94914df085b76e0d89b2230e and project 158c1665476643cda0976e68ab5e595a. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:04.375250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:11:04.378699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:11:04.541164 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3e006b33-f757-4f21-9179-8dcdbaf526cf tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.051059 May 28 21:11:04.542594 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1117/2313] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:11:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:11:04.559302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-8244f156-b907-429c-a5b9-31163a700ff0 req-c1baaeeb-1c4e-4dd2-823b-b533afcd4d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d508d555-a95e-4d29-a6e7-812145ba9293", "name": "network-vif-unplugged", "status": "completed", "tag": "db2ef97b-cc75-4a42-b69e-a29b12d74688"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:04.569896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8244f156-b907-429c-a5b9-31163a700ff0 req-c1baaeeb-1c4e-4dd2-823b-b533afcd4d32 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:04.570767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8244f156-b907-429c-a5b9-31163a700ff0 req-c1baaeeb-1c4e-4dd2-823b-b533afcd4d32 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:04.586166 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-8244f156-b907-429c-a5b9-31163a700ff0 req-c1baaeeb-1c4e-4dd2-823b-b533afcd4d32 service nova] Creating event network-vif-unplugged:db2ef97b-cc75-4a42-b69e-a29b12d74688 for instance d508d555-a95e-4d29-a6e7-812145ba9293 on nch1-master-1 May 28 21:11:04.602200 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-8244f156-b907-429c-a5b9-31163a700ff0 req-c1baaeeb-1c4e-4dd2-823b-b533afcd4d32 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052402 May 28 21:11:04.603102 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1118/2314] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:04.603535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-90a109ca-2722-421a-8b69-17a7207177aa tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:04.611711 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-90a109ca-2722-421a-8b69-17a7207177aa tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 200 len: 1315 microversion: 2.1 time: 1.120008 May 28 21:11:04.613471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-05839730-d5e9-4704-bbb9-acffc92aec6f tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:04.621609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-05839730-d5e9-4704-bbb9-acffc92aec6f tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:04.625328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-05839730-d5e9-4704-bbb9-acffc92aec6f tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Searching by: {'deleted': False, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:11:04.625711 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1197/2315] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:03 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 1315 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:04.630207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1b9ca443-42b2-4c69-94c2-2ff68419176d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:04.630846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1b9ca443-42b2-4c69-94c2-2ff68419176d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:04.636830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05839730-d5e9-4704-bbb9-acffc92aec6f tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:04.638297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05839730-d5e9-4704-bbb9-acffc92aec6f tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:04.639371 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05839730-d5e9-4704-bbb9-acffc92aec6f tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:04.644648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05839730-d5e9-4704-bbb9-acffc92aec6f tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:04.652460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b9ca443-42b2-4c69-94c2-2ff68419176d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:04.653220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b9ca443-42b2-4c69-94c2-2ff68419176d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:04.654301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b9ca443-42b2-4c69-94c2-2ff68419176d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:04.654912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b9ca443-42b2-4c69-94c2-2ff68419176d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:04.698789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-05839730-d5e9-4704-bbb9-acffc92aec6f tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:11:04.743173 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-05839730-d5e9-4704-bbb9-acffc92aec6f tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.135200 May 28 21:11:04.744653 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1119/2316] 10.222.0.33 () {58 vars in 1124 bytes} [Sat May 28 21:11:04 2022] GET /compute/v2.1/servers => generated 340 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:04.752483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-341795ea-d429-4f8c-9dc2-c6c0797b3b29 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:04.753582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-341795ea-d429-4f8c-9dc2-c6c0797b3b29 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:04.763208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-341795ea-d429-4f8c-9dc2-c6c0797b3b29 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:04.764570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-341795ea-d429-4f8c-9dc2-c6c0797b3b29 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:04.765656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-341795ea-d429-4f8c-9dc2-c6c0797b3b29 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:04.766369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-341795ea-d429-4f8c-9dc2-c6c0797b3b29 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:05.439687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1b9ca443-42b2-4c69-94c2-2ff68419176d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4112534978ba4622b0fbbb9a92791876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450ad991a3943e3a4c4233551a42729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:05.464751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-341795ea-d429-4f8c-9dc2-c6c0797b3b29 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:05.465342 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1b9ca443-42b2-4c69-94c2-2ff68419176d tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 200 len: 1540 microversion: 2.1 time: 0.825531 May 28 21:11:05.468400 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1198/2317] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:04 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 1540 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:05.482227 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-341795ea-d429-4f8c-9dc2-c6c0797b3b29 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1333 microversion: 2.1 time: 0.733973 May 28 21:11:05.488396 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1120/2318] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:04 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1333 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:05.489010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-adb144ec-8b5b-4b4f-a890-08f548f32e3a req-5b2face8-cac5-4614-8104-5d654cf6699c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75938ae4-dbff-425f-be63-604274ec2263", "tag": "26bef74d-df41-4db6-a735-9232a61d21aa"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:05.492530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-e784c0d6-2b3c-4dde-a1ef-62cde4cc1ce5 req-3a93704a-509b-4392-9e21-c526f7e0a11a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0e0703e-5c6e-4c58-8497-36a81542fec3", "tag": "b8b43638-9f68-46f7-847c-6c5e90163d68"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:05.506285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-adb144ec-8b5b-4b4f-a890-08f548f32e3a req-5b2face8-cac5-4614-8104-5d654cf6699c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:05.510534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-adb144ec-8b5b-4b4f-a890-08f548f32e3a req-5b2face8-cac5-4614-8104-5d654cf6699c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:05.516251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e784c0d6-2b3c-4dde-a1ef-62cde4cc1ce5 req-3a93704a-509b-4392-9e21-c526f7e0a11a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:05.517003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e784c0d6-2b3c-4dde-a1ef-62cde4cc1ce5 req-3a93704a-509b-4392-9e21-c526f7e0a11a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:05.533395 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-adb144ec-8b5b-4b4f-a890-08f548f32e3a req-5b2face8-cac5-4614-8104-5d654cf6699c service nova] Creating event network-changed:26bef74d-df41-4db6-a735-9232a61d21aa for instance 75938ae4-dbff-425f-be63-604274ec2263 on nch2-master-1 May 28 21:11:05.538842 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-adb144ec-8b5b-4b4f-a890-08f548f32e3a req-5b2face8-cac5-4614-8104-5d654cf6699c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067936 May 28 21:11:05.540059 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1199/2319] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:05.549117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a97ab29f-eff9-4426-b676-d34faba3ecf2 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:05.549330 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e784c0d6-2b3c-4dde-a1ef-62cde4cc1ce5 req-3a93704a-509b-4392-9e21-c526f7e0a11a service nova] Creating event network-changed:b8b43638-9f68-46f7-847c-6c5e90163d68 for instance f0e0703e-5c6e-4c58-8497-36a81542fec3 on nch1-master-1 May 28 21:11:05.555080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a97ab29f-eff9-4426-b676-d34faba3ecf2 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:05.558547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a97ab29f-eff9-4426-b676-d34faba3ecf2 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:05.559234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a97ab29f-eff9-4426-b676-d34faba3ecf2 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:05.560368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a97ab29f-eff9-4426-b676-d34faba3ecf2 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:05.560999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a97ab29f-eff9-4426-b676-d34faba3ecf2 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:05.562073 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-e784c0d6-2b3c-4dde-a1ef-62cde4cc1ce5 req-3a93704a-509b-4392-9e21-c526f7e0a11a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074054 May 28 21:11:05.563127 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1121/2320] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:05.577252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-454082b6-2e3a-4bb3-aa29-48e636663c8b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:05.578261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-454082b6-2e3a-4bb3-aa29-48e636663c8b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:05.749741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-454082b6-2e3a-4bb3-aa29-48e636663c8b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:05.766563 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-454082b6-2e3a-4bb3-aa29-48e636663c8b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1207 microversion: 2.1 time: 0.202096 May 28 21:11:05.776193 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1122/2321] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:05 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1207 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:05.776193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c70f4eba-c460-4a10-ad6b-e0e9fdc1d6aa tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:05.787781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c70f4eba-c460-4a10-ad6b-e0e9fdc1d6aa tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:05.787781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c70f4eba-c460-4a10-ad6b-e0e9fdc1d6aa tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Searching by: {'deleted': False, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:11:05.787781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c70f4eba-c460-4a10-ad6b-e0e9fdc1d6aa tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:05.787781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c70f4eba-c460-4a10-ad6b-e0e9fdc1d6aa tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:05.787781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c70f4eba-c460-4a10-ad6b-e0e9fdc1d6aa tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:05.787781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c70f4eba-c460-4a10-ad6b-e0e9fdc1d6aa tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:05.820351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-c70f4eba-c460-4a10-ad6b-e0e9fdc1d6aa tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:11:05.861386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c70f4eba-c460-4a10-ad6b-e0e9fdc1d6aa tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:05.869073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c70f4eba-c460-4a10-ad6b-e0e9fdc1d6aa tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:05.869587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c70f4eba-c460-4a10-ad6b-e0e9fdc1d6aa tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:06.002818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:06.044376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=20 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:06.127788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a97ab29f-eff9-4426-b676-d34faba3ecf2 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:06.140424 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a97ab29f-eff9-4426-b676-d34faba3ecf2 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 200 len: 1294 microversion: 2.1 time: 0.598450 May 28 21:11:06.141544 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1200/2322] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:05 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 1294 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:06.150681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4dbbc987-c7be-4359-a28b-7ab1d2e4b5c9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:06.151510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4dbbc987-c7be-4359-a28b-7ab1d2e4b5c9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:06.160734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4dbbc987-c7be-4359-a28b-7ab1d2e4b5c9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:06.161549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4dbbc987-c7be-4359-a28b-7ab1d2e4b5c9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:06.164575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4dbbc987-c7be-4359-a28b-7ab1d2e4b5c9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:06.165042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4dbbc987-c7be-4359-a28b-7ab1d2e4b5c9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:06.432539 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c70f4eba-c460-4a10-ad6b-e0e9fdc1d6aa tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.663980 May 28 21:11:06.433148 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1123/2323] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:11:05 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:06.450663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d8140ab2-e139-44b5-ac0b-a1ed5a11b3b7 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:06.460454 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d8140ab2-e139-44b5-ac0b-a1ed5a11b3b7 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013813 May 28 21:11:06.461117 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1124/2324] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:11:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:06.481004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-432e26d5-4547-4a61-a84a-af4360dd42a4 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:06.482924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-432e26d5-4547-4a61-a84a-af4360dd42a4 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:06.492532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-432e26d5-4547-4a61-a84a-af4360dd42a4 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:06.493214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-432e26d5-4547-4a61-a84a-af4360dd42a4 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:06.494043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-432e26d5-4547-4a61-a84a-af4360dd42a4 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:06.494663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-432e26d5-4547-4a61-a84a-af4360dd42a4 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:06.729620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-432e26d5-4547-4a61-a84a-af4360dd42a4 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4112534978ba4622b0fbbb9a92791876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450ad991a3943e3a4c4233551a42729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:06.736460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4dbbc987-c7be-4359-a28b-7ab1d2e4b5c9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:06.767538 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4dbbc987-c7be-4359-a28b-7ab1d2e4b5c9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 200 len: 1503 microversion: 2.1 time: 0.624617 May 28 21:11:06.768703 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1201/2325] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:06 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 1503 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:06.771505 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-432e26d5-4547-4a61-a84a-af4360dd42a4 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 200 len: 1498 microversion: 2.1 time: 0.293013 May 28 21:11:06.773728 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1125/2326] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:06 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 1498 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:06.789873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7ae5e7d0-24e5-47db-b74a-a4090e674d4f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:06.790507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c336021b-684f-4d88-9aac-be7e1c1601fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:06.790972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7ae5e7d0-24e5-47db-b74a-a4090e674d4f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:06.791444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c336021b-684f-4d88-9aac-be7e1c1601fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:06.808210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c336021b-684f-4d88-9aac-be7e1c1601fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:06.808678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c336021b-684f-4d88-9aac-be7e1c1601fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:06.809513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c336021b-684f-4d88-9aac-be7e1c1601fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:06.810160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c336021b-684f-4d88-9aac-be7e1c1601fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:06.810844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ae5e7d0-24e5-47db-b74a-a4090e674d4f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:06.812874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ae5e7d0-24e5-47db-b74a-a4090e674d4f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:06.817876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ae5e7d0-24e5-47db-b74a-a4090e674d4f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:06.817876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ae5e7d0-24e5-47db-b74a-a4090e674d4f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:06.984421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c336021b-684f-4d88-9aac-be7e1c1601fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:06.993870 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c336021b-684f-4d88-9aac-be7e1c1601fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1259 microversion: 2.1 time: 0.212864 May 28 21:11:07.000778 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1126/2327] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:06 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:07.009789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-db9ee35f-333d-4c01-bdc0-536f139e9d1f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:07.010689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-db9ee35f-333d-4c01-bdc0-536f139e9d1f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:07.019490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-db9ee35f-333d-4c01-bdc0-536f139e9d1f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:07.022717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-db9ee35f-333d-4c01-bdc0-536f139e9d1f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:07.022717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-db9ee35f-333d-4c01-bdc0-536f139e9d1f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:07.022717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-db9ee35f-333d-4c01-bdc0-536f139e9d1f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:07.070732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-db9ee35f-333d-4c01-bdc0-536f139e9d1f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:11:07.397353 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-db9ee35f-333d-4c01-bdc0-536f139e9d1f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 204 len: 0 microversion: 2.1 time: 0.394511 May 28 21:11:07.398471 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1127/2328] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:11:07 2022] DELETE /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:11:07.407103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8e9f1d3e-8ec2-487e-bb2b-32e0c45a7f84 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:07.409905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8e9f1d3e-8ec2-487e-bb2b-32e0c45a7f84 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:07.415672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e9f1d3e-8ec2-487e-bb2b-32e0c45a7f84 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:07.416156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e9f1d3e-8ec2-487e-bb2b-32e0c45a7f84 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:07.416996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e9f1d3e-8ec2-487e-bb2b-32e0c45a7f84 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:07.417471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e9f1d3e-8ec2-487e-bb2b-32e0c45a7f84 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:07.451521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8e9f1d3e-8ec2-487e-bb2b-32e0c45a7f84 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:11:07.674452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7ae5e7d0-24e5-47db-b74a-a4090e674d4f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:07.674452 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7ae5e7d0-24e5-47db-b74a-a4090e674d4f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1333 microversion: 2.1 time: 0.843861 May 28 21:11:07.674452 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1202/2329] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:06 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1333 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:07.674452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c8dd7ba1-016f-47c1-8504-da286bbd0f05 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:07.674452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c8dd7ba1-016f-47c1-8504-da286bbd0f05 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:07.674452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8dd7ba1-016f-47c1-8504-da286bbd0f05 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:07.674452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8dd7ba1-016f-47c1-8504-da286bbd0f05 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:07.674452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8dd7ba1-016f-47c1-8504-da286bbd0f05 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:07.674452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8dd7ba1-016f-47c1-8504-da286bbd0f05 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:07.813161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c8dd7ba1-016f-47c1-8504-da286bbd0f05 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:07.821823 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c8dd7ba1-016f-47c1-8504-da286bbd0f05 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 200 len: 1294 microversion: 2.1 time: 0.192145 May 28 21:11:07.822426 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1203/2330] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:07 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 1294 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:07.827017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5609d839-0dd1-448b-b511-2ddbdd2e2779 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:07.827809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5609d839-0dd1-448b-b511-2ddbdd2e2779 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:07.837648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5609d839-0dd1-448b-b511-2ddbdd2e2779 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:07.837648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5609d839-0dd1-448b-b511-2ddbdd2e2779 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:07.837648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5609d839-0dd1-448b-b511-2ddbdd2e2779 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:07.837648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5609d839-0dd1-448b-b511-2ddbdd2e2779 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:07.882741 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8e9f1d3e-8ec2-487e-bb2b-32e0c45a7f84 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "DELETE /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 204 len: 0 microversion: 2.1 time: 0.481890 May 28 21:11:07.883544 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1128/2331] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:11:07 2022] DELETE /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:11:07.891633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ed2dc980-e73a-4ce6-80b4-683ced9cf105 req-00c26514-0ca0-4a5d-a981-1d3cab6c5ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d508d555-a95e-4d29-a6e7-812145ba9293", "name": "network-vif-deleted", "tag": "db2ef97b-cc75-4a42-b69e-a29b12d74688"}, {"server_uuid": "72113f72-3282-428c-b093-b5325dbb5d3e", "name": "network-vif-deleted", "tag": "bb2abcc0-24c9-431a-ad3f-f5bbb1586c09"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:07.901400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ed2dc980-e73a-4ce6-80b4-683ced9cf105 req-00c26514-0ca0-4a5d-a981-1d3cab6c5ae3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:07.901942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ed2dc980-e73a-4ce6-80b4-683ced9cf105 req-00c26514-0ca0-4a5d-a981-1d3cab6c5ae3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:07.916028 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ed2dc980-e73a-4ce6-80b4-683ced9cf105 req-00c26514-0ca0-4a5d-a981-1d3cab6c5ae3 service nova] Creating event network-vif-deleted:db2ef97b-cc75-4a42-b69e-a29b12d74688 for instance d508d555-a95e-4d29-a6e7-812145ba9293 on nch1-master-1 May 28 21:11:07.916557 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ed2dc980-e73a-4ce6-80b4-683ced9cf105 req-00c26514-0ca0-4a5d-a981-1d3cab6c5ae3 service nova] Creating event network-vif-deleted:bb2abcc0-24c9-431a-ad3f-f5bbb1586c09 for instance 72113f72-3282-428c-b093-b5325dbb5d3e on nch2-master-1 May 28 21:11:07.937940 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ed2dc980-e73a-4ce6-80b4-683ced9cf105 req-00c26514-0ca0-4a5d-a981-1d3cab6c5ae3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052775 May 28 21:11:07.938713 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1129/2332] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:07.943852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bbc9607a-ca14-406b-bb27-c358f9a51039 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:07.944842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bbc9607a-ca14-406b-bb27-c358f9a51039 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:07.952379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bbc9607a-ca14-406b-bb27-c358f9a51039 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:07.953680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bbc9607a-ca14-406b-bb27-c358f9a51039 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:07.954887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bbc9607a-ca14-406b-bb27-c358f9a51039 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:07.955511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bbc9607a-ca14-406b-bb27-c358f9a51039 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:07.990901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:07.994243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bbc9607a-ca14-406b-bb27-c358f9a51039 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:07.994714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bbc9607a-ca14-406b-bb27-c358f9a51039 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:07.995168 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-bbc9607a-ca14-406b-bb27-c358f9a51039 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lazy-loading 'fault' on Instance uuid 72113f72-3282-428c-b093-b5325dbb5d3e {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:11:08.058690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bbc9607a-ca14-406b-bb27-c358f9a51039 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4112534978ba4622b0fbbb9a92791876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3450ad991a3943e3a4c4233551a42729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:08.068600 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bbc9607a-ca14-406b-bb27-c358f9a51039 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 200 len: 1321 microversion: 2.1 time: 0.128547 May 28 21:11:08.076524 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1130/2333] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:07 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 1321 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:08.079633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-63112a13-19d3-4dca-a574-3b59ad0c632c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:08.080601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-63112a13-19d3-4dca-a574-3b59ad0c632c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:08.087618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63112a13-19d3-4dca-a574-3b59ad0c632c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:08.088443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63112a13-19d3-4dca-a574-3b59ad0c632c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:08.089321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63112a13-19d3-4dca-a574-3b59ad0c632c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:08.089894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63112a13-19d3-4dca-a574-3b59ad0c632c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:08.133576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5609d839-0dd1-448b-b511-2ddbdd2e2779 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:08.212005 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5609d839-0dd1-448b-b511-2ddbdd2e2779 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 200 len: 1509 microversion: 2.1 time: 0.341627 May 28 21:11:08.212005 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1204/2334] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:07 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 1509 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:08.212005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-799eaad5-ce93-42ce-b20d-f5d20b8b574b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:08.212005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-799eaad5-ce93-42ce-b20d-f5d20b8b574b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:08.212005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-799eaad5-ce93-42ce-b20d-f5d20b8b574b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:08.212005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-799eaad5-ce93-42ce-b20d-f5d20b8b574b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:08.212005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-799eaad5-ce93-42ce-b20d-f5d20b8b574b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:08.212005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-799eaad5-ce93-42ce-b20d-f5d20b8b574b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:08.318066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-799eaad5-ce93-42ce-b20d-f5d20b8b574b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:08.328091 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-799eaad5-ce93-42ce-b20d-f5d20b8b574b tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1267 microversion: 2.1 time: 0.149099 May 28 21:11:08.328970 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1205/2335] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:08 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:08.366749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-63112a13-19d3-4dca-a574-3b59ad0c632c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:08.375526 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-63112a13-19d3-4dca-a574-3b59ad0c632c tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1715 microversion: 2.1 time: 0.302660 May 28 21:11:08.376118 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1131/2336] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:08 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1715 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:08.656665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bebe0095-fd6d-4c9e-874a-c6931e064edb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:08.657827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bebe0095-fd6d-4c9e-874a-c6931e064edb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:08.680758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bebe0095-fd6d-4c9e-874a-c6931e064edb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:08.682389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bebe0095-fd6d-4c9e-874a-c6931e064edb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:08.685427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bebe0095-fd6d-4c9e-874a-c6931e064edb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:08.686499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bebe0095-fd6d-4c9e-874a-c6931e064edb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:08.951307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8daac921-583d-485f-902a-8175454da8a1 tempest-FloatingIPDetailsNegativeTestJSON-2112093266 tempest-FloatingIPDetailsNegativeTestJSON-2112093266-project] Calling method '.version_select at 0x7f4d5765b790>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:09.011508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG neutronclient.v2_0.client [None req-8daac921-583d-485f-902a-8175454da8a1 tempest-FloatingIPDetailsNegativeTestJSON-2112093266 tempest-FloatingIPDetailsNegativeTestJSON-2112093266-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 80e24ecf-557c-4fb7-8713-1fb9d2374f26 could not be found", "detail": ""}} {{(pid=143129) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:11:09.014551 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-8daac921-583d-485f-902a-8175454da8a1 tempest-FloatingIPDetailsNegativeTestJSON-2112093266 tempest-FloatingIPDetailsNegativeTestJSON-2112093266-project] HTTP exception thrown: Floating IP not found for ID 80e24ecf-557c-4fb7-8713-1fb9d2374f26 May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8daac921-583d-485f-902a-8175454da8a1 tempest-FloatingIPDetailsNegativeTestJSON-2112093266 tempest-FloatingIPDetailsNegativeTestJSON-2112093266-project] Request method failure captured: May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/os-floating-ips/80e24ecf-557c-4fb7-8713-1fb9d2374f26 HTTP/1.1 May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko_sxTI5XOud-0bWjaWk9wfGuFMDFNgPbnlPuhs4-cVgxW946RAPPAeQbcAwF9NNycBPcejC2UCJwt0ByEWY66nEZ5_p9rai_lzyrGDf3b3BOYcJNo-4BsRqqLerJ54TfbtrYobBNxfNDY7yD8A869qZCgF8lueTVla948_iHpCZ5C4 May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: d6a685bc40014ea89edf1dfa6ac3c659 May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-2112093266 May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d6a685bc40014ea89edf1dfa6ac3c659", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6a685bc40014ea89edf1dfa6ac3c659"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d6a685bc40014ea89edf1dfa6ac3c659"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d6a685bc40014ea89edf1dfa6ac3c659"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-2112093266 May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: d6a685bc40014ea89edf1dfa6ac3c659 May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-2112093266 May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-2112093266-project May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 4176cf2d27e64e92b3078d96c82671dd May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-2112093266-project May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: exception: Floating IP not found for ID 80e24ecf-557c-4fb7-8713-1fb9d2374f26 May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '80e24ecf-557c-4fb7-8713-1fb9d2374f26'} May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 80e24ecf-557c-4fb7-8713-1fb9d2374f26 could not be found May 28 21:11:09.015031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-39815123-07b9-46a8-b49a-2f4828a8544c'] May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 80e24ecf-557c-4fb7-8713-1fb9d2374f26. May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 80e24ecf-557c-4fb7-8713-1fb9d2374f26 May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 80e24ecf-557c-4fb7-8713-1fb9d2374f26 May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8daac921-583d-485f-902a-8175454da8a1 tempest-FloatingIPDetailsNegativeTestJSON-2112093266 tempest-FloatingIPDetailsNegativeTestJSON-2112093266-project] Returning 404 to user: Floating IP not found for ID 80e24ecf-557c-4fb7-8713-1fb9d2374f26 {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8daac921-583d-485f-902a-8175454da8a1 tempest-FloatingIPDetailsNegativeTestJSON-2112093266 tempest-FloatingIPDetailsNegativeTestJSON-2112093266-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/80e24ecf-557c-4fb7-8713-1fb9d2374f26" status: 404 len: 111 microversion: 2.1 time: 0.277126 May 28 21:11:09.020957 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1132/2337] 10.222.0.33 () {58 vars in 1259 bytes} [Sat May 28 21:11:08 2022] GET /compute/v2.1/os-floating-ips/80e24ecf-557c-4fb7-8713-1fb9d2374f26 => generated 111 bytes in 278 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:09.027195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f96f8dd8-000c-4a58-8d56-87b286bdd4d5 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:09.027195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f96f8dd8-000c-4a58-8d56-87b286bdd4d5 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:09.030077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f96f8dd8-000c-4a58-8d56-87b286bdd4d5 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:09.031385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f96f8dd8-000c-4a58-8d56-87b286bdd4d5 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:09.031385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f96f8dd8-000c-4a58-8d56-87b286bdd4d5 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:09.031755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f96f8dd8-000c-4a58-8d56-87b286bdd4d5 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:09.226539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bebe0095-fd6d-4c9e-874a-c6931e064edb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:09.235351 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bebe0095-fd6d-4c9e-874a-c6931e064edb tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1333 microversion: 2.1 time: 0.593248 May 28 21:11:09.239614 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1206/2338] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:08 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1333 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:09.273133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1cd8e4b2-d93a-41a6-843b-81fd89f0f03a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:09.275347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1cd8e4b2-d93a-41a6-843b-81fd89f0f03a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] [instance: 72113f72-3282-428c-b093-b5325dbb5d3e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:09.286186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cd8e4b2-d93a-41a6-843b-81fd89f0f03a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:09.287480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cd8e4b2-d93a-41a6-843b-81fd89f0f03a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:09.288458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cd8e4b2-d93a-41a6-843b-81fd89f0f03a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:09.289071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cd8e4b2-d93a-41a6-843b-81fd89f0f03a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:09.313323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f96f8dd8-000c-4a58-8d56-87b286bdd4d5 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:09.320458 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-1cd8e4b2-d93a-41a6-843b-81fd89f0f03a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] HTTP exception thrown: Instance 72113f72-3282-428c-b093-b5325dbb5d3e could not be found. May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1cd8e4b2-d93a-41a6-843b-81fd89f0f03a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Request method failure captured: May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e HTTP/1.1 May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko-oacKx8wEbxeovtNO2x7L8G04r2cMzfghbXYI8L3KA7iRtgt1LpnAtzwfnzY8g-CR1ueitDegALDJ8p2eRX-PJAhT6RKF0i-ifIGpBbkWf4IDJzprEwl_BzH0a00f2j8eeAqTGltgVNx-NMvfPU1msLCWB68-eJvw64s1J5APWZWc May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 3450ad991a3943e3a4c4233551a42729 May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3450ad991a3943e3a4c4233551a42729", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3450ad991a3943e3a4c4233551a42729"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3450ad991a3943e3a4c4233551a42729"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3450ad991a3943e3a4c4233551a42729"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 3450ad991a3943e3a4c4233551a42729 May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 4112534978ba4622b0fbbb9a92791876 May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 72113f72-3282-428c-b093-b5325dbb5d3e could not be found. May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '72113f72-3282-428c-b093-b5325dbb5d3e'} May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72113f72-3282-428c-b093-b5325dbb5d3e could not be found. May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72113f72-3282-428c-b093-b5325dbb5d3e could not be found. May 28 21:11:09.322215 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:09.334588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:09.334588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:09.334588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:09.334588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:09.334588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:09.334588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:09.334588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:09.334588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72113f72-3282-428c-b093-b5325dbb5d3e could not be found. May 28 21:11:09.334588 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:09.334588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1cd8e4b2-d93a-41a6-843b-81fd89f0f03a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] Returning 404 to user: Instance 72113f72-3282-428c-b093-b5325dbb5d3e could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:09.335621 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f96f8dd8-000c-4a58-8d56-87b286bdd4d5 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 200 len: 1294 microversion: 2.1 time: 0.305972 May 28 21:11:09.335621 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1133/2339] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:09 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 1294 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:09.335829 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1cd8e4b2-d93a-41a6-843b-81fd89f0f03a tempest-FloatingIPsAssociationNegativeTestJSON-1317801261 tempest-FloatingIPsAssociationNegativeTestJSON-1317801261-project] 10.222.0.33 "GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e" status: 404 len: 111 microversion: 2.1 time: 0.077728 May 28 21:11:09.335829 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1207/2340] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:09 2022] GET /compute/v2.1/servers/72113f72-3282-428c-b093-b5325dbb5d3e => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:09.336032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e6412018-18fe-482f-bd08-83b5fa8baf66 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:09.338575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e6412018-18fe-482f-bd08-83b5fa8baf66 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:09.348865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6ae6fd3c-fa91-4143-9bb9-374afcc06fc2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:09.350648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6ae6fd3c-fa91-4143-9bb9-374afcc06fc2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:09.358601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6412018-18fe-482f-bd08-83b5fa8baf66 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:09.359057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6412018-18fe-482f-bd08-83b5fa8baf66 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:09.364796 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6412018-18fe-482f-bd08-83b5fa8baf66 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:09.364796 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6412018-18fe-482f-bd08-83b5fa8baf66 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:09.364999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:09.367505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ae6fd3c-fa91-4143-9bb9-374afcc06fc2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:09.368457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ae6fd3c-fa91-4143-9bb9-374afcc06fc2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:09.369502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ae6fd3c-fa91-4143-9bb9-374afcc06fc2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:09.370203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ae6fd3c-fa91-4143-9bb9-374afcc06fc2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:09.921955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e6412018-18fe-482f-bd08-83b5fa8baf66 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:09.932537 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e6412018-18fe-482f-bd08-83b5fa8baf66 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 200 len: 1509 microversion: 2.1 time: 0.606185 May 28 21:11:09.933136 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1134/2341] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:09 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 1509 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:09.948353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-24bd428a-ea3e-48b4-9516-a0c451857f04 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:09.949018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-24bd428a-ea3e-48b4-9516-a0c451857f04 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:09.961144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24bd428a-ea3e-48b4-9516-a0c451857f04 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:09.963245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24bd428a-ea3e-48b4-9516-a0c451857f04 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:09.964632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24bd428a-ea3e-48b4-9516-a0c451857f04 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:09.966900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24bd428a-ea3e-48b4-9516-a0c451857f04 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:10.029124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6ae6fd3c-fa91-4143-9bb9-374afcc06fc2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:10.040880 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6ae6fd3c-fa91-4143-9bb9-374afcc06fc2 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1307 microversion: 2.1 time: 0.697979 May 28 21:11:10.041864 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1208/2342] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:09 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1307 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:11:10.263537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1327f9f6-cf7f-4240-8cde-1c01ea5ad7a0 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:10.264539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1327f9f6-cf7f-4240-8cde-1c01ea5ad7a0 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:10.274101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1327f9f6-cf7f-4240-8cde-1c01ea5ad7a0 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:10.275769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1327f9f6-cf7f-4240-8cde-1c01ea5ad7a0 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:10.276796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1327f9f6-cf7f-4240-8cde-1c01ea5ad7a0 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:10.279683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1327f9f6-cf7f-4240-8cde-1c01ea5ad7a0 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:10.940455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-24bd428a-ea3e-48b4-9516-a0c451857f04 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:10.955106 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-24bd428a-ea3e-48b4-9516-a0c451857f04 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1715 microversion: 2.1 time: 1.020815 May 28 21:11:10.955799 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1135/2343] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:09 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1715 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:10.972043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3b298626-f495-4fa2-b7ca-ca0179d03cce tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:10.975086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3b298626-f495-4fa2-b7ca-ca0179d03cce tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:11.006183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b298626-f495-4fa2-b7ca-ca0179d03cce tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:11.006973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b298626-f495-4fa2-b7ca-ca0179d03cce tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:11.008891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b298626-f495-4fa2-b7ca-ca0179d03cce tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:11.011287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b298626-f495-4fa2-b7ca-ca0179d03cce tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:11.273457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1327f9f6-cf7f-4240-8cde-1c01ea5ad7a0 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:11.283699 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1327f9f6-cf7f-4240-8cde-1c01ea5ad7a0 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1333 microversion: 2.1 time: 1.029730 May 28 21:11:11.284290 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1209/2344] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:10 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1333 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:11.298100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-139c07a0-fe6c-4e5e-9cd2-0761babe9943 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:11.303944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-139c07a0-fe6c-4e5e-9cd2-0761babe9943 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:11.320727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-139c07a0-fe6c-4e5e-9cd2-0761babe9943 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:11.321587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-139c07a0-fe6c-4e5e-9cd2-0761babe9943 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:11.322621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-139c07a0-fe6c-4e5e-9cd2-0761babe9943 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:11.323243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-139c07a0-fe6c-4e5e-9cd2-0761babe9943 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:11.580802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-139c07a0-fe6c-4e5e-9cd2-0761babe9943 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:11.590236 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-139c07a0-fe6c-4e5e-9cd2-0761babe9943 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 200 len: 1467 microversion: 2.1 time: 0.295932 May 28 21:11:11.591569 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1210/2345] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:11 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 1467 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:11.596738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a607490a-07c7-4825-953b-edb6f161425f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:11.599289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a607490a-07c7-4825-953b-edb6f161425f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:11.609017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a607490a-07c7-4825-953b-edb6f161425f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:11.609588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a607490a-07c7-4825-953b-edb6f161425f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:11.610683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a607490a-07c7-4825-953b-edb6f161425f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:11.611207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a607490a-07c7-4825-953b-edb6f161425f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:11.843269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3b298626-f495-4fa2-b7ca-ca0179d03cce tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:11.851167 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3b298626-f495-4fa2-b7ca-ca0179d03cce tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 200 len: 1294 microversion: 2.1 time: 0.894289 May 28 21:11:11.861099 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1136/2346] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:10 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 1294 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:11.866616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-01b7987d-a043-4a04-899b-9ba6464057b2 req-cc34725c-a661-401c-a176-cf8f4f436cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2df2686a-ce55-4771-b8e5-a67cf87ee98a", "name": "network-vif-deleted", "tag": "3440f263-e0d8-4509-b88c-ae8078d72399"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:11.875542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-01b7987d-a043-4a04-899b-9ba6464057b2 req-cc34725c-a661-401c-a176-cf8f4f436cdc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:11.878480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-01b7987d-a043-4a04-899b-9ba6464057b2 req-cc34725c-a661-401c-a176-cf8f4f436cdc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:11.960172 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-01b7987d-a043-4a04-899b-9ba6464057b2 req-cc34725c-a661-401c-a176-cf8f4f436cdc service nova] Creating event network-vif-deleted:3440f263-e0d8-4509-b88c-ae8078d72399 for instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a on nch2-master-1 May 28 21:11:11.975885 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-01b7987d-a043-4a04-899b-9ba6464057b2 req-cc34725c-a661-401c-a176-cf8f4f436cdc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112837 May 28 21:11:11.976497 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1137/2347] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:11.983686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-480c6af6-1356-4b5b-bef6-ced5ab6fed54 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:11.984623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-480c6af6-1356-4b5b-bef6-ced5ab6fed54 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:11.993910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-480c6af6-1356-4b5b-bef6-ced5ab6fed54 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:11.994706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-480c6af6-1356-4b5b-bef6-ced5ab6fed54 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:11.995747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-480c6af6-1356-4b5b-bef6-ced5ab6fed54 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:11.996441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-480c6af6-1356-4b5b-bef6-ced5ab6fed54 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:12.626499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a607490a-07c7-4825-953b-edb6f161425f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:12.636461 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a607490a-07c7-4825-953b-edb6f161425f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1307 microversion: 2.1 time: 1.043544 May 28 21:11:12.639157 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1211/2348] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:11 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1307 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:12.656374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-0a8f2702-9d01-48e6-9ddc-72dc194177eb req-14695186-aa5f-4138-aec3-40f88f99d1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e0703e-5c6e-4c58-8497-36a81542fec3", "name": "network-vif-plugged", "status": "completed", "tag": "b8b43638-9f68-46f7-847c-6c5e90163d68"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:12.668790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0a8f2702-9d01-48e6-9ddc-72dc194177eb req-14695186-aa5f-4138-aec3-40f88f99d1a1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:12.670951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0a8f2702-9d01-48e6-9ddc-72dc194177eb req-14695186-aa5f-4138-aec3-40f88f99d1a1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:12.711018 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-0a8f2702-9d01-48e6-9ddc-72dc194177eb req-14695186-aa5f-4138-aec3-40f88f99d1a1 service nova] Creating event network-vif-plugged:b8b43638-9f68-46f7-847c-6c5e90163d68 for instance f0e0703e-5c6e-4c58-8497-36a81542fec3 on nch1-master-1 May 28 21:11:12.722666 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-0a8f2702-9d01-48e6-9ddc-72dc194177eb req-14695186-aa5f-4138-aec3-40f88f99d1a1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078472 May 28 21:11:12.725386 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1212/2349] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:12.735029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3d1a4bda-705f-434c-a1d6-a056f13db701 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:12.741559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3d1a4bda-705f-434c-a1d6-a056f13db701 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:12.757952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:12.760153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d1a4bda-705f-434c-a1d6-a056f13db701 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:12.763414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d1a4bda-705f-434c-a1d6-a056f13db701 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:12.766886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d1a4bda-705f-434c-a1d6-a056f13db701 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:12.767660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d1a4bda-705f-434c-a1d6-a056f13db701 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:13.039659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-480c6af6-1356-4b5b-bef6-ced5ab6fed54 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:13.062584 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-480c6af6-1356-4b5b-bef6-ced5ab6fed54 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1715 microversion: 2.1 time: 1.083331 May 28 21:11:13.066920 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1138/2350] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:11 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1715 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:13.076173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-66a8a996-350b-4d39-9e74-8ad415a38eec tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:13.083405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-66a8a996-350b-4d39-9e74-8ad415a38eec tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:13.086279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66a8a996-350b-4d39-9e74-8ad415a38eec tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:13.086934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66a8a996-350b-4d39-9e74-8ad415a38eec tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:13.087903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66a8a996-350b-4d39-9e74-8ad415a38eec tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:13.088511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66a8a996-350b-4d39-9e74-8ad415a38eec tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:13.136173 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-66a8a996-350b-4d39-9e74-8ad415a38eec tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-66a8a996-350b-4d39-9e74-8ad415a38eec tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a HTTP/1.1 May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '2df2686a-ce55-4771-b8e5-a67cf87ee98a'} May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:13.139007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:13.144724 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:13.144724 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:13.144724 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:13.144724 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:13.144724 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:13.144724 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. May 28 21:11:13.144724 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:13.147991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-66a8a996-350b-4d39-9e74-8ad415a38eec tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:13.149105 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-66a8a996-350b-4d39-9e74-8ad415a38eec tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 404 len: 111 microversion: 2.1 time: 0.080829 May 28 21:11:13.150540 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1139/2351] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:13 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:13.181280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d18e194d-19ae-4f0b-b996-779362111492 req-5d348264-e75b-490d-b51d-b819bd39fc5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f808c8-db89-4f84-91be-66e4ddda87d4", "tag": "136634ca-0287-4836-91e1-7d6df183e1bc"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:13.212093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d18e194d-19ae-4f0b-b996-779362111492 req-5d348264-e75b-490d-b51d-b819bd39fc5d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:13.216413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d18e194d-19ae-4f0b-b996-779362111492 req-5d348264-e75b-490d-b51d-b819bd39fc5d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:13.267858 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d18e194d-19ae-4f0b-b996-779362111492 req-5d348264-e75b-490d-b51d-b819bd39fc5d service nova] Creating event network-changed:136634ca-0287-4836-91e1-7d6df183e1bc for instance 80f808c8-db89-4f84-91be-66e4ddda87d4 on nch1-master-1 May 28 21:11:13.289441 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d18e194d-19ae-4f0b-b996-779362111492 req-5d348264-e75b-490d-b51d-b819bd39fc5d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119251 May 28 21:11:13.297446 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1140/2352] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:13.307660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-30964ce7-c18f-47ea-a7d3-a51e2697f385 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:13.313142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-30964ce7-c18f-47ea-a7d3-a51e2697f385 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:13.334398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30964ce7-c18f-47ea-a7d3-a51e2697f385 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:13.336960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30964ce7-c18f-47ea-a7d3-a51e2697f385 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:13.336960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30964ce7-c18f-47ea-a7d3-a51e2697f385 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:13.337352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30964ce7-c18f-47ea-a7d3-a51e2697f385 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:14.119363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3d1a4bda-705f-434c-a1d6-a056f13db701 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:14.126489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:14.136028 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3d1a4bda-705f-434c-a1d6-a056f13db701 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1333 microversion: 2.1 time: 1.408048 May 28 21:11:14.146653 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1213/2353] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:12 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1333 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:14.151728 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-707528025", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "4688fc3e-7c0b-4b45-bce6-c3e05e995935"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:14.252799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] validate_networks() for [('4688fc3e-7c0b-4b45-bce6-c3e05e995935', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:11:14.416188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-30964ce7-c18f-47ea-a7d3-a51e2697f385 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:14.429381 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-30964ce7-c18f-47ea-a7d3-a51e2697f385 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 200 len: 1294 microversion: 2.1 time: 1.129339 May 28 21:11:14.430234 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1141/2354] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:13 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 1294 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:14.442675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7f65c368-0cca-4531-97c0-3b724810e590 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:14.443575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7f65c368-0cca-4531-97c0-3b724810e590 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:14.458947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f65c368-0cca-4531-97c0-3b724810e590 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:14.464596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f65c368-0cca-4531-97c0-3b724810e590 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:14.465741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f65c368-0cca-4531-97c0-3b724810e590 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:14.466427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f65c368-0cca-4531-97c0-3b724810e590 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:15.240755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7f65c368-0cca-4531-97c0-3b724810e590 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:15.269795 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7f65c368-0cca-4531-97c0-3b724810e590 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1307 microversion: 2.1 time: 0.836324 May 28 21:11:15.271979 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1142/2355] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:14 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1307 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:15.292267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-36da802d-cbf8-4159-ae6f-d5466c00b815 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:15.292267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-36da802d-cbf8-4159-ae6f-d5466c00b815 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:15.306355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36da802d-cbf8-4159-ae6f-d5466c00b815 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:15.308811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36da802d-cbf8-4159-ae6f-d5466c00b815 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:15.315003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36da802d-cbf8-4159-ae6f-d5466c00b815 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:15.315003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36da802d-cbf8-4159-ae6f-d5466c00b815 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:15.399669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36da802d-cbf8-4159-ae6f-d5466c00b815 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:15.403424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36da802d-cbf8-4159-ae6f-d5466c00b815 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:15.407209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-36da802d-cbf8-4159-ae6f-d5466c00b815 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lazy-loading 'fault' on Instance uuid 39db2b33-8e94-4b73-8250-695d7ee9508a {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:11:15.558539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-36da802d-cbf8-4159-ae6f-d5466c00b815 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5df3bc2a59b4d99b81932deac1ece64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e1a1360253a413d8ee275cb1d1fac02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:15.570013 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-36da802d-cbf8-4159-ae6f-d5466c00b815 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 200 len: 1368 microversion: 2.1 time: 0.296180 May 28 21:11:15.570616 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1143/2356] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:15 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 1368 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:15.595705 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-e1a3a205-0f37-4f17-9301-6b8b82295317 req-8e116543-8a14-4798-b4eb-649bf8267de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39db2b33-8e94-4b73-8250-695d7ee9508a", "name": "network-vif-deleted", "tag": "6d5785f3-ce68-4bfc-8303-f8e086ad50d5"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:15.610227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e1a3a205-0f37-4f17-9301-6b8b82295317 req-8e116543-8a14-4798-b4eb-649bf8267de2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:15.630497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e1a3a205-0f37-4f17-9301-6b8b82295317 req-8e116543-8a14-4798-b4eb-649bf8267de2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:15.658255 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e1a3a205-0f37-4f17-9301-6b8b82295317 req-8e116543-8a14-4798-b4eb-649bf8267de2 service nova] Creating event network-vif-deleted:6d5785f3-ce68-4bfc-8303-f8e086ad50d5 for instance 39db2b33-8e94-4b73-8250-695d7ee9508a on nch1-master-1 May 28 21:11:15.684293 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-e1a3a205-0f37-4f17-9301-6b8b82295317 req-8e116543-8a14-4798-b4eb-649bf8267de2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112224 May 28 21:11:15.685481 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1144/2357] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:15.691114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f5905aec-1a2a-4c74-8318-ed7bd8d8872e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:15.691832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f5905aec-1a2a-4c74-8318-ed7bd8d8872e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:15.705341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5905aec-1a2a-4c74-8318-ed7bd8d8872e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:15.711993 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5905aec-1a2a-4c74-8318-ed7bd8d8872e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:15.713216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5905aec-1a2a-4c74-8318-ed7bd8d8872e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:15.714476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5905aec-1a2a-4c74-8318-ed7bd8d8872e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:15.807648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:15.860610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=12 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:16.428543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f5905aec-1a2a-4c74-8318-ed7bd8d8872e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:16.448031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:11:16.448546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:11:16.448996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:11:16.449717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:11:16.450196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:11:16.456691 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f5905aec-1a2a-4c74-8318-ed7bd8d8872e tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1333 microversion: 2.1 time: 0.766430 May 28 21:11:16.460094 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1145/2358] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:15 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1333 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:16.476305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:16.477881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:16.481725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:16.486097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6018c4a3-2195-4aa1-b166-1ae58f83eb12 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:16.486291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:16.486436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6018c4a3-2195-4aa1-b166-1ae58f83eb12 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:16.510709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6018c4a3-2195-4aa1-b166-1ae58f83eb12 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:16.513169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6018c4a3-2195-4aa1-b166-1ae58f83eb12 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:16.514375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6018c4a3-2195-4aa1-b166-1ae58f83eb12 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:16.515911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6018c4a3-2195-4aa1-b166-1ae58f83eb12 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:16.530776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Getting quotas for project cf04fd760c54473f83980a385252fa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:16.544622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Getting quotas for user bf9c8f66e7d24ca9baca835e41546f22 and project cf04fd760c54473f83980a385252fa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:16.572088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:11:16.578222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:11:16.753253 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-119436c1-63d1-4fbb-9167-55f03d6f9a1a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.605370 May 28 21:11:16.754366 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1214/2359] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:11:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:11:16.765237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-8aaf2d16-128d-40f3-b031-5055727c49ce req-7f8782ca-660f-41d1-8e2a-c457850a6c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75938ae4-dbff-425f-be63-604274ec2263", "name": "network-vif-plugged", "status": "completed", "tag": "48713bf0-ee86-41b0-8830-df2898fc6280"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:16.777465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8aaf2d16-128d-40f3-b031-5055727c49ce req-7f8782ca-660f-41d1-8e2a-c457850a6c3b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:16.778848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8aaf2d16-128d-40f3-b031-5055727c49ce req-7f8782ca-660f-41d1-8e2a-c457850a6c3b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:16.792261 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-8aaf2d16-128d-40f3-b031-5055727c49ce req-7f8782ca-660f-41d1-8e2a-c457850a6c3b service nova] Creating event network-vif-plugged:48713bf0-ee86-41b0-8830-df2898fc6280 for instance 75938ae4-dbff-425f-be63-604274ec2263 on nch2-master-1 May 28 21:11:16.807061 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-8aaf2d16-128d-40f3-b031-5055727c49ce req-7f8782ca-660f-41d1-8e2a-c457850a6c3b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037895 May 28 21:11:16.807061 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1215/2360] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:16.807061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6c96c841-55d0-4187-8643-49a956789d00 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:16.807061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6c96c841-55d0-4187-8643-49a956789d00 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:16.814834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c96c841-55d0-4187-8643-49a956789d00 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:16.815590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c96c841-55d0-4187-8643-49a956789d00 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:16.816657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c96c841-55d0-4187-8643-49a956789d00 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:16.817426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c96c841-55d0-4187-8643-49a956789d00 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:16.972059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6018c4a3-2195-4aa1-b166-1ae58f83eb12 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:16.988031 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6018c4a3-2195-4aa1-b166-1ae58f83eb12 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 200 len: 1485 microversion: 2.1 time: 0.523444 May 28 21:11:16.988664 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1146/2361] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:16 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 1485 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:17.008313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-061b11f7-17c7-47cb-a3a9-5b536cb07065 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:17.011047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-061b11f7-17c7-47cb-a3a9-5b536cb07065 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] [instance: 39db2b33-8e94-4b73-8250-695d7ee9508a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:17.026404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-061b11f7-17c7-47cb-a3a9-5b536cb07065 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:17.034237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-061b11f7-17c7-47cb-a3a9-5b536cb07065 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:17.034237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-061b11f7-17c7-47cb-a3a9-5b536cb07065 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:17.034237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-061b11f7-17c7-47cb-a3a9-5b536cb07065 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:17.064478 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-061b11f7-17c7-47cb-a3a9-5b536cb07065 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] HTTP exception thrown: Instance 39db2b33-8e94-4b73-8250-695d7ee9508a could not be found. May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-061b11f7-17c7-47cb-a3a9-5b536cb07065 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Request method failure captured: May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a HTTP/1.1 May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko-d4ImzxJBm-EAMShmQ-kQFvkMvP3v-ZTsUrJfdiz6bu4vecR2bNSqGiBr-ZnDn0xYFZPE7fldy3fUYhqitB1ss71HWm8Xsm3QhTfoi72bTWlvKkw4gK20x0aaVQgK1OwRdqTn1RT1HE-bQ2SGnzTLXyNtNOEMxJJgS7sL8lIN-FNY May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 7e1a1360253a413d8ee275cb1d1fac02 May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersTestManualDisk-781256111 May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7e1a1360253a413d8ee275cb1d1fac02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e1a1360253a413d8ee275cb1d1fac02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7e1a1360253a413d8ee275cb1d1fac02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7e1a1360253a413d8ee275cb1d1fac02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersTestManualDisk-781256111 May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 7e1a1360253a413d8ee275cb1d1fac02 May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersTestManualDisk-781256111 May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersTestManualDisk-781256111-project May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f5df3bc2a59b4d99b81932deac1ece64 May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersTestManualDisk-781256111-project May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 39db2b33-8e94-4b73-8250-695d7ee9508a could not be found. May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '39db2b33-8e94-4b73-8250-695d7ee9508a'} May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39db2b33-8e94-4b73-8250-695d7ee9508a could not be found. May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39db2b33-8e94-4b73-8250-695d7ee9508a could not be found. May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:17.067585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:17.073596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:17.073596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:17.073596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:17.073596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:17.073596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:17.073596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39db2b33-8e94-4b73-8250-695d7ee9508a could not be found. May 28 21:11:17.073596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:17.073596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-061b11f7-17c7-47cb-a3a9-5b536cb07065 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Returning 404 to user: Instance 39db2b33-8e94-4b73-8250-695d7ee9508a could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:17.073596 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-061b11f7-17c7-47cb-a3a9-5b536cb07065 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a" status: 404 len: 111 microversion: 2.1 time: 0.078764 May 28 21:11:17.073596 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1147/2362] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:16 2022] GET /compute/v2.1/servers/39db2b33-8e94-4b73-8250-695d7ee9508a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:17.082113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e21809c0-ae42-45c4-8d1e-12e9e5447388 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:17.082113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e21809c0-ae42-45c4-8d1e-12e9e5447388 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:17.236470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e21809c0-ae42-45c4-8d1e-12e9e5447388 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:17.250358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6c96c841-55d0-4187-8643-49a956789d00 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:17.257931 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e21809c0-ae42-45c4-8d1e-12e9e5447388 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1214 microversion: 2.1 time: 0.184184 May 28 21:11:17.260815 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1148/2363] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:17 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:17.266715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9e2e3e89-8b6a-4e8e-b2c6-8f98d9156c60 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:17.267648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9e2e3e89-8b6a-4e8e-b2c6-8f98d9156c60 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:17.275614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e2e3e89-8b6a-4e8e-b2c6-8f98d9156c60 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:17.276587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e2e3e89-8b6a-4e8e-b2c6-8f98d9156c60 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:17.278475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e2e3e89-8b6a-4e8e-b2c6-8f98d9156c60 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:17.279126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e2e3e89-8b6a-4e8e-b2c6-8f98d9156c60 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:17.279848 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6c96c841-55d0-4187-8643-49a956789d00 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1307 microversion: 2.1 time: 0.476801 May 28 21:11:17.280473 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1216/2364] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:16 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1307 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:17.286761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d4ef7e84-820f-4283-8652-a58bce1e4175 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] Calling method '.version_select at 0x7f4d6426a8b0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:17.387072 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d4ef7e84-820f-4283-8652-a58bce1e4175 tempest-ServersTestManualDisk-781256111 tempest-ServersTestManualDisk-781256111-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091687615" status: 202 len: 0 microversion: 2.1 time: 0.100454 May 28 21:11:17.403101 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1217/2365] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 21:11:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091687615 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:11:17.425440 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9e2e3e89-8b6a-4e8e-b2c6-8f98d9156c60 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163203 May 28 21:11:17.426081 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1149/2366] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:11:17 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:17.476054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a41752c3-7aa7-45b9-97dd-8034f5b4efe7 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:17.476814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a41752c3-7aa7-45b9-97dd-8034f5b4efe7 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:17.490314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a41752c3-7aa7-45b9-97dd-8034f5b4efe7 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:17.491009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a41752c3-7aa7-45b9-97dd-8034f5b4efe7 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:17.492668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a41752c3-7aa7-45b9-97dd-8034f5b4efe7 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:17.493129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a41752c3-7aa7-45b9-97dd-8034f5b4efe7 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:18.080985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a41752c3-7aa7-45b9-97dd-8034f5b4efe7 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:18.091520 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a41752c3-7aa7-45b9-97dd-8034f5b4efe7 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1333 microversion: 2.1 time: 0.619946 May 28 21:11:18.100757 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1218/2367] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:17 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1333 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:18.278402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a482be5c-e082-4d7e-90b2-0e62bafc489d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:18.279155 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a482be5c-e082-4d7e-90b2-0e62bafc489d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:18.292543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a482be5c-e082-4d7e-90b2-0e62bafc489d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:18.293102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a482be5c-e082-4d7e-90b2-0e62bafc489d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:18.294561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a482be5c-e082-4d7e-90b2-0e62bafc489d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:18.299102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a482be5c-e082-4d7e-90b2-0e62bafc489d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:18.302098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0ba3c63b-01b9-4bff-aee8-ede70edf8652 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:18.308214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0ba3c63b-01b9-4bff-aee8-ede70edf8652 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:18.318365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ba3c63b-01b9-4bff-aee8-ede70edf8652 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:18.323190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ba3c63b-01b9-4bff-aee8-ede70edf8652 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:18.324576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ba3c63b-01b9-4bff-aee8-ede70edf8652 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:18.325677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ba3c63b-01b9-4bff-aee8-ede70edf8652 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:18.470841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a482be5c-e082-4d7e-90b2-0e62bafc489d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:18.479952 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a482be5c-e082-4d7e-90b2-0e62bafc489d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1218 microversion: 2.1 time: 0.206774 May 28 21:11:18.490477 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1150/2368] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:18 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1218 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:18.885186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-e9749285-78d6-4578-afe5-fface7086e2b req-4625245c-e44d-43c7-94c1-0b2e5705dd63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75938ae4-dbff-425f-be63-604274ec2263", "name": "network-vif-plugged", "status": "completed", "tag": "26bef74d-df41-4db6-a735-9232a61d21aa"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:18.906426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e9749285-78d6-4578-afe5-fface7086e2b req-4625245c-e44d-43c7-94c1-0b2e5705dd63 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:18.915211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e9749285-78d6-4578-afe5-fface7086e2b req-4625245c-e44d-43c7-94c1-0b2e5705dd63 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:18.938836 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e9749285-78d6-4578-afe5-fface7086e2b req-4625245c-e44d-43c7-94c1-0b2e5705dd63 service nova] Creating event network-vif-plugged:26bef74d-df41-4db6-a735-9232a61d21aa for instance 75938ae4-dbff-425f-be63-604274ec2263 on nch2-master-1 May 28 21:11:18.949550 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-e9749285-78d6-4578-afe5-fface7086e2b req-4625245c-e44d-43c7-94c1-0b2e5705dd63 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064410 May 28 21:11:18.971548 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1151/2369] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:11:19.121236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-36fcc0e4-87ae-446a-8382-d74b2a4c3f80 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:19.123379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-36fcc0e4-87ae-446a-8382-d74b2a4c3f80 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:19.133442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36fcc0e4-87ae-446a-8382-d74b2a4c3f80 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:19.134057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36fcc0e4-87ae-446a-8382-d74b2a4c3f80 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:19.135115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36fcc0e4-87ae-446a-8382-d74b2a4c3f80 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:19.135748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36fcc0e4-87ae-446a-8382-d74b2a4c3f80 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:19.240392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0ba3c63b-01b9-4bff-aee8-ede70edf8652 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:19.250286 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0ba3c63b-01b9-4bff-aee8-ede70edf8652 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1307 microversion: 2.1 time: 0.956692 May 28 21:11:19.250874 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1219/2370] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:18 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1307 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:11:19.499261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9bddc3ab-aa3e-4257-86a6-1e718f2fad36 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:19.500771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9bddc3ab-aa3e-4257-86a6-1e718f2fad36 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:19.512479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bddc3ab-aa3e-4257-86a6-1e718f2fad36 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:19.512947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bddc3ab-aa3e-4257-86a6-1e718f2fad36 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:19.513749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bddc3ab-aa3e-4257-86a6-1e718f2fad36 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:19.514224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bddc3ab-aa3e-4257-86a6-1e718f2fad36 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:19.838947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9bddc3ab-aa3e-4257-86a6-1e718f2fad36 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:19.850261 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9bddc3ab-aa3e-4257-86a6-1e718f2fad36 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1274 microversion: 2.1 time: 0.355425 May 28 21:11:19.861237 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1220/2371] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:19 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1274 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:11:19.916090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-36fcc0e4-87ae-446a-8382-d74b2a4c3f80 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:19.924241 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-36fcc0e4-87ae-446a-8382-d74b2a4c3f80 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1333 microversion: 2.1 time: 0.810100 May 28 21:11:19.929422 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1152/2372] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:19 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1333 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:20.268301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6c484b9c-1732-4a66-aaa3-e48d9f87cd60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:20.269565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6c484b9c-1732-4a66-aaa3-e48d9f87cd60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:20.276470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c484b9c-1732-4a66-aaa3-e48d9f87cd60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:20.277167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c484b9c-1732-4a66-aaa3-e48d9f87cd60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:20.278207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c484b9c-1732-4a66-aaa3-e48d9f87cd60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:20.278813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c484b9c-1732-4a66-aaa3-e48d9f87cd60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:20.635509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6c484b9c-1732-4a66-aaa3-e48d9f87cd60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:20.646230 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6c484b9c-1732-4a66-aaa3-e48d9f87cd60 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1307 microversion: 2.1 time: 0.382676 May 28 21:11:20.647072 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1221/2373] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:20 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1307 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:20.868501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fa6e671e-e57c-4e21-b5b1-b702122dc901 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:20.869305 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fa6e671e-e57c-4e21-b5b1-b702122dc901 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:20.877111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa6e671e-e57c-4e21-b5b1-b702122dc901 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:20.880009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa6e671e-e57c-4e21-b5b1-b702122dc901 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:20.880009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa6e671e-e57c-4e21-b5b1-b702122dc901 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:20.880009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa6e671e-e57c-4e21-b5b1-b702122dc901 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:20.947013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-af47a4ac-4c8d-4bd3-84b8-71e09e5b1ce1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:20.947903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-af47a4ac-4c8d-4bd3-84b8-71e09e5b1ce1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:20.957927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af47a4ac-4c8d-4bd3-84b8-71e09e5b1ce1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:20.958678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af47a4ac-4c8d-4bd3-84b8-71e09e5b1ce1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:20.976776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af47a4ac-4c8d-4bd3-84b8-71e09e5b1ce1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:20.978190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af47a4ac-4c8d-4bd3-84b8-71e09e5b1ce1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:21.078341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fa6e671e-e57c-4e21-b5b1-b702122dc901 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:21.090910 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fa6e671e-e57c-4e21-b5b1-b702122dc901 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1272 microversion: 2.1 time: 0.226522 May 28 21:11:21.108743 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1153/2374] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:20 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:21.130562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d3f6d940-43df-4a88-8741-fd24e24067eb req-c85575be-d9c3-4caf-a7e8-1e5b3b46c679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f808c8-db89-4f84-91be-66e4ddda87d4", "name": "network-vif-plugged", "status": "completed", "tag": "136634ca-0287-4836-91e1-7d6df183e1bc"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:21.147122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d3f6d940-43df-4a88-8741-fd24e24067eb req-c85575be-d9c3-4caf-a7e8-1e5b3b46c679 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:21.147895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d3f6d940-43df-4a88-8741-fd24e24067eb req-c85575be-d9c3-4caf-a7e8-1e5b3b46c679 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:21.189219 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d3f6d940-43df-4a88-8741-fd24e24067eb req-c85575be-d9c3-4caf-a7e8-1e5b3b46c679 service nova] Creating event network-vif-plugged:136634ca-0287-4836-91e1-7d6df183e1bc for instance 80f808c8-db89-4f84-91be-66e4ddda87d4 on nch1-master-1 May 28 21:11:21.198636 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d3f6d940-43df-4a88-8741-fd24e24067eb req-c85575be-d9c3-4caf-a7e8-1e5b3b46c679 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085515 May 28 21:11:21.200357 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1154/2375] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:21.367229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d19456d2-c383-499f-96c3-3f97de4312fa tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:21.367943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d19456d2-c383-499f-96c3-3f97de4312fa tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:21.380246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d19456d2-c383-499f-96c3-3f97de4312fa tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:21.389600 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d19456d2-c383-499f-96c3-3f97de4312fa tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:21.395937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d19456d2-c383-499f-96c3-3f97de4312fa tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:21.395937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d19456d2-c383-499f-96c3-3f97de4312fa tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:21.692008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-af47a4ac-4c8d-4bd3-84b8-71e09e5b1ce1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:21.711982 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-af47a4ac-4c8d-4bd3-84b8-71e09e5b1ce1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1333 microversion: 2.1 time: 0.759455 May 28 21:11:21.712665 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1222/2376] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:20 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1333 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:21.720202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-0486defa-6e12-4596-81fe-3e2934da74ab req-c6141ab8-7a6f-4cec-816e-21f85648a742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0e0703e-5c6e-4c58-8497-36a81542fec3", "tag": "b8b43638-9f68-46f7-847c-6c5e90163d68"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:21.746430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0486defa-6e12-4596-81fe-3e2934da74ab req-c6141ab8-7a6f-4cec-816e-21f85648a742 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:21.751765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0486defa-6e12-4596-81fe-3e2934da74ab req-c6141ab8-7a6f-4cec-816e-21f85648a742 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:21.788423 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-0486defa-6e12-4596-81fe-3e2934da74ab req-c6141ab8-7a6f-4cec-816e-21f85648a742 service nova] Creating event network-changed:b8b43638-9f68-46f7-847c-6c5e90163d68 for instance f0e0703e-5c6e-4c58-8497-36a81542fec3 on nch1-master-1 May 28 21:11:21.803937 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-0486defa-6e12-4596-81fe-3e2934da74ab req-c6141ab8-7a6f-4cec-816e-21f85648a742 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086683 May 28 21:11:21.807171 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1223/2377] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:21.967579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d19456d2-c383-499f-96c3-3f97de4312fa tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:21.983247 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d19456d2-c383-499f-96c3-3f97de4312fa tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 200 len: 1485 microversion: 2.1 time: 0.620717 May 28 21:11:21.984651 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1155/2378] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:21 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 1485 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:11:22.006258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-25b9b82e-2bc5-4a52-a3b2-56e71d17f287 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:22.007144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-25b9b82e-2bc5-4a52-a3b2-56e71d17f287 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:22.029986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25b9b82e-2bc5-4a52-a3b2-56e71d17f287 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:22.030463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25b9b82e-2bc5-4a52-a3b2-56e71d17f287 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:22.031284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25b9b82e-2bc5-4a52-a3b2-56e71d17f287 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:22.038136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25b9b82e-2bc5-4a52-a3b2-56e71d17f287 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:22.077726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:22.086651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1914884335", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "c1dde440-05b5-4215-bf14-fa46ddc2096b"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:22.177228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] validate_networks() for [('c1dde440-05b5-4215-bf14-fa46ddc2096b', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:11:22.522326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-25b9b82e-2bc5-4a52-a3b2-56e71d17f287 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:22.539589 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-25b9b82e-2bc5-4a52-a3b2-56e71d17f287 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1307 microversion: 2.1 time: 0.550494 May 28 21:11:22.541692 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1156/2379] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:21 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1307 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:22.560516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-df3becea-8beb-414c-9e39-8a37a1487f22 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:22.565507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-df3becea-8beb-414c-9e39-8a37a1487f22 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:22.579612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df3becea-8beb-414c-9e39-8a37a1487f22 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:22.581930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df3becea-8beb-414c-9e39-8a37a1487f22 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:22.583148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df3becea-8beb-414c-9e39-8a37a1487f22 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:22.584949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df3becea-8beb-414c-9e39-8a37a1487f22 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:24.159097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-df3becea-8beb-414c-9e39-8a37a1487f22 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:24.174247 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-df3becea-8beb-414c-9e39-8a37a1487f22 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1314 microversion: 2.1 time: 1.631094 May 28 21:11:24.194611 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1157/2380] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:22 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1314 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:24.198082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-64d4a32f-a214-44c7-a627-7fc99cd441c1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:24.198082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-64d4a32f-a214-44c7-a627-7fc99cd441c1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:24.214467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64d4a32f-a214-44c7-a627-7fc99cd441c1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:24.214689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64d4a32f-a214-44c7-a627-7fc99cd441c1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:24.215579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64d4a32f-a214-44c7-a627-7fc99cd441c1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:24.216028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64d4a32f-a214-44c7-a627-7fc99cd441c1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:24.825212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-64d4a32f-a214-44c7-a627-7fc99cd441c1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:24.837827 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-64d4a32f-a214-44c7-a627-7fc99cd441c1 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1668 microversion: 2.1 time: 0.650296 May 28 21:11:24.838458 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1158/2381] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:24 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1668 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:24.846844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e31ed2a0-0a83-4cd5-ae69-5484e46513fe tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:24.864745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e31ed2a0-0a83-4cd5-ae69-5484e46513fe tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:24.882090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e31ed2a0-0a83-4cd5-ae69-5484e46513fe tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:24.883305 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e31ed2a0-0a83-4cd5-ae69-5484e46513fe tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:24.884526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e31ed2a0-0a83-4cd5-ae69-5484e46513fe tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:24.885186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e31ed2a0-0a83-4cd5-ae69-5484e46513fe tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:24.893741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:11:24.894901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:11:24.895572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:11:24.896228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:11:24.897027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:11:24.914023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:24.915635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:24.917552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:24.920007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:24.977240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Getting quotas for project 9d08be7a2d1e4b779987d75d87a5ef44. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:24.990859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Getting quotas for user 04ae3115a9194b47bce62ada4a2afdf2 and project 9d08be7a2d1e4b779987d75d87a5ef44. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:25.024595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:11:25.031838 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:11:25.194274 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c56272fb-9f07-4c09-9957-9e644a976b73 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.385554 May 28 21:11:25.195326 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1224/2382] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:11:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:11:25.230218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e31ed2a0-0a83-4cd5-ae69-5484e46513fe tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:25.245909 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e31ed2a0-0a83-4cd5-ae69-5484e46513fe tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1488 microversion: 2.1 time: 0.402704 May 28 21:11:25.248662 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1159/2383] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:24 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1488 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:25.262342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ec7ee183-94c3-42e1-a578-d078cbc1c1d9 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:25.266871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ec7ee183-94c3-42e1-a578-d078cbc1c1d9 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:25.284952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec7ee183-94c3-42e1-a578-d078cbc1c1d9 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:25.285824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec7ee183-94c3-42e1-a578-d078cbc1c1d9 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:25.286831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec7ee183-94c3-42e1-a578-d078cbc1c1d9 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:25.289288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec7ee183-94c3-42e1-a578-d078cbc1c1d9 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:25.349293 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ec7ee183-94c3-42e1-a578-d078cbc1c1d9 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263/ips" status: 200 len: 179 microversion: 2.1 time: 0.094275 May 28 21:11:25.349992 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1160/2384] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 21:11:25 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263/ips => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:25.356290 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8c646af9-77bb-42c9-b51c-c9f8783af002 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:25.360840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8c646af9-77bb-42c9-b51c-c9f8783af002 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:25.380743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c646af9-77bb-42c9-b51c-c9f8783af002 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:25.382775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c646af9-77bb-42c9-b51c-c9f8783af002 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:25.384465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c646af9-77bb-42c9-b51c-c9f8783af002 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:25.385816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c646af9-77bb-42c9-b51c-c9f8783af002 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:25.704447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d2a282ed-2e58-4058-97cc-936c462bcb76 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Action: 'create', calling method: .version_select at 0x7f4d64251e50>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTpKmQiOJ1PWbZjtYTpZB505BWLWAvOKvMrvQcf4XY14LxfXoqpFeQJ9c72UpPkU6R7EOO5RXvGJhsZ9ZdHfQiYCD18TMIhjESBRI+w5YUlCy3WXar4TfuN82dt64aUuA=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:25.709594 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-d2a282ed-2e58-4058-97cc-936c462bcb76 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d2a282ed-2e58-4058-97cc-936c462bcb76 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Request method failure captured: May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 257 May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_8DaABN1jyqtYPLOgi8ZZvpzerubvQXnAtyWL1ReFfFaGO1hZn9Tta3YWnO75uyL6gDQQdiWB0EOhsvbEvB05PYWXV5i-jG81h7Yh4s-rSGxViqpg5mQbw5lqyQErKT6IHiZ0dcsgyJ6lI4DptT2rwhuFU7ydXGg--HuPk_9tYRM4 May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3b7c6618a074f8c97f2354096574844", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f7355397c65b4af881865f09b6b488bd May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTpKmQiOJ1PWbZjtYTpZB505BWLWAvOKvMrvQcf4XY14LxfXoqpFeQJ9c72UpPkU6R7EOO5RXvGJhsZ9ZdHfQiYCD18TMIhjESBRI+w5YUlCy3WXar4TfuN82dt64aUuA=="}} May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: exception: Keypair data is invalid: Keypair name contains unsafe characters May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTpKmQiOJ1PWbZjtYTpZB505BWLWAvOKvMrvQcf4XY14LxfXoqpFeQJ9c72UpPkU6R7EOO5RXvGJhsZ9ZdHfQiYCD18TMIhjESBRI+w5YUlCy3WXar4TfuN82dt64aUuA=='}}} May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:25.715459 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d2a282ed-2e58-4058-97cc-936c462bcb76 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d2a282ed-2e58-4058-97cc-936c462bcb76 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.520096 May 28 21:11:25.720115 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1225/2385] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:11:25 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 522 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:11:25.725698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c545223d-6e32-49d3-9ae7-550fe8eb96ed tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:25.725698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c545223d-6e32-49d3-9ae7-550fe8eb96ed tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:25.787838 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8c646af9-77bb-42c9-b51c-c9f8783af002 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:25.796455 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8c646af9-77bb-42c9-b51c-c9f8783af002 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1314 microversion: 2.1 time: 0.444406 May 28 21:11:25.797029 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1161/2386] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:25 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:25.807504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ef3df669-2e45-4c26-85e7-1fcd6c9a7267 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1230913375"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:25.808414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c545223d-6e32-49d3-9ae7-550fe8eb96ed tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:25.812168 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ef3df669-2e45-4c26-85e7-1fcd6c9a7267 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:25.816610 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c545223d-6e32-49d3-9ae7-550fe8eb96ed tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1224 microversion: 2.1 time: 0.097799 May 28 21:11:25.817499 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1226/2387] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:25 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:25.819493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef3df669-2e45-4c26-85e7-1fcd6c9a7267 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:25.820756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef3df669-2e45-4c26-85e7-1fcd6c9a7267 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:25.821551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef3df669-2e45-4c26-85e7-1fcd6c9a7267 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:25.822031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef3df669-2e45-4c26-85e7-1fcd6c9a7267 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:25.823134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fbbcf215-614b-4298-8997-67e3e2a69368 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:25.823948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fbbcf215-614b-4298-8997-67e3e2a69368 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:25.833666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fbbcf215-614b-4298-8997-67e3e2a69368 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:25.834557 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fbbcf215-614b-4298-8997-67e3e2a69368 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:25.835411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fbbcf215-614b-4298-8997-67e3e2a69368 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:25.836219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fbbcf215-614b-4298-8997-67e3e2a69368 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:25.879175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fbbcf215-614b-4298-8997-67e3e2a69368 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:11:26.242414 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fbbcf215-614b-4298-8997-67e3e2a69368 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "DELETE /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 204 len: 0 microversion: 2.1 time: 0.423203 May 28 21:11:26.244259 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1227/2388] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:11:25 2022] DELETE /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:11:26.251030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ae79f63-4384-4b39-aa18-3bb69fa3497d tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Action: 'create', calling method: .version_select at 0x7f4d646d8310>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1693593319", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:26.269335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-8ae79f63-4384-4b39-aa18-3bb69fa3497d tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Getting quotas for project e3b7c6618a074f8c97f2354096574844. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:26.280149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-8ae79f63-4384-4b39-aa18-3bb69fa3497d tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Getting quotas for user f7355397c65b4af881865f09b6b488bd and project e3b7c6618a074f8c97f2354096574844. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:26.297965 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-8ae79f63-4384-4b39-aa18-3bb69fa3497d tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ae79f63-4384-4b39-aa18-3bb69fa3497d tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Request method failure captured: May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 2167 May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_8DaABN1jyqtYPLOgi8ZZvpzerubvQXnAtyWL1ReFfFaGO1hZn9Tta3YWnO75uyL6gDQQdiWB0EOhsvbEvB05PYWXV5i-jG81h7Yh4s-rSGxViqpg5mQbw5lqyQErKT6IHiZ0dcsgyJ6lI4DptT2rwhuFU7ydXGg--HuPk_9tYRM4 May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3b7c6618a074f8c97f2354096574844", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f7355397c65b4af881865f09b6b488bd May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1693593319", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:11:26.314304 ncdv-master-1 devstack@n-api.service[143128]: exception: Keypair data is invalid: failed to generate fingerprint May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1693593319', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:26.317241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ae79f63-4384-4b39-aa18-3bb69fa3497d tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8ae79f63-4384-4b39-aa18-3bb69fa3497d tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.070300 May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1228/2389] 10.222.0.33 () {60 vars in 1159 bytes} [Sat May 28 21:11:26 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 21:11:26.320812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a573574b-538e-4377-8c7c-b94eebe3f832 req-ace5cb34-f20a-43ea-a3af-b944555d21e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea206247-c6b4-49e5-aafd-92084ea25c9a", "tag": "b2a22fa5-c484-458c-b896-9639a751194b"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:26.330393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a573574b-538e-4377-8c7c-b94eebe3f832 req-ace5cb34-f20a-43ea-a3af-b944555d21e8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:26.330841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a573574b-538e-4377-8c7c-b94eebe3f832 req-ace5cb34-f20a-43ea-a3af-b944555d21e8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:26.342832 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a573574b-538e-4377-8c7c-b94eebe3f832 req-ace5cb34-f20a-43ea-a3af-b944555d21e8 service nova] Creating event network-changed:b2a22fa5-c484-458c-b896-9639a751194b for instance ea206247-c6b4-49e5-aafd-92084ea25c9a on nch2-master-1 May 28 21:11:26.347337 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a573574b-538e-4377-8c7c-b94eebe3f832 req-ace5cb34-f20a-43ea-a3af-b944555d21e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029946 May 28 21:11:26.348206 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1229/2390] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:26.356303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c4b7073-3fd0-496c-8f6a-7b30cd52033a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:26.356303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3c4b7073-3fd0-496c-8f6a-7b30cd52033a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:26.361290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c4b7073-3fd0-496c-8f6a-7b30cd52033a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:26.361720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c4b7073-3fd0-496c-8f6a-7b30cd52033a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:26.362522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c4b7073-3fd0-496c-8f6a-7b30cd52033a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:26.362966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c4b7073-3fd0-496c-8f6a-7b30cd52033a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:26.571202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3c4b7073-3fd0-496c-8f6a-7b30cd52033a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:26.591948 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3c4b7073-3fd0-496c-8f6a-7b30cd52033a tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1674 microversion: 2.1 time: 0.242560 May 28 21:11:26.609288 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1230/2391] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:26 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1674 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:26.616307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5d6cf6ac-ea31-47ba-9f41-924449653299 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Action: 'create', calling method: .version_select at 0x7f4d642763a0>, body: {"keypair": {"name": "tempest-keypair-891555621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuiB0yqkydUr6yu2Vk8w7rVz5UU6SpY2H6CosaxoR2ldqrcqBfmt3saaIDl3xQvlON3tHVZj1jolOzrJ2ax5sL2YMcikCaf09ZabERReMYC/4ufFR3UADhz/1roUV8KaA=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:26.637438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-5d6cf6ac-ea31-47ba-9f41-924449653299 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Getting quotas for project e3b7c6618a074f8c97f2354096574844. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:26.664041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-5d6cf6ac-ea31-47ba-9f41-924449653299 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Getting quotas for user f7355397c65b4af881865f09b6b488bd and project e3b7c6618a074f8c97f2354096574844. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:26.693613 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ef3df669-2e45-4c26-85e7-1fcd6c9a7267 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "POST /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4/action" status: 202 len: 0 microversion: 2.1 time: 0.894745 May 28 21:11:26.700106 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1162/2392] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:11:25 2022] POST /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4/action => generated 0 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 21:11:26.709452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7fdfaaf0-9821-4a59-8c46-31e2e8aae238 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d64061790>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:26.776013 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7fdfaaf0-9821-4a59-8c46-31e2e8aae238 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d881ab12-d5af-40a4-970a-c48baa50d388" status: 200 len: 1412 microversion: 2.1 time: 0.074492 May 28 21:11:26.777150 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1163/2393] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:11:26 2022] GET /compute/v2.1/images/d881ab12-d5af-40a4-970a-c48baa50d388 => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:26.791025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5687eefc-b602-4675-8064-cbd2e4b6e2db tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d69c258b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:26.839172 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5687eefc-b602-4675-8064-cbd2e4b6e2db tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d881ab12-d5af-40a4-970a-c48baa50d388" status: 200 len: 1412 microversion: 2.1 time: 0.052590 May 28 21:11:26.840530 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1164/2394] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:11:26 2022] GET /compute/v2.1/images/d881ab12-d5af-40a4-970a-c48baa50d388 => generated 1412 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:26.845341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-23b4e7e4-61ee-4c46-9e85-09307556a326 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:26.846110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-23b4e7e4-61ee-4c46-9e85-09307556a326 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:26.852960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23b4e7e4-61ee-4c46-9e85-09307556a326 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:26.853699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23b4e7e4-61ee-4c46-9e85-09307556a326 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:26.854567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23b4e7e4-61ee-4c46-9e85-09307556a326 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:26.854863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23b4e7e4-61ee-4c46-9e85-09307556a326 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:26.870914 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5d6cf6ac-ea31-47ba-9f41-924449653299 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.258670 May 28 21:11:26.873944 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1231/2395] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:11:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:26.884027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d22bb99a-46c7-40ff-b5e4-8036b817bbbd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:26.890611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d22bb99a-46c7-40ff-b5e4-8036b817bbbd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:26.908208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d22bb99a-46c7-40ff-b5e4-8036b817bbbd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:26.910133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d22bb99a-46c7-40ff-b5e4-8036b817bbbd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:26.910133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d22bb99a-46c7-40ff-b5e4-8036b817bbbd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:26.912812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d22bb99a-46c7-40ff-b5e4-8036b817bbbd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:27.052741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d22bb99a-46c7-40ff-b5e4-8036b817bbbd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:27.080921 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d22bb99a-46c7-40ff-b5e4-8036b817bbbd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1228 microversion: 2.1 time: 0.205103 May 28 21:11:27.083020 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1232/2396] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:26 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1228 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:27.093408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-278142c9-6924-4976-88be-ba1c167bb8da tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d64251ca0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:27.175169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-23b4e7e4-61ee-4c46-9e85-09307556a326 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:27.197680 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-23b4e7e4-61ee-4c46-9e85-09307556a326 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1314 microversion: 2.1 time: 0.356061 May 28 21:11:27.208857 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1165/2397] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:26 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:27.221367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d4944467-6b46-493f-9758-b0372853783a tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Action: 'create', calling method: .version_select at 0x7f4d6457c670>, body: {"keypair": {"name": "tempest-keypair-891555621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOG6MQ7LXhx9L8tE63NOvasHF5z+IGFo8zdOdxIORS6WZ2ofUmBvNHQI5i3OHpyE+A0UgbtFNX0/yN2BJ4oGd7Q8GYyDodIi4Sb2ZxDpXNknc39OqiGYCdQIgWzmlHr/yQ=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:27.243657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-d4944467-6b46-493f-9758-b0372853783a tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Getting quotas for project e3b7c6618a074f8c97f2354096574844. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:27.253643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-d4944467-6b46-493f-9758-b0372853783a tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Getting quotas for user f7355397c65b4af881865f09b6b488bd and project e3b7c6618a074f8c97f2354096574844. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:27.322510 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-d4944467-6b46-493f-9758-b0372853783a tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] HTTP exception thrown: Key pair 'tempest-keypair-891555621' already exists. May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d4944467-6b46-493f-9758-b0372853783a tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Request method failure captured: May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 272 May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko_8DaABN1jyqtYPLOgi8ZZvpzerubvQXnAtyWL1ReFfFaGO1hZn9Tta3YWnO75uyL6gDQQdiWB0EOhsvbEvB05PYWXV5i-jG81h7Yh4s-rSGxViqpg5mQbw5lqyQErKT6IHiZ0dcsgyJ6lI4DptT2rwhuFU7ydXGg--HuPk_9tYRM4 May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3b7c6618a074f8c97f2354096574844", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f7355397c65b4af881865f09b6b488bd May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: {"keypair": {"name": "tempest-keypair-891555621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOG6MQ7LXhx9L8tE63NOvasHF5z+IGFo8zdOdxIORS6WZ2ofUmBvNHQI5i3OHpyE+A0UgbtFNX0/yN2BJ4oGd7Q8GYyDodIi4Sb2ZxDpXNknc39OqiGYCdQIgWzmlHr/yQ=="}} May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: exception: Key pair 'tempest-keypair-891555621' already exists. May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-891555621', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOG6MQ7LXhx9L8tE63NOvasHF5z+IGFo8zdOdxIORS6WZ2ofUmBvNHQI5i3OHpyE+A0UgbtFNX0/yN2BJ4oGd7Q8GYyDodIi4Sb2ZxDpXNknc39OqiGYCdQIgWzmlHr/yQ=='}}} May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = self._query(query) May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi conn.query(q) May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result.read() May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'f7355397c65b4af881865f09b6b488bd-tempest-keypair-891555621' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 28 21:11:27.349516 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi kp.save(context.session) May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi session.flush() May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._flush(objects) May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi compat.raise_( May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi flush_context.execute() May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi rec.execute(self) May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _emit_insert_statements( May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = connection._execute_20( May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = self._execute_context( May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = self._query(query) May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi conn.query(q) May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result.read() May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi packet.raise_for_error() May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) May 28 21:11:27.356793 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'f7355397c65b4af881865f09b6b488bd-tempest-keypair-891555621' for key 'key_pairs.uniq_key_pairs0user_id0name'") May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 5, 28, 21, 11, 27, 278579), 'updated_at': None, 'name': 'tempest-keypair-891555621', 'user_id': 'f7355397c65b4af881865f09b6b488bd', 'fingerprint': '99:c4:fb:c4:93:a1:dc:22:ed:5d:4c:87:42:1c:e4:b2', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOG6MQ7LXhx9L8tE63NOvasHF5z+IGFo8zdOdxIORS6WZ2ofUmBvNHQI5i3OHpyE+A0UgbtFNX0/yN2BJ4oGd7Q8GYyDodIi4Sb2ZxDpXNknc39OqiGYCdQIgWzmlHr/yQ==', 'type': 'ssh'}] May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi keypair.create() May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._create() May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-891555621' already exists. May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) May 28 21:11:27.362854 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-891555621' already exists. May 28 21:11:27.375534 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.375534 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.375534 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.375534 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.375534 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:27.375534 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:27.375534 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:27.375534 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:27.375534 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-891555621' already exists. May 28 21:11:27.375534 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.375534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d4944467-6b46-493f-9758-b0372853783a tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Returning 409 to user: Key pair 'tempest-keypair-891555621' already exists. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:27.375534 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d4944467-6b46-493f-9758-b0372853783a tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.141681 May 28 21:11:27.375534 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1166/2398] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:11:27 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:11:27.377274 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-278142c9-6924-4976-88be-ba1c167bb8da tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/images/d881ab12-d5af-40a4-970a-c48baa50d388" status: 204 len: 0 microversion: 2.1 time: 0.286246 May 28 21:11:27.377274 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1233/2399] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:27 2022] DELETE /compute/v2.1/images/d881ab12-d5af-40a4-970a-c48baa50d388 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:11:27.382698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-caa0e6b0-23d9-44e5-8b4e-d598d9c238d3 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d69d06040>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:27.385366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-763c1c9a-3c7d-437b-b3f0-ac62ee76b601 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Calling method '.version_select at 0x7f4d6492ee50>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:27.416184 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-caa0e6b0-23d9-44e5-8b4e-d598d9c238d3 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] HTTP exception thrown: Image not found. May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-caa0e6b0-23d9-44e5-8b4e-d598d9c238d3 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Request method failure captured: May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/images/d881ab12-d5af-40a4-970a-c48baa50d388 HTTP/1.1 May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko8he9ks8vlp5SnGXCv9gdBysO6_b2bFAPwwsIZ6x9Bz9wX0XihGyrBsZWl2n_NaakH7GUX7L5qPaLROHyNsgkGyW0kEItApc2X1pzZnSffgdU6BuSpBb305APZ1QKmZSduHi9PK3knUoxhUm3IEGhLFowLtVlq8KPjloN6F3tDWO1M May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_158c1665476643cda0976e68ab5e595a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/158c1665476643cda0976e68ab5e595a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesTestJSON-347859831 May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesTestJSON-347859831-project May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 04e5b86f94914df085b76e0d89b2230e May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesTestJSON-347859831-project May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: exception: Image not found. May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'd881ab12-d5af-40a4-970a-c48baa50d388'} May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d881ab12-d5af-40a4-970a-c48baa50d388 May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 21:11:27.418513 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d881ab12-d5af-40a4-970a-c48baa50d388 could not be found. May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-caa0e6b0-23d9-44e5-8b4e-d598d9c238d3 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Returning 404 to user: Image not found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-caa0e6b0-23d9-44e5-8b4e-d598d9c238d3 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/images/d881ab12-d5af-40a4-970a-c48baa50d388" status: 404 len: 62 microversion: 2.1 time: 0.043011 May 28 21:11:27.428431 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1234/2400] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:11:27 2022] GET /compute/v2.1/images/d881ab12-d5af-40a4-970a-c48baa50d388 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:11:27.439199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-83d5bdc2-4dc0-4d44-96a7-6a83d3437c69 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:27.440065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-83d5bdc2-4dc0-4d44-96a7-6a83d3437c69 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:27.450194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-83d5bdc2-4dc0-4d44-96a7-6a83d3437c69 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:27.450981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-83d5bdc2-4dc0-4d44-96a7-6a83d3437c69 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:27.451896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-83d5bdc2-4dc0-4d44-96a7-6a83d3437c69 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:27.452808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-83d5bdc2-4dc0-4d44-96a7-6a83d3437c69 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:27.478148 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-763c1c9a-3c7d-437b-b3f0-ac62ee76b601 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-891555621" status: 202 len: 0 microversion: 2.1 time: 0.111512 May 28 21:11:27.479062 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1167/2401] 10.222.0.33 () {58 vars in 1217 bytes} [Sat May 28 21:11:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-891555621 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:11:27.502360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-52bc59f3-2b8a-4872-a018-695a46a71d83 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Action: 'create', calling method: .version_select at 0x7f4d64043c10>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS1SBpf/DssI4K/ZbZsXuc5jaV6iM0zdvdC4RQdq6RBwQ2UdZ8d9hgCp5RD+XJjwU1MUoJWLmKYJpYmuAL2AcerBAKO5inB9tmv3xLkwkQWM1nT3LN4L5iI/DcXEIoyFw=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-52bc59f3-2b8a-4872-a018-695a46a71d83 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Request method failure captured: May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 247 May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko_8DaABN1jyqtYPLOgi8ZZvpzerubvQXnAtyWL1ReFfFaGO1hZn9Tta3YWnO75uyL6gDQQdiWB0EOhsvbEvB05PYWXV5i-jG81h7Yh4s-rSGxViqpg5mQbw5lqyQErKT6IHiZ0dcsgyJ6lI4DptT2rwhuFU7ydXGg--HuPk_9tYRM4 May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3b7c6618a074f8c97f2354096574844", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f7355397c65b4af881865f09b6b488bd May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS1SBpf/DssI4K/ZbZsXuc5jaV6iM0zdvdC4RQdq6RBwQ2UdZ8d9hgCp5RD+XJjwU1MUoJWLmKYJpYmuAL2AcerBAKO5inB9tmv3xLkwkQWM1nT3LN4L5iI/DcXEIoyFw=="}} May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute name. Value: . '' is too short May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJS1SBpf/DssI4K/ZbZsXuc5jaV6iM0zdvdC4RQdq6RBwQ2UdZ8d9hgCp5RD+XJjwU1MUoJWLmKYJpYmuAL2AcerBAKO5inB9tmv3xLkwkQWM1nT3LN4L5iI/DcXEIoyFw=='}}} May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi '' May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:11:27.505918 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-52bc59f3-2b8a-4872-a018-695a46a71d83 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:27.519493 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-52bc59f3-2b8a-4872-a018-695a46a71d83 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.013634 May 28 21:11:27.520733 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1168/2402] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:11:27 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:11:27.531519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-34927dbb-32b4-4646-903b-f589810be289 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Action: 'create', calling method: .version_select at 0x7f4d69cbf1f0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-435375560", "public_key": " "}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:27.563082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-34927dbb-32b4-4646-903b-f589810be289 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Getting quotas for project e3b7c6618a074f8c97f2354096574844. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:27.568649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-34927dbb-32b4-4646-903b-f589810be289 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Getting quotas for user f7355397c65b4af881865f09b6b488bd and project e3b7c6618a074f8c97f2354096574844. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:27.593231 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-34927dbb-32b4-4646-903b-f589810be289 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-34927dbb-32b4-4646-903b-f589810be289 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Request method failure captured: May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 94 May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko_8DaABN1jyqtYPLOgi8ZZvpzerubvQXnAtyWL1ReFfFaGO1hZn9Tta3YWnO75uyL6gDQQdiWB0EOhsvbEvB05PYWXV5i-jG81h7Yh4s-rSGxViqpg5mQbw5lqyQErKT6IHiZ0dcsgyJ6lI4DptT2rwhuFU7ydXGg--HuPk_9tYRM4 May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3b7c6618a074f8c97f2354096574844", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f7355397c65b4af881865f09b6b488bd May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-435375560", "public_key": " "}} May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: exception: Keypair data is invalid: failed to generate fingerprint May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-435375560', 'public_key': ' '}}} May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.598690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-34927dbb-32b4-4646-903b-f589810be289 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-34927dbb-32b4-4646-903b-f589810be289 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.073430 May 28 21:11:27.615585 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1169/2403] 10.222.0.33 () {60 vars in 1157 bytes} [Sat May 28 21:11:27 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) May 28 21:11:27.618540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-32273406-6265-46fd-a179-cf60297f3c0f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:27.618540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-32273406-6265-46fd-a179-cf60297f3c0f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:27.633113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32273406-6265-46fd-a179-cf60297f3c0f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:27.633634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32273406-6265-46fd-a179-cf60297f3c0f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:27.640737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32273406-6265-46fd-a179-cf60297f3c0f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:27.641256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32273406-6265-46fd-a179-cf60297f3c0f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:27.830933 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-83d5bdc2-4dc0-4d44-96a7-6a83d3437c69 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:27.847066 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-83d5bdc2-4dc0-4d44-96a7-6a83d3437c69 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1500 microversion: 2.1 time: 0.415712 May 28 21:11:27.860906 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1235/2404] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:27 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1500 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:11:27.867624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-895dd9e1-052f-4d58-b5af-6ae86c5168a5 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Action: 'create', calling method: .version_select at 0x7f4d64298dc0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnQ7c3d+p3XZseg8OQuEAKRusysGf1W8hrKh6ds+36VMC9OCrDShVrEjaLjTL+39VWK+vbFvtbcXBFONGN8qLpy0w/pE/FCxU5w94f+yBw+f+qaZ1gDGOHs2qBWmk321g=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-895dd9e1-052f-4d58-b5af-6ae86c5168a5 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Request method failure captured: May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 507 May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_8DaABN1jyqtYPLOgi8ZZvpzerubvQXnAtyWL1ReFfFaGO1hZn9Tta3YWnO75uyL6gDQQdiWB0EOhsvbEvB05PYWXV5i-jG81h7Yh4s-rSGxViqpg5mQbw5lqyQErKT6IHiZ0dcsgyJ6lI4DptT2rwhuFU7ydXGg--HuPk_9tYRM4 May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3b7c6618a074f8c97f2354096574844", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f7355397c65b4af881865f09b6b488bd May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnQ7c3d+p3XZseg8OQuEAKRusysGf1W8hrKh6ds+36VMC9OCrDShVrEjaLjTL+39VWK+vbFvtbcXBFONGN8qLpy0w/pE/FCxU5w94f+yBw+f+qaZ1gDGOHs2qBWmk321g=="}} May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnQ7c3d+p3XZseg8OQuEAKRusysGf1W8hrKh6ds+36VMC9OCrDShVrEjaLjTL+39VWK+vbFvtbcXBFONGN8qLpy0w/pE/FCxU5w94f+yBw+f+qaZ1gDGOHs2qBWmk321g=='}}} May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise error May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi On instance['keypair']: May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' May 28 21:11:27.871491 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long May 28 21:11:27.875242 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.882816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-895dd9e1-052f-4d58-b5af-6ae86c5168a5 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:27.884079 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-895dd9e1-052f-4d58-b5af-6ae86c5168a5 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.021901 May 28 21:11:27.890717 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1236/2405] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:11:27 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:11:27.897098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-31449042-fe50-42de-bae6-e36858da9367 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Action: 'create', calling method: .version_select at 0x7f4d69ccbb80>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1788330415", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:27.923086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-31449042-fe50-42de-bae6-e36858da9367 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Getting quotas for project e3b7c6618a074f8c97f2354096574844. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:27.927206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:27.930971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-31449042-fe50-42de-bae6-e36858da9367 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Getting quotas for user f7355397c65b4af881865f09b6b488bd and project e3b7c6618a074f8c97f2354096574844. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:27.951471 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-31449042-fe50-42de-bae6-e36858da9367 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-31449042-fe50-42de-bae6-e36858da9367 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Request method failure captured: May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 118 May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_8DaABN1jyqtYPLOgi8ZZvpzerubvQXnAtyWL1ReFfFaGO1hZn9Tta3YWnO75uyL6gDQQdiWB0EOhsvbEvB05PYWXV5i-jG81h7Yh4s-rSGxViqpg5mQbw5lqyQErKT6IHiZ0dcsgyJ6lI4DptT2rwhuFU7ydXGg--HuPk_9tYRM4 May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3b7c6618a074f8c97f2354096574844", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f7355397c65b4af881865f09b6b488bd May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1788330415", "public_key": "ssh-rsa JUNK nova@ubuntu"}} May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: exception: Keypair data is invalid: failed to generate fingerprint May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1788330415', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ValueError: Invalid data May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint May 28 21:11:27.953020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._create(req, body) May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-31449042-fe50-42de-bae6-e36858da9367 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:27.960007 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-31449042-fe50-42de-bae6-e36858da9367 tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.062334 May 28 21:11:27.969501 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1237/2406] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:11:27 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 21:11:27.969501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c0cc03e3-0583-4965-a5d2-8bd48bcee98d tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Calling method '.version_select at 0x7f4d645d39d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:27.979093 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-c0cc03e3-0583-4965-a5d2-8bd48bcee98d tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2006471435 not found for user f7355397c65b4af881865f09b6b488bd May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c0cc03e3-0583-4965-a5d2-8bd48bcee98d tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Request method failure captured: May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2006471435 HTTP/1.1 May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_8DaABN1jyqtYPLOgi8ZZvpzerubvQXnAtyWL1ReFfFaGO1hZn9Tta3YWnO75uyL6gDQQdiWB0EOhsvbEvB05PYWXV5i-jG81h7Yh4s-rSGxViqpg5mQbw5lqyQErKT6IHiZ0dcsgyJ6lI4DptT2rwhuFU7ydXGg--HuPk_9tYRM4 May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3b7c6618a074f8c97f2354096574844", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3b7c6618a074f8c97f2354096574844"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e3b7c6618a074f8c97f2354096574844 May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-34044992 May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f7355397c65b4af881865f09b6b488bd May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-KeyPairsNegativeTestJSON-34044992-project May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: exception: Keypair tempest-keypair-non-existent-2006471435 not found for user f7355397c65b4af881865f09b6b488bd May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'tempest-keypair-non-existent-2006471435'} May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.force_reraise() May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise self.value May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2006471435 not found for user f7355397c65b4af881865f09b6b488bd May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.981955 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req, id) May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2006471435 not found for user f7355397c65b4af881865f09b6b488bd May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2006471435 not found for user f7355397c65b4af881865f09b6b488bd May 28 21:11:27.986600 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:27.994031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c0cc03e3-0583-4965-a5d2-8bd48bcee98d tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2006471435 not found for user f7355397c65b4af881865f09b6b488bd {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:27.995749 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c0cc03e3-0583-4965-a5d2-8bd48bcee98d tempest-KeyPairsNegativeTestJSON-34044992 tempest-KeyPairsNegativeTestJSON-34044992-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2006471435" status: 404 len: 145 microversion: 2.1 time: 0.032330 May 28 21:11:28.001998 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1238/2407] 10.222.0.33 () {58 vars in 1259 bytes} [Sat May 28 21:11:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2006471435 => generated 145 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:28.051944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-32273406-6265-46fd-a179-cf60297f3c0f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:28.074457 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-32273406-6265-46fd-a179-cf60297f3c0f tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1674 microversion: 2.1 time: 0.464845 May 28 21:11:28.075852 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1170/2408] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:27 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1674 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:28.103847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dc4109e2-650d-4ffe-978f-15e94e3df212 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:28.104792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dc4109e2-650d-4ffe-978f-15e94e3df212 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:28.132126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc4109e2-650d-4ffe-978f-15e94e3df212 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:28.132590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc4109e2-650d-4ffe-978f-15e94e3df212 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:28.133392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc4109e2-650d-4ffe-978f-15e94e3df212 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:28.134984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc4109e2-650d-4ffe-978f-15e94e3df212 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:28.217829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dce20eee-a8af-4807-95dd-1bef967ffbd9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:28.218570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dce20eee-a8af-4807-95dd-1bef967ffbd9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:28.225455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dce20eee-a8af-4807-95dd-1bef967ffbd9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:28.225955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dce20eee-a8af-4807-95dd-1bef967ffbd9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:28.226987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dce20eee-a8af-4807-95dd-1bef967ffbd9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:28.228026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dce20eee-a8af-4807-95dd-1bef967ffbd9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:28.228979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dc4109e2-650d-4ffe-978f-15e94e3df212 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:28.240803 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dc4109e2-650d-4ffe-978f-15e94e3df212 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1276 microversion: 2.1 time: 0.144886 May 28 21:11:28.246973 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1239/2409] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:28 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1276 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:28.653697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dce20eee-a8af-4807-95dd-1bef967ffbd9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:28.668087 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dce20eee-a8af-4807-95dd-1bef967ffbd9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1314 microversion: 2.1 time: 0.455189 May 28 21:11:28.669258 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1171/2410] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:28 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:28.866581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5bb01314-92d8-431c-85d7-0b21d7fabcf8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:28.867191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5bb01314-92d8-431c-85d7-0b21d7fabcf8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:28.881263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bb01314-92d8-431c-85d7-0b21d7fabcf8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:28.887519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bb01314-92d8-431c-85d7-0b21d7fabcf8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:28.887519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bb01314-92d8-431c-85d7-0b21d7fabcf8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:28.887519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bb01314-92d8-431c-85d7-0b21d7fabcf8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:29.096312 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a7a89313-79d8-42f2-a329-83c8e9e8b9bd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:29.097561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a7a89313-79d8-42f2-a329-83c8e9e8b9bd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:29.103882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:29.112062 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a7a89313-79d8-42f2-a329-83c8e9e8b9bd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:29.112827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a7a89313-79d8-42f2-a329-83c8e9e8b9bd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:29.114066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a7a89313-79d8-42f2-a329-83c8e9e8b9bd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:29.114692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a7a89313-79d8-42f2-a329-83c8e9e8b9bd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:29.491087 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5bb01314-92d8-431c-85d7-0b21d7fabcf8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:29.499817 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5bb01314-92d8-431c-85d7-0b21d7fabcf8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1506 microversion: 2.1 time: 0.637697 May 28 21:11:29.501006 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1240/2411] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:28 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1506 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:29.505573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-235d8399-55b1-4d40-a7c5-10f8cd040d10 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:29.506610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-235d8399-55b1-4d40-a7c5-10f8cd040d10 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:29.519147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-235d8399-55b1-4d40-a7c5-10f8cd040d10 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:29.519799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-235d8399-55b1-4d40-a7c5-10f8cd040d10 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:29.520829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-235d8399-55b1-4d40-a7c5-10f8cd040d10 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:29.521453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-235d8399-55b1-4d40-a7c5-10f8cd040d10 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:29.575480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a7a89313-79d8-42f2-a329-83c8e9e8b9bd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:29.588543 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a7a89313-79d8-42f2-a329-83c8e9e8b9bd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1653 microversion: 2.1 time: 0.496799 May 28 21:11:29.590644 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1172/2412] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:29 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1653 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:11:29.609200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-1526034b-dc5d-451b-a7b9-8e276d215fd0 req-70f40d00-493b-416a-b7b9-792e79dc2aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75938ae4-dbff-425f-be63-604274ec2263", "name": "network-vif-deleted", "tag": "26bef74d-df41-4db6-a735-9232a61d21aa"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:29.621829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1526034b-dc5d-451b-a7b9-8e276d215fd0 req-70f40d00-493b-416a-b7b9-792e79dc2aac service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:29.624679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1526034b-dc5d-451b-a7b9-8e276d215fd0 req-70f40d00-493b-416a-b7b9-792e79dc2aac service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:29.640041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-235d8399-55b1-4d40-a7c5-10f8cd040d10 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:29.640560 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-1526034b-dc5d-451b-a7b9-8e276d215fd0 req-70f40d00-493b-416a-b7b9-792e79dc2aac service nova] Creating event network-vif-deleted:26bef74d-df41-4db6-a735-9232a61d21aa for instance 75938ae4-dbff-425f-be63-604274ec2263 on nch2-master-1 May 28 21:11:29.645876 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-1526034b-dc5d-451b-a7b9-8e276d215fd0 req-70f40d00-493b-416a-b7b9-792e79dc2aac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053790 May 28 21:11:29.646490 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1173/2413] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:29.648388 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-235d8399-55b1-4d40-a7c5-10f8cd040d10 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1282 microversion: 2.1 time: 0.146983 May 28 21:11:29.649055 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1241/2414] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:29 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1282 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:29.685413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-21fd2bf8-adcf-404e-9e38-643074c41bd4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:29.689160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-21fd2bf8-adcf-404e-9e38-643074c41bd4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:29.695800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21fd2bf8-adcf-404e-9e38-643074c41bd4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:29.696689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21fd2bf8-adcf-404e-9e38-643074c41bd4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:29.697571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21fd2bf8-adcf-404e-9e38-643074c41bd4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:29.698058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21fd2bf8-adcf-404e-9e38-643074c41bd4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:29.919922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-21fd2bf8-adcf-404e-9e38-643074c41bd4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:29.928836 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-21fd2bf8-adcf-404e-9e38-643074c41bd4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1314 microversion: 2.1 time: 0.247684 May 28 21:11:29.931890 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1174/2415] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:29 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:30.520421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-15ca5f63-466d-4c18-b2fb-6ee4032ea109 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:30.521727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-15ca5f63-466d-4c18-b2fb-6ee4032ea109 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:30.531075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15ca5f63-466d-4c18-b2fb-6ee4032ea109 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:30.533103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15ca5f63-466d-4c18-b2fb-6ee4032ea109 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:30.534237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15ca5f63-466d-4c18-b2fb-6ee4032ea109 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:30.534899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15ca5f63-466d-4c18-b2fb-6ee4032ea109 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:30.541659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:30.610099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1108b709-bbf8-4182-a5f2-47393b3b7695 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:30.611662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1108b709-bbf8-4182-a5f2-47393b3b7695 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:30.628990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1108b709-bbf8-4182-a5f2-47393b3b7695 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:30.632408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1108b709-bbf8-4182-a5f2-47393b3b7695 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:30.633463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1108b709-bbf8-4182-a5f2-47393b3b7695 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:30.636497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1108b709-bbf8-4182-a5f2-47393b3b7695 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:30.832113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1108b709-bbf8-4182-a5f2-47393b3b7695 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '659bd3ebefc348b7a176379bd342f9ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf209a1ba94046f89ddf62c77b6b0f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:30.843469 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1108b709-bbf8-4182-a5f2-47393b3b7695 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 200 len: 1297 microversion: 2.1 time: 0.238049 May 28 21:11:30.847867 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1175/2416] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:30 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 1297 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:30.854538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b4aa6750-9a99-46c2-8de0-5e7ece271900 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:30.855483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b4aa6750-9a99-46c2-8de0-5e7ece271900 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:30.862816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4aa6750-9a99-46c2-8de0-5e7ece271900 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:30.864067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4aa6750-9a99-46c2-8de0-5e7ece271900 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:30.865101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4aa6750-9a99-46c2-8de0-5e7ece271900 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:30.865799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4aa6750-9a99-46c2-8de0-5e7ece271900 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:30.872433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-15ca5f63-466d-4c18-b2fb-6ee4032ea109 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:30.883073 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-15ca5f63-466d-4c18-b2fb-6ee4032ea109 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1501 microversion: 2.1 time: 0.367090 May 28 21:11:30.884191 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1242/2417] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:30 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1501 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:30.948103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bb9e8dc4-dc61-4166-b7a9-b9769e858aa2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:30.950959 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bb9e8dc4-dc61-4166-b7a9-b9769e858aa2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:30.959195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb9e8dc4-dc61-4166-b7a9-b9769e858aa2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:30.962977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb9e8dc4-dc61-4166-b7a9-b9769e858aa2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:30.964087 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb9e8dc4-dc61-4166-b7a9-b9769e858aa2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:30.964549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb9e8dc4-dc61-4166-b7a9-b9769e858aa2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:31.244757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b4aa6750-9a99-46c2-8de0-5e7ece271900 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:31.261051 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b4aa6750-9a99-46c2-8de0-5e7ece271900 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1324 microversion: 2.1 time: 0.414652 May 28 21:11:31.262926 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1176/2418] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:30 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1324 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:31.429676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bb9e8dc4-dc61-4166-b7a9-b9769e858aa2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:31.440921 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bb9e8dc4-dc61-4166-b7a9-b9769e858aa2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1314 microversion: 2.1 time: 0.496893 May 28 21:11:31.446391 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1243/2419] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:30 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1314 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:31.666217 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-486b7ac5-5d47-4764-9d9e-fd0072a4e5ac req-0da18d72-c641-4702-8238-ff7ca1df115b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75938ae4-dbff-425f-be63-604274ec2263", "name": "network-vif-deleted", "tag": "48713bf0-ee86-41b0-8830-df2898fc6280"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:31.690002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-486b7ac5-5d47-4764-9d9e-fd0072a4e5ac req-0da18d72-c641-4702-8238-ff7ca1df115b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:31.690532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-486b7ac5-5d47-4764-9d9e-fd0072a4e5ac req-0da18d72-c641-4702-8238-ff7ca1df115b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:31.709172 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-486b7ac5-5d47-4764-9d9e-fd0072a4e5ac req-0da18d72-c641-4702-8238-ff7ca1df115b service nova] Creating event network-vif-deleted:48713bf0-ee86-41b0-8830-df2898fc6280 for instance 75938ae4-dbff-425f-be63-604274ec2263 on nch2-master-1 May 28 21:11:31.719174 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-486b7ac5-5d47-4764-9d9e-fd0072a4e5ac req-0da18d72-c641-4702-8238-ff7ca1df115b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056556 May 28 21:11:31.719796 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1177/2420] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:31.861974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f2f88cab-d460-48f3-9983-3bf9c87d140c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:31.862678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f2f88cab-d460-48f3-9983-3bf9c87d140c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:31.882398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2f88cab-d460-48f3-9983-3bf9c87d140c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:31.883146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2f88cab-d460-48f3-9983-3bf9c87d140c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:31.884775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2f88cab-d460-48f3-9983-3bf9c87d140c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:31.885447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2f88cab-d460-48f3-9983-3bf9c87d140c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:31.904388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9623347f-e449-41fa-946d-716ddabab59f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:31.905340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9623347f-e449-41fa-946d-716ddabab59f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:31.921866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9623347f-e449-41fa-946d-716ddabab59f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:31.922340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9623347f-e449-41fa-946d-716ddabab59f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:31.923166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9623347f-e449-41fa-946d-716ddabab59f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:31.927966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9623347f-e449-41fa-946d-716ddabab59f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:31.936412 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-f2f88cab-d460-48f3-9983-3bf9c87d140c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] HTTP exception thrown: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f2f88cab-d460-48f3-9983-3bf9c87d140c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Request method failure captured: May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 HTTP/1.1 May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko-GfAmbq19Wzv_IyvJ0froXseFFHax7tRSAMxzOcmJGrgNhnl6GaI4_cqWJ1_mmEzIYwTNYRshjIToYEGaO5q5ats0YCKI_8ETREUpvTBw6IHhnlwFfolTD_fwH7DsbEEqbkIxRvqU_rv_EMuzrUQQcO9LdGvHqdKwJSM18PWYdGQU May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf209a1ba94046f89ddf62c77b6b0f02 May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestMultiNic-1707558365 May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf209a1ba94046f89ddf62c77b6b0f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestMultiNic-1707558365 May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf209a1ba94046f89ddf62c77b6b0f02 May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestMultiNic-1707558365 May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestMultiNic-1707558365-project May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 659bd3ebefc348b7a176379bd342f9ed May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestMultiNic-1707558365-project May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '75938ae4-dbff-425f-be63-604274ec2263'} May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:31.951474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:31.956982 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:31.956982 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:31.956982 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:31.956982 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:31.956982 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:31.956982 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. May 28 21:11:31.956982 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:31.956982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f2f88cab-d460-48f3-9983-3bf9c87d140c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Returning 404 to user: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:31.956982 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f2f88cab-d460-48f3-9983-3bf9c87d140c tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 404 len: 111 microversion: 2.1 time: 0.091864 May 28 21:11:31.963190 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1244/2421] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:31 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:32.279735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ebc93904-ed89-428d-928c-4061f1fb241a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:32.280611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ebc93904-ed89-428d-928c-4061f1fb241a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:32.287855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebc93904-ed89-428d-928c-4061f1fb241a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:32.288308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebc93904-ed89-428d-928c-4061f1fb241a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:32.289097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebc93904-ed89-428d-928c-4061f1fb241a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:32.289537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebc93904-ed89-428d-928c-4061f1fb241a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:32.596255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9623347f-e449-41fa-946d-716ddabab59f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:32.608022 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9623347f-e449-41fa-946d-716ddabab59f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1488 microversion: 2.1 time: 0.708918 May 28 21:11:32.624171 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1178/2422] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:31 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1488 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:32.636486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ea79e03b-aae3-4b0a-a4c8-99d4bcafe2ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:32.638456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ea79e03b-aae3-4b0a-a4c8-99d4bcafe2ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:32.685096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea79e03b-aae3-4b0a-a4c8-99d4bcafe2ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:32.685708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea79e03b-aae3-4b0a-a4c8-99d4bcafe2ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:32.695862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea79e03b-aae3-4b0a-a4c8-99d4bcafe2ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:32.696810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea79e03b-aae3-4b0a-a4c8-99d4bcafe2ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:32.723401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ebc93904-ed89-428d-928c-4061f1fb241a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:32.735549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:32.743343 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ebc93904-ed89-428d-928c-4061f1fb241a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1324 microversion: 2.1 time: 0.467455 May 28 21:11:32.746477 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1245/2423] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:32 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1324 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:32.759189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8fc60cd7-e7f4-4d5d-8140-c32e6f8f4666 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:32.760054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8fc60cd7-e7f4-4d5d-8140-c32e6f8f4666 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:32.776462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fc60cd7-e7f4-4d5d-8140-c32e6f8f4666 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:32.783408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fc60cd7-e7f4-4d5d-8140-c32e6f8f4666 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:32.789056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fc60cd7-e7f4-4d5d-8140-c32e6f8f4666 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:32.789583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fc60cd7-e7f4-4d5d-8140-c32e6f8f4666 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:32.851142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8fc60cd7-e7f4-4d5d-8140-c32e6f8f4666 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:11:33.359795 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8fc60cd7-e7f4-4d5d-8140-c32e6f8f4666 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 204 len: 0 microversion: 2.1 time: 0.611487 May 28 21:11:33.360476 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1246/2424] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:11:32 2022] DELETE /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:11:33.373489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-03dfc9e4-c067-4b96-ad22-7faa572ec2a4 req-228d722c-cf41-442e-a71e-20805121d558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a4cf15-02b5-42d1-ae2f-849ca1ec8d35", "tag": "825989f5-1b0d-4731-92b8-dabd0a2be976"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:33.388822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-03dfc9e4-c067-4b96-ad22-7faa572ec2a4 req-228d722c-cf41-442e-a71e-20805121d558 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:33.389558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-03dfc9e4-c067-4b96-ad22-7faa572ec2a4 req-228d722c-cf41-442e-a71e-20805121d558 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:33.411493 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-03dfc9e4-c067-4b96-ad22-7faa572ec2a4 req-228d722c-cf41-442e-a71e-20805121d558 service nova] Creating event network-changed:825989f5-1b0d-4731-92b8-dabd0a2be976 for instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 on nch2-master-1 May 28 21:11:33.419483 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-03dfc9e4-c067-4b96-ad22-7faa572ec2a4 req-228d722c-cf41-442e-a71e-20805121d558 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050716 May 28 21:11:33.420842 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1247/2425] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:33.431458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e9612055-2c5f-49fc-85d0-2ba32633bc03 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d64276e50>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:33.467662 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-e9612055-2c5f-49fc-85d0-2ba32633bc03 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] HTTP exception thrown: Image not found. May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e9612055-2c5f-49fc-85d0-2ba32633bc03 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Request method failure captured: May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/images/d881ab12-d5af-40a4-970a-c48baa50d388 HTTP/1.1 May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko8he9ks8vlp5SnGXCv9gdBysO6_b2bFAPwwsIZ6x9Bz9wX0XihGyrBsZWl2n_NaakH7GUX7L5qPaLROHyNsgkGyW0kEItApc2X1pzZnSffgdU6BuSpBb305APZ1QKmZSduHi9PK3knUoxhUm3IEGhLFowLtVlq8KPjloN6F3tDWO1M May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_158c1665476643cda0976e68ab5e595a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/158c1665476643cda0976e68ab5e595a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesTestJSON-347859831 May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesTestJSON-347859831-project May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 04e5b86f94914df085b76e0d89b2230e May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesTestJSON-347859831-project May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: exception: Image not found. May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'd881ab12-d5af-40a4-970a-c48baa50d388'} May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d881ab12-d5af-40a4-970a-c48baa50d388 to delete May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d881ab12-d5af-40a4-970a-c48baa50d388 could not be found. May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:33.477501 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e9612055-2c5f-49fc-85d0-2ba32633bc03 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Returning 404 to user: Image not found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:33.483636 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e9612055-2c5f-49fc-85d0-2ba32633bc03 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/images/d881ab12-d5af-40a4-970a-c48baa50d388" status: 404 len: 62 microversion: 2.1 time: 0.051656 May 28 21:11:33.485574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ea79e03b-aae3-4b0a-a4c8-99d4bcafe2ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:33.485693 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1248/2426] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:33 2022] DELETE /compute/v2.1/images/d881ab12-d5af-40a4-970a-c48baa50d388 => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:11:33.487925 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ea79e03b-aae3-4b0a-a4c8-99d4bcafe2ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1314 microversion: 2.1 time: 0.862191 May 28 21:11:33.490154 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1179/2427] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:32 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1314 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:33.493680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d65134b4-748e-427e-9da4-037cfd7e2cce tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:33.494953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d65134b4-748e-427e-9da4-037cfd7e2cce tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:33.504043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d65134b4-748e-427e-9da4-037cfd7e2cce tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:33.513501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d65134b4-748e-427e-9da4-037cfd7e2cce tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:33.514564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d65134b4-748e-427e-9da4-037cfd7e2cce tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:33.515996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d65134b4-748e-427e-9da4-037cfd7e2cce tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:33.548688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d65134b4-748e-427e-9da4-037cfd7e2cce tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:11:33.691324 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.compute.api [None req-d65134b4-748e-427e-9da4-037cfd7e2cce tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Instance is already in deleting state, ignoring this request May 28 21:11:33.692310 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d65134b4-748e-427e-9da4-037cfd7e2cce tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 204 len: 0 microversion: 2.1 time: 0.205633 May 28 21:11:33.693167 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1249/2428] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:11:33 2022] DELETE /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:11:33.701274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7215a137-ae69-4dc2-aaa9-9a228aed33fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:33.702078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7215a137-ae69-4dc2-aaa9-9a228aed33fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:33.716261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7215a137-ae69-4dc2-aaa9-9a228aed33fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:33.717823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7215a137-ae69-4dc2-aaa9-9a228aed33fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:33.720644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7215a137-ae69-4dc2-aaa9-9a228aed33fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:33.721606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7215a137-ae69-4dc2-aaa9-9a228aed33fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:33.762992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c1c6c22a-5d77-473d-8bea-97d3e38567db tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:33.763723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c1c6c22a-5d77-473d-8bea-97d3e38567db tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:33.772763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1c6c22a-5d77-473d-8bea-97d3e38567db tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:33.774357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1c6c22a-5d77-473d-8bea-97d3e38567db tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:33.775167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1c6c22a-5d77-473d-8bea-97d3e38567db tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:33.775838 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1c6c22a-5d77-473d-8bea-97d3e38567db tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:34.108836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c1c6c22a-5d77-473d-8bea-97d3e38567db tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:34.112151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7215a137-ae69-4dc2-aaa9-9a228aed33fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:34.120166 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c1c6c22a-5d77-473d-8bea-97d3e38567db tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1324 microversion: 2.1 time: 0.361132 May 28 21:11:34.121981 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1250/2429] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:33 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1324 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:11:34.125089 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7215a137-ae69-4dc2-aaa9-9a228aed33fb tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1494 microversion: 2.1 time: 0.427337 May 28 21:11:34.130087 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1180/2430] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:33 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1494 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:34.131552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-1d90f70c-5dcf-4cef-aa9a-90c919c2caa3 req-7652b1f5-a55b-42c9-ab30-faeb22849165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea206247-c6b4-49e5-aafd-92084ea25c9a", "name": "network-vif-plugged", "status": "completed", "tag": "b2a22fa5-c484-458c-b896-9639a751194b"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:34.145762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1d90f70c-5dcf-4cef-aa9a-90c919c2caa3 req-7652b1f5-a55b-42c9-ab30-faeb22849165 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:34.147478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1d90f70c-5dcf-4cef-aa9a-90c919c2caa3 req-7652b1f5-a55b-42c9-ab30-faeb22849165 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:34.167330 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-1d90f70c-5dcf-4cef-aa9a-90c919c2caa3 req-7652b1f5-a55b-42c9-ab30-faeb22849165 service nova] Creating event network-vif-plugged:b2a22fa5-c484-458c-b896-9639a751194b for instance ea206247-c6b4-49e5-aafd-92084ea25c9a on nch2-master-1 May 28 21:11:34.173562 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-1d90f70c-5dcf-4cef-aa9a-90c919c2caa3 req-7652b1f5-a55b-42c9-ab30-faeb22849165 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050034 May 28 21:11:34.174185 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1251/2431] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:34.509266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-befeea23-69b5-4f9a-a0fa-84f12e06ac4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:34.510361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-befeea23-69b5-4f9a-a0fa-84f12e06ac4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:34.520518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-befeea23-69b5-4f9a-a0fa-84f12e06ac4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:34.521279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-befeea23-69b5-4f9a-a0fa-84f12e06ac4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:34.521903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-befeea23-69b5-4f9a-a0fa-84f12e06ac4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:34.522359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-befeea23-69b5-4f9a-a0fa-84f12e06ac4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:34.755304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-befeea23-69b5-4f9a-a0fa-84f12e06ac4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:34.766063 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-befeea23-69b5-4f9a-a0fa-84f12e06ac4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1314 microversion: 2.1 time: 0.263635 May 28 21:11:34.766905 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1181/2432] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:34 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:35.141098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-090df5fd-456e-4a97-984f-3be09024830a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:35.141973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-91022fdb-5e04-441e-bc8e-283ff357a57a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:35.142618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-91022fdb-5e04-441e-bc8e-283ff357a57a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:35.143320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-090df5fd-456e-4a97-984f-3be09024830a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:35.151770 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:35.156173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91022fdb-5e04-441e-bc8e-283ff357a57a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:35.156386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-090df5fd-456e-4a97-984f-3be09024830a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:35.157764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-090df5fd-456e-4a97-984f-3be09024830a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:35.157932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91022fdb-5e04-441e-bc8e-283ff357a57a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:35.158707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91022fdb-5e04-441e-bc8e-283ff357a57a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:35.159177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91022fdb-5e04-441e-bc8e-283ff357a57a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:35.159686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-090df5fd-456e-4a97-984f-3be09024830a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:35.160362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-090df5fd-456e-4a97-984f-3be09024830a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:35.524902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-91022fdb-5e04-441e-bc8e-283ff357a57a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:35.534964 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-91022fdb-5e04-441e-bc8e-283ff357a57a tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1494 microversion: 2.1 time: 0.396820 May 28 21:11:35.545599 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1182/2433] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:35 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1494 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:11:35.585633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-090df5fd-456e-4a97-984f-3be09024830a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:35.601164 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-090df5fd-456e-4a97-984f-3be09024830a tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1324 microversion: 2.1 time: 0.466843 May 28 21:11:35.601771 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1252/2434] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:35 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1324 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:35.785066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-71815a2e-8929-4809-88d9-d5f6194dcd5f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:35.786554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-71815a2e-8929-4809-88d9-d5f6194dcd5f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:35.794460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71815a2e-8929-4809-88d9-d5f6194dcd5f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:35.795312 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71815a2e-8929-4809-88d9-d5f6194dcd5f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:35.796347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71815a2e-8929-4809-88d9-d5f6194dcd5f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:35.797019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71815a2e-8929-4809-88d9-d5f6194dcd5f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:36.002147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-71815a2e-8929-4809-88d9-d5f6194dcd5f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:36.010410 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-71815a2e-8929-4809-88d9-d5f6194dcd5f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1314 microversion: 2.1 time: 0.229801 May 28 21:11:36.011010 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1183/2435] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:35 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:36.210607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-1b66d196-6806-498c-ae45-356e3455121b req-3ee8143a-fc08-4a33-ad29-2dfa51bc052f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f808c8-db89-4f84-91be-66e4ddda87d4", "name": "network-vif-plugged", "status": "completed", "tag": "136634ca-0287-4836-91e1-7d6df183e1bc"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:36.227985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1b66d196-6806-498c-ae45-356e3455121b req-3ee8143a-fc08-4a33-ad29-2dfa51bc052f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:36.234326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1b66d196-6806-498c-ae45-356e3455121b req-3ee8143a-fc08-4a33-ad29-2dfa51bc052f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:36.262640 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-1b66d196-6806-498c-ae45-356e3455121b req-3ee8143a-fc08-4a33-ad29-2dfa51bc052f service nova] Creating event network-vif-plugged:136634ca-0287-4836-91e1-7d6df183e1bc for instance 80f808c8-db89-4f84-91be-66e4ddda87d4 on nch1-master-1 May 28 21:11:36.270357 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-1b66d196-6806-498c-ae45-356e3455121b req-3ee8143a-fc08-4a33-ad29-2dfa51bc052f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062725 May 28 21:11:36.275769 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1253/2436] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:36.580965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f231e9cd-76a0-4437-8a53-ee4ef1391690 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:36.582907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f231e9cd-76a0-4437-8a53-ee4ef1391690 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:36.617649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f231e9cd-76a0-4437-8a53-ee4ef1391690 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:36.619312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6e423044-6fc9-4745-80d5-117f02837652 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:36.619794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f231e9cd-76a0-4437-8a53-ee4ef1391690 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:36.620136 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6e423044-6fc9-4745-80d5-117f02837652 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:36.622936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f231e9cd-76a0-4437-8a53-ee4ef1391690 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:36.623642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f231e9cd-76a0-4437-8a53-ee4ef1391690 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:36.635961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e423044-6fc9-4745-80d5-117f02837652 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:36.639366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e423044-6fc9-4745-80d5-117f02837652 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:36.639366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e423044-6fc9-4745-80d5-117f02837652 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:36.639366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e423044-6fc9-4745-80d5-117f02837652 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:37.026598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6e423044-6fc9-4745-80d5-117f02837652 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:37.033258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f231e9cd-76a0-4437-8a53-ee4ef1391690 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:37.054208 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f231e9cd-76a0-4437-8a53-ee4ef1391690 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1494 microversion: 2.1 time: 0.505117 May 28 21:11:37.057425 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1184/2437] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:36 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1494 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:37.059718 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6e423044-6fc9-4745-80d5-117f02837652 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1324 microversion: 2.1 time: 0.444862 May 28 21:11:37.064574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-39ef61b3-b79b-48a2-a8d1-42ed256f8c86 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:37.064779 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1254/2438] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:36 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1324 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:11:37.067059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-39ef61b3-b79b-48a2-a8d1-42ed256f8c86 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:37.080807 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39ef61b3-b79b-48a2-a8d1-42ed256f8c86 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:37.081531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39ef61b3-b79b-48a2-a8d1-42ed256f8c86 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:37.083354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39ef61b3-b79b-48a2-a8d1-42ed256f8c86 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:37.085174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39ef61b3-b79b-48a2-a8d1-42ed256f8c86 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:37.090421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e084cbc3-cd11-4a25-b21e-2af572fe4c37 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:37.091227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e084cbc3-cd11-4a25-b21e-2af572fe4c37 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:37.109199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e084cbc3-cd11-4a25-b21e-2af572fe4c37 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:37.112761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e084cbc3-cd11-4a25-b21e-2af572fe4c37 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:37.114003 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-39ef61b3-b79b-48a2-a8d1-42ed256f8c86 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] HTTP exception thrown: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. May 28 21:11:37.115111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e084cbc3-cd11-4a25-b21e-2af572fe4c37 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:37.116389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e084cbc3-cd11-4a25-b21e-2af572fe4c37 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-39ef61b3-b79b-48a2-a8d1-42ed256f8c86 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Request method failure captured: May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 HTTP/1.1 May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko-GfAmbq19Wzv_IyvJ0froXseFFHax7tRSAMxzOcmJGrgNhnl6GaI4_cqWJ1_mmEzIYwTNYRshjIToYEGaO5q5ats0YCKI_8ETREUpvTBw6IHhnlwFfolTD_fwH7DsbEEqbkIxRvqU_rv_EMuzrUQQcO9LdGvHqdKwJSM18PWYdGQU May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: cf209a1ba94046f89ddf62c77b6b0f02 May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersTestMultiNic-1707558365 May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf209a1ba94046f89ddf62c77b6b0f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersTestMultiNic-1707558365 May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: cf209a1ba94046f89ddf62c77b6b0f02 May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersTestMultiNic-1707558365 May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersTestMultiNic-1707558365-project May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 659bd3ebefc348b7a176379bd342f9ed May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersTestMultiNic-1707558365-project May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '75938ae4-dbff-425f-be63-604274ec2263'} May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:37.117688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:37.124312 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. May 28 21:11:37.124312 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.124312 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:37.124312 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.124312 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.124312 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:37.124312 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:37.124312 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:37.124312 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:37.124312 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. May 28 21:11:37.124312 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.128593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-39ef61b3-b79b-48a2-a8d1-42ed256f8c86 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Returning 404 to user: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:37.129878 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-39ef61b3-b79b-48a2-a8d1-42ed256f8c86 tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "DELETE /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 404 len: 111 microversion: 2.1 time: 0.071098 May 28 21:11:37.130769 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1185/2439] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:11:37 2022] DELETE /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:37.140948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7992f30-ed2b-415e-b60d-d29a57dacddd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:37.144056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d7992f30-ed2b-415e-b60d-d29a57dacddd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: 75938ae4-dbff-425f-be63-604274ec2263] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:37.156309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7992f30-ed2b-415e-b60d-d29a57dacddd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:37.158688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7992f30-ed2b-415e-b60d-d29a57dacddd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:37.159826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7992f30-ed2b-415e-b60d-d29a57dacddd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:37.160452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7992f30-ed2b-415e-b60d-d29a57dacddd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:37.184022 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-d7992f30-ed2b-415e-b60d-d29a57dacddd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] HTTP exception thrown: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7992f30-ed2b-415e-b60d-d29a57dacddd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Request method failure captured: May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 HTTP/1.1 May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko-GfAmbq19Wzv_IyvJ0froXseFFHax7tRSAMxzOcmJGrgNhnl6GaI4_cqWJ1_mmEzIYwTNYRshjIToYEGaO5q5ats0YCKI_8ETREUpvTBw6IHhnlwFfolTD_fwH7DsbEEqbkIxRvqU_rv_EMuzrUQQcO9LdGvHqdKwJSM18PWYdGQU May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: cf209a1ba94046f89ddf62c77b6b0f02 May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersTestMultiNic-1707558365 May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf209a1ba94046f89ddf62c77b6b0f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersTestMultiNic-1707558365 May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: cf209a1ba94046f89ddf62c77b6b0f02 May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersTestMultiNic-1707558365 May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersTestMultiNic-1707558365-project May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 659bd3ebefc348b7a176379bd342f9ed May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersTestMultiNic-1707558365-project May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '75938ae4-dbff-425f-be63-604274ec2263'} May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:37.186364 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.193436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.193436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:37.193436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:37.193436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:37.193436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:37.193436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. May 28 21:11:37.193436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.193436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7992f30-ed2b-415e-b60d-d29a57dacddd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Returning 404 to user: Instance 75938ae4-dbff-425f-be63-604274ec2263 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:37.193436 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d7992f30-ed2b-415e-b60d-d29a57dacddd tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263" status: 404 len: 111 microversion: 2.1 time: 0.053308 May 28 21:11:37.193436 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1186/2440] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:37 2022] GET /compute/v2.1/servers/75938ae4-dbff-425f-be63-604274ec2263 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:11:37.197972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f4ff4f39-87d8-4999-b99b-61255d20fcea tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:37.199513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f4ff4f39-87d8-4999-b99b-61255d20fcea tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:37.213104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4ff4f39-87d8-4999-b99b-61255d20fcea tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:37.213815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4ff4f39-87d8-4999-b99b-61255d20fcea tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:37.216935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4ff4f39-87d8-4999-b99b-61255d20fcea tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:37.217690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4ff4f39-87d8-4999-b99b-61255d20fcea tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-f4ff4f39-87d8-4999-b99b-61255d20fcea tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] HTTP exception thrown: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f4ff4f39-87d8-4999-b99b-61255d20fcea tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Request method failure captured: May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed HTTP/1.1 May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko-GfAmbq19Wzv_IyvJ0froXseFFHax7tRSAMxzOcmJGrgNhnl6GaI4_cqWJ1_mmEzIYwTNYRshjIToYEGaO5q5ats0YCKI_8ETREUpvTBw6IHhnlwFfolTD_fwH7DsbEEqbkIxRvqU_rv_EMuzrUQQcO9LdGvHqdKwJSM18PWYdGQU May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: cf209a1ba94046f89ddf62c77b6b0f02 May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersTestMultiNic-1707558365 May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf209a1ba94046f89ddf62c77b6b0f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersTestMultiNic-1707558365 May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: cf209a1ba94046f89ddf62c77b6b0f02 May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersTestMultiNic-1707558365 May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersTestMultiNic-1707558365-project May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 659bd3ebefc348b7a176379bd342f9ed May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersTestMultiNic-1707558365-project May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'be14fefc-6d15-401c-b5e6-e5edfd7cb9ed'} May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:37.616790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f4ff4f39-87d8-4999-b99b-61255d20fcea tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Returning 404 to user: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f4ff4f39-87d8-4999-b99b-61255d20fcea tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "DELETE /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 404 len: 111 microversion: 2.1 time: 0.054609 May 28 21:11:37.626146 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1187/2441] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:11:37 2022] DELETE /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e084cbc3-cd11-4a25-b21e-2af572fe4c37 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e084cbc3-cd11-4a25-b21e-2af572fe4c37 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1501 microversion: 2.1 time: 0.279288 May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1255/2442] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:37 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1501 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3a63bad6-6905-4bac-b807-fbcede49805b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3a63bad6-6905-4bac-b807-fbcede49805b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] [instance: be14fefc-6d15-401c-b5e6-e5edfd7cb9ed] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a63bad6-6905-4bac-b807-fbcede49805b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a63bad6-6905-4bac-b807-fbcede49805b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a63bad6-6905-4bac-b807-fbcede49805b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a63bad6-6905-4bac-b807-fbcede49805b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-3a63bad6-6905-4bac-b807-fbcede49805b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] HTTP exception thrown: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3a63bad6-6905-4bac-b807-fbcede49805b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Request method failure captured: May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed HTTP/1.1 May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko-GfAmbq19Wzv_IyvJ0froXseFFHax7tRSAMxzOcmJGrgNhnl6GaI4_cqWJ1_mmEzIYwTNYRshjIToYEGaO5q5ats0YCKI_8ETREUpvTBw6IHhnlwFfolTD_fwH7DsbEEqbkIxRvqU_rv_EMuzrUQQcO9LdGvHqdKwJSM18PWYdGQU May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf209a1ba94046f89ddf62c77b6b0f02 May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestMultiNic-1707558365 May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:37.629377 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf209a1ba94046f89ddf62c77b6b0f02", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf209a1ba94046f89ddf62c77b6b0f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestMultiNic-1707558365 May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf209a1ba94046f89ddf62c77b6b0f02 May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestMultiNic-1707558365 May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestMultiNic-1707558365-project May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 659bd3ebefc348b7a176379bd342f9ed May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestMultiNic-1707558365-project May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'be14fefc-6d15-401c-b5e6-e5edfd7cb9ed'} May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:37.636661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3a63bad6-6905-4bac-b807-fbcede49805b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] Returning 404 to user: Instance be14fefc-6d15-401c-b5e6-e5edfd7cb9ed could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:37.642141 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3a63bad6-6905-4bac-b807-fbcede49805b tempest-ServersTestMultiNic-1707558365 tempest-ServersTestMultiNic-1707558365-project] 10.222.0.33 "GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed" status: 404 len: 111 microversion: 2.1 time: 0.048136 May 28 21:11:37.642141 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1256/2443] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:37 2022] GET /compute/v2.1/servers/be14fefc-6d15-401c-b5e6-e5edfd7cb9ed => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:37.642141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-de195895-9632-49ff-b1cc-c0fbf437210f req-596f2e45-f749-47c7-ad6c-801cfe714b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f808c8-db89-4f84-91be-66e4ddda87d4", "name": "network-vif-deleted", "tag": "136634ca-0287-4836-91e1-7d6df183e1bc"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:37.642141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-de195895-9632-49ff-b1cc-c0fbf437210f req-596f2e45-f749-47c7-ad6c-801cfe714b0b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:37.642141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-de195895-9632-49ff-b1cc-c0fbf437210f req-596f2e45-f749-47c7-ad6c-801cfe714b0b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:37.642141 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-de195895-9632-49ff-b1cc-c0fbf437210f req-596f2e45-f749-47c7-ad6c-801cfe714b0b service nova] Creating event network-vif-deleted:136634ca-0287-4836-91e1-7d6df183e1bc for instance 80f808c8-db89-4f84-91be-66e4ddda87d4 on nch1-master-1 May 28 21:11:37.642141 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-de195895-9632-49ff-b1cc-c0fbf437210f req-596f2e45-f749-47c7-ad6c-801cfe714b0b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085047 May 28 21:11:37.642141 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1257/2444] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-27d3ca91-0b3f-4a4a-ad10-da07f54856e3 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Calling method '.version_select at 0x7f4d645ce160>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=10 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG neutronclient.v2_0.client [None req-27d3ca91-0b3f-4a4a-ad10-da07f54856e3 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e7fa2edd-8b47-47da-9376-96e42b8651ff does not exist", "detail": ""}} {{(pid=143129) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.security_group_api [None req-27d3ca91-0b3f-4a4a-ad10-da07f54856e3 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Neutron security group e7fa2edd-8b47-47da-9376-96e42b8651ff not found {{(pid=143129) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-27d3ca91-0b3f-4a4a-ad10-da07f54856e3 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] HTTP exception thrown: Security group e7fa2edd-8b47-47da-9376-96e42b8651ff does not exist May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-0f041f32-b89b-43bc-aba9-e698af522603'] May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-27d3ca91-0b3f-4a4a-ad10-da07f54856e3 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Request method failure captured: May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/os-security-groups/e7fa2edd-8b47-47da-9376-96e42b8651ff HTTP/1.1 May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAJHGf9AOu3dAHPb9lBLh9SDnOTYzjUvSgr9oFAfgqeuDq1IJR6Jeoby26Jh_AN8ov6p29gk8HFKYiJhxA4u7RCTylqeufEiNjC5wYXcxY4jnAI3GUjhMw_XHwHlrTNgYvJYasOlalVO0pqesGKoBhTvJvSQnmWCK1mHqoOzgW0rt0 May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: c0dda471dbbd4c3093f8f362f4b2221a May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-250680754 May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0dda471dbbd4c3093f8f362f4b2221a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0dda471dbbd4c3093f8f362f4b2221a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0dda471dbbd4c3093f8f362f4b2221a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0dda471dbbd4c3093f8f362f4b2221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-250680754 May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: c0dda471dbbd4c3093f8f362f4b2221a May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-250680754 May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-SecurityGroupsNegativeTestJSON-250680754-project May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 64428727aaa145f69f6c009f36e9adbb May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-250680754-project May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: exception: Security group e7fa2edd-8b47-47da-9376-96e42b8651ff does not exist May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-0f041f32-b89b-43bc-aba9-e698af522603'] May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'e7fa2edd-8b47-47da-9376-96e42b8651ff'} May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 21:11:37.642783 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e7fa2edd-8b47-47da-9376-96e42b8651ff does not exist May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f041f32-b89b-43bc-aba9-e698af522603'] May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e7fa2edd-8b47-47da-9376-96e42b8651ff does not exist May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f041f32-b89b-43bc-aba9-e698af522603'] May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e7fa2edd-8b47-47da-9376-96e42b8651ff does not exist May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f041f32-b89b-43bc-aba9-e698af522603'] May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e7fa2edd-8b47-47da-9376-96e42b8651ff does not exist May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0f041f32-b89b-43bc-aba9-e698af522603'] May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:37.649471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-27d3ca91-0b3f-4a4a-ad10-da07f54856e3 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Returning 404 to user: Security group e7fa2edd-8b47-47da-9376-96e42b8651ff does not exist May 28 21:11:37.655332 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-0f041f32-b89b-43bc-aba9-e698af522603'] {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:37.655332 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-27d3ca91-0b3f-4a4a-ad10-da07f54856e3 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e7fa2edd-8b47-47da-9376-96e42b8651ff" status: 404 len: 194 microversion: 2.1 time: 0.350533 May 28 21:11:37.655332 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1188/2445] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:11:37 2022] DELETE /compute/v2.1/os-security-groups/e7fa2edd-8b47-47da-9376-96e42b8651ff => generated 194 bytes in 355 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:37.655557 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-35eac97d-eb08-4b6f-8e76-3fc9d1981448 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.014425 May 28 21:11:37.655557 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1258/2446] 10.222.0.33 () {58 vars in 1163 bytes} [Sat May 28 21:11:37 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 28 21:11:37.655777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ab4a6035-3a37-43a5-a145-dfb09ecd82e0 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Calling method '.version_select at 0x7f4d645610d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:37.976287 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ab4a6035-3a37-43a5-a145-dfb09ecd82e0 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.344962 May 28 21:11:37.976880 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1189/2447] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:11:37 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:37.990098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-86d3364c-1d26-4d31-8c40-1776d307716d tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Calling method '.version_select at 0x7f4d642769d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:37.997658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=26 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:38.074063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a0d34629-6866-4649-85e7-2b3dd73e732f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:38.077579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a0d34629-6866-4649-85e7-2b3dd73e732f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:38.093609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0d34629-6866-4649-85e7-2b3dd73e732f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:38.094134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0d34629-6866-4649-85e7-2b3dd73e732f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:38.094960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0d34629-6866-4649-85e7-2b3dd73e732f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:38.098090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0d34629-6866-4649-85e7-2b3dd73e732f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:38.179405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0d34629-6866-4649-85e7-2b3dd73e732f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:38.180182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0d34629-6866-4649-85e7-2b3dd73e732f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:38.180841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-a0d34629-6866-4649-85e7-2b3dd73e732f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lazy-loading 'fault' on Instance uuid 80f808c8-db89-4f84-91be-66e4ddda87d4 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:11:38.505336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a0d34629-6866-4649-85e7-2b3dd73e732f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04e5b86f94914df085b76e0d89b2230e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '158c1665476643cda0976e68ab5e595a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:38.524314 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a0d34629-6866-4649-85e7-2b3dd73e732f tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 200 len: 1297 microversion: 2.1 time: 0.454369 May 28 21:11:38.525751 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1190/2448] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:38 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 1297 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:38.533013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2d97d629-49d1-48a3-a067-2a81666d5bfe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:38.534044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2d97d629-49d1-48a3-a067-2a81666d5bfe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:38.543912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d97d629-49d1-48a3-a067-2a81666d5bfe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:38.544839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d97d629-49d1-48a3-a067-2a81666d5bfe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:38.545953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d97d629-49d1-48a3-a067-2a81666d5bfe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:38.546617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d97d629-49d1-48a3-a067-2a81666d5bfe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:38.644727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG neutronclient.v2_0.client [None req-86d3364c-1d26-4d31-8c40-1776d307716d tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=143128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:11:38.645509 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-86d3364c-1d26-4d31-8c40-1776d307716d tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] HTTP exception thrown: Insufficient rights for removing default security group. May 28 21:11:38.645509 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-72fb2309-760c-4d42-abe7-edff66fa5f1e'] May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-86d3364c-1d26-4d31-8c40-1776d307716d tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Request method failure captured: May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-security-groups/7a2a46fc-719c-4427-9986-daaa79e1b1b9 HTTP/1.1 May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpAJHGf9AOu3dAHPb9lBLh9SDnOTYzjUvSgr9oFAfgqeuDq1IJR6Jeoby26Jh_AN8ov6p29gk8HFKYiJhxA4u7RCTylqeufEiNjC5wYXcxY4jnAI3GUjhMw_XHwHlrTNgYvJYasOlalVO0pqesGKoBhTvJvSQnmWCK1mHqoOzgW0rt0 May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: c0dda471dbbd4c3093f8f362f4b2221a May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-250680754 May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0dda471dbbd4c3093f8f362f4b2221a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0dda471dbbd4c3093f8f362f4b2221a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0dda471dbbd4c3093f8f362f4b2221a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0dda471dbbd4c3093f8f362f4b2221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-250680754 May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: c0dda471dbbd4c3093f8f362f4b2221a May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-250680754 May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupsNegativeTestJSON-250680754-project May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 64428727aaa145f69f6c009f36e9adbb May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-250680754-project May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: exception: Insufficient rights for removing default security group. May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-72fb2309-760c-4d42-abe7-edff66fa5f1e'] May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '7a2a46fc-719c-4427-9986-daaa79e1b1b9'} May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:11:38.647519 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72fb2309-760c-4d42-abe7-edff66fa5f1e'] May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72fb2309-760c-4d42-abe7-edff66fa5f1e'] May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72fb2309-760c-4d42-abe7-edff66fa5f1e'] May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72fb2309-760c-4d42-abe7-edff66fa5f1e'] May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-86d3364c-1d26-4d31-8c40-1776d307716d tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Returning 400 to user: Insufficient rights for removing default security group. May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-72fb2309-760c-4d42-abe7-edff66fa5f1e'] {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-86d3364c-1d26-4d31-8c40-1776d307716d tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/7a2a46fc-719c-4427-9986-daaa79e1b1b9" status: 400 len: 182 microversion: 2.1 time: 0.663594 May 28 21:11:38.650384 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1259/2449] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:11:37 2022] DELETE /compute/v2.1/os-security-groups/7a2a46fc-719c-4427-9986-daaa79e1b1b9 => generated 182 bytes in 665 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:11:38.688807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2739175c-fdf6-488f-8cf3-741b9266f6e3 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Calling method '.version_select at 0x7f4d64528b80>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:38.732936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG neutronclient.v2_0.client [None req-2739175c-fdf6-488f-8cf3-741b9266f6e3 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 57994662-2518-476e-92a7-348ccbb45dd6 does not exist", "detail": ""}} {{(pid=143128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:11:38.733551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.security_group_api [None req-2739175c-fdf6-488f-8cf3-741b9266f6e3 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Neutron security group 57994662-2518-476e-92a7-348ccbb45dd6 not found {{(pid=143128) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:11:38.734114 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-2739175c-fdf6-488f-8cf3-741b9266f6e3 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] HTTP exception thrown: Security group 57994662-2518-476e-92a7-348ccbb45dd6 does not exist May 28 21:11:38.734114 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-05b919d4-928b-492b-a9b8-596747d87bd7'] May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2739175c-fdf6-488f-8cf3-741b9266f6e3 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Request method failure captured: May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-security-groups/57994662-2518-476e-92a7-348ccbb45dd6 HTTP/1.1 May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpAJHGf9AOu3dAHPb9lBLh9SDnOTYzjUvSgr9oFAfgqeuDq1IJR6Jeoby26Jh_AN8ov6p29gk8HFKYiJhxA4u7RCTylqeufEiNjC5wYXcxY4jnAI3GUjhMw_XHwHlrTNgYvJYasOlalVO0pqesGKoBhTvJvSQnmWCK1mHqoOzgW0rt0 May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: c0dda471dbbd4c3093f8f362f4b2221a May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-250680754 May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0dda471dbbd4c3093f8f362f4b2221a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0dda471dbbd4c3093f8f362f4b2221a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0dda471dbbd4c3093f8f362f4b2221a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0dda471dbbd4c3093f8f362f4b2221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-250680754 May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: c0dda471dbbd4c3093f8f362f4b2221a May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-250680754 May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupsNegativeTestJSON-250680754-project May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 64428727aaa145f69f6c009f36e9adbb May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-250680754-project May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: exception: Security group 57994662-2518-476e-92a7-348ccbb45dd6 does not exist May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-05b919d4-928b-492b-a9b8-596747d87bd7'] May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '57994662-2518-476e-92a7-348ccbb45dd6'} May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:11:38.735977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 57994662-2518-476e-92a7-348ccbb45dd6 does not exist May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05b919d4-928b-492b-a9b8-596747d87bd7'] May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 57994662-2518-476e-92a7-348ccbb45dd6 does not exist May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05b919d4-928b-492b-a9b8-596747d87bd7'] May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 57994662-2518-476e-92a7-348ccbb45dd6 does not exist May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05b919d4-928b-492b-a9b8-596747d87bd7'] May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 57994662-2518-476e-92a7-348ccbb45dd6 does not exist May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05b919d4-928b-492b-a9b8-596747d87bd7'] May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2739175c-fdf6-488f-8cf3-741b9266f6e3 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Returning 404 to user: Security group 57994662-2518-476e-92a7-348ccbb45dd6 does not exist May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-05b919d4-928b-492b-a9b8-596747d87bd7'] {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2739175c-fdf6-488f-8cf3-741b9266f6e3 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/57994662-2518-476e-92a7-348ccbb45dd6" status: 404 len: 194 microversion: 2.1 time: 0.069830 May 28 21:11:38.739202 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1260/2450] 10.222.0.33 () {58 vars in 1268 bytes} [Sat May 28 21:11:38 2022] GET /compute/v2.1/os-security-groups/57994662-2518-476e-92a7-348ccbb45dd6 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:38.751202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-435dadd0-eb33-401d-a64a-7f303d03afd2 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Action: 'update', calling method: .version_select at 0x7f4d64846280>, body: {"security_group": {"name": "tempest-sg-1792851806", "description": "tempest-description-63019314"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:38.828885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG neutronclient.v2_0.client [None req-435dadd0-eb33-401d-a64a-7f303d03afd2 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ef544842-a9f8-4059-b314-0fc3ca0d083d does not exist", "detail": ""}} {{(pid=143128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:11:38.829529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.security_group_api [None req-435dadd0-eb33-401d-a64a-7f303d03afd2 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Neutron security group ef544842-a9f8-4059-b314-0fc3ca0d083d not found {{(pid=143128) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:11:38.830101 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-435dadd0-eb33-401d-a64a-7f303d03afd2 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] HTTP exception thrown: Security group ef544842-a9f8-4059-b314-0fc3ca0d083d does not exist May 28 21:11:38.830101 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-71bed48b-f713-44ea-9e37-bd995b31c6af'] May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-435dadd0-eb33-401d-a64a-7f303d03afd2 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Request method failure captured: May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: request: PUT /compute/v2.1/os-security-groups/ef544842-a9f8-4059-b314-0fc3ca0d083d HTTP/1.1 May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 100 May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpAJHGf9AOu3dAHPb9lBLh9SDnOTYzjUvSgr9oFAfgqeuDq1IJR6Jeoby26Jh_AN8ov6p29gk8HFKYiJhxA4u7RCTylqeufEiNjC5wYXcxY4jnAI3GUjhMw_XHwHlrTNgYvJYasOlalVO0pqesGKoBhTvJvSQnmWCK1mHqoOzgW0rt0 May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: c0dda471dbbd4c3093f8f362f4b2221a May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-250680754 May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c0dda471dbbd4c3093f8f362f4b2221a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0dda471dbbd4c3093f8f362f4b2221a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c0dda471dbbd4c3093f8f362f4b2221a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c0dda471dbbd4c3093f8f362f4b2221a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-250680754 May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: c0dda471dbbd4c3093f8f362f4b2221a May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-250680754 May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupsNegativeTestJSON-250680754-project May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 64428727aaa145f69f6c009f36e9adbb May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-250680754-project May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: {"security_group": {"name": "tempest-sg-1792851806", "description": "tempest-description-63019314"}} May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: exception: Security group ef544842-a9f8-4059-b314-0fc3ca0d083d does not exist May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-71bed48b-f713-44ea-9e37-bd995b31c6af'] May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ef544842-a9f8-4059-b314-0fc3ca0d083d', 'body': {'security_group': {'name': 'tempest-sg-1792851806', 'description': 'tempest-description-63019314'}}} May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:11:38.840537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ef544842-a9f8-4059-b314-0fc3ca0d083d does not exist May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71bed48b-f713-44ea-9e37-bd995b31c6af'] May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ef544842-a9f8-4059-b314-0fc3ca0d083d does not exist May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71bed48b-f713-44ea-9e37-bd995b31c6af'] May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ef544842-a9f8-4059-b314-0fc3ca0d083d does not exist May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71bed48b-f713-44ea-9e37-bd995b31c6af'] May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ef544842-a9f8-4059-b314-0fc3ca0d083d does not exist May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-71bed48b-f713-44ea-9e37-bd995b31c6af'] May 28 21:11:38.843572 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:38.848740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-435dadd0-eb33-401d-a64a-7f303d03afd2 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] Returning 404 to user: Security group ef544842-a9f8-4059-b314-0fc3ca0d083d does not exist May 28 21:11:38.848740 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-71bed48b-f713-44ea-9e37-bd995b31c6af'] {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:38.850431 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-435dadd0-eb33-401d-a64a-7f303d03afd2 tempest-SecurityGroupsNegativeTestJSON-250680754 tempest-SecurityGroupsNegativeTestJSON-250680754-project] 10.222.0.33 "PUT /compute/v2.1/os-security-groups/ef544842-a9f8-4059-b314-0fc3ca0d083d" status: 404 len: 194 microversion: 2.1 time: 0.104564 May 28 21:11:38.858547 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1261/2451] 10.222.0.33 () {60 vars in 1289 bytes} [Sat May 28 21:11:38 2022] PUT /compute/v2.1/os-security-groups/ef544842-a9f8-4059-b314-0fc3ca0d083d => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:11:38.990086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2d97d629-49d1-48a3-a067-2a81666d5bfe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:39.009872 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2d97d629-49d1-48a3-a067-2a81666d5bfe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1324 microversion: 2.1 time: 0.482041 May 28 21:11:39.010487 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1191/2452] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:38 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1324 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:39.566127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-050555d0-4cef-40c0-91dc-c33f8f53c5de tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:39.568963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-050555d0-4cef-40c0-91dc-c33f8f53c5de tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 80f808c8-db89-4f84-91be-66e4ddda87d4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:39.592004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-050555d0-4cef-40c0-91dc-c33f8f53c5de tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:39.593072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-050555d0-4cef-40c0-91dc-c33f8f53c5de tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:39.594090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-050555d0-4cef-40c0-91dc-c33f8f53c5de tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:39.594788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-050555d0-4cef-40c0-91dc-c33f8f53c5de tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:39.611158 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-050555d0-4cef-40c0-91dc-c33f8f53c5de tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] HTTP exception thrown: Instance 80f808c8-db89-4f84-91be-66e4ddda87d4 could not be found. May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-050555d0-4cef-40c0-91dc-c33f8f53c5de tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Request method failure captured: May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 HTTP/1.1 May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko8he9ks8vlp5SnGXCv9gdBysO6_b2bFAPwwsIZ6x9Bz9wX0XihGyrBsZWl2n_NaakH7GUX7L5qPaLROHyNsgkGyW0kEItApc2X1pzZnSffgdU6BuSpBb305APZ1QKmZSduHi9PK3knUoxhUm3IEGhLFowLtVlq8KPjloN6F3tDWO1M May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_158c1665476643cda0976e68ab5e595a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/158c1665476643cda0976e68ab5e595a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesTestJSON-347859831 May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesTestJSON-347859831-project May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 04e5b86f94914df085b76e0d89b2230e May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesTestJSON-347859831-project May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 80f808c8-db89-4f84-91be-66e4ddda87d4 could not be found. May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '80f808c8-db89-4f84-91be-66e4ddda87d4'} May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f808c8-db89-4f84-91be-66e4ddda87d4 could not be found. May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f808c8-db89-4f84-91be-66e4ddda87d4 could not be found. May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.612740 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.618781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:39.618781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:39.618781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:39.618781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:39.618781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f808c8-db89-4f84-91be-66e4ddda87d4 could not be found. May 28 21:11:39.618781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.626863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-050555d0-4cef-40c0-91dc-c33f8f53c5de tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Returning 404 to user: Instance 80f808c8-db89-4f84-91be-66e4ddda87d4 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:39.629624 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-050555d0-4cef-40c0-91dc-c33f8f53c5de tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4" status: 404 len: 111 microversion: 2.1 time: 0.088495 May 28 21:11:39.634628 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1262/2453] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:39 2022] GET /compute/v2.1/servers/80f808c8-db89-4f84-91be-66e4ddda87d4 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:39.640415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1bcf52aa-d73d-45cb-b169-5725c75d0474 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d5784c160>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:39.684570 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-1bcf52aa-d73d-45cb-b169-5725c75d0474 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] HTTP exception thrown: Image not found. May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1bcf52aa-d73d-45cb-b169-5725c75d0474 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Request method failure captured: May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 HTTP/1.1 May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko8he9ks8vlp5SnGXCv9gdBysO6_b2bFAPwwsIZ6x9Bz9wX0XihGyrBsZWl2n_NaakH7GUX7L5qPaLROHyNsgkGyW0kEItApc2X1pzZnSffgdU6BuSpBb305APZ1QKmZSduHi9PK3knUoxhUm3IEGhLFowLtVlq8KPjloN6F3tDWO1M May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_158c1665476643cda0976e68ab5e595a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/158c1665476643cda0976e68ab5e595a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesTestJSON-347859831 May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesTestJSON-347859831-project May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 04e5b86f94914df085b76e0d89b2230e May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesTestJSON-347859831-project May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: exception: Image not found. May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'bf5faf65-33db-4045-bbfe-6d7c59ddc0b0'} May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 to delete May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 could not be found. May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:39.686456 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1bcf52aa-d73d-45cb-b169-5725c75d0474 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Returning 404 to user: Image not found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:39.689574 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1bcf52aa-d73d-45cb-b169-5725c75d0474 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0" status: 404 len: 62 microversion: 2.1 time: 0.052919 May 28 21:11:39.698224 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1192/2454] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:39 2022] DELETE /compute/v2.1/images/bf5faf65-33db-4045-bbfe-6d7c59ddc0b0 => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:11:39.702753 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84f12520-a532-4d4e-a0f3-ead6de91102c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:39.705912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-84f12520-a532-4d4e-a0f3-ead6de91102c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:39.722393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84f12520-a532-4d4e-a0f3-ead6de91102c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:39.727725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84f12520-a532-4d4e-a0f3-ead6de91102c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:39.729747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84f12520-a532-4d4e-a0f3-ead6de91102c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:39.730902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84f12520-a532-4d4e-a0f3-ead6de91102c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:39.774501 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-84f12520-a532-4d4e-a0f3-ead6de91102c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] HTTP exception thrown: Instance d508d555-a95e-4d29-a6e7-812145ba9293 could not be found. May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84f12520-a532-4d4e-a0f3-ead6de91102c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Request method failure captured: May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 HTTP/1.1 May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko8he9ks8vlp5SnGXCv9gdBysO6_b2bFAPwwsIZ6x9Bz9wX0XihGyrBsZWl2n_NaakH7GUX7L5qPaLROHyNsgkGyW0kEItApc2X1pzZnSffgdU6BuSpBb305APZ1QKmZSduHi9PK3knUoxhUm3IEGhLFowLtVlq8KPjloN6F3tDWO1M May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_158c1665476643cda0976e68ab5e595a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/158c1665476643cda0976e68ab5e595a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesTestJSON-347859831 May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesTestJSON-347859831-project May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 04e5b86f94914df085b76e0d89b2230e May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesTestJSON-347859831-project May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance d508d555-a95e-4d29-a6e7-812145ba9293 could not be found. May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'd508d555-a95e-4d29-a6e7-812145ba9293'} May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d508d555-a95e-4d29-a6e7-812145ba9293 could not be found. May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:39.784633 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d508d555-a95e-4d29-a6e7-812145ba9293 could not be found. May 28 21:11:39.788724 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.788724 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:39.788724 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.788724 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.788724 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:39.788724 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:39.788724 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:39.788724 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:39.788724 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d508d555-a95e-4d29-a6e7-812145ba9293 could not be found. May 28 21:11:39.788724 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.788724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84f12520-a532-4d4e-a0f3-ead6de91102c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Returning 404 to user: Instance d508d555-a95e-4d29-a6e7-812145ba9293 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:39.788724 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-84f12520-a532-4d4e-a0f3-ead6de91102c tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293" status: 404 len: 111 microversion: 2.1 time: 0.089087 May 28 21:11:39.794972 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1263/2455] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:11:39 2022] DELETE /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:11:39.798700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5114621e-0afb-4af4-b96b-3e91b35e53c8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:39.799448 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5114621e-0afb-4af4-b96b-3e91b35e53c8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: d508d555-a95e-4d29-a6e7-812145ba9293] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:39.818068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5114621e-0afb-4af4-b96b-3e91b35e53c8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:39.834201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5114621e-0afb-4af4-b96b-3e91b35e53c8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:39.835285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5114621e-0afb-4af4-b96b-3e91b35e53c8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:39.835821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5114621e-0afb-4af4-b96b-3e91b35e53c8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:39.871731 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-5114621e-0afb-4af4-b96b-3e91b35e53c8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] HTTP exception thrown: Instance d508d555-a95e-4d29-a6e7-812145ba9293 could not be found. May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5114621e-0afb-4af4-b96b-3e91b35e53c8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Request method failure captured: May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 HTTP/1.1 May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko8he9ks8vlp5SnGXCv9gdBysO6_b2bFAPwwsIZ6x9Bz9wX0XihGyrBsZWl2n_NaakH7GUX7L5qPaLROHyNsgkGyW0kEItApc2X1pzZnSffgdU6BuSpBb305APZ1QKmZSduHi9PK3knUoxhUm3IEGhLFowLtVlq8KPjloN6F3tDWO1M May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_158c1665476643cda0976e68ab5e595a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/158c1665476643cda0976e68ab5e595a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesTestJSON-347859831 May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesTestJSON-347859831-project May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 04e5b86f94914df085b76e0d89b2230e May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesTestJSON-347859831-project May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance d508d555-a95e-4d29-a6e7-812145ba9293 could not be found. May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'd508d555-a95e-4d29-a6e7-812145ba9293'} May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d508d555-a95e-4d29-a6e7-812145ba9293 could not be found. May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d508d555-a95e-4d29-a6e7-812145ba9293 could not be found. May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:39.884113 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.887481 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:39.887481 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:39.887481 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:39.887481 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:39.887481 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d508d555-a95e-4d29-a6e7-812145ba9293 could not be found. May 28 21:11:39.887481 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:39.890580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5114621e-0afb-4af4-b96b-3e91b35e53c8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Returning 404 to user: Instance d508d555-a95e-4d29-a6e7-812145ba9293 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:39.892815 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5114621e-0afb-4af4-b96b-3e91b35e53c8 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293" status: 404 len: 111 microversion: 2.1 time: 0.098103 May 28 21:11:39.898488 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1193/2456] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:39 2022] GET /compute/v2.1/servers/d508d555-a95e-4d29-a6e7-812145ba9293 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:11:39.913699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-389188ce-29cf-492e-97ce-5b0645c686ec tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d64111dc0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:39.943000 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-389188ce-29cf-492e-97ce-5b0645c686ec tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] HTTP exception thrown: Image not found. May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-389188ce-29cf-492e-97ce-5b0645c686ec tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Request method failure captured: May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd HTTP/1.1 May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko8he9ks8vlp5SnGXCv9gdBysO6_b2bFAPwwsIZ6x9Bz9wX0XihGyrBsZWl2n_NaakH7GUX7L5qPaLROHyNsgkGyW0kEItApc2X1pzZnSffgdU6BuSpBb305APZ1QKmZSduHi9PK3knUoxhUm3IEGhLFowLtVlq8KPjloN6F3tDWO1M May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_158c1665476643cda0976e68ab5e595a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/158c1665476643cda0976e68ab5e595a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesTestJSON-347859831 May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesTestJSON-347859831-project May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 04e5b86f94914df085b76e0d89b2230e May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesTestJSON-347859831-project May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: exception: Image not found. May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'e790a93b-a2bc-45f9-94f1-330cce2c18dd'} May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e790a93b-a2bc-45f9-94f1-330cce2c18dd to delete May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e790a93b-a2bc-45f9-94f1-330cce2c18dd could not be found. May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.944832 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-389188ce-29cf-492e-97ce-5b0645c686ec tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Returning 404 to user: Image not found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:39.948866 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-389188ce-29cf-492e-97ce-5b0645c686ec tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd" status: 404 len: 62 microversion: 2.1 time: 0.046979 May 28 21:11:39.955563 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1264/2457] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:39 2022] DELETE /compute/v2.1/images/e790a93b-a2bc-45f9-94f1-330cce2c18dd => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 21:11:39.956121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-38484cbd-331c-41e2-a4a0-9f38eb903649 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:39.956849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-38484cbd-331c-41e2-a4a0-9f38eb903649 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:39.969310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38484cbd-331c-41e2-a4a0-9f38eb903649 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:39.973976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38484cbd-331c-41e2-a4a0-9f38eb903649 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:39.975086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38484cbd-331c-41e2-a4a0-9f38eb903649 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:39.978640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38484cbd-331c-41e2-a4a0-9f38eb903649 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:40.010614 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-38484cbd-331c-41e2-a4a0-9f38eb903649 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] HTTP exception thrown: Instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 could not be found. May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-38484cbd-331c-41e2-a4a0-9f38eb903649 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Request method failure captured: May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 HTTP/1.1 May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko8he9ks8vlp5SnGXCv9gdBysO6_b2bFAPwwsIZ6x9Bz9wX0XihGyrBsZWl2n_NaakH7GUX7L5qPaLROHyNsgkGyW0kEItApc2X1pzZnSffgdU6BuSpBb305APZ1QKmZSduHi9PK3knUoxhUm3IEGhLFowLtVlq8KPjloN6F3tDWO1M May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_158c1665476643cda0976e68ab5e595a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/158c1665476643cda0976e68ab5e595a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesTestJSON-347859831 May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesTestJSON-347859831-project May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 04e5b86f94914df085b76e0d89b2230e May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesTestJSON-347859831-project May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 could not be found. May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '92d5e5e3-2837-4e11-9b7f-636490b41a93'} May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 could not be found. May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:40.024876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 could not be found. May 28 21:11:40.028585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.028585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:40.028585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.028585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.028585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:40.028585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:40.028585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:40.028585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:40.028585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 could not be found. May 28 21:11:40.028585 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.030928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-38484cbd-331c-41e2-a4a0-9f38eb903649 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Returning 404 to user: Instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:40.032072 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-38484cbd-331c-41e2-a4a0-9f38eb903649 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 404 len: 111 microversion: 2.1 time: 0.080752 May 28 21:11:40.032558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ab9f0502-7683-439e-a061-8669fe0f9305 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:40.033117 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1194/2458] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:11:39 2022] DELETE /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:11:40.037386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ab9f0502-7683-439e-a061-8669fe0f9305 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:40.048566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab9f0502-7683-439e-a061-8669fe0f9305 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:40.049266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab9f0502-7683-439e-a061-8669fe0f9305 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:40.051562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab9f0502-7683-439e-a061-8669fe0f9305 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:40.051562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab9f0502-7683-439e-a061-8669fe0f9305 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:40.052912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-857a56bb-2c1e-4f58-a081-d5bc2efd5577 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:40.055820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-857a56bb-2c1e-4f58-a081-d5bc2efd5577 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 92d5e5e3-2837-4e11-9b7f-636490b41a93] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:40.074844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-857a56bb-2c1e-4f58-a081-d5bc2efd5577 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:40.077282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-857a56bb-2c1e-4f58-a081-d5bc2efd5577 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:40.078443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-857a56bb-2c1e-4f58-a081-d5bc2efd5577 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:40.080708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-857a56bb-2c1e-4f58-a081-d5bc2efd5577 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:40.108502 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-857a56bb-2c1e-4f58-a081-d5bc2efd5577 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] HTTP exception thrown: Instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 could not be found. May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-857a56bb-2c1e-4f58-a081-d5bc2efd5577 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Request method failure captured: May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 HTTP/1.1 May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko8he9ks8vlp5SnGXCv9gdBysO6_b2bFAPwwsIZ6x9Bz9wX0XihGyrBsZWl2n_NaakH7GUX7L5qPaLROHyNsgkGyW0kEItApc2X1pzZnSffgdU6BuSpBb305APZ1QKmZSduHi9PK3knUoxhUm3IEGhLFowLtVlq8KPjloN6F3tDWO1M May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_158c1665476643cda0976e68ab5e595a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/158c1665476643cda0976e68ab5e595a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesTestJSON-347859831 May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesTestJSON-347859831-project May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 04e5b86f94914df085b76e0d89b2230e May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesTestJSON-347859831-project May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 could not be found. May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '92d5e5e3-2837-4e11-9b7f-636490b41a93'} May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 could not be found. May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 could not be found. May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.117639 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.122137 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:40.122137 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:40.122137 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:40.122137 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:40.122137 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 could not be found. May 28 21:11:40.122137 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.126570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-857a56bb-2c1e-4f58-a081-d5bc2efd5577 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Returning 404 to user: Instance 92d5e5e3-2837-4e11-9b7f-636490b41a93 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:40.130019 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-857a56bb-2c1e-4f58-a081-d5bc2efd5577 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93" status: 404 len: 111 microversion: 2.1 time: 0.090556 May 28 21:11:40.130841 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1195/2459] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:40 2022] GET /compute/v2.1/servers/92d5e5e3-2837-4e11-9b7f-636490b41a93 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:11:40.143197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a1ce72aa-02e6-403d-89e9-5c8664944f69 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '.version_select at 0x7f4d6466f040>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:40.207683 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-a1ce72aa-02e6-403d-89e9-5c8664944f69 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] HTTP exception thrown: Image not found. May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a1ce72aa-02e6-403d-89e9-5c8664944f69 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Request method failure captured: May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 HTTP/1.1 May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko8he9ks8vlp5SnGXCv9gdBysO6_b2bFAPwwsIZ6x9Bz9wX0XihGyrBsZWl2n_NaakH7GUX7L5qPaLROHyNsgkGyW0kEItApc2X1pzZnSffgdU6BuSpBb305APZ1QKmZSduHi9PK3knUoxhUm3IEGhLFowLtVlq8KPjloN6F3tDWO1M May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_158c1665476643cda0976e68ab5e595a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/158c1665476643cda0976e68ab5e595a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesTestJSON-347859831 May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesTestJSON-347859831-project May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 04e5b86f94914df085b76e0d89b2230e May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesTestJSON-347859831-project May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: exception: Image not found. May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'd8ea7177-c563-4d6a-b1cd-eefb5fda0bb8'} May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 to delete May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 could not be found. May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.209485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a1ce72aa-02e6-403d-89e9-5c8664944f69 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Returning 404 to user: Image not found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:40.212750 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a1ce72aa-02e6-403d-89e9-5c8664944f69 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8" status: 404 len: 62 microversion: 2.1 time: 0.071773 May 28 21:11:40.217188 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1196/2460] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:40 2022] DELETE /compute/v2.1/images/d8ea7177-c563-4d6a-b1cd-eefb5fda0bb8 => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:11:40.222625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a4a29d9c-bb54-453f-9b7a-22b939443f17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:40.223467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a4a29d9c-bb54-453f-9b7a-22b939443f17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:40.234145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4a29d9c-bb54-453f-9b7a-22b939443f17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:40.234670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4a29d9c-bb54-453f-9b7a-22b939443f17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:40.236050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4a29d9c-bb54-453f-9b7a-22b939443f17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:40.236628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4a29d9c-bb54-453f-9b7a-22b939443f17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:40.266370 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-a4a29d9c-bb54-453f-9b7a-22b939443f17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] HTTP exception thrown: Instance 1f837cef-04b0-4491-8edf-c10423944be0 could not be found. May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a4a29d9c-bb54-453f-9b7a-22b939443f17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Request method failure captured: May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 HTTP/1.1 May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko8he9ks8vlp5SnGXCv9gdBysO6_b2bFAPwwsIZ6x9Bz9wX0XihGyrBsZWl2n_NaakH7GUX7L5qPaLROHyNsgkGyW0kEItApc2X1pzZnSffgdU6BuSpBb305APZ1QKmZSduHi9PK3knUoxhUm3IEGhLFowLtVlq8KPjloN6F3tDWO1M May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_158c1665476643cda0976e68ab5e595a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/158c1665476643cda0976e68ab5e595a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesTestJSON-347859831 May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesTestJSON-347859831-project May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 04e5b86f94914df085b76e0d89b2230e May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesTestJSON-347859831-project May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 1f837cef-04b0-4491-8edf-c10423944be0 could not be found. May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '1f837cef-04b0-4491-8edf-c10423944be0'} May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f837cef-04b0-4491-8edf-c10423944be0 could not be found. May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:40.268153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f837cef-04b0-4491-8edf-c10423944be0 could not be found. May 28 21:11:40.276878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.276878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:40.276878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.276878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.276878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:40.276878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:40.276878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:40.276878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:40.276878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f837cef-04b0-4491-8edf-c10423944be0 could not be found. May 28 21:11:40.276878 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.278560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a4a29d9c-bb54-453f-9b7a-22b939443f17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Returning 404 to user: Instance 1f837cef-04b0-4491-8edf-c10423944be0 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:40.279666 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a4a29d9c-bb54-453f-9b7a-22b939443f17 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 404 len: 111 microversion: 2.1 time: 0.061077 May 28 21:11:40.283390 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1197/2461] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:11:40 2022] DELETE /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:40.292516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f39e7085-bd2a-4d1f-b639-1c2a2c5db7c7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:40.294168 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f39e7085-bd2a-4d1f-b639-1c2a2c5db7c7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] [instance: 1f837cef-04b0-4491-8edf-c10423944be0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:40.310990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f39e7085-bd2a-4d1f-b639-1c2a2c5db7c7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:40.316082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f39e7085-bd2a-4d1f-b639-1c2a2c5db7c7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:40.317045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f39e7085-bd2a-4d1f-b639-1c2a2c5db7c7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:40.317585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f39e7085-bd2a-4d1f-b639-1c2a2c5db7c7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:40.353002 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-f39e7085-bd2a-4d1f-b639-1c2a2c5db7c7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] HTTP exception thrown: Instance 1f837cef-04b0-4491-8edf-c10423944be0 could not be found. May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f39e7085-bd2a-4d1f-b639-1c2a2c5db7c7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Request method failure captured: May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 HTTP/1.1 May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko8he9ks8vlp5SnGXCv9gdBysO6_b2bFAPwwsIZ6x9Bz9wX0XihGyrBsZWl2n_NaakH7GUX7L5qPaLROHyNsgkGyW0kEItApc2X1pzZnSffgdU6BuSpBb305APZ1QKmZSduHi9PK3knUoxhUm3IEGhLFowLtVlq8KPjloN6F3tDWO1M May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_158c1665476643cda0976e68ab5e595a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/158c1665476643cda0976e68ab5e595a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/158c1665476643cda0976e68ab5e595a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesTestJSON-347859831 May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 158c1665476643cda0976e68ab5e595a May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesTestJSON-347859831 May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesTestJSON-347859831-project May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 04e5b86f94914df085b76e0d89b2230e May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesTestJSON-347859831-project May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 1f837cef-04b0-4491-8edf-c10423944be0 could not be found. May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '1f837cef-04b0-4491-8edf-c10423944be0'} May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f837cef-04b0-4491-8edf-c10423944be0 could not be found. May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f837cef-04b0-4491-8edf-c10423944be0 could not be found. May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.355115 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:40.359007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:40.359007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:40.359007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:40.359007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:40.359007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f837cef-04b0-4491-8edf-c10423944be0 could not be found. May 28 21:11:40.359007 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:40.360950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f39e7085-bd2a-4d1f-b639-1c2a2c5db7c7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] Returning 404 to user: Instance 1f837cef-04b0-4491-8edf-c10423944be0 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:40.362083 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f39e7085-bd2a-4d1f-b639-1c2a2c5db7c7 tempest-ImagesTestJSON-347859831 tempest-ImagesTestJSON-347859831-project] 10.222.0.33 "GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0" status: 404 len: 111 microversion: 2.1 time: 0.077435 May 28 21:11:40.363404 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1198/2462] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:40 2022] GET /compute/v2.1/servers/1f837cef-04b0-4491-8edf-c10423944be0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:40.414323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d0f47ccb-25b6-4bd3-a53e-6c3bfad163fe req-bae72cc9-53b2-4400-8163-dd15c79d129c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a4cf15-02b5-42d1-ae2f-849ca1ec8d35", "name": "network-vif-plugged", "status": "completed", "tag": "825989f5-1b0d-4731-92b8-dabd0a2be976"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:40.439536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d0f47ccb-25b6-4bd3-a53e-6c3bfad163fe req-bae72cc9-53b2-4400-8163-dd15c79d129c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:40.440179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d0f47ccb-25b6-4bd3-a53e-6c3bfad163fe req-bae72cc9-53b2-4400-8163-dd15c79d129c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:40.462336 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d0f47ccb-25b6-4bd3-a53e-6c3bfad163fe req-bae72cc9-53b2-4400-8163-dd15c79d129c service nova] Creating event network-vif-plugged:825989f5-1b0d-4731-92b8-dabd0a2be976 for instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 on nch2-master-1 May 28 21:11:40.475278 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d0f47ccb-25b6-4bd3-a53e-6c3bfad163fe req-bae72cc9-53b2-4400-8163-dd15c79d129c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067695 May 28 21:11:40.476600 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1199/2463] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:40.990663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89c8dfcc-3ce2-47eb-9191-6ceecf2f2143 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97e7aab3-d275-463e-aaa5-5830a8126a8d"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:40.993538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-89c8dfcc-3ce2-47eb-9191-6ceecf2f2143 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:41.009817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89c8dfcc-3ce2-47eb-9191-6ceecf2f2143 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:41.011123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89c8dfcc-3ce2-47eb-9191-6ceecf2f2143 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:41.016610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89c8dfcc-3ce2-47eb-9191-6ceecf2f2143 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:41.016610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89c8dfcc-3ce2-47eb-9191-6ceecf2f2143 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:41.247096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ab9f0502-7683-439e-a061-8669fe0f9305 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:41.269983 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ab9f0502-7683-439e-a061-8669fe0f9305 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1324 microversion: 2.1 time: 1.245419 May 28 21:11:41.272575 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1265/2464] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:40 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1324 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:42.181951 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-89c8dfcc-3ce2-47eb-9191-6ceecf2f2143 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "POST /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.195909 May 28 21:11:42.182702 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1200/2465] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:11:40 2022] POST /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a/os-volume_attachments => generated 194 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:42.281444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9ee3a7f9-5c05-42e5-a133-b96f58cec7ca tempest-FloatingIPsNegativeTestJSON-1746753160 tempest-FloatingIPsNegativeTestJSON-1746753160-project] Calling method '.version_select at 0x7f4d57fc03a0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:42.289589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0407cffb-cf24-4be7-b075-b1c644e6db31 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:42.290653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0407cffb-cf24-4be7-b075-b1c644e6db31 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:42.303778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0407cffb-cf24-4be7-b075-b1c644e6db31 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:42.309080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0407cffb-cf24-4be7-b075-b1c644e6db31 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:42.314289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0407cffb-cf24-4be7-b075-b1c644e6db31 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:42.314905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0407cffb-cf24-4be7-b075-b1c644e6db31 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:42.497636 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9ee3a7f9-5c05-42e5-a133-b96f58cec7ca tempest-FloatingIPsNegativeTestJSON-1746753160 tempest-FloatingIPsNegativeTestJSON-1746753160-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.568246 May 28 21:11:42.498716 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1266/2466] 10.222.0.33 () {58 vars in 1148 bytes} [Sat May 28 21:11:41 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:11:42.510746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4f0af326-e27d-416a-a53f-d0bd19cbf7f6 tempest-FloatingIPsNegativeTestJSON-1746753160 tempest-FloatingIPsNegativeTestJSON-1746753160-project] Action: 'create', calling method: .version_select at 0x7f4d57fc0dc0>, body: {"pool": "non_exist_pool"} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:42.586218 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-4f0af326-e27d-416a-a53f-d0bd19cbf7f6 tempest-FloatingIPsNegativeTestJSON-1746753160 tempest-FloatingIPsNegativeTestJSON-1746753160-project] HTTP exception thrown: Floating IP pool not found. May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4f0af326-e27d-416a-a53f-d0bd19cbf7f6 tempest-FloatingIPsNegativeTestJSON-1746753160 tempest-FloatingIPsNegativeTestJSON-1746753160-project] Request method failure captured: May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 26 May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpANC9uIRQKA9ZgXDYwCy5zyXik_bVldk4Y-jeEB3vbt62uPc3AT2b_xqX3HRGce4zHwArcSMJmcZb9qKt-MpXvJ4FsOWOCXyP7tL2kAaiEwcE9AlUIRm6ts4DmPYhKMi8Q8kOE03U4FhzX_QeAIOaK_FiLeN9DWtWfLgvu7YnFHa5c May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: c78c95b156dd4ee183230abc68093a4b May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1746753160 May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c78c95b156dd4ee183230abc68093a4b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c78c95b156dd4ee183230abc68093a4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c78c95b156dd4ee183230abc68093a4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c78c95b156dd4ee183230abc68093a4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1746753160 May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: c78c95b156dd4ee183230abc68093a4b May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1746753160 May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-FloatingIPsNegativeTestJSON-1746753160-project May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 408a54e3416b40479fae5fba67d14a53 May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1746753160-project May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: {"pool": "non_exist_pool"} May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: exception: Floating IP pool not found. May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'pool': 'non_exist_pool'}} May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2958, in allocate_floating_ip May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2948, in _get_floating_ip_pool_id_by_name_or_id May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:42.589213 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:42.593004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. May 28 21:11:42.593004 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:42.593004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4f0af326-e27d-416a-a53f-d0bd19cbf7f6 tempest-FloatingIPsNegativeTestJSON-1746753160 tempest-FloatingIPsNegativeTestJSON-1746753160-project] Returning 404 to user: Floating IP pool not found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:42.593004 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4f0af326-e27d-416a-a53f-d0bd19cbf7f6 tempest-FloatingIPsNegativeTestJSON-1746753160 tempest-FloatingIPsNegativeTestJSON-1746753160-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.085248 May 28 21:11:42.595587 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1267/2467] 10.222.0.33 () {60 vars in 1169 bytes} [Sat May 28 21:11:42 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 21:11:42.613082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b94ff42d-257b-4144-8304-5ea067c75736 tempest-FloatingIPsNegativeTestJSON-1746753160 tempest-FloatingIPsNegativeTestJSON-1746753160-project] Calling method '.version_select at 0x7f4d57fc0d30>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:42.762426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0407cffb-cf24-4be7-b075-b1c644e6db31 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:42.771895 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0407cffb-cf24-4be7-b075-b1c644e6db31 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1324 microversion: 2.1 time: 0.486865 May 28 21:11:42.792232 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1201/2468] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:42 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1324 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:11:42.872221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG neutronclient.v2_0.client [None req-b94ff42d-257b-4144-8304-5ea067c75736 tempest-FloatingIPsNegativeTestJSON-1746753160 tempest-FloatingIPsNegativeTestJSON-1746753160-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP e464f4f6-66a3-4930-84e2-139ea20b3b63 could not be found", "detail": ""}} {{(pid=143128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:11:42.873253 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-b94ff42d-257b-4144-8304-5ea067c75736 tempest-FloatingIPsNegativeTestJSON-1746753160 tempest-FloatingIPsNegativeTestJSON-1746753160-project] HTTP exception thrown: Floating IP not found for ID e464f4f6-66a3-4930-84e2-139ea20b3b63 May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b94ff42d-257b-4144-8304-5ea067c75736 tempest-FloatingIPsNegativeTestJSON-1746753160 tempest-FloatingIPsNegativeTestJSON-1746753160-project] Request method failure captured: May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-floating-ips/e464f4f6-66a3-4930-84e2-139ea20b3b63 HTTP/1.1 May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpANC9uIRQKA9ZgXDYwCy5zyXik_bVldk4Y-jeEB3vbt62uPc3AT2b_xqX3HRGce4zHwArcSMJmcZb9qKt-MpXvJ4FsOWOCXyP7tL2kAaiEwcE9AlUIRm6ts4DmPYhKMi8Q8kOE03U4FhzX_QeAIOaK_FiLeN9DWtWfLgvu7YnFHa5c May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: c78c95b156dd4ee183230abc68093a4b May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1746753160 May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c78c95b156dd4ee183230abc68093a4b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c78c95b156dd4ee183230abc68093a4b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c78c95b156dd4ee183230abc68093a4b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c78c95b156dd4ee183230abc68093a4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1746753160 May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: c78c95b156dd4ee183230abc68093a4b May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1746753160 May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-FloatingIPsNegativeTestJSON-1746753160-project May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 408a54e3416b40479fae5fba67d14a53 May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1746753160-project May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: exception: Floating IP not found for ID e464f4f6-66a3-4930-84e2-139ea20b3b63 May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'e464f4f6-66a3-4930-84e2-139ea20b3b63'} May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2810, in get_floating_ip May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP e464f4f6-66a3-4930-84e2-139ea20b3b63 could not be found May 28 21:11:42.875977 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cc7dd5a2-7ac4-4c19-b0b1-52880f4cf98d'] May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2813, in get_floating_ip May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID e464f4f6-66a3-4930-84e2-139ea20b3b63. May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID e464f4f6-66a3-4930-84e2-139ea20b3b63 May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID e464f4f6-66a3-4930-84e2-139ea20b3b63 May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b94ff42d-257b-4144-8304-5ea067c75736 tempest-FloatingIPsNegativeTestJSON-1746753160 tempest-FloatingIPsNegativeTestJSON-1746753160-project] Returning 404 to user: Floating IP not found for ID e464f4f6-66a3-4930-84e2-139ea20b3b63 {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b94ff42d-257b-4144-8304-5ea067c75736 tempest-FloatingIPsNegativeTestJSON-1746753160 tempest-FloatingIPsNegativeTestJSON-1746753160-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/e464f4f6-66a3-4930-84e2-139ea20b3b63" status: 404 len: 111 microversion: 2.1 time: 0.280823 May 28 21:11:42.879368 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1268/2469] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:11:42 2022] DELETE /compute/v2.1/os-floating-ips/e464f4f6-66a3-4930-84e2-139ea20b3b63 => generated 111 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:43.797776 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b93de68b-e9e5-48c0-9c4a-ce1de08d91fe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:43.798443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b93de68b-e9e5-48c0-9c4a-ce1de08d91fe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:43.820307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b93de68b-e9e5-48c0-9c4a-ce1de08d91fe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:43.820859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b93de68b-e9e5-48c0-9c4a-ce1de08d91fe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:43.821703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b93de68b-e9e5-48c0-9c4a-ce1de08d91fe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:43.822199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b93de68b-e9e5-48c0-9c4a-ce1de08d91fe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:44.865454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b93de68b-e9e5-48c0-9c4a-ce1de08d91fe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:44.887926 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b93de68b-e9e5-48c0-9c4a-ce1de08d91fe tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1520 microversion: 2.1 time: 1.091377 May 28 21:11:44.899598 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1202/2470] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:43 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1520 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:44.910542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-74fa17e4-dd5e-4653-b615-844e812a1e62 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Action: 'create', calling method: .version_select at 0x7f4d64566310>, body: {"pool": null} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:45.258310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-66529672-7bce-4356-886b-925941af0327 tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1963194018", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:45.273524 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-66529672-7bce-4356-886b-925941af0327 tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] HTTP exception thrown: min_count must be <= max_count May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-66529672-7bce-4356-886b-925941af0327 tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] Request method failure captured: May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 184 May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAQlRhILmqDGL7OCvI3p8K0Vns_lXVRSiUG8_5TdVetENMfOgwKqWBtDx660hW9qPlqcbgxW5Nn4IeNNBfzKSXhQytI6gi9_ZOCuLIUq96zj8BMZat_ToL7IwdlHXsQIynwFZdwWBkVV6c_GSc3P6J0P8NcZ9B4yihrZ-tLvS6GXyM May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 514d0cdb1f2641c9a259f7cf555486b7 May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-260814902 May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_514d0cdb1f2641c9a259f7cf555486b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/514d0cdb1f2641c9a259f7cf555486b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/514d0cdb1f2641c9a259f7cf555486b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/514d0cdb1f2641c9a259f7cf555486b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-260814902 May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 514d0cdb1f2641c9a259f7cf555486b7 May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-260814902 May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-MultipleCreateNegativeTestJSON-260814902-project May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 799e63bdb159406286a90a5adeb16cc3 May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-260814902-project May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1963194018", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "min_count": 3, "max_count": 2}} May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: exception: min_count must be <= max_count May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1963194018', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count May 28 21:11:45.278485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.281794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-66529672-7bce-4356-886b-925941af0327 tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] Returning 400 to user: min_count must be <= max_count {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:45.291579 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-66529672-7bce-4356-886b-925941af0327 tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.312767 May 28 21:11:45.295303 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1203/2471] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:11:44 2022] POST /compute/v2.1/servers => generated 74 bytes in 319 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 21:11:45.408389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2ed7db0b-a1c6-470a-b4ec-584a61522091 tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-597695918", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "max_count": 0}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2ed7db0b-a1c6-470a-b4ec-584a61522091 tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] Request method failure captured: May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 167 May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAQlRhILmqDGL7OCvI3p8K0Vns_lXVRSiUG8_5TdVetENMfOgwKqWBtDx660hW9qPlqcbgxW5Nn4IeNNBfzKSXhQytI6gi9_ZOCuLIUq96zj8BMZat_ToL7IwdlHXsQIynwFZdwWBkVV6c_GSc3P6J0P8NcZ9B4yihrZ-tLvS6GXyM May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 514d0cdb1f2641c9a259f7cf555486b7 May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-260814902 May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_514d0cdb1f2641c9a259f7cf555486b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/514d0cdb1f2641c9a259f7cf555486b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/514d0cdb1f2641c9a259f7cf555486b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/514d0cdb1f2641c9a259f7cf555486b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-260814902 May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 514d0cdb1f2641c9a259f7cf555486b7 May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-260814902 May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-MultipleCreateNegativeTestJSON-260814902-project May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 799e63bdb159406286a90a5adeb16cc3 May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-260814902-project May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-597695918", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "max_count": 0}} May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-597695918', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'max_count': 0}}} May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 0 May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:11:45.416728 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:11:45.421750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:11:45.421750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:11:45.421750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:11:45.421750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 28 21:11:45.421750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.421750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:45.421750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.421750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:45.421750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:45.421750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:45.421750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:11:45.421750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:11:45.421750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 May 28 21:11:45.421750 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.425986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2ed7db0b-a1c6-470a-b4ec-584a61522091 tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:45.427532 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2ed7db0b-a1c6-470a-b4ec-584a61522091 tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.025670 May 28 21:11:45.433116 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1204/2472] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:11:45 2022] POST /compute/v2.1/servers => generated 130 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:11:45.695728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e71daf89-cce3-4d08-9b49-b5d4660afb67 tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1703655972", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "max_count": 2.5}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e71daf89-cce3-4d08-9b49-b5d4660afb67 tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] Request method failure captured: May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 170 May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAQlRhILmqDGL7OCvI3p8K0Vns_lXVRSiUG8_5TdVetENMfOgwKqWBtDx660hW9qPlqcbgxW5Nn4IeNNBfzKSXhQytI6gi9_ZOCuLIUq96zj8BMZat_ToL7IwdlHXsQIynwFZdwWBkVV6c_GSc3P6J0P8NcZ9B4yihrZ-tLvS6GXyM May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 514d0cdb1f2641c9a259f7cf555486b7 May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-260814902 May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_514d0cdb1f2641c9a259f7cf555486b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/514d0cdb1f2641c9a259f7cf555486b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/514d0cdb1f2641c9a259f7cf555486b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/514d0cdb1f2641c9a259f7cf555486b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-260814902 May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 514d0cdb1f2641c9a259f7cf555486b7 May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-260814902 May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-MultipleCreateNegativeTestJSON-260814902-project May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 799e63bdb159406286a90a5adeb16cc3 May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-260814902-project May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1703655972", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "max_count": 2.5}} May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1703655972', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'max_count': 2.5}}} May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 2.5 May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:11:45.706473 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.711544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e71daf89-cce3-4d08-9b49-b5d4660afb67 tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:45.723234 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e71daf89-cce3-4d08-9b49-b5d4660afb67 tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.037293 May 28 21:11:45.736128 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1205/2473] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:11:45 2022] POST /compute/v2.1/servers => generated 139 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:11:45.889879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89e75988-735c-4dc0-9e1d-66322c39247a tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1730674556", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "min_count": 0}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89e75988-735c-4dc0-9e1d-66322c39247a tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] Request method failure captured: May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 168 May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAQlRhILmqDGL7OCvI3p8K0Vns_lXVRSiUG8_5TdVetENMfOgwKqWBtDx660hW9qPlqcbgxW5Nn4IeNNBfzKSXhQytI6gi9_ZOCuLIUq96zj8BMZat_ToL7IwdlHXsQIynwFZdwWBkVV6c_GSc3P6J0P8NcZ9B4yihrZ-tLvS6GXyM May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 514d0cdb1f2641c9a259f7cf555486b7 May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-260814902 May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_514d0cdb1f2641c9a259f7cf555486b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/514d0cdb1f2641c9a259f7cf555486b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/514d0cdb1f2641c9a259f7cf555486b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/514d0cdb1f2641c9a259f7cf555486b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-260814902 May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 514d0cdb1f2641c9a259f7cf555486b7 May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-260814902 May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-MultipleCreateNegativeTestJSON-260814902-project May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 799e63bdb159406286a90a5adeb16cc3 May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-260814902-project May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1730674556", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "min_count": 0}} May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1730674556', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'min_count': 0}}} May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 0 May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:11:45.892806 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89e75988-735c-4dc0-9e1d-66322c39247a tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:45.896193 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-89e75988-735c-4dc0-9e1d-66322c39247a tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009097 May 28 21:11:45.902930 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1206/2474] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:11:45 2022] POST /compute/v2.1/servers => generated 130 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:11:45.971879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1927bf14-84e0-47c9-97f7-70413155113a tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1532925019", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "min_count": 2.5}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1927bf14-84e0-47c9-97f7-70413155113a tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] Request method failure captured: May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 170 May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAQlRhILmqDGL7OCvI3p8K0Vns_lXVRSiUG8_5TdVetENMfOgwKqWBtDx660hW9qPlqcbgxW5Nn4IeNNBfzKSXhQytI6gi9_ZOCuLIUq96zj8BMZat_ToL7IwdlHXsQIynwFZdwWBkVV6c_GSc3P6J0P8NcZ9B4yihrZ-tLvS6GXyM May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 514d0cdb1f2641c9a259f7cf555486b7 May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-260814902 May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_514d0cdb1f2641c9a259f7cf555486b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/514d0cdb1f2641c9a259f7cf555486b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/514d0cdb1f2641c9a259f7cf555486b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/514d0cdb1f2641c9a259f7cf555486b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-260814902 May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 514d0cdb1f2641c9a259f7cf555486b7 May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-260814902 May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-MultipleCreateNegativeTestJSON-260814902-project May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 799e63bdb159406286a90a5adeb16cc3 May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-260814902-project May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1532925019", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "min_count": 2.5}} May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1532925019', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'min_count': 2.5}}} May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'minimum': 1, May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 2.5 May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:11:45.973238 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:11:45.976623 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:11:45.976623 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:11:45.976623 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:11:45.976623 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:11:45.976623 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 28 21:11:45.976623 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.976623 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:45.976623 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.976623 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:45.976623 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:45.976623 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:45.976623 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:11:45.976623 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:11:45.976623 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' May 28 21:11:45.976623 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:45.978156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1927bf14-84e0-47c9-97f7-70413155113a tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:45.986502 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1927bf14-84e0-47c9-97f7-70413155113a tempest-MultipleCreateNegativeTestJSON-260814902 tempest-MultipleCreateNegativeTestJSON-260814902-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.014272 May 28 21:11:45.988096 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1207/2475] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:11:45 2022] POST /compute/v2.1/servers => generated 139 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 21:11:47.230740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e0a7bb5d-75ef-4f21-95b2-fdcd63519b34 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Action: 'create', calling method: .version_select at 0x7f4d64807820>, body: {"keypair": {"name": "tempest-keypair-1291948410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSTeq0jmB8Y8ZxGUtyZ/P8IYxbXyuPGdByzkttwN2W7qlvYIdh4ZJ7vvw/9fHgjSCCp8gJbzGj/UxL9quKVor+Pymw8PGePGUH9hpalPRBNrZLCVE6LsGdv380HX2p6+Q=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:47.265282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-e0a7bb5d-75ef-4f21-95b2-fdcd63519b34 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Getting quotas for project 8e63642fba3b4b72bc6297f4b85a1119. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:47.318346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-e0a7bb5d-75ef-4f21-95b2-fdcd63519b34 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Getting quotas for user 32caeee3c02547e7bffce1e68ba81294 and project 8e63642fba3b4b72bc6297f4b85a1119. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:47.491609 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e0a7bb5d-75ef-4f21-95b2-fdcd63519b34 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.833255 May 28 21:11:47.492236 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1208/2476] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:11:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:47.497719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-41241d60-7f56-4d43-ab6e-10f7aff0524c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:47.497905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-41241d60-7f56-4d43-ab6e-10f7aff0524c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:47.524501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41241d60-7f56-4d43-ab6e-10f7aff0524c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:47.527840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41241d60-7f56-4d43-ab6e-10f7aff0524c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:47.528937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41241d60-7f56-4d43-ab6e-10f7aff0524c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:47.532467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41241d60-7f56-4d43-ab6e-10f7aff0524c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:47.596124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-41241d60-7f56-4d43-ab6e-10f7aff0524c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:11:47.672421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:48.050723 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-41241d60-7f56-4d43-ab6e-10f7aff0524c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 204 len: 0 microversion: 2.1 time: 0.556487 May 28 21:11:48.051710 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1209/2477] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:11:47 2022] DELETE /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:11:48.074611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eabae6cb-e2e9-4b5d-a869-270f0df725c1 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Calling method '.version_select at 0x7f4d6487b430>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:48.083828 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eabae6cb-e2e9-4b5d-a869-270f0df725c1 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1291948410" status: 200 len: 498 microversion: 2.1 time: 0.029887 May 28 21:11:48.084612 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1210/2478] 10.222.0.33 () {58 vars in 1217 bytes} [Sat May 28 21:11:48 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1291948410 => generated 498 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:48.090370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7da637e1-1c16-4651-82f3-1be9dcc4ea09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:48.091544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7da637e1-1c16-4651-82f3-1be9dcc4ea09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:48.102093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7da637e1-1c16-4651-82f3-1be9dcc4ea09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:48.102887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7da637e1-1c16-4651-82f3-1be9dcc4ea09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:48.103697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7da637e1-1c16-4651-82f3-1be9dcc4ea09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:48.104202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7da637e1-1c16-4651-82f3-1be9dcc4ea09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:48.396197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7da637e1-1c16-4651-82f3-1be9dcc4ea09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:48.407701 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7da637e1-1c16-4651-82f3-1be9dcc4ea09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1553 microversion: 2.1 time: 0.318798 May 28 21:11:48.408968 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1211/2479] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:48 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1553 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:48.416809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ef8bce4d-33f1-425e-9e38-8a6288a39269 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Calling method '.version_select at 0x7f4d69c1bf70>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:48.537753 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ef8bce4d-33f1-425e-9e38-8a6288a39269 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1291948410" status: 202 len: 0 microversion: 2.1 time: 0.127229 May 28 21:11:48.540824 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1212/2480] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 21:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1291948410 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:11:48.555098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-33a24df3-a15f-49ff-8e6a-609852d9af7d tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Action: 'create', calling method: .version_select at 0x7f4d64061ca0>, body: {"keypair": {"name": "tempest-keypair-1461287877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+HTeBudpiSgX1CB51kNFXCVLQuh+A2SL2Zkp7eI+woevyNDvHHTKRzog1b3qdCr2/8gXr+tKxjnRGNB14jCrl7mZoZk1Qtu0cCd32HrKhj7tEe6y4l/Ae5wsBADZHAcg=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:48.590930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-33a24df3-a15f-49ff-8e6a-609852d9af7d tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Getting quotas for project 8e63642fba3b4b72bc6297f4b85a1119. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:48.603385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-33a24df3-a15f-49ff-8e6a-609852d9af7d tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Getting quotas for user 32caeee3c02547e7bffce1e68ba81294 and project 8e63642fba3b4b72bc6297f4b85a1119. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:48.751663 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-33a24df3-a15f-49ff-8e6a-609852d9af7d tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.201939 May 28 21:11:48.752296 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1213/2481] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:11:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:11:48.762508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bb3ec1b1-a247-4e44-869c-dfe5faaa7c07 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Calling method '.version_select at 0x7f4d648075e0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:48.907883 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bb3ec1b1-a247-4e44-869c-dfe5faaa7c07 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1461287877" status: 202 len: 0 microversion: 2.1 time: 0.149668 May 28 21:11:48.909015 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1214/2482] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 21:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1461287877 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:11:48.918752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2db0d39f-b10e-4392-bd8a-6fb6e5ef2c5e tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Action: 'create', calling method: .version_select at 0x7f4d57f7f8b0>, body: {"keypair": {"name": "tempest-keypair-1998221331", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:48.923559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:48.945345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-2db0d39f-b10e-4392-bd8a-6fb6e5ef2c5e tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Getting quotas for project 8e63642fba3b4b72bc6297f4b85a1119. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:48.954283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-2db0d39f-b10e-4392-bd8a-6fb6e5ef2c5e tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Getting quotas for user 32caeee3c02547e7bffce1e68ba81294 and project 8e63642fba3b4b72bc6297f4b85a1119. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:49.143720 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2db0d39f-b10e-4392-bd8a-6fb6e5ef2c5e tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.228602 May 28 21:11:49.144209 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1215/2483] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:11:48 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:11:49.156282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bc914185-bb34-411c-8083-42f4a3094534 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Calling method '.version_select at 0x7f4d6420aee0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:49.307171 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bc914185-bb34-411c-8083-42f4a3094534 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998221331" status: 202 len: 0 microversion: 2.1 time: 0.156793 May 28 21:11:49.308952 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1216/2484] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 21:11:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1998221331 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:11:49.317054 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-74fa17e4-dd5e-4653-b615-844e812a1e62 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.411350 May 28 21:11:49.322001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2be66050-d7d0-43ce-8e2a-92ef0682343f tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Action: 'create', calling method: .version_select at 0x7f4d64622dc0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1170514830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBNO64I7PFYSW7sSRoS6phiIvq/IUQWkLZAQVvL/D2fs5TE9pnPpcaoUu5CnBNVZVaOTCxlExn1lquqoXAeN3+c7nzXeMowDs1EZ/8p3HLsilx7I6VOT8uAm5Ks3hbBsA=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:49.329177 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1269/2485] 10.222.0.33 () {60 vars in 1169 bytes} [Sat May 28 21:11:44 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:49.344942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-2be66050-d7d0-43ce-8e2a-92ef0682343f tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Getting quotas for project 8e63642fba3b4b72bc6297f4b85a1119. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:49.353490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-2be66050-d7d0-43ce-8e2a-92ef0682343f tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Getting quotas for user 32caeee3c02547e7bffce1e68ba81294 and project 8e63642fba3b4b72bc6297f4b85a1119. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:49.424700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-914f7eec-6000-40e8-8144-8f72f880abce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:49.425561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-914f7eec-6000-40e8-8144-8f72f880abce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:49.438267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-914f7eec-6000-40e8-8144-8f72f880abce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:49.439536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-914f7eec-6000-40e8-8144-8f72f880abce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:49.441265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-914f7eec-6000-40e8-8144-8f72f880abce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:49.443042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-914f7eec-6000-40e8-8144-8f72f880abce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:49.489786 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2be66050-d7d0-43ce-8e2a-92ef0682343f tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.172845 May 28 21:11:49.491561 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1217/2486] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:11:49 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:49.514199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3204c434-84c5-4f46-9ec5-6db137755d07 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Action: 'create', calling method: .version_select at 0x7f4d57f05a60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1593416186", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBi8Cz/g4J+UyJfdDLNCIdAm9GcKVqqpwsnQuaopYUutdcpaK30nkFcDNSD/0XOQv3J/auiPiy9YVtlYLl0vM18RnPunJMw2t31WOLIqVJrG8pz6jUio1wzuky7pqIt9vQ=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:49.582095 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-3204c434-84c5-4f46-9ec5-6db137755d07 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Getting quotas for project 8e63642fba3b4b72bc6297f4b85a1119. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:49.595010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-3204c434-84c5-4f46-9ec5-6db137755d07 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Getting quotas for user 32caeee3c02547e7bffce1e68ba81294 and project 8e63642fba3b4b72bc6297f4b85a1119. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:49.730699 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3204c434-84c5-4f46-9ec5-6db137755d07 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.230878 May 28 21:11:49.742981 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1218/2487] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:11:49 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:49.755639 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-914f7eec-6000-40e8-8144-8f72f880abce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:49.773356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-52ca75dd-2ee3-436a-bc09-16af2bd2f942 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Action: 'create', calling method: .version_select at 0x7f4d57f7f8b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1785982309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWe+bXsYOUpLDXeY60u97F8SJJFAll6kC5eVuEOmYLm5pda43NZAYynFsybgUdNlqC9AEVp/MyMCTOxFB9yZ08XURyfmsObIPsa6teT9QwH9SWTjBYLVkIMrsTVyoboig=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:49.776045 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-914f7eec-6000-40e8-8144-8f72f880abce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1553 microversion: 2.1 time: 0.353837 May 28 21:11:49.776900 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1270/2488] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:49 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1553 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:11:49.810494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-52ca75dd-2ee3-436a-bc09-16af2bd2f942 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Getting quotas for project 8e63642fba3b4b72bc6297f4b85a1119. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:49.830347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-52ca75dd-2ee3-436a-bc09-16af2bd2f942 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Getting quotas for user 32caeee3c02547e7bffce1e68ba81294 and project 8e63642fba3b4b72bc6297f4b85a1119. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:49.889165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-455366293", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "c1dde440-05b5-4215-bf14-fa46ddc2096b"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:49.993443 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-52ca75dd-2ee3-436a-bc09-16af2bd2f942 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.248726 May 28 21:11:50.000094 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1219/2489] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:11:49 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:50.009448 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9651f24d-5f5f-4e07-9f9d-989d216d73cd tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Calling method '.version_select at 0x7f4d642518b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:50.022112 ncdv-master-1 devstack@n-api.service[143129]: WARNING oslo_db.sqlalchemy.utils [None req-9651f24d-5f5f-4e07-9f9d-989d216d73cd tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Unique keys not in sort_keys. The sorting order may be unstable. May 28 21:11:50.022474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] validate_networks() for [('c1dde440-05b5-4215-bf14-fa46ddc2096b', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:11:50.039652 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9651f24d-5f5f-4e07-9f9d-989d216d73cd tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.036687 May 28 21:11:50.043032 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1220/2490] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:11:50 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:50.065263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b71cefca-b384-4377-b243-860b7e699762 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Calling method '.version_select at 0x7f4d64061790>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:50.220049 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b71cefca-b384-4377-b243-860b7e699762 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1785982309" status: 202 len: 0 microversion: 2.1 time: 0.170926 May 28 21:11:50.225063 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1221/2491] 10.222.0.33 () {58 vars in 1277 bytes} [Sat May 28 21:11:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1785982309 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:11:50.229172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3451121f-d34a-4ded-b319-066f9f838f45 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Calling method '.version_select at 0x7f4d57f059d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:50.358057 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3451121f-d34a-4ded-b319-066f9f838f45 tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1593416186" status: 202 len: 0 microversion: 2.1 time: 0.132325 May 28 21:11:50.365603 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1222/2492] 10.222.0.33 () {58 vars in 1277 bytes} [Sat May 28 21:11:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1593416186 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:11:50.388219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-08deceac-6eca-4f46-ab00-567e3988881a tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] Calling method '.version_select at 0x7f4d646225e0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:50.546968 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-08deceac-6eca-4f46-ab00-567e3988881a tempest-KeyPairsV2TestJSON-1473039876 tempest-KeyPairsV2TestJSON-1473039876-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1170514830" status: 202 len: 0 microversion: 2.1 time: 0.175958 May 28 21:11:50.550051 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1223/2493] 10.222.0.33 () {58 vars in 1277 bytes} [Sat May 28 21:11:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1170514830 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:11:50.798422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9ef672fb-dc1e-4731-8ca7-cca683c8670a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:50.799465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9ef672fb-dc1e-4731-8ca7-cca683c8670a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:50.812316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ef672fb-dc1e-4731-8ca7-cca683c8670a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:50.812788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ef672fb-dc1e-4731-8ca7-cca683c8670a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:50.813590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ef672fb-dc1e-4731-8ca7-cca683c8670a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:50.814599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ef672fb-dc1e-4731-8ca7-cca683c8670a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:51.440440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9ef672fb-dc1e-4731-8ca7-cca683c8670a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:51.449560 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9ef672fb-dc1e-4731-8ca7-cca683c8670a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1553 microversion: 2.1 time: 0.656110 May 28 21:11:51.454602 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1224/2494] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:50 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1553 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:51.712693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-acd8b08c-037f-4dee-a04d-55af3568b2e6 req-43419713-a034-47e6-90a8-79dcdb2210f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea206247-c6b4-49e5-aafd-92084ea25c9a", "name": "network-vif-deleted", "tag": "b2a22fa5-c484-458c-b896-9639a751194b"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:51.745242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-acd8b08c-037f-4dee-a04d-55af3568b2e6 req-43419713-a034-47e6-90a8-79dcdb2210f7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:51.754640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-acd8b08c-037f-4dee-a04d-55af3568b2e6 req-43419713-a034-47e6-90a8-79dcdb2210f7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:51.805427 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-acd8b08c-037f-4dee-a04d-55af3568b2e6 req-43419713-a034-47e6-90a8-79dcdb2210f7 service nova] Creating event network-vif-deleted:b2a22fa5-c484-458c-b896-9639a751194b for instance ea206247-c6b4-49e5-aafd-92084ea25c9a on nch2-master-1 May 28 21:11:51.822684 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-acd8b08c-037f-4dee-a04d-55af3568b2e6 req-43419713-a034-47e6-90a8-79dcdb2210f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110378 May 28 21:11:51.826205 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1225/2495] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:51.982037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:11:51.982544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:11:51.983152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:11:51.983848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:11:51.984491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:11:52.009165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:52.017402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:52.017402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:52.017659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:52.033071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:52.046071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Getting quotas for project 9d08be7a2d1e4b779987d75d87a5ef44. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:52.053370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Getting quotas for user 04ae3115a9194b47bce62ada4a2afdf2 and project 9d08be7a2d1e4b779987d75d87a5ef44. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:52.068977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:11:52.071685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:11:52.242660 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-577e0882-9072-4148-a58a-8ec5d7e8ad38 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.357956 May 28 21:11:52.243386 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1271/2496] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:11:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:11:52.255513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3a15feb5-f5f4-4be4-a2cb-7c5286d47147 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:52.255513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3a15feb5-f5f4-4be4-a2cb-7c5286d47147 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:52.356369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3a15feb5-f5f4-4be4-a2cb-7c5286d47147 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:52.365906 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3a15feb5-f5f4-4be4-a2cb-7c5286d47147 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e" status: 200 len: 1223 microversion: 2.1 time: 0.115453 May 28 21:11:52.382969 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1226/2497] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:52 2022] GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e => generated 1223 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:52.471664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-06839423-eb71-4130-a988-140272c27e8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:52.472597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-06839423-eb71-4130-a988-140272c27e8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:52.484485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06839423-eb71-4130-a988-140272c27e8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:52.484953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06839423-eb71-4130-a988-140272c27e8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:52.486672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06839423-eb71-4130-a988-140272c27e8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:52.487144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06839423-eb71-4130-a988-140272c27e8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:52.585626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06839423-eb71-4130-a988-140272c27e8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:52.586842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06839423-eb71-4130-a988-140272c27e8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:52.587754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-06839423-eb71-4130-a988-140272c27e8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lazy-loading 'fault' on Instance uuid ea206247-c6b4-49e5-aafd-92084ea25c9a {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:11:52.644365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-06839423-eb71-4130-a988-140272c27e8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:52.656499 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-06839423-eb71-4130-a988-140272c27e8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 200 len: 1350 microversion: 2.1 time: 0.188392 May 28 21:11:52.660110 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1272/2498] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:52 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 1350 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:53.384440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2d818524-73e7-47ae-9961-7c50d07f6df5 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:53.385311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2d818524-73e7-47ae-9961-7c50d07f6df5 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:53.575855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2d818524-73e7-47ae-9961-7c50d07f6df5 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:53.604322 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2d818524-73e7-47ae-9961-7c50d07f6df5 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e" status: 200 len: 1223 microversion: 2.1 time: 0.207319 May 28 21:11:53.614327 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1227/2499] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:53 2022] GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e => generated 1223 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:53.683541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f8128dcd-7f30-49cc-bf75-5b31ca320706 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:53.685117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f8128dcd-7f30-49cc-bf75-5b31ca320706 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:53.713947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8128dcd-7f30-49cc-bf75-5b31ca320706 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:53.714966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8128dcd-7f30-49cc-bf75-5b31ca320706 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:53.718798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8128dcd-7f30-49cc-bf75-5b31ca320706 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:53.718798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8128dcd-7f30-49cc-bf75-5b31ca320706 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:53.752653 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-f8128dcd-7f30-49cc-bf75-5b31ca320706 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f8128dcd-7f30-49cc-bf75-5b31ca320706 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a HTTP/1.1 May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ea206247-c6b4-49e5-aafd-92084ea25c9a'} May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:53.754646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:53.757952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:53.757952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:53.757952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:53.757952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:53.757952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:53.757952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:11:53.757952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:53.757952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f8128dcd-7f30-49cc-bf75-5b31ca320706 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:53.757952 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f8128dcd-7f30-49cc-bf75-5b31ca320706 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 404 len: 111 microversion: 2.1 time: 0.080702 May 28 21:11:53.760340 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1273/2500] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:53 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:53.995226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aec617e5-cbaa-47b6-acea-65f08baefca1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:53.998071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aec617e5-cbaa-47b6-acea-65f08baefca1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:54.014363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aec617e5-cbaa-47b6-acea-65f08baefca1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:54.015900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aec617e5-cbaa-47b6-acea-65f08baefca1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:54.016432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aec617e5-cbaa-47b6-acea-65f08baefca1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:54.017033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aec617e5-cbaa-47b6-acea-65f08baefca1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:54.041673 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-aec617e5-cbaa-47b6-acea-65f08baefca1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aec617e5-cbaa-47b6-acea-65f08baefca1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a/os-volume_attachments HTTP/1.1 May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'server_id': 'ea206247-c6b4-49e5-aafd-92084ea25c9a'} May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:54.049613 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:11:54.053418 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:54.053418 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:54.053418 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:54.053418 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:54.053418 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:54.053418 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:54.053418 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:54.053418 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:54.053418 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:11:54.053418 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:54.055000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aec617e5-cbaa-47b6-acea-65f08baefca1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:54.056171 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aec617e5-cbaa-47b6-acea-65f08baefca1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.065760 May 28 21:11:54.061235 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1228/2501] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:11:53 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a/os-volume_attachments => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:54.422368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1642861275", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "4688fc3e-7c0b-4b45-bce6-c3e05e995935"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:54.519196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] validate_networks() for [('4688fc3e-7c0b-4b45-bce6-c3e05e995935', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:11:54.628022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f3291417-395b-4c70-afdd-bf7393f8ea8c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:54.629336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f3291417-395b-4c70-afdd-bf7393f8ea8c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:54.643709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3291417-395b-4c70-afdd-bf7393f8ea8c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:54.644853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3291417-395b-4c70-afdd-bf7393f8ea8c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:54.646298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3291417-395b-4c70-afdd-bf7393f8ea8c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:54.647084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3291417-395b-4c70-afdd-bf7393f8ea8c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:54.836159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f3291417-395b-4c70-afdd-bf7393f8ea8c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:54.850843 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f3291417-395b-4c70-afdd-bf7393f8ea8c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e" status: 200 len: 1275 microversion: 2.1 time: 0.231507 May 28 21:11:54.863194 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1229/2502] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:54 2022] GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e => generated 1275 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:55.528341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:11:55.528881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:11:55.529268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:11:55.529661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:11:55.530712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:11:55.544382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:55.544382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:55.544937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:55.545372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:55.565541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Getting quotas for project cf04fd760c54473f83980a385252fa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:55.571366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Getting quotas for user bf9c8f66e7d24ca9baca835e41546f22 and project cf04fd760c54473f83980a385252fa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:55.588006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:11:55.590936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 40e3cea4-71b3-45b0-b832-370b34557bc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:11:55.748482 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5c1eb237-494a-45c5-a08b-f74fcad39259 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.331595 May 28 21:11:55.749224 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1274/2503] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:11:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:11:55.762237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-214f148d-d24f-4522-a469-fd94537cc609 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:55.762881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-214f148d-d24f-4522-a469-fd94537cc609 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 40e3cea4-71b3-45b0-b832-370b34557bc0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:55.869357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c2c4cdc1-f82a-4bcf-b5b3-8a6c5e87cbd4 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:55.870069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c2c4cdc1-f82a-4bcf-b5b3-8a6c5e87cbd4 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:55.880669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2c4cdc1-f82a-4bcf-b5b3-8a6c5e87cbd4 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:55.881313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2c4cdc1-f82a-4bcf-b5b3-8a6c5e87cbd4 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:55.884939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2c4cdc1-f82a-4bcf-b5b3-8a6c5e87cbd4 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:55.885442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2c4cdc1-f82a-4bcf-b5b3-8a6c5e87cbd4 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:55.925186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-214f148d-d24f-4522-a469-fd94537cc609 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:55.937483 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-214f148d-d24f-4522-a469-fd94537cc609 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/40e3cea4-71b3-45b0-b832-370b34557bc0" status: 200 len: 1215 microversion: 2.1 time: 0.181055 May 28 21:11:55.950060 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1230/2504] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:55 2022] GET /compute/v2.1/servers/40e3cea4-71b3-45b0-b832-370b34557bc0 => generated 1215 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:55.959004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6ee4c78e-09ea-4b5b-81a7-e4fc32df215a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:55.963036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6ee4c78e-09ea-4b5b-81a7-e4fc32df215a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 40e3cea4-71b3-45b0-b832-370b34557bc0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:56.011937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6ee4c78e-09ea-4b5b-81a7-e4fc32df215a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 40e3cea4-71b3-45b0-b832-370b34557bc0] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:11:56.034698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c2c4cdc1-f82a-4bcf-b5b3-8a6c5e87cbd4 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:56.044260 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c2c4cdc1-f82a-4bcf-b5b3-8a6c5e87cbd4 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e" status: 200 len: 1293 microversion: 2.1 time: 0.179566 May 28 21:11:56.046572 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1275/2505] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:55 2022] GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e => generated 1293 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:56.588867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-76cb6fcd-30fe-48fa-bed3-ab561d5e445d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Action: 'create', calling method: .version_select at 0x7f4d641a8700>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-458373816", "policies": ["affinity"]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:56.639391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:56.655203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-76cb6fcd-30fe-48fa-bed3-ab561d5e445d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:56.665807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-76cb6fcd-30fe-48fa-bed3-ab561d5e445d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for user ce8ac48fe53b4080bf74c9788408f8c5 and project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:56.815550 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.scheduler.client.report [None req-6ee4c78e-09ea-4b5b-81a7-e4fc32df215a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Deleted allocations for instance 40e3cea4-71b3-45b0-b832-370b34557bc0 May 28 21:11:56.827176 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.compute.api [None req-6ee4c78e-09ea-4b5b-81a7-e4fc32df215a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 40e3cea4-71b3-45b0-b832-370b34557bc0] Instance Mapping does not exist while attempting local delete cleanup. May 28 21:11:56.827176 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6ee4c78e-09ea-4b5b-81a7-e4fc32df215a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "DELETE /compute/v2.1/servers/40e3cea4-71b3-45b0-b832-370b34557bc0" status: 204 len: 0 microversion: 2.1 time: 0.871829 May 28 21:11:56.827176 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1231/2506] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:11:55 2022] DELETE /compute/v2.1/servers/40e3cea4-71b3-45b0-b832-370b34557bc0 => generated 0 bytes in 873 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:11:56.868676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-76cb6fcd-30fe-48fa-bed3-ab561d5e445d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:56.881224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-76cb6fcd-30fe-48fa-bed3-ab561d5e445d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for user ce8ac48fe53b4080bf74c9788408f8c5 and project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:56.905812 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-76cb6fcd-30fe-48fa-bed3-ab561d5e445d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.629247 May 28 21:11:56.907027 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1276/2507] 10.222.0.33 () {60 vars in 1173 bytes} [Sat May 28 21:11:56 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:11:56.914267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b773ea36-7111-43e9-8274-6373b40175fa tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:56.915251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b773ea36-7111-43e9-8274-6373b40175fa tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 40e3cea4-71b3-45b0-b832-370b34557bc0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-b773ea36-7111-43e9-8274-6373b40175fa tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b773ea36-7111-43e9-8274-6373b40175fa tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/40e3cea4-71b3-45b0-b832-370b34557bc0 HTTP/1.1 May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '40e3cea4-71b3-45b0-b832-370b34557bc0'} May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:56.931293 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:56.935334 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:56.935334 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:56.935334 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:56.935334 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:56.935334 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:56.935334 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:56.935334 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. May 28 21:11:56.935334 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:11:56.935334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b773ea36-7111-43e9-8274-6373b40175fa tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:56.935334 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b773ea36-7111-43e9-8274-6373b40175fa tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/40e3cea4-71b3-45b0-b832-370b34557bc0" status: 404 len: 111 microversion: 2.1 time: 0.023033 May 28 21:11:56.935334 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1277/2508] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:56 2022] GET /compute/v2.1/servers/40e3cea4-71b3-45b0-b832-370b34557bc0 => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:11:56.937729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8a8af5f9-4c9a-4a6f-bf2c-2fafc53edecc tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] Action: 'create', calling method: .version_select at 0x7f4d69c259d0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:56.940508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2f9db751-c9ce-4c4d-93ae-004b7eb9ebfe tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Action: 'create', calling method: .version_select at 0x7f4d640775e0>, body: {"server_group": {"name": "tempest-server-group-2099741034", "policies": ["affinity"]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:56.965944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=5 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:56.977937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-2f9db751-c9ce-4c4d-93ae-004b7eb9ebfe tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:56.981940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-8a8af5f9-4c9a-4a6f-bf2c-2fafc53edecc tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] Getting quotas for project e1f0267259d74463b29bda378389f5e4. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:56.990661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-8a8af5f9-4c9a-4a6f-bf2c-2fafc53edecc tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] Getting quotas for user 28a6a9a1c0ed478eb54268fbb45b63d0 and project e1f0267259d74463b29bda378389f5e4. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:56.996562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-2f9db751-c9ce-4c4d-93ae-004b7eb9ebfe tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for user ce8ac48fe53b4080bf74c9788408f8c5 and project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:57.138098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-8a8af5f9-4c9a-4a6f-bf2c-2fafc53edecc tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] Getting quotas for project e1f0267259d74463b29bda378389f5e4. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:57.145005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-8a8af5f9-4c9a-4a6f-bf2c-2fafc53edecc tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] Getting quotas for user 28a6a9a1c0ed478eb54268fbb45b63d0 and project e1f0267259d74463b29bda378389f5e4. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:57.162334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-2f9db751-c9ce-4c4d-93ae-004b7eb9ebfe tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:57.165196 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8a8af5f9-4c9a-4a6f-bf2c-2fafc53edecc tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.339776 May 28 21:11:57.166231 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1232/2509] 10.222.0.33 () {62 vars in 1213 bytes} [Sat May 28 21:11:56 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:11:57.175140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-2f9db751-c9ce-4c4d-93ae-004b7eb9ebfe tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for user ce8ac48fe53b4080bf74c9788408f8c5 and project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:57.175711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-34f9f8ae-7c48-41b7-9639-933d4b833424 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:57.176467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-34f9f8ae-7c48-41b7-9639-933d4b833424 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:57.183296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34f9f8ae-7c48-41b7-9639-933d4b833424 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:57.184018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34f9f8ae-7c48-41b7-9639-933d4b833424 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:57.185047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34f9f8ae-7c48-41b7-9639-933d4b833424 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:57.185662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34f9f8ae-7c48-41b7-9639-933d4b833424 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:57.198999 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2f9db751-c9ce-4c4d-93ae-004b7eb9ebfe tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.264653 May 28 21:11:57.200353 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1278/2510] 10.222.0.33 () {60 vars in 1172 bytes} [Sat May 28 21:11:56 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:57.205572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1295209555", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "4688fc3e-7c0b-4b45-bce6-c3e05e995935"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:57.273894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] validate_networks() for [('4688fc3e-7c0b-4b45-bce6-c3e05e995935', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:11:57.294507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-34f9f8ae-7c48-41b7-9639-933d4b833424 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:57.304005 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-34f9f8ae-7c48-41b7-9639-933d4b833424 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e" status: 200 len: 1281 microversion: 2.1 time: 0.136405 May 28 21:11:57.304973 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1233/2511] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:57 2022] GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e => generated 1281 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:57.311734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-20792f4f-8c74-4980-a1f9-3f16e06e72f8 tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:57.328160 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-20792f4f-8c74-4980-a1f9-3f16e06e72f8 tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.021770 May 28 21:11:57.329401 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1234/2512] 10.222.0.33 () {60 vars in 1192 bytes} [Sat May 28 21:11:57 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:11:57.340773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1b13a364-d3ce-4628-abf0-e70129e7f4dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Action: 'create', calling method: .version_select at 0x7f4d69c8a8b0>, body: {"server_group": {"name": "tempest-server-group-2099741034", "policies": ["affinity"]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:57.361433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-1b13a364-d3ce-4628-abf0-e70129e7f4dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:57.367401 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-1b13a364-d3ce-4628-abf0-e70129e7f4dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for user ce8ac48fe53b4080bf74c9788408f8c5 and project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:57.575288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-1b13a364-d3ce-4628-abf0-e70129e7f4dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:57.592020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-1b13a364-d3ce-4628-abf0-e70129e7f4dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for user ce8ac48fe53b4080bf74c9788408f8c5 and project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:57.619002 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1b13a364-d3ce-4628-abf0-e70129e7f4dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.283113 May 28 21:11:57.624390 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1235/2513] 10.222.0.33 () {60 vars in 1172 bytes} [Sat May 28 21:11:57 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:57.630348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c2e02721-136c-495f-a6da-77fb67dbfca4 tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:57.646181 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c2e02721-136c-495f-a6da-77fb67dbfca4 tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/2546d161-ecdb-45be-ab2a-d7109f85b330" status: 200 len: 235 microversion: 2.64 time: 0.024028 May 28 21:11:57.656108 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1236/2514] 10.222.0.33 () {60 vars in 1303 bytes} [Sat May 28 21:11:57 2022] GET /compute/v2.1/os-server-groups/2546d161-ecdb-45be-ab2a-d7109f85b330 => generated 235 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:11:57.656108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5ec105f8-2d2c-43e7-8ac2-f6bfc027e237 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:57.764766 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5ec105f8-2d2c-43e7-8ac2-f6bfc027e237 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/0b0fd34d-6e0c-45d9-9858-797a729e091d" status: 204 len: 0 microversion: 2.1 time: 0.116680 May 28 21:11:57.765651 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1237/2515] 10.222.0.33 () {58 vars in 1265 bytes} [Sat May 28 21:11:57 2022] DELETE /compute/v2.1/os-server-groups/0b0fd34d-6e0c-45d9-9858-797a729e091d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:11:57.773694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ba563cf4-afe5-4327-aef3-ccf7c3787e47 tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:57.906692 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ba563cf4-afe5-4327-aef3-ccf7c3787e47 tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/2546d161-ecdb-45be-ab2a-d7109f85b330" status: 204 len: 0 microversion: 2.64 time: 0.139843 May 28 21:11:57.907962 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1238/2516] 10.222.0.33 () {60 vars in 1306 bytes} [Sat May 28 21:11:57 2022] DELETE /compute/v2.1/os-server-groups/2546d161-ecdb-45be-ab2a-d7109f85b330 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:11:57.919213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b0d168e8-9488-46fa-b845-758e93f97234 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:57.944380 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b0d168e8-9488-46fa-b845-758e93f97234 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.033500 May 28 21:11:57.946123 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1239/2517] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:11:57 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:57.955560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d8db8dac-8b86-4764-aa7e-e2257cae1fad tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:57.966996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:11:57.967503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:11:57.968725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:11:57.969158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:11:57.969577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:11:57.973420 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-d8db8dac-8b86-4764-aa7e-e2257cae1fad tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] HTTP exception thrown: Instance group 2546d161-ecdb-45be-ab2a-d7109f85b330 could not be found. May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d8db8dac-8b86-4764-aa7e-e2257cae1fad tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] Request method failure captured: May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/os-server-groups/2546d161-ecdb-45be-ab2a-d7109f85b330 HTTP/1.1 May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAcriSJom__Z_z5Tg_RIuEhjyWchjejmnoqJ7SQiy3sORg6zYESrZjF9BsszRq_PAKONVBV2dW8-iv1srps2eiSlGQ8OVEM-iF-hjiRUP4gdzY1itlCIAdCBwyVZ_n-GuOM3daduvgFHrZ3Mq2CmK9EoyRU1UucPU6mrTaPFoY7OeQ May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Openstack-Nova-Api-Version: 2.64 May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e1f0267259d74463b29bda378389f5e4 May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerGroup264TestJSON-434847150 May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e1f0267259d74463b29bda378389f5e4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1f0267259d74463b29bda378389f5e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e1f0267259d74463b29bda378389f5e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e1f0267259d74463b29bda378389f5e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerGroup264TestJSON-434847150 May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e1f0267259d74463b29bda378389f5e4 May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerGroup264TestJSON-434847150 May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerGroup264TestJSON-434847150-project May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 28a6a9a1c0ed478eb54268fbb45b63d0 May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerGroup264TestJSON-434847150-project May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance group 2546d161-ecdb-45be-ab2a-d7109f85b330 could not be found. May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '2546d161-ecdb-45be-ab2a-d7109f85b330'} May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2546d161-ecdb-45be-ab2a-d7109f85b330 could not be found. May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2546d161-ecdb-45be-ab2a-d7109f85b330 could not be found. May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:57.986076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:57.989708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:57.989708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:57.989708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:57.989708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:57.989708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2546d161-ecdb-45be-ab2a-d7109f85b330 could not be found. May 28 21:11:57.989708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:57.991788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:57.991788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:57.991788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:57.991788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:57.997062 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d8db8dac-8b86-4764-aa7e-e2257cae1fad tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] Returning 404 to user: Instance group 2546d161-ecdb-45be-ab2a-d7109f85b330 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:57.999677 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d8db8dac-8b86-4764-aa7e-e2257cae1fad tempest-ServerGroup264TestJSON-434847150 tempest-ServerGroup264TestJSON-434847150-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/2546d161-ecdb-45be-ab2a-d7109f85b330" status: 404 len: 117 microversion: 2.64 time: 0.050844 May 28 21:11:58.002166 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1240/2518] 10.222.0.33 () {60 vars in 1306 bytes} [Sat May 28 21:11:57 2022] DELETE /compute/v2.1/os-server-groups/2546d161-ecdb-45be-ab2a-d7109f85b330 => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:11:58.015822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3a9174b9-12f2-49ea-85a4-e7914e6eb23d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:58.062226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Getting quotas for project cf04fd760c54473f83980a385252fa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:58.072112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Getting quotas for user bf9c8f66e7d24ca9baca835e41546f22 and project cf04fd760c54473f83980a385252fa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:58.117127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:11:58.124478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:11:58.171205 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3a9174b9-12f2-49ea-85a4-e7914e6eb23d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/e308adf1-98ac-451d-8deb-e27c5f103fa5" status: 204 len: 0 microversion: 2.1 time: 0.167003 May 28 21:11:58.174215 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1241/2519] 10.222.0.33 () {58 vars in 1265 bytes} [Sat May 28 21:11:58 2022] DELETE /compute/v2.1/os-server-groups/e308adf1-98ac-451d-8deb-e27c5f103fa5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:11:58.191639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1e37e0b9-6359-44aa-a08d-27c4595b55c9 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:58.216289 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1e37e0b9-6359-44aa-a08d-27c4595b55c9 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.029067 May 28 21:11:58.219949 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1242/2520] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:11:58 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:58.237959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-87535d8a-0cd3-4d67-b74a-bacb2ec5862a tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Action: 'create', calling method: .version_select at 0x7f4d576d9dc0>, body: {"server_group": {"name": "tempest-server-group-1483439187", "policies": ["affinity"]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:58.271464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-87535d8a-0cd3-4d67-b74a-bacb2ec5862a tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:58.284775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-87535d8a-0cd3-4d67-b74a-bacb2ec5862a tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for user ce8ac48fe53b4080bf74c9788408f8c5 and project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:58.349599 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-21ead9cf-2b6e-43c8-99e7-675593222923 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.147098 May 28 21:11:58.349599 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1279/2521] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:11:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:11:58.455130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-87535d8a-0cd3-4d67-b74a-bacb2ec5862a tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:58.465729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-87535d8a-0cd3-4d67-b74a-bacb2ec5862a tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for user ce8ac48fe53b4080bf74c9788408f8c5 and project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:58.493298 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-87535d8a-0cd3-4d67-b74a-bacb2ec5862a tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.266340 May 28 21:11:58.499205 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1243/2522] 10.222.0.33 () {60 vars in 1172 bytes} [Sat May 28 21:11:58 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:11:58.508779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3f026347-96c7-4bc6-bf4f-3de950f85b29 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:58.511542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3f026347-96c7-4bc6-bf4f-3de950f85b29 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:58.525129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f026347-96c7-4bc6-bf4f-3de950f85b29 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:58.525935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f026347-96c7-4bc6-bf4f-3de950f85b29 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:58.526927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f026347-96c7-4bc6-bf4f-3de950f85b29 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:58.527529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f026347-96c7-4bc6-bf4f-3de950f85b29 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:58.583352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1148673826", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "a1d7c67d-4437-4075-890e-fbb84a23f2b5"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:58.669392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] validate_networks() for [('a1d7c67d-4437-4075-890e-fbb84a23f2b5', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:11:58.973295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3f026347-96c7-4bc6-bf4f-3de950f85b29 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:58.999459 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3f026347-96c7-4bc6-bf4f-3de950f85b29 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e" status: 200 len: 1323 microversion: 2.1 time: 0.498916 May 28 21:11:59.001556 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1244/2523] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:58 2022] GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e => generated 1323 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:59.009533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3030f5a2-da90-4f3e-a565-67505a1a128d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:59.012159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3030f5a2-da90-4f3e-a565-67505a1a128d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:11:59.163654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3030f5a2-da90-4f3e-a565-67505a1a128d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:11:59.175370 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3030f5a2-da90-4f3e-a565-67505a1a128d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 200 len: 1215 microversion: 2.1 time: 0.169680 May 28 21:11:59.178573 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1245/2524] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:11:59 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:11:59.200339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c66479bc-2ee0-42c9-a8b0-2e9b1669a3a0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:59.360884 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c66479bc-2ee0-42c9-a8b0-2e9b1669a3a0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/6bd50cf1-248c-4418-8cd7-bb4c7ea1d1a2" status: 204 len: 0 microversion: 2.1 time: 0.180397 May 28 21:11:59.362790 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1246/2525] 10.222.0.33 () {58 vars in 1265 bytes} [Sat May 28 21:11:59 2022] DELETE /compute/v2.1/os-server-groups/6bd50cf1-248c-4418-8cd7-bb4c7ea1d1a2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:11:59.681082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d86c4c4b-dee3-4312-889e-d0d349c43727 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Calling method '.version_select at 0x7f4d642933a0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:59.725898 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-d86c4c4b-dee3-4312-889e-d0d349c43727 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] HTTP exception thrown: Image not found. May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d86c4c4b-dee3-4312-889e-d0d349c43727 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Request method failure captured: May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/images/b3adbd91-5c83-4d17-9787-8448ad6f7367/metadata/os_distro HTTP/1.1 May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAfGw_O-tns8MRKl3ZJYmwcfPR8ZbUAmRYHIrLvzbEiDxGrdFXG0rKz2q7jtzAeYAjq-j0XgCMvRpIC5Zc0JbyRK6n4-xva5uAHq9xCFVrgvvRpRE6ZUloPa5mcrwTMyVm9DHcH7MU6YzaXrSxOlxFed8vkfHtIb1mO0ubUB-TnI1M May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 8c5c8f0a4a21466fa3704ddcf51a599d May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c5c8f0a4a21466fa3704ddcf51a599d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 8c5c8f0a4a21466fa3704ddcf51a599d May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesMetadataNegativeTestJSON-1465235252-project May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: e134b2546c7340c490aff72572059854 May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252-project May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: exception: Image not found. May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'image_id': 'b3adbd91-5c83-4d17-9787-8448ad6f7367', 'id': 'os_distro'} May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b3adbd91-5c83-4d17-9787-8448ad6f7367 May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 21:11:59.732179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b3adbd91-5c83-4d17-9787-8448ad6f7367 could not be found. May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:11:59.735438 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:59.758571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d86c4c4b-dee3-4312-889e-d0d349c43727 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Returning 404 to user: Image not found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:59.758571 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d86c4c4b-dee3-4312-889e-d0d349c43727 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] 10.222.0.33 "DELETE /compute/v2.1/images/b3adbd91-5c83-4d17-9787-8448ad6f7367/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.386388 May 28 21:11:59.758571 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1247/2526] 10.222.0.33 () {58 vars in 1292 bytes} [Sat May 28 21:11:59 2022] DELETE /compute/v2.1/images/b3adbd91-5c83-4d17-9787-8448ad6f7367/metadata/os_distro => generated 62 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:11:59.764335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dbb6a293-5a98-4304-bcae-98ad89c54d64 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:59.783056 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dbb6a293-5a98-4304-bcae-98ad89c54d64 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.029156 May 28 21:11:59.784389 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1248/2527] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:11:59 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:11:59.791992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1b3ceba8-75e4-47ad-93a6-4f19695dead6 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Calling method '.version_select at 0x7f4d5765b790>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:11:59.823144 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-1b3ceba8-75e4-47ad-93a6-4f19695dead6 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] HTTP exception thrown: Image not found. May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1b3ceba8-75e4-47ad-93a6-4f19695dead6 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Request method failure captured: May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/images/f0d19913-2e8b-4082-941d-1f35bdfbffb2/metadata/os_version HTTP/1.1 May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAfGw_O-tns8MRKl3ZJYmwcfPR8ZbUAmRYHIrLvzbEiDxGrdFXG0rKz2q7jtzAeYAjq-j0XgCMvRpIC5Zc0JbyRK6n4-xva5uAHq9xCFVrgvvRpRE6ZUloPa5mcrwTMyVm9DHcH7MU6YzaXrSxOlxFed8vkfHtIb1mO0ubUB-TnI1M May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 8c5c8f0a4a21466fa3704ddcf51a599d May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c5c8f0a4a21466fa3704ddcf51a599d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 8c5c8f0a4a21466fa3704ddcf51a599d May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesMetadataNegativeTestJSON-1465235252-project May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: e134b2546c7340c490aff72572059854 May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252-project May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: exception: Image not found. May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'image_id': 'f0d19913-2e8b-4082-941d-1f35bdfbffb2', 'id': 'os_version'} May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f0d19913-2e8b-4082-941d-1f35bdfbffb2 May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 21:11:59.826428 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f0d19913-2e8b-4082-941d-1f35bdfbffb2 could not be found. May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:11:59.830012 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:11:59.842764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1b3ceba8-75e4-47ad-93a6-4f19695dead6 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Returning 404 to user: Image not found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:11:59.842764 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1b3ceba8-75e4-47ad-93a6-4f19695dead6 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] 10.222.0.33 "GET /compute/v2.1/images/f0d19913-2e8b-4082-941d-1f35bdfbffb2/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.048265 May 28 21:11:59.842764 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1249/2528] 10.222.0.33 () {58 vars in 1292 bytes} [Sat May 28 21:11:59 2022] GET /compute/v2.1/images/f0d19913-2e8b-4082-941d-1f35bdfbffb2/metadata/os_version => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:11:59.853296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ef0f5be2-f563-4cf2-a388-a449ada48950 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Action: 'create', calling method: .version_select at 0x7f4d6460d9d0>, body: {"server_group": {"name": "tempest-server-group-932318317", "policies": ["anti-affinity"]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:11:59.879244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ef0f5be2-f563-4cf2-a388-a449ada48950 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:59.892428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ef0f5be2-f563-4cf2-a388-a449ada48950 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for user ce8ac48fe53b4080bf74c9788408f8c5 and project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:59.898812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:11:59.904919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:11:59.905409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:11:59.905820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:11:59.906259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:11:59.906681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:11:59.930930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:59.933949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:59.933949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:11:59.933949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:11:59.953085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Getting quotas for project 53ecc00f85b54d01aa7dbe2f0386dac6. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:11:59.963569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Getting quotas for user 25b2f1524f7f48149cbc5d2c694a9e2b and project 53ecc00f85b54d01aa7dbe2f0386dac6. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:11:59.988388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:11:59.988388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:12:00.064975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ef0f5be2-f563-4cf2-a388-a449ada48950 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:00.074526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ef0f5be2-f563-4cf2-a388-a449ada48950 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for user ce8ac48fe53b4080bf74c9788408f8c5 and project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_groups'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:00.088414 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ef0f5be2-f563-4cf2-a388-a449ada48950 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.248894 May 28 21:12:00.090689 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1250/2529] 10.222.0.33 () {60 vars in 1172 bytes} [Sat May 28 21:11:59 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:00.096101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-41fa8df9-aada-4948-9392-9c9c68df7354 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Calling method '.version_select at 0x7f4d645cea60>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:00.126525 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-41fa8df9-aada-4948-9392-9c9c68df7354 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] HTTP exception thrown: Image not found. May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-41fa8df9-aada-4948-9392-9c9c68df7354 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Request method failure captured: May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/images/181d6eb7-522c-40fe-b405-cd7907e01381/metadata HTTP/1.1 May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAfGw_O-tns8MRKl3ZJYmwcfPR8ZbUAmRYHIrLvzbEiDxGrdFXG0rKz2q7jtzAeYAjq-j0XgCMvRpIC5Zc0JbyRK6n4-xva5uAHq9xCFVrgvvRpRE6ZUloPa5mcrwTMyVm9DHcH7MU6YzaXrSxOlxFed8vkfHtIb1mO0ubUB-TnI1M May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 8c5c8f0a4a21466fa3704ddcf51a599d May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c5c8f0a4a21466fa3704ddcf51a599d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 8c5c8f0a4a21466fa3704ddcf51a599d May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesMetadataNegativeTestJSON-1465235252-project May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: e134b2546c7340c490aff72572059854 May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252-project May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: exception: Image not found. May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'image_id': '181d6eb7-522c-40fe-b405-cd7907e01381'} May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 181d6eb7-522c-40fe-b405-cd7907e01381 May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 21:12:00.133875 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 181d6eb7-522c-40fe-b405-cd7907e01381 could not be found. May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-41fa8df9-aada-4948-9392-9c9c68df7354 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Returning 404 to user: Image not found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-41fa8df9-aada-4948-9392-9c9c68df7354 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] 10.222.0.33 "GET /compute/v2.1/images/181d6eb7-522c-40fe-b405-cd7907e01381/metadata" status: 404 len: 62 microversion: 2.1 time: 0.043660 May 28 21:12:00.137120 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1251/2530] 10.222.0.33 () {58 vars in 1259 bytes} [Sat May 28 21:12:00 2022] GET /compute/v2.1/images/181d6eb7-522c-40fe-b405-cd7907e01381/metadata => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:12:00.148751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e8c2d2b8-7d0a-430c-8831-7045ef74d2cf tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:00.149399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e8c2d2b8-7d0a-430c-8831-7045ef74d2cf tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:00.178435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8c2d2b8-7d0a-430c-8831-7045ef74d2cf tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:00.178904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8c2d2b8-7d0a-430c-8831-7045ef74d2cf tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:00.179707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8c2d2b8-7d0a-430c-8831-7045ef74d2cf tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:00.180462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8c2d2b8-7d0a-430c-8831-7045ef74d2cf tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:00.223899 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0a5276c4-bdad-4386-9a4e-95e4c05ed7ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.873282 May 28 21:12:00.224571 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1280/2531] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:11:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:12:00.235461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1b07858f-f815-44ac-9609-08cd7b3e6002 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:00.415924 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1b07858f-f815-44ac-9609-08cd7b3e6002 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/4a55988a-b525-439e-aa0a-94fa9015c2aa" status: 204 len: 0 microversion: 2.1 time: 0.190227 May 28 21:12:00.421287 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1281/2532] 10.222.0.33 () {58 vars in 1265 bytes} [Sat May 28 21:12:00 2022] DELETE /compute/v2.1/os-server-groups/4a55988a-b525-439e-aa0a-94fa9015c2aa => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:12:00.429771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-82fd52e2-d38e-48eb-828a-267d3543f779 req-b7b06ff3-467c-4805-95ef-ae6b5cb8fec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00573ede-054c-45fe-90f8-b1ef7725596e", "tag": "e1731f50-e120-4158-be35-70b39f01d5b7"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:00.448230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-82fd52e2-d38e-48eb-828a-267d3543f779 req-b7b06ff3-467c-4805-95ef-ae6b5cb8fec2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:00.451588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-82fd52e2-d38e-48eb-828a-267d3543f779 req-b7b06ff3-467c-4805-95ef-ae6b5cb8fec2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:00.466521 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-82fd52e2-d38e-48eb-828a-267d3543f779 req-b7b06ff3-467c-4805-95ef-ae6b5cb8fec2 service nova] Creating event network-changed:e1731f50-e120-4158-be35-70b39f01d5b7 for instance 00573ede-054c-45fe-90f8-b1ef7725596e on nch1-master-1 May 28 21:12:00.473115 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-82fd52e2-d38e-48eb-828a-267d3543f779 req-b7b06ff3-467c-4805-95ef-ae6b5cb8fec2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047855 May 28 21:12:00.474240 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1282/2533] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:00.485189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-514ad49c-827b-498e-b333-1dd883d28e80 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Action: 'update_all', calling method: .version_select at 0x7f4d6421e3a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:00.525426 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-514ad49c-827b-498e-b333-1dd883d28e80 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] HTTP exception thrown: Image not found. May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-514ad49c-827b-498e-b333-1dd883d28e80 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Request method failure captured: May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: request: PUT /compute/v2.1/images/aa794a90-d415-4845-a205-8be515255656/metadata HTTP/1.1 May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 57 May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpAfGw_O-tns8MRKl3ZJYmwcfPR8ZbUAmRYHIrLvzbEiDxGrdFXG0rKz2q7jtzAeYAjq-j0XgCMvRpIC5Zc0JbyRK6n4-xva5uAHq9xCFVrgvvRpRE6ZUloPa5mcrwTMyVm9DHcH7MU6YzaXrSxOlxFed8vkfHtIb1mO0ubUB-TnI1M May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 8c5c8f0a4a21466fa3704ddcf51a599d May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c5c8f0a4a21466fa3704ddcf51a599d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 8c5c8f0a4a21466fa3704ddcf51a599d May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesMetadataNegativeTestJSON-1465235252-project May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: e134b2546c7340c490aff72572059854 May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252-project May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: exception: Image not found. May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'image_id': 'aa794a90-d415-4845-a205-8be515255656', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID aa794a90-d415-4845-a205-8be515255656 May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 21:12:00.529584 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aa794a90-d415-4845-a205-8be515255656 could not be found. May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-514ad49c-827b-498e-b333-1dd883d28e80 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Returning 404 to user: Image not found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-514ad49c-827b-498e-b333-1dd883d28e80 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] 10.222.0.33 "PUT /compute/v2.1/images/aa794a90-d415-4845-a205-8be515255656/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055600 May 28 21:12:00.540281 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1283/2534] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:12:00 2022] PUT /compute/v2.1/images/aa794a90-d415-4845-a205-8be515255656/metadata => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:12:00.562556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0124fef1-5462-43c0-ba6a-2074cc9b7dbe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:00.565478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0124fef1-5462-43c0-ba6a-2074cc9b7dbe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:00.588473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0124fef1-5462-43c0-ba6a-2074cc9b7dbe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:00.588473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0124fef1-5462-43c0-ba6a-2074cc9b7dbe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:00.588473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0124fef1-5462-43c0-ba6a-2074cc9b7dbe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:00.588473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0124fef1-5462-43c0-ba6a-2074cc9b7dbe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:00.748607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0124fef1-5462-43c0-ba6a-2074cc9b7dbe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:00.759645 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0124fef1-5462-43c0-ba6a-2074cc9b7dbe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 200 len: 1211 microversion: 2.1 time: 0.224838 May 28 21:12:00.760449 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1284/2535] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:00 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 1211 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:00.769397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9a11c17c-210a-4b15-a427-f98f8066de68 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:00.770503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9a11c17c-210a-4b15-a427-f98f8066de68 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:00.784261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10,nova_api:DELETE=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:00.813810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e8c2d2b8-7d0a-430c-8831-7045ef74d2cf tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:00.826584 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e8c2d2b8-7d0a-430c-8831-7045ef74d2cf tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e" status: 200 len: 1323 microversion: 2.1 time: 0.689482 May 28 21:12:00.828449 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1252/2536] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:00 2022] GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e => generated 1323 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:00.840670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1e69eaf9-6f1d-484d-b052-49a99f8ad5e0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:00.862980 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1e69eaf9-6f1d-484d-b052-49a99f8ad5e0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.032943 May 28 21:12:00.863589 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1253/2537] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:12:00 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:00.881927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cf935640-69ec-4343-aa3e-d5f6bb16baa1 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Action: 'update', calling method: .version_select at 0x7f4d69c1b3a0>, body: {"meta": {"os_distro": "alt"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:00.923993 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-cf935640-69ec-4343-aa3e-d5f6bb16baa1 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] HTTP exception thrown: Image not found. May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cf935640-69ec-4343-aa3e-d5f6bb16baa1 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Request method failure captured: May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: request: PUT /compute/v2.1/images/a1fa2fc7-d4a6-4bac-a87c-7e330f25d888/metadata/os_distro HTTP/1.1 May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 30 May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAfGw_O-tns8MRKl3ZJYmwcfPR8ZbUAmRYHIrLvzbEiDxGrdFXG0rKz2q7jtzAeYAjq-j0XgCMvRpIC5Zc0JbyRK6n4-xva5uAHq9xCFVrgvvRpRE6ZUloPa5mcrwTMyVm9DHcH7MU6YzaXrSxOlxFed8vkfHtIb1mO0ubUB-TnI1M May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 8c5c8f0a4a21466fa3704ddcf51a599d May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c5c8f0a4a21466fa3704ddcf51a599d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 8c5c8f0a4a21466fa3704ddcf51a599d May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesMetadataNegativeTestJSON-1465235252-project May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: e134b2546c7340c490aff72572059854 May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252-project May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: {"meta": {"os_distro": "alt"}} May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: exception: Image not found. May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'image_id': 'a1fa2fc7-d4a6-4bac-a87c-7e330f25d888', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a1fa2fc7-d4a6-4bac-a87c-7e330f25d888 May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 21:12:00.926575 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a1fa2fc7-d4a6-4bac-a87c-7e330f25d888 could not be found. May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cf935640-69ec-4343-aa3e-d5f6bb16baa1 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Returning 404 to user: Image not found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cf935640-69ec-4343-aa3e-d5f6bb16baa1 tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] 10.222.0.33 "PUT /compute/v2.1/images/a1fa2fc7-d4a6-4bac-a87c-7e330f25d888/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.062457 May 28 21:12:00.939612 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1254/2538] 10.222.0.33 () {60 vars in 1309 bytes} [Sat May 28 21:12:00 2022] PUT /compute/v2.1/images/a1fa2fc7-d4a6-4bac-a87c-7e330f25d888/metadata/os_distro => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:12:00.947641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9a11c17c-210a-4b15-a427-f98f8066de68 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:00.954002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f0d02f0b-6383-4952-8781-d2be72c5a78a tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Action: 'create', calling method: .version_select at 0x7f4d576d9b80>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:00.961059 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9a11c17c-210a-4b15-a427-f98f8066de68 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1218 microversion: 2.1 time: 0.198041 May 28 21:12:00.961822 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1285/2539] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:00 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1218 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:01.000774 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-f0d02f0b-6383-4952-8781-d2be72c5a78a tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] HTTP exception thrown: Image not found. May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f0d02f0b-6383-4952-8781-d2be72c5a78a tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Request method failure captured: May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/images/3bae5139-152e-48c7-8c22-ce5f59f723df/metadata HTTP/1.1 May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 57 May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAfGw_O-tns8MRKl3ZJYmwcfPR8ZbUAmRYHIrLvzbEiDxGrdFXG0rKz2q7jtzAeYAjq-j0XgCMvRpIC5Zc0JbyRK6n4-xva5uAHq9xCFVrgvvRpRE6ZUloPa5mcrwTMyVm9DHcH7MU6YzaXrSxOlxFed8vkfHtIb1mO0ubUB-TnI1M May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 8c5c8f0a4a21466fa3704ddcf51a599d May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c5c8f0a4a21466fa3704ddcf51a599d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c5c8f0a4a21466fa3704ddcf51a599d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 8c5c8f0a4a21466fa3704ddcf51a599d May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252 May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesMetadataNegativeTestJSON-1465235252-project May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: e134b2546c7340c490aff72572059854 May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1465235252-project May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: exception: Image not found. May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'image_id': '3bae5139-152e-48c7-8c22-ce5f59f723df', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3bae5139-152e-48c7-8c22-ce5f59f723df May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 21:12:01.008563 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3bae5139-152e-48c7-8c22-ce5f59f723df could not be found. May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:12:01.013471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:01.019095 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f0d02f0b-6383-4952-8781-d2be72c5a78a tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] Returning 404 to user: Image not found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:01.021890 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f0d02f0b-6383-4952-8781-d2be72c5a78a tempest-ImagesMetadataNegativeTestJSON-1465235252 tempest-ImagesMetadataNegativeTestJSON-1465235252-project] 10.222.0.33 "POST /compute/v2.1/images/3bae5139-152e-48c7-8c22-ce5f59f723df/metadata" status: 404 len: 62 microversion: 2.1 time: 0.082913 May 28 21:12:01.023948 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1255/2540] 10.222.0.33 () {60 vars in 1280 bytes} [Sat May 28 21:12:00 2022] POST /compute/v2.1/images/3bae5139-152e-48c7-8c22-ce5f59f723df/metadata => generated 62 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:12:01.118408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-279182851", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "213eb744-a640-4de3-b747-9d0eff991ba5"}]}, "os:scheduler_hints": {"group": "07618ba6-bbcc-450f-9a45-c977278c2741"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:01.238968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] validate_networks() for [('213eb744-a640-4de3-b747-9d0eff991ba5', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:12:01.777061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9a7ef1fe-7e99-4f01-ac09-b962954d223d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:01.777689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9a7ef1fe-7e99-4f01-ac09-b962954d223d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:01.795383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a7ef1fe-7e99-4f01-ac09-b962954d223d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:01.796129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a7ef1fe-7e99-4f01-ac09-b962954d223d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:01.809860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a7ef1fe-7e99-4f01-ac09-b962954d223d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:01.824993 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a7ef1fe-7e99-4f01-ac09-b962954d223d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:02.008929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9a7ef1fe-7e99-4f01-ac09-b962954d223d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:02.023102 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9a7ef1fe-7e99-4f01-ac09-b962954d223d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 200 len: 1285 microversion: 2.1 time: 0.250001 May 28 21:12:02.025150 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1256/2541] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:01 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 1285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:12:02.032654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d486b32d-ca4c-4ce8-9e42-15d8f10212dd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:02.033943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d486b32d-ca4c-4ce8-9e42-15d8f10212dd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:02.043932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d486b32d-ca4c-4ce8-9e42-15d8f10212dd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:02.043932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d486b32d-ca4c-4ce8-9e42-15d8f10212dd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:02.045270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d486b32d-ca4c-4ce8-9e42-15d8f10212dd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:02.055923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d486b32d-ca4c-4ce8-9e42-15d8f10212dd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:02.368339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:12:02.368879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:12:02.370187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:12:02.371034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:12:02.371836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:12:02.421906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:02.422372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:02.423186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:02.423625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:02.444476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:02.453865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for user ce8ac48fe53b4080bf74c9788408f8c5 and project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:02.484614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:12:02.493356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:12:02.679106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:02.686017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for user ce8ac48fe53b4080bf74c9788408f8c5 and project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:02.739070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d486b32d-ca4c-4ce8-9e42-15d8f10212dd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:02.748868 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d486b32d-ca4c-4ce8-9e42-15d8f10212dd tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e" status: 200 len: 1323 microversion: 2.1 time: 0.722409 May 28 21:12:02.749700 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1257/2542] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:02 2022] GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e => generated 1323 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:02.755100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b9aae8a7-9971-452a-b04e-f900078a8343 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:02.756573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b9aae8a7-9971-452a-b04e-f900078a8343 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:02.766432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9aae8a7-9971-452a-b04e-f900078a8343 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:02.766432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9aae8a7-9971-452a-b04e-f900078a8343 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:02.766432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9aae8a7-9971-452a-b04e-f900078a8343 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:02.766432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9aae8a7-9971-452a-b04e-f900078a8343 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:02.863005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:02.869277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b9aae8a7-9971-452a-b04e-f900078a8343 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:02.882780 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b9aae8a7-9971-452a-b04e-f900078a8343 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1270 microversion: 2.1 time: 0.130286 May 28 21:12:02.886409 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1258/2543] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:02 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1270 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:02.892909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Getting quotas for user ce8ac48fe53b4080bf74c9788408f8c5 and project 2e073d4d15a243eca3ea41985b8150b0. Resources: {'server_group_members'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:02.982831 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ccf496c0-8d97-4f8d-aaa0-929cf3817ba0 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.868484 May 28 21:12:02.987457 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1286/2544] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:12:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:12:02.995936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-15b47382-777e-48eb-8551-ed8ca0bc8693 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:02.997099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-15b47382-777e-48eb-8551-ed8ca0bc8693 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:03.045433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1a079422-715c-44e4-90a0-94968ffe60f8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:03.046261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1a079422-715c-44e4-90a0-94968ffe60f8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:03.101249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a079422-715c-44e4-90a0-94968ffe60f8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:03.101736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a079422-715c-44e4-90a0-94968ffe60f8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:03.103584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a079422-715c-44e4-90a0-94968ffe60f8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:03.109025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a079422-715c-44e4-90a0-94968ffe60f8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:03.132414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-15b47382-777e-48eb-8551-ed8ca0bc8693 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8ac48fe53b4080bf74c9788408f8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e073d4d15a243eca3ea41985b8150b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:03.145339 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-15b47382-777e-48eb-8551-ed8ca0bc8693 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 200 len: 1212 microversion: 2.1 time: 0.152837 May 28 21:12:03.146706 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1259/2545] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:02 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 1212 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:03.258762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1a079422-715c-44e4-90a0-94968ffe60f8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:03.310344 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1a079422-715c-44e4-90a0-94968ffe60f8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 200 len: 1273 microversion: 2.1 time: 0.268448 May 28 21:12:03.314314 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1287/2546] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:03 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 1273 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:12:03.766845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a017de85-1eeb-4275-b3c7-b18853ca4eb6 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:03.767706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a017de85-1eeb-4275-b3c7-b18853ca4eb6 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:03.793428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a017de85-1eeb-4275-b3c7-b18853ca4eb6 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:03.794195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a017de85-1eeb-4275-b3c7-b18853ca4eb6 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:03.795524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a017de85-1eeb-4275-b3c7-b18853ca4eb6 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:03.796143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a017de85-1eeb-4275-b3c7-b18853ca4eb6 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:03.914490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b3ac3b8c-312b-47a7-879e-56536aafd1b3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:03.915799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b3ac3b8c-312b-47a7-879e-56536aafd1b3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:03.941113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3ac3b8c-312b-47a7-879e-56536aafd1b3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:03.944764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3ac3b8c-312b-47a7-879e-56536aafd1b3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:03.947619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3ac3b8c-312b-47a7-879e-56536aafd1b3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:03.948897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3ac3b8c-312b-47a7-879e-56536aafd1b3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:04.333264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b3ac3b8c-312b-47a7-879e-56536aafd1b3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:04.353419 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b3ac3b8c-312b-47a7-879e-56536aafd1b3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1288 microversion: 2.1 time: 0.455834 May 28 21:12:04.354416 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1288/2547] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:03 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1288 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:04.359366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-14e32128-e99a-4acd-a787-e05cb9cb3013 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:04.360179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-14e32128-e99a-4acd-a787-e05cb9cb3013 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:04.525464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-14e32128-e99a-4acd-a787-e05cb9cb3013 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8ac48fe53b4080bf74c9788408f8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e073d4d15a243eca3ea41985b8150b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:04.550501 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-14e32128-e99a-4acd-a787-e05cb9cb3013 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 200 len: 1212 microversion: 2.1 time: 0.194641 May 28 21:12:04.562938 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1289/2548] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:04 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 1212 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:04.568563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-06757ad6-de5f-4e49-b0ff-5f4b21ee94a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:04.571361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-06757ad6-de5f-4e49-b0ff-5f4b21ee94a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:04.592376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06757ad6-de5f-4e49-b0ff-5f4b21ee94a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:04.593151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06757ad6-de5f-4e49-b0ff-5f4b21ee94a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:04.595354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06757ad6-de5f-4e49-b0ff-5f4b21ee94a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:04.595979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06757ad6-de5f-4e49-b0ff-5f4b21ee94a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:04.614944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a017de85-1eeb-4275-b3c7-b18853ca4eb6 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:04.627024 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a017de85-1eeb-4275-b3c7-b18853ca4eb6 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e" status: 200 len: 1323 microversion: 2.1 time: 0.864641 May 28 21:12:04.628776 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1260/2549] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:03 2022] GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e => generated 1323 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:04.879711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-06757ad6-de5f-4e49-b0ff-5f4b21ee94a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:04.888276 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-06757ad6-de5f-4e49-b0ff-5f4b21ee94a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 200 len: 1315 microversion: 2.1 time: 0.323246 May 28 21:12:04.889873 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1290/2550] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:04 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:05.370475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-76f1a35f-d828-402f-9a2d-b1d08d621ce6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:05.371268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-76f1a35f-d828-402f-9a2d-b1d08d621ce6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:05.380622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-76f1a35f-d828-402f-9a2d-b1d08d621ce6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:05.384014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-76f1a35f-d828-402f-9a2d-b1d08d621ce6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:05.384865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-76f1a35f-d828-402f-9a2d-b1d08d621ce6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:05.385322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-76f1a35f-d828-402f-9a2d-b1d08d621ce6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:05.604429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1190573506", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:05.678646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-76f1a35f-d828-402f-9a2d-b1d08d621ce6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:05.690646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:12:05.696263 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-76f1a35f-d828-402f-9a2d-b1d08d621ce6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1318 microversion: 2.1 time: 0.329098 May 28 21:12:05.697654 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1291/2551] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:05 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:12:05.718027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9e4aa4c6-f36e-45c9-828d-02085bc4f15c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:05.718767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9e4aa4c6-f36e-45c9-828d-02085bc4f15c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:05.736692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e4aa4c6-f36e-45c9-828d-02085bc4f15c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:05.737152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e4aa4c6-f36e-45c9-828d-02085bc4f15c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:05.741788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e4aa4c6-f36e-45c9-828d-02085bc4f15c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:05.742345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e4aa4c6-f36e-45c9-828d-02085bc4f15c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:05.869648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9e4aa4c6-f36e-45c9-828d-02085bc4f15c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8ac48fe53b4080bf74c9788408f8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e073d4d15a243eca3ea41985b8150b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:05.890336 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9e4aa4c6-f36e-45c9-828d-02085bc4f15c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 200 len: 1208 microversion: 2.1 time: 0.191191 May 28 21:12:05.897322 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1292/2552] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:05 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 1208 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:05.922403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d6dd2f0e-e610-4017-bc9b-037be7d55a71 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:05.923486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d6dd2f0e-e610-4017-bc9b-037be7d55a71 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:05.942091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6dd2f0e-e610-4017-bc9b-037be7d55a71 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:05.951075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6dd2f0e-e610-4017-bc9b-037be7d55a71 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:05.951075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6dd2f0e-e610-4017-bc9b-037be7d55a71 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:05.951075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6dd2f0e-e610-4017-bc9b-037be7d55a71 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:06.265127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:12:06.265721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:12:06.266504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:12:06.266973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:12:06.267451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:12:06.284149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:06.284777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:06.285977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:06.286555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:06.307398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Getting quotas for project 659cd6db8d6741329dded06813f0ef93. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:06.315057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Getting quotas for user 0e36e381aa5a4e4196d4e994e70f586e and project 659cd6db8d6741329dded06813f0ef93. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:06.332597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:12:06.335685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:12:06.378602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d6dd2f0e-e610-4017-bc9b-037be7d55a71 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:06.396241 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d6dd2f0e-e610-4017-bc9b-037be7d55a71 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e" status: 200 len: 1323 microversion: 2.1 time: 0.494241 May 28 21:12:06.400504 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1293/2553] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:05 2022] GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e => generated 1323 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:06.407643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-9b52ff22-e3c3-4c88-b9d9-6ca1e363cd0e req-836c54dd-68af-4cc8-aee4-ff46b5909389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea458195-fcf6-455c-873e-de1f07779365", "tag": "c3d5ae0d-0d35-410e-94e1-8491e9231b77"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:06.455891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9b52ff22-e3c3-4c88-b9d9-6ca1e363cd0e req-836c54dd-68af-4cc8-aee4-ff46b5909389 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:06.456227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9b52ff22-e3c3-4c88-b9d9-6ca1e363cd0e req-836c54dd-68af-4cc8-aee4-ff46b5909389 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:06.470929 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-896a7112-2255-431b-8ae6-e66dd8c87a26 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.163209 May 28 21:12:06.473935 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1261/2554] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:12:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:12:06.488476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7fe4900f-e000-48c7-bf6b-bd523ae8b330 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:06.491481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7fe4900f-e000-48c7-bf6b-bd523ae8b330 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:06.500341 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-9b52ff22-e3c3-4c88-b9d9-6ca1e363cd0e req-836c54dd-68af-4cc8-aee4-ff46b5909389 service nova] Creating event network-changed:c3d5ae0d-0d35-410e-94e1-8491e9231b77 for instance ea458195-fcf6-455c-873e-de1f07779365 on nch2-master-1 May 28 21:12:06.509448 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fe4900f-e000-48c7-bf6b-bd523ae8b330 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:06.511619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fe4900f-e000-48c7-bf6b-bd523ae8b330 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:06.512441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fe4900f-e000-48c7-bf6b-bd523ae8b330 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:06.514321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fe4900f-e000-48c7-bf6b-bd523ae8b330 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:06.520830 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-9b52ff22-e3c3-4c88-b9d9-6ca1e363cd0e req-836c54dd-68af-4cc8-aee4-ff46b5909389 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120047 May 28 21:12:06.524683 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1294/2555] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:06.543273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-003d906f-163d-4801-9722-c82ed6a3e80e req-456b8362-08a7-4ed2-8da6-e46220fdbad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00573ede-054c-45fe-90f8-b1ef7725596e", "name": "network-vif-plugged", "status": "completed", "tag": "e1731f50-e120-4158-be35-70b39f01d5b7"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:06.582426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-003d906f-163d-4801-9722-c82ed6a3e80e req-456b8362-08a7-4ed2-8da6-e46220fdbad5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:06.582426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-003d906f-163d-4801-9722-c82ed6a3e80e req-456b8362-08a7-4ed2-8da6-e46220fdbad5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:06.607056 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-003d906f-163d-4801-9722-c82ed6a3e80e req-456b8362-08a7-4ed2-8da6-e46220fdbad5 service nova] Creating event network-vif-plugged:e1731f50-e120-4158-be35-70b39f01d5b7 for instance 00573ede-054c-45fe-90f8-b1ef7725596e on nch1-master-1 May 28 21:12:06.620991 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-003d906f-163d-4801-9722-c82ed6a3e80e req-456b8362-08a7-4ed2-8da6-e46220fdbad5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096782 May 28 21:12:06.623030 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1295/2556] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:06.668970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2c9aad29-4273-4c4e-b733-3dc51f0aeacc tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:06.669825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2c9aad29-4273-4c4e-b733-3dc51f0aeacc tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:06.967174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2c9aad29-4273-4c4e-b733-3dc51f0aeacc tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36e381aa5a4e4196d4e994e70f586e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659cd6db8d6741329dded06813f0ef93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:06.981573 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2c9aad29-4273-4c4e-b733-3dc51f0aeacc tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 200 len: 1216 microversion: 2.1 time: 0.351691 May 28 21:12:06.986809 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1296/2557] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:06 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 1216 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:07.000081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ba032999-3908-40d4-8c0c-7cf06947a7ab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:07.001612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ba032999-3908-40d4-8c0c-7cf06947a7ab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:07.021597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba032999-3908-40d4-8c0c-7cf06947a7ab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:07.022264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba032999-3908-40d4-8c0c-7cf06947a7ab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:07.023160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba032999-3908-40d4-8c0c-7cf06947a7ab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:07.023708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba032999-3908-40d4-8c0c-7cf06947a7ab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:07.191172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7fe4900f-e000-48c7-bf6b-bd523ae8b330 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:07.210816 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7fe4900f-e000-48c7-bf6b-bd523ae8b330 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 200 len: 1315 microversion: 2.1 time: 0.735420 May 28 21:12:07.214448 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1262/2558] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:06 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 1315 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:07.223706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f595cb77-7f53-4615-99a0-640178b092db tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:07.230457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f595cb77-7f53-4615-99a0-640178b092db tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:07.236861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f595cb77-7f53-4615-99a0-640178b092db tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:07.237765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f595cb77-7f53-4615-99a0-640178b092db tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:07.238702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f595cb77-7f53-4615-99a0-640178b092db tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:07.239149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f595cb77-7f53-4615-99a0-640178b092db tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:07.329882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f595cb77-7f53-4615-99a0-640178b092db tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8ac48fe53b4080bf74c9788408f8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e073d4d15a243eca3ea41985b8150b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:07.342747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ba032999-3908-40d4-8c0c-7cf06947a7ab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:07.343376 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f595cb77-7f53-4615-99a0-640178b092db tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 200 len: 1270 microversion: 2.1 time: 0.127419 May 28 21:12:07.352870 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ba032999-3908-40d4-8c0c-7cf06947a7ab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1318 microversion: 2.1 time: 0.363677 May 28 21:12:07.353685 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1297/2559] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:06 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:07.369934 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1263/2560] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:07 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 1270 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:07.415138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0d333ce9-0451-44d5-9ed8-0c82c0926380 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:07.415892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0d333ce9-0451-44d5-9ed8-0c82c0926380 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:07.422229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d333ce9-0451-44d5-9ed8-0c82c0926380 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:07.422690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d333ce9-0451-44d5-9ed8-0c82c0926380 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:07.423464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d333ce9-0451-44d5-9ed8-0c82c0926380 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:07.423921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d333ce9-0451-44d5-9ed8-0c82c0926380 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:07.430013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-902578825", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "7903dad0-52bd-4a4f-bd8a-e817d092cf94"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:07.489723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] validate_networks() for [('7903dad0-52bd-4a4f-bd8a-e817d092cf94', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:12:07.962698 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0d333ce9-0451-44d5-9ed8-0c82c0926380 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:07.972315 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0d333ce9-0451-44d5-9ed8-0c82c0926380 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e" status: 200 len: 1323 microversion: 2.1 time: 0.560940 May 28 21:12:07.973129 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1264/2561] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:07 2022] GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e => generated 1323 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:12:07.978018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-42fbfbf6-a492-4f37-a919-f719013e1675 req-9237d211-5b5b-4270-ad87-f8c39dcb43d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af7be2b-2058-490c-b258-2103bacdb44f", "tag": "80b2c42c-6208-42e7-8bba-7fc8e7727506"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:07.987051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-42fbfbf6-a492-4f37-a919-f719013e1675 req-9237d211-5b5b-4270-ad87-f8c39dcb43d8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:07.988001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-42fbfbf6-a492-4f37-a919-f719013e1675 req-9237d211-5b5b-4270-ad87-f8c39dcb43d8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:08.000620 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-42fbfbf6-a492-4f37-a919-f719013e1675 req-9237d211-5b5b-4270-ad87-f8c39dcb43d8 service nova] Creating event network-changed:80b2c42c-6208-42e7-8bba-7fc8e7727506 for instance 0af7be2b-2058-490c-b258-2103bacdb44f on nch2-master-1 May 28 21:12:08.005613 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-42fbfbf6-a492-4f37-a919-f719013e1675 req-9237d211-5b5b-4270-ad87-f8c39dcb43d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031576 May 28 21:12:08.006386 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1265/2562] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:08.011909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cf7fc911-2a28-4656-9526-851e7ec4cca6 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:08.012809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cf7fc911-2a28-4656-9526-851e7ec4cca6 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:08.028462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf7fc911-2a28-4656-9526-851e7ec4cca6 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:08.028928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf7fc911-2a28-4656-9526-851e7ec4cca6 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:08.029715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf7fc911-2a28-4656-9526-851e7ec4cca6 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:08.030273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf7fc911-2a28-4656-9526-851e7ec4cca6 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:08.159960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cf7fc911-2a28-4656-9526-851e7ec4cca6 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36e381aa5a4e4196d4e994e70f586e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659cd6db8d6741329dded06813f0ef93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:08.171040 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cf7fc911-2a28-4656-9526-851e7ec4cca6 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 200 len: 1220 microversion: 2.1 time: 0.163257 May 28 21:12:08.171630 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1266/2563] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:08 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 1220 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:08.230583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0a87f76d-20d5-4fa8-8dcd-e0e689941e09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:08.231777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0a87f76d-20d5-4fa8-8dcd-e0e689941e09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:08.234971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:08.240438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a87f76d-20d5-4fa8-8dcd-e0e689941e09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:08.251466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a87f76d-20d5-4fa8-8dcd-e0e689941e09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:08.251466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a87f76d-20d5-4fa8-8dcd-e0e689941e09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:08.251466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a87f76d-20d5-4fa8-8dcd-e0e689941e09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:08.267154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:08.517757 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:12:08.518309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:12:08.519124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:12:08.519265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:12:08.519610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:12:08.529247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:08.529717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:08.537894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:08.537894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:08.546966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0a87f76d-20d5-4fa8-8dcd-e0e689941e09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:08.554743 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0a87f76d-20d5-4fa8-8dcd-e0e689941e09 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 200 len: 1315 microversion: 2.1 time: 0.328834 May 28 21:12:08.555323 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1267/2564] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:08 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:12:08.560555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-587cce86-fa42-4062-8a26-6cbb24cc8c8e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:08.561509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-587cce86-fa42-4062-8a26-6cbb24cc8c8e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:08.563293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Getting quotas for project 8047aaa6e1f7401fbcf4b4cd5dcd004e. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:08.568219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-587cce86-fa42-4062-8a26-6cbb24cc8c8e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:08.568866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-587cce86-fa42-4062-8a26-6cbb24cc8c8e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:08.569826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-587cce86-fa42-4062-8a26-6cbb24cc8c8e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:08.570436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-587cce86-fa42-4062-8a26-6cbb24cc8c8e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:08.576550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Getting quotas for user 2dd86b6dd9894aac971943b2fa859bd1 and project 8047aaa6e1f7401fbcf4b4cd5dcd004e. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:08.595716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:12:08.598978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:12:08.700452 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-52f5e9b4-c8af-4d56-a1d1-d159544c7c36 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345554 May 28 21:12:08.701365 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1298/2565] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:12:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:12:08.714143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ad6b2611-d91f-4444-8a36-ddf9ffab27e1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:08.714822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ad6b2611-d91f-4444-8a36-ddf9ffab27e1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:08.729041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad6b2611-d91f-4444-8a36-ddf9ffab27e1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:08.730071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad6b2611-d91f-4444-8a36-ddf9ffab27e1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:08.731068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad6b2611-d91f-4444-8a36-ddf9ffab27e1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:08.732158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad6b2611-d91f-4444-8a36-ddf9ffab27e1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:08.942221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-587cce86-fa42-4062-8a26-6cbb24cc8c8e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8ac48fe53b4080bf74c9788408f8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e073d4d15a243eca3ea41985b8150b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:08.952751 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-587cce86-fa42-4062-8a26-6cbb24cc8c8e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 200 len: 1312 microversion: 2.1 time: 0.396203 May 28 21:12:08.966027 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1268/2566] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:08 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 1312 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:08.973610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b889775f-3dab-4b55-b884-07381f3aba78 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:08.975276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b889775f-3dab-4b55-b884-07381f3aba78 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:09.098576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b889775f-3dab-4b55-b884-07381f3aba78 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd86b6dd9894aac971943b2fa859bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8047aaa6e1f7401fbcf4b4cd5dcd004e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:09.101548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=75 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:09.108011 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b889775f-3dab-4b55-b884-07381f3aba78 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9" status: 200 len: 1215 microversion: 2.1 time: 0.140546 May 28 21:12:09.108891 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1269/2567] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:08 2022] GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 => generated 1215 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:09.114074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b793ac46-be24-437c-b2af-cbdf04fab40e tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:09.115084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b793ac46-be24-437c-b2af-cbdf04fab40e tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:09.122828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b793ac46-be24-437c-b2af-cbdf04fab40e tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:09.123821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b793ac46-be24-437c-b2af-cbdf04fab40e tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:09.124260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b793ac46-be24-437c-b2af-cbdf04fab40e tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:09.124792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b793ac46-be24-437c-b2af-cbdf04fab40e tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:09.158060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ad6b2611-d91f-4444-8a36-ddf9ffab27e1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:09.166354 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ad6b2611-d91f-4444-8a36-ddf9ffab27e1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1318 microversion: 2.1 time: 0.463464 May 28 21:12:09.176875 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1299/2568] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:08 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1318 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:09.187862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6d9d2996-e37a-48d7-87ee-b6919ad6f982 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:09.188478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6d9d2996-e37a-48d7-87ee-b6919ad6f982 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:09.194797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d9d2996-e37a-48d7-87ee-b6919ad6f982 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:09.198266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d9d2996-e37a-48d7-87ee-b6919ad6f982 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:09.198266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d9d2996-e37a-48d7-87ee-b6919ad6f982 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:09.198266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d9d2996-e37a-48d7-87ee-b6919ad6f982 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:09.308652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6d9d2996-e37a-48d7-87ee-b6919ad6f982 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36e381aa5a4e4196d4e994e70f586e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659cd6db8d6741329dded06813f0ef93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:09.316717 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6d9d2996-e37a-48d7-87ee-b6919ad6f982 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 200 len: 1268 microversion: 2.1 time: 0.132680 May 28 21:12:09.317887 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1300/2569] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:09 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 1268 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:12:09.356869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b793ac46-be24-437c-b2af-cbdf04fab40e tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:09.367603 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b793ac46-be24-437c-b2af-cbdf04fab40e tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e" status: 200 len: 1519 microversion: 2.1 time: 0.257321 May 28 21:12:09.377623 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1270/2570] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:09 2022] GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e => generated 1519 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:09.390949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9e85556e-33c9-48d4-9305-7dfb713676df tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.52"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:09.392266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9e85556e-33c9-48d4-9305-7dfb713676df tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:09.408233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e85556e-33c9-48d4-9305-7dfb713676df tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:09.408695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e85556e-33c9-48d4-9305-7dfb713676df tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:09.409483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e85556e-33c9-48d4-9305-7dfb713676df tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:09.409966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e85556e-33c9-48d4-9305-7dfb713676df tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:09.508075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e85556e-33c9-48d4-9305-7dfb713676df tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Acquired lock "refresh_cache-50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" {{(pid=143128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 21:12:09.572768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f1f87c95-e705-43c6-ba5b-9b3261cc9b45 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:09.580273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f1f87c95-e705-43c6-ba5b-9b3261cc9b45 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:09.583536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1f87c95-e705-43c6-ba5b-9b3261cc9b45 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:09.584237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1f87c95-e705-43c6-ba5b-9b3261cc9b45 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:09.585235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1f87c95-e705-43c6-ba5b-9b3261cc9b45 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:09.585909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1f87c95-e705-43c6-ba5b-9b3261cc9b45 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:09.929920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f1f87c95-e705-43c6-ba5b-9b3261cc9b45 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:09.935002 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f1f87c95-e705-43c6-ba5b-9b3261cc9b45 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 200 len: 1315 microversion: 2.1 time: 0.366605 May 28 21:12:09.937389 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1271/2571] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:09 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:12:09.969964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a603f790-546a-4ede-8791-8f6fb290fc0c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:09.970601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a603f790-546a-4ede-8791-8f6fb290fc0c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:09.979974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a603f790-546a-4ede-8791-8f6fb290fc0c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:09.980446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a603f790-546a-4ede-8791-8f6fb290fc0c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:09.981254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a603f790-546a-4ede-8791-8f6fb290fc0c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:09.981687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a603f790-546a-4ede-8791-8f6fb290fc0c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:10.297438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a603f790-546a-4ede-8791-8f6fb290fc0c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8ac48fe53b4080bf74c9788408f8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e073d4d15a243eca3ea41985b8150b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:10.306705 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a603f790-546a-4ede-8791-8f6fb290fc0c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 200 len: 1312 microversion: 2.1 time: 0.340456 May 28 21:12:10.308539 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1272/2572] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:09 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 1312 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:12:10.313751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-7bf6525b-9245-448d-9d84-43ade0db0bb4 req-6eb56207-79f4-41e5-b860-4156a3effb06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb986652-a1db-48a0-89cc-5f3479f029e3", "tag": "2e867dc7-af5e-4cd6-be5f-2c31650317b4"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:10.322417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7bf6525b-9245-448d-9d84-43ade0db0bb4 req-6eb56207-79f4-41e5-b860-4156a3effb06 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:10.322878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7bf6525b-9245-448d-9d84-43ade0db0bb4 req-6eb56207-79f4-41e5-b860-4156a3effb06 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:10.334423 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-7bf6525b-9245-448d-9d84-43ade0db0bb4 req-6eb56207-79f4-41e5-b860-4156a3effb06 service nova] Creating event network-changed:2e867dc7-af5e-4cd6-be5f-2c31650317b4 for instance cb986652-a1db-48a0-89cc-5f3479f029e3 on nch1-master-1 May 28 21:12:10.339009 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-7bf6525b-9245-448d-9d84-43ade0db0bb4 req-6eb56207-79f4-41e5-b860-4156a3effb06 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029546 May 28 21:12:10.339706 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1273/2573] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:10.344675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a584f51d-c948-4b51-93a2-6bd3138f8577 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:10.345389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a584f51d-c948-4b51-93a2-6bd3138f8577 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:10.351887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a584f51d-c948-4b51-93a2-6bd3138f8577 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:10.352424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a584f51d-c948-4b51-93a2-6bd3138f8577 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:10.353128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a584f51d-c948-4b51-93a2-6bd3138f8577 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:10.353577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a584f51d-c948-4b51-93a2-6bd3138f8577 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:10.442198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a584f51d-c948-4b51-93a2-6bd3138f8577 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd86b6dd9894aac971943b2fa859bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8047aaa6e1f7401fbcf4b4cd5dcd004e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:10.449903 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a584f51d-c948-4b51-93a2-6bd3138f8577 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9" status: 200 len: 1219 microversion: 2.1 time: 0.109012 May 28 21:12:10.450494 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1274/2574] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:10 2022] GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:10.455008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4f5c3e17-4d2f-410c-9cf9-9effd87f2143 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:10.455628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4f5c3e17-4d2f-410c-9cf9-9effd87f2143 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:10.461544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f5c3e17-4d2f-410c-9cf9-9effd87f2143 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:10.462039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f5c3e17-4d2f-410c-9cf9-9effd87f2143 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:10.462817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f5c3e17-4d2f-410c-9cf9-9effd87f2143 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:10.463266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f5c3e17-4d2f-410c-9cf9-9effd87f2143 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:10.662856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4f5c3e17-4d2f-410c-9cf9-9effd87f2143 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:10.670861 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4f5c3e17-4d2f-410c-9cf9-9effd87f2143 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1318 microversion: 2.1 time: 0.219394 May 28 21:12:10.671440 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1275/2575] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:10 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:10.676082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dbe09c04-9d01-493e-9ba8-5a4b9f4d1778 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:10.676693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dbe09c04-9d01-493e-9ba8-5a4b9f4d1778 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:10.684137 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbe09c04-9d01-493e-9ba8-5a4b9f4d1778 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:10.684137 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbe09c04-9d01-493e-9ba8-5a4b9f4d1778 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:10.684404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbe09c04-9d01-493e-9ba8-5a4b9f4d1778 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:10.684801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbe09c04-9d01-493e-9ba8-5a4b9f4d1778 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:10.804148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dbe09c04-9d01-493e-9ba8-5a4b9f4d1778 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36e381aa5a4e4196d4e994e70f586e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659cd6db8d6741329dded06813f0ef93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:10.811908 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dbe09c04-9d01-493e-9ba8-5a4b9f4d1778 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 200 len: 1274 microversion: 2.1 time: 0.139485 May 28 21:12:10.812698 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1276/2576] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:10 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:10.953640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b0622162-e550-4916-ae02-3782f90c09ae tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:10.954377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b0622162-e550-4916-ae02-3782f90c09ae tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:10.961089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0622162-e550-4916-ae02-3782f90c09ae tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:10.961785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0622162-e550-4916-ae02-3782f90c09ae tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:10.962821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0622162-e550-4916-ae02-3782f90c09ae tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:10.963369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0622162-e550-4916-ae02-3782f90c09ae tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:11.605455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b0622162-e550-4916-ae02-3782f90c09ae tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:11.618209 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b0622162-e550-4916-ae02-3782f90c09ae tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 200 len: 1315 microversion: 2.1 time: 0.668809 May 28 21:12:11.619067 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1277/2577] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:10 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 1315 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:12:11.626046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8554cd87-0b94-4d3c-931c-71dd05ce63cc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:11.629029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8554cd87-0b94-4d3c-931c-71dd05ce63cc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:11.640898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8554cd87-0b94-4d3c-931c-71dd05ce63cc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:11.656666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8554cd87-0b94-4d3c-931c-71dd05ce63cc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:11.661091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8554cd87-0b94-4d3c-931c-71dd05ce63cc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:11.661091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8554cd87-0b94-4d3c-931c-71dd05ce63cc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:11.960670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8554cd87-0b94-4d3c-931c-71dd05ce63cc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8ac48fe53b4080bf74c9788408f8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e073d4d15a243eca3ea41985b8150b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:11.969769 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8554cd87-0b94-4d3c-931c-71dd05ce63cc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 200 len: 1312 microversion: 2.1 time: 0.349508 May 28 21:12:11.970386 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1278/2578] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:11 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 1312 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:11.981733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-9e85556e-33c9-48d4-9305-7dfb713676df tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Building network info cache for instance {{(pid=143128) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 21:12:11.995791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3e99f50e-d309-4a1e-aacb-b07113e3e9b7 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:11.996519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3e99f50e-d309-4a1e-aacb-b07113e3e9b7 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:12.008973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e99f50e-d309-4a1e-aacb-b07113e3e9b7 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:12.009696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e99f50e-d309-4a1e-aacb-b07113e3e9b7 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:12.010679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e99f50e-d309-4a1e-aacb-b07113e3e9b7 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:12.013896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e99f50e-d309-4a1e-aacb-b07113e3e9b7 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:12.143271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3e99f50e-d309-4a1e-aacb-b07113e3e9b7 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd86b6dd9894aac971943b2fa859bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8047aaa6e1f7401fbcf4b4cd5dcd004e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:12.154737 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3e99f50e-d309-4a1e-aacb-b07113e3e9b7 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9" status: 200 len: 1267 microversion: 2.1 time: 0.182613 May 28 21:12:12.155537 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1279/2579] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:11 2022] GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:12.172200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-91be072f-9de2-4871-821d-0322716f98c7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:12.173637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-91be072f-9de2-4871-821d-0322716f98c7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:12.189712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91be072f-9de2-4871-821d-0322716f98c7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:12.196894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91be072f-9de2-4871-821d-0322716f98c7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:12.196894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91be072f-9de2-4871-821d-0322716f98c7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:12.196894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91be072f-9de2-4871-821d-0322716f98c7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:12.559604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-91be072f-9de2-4871-821d-0322716f98c7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:12.569581 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-91be072f-9de2-4871-821d-0322716f98c7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1318 microversion: 2.1 time: 0.412610 May 28 21:12:12.581800 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1280/2580] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:12 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:12.587342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e263352e-c83c-447a-b082-284f89ca5f65 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:12.587997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e263352e-c83c-447a-b082-284f89ca5f65 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:12.595413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e263352e-c83c-447a-b082-284f89ca5f65 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:12.596235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e263352e-c83c-447a-b082-284f89ca5f65 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:12.597248 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e263352e-c83c-447a-b082-284f89ca5f65 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:12.597891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e263352e-c83c-447a-b082-284f89ca5f65 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:12.962691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e263352e-c83c-447a-b082-284f89ca5f65 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36e381aa5a4e4196d4e994e70f586e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659cd6db8d6741329dded06813f0ef93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:12.974695 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e263352e-c83c-447a-b082-284f89ca5f65 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 200 len: 1316 microversion: 2.1 time: 0.391497 May 28 21:12:12.985703 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1281/2581] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:12 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 1316 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:12.992104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-0fa4fe8c-1398-48fc-a137-de32352dce72 req-0f5f7004-8f44-4141-bf27-2d03e9690483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea458195-fcf6-455c-873e-de1f07779365", "name": "network-vif-plugged", "status": "completed", "tag": "c3d5ae0d-0d35-410e-94e1-8491e9231b77"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:13.002870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0fa4fe8c-1398-48fc-a137-de32352dce72 req-0f5f7004-8f44-4141-bf27-2d03e9690483 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:13.004596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0fa4fe8c-1398-48fc-a137-de32352dce72 req-0f5f7004-8f44-4141-bf27-2d03e9690483 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:13.024110 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-0fa4fe8c-1398-48fc-a137-de32352dce72 req-0f5f7004-8f44-4141-bf27-2d03e9690483 service nova] Creating event network-vif-plugged:c3d5ae0d-0d35-410e-94e1-8491e9231b77 for instance ea458195-fcf6-455c-873e-de1f07779365 on nch2-master-1 May 28 21:12:13.031060 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-0fa4fe8c-1398-48fc-a137-de32352dce72 req-0f5f7004-8f44-4141-bf27-2d03e9690483 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047432 May 28 21:12:13.032350 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1282/2582] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:13.039718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-5d551c76-eb6d-4775-aaf7-bc9f04868162 req-60e57253-fb57-4d2d-90ea-d496ab8f7312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a4cf15-02b5-42d1-ae2f-849ca1ec8d35", "tag": "825989f5-1b0d-4731-92b8-dabd0a2be976"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:13.049099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5d551c76-eb6d-4775-aaf7-bc9f04868162 req-60e57253-fb57-4d2d-90ea-d496ab8f7312 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:13.051428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5d551c76-eb6d-4775-aaf7-bc9f04868162 req-60e57253-fb57-4d2d-90ea-d496ab8f7312 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:13.078761 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-5d551c76-eb6d-4775-aaf7-bc9f04868162 req-60e57253-fb57-4d2d-90ea-d496ab8f7312 service nova] Creating event network-changed:825989f5-1b0d-4731-92b8-dabd0a2be976 for instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 on nch2-master-1 May 28 21:12:13.086414 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-5d551c76-eb6d-4775-aaf7-bc9f04868162 req-60e57253-fb57-4d2d-90ea-d496ab8f7312 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052263 May 28 21:12:13.087426 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1283/2583] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:13.093101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3142460a-07f1-440e-992e-64d7385e213c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:13.104376 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3142460a-07f1-440e-992e-64d7385e213c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:13.133510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3142460a-07f1-440e-992e-64d7385e213c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:13.134392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3142460a-07f1-440e-992e-64d7385e213c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:13.135413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3142460a-07f1-440e-992e-64d7385e213c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:13.136855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3142460a-07f1-440e-992e-64d7385e213c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:13.415340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-9e85556e-33c9-48d4-9305-7dfb713676df tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Updating instance_info_cache with network_info: [{"id": "825989f5-1b0d-4731-92b8-dabd0a2be976", "address": "fa:16:3e:76:3b:1f", "network": {"id": "c1dde440-05b5-4215-bf14-fa46ddc2096b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1102943986-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9d08be7a2d1e4b779987d75d87a5ef44", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap825989f5-1b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=143128) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 21:12:13.420225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:13.498784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3142460a-07f1-440e-992e-64d7385e213c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:13.512865 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3142460a-07f1-440e-992e-64d7385e213c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 200 len: 1315 microversion: 2.1 time: 0.424153 May 28 21:12:13.513661 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1284/2584] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:13 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:13.526496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ed3f1066-da41-45c4-a505-6b39f52ed8b3 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:13.527141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ed3f1066-da41-45c4-a505-6b39f52ed8b3 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:13.534829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed3f1066-da41-45c4-a505-6b39f52ed8b3 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:13.535291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed3f1066-da41-45c4-a505-6b39f52ed8b3 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:13.538081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e85556e-33c9-48d4-9305-7dfb713676df tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Releasing lock "refresh_cache-50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" {{(pid=143128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 21:12:13.543429 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9e85556e-33c9-48d4-9305-7dfb713676df tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "POST /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35/action" status: 202 len: 0 microversion: 2.1 time: 4.152893 May 28 21:12:13.543684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed3f1066-da41-45c4-a505-6b39f52ed8b3 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:13.543684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed3f1066-da41-45c4-a505-6b39f52ed8b3 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:13.543875 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1301/2585] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:12:09 2022] POST /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35/action => generated 0 bytes in 4155 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 21:12:13.549341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4d06d80d-f94e-4afc-8eaa-7d1e12917f1e tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:13.550246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4d06d80d-f94e-4afc-8eaa-7d1e12917f1e tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:13.573418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d06d80d-f94e-4afc-8eaa-7d1e12917f1e tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:13.573941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d06d80d-f94e-4afc-8eaa-7d1e12917f1e tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:13.574749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d06d80d-f94e-4afc-8eaa-7d1e12917f1e tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:13.575213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d06d80d-f94e-4afc-8eaa-7d1e12917f1e tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:14.036432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4d06d80d-f94e-4afc-8eaa-7d1e12917f1e tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd86b6dd9894aac971943b2fa859bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8047aaa6e1f7401fbcf4b4cd5dcd004e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:14.048377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ed3f1066-da41-45c4-a505-6b39f52ed8b3 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8ac48fe53b4080bf74c9788408f8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e073d4d15a243eca3ea41985b8150b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:14.058765 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4d06d80d-f94e-4afc-8eaa-7d1e12917f1e tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9" status: 200 len: 1315 microversion: 2.1 time: 0.513723 May 28 21:12:14.059421 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ed3f1066-da41-45c4-a505-6b39f52ed8b3 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 200 len: 1312 microversion: 2.1 time: 0.544629 May 28 21:12:14.059871 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1302/2586] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:13 2022] GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:14.068576 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1285/2587] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:13 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 1312 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:14.080149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cae30afc-516f-4373-bc75-91a8ad151557 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.52"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:14.081353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cae30afc-516f-4373-bc75-91a8ad151557 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:14.090460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fe1177ff-55e8-41b1-80f0-57bcf74f407d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:14.091650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fe1177ff-55e8-41b1-80f0-57bcf74f407d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:14.111874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe1177ff-55e8-41b1-80f0-57bcf74f407d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:14.114023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cae30afc-516f-4373-bc75-91a8ad151557 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:14.114154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe1177ff-55e8-41b1-80f0-57bcf74f407d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:14.114236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cae30afc-516f-4373-bc75-91a8ad151557 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:14.114236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cae30afc-516f-4373-bc75-91a8ad151557 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:14.114373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cae30afc-516f-4373-bc75-91a8ad151557 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:14.114636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe1177ff-55e8-41b1-80f0-57bcf74f407d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:14.115291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe1177ff-55e8-41b1-80f0-57bcf74f407d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:14.184999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cae30afc-516f-4373-bc75-91a8ad151557 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Acquired lock "refresh_cache-00573ede-054c-45fe-90f8-b1ef7725596e" {{(pid=143128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 21:12:14.573667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fe1177ff-55e8-41b1-80f0-57bcf74f407d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:14.577537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:14.586353 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fe1177ff-55e8-41b1-80f0-57bcf74f407d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1318 microversion: 2.1 time: 0.516275 May 28 21:12:14.587604 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1286/2588] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:14 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:14.592863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9f02aeaa-a877-482a-8c19-cb1e60d5bf39 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:14.593710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9f02aeaa-a877-482a-8c19-cb1e60d5bf39 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:14.602862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f02aeaa-a877-482a-8c19-cb1e60d5bf39 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:14.602862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f02aeaa-a877-482a-8c19-cb1e60d5bf39 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:14.602862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f02aeaa-a877-482a-8c19-cb1e60d5bf39 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:14.603130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f02aeaa-a877-482a-8c19-cb1e60d5bf39 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:14.936508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9f02aeaa-a877-482a-8c19-cb1e60d5bf39 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36e381aa5a4e4196d4e994e70f586e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659cd6db8d6741329dded06813f0ef93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:14.944209 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9f02aeaa-a877-482a-8c19-cb1e60d5bf39 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 200 len: 1316 microversion: 2.1 time: 0.355052 May 28 21:12:14.960666 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1287/2589] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:14 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 1316 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:14.962886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fd55ba3e-6f40-4b1a-83fd-cc47435f4125 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:14.963516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fd55ba3e-6f40-4b1a-83fd-cc47435f4125 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:14.972535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd55ba3e-6f40-4b1a-83fd-cc47435f4125 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:14.973271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd55ba3e-6f40-4b1a-83fd-cc47435f4125 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:14.974773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd55ba3e-6f40-4b1a-83fd-cc47435f4125 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:14.978706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd55ba3e-6f40-4b1a-83fd-cc47435f4125 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:15.377973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fd55ba3e-6f40-4b1a-83fd-cc47435f4125 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:15.387047 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fd55ba3e-6f40-4b1a-83fd-cc47435f4125 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 200 len: 1502 microversion: 2.1 time: 0.427917 May 28 21:12:15.387638 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1288/2590] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:14 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 1502 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:15.393130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b45aebfd-e371-47d9-b64d-87d7d256034d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:15.393979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b45aebfd-e371-47d9-b64d-87d7d256034d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:15.400853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b45aebfd-e371-47d9-b64d-87d7d256034d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:15.401856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b45aebfd-e371-47d9-b64d-87d7d256034d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:15.402986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b45aebfd-e371-47d9-b64d-87d7d256034d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:15.403644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b45aebfd-e371-47d9-b64d-87d7d256034d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:15.928030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b45aebfd-e371-47d9-b64d-87d7d256034d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8ac48fe53b4080bf74c9788408f8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e073d4d15a243eca3ea41985b8150b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:15.936616 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b45aebfd-e371-47d9-b64d-87d7d256034d tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 200 len: 1312 microversion: 2.1 time: 0.547481 May 28 21:12:15.937418 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1289/2591] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:15 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 1312 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:15.942317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-990f321a-fa9d-4479-a4ec-c34398881715 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:15.943055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-990f321a-fa9d-4479-a4ec-c34398881715 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:15.949690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-990f321a-fa9d-4479-a4ec-c34398881715 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:15.950247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-990f321a-fa9d-4479-a4ec-c34398881715 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:15.951090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-990f321a-fa9d-4479-a4ec-c34398881715 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:15.951603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-990f321a-fa9d-4479-a4ec-c34398881715 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:16.159595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-990f321a-fa9d-4479-a4ec-c34398881715 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd86b6dd9894aac971943b2fa859bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8047aaa6e1f7401fbcf4b4cd5dcd004e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:16.176717 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-990f321a-fa9d-4479-a4ec-c34398881715 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9" status: 200 len: 1315 microversion: 2.1 time: 0.237944 May 28 21:12:16.177378 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1290/2592] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:15 2022] GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:16.182053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ff1e93c8-8ea0-49c1-9e10-78353fbc68a9 req-092b01b2-c962-4afa-b177-c9abdf495b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af7be2b-2058-490c-b258-2103bacdb44f", "name": "network-vif-plugged", "status": "completed", "tag": "80b2c42c-6208-42e7-8bba-7fc8e7727506"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:16.190540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ff1e93c8-8ea0-49c1-9e10-78353fbc68a9 req-092b01b2-c962-4afa-b177-c9abdf495b06 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:16.191072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ff1e93c8-8ea0-49c1-9e10-78353fbc68a9 req-092b01b2-c962-4afa-b177-c9abdf495b06 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:16.203112 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ff1e93c8-8ea0-49c1-9e10-78353fbc68a9 req-092b01b2-c962-4afa-b177-c9abdf495b06 service nova] Creating event network-vif-plugged:80b2c42c-6208-42e7-8bba-7fc8e7727506 for instance 0af7be2b-2058-490c-b258-2103bacdb44f on nch2-master-1 May 28 21:12:16.209380 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ff1e93c8-8ea0-49c1-9e10-78353fbc68a9 req-092b01b2-c962-4afa-b177-c9abdf495b06 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030808 May 28 21:12:16.211706 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1291/2593] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:16.217193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-67cf6c9a-edab-4f08-a49e-1dda45cf81a1 req-7d021c69-1a8b-41b7-a321-d440c38640b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5940795e-f9e1-4337-9ca6-72ade7d53426", "tag": "2a5cab06-5081-4886-be72-7b50c3954f50"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:16.240577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-67cf6c9a-edab-4f08-a49e-1dda45cf81a1 req-7d021c69-1a8b-41b7-a321-d440c38640b9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:16.241030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-67cf6c9a-edab-4f08-a49e-1dda45cf81a1 req-7d021c69-1a8b-41b7-a321-d440c38640b9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:16.254882 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-67cf6c9a-edab-4f08-a49e-1dda45cf81a1 req-7d021c69-1a8b-41b7-a321-d440c38640b9 service nova] Creating event network-changed:2a5cab06-5081-4886-be72-7b50c3954f50 for instance 5940795e-f9e1-4337-9ca6-72ade7d53426 on nch1-master-1 May 28 21:12:16.259774 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-67cf6c9a-edab-4f08-a49e-1dda45cf81a1 req-7d021c69-1a8b-41b7-a321-d440c38640b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046442 May 28 21:12:16.260689 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1292/2594] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:16.265905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-72124e2a-2559-4326-8deb-2372d619c340 req-fe15e18a-e447-4a8f-9f44-302b8857dd60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9", "tag": "25393872-7541-4fa7-a96e-46ce44c1dd0b"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:16.274443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-72124e2a-2559-4326-8deb-2372d619c340 req-fe15e18a-e447-4a8f-9f44-302b8857dd60 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:16.275213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-72124e2a-2559-4326-8deb-2372d619c340 req-fe15e18a-e447-4a8f-9f44-302b8857dd60 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:16.290558 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-72124e2a-2559-4326-8deb-2372d619c340 req-fe15e18a-e447-4a8f-9f44-302b8857dd60 service nova] Creating event network-changed:25393872-7541-4fa7-a96e-46ce44c1dd0b for instance 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 on nch1-master-1 May 28 21:12:16.295628 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-72124e2a-2559-4326-8deb-2372d619c340 req-fe15e18a-e447-4a8f-9f44-302b8857dd60 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033461 May 28 21:12:16.296556 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1293/2595] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:16.311715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1424fcd9-745b-4f3f-9587-08208a89a75a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:16.312375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1424fcd9-745b-4f3f-9587-08208a89a75a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:16.320134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:16.320728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1424fcd9-745b-4f3f-9587-08208a89a75a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:16.321199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1424fcd9-745b-4f3f-9587-08208a89a75a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:16.322022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1424fcd9-745b-4f3f-9587-08208a89a75a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:16.323142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1424fcd9-745b-4f3f-9587-08208a89a75a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:16.758494 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1424fcd9-745b-4f3f-9587-08208a89a75a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "POST /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365/action" status: 202 len: 0 microversion: 2.1 time: 0.460433 May 28 21:12:16.759842 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1294/2596] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:12:16 2022] POST /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:12:16.768473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dccf083f-a1f3-4607-8ef2-dee61c387098 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:16.771680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dccf083f-a1f3-4607-8ef2-dee61c387098 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:16.780039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dccf083f-a1f3-4607-8ef2-dee61c387098 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:16.780761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dccf083f-a1f3-4607-8ef2-dee61c387098 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:16.781991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dccf083f-a1f3-4607-8ef2-dee61c387098 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:16.782641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dccf083f-a1f3-4607-8ef2-dee61c387098 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:17.092916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dccf083f-a1f3-4607-8ef2-dee61c387098 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:17.099752 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dccf083f-a1f3-4607-8ef2-dee61c387098 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1318 microversion: 2.1 time: 0.335188 May 28 21:12:17.100169 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1295/2597] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:16 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:17.114877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b0c83916-b554-4a2f-a8d3-66b36d8a7bf7 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:17.115506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b0c83916-b554-4a2f-a8d3-66b36d8a7bf7 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:17.122033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0c83916-b554-4a2f-a8d3-66b36d8a7bf7 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:17.122495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0c83916-b554-4a2f-a8d3-66b36d8a7bf7 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:17.123284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0c83916-b554-4a2f-a8d3-66b36d8a7bf7 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:17.124130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0c83916-b554-4a2f-a8d3-66b36d8a7bf7 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:17.368460 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.network.neutron [None req-cae30afc-516f-4373-bc75-91a8ad151557 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] re-assign floating IP 172.35.3.52 from instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 May 28 21:12:17.382077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b0c83916-b554-4a2f-a8d3-66b36d8a7bf7 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36e381aa5a4e4196d4e994e70f586e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659cd6db8d6741329dded06813f0ef93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:17.390830 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b0c83916-b554-4a2f-a8d3-66b36d8a7bf7 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 200 len: 1316 microversion: 2.1 time: 0.280055 May 28 21:12:17.402104 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1296/2598] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:17 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 1316 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:17.407354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1985f22d-3b4b-422b-99b2-0cdd7b530f42 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:17.408034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1985f22d-3b4b-422b-99b2-0cdd7b530f42 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:17.415328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1985f22d-3b4b-422b-99b2-0cdd7b530f42 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:17.418417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1985f22d-3b4b-422b-99b2-0cdd7b530f42 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:17.418417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1985f22d-3b4b-422b-99b2-0cdd7b530f42 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:17.418417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1985f22d-3b4b-422b-99b2-0cdd7b530f42 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:17.424176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-cae30afc-516f-4373-bc75-91a8ad151557 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Building network info cache for instance {{(pid=143128) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 21:12:17.642348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1985f22d-3b4b-422b-99b2-0cdd7b530f42 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:17.658329 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1985f22d-3b4b-422b-99b2-0cdd7b530f42 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 200 len: 1507 microversion: 2.1 time: 0.254533 May 28 21:12:17.661928 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1297/2599] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:17 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 1507 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:17.667425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-808220ac-92fe-43b8-8585-93d47b66aa08 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:17.668217 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-808220ac-92fe-43b8-8585-93d47b66aa08 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:17.676151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-808220ac-92fe-43b8-8585-93d47b66aa08 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:17.678348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-808220ac-92fe-43b8-8585-93d47b66aa08 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:17.678348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-808220ac-92fe-43b8-8585-93d47b66aa08 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:17.679250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-808220ac-92fe-43b8-8585-93d47b66aa08 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:17.881228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-808220ac-92fe-43b8-8585-93d47b66aa08 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8ac48fe53b4080bf74c9788408f8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e073d4d15a243eca3ea41985b8150b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:17.890471 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-808220ac-92fe-43b8-8585-93d47b66aa08 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 200 len: 1312 microversion: 2.1 time: 0.227018 May 28 21:12:17.894246 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1298/2600] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:17 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:17.907292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ce749810-2fc7-4a4b-b581-4491352336e0 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:17.908006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ce749810-2fc7-4a4b-b581-4491352336e0 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:17.923494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce749810-2fc7-4a4b-b581-4491352336e0 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:17.923849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce749810-2fc7-4a4b-b581-4491352336e0 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:17.930044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce749810-2fc7-4a4b-b581-4491352336e0 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:17.930044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce749810-2fc7-4a4b-b581-4491352336e0 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:18.129257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ce749810-2fc7-4a4b-b581-4491352336e0 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd86b6dd9894aac971943b2fa859bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8047aaa6e1f7401fbcf4b4cd5dcd004e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:18.141193 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ce749810-2fc7-4a4b-b581-4491352336e0 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9" status: 200 len: 1315 microversion: 2.1 time: 0.245238 May 28 21:12:18.142210 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1299/2601] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:17 2022] GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:18.147527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ad15d3a0-bf61-4984-b523-88e419f49862 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:18.148165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ad15d3a0-bf61-4984-b523-88e419f49862 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:18.153810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-cae30afc-516f-4373-bc75-91a8ad151557 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Updating instance_info_cache with network_info: [{"id": "825989f5-1b0d-4731-92b8-dabd0a2be976", "address": "fa:16:3e:76:3b:1f", "network": {"id": "c1dde440-05b5-4215-bf14-fa46ddc2096b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1102943986-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9d08be7a2d1e4b779987d75d87a5ef44", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap825989f5-1b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=143128) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 21:12:18.155608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad15d3a0-bf61-4984-b523-88e419f49862 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:18.156076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad15d3a0-bf61-4984-b523-88e419f49862 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:18.156854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad15d3a0-bf61-4984-b523-88e419f49862 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:18.157301 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad15d3a0-bf61-4984-b523-88e419f49862 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:18.234495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-cae30afc-516f-4373-bc75-91a8ad151557 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Building network info cache for instance {{(pid=143128) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 21:12:18.396025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ad15d3a0-bf61-4984-b523-88e419f49862 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:18.408769 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ad15d3a0-bf61-4984-b523-88e419f49862 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1508 microversion: 2.1 time: 0.265404 May 28 21:12:18.412600 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1300/2602] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:18 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1508 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:18.430946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-0c3b82f9-c74b-4fa0-a887-5eb33fefe99f req-f80ccc74-9942-4360-995f-d2e5f3169004 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb986652-a1db-48a0-89cc-5f3479f029e3", "name": "network-vif-plugged", "status": "completed", "tag": "2e867dc7-af5e-4cd6-be5f-2c31650317b4"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:18.444842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0c3b82f9-c74b-4fa0-a887-5eb33fefe99f req-f80ccc74-9942-4360-995f-d2e5f3169004 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:18.445477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0c3b82f9-c74b-4fa0-a887-5eb33fefe99f req-f80ccc74-9942-4360-995f-d2e5f3169004 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:18.459313 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-0c3b82f9-c74b-4fa0-a887-5eb33fefe99f req-f80ccc74-9942-4360-995f-d2e5f3169004 service nova] Creating event network-vif-plugged:2e867dc7-af5e-4cd6-be5f-2c31650317b4 for instance cb986652-a1db-48a0-89cc-5f3479f029e3 on nch1-master-1 May 28 21:12:18.465394 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-0c3b82f9-c74b-4fa0-a887-5eb33fefe99f req-f80ccc74-9942-4360-995f-d2e5f3169004 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051378 May 28 21:12:18.466574 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1301/2603] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:18.483910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ed7e6b5f-24c3-4931-a8c8-cc932e3bcce2 req-fadc8a9a-fe43-42fa-9498-cf8728fedf96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a4cf15-02b5-42d1-ae2f-849ca1ec8d35", "tag": "825989f5-1b0d-4731-92b8-dabd0a2be976"}, {"name": "network-changed", "server_uuid": "00573ede-054c-45fe-90f8-b1ef7725596e", "tag": "e1731f50-e120-4158-be35-70b39f01d5b7"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:18.495004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ed7e6b5f-24c3-4931-a8c8-cc932e3bcce2 req-fadc8a9a-fe43-42fa-9498-cf8728fedf96 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:18.497730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ed7e6b5f-24c3-4931-a8c8-cc932e3bcce2 req-fadc8a9a-fe43-42fa-9498-cf8728fedf96 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:18.529443 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ed7e6b5f-24c3-4931-a8c8-cc932e3bcce2 req-fadc8a9a-fe43-42fa-9498-cf8728fedf96 service nova] Creating event network-changed:825989f5-1b0d-4731-92b8-dabd0a2be976 for instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 on nch2-master-1 May 28 21:12:18.530193 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ed7e6b5f-24c3-4931-a8c8-cc932e3bcce2 req-fadc8a9a-fe43-42fa-9498-cf8728fedf96 service nova] Creating event network-changed:e1731f50-e120-4158-be35-70b39f01d5b7 for instance 00573ede-054c-45fe-90f8-b1ef7725596e on nch1-master-1 May 28 21:12:18.541808 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ed7e6b5f-24c3-4931-a8c8-cc932e3bcce2 req-fadc8a9a-fe43-42fa-9498-cf8728fedf96 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.073679 May 28 21:12:18.542750 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1302/2604] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:18.545019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=12 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:18.567425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d29700a9-2788-4ce1-afe9-1dd30b9e1b46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:18.568149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d29700a9-2788-4ce1-afe9-1dd30b9e1b46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:18.577606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d29700a9-2788-4ce1-afe9-1dd30b9e1b46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:18.578153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d29700a9-2788-4ce1-afe9-1dd30b9e1b46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:18.580012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d29700a9-2788-4ce1-afe9-1dd30b9e1b46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:18.581987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d29700a9-2788-4ce1-afe9-1dd30b9e1b46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:18.589497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=66 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:18.835918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d29700a9-2788-4ce1-afe9-1dd30b9e1b46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36e381aa5a4e4196d4e994e70f586e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659cd6db8d6741329dded06813f0ef93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:18.848750 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d29700a9-2788-4ce1-afe9-1dd30b9e1b46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 200 len: 1316 microversion: 2.1 time: 0.304371 May 28 21:12:18.849578 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1303/2605] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:18 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:18.854764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d43828dc-5843-4e46-adca-618bafd90f66 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:18.855613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d43828dc-5843-4e46-adca-618bafd90f66 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:18.863012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d43828dc-5843-4e46-adca-618bafd90f66 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:18.863720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d43828dc-5843-4e46-adca-618bafd90f66 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:18.864512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d43828dc-5843-4e46-adca-618bafd90f66 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:18.865143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d43828dc-5843-4e46-adca-618bafd90f66 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:19.112578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d43828dc-5843-4e46-adca-618bafd90f66 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:19.126000 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d43828dc-5843-4e46-adca-618bafd90f66 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1508 microversion: 2.1 time: 0.274574 May 28 21:12:19.128404 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1304/2606] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:18 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:19.133855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-07de54fa-0339-40b4-87da-f29f4ca6de74 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:19.134720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-07de54fa-0339-40b4-87da-f29f4ca6de74 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:19.152461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07de54fa-0339-40b4-87da-f29f4ca6de74 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:19.153167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07de54fa-0339-40b4-87da-f29f4ca6de74 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:19.154151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07de54fa-0339-40b4-87da-f29f4ca6de74 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:19.160687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07de54fa-0339-40b4-87da-f29f4ca6de74 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:19.167356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-cae30afc-516f-4373-bc75-91a8ad151557 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Updating instance_info_cache with network_info: [{"id": "e1731f50-e120-4158-be35-70b39f01d5b7", "address": "fa:16:3e:c6:c7:50", "network": {"id": "c1dde440-05b5-4215-bf14-fa46ddc2096b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1102943986-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9d08be7a2d1e4b779987d75d87a5ef44", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape1731f50-e1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=143128) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 21:12:19.246879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cae30afc-516f-4373-bc75-91a8ad151557 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Releasing lock "refresh_cache-00573ede-054c-45fe-90f8-b1ef7725596e" {{(pid=143128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 21:12:19.247778 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cae30afc-516f-4373-bc75-91a8ad151557 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "POST /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e/action" status: 202 len: 0 microversion: 2.1 time: 5.184401 May 28 21:12:19.248745 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1303/2607] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:12:14 2022] POST /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e/action => generated 0 bytes in 5188 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 21:12:19.255518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-88fb5abd-d375-457d-bead-839b8fa47c7e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:19.255518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-88fb5abd-d375-457d-bead-839b8fa47c7e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:19.266846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88fb5abd-d375-457d-bead-839b8fa47c7e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:19.267302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88fb5abd-d375-457d-bead-839b8fa47c7e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:19.268078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88fb5abd-d375-457d-bead-839b8fa47c7e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:19.268516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88fb5abd-d375-457d-bead-839b8fa47c7e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:19.347947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-07de54fa-0339-40b4-87da-f29f4ca6de74 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:19.352547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:19.358239 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-07de54fa-0339-40b4-87da-f29f4ca6de74 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 200 len: 1487 microversion: 2.1 time: 0.229469 May 28 21:12:19.371602 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1305/2608] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:19 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 1487 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:19.371602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "OS-DCF:diskConfig": "AUTO"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:19.371602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:19.373964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:19.374462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:19.375398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:19.375859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:19.439403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-88fb5abd-d375-457d-bead-839b8fa47c7e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8ac48fe53b4080bf74c9788408f8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e073d4d15a243eca3ea41985b8150b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:19.450777 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-88fb5abd-d375-457d-bead-839b8fa47c7e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 200 len: 1312 microversion: 2.1 time: 0.200607 May 28 21:12:19.451581 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1304/2609] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:19 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 1312 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:19.457541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bb6e81bc-acab-4505-b5ba-535423e4225b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:19.458410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:12:19.458863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:12:19.459389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:12:19.459968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:12:19.460169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:12:19.460509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bb6e81bc-acab-4505-b5ba-535423e4225b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:19.466912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb6e81bc-acab-4505-b5ba-535423e4225b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:19.471762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb6e81bc-acab-4505-b5ba-535423e4225b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:19.471762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb6e81bc-acab-4505-b5ba-535423e4225b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:19.471762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb6e81bc-acab-4505-b5ba-535423e4225b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:19.606057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bb6e81bc-acab-4505-b5ba-535423e4225b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd86b6dd9894aac971943b2fa859bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8047aaa6e1f7401fbcf4b4cd5dcd004e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:19.614181 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bb6e81bc-acab-4505-b5ba-535423e4225b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9" status: 200 len: 1315 microversion: 2.1 time: 0.160955 May 28 21:12:19.614759 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1305/2610] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:19 2022] GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:19.619886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3a31023e-21c4-4db4-8f47-217e1d937e48 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.52"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:19.742154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3a31023e-21c4-4db4-8f47-217e1d937e48 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:19.745192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:19.749016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a31023e-21c4-4db4-8f47-217e1d937e48 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:19.749468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a31023e-21c4-4db4-8f47-217e1d937e48 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:19.750300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a31023e-21c4-4db4-8f47-217e1d937e48 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:19.750924 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a31023e-21c4-4db4-8f47-217e1d937e48 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:19.769290 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:19.791268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:19.791268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:19.798432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:19.799114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:19.853754 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7b5f4dfb-6309-46e5-8c2a-a6fdfb69e389 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "POST /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f/action" status: 202 len: 1110 microversion: 2.1 time: 0.492540 May 28 21:12:19.855035 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1306/2611] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:12:19 2022] POST /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f/action => generated 1110 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 28 21:12:19.861129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9f0d800d-2076-474e-92b9-3a179de9171b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:19.861831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9f0d800d-2076-474e-92b9-3a179de9171b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:19.869109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f0d800d-2076-474e-92b9-3a179de9171b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:19.870192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f0d800d-2076-474e-92b9-3a179de9171b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:19.871793 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f0d800d-2076-474e-92b9-3a179de9171b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:19.872432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f0d800d-2076-474e-92b9-3a179de9171b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:19.909153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9f0d800d-2076-474e-92b9-3a179de9171b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:12:20.132914 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-3a31023e-21c4-4db4-8f47-217e1d937e48 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] HTTP exception thrown: Floating IP 172.35.3.52 is not associated with instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35. May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3a31023e-21c4-4db4-8f47-217e1d937e48 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Request method failure captured: May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35/action HTTP/1.1 May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 48 May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_5hNM14SyxGy7pIAZpEILymcxSG05alvy6v_YG3Mq-2gRi8bBiJB7-zN4dhukVG5VT5nHinUhZDy6KVP_9T3Ei64UuVP5vDBsmGKeQoe0oLBUKwXo4BOle8dmU_eNql98NHdDQhjYbAd8fhs-VXsJjcp1ynznAlV2611L-oTN6srw May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 9d08be7a2d1e4b779987d75d87a5ef44 May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-875612888 May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d08be7a2d1e4b779987d75d87a5ef44", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d08be7a2d1e4b779987d75d87a5ef44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d08be7a2d1e4b779987d75d87a5ef44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d08be7a2d1e4b779987d75d87a5ef44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-875612888 May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 9d08be7a2d1e4b779987d75d87a5ef44 May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-875612888 May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-FloatingIPsAssociationTestJSON-875612888-project May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 04ae3115a9194b47bce62ada4a2afdf2 May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-875612888-project May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: {"removeFloatingIp": {"address": "172.35.3.52"}} May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: exception: Floating IP 172.35.3.52 is not associated with instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35. May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '50a4cf15-02b5-42d1-ae2f-849ca1ec8d35', 'body': {'removeFloatingIp': {'address': '172.35.3.52'}}} May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.3.52 is not associated with instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35. May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.3.52 is not associated with instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35. May 28 21:12:20.138382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:20.142589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3a31023e-21c4-4db4-8f47-217e1d937e48 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Returning 409 to user: Floating IP 172.35.3.52 is not associated with instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:20.142876 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3a31023e-21c4-4db4-8f47-217e1d937e48 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "POST /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35/action" status: 409 len: 145 microversion: 2.1 time: 0.526092 May 28 21:12:20.146803 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1306/2612] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:12:19 2022] POST /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35/action => generated 145 bytes in 528 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:12:20.156555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8e8c4453-0dea-4f72-b457-4298e30c7f28 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:20.158359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8e8c4453-0dea-4f72-b457-4298e30c7f28 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:20.167963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e8c4453-0dea-4f72-b457-4298e30c7f28 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:20.168641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e8c4453-0dea-4f72-b457-4298e30c7f28 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:20.169495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e8c4453-0dea-4f72-b457-4298e30c7f28 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:20.170009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e8c4453-0dea-4f72-b457-4298e30c7f28 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:20.320472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:20.360907 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9f0d800d-2076-474e-92b9-3a179de9171b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 204 len: 0 microversion: 2.1 time: 0.504370 May 28 21:12:20.361789 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1307/2613] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:12:19 2022] DELETE /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:12:20.371566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4fe59945-2054-446b-a29f-c185d1750df6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:20.372111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4fe59945-2054-446b-a29f-c185d1750df6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:20.390109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fe59945-2054-446b-a29f-c185d1750df6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:20.390572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fe59945-2054-446b-a29f-c185d1750df6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:20.391496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fe59945-2054-446b-a29f-c185d1750df6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:20.392755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fe59945-2054-446b-a29f-c185d1750df6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:20.426281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8e8c4453-0dea-4f72-b457-4298e30c7f28 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36e381aa5a4e4196d4e994e70f586e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659cd6db8d6741329dded06813f0ef93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:20.445805 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8e8c4453-0dea-4f72-b457-4298e30c7f28 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 200 len: 1316 microversion: 2.1 time: 0.301077 May 28 21:12:20.461820 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1307/2614] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:20 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:20.461820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a133cd3f-2d82-42ea-8974-215b22bd2fb5 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.52"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:20.615587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4fe59945-2054-446b-a29f-c185d1750df6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:20.623665 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4fe59945-2054-446b-a29f-c185d1750df6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.257114 May 28 21:12:20.633888 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1308/2615] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:20 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:20.641267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-23233f63-2555-49d2-9ace-8665b9b8daf8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:20.641987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-23233f63-2555-49d2-9ace-8665b9b8daf8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:20.649375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23233f63-2555-49d2-9ace-8665b9b8daf8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:20.649375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23233f63-2555-49d2-9ace-8665b9b8daf8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:20.649623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23233f63-2555-49d2-9ace-8665b9b8daf8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:20.650020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23233f63-2555-49d2-9ace-8665b9b8daf8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:20.696957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a133cd3f-2d82-42ea-8974-215b22bd2fb5 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:20.703915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a133cd3f-2d82-42ea-8974-215b22bd2fb5 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:20.704373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a133cd3f-2d82-42ea-8974-215b22bd2fb5 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:20.705147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a133cd3f-2d82-42ea-8974-215b22bd2fb5 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:20.705591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a133cd3f-2d82-42ea-8974-215b22bd2fb5 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:20.855094 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-23233f63-2555-49d2-9ace-8665b9b8daf8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:20.863753 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-23233f63-2555-49d2-9ace-8665b9b8daf8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 200 len: 1493 microversion: 2.1 time: 0.228677 May 28 21:12:20.864872 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1309/2616] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:20 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 1493 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:20.870792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d74547fa-520c-4b63-8107-7a6742542ee4 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:20.871409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d74547fa-520c-4b63-8107-7a6742542ee4 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:20.878930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d74547fa-520c-4b63-8107-7a6742542ee4 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:20.879641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d74547fa-520c-4b63-8107-7a6742542ee4 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:20.880415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d74547fa-520c-4b63-8107-7a6742542ee4 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:20.880855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d74547fa-520c-4b63-8107-7a6742542ee4 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:21.332968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a133cd3f-2d82-42ea-8974-215b22bd2fb5 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Acquired lock "refresh_cache-00573ede-054c-45fe-90f8-b1ef7725596e" {{(pid=143128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 21:12:21.368695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d74547fa-520c-4b63-8107-7a6742542ee4 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8ac48fe53b4080bf74c9788408f8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e073d4d15a243eca3ea41985b8150b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:21.377234 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d74547fa-520c-4b63-8107-7a6742542ee4 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 200 len: 1498 microversion: 2.1 time: 0.511092 May 28 21:12:21.388716 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1310/2617] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:20 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 1498 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:21.394857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d820e02d-2fd5-430b-8637-eee121499c14 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:21.395643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d820e02d-2fd5-430b-8637-eee121499c14 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:21.397725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:21.403683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d820e02d-2fd5-430b-8637-eee121499c14 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:21.404384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d820e02d-2fd5-430b-8637-eee121499c14 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:21.413512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d820e02d-2fd5-430b-8637-eee121499c14 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:21.413512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d820e02d-2fd5-430b-8637-eee121499c14 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:21.677587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d820e02d-2fd5-430b-8637-eee121499c14 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd86b6dd9894aac971943b2fa859bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8047aaa6e1f7401fbcf4b4cd5dcd004e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:21.686729 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d820e02d-2fd5-430b-8637-eee121499c14 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9" status: 200 len: 1315 microversion: 2.1 time: 0.307311 May 28 21:12:21.696800 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1311/2618] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:21 2022] GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:21.696800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0123d75c-3fb4-494b-bf51-759492ec2fc5 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:21.720470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.compute.server_groups [None req-0123d75c-3fb4-494b-bf51-759492ec2fc5 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Querying cell fc53a60a-e345-4363-abb1-87c4d33bcbf6(cell1) for 1 instances {{(pid=143129) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 28 21:12:21.722049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0123d75c-3fb4-494b-bf51-759492ec2fc5 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:21.723212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0123d75c-3fb4-494b-bf51-759492ec2fc5 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:21.750661 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0123d75c-3fb4-494b-bf51-759492ec2fc5 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/07618ba6-bbcc-450f-9a45-c977278c2741" status: 200 len: 221 microversion: 2.1 time: 0.062262 May 28 21:12:21.751256 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1312/2619] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:12:21 2022] GET /compute/v2.1/os-server-groups/07618ba6-bbcc-450f-9a45-c977278c2741 => generated 221 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:21.756208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ae760dc8-391a-4617-9300-06304969ecfc tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:21.756820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ae760dc8-391a-4617-9300-06304969ecfc tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:21.764262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae760dc8-391a-4617-9300-06304969ecfc tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:21.764720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae760dc8-391a-4617-9300-06304969ecfc tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:21.765506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae760dc8-391a-4617-9300-06304969ecfc tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:21.765974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae760dc8-391a-4617-9300-06304969ecfc tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:21.991892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ae760dc8-391a-4617-9300-06304969ecfc tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36e381aa5a4e4196d4e994e70f586e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659cd6db8d6741329dded06813f0ef93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:22.000588 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ae760dc8-391a-4617-9300-06304969ecfc tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 200 len: 1316 microversion: 2.1 time: 0.248304 May 28 21:12:22.001177 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1313/2620] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:21 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:22.006672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-10258638-b2cc-4255-88d8-06bcbe128bb0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:22.007533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-10258638-b2cc-4255-88d8-06bcbe128bb0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:22.015308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10258638-b2cc-4255-88d8-06bcbe128bb0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:22.020546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10258638-b2cc-4255-88d8-06bcbe128bb0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:22.020546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10258638-b2cc-4255-88d8-06bcbe128bb0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:22.020546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10258638-b2cc-4255-88d8-06bcbe128bb0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:22.265920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-10258638-b2cc-4255-88d8-06bcbe128bb0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:22.277870 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-10258638-b2cc-4255-88d8-06bcbe128bb0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.275135 May 28 21:12:22.278820 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1314/2621] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:22 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:22.286414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7bd55d6e-c732-41ba-8fe1-6b59b424b321 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:22.286986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7bd55d6e-c732-41ba-8fe1-6b59b424b321 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:22.293976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bd55d6e-c732-41ba-8fe1-6b59b424b321 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:22.294444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bd55d6e-c732-41ba-8fe1-6b59b424b321 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:22.295283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bd55d6e-c732-41ba-8fe1-6b59b424b321 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:22.295732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bd55d6e-c732-41ba-8fe1-6b59b424b321 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:22.336652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7bd55d6e-c732-41ba-8fe1-6b59b424b321 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:12:22.369138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-a133cd3f-2d82-42ea-8974-215b22bd2fb5 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Building network info cache for instance {{(pid=143128) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 21:12:22.778955 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7bd55d6e-c732-41ba-8fe1-6b59b424b321 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 204 len: 0 microversion: 2.1 time: 0.498973 May 28 21:12:22.779864 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1315/2622] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:12:22 2022] DELETE /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:12:22.785930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f4ae2cdf-ed2e-426b-8c79-39490ece74d0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:22.786824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f4ae2cdf-ed2e-426b-8c79-39490ece74d0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:22.846681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4ae2cdf-ed2e-426b-8c79-39490ece74d0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:22.847442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4ae2cdf-ed2e-426b-8c79-39490ece74d0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:22.848141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4ae2cdf-ed2e-426b-8c79-39490ece74d0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:22.848602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4ae2cdf-ed2e-426b-8c79-39490ece74d0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:23.011239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f4ae2cdf-ed2e-426b-8c79-39490ece74d0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:23.024648 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f4ae2cdf-ed2e-426b-8c79-39490ece74d0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 200 len: 1285 microversion: 2.1 time: 0.242321 May 28 21:12:23.034956 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1316/2623] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:22 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 1285 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:23.041241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ff976415-2951-41f7-aa27-bdc20a7b53c7 req-a46aed3e-f5d3-4318-8c2f-a8ffe6d74270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00573ede-054c-45fe-90f8-b1ef7725596e", "tag": "e1731f50-e120-4158-be35-70b39f01d5b7"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:23.068749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ff976415-2951-41f7-aa27-bdc20a7b53c7 req-a46aed3e-f5d3-4318-8c2f-a8ffe6d74270 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:23.068749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ff976415-2951-41f7-aa27-bdc20a7b53c7 req-a46aed3e-f5d3-4318-8c2f-a8ffe6d74270 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:23.098545 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ff976415-2951-41f7-aa27-bdc20a7b53c7 req-a46aed3e-f5d3-4318-8c2f-a8ffe6d74270 service nova] Creating event network-changed:e1731f50-e120-4158-be35-70b39f01d5b7 for instance 00573ede-054c-45fe-90f8-b1ef7725596e on nch1-master-1 May 28 21:12:23.110188 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ff976415-2951-41f7-aa27-bdc20a7b53c7 req-a46aed3e-f5d3-4318-8c2f-a8ffe6d74270 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079650 May 28 21:12:23.111593 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1317/2624] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:23.120840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-0466ac2f-e2b5-4e5d-b9e4-69e460d4fbed req-7c245660-4f02-4c48-b496-c5eadda1f284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea458195-fcf6-455c-873e-de1f07779365", "name": "network-vif-deleted", "tag": "c3d5ae0d-0d35-410e-94e1-8491e9231b77"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:23.157114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0466ac2f-e2b5-4e5d-b9e4-69e460d4fbed req-7c245660-4f02-4c48-b496-c5eadda1f284 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:23.160725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0466ac2f-e2b5-4e5d-b9e4-69e460d4fbed req-7c245660-4f02-4c48-b496-c5eadda1f284 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:23.165475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:23.185584 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-0466ac2f-e2b5-4e5d-b9e4-69e460d4fbed req-7c245660-4f02-4c48-b496-c5eadda1f284 service nova] Creating event network-vif-deleted:c3d5ae0d-0d35-410e-94e1-8491e9231b77 for instance ea458195-fcf6-455c-873e-de1f07779365 on nch2-master-1 May 28 21:12:23.194847 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-0466ac2f-e2b5-4e5d-b9e4-69e460d4fbed req-7c245660-4f02-4c48-b496-c5eadda1f284 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081570 May 28 21:12:23.201209 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1318/2625] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:23.210433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b3571963-fe7e-4633-a898-f238226cc73b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:23.211365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b3571963-fe7e-4633-a898-f238226cc73b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:23.218843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3571963-fe7e-4633-a898-f238226cc73b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:23.219573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3571963-fe7e-4633-a898-f238226cc73b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:23.221149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3571963-fe7e-4633-a898-f238226cc73b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:23.221800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b3571963-fe7e-4633-a898-f238226cc73b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:23.438446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-a133cd3f-2d82-42ea-8974-215b22bd2fb5 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Updating instance_info_cache with network_info: [{"id": "e1731f50-e120-4158-be35-70b39f01d5b7", "address": "fa:16:3e:c6:c7:50", "network": {"id": "c1dde440-05b5-4215-bf14-fa46ddc2096b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1102943986-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9d08be7a2d1e4b779987d75d87a5ef44", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tape1731f50-e1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=143128) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 21:12:23.485355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b3571963-fe7e-4633-a898-f238226cc73b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd86b6dd9894aac971943b2fa859bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8047aaa6e1f7401fbcf4b4cd5dcd004e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:23.500339 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b3571963-fe7e-4633-a898-f238226cc73b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9" status: 200 len: 1315 microversion: 2.1 time: 0.296534 May 28 21:12:23.503198 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1319/2626] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:23 2022] GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:23.509169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b1c7d3c4-f68f-4cad-8384-5eb512940f55 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:23.511912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b1c7d3c4-f68f-4cad-8384-5eb512940f55 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:23.525383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1c7d3c4-f68f-4cad-8384-5eb512940f55 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:23.526356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1c7d3c4-f68f-4cad-8384-5eb512940f55 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:23.528193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1c7d3c4-f68f-4cad-8384-5eb512940f55 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:23.528862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1c7d3c4-f68f-4cad-8384-5eb512940f55 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:23.565769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a133cd3f-2d82-42ea-8974-215b22bd2fb5 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Releasing lock "refresh_cache-00573ede-054c-45fe-90f8-b1ef7725596e" {{(pid=143128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 21:12:23.568371 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a133cd3f-2d82-42ea-8974-215b22bd2fb5 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "POST /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e/action" status: 202 len: 0 microversion: 2.1 time: 3.118796 May 28 21:12:23.568371 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1308/2627] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:12:20 2022] POST /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e/action => generated 0 bytes in 3120 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 21:12:23.573977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c068c4d2-cdeb-4f7f-9368-c7b8706d951f tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:23.574604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c068c4d2-cdeb-4f7f-9368-c7b8706d951f tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:23.597168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c068c4d2-cdeb-4f7f-9368-c7b8706d951f tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:23.597672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c068c4d2-cdeb-4f7f-9368-c7b8706d951f tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:23.598746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c068c4d2-cdeb-4f7f-9368-c7b8706d951f tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:23.599197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c068c4d2-cdeb-4f7f-9368-c7b8706d951f tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:23.886262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c068c4d2-cdeb-4f7f-9368-c7b8706d951f tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36e381aa5a4e4196d4e994e70f586e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659cd6db8d6741329dded06813f0ef93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:23.890375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b1c7d3c4-f68f-4cad-8384-5eb512940f55 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8ac48fe53b4080bf74c9788408f8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e073d4d15a243eca3ea41985b8150b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:23.899411 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b1c7d3c4-f68f-4cad-8384-5eb512940f55 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 200 len: 1504 microversion: 2.1 time: 0.394892 May 28 21:12:23.900725 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1320/2628] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:23 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 1504 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:23.912700 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c068c4d2-cdeb-4f7f-9368-c7b8706d951f tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 200 len: 1316 microversion: 2.1 time: 0.343420 May 28 21:12:23.914514 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1309/2629] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:23 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 1316 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:23.923264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-0f70e9f7-b888-4252-a41e-25f7bcf3b12a req-8569c474-d708-4d31-8d7e-93aadab92038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9", "name": "network-vif-plugged", "status": "completed", "tag": "25393872-7541-4fa7-a96e-46ce44c1dd0b"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:23.927636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-01294d98-79d5-480a-bce1-4748033a9396 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:23.929112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-01294d98-79d5-480a-bce1-4748033a9396 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:23.942896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01294d98-79d5-480a-bce1-4748033a9396 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:23.944199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01294d98-79d5-480a-bce1-4748033a9396 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:23.946124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01294d98-79d5-480a-bce1-4748033a9396 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:23.946796 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01294d98-79d5-480a-bce1-4748033a9396 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:23.950966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0f70e9f7-b888-4252-a41e-25f7bcf3b12a req-8569c474-d708-4d31-8d7e-93aadab92038 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:23.951618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0f70e9f7-b888-4252-a41e-25f7bcf3b12a req-8569c474-d708-4d31-8d7e-93aadab92038 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:23.973399 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-0f70e9f7-b888-4252-a41e-25f7bcf3b12a req-8569c474-d708-4d31-8d7e-93aadab92038 service nova] Creating event network-vif-plugged:25393872-7541-4fa7-a96e-46ce44c1dd0b for instance 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 on nch1-master-1 May 28 21:12:23.979905 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-0f70e9f7-b888-4252-a41e-25f7bcf3b12a req-8569c474-d708-4d31-8d7e-93aadab92038 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062662 May 28 21:12:23.980745 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1310/2630] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:23.992307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-31c3692e-9f3e-491d-81b2-4e97d3818204 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:23.999191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-31c3692e-9f3e-491d-81b2-4e97d3818204 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:24.025058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31c3692e-9f3e-491d-81b2-4e97d3818204 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:24.030267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31c3692e-9f3e-491d-81b2-4e97d3818204 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:24.031458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31c3692e-9f3e-491d-81b2-4e97d3818204 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:24.032123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31c3692e-9f3e-491d-81b2-4e97d3818204 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:24.117725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-31c3692e-9f3e-491d-81b2-4e97d3818204 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:12:24.262872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-01294d98-79d5-480a-bce1-4748033a9396 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:24.266214 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-01294d98-79d5-480a-bce1-4748033a9396 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.363678 May 28 21:12:24.275836 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1321/2631] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:23 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:24.276916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-84caacc1-0660-4910-a7cc-fc99507f94db tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:24.278452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-84caacc1-0660-4910-a7cc-fc99507f94db tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:24.288060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84caacc1-0660-4910-a7cc-fc99507f94db tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:24.288525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84caacc1-0660-4910-a7cc-fc99507f94db tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:24.289425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84caacc1-0660-4910-a7cc-fc99507f94db tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:24.289973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84caacc1-0660-4910-a7cc-fc99507f94db tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:24.331463 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-84caacc1-0660-4910-a7cc-fc99507f94db tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-84caacc1-0660-4910-a7cc-fc99507f94db tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 HTTP/1.1 May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'ea458195-fcf6-455c-873e-de1f07779365'} May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:24.333652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:24.337477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:24.337477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:24.337477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:24.337477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:24.337477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:24.337477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. May 28 21:12:24.337477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:24.337477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-84caacc1-0660-4910-a7cc-fc99507f94db tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:24.337477 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-84caacc1-0660-4910-a7cc-fc99507f94db tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 404 len: 111 microversion: 2.1 time: 0.066036 May 28 21:12:24.337477 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1322/2632] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:24 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:24.498227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-466543461", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "4688fc3e-7c0b-4b45-bce6-c3e05e995935"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:24.554069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] validate_networks() for [('4688fc3e-7c0b-4b45-bce6-c3e05e995935', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:12:24.577969 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-31c3692e-9f3e-491d-81b2-4e97d3818204 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "DELETE /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e" status: 204 len: 0 microversion: 2.1 time: 0.595501 May 28 21:12:24.578865 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1311/2633] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:12:23 2022] DELETE /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:12:24.586037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cd67d4b3-c19f-4197-add3-1f6945102830 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:24.587091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cd67d4b3-c19f-4197-add3-1f6945102830 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:24.606366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd67d4b3-c19f-4197-add3-1f6945102830 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:24.606963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd67d4b3-c19f-4197-add3-1f6945102830 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:24.607850 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd67d4b3-c19f-4197-add3-1f6945102830 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:24.610386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd67d4b3-c19f-4197-add3-1f6945102830 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:24.850969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cd67d4b3-c19f-4197-add3-1f6945102830 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd86b6dd9894aac971943b2fa859bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8047aaa6e1f7401fbcf4b4cd5dcd004e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:24.860303 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cd67d4b3-c19f-4197-add3-1f6945102830 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9" status: 200 len: 1315 microversion: 2.1 time: 0.279988 May 28 21:12:24.871829 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1312/2634] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:24 2022] GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:24.878447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-61ee6266-c750-4c37-baea-56ad40948c68 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.52"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:24.879855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-61ee6266-c750-4c37-baea-56ad40948c68 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:24.887141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61ee6266-c750-4c37-baea-56ad40948c68 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:24.887901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61ee6266-c750-4c37-baea-56ad40948c68 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:24.888994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61ee6266-c750-4c37-baea-56ad40948c68 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:24.889686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61ee6266-c750-4c37-baea-56ad40948c68 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:24.944501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61ee6266-c750-4c37-baea-56ad40948c68 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Acquired lock "refresh_cache-50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" {{(pid=143128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 21:12:25.403219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:12:25.403721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:12:25.404131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:12:25.404606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:12:25.405170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:12:25.426739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:25.427318 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:25.428247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:25.428715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:25.463839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Getting quotas for project cf04fd760c54473f83980a385252fa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:25.474627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Getting quotas for user bf9c8f66e7d24ca9baca835e41546f22 and project cf04fd760c54473f83980a385252fa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:25.493784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:12:25.497186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:12:25.785435 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0d9da65b-6879-4313-a9cf-e47d65d24c19 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.291124 May 28 21:12:25.786332 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1323/2635] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:12:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:12:25.791341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a3138be4-e9ff-46b7-acc3-6bd28de0fd61 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:25.793288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a3138be4-e9ff-46b7-acc3-6bd28de0fd61 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:25.803244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3138be4-e9ff-46b7-acc3-6bd28de0fd61 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:25.804673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3138be4-e9ff-46b7-acc3-6bd28de0fd61 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:25.805824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3138be4-e9ff-46b7-acc3-6bd28de0fd61 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:25.806515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3138be4-e9ff-46b7-acc3-6bd28de0fd61 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:25.929575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a3138be4-e9ff-46b7-acc3-6bd28de0fd61 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce8ac48fe53b4080bf74c9788408f8c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e073d4d15a243eca3ea41985b8150b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:25.938222 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a3138be4-e9ff-46b7-acc3-6bd28de0fd61 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 200 len: 1462 microversion: 2.1 time: 0.150584 May 28 21:12:25.941374 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1324/2636] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:25 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 1462 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:25.943919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9f500dae-b2fe-4710-b9f4-a3ab93e0f7ca tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:25.944560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9f500dae-b2fe-4710-b9f4-a3ab93e0f7ca tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:25.950720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f500dae-b2fe-4710-b9f4-a3ab93e0f7ca tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:25.951176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f500dae-b2fe-4710-b9f4-a3ab93e0f7ca tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:25.951944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f500dae-b2fe-4710-b9f4-a3ab93e0f7ca tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:25.952390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f500dae-b2fe-4710-b9f4-a3ab93e0f7ca tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:26.167957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9f500dae-b2fe-4710-b9f4-a3ab93e0f7ca tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36e381aa5a4e4196d4e994e70f586e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659cd6db8d6741329dded06813f0ef93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:26.176053 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9f500dae-b2fe-4710-b9f4-a3ab93e0f7ca tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 200 len: 1316 microversion: 2.1 time: 0.235936 May 28 21:12:26.176728 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1325/2637] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:25 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:26.181555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b1dfaec6-d7cf-4949-b9f4-7c4c1bb8d4d5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:26.182272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b1dfaec6-d7cf-4949-b9f4-7c4c1bb8d4d5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:26.188777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1dfaec6-d7cf-4949-b9f4-7c4c1bb8d4d5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:26.189294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1dfaec6-d7cf-4949-b9f4-7c4c1bb8d4d5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:26.192840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1dfaec6-d7cf-4949-b9f4-7c4c1bb8d4d5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:26.192840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1dfaec6-d7cf-4949-b9f4-7c4c1bb8d4d5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:26.393527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b1dfaec6-d7cf-4949-b9f4-7c4c1bb8d4d5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:26.402019 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b1dfaec6-d7cf-4949-b9f4-7c4c1bb8d4d5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.224003 May 28 21:12:26.402609 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1326/2638] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:26 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:26.419103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-32edbb5e-9ebc-4fa1-ab1b-ed515c57f88d req-e60eeb14-38eb-4753-a1d2-c8fcefd426da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb986652-a1db-48a0-89cc-5f3479f029e3", "name": "network-vif-deleted", "tag": "2e867dc7-af5e-4cd6-be5f-2c31650317b4"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:26.436523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-32edbb5e-9ebc-4fa1-ab1b-ed515c57f88d req-e60eeb14-38eb-4753-a1d2-c8fcefd426da service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:26.438525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-32edbb5e-9ebc-4fa1-ab1b-ed515c57f88d req-e60eeb14-38eb-4753-a1d2-c8fcefd426da service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:26.457387 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-32edbb5e-9ebc-4fa1-ab1b-ed515c57f88d req-e60eeb14-38eb-4753-a1d2-c8fcefd426da service nova] Creating event network-vif-deleted:2e867dc7-af5e-4cd6-be5f-2c31650317b4 for instance cb986652-a1db-48a0-89cc-5f3479f029e3 on nch1-master-1 May 28 21:12:26.466467 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-32edbb5e-9ebc-4fa1-ab1b-ed515c57f88d req-e60eeb14-38eb-4753-a1d2-c8fcefd426da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062318 May 28 21:12:26.467727 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1327/2639] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:26.475492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-38239915-6107-469d-9180-cb1e40171c47 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Action: 'create', calling method: .version_select at 0x7f4d64251dc0>, body: {"keypair": {"name": "tempest-keypair-2065388250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECpDopjyYuUV1uUePQx9Kh13DdZ3txxb8gw1Pun33/sPMhU6HbypVTfrx5zOI4fmn3XpGCYZStFcdbKmz/M3d75K8UoEdwUApZiaU4xNld9LxRRVs3E4kzI+geGNOCmeQ=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:26.503783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-38239915-6107-469d-9180-cb1e40171c47 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Getting quotas for project 8f20390f83d3407e93a3d8d2a196281b. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:26.515135 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-38239915-6107-469d-9180-cb1e40171c47 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Getting quotas for user cafc81a185c645e893a77b7fd297d950 and project 8f20390f83d3407e93a3d8d2a196281b. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:26.672438 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-38239915-6107-469d-9180-cb1e40171c47 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.202223 May 28 21:12:26.673672 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1328/2640] 10.222.0.33 () {62 vars in 1199 bytes} [Sat May 28 21:12:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 205 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 28 21:12:26.685201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a986eae0-5aa3-4543-86a0-7b5ee53f8d34 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:26.686229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a986eae0-5aa3-4543-86a0-7b5ee53f8d34 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:26.810354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-61ee6266-c750-4c37-baea-56ad40948c68 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Building network info cache for instance {{(pid=143128) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 21:12:26.844517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a986eae0-5aa3-4543-86a0-7b5ee53f8d34 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:26.859946 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a986eae0-5aa3-4543-86a0-7b5ee53f8d34 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1214 microversion: 2.1 time: 0.183703 May 28 21:12:26.861747 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1329/2641] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:26 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1214 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:26.868200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4ee21fa6-9409-45b7-8d0a-c738b47ed20b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:26.870360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4ee21fa6-9409-45b7-8d0a-c738b47ed20b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:26.880609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ee21fa6-9409-45b7-8d0a-c738b47ed20b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:26.883876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ee21fa6-9409-45b7-8d0a-c738b47ed20b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:26.883876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ee21fa6-9409-45b7-8d0a-c738b47ed20b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:26.883876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ee21fa6-9409-45b7-8d0a-c738b47ed20b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:27.828975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4ee21fa6-9409-45b7-8d0a-c738b47ed20b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd86b6dd9894aac971943b2fa859bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8047aaa6e1f7401fbcf4b4cd5dcd004e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:27.842202 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4ee21fa6-9409-45b7-8d0a-c738b47ed20b tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9" status: 200 len: 1502 microversion: 2.1 time: 0.977931 May 28 21:12:27.842818 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1330/2642] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:26 2022] GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 => generated 1502 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:27.856801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-38bdf64f-ab40-47a4-9c99-fad39973f3ee req-d7fcc9ef-e8d3-42d4-b741-555871c7d443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5940795e-f9e1-4337-9ca6-72ade7d53426", "name": "network-vif-plugged", "status": "completed", "tag": "2a5cab06-5081-4886-be72-7b50c3954f50"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:27.878110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-38bdf64f-ab40-47a4-9c99-fad39973f3ee req-d7fcc9ef-e8d3-42d4-b741-555871c7d443 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:27.878956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-38bdf64f-ab40-47a4-9c99-fad39973f3ee req-d7fcc9ef-e8d3-42d4-b741-555871c7d443 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:27.899596 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-38bdf64f-ab40-47a4-9c99-fad39973f3ee req-d7fcc9ef-e8d3-42d4-b741-555871c7d443 service nova] Creating event network-vif-plugged:2a5cab06-5081-4886-be72-7b50c3954f50 for instance 5940795e-f9e1-4337-9ca6-72ade7d53426 on nch1-master-1 May 28 21:12:27.908016 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-38bdf64f-ab40-47a4-9c99-fad39973f3ee req-d7fcc9ef-e8d3-42d4-b741-555871c7d443 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060403 May 28 21:12:27.909193 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1331/2643] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:27.921589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-f7d1a95c-2ea0-4356-9102-239200597f8d req-1482e65a-807f-4dd2-add1-fdc58851c4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a4cf15-02b5-42d1-ae2f-849ca1ec8d35", "tag": "825989f5-1b0d-4731-92b8-dabd0a2be976"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:27.933241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f7d1a95c-2ea0-4356-9102-239200597f8d req-1482e65a-807f-4dd2-add1-fdc58851c4e9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:27.934183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f7d1a95c-2ea0-4356-9102-239200597f8d req-1482e65a-807f-4dd2-add1-fdc58851c4e9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:27.956738 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-f7d1a95c-2ea0-4356-9102-239200597f8d req-1482e65a-807f-4dd2-add1-fdc58851c4e9 service nova] Creating event network-changed:825989f5-1b0d-4731-92b8-dabd0a2be976 for instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 on nch2-master-1 May 28 21:12:27.962856 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-f7d1a95c-2ea0-4356-9102-239200597f8d req-1482e65a-807f-4dd2-add1-fdc58851c4e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051306 May 28 21:12:27.964371 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1332/2644] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:27.972176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d324880c-7a63-4333-8942-847b8d8abdcc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:27.973136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d324880c-7a63-4333-8942-847b8d8abdcc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:28.012732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d324880c-7a63-4333-8942-847b8d8abdcc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:28.014765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d324880c-7a63-4333-8942-847b8d8abdcc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:28.016449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d324880c-7a63-4333-8942-847b8d8abdcc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:28.018062 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d324880c-7a63-4333-8942-847b8d8abdcc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:28.056086 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-d324880c-7a63-4333-8942-847b8d8abdcc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] HTTP exception thrown: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d324880c-7a63-4333-8942-847b8d8abdcc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Request method failure captured: May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 HTTP/1.1 May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAc_FQFCE1TM_5U7DfRIq71eexfxW_cLqp_H5Zt4Ny_VkWobEusNxf6U65KFoXAIWvze7bpbocQSU5Z453cg5TOikOT8SlDhkBG8vtGnwjoDQYXnVVLfYVDBuxKMA74G2ZCA5tGZxdWDVlB1EatcxxJMB_l4evS6qUV2ilKxOsb-jk May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2e073d4d15a243eca3ea41985b8150b0 May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerGroupTestJSON-518149138 May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e073d4d15a243eca3ea41985b8150b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerGroupTestJSON-518149138 May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2e073d4d15a243eca3ea41985b8150b0 May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerGroupTestJSON-518149138 May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerGroupTestJSON-518149138-project May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ce8ac48fe53b4080bf74c9788408f8c5 May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerGroupTestJSON-518149138-project May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'cb986652-a1db-48a0-89cc-5f3479f029e3'} May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:28.065338 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:28.069704 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:28.069704 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:28.069704 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:28.069704 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:28.069704 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:28.069704 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. May 28 21:12:28.069704 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:28.071894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d324880c-7a63-4333-8942-847b8d8abdcc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Returning 404 to user: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:28.073501 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d324880c-7a63-4333-8942-847b8d8abdcc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 404 len: 111 microversion: 2.1 time: 0.107037 May 28 21:12:28.079163 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1333/2645] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:27 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:28.084958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-837d3ffe-cdf9-47d1-903e-c1e5735d5a24 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:28.085781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-837d3ffe-cdf9-47d1-903e-c1e5735d5a24 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:28.092823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-837d3ffe-cdf9-47d1-903e-c1e5735d5a24 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:28.094246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-837d3ffe-cdf9-47d1-903e-c1e5735d5a24 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:28.095308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-837d3ffe-cdf9-47d1-903e-c1e5735d5a24 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:28.096734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-837d3ffe-cdf9-47d1-903e-c1e5735d5a24 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:28.312443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-837d3ffe-cdf9-47d1-903e-c1e5735d5a24 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36e381aa5a4e4196d4e994e70f586e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659cd6db8d6741329dded06813f0ef93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:28.321163 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-837d3ffe-cdf9-47d1-903e-c1e5735d5a24 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 200 len: 1316 microversion: 2.1 time: 0.240616 May 28 21:12:28.321738 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1334/2646] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:28 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:28.328256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5f0b1477-c23a-4ec9-a151-9d146c48440d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:28.336849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5f0b1477-c23a-4ec9-a151-9d146c48440d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:28.336849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f0b1477-c23a-4ec9-a151-9d146c48440d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:28.336849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f0b1477-c23a-4ec9-a151-9d146c48440d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:28.336849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f0b1477-c23a-4ec9-a151-9d146c48440d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:28.336849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f0b1477-c23a-4ec9-a151-9d146c48440d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:28.568380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5f0b1477-c23a-4ec9-a151-9d146c48440d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:28.577126 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5f0b1477-c23a-4ec9-a151-9d146c48440d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.254186 May 28 21:12:28.577647 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1335/2647] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:28 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:28.582773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e517d770-a9c5-4df1-9f63-739f3e352765 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:28.587053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e517d770-a9c5-4df1-9f63-739f3e352765 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:28.590159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e517d770-a9c5-4df1-9f63-739f3e352765 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:28.590617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e517d770-a9c5-4df1-9f63-739f3e352765 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:28.591399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e517d770-a9c5-4df1-9f63-739f3e352765 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:28.591872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e517d770-a9c5-4df1-9f63-739f3e352765 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:28.616210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-61ee6266-c750-4c37-baea-56ad40948c68 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Updating instance_info_cache with network_info: [{"id": "825989f5-1b0d-4731-92b8-dabd0a2be976", "address": "fa:16:3e:76:3b:1f", "network": {"id": "c1dde440-05b5-4215-bf14-fa46ddc2096b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1102943986-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9d08be7a2d1e4b779987d75d87a5ef44", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap825989f5-1b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=143128) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 21:12:28.619735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=5,nova_cell1:RELEASE=4,nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:28.742891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61ee6266-c750-4c37-baea-56ad40948c68 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Releasing lock "refresh_cache-50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" {{(pid=143128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 21:12:28.743790 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-61ee6266-c750-4c37-baea-56ad40948c68 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "POST /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35/action" status: 202 len: 0 microversion: 2.1 time: 3.869946 May 28 21:12:28.744486 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1313/2648] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:12:24 2022] POST /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35/action => generated 0 bytes in 3872 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 21:12:28.750894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-072082b7-7e65-4c92-bc33-ce959246fd61 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:28.751964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-072082b7-7e65-4c92-bc33-ce959246fd61 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:28.758357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-072082b7-7e65-4c92-bc33-ce959246fd61 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:28.759141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-072082b7-7e65-4c92-bc33-ce959246fd61 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:28.760123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-072082b7-7e65-4c92-bc33-ce959246fd61 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:28.761126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-072082b7-7e65-4c92-bc33-ce959246fd61 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:28.775909 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e517d770-a9c5-4df1-9f63-739f3e352765 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.197094 May 28 21:12:28.777367 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1336/2649] 10.222.0.33 () {58 vars in 1295 bytes} [Sat May 28 21:12:28 2022] DELETE /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9/os-server-password => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:12:28.785049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-51b025fd-a45d-4851-b30b-9ae67ded08d4 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:28.805084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.compute.server_groups [None req-51b025fd-a45d-4851-b30b-9ae67ded08d4 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Querying cell fc53a60a-e345-4363-abb1-87c4d33bcbf6(cell1) for 1 instances {{(pid=143129) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 28 21:12:28.806136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51b025fd-a45d-4851-b30b-9ae67ded08d4 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:28.806902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51b025fd-a45d-4851-b30b-9ae67ded08d4 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:28.821003 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-51b025fd-a45d-4851-b30b-9ae67ded08d4 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.042269 May 28 21:12:28.822199 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1337/2650] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:12:28 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:28.829871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-2e6e1c3f-0ddc-4e49-a7a6-955697404ce5 req-944fbd37-465c-497b-a200-b96a2123e978 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00573ede-054c-45fe-90f8-b1ef7725596e", "name": "network-vif-deleted", "tag": "e1731f50-e120-4158-be35-70b39f01d5b7"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:28.839066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2e6e1c3f-0ddc-4e49-a7a6-955697404ce5 req-944fbd37-465c-497b-a200-b96a2123e978 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:28.839789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2e6e1c3f-0ddc-4e49-a7a6-955697404ce5 req-944fbd37-465c-497b-a200-b96a2123e978 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:28.851961 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-2e6e1c3f-0ddc-4e49-a7a6-955697404ce5 req-944fbd37-465c-497b-a200-b96a2123e978 service nova] Creating event network-vif-deleted:e1731f50-e120-4158-be35-70b39f01d5b7 for instance 00573ede-054c-45fe-90f8-b1ef7725596e on nch1-master-1 May 28 21:12:28.859302 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-2e6e1c3f-0ddc-4e49-a7a6-955697404ce5 req-944fbd37-465c-497b-a200-b96a2123e978 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033611 May 28 21:12:28.860251 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1338/2651] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:28.867093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-69cd9bba-f333-47b5-97c3-cb5d456e03ef tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '.version_select at 0x7f4d57efd700>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:28.893323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-072082b7-7e65-4c92-bc33-ce959246fd61 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:28.905511 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-072082b7-7e65-4c92-bc33-ce959246fd61 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1274 microversion: 2.1 time: 0.159057 May 28 21:12:28.906706 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1314/2652] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:28 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:28.913437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-485e1bb2-ffda-4e47-b333-1e214a19f512 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:28.914218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-485e1bb2-ffda-4e47-b333-1e214a19f512 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:28.921018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-485e1bb2-ffda-4e47-b333-1e214a19f512 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:28.932702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-485e1bb2-ffda-4e47-b333-1e214a19f512 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:28.932702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-485e1bb2-ffda-4e47-b333-1e214a19f512 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:28.932702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-485e1bb2-ffda-4e47-b333-1e214a19f512 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:28.955564 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-485e1bb2-ffda-4e47-b333-1e214a19f512 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.047505 May 28 21:12:28.956304 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1315/2653] 10.222.0.33 () {58 vars in 1292 bytes} [Sat May 28 21:12:28 2022] GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9/os-server-password => generated 16 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:12:28.963604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a3a714ad-c49a-4cdb-9262-34358e2bf770 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:28.984116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.compute.server_groups [None req-a3a714ad-c49a-4cdb-9262-34358e2bf770 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Querying cell fc53a60a-e345-4363-abb1-87c4d33bcbf6(cell1) for 1 instances {{(pid=143128) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} May 28 21:12:28.985289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a3a714ad-c49a-4cdb-9262-34358e2bf770 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:28.985975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a3a714ad-c49a-4cdb-9262-34358e2bf770 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:29.042431 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a3a714ad-c49a-4cdb-9262-34358e2bf770 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/os-server-groups/07618ba6-bbcc-450f-9a45-c977278c2741" status: 200 len: 183 microversion: 2.1 time: 0.084204 May 28 21:12:29.054478 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1316/2654] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:12:28 2022] GET /compute/v2.1/os-server-groups/07618ba6-bbcc-450f-9a45-c977278c2741 => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:29.060719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fb89cf96-0625-48b0-aea1-516d33cb7f7f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:29.061235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fb89cf96-0625-48b0-aea1-516d33cb7f7f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:29.069471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb89cf96-0625-48b0-aea1-516d33cb7f7f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:29.070146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb89cf96-0625-48b0-aea1-516d33cb7f7f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:29.070926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb89cf96-0625-48b0-aea1-516d33cb7f7f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:29.071364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb89cf96-0625-48b0-aea1-516d33cb7f7f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:29.099329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fb89cf96-0625-48b0-aea1-516d33cb7f7f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:12:29.242332 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-69cd9bba-f333-47b5-97c3-cb5d456e03ef tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/os-floating-ips/258fea4c-48f6-43c0-94f6-32416e83befd" status: 200 len: 183 microversion: 2.1 time: 0.380479 May 28 21:12:29.243851 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1339/2655] 10.222.0.33 () {58 vars in 1259 bytes} [Sat May 28 21:12:28 2022] GET /compute/v2.1/os-floating-ips/258fea4c-48f6-43c0-94f6-32416e83befd => generated 183 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:29.251214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-37c3ceda-a04b-42db-a6c0-f89ee4173a2e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:29.252227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-37c3ceda-a04b-42db-a6c0-f89ee4173a2e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:29.259108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37c3ceda-a04b-42db-a6c0-f89ee4173a2e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:29.259762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37c3ceda-a04b-42db-a6c0-f89ee4173a2e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:29.260718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37c3ceda-a04b-42db-a6c0-f89ee4173a2e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:29.261653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37c3ceda-a04b-42db-a6c0-f89ee4173a2e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:29.277953 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-37c3ceda-a04b-42db-a6c0-f89ee4173a2e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] HTTP exception thrown: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-37c3ceda-a04b-42db-a6c0-f89ee4173a2e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Request method failure captured: May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 HTTP/1.1 May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAc_FQFCE1TM_5U7DfRIq71eexfxW_cLqp_H5Zt4Ny_VkWobEusNxf6U65KFoXAIWvze7bpbocQSU5Z453cg5TOikOT8SlDhkBG8vtGnwjoDQYXnVVLfYVDBuxKMA74G2ZCA5tGZxdWDVlB1EatcxxJMB_l4evS6qUV2ilKxOsb-jk May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2e073d4d15a243eca3ea41985b8150b0 May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerGroupTestJSON-518149138 May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e073d4d15a243eca3ea41985b8150b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerGroupTestJSON-518149138 May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2e073d4d15a243eca3ea41985b8150b0 May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerGroupTestJSON-518149138 May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerGroupTestJSON-518149138-project May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ce8ac48fe53b4080bf74c9788408f8c5 May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerGroupTestJSON-518149138-project May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'cb986652-a1db-48a0-89cc-5f3479f029e3'} May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:29.279782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. May 28 21:12:29.283150 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:29.283150 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:29.283150 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:29.283150 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:29.283150 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:29.283150 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:29.283150 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:29.283150 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:29.283150 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. May 28 21:12:29.283150 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:29.283150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-37c3ceda-a04b-42db-a6c0-f89ee4173a2e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Returning 404 to user: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:29.283150 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-37c3ceda-a04b-42db-a6c0-f89ee4173a2e tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 404 len: 111 microversion: 2.1 time: 0.034357 May 28 21:12:29.283150 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1340/2656] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:12:29 2022] DELETE /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:29.287829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8eefde79-a354-45fd-8a11-bcd66803ff1c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.52"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:29.475930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8eefde79-a354-45fd-8a11-bcd66803ff1c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:29.487007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8eefde79-a354-45fd-8a11-bcd66803ff1c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:29.488219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8eefde79-a354-45fd-8a11-bcd66803ff1c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:29.490576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8eefde79-a354-45fd-8a11-bcd66803ff1c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:29.491256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8eefde79-a354-45fd-8a11-bcd66803ff1c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:29.694490 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fb89cf96-0625-48b0-aea1-516d33cb7f7f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9" status: 204 len: 0 microversion: 2.1 time: 0.637076 May 28 21:12:29.696328 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1317/2657] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:12:29 2022] DELETE /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:12:29.706707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6ac33f0d-96a1-4ceb-9b6b-99e9e59307dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:29.710216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6ac33f0d-96a1-4ceb-9b6b-99e9e59307dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] [instance: cb986652-a1db-48a0-89cc-5f3479f029e3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:29.730079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ac33f0d-96a1-4ceb-9b6b-99e9e59307dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:29.730512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ac33f0d-96a1-4ceb-9b6b-99e9e59307dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:29.731467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ac33f0d-96a1-4ceb-9b6b-99e9e59307dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:29.732052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ac33f0d-96a1-4ceb-9b6b-99e9e59307dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:29.756120 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-6ac33f0d-96a1-4ceb-9b6b-99e9e59307dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] HTTP exception thrown: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6ac33f0d-96a1-4ceb-9b6b-99e9e59307dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Request method failure captured: May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 HTTP/1.1 May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpAc_FQFCE1TM_5U7DfRIq71eexfxW_cLqp_H5Zt4Ny_VkWobEusNxf6U65KFoXAIWvze7bpbocQSU5Z453cg5TOikOT8SlDhkBG8vtGnwjoDQYXnVVLfYVDBuxKMA74G2ZCA5tGZxdWDVlB1EatcxxJMB_l4evS6qUV2ilKxOsb-jk May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 2e073d4d15a243eca3ea41985b8150b0 May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerGroupTestJSON-518149138 May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e073d4d15a243eca3ea41985b8150b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerGroupTestJSON-518149138 May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 2e073d4d15a243eca3ea41985b8150b0 May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerGroupTestJSON-518149138 May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerGroupTestJSON-518149138-project May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ce8ac48fe53b4080bf74c9788408f8c5 May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerGroupTestJSON-518149138-project May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'cb986652-a1db-48a0-89cc-5f3479f029e3'} May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:29.758099 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:29.763717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:29.763717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:29.763717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:29.763717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:29.763717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:29.763717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. May 28 21:12:29.763717 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:29.765608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6ac33f0d-96a1-4ceb-9b6b-99e9e59307dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Returning 404 to user: Instance cb986652-a1db-48a0-89cc-5f3479f029e3 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:29.766788 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6ac33f0d-96a1-4ceb-9b6b-99e9e59307dc tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3" status: 404 len: 111 microversion: 2.1 time: 0.068226 May 28 21:12:29.767603 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1318/2658] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:29 2022] GET /compute/v2.1/servers/cb986652-a1db-48a0-89cc-5f3479f029e3 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:29.778182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b039cc8a-0af4-48af-afab-69fa8cb305f8 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:29.778921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b039cc8a-0af4-48af-afab-69fa8cb305f8 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:29.785527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b039cc8a-0af4-48af-afab-69fa8cb305f8 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:29.786582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b039cc8a-0af4-48af-afab-69fa8cb305f8 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:29.787714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b039cc8a-0af4-48af-afab-69fa8cb305f8 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:29.788428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b039cc8a-0af4-48af-afab-69fa8cb305f8 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:29.804033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8eefde79-a354-45fd-8a11-bcd66803ff1c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Acquired lock "refresh_cache-50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" {{(pid=143129) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 21:12:30.062410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b039cc8a-0af4-48af-afab-69fa8cb305f8 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36e381aa5a4e4196d4e994e70f586e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659cd6db8d6741329dded06813f0ef93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:30.070971 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b039cc8a-0af4-48af-afab-69fa8cb305f8 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 200 len: 1466 microversion: 2.1 time: 0.302152 May 28 21:12:30.082058 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1319/2659] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:29 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 1466 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:30.089592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a56fd571-69bb-4aa1-aa91-972829ad5994 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:30.090262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a56fd571-69bb-4aa1-aa91-972829ad5994 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:30.096389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a56fd571-69bb-4aa1-aa91-972829ad5994 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:30.096847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a56fd571-69bb-4aa1-aa91-972829ad5994 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:30.097626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a56fd571-69bb-4aa1-aa91-972829ad5994 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:30.098110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a56fd571-69bb-4aa1-aa91-972829ad5994 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:30.399521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a56fd571-69bb-4aa1-aa91-972829ad5994 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:30.407728 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a56fd571-69bb-4aa1-aa91-972829ad5994 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.324138 May 28 21:12:30.408290 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1320/2660] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:30 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:30.412784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-306ab760-201e-4d0d-95c9-1e9fdfa5b0d3 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:30.413393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-306ab760-201e-4d0d-95c9-1e9fdfa5b0d3 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:30.420123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-306ab760-201e-4d0d-95c9-1e9fdfa5b0d3 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:30.420568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-306ab760-201e-4d0d-95c9-1e9fdfa5b0d3 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:30.421326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-306ab760-201e-4d0d-95c9-1e9fdfa5b0d3 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:30.421760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-306ab760-201e-4d0d-95c9-1e9fdfa5b0d3 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:30.742216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-306ab760-201e-4d0d-95c9-1e9fdfa5b0d3 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd86b6dd9894aac971943b2fa859bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8047aaa6e1f7401fbcf4b4cd5dcd004e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:30.749893 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-306ab760-201e-4d0d-95c9-1e9fdfa5b0d3 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9" status: 200 len: 1508 microversion: 2.1 time: 0.340482 May 28 21:12:30.750475 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1321/2661] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:30 2022] GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 => generated 1508 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:30.755654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f0c0b625-fda4-4575-98c0-d27f563ae1b3 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:30.763036 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-f0c0b625-fda4-4575-98c0-d27f563ae1b3 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] HTTP exception thrown: Instance group 4a55988a-b525-439e-aa0a-94fa9015c2aa could not be found. May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f0c0b625-fda4-4575-98c0-d27f563ae1b3 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Request method failure captured: May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-server-groups/4a55988a-b525-439e-aa0a-94fa9015c2aa HTTP/1.1 May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpAc_FQFCE1TM_5U7DfRIq71eexfxW_cLqp_H5Zt4Ny_VkWobEusNxf6U65KFoXAIWvze7bpbocQSU5Z453cg5TOikOT8SlDhkBG8vtGnwjoDQYXnVVLfYVDBuxKMA74G2ZCA5tGZxdWDVlB1EatcxxJMB_l4evS6qUV2ilKxOsb-jk May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 2e073d4d15a243eca3ea41985b8150b0 May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerGroupTestJSON-518149138 May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e073d4d15a243eca3ea41985b8150b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerGroupTestJSON-518149138 May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 2e073d4d15a243eca3ea41985b8150b0 May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerGroupTestJSON-518149138 May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerGroupTestJSON-518149138-project May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ce8ac48fe53b4080bf74c9788408f8c5 May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerGroupTestJSON-518149138-project May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance group 4a55988a-b525-439e-aa0a-94fa9015c2aa could not be found. May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '4a55988a-b525-439e-aa0a-94fa9015c2aa'} May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 4a55988a-b525-439e-aa0a-94fa9015c2aa could not be found. May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 4a55988a-b525-439e-aa0a-94fa9015c2aa could not be found. May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:30.765255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:30.769447 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:30.769447 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:30.769447 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:30.769447 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:30.769447 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 4a55988a-b525-439e-aa0a-94fa9015c2aa could not be found. May 28 21:12:30.769447 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:30.769447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f0c0b625-fda4-4575-98c0-d27f563ae1b3 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Returning 404 to user: Instance group 4a55988a-b525-439e-aa0a-94fa9015c2aa could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:30.769447 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f0c0b625-fda4-4575-98c0-d27f563ae1b3 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/4a55988a-b525-439e-aa0a-94fa9015c2aa" status: 404 len: 117 microversion: 2.1 time: 0.015306 May 28 21:12:30.769447 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1322/2662] 10.222.0.33 () {58 vars in 1265 bytes} [Sat May 28 21:12:30 2022] DELETE /compute/v2.1/os-server-groups/4a55988a-b525-439e-aa0a-94fa9015c2aa => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:30.773872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ea8a6e68-4479-479e-aaab-517c44602da9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:30.774524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ea8a6e68-4479-479e-aaab-517c44602da9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:30.783340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea8a6e68-4479-479e-aaab-517c44602da9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:30.785447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea8a6e68-4479-479e-aaab-517c44602da9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:30.785447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea8a6e68-4479-479e-aaab-517c44602da9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:30.785447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea8a6e68-4479-479e-aaab-517c44602da9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:31.126638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ea8a6e68-4479-479e-aaab-517c44602da9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:31.137395 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ea8a6e68-4479-479e-aaab-517c44602da9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1314 microversion: 2.1 time: 0.369073 May 28 21:12:31.146897 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1323/2663] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:30 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:31.146897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-31f46777-5cb3-4d41-b9da-d1bd66d5fc46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:31.146897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-31f46777-5cb3-4d41-b9da-d1bd66d5fc46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:31.153745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31f46777-5cb3-4d41-b9da-d1bd66d5fc46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:31.154310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31f46777-5cb3-4d41-b9da-d1bd66d5fc46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:31.155139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31f46777-5cb3-4d41-b9da-d1bd66d5fc46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:31.155585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31f46777-5cb3-4d41-b9da-d1bd66d5fc46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:31.201177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-31f46777-5cb3-4d41-b9da-d1bd66d5fc46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:12:31.266904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-8eefde79-a354-45fd-8a11-bcd66803ff1c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Building network info cache for instance {{(pid=143129) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 21:12:31.634991 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-31f46777-5cb3-4d41-b9da-d1bd66d5fc46 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 204 len: 0 microversion: 2.1 time: 0.495465 May 28 21:12:31.636526 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1324/2664] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:12:31 2022] DELETE /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:12:31.643267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1210844702", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "736f6698-8bf3-4f07-af39-43a23fd87f50"}, {"port": "b9147e1c-e446-4b38-b6cd-4ba5d9efe9bf", "tag": "port-1"}, {"port": "48633e8e-091d-451b-8abe-5cdb8fc414cf", "tag": "port-2"}, {"uuid": "63a86339-02c4-4cb7-b2a5-0c3d362e87a6", "tag": "net-1"}, {"uuid": "63a86339-02c4-4cb7-b2a5-0c3d362e87a6"}, {"uuid": "69efb10b-d6a6-47e7-80d4-ae92dbdf9602", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "69efb10b-d6a6-47e7-80d4-ae92dbdf9602", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f988fe9b-43f7-4336-8526-979ab3142238", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1896dbc5-1bc4-4ba7-a09c-f8a5a3e84615", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c7ec9972-c33d-41d5-bf85-a57642501bd3", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--369230892"}], "key_name": "tempest-keypair-2065388250", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:32.019978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] validate_networks() for [('736f6698-8bf3-4f07-af39-43a23fd87f50', None, None, None, None, None), (None, None, 'b9147e1c-e446-4b38-b6cd-4ba5d9efe9bf', None, None, None), (None, None, '48633e8e-091d-451b-8abe-5cdb8fc414cf', None, None, None), ('63a86339-02c4-4cb7-b2a5-0c3d362e87a6', None, None, None, None, None), ('63a86339-02c4-4cb7-b2a5-0c3d362e87a6', None, None, None, None, None), ('69efb10b-d6a6-47e7-80d4-ae92dbdf9602', '10.2.2.100', None, None, None, None), ('69efb10b-d6a6-47e7-80d4-ae92dbdf9602', '10.2.2.200', None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:12:32.612399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-8eefde79-a354-45fd-8a11-bcd66803ff1c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Updating instance_info_cache with network_info: [{"id": "825989f5-1b0d-4731-92b8-dabd0a2be976", "address": "fa:16:3e:76:3b:1f", "network": {"id": "c1dde440-05b5-4215-bf14-fa46ddc2096b", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1102943986-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "9d08be7a2d1e4b779987d75d87a5ef44", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap825989f5-1b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=143129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 21:12:32.699053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8eefde79-a354-45fd-8a11-bcd66803ff1c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Releasing lock "refresh_cache-50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" {{(pid=143129) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 21:12:32.702985 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8eefde79-a354-45fd-8a11-bcd66803ff1c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "POST /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35/action" status: 202 len: 0 microversion: 2.1 time: 3.419836 May 28 21:12:32.714227 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1341/2665] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:12:29 2022] POST /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35/action => generated 0 bytes in 3431 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 21:12:32.728330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3efa93f0-9e97-4bb2-a241-b2f4f7203b1b tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:32.743727 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-3efa93f0-9e97-4bb2-a241-b2f4f7203b1b tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] HTTP exception thrown: Instance group 6bd50cf1-248c-4418-8cd7-bb4c7ea1d1a2 could not be found. May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3efa93f0-9e97-4bb2-a241-b2f4f7203b1b tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Request method failure captured: May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/os-server-groups/6bd50cf1-248c-4418-8cd7-bb4c7ea1d1a2 HTTP/1.1 May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAc_FQFCE1TM_5U7DfRIq71eexfxW_cLqp_H5Zt4Ny_VkWobEusNxf6U65KFoXAIWvze7bpbocQSU5Z453cg5TOikOT8SlDhkBG8vtGnwjoDQYXnVVLfYVDBuxKMA74G2ZCA5tGZxdWDVlB1EatcxxJMB_l4evS6qUV2ilKxOsb-jk May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2e073d4d15a243eca3ea41985b8150b0 May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerGroupTestJSON-518149138 May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e073d4d15a243eca3ea41985b8150b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerGroupTestJSON-518149138 May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2e073d4d15a243eca3ea41985b8150b0 May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerGroupTestJSON-518149138 May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerGroupTestJSON-518149138-project May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ce8ac48fe53b4080bf74c9788408f8c5 May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerGroupTestJSON-518149138-project May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance group 6bd50cf1-248c-4418-8cd7-bb4c7ea1d1a2 could not be found. May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '6bd50cf1-248c-4418-8cd7-bb4c7ea1d1a2'} May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6bd50cf1-248c-4418-8cd7-bb4c7ea1d1a2 could not be found. May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6bd50cf1-248c-4418-8cd7-bb4c7ea1d1a2 could not be found. May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:32.748082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:32.751812 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:32.751812 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:32.751812 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:32.751812 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:32.751812 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6bd50cf1-248c-4418-8cd7-bb4c7ea1d1a2 could not be found. May 28 21:12:32.751812 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:32.751812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3efa93f0-9e97-4bb2-a241-b2f4f7203b1b tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Returning 404 to user: Instance group 6bd50cf1-248c-4418-8cd7-bb4c7ea1d1a2 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:32.751812 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3efa93f0-9e97-4bb2-a241-b2f4f7203b1b tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/6bd50cf1-248c-4418-8cd7-bb4c7ea1d1a2" status: 404 len: 117 microversion: 2.1 time: 0.035742 May 28 21:12:32.757963 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1342/2666] 10.222.0.33 () {58 vars in 1265 bytes} [Sat May 28 21:12:32 2022] DELETE /compute/v2.1/os-server-groups/6bd50cf1-248c-4418-8cd7-bb4c7ea1d1a2 => generated 117 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:32.767003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-32c1fd6d-1fd1-4e3d-8a59-d1ce8566a779 req-68e04bdc-1f35-4b32-8afc-9246c03c9772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a4cf15-02b5-42d1-ae2f-849ca1ec8d35", "tag": "825989f5-1b0d-4731-92b8-dabd0a2be976"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:32.778621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-32c1fd6d-1fd1-4e3d-8a59-d1ce8566a779 req-68e04bdc-1f35-4b32-8afc-9246c03c9772 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:32.779080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-32c1fd6d-1fd1-4e3d-8a59-d1ce8566a779 req-68e04bdc-1f35-4b32-8afc-9246c03c9772 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:32.794736 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-32c1fd6d-1fd1-4e3d-8a59-d1ce8566a779 req-68e04bdc-1f35-4b32-8afc-9246c03c9772 service nova] Creating event network-changed:825989f5-1b0d-4731-92b8-dabd0a2be976 for instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 on nch2-master-1 May 28 21:12:32.797736 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-32c1fd6d-1fd1-4e3d-8a59-d1ce8566a779 req-68e04bdc-1f35-4b32-8afc-9246c03c9772 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038246 May 28 21:12:32.798503 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1343/2667] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:32.806223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40955fe7-9879-46b5-a733-92e99709d0b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:32.806992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-40955fe7-9879-46b5-a733-92e99709d0b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:32.813704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:32.816863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40955fe7-9879-46b5-a733-92e99709d0b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:32.817328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40955fe7-9879-46b5-a733-92e99709d0b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:32.818150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40955fe7-9879-46b5-a733-92e99709d0b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:32.818676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40955fe7-9879-46b5-a733-92e99709d0b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:32.861219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:33.163288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-40955fe7-9879-46b5-a733-92e99709d0b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:33.172080 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-40955fe7-9879-46b5-a733-92e99709d0b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.372136 May 28 21:12:33.172870 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1344/2668] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:32 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:33.187825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-01f4fa41-5fd4-48f8-a9fb-a05911ce9772 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:33.188754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-01f4fa41-5fd4-48f8-a9fb-a05911ce9772 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:33.195913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01f4fa41-5fd4-48f8-a9fb-a05911ce9772 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:33.197025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01f4fa41-5fd4-48f8-a9fb-a05911ce9772 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:33.198329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01f4fa41-5fd4-48f8-a9fb-a05911ce9772 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:33.199006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01f4fa41-5fd4-48f8-a9fb-a05911ce9772 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:33.532191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-01f4fa41-5fd4-48f8-a9fb-a05911ce9772 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e36e381aa5a4e4196d4e994e70f586e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '659cd6db8d6741329dded06813f0ef93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:33.555891 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-01f4fa41-5fd4-48f8-a9fb-a05911ce9772 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 200 len: 1472 microversion: 2.1 time: 0.371325 May 28 21:12:33.557375 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1345/2669] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:33 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 1472 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:33.578150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3fd7c690-2572-4869-bc14-67c79fb1423f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:33.578926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3fd7c690-2572-4869-bc14-67c79fb1423f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:33.586802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fd7c690-2572-4869-bc14-67c79fb1423f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:33.587471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fd7c690-2572-4869-bc14-67c79fb1423f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:33.588896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fd7c690-2572-4869-bc14-67c79fb1423f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:33.589426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fd7c690-2572-4869-bc14-67c79fb1423f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:33.623490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fd7c690-2572-4869-bc14-67c79fb1423f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:33.624126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fd7c690-2572-4869-bc14-67c79fb1423f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:33.624503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-3fd7c690-2572-4869-bc14-67c79fb1423f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lazy-loading 'fault' on Instance uuid 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:12:33.678734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3fd7c690-2572-4869-bc14-67c79fb1423f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2dd86b6dd9894aac971943b2fa859bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8047aaa6e1f7401fbcf4b4cd5dcd004e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:33.686552 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3fd7c690-2572-4869-bc14-67c79fb1423f tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9" status: 200 len: 1305 microversion: 2.1 time: 0.125445 May 28 21:12:33.687174 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1346/2670] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:33 2022] GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:33.691769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-268e5689-7a63-4067-bd5d-c276255a4638 req-8a9cd326-b46e-4b44-a422-7df7f8fa5a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9", "name": "network-vif-deleted", "tag": "25393872-7541-4fa7-a96e-46ce44c1dd0b"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:33.700435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-268e5689-7a63-4067-bd5d-c276255a4638 req-8a9cd326-b46e-4b44-a422-7df7f8fa5a4c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:33.700938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-268e5689-7a63-4067-bd5d-c276255a4638 req-8a9cd326-b46e-4b44-a422-7df7f8fa5a4c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:33.711924 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-268e5689-7a63-4067-bd5d-c276255a4638 req-8a9cd326-b46e-4b44-a422-7df7f8fa5a4c service nova] Creating event network-vif-deleted:25393872-7541-4fa7-a96e-46ce44c1dd0b for instance 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 on nch1-master-1 May 28 21:12:33.717419 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-268e5689-7a63-4067-bd5d-c276255a4638 req-8a9cd326-b46e-4b44-a422-7df7f8fa5a4c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029081 May 28 21:12:33.718222 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1347/2671] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:33.723273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-be2a75c9-7c4e-4d79-959d-3714516a2d8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:33.723978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-be2a75c9-7c4e-4d79-959d-3714516a2d8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:33.730718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be2a75c9-7c4e-4d79-959d-3714516a2d8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:33.731174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be2a75c9-7c4e-4d79-959d-3714516a2d8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:33.735704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be2a75c9-7c4e-4d79-959d-3714516a2d8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:33.735704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be2a75c9-7c4e-4d79-959d-3714516a2d8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:33.954918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-be2a75c9-7c4e-4d79-959d-3714516a2d8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:33.963460 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-be2a75c9-7c4e-4d79-959d-3714516a2d8e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1314 microversion: 2.1 time: 0.244078 May 28 21:12:33.964223 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1348/2672] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:33 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:33.969150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9a8810b0-4c6e-4273-89e5-d1dba93fe09c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:33.969764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9a8810b0-4c6e-4273-89e5-d1dba93fe09c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:33.976526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a8810b0-4c6e-4273-89e5-d1dba93fe09c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:33.978097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a8810b0-4c6e-4273-89e5-d1dba93fe09c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:33.978097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a8810b0-4c6e-4273-89e5-d1dba93fe09c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:33.978754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a8810b0-4c6e-4273-89e5-d1dba93fe09c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:33.994213 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-9a8810b0-4c6e-4273-89e5-d1dba93fe09c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] HTTP exception thrown: Instance 00573ede-054c-45fe-90f8-b1ef7725596e could not be found. May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9a8810b0-4c6e-4273-89e5-d1dba93fe09c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Request method failure captured: May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e HTTP/1.1 May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko_5hNM14SyxGy7pIAZpEILymcxSG05alvy6v_YG3Mq-2gRi8bBiJB7-zN4dhukVG5VT5nHinUhZDy6KVP_9T3Ei64UuVP5vDBsmGKeQoe0oLBUKwXo4BOle8dmU_eNql98NHdDQhjYbAd8fhs-VXsJjcp1ynznAlV2611L-oTN6srw May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 9d08be7a2d1e4b779987d75d87a5ef44 May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-875612888 May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d08be7a2d1e4b779987d75d87a5ef44", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d08be7a2d1e4b779987d75d87a5ef44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d08be7a2d1e4b779987d75d87a5ef44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d08be7a2d1e4b779987d75d87a5ef44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-875612888 May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 9d08be7a2d1e4b779987d75d87a5ef44 May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-875612888 May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-FloatingIPsAssociationTestJSON-875612888-project May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 04ae3115a9194b47bce62ada4a2afdf2 May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-875612888-project May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 00573ede-054c-45fe-90f8-b1ef7725596e could not be found. May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '00573ede-054c-45fe-90f8-b1ef7725596e'} May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00573ede-054c-45fe-90f8-b1ef7725596e could not be found. May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:12:33.996804 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:34.000998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00573ede-054c-45fe-90f8-b1ef7725596e could not be found. May 28 21:12:34.000998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.000998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:34.000998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.000998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:34.000998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:34.000998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:34.000998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:34.000998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:34.000998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00573ede-054c-45fe-90f8-b1ef7725596e could not be found. May 28 21:12:34.000998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.002803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9a8810b0-4c6e-4273-89e5-d1dba93fe09c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Returning 404 to user: Instance 00573ede-054c-45fe-90f8-b1ef7725596e could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:34.003858 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9a8810b0-4c6e-4273-89e5-d1dba93fe09c tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "DELETE /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e" status: 404 len: 111 microversion: 2.1 time: 0.038599 May 28 21:12:34.004449 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1349/2673] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:12:33 2022] DELETE /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:34.009983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e56c42fa-91d4-446a-958e-b331bf83402c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:34.016821 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-e56c42fa-91d4-446a-958e-b331bf83402c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] HTTP exception thrown: Instance group e308adf1-98ac-451d-8deb-e27c5f103fa5 could not be found. May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e56c42fa-91d4-446a-958e-b331bf83402c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Request method failure captured: May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/os-server-groups/e308adf1-98ac-451d-8deb-e27c5f103fa5 HTTP/1.1 May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAc_FQFCE1TM_5U7DfRIq71eexfxW_cLqp_H5Zt4Ny_VkWobEusNxf6U65KFoXAIWvze7bpbocQSU5Z453cg5TOikOT8SlDhkBG8vtGnwjoDQYXnVVLfYVDBuxKMA74G2ZCA5tGZxdWDVlB1EatcxxJMB_l4evS6qUV2ilKxOsb-jk May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2e073d4d15a243eca3ea41985b8150b0 May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerGroupTestJSON-518149138 May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e073d4d15a243eca3ea41985b8150b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerGroupTestJSON-518149138 May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2e073d4d15a243eca3ea41985b8150b0 May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerGroupTestJSON-518149138 May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerGroupTestJSON-518149138-project May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ce8ac48fe53b4080bf74c9788408f8c5 May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerGroupTestJSON-518149138-project May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance group e308adf1-98ac-451d-8deb-e27c5f103fa5 could not be found. May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'e308adf1-98ac-451d-8deb-e27c5f103fa5'} May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e308adf1-98ac-451d-8deb-e27c5f103fa5 could not be found. May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e308adf1-98ac-451d-8deb-e27c5f103fa5 could not be found. May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.018488 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:34.024286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:34.024286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:34.024286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:34.024286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:34.024286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e308adf1-98ac-451d-8deb-e27c5f103fa5 could not be found. May 28 21:12:34.024286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.024286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e56c42fa-91d4-446a-958e-b331bf83402c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Returning 404 to user: Instance group e308adf1-98ac-451d-8deb-e27c5f103fa5 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:34.024286 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e56c42fa-91d4-446a-958e-b331bf83402c tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/e308adf1-98ac-451d-8deb-e27c5f103fa5" status: 404 len: 117 microversion: 2.1 time: 0.014625 May 28 21:12:34.024286 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1350/2674] 10.222.0.33 () {58 vars in 1265 bytes} [Sat May 28 21:12:34 2022] DELETE /compute/v2.1/os-server-groups/e308adf1-98ac-451d-8deb-e27c5f103fa5 => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:34.025921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fdd8585c-d753-49c6-bcc2-09504d5a9952 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:34.026562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fdd8585c-d753-49c6-bcc2-09504d5a9952 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 00573ede-054c-45fe-90f8-b1ef7725596e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:34.035771 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fdd8585c-d753-49c6-bcc2-09504d5a9952 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:34.036236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fdd8585c-d753-49c6-bcc2-09504d5a9952 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:34.037035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fdd8585c-d753-49c6-bcc2-09504d5a9952 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:34.037491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fdd8585c-d753-49c6-bcc2-09504d5a9952 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:34.060850 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-fdd8585c-d753-49c6-bcc2-09504d5a9952 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] HTTP exception thrown: Instance 00573ede-054c-45fe-90f8-b1ef7725596e could not be found. May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fdd8585c-d753-49c6-bcc2-09504d5a9952 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Request method failure captured: May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e HTTP/1.1 May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko_5hNM14SyxGy7pIAZpEILymcxSG05alvy6v_YG3Mq-2gRi8bBiJB7-zN4dhukVG5VT5nHinUhZDy6KVP_9T3Ei64UuVP5vDBsmGKeQoe0oLBUKwXo4BOle8dmU_eNql98NHdDQhjYbAd8fhs-VXsJjcp1ynznAlV2611L-oTN6srw May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 9d08be7a2d1e4b779987d75d87a5ef44 May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-875612888 May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d08be7a2d1e4b779987d75d87a5ef44", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d08be7a2d1e4b779987d75d87a5ef44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d08be7a2d1e4b779987d75d87a5ef44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d08be7a2d1e4b779987d75d87a5ef44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-875612888 May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 9d08be7a2d1e4b779987d75d87a5ef44 May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-875612888 May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-FloatingIPsAssociationTestJSON-875612888-project May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 04ae3115a9194b47bce62ada4a2afdf2 May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-875612888-project May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 00573ede-054c-45fe-90f8-b1ef7725596e could not be found. May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '00573ede-054c-45fe-90f8-b1ef7725596e'} May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00573ede-054c-45fe-90f8-b1ef7725596e could not be found. May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00573ede-054c-45fe-90f8-b1ef7725596e could not be found. May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.062593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:34.066455 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.066455 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:34.066455 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:34.066455 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:34.066455 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:34.066455 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:34.066455 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00573ede-054c-45fe-90f8-b1ef7725596e could not be found. May 28 21:12:34.066455 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.066455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fdd8585c-d753-49c6-bcc2-09504d5a9952 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Returning 404 to user: Instance 00573ede-054c-45fe-90f8-b1ef7725596e could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:34.066455 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fdd8585c-d753-49c6-bcc2-09504d5a9952 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e" status: 404 len: 111 microversion: 2.1 time: 0.042364 May 28 21:12:34.066455 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1351/2675] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:34 2022] GET /compute/v2.1/servers/00573ede-054c-45fe-90f8-b1ef7725596e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:34.072087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2a7ad739-4b9e-409d-b8dd-892cbf7ad142 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:34.080093 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-2a7ad739-4b9e-409d-b8dd-892cbf7ad142 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] HTTP exception thrown: Instance group 0b0fd34d-6e0c-45d9-9858-797a729e091d could not be found. May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2a7ad739-4b9e-409d-b8dd-892cbf7ad142 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Request method failure captured: May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/os-server-groups/0b0fd34d-6e0c-45d9-9858-797a729e091d HTTP/1.1 May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAc_FQFCE1TM_5U7DfRIq71eexfxW_cLqp_H5Zt4Ny_VkWobEusNxf6U65KFoXAIWvze7bpbocQSU5Z453cg5TOikOT8SlDhkBG8vtGnwjoDQYXnVVLfYVDBuxKMA74G2ZCA5tGZxdWDVlB1EatcxxJMB_l4evS6qUV2ilKxOsb-jk May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2e073d4d15a243eca3ea41985b8150b0 May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerGroupTestJSON-518149138 May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2e073d4d15a243eca3ea41985b8150b0", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2e073d4d15a243eca3ea41985b8150b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerGroupTestJSON-518149138 May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2e073d4d15a243eca3ea41985b8150b0 May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerGroupTestJSON-518149138 May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerGroupTestJSON-518149138-project May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ce8ac48fe53b4080bf74c9788408f8c5 May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerGroupTestJSON-518149138-project May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance group 0b0fd34d-6e0c-45d9-9858-797a729e091d could not be found. May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '0b0fd34d-6e0c-45d9-9858-797a729e091d'} May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0b0fd34d-6e0c-45d9-9858-797a729e091d could not be found. May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0b0fd34d-6e0c-45d9-9858-797a729e091d could not be found. May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.081660 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:34.086170 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:34.086170 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:34.086170 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:34.086170 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:34.086170 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0b0fd34d-6e0c-45d9-9858-797a729e091d could not be found. May 28 21:12:34.086170 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:34.086170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2a7ad739-4b9e-409d-b8dd-892cbf7ad142 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Returning 404 to user: Instance group 0b0fd34d-6e0c-45d9-9858-797a729e091d could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:34.086170 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2a7ad739-4b9e-409d-b8dd-892cbf7ad142 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/0b0fd34d-6e0c-45d9-9858-797a729e091d" status: 404 len: 117 microversion: 2.1 time: 0.017313 May 28 21:12:34.086170 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1352/2676] 10.222.0.33 () {58 vars in 1265 bytes} [Sat May 28 21:12:34 2022] DELETE /compute/v2.1/os-server-groups/0b0fd34d-6e0c-45d9-9858-797a729e091d => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:34.088494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f484bb7a-f897-42fe-8813-df2022abbe2e tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '.version_select at 0x7f4d576b0940>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:35.448912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:35.588438 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f484bb7a-f897-42fe-8813-df2022abbe2e tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/258fea4c-48f6-43c0-94f6-32416e83befd" status: 202 len: 0 microversion: 2.1 time: 1.503731 May 28 21:12:35.589104 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1353/2677] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:12:34 2022] DELETE /compute/v2.1/os-floating-ips/258fea4c-48f6-43c0-94f6-32416e83befd => generated 0 bytes in 1505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:12:35.594676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-324c810d-2e0c-4817-ade1-290c42e65185 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:35.756418 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-324c810d-2e0c-4817-ade1-290c42e65185 tempest-ServerGroupTestJSON-518149138 tempest-ServerGroupTestJSON-518149138-project] 10.222.0.33 "DELETE /compute/v2.1/os-server-groups/07618ba6-bbcc-450f-9a45-c977278c2741" status: 204 len: 0 microversion: 2.1 time: 0.165969 May 28 21:12:35.756999 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1354/2678] 10.222.0.33 () {58 vars in 1265 bytes} [Sat May 28 21:12:35 2022] DELETE /compute/v2.1/os-server-groups/07618ba6-bbcc-450f-9a45-c977278c2741 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:12:35.769068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-88cc09be-4244-40d0-9c24-3efa511e5e9e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:35.769927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-88cc09be-4244-40d0-9c24-3efa511e5e9e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:35.777186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88cc09be-4244-40d0-9c24-3efa511e5e9e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:35.779395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88cc09be-4244-40d0-9c24-3efa511e5e9e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:35.779395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88cc09be-4244-40d0-9c24-3efa511e5e9e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:35.779395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88cc09be-4244-40d0-9c24-3efa511e5e9e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:35.794058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:12:35.795345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:12:35.796004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:12:35.796720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:12:35.797227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:12:35.808251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:35.808885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:35.809745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:35.810403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:35.828693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Getting quotas for project 8f20390f83d3407e93a3d8d2a196281b. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:35.834177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Getting quotas for user cafc81a185c645e893a77b7fd297d950 and project 8f20390f83d3407e93a3d8d2a196281b. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:35.934464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-88cc09be-4244-40d0-9c24-3efa511e5e9e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:35.944599 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-88cc09be-4244-40d0-9c24-3efa511e5e9e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.186437 May 28 21:12:35.945751 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1355/2679] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:35 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:35.950691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b918eec6-c268-4729-a1cc-41b72fb2bc4e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:35.951588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b918eec6-c268-4729-a1cc-41b72fb2bc4e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:35.957827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b918eec6-c268-4729-a1cc-41b72fb2bc4e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:35.958398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b918eec6-c268-4729-a1cc-41b72fb2bc4e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:35.959222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b918eec6-c268-4729-a1cc-41b72fb2bc4e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:35.959726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b918eec6-c268-4729-a1cc-41b72fb2bc4e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:35.974746 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-b918eec6-c268-4729-a1cc-41b72fb2bc4e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] HTTP exception thrown: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b918eec6-c268-4729-a1cc-41b72fb2bc4e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Request method failure captured: May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 HTTP/1.1 May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAlbFYH6AeRjBPVqNHg6873-_1FzvTLr-J8xeJmMgIjTwx8ecOFPv9jVLq6gpqOYxGHzfsQJPlISCIEgm6agGWUlxBnRLTiJ7NygGYQrGQ3KY8J1TQRosyG59VnIvMmSzsIf-18KiRFxH6X8adJ3113Xyr-sRbjKKAo1-iTp1S3f3M May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 659cd6db8d6741329dded06813f0ef93 May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_659cd6db8d6741329dded06813f0ef93", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 659cd6db8d6741329dded06813f0ef93 May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesNegativeTestJSON-1975235587-project May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 0e36e381aa5a4e4196d4e994e70f586e May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesNegativeTestJSON-1975235587-project May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '5940795e-f9e1-4337-9ca6-72ade7d53426'} May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:35.976293 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:35.981073 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:35.981073 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:35.981073 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:35.981073 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:35.981073 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:35.981073 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:35.981073 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:35.981073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b918eec6-c268-4729-a1cc-41b72fb2bc4e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Returning 404 to user: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:35.981073 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b918eec6-c268-4729-a1cc-41b72fb2bc4e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 404 len: 111 microversion: 2.1 time: 0.031131 May 28 21:12:35.982536 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1356/2680] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:35 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:35.986707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ecccd583-aa87-4ed3-80aa-623e900dd9a2 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:35.987585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ecccd583-aa87-4ed3-80aa-623e900dd9a2 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] [instance: 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:35.993402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecccd583-aa87-4ed3-80aa-623e900dd9a2 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:35.998239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecccd583-aa87-4ed3-80aa-623e900dd9a2 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:35.998239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecccd583-aa87-4ed3-80aa-623e900dd9a2 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:35.998239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecccd583-aa87-4ed3-80aa-623e900dd9a2 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:36.009726 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-ecccd583-aa87-4ed3-80aa-623e900dd9a2 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] HTTP exception thrown: Instance 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 could not be found. May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ecccd583-aa87-4ed3-80aa-623e900dd9a2 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Request method failure captured: May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 HTTP/1.1 May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAm8tLogtmDmdjpi_LN60g0HNIi7I2MHfgUrb9Ydlrd2CZtbDag6y8zw8R7ekeCx0wO-D59ls5MboUSNewjZFdASJUzQwDJUFzlHIwLNHo1uBpKBO44qZMhHMxSQkwpxmclxnsDU93WGCBW2HvWqowb8P8CxwqKSkIj1MCNtps236g May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 8047aaa6e1f7401fbcf4b4cd5dcd004e May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerPasswordTestJSON-647779815 May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8047aaa6e1f7401fbcf4b4cd5dcd004e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8047aaa6e1f7401fbcf4b4cd5dcd004e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8047aaa6e1f7401fbcf4b4cd5dcd004e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8047aaa6e1f7401fbcf4b4cd5dcd004e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerPasswordTestJSON-647779815 May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 8047aaa6e1f7401fbcf4b4cd5dcd004e May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerPasswordTestJSON-647779815 May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerPasswordTestJSON-647779815-project May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 2dd86b6dd9894aac971943b2fa859bd1 May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerPasswordTestJSON-647779815-project May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 could not be found. May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9'} May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 could not be found. May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 could not be found. May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:36.011322 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:36.015849 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:36.015849 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:36.015849 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:36.015849 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:36.015849 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:36.015849 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 could not be found. May 28 21:12:36.015849 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:36.015849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ecccd583-aa87-4ed3-80aa-623e900dd9a2 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] Returning 404 to user: Instance 0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:36.015849 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ecccd583-aa87-4ed3-80aa-623e900dd9a2 tempest-ServerPasswordTestJSON-647779815 tempest-ServerPasswordTestJSON-647779815-project] 10.222.0.33 "GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9" status: 404 len: 111 microversion: 2.1 time: 0.029536 May 28 21:12:36.015849 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1357/2681] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:35 2022] GET /compute/v2.1/servers/0dac67be-f7b5-4eb0-a9c2-91ea4880a5a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:36.017857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-3bd9a285-5866-4f00-b2f3-c1da8034e953 req-f8b43d2e-8b45-4a00-b33a-ee437ac46bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce53dda7-d501-475f-a4c0-73853a36630a", "tag": "197a0eea-120c-4af5-b57d-60f7eef43916"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:36.026645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3bd9a285-5866-4f00-b2f3-c1da8034e953 req-f8b43d2e-8b45-4a00-b33a-ee437ac46bce service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:36.027093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3bd9a285-5866-4f00-b2f3-c1da8034e953 req-f8b43d2e-8b45-4a00-b33a-ee437ac46bce service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:36.035294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:12:36.038405 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-3bd9a285-5866-4f00-b2f3-c1da8034e953 req-f8b43d2e-8b45-4a00-b33a-ee437ac46bce service nova] Creating event network-changed:197a0eea-120c-4af5-b57d-60f7eef43916 for instance ce53dda7-d501-475f-a4c0-73853a36630a on nch2-master-1 May 28 21:12:36.038620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f988fe9b-43f7-4336-8526-979ab3142238',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1896dbc5-1bc4-4ba7-a09c-f8a5a3e84615',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7ec9972-c33d-41d5-bf85-a57642501bd3',volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:12:36.044293 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-3bd9a285-5866-4f00-b2f3-c1da8034e953 req-f8b43d2e-8b45-4a00-b33a-ee437ac46bce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029646 May 28 21:12:36.045071 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1358/2682] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:36.066867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d529fbed-00ea-4756-b1fc-24754a9a70d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:36.068067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d529fbed-00ea-4756-b1fc-24754a9a70d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:36.077440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d529fbed-00ea-4756-b1fc-24754a9a70d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:36.078190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d529fbed-00ea-4756-b1fc-24754a9a70d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:36.079147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d529fbed-00ea-4756-b1fc-24754a9a70d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:36.079589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d529fbed-00ea-4756-b1fc-24754a9a70d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:36.322992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d529fbed-00ea-4756-b1fc-24754a9a70d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:36.331424 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d529fbed-00ea-4756-b1fc-24754a9a70d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1314 microversion: 2.1 time: 0.284971 May 28 21:12:36.332388 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1359/2683] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:36 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:36.337284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3c326be7-a47a-4446-9198-9a0351969586 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:36.337985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3c326be7-a47a-4446-9198-9a0351969586 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:36.348667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c326be7-a47a-4446-9198-9a0351969586 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:36.349810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c326be7-a47a-4446-9198-9a0351969586 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:36.350639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c326be7-a47a-4446-9198-9a0351969586 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:36.351084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c326be7-a47a-4446-9198-9a0351969586 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:36.380559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3c326be7-a47a-4446-9198-9a0351969586 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:12:36.743219 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3c326be7-a47a-4446-9198-9a0351969586 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "DELETE /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 204 len: 0 microversion: 2.1 time: 0.409390 May 28 21:12:36.743951 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1360/2684] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:12:36 2022] DELETE /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:12:36.749508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-f628bdb4-6ccb-47e6-917c-c7d5271757d4 req-907658fa-0f20-4b29-b090-2bed0b18fe4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5940795e-f9e1-4337-9ca6-72ade7d53426", "name": "network-vif-deleted", "tag": "2a5cab06-5081-4886-be72-7b50c3954f50"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:36.768562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f628bdb4-6ccb-47e6-917c-c7d5271757d4 req-907658fa-0f20-4b29-b090-2bed0b18fe4b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:36.769026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f628bdb4-6ccb-47e6-917c-c7d5271757d4 req-907658fa-0f20-4b29-b090-2bed0b18fe4b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:36.785023 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-f628bdb4-6ccb-47e6-917c-c7d5271757d4 req-907658fa-0f20-4b29-b090-2bed0b18fe4b service nova] Creating event network-vif-deleted:2a5cab06-5081-4886-be72-7b50c3954f50 for instance 5940795e-f9e1-4337-9ca6-72ade7d53426 on nch1-master-1 May 28 21:12:36.789985 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-f628bdb4-6ccb-47e6-917c-c7d5271757d4 req-907658fa-0f20-4b29-b090-2bed0b18fe4b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044637 May 28 21:12:36.790599 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1361/2685] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:36.798775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c9260d03-c68d-49d3-9726-cbf7bac2f1c0 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1357062056", "metadata": {"image_type": "test"}}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:36.799958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c9260d03-c68d-49d3-9726-cbf7bac2f1c0 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:36.806549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c9260d03-c68d-49d3-9726-cbf7bac2f1c0 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:36.807001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c9260d03-c68d-49d3-9726-cbf7bac2f1c0 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:36.807841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c9260d03-c68d-49d3-9726-cbf7bac2f1c0 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:36.808293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c9260d03-c68d-49d3-9726-cbf7bac2f1c0 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:36.823829 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-c9260d03-c68d-49d3-9726-cbf7bac2f1c0 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] HTTP exception thrown: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c9260d03-c68d-49d3-9726-cbf7bac2f1c0 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Request method failure captured: May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426/action HTTP/1.1 May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 112 May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAlbFYH6AeRjBPVqNHg6873-_1FzvTLr-J8xeJmMgIjTwx8ecOFPv9jVLq6gpqOYxGHzfsQJPlISCIEgm6agGWUlxBnRLTiJ7NygGYQrGQ3KY8J1TQRosyG59VnIvMmSzsIf-18KiRFxH6X8adJ3113Xyr-sRbjKKAo1-iTp1S3f3M May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 659cd6db8d6741329dded06813f0ef93 May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_659cd6db8d6741329dded06813f0ef93", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 659cd6db8d6741329dded06813f0ef93 May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesNegativeTestJSON-1975235587-project May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 0e36e381aa5a4e4196d4e994e70f586e May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesNegativeTestJSON-1975235587-project May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1357062056", "metadata": {"image_type": "test"}}} May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '5940795e-f9e1-4337-9ca6-72ade7d53426', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1357062056', 'metadata': {'image_type': 'test'}}}} May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 21:12:36.825710 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c9260d03-c68d-49d3-9726-cbf7bac2f1c0 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Returning 404 to user: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c9260d03-c68d-49d3-9726-cbf7bac2f1c0 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "POST /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426/action" status: 404 len: 111 microversion: 2.1 time: 0.035291 May 28 21:12:36.829596 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1362/2686] 10.222.0.33 () {60 vars in 1278 bytes} [Sat May 28 21:12:36 2022] POST /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:36.832709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb01cfb9-ad3b-4202-9482-66890cbb4086 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:36.833696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fb01cfb9-ad3b-4202-9482-66890cbb4086 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:36.841683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb01cfb9-ad3b-4202-9482-66890cbb4086 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:36.842368 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb01cfb9-ad3b-4202-9482-66890cbb4086 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:36.843306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb01cfb9-ad3b-4202-9482-66890cbb4086 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:36.844113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb01cfb9-ad3b-4202-9482-66890cbb4086 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:36.860569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=12 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:36.990441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fb01cfb9-ad3b-4202-9482-66890cbb4086 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:37.000960 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb01cfb9-ad3b-4202-9482-66890cbb4086 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1526 microversion: 2.1 time: 0.171842 May 28 21:12:37.002930 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1363/2687] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:36 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1526 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:37.019403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-692265cc-c8b3-4af2-9c05-91c8040eadab tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1197547348", "metadata": {"image_type": "test"}}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:37.020960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-692265cc-c8b3-4af2-9c05-91c8040eadab tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Failed to fetch instance by id tempest-invalid-1639038683 {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2926}} May 28 21:12:37.021827 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-692265cc-c8b3-4af2-9c05-91c8040eadab tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] HTTP exception thrown: Instance tempest-invalid-1639038683 could not be found. May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-692265cc-c8b3-4af2-9c05-91c8040eadab tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Request method failure captured: May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/tempest-invalid-1639038683/action HTTP/1.1 May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 112 May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAlbFYH6AeRjBPVqNHg6873-_1FzvTLr-J8xeJmMgIjTwx8ecOFPv9jVLq6gpqOYxGHzfsQJPlISCIEgm6agGWUlxBnRLTiJ7NygGYQrGQ3KY8J1TQRosyG59VnIvMmSzsIf-18KiRFxH6X8adJ3113Xyr-sRbjKKAo1-iTp1S3f3M May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 659cd6db8d6741329dded06813f0ef93 May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_659cd6db8d6741329dded06813f0ef93", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 659cd6db8d6741329dded06813f0ef93 May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesNegativeTestJSON-1975235587-project May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 0e36e381aa5a4e4196d4e994e70f586e May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesNegativeTestJSON-1975235587-project May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1197547348", "metadata": {"image_type": "test"}}} May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance tempest-invalid-1639038683 could not be found. May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'tempest-invalid-1639038683', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1197547348', 'metadata': {'image_type': 'test'}}}} May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1639038683 could not be found. May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:37.023775 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1639038683 could not be found. May 28 21:12:37.028118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.028118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:37.028118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.028118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:37.028118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:37.028118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:37.028118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:37.028118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:37.028118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1639038683 could not be found. May 28 21:12:37.028118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.028118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-692265cc-c8b3-4af2-9c05-91c8040eadab tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Returning 404 to user: Instance tempest-invalid-1639038683 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:37.028118 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-692265cc-c8b3-4af2-9c05-91c8040eadab tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "POST /compute/v2.1/servers/tempest-invalid-1639038683/action" status: 404 len: 101 microversion: 2.1 time: 0.014320 May 28 21:12:37.028118 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1364/2688] 10.222.0.33 () {60 vars in 1248 bytes} [Sat May 28 21:12:37 2022] POST /compute/v2.1/servers/tempest-invalid-1639038683/action => generated 101 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:37.033249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5d39b9d1-d76b-4815-a4c6-418c7372a1ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:37.034059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5d39b9d1-d76b-4815-a4c6-418c7372a1ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:37.042607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d39b9d1-d76b-4815-a4c6-418c7372a1ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:37.043080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d39b9d1-d76b-4815-a4c6-418c7372a1ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:37.044599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d39b9d1-d76b-4815-a4c6-418c7372a1ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:37.044599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d39b9d1-d76b-4815-a4c6-418c7372a1ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:37.202373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5d39b9d1-d76b-4815-a4c6-418c7372a1ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:37.211025 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5d39b9d1-d76b-4815-a4c6-418c7372a1ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.183655 May 28 21:12:37.211639 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1365/2689] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:37 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:37.216463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c8413532-6288-43af-8850-8ddd014e987a tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-149442337"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:37.217797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c8413532-6288-43af-8850-8ddd014e987a tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2926}} May 28 21:12:37.218561 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-c8413532-6288-43af-8850-8ddd014e987a tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c8413532-6288-43af-8850-8ddd014e987a tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Request method failure captured: May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 56 May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAlbFYH6AeRjBPVqNHg6873-_1FzvTLr-J8xeJmMgIjTwx8ecOFPv9jVLq6gpqOYxGHzfsQJPlISCIEgm6agGWUlxBnRLTiJ7NygGYQrGQ3KY8J1TQRosyG59VnIvMmSzsIf-18KiRFxH6X8adJ3113Xyr-sRbjKKAo1-iTp1S3f3M May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 659cd6db8d6741329dded06813f0ef93 May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_659cd6db8d6741329dded06813f0ef93", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 659cd6db8d6741329dded06813f0ef93 May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesNegativeTestJSON-1975235587-project May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 0e36e381aa5a4e4196d4e994e70f586e May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesNegativeTestJSON-1975235587-project May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: {"createImage": {"name": "tempest-test-snap-149442337"}} May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-149442337'}}} May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 21:12:37.220330 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.224337 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:37.224337 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.224337 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:37.224337 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:37.224337 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:37.224337 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:37.224337 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:37.224337 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 21:12:37.224337 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.224337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c8413532-6288-43af-8850-8ddd014e987a tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:37.224337 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c8413532-6288-43af-8850-8ddd014e987a tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.009210 May 28 21:12:37.224337 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1366/2690] 10.222.0.33 () {60 vars in 1274 bytes} [Sat May 28 21:12:37 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:37.233365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a33a9635-d114-4132-afed-32a6bce42f61 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-642480004"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:37.234644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a33a9635-d114-4132-afed-32a6bce42f61 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2926}} May 28 21:12:37.235161 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-a33a9635-d114-4132-afed-32a6bce42f61 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a33a9635-d114-4132-afed-32a6bce42f61 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Request method failure captured: May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 56 May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAlbFYH6AeRjBPVqNHg6873-_1FzvTLr-J8xeJmMgIjTwx8ecOFPv9jVLq6gpqOYxGHzfsQJPlISCIEgm6agGWUlxBnRLTiJ7NygGYQrGQ3KY8J1TQRosyG59VnIvMmSzsIf-18KiRFxH6X8adJ3113Xyr-sRbjKKAo1-iTp1S3f3M May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 659cd6db8d6741329dded06813f0ef93 May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_659cd6db8d6741329dded06813f0ef93", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 659cd6db8d6741329dded06813f0ef93 May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesNegativeTestJSON-1975235587-project May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 0e36e381aa5a4e4196d4e994e70f586e May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesNegativeTestJSON-1975235587-project May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: {"createImage": {"name": "tempest-test-snap-642480004"}} May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-642480004'}}} May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 21:12:37.238177 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.245232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:37.245232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.245232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:37.245232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:37.245232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:37.245232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:37.245232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:37.245232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. May 28 21:12:37.245232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.245232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a33a9635-d114-4132-afed-32a6bce42f61 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:37.245232 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a33a9635-d114-4132-afed-32a6bce42f61 tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010586 May 28 21:12:37.245232 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1367/2691] 10.222.0.33 () {60 vars in 1280 bytes} [Sat May 28 21:12:37 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:12:37.251133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9f9601ba-52e0-413b-b4d4-9a223a5e112d tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:37.251649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9f9601ba-52e0-413b-b4d4-9a223a5e112d tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:37.258894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f9601ba-52e0-413b-b4d4-9a223a5e112d tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:37.259428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f9601ba-52e0-413b-b4d4-9a223a5e112d tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:37.260530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f9601ba-52e0-413b-b4d4-9a223a5e112d tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:37.261041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f9601ba-52e0-413b-b4d4-9a223a5e112d tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:37.275995 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-9f9601ba-52e0-413b-b4d4-9a223a5e112d tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] HTTP exception thrown: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9f9601ba-52e0-413b-b4d4-9a223a5e112d tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Request method failure captured: May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 HTTP/1.1 May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAlbFYH6AeRjBPVqNHg6873-_1FzvTLr-J8xeJmMgIjTwx8ecOFPv9jVLq6gpqOYxGHzfsQJPlISCIEgm6agGWUlxBnRLTiJ7NygGYQrGQ3KY8J1TQRosyG59VnIvMmSzsIf-18KiRFxH6X8adJ3113Xyr-sRbjKKAo1-iTp1S3f3M May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 659cd6db8d6741329dded06813f0ef93 May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_659cd6db8d6741329dded06813f0ef93", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 659cd6db8d6741329dded06813f0ef93 May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesNegativeTestJSON-1975235587-project May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 0e36e381aa5a4e4196d4e994e70f586e May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesNegativeTestJSON-1975235587-project May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '5940795e-f9e1-4337-9ca6-72ade7d53426'} May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:12:37.277597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:37.285348 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:37.285348 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.285348 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:37.285348 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.285348 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:37.285348 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:37.285348 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:37.285348 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:37.285348 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:37.285348 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:37.285348 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.285348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9f9601ba-52e0-413b-b4d4-9a223a5e112d tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Returning 404 to user: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:37.285348 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9f9601ba-52e0-413b-b4d4-9a223a5e112d tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 404 len: 111 microversion: 2.1 time: 0.032938 May 28 21:12:37.285348 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1368/2692] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:12:37 2022] DELETE /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:12:37.291156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-544874cc-40ca-453b-be7a-807e936ec26e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:37.292323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-544874cc-40ca-453b-be7a-807e936ec26e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] [instance: 5940795e-f9e1-4337-9ca6-72ade7d53426] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:37.298459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-544874cc-40ca-453b-be7a-807e936ec26e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:37.298957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-544874cc-40ca-453b-be7a-807e936ec26e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:37.299731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-544874cc-40ca-453b-be7a-807e936ec26e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:37.300171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-544874cc-40ca-453b-be7a-807e936ec26e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:37.313930 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-544874cc-40ca-453b-be7a-807e936ec26e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] HTTP exception thrown: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-544874cc-40ca-453b-be7a-807e936ec26e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Request method failure captured: May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 HTTP/1.1 May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAlbFYH6AeRjBPVqNHg6873-_1FzvTLr-J8xeJmMgIjTwx8ecOFPv9jVLq6gpqOYxGHzfsQJPlISCIEgm6agGWUlxBnRLTiJ7NygGYQrGQ3KY8J1TQRosyG59VnIvMmSzsIf-18KiRFxH6X8adJ3113Xyr-sRbjKKAo1-iTp1S3f3M May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 659cd6db8d6741329dded06813f0ef93 May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_659cd6db8d6741329dded06813f0ef93", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/659cd6db8d6741329dded06813f0ef93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 659cd6db8d6741329dded06813f0ef93 May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975235587 May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesNegativeTestJSON-1975235587-project May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 0e36e381aa5a4e4196d4e994e70f586e May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesNegativeTestJSON-1975235587-project May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '5940795e-f9e1-4337-9ca6-72ade7d53426'} May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:37.315441 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.319329 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:37.319329 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:37.319329 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:37.319329 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:37.319329 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:37.319329 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. May 28 21:12:37.319329 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:12:37.319329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-544874cc-40ca-453b-be7a-807e936ec26e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] Returning 404 to user: Instance 5940795e-f9e1-4337-9ca6-72ade7d53426 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:37.319329 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-544874cc-40ca-453b-be7a-807e936ec26e tempest-ImagesNegativeTestJSON-1975235587 tempest-ImagesNegativeTestJSON-1975235587-project] 10.222.0.33 "GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426" status: 404 len: 111 microversion: 2.1 time: 0.032929 May 28 21:12:37.319329 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1369/2693] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:37 2022] GET /compute/v2.1/servers/5940795e-f9e1-4337-9ca6-72ade7d53426 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:37.349066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dfa28601-398b-4abe-b48a-8583de964db4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:37.349678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dfa28601-398b-4abe-b48a-8583de964db4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:37.358300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dfa28601-398b-4abe-b48a-8583de964db4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:37.358755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dfa28601-398b-4abe-b48a-8583de964db4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:37.359527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dfa28601-398b-4abe-b48a-8583de964db4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:37.359965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dfa28601-398b-4abe-b48a-8583de964db4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:37.428814 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c275b61d-09fd-417a-b0d2-2d115cd43248 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 5.791297 May 28 21:12:37.429468 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1325/2694] 10.222.0.33 () {62 vars in 1188 bytes} [Sat May 28 21:12:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 5793 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 21:12:37.443662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-415ed02f-655e-45d8-9111-bfcb177ce714 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:37.444689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-415ed02f-655e-45d8-9111-bfcb177ce714 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:37.524547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-415ed02f-655e-45d8-9111-bfcb177ce714 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:37.536904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-415ed02f-655e-45d8-9111-bfcb177ce714 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:37.553249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-415ed02f-655e-45d8-9111-bfcb177ce714 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:37.557788 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-415ed02f-655e-45d8-9111-bfcb177ce714 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1286 microversion: 2.32 time: 0.118051 May 28 21:12:37.558686 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1326/2695] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:37 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1286 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:12:37.563941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dfa28601-398b-4abe-b48a-8583de964db4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:37.575332 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dfa28601-398b-4abe-b48a-8583de964db4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1314 microversion: 2.1 time: 0.229661 May 28 21:12:37.576140 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1370/2696] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:37 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:12:37.806130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-f961097a-664a-4faf-859c-c5824f3184a8 req-8e7f5970-b009-4e98-b46c-0383b2968119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce53dda7-d501-475f-a4c0-73853a36630a", "name": "network-vif-plugged", "status": "completed", "tag": "197a0eea-120c-4af5-b57d-60f7eef43916"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:37.818081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f961097a-664a-4faf-859c-c5824f3184a8 req-8e7f5970-b009-4e98-b46c-0383b2968119 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:37.818741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f961097a-664a-4faf-859c-c5824f3184a8 req-8e7f5970-b009-4e98-b46c-0383b2968119 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:37.831409 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-f961097a-664a-4faf-859c-c5824f3184a8 req-8e7f5970-b009-4e98-b46c-0383b2968119 service nova] Creating event network-vif-plugged:197a0eea-120c-4af5-b57d-60f7eef43916 for instance ce53dda7-d501-475f-a4c0-73853a36630a on nch2-master-1 May 28 21:12:37.837771 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-f961097a-664a-4faf-859c-c5824f3184a8 req-8e7f5970-b009-4e98-b46c-0383b2968119 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035360 May 28 21:12:37.839612 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1327/2697] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:38.021158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a06e56fb-3b17-4164-8503-94d0f2ddddd2 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:38.022464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a06e56fb-3b17-4164-8503-94d0f2ddddd2 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:38.043733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a06e56fb-3b17-4164-8503-94d0f2ddddd2 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:38.043733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a06e56fb-3b17-4164-8503-94d0f2ddddd2 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:38.043733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a06e56fb-3b17-4164-8503-94d0f2ddddd2 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:38.043733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a06e56fb-3b17-4164-8503-94d0f2ddddd2 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:38.232728 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-80b6d576-ad74-49b5-a002-2b2f24187dcb tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:38.233424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-80b6d576-ad74-49b5-a002-2b2f24187dcb tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:38.252382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80b6d576-ad74-49b5-a002-2b2f24187dcb tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:38.252823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80b6d576-ad74-49b5-a002-2b2f24187dcb tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:38.253657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80b6d576-ad74-49b5-a002-2b2f24187dcb tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:38.255346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80b6d576-ad74-49b5-a002-2b2f24187dcb tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:38.624445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a06e56fb-3b17-4164-8503-94d0f2ddddd2 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:38.641749 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a06e56fb-3b17-4164-8503-94d0f2ddddd2 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1526 microversion: 2.1 time: 0.624895 May 28 21:12:38.643315 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1371/2698] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:38 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1526 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:38.650368 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fd127db8-8efe-480f-a8a5-c5ea19690fbc tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:38.651624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fd127db8-8efe-480f-a8a5-c5ea19690fbc tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:38.747652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fd127db8-8efe-480f-a8a5-c5ea19690fbc tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:38.753071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-80b6d576-ad74-49b5-a002-2b2f24187dcb tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:38.757119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fd127db8-8efe-480f-a8a5-c5ea19690fbc tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:38.761399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fd127db8-8efe-480f-a8a5-c5ea19690fbc tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:38.763543 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-80b6d576-ad74-49b5-a002-2b2f24187dcb tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.537885 May 28 21:12:38.764941 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fd127db8-8efe-480f-a8a5-c5ea19690fbc tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1286 microversion: 2.32 time: 0.119729 May 28 21:12:38.765062 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1328/2699] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:38 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:38.770776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0cdfdfb5-bec5-4053-b312-b31491eaabc4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:38.771782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0cdfdfb5-bec5-4053-b312-b31491eaabc4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:38.779453 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1372/2700] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:38 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1286 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:38.785647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0cdfdfb5-bec5-4053-b312-b31491eaabc4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:38.786344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0cdfdfb5-bec5-4053-b312-b31491eaabc4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:38.787124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0cdfdfb5-bec5-4053-b312-b31491eaabc4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:38.787723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0cdfdfb5-bec5-4053-b312-b31491eaabc4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:38.997221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0cdfdfb5-bec5-4053-b312-b31491eaabc4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:39.006475 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0cdfdfb5-bec5-4053-b312-b31491eaabc4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1314 microversion: 2.1 time: 0.240336 May 28 21:12:39.007060 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1329/2701] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:38 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:39.250183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-16b5c6db-8660-457a-896f-305641d3a015 req-c012444d-6437-4ecd-9a71-87746bff0824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a4cf15-02b5-42d1-ae2f-849ca1ec8d35", "name": "network-vif-deleted", "tag": "825989f5-1b0d-4731-92b8-dabd0a2be976"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:39.259604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-16b5c6db-8660-457a-896f-305641d3a015 req-c012444d-6437-4ecd-9a71-87746bff0824 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:39.260672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-16b5c6db-8660-457a-896f-305641d3a015 req-c012444d-6437-4ecd-9a71-87746bff0824 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:39.271468 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-16b5c6db-8660-457a-896f-305641d3a015 req-c012444d-6437-4ecd-9a71-87746bff0824 service nova] Creating event network-vif-deleted:825989f5-1b0d-4731-92b8-dabd0a2be976 for instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 on nch2-master-1 May 28 21:12:39.276315 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-16b5c6db-8660-457a-896f-305641d3a015 req-c012444d-6437-4ecd-9a71-87746bff0824 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030306 May 28 21:12:39.276920 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1373/2702] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:39.665305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-558da7e1-1458-48fa-9145-02c94b7aa0f0 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:39.667139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-558da7e1-1458-48fa-9145-02c94b7aa0f0 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:39.678185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-558da7e1-1458-48fa-9145-02c94b7aa0f0 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:39.679153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-558da7e1-1458-48fa-9145-02c94b7aa0f0 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:39.680152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-558da7e1-1458-48fa-9145-02c94b7aa0f0 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:39.680743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-558da7e1-1458-48fa-9145-02c94b7aa0f0 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:39.759061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-558da7e1-1458-48fa-9145-02c94b7aa0f0 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:39.759577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-558da7e1-1458-48fa-9145-02c94b7aa0f0 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:39.759978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-558da7e1-1458-48fa-9145-02c94b7aa0f0 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lazy-loading 'fault' on Instance uuid 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:12:39.823923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-558da7e1-1458-48fa-9145-02c94b7aa0f0 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04ae3115a9194b47bce62ada4a2afdf2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d08be7a2d1e4b779987d75d87a5ef44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:39.831934 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-558da7e1-1458-48fa-9145-02c94b7aa0f0 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 200 len: 1314 microversion: 2.1 time: 0.170803 May 28 21:12:39.846518 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1330/2703] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:39 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:39.846518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-154996b2-0b07-43f3-9083-968f9dbdddee tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:39.846518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-154996b2-0b07-43f3-9083-968f9dbdddee tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:39.846518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-154996b2-0b07-43f3-9083-968f9dbdddee tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:39.847007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-154996b2-0b07-43f3-9083-968f9dbdddee tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:39.847503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-154996b2-0b07-43f3-9083-968f9dbdddee tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:39.847943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-154996b2-0b07-43f3-9083-968f9dbdddee tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:39.865174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:SELECT=93,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:39.989639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-297b878f-8948-4e03-8cd8-b3bed33e3678 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-805437256", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": "none"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:39.989971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-154996b2-0b07-43f3-9083-968f9dbdddee tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:39.995884 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-154996b2-0b07-43f3-9083-968f9dbdddee tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.161289 May 28 21:12:39.997901 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1331/2704] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:39 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:40.002294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-55c02dd2-b470-4a19-8147-393e76b84eb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:40.002955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-55c02dd2-b470-4a19-8147-393e76b84eb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:40.020306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55c02dd2-b470-4a19-8147-393e76b84eb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:40.022080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55c02dd2-b470-4a19-8147-393e76b84eb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:40.022211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55c02dd2-b470-4a19-8147-393e76b84eb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:40.022655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55c02dd2-b470-4a19-8147-393e76b84eb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:40.081025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-297b878f-8948-4e03-8cd8-b3bed33e3678 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:12:40.082428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-297b878f-8948-4e03-8cd8-b3bed33e3678 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:12:40.083034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-297b878f-8948-4e03-8cd8-b3bed33e3678 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:12:40.084773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-297b878f-8948-4e03-8cd8-b3bed33e3678 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:12:40.086406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-297b878f-8948-4e03-8cd8-b3bed33e3678 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:12:40.098144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-297b878f-8948-4e03-8cd8-b3bed33e3678 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:40.098987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-297b878f-8948-4e03-8cd8-b3bed33e3678 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:40.099914 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-297b878f-8948-4e03-8cd8-b3bed33e3678 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:40.100665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-297b878f-8948-4e03-8cd8-b3bed33e3678 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:40.113041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:40.123554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-297b878f-8948-4e03-8cd8-b3bed33e3678 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Getting quotas for project d64af7d364a74dc6b9c527532a5d8abd. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:40.134357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-297b878f-8948-4e03-8cd8-b3bed33e3678 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Getting quotas for user 752fbb20c21449bb80bc9de2da474865 and project d64af7d364a74dc6b9c527532a5d8abd. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:40.146564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-297b878f-8948-4e03-8cd8-b3bed33e3678 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:12:40.149032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-297b878f-8948-4e03-8cd8-b3bed33e3678 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:12:40.188049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-55c02dd2-b470-4a19-8147-393e76b84eb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:40.198992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-55c02dd2-b470-4a19-8147-393e76b84eb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:40.200560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-55c02dd2-b470-4a19-8147-393e76b84eb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:40.202010 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-55c02dd2-b470-4a19-8147-393e76b84eb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1528 microversion: 2.32 time: 0.203173 May 28 21:12:40.202580 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1332/2705] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:39 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1528 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:40.218791 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-39078031-ba2b-420c-acc3-b285a8293afe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:40.220643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-39078031-ba2b-420c-acc3-b285a8293afe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:40.225548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39078031-ba2b-420c-acc3-b285a8293afe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:40.226056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39078031-ba2b-420c-acc3-b285a8293afe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:40.226841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39078031-ba2b-420c-acc3-b285a8293afe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:40.227287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39078031-ba2b-420c-acc3-b285a8293afe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:40.295308 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-297b878f-8948-4e03-8cd8-b3bed33e3678 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.521159 May 28 21:12:40.301773 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1374/2706] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:12:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 28 21:12:40.307290 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-396b4b8e-bf97-4e3f-88f5-9ca55efcba5e tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:40.308225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-396b4b8e-bf97-4e3f-88f5-9ca55efcba5e tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:40.393272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-396b4b8e-bf97-4e3f-88f5-9ca55efcba5e tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:40.408838 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-396b4b8e-bf97-4e3f-88f5-9ca55efcba5e tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:40.423175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-396b4b8e-bf97-4e3f-88f5-9ca55efcba5e tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:40.429531 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-396b4b8e-bf97-4e3f-88f5-9ca55efcba5e tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1277 microversion: 2.54 time: 0.122432 May 28 21:12:40.430080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-39078031-ba2b-420c-acc3-b285a8293afe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:40.446490 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1375/2707] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:40 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1277 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:40.452346 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-39078031-ba2b-420c-acc3-b285a8293afe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1502 microversion: 2.1 time: 0.248359 May 28 21:12:40.455762 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1333/2708] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:40 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:40.479677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-afa89099-bb09-47c3-b999-146ffb739b84 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:40.490610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-afa89099-bb09-47c3-b999-146ffb739b84 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:40.494536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afa89099-bb09-47c3-b999-146ffb739b84 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:40.498026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afa89099-bb09-47c3-b999-146ffb739b84 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:40.500216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afa89099-bb09-47c3-b999-146ffb739b84 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:40.510983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afa89099-bb09-47c3-b999-146ffb739b84 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:40.558060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-afa89099-bb09-47c3-b999-146ffb739b84 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lazy-loading 'flavor' on Instance uuid ce53dda7-d501-475f-a4c0-73853a36630a {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:12:40.852814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b388dc13-ee92-4013-9fa8-c4a729f80911 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:40.854962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b388dc13-ee92-4013-9fa8-c4a729f80911 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] [instance: 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:40.874281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b388dc13-ee92-4013-9fa8-c4a729f80911 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:40.875021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b388dc13-ee92-4013-9fa8-c4a729f80911 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:40.875982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b388dc13-ee92-4013-9fa8-c4a729f80911 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:40.876427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b388dc13-ee92-4013-9fa8-c4a729f80911 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:40.893392 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-b388dc13-ee92-4013-9fa8-c4a729f80911 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] HTTP exception thrown: Instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 could not be found. May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b388dc13-ee92-4013-9fa8-c4a729f80911 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Request method failure captured: May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 HTTP/1.1 May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_5hNM14SyxGy7pIAZpEILymcxSG05alvy6v_YG3Mq-2gRi8bBiJB7-zN4dhukVG5VT5nHinUhZDy6KVP_9T3Ei64UuVP5vDBsmGKeQoe0oLBUKwXo4BOle8dmU_eNql98NHdDQhjYbAd8fhs-VXsJjcp1ynznAlV2611L-oTN6srw May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 9d08be7a2d1e4b779987d75d87a5ef44 May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-875612888 May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_9d08be7a2d1e4b779987d75d87a5ef44", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d08be7a2d1e4b779987d75d87a5ef44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/9d08be7a2d1e4b779987d75d87a5ef44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/9d08be7a2d1e4b779987d75d87a5ef44"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-875612888 May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 9d08be7a2d1e4b779987d75d87a5ef44 May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-875612888 May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-FloatingIPsAssociationTestJSON-875612888-project May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 04ae3115a9194b47bce62ada4a2afdf2 May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-875612888-project May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 could not be found. May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '50a4cf15-02b5-42d1-ae2f-849ca1ec8d35'} May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 could not be found. May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 could not be found. May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:40.895728 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:40.899538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:40.899538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:40.899538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:40.899538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:40.899538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:40.899538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:40.899538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 could not be found. May 28 21:12:40.899538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:40.901408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b388dc13-ee92-4013-9fa8-c4a729f80911 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] Returning 404 to user: Instance 50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:40.902529 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b388dc13-ee92-4013-9fa8-c4a729f80911 tempest-FloatingIPsAssociationTestJSON-875612888 tempest-FloatingIPsAssociationTestJSON-875612888-project] 10.222.0.33 "GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35" status: 404 len: 111 microversion: 2.1 time: 0.056605 May 28 21:12:40.903310 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1334/2709] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:40 2022] GET /compute/v2.1/servers/50a4cf15-02b5-42d1-ae2f-849ca1ec8d35 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:12:41.179055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c60c0bd-33d4-4a28-a8a6-aa3aaf541b2b tempest-ListImageFiltersNegativeTestJSON-443079050 tempest-ListImageFiltersNegativeTestJSON-443079050-project] Calling method '.version_select at 0x7f4d64188040>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:41.200975 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-3c60c0bd-33d4-4a28-a8a6-aa3aaf541b2b tempest-ListImageFiltersNegativeTestJSON-443079050 tempest-ListImageFiltersNegativeTestJSON-443079050-project] HTTP exception thrown: Image not found. May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c60c0bd-33d4-4a28-a8a6-aa3aaf541b2b tempest-ListImageFiltersNegativeTestJSON-443079050 tempest-ListImageFiltersNegativeTestJSON-443079050-project] Request method failure captured: May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/images/78af6cb9-72c1-4a28-b9c2-021b501d0299 HTTP/1.1 May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpBIs9Yk6b7tK1Otkx6vttZLmssnDGLDbC42zuTMnZRZIcb0_bhy70jCodFrpwCVK23SSBg6KOIFSzYZTba3QDvTfiH20yJvz8Eb8mj30ryB6eBZJxJpYz3uWcvb60bHABN-CKeLoS3mZEqrxy7xLH0MCyvx6LU4aU1el4vOVCDmnRk May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 7f665b043fd24ef986c43932f44d66d3 May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-443079050 May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_7f665b043fd24ef986c43932f44d66d3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7f665b043fd24ef986c43932f44d66d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/7f665b043fd24ef986c43932f44d66d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/7f665b043fd24ef986c43932f44d66d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-443079050 May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 7f665b043fd24ef986c43932f44d66d3 May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-443079050 May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ListImageFiltersNegativeTestJSON-443079050-project May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 34509fc3349248e9acfee855487f92d6 May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-443079050-project May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: exception: Image not found. May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '78af6cb9-72c1-4a28-b9c2-021b501d0299'} May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 78af6cb9-72c1-4a28-b9c2-021b501d0299 May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 21:12:41.203066 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 78af6cb9-72c1-4a28-b9c2-021b501d0299 could not be found. May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c60c0bd-33d4-4a28-a8a6-aa3aaf541b2b tempest-ListImageFiltersNegativeTestJSON-443079050 tempest-ListImageFiltersNegativeTestJSON-443079050-project] Returning 404 to user: Image not found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3c60c0bd-33d4-4a28-a8a6-aa3aaf541b2b tempest-ListImageFiltersNegativeTestJSON-443079050 tempest-ListImageFiltersNegativeTestJSON-443079050-project] 10.222.0.33 "GET /compute/v2.1/images/78af6cb9-72c1-4a28-b9c2-021b501d0299" status: 404 len: 62 microversion: 2.1 time: 0.212023 May 28 21:12:41.207506 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1335/2710] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:12:40 2022] GET /compute/v2.1/images/78af6cb9-72c1-4a28-b9c2-021b501d0299 => generated 62 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 21:12:41.212547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9c205b0f-0641-4ea7-97e7-b9ad49b44d5f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:41.226274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9c205b0f-0641-4ea7-97e7-b9ad49b44d5f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:41.248033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c205b0f-0641-4ea7-97e7-b9ad49b44d5f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:41.248498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c205b0f-0641-4ea7-97e7-b9ad49b44d5f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:41.250259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c205b0f-0641-4ea7-97e7-b9ad49b44d5f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:41.250723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c205b0f-0641-4ea7-97e7-b9ad49b44d5f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:41.290302 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-afa89099-bb09-47c3-b999-146ffb739b84 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "POST /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a/action" status: 202 len: 0 microversion: 2.1 time: 0.816649 May 28 21:12:41.290995 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1376/2711] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:12:40 2022] POST /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a/action => generated 0 bytes in 818 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:12:41.309332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c9fa3866-f12e-4f5f-acfd-3110f702bfb0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:41.310098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c9fa3866-f12e-4f5f-acfd-3110f702bfb0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:41.320375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c9fa3866-f12e-4f5f-acfd-3110f702bfb0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:41.320843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c9fa3866-f12e-4f5f-acfd-3110f702bfb0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:41.321672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c9fa3866-f12e-4f5f-acfd-3110f702bfb0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:41.322827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c9fa3866-f12e-4f5f-acfd-3110f702bfb0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:41.476045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c9fa3866-f12e-4f5f-acfd-3110f702bfb0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:41.502266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c9fa3866-f12e-4f5f-acfd-3110f702bfb0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:41.503876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c9fa3866-f12e-4f5f-acfd-3110f702bfb0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:41.511102 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c9fa3866-f12e-4f5f-acfd-3110f702bfb0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1576 microversion: 2.32 time: 0.212531 May 28 21:12:41.522642 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1377/2712] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:41 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:41.532804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9c205b0f-0641-4ea7-97e7-b9ad49b44d5f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:41.536161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6b8d8a01-5072-49be-a27d-9464aa8b9bac tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:41.536161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6b8d8a01-5072-49be-a27d-9464aa8b9bac tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:41.545762 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9c205b0f-0641-4ea7-97e7-b9ad49b44d5f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.339320 May 28 21:12:41.547037 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1336/2713] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:41 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:41.550410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b8d8a01-5072-49be-a27d-9464aa8b9bac tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:41.551073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b8d8a01-5072-49be-a27d-9464aa8b9bac tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:41.555812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-78e27ff5-0a3b-4f28-80c0-e57a321d64b5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:41.555812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-78e27ff5-0a3b-4f28-80c0-e57a321d64b5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:41.557060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b8d8a01-5072-49be-a27d-9464aa8b9bac tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:41.557687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b8d8a01-5072-49be-a27d-9464aa8b9bac tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:41.561682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:41.698175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-78e27ff5-0a3b-4f28-80c0-e57a321d64b5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:41.706726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-78e27ff5-0a3b-4f28-80c0-e57a321d64b5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:41.708147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-78e27ff5-0a3b-4f28-80c0-e57a321d64b5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:41.709314 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-78e27ff5-0a3b-4f28-80c0-e57a321d64b5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1277 microversion: 2.54 time: 0.160996 May 28 21:12:41.710184 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1337/2714] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:41 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:41.836608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6b8d8a01-5072-49be-a27d-9464aa8b9bac tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:41.850946 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6b8d8a01-5072-49be-a27d-9464aa8b9bac tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1508 microversion: 2.1 time: 0.326826 May 28 21:12:41.856688 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1378/2715] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:41 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1508 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:42.535100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-981bf39e-f2ee-44cf-a479-5e75436d5e80 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:42.536332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-981bf39e-f2ee-44cf-a479-5e75436d5e80 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:42.560316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-981bf39e-f2ee-44cf-a479-5e75436d5e80 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:42.563761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-981bf39e-f2ee-44cf-a479-5e75436d5e80 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:42.563761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-981bf39e-f2ee-44cf-a479-5e75436d5e80 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:42.563761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-981bf39e-f2ee-44cf-a479-5e75436d5e80 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:42.570406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fd8ac267-88fa-4ab3-bc1a-bafa3fdfde35 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:42.573235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fd8ac267-88fa-4ab3-bc1a-bafa3fdfde35 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:42.594734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd8ac267-88fa-4ab3-bc1a-bafa3fdfde35 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:42.595355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd8ac267-88fa-4ab3-bc1a-bafa3fdfde35 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:42.599408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd8ac267-88fa-4ab3-bc1a-bafa3fdfde35 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:42.599923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd8ac267-88fa-4ab3-bc1a-bafa3fdfde35 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:42.803274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-981bf39e-f2ee-44cf-a479-5e75436d5e80 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:42.821542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-981bf39e-f2ee-44cf-a479-5e75436d5e80 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:42.823148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-981bf39e-f2ee-44cf-a479-5e75436d5e80 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:42.824326 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-981bf39e-f2ee-44cf-a479-5e75436d5e80 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1594 microversion: 2.32 time: 0.297432 May 28 21:12:42.824883 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1338/2716] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:42 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1594 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:42.831813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2e691290-c5fc-4d50-b15f-7525e7242778 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:42.835953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2e691290-c5fc-4d50-b15f-7525e7242778 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:42.858605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e691290-c5fc-4d50-b15f-7525e7242778 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:42.859150 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e691290-c5fc-4d50-b15f-7525e7242778 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:42.860002 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e691290-c5fc-4d50-b15f-7525e7242778 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:42.860454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e691290-c5fc-4d50-b15f-7525e7242778 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:43.032552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2e691290-c5fc-4d50-b15f-7525e7242778 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:43.058201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2e691290-c5fc-4d50-b15f-7525e7242778 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:43.060261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2e691290-c5fc-4d50-b15f-7525e7242778 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:43.061985 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2e691290-c5fc-4d50-b15f-7525e7242778 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1329 microversion: 2.54 time: 0.233563 May 28 21:12:43.064902 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1339/2717] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:42 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1329 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:43.078422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b0e8e5cd-c1dc-474c-a0ac-62128d7eea4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:43.078557 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b0e8e5cd-c1dc-474c-a0ac-62128d7eea4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:43.089697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0e8e5cd-c1dc-474c-a0ac-62128d7eea4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:43.090426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0e8e5cd-c1dc-474c-a0ac-62128d7eea4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:43.091409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0e8e5cd-c1dc-474c-a0ac-62128d7eea4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:43.092016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0e8e5cd-c1dc-474c-a0ac-62128d7eea4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:43.299806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fd8ac267-88fa-4ab3-bc1a-bafa3fdfde35 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:43.307751 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fd8ac267-88fa-4ab3-bc1a-bafa3fdfde35 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.746104 May 28 21:12:43.317257 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1379/2718] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:42 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:43.387339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b0e8e5cd-c1dc-474c-a0ac-62128d7eea4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:43.399742 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b0e8e5cd-c1dc-474c-a0ac-62128d7eea4b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1508 microversion: 2.1 time: 0.331537 May 28 21:12:43.401290 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1340/2719] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:43 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1508 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:43.847020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4451a780-0108-4e1d-8bac-506aecf1e2a9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:43.848415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4451a780-0108-4e1d-8bac-506aecf1e2a9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:43.863746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4451a780-0108-4e1d-8bac-506aecf1e2a9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:43.866909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4451a780-0108-4e1d-8bac-506aecf1e2a9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:43.872015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4451a780-0108-4e1d-8bac-506aecf1e2a9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:43.872808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4451a780-0108-4e1d-8bac-506aecf1e2a9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:44.086157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1da05ece-71ec-4b0a-9d9b-de14cd071f6b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:44.086972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1da05ece-71ec-4b0a-9d9b-de14cd071f6b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:44.101026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1da05ece-71ec-4b0a-9d9b-de14cd071f6b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:44.101493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1da05ece-71ec-4b0a-9d9b-de14cd071f6b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:44.102333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1da05ece-71ec-4b0a-9d9b-de14cd071f6b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:44.102772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1da05ece-71ec-4b0a-9d9b-de14cd071f6b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:44.164921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4451a780-0108-4e1d-8bac-506aecf1e2a9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:44.180427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4451a780-0108-4e1d-8bac-506aecf1e2a9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:44.185540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4451a780-0108-4e1d-8bac-506aecf1e2a9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:44.187348 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4451a780-0108-4e1d-8bac-506aecf1e2a9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1661 microversion: 2.32 time: 0.346524 May 28 21:12:44.205904 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1380/2720] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:43 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1661 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:44.216176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1da05ece-71ec-4b0a-9d9b-de14cd071f6b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:44.233522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1da05ece-71ec-4b0a-9d9b-de14cd071f6b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:44.238754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1da05ece-71ec-4b0a-9d9b-de14cd071f6b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:44.241867 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1da05ece-71ec-4b0a-9d9b-de14cd071f6b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1335 microversion: 2.54 time: 0.159750 May 28 21:12:44.246123 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1341/2721] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:44 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1335 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:12:44.325237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cd292595-dd77-4bb3-a6a0-f912eea641b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:44.325886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cd292595-dd77-4bb3-a6a0-f912eea641b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:44.335738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd292595-dd77-4bb3-a6a0-f912eea641b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:44.336299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd292595-dd77-4bb3-a6a0-f912eea641b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:44.337186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd292595-dd77-4bb3-a6a0-f912eea641b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:44.337729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd292595-dd77-4bb3-a6a0-f912eea641b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:44.418435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9f0d758c-9b5f-447c-9ee5-b5c87dbaeada tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:44.419053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9f0d758c-9b5f-447c-9ee5-b5c87dbaeada tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:44.438047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f0d758c-9b5f-447c-9ee5-b5c87dbaeada tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:44.438047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f0d758c-9b5f-447c-9ee5-b5c87dbaeada tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:44.438047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f0d758c-9b5f-447c-9ee5-b5c87dbaeada tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:44.438047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f0d758c-9b5f-447c-9ee5-b5c87dbaeada tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:44.778725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9f0d758c-9b5f-447c-9ee5-b5c87dbaeada tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:44.779930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cd292595-dd77-4bb3-a6a0-f912eea641b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:44.787851 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9f0d758c-9b5f-447c-9ee5-b5c87dbaeada tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1508 microversion: 2.1 time: 0.373838 May 28 21:12:44.798217 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1342/2722] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:44 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1508 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:44.809313 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cd292595-dd77-4bb3-a6a0-f912eea641b2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.486508 May 28 21:12:44.810936 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1381/2723] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:44 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:45.032281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8d82aa25-fac9-4d23-b06c-2b5800e8b510 tempest-AbsoluteLimitsTestJSON-103111735 tempest-AbsoluteLimitsTestJSON-103111735-project] Calling method '.version_select at 0x7f4d575d54c0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:45.048441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d82aa25-fac9-4d23-b06c-2b5800e8b510 tempest-AbsoluteLimitsTestJSON-103111735 tempest-AbsoluteLimitsTestJSON-103111735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:45.049363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d82aa25-fac9-4d23-b06c-2b5800e8b510 tempest-AbsoluteLimitsTestJSON-103111735 tempest-AbsoluteLimitsTestJSON-103111735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:45.051201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d82aa25-fac9-4d23-b06c-2b5800e8b510 tempest-AbsoluteLimitsTestJSON-103111735 tempest-AbsoluteLimitsTestJSON-103111735-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:45.057854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d82aa25-fac9-4d23-b06c-2b5800e8b510 tempest-AbsoluteLimitsTestJSON-103111735 tempest-AbsoluteLimitsTestJSON-103111735-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:45.085225 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8d82aa25-fac9-4d23-b06c-2b5800e8b510 tempest-AbsoluteLimitsTestJSON-103111735 tempest-AbsoluteLimitsTestJSON-103111735-project] 10.222.0.33 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.244069 May 28 21:12:45.094161 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1343/2724] 10.222.0.33 () {58 vars in 1121 bytes} [Sat May 28 21:12:44 2022] GET /compute/v2.1/limits => generated 511 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:45.213832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-acb00d5f-1608-4d58-9300-0f39950abca2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:45.215307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-acb00d5f-1608-4d58-9300-0f39950abca2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:45.219549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:45.231744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-acb00d5f-1608-4d58-9300-0f39950abca2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:45.234227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-acb00d5f-1608-4d58-9300-0f39950abca2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:45.235623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-acb00d5f-1608-4d58-9300-0f39950abca2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:45.238489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-acb00d5f-1608-4d58-9300-0f39950abca2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:45.267016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ac2e6c87-d838-459a-86e7-17a81ce8e490 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:45.268540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ac2e6c87-d838-459a-86e7-17a81ce8e490 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:45.292899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac2e6c87-d838-459a-86e7-17a81ce8e490 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:45.298447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac2e6c87-d838-459a-86e7-17a81ce8e490 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:45.307282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac2e6c87-d838-459a-86e7-17a81ce8e490 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:45.307282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac2e6c87-d838-459a-86e7-17a81ce8e490 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:45.820127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ac2e6c87-d838-459a-86e7-17a81ce8e490 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:45.836087 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ac2e6c87-d838-459a-86e7-17a81ce8e490 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:45.838810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ac2e6c87-d838-459a-86e7-17a81ce8e490 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:45.839517 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ac2e6c87-d838-459a-86e7-17a81ce8e490 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1335 microversion: 2.54 time: 0.582144 May 28 21:12:45.841819 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1344/2725] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:45 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1335 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:12:45.851027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-663feec1-4b4b-4599-bdf1-ddd86381b04e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:45.851027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-663feec1-4b4b-4599-bdf1-ddd86381b04e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:45.866968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-663feec1-4b4b-4599-bdf1-ddd86381b04e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:45.867642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-663feec1-4b4b-4599-bdf1-ddd86381b04e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:45.868625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-663feec1-4b4b-4599-bdf1-ddd86381b04e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:45.872429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-663feec1-4b4b-4599-bdf1-ddd86381b04e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:46.100188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-acb00d5f-1608-4d58-9300-0f39950abca2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:46.119636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-acb00d5f-1608-4d58-9300-0f39950abca2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:46.121778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-acb00d5f-1608-4d58-9300-0f39950abca2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:46.123277 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-acb00d5f-1608-4d58-9300-0f39950abca2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1707 microversion: 2.32 time: 0.915229 May 28 21:12:46.124078 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1382/2726] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:45 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1707 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:46.132221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d8d5fc4a-3899-443f-9bcf-99f23fc2c885 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:46.136945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d8d5fc4a-3899-443f-9bcf-99f23fc2c885 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:46.145414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8d5fc4a-3899-443f-9bcf-99f23fc2c885 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:46.146098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8d5fc4a-3899-443f-9bcf-99f23fc2c885 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:46.146897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8d5fc4a-3899-443f-9bcf-99f23fc2c885 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:46.147344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8d5fc4a-3899-443f-9bcf-99f23fc2c885 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:46.204003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-663feec1-4b4b-4599-bdf1-ddd86381b04e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:46.212144 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-663feec1-4b4b-4599-bdf1-ddd86381b04e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1508 microversion: 2.1 time: 0.369163 May 28 21:12:46.213140 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1345/2727] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:45 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1508 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:46.337362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d8d5fc4a-3899-443f-9bcf-99f23fc2c885 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:46.347078 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d8d5fc4a-3899-443f-9bcf-99f23fc2c885 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.221557 May 28 21:12:46.347663 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1383/2728] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:46 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:46.859438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ba09ad18-58f9-4e40-b68a-6872add3e68d tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:46.860141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ba09ad18-58f9-4e40-b68a-6872add3e68d tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:46.873107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba09ad18-58f9-4e40-b68a-6872add3e68d tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:46.873580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba09ad18-58f9-4e40-b68a-6872add3e68d tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:46.874454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba09ad18-58f9-4e40-b68a-6872add3e68d tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:46.875069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba09ad18-58f9-4e40-b68a-6872add3e68d tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:47.066345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ba09ad18-58f9-4e40-b68a-6872add3e68d tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:47.078932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ba09ad18-58f9-4e40-b68a-6872add3e68d tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:47.082191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ba09ad18-58f9-4e40-b68a-6872add3e68d tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:47.085320 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ba09ad18-58f9-4e40-b68a-6872add3e68d tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1356 microversion: 2.54 time: 0.230830 May 28 21:12:47.087647 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1346/2729] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:46 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1356 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:47.113313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5e427afc-7898-419e-8d62-c32f84b1cdd8 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Action: 'create', calling method: .version_select at 0x7f4d5738b790>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1059017657", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHIumtv9Q5+KDz17OJK7ROj6Ikw0vowyAT/Yk3dheGjjLXWikbLPCQg1tjRXB6QCANBgt1fo5IR4expHAxSsXivIqf+u1wHK37Gnv3fkozW7Qp0YtXIjkgoiV6/zWThPw=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:47.136804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-5e427afc-7898-419e-8d62-c32f84b1cdd8 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Getting quotas for project d64af7d364a74dc6b9c527532a5d8abd. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:47.143521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-5e427afc-7898-419e-8d62-c32f84b1cdd8 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Getting quotas for user 752fbb20c21449bb80bc9de2da474865 and project d64af7d364a74dc6b9c527532a5d8abd. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:47.146973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b0b39838-3e06-4bc4-ac2c-33d90adc7ab3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:47.147785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b0b39838-3e06-4bc4-ac2c-33d90adc7ab3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:47.162670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0b39838-3e06-4bc4-ac2c-33d90adc7ab3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:47.163549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0b39838-3e06-4bc4-ac2c-33d90adc7ab3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:47.168387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0b39838-3e06-4bc4-ac2c-33d90adc7ab3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:47.169179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0b39838-3e06-4bc4-ac2c-33d90adc7ab3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:47.237207 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5e427afc-7898-419e-8d62-c32f84b1cdd8 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.130797 May 28 21:12:47.243616 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1384/2730] 10.222.0.33 () {62 vars in 1199 bytes} [Sat May 28 21:12:47 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 28 21:12:47.251495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-11945cc1-7f56-445c-8449-0c485169b80b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:47.258463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-11945cc1-7f56-445c-8449-0c485169b80b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:47.279720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11945cc1-7f56-445c-8449-0c485169b80b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:47.281591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11945cc1-7f56-445c-8449-0c485169b80b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:47.282587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11945cc1-7f56-445c-8449-0c485169b80b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:47.284611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11945cc1-7f56-445c-8449-0c485169b80b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:47.780076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-11945cc1-7f56-445c-8449-0c485169b80b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:47.793933 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-11945cc1-7f56-445c-8449-0c485169b80b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1508 microversion: 2.1 time: 0.548238 May 28 21:12:47.798176 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1385/2731] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:47 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1508 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:47.808639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1059017657", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:47.810943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:47.825721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:47.826239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:47.827204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:47.827786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:47.896968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b0b39838-3e06-4bc4-ac2c-33d90adc7ab3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:47.917647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b0b39838-3e06-4bc4-ac2c-33d90adc7ab3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:47.920781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b0b39838-3e06-4bc4-ac2c-33d90adc7ab3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:47.937220 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b0b39838-3e06-4bc4-ac2c-33d90adc7ab3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1753 microversion: 2.32 time: 0.781692 May 28 21:12:47.937913 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1347/2732] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:47 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1753 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:47.962370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-19ce86f8-ba0b-4b51-a6a0-81cfdbfb89e6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:47.967392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-19ce86f8-ba0b-4b51-a6a0-81cfdbfb89e6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:47.987539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19ce86f8-ba0b-4b51-a6a0-81cfdbfb89e6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:47.987996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19ce86f8-ba0b-4b51-a6a0-81cfdbfb89e6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:47.992643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19ce86f8-ba0b-4b51-a6a0-81cfdbfb89e6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:47.993097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19ce86f8-ba0b-4b51-a6a0-81cfdbfb89e6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:47.995638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:12:47.998418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:12:48.001991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:12:48.001991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:12:48.002594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:12:48.224368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-19ce86f8-ba0b-4b51-a6a0-81cfdbfb89e6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:48.239118 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-19ce86f8-ba0b-4b51-a6a0-81cfdbfb89e6 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1515 microversion: 2.1 time: 0.299837 May 28 21:12:48.254302 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1348/2733] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:47 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1515 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:48.466037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:48.473535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:48.474177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:48.474977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:48.475482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:48.516909 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b062ffb2-fe1a-4ee0-b741-8394bdf7be57 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "POST /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2/action" status: 202 len: 1139 microversion: 2.54 time: 0.717218 May 28 21:12:48.540433 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1386/2734] 10.222.0.33 () {62 vars in 1319 bytes} [Sat May 28 21:12:47 2022] POST /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2/action => generated 1139 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 28 21:12:48.545531 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b2e8b043-6e36-44d9-8941-d96806238c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:48.546459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b2e8b043-6e36-44d9-8941-d96806238c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:48.555246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b2e8b043-6e36-44d9-8941-d96806238c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:48.556059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b2e8b043-6e36-44d9-8941-d96806238c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:48.558001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b2e8b043-6e36-44d9-8941-d96806238c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:48.558810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b2e8b043-6e36-44d9-8941-d96806238c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:48.710227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b2e8b043-6e36-44d9-8941-d96806238c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:48.719239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b2e8b043-6e36-44d9-8941-d96806238c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:48.721213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b2e8b043-6e36-44d9-8941-d96806238c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:48.722705 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b2e8b043-6e36-44d9-8941-d96806238c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.183012 May 28 21:12:48.735094 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1349/2735] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:48 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:48.812349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ed1e1158-b1db-4802-955d-cb6687bbb9fe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:48.812980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ed1e1158-b1db-4802-955d-cb6687bbb9fe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:48.822842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed1e1158-b1db-4802-955d-cb6687bbb9fe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:48.823347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed1e1158-b1db-4802-955d-cb6687bbb9fe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:48.824087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed1e1158-b1db-4802-955d-cb6687bbb9fe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:48.824538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed1e1158-b1db-4802-955d-cb6687bbb9fe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:48.966335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-397982fe-4165-4fc0-aa3a-a9997752cad0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:48.967055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-397982fe-4165-4fc0-aa3a-a9997752cad0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:48.978334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-397982fe-4165-4fc0-aa3a-a9997752cad0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:48.980349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-397982fe-4165-4fc0-aa3a-a9997752cad0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:48.984447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-397982fe-4165-4fc0-aa3a-a9997752cad0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:48.989238 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-397982fe-4165-4fc0-aa3a-a9997752cad0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:49.102659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ed1e1158-b1db-4802-955d-cb6687bbb9fe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:49.117304 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ed1e1158-b1db-4802-955d-cb6687bbb9fe tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1508 microversion: 2.1 time: 0.310395 May 28 21:12:49.124551 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1387/2736] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:48 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1508 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:49.272143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e2bda252-c9fa-4f70-9c26-2947b074cc38 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:49.275064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e2bda252-c9fa-4f70-9c26-2947b074cc38 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:49.290311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e2bda252-c9fa-4f70-9c26-2947b074cc38 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:49.292645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e2bda252-c9fa-4f70-9c26-2947b074cc38 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:49.293827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e2bda252-c9fa-4f70-9c26-2947b074cc38 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:49.294534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e2bda252-c9fa-4f70-9c26-2947b074cc38 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:49.325736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-397982fe-4165-4fc0-aa3a-a9997752cad0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:49.336153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-397982fe-4165-4fc0-aa3a-a9997752cad0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:49.338879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-397982fe-4165-4fc0-aa3a-a9997752cad0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:49.340315 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-397982fe-4165-4fc0-aa3a-a9997752cad0 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1753 microversion: 2.32 time: 0.382455 May 28 21:12:49.352699 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1350/2737] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:48 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1753 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:49.638401 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e2bda252-c9fa-4f70-9c26-2947b074cc38 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:49.646560 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e2bda252-c9fa-4f70-9c26-2947b074cc38 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1521 microversion: 2.1 time: 0.384079 May 28 21:12:49.656129 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1388/2738] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:49 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:12:49.743491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-426722cb-3cd4-407a-99fb-86d714e4f5ea tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:49.745304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-426722cb-3cd4-407a-99fb-86d714e4f5ea tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:49.752061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-426722cb-3cd4-407a-99fb-86d714e4f5ea tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:49.752953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-426722cb-3cd4-407a-99fb-86d714e4f5ea tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:49.753747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-426722cb-3cd4-407a-99fb-86d714e4f5ea tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:49.754220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-426722cb-3cd4-407a-99fb-86d714e4f5ea tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:49.770584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:49.910306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-426722cb-3cd4-407a-99fb-86d714e4f5ea tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:49.937230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-426722cb-3cd4-407a-99fb-86d714e4f5ea tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:49.938793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-426722cb-3cd4-407a-99fb-86d714e4f5ea tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:49.939999 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-426722cb-3cd4-407a-99fb-86d714e4f5ea tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.202050 May 28 21:12:49.951097 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1351/2739] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:49 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:50.141049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7498d237-e2bf-4870-b418-189f980176ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:50.141691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7498d237-e2bf-4870-b418-189f980176ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:50.144213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:50.156359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7498d237-e2bf-4870-b418-189f980176ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:50.157122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7498d237-e2bf-4870-b418-189f980176ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:50.160169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7498d237-e2bf-4870-b418-189f980176ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:50.160873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7498d237-e2bf-4870-b418-189f980176ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:50.166538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:50.362430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-89cbc149-8c96-4652-af7a-4b58a9f37bf7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:50.364090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-89cbc149-8c96-4652-af7a-4b58a9f37bf7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:50.382250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89cbc149-8c96-4652-af7a-4b58a9f37bf7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:50.383730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89cbc149-8c96-4652-af7a-4b58a9f37bf7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:50.386400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89cbc149-8c96-4652-af7a-4b58a9f37bf7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:50.393820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89cbc149-8c96-4652-af7a-4b58a9f37bf7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:50.744838 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89cbc149-8c96-4652-af7a-4b58a9f37bf7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:50.756765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89cbc149-8c96-4652-af7a-4b58a9f37bf7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:50.758960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89cbc149-8c96-4652-af7a-4b58a9f37bf7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:50.760914 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-89cbc149-8c96-4652-af7a-4b58a9f37bf7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1787 microversion: 2.32 time: 0.404696 May 28 21:12:50.763701 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1352/2740] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:50 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1787 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:50.779930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7498d237-e2bf-4870-b418-189f980176ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:50.788680 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7498d237-e2bf-4870-b418-189f980176ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1508 microversion: 2.1 time: 0.642671 May 28 21:12:50.788680 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1389/2741] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:50 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1508 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:50.788852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0d3d0a37-7547-40bf-8146-b9fc6efd939f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:50.791296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0d3d0a37-7547-40bf-8146-b9fc6efd939f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:50.830580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d3d0a37-7547-40bf-8146-b9fc6efd939f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:50.831078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d3d0a37-7547-40bf-8146-b9fc6efd939f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:50.831881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d3d0a37-7547-40bf-8146-b9fc6efd939f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:50.832313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d3d0a37-7547-40bf-8146-b9fc6efd939f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:51.060271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0d3d0a37-7547-40bf-8146-b9fc6efd939f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:51.079534 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0d3d0a37-7547-40bf-8146-b9fc6efd939f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1521 microversion: 2.1 time: 0.313273 May 28 21:12:51.079534 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1353/2742] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:50 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:51.084077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d56772f9-9fd3-4f42-bbf1-0342a852fa9a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:51.084969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d56772f9-9fd3-4f42-bbf1-0342a852fa9a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:51.092491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d56772f9-9fd3-4f42-bbf1-0342a852fa9a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:51.093139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d56772f9-9fd3-4f42-bbf1-0342a852fa9a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:51.094119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d56772f9-9fd3-4f42-bbf1-0342a852fa9a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:51.095226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d56772f9-9fd3-4f42-bbf1-0342a852fa9a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:51.105361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1708431987", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:51.180384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d56772f9-9fd3-4f42-bbf1-0342a852fa9a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:51.197794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d56772f9-9fd3-4f42-bbf1-0342a852fa9a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:51.201064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] validate_networks() for [('44029916-1fdb-4ad5-9c01-eb6eab801765', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:12:51.203306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d56772f9-9fd3-4f42-bbf1-0342a852fa9a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:51.204631 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d56772f9-9fd3-4f42-bbf1-0342a852fa9a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.125749 May 28 21:12:51.207140 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1354/2743] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:51 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:51.787756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-15c9134f-2f94-42ad-bdda-4bed814bd388 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:51.789178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-15c9134f-2f94-42ad-bdda-4bed814bd388 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:51.797190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15c9134f-2f94-42ad-bdda-4bed814bd388 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:51.798023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15c9134f-2f94-42ad-bdda-4bed814bd388 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:51.799472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15c9134f-2f94-42ad-bdda-4bed814bd388 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:51.800155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15c9134f-2f94-42ad-bdda-4bed814bd388 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:52.132494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:12:52.133309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:12:52.134684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:12:52.135110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:12:52.135567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:12:52.148960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:52.150762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:52.151889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:52.152511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:52.167456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-15c9134f-2f94-42ad-bdda-4bed814bd388 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:52.180808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Getting quotas for project d26d403e254e4caa887f8155d74c84c4. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:52.183175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-15c9134f-2f94-42ad-bdda-4bed814bd388 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:52.190237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Getting quotas for user ffb90cfa7828412f96f330dab49466cd and project d26d403e254e4caa887f8155d74c84c4. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:52.193348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-15c9134f-2f94-42ad-bdda-4bed814bd388 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:52.197492 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-15c9134f-2f94-42ad-bdda-4bed814bd388 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1833 microversion: 2.32 time: 0.411314 May 28 21:12:52.197492 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1355/2744] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:51 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1833 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:12:52.217639 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-52580015-158b-42b9-be94-f9f3e5d55281 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:52.229751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:12:52.234134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:12:52.235638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-52580015-158b-42b9-be94-f9f3e5d55281 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:52.252966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52580015-158b-42b9-be94-f9f3e5d55281 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:52.255060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52580015-158b-42b9-be94-f9f3e5d55281 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:52.257159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52580015-158b-42b9-be94-f9f3e5d55281 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:52.259006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52580015-158b-42b9-be94-f9f3e5d55281 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:52.388561 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-de096ef7-ad29-452c-80aa-1db29c39491a tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.602892 May 28 21:12:52.389216 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1390/2745] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:12:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:12:52.413216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1e9ec4f0-be17-48ba-b781-ca2ef4235890 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:52.414403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1e9ec4f0-be17-48ba-b781-ca2ef4235890 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:52.453189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e9ec4f0-be17-48ba-b781-ca2ef4235890 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:52.455587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e9ec4f0-be17-48ba-b781-ca2ef4235890 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:52.462160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e9ec4f0-be17-48ba-b781-ca2ef4235890 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:52.462635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e9ec4f0-be17-48ba-b781-ca2ef4235890 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:52.818840 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-52580015-158b-42b9-be94-f9f3e5d55281 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:52.834797 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-52580015-158b-42b9-be94-f9f3e5d55281 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1508 microversion: 2.1 time: 0.637074 May 28 21:12:52.838596 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1356/2746] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:52 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1508 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:52.840821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6ff1838b-f4ca-4396-8eae-ea23727f2c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:52.841428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6ff1838b-f4ca-4396-8eae-ea23727f2c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:52.858178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ff1838b-f4ca-4396-8eae-ea23727f2c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:52.858632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ff1838b-f4ca-4396-8eae-ea23727f2c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:52.860294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ff1838b-f4ca-4396-8eae-ea23727f2c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:52.860294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ff1838b-f4ca-4396-8eae-ea23727f2c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:52.918835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1e9ec4f0-be17-48ba-b781-ca2ef4235890 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:52.941095 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1e9ec4f0-be17-48ba-b781-ca2ef4235890 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1521 microversion: 2.1 time: 0.531868 May 28 21:12:52.941807 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1391/2747] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:52 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:52.986177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-802cc573-7874-4221-bbd3-91e0c8bdc6eb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:52.986952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-802cc573-7874-4221-bbd3-91e0c8bdc6eb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:53.047247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6ff1838b-f4ca-4396-8eae-ea23727f2c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:53.073571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6ff1838b-f4ca-4396-8eae-ea23727f2c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:53.075761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6ff1838b-f4ca-4396-8eae-ea23727f2c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:53.077816 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6ff1838b-f4ca-4396-8eae-ea23727f2c1b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.240931 May 28 21:12:53.084113 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1357/2748] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:52 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:53.098722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-802cc573-7874-4221-bbd3-91e0c8bdc6eb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:53.102822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-1d64b8f3-a046-4b36-bb78-a6e1872af319 req-57f7d014-9be1-4d98-b8c4-df523a0d5a07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "tag": "8441633d-d2d5-43e9-899c-acfbbc72f929"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:53.106936 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-802cc573-7874-4221-bbd3-91e0c8bdc6eb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1223 microversion: 2.1 time: 0.163963 May 28 21:12:53.107512 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1392/2749] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:52 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1223 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:53.123912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-774d9de6-946d-4c48-b1e6-b62919674ac5 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Calling method '.version_select at 0x7f4d57411dc0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:53.136021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1d64b8f3-a046-4b36-bb78-a6e1872af319 req-57f7d014-9be1-4d98-b8c4-df523a0d5a07 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:53.136649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1d64b8f3-a046-4b36-bb78-a6e1872af319 req-57f7d014-9be1-4d98-b8c4-df523a0d5a07 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:53.162735 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-1d64b8f3-a046-4b36-bb78-a6e1872af319 req-57f7d014-9be1-4d98-b8c4-df523a0d5a07 service nova] Creating event network-changed:8441633d-d2d5-43e9-899c-acfbbc72f929 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:12:53.172663 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-1d64b8f3-a046-4b36-bb78-a6e1872af319 req-57f7d014-9be1-4d98-b8c4-df523a0d5a07 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085816 May 28 21:12:53.178584 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1358/2750] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:53.215559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4250c191-c75a-4e85-ab37-bf3f3c2ae72c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:53.216722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4250c191-c75a-4e85-ab37-bf3f3c2ae72c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:53.233823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4250c191-c75a-4e85-ab37-bf3f3c2ae72c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:53.234877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4250c191-c75a-4e85-ab37-bf3f3c2ae72c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:53.237155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4250c191-c75a-4e85-ab37-bf3f3c2ae72c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:53.238808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4250c191-c75a-4e85-ab37-bf3f3c2ae72c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:53.249824 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-774d9de6-946d-4c48-b1e6-b62919674ac5 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "GET /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354" status: 200 len: 636 microversion: 2.1 time: 0.140937 May 28 21:12:53.251423 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1393/2751] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:12:53 2022] GET /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354 => generated 636 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:53.270819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1ff51d7d-290a-46fa-ae43-10ccb545ba4d tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Action: 'update_all', calling method: .version_select at 0x7f4d576b0670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:53.364073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-1ff51d7d-290a-46fa-ae43-10ccb545ba4d tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:53.373096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-1ff51d7d-290a-46fa-ae43-10ccb545ba4d tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for user 9e5bb3a0b7c9438bbfdc22fac3f71995 and project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:53.831199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4250c191-c75a-4e85-ab37-bf3f3c2ae72c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:53.849405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4250c191-c75a-4e85-ab37-bf3f3c2ae72c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:53.851482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4250c191-c75a-4e85-ab37-bf3f3c2ae72c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:53.854675 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4250c191-c75a-4e85-ab37-bf3f3c2ae72c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1833 microversion: 2.32 time: 0.644311 May 28 21:12:53.858087 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1359/2752] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:53 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1833 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:53.876497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5ae1237e-6759-4961-8d50-b01484dbf203 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:53.881437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5ae1237e-6759-4961-8d50-b01484dbf203 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:53.894081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ae1237e-6759-4961-8d50-b01484dbf203 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:53.894822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ae1237e-6759-4961-8d50-b01484dbf203 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:53.896352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ae1237e-6759-4961-8d50-b01484dbf203 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:53.900236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ae1237e-6759-4961-8d50-b01484dbf203 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:54.025888 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1ff51d7d-290a-46fa-ae43-10ccb545ba4d tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata" status: 200 len: 61 microversion: 2.1 time: 0.764549 May 28 21:12:54.026484 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1394/2753] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:12:53 2022] PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata => generated 61 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:12:54.034679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-153b4202-cb27-44b1-8223-bab81fd40e69 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:54.035582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-153b4202-cb27-44b1-8223-bab81fd40e69 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:54.048384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-153b4202-cb27-44b1-8223-bab81fd40e69 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:54.049136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-153b4202-cb27-44b1-8223-bab81fd40e69 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:54.053997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-153b4202-cb27-44b1-8223-bab81fd40e69 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:54.056353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-153b4202-cb27-44b1-8223-bab81fd40e69 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:54.769905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5ae1237e-6759-4961-8d50-b01484dbf203 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:54.788419 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5ae1237e-6759-4961-8d50-b01484dbf203 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1508 microversion: 2.1 time: 0.916188 May 28 21:12:54.791622 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1360/2754] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:53 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1508 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:54.798415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c8452934-8432-4446-a18f-55a80284caf6 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Calling method '.version_select at 0x7f4d578270d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:54.989111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-153b4202-cb27-44b1-8223-bab81fd40e69 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:55.016236 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-153b4202-cb27-44b1-8223-bab81fd40e69 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1521 microversion: 2.1 time: 0.983651 May 28 21:12:55.016898 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1395/2755] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:54 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1521 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:55.044662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fd45a829-e724-427e-8964-cc46da36cbc4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:55.047966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fd45a829-e724-427e-8964-cc46da36cbc4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:55.087099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd45a829-e724-427e-8964-cc46da36cbc4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:55.089243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd45a829-e724-427e-8964-cc46da36cbc4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:55.092759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd45a829-e724-427e-8964-cc46da36cbc4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:55.094627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd45a829-e724-427e-8964-cc46da36cbc4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:55.159880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=12 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:55.161904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:55.332555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fd45a829-e724-427e-8964-cc46da36cbc4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:55.349713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fd45a829-e724-427e-8964-cc46da36cbc4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:55.370401 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fd45a829-e724-427e-8964-cc46da36cbc4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:55.375682 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fd45a829-e724-427e-8964-cc46da36cbc4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.352654 May 28 21:12:55.377707 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1396/2756] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:55 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:55.399584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a5b77c54-3bc7-4b43-ab3c-b39c726e3024 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:55.401245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a5b77c54-3bc7-4b43-ab3c-b39c726e3024 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:55.410049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5b77c54-3bc7-4b43-ab3c-b39c726e3024 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:55.410870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5b77c54-3bc7-4b43-ab3c-b39c726e3024 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:55.411892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5b77c54-3bc7-4b43-ab3c-b39c726e3024 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:55.412539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5b77c54-3bc7-4b43-ab3c-b39c726e3024 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:55.465924 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c8452934-8432-4446-a18f-55a80284caf6 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "DELETE /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.672594 May 28 21:12:55.466633 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1361/2757] 10.222.0.33 () {58 vars in 1295 bytes} [Sat May 28 21:12:54 2022] DELETE /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata/os_version => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:12:55.485163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-d0f6dc20-caac-4dd2-bbec-416bc022768f req-8d5e8abf-e8b0-4e54-a4f6-398ad8e8b520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af7be2b-2058-490c-b258-2103bacdb44f", "name": "network-vif-plugged", "status": "completed", "tag": "80b2c42c-6208-42e7-8bba-7fc8e7727506"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:55.517889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d0f6dc20-caac-4dd2-bbec-416bc022768f req-8d5e8abf-e8b0-4e54-a4f6-398ad8e8b520 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:55.518607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d0f6dc20-caac-4dd2-bbec-416bc022768f req-8d5e8abf-e8b0-4e54-a4f6-398ad8e8b520 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:55.563483 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-d0f6dc20-caac-4dd2-bbec-416bc022768f req-8d5e8abf-e8b0-4e54-a4f6-398ad8e8b520 service nova] Creating event network-vif-plugged:80b2c42c-6208-42e7-8bba-7fc8e7727506 for instance 0af7be2b-2058-490c-b258-2103bacdb44f on nch2-master-1 May 28 21:12:55.582812 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-d0f6dc20-caac-4dd2-bbec-416bc022768f req-8d5e8abf-e8b0-4e54-a4f6-398ad8e8b520 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114709 May 28 21:12:55.586952 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1362/2758] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:55.622339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0c91e55a-4bb4-414e-b0f6-665756abcc73 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:55.626487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0c91e55a-4bb4-414e-b0f6-665756abcc73 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:55.668229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c91e55a-4bb4-414e-b0f6-665756abcc73 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:55.671702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c91e55a-4bb4-414e-b0f6-665756abcc73 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:55.671702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c91e55a-4bb4-414e-b0f6-665756abcc73 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:55.671702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c91e55a-4bb4-414e-b0f6-665756abcc73 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:55.792585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a5b77c54-3bc7-4b43-ab3c-b39c726e3024 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:55.804934 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a5b77c54-3bc7-4b43-ab3c-b39c726e3024 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1275 microversion: 2.1 time: 0.425819 May 28 21:12:55.808858 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1397/2759] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:55 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1275 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:55.840772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-bbca0bee-6932-4429-9926-104fcdcbf863 req-11772f69-1a35-43fe-8c60-9ab58f75d4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "tag": "b9147e1c-e446-4b38-b6cd-4ba5d9efe9bf"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:55.864592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-bbca0bee-6932-4429-9926-104fcdcbf863 req-11772f69-1a35-43fe-8c60-9ab58f75d4f0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:55.865054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-bbca0bee-6932-4429-9926-104fcdcbf863 req-11772f69-1a35-43fe-8c60-9ab58f75d4f0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:55.894555 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-bbca0bee-6932-4429-9926-104fcdcbf863 req-11772f69-1a35-43fe-8c60-9ab58f75d4f0 service nova] Creating event network-changed:b9147e1c-e446-4b38-b6cd-4ba5d9efe9bf for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:12:55.908123 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-bbca0bee-6932-4429-9926-104fcdcbf863 req-11772f69-1a35-43fe-8c60-9ab58f75d4f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090965 May 28 21:12:55.908741 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1398/2760] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:55.914166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-02899d47-4779-41bf-9d48-40da18f9178d tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Calling method '.version_select at 0x7f4d57370e50>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:56.027901 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-02899d47-4779-41bf-9d48-40da18f9178d tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "GET /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata" status: 200 len: 37 microversion: 2.1 time: 0.114853 May 28 21:12:56.030339 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1399/2761] 10.222.0.33 () {58 vars in 1259 bytes} [Sat May 28 21:12:55 2022] GET /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata => generated 37 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:12:56.038103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-885cec48-e39a-4ee1-97b5-53e76a99873c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:56.039272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-885cec48-e39a-4ee1-97b5-53e76a99873c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:56.047810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-885cec48-e39a-4ee1-97b5-53e76a99873c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:56.048518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-885cec48-e39a-4ee1-97b5-53e76a99873c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:56.049814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-885cec48-e39a-4ee1-97b5-53e76a99873c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:56.050717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-885cec48-e39a-4ee1-97b5-53e76a99873c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:56.184327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c91e55a-4bb4-414e-b0f6-665756abcc73 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:56.198310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c91e55a-4bb4-414e-b0f6-665756abcc73 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:56.205170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c91e55a-4bb4-414e-b0f6-665756abcc73 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:56.209050 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0c91e55a-4bb4-414e-b0f6-665756abcc73 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1854 microversion: 2.32 time: 0.617869 May 28 21:12:56.210018 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1363/2762] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:55 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1854 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:56.221789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ecb0ab45-abc1-4b65-8c37-5ef4a75d744d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:56.225253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ecb0ab45-abc1-4b65-8c37-5ef4a75d744d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:56.240265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecb0ab45-abc1-4b65-8c37-5ef4a75d744d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:56.242799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecb0ab45-abc1-4b65-8c37-5ef4a75d744d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:56.247049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecb0ab45-abc1-4b65-8c37-5ef4a75d744d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:56.247510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecb0ab45-abc1-4b65-8c37-5ef4a75d744d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:56.665022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-885cec48-e39a-4ee1-97b5-53e76a99873c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:56.665022 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-885cec48-e39a-4ee1-97b5-53e76a99873c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1508 microversion: 2.1 time: 0.595800 May 28 21:12:56.665022 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1400/2763] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:56 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1508 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:56.665022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-00400f03-7a8c-4a1c-b77b-546a892f30f5 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Action: 'update_all', calling method: .version_select at 0x7f4d57370dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:56.667250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ecb0ab45-abc1-4b65-8c37-5ef4a75d744d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:56.667250 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ecb0ab45-abc1-4b65-8c37-5ef4a75d744d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1521 microversion: 2.1 time: 0.448076 May 28 21:12:56.667250 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1364/2764] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:56 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:56.680976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ef4f7ff0-d11d-458b-bcac-fb6c5f3e1f6a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:56.688469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ef4f7ff0-d11d-458b-bcac-fb6c5f3e1f6a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:56.708790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef4f7ff0-d11d-458b-bcac-fb6c5f3e1f6a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:56.709567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef4f7ff0-d11d-458b-bcac-fb6c5f3e1f6a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:56.710990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef4f7ff0-d11d-458b-bcac-fb6c5f3e1f6a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:56.711920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef4f7ff0-d11d-458b-bcac-fb6c5f3e1f6a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:56.735761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-00400f03-7a8c-4a1c-b77b-546a892f30f5 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:56.771512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-00400f03-7a8c-4a1c-b77b-546a892f30f5 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for user 9e5bb3a0b7c9438bbfdc22fac3f71995 and project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:56.953713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ef4f7ff0-d11d-458b-bcac-fb6c5f3e1f6a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:56.966090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ef4f7ff0-d11d-458b-bcac-fb6c5f3e1f6a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:56.968054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ef4f7ff0-d11d-458b-bcac-fb6c5f3e1f6a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:56.970823 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ef4f7ff0-d11d-458b-bcac-fb6c5f3e1f6a tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.306169 May 28 21:12:56.972778 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1365/2765] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:56 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:56.980482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2d315708-fc21-4c07-be4e-19ed902d16f0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:56.981447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2d315708-fc21-4c07-be4e-19ed902d16f0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:56.989619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d315708-fc21-4c07-be4e-19ed902d16f0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:56.990679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d315708-fc21-4c07-be4e-19ed902d16f0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:56.992143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d315708-fc21-4c07-be4e-19ed902d16f0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:56.993074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d315708-fc21-4c07-be4e-19ed902d16f0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:57.169540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2d315708-fc21-4c07-be4e-19ed902d16f0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:57.184254 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2d315708-fc21-4c07-be4e-19ed902d16f0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1281 microversion: 2.1 time: 0.210092 May 28 21:12:57.185411 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1366/2766] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:56 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1281 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:57.230924 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84fea534-2f37-418d-87b5-c4731fbde5f2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:57.231650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-84fea534-2f37-418d-87b5-c4731fbde5f2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:57.248157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84fea534-2f37-418d-87b5-c4731fbde5f2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:57.250909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84fea534-2f37-418d-87b5-c4731fbde5f2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:57.251857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84fea534-2f37-418d-87b5-c4731fbde5f2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:57.255309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84fea534-2f37-418d-87b5-c4731fbde5f2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:57.474725 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-00400f03-7a8c-4a1c-b77b-546a892f30f5 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata" status: 200 len: 61 microversion: 2.1 time: 0.845656 May 28 21:12:57.476191 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1401/2767] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:12:56 2022] PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata => generated 61 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:12:57.485423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7ddadf8-04c2-489a-b8f8-3f5b5f7d6ce3 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Calling method '.version_select at 0x7f4d576625e0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:57.533394 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d7ddadf8-04c2-489a-b8f8-3f5b5f7d6ce3 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "GET /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.051375 May 28 21:12:57.535460 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1402/2768] 10.222.0.33 () {58 vars in 1289 bytes} [Sat May 28 21:12:57 2022] GET /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata/os_distro => generated 33 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 21:12:57.547975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5f5519d1-4c05-419b-893c-0dd6f9d6bee7 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Action: 'update_all', calling method: .version_select at 0x7f4d5738bc10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:57.611216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-5f5519d1-4c05-419b-893c-0dd6f9d6bee7 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:57.618208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-5f5519d1-4c05-419b-893c-0dd6f9d6bee7 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for user 9e5bb3a0b7c9438bbfdc22fac3f71995 and project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:57.878786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-84fea534-2f37-418d-87b5-c4731fbde5f2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:57.896552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-84fea534-2f37-418d-87b5-c4731fbde5f2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:57.908166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-84fea534-2f37-418d-87b5-c4731fbde5f2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:57.922925 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-84fea534-2f37-418d-87b5-c4731fbde5f2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.683729 May 28 21:12:57.922925 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1367/2769] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:57 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:57.932764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b65bbb6a-5d96-431b-a21f-a820cde366c2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:57.933684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b65bbb6a-5d96-431b-a21f-a820cde366c2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:57.943353 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5f5519d1-4c05-419b-893c-0dd6f9d6bee7 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata" status: 200 len: 61 microversion: 2.1 time: 0.399825 May 28 21:12:57.943783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b65bbb6a-5d96-431b-a21f-a820cde366c2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:57.944453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b65bbb6a-5d96-431b-a21f-a820cde366c2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:57.944563 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1403/2770] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:12:57 2022] PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata => generated 61 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 21:12:57.945628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b65bbb6a-5d96-431b-a21f-a820cde366c2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:57.946305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b65bbb6a-5d96-431b-a21f-a820cde366c2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:57.962506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9e80f7b5-a9a7-471c-b648-dc047d90cb46 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:57.963285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9e80f7b5-a9a7-471c-b648-dc047d90cb46 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:57.972043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e80f7b5-a9a7-471c-b648-dc047d90cb46 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:57.972506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e80f7b5-a9a7-471c-b648-dc047d90cb46 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:57.974041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e80f7b5-a9a7-471c-b648-dc047d90cb46 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:57.977028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e80f7b5-a9a7-471c-b648-dc047d90cb46 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:58.435819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9e80f7b5-a9a7-471c-b648-dc047d90cb46 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:58.442706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b65bbb6a-5d96-431b-a21f-a820cde366c2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:58.449392 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9e80f7b5-a9a7-471c-b648-dc047d90cb46 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1506 microversion: 2.1 time: 0.495290 May 28 21:12:58.452043 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1404/2771] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:57 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1506 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:58.458740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-c735913d-eb33-4202-a625-9f2669affa34 req-aa11751d-b577-416a-b8b4-39764943a8d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "tag": "48633e8e-091d-451b-8abe-5cdb8fc414cf"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:58.464594 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b65bbb6a-5d96-431b-a21f-a820cde366c2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1508 microversion: 2.1 time: 0.536936 May 28 21:12:58.465288 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1368/2772] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:57 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1508 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:58.472131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c735913d-eb33-4202-a625-9f2669affa34 req-aa11751d-b577-416a-b8b4-39764943a8d6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:58.472856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c735913d-eb33-4202-a625-9f2669affa34 req-aa11751d-b577-416a-b8b4-39764943a8d6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:58.482506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7a31807b-fff2-4906-848f-252ef7d64973 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Calling method '.version_select at 0x7f4d575e90d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:58.485901 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-c735913d-eb33-4202-a625-9f2669affa34 req-aa11751d-b577-416a-b8b4-39764943a8d6 service nova] Creating event network-changed:48633e8e-091d-451b-8abe-5cdb8fc414cf for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:12:58.499289 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-c735913d-eb33-4202-a625-9f2669affa34 req-aa11751d-b577-416a-b8b4-39764943a8d6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045637 May 28 21:12:58.500233 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1405/2773] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:12:58.512896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e3e60176-7ae3-4955-93c9-f866169380e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:58.513634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e3e60176-7ae3-4955-93c9-f866169380e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:58.528309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3e60176-7ae3-4955-93c9-f866169380e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:58.528309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3e60176-7ae3-4955-93c9-f866169380e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:58.528699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3e60176-7ae3-4955-93c9-f866169380e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:58.531735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3e60176-7ae3-4955-93c9-f866169380e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:58.552652 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7a31807b-fff2-4906-848f-252ef7d64973 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "GET /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata" status: 200 len: 61 microversion: 2.1 time: 0.081877 May 28 21:12:58.553484 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1369/2774] 10.222.0.33 () {58 vars in 1259 bytes} [Sat May 28 21:12:58 2022] GET /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata => generated 61 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:12:58.561423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-33b8f0f7-e8bc-4150-9b13-769d6b8c94bb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:58.570961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-33b8f0f7-e8bc-4150-9b13-769d6b8c94bb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:58.580585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33b8f0f7-e8bc-4150-9b13-769d6b8c94bb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:58.581331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33b8f0f7-e8bc-4150-9b13-769d6b8c94bb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:58.582359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33b8f0f7-e8bc-4150-9b13-769d6b8c94bb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:58.583772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33b8f0f7-e8bc-4150-9b13-769d6b8c94bb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:58.715629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e3e60176-7ae3-4955-93c9-f866169380e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:58.735160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e3e60176-7ae3-4955-93c9-f866169380e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:58.736964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e3e60176-7ae3-4955-93c9-f866169380e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:58.738214 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e3e60176-7ae3-4955-93c9-f866169380e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.236506 May 28 21:12:58.738741 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1406/2775] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:58 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:58.754572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3746ae77-d3d0-4b00-a7b8-29de4102fbe9 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:58.755199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3746ae77-d3d0-4b00-a7b8-29de4102fbe9 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:58.761307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3746ae77-d3d0-4b00-a7b8-29de4102fbe9 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:58.761759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3746ae77-d3d0-4b00-a7b8-29de4102fbe9 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:58.762564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3746ae77-d3d0-4b00-a7b8-29de4102fbe9 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:58.763038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3746ae77-d3d0-4b00-a7b8-29de4102fbe9 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:59.040504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-33b8f0f7-e8bc-4150-9b13-769d6b8c94bb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:59.049202 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-33b8f0f7-e8bc-4150-9b13-769d6b8c94bb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1323 microversion: 2.1 time: 0.494885 May 28 21:12:59.052680 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1370/2776] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:58 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1323 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:59.063256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b3689a12-a03a-4cd2-b5a9-254ece320878 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Action: 'update_all', calling method: .version_select at 0x7f4d575e91f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:59.118370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b3689a12-a03a-4cd2-b5a9-254ece320878 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:59.127985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b3689a12-a03a-4cd2-b5a9-254ece320878 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for user 9e5bb3a0b7c9438bbfdc22fac3f71995 and project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:12:59.213724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3746ae77-d3d0-4b00-a7b8-29de4102fbe9 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:59.230037 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3746ae77-d3d0-4b00-a7b8-29de4102fbe9 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 200 len: 1506 microversion: 2.1 time: 0.479200 May 28 21:12:59.230695 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1407/2777] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:12:58 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 1506 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:12:59.237204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f0c7c4ee-6652-4c15-b32c-28260f91308a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:59.238292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f0c7c4ee-6652-4c15-b32c-28260f91308a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:59.254677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0c7c4ee-6652-4c15-b32c-28260f91308a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:59.260244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0c7c4ee-6652-4c15-b32c-28260f91308a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:59.260244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0c7c4ee-6652-4c15-b32c-28260f91308a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:59.260244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0c7c4ee-6652-4c15-b32c-28260f91308a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:59.436830 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b3689a12-a03a-4cd2-b5a9-254ece320878 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata" status: 200 len: 61 microversion: 2.1 time: 0.381701 May 28 21:12:59.437832 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1371/2778] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:12:59 2022] PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata => generated 61 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:12:59.444086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4a904756-b316-4973-948e-90d0206b3a85 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:12:59.446441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4a904756-b316-4973-948e-90d0206b3a85 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:12:59.463892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a904756-b316-4973-948e-90d0206b3a85 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:59.464451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a904756-b316-4973-948e-90d0206b3a85 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:59.465333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a904756-b316-4973-948e-90d0206b3a85 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:12:59.471899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a904756-b316-4973-948e-90d0206b3a85 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:12:59.491891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:59.505026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4a904756-b316-4973-948e-90d0206b3a85 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:12:59.868253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f0c7c4ee-6652-4c15-b32c-28260f91308a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:59.889010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f0c7c4ee-6652-4c15-b32c-28260f91308a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:59.890960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f0c7c4ee-6652-4c15-b32c-28260f91308a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:12:59.894846 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f0c7c4ee-6652-4c15-b32c-28260f91308a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.661703 May 28 21:12:59.897509 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1408/2779] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:12:59 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:12:59.905032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9f456a40-6030-45d0-bfb2-bf305c56c11e tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Action: 'update_all', calling method: .version_select at 0x7f4d5735fd30>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:12:59.972848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9f456a40-6030-45d0-bfb2-bf305c56c11e tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:12:59.975787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:12:59.983126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9f456a40-6030-45d0-bfb2-bf305c56c11e tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for user 9e5bb3a0b7c9438bbfdc22fac3f71995 and project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:13:00.017284 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4a904756-b316-4973-948e-90d0206b3a85 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 204 len: 0 microversion: 2.1 time: 0.578017 May 28 21:13:00.018477 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1372/2780] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:12:59 2022] DELETE /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:13:00.027067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e9625f76-1d5d-411c-be5e-edb7566d584f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:00.027067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e9625f76-1d5d-411c-be5e-edb7566d584f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:00.042869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9625f76-1d5d-411c-be5e-edb7566d584f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:00.043687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9625f76-1d5d-411c-be5e-edb7566d584f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:00.047328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9625f76-1d5d-411c-be5e-edb7566d584f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:00.047929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9625f76-1d5d-411c-be5e-edb7566d584f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:00.610322 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9f456a40-6030-45d0-bfb2-bf305c56c11e tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata" status: 200 len: 64 microversion: 2.1 time: 0.710344 May 28 21:13:00.610919 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1409/2781] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:12:59 2022] PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata => generated 64 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:13:00.622613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4059b569-bff2-4a25-9b05-69cc74bc5965 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:00.623243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4059b569-bff2-4a25-9b05-69cc74bc5965 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:00.631625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4059b569-bff2-4a25-9b05-69cc74bc5965 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:00.632432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4059b569-bff2-4a25-9b05-69cc74bc5965 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:00.633369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4059b569-bff2-4a25-9b05-69cc74bc5965 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:00.633996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4059b569-bff2-4a25-9b05-69cc74bc5965 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:00.781625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4059b569-bff2-4a25-9b05-69cc74bc5965 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:00.792204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4059b569-bff2-4a25-9b05-69cc74bc5965 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:00.794258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4059b569-bff2-4a25-9b05-69cc74bc5965 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:00.796369 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4059b569-bff2-4a25-9b05-69cc74bc5965 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.183870 May 28 21:13:00.797641 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1410/2782] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:00 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:00.805152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2615123c-0c7f-4cc0-ab1d-6100f4fe7f7e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:00.807440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2615123c-0c7f-4cc0-ab1d-6100f4fe7f7e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:00.822884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2615123c-0c7f-4cc0-ab1d-6100f4fe7f7e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:00.823768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2615123c-0c7f-4cc0-ab1d-6100f4fe7f7e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:00.824756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2615123c-0c7f-4cc0-ab1d-6100f4fe7f7e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:00.825355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2615123c-0c7f-4cc0-ab1d-6100f4fe7f7e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:01.080367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e9625f76-1d5d-411c-be5e-edb7566d584f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:01.097707 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e9625f76-1d5d-411c-be5e-edb7566d584f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1508 microversion: 2.1 time: 1.077937 May 28 21:13:01.099397 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1373/2783] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:00 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1508 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:01.106490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-460059147", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "a1d7c67d-4437-4075-890e-fbb84a23f2b5"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:01.205608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] validate_networks() for [('a1d7c67d-4437-4075-890e-fbb84a23f2b5', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:13:01.705429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2615123c-0c7f-4cc0-ab1d-6100f4fe7f7e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:01.715128 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2615123c-0c7f-4cc0-ab1d-6100f4fe7f7e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1323 microversion: 2.1 time: 0.916124 May 28 21:13:01.715834 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1411/2784] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:00 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1323 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:01.724429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-c3e92ddd-83c0-44ab-a065-8dbd8a15c295 req-6d3f6cba-b5a1-442e-8c8d-cc6bf50f17c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "tag": "bd03c494-abd0-49ea-9ef3-2c2229cfd371"}, {"name": "network-changed", "server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "tag": "41835e77-75bb-49d7-a493-54f3f8518d81"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:01.740658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c3e92ddd-83c0-44ab-a065-8dbd8a15c295 req-6d3f6cba-b5a1-442e-8c8d-cc6bf50f17c3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:01.741118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c3e92ddd-83c0-44ab-a065-8dbd8a15c295 req-6d3f6cba-b5a1-442e-8c8d-cc6bf50f17c3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:01.768433 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-c3e92ddd-83c0-44ab-a065-8dbd8a15c295 req-6d3f6cba-b5a1-442e-8c8d-cc6bf50f17c3 service nova] Creating event network-changed:bd03c494-abd0-49ea-9ef3-2c2229cfd371 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:13:01.768868 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-c3e92ddd-83c0-44ab-a065-8dbd8a15c295 req-6d3f6cba-b5a1-442e-8c8d-cc6bf50f17c3 service nova] Creating event network-changed:41835e77-75bb-49d7-a493-54f3f8518d81 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:13:01.783422 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-c3e92ddd-83c0-44ab-a065-8dbd8a15c295 req-6d3f6cba-b5a1-442e-8c8d-cc6bf50f17c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.066035 May 28 21:13:01.784691 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1412/2785] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:01.797338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c9e1d394-cea0-41ff-bfae-6499263a3a80 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Calling method '.version_select at 0x7f4d573a85e0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:01.854949 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c9e1d394-cea0-41ff-bfae-6499263a3a80 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "GET /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata" status: 200 len: 64 microversion: 2.1 time: 0.068248 May 28 21:13:01.857101 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1413/2786] 10.222.0.33 () {58 vars in 1259 bytes} [Sat May 28 21:13:01 2022] GET /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata => generated 64 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:13:01.868801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c98c45ac-2b6e-4d4c-ba3d-31dae3309e7a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:01.872069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c98c45ac-2b6e-4d4c-ba3d-31dae3309e7a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:01.882777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c98c45ac-2b6e-4d4c-ba3d-31dae3309e7a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:01.882777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c98c45ac-2b6e-4d4c-ba3d-31dae3309e7a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:01.882777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c98c45ac-2b6e-4d4c-ba3d-31dae3309e7a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:01.882777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c98c45ac-2b6e-4d4c-ba3d-31dae3309e7a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:02.174784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:02.411006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c98c45ac-2b6e-4d4c-ba3d-31dae3309e7a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:02.423629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c98c45ac-2b6e-4d4c-ba3d-31dae3309e7a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:02.425488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c98c45ac-2b6e-4d4c-ba3d-31dae3309e7a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:02.426852 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c98c45ac-2b6e-4d4c-ba3d-31dae3309e7a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.568647 May 28 21:13:02.427596 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1414/2787] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:01 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:02.433266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-7db57e41-ef34-44c0-be4b-a4c7b3e2de94 req-f2a9a3eb-ec2a-417a-a0b0-a7d10f3a01ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d4c0a5-6961-49e0-8863-846ca05d0723", "tag": "b924fa8a-bfb6-498c-af2f-c5e8038266e0"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:02.442294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7db57e41-ef34-44c0-be4b-a4c7b3e2de94 req-f2a9a3eb-ec2a-417a-a0b0-a7d10f3a01ff service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:02.442744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7db57e41-ef34-44c0-be4b-a4c7b3e2de94 req-f2a9a3eb-ec2a-417a-a0b0-a7d10f3a01ff service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:02.455517 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-7db57e41-ef34-44c0-be4b-a4c7b3e2de94 req-f2a9a3eb-ec2a-417a-a0b0-a7d10f3a01ff service nova] Creating event network-changed:b924fa8a-bfb6-498c-af2f-c5e8038266e0 for instance 60d4c0a5-6961-49e0-8863-846ca05d0723 on nch2-master-1 May 28 21:13:02.461091 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-7db57e41-ef34-44c0-be4b-a4c7b3e2de94 req-f2a9a3eb-ec2a-417a-a0b0-a7d10f3a01ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031025 May 28 21:13:02.461091 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1415/2788] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:02.466643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3fb8b789-c4aa-4302-bf75-1a7b92f614e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:02.467361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3fb8b789-c4aa-4302-bf75-1a7b92f614e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:02.477991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fb8b789-c4aa-4302-bf75-1a7b92f614e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:02.478452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fb8b789-c4aa-4302-bf75-1a7b92f614e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:02.479449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fb8b789-c4aa-4302-bf75-1a7b92f614e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:02.480049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fb8b789-c4aa-4302-bf75-1a7b92f614e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:02.492151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:13:02.492643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:13:02.493107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:13:02.494865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:13:02.495436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:13:02.520425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:02.520883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:02.521862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:02.522481 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:02.553878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Getting quotas for project 53ecc00f85b54d01aa7dbe2f0386dac6. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:13:02.562933 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Getting quotas for user 25b2f1524f7f48149cbc5d2c694a9e2b and project 53ecc00f85b54d01aa7dbe2f0386dac6. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:13:02.579484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:13:02.582975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:13:02.598385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3fb8b789-c4aa-4302-bf75-1a7b92f614e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:02.614674 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3fb8b789-c4aa-4302-bf75-1a7b92f614e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:02.620858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3fb8b789-c4aa-4302-bf75-1a7b92f614e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:02.621069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:02.625556 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3fb8b789-c4aa-4302-bf75-1a7b92f614e9 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.163092 May 28 21:13:02.638236 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1416/2789] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:02 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:02.638236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2288d3b0-bdb5-4c7d-a5e3-d28cf1fd6213 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Action: 'update_all', calling method: .version_select at 0x7f4d576b0280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:02.723868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-2288d3b0-bdb5-4c7d-a5e3-d28cf1fd6213 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:13:02.731029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-2288d3b0-bdb5-4c7d-a5e3-d28cf1fd6213 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for user 9e5bb3a0b7c9438bbfdc22fac3f71995 and project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:13:02.843430 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8c6b164b-039b-4da8-8092-ad18201965f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.742142 May 28 21:13:02.849184 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1374/2790] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:13:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:13:02.855357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e96d93b7-80ab-4d19-bf48-e22eb0fdbb60 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:02.856313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e96d93b7-80ab-4d19-bf48-e22eb0fdbb60 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:02.866689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e96d93b7-80ab-4d19-bf48-e22eb0fdbb60 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:02.867374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e96d93b7-80ab-4d19-bf48-e22eb0fdbb60 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:02.868384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e96d93b7-80ab-4d19-bf48-e22eb0fdbb60 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:02.869590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e96d93b7-80ab-4d19-bf48-e22eb0fdbb60 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:03.365282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e96d93b7-80ab-4d19-bf48-e22eb0fdbb60 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:03.370986 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2288d3b0-bdb5-4c7d-a5e3-d28cf1fd6213 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata" status: 200 len: 61 microversion: 2.1 time: 0.739008 May 28 21:13:03.372330 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1417/2791] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:13:02 2022] PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata => generated 61 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:13:03.384462 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e96d93b7-80ab-4d19-bf48-e22eb0fdbb60 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1508 microversion: 2.1 time: 0.535358 May 28 21:13:03.389311 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1375/2792] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:02 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1508 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:03.392152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-29f8db10-4012-4818-ab4d-da952ff46c84 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:03.397030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-29f8db10-4012-4818-ab4d-da952ff46c84 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:03.404339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-82d3859e-43c7-46f5-ad28-28ac1a8bf130 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:03.405243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-82d3859e-43c7-46f5-ad28-28ac1a8bf130 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:03.414253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29f8db10-4012-4818-ab4d-da952ff46c84 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:03.419765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29f8db10-4012-4818-ab4d-da952ff46c84 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:03.421031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29f8db10-4012-4818-ab4d-da952ff46c84 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:03.422717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29f8db10-4012-4818-ab4d-da952ff46c84 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:03.512723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-82d3859e-43c7-46f5-ad28-28ac1a8bf130 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:03.522383 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-82d3859e-43c7-46f5-ad28-28ac1a8bf130 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1217 microversion: 2.1 time: 0.130352 May 28 21:13:03.523096 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1376/2793] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:03 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1217 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:03.530754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-72ab0667-e1ca-4fe5-b535-119def9d48da tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Action: 'update', calling method: .version_select at 0x7f4d5754c820>, body: {"meta": {"os_version": "alt"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:03.656664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-72ab0667-e1ca-4fe5-b535-119def9d48da tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:13:03.673442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-72ab0667-e1ca-4fe5-b535-119def9d48da tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for user 9e5bb3a0b7c9438bbfdc22fac3f71995 and project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:13:03.760451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-29f8db10-4012-4818-ab4d-da952ff46c84 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:03.774462 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-29f8db10-4012-4818-ab4d-da952ff46c84 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1323 microversion: 2.1 time: 0.400611 May 28 21:13:03.775907 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1418/2794] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:03 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1323 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:03.782167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3a38efda-e69a-4173-98b5-a03395a31ae9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:03.782811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3a38efda-e69a-4173-98b5-a03395a31ae9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:03.789351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a38efda-e69a-4173-98b5-a03395a31ae9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:03.789784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a38efda-e69a-4173-98b5-a03395a31ae9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:03.791015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a38efda-e69a-4173-98b5-a03395a31ae9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:03.791605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a38efda-e69a-4173-98b5-a03395a31ae9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:03.796498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:04.200565 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3a38efda-e69a-4173-98b5-a03395a31ae9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:04.207743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3a38efda-e69a-4173-98b5-a03395a31ae9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:04.218233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3a38efda-e69a-4173-98b5-a03395a31ae9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:04.221079 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3a38efda-e69a-4173-98b5-a03395a31ae9 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.443824 May 28 21:13:04.223636 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1419/2795] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:03 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:04.235573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-77161d67-4ee7-4940-b04e-c0087f5a8c92 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:04.235573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-77161d67-4ee7-4940-b04e-c0087f5a8c92 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:04.251320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77161d67-4ee7-4940-b04e-c0087f5a8c92 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:04.253591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77161d67-4ee7-4940-b04e-c0087f5a8c92 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:04.256035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77161d67-4ee7-4940-b04e-c0087f5a8c92 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:04.259019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77161d67-4ee7-4940-b04e-c0087f5a8c92 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:04.278669 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-72ab0667-e1ca-4fe5-b535-119def9d48da tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.744354 May 28 21:13:04.278669 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1377/2796] 10.222.0.33 () {60 vars in 1312 bytes} [Sat May 28 21:13:03 2022] PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata/os_version => generated 31 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:13:04.278669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-247d2bb9-dba9-4b1a-a354-c43b4af98c78 req-06815dff-2aa3-488a-b5ef-cd13f9c0f3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "tag": "f081357a-b6d4-48c4-bf24-83685b0f0b05"}, {"server_uuid": "0af7be2b-2058-490c-b258-2103bacdb44f", "name": "network-vif-deleted", "tag": "80b2c42c-6208-42e7-8bba-7fc8e7727506"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:04.298838 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-247d2bb9-dba9-4b1a-a354-c43b4af98c78 req-06815dff-2aa3-488a-b5ef-cd13f9c0f3b0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:04.299741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-247d2bb9-dba9-4b1a-a354-c43b4af98c78 req-06815dff-2aa3-488a-b5ef-cd13f9c0f3b0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:04.324261 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-247d2bb9-dba9-4b1a-a354-c43b4af98c78 req-06815dff-2aa3-488a-b5ef-cd13f9c0f3b0 service nova] Creating event network-changed:f081357a-b6d4-48c4-bf24-83685b0f0b05 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:13:04.330327 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-247d2bb9-dba9-4b1a-a354-c43b4af98c78 req-06815dff-2aa3-488a-b5ef-cd13f9c0f3b0 service nova] Creating event network-vif-deleted:80b2c42c-6208-42e7-8bba-7fc8e7727506 for instance 0af7be2b-2058-490c-b258-2103bacdb44f on nch2-master-1 May 28 21:13:04.346423 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-247d2bb9-dba9-4b1a-a354-c43b4af98c78 req-06815dff-2aa3-488a-b5ef-cd13f9c0f3b0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.074939 May 28 21:13:04.347790 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1378/2797] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:04.355387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c951c367-6944-4771-9633-4d17cc8125d1 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Calling method '.version_select at 0x7f4d575a0e50>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:04.376530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-77161d67-4ee7-4940-b04e-c0087f5a8c92 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:04.390342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-77161d67-4ee7-4940-b04e-c0087f5a8c92 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:04.392586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-77161d67-4ee7-4940-b04e-c0087f5a8c92 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:04.394251 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-77161d67-4ee7-4940-b04e-c0087f5a8c92 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.169467 May 28 21:13:04.395219 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1420/2798] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:04 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:04.412449 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c951c367-6944-4771-9633-4d17cc8125d1 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "GET /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata" status: 200 len: 58 microversion: 2.1 time: 0.063047 May 28 21:13:04.413820 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1379/2799] 10.222.0.33 () {58 vars in 1259 bytes} [Sat May 28 21:13:04 2022] GET /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata => generated 58 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:13:04.420783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-026b1d76-b2e0-4ec8-b7ca-6920fa79e890 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:04.421592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-026b1d76-b2e0-4ec8-b7ca-6920fa79e890 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:04.429103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-026b1d76-b2e0-4ec8-b7ca-6920fa79e890 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:04.429665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-026b1d76-b2e0-4ec8-b7ca-6920fa79e890 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:04.430534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-026b1d76-b2e0-4ec8-b7ca-6920fa79e890 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:04.431045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-026b1d76-b2e0-4ec8-b7ca-6920fa79e890 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:04.432143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0badad09-e0f4-4507-aab9-94479540ad50 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Action: 'update_all', calling method: .version_select at 0x7f4d57569280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:04.526067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-0badad09-e0f4-4507-aab9-94479540ad50 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:13:04.532547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-0badad09-e0f4-4507-aab9-94479540ad50 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for user 9e5bb3a0b7c9438bbfdc22fac3f71995 and project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:13:04.853661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-026b1d76-b2e0-4ec8-b7ca-6920fa79e890 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:04.865492 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-026b1d76-b2e0-4ec8-b7ca-6920fa79e890 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1508 microversion: 2.1 time: 0.454562 May 28 21:13:04.867891 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1421/2800] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:04 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1508 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:04.877774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5604378c-153f-48f7-b363-bc63b8b2c078 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:04.881894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5604378c-153f-48f7-b363-bc63b8b2c078 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:04.897609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5604378c-153f-48f7-b363-bc63b8b2c078 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:04.900800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5604378c-153f-48f7-b363-bc63b8b2c078 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:04.901904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5604378c-153f-48f7-b363-bc63b8b2c078 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:04.902656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5604378c-153f-48f7-b363-bc63b8b2c078 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:05.039369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5604378c-153f-48f7-b363-bc63b8b2c078 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:05.052816 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5604378c-153f-48f7-b363-bc63b8b2c078 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1213 microversion: 2.1 time: 0.181942 May 28 21:13:05.055103 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1422/2801] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:04 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1213 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:05.068663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bb0aafe1-1755-48ae-a4cf-0438ed877222 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:05.071564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bb0aafe1-1755-48ae-a4cf-0438ed877222 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:05.093138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb0aafe1-1755-48ae-a4cf-0438ed877222 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:05.093610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb0aafe1-1755-48ae-a4cf-0438ed877222 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:05.095608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb0aafe1-1755-48ae-a4cf-0438ed877222 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:05.096121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb0aafe1-1755-48ae-a4cf-0438ed877222 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:05.108956 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0badad09-e0f4-4507-aab9-94479540ad50 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata" status: 200 len: 61 microversion: 2.1 time: 0.682855 May 28 21:13:05.109560 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1380/2802] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:13:04 2022] PUT /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata => generated 61 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:13:05.121453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e2ec81f6-7856-4b34-ba86-66f532329018 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Action: 'create', calling method: .version_select at 0x7f4d64715f70>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:05.230624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-e2ec81f6-7856-4b34-ba86-66f532329018 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:13:05.251913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-e2ec81f6-7856-4b34-ba86-66f532329018 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Getting quotas for user 9e5bb3a0b7c9438bbfdc22fac3f71995 and project 43f6ea47af5945bfada7f59cd1a7da28. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:13:05.520983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bb0aafe1-1755-48ae-a4cf-0438ed877222 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:05.520983 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bb0aafe1-1755-48ae-a4cf-0438ed877222 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1323 microversion: 2.1 time: 0.464619 May 28 21:13:05.521477 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1423/2803] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:05 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1323 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:05.526507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d9704593-57dd-4f98-a65c-1291cac2f752 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:05.527127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d9704593-57dd-4f98-a65c-1291cac2f752 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:05.543281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9704593-57dd-4f98-a65c-1291cac2f752 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:05.548420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9704593-57dd-4f98-a65c-1291cac2f752 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:05.548420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9704593-57dd-4f98-a65c-1291cac2f752 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:05.548420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9704593-57dd-4f98-a65c-1291cac2f752 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:05.855100 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e2ec81f6-7856-4b34-ba86-66f532329018 tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "POST /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata" status: 200 len: 85 microversion: 2.1 time: 0.738870 May 28 21:13:05.857985 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1381/2804] 10.222.0.33 () {60 vars in 1280 bytes} [Sat May 28 21:13:05 2022] POST /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata => generated 85 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:13:05.871392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c8508b73-ba12-4c54-a43f-a213b2fe2c91 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:05.872290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c8508b73-ba12-4c54-a43f-a213b2fe2c91 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:05.902182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8508b73-ba12-4c54-a43f-a213b2fe2c91 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:05.905691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8508b73-ba12-4c54-a43f-a213b2fe2c91 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:05.906647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8508b73-ba12-4c54-a43f-a213b2fe2c91 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:05.907106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8508b73-ba12-4c54-a43f-a213b2fe2c91 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:05.951754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d9704593-57dd-4f98-a65c-1291cac2f752 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:05.968733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d9704593-57dd-4f98-a65c-1291cac2f752 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:05.970934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d9704593-57dd-4f98-a65c-1291cac2f752 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:05.974180 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d9704593-57dd-4f98-a65c-1291cac2f752 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.449868 May 28 21:13:05.976103 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1424/2805] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:05 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:05.991481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a08bcb72-dd8a-469a-a845-8ba9403e087e tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] Calling method '.version_select at 0x7f4d573a8700>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:06.104835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c8508b73-ba12-4c54-a43f-a213b2fe2c91 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:06.119088 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a08bcb72-dd8a-469a-a845-8ba9403e087e tempest-ImagesMetadataTestJSON-1953033591 tempest-ImagesMetadataTestJSON-1953033591-project] 10.222.0.33 "GET /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata" status: 200 len: 85 microversion: 2.1 time: 0.140962 May 28 21:13:06.122120 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1425/2806] 10.222.0.33 () {58 vars in 1259 bytes} [Sat May 28 21:13:05 2022] GET /compute/v2.1/images/a32ab9b9-b2db-432a-9070-868957777354/metadata => generated 85 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:13:06.131899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c8508b73-ba12-4c54-a43f-a213b2fe2c91 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:06.135043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c8508b73-ba12-4c54-a43f-a213b2fe2c91 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:06.136732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb85408f-1904-4bba-87a9-1dc7b88888ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:06.137513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fb85408f-1904-4bba-87a9-1dc7b88888ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:06.154474 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c8508b73-ba12-4c54-a43f-a213b2fe2c91 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.279000 May 28 21:13:06.154474 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1382/2807] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:05 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:06.154474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3dd095df-2517-4a6a-91e3-fb2f2107d141 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:06.154474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3dd095df-2517-4a6a-91e3-fb2f2107d141 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:06.155462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb85408f-1904-4bba-87a9-1dc7b88888ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:06.156159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb85408f-1904-4bba-87a9-1dc7b88888ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:06.157820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb85408f-1904-4bba-87a9-1dc7b88888ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:06.158402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb85408f-1904-4bba-87a9-1dc7b88888ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:06.169037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3dd095df-2517-4a6a-91e3-fb2f2107d141 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:06.169765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3dd095df-2517-4a6a-91e3-fb2f2107d141 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:06.170960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3dd095df-2517-4a6a-91e3-fb2f2107d141 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:06.171802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3dd095df-2517-4a6a-91e3-fb2f2107d141 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:06.305114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3dd095df-2517-4a6a-91e3-fb2f2107d141 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:06.314602 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3dd095df-2517-4a6a-91e3-fb2f2107d141 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1277 microversion: 2.1 time: 0.174360 May 28 21:13:06.315197 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1383/2808] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:06 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:06.418772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fb85408f-1904-4bba-87a9-1dc7b88888ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:06.428712 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb85408f-1904-4bba-87a9-1dc7b88888ea tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1508 microversion: 2.1 time: 0.305617 May 28 21:13:06.429796 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1426/2809] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:06 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1508 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:06.472077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-0e357f95-45a1-4988-8081-8da91162e209 req-c9fe0b2e-f270-4c16-89b6-a613091da114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "tag": "deee404e-9d98-4fc9-a566-770085e51d43"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:06.488271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0e357f95-45a1-4988-8081-8da91162e209 req-c9fe0b2e-f270-4c16-89b6-a613091da114 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:06.488771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0e357f95-45a1-4988-8081-8da91162e209 req-c9fe0b2e-f270-4c16-89b6-a613091da114 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:06.518079 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-0e357f95-45a1-4988-8081-8da91162e209 req-c9fe0b2e-f270-4c16-89b6-a613091da114 service nova] Creating event network-changed:deee404e-9d98-4fc9-a566-770085e51d43 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:13:06.539575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-96d64acb-7e96-4ed5-834d-b6cc4f4e913f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:06.540407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-96d64acb-7e96-4ed5-834d-b6cc4f4e913f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:06.546201 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-0e357f95-45a1-4988-8081-8da91162e209 req-c9fe0b2e-f270-4c16-89b6-a613091da114 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064974 May 28 21:13:06.566042 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1384/2810] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:06.566199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-96d64acb-7e96-4ed5-834d-b6cc4f4e913f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:06.566199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-96d64acb-7e96-4ed5-834d-b6cc4f4e913f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:06.566199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-96d64acb-7e96-4ed5-834d-b6cc4f4e913f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:06.566199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-96d64acb-7e96-4ed5-834d-b6cc4f4e913f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:06.727376 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-96d64acb-7e96-4ed5-834d-b6cc4f4e913f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:06.732871 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-96d64acb-7e96-4ed5-834d-b6cc4f4e913f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1323 microversion: 2.1 time: 0.198064 May 28 21:13:06.733387 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1427/2811] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:06 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1323 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:06.994768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e7726a11-21d5-418a-b83c-7e3430845bb7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:06.997717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e7726a11-21d5-418a-b83c-7e3430845bb7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:07.017294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7726a11-21d5-418a-b83c-7e3430845bb7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:07.018051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7726a11-21d5-418a-b83c-7e3430845bb7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:07.019088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7726a11-21d5-418a-b83c-7e3430845bb7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:07.019249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7726a11-21d5-418a-b83c-7e3430845bb7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:07.164968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-13eef3d3-dc30-4b46-b1fd-529b7088712b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:07.169908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-13eef3d3-dc30-4b46-b1fd-529b7088712b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:07.180346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13eef3d3-dc30-4b46-b1fd-529b7088712b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:07.182805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13eef3d3-dc30-4b46-b1fd-529b7088712b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:07.186850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13eef3d3-dc30-4b46-b1fd-529b7088712b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:07.187433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13eef3d3-dc30-4b46-b1fd-529b7088712b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:07.315442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-13eef3d3-dc30-4b46-b1fd-529b7088712b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:07.327499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-13eef3d3-dc30-4b46-b1fd-529b7088712b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:07.334720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-13eef3d3-dc30-4b46-b1fd-529b7088712b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:07.337086 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-13eef3d3-dc30-4b46-b1fd-529b7088712b tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.179283 May 28 21:13:07.356147 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1428/2812] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:07 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:07.377654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a237885-167e-4b7a-9200-1dd295b99d60 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:07.385758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6a237885-167e-4b7a-9200-1dd295b99d60 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:07.397106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a237885-167e-4b7a-9200-1dd295b99d60 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:07.397488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e7726a11-21d5-418a-b83c-7e3430845bb7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:07.399559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a237885-167e-4b7a-9200-1dd295b99d60 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:07.401099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a237885-167e-4b7a-9200-1dd295b99d60 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:07.402263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a237885-167e-4b7a-9200-1dd295b99d60 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:07.407997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e7726a11-21d5-418a-b83c-7e3430845bb7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:07.410922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e7726a11-21d5-418a-b83c-7e3430845bb7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:07.413078 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e7726a11-21d5-418a-b83c-7e3430845bb7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.423036 May 28 21:13:07.415208 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1385/2813] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:06 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:07.449031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a47aadc5-cde6-46c7-940d-bb4c9647d814 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:07.450048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a47aadc5-cde6-46c7-940d-bb4c9647d814 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:07.462976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a47aadc5-cde6-46c7-940d-bb4c9647d814 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:07.464705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a47aadc5-cde6-46c7-940d-bb4c9647d814 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:07.467186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a47aadc5-cde6-46c7-940d-bb4c9647d814 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:07.467848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a47aadc5-cde6-46c7-940d-bb4c9647d814 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:07.529478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a237885-167e-4b7a-9200-1dd295b99d60 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:07.539879 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6a237885-167e-4b7a-9200-1dd295b99d60 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1275 microversion: 2.1 time: 0.182185 May 28 21:13:07.541811 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1429/2814] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:07 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1275 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:07.639097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a47aadc5-cde6-46c7-940d-bb4c9647d814 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:07.648275 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a47aadc5-cde6-46c7-940d-bb4c9647d814 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1529 microversion: 2.1 time: 0.205322 May 28 21:13:07.649603 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1386/2815] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:07 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1529 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:07.749904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-26e9e538-9bc6-48ad-9e45-7eedb491b2e1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:07.750664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-26e9e538-9bc6-48ad-9e45-7eedb491b2e1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:07.761492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-26e9e538-9bc6-48ad-9e45-7eedb491b2e1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:07.762241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-26e9e538-9bc6-48ad-9e45-7eedb491b2e1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:07.763372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-26e9e538-9bc6-48ad-9e45-7eedb491b2e1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:07.764058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-26e9e538-9bc6-48ad-9e45-7eedb491b2e1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:07.983581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-26e9e538-9bc6-48ad-9e45-7eedb491b2e1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:07.998554 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-26e9e538-9bc6-48ad-9e45-7eedb491b2e1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1323 microversion: 2.1 time: 0.252663 May 28 21:13:08.008345 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1430/2816] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:07 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1323 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:08.191962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-eb18c50c-1835-488a-ba54-fe238385f287 req-3981cf3c-fa79-4e9d-a0fd-0495a2eb5b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d4c0a5-6961-49e0-8863-846ca05d0723", "name": "network-vif-plugged", "status": "completed", "tag": "b924fa8a-bfb6-498c-af2f-c5e8038266e0"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:08.204234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-eb18c50c-1835-488a-ba54-fe238385f287 req-3981cf3c-fa79-4e9d-a0fd-0495a2eb5b6a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:08.204749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-eb18c50c-1835-488a-ba54-fe238385f287 req-3981cf3c-fa79-4e9d-a0fd-0495a2eb5b6a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:08.220357 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-eb18c50c-1835-488a-ba54-fe238385f287 req-3981cf3c-fa79-4e9d-a0fd-0495a2eb5b6a service nova] Creating event network-vif-plugged:b924fa8a-bfb6-498c-af2f-c5e8038266e0 for instance 60d4c0a5-6961-49e0-8863-846ca05d0723 on nch2-master-1 May 28 21:13:08.225815 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-eb18c50c-1835-488a-ba54-fe238385f287 req-3981cf3c-fa79-4e9d-a0fd-0495a2eb5b6a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039580 May 28 21:13:08.228790 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1387/2817] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:08.355772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ce7d1527-6726-4319-abea-54c1782ac79f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:08.358008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ce7d1527-6726-4319-abea-54c1782ac79f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:08.365427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce7d1527-6726-4319-abea-54c1782ac79f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:08.366660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce7d1527-6726-4319-abea-54c1782ac79f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:08.368346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce7d1527-6726-4319-abea-54c1782ac79f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:08.369489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce7d1527-6726-4319-abea-54c1782ac79f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:08.436961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1e17ff8b-267e-4d62-aa66-b64e0a7e7844 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:08.437673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1e17ff8b-267e-4d62-aa66-b64e0a7e7844 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:08.446710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e17ff8b-267e-4d62-aa66-b64e0a7e7844 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:08.447874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e17ff8b-267e-4d62-aa66-b64e0a7e7844 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:08.448825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e17ff8b-267e-4d62-aa66-b64e0a7e7844 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:08.449898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e17ff8b-267e-4d62-aa66-b64e0a7e7844 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:08.463407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ce7d1527-6726-4319-abea-54c1782ac79f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:08.476529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ce7d1527-6726-4319-abea-54c1782ac79f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:08.479946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ce7d1527-6726-4319-abea-54c1782ac79f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:08.481458 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ce7d1527-6726-4319-abea-54c1782ac79f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.129533 May 28 21:13:08.483063 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1431/2818] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:08 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:08.558914 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-edc0f856-32bc-4054-9c7a-951182c29f92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:08.559547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-edc0f856-32bc-4054-9c7a-951182c29f92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:08.567103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edc0f856-32bc-4054-9c7a-951182c29f92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:08.567833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edc0f856-32bc-4054-9c7a-951182c29f92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:08.568850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edc0f856-32bc-4054-9c7a-951182c29f92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:08.569456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edc0f856-32bc-4054-9c7a-951182c29f92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:08.780704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1e17ff8b-267e-4d62-aa66-b64e0a7e7844 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:08.797162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1e17ff8b-267e-4d62-aa66-b64e0a7e7844 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:08.799019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1e17ff8b-267e-4d62-aa66-b64e0a7e7844 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:08.818151 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1e17ff8b-267e-4d62-aa66-b64e0a7e7844 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.376351 May 28 21:13:08.819899 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1388/2819] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:08 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:08.832264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fd8b5478-c93c-4af1-8038-7d362a6d7d6b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:08.833530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fd8b5478-c93c-4af1-8038-7d362a6d7d6b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:08.841968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fd8b5478-c93c-4af1-8038-7d362a6d7d6b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:08.842615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fd8b5478-c93c-4af1-8038-7d362a6d7d6b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:08.843714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fd8b5478-c93c-4af1-8038-7d362a6d7d6b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:08.844306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fd8b5478-c93c-4af1-8038-7d362a6d7d6b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:08.983091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-edc0f856-32bc-4054-9c7a-951182c29f92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:08.995033 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-edc0f856-32bc-4054-9c7a-951182c29f92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1317 microversion: 2.1 time: 0.440820 May 28 21:13:08.996241 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1432/2820] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:08 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:09.020529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-92357d51-95f3-4fdc-8c24-de0394b749e5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:09.021335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-92357d51-95f3-4fdc-8c24-de0394b749e5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:09.031472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92357d51-95f3-4fdc-8c24-de0394b749e5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:09.032047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92357d51-95f3-4fdc-8c24-de0394b749e5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:09.033085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92357d51-95f3-4fdc-8c24-de0394b749e5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:09.034265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92357d51-95f3-4fdc-8c24-de0394b749e5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:09.051074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fd8b5478-c93c-4af1-8038-7d362a6d7d6b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:09.073463 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fd8b5478-c93c-4af1-8038-7d362a6d7d6b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1529 microversion: 2.1 time: 0.245649 May 28 21:13:09.104829 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1389/2821] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:08 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1529 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:09.265879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-92357d51-95f3-4fdc-8c24-de0394b749e5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:09.275918 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-92357d51-95f3-4fdc-8c24-de0394b749e5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1323 microversion: 2.1 time: 0.259967 May 28 21:13:09.277136 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1433/2822] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:09 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1323 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:09.503996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1b72101f-b56d-40c0-9b09-d943c9dda7aa tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:09.511577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1b72101f-b56d-40c0-9b09-d943c9dda7aa tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:09.521249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b72101f-b56d-40c0-9b09-d943c9dda7aa tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:09.527360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b72101f-b56d-40c0-9b09-d943c9dda7aa tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:09.528804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b72101f-b56d-40c0-9b09-d943c9dda7aa tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:09.537047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b72101f-b56d-40c0-9b09-d943c9dda7aa tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:09.625386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1b72101f-b56d-40c0-9b09-d943c9dda7aa tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:09.635489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1b72101f-b56d-40c0-9b09-d943c9dda7aa tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:09.640539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1b72101f-b56d-40c0-9b09-d943c9dda7aa tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:09.642165 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1b72101f-b56d-40c0-9b09-d943c9dda7aa tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.142465 May 28 21:13:09.643224 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1390/2823] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:09 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:09.826837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f0b41f30-14be-4cb3-8702-df3c49e10eb4 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:09.827665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f0b41f30-14be-4cb3-8702-df3c49e10eb4 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:09.841540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0b41f30-14be-4cb3-8702-df3c49e10eb4 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:09.842040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0b41f30-14be-4cb3-8702-df3c49e10eb4 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:09.845643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0b41f30-14be-4cb3-8702-df3c49e10eb4 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:09.846549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0b41f30-14be-4cb3-8702-df3c49e10eb4 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:10.014052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bb509b87-391c-4643-b44e-e884862c2f12 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:10.014672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bb509b87-391c-4643-b44e-e884862c2f12 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:10.028542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb509b87-391c-4643-b44e-e884862c2f12 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:10.029006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb509b87-391c-4643-b44e-e884862c2f12 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:10.029790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb509b87-391c-4643-b44e-e884862c2f12 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:10.030270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb509b87-391c-4643-b44e-e884862c2f12 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:10.335965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f0b41f30-14be-4cb3-8702-df3c49e10eb4 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:10.351828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f0b41f30-14be-4cb3-8702-df3c49e10eb4 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:10.358292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f0b41f30-14be-4cb3-8702-df3c49e10eb4 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:10.359785 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f0b41f30-14be-4cb3-8702-df3c49e10eb4 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.537979 May 28 21:13:10.376762 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1434/2824] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:09 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:10.386821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1779afe2-e9c0-48df-833e-ba38c92aa10c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:10.390142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1779afe2-e9c0-48df-833e-ba38c92aa10c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:10.407010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bb509b87-391c-4643-b44e-e884862c2f12 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:10.412458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1779afe2-e9c0-48df-833e-ba38c92aa10c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:10.419215 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1779afe2-e9c0-48df-833e-ba38c92aa10c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:10.420069 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bb509b87-391c-4643-b44e-e884862c2f12 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1317 microversion: 2.1 time: 0.411128 May 28 21:13:10.421062 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1779afe2-e9c0-48df-833e-ba38c92aa10c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:10.422413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1779afe2-e9c0-48df-833e-ba38c92aa10c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:10.422830 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1391/2825] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:10 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:10.435178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-e9d73e69-29aa-455e-b7dd-e6d87c944fb6 req-7a031298-db97-421e-b575-0bfb4cabd9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce53dda7-d501-475f-a4c0-73853a36630a", "name": "network-vif-plugged", "status": "completed", "tag": "197a0eea-120c-4af5-b57d-60f7eef43916"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:10.452880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e9d73e69-29aa-455e-b7dd-e6d87c944fb6 req-7a031298-db97-421e-b575-0bfb4cabd9e7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:10.453368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e9d73e69-29aa-455e-b7dd-e6d87c944fb6 req-7a031298-db97-421e-b575-0bfb4cabd9e7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:10.478728 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e9d73e69-29aa-455e-b7dd-e6d87c944fb6 req-7a031298-db97-421e-b575-0bfb4cabd9e7 service nova] Creating event network-vif-plugged:197a0eea-120c-4af5-b57d-60f7eef43916 for instance ce53dda7-d501-475f-a4c0-73853a36630a on nch2-master-1 May 28 21:13:10.490423 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-e9d73e69-29aa-455e-b7dd-e6d87c944fb6 req-7a031298-db97-421e-b575-0bfb4cabd9e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064560 May 28 21:13:10.492444 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1392/2826] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:10.501243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6df29585-9362-4c0f-996a-d1db7dbd7bbb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:10.502797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6df29585-9362-4c0f-996a-d1db7dbd7bbb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:10.510037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6df29585-9362-4c0f-996a-d1db7dbd7bbb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:10.511309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6df29585-9362-4c0f-996a-d1db7dbd7bbb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:10.513275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6df29585-9362-4c0f-996a-d1db7dbd7bbb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:10.513275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6df29585-9362-4c0f-996a-d1db7dbd7bbb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:10.711675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1779afe2-e9c0-48df-833e-ba38c92aa10c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:10.733763 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1779afe2-e9c0-48df-833e-ba38c92aa10c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1524 microversion: 2.1 time: 0.355482 May 28 21:13:10.735085 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1435/2827] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:10 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1524 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:10.869305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6df29585-9362-4c0f-996a-d1db7dbd7bbb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:10.880643 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6df29585-9362-4c0f-996a-d1db7dbd7bbb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1518 microversion: 2.1 time: 0.387045 May 28 21:13:10.882043 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1393/2828] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:10 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1518 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:10.901945 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9cd6b57b-3e36-4c56-b60e-2127487639a0 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:10.901945 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9cd6b57b-3e36-4c56-b60e-2127487639a0 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:10.901945 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cd6b57b-3e36-4c56-b60e-2127487639a0 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:10.901945 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cd6b57b-3e36-4c56-b60e-2127487639a0 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:10.901945 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cd6b57b-3e36-4c56-b60e-2127487639a0 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:10.901945 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cd6b57b-3e36-4c56-b60e-2127487639a0 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:10.993915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9cd6b57b-3e36-4c56-b60e-2127487639a0 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:11.008532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9cd6b57b-3e36-4c56-b60e-2127487639a0 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:11.011368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9cd6b57b-3e36-4c56-b60e-2127487639a0 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:11.013652 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9cd6b57b-3e36-4c56-b60e-2127487639a0 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.129874 May 28 21:13:11.025952 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1394/2829] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:10 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:11.031731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-645fd02c-985b-4308-b7be-40270e967636 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:11.033591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-645fd02c-985b-4308-b7be-40270e967636 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:11.040608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-645fd02c-985b-4308-b7be-40270e967636 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:11.041403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-645fd02c-985b-4308-b7be-40270e967636 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:11.042761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-645fd02c-985b-4308-b7be-40270e967636 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:11.043432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-645fd02c-985b-4308-b7be-40270e967636 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:11.053711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-687752352", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:11.096813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-645fd02c-985b-4308-b7be-40270e967636 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lazy-loading 'flavor' on Instance uuid 60d4c0a5-6961-49e0-8863-846ca05d0723 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:13:11.099676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:11.174945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:13:11.518646 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-645fd02c-985b-4308-b7be-40270e967636 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "POST /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723/action" status: 200 len: 32 microversion: 2.1 time: 0.490674 May 28 21:13:11.519335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:13:11.520213 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1395/2830] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:13:11 2022] POST /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723/action => generated 32 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:13:11.524319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:13:11.524319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:13:11.524319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:13:11.524319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:13:11.533330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-3dd3f4b7-fdef-44b4-ba99-c01863540b61 req-e46b7edf-97aa-4c66-a2ba-23b0af21cb35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410adadb-b6ed-4904-83ec-dc9be8451944", "tag": "bfefcc6d-5c5d-48a7-9a00-d4ab1bef767e"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:11.545385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3dd3f4b7-fdef-44b4-ba99-c01863540b61 req-e46b7edf-97aa-4c66-a2ba-23b0af21cb35 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:11.552070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3dd3f4b7-fdef-44b4-ba99-c01863540b61 req-e46b7edf-97aa-4c66-a2ba-23b0af21cb35 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:11.552236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=43 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:11.553896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:11.554505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:11.555417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:11.555951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:11.568446 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-3dd3f4b7-fdef-44b4-ba99-c01863540b61 req-e46b7edf-97aa-4c66-a2ba-23b0af21cb35 service nova] Creating event network-changed:bfefcc6d-5c5d-48a7-9a00-d4ab1bef767e for instance 410adadb-b6ed-4904-83ec-dc9be8451944 on nch1-master-1 May 28 21:13:11.574795 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-3dd3f4b7-fdef-44b4-ba99-c01863540b61 req-e46b7edf-97aa-4c66-a2ba-23b0af21cb35 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046893 May 28 21:13:11.576010 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1396/2831] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:11.584715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fc2b0a70-f18f-46d9-ba1a-7c2ae4ed4dbf tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:11.585960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fc2b0a70-f18f-46d9-ba1a-7c2ae4ed4dbf tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:11.590940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Getting quotas for project 149d4937782d47f1b75fcdcfb4a89707. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:13:11.597960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc2b0a70-f18f-46d9-ba1a-7c2ae4ed4dbf tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:11.597960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc2b0a70-f18f-46d9-ba1a-7c2ae4ed4dbf tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:11.597960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc2b0a70-f18f-46d9-ba1a-7c2ae4ed4dbf tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:11.597960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc2b0a70-f18f-46d9-ba1a-7c2ae4ed4dbf tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:11.598345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Getting quotas for user cf4bbfcd9bf64e3eabac163461e98f66 and project 149d4937782d47f1b75fcdcfb4a89707. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:13:11.616420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:13:11.620815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:13:11.833641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fc2b0a70-f18f-46d9-ba1a-7c2ae4ed4dbf tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:11.837023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fc2b0a70-f18f-46d9-ba1a-7c2ae4ed4dbf tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:11.839654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fc2b0a70-f18f-46d9-ba1a-7c2ae4ed4dbf tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:11.841135 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fc2b0a70-f18f-46d9-ba1a-7c2ae4ed4dbf tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.263623 May 28 21:13:11.842017 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1397/2832] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:11 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:11.848490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d61a606f-089a-44ff-90bd-a6ab5e7d2d92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:11.848490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d61a606f-089a-44ff-90bd-a6ab5e7d2d92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:11.856208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d61a606f-089a-44ff-90bd-a6ab5e7d2d92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:11.856600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d61a606f-089a-44ff-90bd-a6ab5e7d2d92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:11.857435 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ab23ed0f-4ce5-40ef-82fe-9afe23c7d474 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.120953 May 28 21:13:11.857733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d61a606f-089a-44ff-90bd-a6ab5e7d2d92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:11.858390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d61a606f-089a-44ff-90bd-a6ab5e7d2d92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:11.859140 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1436/2833] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:13:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:13:11.865551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0f581542-98b6-4e00-b2fa-e8c847a80383 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:11.868372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0f581542-98b6-4e00-b2fa-e8c847a80383 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:11.888780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f581542-98b6-4e00-b2fa-e8c847a80383 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:11.889513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f581542-98b6-4e00-b2fa-e8c847a80383 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:11.890735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f581542-98b6-4e00-b2fa-e8c847a80383 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:11.891919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f581542-98b6-4e00-b2fa-e8c847a80383 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:11.912465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:12.183103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d61a606f-089a-44ff-90bd-a6ab5e7d2d92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:12.193951 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d61a606f-089a-44ff-90bd-a6ab5e7d2d92 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1317 microversion: 2.1 time: 0.350431 May 28 21:13:12.195169 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1398/2834] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:11 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:12.209180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-22339ec1-10e0-47c7-b7ec-c8b96b6c96f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:12.211299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-22339ec1-10e0-47c7-b7ec-c8b96b6c96f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:12.241555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22339ec1-10e0-47c7-b7ec-c8b96b6c96f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:12.242429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22339ec1-10e0-47c7-b7ec-c8b96b6c96f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:12.246773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22339ec1-10e0-47c7-b7ec-c8b96b6c96f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:12.247914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22339ec1-10e0-47c7-b7ec-c8b96b6c96f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:12.267538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0f581542-98b6-4e00-b2fa-e8c847a80383 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:12.280003 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0f581542-98b6-4e00-b2fa-e8c847a80383 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.417874 May 28 21:13:12.282675 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1437/2835] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:11 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:12.297693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b5f96626-ab48-499a-86e5-b446f216e61e tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:12.308921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b5f96626-ab48-499a-86e5-b446f216e61e tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:12.416074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b5f96626-ab48-499a-86e5-b446f216e61e tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:12.426108 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b5f96626-ab48-499a-86e5-b446f216e61e tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1216 microversion: 2.1 time: 0.139989 May 28 21:13:12.429759 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1438/2836] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:12 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1216 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:12.440310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-42f26a36-0dcc-4e08-ba74-14644ae99122 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:12.442786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-42f26a36-0dcc-4e08-ba74-14644ae99122 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:12.461665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42f26a36-0dcc-4e08-ba74-14644ae99122 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:12.462464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42f26a36-0dcc-4e08-ba74-14644ae99122 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:12.463481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42f26a36-0dcc-4e08-ba74-14644ae99122 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:12.464182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42f26a36-0dcc-4e08-ba74-14644ae99122 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:12.537166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-22339ec1-10e0-47c7-b7ec-c8b96b6c96f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:12.547881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:12.554861 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-22339ec1-10e0-47c7-b7ec-c8b96b6c96f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1524 microversion: 2.1 time: 0.353231 May 28 21:13:12.556603 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1399/2837] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:12 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1524 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:12.557635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-42f26a36-0dcc-4e08-ba74-14644ae99122 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:12.579719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-42f26a36-0dcc-4e08-ba74-14644ae99122 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:12.582038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-42f26a36-0dcc-4e08-ba74-14644ae99122 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:12.583642 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-42f26a36-0dcc-4e08-ba74-14644ae99122 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.154017 May 28 21:13:12.584728 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1439/2838] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:12 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:12.872620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2a0c3c60-6316-4788-9884-d014c6937c88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:12.873730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2a0c3c60-6316-4788-9884-d014c6937c88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:12.881313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a0c3c60-6316-4788-9884-d014c6937c88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:12.881881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a0c3c60-6316-4788-9884-d014c6937c88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:12.882972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a0c3c60-6316-4788-9884-d014c6937c88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:12.883133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a0c3c60-6316-4788-9884-d014c6937c88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:13.178516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2a0c3c60-6316-4788-9884-d014c6937c88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:13.195971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2a0c3c60-6316-4788-9884-d014c6937c88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:13.198013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2a0c3c60-6316-4788-9884-d014c6937c88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:13.199518 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2a0c3c60-6316-4788-9884-d014c6937c88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.331522 May 28 21:13:13.200443 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1400/2839] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:12 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:13.224082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4c71b73d-3de9-4801-97c5-8e600583f751 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:13.224082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4c71b73d-3de9-4801-97c5-8e600583f751 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:13.247782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c71b73d-3de9-4801-97c5-8e600583f751 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:13.248344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c71b73d-3de9-4801-97c5-8e600583f751 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:13.249408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c71b73d-3de9-4801-97c5-8e600583f751 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:13.250182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c71b73d-3de9-4801-97c5-8e600583f751 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:13.298775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f25930ea-7e03-41ea-b4ab-a6bf5d460c3c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:13.299353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f25930ea-7e03-41ea-b4ab-a6bf5d460c3c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:13.313936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f25930ea-7e03-41ea-b4ab-a6bf5d460c3c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:13.314637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f25930ea-7e03-41ea-b4ab-a6bf5d460c3c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:13.315596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f25930ea-7e03-41ea-b4ab-a6bf5d460c3c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:13.334048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f25930ea-7e03-41ea-b4ab-a6bf5d460c3c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:13.529198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4c71b73d-3de9-4801-97c5-8e600583f751 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:13.543313 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4c71b73d-3de9-4801-97c5-8e600583f751 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1317 microversion: 2.1 time: 0.331814 May 28 21:13:13.545198 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1440/2840] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:13 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:13.551025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d54bb0c1-a9ef-447b-acc6-87cde703a4cd tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:13.551863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d54bb0c1-a9ef-447b-acc6-87cde703a4cd tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:13.607832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f25930ea-7e03-41ea-b4ab-a6bf5d460c3c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:13.628420 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f25930ea-7e03-41ea-b4ab-a6bf5d460c3c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.323586 May 28 21:13:13.628420 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1401/2841] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:13 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:13.635876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-77667204-0b6c-43e7-a337-c017c098bf9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:13.636509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-77667204-0b6c-43e7-a337-c017c098bf9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:13.653912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77667204-0b6c-43e7-a337-c017c098bf9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:13.654571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77667204-0b6c-43e7-a337-c017c098bf9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:13.655508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77667204-0b6c-43e7-a337-c017c098bf9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:13.656125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77667204-0b6c-43e7-a337-c017c098bf9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:14.204644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d54bb0c1-a9ef-447b-acc6-87cde703a4cd tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:14.217710 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d54bb0c1-a9ef-447b-acc6-87cde703a4cd tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1216 microversion: 2.1 time: 0.671051 May 28 21:13:14.220186 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1441/2842] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:13 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1216 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:14.233489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eedcd260-6979-4ed6-a8f6-6ac3e9b6c668 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:14.235142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eedcd260-6979-4ed6-a8f6-6ac3e9b6c668 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:14.248152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eedcd260-6979-4ed6-a8f6-6ac3e9b6c668 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:14.248152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eedcd260-6979-4ed6-a8f6-6ac3e9b6c668 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:14.248152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eedcd260-6979-4ed6-a8f6-6ac3e9b6c668 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:14.248152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eedcd260-6979-4ed6-a8f6-6ac3e9b6c668 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:14.345623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eedcd260-6979-4ed6-a8f6-6ac3e9b6c668 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:14.360798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eedcd260-6979-4ed6-a8f6-6ac3e9b6c668 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:14.366612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eedcd260-6979-4ed6-a8f6-6ac3e9b6c668 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:14.369395 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eedcd260-6979-4ed6-a8f6-6ac3e9b6c668 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.148078 May 28 21:13:14.372269 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1442/2843] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:14 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:14.391911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-501ad3db-b4f9-4e2e-8417-4d739698c36d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:14.395391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-501ad3db-b4f9-4e2e-8417-4d739698c36d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:14.444861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-501ad3db-b4f9-4e2e-8417-4d739698c36d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:14.448862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-501ad3db-b4f9-4e2e-8417-4d739698c36d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:14.450755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-501ad3db-b4f9-4e2e-8417-4d739698c36d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:14.454134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-501ad3db-b4f9-4e2e-8417-4d739698c36d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:14.740704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-77667204-0b6c-43e7-a337-c017c098bf9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:14.752574 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-77667204-0b6c-43e7-a337-c017c098bf9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1524 microversion: 2.1 time: 1.128901 May 28 21:13:14.753557 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1402/2844] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:13 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1524 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:14.771396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c3ddbf2-375c-40f4-b38a-7785d01aa188 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:14.773800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3c3ddbf2-375c-40f4-b38a-7785d01aa188 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:14.781366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c3ddbf2-375c-40f4-b38a-7785d01aa188 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:14.783067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c3ddbf2-375c-40f4-b38a-7785d01aa188 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:14.784316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c3ddbf2-375c-40f4-b38a-7785d01aa188 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:14.784973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c3ddbf2-375c-40f4-b38a-7785d01aa188 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:15.107567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-501ad3db-b4f9-4e2e-8417-4d739698c36d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:15.120114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-501ad3db-b4f9-4e2e-8417-4d739698c36d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:15.121651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-501ad3db-b4f9-4e2e-8417-4d739698c36d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:15.122882 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-501ad3db-b4f9-4e2e-8417-4d739698c36d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.749622 May 28 21:13:15.134911 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1443/2845] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:14 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:15.139568 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d1889d0b-4f93-4516-8b7d-b2eb3f52ddd1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:15.140208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d1889d0b-4f93-4516-8b7d-b2eb3f52ddd1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:15.161560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d1889d0b-4f93-4516-8b7d-b2eb3f52ddd1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:15.162056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d1889d0b-4f93-4516-8b7d-b2eb3f52ddd1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:15.162855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d1889d0b-4f93-4516-8b7d-b2eb3f52ddd1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:15.163311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d1889d0b-4f93-4516-8b7d-b2eb3f52ddd1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:15.233168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3c3ddbf2-375c-40f4-b38a-7785d01aa188 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:15.271820 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3c3ddbf2-375c-40f4-b38a-7785d01aa188 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1317 microversion: 2.1 time: 0.502040 May 28 21:13:15.274053 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1403/2846] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:14 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1317 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:15.311596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6a8002b8-b5c3-4d30-8da0-459e41d38a5f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:15.312469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6a8002b8-b5c3-4d30-8da0-459e41d38a5f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:15.336357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=24 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:15.349221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a8002b8-b5c3-4d30-8da0-459e41d38a5f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:15.351209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a8002b8-b5c3-4d30-8da0-459e41d38a5f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:15.360025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a8002b8-b5c3-4d30-8da0-459e41d38a5f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:15.362738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a8002b8-b5c3-4d30-8da0-459e41d38a5f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:15.427711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d1889d0b-4f93-4516-8b7d-b2eb3f52ddd1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:15.436378 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d1889d0b-4f93-4516-8b7d-b2eb3f52ddd1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.300638 May 28 21:13:15.449146 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1444/2847] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:15 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:15.459065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bceef1b9-21fd-4cf1-8843-8bec29260f55 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:15.460050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bceef1b9-21fd-4cf1-8843-8bec29260f55 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:15.484201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bceef1b9-21fd-4cf1-8843-8bec29260f55 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:15.485050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bceef1b9-21fd-4cf1-8843-8bec29260f55 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:15.486096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bceef1b9-21fd-4cf1-8843-8bec29260f55 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:15.486997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bceef1b9-21fd-4cf1-8843-8bec29260f55 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:15.624336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6a8002b8-b5c3-4d30-8da0-459e41d38a5f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:15.629581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bceef1b9-21fd-4cf1-8843-8bec29260f55 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:15.641981 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6a8002b8-b5c3-4d30-8da0-459e41d38a5f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1276 microversion: 2.1 time: 0.343874 May 28 21:13:15.651932 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1404/2848] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:15 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1276 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:15.665510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bceef1b9-21fd-4cf1-8843-8bec29260f55 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:15.667080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bceef1b9-21fd-4cf1-8843-8bec29260f55 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:15.669157 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bceef1b9-21fd-4cf1-8843-8bec29260f55 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1408 microversion: 2.54 time: 0.217877 May 28 21:13:15.688280 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1445/2849] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:15 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:15.771449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c59a6510-bd1b-4d06-83ea-23d5ff936a71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:15.772243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c59a6510-bd1b-4d06-83ea-23d5ff936a71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:15.788362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c59a6510-bd1b-4d06-83ea-23d5ff936a71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:15.788830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c59a6510-bd1b-4d06-83ea-23d5ff936a71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:15.789648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c59a6510-bd1b-4d06-83ea-23d5ff936a71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:15.790138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c59a6510-bd1b-4d06-83ea-23d5ff936a71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:16.079097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c59a6510-bd1b-4d06-83ea-23d5ff936a71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:16.090624 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c59a6510-bd1b-4d06-83ea-23d5ff936a71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1524 microversion: 2.1 time: 0.323429 May 28 21:13:16.091577 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1405/2850] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:15 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1524 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:16.153468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b7561ab4-4819-49bc-8252-4256166d7235 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:16.154553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b7561ab4-4819-49bc-8252-4256166d7235 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:16.162192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7561ab4-4819-49bc-8252-4256166d7235 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:16.163211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7561ab4-4819-49bc-8252-4256166d7235 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:16.164014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7561ab4-4819-49bc-8252-4256166d7235 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:16.164506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7561ab4-4819-49bc-8252-4256166d7235 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:16.291310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ac76c058-5e24-4a78-95fb-1a87448f0ecd tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:16.293546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ac76c058-5e24-4a78-95fb-1a87448f0ecd tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:16.302291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac76c058-5e24-4a78-95fb-1a87448f0ecd tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:16.302982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac76c058-5e24-4a78-95fb-1a87448f0ecd tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:16.304022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac76c058-5e24-4a78-95fb-1a87448f0ecd tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:16.304709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac76c058-5e24-4a78-95fb-1a87448f0ecd tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:16.990381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b7561ab4-4819-49bc-8252-4256166d7235 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:17.009648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b7561ab4-4819-49bc-8252-4256166d7235 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:17.014032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b7561ab4-4819-49bc-8252-4256166d7235 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:17.019313 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b7561ab4-4819-49bc-8252-4256166d7235 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.867867 May 28 21:13:17.022097 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1446/2851] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:16 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:17.033864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-957207b1-6fa5-49c2-a1f2-e32205a960f3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:17.035122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-957207b1-6fa5-49c2-a1f2-e32205a960f3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:17.052451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:17.068289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-957207b1-6fa5-49c2-a1f2-e32205a960f3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:17.068763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-957207b1-6fa5-49c2-a1f2-e32205a960f3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:17.070084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-957207b1-6fa5-49c2-a1f2-e32205a960f3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:17.070084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-957207b1-6fa5-49c2-a1f2-e32205a960f3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:17.116854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ac76c058-5e24-4a78-95fb-1a87448f0ecd tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:17.139558 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ac76c058-5e24-4a78-95fb-1a87448f0ecd tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1317 microversion: 2.1 time: 0.851524 May 28 21:13:17.141189 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1406/2852] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:16 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1317 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:17.171870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-93170dfb-d65c-44e9-875a-7d34a648a0a1 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:17.172787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-93170dfb-d65c-44e9-875a-7d34a648a0a1 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:17.200716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93170dfb-d65c-44e9-875a-7d34a648a0a1 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:17.202037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93170dfb-d65c-44e9-875a-7d34a648a0a1 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:17.203099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93170dfb-d65c-44e9-875a-7d34a648a0a1 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:17.203782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93170dfb-d65c-44e9-875a-7d34a648a0a1 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:17.321076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-93170dfb-d65c-44e9-875a-7d34a648a0a1 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:17.330587 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-93170dfb-d65c-44e9-875a-7d34a648a0a1 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1274 microversion: 2.1 time: 0.187685 May 28 21:13:17.344738 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1407/2853] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:17 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1274 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:17.365007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a67f7330-f5b8-4e15-8562-23184617534c tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:17.366082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a67f7330-f5b8-4e15-8562-23184617534c tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:17.377527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a67f7330-f5b8-4e15-8562-23184617534c tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:17.378272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a67f7330-f5b8-4e15-8562-23184617534c tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:17.379226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a67f7330-f5b8-4e15-8562-23184617534c tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:17.379833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a67f7330-f5b8-4e15-8562-23184617534c tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:17.428618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-957207b1-6fa5-49c2-a1f2-e32205a960f3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:17.437639 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-957207b1-6fa5-49c2-a1f2-e32205a960f3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.414390 May 28 21:13:17.439567 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1447/2854] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:17 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:17.451725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3b0aba9c-83ba-4279-ab1e-51c3f36e5270 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:17.452558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3b0aba9c-83ba-4279-ab1e-51c3f36e5270 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:17.464452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b0aba9c-83ba-4279-ab1e-51c3f36e5270 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:17.468910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b0aba9c-83ba-4279-ab1e-51c3f36e5270 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:17.468910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b0aba9c-83ba-4279-ab1e-51c3f36e5270 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:17.468910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b0aba9c-83ba-4279-ab1e-51c3f36e5270 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:17.586138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a67f7330-f5b8-4e15-8562-23184617534c tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:17.609107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a67f7330-f5b8-4e15-8562-23184617534c tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:17.612631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a67f7330-f5b8-4e15-8562-23184617534c tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:17.615571 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a67f7330-f5b8-4e15-8562-23184617534c tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1414 microversion: 2.54 time: 0.269524 May 28 21:13:17.628182 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1408/2855] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:17 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1414 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:17.788078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3b0aba9c-83ba-4279-ab1e-51c3f36e5270 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:17.799929 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3b0aba9c-83ba-4279-ab1e-51c3f36e5270 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1524 microversion: 2.1 time: 0.359082 May 28 21:13:17.805144 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1448/2856] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:17 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1524 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:18.039005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7e9062cb-5f90-40d6-9379-d41e694a08ff tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:18.039986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7e9062cb-5f90-40d6-9379-d41e694a08ff tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:18.064247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e9062cb-5f90-40d6-9379-d41e694a08ff tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:18.065169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e9062cb-5f90-40d6-9379-d41e694a08ff tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:18.066521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e9062cb-5f90-40d6-9379-d41e694a08ff tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:18.067178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e9062cb-5f90-40d6-9379-d41e694a08ff tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:18.158173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ff06a52d-5044-4126-b0f0-b431077fc5a1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:18.162660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ff06a52d-5044-4126-b0f0-b431077fc5a1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:18.226143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff06a52d-5044-4126-b0f0-b431077fc5a1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:18.226143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff06a52d-5044-4126-b0f0-b431077fc5a1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:18.226143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff06a52d-5044-4126-b0f0-b431077fc5a1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:18.226143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff06a52d-5044-4126-b0f0-b431077fc5a1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:18.789468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7e9062cb-5f90-40d6-9379-d41e694a08ff tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:18.798467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ff06a52d-5044-4126-b0f0-b431077fc5a1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:18.806890 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ff06a52d-5044-4126-b0f0-b431077fc5a1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1317 microversion: 2.1 time: 0.653774 May 28 21:13:18.810767 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1449/2857] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:18 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1317 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:18.822177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7e9062cb-5f90-40d6-9379-d41e694a08ff tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:18.824395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7e9062cb-5f90-40d6-9379-d41e694a08ff tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:18.825327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2a9c274c-a7e7-48d9-aa5f-67f7070a7ec8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:18.830210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2a9c274c-a7e7-48d9-aa5f-67f7070a7ec8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:18.830439 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7e9062cb-5f90-40d6-9379-d41e694a08ff tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.794882 May 28 21:13:18.841887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a9c274c-a7e7-48d9-aa5f-67f7070a7ec8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:18.846625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a9c274c-a7e7-48d9-aa5f-67f7070a7ec8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:18.846625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a9c274c-a7e7-48d9-aa5f-67f7070a7ec8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:18.846846 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1409/2858] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:18 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:18.846960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a9c274c-a7e7-48d9-aa5f-67f7070a7ec8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:18.848667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-65a7e24a-4c71-4500-8188-02af885867d3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:18.849589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-65a7e24a-4c71-4500-8188-02af885867d3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:18.858071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65a7e24a-4c71-4500-8188-02af885867d3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:18.860820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65a7e24a-4c71-4500-8188-02af885867d3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:18.862148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65a7e24a-4c71-4500-8188-02af885867d3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:18.862817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65a7e24a-4c71-4500-8188-02af885867d3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:19.228681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2a9c274c-a7e7-48d9-aa5f-67f7070a7ec8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:19.252979 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2a9c274c-a7e7-48d9-aa5f-67f7070a7ec8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1316 microversion: 2.1 time: 0.440004 May 28 21:13:19.257044 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1450/2859] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:18 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:19.272211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-340dde0a-57ea-4811-ab80-11883da094a4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:19.273792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-340dde0a-57ea-4811-ab80-11883da094a4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:19.281073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-65a7e24a-4c71-4500-8188-02af885867d3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:19.290947 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-65a7e24a-4c71-4500-8188-02af885867d3 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.445745 May 28 21:13:19.291294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-340dde0a-57ea-4811-ab80-11883da094a4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:19.291879 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1410/2860] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:18 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:19.292921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-340dde0a-57ea-4811-ab80-11883da094a4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:19.294831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-340dde0a-57ea-4811-ab80-11883da094a4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:19.297910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-340dde0a-57ea-4811-ab80-11883da094a4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:19.326185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d006529f-4f6b-4702-a8cc-14f3b9898f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:19.326957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d006529f-4f6b-4702-a8cc-14f3b9898f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:19.338237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d006529f-4f6b-4702-a8cc-14f3b9898f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:19.343941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d006529f-4f6b-4702-a8cc-14f3b9898f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:19.343941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d006529f-4f6b-4702-a8cc-14f3b9898f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:19.346442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d006529f-4f6b-4702-a8cc-14f3b9898f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:19.363352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:19.548884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-340dde0a-57ea-4811-ab80-11883da094a4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:19.563848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-340dde0a-57ea-4811-ab80-11883da094a4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:19.572892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-340dde0a-57ea-4811-ab80-11883da094a4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:19.574577 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-340dde0a-57ea-4811-ab80-11883da094a4 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1414 microversion: 2.54 time: 0.315441 May 28 21:13:19.588833 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1451/2861] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:19 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1414 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:19.634463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d006529f-4f6b-4702-a8cc-14f3b9898f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:19.645109 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d006529f-4f6b-4702-a8cc-14f3b9898f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1524 microversion: 2.1 time: 0.352152 May 28 21:13:19.645705 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1411/2862] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:19 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1524 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:19.827764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ee3e7157-3c98-4b46-adcc-b70d2e1e5a03 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:19.828987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ee3e7157-3c98-4b46-adcc-b70d2e1e5a03 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:19.835923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee3e7157-3c98-4b46-adcc-b70d2e1e5a03 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:19.845494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee3e7157-3c98-4b46-adcc-b70d2e1e5a03 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:19.847226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee3e7157-3c98-4b46-adcc-b70d2e1e5a03 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:19.847789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee3e7157-3c98-4b46-adcc-b70d2e1e5a03 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:19.850374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7e105943-bbff-4825-9d64-2f4180f6483a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:19.850998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7e105943-bbff-4825-9d64-2f4180f6483a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:19.864880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e105943-bbff-4825-9d64-2f4180f6483a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:19.868772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e105943-bbff-4825-9d64-2f4180f6483a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:19.868772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e105943-bbff-4825-9d64-2f4180f6483a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:19.868772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e105943-bbff-4825-9d64-2f4180f6483a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:20.402440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7e105943-bbff-4825-9d64-2f4180f6483a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:20.418601 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7e105943-bbff-4825-9d64-2f4180f6483a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:20.420223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7e105943-bbff-4825-9d64-2f4180f6483a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:20.421449 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7e105943-bbff-4825-9d64-2f4180f6483a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.575673 May 28 21:13:20.432387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ee3e7157-3c98-4b46-adcc-b70d2e1e5a03 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:20.434470 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1412/2863] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:19 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:20.448162 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ee3e7157-3c98-4b46-adcc-b70d2e1e5a03 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1317 microversion: 2.1 time: 0.624374 May 28 21:13:20.451686 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1452/2864] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:19 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1317 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:20.464334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-397a5e11-e5af-4546-8a3a-4b4a8e6952a5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:20.465121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-397a5e11-e5af-4546-8a3a-4b4a8e6952a5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:20.479850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-397a5e11-e5af-4546-8a3a-4b4a8e6952a5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:20.483806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-61133725-e893-4df9-9579-9d8e79f0f6c6 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:20.483944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-397a5e11-e5af-4546-8a3a-4b4a8e6952a5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:20.484546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-397a5e11-e5af-4546-8a3a-4b4a8e6952a5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:20.485880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-61133725-e893-4df9-9579-9d8e79f0f6c6 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:20.486822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-397a5e11-e5af-4546-8a3a-4b4a8e6952a5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:20.511373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61133725-e893-4df9-9579-9d8e79f0f6c6 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:20.513498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61133725-e893-4df9-9579-9d8e79f0f6c6 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:20.516430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61133725-e893-4df9-9579-9d8e79f0f6c6 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:20.517736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61133725-e893-4df9-9579-9d8e79f0f6c6 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:20.833760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-61133725-e893-4df9-9579-9d8e79f0f6c6 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:20.845123 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-61133725-e893-4df9-9579-9d8e79f0f6c6 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1316 microversion: 2.1 time: 0.409297 May 28 21:13:20.846097 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1413/2865] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:20 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1316 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:20.871925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0c5ce189-a1ae-4b7a-8306-3d76c521e4a5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:20.873763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0c5ce189-a1ae-4b7a-8306-3d76c521e4a5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:20.884996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:20.895337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c5ce189-a1ae-4b7a-8306-3d76c521e4a5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:20.913988 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c5ce189-a1ae-4b7a-8306-3d76c521e4a5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:20.917797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c5ce189-a1ae-4b7a-8306-3d76c521e4a5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:20.920193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c5ce189-a1ae-4b7a-8306-3d76c521e4a5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:21.029902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-397a5e11-e5af-4546-8a3a-4b4a8e6952a5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:21.048247 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-397a5e11-e5af-4546-8a3a-4b4a8e6952a5 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.591916 May 28 21:13:21.050738 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1453/2866] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:20 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:21.068907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9c98a002-0dfb-4f46-a1b7-8cd9d84acd59 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:21.085141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c5ce189-a1ae-4b7a-8306-3d76c521e4a5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:21.090639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9c98a002-0dfb-4f46-a1b7-8cd9d84acd59 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:21.096702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c5ce189-a1ae-4b7a-8306-3d76c521e4a5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:21.098272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c5ce189-a1ae-4b7a-8306-3d76c521e4a5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:21.099539 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0c5ce189-a1ae-4b7a-8306-3d76c521e4a5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1399 microversion: 2.54 time: 0.252461 May 28 21:13:21.109919 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1414/2867] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:20 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1399 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:21.109919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-4fb5e21a-7136-4df8-8994-6c368c25526c req-2fa3b74c-2cb9-4bea-979e-e194f367f38b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410adadb-b6ed-4904-83ec-dc9be8451944", "name": "network-vif-plugged", "status": "completed", "tag": "bfefcc6d-5c5d-48a7-9a00-d4ab1bef767e"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:21.124677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-4fb5e21a-7136-4df8-8994-6c368c25526c req-2fa3b74c-2cb9-4bea-979e-e194f367f38b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:21.124677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-4fb5e21a-7136-4df8-8994-6c368c25526c req-2fa3b74c-2cb9-4bea-979e-e194f367f38b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:21.130979 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-4fb5e21a-7136-4df8-8994-6c368c25526c req-2fa3b74c-2cb9-4bea-979e-e194f367f38b service nova] Creating event network-vif-plugged:bfefcc6d-5c5d-48a7-9a00-d4ab1bef767e for instance 410adadb-b6ed-4904-83ec-dc9be8451944 on nch1-master-1 May 28 21:13:21.131493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c98a002-0dfb-4f46-a1b7-8cd9d84acd59 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:21.134028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c98a002-0dfb-4f46-a1b7-8cd9d84acd59 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:21.136726 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-4fb5e21a-7136-4df8-8994-6c368c25526c req-2fa3b74c-2cb9-4bea-979e-e194f367f38b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033984 May 28 21:13:21.137515 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1415/2868] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:21.143601 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-29cd939f-de60-4e2d-ba50-ea17326a4f02 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '.version_select at 0x7f4d575a6940>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:21.145125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c98a002-0dfb-4f46-a1b7-8cd9d84acd59 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:21.149286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c98a002-0dfb-4f46-a1b7-8cd9d84acd59 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:21.240064 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-29cd939f-de60-4e2d-ba50-ea17326a4f02 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1059017657" status: 204 len: 0 microversion: 2.54 time: 0.101089 May 28 21:13:21.242143 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1416/2869] 10.222.0.33 () {60 vars in 1318 bytes} [Sat May 28 21:13:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1059017657 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:13:21.404261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-f2ff5b0b-903e-4590-870c-b9f3b2a37483 req-1f65e743-0d96-4e0b-ae56-d04711beb4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "818f89de-48f1-43d3-9ee2-4ab0e3652353", "tag": "59de6851-8323-4006-84f5-6c1b327b2c4f"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:21.449452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f2ff5b0b-903e-4590-870c-b9f3b2a37483 req-1f65e743-0d96-4e0b-ae56-d04711beb4c3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:21.466211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f2ff5b0b-903e-4590-870c-b9f3b2a37483 req-1f65e743-0d96-4e0b-ae56-d04711beb4c3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:21.523302 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-f2ff5b0b-903e-4590-870c-b9f3b2a37483 req-1f65e743-0d96-4e0b-ae56-d04711beb4c3 service nova] Creating event network-changed:59de6851-8323-4006-84f5-6c1b327b2c4f for instance 818f89de-48f1-43d3-9ee2-4ab0e3652353 on nch2-master-1 May 28 21:13:21.547058 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-f2ff5b0b-903e-4590-870c-b9f3b2a37483 req-1f65e743-0d96-4e0b-ae56-d04711beb4c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.304665 May 28 21:13:21.549362 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1417/2870] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:21.566967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9c98a002-0dfb-4f46-a1b7-8cd9d84acd59 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:21.570131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-17090d05-6d2a-491e-9547-0d9ca0d38511 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:21.573597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-17090d05-6d2a-491e-9547-0d9ca0d38511 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:21.577969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:21.584782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-17090d05-6d2a-491e-9547-0d9ca0d38511 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:21.585909 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9c98a002-0dfb-4f46-a1b7-8cd9d84acd59 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1524 microversion: 2.1 time: 0.533842 May 28 21:13:21.596673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-17090d05-6d2a-491e-9547-0d9ca0d38511 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:21.596673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-17090d05-6d2a-491e-9547-0d9ca0d38511 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:21.596673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-17090d05-6d2a-491e-9547-0d9ca0d38511 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:21.602752 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1454/2871] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:21 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1524 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:21.617157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d82c0532-b87c-4286-b7d2-57ae6513cdeb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:21.618110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d82c0532-b87c-4286-b7d2-57ae6513cdeb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:21.652588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d82c0532-b87c-4286-b7d2-57ae6513cdeb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:21.653064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d82c0532-b87c-4286-b7d2-57ae6513cdeb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:21.658482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d82c0532-b87c-4286-b7d2-57ae6513cdeb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:21.658953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d82c0532-b87c-4286-b7d2-57ae6513cdeb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:21.676604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-17090d05-6d2a-491e-9547-0d9ca0d38511 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:13:21.989625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d82c0532-b87c-4286-b7d2-57ae6513cdeb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:22.008199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d82c0532-b87c-4286-b7d2-57ae6513cdeb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:22.016925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d82c0532-b87c-4286-b7d2-57ae6513cdeb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:22.019373 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d82c0532-b87c-4286-b7d2-57ae6513cdeb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.415202 May 28 21:13:22.040423 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1455/2872] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:21 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:22.056206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c4bfb665-97f7-4fb9-a726-215546dd5664 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:22.062696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c4bfb665-97f7-4fb9-a726-215546dd5664 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:22.086712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4bfb665-97f7-4fb9-a726-215546dd5664 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:22.090402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4bfb665-97f7-4fb9-a726-215546dd5664 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:22.091421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4bfb665-97f7-4fb9-a726-215546dd5664 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:22.094418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4bfb665-97f7-4fb9-a726-215546dd5664 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:22.114542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:22.171553 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-17090d05-6d2a-491e-9547-0d9ca0d38511 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 204 len: 0 microversion: 2.54 time: 0.614307 May 28 21:13:22.175542 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1418/2873] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:13:21 2022] DELETE /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:13:22.189264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-39d22bf2-602a-4945-bc60-3c3b3d1af31d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:22.190157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-39d22bf2-602a-4945-bc60-3c3b3d1af31d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:22.209536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39d22bf2-602a-4945-bc60-3c3b3d1af31d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:22.212307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39d22bf2-602a-4945-bc60-3c3b3d1af31d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:22.214488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39d22bf2-602a-4945-bc60-3c3b3d1af31d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:22.214976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39d22bf2-602a-4945-bc60-3c3b3d1af31d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:22.634575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c4bfb665-97f7-4fb9-a726-215546dd5664 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:22.644474 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c4bfb665-97f7-4fb9-a726-215546dd5664 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1317 microversion: 2.1 time: 0.605000 May 28 21:13:22.654836 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1456/2874] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:22 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:22.660125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-773e8e02-3722-49c8-9917-0d551f37ddcb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:22.673146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-39d22bf2-602a-4945-bc60-3c3b3d1af31d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:22.678446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-773e8e02-3722-49c8-9917-0d551f37ddcb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:22.681068 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-39d22bf2-602a-4945-bc60-3c3b3d1af31d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1316 microversion: 2.1 time: 0.506900 May 28 21:13:22.683244 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1419/2875] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:22 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:22.700833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3d25a74c-89c0-4d83-906e-e7fe0494cbe5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:22.706513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3d25a74c-89c0-4d83-906e-e7fe0494cbe5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:22.711782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-773e8e02-3722-49c8-9917-0d551f37ddcb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:22.714198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-773e8e02-3722-49c8-9917-0d551f37ddcb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:22.715026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-773e8e02-3722-49c8-9917-0d551f37ddcb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:22.715475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-773e8e02-3722-49c8-9917-0d551f37ddcb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:22.744692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d25a74c-89c0-4d83-906e-e7fe0494cbe5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:22.745159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d25a74c-89c0-4d83-906e-e7fe0494cbe5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:22.745975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d25a74c-89c0-4d83-906e-e7fe0494cbe5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:22.750133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d25a74c-89c0-4d83-906e-e7fe0494cbe5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:22.869370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3d25a74c-89c0-4d83-906e-e7fe0494cbe5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:22.879832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3d25a74c-89c0-4d83-906e-e7fe0494cbe5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:22.888030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3d25a74c-89c0-4d83-906e-e7fe0494cbe5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:22.889539 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3d25a74c-89c0-4d83-906e-e7fe0494cbe5 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1405 microversion: 2.54 time: 0.205061 May 28 21:13:22.893781 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1420/2876] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:22 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:22.933593 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9f6a1815-a891-40bb-a03c-1a3b95834106 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:22.933593 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9f6a1815-a891-40bb-a03c-1a3b95834106 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:22.971682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-773e8e02-3722-49c8-9917-0d551f37ddcb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:22.985689 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-773e8e02-3722-49c8-9917-0d551f37ddcb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.329366 May 28 21:13:22.992481 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1457/2877] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:22 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:23.003739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f6a1815-a891-40bb-a03c-1a3b95834106 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:23.014864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f6a1815-a891-40bb-a03c-1a3b95834106 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:23.014864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f6a1815-a891-40bb-a03c-1a3b95834106 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:23.014864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f6a1815-a891-40bb-a03c-1a3b95834106 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:23.074783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-79351d5d-0002-472c-9502-bcb1f1782e5d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:23.076332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-79351d5d-0002-472c-9502-bcb1f1782e5d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:23.105859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79351d5d-0002-472c-9502-bcb1f1782e5d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:23.106609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79351d5d-0002-472c-9502-bcb1f1782e5d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:23.111789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79351d5d-0002-472c-9502-bcb1f1782e5d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:23.112324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79351d5d-0002-472c-9502-bcb1f1782e5d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:23.434460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9f6a1815-a891-40bb-a03c-1a3b95834106 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:23.461788 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9f6a1815-a891-40bb-a03c-1a3b95834106 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1524 microversion: 2.1 time: 0.568608 May 28 21:13:23.466293 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1421/2878] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:22 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1524 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:23.481990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-79351d5d-0002-472c-9502-bcb1f1782e5d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:23.494433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-79351d5d-0002-472c-9502-bcb1f1782e5d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:23.496266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-79351d5d-0002-472c-9502-bcb1f1782e5d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:23.497551 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-79351d5d-0002-472c-9502-bcb1f1782e5d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.458516 May 28 21:13:23.498165 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1458/2879] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:23 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:13:23.663361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a95f58a1-d753-4b59-a9aa-b5c3dc2df095 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:23.664557 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a95f58a1-d753-4b59-a9aa-b5c3dc2df095 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:23.681787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a95f58a1-d753-4b59-a9aa-b5c3dc2df095 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:23.686313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a95f58a1-d753-4b59-a9aa-b5c3dc2df095 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:23.694122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a95f58a1-d753-4b59-a9aa-b5c3dc2df095 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:23.694122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a95f58a1-d753-4b59-a9aa-b5c3dc2df095 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:23.702196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-90cde755-ac46-4d5b-ada5-10e1ba343f4a tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:23.703595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-90cde755-ac46-4d5b-ada5-10e1ba343f4a tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:23.722473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90cde755-ac46-4d5b-ada5-10e1ba343f4a tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:23.723332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90cde755-ac46-4d5b-ada5-10e1ba343f4a tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:23.724445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90cde755-ac46-4d5b-ada5-10e1ba343f4a tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:23.725084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90cde755-ac46-4d5b-ada5-10e1ba343f4a tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:24.003921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-90cde755-ac46-4d5b-ada5-10e1ba343f4a tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:24.015215 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-90cde755-ac46-4d5b-ada5-10e1ba343f4a tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1316 microversion: 2.1 time: 0.319572 May 28 21:13:24.019848 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1459/2880] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:23 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:24.025311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cb2556a7-adfc-450b-ba1c-2b2736ba6e70 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:24.030960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cb2556a7-adfc-450b-ba1c-2b2736ba6e70 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:24.046719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cb2556a7-adfc-450b-ba1c-2b2736ba6e70 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:24.052459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cb2556a7-adfc-450b-ba1c-2b2736ba6e70 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:24.053635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cb2556a7-adfc-450b-ba1c-2b2736ba6e70 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:24.054321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cb2556a7-adfc-450b-ba1c-2b2736ba6e70 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:24.077648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a95f58a1-d753-4b59-a9aa-b5c3dc2df095 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:24.092758 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a95f58a1-d753-4b59-a9aa-b5c3dc2df095 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1506 microversion: 2.1 time: 0.433528 May 28 21:13:24.106947 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1422/2881] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:23 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1506 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:24.114326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-35c2b1d1-4300-4139-a882-20d5c8156783 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:24.115194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-35c2b1d1-4300-4139-a882-20d5c8156783 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:24.124301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35c2b1d1-4300-4139-a882-20d5c8156783 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:24.125013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35c2b1d1-4300-4139-a882-20d5c8156783 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:24.126767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35c2b1d1-4300-4139-a882-20d5c8156783 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:24.128738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35c2b1d1-4300-4139-a882-20d5c8156783 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:24.194221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cb2556a7-adfc-450b-ba1c-2b2736ba6e70 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:24.203484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cb2556a7-adfc-450b-ba1c-2b2736ba6e70 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:24.220157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cb2556a7-adfc-450b-ba1c-2b2736ba6e70 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:24.222249 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cb2556a7-adfc-450b-ba1c-2b2736ba6e70 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1405 microversion: 2.54 time: 0.200184 May 28 21:13:24.228208 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1460/2882] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:24 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:24.261726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4b4ef060-f368-4d25-a573-8527c299e172 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:24.265550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4b4ef060-f368-4d25-a573-8527c299e172 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:24.281363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=9 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:24.288011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4b4ef060-f368-4d25-a573-8527c299e172 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:24.290774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4b4ef060-f368-4d25-a573-8527c299e172 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:24.298862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4b4ef060-f368-4d25-a573-8527c299e172 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:24.302143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4b4ef060-f368-4d25-a573-8527c299e172 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:24.640314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-35c2b1d1-4300-4139-a882-20d5c8156783 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:24.652685 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-35c2b1d1-4300-4139-a882-20d5c8156783 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.544322 May 28 21:13:24.663211 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1423/2883] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:24 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:24.669341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2a6f0885-1329-4fe7-bb99-16bc27708860 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:24.672396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2a6f0885-1329-4fe7-bb99-16bc27708860 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:24.681659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4b4ef060-f368-4d25-a573-8527c299e172 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:24.694861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a6f0885-1329-4fe7-bb99-16bc27708860 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:24.695582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a6f0885-1329-4fe7-bb99-16bc27708860 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:24.702282 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4b4ef060-f368-4d25-a573-8527c299e172 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1506 microversion: 2.1 time: 0.468074 May 28 21:13:24.709430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a6f0885-1329-4fe7-bb99-16bc27708860 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:24.710760 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1461/2884] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:24 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1506 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:24.711302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a6f0885-1329-4fe7-bb99-16bc27708860 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:24.730840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-be5501dd-ff67-41af-a830-ef9968b6b59a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:24.731446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-be5501dd-ff67-41af-a830-ef9968b6b59a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:24.748389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be5501dd-ff67-41af-a830-ef9968b6b59a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:24.749093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be5501dd-ff67-41af-a830-ef9968b6b59a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:24.750072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be5501dd-ff67-41af-a830-ef9968b6b59a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:24.750760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be5501dd-ff67-41af-a830-ef9968b6b59a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:25.090154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-be5501dd-ff67-41af-a830-ef9968b6b59a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:25.098831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2a6f0885-1329-4fe7-bb99-16bc27708860 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:25.107708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-be5501dd-ff67-41af-a830-ef9968b6b59a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:25.109710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-be5501dd-ff67-41af-a830-ef9968b6b59a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:25.111424 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-be5501dd-ff67-41af-a830-ef9968b6b59a tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.397735 May 28 21:13:25.112493 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2a6f0885-1329-4fe7-bb99-16bc27708860 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1524 microversion: 2.1 time: 0.447915 May 28 21:13:25.113111 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1424/2885] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:24 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1524 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:25.116958 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1462/2886] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:24 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:25.127577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-15067149-e478-499d-a6cc-aa21f61e5fd8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:25.134867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-419a5d1f-774f-4a57-8dcc-09829ec53941 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:25.135443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-15067149-e478-499d-a6cc-aa21f61e5fd8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:25.136763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-419a5d1f-774f-4a57-8dcc-09829ec53941 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:25.142886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15067149-e478-499d-a6cc-aa21f61e5fd8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:25.143571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15067149-e478-499d-a6cc-aa21f61e5fd8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:25.144464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15067149-e478-499d-a6cc-aa21f61e5fd8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:25.144987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15067149-e478-499d-a6cc-aa21f61e5fd8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:25.148907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-419a5d1f-774f-4a57-8dcc-09829ec53941 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:25.150894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-419a5d1f-774f-4a57-8dcc-09829ec53941 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:25.151112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-419a5d1f-774f-4a57-8dcc-09829ec53941 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:25.152119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-419a5d1f-774f-4a57-8dcc-09829ec53941 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:25.297692 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-419a5d1f-774f-4a57-8dcc-09829ec53941 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "PUT /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1078 microversion: 2.1 time: 0.183502 May 28 21:13:25.298825 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1425/2887] 10.222.0.33 () {60 vars in 1255 bytes} [Sat May 28 21:13:25 2022] PUT /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1078 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:25.303637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-519a0538-06d6-4d78-8d6d-894fc283f67f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:25.304258 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-519a0538-06d6-4d78-8d6d-894fc283f67f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:25.327903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-519a0538-06d6-4d78-8d6d-894fc283f67f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:25.328368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-519a0538-06d6-4d78-8d6d-894fc283f67f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:25.335588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-519a0538-06d6-4d78-8d6d-894fc283f67f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:25.339337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-519a0538-06d6-4d78-8d6d-894fc283f67f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:25.345778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-15067149-e478-499d-a6cc-aa21f61e5fd8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:25.369622 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-15067149-e478-499d-a6cc-aa21f61e5fd8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1316 microversion: 2.1 time: 0.253632 May 28 21:13:25.371433 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1463/2888] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:25 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:25.409202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ac346163-57af-4774-9033-d65d195149e2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:25.409855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ac346163-57af-4774-9033-d65d195149e2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:25.427848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac346163-57af-4774-9033-d65d195149e2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:25.434968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac346163-57af-4774-9033-d65d195149e2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:25.435960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac346163-57af-4774-9033-d65d195149e2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:25.436392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-519a0538-06d6-4d78-8d6d-894fc283f67f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:25.436509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac346163-57af-4774-9033-d65d195149e2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:25.437051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-519a0538-06d6-4d78-8d6d-894fc283f67f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:25.437506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-519a0538-06d6-4d78-8d6d-894fc283f67f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lazy-loading 'fault' on Instance uuid 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:13:25.491123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-519a0538-06d6-4d78-8d6d-894fc283f67f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:25.504026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-519a0538-06d6-4d78-8d6d-894fc283f67f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:25.504026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-519a0538-06d6-4d78-8d6d-894fc283f67f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '752fbb20c21449bb80bc9de2da474865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd64af7d364a74dc6b9c527532a5d8abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:25.504730 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-519a0538-06d6-4d78-8d6d-894fc283f67f tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 200 len: 1410 microversion: 2.54 time: 0.204109 May 28 21:13:25.505289 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1426/2889] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:25 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 1410 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:25.670951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e224fde0-4490-449d-ab96-367a4d631ae0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:25.672378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e224fde0-4490-449d-ab96-367a4d631ae0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:25.680374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e224fde0-4490-449d-ab96-367a4d631ae0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:25.682088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e224fde0-4490-449d-ab96-367a4d631ae0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:25.683169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e224fde0-4490-449d-ab96-367a4d631ae0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:25.683986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e224fde0-4490-449d-ab96-367a4d631ae0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:25.723346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:25.995706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e224fde0-4490-449d-ab96-367a4d631ae0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:26.008537 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e224fde0-4490-449d-ab96-367a4d631ae0 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.342314 May 28 21:13:26.009394 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1427/2890] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:25 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:26.010611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ac346163-57af-4774-9033-d65d195149e2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:26.025287 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ac346163-57af-4774-9033-d65d195149e2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1504 microversion: 2.1 time: 0.652423 May 28 21:13:26.038406 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1464/2891] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:25 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1504 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:26.045521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-46e4d1fd-6079-440d-a042-66335a8c56aa tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:26.046246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-46e4d1fd-6079-440d-a042-66335a8c56aa tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:26.052567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46e4d1fd-6079-440d-a042-66335a8c56aa tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.053033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46e4d1fd-6079-440d-a042-66335a8c56aa tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:26.054155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46e4d1fd-6079-440d-a042-66335a8c56aa tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.054346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46e4d1fd-6079-440d-a042-66335a8c56aa tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:26.133131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c5a4219c-370a-4994-a640-f70c491d67b1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:26.133878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c5a4219c-370a-4994-a640-f70c491d67b1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:26.141512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5a4219c-370a-4994-a640-f70c491d67b1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.142076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5a4219c-370a-4994-a640-f70c491d67b1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:26.142858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5a4219c-370a-4994-a640-f70c491d67b1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.143298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5a4219c-370a-4994-a640-f70c491d67b1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:26.307136 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-46e4d1fd-6079-440d-a042-66335a8c56aa tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:26.323910 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-46e4d1fd-6079-440d-a042-66335a8c56aa tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1504 microversion: 2.1 time: 0.282154 May 28 21:13:26.324895 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1428/2892] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:26 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:26.333731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c5a4219c-370a-4994-a640-f70c491d67b1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:26.337717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2167c0f9-bab6-4727-9d93-dd35783fd6fb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:26.338848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2167c0f9-bab6-4727-9d93-dd35783fd6fb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:26.347084 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c5a4219c-370a-4994-a640-f70c491d67b1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1524 microversion: 2.1 time: 0.217552 May 28 21:13:26.348635 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1465/2893] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:26 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1524 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:26.360624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2167c0f9-bab6-4727-9d93-dd35783fd6fb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.362880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2167c0f9-bab6-4727-9d93-dd35783fd6fb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:26.363853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2167c0f9-bab6-4727-9d93-dd35783fd6fb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.364450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2167c0f9-bab6-4727-9d93-dd35783fd6fb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:26.367395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:26.369193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:26.376379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.376847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:26.378556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.379141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:26.546356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:13:26.546356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:13:26.546356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:13:26.546356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:13:26.546356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:13:26.618973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2167c0f9-bab6-4727-9d93-dd35783fd6fb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:26.629458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2167c0f9-bab6-4727-9d93-dd35783fd6fb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:26.634316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2167c0f9-bab6-4727-9d93-dd35783fd6fb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:26.635882 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2167c0f9-bab6-4727-9d93-dd35783fd6fb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.309752 May 28 21:13:26.636643 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1429/2894] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:26 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:26.642087 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-14d6ea9b-616e-4000-a0ec-bf511c25bc55 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:26.643016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-14d6ea9b-616e-4000-a0ec-bf511c25bc55 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:26.650129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14d6ea9b-616e-4000-a0ec-bf511c25bc55 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.657431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14d6ea9b-616e-4000-a0ec-bf511c25bc55 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:26.657431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14d6ea9b-616e-4000-a0ec-bf511c25bc55 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.657431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14d6ea9b-616e-4000-a0ec-bf511c25bc55 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:26.807201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:26.823359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-14d6ea9b-616e-4000-a0ec-bf511c25bc55 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:26.834395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.834907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:26.835761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.836186 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-14d6ea9b-616e-4000-a0ec-bf511c25bc55 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1316 microversion: 2.1 time: 0.198116 May 28 21:13:26.836320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:26.838421 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1430/2895] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:26 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:26.847778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-34354faf-8887-48da-8394-a3ceaf2d0e84 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:26.848929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-34354faf-8887-48da-8394-a3ceaf2d0e84 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] [instance: 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:26.857966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-34354faf-8887-48da-8394-a3ceaf2d0e84 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.858839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-34354faf-8887-48da-8394-a3ceaf2d0e84 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:26.859905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-34354faf-8887-48da-8394-a3ceaf2d0e84 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.861314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-34354faf-8887-48da-8394-a3ceaf2d0e84 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:26.885349 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-34354faf-8887-48da-8394-a3ceaf2d0e84 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] HTTP exception thrown: Instance 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 could not be found. May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-34354faf-8887-48da-8394-a3ceaf2d0e84 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Request method failure captured: May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 HTTP/1.1 May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpBHNsWBBmT6QzT6prHXUc-LZmh7pNjYg0L-rt3oSHvOhUxLTkeUGU4cPxRPlll8OoL9Mow2hueelv4hdz9oFolHyeFAw_7xj3wiHVKgDU_Og3iq8fXvkbG4j8UpE_vgqDnGrfUA_HcTsE9w5FwDLXjaq7TNFjg5c_evM3bAwTHlxiw May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Openstack-Nova-Api-Version: 2.54 May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: d64af7d364a74dc6b9c527532a5d8abd May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerShowV254Test-1543952458 May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d64af7d364a74dc6b9c527532a5d8abd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d64af7d364a74dc6b9c527532a5d8abd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d64af7d364a74dc6b9c527532a5d8abd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d64af7d364a74dc6b9c527532a5d8abd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerShowV254Test-1543952458 May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: d64af7d364a74dc6b9c527532a5d8abd May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerShowV254Test-1543952458 May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerShowV254Test-1543952458-project May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 752fbb20c21449bb80bc9de2da474865 May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerShowV254Test-1543952458-project May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 could not be found. May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2'} May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 could not be found. May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 could not be found. May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:26.888317 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:26.893420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:26.893420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:13:26.893420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:13:26.893420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:13:26.893420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:13:26.893420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 could not be found. May 28 21:13:26.893420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:26.895542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-34354faf-8887-48da-8394-a3ceaf2d0e84 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] Returning 404 to user: Instance 2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:13:26.896693 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-34354faf-8887-48da-8394-a3ceaf2d0e84 tempest-ServerShowV254Test-1543952458 tempest-ServerShowV254Test-1543952458-project] 10.222.0.33 "GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2" status: 404 len: 111 microversion: 2.54 time: 0.056561 May 28 21:13:26.898553 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1431/2896] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:26 2022] GET /compute/v2.1/servers/2f1f56e9-1f4d-4e3c-a2f5-7697b743aff2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:13:26.929205 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-109d156f-b5f7-4040-8f19-8ff1db463083 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "POST /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944/action" status: 202 len: 1110 microversion: 2.1 time: 0.578754 May 28 21:13:26.941650 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1466/2897] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:13:26 2022] POST /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944/action => generated 1110 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 28 21:13:26.945915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5c638b5f-1c24-4e19-8b84-34f2f155e6d0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:26.947433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5c638b5f-1c24-4e19-8b84-34f2f155e6d0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:26.958901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c638b5f-1c24-4e19-8b84-34f2f155e6d0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.961799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c638b5f-1c24-4e19-8b84-34f2f155e6d0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:26.963417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c638b5f-1c24-4e19-8b84-34f2f155e6d0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:26.964954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c638b5f-1c24-4e19-8b84-34f2f155e6d0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:27.029379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-63a6728d-5704-444a-aea1-358d919210f2 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:27.030675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-63a6728d-5704-444a-aea1-358d919210f2 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:27.044108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63a6728d-5704-444a-aea1-358d919210f2 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:27.045473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63a6728d-5704-444a-aea1-358d919210f2 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:27.047955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63a6728d-5704-444a-aea1-358d919210f2 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:27.050863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63a6728d-5704-444a-aea1-358d919210f2 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:27.365385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5c638b5f-1c24-4e19-8b84-34f2f155e6d0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:27.400982 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5c638b5f-1c24-4e19-8b84-34f2f155e6d0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.459718 May 28 21:13:27.407921 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1432/2898] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:26 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:27.412776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e7ad24a5-bddb-4127-82eb-ade4c59ab915 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:27.413339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e7ad24a5-bddb-4127-82eb-ade4c59ab915 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:27.434505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7ad24a5-bddb-4127-82eb-ade4c59ab915 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:27.434505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7ad24a5-bddb-4127-82eb-ade4c59ab915 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:27.435243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7ad24a5-bddb-4127-82eb-ade4c59ab915 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:27.435743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7ad24a5-bddb-4127-82eb-ade4c59ab915 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:27.457148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-63a6728d-5704-444a-aea1-358d919210f2 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:27.482146 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-63a6728d-5704-444a-aea1-358d919210f2 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.459384 May 28 21:13:27.484522 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1467/2899] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:27 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:27.655131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0c199d60-ae2a-426d-88a0-d09b3af92c5f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:27.657648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0c199d60-ae2a-426d-88a0-d09b3af92c5f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:27.682446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c199d60-ae2a-426d-88a0-d09b3af92c5f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:27.695894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c199d60-ae2a-426d-88a0-d09b3af92c5f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:27.695894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c199d60-ae2a-426d-88a0-d09b3af92c5f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:27.695894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c199d60-ae2a-426d-88a0-d09b3af92c5f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:27.904897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e7ad24a5-bddb-4127-82eb-ade4c59ab915 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:27.904897 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e7ad24a5-bddb-4127-82eb-ade4c59ab915 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1524 microversion: 2.1 time: 0.376999 May 28 21:13:27.904897 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1433/2900] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:27 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1524 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:27.904897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8a69f127-edd8-4340-9e29-5b8498259095 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:27.904897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8a69f127-edd8-4340-9e29-5b8498259095 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:27.904897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8a69f127-edd8-4340-9e29-5b8498259095 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:27.904897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8a69f127-edd8-4340-9e29-5b8498259095 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:27.904897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8a69f127-edd8-4340-9e29-5b8498259095 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:27.904897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8a69f127-edd8-4340-9e29-5b8498259095 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:28.008725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0c199d60-ae2a-426d-88a0-d09b3af92c5f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:28.025673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0c199d60-ae2a-426d-88a0-d09b3af92c5f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:28.027597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0c199d60-ae2a-426d-88a0-d09b3af92c5f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:28.029246 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0c199d60-ae2a-426d-88a0-d09b3af92c5f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.378537 May 28 21:13:28.030460 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1468/2901] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:27 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:28.048660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8a69f127-edd8-4340-9e29-5b8498259095 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:28.062631 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8a69f127-edd8-4340-9e29-5b8498259095 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1316 microversion: 2.1 time: 0.211781 May 28 21:13:28.068848 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1434/2902] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:27 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:28.335794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-1f36da89-e501-44c1-8d0a-97ea089bcd25 req-c20313fa-634a-48a1-824e-097088fe341e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818f89de-48f1-43d3-9ee2-4ab0e3652353", "name": "network-vif-plugged", "status": "completed", "tag": "59de6851-8323-4006-84f5-6c1b327b2c4f"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:28.358749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1f36da89-e501-44c1-8d0a-97ea089bcd25 req-c20313fa-634a-48a1-824e-097088fe341e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:28.359247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1f36da89-e501-44c1-8d0a-97ea089bcd25 req-c20313fa-634a-48a1-824e-097088fe341e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:28.385961 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-1f36da89-e501-44c1-8d0a-97ea089bcd25 req-c20313fa-634a-48a1-824e-097088fe341e service nova] Creating event network-vif-plugged:59de6851-8323-4006-84f5-6c1b327b2c4f for instance 818f89de-48f1-43d3-9ee2-4ab0e3652353 on nch2-master-1 May 28 21:13:28.391757 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-1f36da89-e501-44c1-8d0a-97ea089bcd25 req-c20313fa-634a-48a1-824e-097088fe341e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062192 May 28 21:13:28.393052 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1469/2903] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:28.425328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-19018508-b122-41fe-82c0-a99e1f916b32 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:28.426146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-19018508-b122-41fe-82c0-a99e1f916b32 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:28.435522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19018508-b122-41fe-82c0-a99e1f916b32 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:28.436331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19018508-b122-41fe-82c0-a99e1f916b32 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:28.437818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19018508-b122-41fe-82c0-a99e1f916b32 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:28.438444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19018508-b122-41fe-82c0-a99e1f916b32 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:28.504598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fe6f5e7e-ebb0-4b78-a4fd-b908e8d96025 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:28.505601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fe6f5e7e-ebb0-4b78-a4fd-b908e8d96025 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:28.526379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe6f5e7e-ebb0-4b78-a4fd-b908e8d96025 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:28.527868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe6f5e7e-ebb0-4b78-a4fd-b908e8d96025 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:28.528697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe6f5e7e-ebb0-4b78-a4fd-b908e8d96025 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:28.529163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe6f5e7e-ebb0-4b78-a4fd-b908e8d96025 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:28.776307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-19018508-b122-41fe-82c0-a99e1f916b32 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:28.784466 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-19018508-b122-41fe-82c0-a99e1f916b32 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.364945 May 28 21:13:28.785106 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1435/2904] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:28 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:28.791232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fe6f5e7e-ebb0-4b78-a4fd-b908e8d96025 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:28.807214 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fe6f5e7e-ebb0-4b78-a4fd-b908e8d96025 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.308390 May 28 21:13:28.819174 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1470/2905] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:28 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:28.919619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-60043815-9456-4337-9508-37eb0879394b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:28.920379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-60043815-9456-4337-9508-37eb0879394b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:28.932351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60043815-9456-4337-9508-37eb0879394b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:28.932351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60043815-9456-4337-9508-37eb0879394b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:28.932351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60043815-9456-4337-9508-37eb0879394b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:28.932351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60043815-9456-4337-9508-37eb0879394b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:29.048522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6884930b-427e-4268-acd1-5ebeba6dd7a2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:29.049172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6884930b-427e-4268-acd1-5ebeba6dd7a2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:29.056338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6884930b-427e-4268-acd1-5ebeba6dd7a2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:29.063448 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6884930b-427e-4268-acd1-5ebeba6dd7a2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:29.064333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6884930b-427e-4268-acd1-5ebeba6dd7a2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:29.065004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6884930b-427e-4268-acd1-5ebeba6dd7a2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:29.082077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:29.087893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-60043815-9456-4337-9508-37eb0879394b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:29.096856 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-60043815-9456-4337-9508-37eb0879394b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1524 microversion: 2.1 time: 0.181773 May 28 21:13:29.097495 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1436/2906] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:28 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1524 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:29.102765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7a38a789-fdd6-4f60-9ad7-93e28bc59604 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:29.103395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7a38a789-fdd6-4f60-9ad7-93e28bc59604 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:29.109687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a38a789-fdd6-4f60-9ad7-93e28bc59604 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:29.110175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a38a789-fdd6-4f60-9ad7-93e28bc59604 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:29.110950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a38a789-fdd6-4f60-9ad7-93e28bc59604 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:29.111822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a38a789-fdd6-4f60-9ad7-93e28bc59604 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:29.313791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6884930b-427e-4268-acd1-5ebeba6dd7a2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:29.323369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6884930b-427e-4268-acd1-5ebeba6dd7a2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:29.324886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6884930b-427e-4268-acd1-5ebeba6dd7a2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:29.326082 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6884930b-427e-4268-acd1-5ebeba6dd7a2 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.281470 May 28 21:13:29.335846 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1471/2907] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:29 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:29.347466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7a38a789-fdd6-4f60-9ad7-93e28bc59604 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:29.355310 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7a38a789-fdd6-4f60-9ad7-93e28bc59604 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1316 microversion: 2.1 time: 0.256591 May 28 21:13:29.355885 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1437/2908] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:29 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:29.801599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f455055b-3488-4235-92b0-52e3de6f5408 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:29.802259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f455055b-3488-4235-92b0-52e3de6f5408 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:29.809285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f455055b-3488-4235-92b0-52e3de6f5408 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:29.809746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f455055b-3488-4235-92b0-52e3de6f5408 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:29.810545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f455055b-3488-4235-92b0-52e3de6f5408 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:29.814133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f455055b-3488-4235-92b0-52e3de6f5408 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:29.824700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-293415b2-5a28-418e-b315-1387a9045631 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:29.827894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-293415b2-5a28-418e-b315-1387a9045631 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:29.834946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-293415b2-5a28-418e-b315-1387a9045631 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:29.835515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-293415b2-5a28-418e-b315-1387a9045631 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:29.836304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-293415b2-5a28-418e-b315-1387a9045631 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:29.836966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-293415b2-5a28-418e-b315-1387a9045631 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:30.048236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f455055b-3488-4235-92b0-52e3de6f5408 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:30.051621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-293415b2-5a28-418e-b315-1387a9045631 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:30.065776 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f455055b-3488-4235-92b0-52e3de6f5408 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.265492 May 28 21:13:30.066187 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-293415b2-5a28-418e-b315-1387a9045631 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.245597 May 28 21:13:30.066439 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1472/2909] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:29 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:30.067720 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1438/2910] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:29 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:30.116121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ccd9a4df-7d32-4ecd-90e8-0bdc31c2aea9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:30.117153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ccd9a4df-7d32-4ecd-90e8-0bdc31c2aea9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:30.124841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccd9a4df-7d32-4ecd-90e8-0bdc31c2aea9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:30.125554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccd9a4df-7d32-4ecd-90e8-0bdc31c2aea9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:30.126551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccd9a4df-7d32-4ecd-90e8-0bdc31c2aea9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:30.127153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccd9a4df-7d32-4ecd-90e8-0bdc31c2aea9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:30.214755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ec12878e-6cf0-46b6-98c1-b1fe33d2c86e tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Action: 'create', calling method: .version_select at 0x7f4d573793a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-981657982"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:30.577226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ccd9a4df-7d32-4ecd-90e8-0bdc31c2aea9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:30.585410 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ccd9a4df-7d32-4ecd-90e8-0bdc31c2aea9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1506 microversion: 2.1 time: 0.474291 May 28 21:13:30.586047 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1439/2911] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:30 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1506 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:30.591130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1184a4e8-f120-400c-93c5-718305d3313b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:30.591877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1184a4e8-f120-400c-93c5-718305d3313b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:30.599743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1184a4e8-f120-400c-93c5-718305d3313b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:30.600198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1184a4e8-f120-400c-93c5-718305d3313b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:30.600973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1184a4e8-f120-400c-93c5-718305d3313b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:30.601446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1184a4e8-f120-400c-93c5-718305d3313b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:30.795981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1184a4e8-f120-400c-93c5-718305d3313b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:30.805685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1184a4e8-f120-400c-93c5-718305d3313b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:30.807441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1184a4e8-f120-400c-93c5-718305d3313b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:30.808764 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1184a4e8-f120-400c-93c5-718305d3313b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.221766 May 28 21:13:30.809329 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1440/2912] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:30 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:30.814104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1892aa1d-623e-45b1-adde-8b029d2f3f26 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:30.814928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1892aa1d-623e-45b1-adde-8b029d2f3f26 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:30.820984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1892aa1d-623e-45b1-adde-8b029d2f3f26 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:30.822241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1892aa1d-623e-45b1-adde-8b029d2f3f26 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:30.823068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1892aa1d-623e-45b1-adde-8b029d2f3f26 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:30.823576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1892aa1d-623e-45b1-adde-8b029d2f3f26 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:30.953655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1892aa1d-623e-45b1-adde-8b029d2f3f26 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:30.961823 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1892aa1d-623e-45b1-adde-8b029d2f3f26 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1465 microversion: 2.1 time: 0.151136 May 28 21:13:30.962613 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1441/2913] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:30 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1465 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:30.978050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a9121323-5c73-43e3-b8ac-7d110ed7aa3d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-494775947", "metadata": {"image_type": "test"}}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:30.979302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a9121323-5c73-43e3-b8ac-7d110ed7aa3d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:30.985468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a9121323-5c73-43e3-b8ac-7d110ed7aa3d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:30.986244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a9121323-5c73-43e3-b8ac-7d110ed7aa3d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:30.987027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a9121323-5c73-43e3-b8ac-7d110ed7aa3d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:30.987640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a9121323-5c73-43e3-b8ac-7d110ed7aa3d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:31.026561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-a9121323-5c73-43e3-b8ac-7d110ed7aa3d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Getting quotas for project 149d4937782d47f1b75fcdcfb4a89707. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:13:31.032488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-a9121323-5c73-43e3-b8ac-7d110ed7aa3d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Getting quotas for user cf4bbfcd9bf64e3eabac163461e98f66 and project 149d4937782d47f1b75fcdcfb4a89707. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:13:31.050938 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ec12878e-6cf0-46b6-98c1-b1fe33d2c86e tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 0.983159 May 28 21:13:31.051741 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1473/2914] 10.222.0.33 () {60 vars in 1154 bytes} [Sat May 28 21:13:30 2022] POST /compute/v2.1/os-volumes => generated 337 bytes in 985 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 28 21:13:31.066203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e2b73c78-98a7-4545-9145-8a27a4dc08b0 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d573a8040>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:31.119993 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e2b73c78-98a7-4545-9145-8a27a4dc08b0 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a" status: 200 len: 337 microversion: 2.1 time: 0.057700 May 28 21:13:31.120673 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1474/2915] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:13:31 2022] GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a => generated 337 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:13:31.125444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-05992e5b-86f4-4cb0-a1e0-049bad0eeab0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:31.126198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-05992e5b-86f4-4cb0-a1e0-049bad0eeab0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:31.132578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05992e5b-86f4-4cb0-a1e0-049bad0eeab0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:31.133123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05992e5b-86f4-4cb0-a1e0-049bad0eeab0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:31.134820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05992e5b-86f4-4cb0-a1e0-049bad0eeab0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:31.137935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05992e5b-86f4-4cb0-a1e0-049bad0eeab0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:31.271823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-05992e5b-86f4-4cb0-a1e0-049bad0eeab0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:31.279616 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-05992e5b-86f4-4cb0-a1e0-049bad0eeab0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.157894 May 28 21:13:31.280203 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1475/2916] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:31 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:31.284602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0185469d-093b-4325-a379-40d85a38eadb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:31.285209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0185469d-093b-4325-a379-40d85a38eadb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:31.291656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0185469d-093b-4325-a379-40d85a38eadb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:31.292153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0185469d-093b-4325-a379-40d85a38eadb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:31.298619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0185469d-093b-4325-a379-40d85a38eadb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:31.298619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0185469d-093b-4325-a379-40d85a38eadb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:31.452361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0185469d-093b-4325-a379-40d85a38eadb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:31.460151 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0185469d-093b-4325-a379-40d85a38eadb tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.178974 May 28 21:13:31.460724 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1476/2917] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:31 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:31.518342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:31.603064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5ca48699-ad84-4e68-95e4-a7f9ee19a728 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:31.603784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5ca48699-ad84-4e68-95e4-a7f9ee19a728 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:31.610594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ca48699-ad84-4e68-95e4-a7f9ee19a728 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:31.612042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ca48699-ad84-4e68-95e4-a7f9ee19a728 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:31.624359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ca48699-ad84-4e68-95e4-a7f9ee19a728 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:31.624359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ca48699-ad84-4e68-95e4-a7f9ee19a728 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:31.653809 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a9121323-5c73-43e3-b8ac-7d110ed7aa3d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "POST /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353/action" status: 202 len: 0 microversion: 2.1 time: 0.679278 May 28 21:13:31.656253 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1442/2918] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:13:30 2022] POST /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) May 28 21:13:31.666914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f474f78b-d9b5-498b-963d-b53a910cafa0 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d5756d670>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:31.718685 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f474f78b-d9b5-498b-963d-b53a910cafa0 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 200 len: 1419 microversion: 2.1 time: 0.055898 May 28 21:13:31.719265 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1443/2919] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:31 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 1419 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:31.765352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5ca48699-ad84-4e68-95e4-a7f9ee19a728 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:31.772970 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5ca48699-ad84-4e68-95e4-a7f9ee19a728 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1506 microversion: 2.1 time: 0.173778 May 28 21:13:31.773661 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1477/2920] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:31 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:31.828776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1df528d7-9a55-4e11-a2f4-c85f28cb6bb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:31.829766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1df528d7-9a55-4e11-a2f4-c85f28cb6bb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:31.837486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1df528d7-9a55-4e11-a2f4-c85f28cb6bb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:31.838166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1df528d7-9a55-4e11-a2f4-c85f28cb6bb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:31.838941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1df528d7-9a55-4e11-a2f4-c85f28cb6bb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:31.839573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1df528d7-9a55-4e11-a2f4-c85f28cb6bb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:31.891353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-78b33b96-1a84-477f-a131-8d4a21b7c372 req-ea753718-dd25-4fc5-8b3b-a1f0b8c4c271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "name": "network-vif-plugged", "status": "completed", "tag": "deee404e-9d98-4fc9-a566-770085e51d43"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:31.901187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-78b33b96-1a84-477f-a131-8d4a21b7c372 req-ea753718-dd25-4fc5-8b3b-a1f0b8c4c271 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:31.901637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-78b33b96-1a84-477f-a131-8d4a21b7c372 req-ea753718-dd25-4fc5-8b3b-a1f0b8c4c271 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:31.915318 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-78b33b96-1a84-477f-a131-8d4a21b7c372 req-ea753718-dd25-4fc5-8b3b-a1f0b8c4c271 service nova] Creating event network-vif-plugged:deee404e-9d98-4fc9-a566-770085e51d43 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:13:31.920695 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-78b33b96-1a84-477f-a131-8d4a21b7c372 req-ea753718-dd25-4fc5-8b3b-a1f0b8c4c271 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037235 May 28 21:13:31.921295 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1478/2921] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:32.038202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1df528d7-9a55-4e11-a2f4-c85f28cb6bb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:32.048718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1df528d7-9a55-4e11-a2f4-c85f28cb6bb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:32.050728 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1df528d7-9a55-4e11-a2f4-c85f28cb6bb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:32.051993 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1df528d7-9a55-4e11-a2f4-c85f28cb6bb1 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.227608 May 28 21:13:32.052569 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1444/2922] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:31 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:32.134104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-14984f30-f4b9-46df-ac2d-8c8828faab4e tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d5727fdc0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:32.190282 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-14984f30-f4b9-46df-ac2d-8c8828faab4e tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a" status: 200 len: 337 microversion: 2.1 time: 0.061322 May 28 21:13:32.190912 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1479/2923] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:13:32 2022] GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a => generated 337 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:32.296518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5e50f714-f883-4eb2-8cfa-5f75533cc1a0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:32.297134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5e50f714-f883-4eb2-8cfa-5f75533cc1a0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:32.304220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e50f714-f883-4eb2-8cfa-5f75533cc1a0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:32.304848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e50f714-f883-4eb2-8cfa-5f75533cc1a0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:32.306242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e50f714-f883-4eb2-8cfa-5f75533cc1a0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:32.306686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e50f714-f883-4eb2-8cfa-5f75533cc1a0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:32.457618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5e50f714-f883-4eb2-8cfa-5f75533cc1a0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:32.466585 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5e50f714-f883-4eb2-8cfa-5f75533cc1a0 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.173901 May 28 21:13:32.467162 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1445/2924] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:32 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:32.480609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-224243ff-a833-48a8-a74b-c471df1bd2fc tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:32.481349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-224243ff-a833-48a8-a74b-c471df1bd2fc tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:32.489438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-224243ff-a833-48a8-a74b-c471df1bd2fc tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:32.489921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-224243ff-a833-48a8-a74b-c471df1bd2fc tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:32.490703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-224243ff-a833-48a8-a74b-c471df1bd2fc tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:32.491150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-224243ff-a833-48a8-a74b-c471df1bd2fc tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:32.636665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-224243ff-a833-48a8-a74b-c471df1bd2fc tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:32.646263 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-224243ff-a833-48a8-a74b-c471df1bd2fc tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.171382 May 28 21:13:32.647193 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1480/2925] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:32 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:32.734521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7b2f6b79-f60e-4fbe-b4a9-53dd9a0916ed tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d574da9d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:32.779112 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7b2f6b79-f60e-4fbe-b4a9-53dd9a0916ed tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 200 len: 1419 microversion: 2.1 time: 0.048401 May 28 21:13:32.779927 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1446/2926] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:32 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 1419 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:32.790726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e78b0a3d-74e2-4606-bc74-4a6a692eedbb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:32.790726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e78b0a3d-74e2-4606-bc74-4a6a692eedbb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:32.796425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e78b0a3d-74e2-4606-bc74-4a6a692eedbb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:32.797595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e78b0a3d-74e2-4606-bc74-4a6a692eedbb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:32.798424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e78b0a3d-74e2-4606-bc74-4a6a692eedbb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:32.798873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e78b0a3d-74e2-4606-bc74-4a6a692eedbb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:32.936107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e78b0a3d-74e2-4606-bc74-4a6a692eedbb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:32.943885 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e78b0a3d-74e2-4606-bc74-4a6a692eedbb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 200 len: 1509 microversion: 2.1 time: 0.158225 May 28 21:13:32.944542 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1481/2927] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:32 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:32.963169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-947c671d-2da2-4fd8-8f6c-484b39716e26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:32.963680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-947c671d-2da2-4fd8-8f6c-484b39716e26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:32.970142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-947c671d-2da2-4fd8-8f6c-484b39716e26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:32.970593 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-947c671d-2da2-4fd8-8f6c-484b39716e26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:32.971530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-947c671d-2da2-4fd8-8f6c-484b39716e26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:32.972128 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-947c671d-2da2-4fd8-8f6c-484b39716e26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:32.998843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-947c671d-2da2-4fd8-8f6c-484b39716e26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:13:33.004909 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.compute.api [None req-947c671d-2da2-4fd8-8f6c-484b39716e26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Working on deleting snapshot 09971b11-b69b-4c3b-a701-dc5e939b98fd from shelved instance... May 28 21:13:33.072760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fa90702f-28cc-4642-8703-e52114db9067 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:33.073853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fa90702f-28cc-4642-8703-e52114db9067 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:33.080209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa90702f-28cc-4642-8703-e52114db9067 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:33.080701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa90702f-28cc-4642-8703-e52114db9067 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:33.081486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa90702f-28cc-4642-8703-e52114db9067 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:33.083194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa90702f-28cc-4642-8703-e52114db9067 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:33.327409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fa90702f-28cc-4642-8703-e52114db9067 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:33.327409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fa90702f-28cc-4642-8703-e52114db9067 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:33.327409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fa90702f-28cc-4642-8703-e52114db9067 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:33.327409 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fa90702f-28cc-4642-8703-e52114db9067 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.237710 May 28 21:13:33.327409 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1482/2928] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:33 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:33.327409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dfacac7c-2da8-43a5-bcc2-6cc306065436 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d573790d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:33.368899 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dfacac7c-2da8-43a5-bcc2-6cc306065436 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a" status: 200 len: 338 microversion: 2.1 time: 0.050911 May 28 21:13:33.369465 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1483/2929] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:13:33 2022] GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a => generated 338 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:33.385466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fe8b4d44-fe18-4fb5-b994-db98a9dd0906 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Action: 'create', calling method: .version_select at 0x7f4d5742d5e0>, body: {"snapshot": {"volume_id": "290d5498-182e-4bc7-bcec-0cf0a2ec578a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-763148002"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:33.916164 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fe8b4d44-fe18-4fb5-b994-db98a9dd0906 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.535150 May 28 21:13:33.916669 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1484/2930] 10.222.0.33 () {60 vars in 1161 bytes} [Sat May 28 21:13:33 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:13:33.925232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2e645c02-533d-4582-9c19-7613a5b9817b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:33.927610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2e645c02-533d-4582-9c19-7613a5b9817b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:33.935527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e645c02-533d-4582-9c19-7613a5b9817b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:33.936309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e645c02-533d-4582-9c19-7613a5b9817b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:33.936917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e645c02-533d-4582-9c19-7613a5b9817b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:33.937393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e645c02-533d-4582-9c19-7613a5b9817b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:34.108782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2e645c02-533d-4582-9c19-7613a5b9817b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:34.118802 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2e645c02-533d-4582-9c19-7613a5b9817b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.200350 May 28 21:13:34.120118 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1485/2931] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:33 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:34.127089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-49090c3b-fb55-421d-853f-57f239ec074d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:34.128001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-49090c3b-fb55-421d-853f-57f239ec074d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:34.141260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49090c3b-fb55-421d-853f-57f239ec074d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:34.146321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49090c3b-fb55-421d-853f-57f239ec074d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:34.146321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49090c3b-fb55-421d-853f-57f239ec074d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:34.146321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49090c3b-fb55-421d-853f-57f239ec074d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:34.325343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-49090c3b-fb55-421d-853f-57f239ec074d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:34.334429 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-49090c3b-fb55-421d-853f-57f239ec074d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.212354 May 28 21:13:34.335979 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1486/2932] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:34 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:34.350018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b2ae43be-7584-4aeb-ab15-3061285b9ce2 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d57370c10>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:34.414498 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b2ae43be-7584-4aeb-ab15-3061285b9ce2 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 200 len: 1419 microversion: 2.1 time: 0.076309 May 28 21:13:34.421036 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1487/2933] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:34 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 1419 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:34.426317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cd5e0ac1-08b0-492a-b90a-00e406dc2a00 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d5738bc10>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:34.472860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-947c671d-2da2-4fd8-8f6c-484b39716e26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Doing local delete in cell fc53a60a-e345-4363-abb1-87c4d33bcbf6(cell1) {{(pid=143128) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 28 21:13:34.473779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-947c671d-2da2-4fd8-8f6c-484b39716e26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:34.474170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-947c671d-2da2-4fd8-8f6c-484b39716e26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:34.474598 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.compute.api [None req-947c671d-2da2-4fd8-8f6c-484b39716e26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 28 21:13:34.479094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-947c671d-2da2-4fd8-8f6c-484b39716e26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] deallocate_for_instance() {{(pid=143128) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} May 28 21:13:34.525769 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cd5e0ac1-08b0-492a-b90a-00e406dc2a00 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba" status: 200 len: 286 microversion: 2.1 time: 0.103584 May 28 21:13:34.527048 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1488/2934] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 21:13:34 2022] GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba => generated 286 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:34.621483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-db154d51-dac4-4252-beae-e442da505b41 req-ffa028c5-6c28-485f-a6b1-51161ef79e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "name": "network-vif-plugged", "status": "completed", "tag": "b9147e1c-e446-4b38-b6cd-4ba5d9efe9bf"}, {"server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "name": "network-vif-plugged", "status": "completed", "tag": "41835e77-75bb-49d7-a493-54f3f8518d81"}, {"server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "name": "network-vif-plugged", "status": "completed", "tag": "f081357a-b6d4-48c4-bf24-83685b0f0b05"}, {"server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "name": "network-vif-plugged", "status": "completed", "tag": "8441633d-d2d5-43e9-899c-acfbbc72f929"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:34.633200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-db154d51-dac4-4252-beae-e442da505b41 req-ffa028c5-6c28-485f-a6b1-51161ef79e85 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:34.634477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-db154d51-dac4-4252-beae-e442da505b41 req-ffa028c5-6c28-485f-a6b1-51161ef79e85 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:34.650504 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-db154d51-dac4-4252-beae-e442da505b41 req-ffa028c5-6c28-485f-a6b1-51161ef79e85 service nova] Creating event network-vif-plugged:b9147e1c-e446-4b38-b6cd-4ba5d9efe9bf for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:13:34.651031 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-db154d51-dac4-4252-beae-e442da505b41 req-ffa028c5-6c28-485f-a6b1-51161ef79e85 service nova] Creating event network-vif-plugged:41835e77-75bb-49d7-a493-54f3f8518d81 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:13:34.651549 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-db154d51-dac4-4252-beae-e442da505b41 req-ffa028c5-6c28-485f-a6b1-51161ef79e85 service nova] Creating event network-vif-plugged:f081357a-b6d4-48c4-bf24-83685b0f0b05 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:13:34.652089 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-db154d51-dac4-4252-beae-e442da505b41 req-ffa028c5-6c28-485f-a6b1-51161ef79e85 service nova] Creating event network-vif-plugged:8441633d-d2d5-43e9-899c-acfbbc72f929 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:13:34.658328 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-db154d51-dac4-4252-beae-e442da505b41 req-ffa028c5-6c28-485f-a6b1-51161ef79e85 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.130577 May 28 21:13:34.659149 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1489/2935] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:34.665075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-548e64a1-71f4-4cae-bed2-9f876458aac7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:34.665794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-548e64a1-71f4-4cae-bed2-9f876458aac7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:34.672236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-548e64a1-71f4-4cae-bed2-9f876458aac7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:34.672902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-548e64a1-71f4-4cae-bed2-9f876458aac7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:34.673936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-548e64a1-71f4-4cae-bed2-9f876458aac7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:34.674387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-548e64a1-71f4-4cae-bed2-9f876458aac7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:34.954282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-548e64a1-71f4-4cae-bed2-9f876458aac7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:34.964995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-548e64a1-71f4-4cae-bed2-9f876458aac7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:34.966583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-548e64a1-71f4-4cae-bed2-9f876458aac7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:34.967764 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-548e64a1-71f4-4cae-bed2-9f876458aac7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.307184 May 28 21:13:34.968322 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1490/2936] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:34 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:34.972948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-793b912e-cc2b-48a9-976c-2353070ab4ba tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d57335ca0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:35.015962 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-793b912e-cc2b-48a9-976c-2353070ab4ba tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.046295 May 28 21:13:35.016409 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1491/2937] 10.222.0.33 () {58 vars in 1139 bytes} [Sat May 28 21:13:34 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:35.027137 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ffb9fcc0-e510-496c-84f1-bf6906a800ca tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d57662700>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:35.061867 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ffb9fcc0-e510-496c-84f1-bf6906a800ca tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba" status: 200 len: 286 microversion: 2.1 time: 0.034980 May 28 21:13:35.061867 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1492/2938] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 21:13:35 2022] GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:13:35.136926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-77df1d2e-db8f-479c-9c32-dc9cc12b23ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:35.137550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-77df1d2e-db8f-479c-9c32-dc9cc12b23ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:35.145154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77df1d2e-db8f-479c-9c32-dc9cc12b23ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:35.145615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77df1d2e-db8f-479c-9c32-dc9cc12b23ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:35.146416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77df1d2e-db8f-479c-9c32-dc9cc12b23ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:35.146864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77df1d2e-db8f-479c-9c32-dc9cc12b23ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:35.334362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-77df1d2e-db8f-479c-9c32-dc9cc12b23ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:35.343048 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-77df1d2e-db8f-479c-9c32-dc9cc12b23ac tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.210569 May 28 21:13:35.352296 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1493/2939] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:35 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:35.358081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-947c671d-2da2-4fd8-8f6c-484b39716e26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Updating instance_info_cache with network_info: [] {{(pid=143128) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 21:13:35.358658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-b030dfff-8a45-4815-8b5f-27ac0295b9e4 req-a7b7662c-1482-44b3-8749-de34a67dd7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce53dda7-d501-475f-a4c0-73853a36630a", "name": "network-vif-deleted", "tag": "197a0eea-120c-4af5-b57d-60f7eef43916"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:35.368399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b030dfff-8a45-4815-8b5f-27ac0295b9e4 req-a7b7662c-1482-44b3-8749-de34a67dd7ef service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:35.368870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b030dfff-8a45-4815-8b5f-27ac0295b9e4 req-a7b7662c-1482-44b3-8749-de34a67dd7ef service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:35.380941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.compute.server_external_events [req-b030dfff-8a45-4815-8b5f-27ac0295b9e4 req-a7b7662c-1482-44b3-8749-de34a67dd7ef service nova] Unable to find a host for instance ce53dda7-d501-475f-a4c0-73853a36630a. Dropping event network-vif-deleted {{(pid=143129) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 28 21:13:35.381828 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-b030dfff-8a45-4815-8b5f-27ac0295b9e4 req-a7b7662c-1482-44b3-8749-de34a67dd7ef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.028496 May 28 21:13:35.382465 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1494/2940] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 28 21:13:35.387515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fa206bc6-dfe7-446a-b306-0f71c114b05f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:35.388131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fa206bc6-dfe7-446a-b306-0f71c114b05f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:35.394501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa206bc6-dfe7-446a-b306-0f71c114b05f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:35.395132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa206bc6-dfe7-446a-b306-0f71c114b05f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:35.396244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa206bc6-dfe7-446a-b306-0f71c114b05f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:35.396874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa206bc6-dfe7-446a-b306-0f71c114b05f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:35.546833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fa206bc6-dfe7-446a-b306-0f71c114b05f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:35.554549 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fa206bc6-dfe7-446a-b306-0f71c114b05f tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.171109 May 28 21:13:35.555114 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1495/2941] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:35 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:35.559591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eed601c1-2255-4508-82fe-f6eed9670f23 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d57379f70>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:35.615279 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eed601c1-2255-4508-82fe-f6eed9670f23 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 200 len: 1419 microversion: 2.1 time: 0.059062 May 28 21:13:35.616339 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1496/2942] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:35 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 1419 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:35.988667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc7c4d38-f363-4139-8d7c-410752ea38ea tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:35.989314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc7c4d38-f363-4139-8d7c-410752ea38ea tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:35.997454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc7c4d38-f363-4139-8d7c-410752ea38ea tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:35.997943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc7c4d38-f363-4139-8d7c-410752ea38ea tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:35.998938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc7c4d38-f363-4139-8d7c-410752ea38ea tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:35.999396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc7c4d38-f363-4139-8d7c-410752ea38ea tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:36.219586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc7c4d38-f363-4139-8d7c-410752ea38ea tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:36.230063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc7c4d38-f363-4139-8d7c-410752ea38ea tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:36.231767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc7c4d38-f363-4139-8d7c-410752ea38ea tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:36.233028 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc7c4d38-f363-4139-8d7c-410752ea38ea tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.248609 May 28 21:13:36.233736 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1497/2943] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:35 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:13:36.246072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5e46edff-b2cd-44ee-afa2-6598bf0457f9 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d5738b820>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:36.271752 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-947c671d-2da2-4fd8-8f6c-484b39716e26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 204 len: 0 microversion: 2.1 time: 3.313737 May 28 21:13:36.275537 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1447/2944] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:13:32 2022] DELETE /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 0 bytes in 3317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:13:36.282846 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5e46edff-b2cd-44ee-afa2-6598bf0457f9 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba" status: 200 len: 286 microversion: 2.1 time: 0.047868 May 28 21:13:36.283590 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1498/2945] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 21:13:36 2022] GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:36.289364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-515f267a-a024-4153-949e-1e6b711214ba tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:36.290152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-515f267a-a024-4153-949e-1e6b711214ba tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:36.297411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-515f267a-a024-4153-949e-1e6b711214ba tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:36.298062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-515f267a-a024-4153-949e-1e6b711214ba tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:36.299167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-515f267a-a024-4153-949e-1e6b711214ba tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:36.299420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-515f267a-a024-4153-949e-1e6b711214ba tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:36.317983 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-515f267a-a024-4153-949e-1e6b711214ba tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-515f267a-a024-4153-949e-1e6b711214ba tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a HTTP/1.1 May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ce53dda7-d501-475f-a4c0-73853a36630a'} May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:36.319668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:36.326339 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:36.326339 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:13:36.326339 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:13:36.326339 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:13:36.326339 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:13:36.326339 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. May 28 21:13:36.326339 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:36.326339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-515f267a-a024-4153-949e-1e6b711214ba tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:13:36.326339 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-515f267a-a024-4153-949e-1e6b711214ba tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 404 len: 111 microversion: 2.1 time: 0.036005 May 28 21:13:36.326339 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1448/2946] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:36 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:13:36.360825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-11cc1801-bfda-459a-a7a8-6fe24a6dfe90 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:36.362400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-11cc1801-bfda-459a-a7a8-6fe24a6dfe90 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:36.369630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11cc1801-bfda-459a-a7a8-6fe24a6dfe90 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:36.370287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11cc1801-bfda-459a-a7a8-6fe24a6dfe90 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:36.371236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11cc1801-bfda-459a-a7a8-6fe24a6dfe90 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:36.371847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11cc1801-bfda-459a-a7a8-6fe24a6dfe90 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:36.471115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-344650706", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "4688fc3e-7c0b-4b45-bce6-c3e05e995935"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:36.540781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] validate_networks() for [('4688fc3e-7c0b-4b45-bce6-c3e05e995935', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:13:36.690170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-11cc1801-bfda-459a-a7a8-6fe24a6dfe90 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:36.702285 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-11cc1801-bfda-459a-a7a8-6fe24a6dfe90 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.345737 May 28 21:13:36.703557 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1499/2947] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:36 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:36.711382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9d616406-e08c-4eef-9bed-2738a088de4d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:36.712260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9d616406-e08c-4eef-9bed-2738a088de4d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:36.724370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d616406-e08c-4eef-9bed-2738a088de4d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:36.725051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d616406-e08c-4eef-9bed-2738a088de4d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:36.750666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d616406-e08c-4eef-9bed-2738a088de4d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:36.751310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d616406-e08c-4eef-9bed-2738a088de4d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:37.413757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9d616406-e08c-4eef-9bed-2738a088de4d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:37.427798 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9d616406-e08c-4eef-9bed-2738a088de4d tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.721774 May 28 21:13:37.428970 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1500/2948] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:36 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:37.456038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-59f1bf3e-5e81-47fb-92bc-ad29cddc3020 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d577bd940>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:37.529766 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-59f1bf3e-5e81-47fb-92bc-ad29cddc3020 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 200 len: 1419 microversion: 2.1 time: 0.098910 May 28 21:13:37.530787 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1501/2949] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:37 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 1419 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:37.536950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-b768584f-d1ca-424e-ae7a-d01c0b3003a7 req-b0949516-80c8-4b96-a984-45ac2777298f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "name": "network-vif-plugged", "status": "completed", "tag": "bd03c494-abd0-49ea-9ef3-2c2229cfd371"}, {"server_uuid": "ce53dda7-d501-475f-a4c0-73853a36630a", "name": "network-vif-unplugged", "status": "completed", "tag": "197a0eea-120c-4af5-b57d-60f7eef43916"}, {"server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "name": "network-vif-plugged", "status": "completed", "tag": "48633e8e-091d-451b-8abe-5cdb8fc414cf"}, {"server_uuid": "818f89de-48f1-43d3-9ee2-4ab0e3652353", "name": "network-vif-plugged", "status": "completed", "tag": "59de6851-8323-4006-84f5-6c1b327b2c4f"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:37.554045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b768584f-d1ca-424e-ae7a-d01c0b3003a7 req-b0949516-80c8-4b96-a984-45ac2777298f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:37.554838 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b768584f-d1ca-424e-ae7a-d01c0b3003a7 req-b0949516-80c8-4b96-a984-45ac2777298f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:37.561566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:37.576621 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b768584f-d1ca-424e-ae7a-d01c0b3003a7 req-b0949516-80c8-4b96-a984-45ac2777298f service nova] Creating event network-vif-plugged:bd03c494-abd0-49ea-9ef3-2c2229cfd371 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:13:37.577469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.compute.server_external_events [req-b768584f-d1ca-424e-ae7a-d01c0b3003a7 req-b0949516-80c8-4b96-a984-45ac2777298f service nova] Unable to find a host for instance ce53dda7-d501-475f-a4c0-73853a36630a. Dropping event network-vif-unplugged {{(pid=143129) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 28 21:13:37.578526 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b768584f-d1ca-424e-ae7a-d01c0b3003a7 req-b0949516-80c8-4b96-a984-45ac2777298f service nova] Creating event network-vif-plugged:48633e8e-091d-451b-8abe-5cdb8fc414cf for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:13:37.579688 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b768584f-d1ca-424e-ae7a-d01c0b3003a7 req-b0949516-80c8-4b96-a984-45ac2777298f service nova] Creating event network-vif-plugged:59de6851-8323-4006-84f5-6c1b327b2c4f for instance 818f89de-48f1-43d3-9ee2-4ab0e3652353 on nch2-master-1 May 28 21:13:37.590479 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-b768584f-d1ca-424e-ae7a-d01c0b3003a7 req-b0949516-80c8-4b96-a984-45ac2777298f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 695 microversion: 2.1 time: 0.058255 May 28 21:13:37.591771 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1502/2950] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 695 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 28 21:13:37.597527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-de34edf5-4dab-4c13-b4e2-21bd4eee43f7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:37.599769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-de34edf5-4dab-4c13-b4e2-21bd4eee43f7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:37.611170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de34edf5-4dab-4c13-b4e2-21bd4eee43f7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:37.611700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de34edf5-4dab-4c13-b4e2-21bd4eee43f7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:37.612507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de34edf5-4dab-4c13-b4e2-21bd4eee43f7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:37.614081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de34edf5-4dab-4c13-b4e2-21bd4eee43f7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:37.669809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:13:37.672914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:13:37.673589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:13:37.674195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:13:37.674763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:13:37.688380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:37.689088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:37.690102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:37.690553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:37.729421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Getting quotas for project cf04fd760c54473f83980a385252fa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:13:37.737177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Getting quotas for user bf9c8f66e7d24ca9baca835e41546f22 and project cf04fd760c54473f83980a385252fa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:13:37.744368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:37.760342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:13:37.763136 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:13:37.910816 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-829ad02c-75b6-4364-855d-b438cf9b7945 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.448183 May 28 21:13:37.911512 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1449/2951] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:13:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1451 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:13:37.927114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-49486dc7-65b6-4003-ae18-3b5db964eecc tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d578275e0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:38.027199 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-49486dc7-65b6-4003-ae18-3b5db964eecc tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba" status: 200 len: 287 microversion: 2.1 time: 0.110761 May 28 21:13:38.027779 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1450/2952] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 21:13:37 2022] GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba => generated 287 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:38.034922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-91fd00de-fee0-448e-af48-4b8b59c8fbe1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:38.035754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-91fd00de-fee0-448e-af48-4b8b59c8fbe1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:38.056927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91fd00de-fee0-448e-af48-4b8b59c8fbe1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:38.062009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91fd00de-fee0-448e-af48-4b8b59c8fbe1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:38.063139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91fd00de-fee0-448e-af48-4b8b59c8fbe1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:38.065210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91fd00de-fee0-448e-af48-4b8b59c8fbe1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:38.195634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-de34edf5-4dab-4c13-b4e2-21bd4eee43f7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:38.215866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-de34edf5-4dab-4c13-b4e2-21bd4eee43f7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:38.218979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-de34edf5-4dab-4c13-b4e2-21bd4eee43f7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:38.221587 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-de34edf5-4dab-4c13-b4e2-21bd4eee43f7 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.628341 May 28 21:13:38.237979 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1503/2953] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:37 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:38.260184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e77d1928-ecad-49ac-871f-766d565db832 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:38.269482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e77d1928-ecad-49ac-871f-766d565db832 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:38.424209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e77d1928-ecad-49ac-871f-766d565db832 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:38.439073 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e77d1928-ecad-49ac-871f-766d565db832 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1214 microversion: 2.1 time: 0.194240 May 28 21:13:38.453046 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1504/2954] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:38 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1214 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:38.458688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e02c0789-64b7-4bb9-9f03-f270c158eb9f tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d5727fd30>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:38.614726 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e02c0789-64b7-4bb9-9f03-f270c158eb9f tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba" status: 202 len: 0 microversion: 2.1 time: 0.160224 May 28 21:13:38.614873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-91fd00de-fee0-448e-af48-4b8b59c8fbe1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:38.616093 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1505/2955] 10.222.0.33 () {58 vars in 1253 bytes} [Sat May 28 21:13:38 2022] DELETE /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:13:38.623693 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-91fd00de-fee0-448e-af48-4b8b59c8fbe1 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.594253 May 28 21:13:38.625011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-536bedd5-225d-43cb-8a49-fdadc5b0f8f1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:38.627869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-536bedd5-225d-43cb-8a49-fdadc5b0f8f1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:38.634286 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1451/2956] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:38 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:38.640000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d5e6187e-28b7-4c30-8d0d-c0e888551549 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d574993a0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:38.660740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-536bedd5-225d-43cb-8a49-fdadc5b0f8f1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:38.660740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-536bedd5-225d-43cb-8a49-fdadc5b0f8f1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:38.660740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-536bedd5-225d-43cb-8a49-fdadc5b0f8f1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:38.660740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-536bedd5-225d-43cb-8a49-fdadc5b0f8f1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:38.731871 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d5e6187e-28b7-4c30-8d0d-c0e888551549 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 200 len: 1419 microversion: 2.1 time: 0.096136 May 28 21:13:38.734052 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1452/2957] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:38 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 1419 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:38.741222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a57cd5cf-978d-49c5-a18e-19f75967d72c tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d574999d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:38.789119 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a57cd5cf-978d-49c5-a18e-19f75967d72c tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba" status: 200 len: 286 microversion: 2.1 time: 0.053849 May 28 21:13:38.790418 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1453/2958] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 21:13:38 2022] GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:38.946622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-536bedd5-225d-43cb-8a49-fdadc5b0f8f1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:38.961086 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-536bedd5-225d-43cb-8a49-fdadc5b0f8f1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.343047 May 28 21:13:38.962664 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1506/2959] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:38 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:39.246392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eb5d68e8-7bf6-4c82-9552-0692a4938d3f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:39.247383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eb5d68e8-7bf6-4c82-9552-0692a4938d3f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:39.276660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb5d68e8-7bf6-4c82-9552-0692a4938d3f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:39.277490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb5d68e8-7bf6-4c82-9552-0692a4938d3f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:39.278580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb5d68e8-7bf6-4c82-9552-0692a4938d3f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:39.279238 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb5d68e8-7bf6-4c82-9552-0692a4938d3f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:39.460439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fe314c66-161f-4a8f-8d37-7f4a1e40a089 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:39.462642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fe314c66-161f-4a8f-8d37-7f4a1e40a089 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:39.475487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:39.484899 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe314c66-161f-4a8f-8d37-7f4a1e40a089 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:39.485710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe314c66-161f-4a8f-8d37-7f4a1e40a089 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:39.487039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe314c66-161f-4a8f-8d37-7f4a1e40a089 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:39.487744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe314c66-161f-4a8f-8d37-7f4a1e40a089 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:39.881359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fe314c66-161f-4a8f-8d37-7f4a1e40a089 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:39.901681 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fe314c66-161f-4a8f-8d37-7f4a1e40a089 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1218 microversion: 2.1 time: 0.443796 May 28 21:13:39.912930 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1507/2960] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:39 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1218 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:39.920772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-09a348b1-852a-495c-a67f-41e06939a991 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:39.921646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-09a348b1-852a-495c-a67f-41e06939a991 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:39.938882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-09a348b1-852a-495c-a67f-41e06939a991 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:39.944832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-09a348b1-852a-495c-a67f-41e06939a991 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:39.944832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-09a348b1-852a-495c-a67f-41e06939a991 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:39.944832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-09a348b1-852a-495c-a67f-41e06939a991 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:40.003185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eb5d68e8-7bf6-4c82-9552-0692a4938d3f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:40.021768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eb5d68e8-7bf6-4c82-9552-0692a4938d3f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:40.024058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eb5d68e8-7bf6-4c82-9552-0692a4938d3f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:40.026405 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eb5d68e8-7bf6-4c82-9552-0692a4938d3f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1875 microversion: 2.32 time: 0.786483 May 28 21:13:40.030466 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1454/2961] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:39 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1875 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:40.044068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b54d8b75-401b-4aab-96e4-d372241b06b7 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d5749f670>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:40.142665 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b54d8b75-401b-4aab-96e4-d372241b06b7 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 200 len: 1419 microversion: 2.1 time: 0.109732 May 28 21:13:40.144985 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1455/2962] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:40 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 1419 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:40.160103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f3518d34-73e1-4e5e-b609-a3e8a4f31245 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d5749fd30>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:40.225829 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f3518d34-73e1-4e5e-b609-a3e8a4f31245 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba" status: 200 len: 286 microversion: 2.1 time: 0.079593 May 28 21:13:40.226696 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1456/2963] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 21:13:40 2022] GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:40.233882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-244763ee-9d31-4724-96a2-f6629e6af7da tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:40.234614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-244763ee-9d31-4724-96a2-f6629e6af7da tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:40.260909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-244763ee-9d31-4724-96a2-f6629e6af7da tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:40.263025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-244763ee-9d31-4724-96a2-f6629e6af7da tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:40.265065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-244763ee-9d31-4724-96a2-f6629e6af7da tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:40.267639 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-244763ee-9d31-4724-96a2-f6629e6af7da tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:40.524865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-09a348b1-852a-495c-a67f-41e06939a991 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:40.540358 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-09a348b1-852a-495c-a67f-41e06939a991 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.626437 May 28 21:13:40.545220 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1508/2964] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:39 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:40.715103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a4d24887-8b09-4906-8ba4-562afb34ffd6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Action: 'create', calling method: .version_select at 0x7f4d57379e50>, body: {"keypair": {"name": "tempest-keypair-1067773748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlLT1O0T2ebibHaSSmJZ1yNkY+zrQV8Ni8Rk1wjt9EAsLqyMki/LlXZAJAP8co9ic9Rscf90nbpyD9yOs/NJp+r5CVvZ3tTq5Lu359s6ELY38G7g+AXQgvQ1TwMcuqckg=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:40.764830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-a4d24887-8b09-4906-8ba4-562afb34ffd6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Getting quotas for project ca680361a7b349e39f77a7f7c96934f8. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:13:40.772788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-a4d24887-8b09-4906-8ba4-562afb34ffd6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Getting quotas for user eb7c3a01b54f4db2841f4836635eff2e and project ca680361a7b349e39f77a7f7c96934f8. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:13:40.802603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-244763ee-9d31-4724-96a2-f6629e6af7da tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:40.812403 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-244763ee-9d31-4724-96a2-f6629e6af7da tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1524 microversion: 2.1 time: 0.584052 May 28 21:13:40.813278 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1457/2965] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:40 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1524 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:40.886702 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a4d24887-8b09-4906-8ba4-562afb34ffd6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.180557 May 28 21:13:40.887413 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1509/2966] 10.222.0.33 () {62 vars in 1199 bytes} [Sat May 28 21:13:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 182 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 28 21:13:40.920964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fe323892-bcae-4845-8d69-2818c7d6ffbd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:40.921593 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fe323892-bcae-4845-8d69-2818c7d6ffbd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:40.930317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fe323892-bcae-4845-8d69-2818c7d6ffbd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:40.931012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fe323892-bcae-4845-8d69-2818c7d6ffbd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:40.931990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fe323892-bcae-4845-8d69-2818c7d6ffbd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:40.932597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fe323892-bcae-4845-8d69-2818c7d6ffbd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:41.016986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fe323892-bcae-4845-8d69-2818c7d6ffbd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:41.045869 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fe323892-bcae-4845-8d69-2818c7d6ffbd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1266 microversion: 2.1 time: 0.126851 May 28 21:13:41.048086 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1458/2967] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:40 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1266 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:41.078067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e1e28d52-c147-4212-81dc-9ff4d48e9bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:41.078959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e1e28d52-c147-4212-81dc-9ff4d48e9bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:41.093219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1e28d52-c147-4212-81dc-9ff4d48e9bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:41.108521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1e28d52-c147-4212-81dc-9ff4d48e9bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:41.109391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1e28d52-c147-4212-81dc-9ff4d48e9bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:41.109871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1e28d52-c147-4212-81dc-9ff4d48e9bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:41.159285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8debda1a-9db5-44ba-9fb9-ba354f96a7a6 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d5756ddc0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:41.230113 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8debda1a-9db5-44ba-9fb9-ba354f96a7a6 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 200 len: 1419 microversion: 2.1 time: 0.075335 May 28 21:13:41.230773 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1459/2968] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:41 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 1419 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:41.244667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-46a3eaf4-9c1a-4cb4-b3c2-3b7577f7241c tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d574da430>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:41.300752 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-46a3eaf4-9c1a-4cb4-b3c2-3b7577f7241c tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba" status: 200 len: 286 microversion: 2.1 time: 0.061351 May 28 21:13:41.302142 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1460/2969] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 21:13:41 2022] GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:41.564342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a165984c-428d-49d2-9385-25229402dea7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:41.565035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a165984c-428d-49d2-9385-25229402dea7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:41.572932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a165984c-428d-49d2-9385-25229402dea7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:41.573708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a165984c-428d-49d2-9385-25229402dea7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:41.574752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a165984c-428d-49d2-9385-25229402dea7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:41.575337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a165984c-428d-49d2-9385-25229402dea7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:41.588059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e1e28d52-c147-4212-81dc-9ff4d48e9bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:41.606069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e1e28d52-c147-4212-81dc-9ff4d48e9bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:41.608379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e1e28d52-c147-4212-81dc-9ff4d48e9bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:41.609466 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e1e28d52-c147-4212-81dc-9ff4d48e9bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 2828 microversion: 2.32 time: 0.562479 May 28 21:13:41.611904 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1510/2970] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:41 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 2828 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:41.640980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e0caa962-d951-47ae-abeb-ac8a9ce92bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:41.650491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e0caa962-d951-47ae-abeb-ac8a9ce92bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:41.673325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0caa962-d951-47ae-abeb-ac8a9ce92bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:41.676296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0caa962-d951-47ae-abeb-ac8a9ce92bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:41.681387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0caa962-d951-47ae-abeb-ac8a9ce92bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:41.685476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0caa962-d951-47ae-abeb-ac8a9ce92bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:42.298677 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e0caa962-d951-47ae-abeb-ac8a9ce92bfb tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.670635 May 28 21:13:42.302219 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1511/2971] 10.222.0.33 () {60 vars in 1315 bytes} [Sat May 28 21:13:41 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2/os-interface => generated 1831 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:42.308349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-001a4d9c-03ea-40be-ad6b-858b6038aeaf tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:42.309664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-001a4d9c-03ea-40be-ad6b-858b6038aeaf tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:42.338667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-001a4d9c-03ea-40be-ad6b-858b6038aeaf tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:42.338667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-001a4d9c-03ea-40be-ad6b-858b6038aeaf tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:42.338667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-001a4d9c-03ea-40be-ad6b-858b6038aeaf tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:42.338667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-001a4d9c-03ea-40be-ad6b-858b6038aeaf tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:42.397680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a165984c-428d-49d2-9385-25229402dea7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:42.443474 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a165984c-428d-49d2-9385-25229402dea7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.868216 May 28 21:13:42.454956 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1461/2972] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:41 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:42.462911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-68c309c9-4cdf-4d97-9f91-0dcce1fa33f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:42.464445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-68c309c9-4cdf-4d97-9f91-0dcce1fa33f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:42.476874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-68c309c9-4cdf-4d97-9f91-0dcce1fa33f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:42.477930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-68c309c9-4cdf-4d97-9f91-0dcce1fa33f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:42.479089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-68c309c9-4cdf-4d97-9f91-0dcce1fa33f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:42.479546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-68c309c9-4cdf-4d97-9f91-0dcce1fa33f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:42.563344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-68c309c9-4cdf-4d97-9f91-0dcce1fa33f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:42.575407 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-68c309c9-4cdf-4d97-9f91-0dcce1fa33f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1272 microversion: 2.1 time: 0.123707 May 28 21:13:42.576456 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1462/2973] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:42 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:42.581868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1f7d6c07-7e43-467d-844a-3fb0e3c5779f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d575728b0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:42.582873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-001a4d9c-03ea-40be-ad6b-858b6038aeaf tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:42.597724 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-001a4d9c-03ea-40be-ad6b-858b6038aeaf tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1504 microversion: 2.1 time: 0.293898 May 28 21:13:42.601113 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1512/2974] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:42 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:42.608033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9108d287-96e2-47ec-bf46-220492b9881f tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d57efd4c0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:42.647164 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-9108d287-96e2-47ec-bf46-220492b9881f tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] HTTP exception thrown: Snapshot 06b9663d-74c3-44b0-835e-37f8e32120ba could not be found. May 28 21:13:42.649294 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1f7d6c07-7e43-467d-844a-3fb0e3c5779f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 200 len: 1419 microversion: 2.1 time: 0.071399 May 28 21:13:42.649976 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1463/2975] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:42 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 1419 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:42.654922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e94c80fc-92d3-42f0-bf23-482fe8b27190 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Action: 'create', calling method: .version_select at 0x7f4d574549d0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-631995083", "description": "tempest-description-744801365"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9108d287-96e2-47ec-bf46-220492b9881f tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Request method failure captured: May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba HTTP/1.1 May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpB56b_60xm1cQXskrsu3kzUL-5VL3y4EMNqhjAQhcI2x_ZK6OcsTMsnhvH0gk1vvbmRGkExGR-YQSJ21vky8i4u095KAVYwIyb0-g6C-Padddfm6fRrlgfPi9kSnzI4w4Lo7rbqzHV4PJj9923_XcBlQQQplXIbYRW60-PpL2daOns May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 713293ceb9c44e8ea1a5d92668ad252a May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-21813657 May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_713293ceb9c44e8ea1a5d92668ad252a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/713293ceb9c44e8ea1a5d92668ad252a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/713293ceb9c44e8ea1a5d92668ad252a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/713293ceb9c44e8ea1a5d92668ad252a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-VolumesSnapshotsTestJSON-21813657 May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 713293ceb9c44e8ea1a5d92668ad252a May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-21813657 May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-VolumesSnapshotsTestJSON-21813657-project May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 041cd29a8fca40d0aab7e18c3b5e0dd6 May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-VolumesSnapshotsTestJSON-21813657-project May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: exception: Snapshot 06b9663d-74c3-44b0-835e-37f8e32120ba could not be found. May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '06b9663d-74c3-44b0-835e-37f8e32120ba'} May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 06b9663d-74c3-44b0-835e-37f8e32120ba could not be found. (HTTP 404) (Request-ID: req-e33bc742-387f-4cff-8673-0269e00a80f6) May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 21:13:42.696389 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 06b9663d-74c3-44b0-835e-37f8e32120ba could not be found. May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 06b9663d-74c3-44b0-835e-37f8e32120ba could not be found. May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 06b9663d-74c3-44b0-835e-37f8e32120ba could not be found. May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9108d287-96e2-47ec-bf46-220492b9881f tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Returning 404 to user: Snapshot 06b9663d-74c3-44b0-835e-37f8e32120ba could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9108d287-96e2-47ec-bf46-220492b9881f tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba" status: 404 len: 111 microversion: 2.1 time: 0.095475 May 28 21:13:42.701515 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1513/2976] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 21:13:42 2022] GET /compute/v2.1/os-snapshots/06b9663d-74c3-44b0-835e-37f8e32120ba => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:13:42.707975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-66906741-a04f-466d-87be-1d82172ffd6e tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d57efe790>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:42.972149 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-66906741-a04f-466d-87be-1d82172ffd6e tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a" status: 202 len: 0 microversion: 2.1 time: 0.265574 May 28 21:13:42.985636 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1514/2977] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 21:13:42 2022] DELETE /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:13:43.011826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e7192014-894e-4845-94de-6a76b8919284 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d57efdf70>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:43.123495 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e7192014-894e-4845-94de-6a76b8919284 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a" status: 200 len: 337 microversion: 2.1 time: 0.132666 May 28 21:13:43.124732 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1515/2978] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:13:42 2022] GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a => generated 337 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:43.336005 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e94c80fc-92d3-42f0-bf23-482fe8b27190 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.684694 May 28 21:13:43.339012 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1464/2979] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:13:42 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:43.352278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-afb2042e-96c2-4483-9ba6-fc080d7375a7 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-631995083"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:43.353091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-afb2042e-96c2-4483-9ba6-fc080d7375a7 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:43.366160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afb2042e-96c2-4483-9ba6-fc080d7375a7 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:43.367139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afb2042e-96c2-4483-9ba6-fc080d7375a7 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:43.368457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afb2042e-96c2-4483-9ba6-fc080d7375a7 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:43.369251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afb2042e-96c2-4483-9ba6-fc080d7375a7 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:43.463455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-16321f6d-28b4-49d8-9d5b-04eb1e3b42c5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:43.464069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-16321f6d-28b4-49d8-9d5b-04eb1e3b42c5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:43.475365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16321f6d-28b4-49d8-9d5b-04eb1e3b42c5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:43.476104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16321f6d-28b4-49d8-9d5b-04eb1e3b42c5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:43.477097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16321f6d-28b4-49d8-9d5b-04eb1e3b42c5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:43.477689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16321f6d-28b4-49d8-9d5b-04eb1e3b42c5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:43.496700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=79,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:43.662575 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.network.security_group_api [None req-afb2042e-96c2-4483-9ba6-fc080d7375a7 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Adding security group b034a9ee-141a-4307-ae5d-5114287cc286 to port b924fa8a-bfb6-498c-af2f-c5e8038266e0 May 28 21:13:43.787781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-16321f6d-28b4-49d8-9d5b-04eb1e3b42c5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:43.798741 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-16321f6d-28b4-49d8-9d5b-04eb1e3b42c5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.339967 May 28 21:13:43.805038 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1465/2980] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:43 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:43.816892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b837a2ff-dad6-4f80-9356-215564af32bd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:43.818381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b837a2ff-dad6-4f80-9356-215564af32bd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:43.841597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b837a2ff-dad6-4f80-9356-215564af32bd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:43.843847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b837a2ff-dad6-4f80-9356-215564af32bd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:43.843847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b837a2ff-dad6-4f80-9356-215564af32bd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:43.843847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b837a2ff-dad6-4f80-9356-215564af32bd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:44.172006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b837a2ff-dad6-4f80-9356-215564af32bd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:44.197959 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b837a2ff-dad6-4f80-9356-215564af32bd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1314 microversion: 2.1 time: 0.390465 May 28 21:13:44.199187 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1466/2981] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:43 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:44.216769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-975592e2-ce90-45bf-aa96-69b21e597cd9 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d57477e50>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:44.298598 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-975592e2-ce90-45bf-aa96-69b21e597cd9 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 200 len: 1419 microversion: 2.1 time: 0.097512 May 28 21:13:44.299201 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1467/2982] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:44 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 1419 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:44.304544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4cbf7c57-78e5-41b6-95e2-334d1e434e3e tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d574ede50>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:44.393063 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4cbf7c57-78e5-41b6-95e2-334d1e434e3e tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a" status: 200 len: 337 microversion: 2.1 time: 0.092368 May 28 21:13:44.394498 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1468/2983] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:13:44 2022] GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a => generated 337 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:44.780171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-5d154b09-a3c8-4b43-8a00-00c83b1255d4 req-5bf56258-fe06-4938-9890-7ede6b676d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "tag": "8441633d-d2d5-43e9-899c-acfbbc72f929"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:44.792593 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-afb2042e-96c2-4483-9ba6-fc080d7375a7 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "POST /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723/action" status: 202 len: 0 microversion: 2.1 time: 1.447133 May 28 21:13:44.796691 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1516/2984] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:13:43 2022] POST /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723/action => generated 0 bytes in 1452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:13:44.802268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7ab6ddcd-3177-4cbf-819b-cf864cdde20e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-631995083"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:44.804171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7ab6ddcd-3177-4cbf-819b-cf864cdde20e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:44.822387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ab6ddcd-3177-4cbf-819b-cf864cdde20e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:44.827093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ab6ddcd-3177-4cbf-819b-cf864cdde20e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:44.828082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ab6ddcd-3177-4cbf-819b-cf864cdde20e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:44.828597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ab6ddcd-3177-4cbf-819b-cf864cdde20e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:45.220974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5d154b09-a3c8-4b43-8a00-00c83b1255d4 req-5bf56258-fe06-4938-9890-7ede6b676d45 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:45.222621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5d154b09-a3c8-4b43-8a00-00c83b1255d4 req-5bf56258-fe06-4938-9890-7ede6b676d45 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:45.236482 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-5d154b09-a3c8-4b43-8a00-00c83b1255d4 req-5bf56258-fe06-4938-9890-7ede6b676d45 service nova] Creating event network-changed:8441633d-d2d5-43e9-899c-acfbbc72f929 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:13:45.243505 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-5d154b09-a3c8-4b43-8a00-00c83b1255d4 req-5bf56258-fe06-4938-9890-7ede6b676d45 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.465646 May 28 21:13:45.244688 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1469/2985] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:13:45.251615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0f498433-588e-46c6-8b67-480fa06d08c3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:45.262423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0f498433-588e-46c6-8b67-480fa06d08c3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:45.275993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f498433-588e-46c6-8b67-480fa06d08c3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:45.276663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f498433-588e-46c6-8b67-480fa06d08c3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:45.277050 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.network.security_group_api [None req-7ab6ddcd-3177-4cbf-819b-cf864cdde20e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Removing security group b034a9ee-141a-4307-ae5d-5114287cc286 from port b924fa8a-bfb6-498c-af2f-c5e8038266e0 May 28 21:13:45.277595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f498433-588e-46c6-8b67-480fa06d08c3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:45.278059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f498433-588e-46c6-8b67-480fa06d08c3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:45.959665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0f498433-588e-46c6-8b67-480fa06d08c3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:45.972913 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0f498433-588e-46c6-8b67-480fa06d08c3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.722639 May 28 21:13:45.973932 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1470/2986] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:45 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:46.112566 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7ab6ddcd-3177-4cbf-819b-cf864cdde20e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "POST /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723/action" status: 202 len: 0 microversion: 2.1 time: 1.308833 May 28 21:13:46.112566 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1517/2987] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:13:44 2022] POST /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723/action => generated 0 bytes in 1310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:13:46.120831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0aac1619-ee18-43d3-b122-f20d6c35a847 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:46.122466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0aac1619-ee18-43d3-b122-f20d6c35a847 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:46.138237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0aac1619-ee18-43d3-b122-f20d6c35a847 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:46.140895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0aac1619-ee18-43d3-b122-f20d6c35a847 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:46.146258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0aac1619-ee18-43d3-b122-f20d6c35a847 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:46.147239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0aac1619-ee18-43d3-b122-f20d6c35a847 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:46.150882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-8e3dd7ce-d31a-4132-ae62-cd900ad719e7 req-ebeccc85-32bf-4cbb-ae3b-94407e771314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d4c0a5-6961-49e0-8863-846ca05d0723", "tag": "b924fa8a-bfb6-498c-af2f-c5e8038266e0"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:46.162944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8e3dd7ce-d31a-4132-ae62-cd900ad719e7 req-ebeccc85-32bf-4cbb-ae3b-94407e771314 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:46.169550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8e3dd7ce-d31a-4132-ae62-cd900ad719e7 req-ebeccc85-32bf-4cbb-ae3b-94407e771314 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:46.198261 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-8e3dd7ce-d31a-4132-ae62-cd900ad719e7 req-ebeccc85-32bf-4cbb-ae3b-94407e771314 service nova] Creating event network-changed:b924fa8a-bfb6-498c-af2f-c5e8038266e0 for instance 60d4c0a5-6961-49e0-8863-846ca05d0723 on nch2-master-1 May 28 21:13:46.210965 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-8e3dd7ce-d31a-4132-ae62-cd900ad719e7 req-ebeccc85-32bf-4cbb-ae3b-94407e771314 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233055 May 28 21:13:46.212608 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1471/2988] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:46.236549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3d438561-deff-44d8-9f98-49b42906ff07 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d574edd30>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:46.324958 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3d438561-deff-44d8-9f98-49b42906ff07 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 200 len: 1419 microversion: 2.1 time: 0.108944 May 28 21:13:46.326662 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1472/2989] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:46 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 1419 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:46.338734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3f3d41cd-c902-4b57-adbe-2b7882141871 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d574dad30>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:46.450417 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3f3d41cd-c902-4b57-adbe-2b7882141871 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a" status: 200 len: 337 microversion: 2.1 time: 0.120277 May 28 21:13:46.451102 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1473/2990] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:13:46 2022] GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a => generated 337 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:46.466336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9b4d2fcb-476c-42d1-b92b-7cd1c20100a1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Action: 'create', calling method: .version_select at 0x7f4d57539430>, body: {"pool": null} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:46.753766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0aac1619-ee18-43d3-b122-f20d6c35a847 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:46.764528 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0aac1619-ee18-43d3-b122-f20d6c35a847 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1314 microversion: 2.1 time: 0.655880 May 28 21:13:46.765861 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1518/2991] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:46 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1314 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:46.991612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-824b4c4c-d329-45f0-8f66-edae50afc760 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:46.992468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-824b4c4c-d329-45f0-8f66-edae50afc760 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:47.004830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-824b4c4c-d329-45f0-8f66-edae50afc760 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:47.006363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-824b4c4c-d329-45f0-8f66-edae50afc760 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:47.008047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-824b4c4c-d329-45f0-8f66-edae50afc760 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:47.010529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-824b4c4c-d329-45f0-8f66-edae50afc760 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:47.344440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-824b4c4c-d329-45f0-8f66-edae50afc760 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:47.357026 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-824b4c4c-d329-45f0-8f66-edae50afc760 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.370008 May 28 21:13:47.358016 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1519/2992] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:46 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:47.363443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-4ae4d16c-2144-4715-92eb-b877af086d69 req-8f91d453-aef1-46cd-a13d-c68aac0e20e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90a4d46c-e387-4ba1-962d-71d5fcfe5577", "tag": "1c674af8-61de-4365-96e1-e23e1214c3ba"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:47.373099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4ae4d16c-2144-4715-92eb-b877af086d69 req-8f91d453-aef1-46cd-a13d-c68aac0e20e4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:47.373554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4ae4d16c-2144-4715-92eb-b877af086d69 req-8f91d453-aef1-46cd-a13d-c68aac0e20e4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:47.387452 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-4ae4d16c-2144-4715-92eb-b877af086d69 req-8f91d453-aef1-46cd-a13d-c68aac0e20e4 service nova] Creating event network-changed:1c674af8-61de-4365-96e1-e23e1214c3ba for instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 on nch2-master-1 May 28 21:13:47.395936 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-4ae4d16c-2144-4715-92eb-b877af086d69 req-8f91d453-aef1-46cd-a13d-c68aac0e20e4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036047 May 28 21:13:47.397164 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1520/2993] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:47.405742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c60895bf-7929-4d1b-b258-b9a34fb24e3a tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d574788b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:47.472125 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c60895bf-7929-4d1b-b258-b9a34fb24e3a tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 200 len: 1419 microversion: 2.1 time: 0.070754 May 28 21:13:47.473394 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1521/2994] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:47 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 1419 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:47.492110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d80005ed-dd51-4334-9836-a1459c6f4d4d tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d5738bdc0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:47.575004 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d80005ed-dd51-4334-9836-a1459c6f4d4d tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a" status: 200 len: 337 microversion: 2.1 time: 0.098309 May 28 21:13:47.576643 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1522/2995] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:13:47 2022] GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a => generated 337 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:47.667810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1585696834", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a9c31b2d-8ebb-4564-bdb3-09390865ea56"}, {"port": "cd216d91-0e66-48bd-ba1b-debee67cf784", "tag": "port-1"}, {"port": "ec5c409c-5c1a-40d9-8be5-b5bc17805f84", "tag": "port-2"}, {"uuid": "db2b1f2f-bf0a-4d81-b90b-7bfc42420544", "tag": "net-1"}, {"uuid": "db2b1f2f-bf0a-4d81-b90b-7bfc42420544"}, {"uuid": "9c3e6f6a-37d3-4df8-af64-d241ef40a30f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9c3e6f6a-37d3-4df8-af64-d241ef40a30f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "26cabed5-9ce1-42aa-b829-f68d323905f3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "50730637-3c48-4270-bed2-229c25f4f463", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0aae4e20-4ac4-4c87-a853-064fb70796fb", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--316580012"}], "key_name": "tempest-keypair-1067773748", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:47.722006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:47.753538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:47.924344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] validate_networks() for [('a9c31b2d-8ebb-4564-bdb3-09390865ea56', None, None, None, None, None), (None, None, 'cd216d91-0e66-48bd-ba1b-debee67cf784', None, None, None), (None, None, 'ec5c409c-5c1a-40d9-8be5-b5bc17805f84', None, None, None), ('db2b1f2f-bf0a-4d81-b90b-7bfc42420544', None, None, None, None, None), ('db2b1f2f-bf0a-4d81-b90b-7bfc42420544', None, None, None, None, None), ('9c3e6f6a-37d3-4df8-af64-d241ef40a30f', '10.2.2.100', None, None, None, None), ('9c3e6f6a-37d3-4df8-af64-d241ef40a30f', '10.2.2.200', None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:13:50.033432 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9b4d2fcb-476c-42d1-b92b-7cd1c20100a1 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.581152 May 28 21:13:50.036858 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1474/2996] 10.222.0.33 () {60 vars in 1169 bytes} [Sat May 28 21:13:46 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:50.040973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-13f7a271-dcbc-44c5-823a-8a0a21564729 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:50.042304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-13f7a271-dcbc-44c5-823a-8a0a21564729 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:50.055851 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13f7a271-dcbc-44c5-823a-8a0a21564729 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:50.063860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13f7a271-dcbc-44c5-823a-8a0a21564729 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:50.065157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13f7a271-dcbc-44c5-823a-8a0a21564729 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:50.066090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13f7a271-dcbc-44c5-823a-8a0a21564729 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:50.299605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-13f7a271-dcbc-44c5-823a-8a0a21564729 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:50.317868 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-13f7a271-dcbc-44c5-823a-8a0a21564729 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1314 microversion: 2.1 time: 0.281812 May 28 21:13:50.331429 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1475/2997] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:50 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:50.336996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-e2c8ff98-fa92-4836-98d3-b09c414407c5 req-4e90c454-ffd2-4b3f-a8e1-6a7edbff99af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d4c0a5-6961-49e0-8863-846ca05d0723", "tag": "b924fa8a-bfb6-498c-af2f-c5e8038266e0"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:50.347112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e2c8ff98-fa92-4836-98d3-b09c414407c5 req-4e90c454-ffd2-4b3f-a8e1-6a7edbff99af service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:50.347842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e2c8ff98-fa92-4836-98d3-b09c414407c5 req-4e90c454-ffd2-4b3f-a8e1-6a7edbff99af service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:50.361944 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e2c8ff98-fa92-4836-98d3-b09c414407c5 req-4e90c454-ffd2-4b3f-a8e1-6a7edbff99af service nova] Creating event network-changed:b924fa8a-bfb6-498c-af2f-c5e8038266e0 for instance 60d4c0a5-6961-49e0-8863-846ca05d0723 on nch2-master-1 May 28 21:13:50.367534 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-e2c8ff98-fa92-4836-98d3-b09c414407c5 req-4e90c454-ffd2-4b3f-a8e1-6a7edbff99af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034488 May 28 21:13:50.376398 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1476/2998] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:50.376398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-128783e5-60cb-4848-82fa-139c5cb31de2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:50.376398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-128783e5-60cb-4848-82fa-139c5cb31de2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:50.394703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-128783e5-60cb-4848-82fa-139c5cb31de2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:50.395440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-128783e5-60cb-4848-82fa-139c5cb31de2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:50.396418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-128783e5-60cb-4848-82fa-139c5cb31de2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:50.397007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-128783e5-60cb-4848-82fa-139c5cb31de2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:50.763338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-128783e5-60cb-4848-82fa-139c5cb31de2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:50.776442 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-128783e5-60cb-4848-82fa-139c5cb31de2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.405930 May 28 21:13:50.777398 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1477/2999] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:50 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:50.782427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0d8f4897-9bb1-422c-ade4-e77abdf400a5 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d575284c0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:50.782953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:50.840137 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0d8f4897-9bb1-422c-ade4-e77abdf400a5 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 200 len: 1419 microversion: 2.1 time: 0.061766 May 28 21:13:50.846716 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1478/3000] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:50 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 1419 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:50.857070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-85abfb4a-59e2-467f-9ec9-3363e22583e2 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d57578b80>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:50.889902 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-85abfb4a-59e2-467f-9ec9-3363e22583e2 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] HTTP exception thrown: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-85abfb4a-59e2-467f-9ec9-3363e22583e2 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Request method failure captured: May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a HTTP/1.1 May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpB56b_60xm1cQXskrsu3kzUL-5VL3y4EMNqhjAQhcI2x_ZK6OcsTMsnhvH0gk1vvbmRGkExGR-YQSJ21vky8i4u095KAVYwIyb0-g6C-Padddfm6fRrlgfPi9kSnzI4w4Lo7rbqzHV4PJj9923_XcBlQQQplXIbYRW60-PpL2daOns May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 713293ceb9c44e8ea1a5d92668ad252a May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-21813657 May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_713293ceb9c44e8ea1a5d92668ad252a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/713293ceb9c44e8ea1a5d92668ad252a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/713293ceb9c44e8ea1a5d92668ad252a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/713293ceb9c44e8ea1a5d92668ad252a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-VolumesSnapshotsTestJSON-21813657 May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 713293ceb9c44e8ea1a5d92668ad252a May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-21813657 May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-VolumesSnapshotsTestJSON-21813657-project May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 041cd29a8fca40d0aab7e18c3b5e0dd6 May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-VolumesSnapshotsTestJSON-21813657-project May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: exception: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '290d5498-182e-4bc7-bcec-0cf0a2ec578a'} May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. (HTTP 404) (Request-ID: req-a0d16867-119a-4d7c-88ca-93a3928ff919) May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 21:13:50.893286 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:50.897626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-85abfb4a-59e2-467f-9ec9-3363e22583e2 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Returning 404 to user: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:13:50.902041 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-85abfb4a-59e2-467f-9ec9-3363e22583e2 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a" status: 404 len: 109 microversion: 2.1 time: 0.048722 May 28 21:13:50.903569 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1479/3001] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:13:50 2022] GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:13:50.910228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6cdf8865-e20b-46e8-8616-2fe6cb67540c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.132"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:50.911576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6cdf8865-e20b-46e8-8616-2fe6cb67540c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:50.918801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cdf8865-e20b-46e8-8616-2fe6cb67540c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:50.919558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cdf8865-e20b-46e8-8616-2fe6cb67540c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:50.920504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cdf8865-e20b-46e8-8616-2fe6cb67540c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:50.921107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cdf8865-e20b-46e8-8616-2fe6cb67540c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:50.953427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cdf8865-e20b-46e8-8616-2fe6cb67540c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Acquired lock "refresh_cache-60d4c0a5-6961-49e0-8863-846ca05d0723" {{(pid=143128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 21:13:52.533456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:13:52.534027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:13:52.534658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:13:52.535130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:13:52.535554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:13:52.546932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:52.547391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:52.548202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:52.548654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:52.567432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Getting quotas for project ca680361a7b349e39f77a7f7c96934f8. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:13:52.573265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Getting quotas for user eb7c3a01b54f4db2841f4836635eff2e and project ca680361a7b349e39f77a7f7c96934f8. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:13:52.753202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:13:52.756055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='26cabed5-9ce1-42aa-b829-f68d323905f3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='50730637-3c48-4270-bed2-229c25f4f463',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0aae4e20-4ac4-4c87-a853-064fb70796fb',volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:13:53.009932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-6cdf8865-e20b-46e8-8616-2fe6cb67540c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Building network info cache for instance {{(pid=143128) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 21:13:53.554204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-6cdf8865-e20b-46e8-8616-2fe6cb67540c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Updating instance_info_cache with network_info: [{"id": "b924fa8a-bfb6-498c-af2f-c5e8038266e0", "address": "fa:16:3e:58:2f:c7", "network": {"id": "44029916-1fdb-4ad5-9c01-eb6eab801765", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-611153693-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d26d403e254e4caa887f8155d74c84c4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb924fa8a-bf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=143128) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 21:13:53.695013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cdf8865-e20b-46e8-8616-2fe6cb67540c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Releasing lock "refresh_cache-60d4c0a5-6961-49e0-8863-846ca05d0723" {{(pid=143128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 21:13:53.696428 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6cdf8865-e20b-46e8-8616-2fe6cb67540c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "POST /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723/action" status: 202 len: 0 microversion: 2.1 time: 2.791057 May 28 21:13:53.697044 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1480/3002] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:13:50 2022] POST /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723/action => generated 0 bytes in 2793 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 21:13:53.701877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-68d4914f-1428-435e-9b6e-7bbad55d4291 req-37e54fbf-94cf-46b1-a7c8-b34e75692063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a4d46c-e387-4ba1-962d-71d5fcfe5577", "name": "network-vif-plugged", "status": "completed", "tag": "1c674af8-61de-4365-96e1-e23e1214c3ba"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:53.710213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-68d4914f-1428-435e-9b6e-7bbad55d4291 req-37e54fbf-94cf-46b1-a7c8-b34e75692063 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:53.710688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-68d4914f-1428-435e-9b6e-7bbad55d4291 req-37e54fbf-94cf-46b1-a7c8-b34e75692063 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:53.722231 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-68d4914f-1428-435e-9b6e-7bbad55d4291 req-37e54fbf-94cf-46b1-a7c8-b34e75692063 service nova] Creating event network-vif-plugged:1c674af8-61de-4365-96e1-e23e1214c3ba for instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 on nch2-master-1 May 28 21:13:53.727965 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-68d4914f-1428-435e-9b6e-7bbad55d4291 req-37e54fbf-94cf-46b1-a7c8-b34e75692063 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029119 May 28 21:13:53.728614 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1481/3003] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:53.733790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-955d6882-8197-4ece-b4b4-198063e8f2d3 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d673b8b80>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:53.790637 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-955d6882-8197-4ece-b4b4-198063e8f2d3 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] HTTP exception thrown: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-955d6882-8197-4ece-b4b4-198063e8f2d3 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Request method failure captured: May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a HTTP/1.1 May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpB56b_60xm1cQXskrsu3kzUL-5VL3y4EMNqhjAQhcI2x_ZK6OcsTMsnhvH0gk1vvbmRGkExGR-YQSJ21vky8i4u095KAVYwIyb0-g6C-Padddfm6fRrlgfPi9kSnzI4w4Lo7rbqzHV4PJj9923_XcBlQQQplXIbYRW60-PpL2daOns May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 713293ceb9c44e8ea1a5d92668ad252a May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-21813657 May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_713293ceb9c44e8ea1a5d92668ad252a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/713293ceb9c44e8ea1a5d92668ad252a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/713293ceb9c44e8ea1a5d92668ad252a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/713293ceb9c44e8ea1a5d92668ad252a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-VolumesSnapshotsTestJSON-21813657 May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 713293ceb9c44e8ea1a5d92668ad252a May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-21813657 May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-VolumesSnapshotsTestJSON-21813657-project May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 041cd29a8fca40d0aab7e18c3b5e0dd6 May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-VolumesSnapshotsTestJSON-21813657-project May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: exception: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '290d5498-182e-4bc7-bcec-0cf0a2ec578a'} May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. (HTTP 404) (Request-ID: req-ac152bb5-7263-4817-88dd-1e2e55981496) May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 21:13:53.793091 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-955d6882-8197-4ece-b4b4-198063e8f2d3 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Returning 404 to user: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-955d6882-8197-4ece-b4b4-198063e8f2d3 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a" status: 404 len: 109 microversion: 2.1 time: 0.065007 May 28 21:13:53.802946 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1482/3004] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 21:13:53 2022] DELETE /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:13:53.806938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6c49c686-6bea-4d1a-8674-47eed9435d79 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:53.807294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6c49c686-6bea-4d1a-8674-47eed9435d79 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:53.815225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c49c686-6bea-4d1a-8674-47eed9435d79 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:53.815829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c49c686-6bea-4d1a-8674-47eed9435d79 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:53.816617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c49c686-6bea-4d1a-8674-47eed9435d79 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:53.818581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c49c686-6bea-4d1a-8674-47eed9435d79 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:53.918044 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b52fc8ad-9c98-49be-acc2-58caeeb15176 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 6.255124 May 28 21:13:53.919989 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1523/3005] 10.222.0.33 () {62 vars in 1188 bytes} [Sat May 28 21:13:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 6257 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 28 21:13:53.928092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2e500f2f-db01-486b-a055-414eb186c2d7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:53.929196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2e500f2f-db01-486b-a055-414eb186c2d7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:53.940876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e500f2f-db01-486b-a055-414eb186c2d7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:53.946151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e500f2f-db01-486b-a055-414eb186c2d7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:53.946151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e500f2f-db01-486b-a055-414eb186c2d7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:53.946151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e500f2f-db01-486b-a055-414eb186c2d7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:53.997528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6c49c686-6bea-4d1a-8674-47eed9435d79 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:54.007551 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6c49c686-6bea-4d1a-8674-47eed9435d79 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1314 microversion: 2.1 time: 0.209546 May 28 21:13:54.011926 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1483/3006] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:53 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:54.018712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-33d80ceb-e5e3-4a07-8462-a4531269e2b4 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d5746a3a0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:54.098013 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-33d80ceb-e5e3-4a07-8462-a4531269e2b4 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 200 len: 1428 microversion: 2.1 time: 0.084284 May 28 21:13:54.098851 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1484/3007] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:54 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 1428 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:54.103679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-903c4997-26aa-43a8-bd5c-93f1dff17b2c req-687a23d4-4408-4958-ae83-602f5312a189 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d4c0a5-6961-49e0-8863-846ca05d0723", "tag": "b924fa8a-bfb6-498c-af2f-c5e8038266e0"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:54.126195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-903c4997-26aa-43a8-bd5c-93f1dff17b2c req-687a23d4-4408-4958-ae83-602f5312a189 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:54.127434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-903c4997-26aa-43a8-bd5c-93f1dff17b2c req-687a23d4-4408-4958-ae83-602f5312a189 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:54.141692 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-903c4997-26aa-43a8-bd5c-93f1dff17b2c req-687a23d4-4408-4958-ae83-602f5312a189 service nova] Creating event network-changed:b924fa8a-bfb6-498c-af2f-c5e8038266e0 for instance 60d4c0a5-6961-49e0-8863-846ca05d0723 on nch2-master-1 May 28 21:13:54.149370 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-903c4997-26aa-43a8-bd5c-93f1dff17b2c req-687a23d4-4408-4958-ae83-602f5312a189 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049261 May 28 21:13:54.150555 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1485/3008] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:54.157536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-349019a1-eaab-458f-8dfc-855fa19fce1e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.132"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:54.163393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2e500f2f-db01-486b-a055-414eb186c2d7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:54.171648 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2e500f2f-db01-486b-a055-414eb186c2d7 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1515 microversion: 2.1 time: 0.250352 May 28 21:13:54.182589 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1524/3009] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:53 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:54.187726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2d29d453-3e56-4e98-930d-999125e3d5a1 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Calling method '.version_select at 0x7f4d648078b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:54.248058 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-2d29d453-3e56-4e98-930d-999125e3d5a1 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] HTTP exception thrown: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2d29d453-3e56-4e98-930d-999125e3d5a1 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Request method failure captured: May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a HTTP/1.1 May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpB56b_60xm1cQXskrsu3kzUL-5VL3y4EMNqhjAQhcI2x_ZK6OcsTMsnhvH0gk1vvbmRGkExGR-YQSJ21vky8i4u095KAVYwIyb0-g6C-Padddfm6fRrlgfPi9kSnzI4w4Lo7rbqzHV4PJj9923_XcBlQQQplXIbYRW60-PpL2daOns May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 713293ceb9c44e8ea1a5d92668ad252a May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-21813657 May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_713293ceb9c44e8ea1a5d92668ad252a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/713293ceb9c44e8ea1a5d92668ad252a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/713293ceb9c44e8ea1a5d92668ad252a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/713293ceb9c44e8ea1a5d92668ad252a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-VolumesSnapshotsTestJSON-21813657 May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 713293ceb9c44e8ea1a5d92668ad252a May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-21813657 May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-VolumesSnapshotsTestJSON-21813657-project May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 041cd29a8fca40d0aab7e18c3b5e0dd6 May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-VolumesSnapshotsTestJSON-21813657-project May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: exception: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '290d5498-182e-4bc7-bcec-0cf0a2ec578a'} May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. (HTTP 404) (Request-ID: req-4da9469a-a623-4e4f-ace3-05bade8166e2) May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 21:13:54.250290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2d29d453-3e56-4e98-930d-999125e3d5a1 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] Returning 404 to user: Volume 290d5498-182e-4bc7-bcec-0cf0a2ec578a could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2d29d453-3e56-4e98-930d-999125e3d5a1 tempest-VolumesSnapshotsTestJSON-21813657 tempest-VolumesSnapshotsTestJSON-21813657-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a" status: 404 len: 109 microversion: 2.1 time: 0.068221 May 28 21:13:54.258829 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1525/3010] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:13:54 2022] GET /compute/v2.1/os-volumes/290d5498-182e-4bc7-bcec-0cf0a2ec578a => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:13:54.262332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0d54890b-aa40-4cda-bc1e-1e239510078f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:54.263284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0d54890b-aa40-4cda-bc1e-1e239510078f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:54.457159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0d54890b-aa40-4cda-bc1e-1e239510078f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:54.467066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0d54890b-aa40-4cda-bc1e-1e239510078f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:54.469059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-349019a1-eaab-458f-8dfc-855fa19fce1e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:54.478471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0d54890b-aa40-4cda-bc1e-1e239510078f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:54.479684 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0d54890b-aa40-4cda-bc1e-1e239510078f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1286 microversion: 2.42 time: 0.226265 May 28 21:13:54.480269 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1526/3011] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:54 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1286 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:54.482592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-349019a1-eaab-458f-8dfc-855fa19fce1e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:54.483058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-349019a1-eaab-458f-8dfc-855fa19fce1e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:54.483880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-349019a1-eaab-458f-8dfc-855fa19fce1e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:54.484324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-349019a1-eaab-458f-8dfc-855fa19fce1e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:54.502633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-90b66933-318c-4a35-a79b-efea28f29992 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d6422c550>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:54.550484 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-90b66933-318c-4a35-a79b-efea28f29992 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 200 len: 1428 microversion: 2.1 time: 0.060673 May 28 21:13:54.551091 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1527/3012] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:54 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 1428 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:54.563480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aeb8f6ba-3f29-44a3-92ed-199f9731bc0c tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:54.564113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aeb8f6ba-3f29-44a3-92ed-199f9731bc0c tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:54.570367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aeb8f6ba-3f29-44a3-92ed-199f9731bc0c tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:54.571363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aeb8f6ba-3f29-44a3-92ed-199f9731bc0c tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:54.576612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aeb8f6ba-3f29-44a3-92ed-199f9731bc0c tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:54.576612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aeb8f6ba-3f29-44a3-92ed-199f9731bc0c tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:54.792814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-349019a1-eaab-458f-8dfc-855fa19fce1e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Acquired lock "refresh_cache-60d4c0a5-6961-49e0-8863-846ca05d0723" {{(pid=143128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 28 21:13:54.884161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aeb8f6ba-3f29-44a3-92ed-199f9731bc0c tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:54.893373 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aeb8f6ba-3f29-44a3-92ed-199f9731bc0c tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1465 microversion: 2.1 time: 0.333461 May 28 21:13:54.894005 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1528/3013] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:54 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1465 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:54.910373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-075276fc-243a-454b-88a1-5c27c3cb0ae2 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d6422c670>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:54.957116 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-075276fc-243a-454b-88a1-5c27c3cb0ae2 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/9586d0d3-c540-4636-bb36-06bb4b16c195" status: 200 len: 784 microversion: 2.1 time: 0.050500 May 28 21:13:54.958167 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1529/3014] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:54 2022] GET /compute/v2.1/images/9586d0d3-c540-4636-bb36-06bb4b16c195 => generated 784 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:54.971720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d3cdf9e0-fd10-46bb-9330-acdcd3df676b tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:54.982870 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d3cdf9e0-fd10-46bb-9330-acdcd3df676b tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017001 May 28 21:13:54.996999 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1530/3015] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:13:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:55.018728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-99a5cc4f-9055-4df0-8cd9-fc8887d59dab tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d57efe8b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:55.764064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-349019a1-eaab-458f-8dfc-855fa19fce1e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Building network info cache for instance {{(pid=143128) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1973}} May 28 21:13:56.302234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-349019a1-eaab-458f-8dfc-855fa19fce1e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Updating instance_info_cache with network_info: [{"id": "b924fa8a-bfb6-498c-af2f-c5e8038266e0", "address": "fa:16:3e:58:2f:c7", "network": {"id": "44029916-1fdb-4ad5-9c01-eb6eab801765", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-611153693-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d26d403e254e4caa887f8155d74c84c4", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb924fa8a-bf", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=143128) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 21:13:56.337434 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-99a5cc4f-9055-4df0-8cd9-fc8887d59dab tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "DELETE /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 204 len: 0 microversion: 2.1 time: 1.339042 May 28 21:13:56.338166 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1531/3016] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:54 2022] DELETE /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 0 bytes in 1341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:13:56.348013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d5a9263f-7157-4f97-b09c-ba5eaac1c1d1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:56.348647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d5a9263f-7157-4f97-b09c-ba5eaac1c1d1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:56.356571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5a9263f-7157-4f97-b09c-ba5eaac1c1d1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:56.357069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5a9263f-7157-4f97-b09c-ba5eaac1c1d1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:56.357876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5a9263f-7157-4f97-b09c-ba5eaac1c1d1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:56.358502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5a9263f-7157-4f97-b09c-ba5eaac1c1d1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:56.390068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-349019a1-eaab-458f-8dfc-855fa19fce1e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Releasing lock "refresh_cache-60d4c0a5-6961-49e0-8863-846ca05d0723" {{(pid=143128) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 28 21:13:56.400845 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-349019a1-eaab-458f-8dfc-855fa19fce1e tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "POST /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723/action" status: 202 len: 0 microversion: 2.1 time: 2.245801 May 28 21:13:56.402613 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1486/3017] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:13:54 2022] POST /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723/action => generated 0 bytes in 2251 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) May 28 21:13:56.423111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-401d3da4-1c40-4f9b-a1b7-ea49ba7b4037 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:56.424644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-401d3da4-1c40-4f9b-a1b7-ea49ba7b4037 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:56.453395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-401d3da4-1c40-4f9b-a1b7-ea49ba7b4037 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:56.454052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-401d3da4-1c40-4f9b-a1b7-ea49ba7b4037 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:56.454956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-401d3da4-1c40-4f9b-a1b7-ea49ba7b4037 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:56.455514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-401d3da4-1c40-4f9b-a1b7-ea49ba7b4037 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:56.613547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d5a9263f-7157-4f97-b09c-ba5eaac1c1d1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:56.625638 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d5a9263f-7157-4f97-b09c-ba5eaac1c1d1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1502 microversion: 2.1 time: 0.284207 May 28 21:13:56.625638 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1532/3018] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:56 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1502 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:56.631044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a3e5cf93-7f53-4f69-8e46-379b953882b5 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:56.631788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a3e5cf93-7f53-4f69-8e46-379b953882b5 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:56.644184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3e5cf93-7f53-4f69-8e46-379b953882b5 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:56.644184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3e5cf93-7f53-4f69-8e46-379b953882b5 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:56.644184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3e5cf93-7f53-4f69-8e46-379b953882b5 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:56.644184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a3e5cf93-7f53-4f69-8e46-379b953882b5 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:56.655102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-401d3da4-1c40-4f9b-a1b7-ea49ba7b4037 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:56.664004 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-401d3da4-1c40-4f9b-a1b7-ea49ba7b4037 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1521 microversion: 2.1 time: 0.260224 May 28 21:13:56.666075 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1487/3019] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:56 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:56.671845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-042db575-711e-456c-99bd-11ce65db5d9a req-4e69dfb5-dcd2-4c2d-aec6-d643fe31dce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d4c0a5-6961-49e0-8863-846ca05d0723", "tag": "b924fa8a-bfb6-498c-af2f-c5e8038266e0"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:56.683660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-042db575-711e-456c-99bd-11ce65db5d9a req-4e69dfb5-dcd2-4c2d-aec6-d643fe31dce3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:56.684494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-042db575-711e-456c-99bd-11ce65db5d9a req-4e69dfb5-dcd2-4c2d-aec6-d643fe31dce3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:56.703301 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-042db575-711e-456c-99bd-11ce65db5d9a req-4e69dfb5-dcd2-4c2d-aec6-d643fe31dce3 service nova] Creating event network-changed:b924fa8a-bfb6-498c-af2f-c5e8038266e0 for instance 60d4c0a5-6961-49e0-8863-846ca05d0723 on nch2-master-1 May 28 21:13:56.710311 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-042db575-711e-456c-99bd-11ce65db5d9a req-4e69dfb5-dcd2-4c2d-aec6-d643fe31dce3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042115 May 28 21:13:56.712050 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1488/3020] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:56.717738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-91683c9c-6409-4454-b7ae-34f253839a20 req-413237b5-f9bf-41f6-bf31-1a8576613184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818f89de-48f1-43d3-9ee2-4ab0e3652353", "name": "network-vif-unplugged", "status": "completed", "tag": "59de6851-8323-4006-84f5-6c1b327b2c4f"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:56.728893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-91683c9c-6409-4454-b7ae-34f253839a20 req-413237b5-f9bf-41f6-bf31-1a8576613184 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:56.729693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-91683c9c-6409-4454-b7ae-34f253839a20 req-413237b5-f9bf-41f6-bf31-1a8576613184 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:56.739885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a3e5cf93-7f53-4f69-8e46-379b953882b5 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:56.746335 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-91683c9c-6409-4454-b7ae-34f253839a20 req-413237b5-f9bf-41f6-bf31-1a8576613184 service nova] Creating event network-vif-unplugged:59de6851-8323-4006-84f5-6c1b327b2c4f for instance 818f89de-48f1-43d3-9ee2-4ab0e3652353 on nch2-master-1 May 28 21:13:56.754553 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-91683c9c-6409-4454-b7ae-34f253839a20 req-413237b5-f9bf-41f6-bf31-1a8576613184 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040627 May 28 21:13:56.755319 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1489/3021] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:56.762030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a3e5cf93-7f53-4f69-8e46-379b953882b5 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:56.762825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-312b10e2-358d-4dc3-8d1e-9dedd439c379 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d574543a0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:56.763694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a3e5cf93-7f53-4f69-8e46-379b953882b5 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:56.764947 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a3e5cf93-7f53-4f69-8e46-379b953882b5 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1576 microversion: 2.42 time: 0.138313 May 28 21:13:56.770960 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1533/3022] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:56 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1576 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:56.781130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7d2b1ec-9ea9-45b6-a46c-3a0d8d0d8f31 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '.version_select at 0x7f4d5746aca0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:56.788799 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-312b10e2-358d-4dc3-8d1e-9dedd439c379 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] HTTP exception thrown: Image not found. May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-312b10e2-358d-4dc3-8d1e-9dedd439c379 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Request method failure captured: May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e HTTP/1.1 May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpBmeXh7FBh0v9mLFu77Yx2_HGDe2y2j7_sHZMOyYfpTVRioMx0ACSZvMmQzSXmgBM0grBmBcio4X9DWjXXZUN_AE-t39yRSLLq9YBdP-32ltEM9RUijhpxh0ZqFtk6GDhfQtitzgihnIoKOqCluUNSxCCYUxiv2lS9-uMe-Nn50aeo May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 149d4937782d47f1b75fcdcfb4a89707 May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ImagesOneServerTestJSON-81255134 May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_149d4937782d47f1b75fcdcfb4a89707", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/149d4937782d47f1b75fcdcfb4a89707"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/149d4937782d47f1b75fcdcfb4a89707"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/149d4937782d47f1b75fcdcfb4a89707"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ImagesOneServerTestJSON-81255134 May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 149d4937782d47f1b75fcdcfb4a89707 May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-81255134 May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ImagesOneServerTestJSON-81255134-project May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: cf4bbfcd9bf64e3eabac163461e98f66 May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ImagesOneServerTestJSON-81255134-project May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: exception: Image not found. May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '730ff2a9-6504-4e86-9be2-23a94111e39e'} May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 730ff2a9-6504-4e86-9be2-23a94111e39e May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception May 28 21:13:56.791653 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._get(image_id) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 730ff2a9-6504-4e86-9be2-23a94111e39e could not be found. May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-312b10e2-358d-4dc3-8d1e-9dedd439c379 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Returning 404 to user: Image not found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:13:56.796668 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-312b10e2-358d-4dc3-8d1e-9dedd439c379 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 404 len: 62 microversion: 2.1 time: 0.036553 May 28 21:13:56.805404 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1490/3023] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:56 2022] GET /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:13:56.814359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a3221009-6a69-4061-b0c9-467d2429cf46 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:56.830411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a3221009-6a69-4061-b0c9-467d2429cf46 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:56.831543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a3221009-6a69-4061-b0c9-467d2429cf46 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:56.922562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a3221009-6a69-4061-b0c9-467d2429cf46 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Going to try to stop instance {{(pid=143128) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 21:13:57.172440 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a3221009-6a69-4061-b0c9-467d2429cf46 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "POST /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577/action" status: 202 len: 0 microversion: 2.1 time: 0.368193 May 28 21:13:57.173729 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1491/3024] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:13:56 2022] POST /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:13:57.197167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8664b638-fb29-4d47-8a19-a64c7d31f805 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-944185765"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:57.199379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8664b638-fb29-4d47-8a19-a64c7d31f805 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:57.210301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8664b638-fb29-4d47-8a19-a64c7d31f805 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:57.211310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8664b638-fb29-4d47-8a19-a64c7d31f805 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:57.212350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8664b638-fb29-4d47-8a19-a64c7d31f805 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:57.213050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8664b638-fb29-4d47-8a19-a64c7d31f805 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:57.861663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:58.007057 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8664b638-fb29-4d47-8a19-a64c7d31f805 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "POST /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353/action" status: 202 len: 0 microversion: 2.1 time: 0.831491 May 28 21:13:58.021400 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1492/3025] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:13:57 2022] POST /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353/action => generated 0 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 21:13:58.040662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4c00ee65-ff8c-4802-ae74-0bbef8aad8c6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:58.043232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4c00ee65-ff8c-4802-ae74-0bbef8aad8c6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:58.059099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c00ee65-ff8c-4802-ae74-0bbef8aad8c6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:58.059570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c00ee65-ff8c-4802-ae74-0bbef8aad8c6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:58.060378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c00ee65-ff8c-4802-ae74-0bbef8aad8c6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:58.060830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c00ee65-ff8c-4802-ae74-0bbef8aad8c6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:58.356341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4c00ee65-ff8c-4802-ae74-0bbef8aad8c6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:58.366286 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4c00ee65-ff8c-4802-ae74-0bbef8aad8c6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.343053 May 28 21:13:58.368647 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1493/3026] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:58 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:58.373618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ed3ba6b3-cd07-44ff-8023-0319536dd810 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:58.376826 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ed3ba6b3-cd07-44ff-8023-0319536dd810 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:58.400090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed3ba6b3-cd07-44ff-8023-0319536dd810 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:58.401285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed3ba6b3-cd07-44ff-8023-0319536dd810 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:58.402456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed3ba6b3-cd07-44ff-8023-0319536dd810 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:58.403062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed3ba6b3-cd07-44ff-8023-0319536dd810 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:58.524400 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d7d2b1ec-9ea9-45b6-a46c-3a0d8d0d8f31 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "DELETE /compute/v2.1/os-floating-ips/0b099375-5404-4c3a-b282-73d9db638b9b" status: 202 len: 0 microversion: 2.1 time: 1.752288 May 28 21:13:58.525730 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1534/3027] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:13:56 2022] DELETE /compute/v2.1/os-floating-ips/0b099375-5404-4c3a-b282-73d9db638b9b => generated 0 bytes in 1754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:13:58.537404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-95b44cd1-55f3-463c-b784-86391c9a70d8 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:58.538084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-95b44cd1-55f3-463c-b784-86391c9a70d8 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:58.559862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95b44cd1-55f3-463c-b784-86391c9a70d8 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:58.562196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95b44cd1-55f3-463c-b784-86391c9a70d8 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:58.571003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95b44cd1-55f3-463c-b784-86391c9a70d8 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:58.572002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95b44cd1-55f3-463c-b784-86391c9a70d8 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:58.627821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ed3ba6b3-cd07-44ff-8023-0319536dd810 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:58.638960 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ed3ba6b3-cd07-44ff-8023-0319536dd810 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1521 microversion: 2.1 time: 0.269068 May 28 21:13:58.639888 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1494/3028] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:58 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:58.644629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-536177f7-be87-457f-ba26-05cbc350a0c2 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d575e91f0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:58.708487 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-536177f7-be87-457f-ba26-05cbc350a0c2 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.067343 May 28 21:13:58.720099 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1495/3029] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:58 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:58.735686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bced14af-4cd1-4334-b897-944277558da9 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '.version_select at 0x7f4d57454a60>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:58.896273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-95b44cd1-55f3-463c-b784-86391c9a70d8 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:58.917786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-95b44cd1-55f3-463c-b784-86391c9a70d8 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:58.920042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-95b44cd1-55f3-463c-b784-86391c9a70d8 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:58.921501 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-95b44cd1-55f3-463c-b784-86391c9a70d8 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1661 microversion: 2.42 time: 0.394634 May 28 21:13:58.934411 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1535/3030] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:58 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1661 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:13:58.941260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-80110027-28ee-4b9f-b888-3a1d8f49a3cb req-b0eea365-56e3-43fe-9f3c-255b09422e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410adadb-b6ed-4904-83ec-dc9be8451944", "name": "network-vif-unplugged", "status": "completed", "tag": "bfefcc6d-5c5d-48a7-9a00-d4ab1bef767e"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:13:58.952511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-80110027-28ee-4b9f-b888-3a1d8f49a3cb req-b0eea365-56e3-43fe-9f3c-255b09422e67 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:58.953233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-80110027-28ee-4b9f-b888-3a1d8f49a3cb req-b0eea365-56e3-43fe-9f3c-255b09422e67 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:58.972529 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-80110027-28ee-4b9f-b888-3a1d8f49a3cb req-b0eea365-56e3-43fe-9f3c-255b09422e67 service nova] Creating event network-vif-unplugged:bfefcc6d-5c5d-48a7-9a00-d4ab1bef767e for instance 410adadb-b6ed-4904-83ec-dc9be8451944 on nch1-master-1 May 28 21:13:58.983506 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-80110027-28ee-4b9f-b888-3a1d8f49a3cb req-b0eea365-56e3-43fe-9f3c-255b09422e67 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046385 May 28 21:13:58.984494 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1536/3031] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:13:59.229272 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bced14af-4cd1-4334-b897-944277558da9 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/b034a9ee-141a-4307-ae5d-5114287cc286" status: 202 len: 0 microversion: 2.1 time: 0.507936 May 28 21:13:59.230072 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1496/3032] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:13:58 2022] DELETE /compute/v2.1/os-security-groups/b034a9ee-141a-4307-ae5d-5114287cc286 => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:13:59.243876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-88ccdf43-98f3-4089-ac90-2296ea145685 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:59.244761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-88ccdf43-98f3-4089-ac90-2296ea145685 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:59.261701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88ccdf43-98f3-4089-ac90-2296ea145685 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:59.263052 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88ccdf43-98f3-4089-ac90-2296ea145685 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:59.263846 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88ccdf43-98f3-4089-ac90-2296ea145685 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:59.264394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88ccdf43-98f3-4089-ac90-2296ea145685 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:59.300827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:13:59.307112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-88ccdf43-98f3-4089-ac90-2296ea145685 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:13:59.385262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7217e4c9-1a9f-4045-9c48-a40e2393726d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:59.386257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7217e4c9-1a9f-4045-9c48-a40e2393726d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:59.399014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7217e4c9-1a9f-4045-9c48-a40e2393726d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:59.399722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7217e4c9-1a9f-4045-9c48-a40e2393726d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:59.400519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7217e4c9-1a9f-4045-9c48-a40e2393726d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:59.400975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7217e4c9-1a9f-4045-9c48-a40e2393726d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:59.552704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7217e4c9-1a9f-4045-9c48-a40e2393726d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:59.560538 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7217e4c9-1a9f-4045-9c48-a40e2393726d tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.180401 May 28 21:13:59.561122 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1497/3033] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:59 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:59.656888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b44425f4-7a1b-4919-990b-397f85f64371 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:59.657653 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b44425f4-7a1b-4919-990b-397f85f64371 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:59.664975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b44425f4-7a1b-4919-990b-397f85f64371 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:59.666634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b44425f4-7a1b-4919-990b-397f85f64371 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:59.666634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b44425f4-7a1b-4919-990b-397f85f64371 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:59.667070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b44425f4-7a1b-4919-990b-397f85f64371 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:59.679425 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-88ccdf43-98f3-4089-ac90-2296ea145685 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "DELETE /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 204 len: 0 microversion: 2.1 time: 0.442270 May 28 21:13:59.683712 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1537/3034] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:13:59 2022] DELETE /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:13:59.690482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5454ab03-8c12-438c-90d9-708aa1e4748c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:59.691205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5454ab03-8c12-438c-90d9-708aa1e4748c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:59.697864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5454ab03-8c12-438c-90d9-708aa1e4748c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:59.698335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5454ab03-8c12-438c-90d9-708aa1e4748c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:59.699464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5454ab03-8c12-438c-90d9-708aa1e4748c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:59.700128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5454ab03-8c12-438c-90d9-708aa1e4748c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:59.862731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b44425f4-7a1b-4919-990b-397f85f64371 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:59.873861 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b44425f4-7a1b-4919-990b-397f85f64371 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1521 microversion: 2.1 time: 0.220842 May 28 21:13:59.885495 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1498/3035] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:59 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:13:59.885495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a97d9154-5f6d-4dae-af30-5145ce843514 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d575b53a0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:59.937474 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a97d9154-5f6d-4dae-af30-5145ce843514 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.062000 May 28 21:13:59.938383 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1499/3036] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:13:59 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:13:59.947074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4f0035ca-3a51-4c52-b80f-3cd4fbad9e9d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:13:59.948058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4f0035ca-3a51-4c52-b80f-3cd4fbad9e9d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:13:59.955709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5454ab03-8c12-438c-90d9-708aa1e4748c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:13:59.957723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f0035ca-3a51-4c52-b80f-3cd4fbad9e9d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:59.958220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f0035ca-3a51-4c52-b80f-3cd4fbad9e9d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:59.959191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f0035ca-3a51-4c52-b80f-3cd4fbad9e9d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:13:59.959640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f0035ca-3a51-4c52-b80f-3cd4fbad9e9d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:13:59.964914 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5454ab03-8c12-438c-90d9-708aa1e4748c tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1510 microversion: 2.1 time: 0.279356 May 28 21:13:59.975010 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1538/3037] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:13:59 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1510 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:00.137037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4f0035ca-3a51-4c52-b80f-3cd4fbad9e9d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:00.148587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4f0035ca-3a51-4c52-b80f-3cd4fbad9e9d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:00.151153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4f0035ca-3a51-4c52-b80f-3cd4fbad9e9d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:00.152727 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4f0035ca-3a51-4c52-b80f-3cd4fbad9e9d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1707 microversion: 2.42 time: 0.213066 May 28 21:14:00.153480 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1500/3038] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:13:59 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1707 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:00.579147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-02f42a77-897f-445d-bfad-d7f7a48ef6c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:00.580184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-02f42a77-897f-445d-bfad-d7f7a48ef6c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:00.589090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02f42a77-897f-445d-bfad-d7f7a48ef6c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:00.589920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02f42a77-897f-445d-bfad-d7f7a48ef6c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:00.591921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02f42a77-897f-445d-bfad-d7f7a48ef6c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:00.592528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02f42a77-897f-445d-bfad-d7f7a48ef6c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:00.765762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-02f42a77-897f-445d-bfad-d7f7a48ef6c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:00.779602 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-02f42a77-897f-445d-bfad-d7f7a48ef6c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.205263 May 28 21:14:00.780538 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1539/3039] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:00 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:00.893987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d16badd5-8700-429b-82bd-e9894c9d4f0f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:00.895433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d16badd5-8700-429b-82bd-e9894c9d4f0f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:00.903683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d16badd5-8700-429b-82bd-e9894c9d4f0f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:00.904378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d16badd5-8700-429b-82bd-e9894c9d4f0f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:00.905159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d16badd5-8700-429b-82bd-e9894c9d4f0f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:00.905597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d16badd5-8700-429b-82bd-e9894c9d4f0f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:00.955573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-60a88f42-7b85-488a-b9fa-116013b32f66 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d6422c0d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:01.019575 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-60a88f42-7b85-488a-b9fa-116013b32f66 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.067937 May 28 21:14:01.025621 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1540/3040] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:00 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:01.032828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9a6cc3ce-4de2-407f-b8f3-caa759ba9379 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:01.040545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9a6cc3ce-4de2-407f-b8f3-caa759ba9379 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:01.045961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a6cc3ce-4de2-407f-b8f3-caa759ba9379 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:01.048856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a6cc3ce-4de2-407f-b8f3-caa759ba9379 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:01.049758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a6cc3ce-4de2-407f-b8f3-caa759ba9379 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:01.050405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9a6cc3ce-4de2-407f-b8f3-caa759ba9379 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:01.101095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d16badd5-8700-429b-82bd-e9894c9d4f0f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:01.114666 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d16badd5-8700-429b-82bd-e9894c9d4f0f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1521 microversion: 2.1 time: 0.226904 May 28 21:14:01.115262 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1501/3041] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:00 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:01.120501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-6b349efc-32e5-4a47-a8b2-f18da23f48d6 req-7d5a7495-3f44-4754-9124-195869e33ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410adadb-b6ed-4904-83ec-dc9be8451944", "name": "network-vif-plugged", "status": "completed", "tag": "bfefcc6d-5c5d-48a7-9a00-d4ab1bef767e"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:01.144506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6b349efc-32e5-4a47-a8b2-f18da23f48d6 req-7d5a7495-3f44-4754-9124-195869e33ee5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:01.144973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6b349efc-32e5-4a47-a8b2-f18da23f48d6 req-7d5a7495-3f44-4754-9124-195869e33ee5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:01.161376 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-6b349efc-32e5-4a47-a8b2-f18da23f48d6 req-7d5a7495-3f44-4754-9124-195869e33ee5 service nova] Creating event network-vif-plugged:bfefcc6d-5c5d-48a7-9a00-d4ab1bef767e for instance 410adadb-b6ed-4904-83ec-dc9be8451944 on nch1-master-1 May 28 21:14:01.172213 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-6b349efc-32e5-4a47-a8b2-f18da23f48d6 req-7d5a7495-3f44-4754-9124-195869e33ee5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055227 May 28 21:14:01.175066 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1502/3042] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:01.186397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4974447d-807a-4f1b-9b62-dc68c25d564c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:01.187197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4974447d-807a-4f1b-9b62-dc68c25d564c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:01.201586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4974447d-807a-4f1b-9b62-dc68c25d564c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:01.209470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4974447d-807a-4f1b-9b62-dc68c25d564c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:01.209470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4974447d-807a-4f1b-9b62-dc68c25d564c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:01.209470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4974447d-807a-4f1b-9b62-dc68c25d564c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:01.291725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9a6cc3ce-4de2-407f-b8f3-caa759ba9379 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:01.301053 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9a6cc3ce-4de2-407f-b8f3-caa759ba9379 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1510 microversion: 2.1 time: 0.277564 May 28 21:14:01.305870 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1541/3043] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:01 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:01.436514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4974447d-807a-4f1b-9b62-dc68c25d564c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:01.446885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4974447d-807a-4f1b-9b62-dc68c25d564c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:01.448533 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4974447d-807a-4f1b-9b62-dc68c25d564c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:01.449771 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4974447d-807a-4f1b-9b62-dc68c25d564c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1753 microversion: 2.42 time: 0.273232 May 28 21:14:01.450699 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1503/3044] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:01 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1753 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:01.798022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6f3691b1-1dcf-4960-af5d-d776898d2cab tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:01.798662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6f3691b1-1dcf-4960-af5d-d776898d2cab tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:01.810271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f3691b1-1dcf-4960-af5d-d776898d2cab tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:01.810271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f3691b1-1dcf-4960-af5d-d776898d2cab tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:01.810271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f3691b1-1dcf-4960-af5d-d776898d2cab tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:01.810271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f3691b1-1dcf-4960-af5d-d776898d2cab tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:01.996291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6f3691b1-1dcf-4960-af5d-d776898d2cab tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:02.005458 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6f3691b1-1dcf-4960-af5d-d776898d2cab tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.211737 May 28 21:14:02.007412 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1542/3045] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:01 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:02.033200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e302a20e-4d86-487b-91ab-053be04e6158 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d575b5430>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:02.086623 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e302a20e-4d86-487b-91ab-053be04e6158 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.056981 May 28 21:14:02.089138 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1504/3046] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:02 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:02.132964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8b04f945-1f7a-4290-9068-cf25212c1b3b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:02.134127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8b04f945-1f7a-4290-9068-cf25212c1b3b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:02.144819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b04f945-1f7a-4290-9068-cf25212c1b3b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:02.145526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b04f945-1f7a-4290-9068-cf25212c1b3b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:02.146703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b04f945-1f7a-4290-9068-cf25212c1b3b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:02.147358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b04f945-1f7a-4290-9068-cf25212c1b3b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:02.326435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-14ab5864-c862-474c-b399-800e07e60988 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:02.327837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-14ab5864-c862-474c-b399-800e07e60988 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:02.344980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14ab5864-c862-474c-b399-800e07e60988 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:02.349310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14ab5864-c862-474c-b399-800e07e60988 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:02.350309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14ab5864-c862-474c-b399-800e07e60988 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:02.350872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14ab5864-c862-474c-b399-800e07e60988 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:02.518887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8b04f945-1f7a-4290-9068-cf25212c1b3b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:02.531542 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8b04f945-1f7a-4290-9068-cf25212c1b3b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1521 microversion: 2.1 time: 0.402794 May 28 21:14:02.536355 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1543/3047] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:02 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:02.542474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ac2e124b-5987-4e99-899e-250c76f4a721 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:02.543324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ac2e124b-5987-4e99-899e-250c76f4a721 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:02.551676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac2e124b-5987-4e99-899e-250c76f4a721 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:02.552573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac2e124b-5987-4e99-899e-250c76f4a721 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:02.553728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac2e124b-5987-4e99-899e-250c76f4a721 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:02.554431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac2e124b-5987-4e99-899e-250c76f4a721 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:02.579390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:02.768379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-14ab5864-c862-474c-b399-800e07e60988 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:02.784325 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-14ab5864-c862-474c-b399-800e07e60988 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1510 microversion: 2.1 time: 0.464001 May 28 21:14:02.786874 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1505/3048] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:02 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1510 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:02.925605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ac2e124b-5987-4e99-899e-250c76f4a721 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:02.947344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ac2e124b-5987-4e99-899e-250c76f4a721 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:02.953991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ac2e124b-5987-4e99-899e-250c76f4a721 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:02.955538 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ac2e124b-5987-4e99-899e-250c76f4a721 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1799 microversion: 2.42 time: 0.419561 May 28 21:14:02.957785 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1544/3049] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:02 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1799 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:03.024843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-25b0625a-b2ff-4e17-8d28-c5c08a16b250 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:03.025796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-25b0625a-b2ff-4e17-8d28-c5c08a16b250 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:03.034137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25b0625a-b2ff-4e17-8d28-c5c08a16b250 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:03.038471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25b0625a-b2ff-4e17-8d28-c5c08a16b250 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:03.038471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25b0625a-b2ff-4e17-8d28-c5c08a16b250 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:03.038471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25b0625a-b2ff-4e17-8d28-c5c08a16b250 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:03.107361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2648daad-3fcc-4c2f-b002-33799a2276b0 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d57379b80>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:03.187212 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2648daad-3fcc-4c2f-b002-33799a2276b0 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.086724 May 28 21:14:03.194718 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1545/3050] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:03 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:03.237962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ff2d17f2-7343-4ec9-b17d-008e0aa68e6f req-c24b5422-2e96-4fd1-9608-2cb674cc0479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d4c0a5-6961-49e0-8863-846ca05d0723", "name": "network-vif-deleted", "tag": "b924fa8a-bfb6-498c-af2f-c5e8038266e0"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:03.249780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ff2d17f2-7343-4ec9-b17d-008e0aa68e6f req-c24b5422-2e96-4fd1-9608-2cb674cc0479 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:03.251167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ff2d17f2-7343-4ec9-b17d-008e0aa68e6f req-c24b5422-2e96-4fd1-9608-2cb674cc0479 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:03.269986 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ff2d17f2-7343-4ec9-b17d-008e0aa68e6f req-c24b5422-2e96-4fd1-9608-2cb674cc0479 service nova] Creating event network-vif-deleted:b924fa8a-bfb6-498c-af2f-c5e8038266e0 for instance 60d4c0a5-6961-49e0-8863-846ca05d0723 on nch2-master-1 May 28 21:14:03.278214 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ff2d17f2-7343-4ec9-b17d-008e0aa68e6f req-c24b5422-2e96-4fd1-9608-2cb674cc0479 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045166 May 28 21:14:03.280356 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1546/3051] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:03.313953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-25b0625a-b2ff-4e17-8d28-c5c08a16b250 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:03.335252 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-25b0625a-b2ff-4e17-8d28-c5c08a16b250 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.315286 May 28 21:14:03.335978 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1506/3052] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:03 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:03.550844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a085b5ea-1d89-4cde-aba6-d08ec235c313 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:03.551677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a085b5ea-1d89-4cde-aba6-d08ec235c313 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:03.559347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a085b5ea-1d89-4cde-aba6-d08ec235c313 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:03.559814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a085b5ea-1d89-4cde-aba6-d08ec235c313 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:03.560641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a085b5ea-1d89-4cde-aba6-d08ec235c313 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:03.561279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a085b5ea-1d89-4cde-aba6-d08ec235c313 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:03.769319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a085b5ea-1d89-4cde-aba6-d08ec235c313 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:03.779096 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a085b5ea-1d89-4cde-aba6-d08ec235c313 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1506 microversion: 2.1 time: 0.233125 May 28 21:14:03.779903 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1547/3053] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:03 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:03.802336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-299dca2e-41df-4902-96ae-b5622cf17bce tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:03.802336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-299dca2e-41df-4902-96ae-b5622cf17bce tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:03.802602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b41ffbbc-2156-4f37-a58b-89e043ac7fb4 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:03.802910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b41ffbbc-2156-4f37-a58b-89e043ac7fb4 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:03.804919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-299dca2e-41df-4902-96ae-b5622cf17bce tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:03.805385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-299dca2e-41df-4902-96ae-b5622cf17bce tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:03.806774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-299dca2e-41df-4902-96ae-b5622cf17bce tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:03.807534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-299dca2e-41df-4902-96ae-b5622cf17bce tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:03.810857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b41ffbbc-2156-4f37-a58b-89e043ac7fb4 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:03.811831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b41ffbbc-2156-4f37-a58b-89e043ac7fb4 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:03.812794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b41ffbbc-2156-4f37-a58b-89e043ac7fb4 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:03.813397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b41ffbbc-2156-4f37-a58b-89e043ac7fb4 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:03.852554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b41ffbbc-2156-4f37-a58b-89e043ac7fb4 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:03.853094 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b41ffbbc-2156-4f37-a58b-89e043ac7fb4 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:03.853588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-b41ffbbc-2156-4f37-a58b-89e043ac7fb4 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lazy-loading 'fault' on Instance uuid 60d4c0a5-6961-49e0-8863-846ca05d0723 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:14:03.922785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b41ffbbc-2156-4f37-a58b-89e043ac7fb4 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ffb90cfa7828412f96f330dab49466cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd26d403e254e4caa887f8155d74c84c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:03.934136 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b41ffbbc-2156-4f37-a58b-89e043ac7fb4 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 200 len: 1313 microversion: 2.1 time: 0.136000 May 28 21:14:03.935871 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1548/3054] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:03 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 1313 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:03.979473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-de4f936d-13c3-4444-bbb2-42d3a3b321a1 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:03.979473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-de4f936d-13c3-4444-bbb2-42d3a3b321a1 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:04.005276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de4f936d-13c3-4444-bbb2-42d3a3b321a1 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:04.007513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de4f936d-13c3-4444-bbb2-42d3a3b321a1 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:04.011066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de4f936d-13c3-4444-bbb2-42d3a3b321a1 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:04.013678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de4f936d-13c3-4444-bbb2-42d3a3b321a1 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:04.033638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-299dca2e-41df-4902-96ae-b5622cf17bce tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:04.048120 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-299dca2e-41df-4902-96ae-b5622cf17bce tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 200 len: 1506 microversion: 2.1 time: 0.256058 May 28 21:14:04.049516 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1507/3055] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:03 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:04.074509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e1579058-2444-4bff-bfd8-61e604774873 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:04.075746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e1579058-2444-4bff-bfd8-61e604774873 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:04.107752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1579058-2444-4bff-bfd8-61e604774873 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:04.110164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1579058-2444-4bff-bfd8-61e604774873 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:04.111574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1579058-2444-4bff-bfd8-61e604774873 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:04.112270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1579058-2444-4bff-bfd8-61e604774873 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:04.178292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e1579058-2444-4bff-bfd8-61e604774873 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:14:04.272915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-de4f936d-13c3-4444-bbb2-42d3a3b321a1 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:04.286522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-de4f936d-13c3-4444-bbb2-42d3a3b321a1 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:04.289718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-de4f936d-13c3-4444-bbb2-42d3a3b321a1 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:04.291266 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-de4f936d-13c3-4444-bbb2-42d3a3b321a1 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1845 microversion: 2.42 time: 0.319515 May 28 21:14:04.292439 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1549/3056] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:03 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1845 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:04.298199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-896baca9-be37-4237-9eb6-b1de5739c082 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d57662790>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:04.363802 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-896baca9-be37-4237-9eb6-b1de5739c082 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.070178 May 28 21:14:04.365316 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1550/3057] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:04 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:04.389714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-4859bdd2-8282-4484-9eac-3bf4a600b84b req-384e3274-455c-47c7-948e-2d6ee9fcaccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818f89de-48f1-43d3-9ee2-4ab0e3652353", "name": "network-vif-plugged", "status": "completed", "tag": "59de6851-8323-4006-84f5-6c1b327b2c4f"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:04.404142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4859bdd2-8282-4484-9eac-3bf4a600b84b req-384e3274-455c-47c7-948e-2d6ee9fcaccd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:04.408173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4859bdd2-8282-4484-9eac-3bf4a600b84b req-384e3274-455c-47c7-948e-2d6ee9fcaccd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:04.438545 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-4859bdd2-8282-4484-9eac-3bf4a600b84b req-384e3274-455c-47c7-948e-2d6ee9fcaccd service nova] Creating event network-vif-plugged:59de6851-8323-4006-84f5-6c1b327b2c4f for instance 818f89de-48f1-43d3-9ee2-4ab0e3652353 on nch2-master-1 May 28 21:14:04.453280 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-4859bdd2-8282-4484-9eac-3bf4a600b84b req-384e3274-455c-47c7-948e-2d6ee9fcaccd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086398 May 28 21:14:04.454479 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1551/3058] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:04.468294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eca87cae-6e42-4667-92bf-8565137d27df tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:04.469418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eca87cae-6e42-4667-92bf-8565137d27df tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:04.471551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=8 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:04.472237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:04.486766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eca87cae-6e42-4667-92bf-8565137d27df tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:04.488905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eca87cae-6e42-4667-92bf-8565137d27df tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:04.492771 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eca87cae-6e42-4667-92bf-8565137d27df tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:04.494596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eca87cae-6e42-4667-92bf-8565137d27df tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:04.599646 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e1579058-2444-4bff-bfd8-61e604774873 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "DELETE /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 204 len: 0 microversion: 2.1 time: 0.537005 May 28 21:14:04.600263 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1508/3059] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:14:04 2022] DELETE /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:14:04.701222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eca87cae-6e42-4667-92bf-8565137d27df tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:04.711208 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eca87cae-6e42-4667-92bf-8565137d27df tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.255217 May 28 21:14:04.711813 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1552/3060] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:04 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:04.750364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1938531518", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "a1d7c67d-4437-4075-890e-fbb84a23f2b5"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:04.830285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] validate_networks() for [('a1d7c67d-4437-4075-890e-fbb84a23f2b5', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:14:04.954654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-65712ab0-e445-43f1-bfe4-8a259e6f42d9 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:04.956017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-65712ab0-e445-43f1-bfe4-8a259e6f42d9 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] [instance: 60d4c0a5-6961-49e0-8863-846ca05d0723] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:04.968645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65712ab0-e445-43f1-bfe4-8a259e6f42d9 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:04.969614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65712ab0-e445-43f1-bfe4-8a259e6f42d9 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:04.970632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65712ab0-e445-43f1-bfe4-8a259e6f42d9 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:04.971418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65712ab0-e445-43f1-bfe4-8a259e6f42d9 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:04.991511 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-65712ab0-e445-43f1-bfe4-8a259e6f42d9 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] HTTP exception thrown: Instance 60d4c0a5-6961-49e0-8863-846ca05d0723 could not be found. May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-65712ab0-e445-43f1-bfe4-8a259e6f42d9 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Request method failure captured: May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 HTTP/1.1 May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpBSgL7RU6Yu1MDOqFVFbhjPr5o7xV3OAMCq28FRPUdOsqlLdAPq2kcrGy_4lTr4RtvenuMxkvEgIDq_AAUe-1P4Bkjn7rvRaWSOVq33J2vew8tGgBtt0XwQD58FACEX4sLyCFh07Zig8YN2UmyX-Nryzk_oTUXB8w7C9ca-JTLTmyQ May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: d26d403e254e4caa887f8155d74c84c4 May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1907559116 May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d26d403e254e4caa887f8155d74c84c4", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d26d403e254e4caa887f8155d74c84c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d26d403e254e4caa887f8155d74c84c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d26d403e254e4caa887f8155d74c84c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1907559116 May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: d26d403e254e4caa887f8155d74c84c4 May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1907559116 May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerRescueTestJSONUnderV235-1907559116-project May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ffb90cfa7828412f96f330dab49466cd May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1907559116-project May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 60d4c0a5-6961-49e0-8863-846ca05d0723 could not be found. May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '60d4c0a5-6961-49e0-8863-846ca05d0723'} May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d4c0a5-6961-49e0-8863-846ca05d0723 could not be found. May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d4c0a5-6961-49e0-8863-846ca05d0723 could not be found. May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:04.994242 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:04.998712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:04.998712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:04.998712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:04.998712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:04.998712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:04.998712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:04.998712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d4c0a5-6961-49e0-8863-846ca05d0723 could not be found. May 28 21:14:04.998712 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:05.000512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-65712ab0-e445-43f1-bfe4-8a259e6f42d9 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] Returning 404 to user: Instance 60d4c0a5-6961-49e0-8863-846ca05d0723 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:05.001687 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-65712ab0-e445-43f1-bfe4-8a259e6f42d9 tempest-ServerRescueTestJSONUnderV235-1907559116 tempest-ServerRescueTestJSONUnderV235-1907559116-project] 10.222.0.33 "GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723" status: 404 len: 111 microversion: 2.1 time: 0.052311 May 28 21:14:05.002835 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1553/3061] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:04 2022] GET /compute/v2.1/servers/60d4c0a5-6961-49e0-8863-846ca05d0723 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:05.173380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-a10aa6db-6c63-4a86-92ae-26df8141e313 req-011c3587-9597-41ae-bcff-5cda2bdaf50a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "tag": "a093c2f2-1530-48bb-9240-39d12badf81f"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:05.184880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a10aa6db-6c63-4a86-92ae-26df8141e313 req-011c3587-9597-41ae-bcff-5cda2bdaf50a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:05.185392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a10aa6db-6c63-4a86-92ae-26df8141e313 req-011c3587-9597-41ae-bcff-5cda2bdaf50a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:05.226760 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a10aa6db-6c63-4a86-92ae-26df8141e313 req-011c3587-9597-41ae-bcff-5cda2bdaf50a service nova] Creating event network-changed:a093c2f2-1530-48bb-9240-39d12badf81f for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:14:05.231074 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-a10aa6db-6c63-4a86-92ae-26df8141e313 req-011c3587-9597-41ae-bcff-5cda2bdaf50a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062124 May 28 21:14:05.232390 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1554/3062] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:14:05.312399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e4374f0d-691a-401d-baff-41ddfa7b1594 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:05.313125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e4374f0d-691a-401d-baff-41ddfa7b1594 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:05.325089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e4374f0d-691a-401d-baff-41ddfa7b1594 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:05.326187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e4374f0d-691a-401d-baff-41ddfa7b1594 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:05.327464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e4374f0d-691a-401d-baff-41ddfa7b1594 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:05.328187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e4374f0d-691a-401d-baff-41ddfa7b1594 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:05.665456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e4374f0d-691a-401d-baff-41ddfa7b1594 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:05.669698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:14:05.669698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:14:05.669698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:14:05.669698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:14:05.669698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:14:05.680248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:05.680839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:05.681878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:05.682453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:05.683604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e4374f0d-691a-401d-baff-41ddfa7b1594 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:05.688861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e4374f0d-691a-401d-baff-41ddfa7b1594 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:05.694050 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e4374f0d-691a-401d-baff-41ddfa7b1594 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1833 microversion: 2.42 time: 0.385723 May 28 21:14:05.698570 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1555/3063] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:05 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1833 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:14:05.716133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0023e23b-fd76-44d6-9378-849fd38e4ecf tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d57760040>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:05.769212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Getting quotas for project 53ecc00f85b54d01aa7dbe2f0386dac6. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:14:05.806913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Getting quotas for user 25b2f1524f7f48149cbc5d2c694a9e2b and project 53ecc00f85b54d01aa7dbe2f0386dac6. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:14:05.863892 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0023e23b-fd76-44d6-9378-849fd38e4ecf tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.163898 May 28 21:14:05.864915 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1556/3064] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:05 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:05.867471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:14:05.873784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:14:05.877126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eefaca46-c63b-45fb-88a2-b660303e2502 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:05.879570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eefaca46-c63b-45fb-88a2-b660303e2502 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:05.895040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eefaca46-c63b-45fb-88a2-b660303e2502 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:05.895561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eefaca46-c63b-45fb-88a2-b660303e2502 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:05.896553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eefaca46-c63b-45fb-88a2-b660303e2502 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:05.897085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eefaca46-c63b-45fb-88a2-b660303e2502 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:05.989299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:06.111914 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e0cbf478-8063-4d4d-9d94-b3a372d11363 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.367373 May 28 21:14:06.112339 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1509/3065] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:14:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1369 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:14:06.127653 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-13c5803f-b67e-4b7f-9fb4-bf64ada14104 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:06.128874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-13c5803f-b67e-4b7f-9fb4-bf64ada14104 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:06.308587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-13c5803f-b67e-4b7f-9fb4-bf64ada14104 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:06.321494 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-13c5803f-b67e-4b7f-9fb4-bf64ada14104 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1218 microversion: 2.1 time: 0.197721 May 28 21:14:06.334230 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1510/3066] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:06 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1218 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:06.639523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eefaca46-c63b-45fb-88a2-b660303e2502 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:06.654229 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eefaca46-c63b-45fb-88a2-b660303e2502 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.787991 May 28 21:14:06.658518 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1557/3067] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:05 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:06.720080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fca3730c-53d2-45b5-9a3a-0faa7905be15 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:06.722429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fca3730c-53d2-45b5-9a3a-0faa7905be15 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:06.753535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fca3730c-53d2-45b5-9a3a-0faa7905be15 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:06.755458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fca3730c-53d2-45b5-9a3a-0faa7905be15 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:06.757542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fca3730c-53d2-45b5-9a3a-0faa7905be15 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:06.759283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fca3730c-53d2-45b5-9a3a-0faa7905be15 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:06.878302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d97eb9f2-5191-455d-a23d-21d94c006fbe tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d648070d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:06.947708 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d97eb9f2-5191-455d-a23d-21d94c006fbe tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.073998 May 28 21:14:06.949649 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1558/3068] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:06 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:07.181446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-b049449a-acf3-4654-acd5-073639d444be req-729f5aa5-bbaf-4f51-b9a3-5b36889c54d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410adadb-b6ed-4904-83ec-dc9be8451944", "name": "network-vif-deleted", "tag": "bfefcc6d-5c5d-48a7-9a00-d4ab1bef767e"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:07.203584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fca3730c-53d2-45b5-9a3a-0faa7905be15 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:07.212373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b049449a-acf3-4654-acd5-073639d444be req-729f5aa5-bbaf-4f51-b9a3-5b36889c54d4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:07.215723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fca3730c-53d2-45b5-9a3a-0faa7905be15 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:07.215905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b049449a-acf3-4654-acd5-073639d444be req-729f5aa5-bbaf-4f51-b9a3-5b36889c54d4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:07.217691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fca3730c-53d2-45b5-9a3a-0faa7905be15 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:07.219165 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fca3730c-53d2-45b5-9a3a-0faa7905be15 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1833 microversion: 2.42 time: 0.504976 May 28 21:14:07.232558 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1511/3069] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:06 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1833 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:07.242004 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b049449a-acf3-4654-acd5-073639d444be req-729f5aa5-bbaf-4f51-b9a3-5b36889c54d4 service nova] Creating event network-vif-deleted:bfefcc6d-5c5d-48a7-9a00-d4ab1bef767e for instance 410adadb-b6ed-4904-83ec-dc9be8451944 on nch1-master-1 May 28 21:14:07.249521 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-b049449a-acf3-4654-acd5-073639d444be req-729f5aa5-bbaf-4f51-b9a3-5b36889c54d4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073209 May 28 21:14:07.250834 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1559/3070] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:14:07.343891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d9c5e55a-1dc5-4f6a-98a7-1c78869c79c5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:07.344554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d9c5e55a-1dc5-4f6a-98a7-1c78869c79c5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:07.556404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d9c5e55a-1dc5-4f6a-98a7-1c78869c79c5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:07.566638 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d9c5e55a-1dc5-4f6a-98a7-1c78869c79c5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1218 microversion: 2.1 time: 0.230575 May 28 21:14:07.568002 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1512/3071] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:07 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1218 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:07.675109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c200f37c-8750-4444-be8e-151c377e7c46 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:07.675894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c200f37c-8750-4444-be8e-151c377e7c46 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:07.688999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c200f37c-8750-4444-be8e-151c377e7c46 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:07.689467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c200f37c-8750-4444-be8e-151c377e7c46 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:07.695127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c200f37c-8750-4444-be8e-151c377e7c46 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:07.695949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c200f37c-8750-4444-be8e-151c377e7c46 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:07.739139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:07.933509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c200f37c-8750-4444-be8e-151c377e7c46 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:07.942292 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c200f37c-8750-4444-be8e-151c377e7c46 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.272510 May 28 21:14:07.943466 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1560/3072] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:07 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:07.967932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f35e9b5e-e679-4025-b1bc-a82d3e801a2b tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d575ebca0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:08.076472 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f35e9b5e-e679-4025-b1bc-a82d3e801a2b tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.112899 May 28 21:14:08.082920 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1513/3073] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:07 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:08.240390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2f898d18-f2d3-4193-a891-fe7ba4e01f36 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:08.241741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2f898d18-f2d3-4193-a891-fe7ba4e01f36 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:08.254234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f898d18-f2d3-4193-a891-fe7ba4e01f36 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:08.254234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f898d18-f2d3-4193-a891-fe7ba4e01f36 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:08.254234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f898d18-f2d3-4193-a891-fe7ba4e01f36 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:08.254846 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2f898d18-f2d3-4193-a891-fe7ba4e01f36 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:08.497203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2f898d18-f2d3-4193-a891-fe7ba4e01f36 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:08.517157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2f898d18-f2d3-4193-a891-fe7ba4e01f36 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:08.517326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-21737fb7-a3a3-4297-8db7-c8fe003537a5 req-58da044b-8e22-4612-9f95-9617f9225f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "tag": "cd216d91-0e66-48bd-ba1b-debee67cf784"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:08.519045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2f898d18-f2d3-4193-a891-fe7ba4e01f36 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:08.522362 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2f898d18-f2d3-4193-a891-fe7ba4e01f36 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1854 microversion: 2.42 time: 0.287688 May 28 21:14:08.523530 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1561/3074] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:08 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1854 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:08.550495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-21737fb7-a3a3-4297-8db7-c8fe003537a5 req-58da044b-8e22-4612-9f95-9617f9225f0e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:08.552570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-21737fb7-a3a3-4297-8db7-c8fe003537a5 req-58da044b-8e22-4612-9f95-9617f9225f0e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:08.565459 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-21737fb7-a3a3-4297-8db7-c8fe003537a5 req-58da044b-8e22-4612-9f95-9617f9225f0e service nova] Creating event network-changed:cd216d91-0e66-48bd-ba1b-debee67cf784 for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:14:08.574459 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-21737fb7-a3a3-4297-8db7-c8fe003537a5 req-58da044b-8e22-4612-9f95-9617f9225f0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063998 May 28 21:14:08.577019 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1514/3075] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:08.587526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8cc5983f-6d3e-4bdb-a203-0dd8bf7b24f5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:08.588519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8cc5983f-6d3e-4bdb-a203-0dd8bf7b24f5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:08.610627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8cc5983f-6d3e-4bdb-a203-0dd8bf7b24f5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:08.610627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8cc5983f-6d3e-4bdb-a203-0dd8bf7b24f5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:08.610627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8cc5983f-6d3e-4bdb-a203-0dd8bf7b24f5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:08.610627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8cc5983f-6d3e-4bdb-a203-0dd8bf7b24f5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:08.760731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8cc5983f-6d3e-4bdb-a203-0dd8bf7b24f5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:08.816537 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8cc5983f-6d3e-4bdb-a203-0dd8bf7b24f5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1270 microversion: 2.1 time: 0.236389 May 28 21:14:08.828198 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1562/3076] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:08 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1270 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:08.963688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-47a69773-85ff-40d9-9725-c4510d3fc19e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:08.964853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-47a69773-85ff-40d9-9725-c4510d3fc19e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:08.978397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47a69773-85ff-40d9-9725-c4510d3fc19e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:08.979981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47a69773-85ff-40d9-9725-c4510d3fc19e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:08.982671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47a69773-85ff-40d9-9725-c4510d3fc19e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:08.983306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47a69773-85ff-40d9-9725-c4510d3fc19e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:09.104203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d55f6681-1aac-4c85-ba5a-75b7201c9935 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d5727fd30>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:09.225933 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d55f6681-1aac-4c85-ba5a-75b7201c9935 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.130890 May 28 21:14:09.228439 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1563/3077] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:09 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:09.487527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-47a69773-85ff-40d9-9725-c4510d3fc19e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:09.504512 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-47a69773-85ff-40d9-9725-c4510d3fc19e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.543905 May 28 21:14:09.519282 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1515/3078] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:08 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:09.544450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-55710939-8b10-4bfa-96c0-bcf5faa48491 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:09.545251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-55710939-8b10-4bfa-96c0-bcf5faa48491 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:09.562803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-55710939-8b10-4bfa-96c0-bcf5faa48491 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:09.563308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-55710939-8b10-4bfa-96c0-bcf5faa48491 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:09.565867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-55710939-8b10-4bfa-96c0-bcf5faa48491 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:09.566354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-55710939-8b10-4bfa-96c0-bcf5faa48491 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:09.846562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e7d927b9-a0fc-4217-92e4-32ea1210257e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:09.847600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e7d927b9-a0fc-4217-92e4-32ea1210257e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:09.860773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7d927b9-a0fc-4217-92e4-32ea1210257e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:09.864677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7d927b9-a0fc-4217-92e4-32ea1210257e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:09.865958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7d927b9-a0fc-4217-92e4-32ea1210257e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:09.866614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7d927b9-a0fc-4217-92e4-32ea1210257e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:10.980590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e7d927b9-a0fc-4217-92e4-32ea1210257e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:10.988421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:11.006817 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e7d927b9-a0fc-4217-92e4-32ea1210257e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1276 microversion: 2.1 time: 1.166789 May 28 21:14:11.008729 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1516/3079] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:09 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1276 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:11.015183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-94a11f16-eee6-4ffa-8af1-4239a4d7d852 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d575a6700>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:11.075832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-55710939-8b10-4bfa-96c0-bcf5faa48491 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:11.080743 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-94a11f16-eee6-4ffa-8af1-4239a4d7d852 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.070348 May 28 21:14:11.086908 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1517/3080] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:11 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:11.091351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-55710939-8b10-4bfa-96c0-bcf5faa48491 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:11.092152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-89dc268f-b7cc-487d-85d5-4e35e78e1adb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:11.093402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-89dc268f-b7cc-487d-85d5-4e35e78e1adb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:11.093701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-55710939-8b10-4bfa-96c0-bcf5faa48491 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:11.094317 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-55710939-8b10-4bfa-96c0-bcf5faa48491 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1854 microversion: 2.42 time: 1.555761 May 28 21:14:11.095950 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1564/3081] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:09 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1854 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:11.100679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-6e334089-a497-4bc5-8ca4-c6ee1dc8ed53 req-f9368526-5ba2-43a6-8684-ca5fbe955822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "tag": "ec5c409c-5c1a-40d9-8be5-b5bc17805f84"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:11.101744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89dc268f-b7cc-487d-85d5-4e35e78e1adb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:11.102242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89dc268f-b7cc-487d-85d5-4e35e78e1adb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:11.103035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89dc268f-b7cc-487d-85d5-4e35e78e1adb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:11.103541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89dc268f-b7cc-487d-85d5-4e35e78e1adb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:11.109041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6e334089-a497-4bc5-8ca4-c6ee1dc8ed53 req-f9368526-5ba2-43a6-8684-ca5fbe955822 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:11.109496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6e334089-a497-4bc5-8ca4-c6ee1dc8ed53 req-f9368526-5ba2-43a6-8684-ca5fbe955822 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:11.123148 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-6e334089-a497-4bc5-8ca4-c6ee1dc8ed53 req-f9368526-5ba2-43a6-8684-ca5fbe955822 service nova] Creating event network-changed:ec5c409c-5c1a-40d9-8be5-b5bc17805f84 for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:14:11.129139 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-6e334089-a497-4bc5-8ca4-c6ee1dc8ed53 req-f9368526-5ba2-43a6-8684-ca5fbe955822 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031723 May 28 21:14:11.130173 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1565/3082] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:11.684168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89dc268f-b7cc-487d-85d5-4e35e78e1adb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:11.701123 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-89dc268f-b7cc-487d-85d5-4e35e78e1adb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.612936 May 28 21:14:11.702368 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1518/3083] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:11 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:12.028103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-37e0f833-5136-4bf6-b1ac-080d5dbf796e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:12.029733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-37e0f833-5136-4bf6-b1ac-080d5dbf796e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:12.048090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37e0f833-5136-4bf6-b1ac-080d5dbf796e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:12.048576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37e0f833-5136-4bf6-b1ac-080d5dbf796e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:12.050130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37e0f833-5136-4bf6-b1ac-080d5dbf796e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:12.050591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37e0f833-5136-4bf6-b1ac-080d5dbf796e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:12.095025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0ad628c9-5ac3-45b6-93ff-5fd1a5eb130f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d574faf70>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:12.223859 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0ad628c9-5ac3-45b6-93ff-5fd1a5eb130f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.123418 May 28 21:14:12.223859 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1519/3084] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:12 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:12.223859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3868a8fe-538c-44ce-a522-ae992216e428 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:12.229197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3868a8fe-538c-44ce-a522-ae992216e428 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:12.244153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3868a8fe-538c-44ce-a522-ae992216e428 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:12.244773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3868a8fe-538c-44ce-a522-ae992216e428 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:12.245668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3868a8fe-538c-44ce-a522-ae992216e428 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:12.247218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3868a8fe-538c-44ce-a522-ae992216e428 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:12.710356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-37e0f833-5136-4bf6-b1ac-080d5dbf796e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:12.716631 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-37e0f833-5136-4bf6-b1ac-080d5dbf796e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1318 microversion: 2.1 time: 0.695710 May 28 21:14:12.717388 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1566/3085] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:12 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1318 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:12.741231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4f18492a-86c4-4c26-af36-11534558a816 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:12.741942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4f18492a-86c4-4c26-af36-11534558a816 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:12.757457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f18492a-86c4-4c26-af36-11534558a816 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:12.758477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f18492a-86c4-4c26-af36-11534558a816 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:12.759274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f18492a-86c4-4c26-af36-11534558a816 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:12.759724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f18492a-86c4-4c26-af36-11534558a816 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:12.957085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3868a8fe-538c-44ce-a522-ae992216e428 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:12.981716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3868a8fe-538c-44ce-a522-ae992216e428 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:12.986815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3868a8fe-538c-44ce-a522-ae992216e428 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:12.989888 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3868a8fe-538c-44ce-a522-ae992216e428 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.773575 May 28 21:14:12.995742 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1520/3086] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:12 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:13.187808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-802d65b6-1291-47fa-8a15-bebb3fec4c93 req-4bea6b46-5875-475d-9379-03abaafc3e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "tag": "b9f06dda-68a6-48bd-8781-3e0aabc602a4"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:13.223771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-802d65b6-1291-47fa-8a15-bebb3fec4c93 req-4bea6b46-5875-475d-9379-03abaafc3e08 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:13.223771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-802d65b6-1291-47fa-8a15-bebb3fec4c93 req-4bea6b46-5875-475d-9379-03abaafc3e08 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:13.238547 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-802d65b6-1291-47fa-8a15-bebb3fec4c93 req-4bea6b46-5875-475d-9379-03abaafc3e08 service nova] Creating event network-changed:b9f06dda-68a6-48bd-8781-3e0aabc602a4 for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:14:13.258153 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-802d65b6-1291-47fa-8a15-bebb3fec4c93 req-4bea6b46-5875-475d-9379-03abaafc3e08 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074890 May 28 21:14:13.259143 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1521/3087] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:14:13.264716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f29c372b-7891-4b78-a5ed-797ae9922b20 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d574ede50>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:13.295910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4f18492a-86c4-4c26-af36-11534558a816 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:13.307097 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4f18492a-86c4-4c26-af36-11534558a816 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.580371 May 28 21:14:13.310198 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1567/3088] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:12 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:13.339635 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f29c372b-7891-4b78-a5ed-797ae9922b20 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.078975 May 28 21:14:13.343913 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1522/3089] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:13 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:13.735466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5534dae6-a0d2-4137-a057-b124674523f2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:13.736911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5534dae6-a0d2-4137-a057-b124674523f2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:13.744843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5534dae6-a0d2-4137-a057-b124674523f2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:13.745777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5534dae6-a0d2-4137-a057-b124674523f2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:13.746805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5534dae6-a0d2-4137-a057-b124674523f2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:13.748685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5534dae6-a0d2-4137-a057-b124674523f2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:14.014543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ec708f27-d035-4a71-95b0-9741a62cd97c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:14.015629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ec708f27-d035-4a71-95b0-9741a62cd97c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:14.023628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec708f27-d035-4a71-95b0-9741a62cd97c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:14.024816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec708f27-d035-4a71-95b0-9741a62cd97c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:14.025829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec708f27-d035-4a71-95b0-9741a62cd97c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:14.026576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec708f27-d035-4a71-95b0-9741a62cd97c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:14.297265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5534dae6-a0d2-4137-a057-b124674523f2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:14.307583 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5534dae6-a0d2-4137-a057-b124674523f2 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1318 microversion: 2.1 time: 0.577568 May 28 21:14:14.316148 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1568/3090] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:13 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1318 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:14.326173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-863fd9d0-4d38-4b9f-8e7e-26ea82459c33 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:14.327140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-863fd9d0-4d38-4b9f-8e7e-26ea82459c33 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:14.334197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-863fd9d0-4d38-4b9f-8e7e-26ea82459c33 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:14.334963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-863fd9d0-4d38-4b9f-8e7e-26ea82459c33 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:14.336532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-863fd9d0-4d38-4b9f-8e7e-26ea82459c33 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:14.337190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-863fd9d0-4d38-4b9f-8e7e-26ea82459c33 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:15.590348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-863fd9d0-4d38-4b9f-8e7e-26ea82459c33 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:15.592792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ec708f27-d035-4a71-95b0-9741a62cd97c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:15.625483 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-863fd9d0-4d38-4b9f-8e7e-26ea82459c33 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 1.297672 May 28 21:14:15.625483 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1569/3091] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:14 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:15.631158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ec708f27-d035-4a71-95b0-9741a62cd97c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:15.637648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-92ca05e1-9e28-489e-bf18-f8af6f5f7428 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d5727fd30>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:15.641056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ec708f27-d035-4a71-95b0-9741a62cd97c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:15.644026 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ec708f27-d035-4a71-95b0-9741a62cd97c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 1.633729 May 28 21:14:15.645268 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1523/3092] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:14 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:15.654890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2443dd97-f0ef-4587-b0b0-1299d271adc3 req-6add1d9d-c766-4420-a647-b08178e0ebc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "tag": "6b0d782b-1790-41fb-93ea-5c3cb2d2bf1a"}, {"name": "network-changed", "server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "tag": "8e9126c9-eb54-4fe2-8d2d-2fd3d4b4fe8d"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:15.666741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2443dd97-f0ef-4587-b0b0-1299d271adc3 req-6add1d9d-c766-4420-a647-b08178e0ebc0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:15.667921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2443dd97-f0ef-4587-b0b0-1299d271adc3 req-6add1d9d-c766-4420-a647-b08178e0ebc0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:15.695769 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2443dd97-f0ef-4587-b0b0-1299d271adc3 req-6add1d9d-c766-4420-a647-b08178e0ebc0 service nova] Creating event network-changed:6b0d782b-1790-41fb-93ea-5c3cb2d2bf1a for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:14:15.704452 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2443dd97-f0ef-4587-b0b0-1299d271adc3 req-6add1d9d-c766-4420-a647-b08178e0ebc0 service nova] Creating event network-changed:8e9126c9-eb54-4fe2-8d2d-2fd3d4b4fe8d for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:14:15.712988 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2443dd97-f0ef-4587-b0b0-1299d271adc3 req-6add1d9d-c766-4420-a647-b08178e0ebc0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.066057 May 28 21:14:15.713123 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-92ca05e1-9e28-489e-bf18-f8af6f5f7428 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.085594 May 28 21:14:15.713647 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1570/3093] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:15 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:15.725051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0de441aa-ff70-4845-8b37-d21b568f9bab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:15.725694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0de441aa-ff70-4845-8b37-d21b568f9bab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:15.764968 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1524/3094] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:15.787662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0de441aa-ff70-4845-8b37-d21b568f9bab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:15.790380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0de441aa-ff70-4845-8b37-d21b568f9bab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:15.791267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0de441aa-ff70-4845-8b37-d21b568f9bab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:15.791754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0de441aa-ff70-4845-8b37-d21b568f9bab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:15.968524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-35c41618-5b44-412a-9bb5-2d9fdbb0ae87 req-a5c035c1-67a2-4497-b8eb-e03c276b5c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5feafb80-57d1-47d0-9ad3-fc0a081d66ad", "tag": "0f14230b-e5f3-45e8-a7d9-0d59804c7822"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:15.980869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:15.983595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-35c41618-5b44-412a-9bb5-2d9fdbb0ae87 req-a5c035c1-67a2-4497-b8eb-e03c276b5c3e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:15.984383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-35c41618-5b44-412a-9bb5-2d9fdbb0ae87 req-a5c035c1-67a2-4497-b8eb-e03c276b5c3e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:15.997294 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-35c41618-5b44-412a-9bb5-2d9fdbb0ae87 req-a5c035c1-67a2-4497-b8eb-e03c276b5c3e service nova] Creating event network-changed:0f14230b-e5f3-45e8-a7d9-0d59804c7822 for instance 5feafb80-57d1-47d0-9ad3-fc0a081d66ad on nch2-master-1 May 28 21:14:16.003261 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-35c41618-5b44-412a-9bb5-2d9fdbb0ae87 req-a5c035c1-67a2-4497-b8eb-e03c276b5c3e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039030 May 28 21:14:16.005070 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1525/3095] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:14:16.438455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0de441aa-ff70-4845-8b37-d21b568f9bab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:16.446412 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0de441aa-ff70-4845-8b37-d21b568f9bab tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1318 microversion: 2.1 time: 0.730224 May 28 21:14:16.447404 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1571/3096] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:15 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1318 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:16.640681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0dc08f38-1052-4362-895f-d3439f8cc6ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:16.641911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0dc08f38-1052-4362-895f-d3439f8cc6ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:16.650935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0dc08f38-1052-4362-895f-d3439f8cc6ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:16.651770 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0dc08f38-1052-4362-895f-d3439f8cc6ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:16.652919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0dc08f38-1052-4362-895f-d3439f8cc6ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:16.653665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0dc08f38-1052-4362-895f-d3439f8cc6ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:16.666635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eafec17e-932f-4d78-a748-0b1b3dcdf17c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:16.667892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eafec17e-932f-4d78-a748-0b1b3dcdf17c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:16.685028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eafec17e-932f-4d78-a748-0b1b3dcdf17c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:16.685483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eafec17e-932f-4d78-a748-0b1b3dcdf17c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:16.686291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eafec17e-932f-4d78-a748-0b1b3dcdf17c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:16.695624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eafec17e-932f-4d78-a748-0b1b3dcdf17c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:17.299766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0dc08f38-1052-4362-895f-d3439f8cc6ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:17.302947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eafec17e-932f-4d78-a748-0b1b3dcdf17c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:17.339528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eafec17e-932f-4d78-a748-0b1b3dcdf17c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:17.339732 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0dc08f38-1052-4362-895f-d3439f8cc6ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.701751 May 28 21:14:17.341537 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1526/3097] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:16 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:17.349028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eafec17e-932f-4d78-a748-0b1b3dcdf17c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:17.351124 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eafec17e-932f-4d78-a748-0b1b3dcdf17c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.689378 May 28 21:14:17.354793 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1572/3098] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:16 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:17.355176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c3c14ae-5751-4a50-a7ff-81746bf222aa tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d57803550>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:17.426159 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8c3c14ae-5751-4a50-a7ff-81746bf222aa tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.083218 May 28 21:14:17.432559 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1527/3099] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:17 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:17.463553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0692a94f-a532-40bd-9889-ab60878d0180 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:17.464394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0692a94f-a532-40bd-9889-ab60878d0180 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:17.474156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0692a94f-a532-40bd-9889-ab60878d0180 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:17.478448 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0692a94f-a532-40bd-9889-ab60878d0180 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:17.479845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0692a94f-a532-40bd-9889-ab60878d0180 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:17.480319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0692a94f-a532-40bd-9889-ab60878d0180 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:17.771644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2ce5de16-a51b-4d29-b7dd-b5e1e338d05d req-7f86e3fc-8729-4492-9446-79bf24b06f64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "tag": "63e35303-0289-4426-8f0f-dfccabdbfba7"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:17.795302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=10 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:17.818986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2ce5de16-a51b-4d29-b7dd-b5e1e338d05d req-7f86e3fc-8729-4492-9446-79bf24b06f64 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:17.824208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2ce5de16-a51b-4d29-b7dd-b5e1e338d05d req-7f86e3fc-8729-4492-9446-79bf24b06f64 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:17.859463 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2ce5de16-a51b-4d29-b7dd-b5e1e338d05d req-7f86e3fc-8729-4492-9446-79bf24b06f64 service nova] Creating event network-changed:63e35303-0289-4426-8f0f-dfccabdbfba7 for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:14:17.871724 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2ce5de16-a51b-4d29-b7dd-b5e1e338d05d req-7f86e3fc-8729-4492-9446-79bf24b06f64 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113399 May 28 21:14:17.874144 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1528/3100] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:17.976874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0692a94f-a532-40bd-9889-ab60878d0180 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:18.003630 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0692a94f-a532-40bd-9889-ab60878d0180 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1318 microversion: 2.1 time: 0.544238 May 28 21:14:18.010148 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1573/3101] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:17 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1318 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:18.359746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-75456d6f-6c31-49ac-8b1d-c5e7206a71d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:18.360964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-75456d6f-6c31-49ac-8b1d-c5e7206a71d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:18.372193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-55dae5af-c0ef-4b66-bdcb-1184ac3334d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:18.372905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-55dae5af-c0ef-4b66-bdcb-1184ac3334d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:18.404928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75456d6f-6c31-49ac-8b1d-c5e7206a71d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:18.406177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-55dae5af-c0ef-4b66-bdcb-1184ac3334d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:18.408384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-55dae5af-c0ef-4b66-bdcb-1184ac3334d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:18.408830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75456d6f-6c31-49ac-8b1d-c5e7206a71d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:18.410625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-55dae5af-c0ef-4b66-bdcb-1184ac3334d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:18.412224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75456d6f-6c31-49ac-8b1d-c5e7206a71d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:18.412883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75456d6f-6c31-49ac-8b1d-c5e7206a71d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:18.413598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-55dae5af-c0ef-4b66-bdcb-1184ac3334d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:18.806287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-75456d6f-6c31-49ac-8b1d-c5e7206a71d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:18.819238 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-75456d6f-6c31-49ac-8b1d-c5e7206a71d8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.466201 May 28 21:14:18.821007 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1529/3102] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:18 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:18.827799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cb40a85a-bb3f-4b12-b896-d1600632feb9 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d57903280>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:18.861102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-55dae5af-c0ef-4b66-bdcb-1184ac3334d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:18.885855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-55dae5af-c0ef-4b66-bdcb-1184ac3334d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:18.889698 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-55dae5af-c0ef-4b66-bdcb-1184ac3334d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:18.891136 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-55dae5af-c0ef-4b66-bdcb-1184ac3334d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.524667 May 28 21:14:18.904212 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1574/3103] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:18 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:18.906037 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cb40a85a-bb3f-4b12-b896-d1600632feb9 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.071913 May 28 21:14:18.906037 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1530/3104] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:18 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:19.027948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5212fadb-a2f0-4b6b-a261-27c80b89044e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:19.037623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5212fadb-a2f0-4b6b-a261-27c80b89044e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:19.044931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5212fadb-a2f0-4b6b-a261-27c80b89044e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:19.045402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5212fadb-a2f0-4b6b-a261-27c80b89044e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:19.046848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5212fadb-a2f0-4b6b-a261-27c80b89044e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:19.047308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5212fadb-a2f0-4b6b-a261-27c80b89044e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:19.278798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5212fadb-a2f0-4b6b-a261-27c80b89044e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:19.285822 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5212fadb-a2f0-4b6b-a261-27c80b89044e tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1318 microversion: 2.1 time: 0.265681 May 28 21:14:19.286817 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1575/3105] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:19 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:19.838899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0987e210-bf6e-4d0a-b913-56d3442564b8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:19.840360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0987e210-bf6e-4d0a-b913-56d3442564b8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:19.854793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0987e210-bf6e-4d0a-b913-56d3442564b8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:19.857259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0987e210-bf6e-4d0a-b913-56d3442564b8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:19.860464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0987e210-bf6e-4d0a-b913-56d3442564b8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:19.860929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0987e210-bf6e-4d0a-b913-56d3442564b8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:19.912392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a8eae94-3e7b-432f-9375-d8df63a801af tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:19.913087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6a8eae94-3e7b-432f-9375-d8df63a801af tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:19.925556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a8eae94-3e7b-432f-9375-d8df63a801af tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:19.926290 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a8eae94-3e7b-432f-9375-d8df63a801af tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:19.927252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a8eae94-3e7b-432f-9375-d8df63a801af tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:19.928886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a8eae94-3e7b-432f-9375-d8df63a801af tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:20.214367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0987e210-bf6e-4d0a-b913-56d3442564b8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:20.237171 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0987e210-bf6e-4d0a-b913-56d3442564b8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.399864 May 28 21:14:20.241541 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1531/3106] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:19 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:20.263647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6faa2608-8b21-4bfe-86a8-0f1394b50d1f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d575a0670>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:20.303527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a8eae94-3e7b-432f-9375-d8df63a801af tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:20.321198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a8eae94-3e7b-432f-9375-d8df63a801af tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:20.324333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a8eae94-3e7b-432f-9375-d8df63a801af tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:20.328392 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6a8eae94-3e7b-432f-9375-d8df63a801af tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.420006 May 28 21:14:20.329570 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1576/3107] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:19 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:14:20.361532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-64332399-a951-45e6-8052-77f5a7978753 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:20.363674 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-64332399-a951-45e6-8052-77f5a7978753 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:20.368280 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6faa2608-8b21-4bfe-86a8-0f1394b50d1f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.124828 May 28 21:14:20.368878 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1532/3108] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:20 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:20.412210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64332399-a951-45e6-8052-77f5a7978753 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:20.412694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64332399-a951-45e6-8052-77f5a7978753 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:20.413507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64332399-a951-45e6-8052-77f5a7978753 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:20.414539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64332399-a951-45e6-8052-77f5a7978753 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:21.112154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-64332399-a951-45e6-8052-77f5a7978753 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:21.130130 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-64332399-a951-45e6-8052-77f5a7978753 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1318 microversion: 2.1 time: 0.798004 May 28 21:14:21.131119 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1577/3109] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:20 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1318 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:21.259771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-450ee895-4a51-4799-93e7-1aa58f108f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:21.260458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-450ee895-4a51-4799-93e7-1aa58f108f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:21.269756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-450ee895-4a51-4799-93e7-1aa58f108f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:21.270346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-450ee895-4a51-4799-93e7-1aa58f108f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:21.273373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-450ee895-4a51-4799-93e7-1aa58f108f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:21.273861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-450ee895-4a51-4799-93e7-1aa58f108f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:21.350315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-722e5afa-563f-40a8-bc2f-15c30049d90d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:21.350935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-722e5afa-563f-40a8-bc2f-15c30049d90d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:21.374309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-722e5afa-563f-40a8-bc2f-15c30049d90d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:21.375049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-722e5afa-563f-40a8-bc2f-15c30049d90d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:21.377428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-722e5afa-563f-40a8-bc2f-15c30049d90d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:21.378218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-722e5afa-563f-40a8-bc2f-15c30049d90d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:21.757691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-450ee895-4a51-4799-93e7-1aa58f108f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:21.763046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-722e5afa-563f-40a8-bc2f-15c30049d90d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:21.772882 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-450ee895-4a51-4799-93e7-1aa58f108f21 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.515255 May 28 21:14:21.773398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-722e5afa-563f-40a8-bc2f-15c30049d90d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:21.778197 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1533/3110] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:21 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:21.787883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-722e5afa-563f-40a8-bc2f-15c30049d90d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:21.790415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-11d0850a-1a34-424a-8f68-7a33f5cd4dbe tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d57637af0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:21.790624 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-722e5afa-563f-40a8-bc2f-15c30049d90d tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.445836 May 28 21:14:21.791744 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1578/3111] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:21 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:21.846024 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-11d0850a-1a34-424a-8f68-7a33f5cd4dbe tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.065464 May 28 21:14:21.846766 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1534/3112] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:21 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:22.149354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-62fd0c84-5dc9-498b-81b5-31b7bed27d26 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:22.150128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-62fd0c84-5dc9-498b-81b5-31b7bed27d26 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:22.157326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62fd0c84-5dc9-498b-81b5-31b7bed27d26 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:22.157930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62fd0c84-5dc9-498b-81b5-31b7bed27d26 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:22.158799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62fd0c84-5dc9-498b-81b5-31b7bed27d26 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:22.159319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62fd0c84-5dc9-498b-81b5-31b7bed27d26 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:22.436012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-62fd0c84-5dc9-498b-81b5-31b7bed27d26 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:22.452999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:22.455430 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-62fd0c84-5dc9-498b-81b5-31b7bed27d26 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1318 microversion: 2.1 time: 0.310635 May 28 21:14:22.456026 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1579/3113] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:22 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:22.623996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-9132760b-55ae-4a00-9e2d-6a1803586aee req-978b2d7b-a2f2-4953-af45-4372e9ac2b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5feafb80-57d1-47d0-9ad3-fc0a081d66ad", "name": "network-vif-plugged", "status": "completed", "tag": "0f14230b-e5f3-45e8-a7d9-0d59804c7822"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:22.641584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9132760b-55ae-4a00-9e2d-6a1803586aee req-978b2d7b-a2f2-4953-af45-4372e9ac2b2e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:22.642437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9132760b-55ae-4a00-9e2d-6a1803586aee req-978b2d7b-a2f2-4953-af45-4372e9ac2b2e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:22.659475 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-9132760b-55ae-4a00-9e2d-6a1803586aee req-978b2d7b-a2f2-4953-af45-4372e9ac2b2e service nova] Creating event network-vif-plugged:0f14230b-e5f3-45e8-a7d9-0d59804c7822 for instance 5feafb80-57d1-47d0-9ad3-fc0a081d66ad on nch2-master-1 May 28 21:14:22.665636 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-9132760b-55ae-4a00-9e2d-6a1803586aee req-978b2d7b-a2f2-4953-af45-4372e9ac2b2e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049430 May 28 21:14:22.669265 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1535/3114] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:22.795750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-788dd756-5d67-4f15-a372-dc0b34da57b5 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:22.797280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-788dd756-5d67-4f15-a372-dc0b34da57b5 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:22.805185 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-788dd756-5d67-4f15-a372-dc0b34da57b5 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:22.805630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-788dd756-5d67-4f15-a372-dc0b34da57b5 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:22.814060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-160aa74b-5e3b-4623-8a83-99bc9e4abd0b tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:22.815124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-160aa74b-5e3b-4623-8a83-99bc9e4abd0b tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:22.819668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-788dd756-5d67-4f15-a372-dc0b34da57b5 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:22.823646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-160aa74b-5e3b-4623-8a83-99bc9e4abd0b tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:22.824327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-788dd756-5d67-4f15-a372-dc0b34da57b5 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:22.824943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-160aa74b-5e3b-4623-8a83-99bc9e4abd0b tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:22.829234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-160aa74b-5e3b-4623-8a83-99bc9e4abd0b tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:22.829953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-160aa74b-5e3b-4623-8a83-99bc9e4abd0b tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:23.325889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-788dd756-5d67-4f15-a372-dc0b34da57b5 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:23.340686 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-788dd756-5d67-4f15-a372-dc0b34da57b5 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.547701 May 28 21:14:23.343151 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1580/3115] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:22 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:23.351387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-be6037ac-c762-4a49-a01b-189b5959110c tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d64293550>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:23.377046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-160aa74b-5e3b-4623-8a83-99bc9e4abd0b tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:23.396402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-160aa74b-5e3b-4623-8a83-99bc9e4abd0b tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:23.397411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-160aa74b-5e3b-4623-8a83-99bc9e4abd0b tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:23.397811 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-160aa74b-5e3b-4623-8a83-99bc9e4abd0b tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.588807 May 28 21:14:23.399026 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1536/3116] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:22 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:23.418603 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-be6037ac-c762-4a49-a01b-189b5959110c tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1424 microversion: 2.1 time: 0.072745 May 28 21:14:23.421163 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1581/3117] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:23 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:23.474563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1d34136b-56ca-481b-bae1-f8fab8b8f3d3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:23.474563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1d34136b-56ca-481b-bae1-f8fab8b8f3d3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:23.482869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d34136b-56ca-481b-bae1-f8fab8b8f3d3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:23.483638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d34136b-56ca-481b-bae1-f8fab8b8f3d3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:23.484588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d34136b-56ca-481b-bae1-f8fab8b8f3d3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:23.485488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d34136b-56ca-481b-bae1-f8fab8b8f3d3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:23.764283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1d34136b-56ca-481b-bae1-f8fab8b8f3d3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:23.772491 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1d34136b-56ca-481b-bae1-f8fab8b8f3d3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1318 microversion: 2.1 time: 0.303640 May 28 21:14:23.773250 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1537/3118] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:23 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:24.357773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6ed1c6d1-d6d9-4705-b188-8ab078c81ccd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:24.358457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6ed1c6d1-d6d9-4705-b188-8ab078c81ccd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:24.366569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ed1c6d1-d6d9-4705-b188-8ab078c81ccd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:24.366974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ed1c6d1-d6d9-4705-b188-8ab078c81ccd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:24.367881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ed1c6d1-d6d9-4705-b188-8ab078c81ccd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:24.368369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ed1c6d1-d6d9-4705-b188-8ab078c81ccd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:24.420365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d4db60a6-4f5f-46e9-9dee-1fc95c1fbfde tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:24.423502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d4db60a6-4f5f-46e9-9dee-1fc95c1fbfde tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:24.436084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4db60a6-4f5f-46e9-9dee-1fc95c1fbfde tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:24.436615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4db60a6-4f5f-46e9-9dee-1fc95c1fbfde tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:24.437336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4db60a6-4f5f-46e9-9dee-1fc95c1fbfde tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:24.437779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4db60a6-4f5f-46e9-9dee-1fc95c1fbfde tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:24.551676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6ed1c6d1-d6d9-4705-b188-8ab078c81ccd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:24.561199 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6ed1c6d1-d6d9-4705-b188-8ab078c81ccd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.207132 May 28 21:14:24.571670 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1582/3119] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:24 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:24.582827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-507ba403-fe34-495a-b48f-ae4606a2087f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d64bda700>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:24.658255 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-507ba403-fe34-495a-b48f-ae4606a2087f tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1433 microversion: 2.1 time: 0.084312 May 28 21:14:24.659022 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1583/3120] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:24 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1433 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:24.672998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-17c1715c-2a16-4c13-9e7f-f08e46262189 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d57478f70>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:24.723017 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-17c1715c-2a16-4c13-9e7f-f08e46262189 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 200 len: 1433 microversion: 2.1 time: 0.054264 May 28 21:14:24.723827 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1584/3121] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:24 2022] GET /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 1433 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:24.737497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-77bc712e-d0ab-4d6c-b3e0-5ce10d98ef93 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:24.738802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-77bc712e-d0ab-4d6c-b3e0-5ce10d98ef93 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:24.746332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77bc712e-d0ab-4d6c-b3e0-5ce10d98ef93 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:24.746800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77bc712e-d0ab-4d6c-b3e0-5ce10d98ef93 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:24.747596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77bc712e-d0ab-4d6c-b3e0-5ce10d98ef93 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:24.748205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77bc712e-d0ab-4d6c-b3e0-5ce10d98ef93 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:24.764853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d4db60a6-4f5f-46e9-9dee-1fc95c1fbfde tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:24.777257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d4db60a6-4f5f-46e9-9dee-1fc95c1fbfde tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:24.779970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d4db60a6-4f5f-46e9-9dee-1fc95c1fbfde tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:24.781541 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d4db60a6-4f5f-46e9-9dee-1fc95c1fbfde tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.365822 May 28 21:14:24.782697 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1538/3122] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:24 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:24.797823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c0bb65d-072e-4da6-b21a-635663ba9f20 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:24.798746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3c0bb65d-072e-4da6-b21a-635663ba9f20 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:24.805742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c0bb65d-072e-4da6-b21a-635663ba9f20 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:24.806609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c0bb65d-072e-4da6-b21a-635663ba9f20 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:24.807669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c0bb65d-072e-4da6-b21a-635663ba9f20 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:24.808110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c0bb65d-072e-4da6-b21a-635663ba9f20 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:25.005458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-77bc712e-d0ab-4d6c-b3e0-5ce10d98ef93 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:25.017636 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-77bc712e-d0ab-4d6c-b3e0-5ce10d98ef93 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1465 microversion: 2.1 time: 0.284820 May 28 21:14:25.031501 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1585/3123] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:24 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1465 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:25.042175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c14ef814-75ec-4496-8168-400c6cc4d484 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d64293160>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:25.109055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3c0bb65d-072e-4da6-b21a-635663ba9f20 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:25.123340 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3c0bb65d-072e-4da6-b21a-635663ba9f20 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1507 microversion: 2.1 time: 0.329660 May 28 21:14:25.127453 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1539/3124] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:24 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:25.140620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0f231242-d51b-4bf9-97b2-c3448a90e18f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:25.143027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0f231242-d51b-4bf9-97b2-c3448a90e18f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:25.154958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f231242-d51b-4bf9-97b2-c3448a90e18f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:25.159681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f231242-d51b-4bf9-97b2-c3448a90e18f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:25.160561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f231242-d51b-4bf9-97b2-c3448a90e18f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:25.161337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f231242-d51b-4bf9-97b2-c3448a90e18f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:25.390272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0f231242-d51b-4bf9-97b2-c3448a90e18f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:25.401514 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0f231242-d51b-4bf9-97b2-c3448a90e18f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1507 microversion: 2.1 time: 0.264217 May 28 21:14:25.402886 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1540/3125] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:25 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:25.428753 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-48e8de60-3c7e-411b-a201-3a5316883cb5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:25.431527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-48e8de60-3c7e-411b-a201-3a5316883cb5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:25.442290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-48e8de60-3c7e-411b-a201-3a5316883cb5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:25.442760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-48e8de60-3c7e-411b-a201-3a5316883cb5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:25.443556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-48e8de60-3c7e-411b-a201-3a5316883cb5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:25.448147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-48e8de60-3c7e-411b-a201-3a5316883cb5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:25.664718 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-48e8de60-3c7e-411b-a201-3a5316883cb5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "PUT /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1079 microversion: 2.1 time: 0.244600 May 28 21:14:25.667291 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1541/3126] 10.222.0.33 () {60 vars in 1255 bytes} [Sat May 28 21:14:25 2022] PUT /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1079 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:25.685399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bea1a1a0-0afa-44ae-8721-7458efae0c81 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:25.686309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bea1a1a0-0afa-44ae-8721-7458efae0c81 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:25.707388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bea1a1a0-0afa-44ae-8721-7458efae0c81 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:25.707892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bea1a1a0-0afa-44ae-8721-7458efae0c81 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:25.708794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bea1a1a0-0afa-44ae-8721-7458efae0c81 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:25.709254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bea1a1a0-0afa-44ae-8721-7458efae0c81 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:26.008091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bea1a1a0-0afa-44ae-8721-7458efae0c81 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:26.018269 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bea1a1a0-0afa-44ae-8721-7458efae0c81 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.349626 May 28 21:14:26.018950 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1542/3127] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:25 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:26.034391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-079c9554-7596-449c-ba84-43fa899680fe tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:26.035165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-079c9554-7596-449c-ba84-43fa899680fe tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:26.045415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-079c9554-7596-449c-ba84-43fa899680fe tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:26.046143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-079c9554-7596-449c-ba84-43fa899680fe tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:26.047414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-079c9554-7596-449c-ba84-43fa899680fe tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:26.048213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-079c9554-7596-449c-ba84-43fa899680fe tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:26.052820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:26.232241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-079c9554-7596-449c-ba84-43fa899680fe tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:26.242995 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-079c9554-7596-449c-ba84-43fa899680fe tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1505 microversion: 2.1 time: 0.222860 May 28 21:14:26.246976 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1543/3128] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:26 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1505 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:26.249674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5c1760df-4cc7-4be0-8bf0-ea09f6523933 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:26.250401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5c1760df-4cc7-4be0-8bf0-ea09f6523933 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:26.256859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c1760df-4cc7-4be0-8bf0-ea09f6523933 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:26.257590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c1760df-4cc7-4be0-8bf0-ea09f6523933 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:26.258409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c1760df-4cc7-4be0-8bf0-ea09f6523933 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:26.258862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c1760df-4cc7-4be0-8bf0-ea09f6523933 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:26.499756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5c1760df-4cc7-4be0-8bf0-ea09f6523933 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:26.509480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5c1760df-4cc7-4be0-8bf0-ea09f6523933 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:26.511009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5c1760df-4cc7-4be0-8bf0-ea09f6523933 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:26.512181 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5c1760df-4cc7-4be0-8bf0-ea09f6523933 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.267097 May 28 21:14:26.512749 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1544/3129] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:26 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:26.517234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-211460b0-c83e-4aa2-9e47-0e9d622854af tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:26.517893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-211460b0-c83e-4aa2-9e47-0e9d622854af tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:26.527003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-211460b0-c83e-4aa2-9e47-0e9d622854af tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:26.527457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-211460b0-c83e-4aa2-9e47-0e9d622854af tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:26.528236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-211460b0-c83e-4aa2-9e47-0e9d622854af tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:26.528679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-211460b0-c83e-4aa2-9e47-0e9d622854af tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:26.687034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-211460b0-c83e-4aa2-9e47-0e9d622854af tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:26.713295 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-211460b0-c83e-4aa2-9e47-0e9d622854af tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1505 microversion: 2.1 time: 0.199467 May 28 21:14:26.716528 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1545/3130] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:26 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1505 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:26.734139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2882b49b-b4fc-4651-8882-f222efde3c1f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:26.735927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2882b49b-b4fc-4651-8882-f222efde3c1f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:26.752522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2882b49b-b4fc-4651-8882-f222efde3c1f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:26.754336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2882b49b-b4fc-4651-8882-f222efde3c1f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:26.755371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2882b49b-b4fc-4651-8882-f222efde3c1f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:26.756041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2882b49b-b4fc-4651-8882-f222efde3c1f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:26.952311 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c14ef814-75ec-4496-8168-400c6cc4d484 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "DELETE /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f" status: 204 len: 0 microversion: 2.1 time: 1.913921 May 28 21:14:26.952903 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1586/3131] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:25 2022] DELETE /compute/v2.1/images/c1c81180-5d2c-417b-97f6-2baff957404f => generated 0 bytes in 1916 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:14:26.960857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-75f538a8-5ead-422e-b7cf-cbc17cf4a7be tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '.version_select at 0x7f4d64101d30>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:26.982599 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-75f538a8-5ead-422e-b7cf-cbc17cf4a7be tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] HTTP exception thrown: Image not found. May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-75f538a8-5ead-422e-b7cf-cbc17cf4a7be tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Request method failure captured: May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e HTTP/1.1 May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpBmeXh7FBh0v9mLFu77Yx2_HGDe2y2j7_sHZMOyYfpTVRioMx0ACSZvMmQzSXmgBM0grBmBcio4X9DWjXXZUN_AE-t39yRSLLq9YBdP-32ltEM9RUijhpxh0ZqFtk6GDhfQtitzgihnIoKOqCluUNSxCCYUxiv2lS9-uMe-Nn50aeo May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 149d4937782d47f1b75fcdcfb4a89707 May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesOneServerTestJSON-81255134 May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_149d4937782d47f1b75fcdcfb4a89707", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/149d4937782d47f1b75fcdcfb4a89707"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/149d4937782d47f1b75fcdcfb4a89707"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/149d4937782d47f1b75fcdcfb4a89707"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesOneServerTestJSON-81255134 May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 149d4937782d47f1b75fcdcfb4a89707 May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-81255134 May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesOneServerTestJSON-81255134-project May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: cf4bbfcd9bf64e3eabac163461e98f66 May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesOneServerTestJSON-81255134-project May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: exception: Image not found. May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '730ff2a9-6504-4e86-9be2-23a94111e39e'} May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 730ff2a9-6504-4e86-9be2-23a94111e39e to delete May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 730ff2a9-6504-4e86-9be2-23a94111e39e could not be found. May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:26.998737 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:27.003461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-75f538a8-5ead-422e-b7cf-cbc17cf4a7be tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Returning 404 to user: Image not found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:27.005540 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2882b49b-b4fc-4651-8882-f222efde3c1f tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "PUT /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1081 microversion: 2.1 time: 0.261867 May 28 21:14:27.005641 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-75f538a8-5ead-422e-b7cf-cbc17cf4a7be tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "DELETE /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e" status: 404 len: 62 microversion: 2.1 time: 0.036096 May 28 21:14:27.005731 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1546/3132] 10.222.0.33 () {60 vars in 1255 bytes} [Sat May 28 21:14:26 2022] PUT /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1081 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:27.005826 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1587/3133] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:26 2022] DELETE /compute/v2.1/images/730ff2a9-6504-4e86-9be2-23a94111e39e => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 21:14:27.015676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b07f6cf9-7077-4e53-9a2d-ab8392fd4bff tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:27.016405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-42cf95fe-2454-48e5-bc9f-0a805d10b89b tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:27.016528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b07f6cf9-7077-4e53-9a2d-ab8392fd4bff tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:27.016639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-42cf95fe-2454-48e5-bc9f-0a805d10b89b tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:27.021433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42cf95fe-2454-48e5-bc9f-0a805d10b89b tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:27.021908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42cf95fe-2454-48e5-bc9f-0a805d10b89b tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:27.023085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42cf95fe-2454-48e5-bc9f-0a805d10b89b tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:27.023899 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42cf95fe-2454-48e5-bc9f-0a805d10b89b tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:27.024745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b07f6cf9-7077-4e53-9a2d-ab8392fd4bff tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:27.025217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b07f6cf9-7077-4e53-9a2d-ab8392fd4bff tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:27.026049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b07f6cf9-7077-4e53-9a2d-ab8392fd4bff tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:27.027030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b07f6cf9-7077-4e53-9a2d-ab8392fd4bff tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:27.063934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-42cf95fe-2454-48e5-bc9f-0a805d10b89b tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:14:27.257536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b07f6cf9-7077-4e53-9a2d-ab8392fd4bff tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:27.271745 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b07f6cf9-7077-4e53-9a2d-ab8392fd4bff tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1507 microversion: 2.1 time: 0.261503 May 28 21:14:27.282905 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1547/3134] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:27 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1507 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:27.287629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9bb454ab-6e1b-4358-839c-3bcc6bfcaf24 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:27.288363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9bb454ab-6e1b-4358-839c-3bcc6bfcaf24 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:27.298719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bb454ab-6e1b-4358-839c-3bcc6bfcaf24 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:27.301245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bb454ab-6e1b-4358-839c-3bcc6bfcaf24 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:27.302106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bb454ab-6e1b-4358-839c-3bcc6bfcaf24 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:27.302570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bb454ab-6e1b-4358-839c-3bcc6bfcaf24 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:27.486635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9bb454ab-6e1b-4358-839c-3bcc6bfcaf24 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:27.494724 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9bb454ab-6e1b-4358-839c-3bcc6bfcaf24 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.219434 May 28 21:14:27.504674 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1548/3135] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:27 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:27.504674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-abef82ea-b4eb-4fe2-b2e3-b70397aec567 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:27.504674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-abef82ea-b4eb-4fe2-b2e3-b70397aec567 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:27.509183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abef82ea-b4eb-4fe2-b2e3-b70397aec567 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:27.509725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abef82ea-b4eb-4fe2-b2e3-b70397aec567 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:27.510861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abef82ea-b4eb-4fe2-b2e3-b70397aec567 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:27.511359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abef82ea-b4eb-4fe2-b2e3-b70397aec567 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:27.514668 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-42cf95fe-2454-48e5-bc9f-0a805d10b89b tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "DELETE /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 204 len: 0 microversion: 2.1 time: 0.504058 May 28 21:14:27.515347 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1588/3136] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:14:27 2022] DELETE /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:14:27.524708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-84e2a411-488e-4e9d-8852-decbb4332477 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:27.525133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-84e2a411-488e-4e9d-8852-decbb4332477 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:27.543202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84e2a411-488e-4e9d-8852-decbb4332477 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:27.543718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84e2a411-488e-4e9d-8852-decbb4332477 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:27.544442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84e2a411-488e-4e9d-8852-decbb4332477 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:27.544881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84e2a411-488e-4e9d-8852-decbb4332477 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:27.762704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-abef82ea-b4eb-4fe2-b2e3-b70397aec567 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:27.773519 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-abef82ea-b4eb-4fe2-b2e3-b70397aec567 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1507 microversion: 2.1 time: 0.275954 May 28 21:14:27.774793 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1549/3137] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:27 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:27.781496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d9240d1f-77fc-4247-aa56-1ada244b9a95 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:27.782330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d9240d1f-77fc-4247-aa56-1ada244b9a95 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:27.791949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9240d1f-77fc-4247-aa56-1ada244b9a95 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:27.798137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9240d1f-77fc-4247-aa56-1ada244b9a95 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:27.798137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9240d1f-77fc-4247-aa56-1ada244b9a95 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:27.798560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-84e2a411-488e-4e9d-8852-decbb4332477 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:27.801241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9240d1f-77fc-4247-aa56-1ada244b9a95 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:27.811812 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-84e2a411-488e-4e9d-8852-decbb4332477 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1471 microversion: 2.1 time: 0.291941 May 28 21:14:27.812760 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1589/3138] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:27 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1471 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:27.818378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2de3ca92-9bc4-4ae4-a6b2-7a025d59b784 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:27.818893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2de3ca92-9bc4-4ae4-a6b2-7a025d59b784 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:27.827493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2de3ca92-9bc4-4ae4-a6b2-7a025d59b784 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:27.828824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2de3ca92-9bc4-4ae4-a6b2-7a025d59b784 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:27.829616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2de3ca92-9bc4-4ae4-a6b2-7a025d59b784 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:27.832329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2de3ca92-9bc4-4ae4-a6b2-7a025d59b784 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:27.863871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2de3ca92-9bc4-4ae4-a6b2-7a025d59b784 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:14:28.054031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d9240d1f-77fc-4247-aa56-1ada244b9a95 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:28.080919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d9240d1f-77fc-4247-aa56-1ada244b9a95 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:28.082617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d9240d1f-77fc-4247-aa56-1ada244b9a95 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:28.084420 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d9240d1f-77fc-4247-aa56-1ada244b9a95 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.308060 May 28 21:14:28.086137 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1550/3139] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:27 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:28.212422 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2de3ca92-9bc4-4ae4-a6b2-7a025d59b784 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 204 len: 0 microversion: 2.1 time: 0.398019 May 28 21:14:28.219143 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1590/3140] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:14:27 2022] DELETE /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:14:28.224414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-084229c7-a106-4b92-814a-0015dba8c52a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:28.224922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-084229c7-a106-4b92-814a-0015dba8c52a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:28.237894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-084229c7-a106-4b92-814a-0015dba8c52a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:28.238298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-084229c7-a106-4b92-814a-0015dba8c52a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:28.239097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-084229c7-a106-4b92-814a-0015dba8c52a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:28.239539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-084229c7-a106-4b92-814a-0015dba8c52a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:28.288699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-542e7832-84d6-4feb-b5f1-3c90c9886ccb req-0837f05d-18e4-47bf-8e64-cc1b817a9c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818f89de-48f1-43d3-9ee2-4ab0e3652353", "name": "network-vif-unplugged", "status": "completed", "tag": "59de6851-8323-4006-84f5-6c1b327b2c4f"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:28.308292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-542e7832-84d6-4feb-b5f1-3c90c9886ccb req-0837f05d-18e4-47bf-8e64-cc1b817a9c2b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:28.311098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-542e7832-84d6-4feb-b5f1-3c90c9886ccb req-0837f05d-18e4-47bf-8e64-cc1b817a9c2b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:28.343968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-084229c7-a106-4b92-814a-0015dba8c52a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:14:28.344122 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-542e7832-84d6-4feb-b5f1-3c90c9886ccb req-0837f05d-18e4-47bf-8e64-cc1b817a9c2b service nova] Creating event network-vif-unplugged:59de6851-8323-4006-84f5-6c1b327b2c4f for instance 818f89de-48f1-43d3-9ee2-4ab0e3652353 on nch2-master-1 May 28 21:14:28.356546 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-542e7832-84d6-4feb-b5f1-3c90c9886ccb req-0837f05d-18e4-47bf-8e64-cc1b817a9c2b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071641 May 28 21:14:28.357713 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1591/3141] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:14:28.457698 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.compute.api [None req-084229c7-a106-4b92-814a-0015dba8c52a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Instance is already in deleting state, ignoring this request May 28 21:14:28.458924 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-084229c7-a106-4b92-814a-0015dba8c52a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 204 len: 0 microversion: 2.1 time: 0.238430 May 28 21:14:28.461815 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1551/3142] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:14:28 2022] DELETE /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:14:28.479571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-daef81a2-55a4-4f43-8950-938677f03d6b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:28.480356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-daef81a2-55a4-4f43-8950-938677f03d6b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:28.497193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-daef81a2-55a4-4f43-8950-938677f03d6b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:28.499416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-daef81a2-55a4-4f43-8950-938677f03d6b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:28.501600 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-daef81a2-55a4-4f43-8950-938677f03d6b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:28.502262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-daef81a2-55a4-4f43-8950-938677f03d6b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:28.514318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7b43e813-be4b-44ec-9c83-95f30bc3619a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:28.515405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7b43e813-be4b-44ec-9c83-95f30bc3619a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:28.536325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b43e813-be4b-44ec-9c83-95f30bc3619a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:28.536812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b43e813-be4b-44ec-9c83-95f30bc3619a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:28.537620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b43e813-be4b-44ec-9c83-95f30bc3619a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:28.538148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b43e813-be4b-44ec-9c83-95f30bc3619a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:28.787157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-daef81a2-55a4-4f43-8950-938677f03d6b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:28.800022 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-daef81a2-55a4-4f43-8950-938677f03d6b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1513 microversion: 2.1 time: 0.329119 May 28 21:14:28.803779 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1592/3143] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:28 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1513 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:28.826807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7b43e813-be4b-44ec-9c83-95f30bc3619a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:28.836061 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7b43e813-be4b-44ec-9c83-95f30bc3619a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1512 microversion: 2.1 time: 0.326928 May 28 21:14:28.837225 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1552/3144] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:28 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1512 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:28.843569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fa72589c-e34d-4f46-bac2-2dc14a3aa807 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:28.845710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fa72589c-e34d-4f46-bac2-2dc14a3aa807 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:28.852367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fa72589c-e34d-4f46-bac2-2dc14a3aa807 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:28.852835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fa72589c-e34d-4f46-bac2-2dc14a3aa807 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:28.853626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fa72589c-e34d-4f46-bac2-2dc14a3aa807 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:28.854098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fa72589c-e34d-4f46-bac2-2dc14a3aa807 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:28.987710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-508770450", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:29.012443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fa72589c-e34d-4f46-bac2-2dc14a3aa807 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:29.022555 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fa72589c-e34d-4f46-bac2-2dc14a3aa807 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1471 microversion: 2.1 time: 0.183895 May 28 21:14:29.033456 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1553/3145] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:28 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1471 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:29.050882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] validate_networks() for [('1d8fb7bc-f468-443c-8ba9-f4cae3a20512', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:14:29.106939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5851be52-d3fb-41ca-9dc5-648d49ac15d2 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:29.107581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5851be52-d3fb-41ca-9dc5-648d49ac15d2 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:29.115588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5851be52-d3fb-41ca-9dc5-648d49ac15d2 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:29.116111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5851be52-d3fb-41ca-9dc5-648d49ac15d2 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:29.117688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5851be52-d3fb-41ca-9dc5-648d49ac15d2 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:29.117973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5851be52-d3fb-41ca-9dc5-648d49ac15d2 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:29.439628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5851be52-d3fb-41ca-9dc5-648d49ac15d2 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:29.448518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5851be52-d3fb-41ca-9dc5-648d49ac15d2 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:29.450071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5851be52-d3fb-41ca-9dc5-648d49ac15d2 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:29.451272 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5851be52-d3fb-41ca-9dc5-648d49ac15d2 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.350613 May 28 21:14:29.462738 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1554/3146] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:29 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:14:29.722447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:14:29.722887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:14:29.723409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:14:29.723892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:14:29.724319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:14:29.738161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:29.738652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:29.739475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:29.739924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:29.759334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Getting quotas for project 53b9cfacdbb74a058e52bed331a6f241. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:14:29.765070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Getting quotas for user af446b3d802a42e3bd72b08bace8ea8d and project 53b9cfacdbb74a058e52bed331a6f241. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:14:29.778919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:14:29.781207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:14:29.821789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3e7ba903-c4b0-48e0-b8fe-f871f16e6dc5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:29.822472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3e7ba903-c4b0-48e0-b8fe-f871f16e6dc5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:29.829205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e7ba903-c4b0-48e0-b8fe-f871f16e6dc5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:29.829646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e7ba903-c4b0-48e0-b8fe-f871f16e6dc5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:29.830456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e7ba903-c4b0-48e0-b8fe-f871f16e6dc5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:29.830896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e7ba903-c4b0-48e0-b8fe-f871f16e6dc5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:29.904809 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-61d4ecbd-36d5-4bc4-a6a8-5c45c5803c43 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.086337 May 28 21:14:29.905893 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1593/3147] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:14:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:14:29.913328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-feaa929a-5d7b-4444-9e52-568933d698ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:29.913978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-feaa929a-5d7b-4444-9e52-568933d698ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:29.924794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-feaa929a-5d7b-4444-9e52-568933d698ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:29.925954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-feaa929a-5d7b-4444-9e52-568933d698ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:29.926988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-feaa929a-5d7b-4444-9e52-568933d698ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:29.927696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-feaa929a-5d7b-4444-9e52-568933d698ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:30.034939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3e7ba903-c4b0-48e0-b8fe-f871f16e6dc5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:30.046869 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3e7ba903-c4b0-48e0-b8fe-f871f16e6dc5 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1513 microversion: 2.1 time: 0.229963 May 28 21:14:30.059239 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1555/3148] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:29 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:30.064757 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-95e2097a-a606-4555-a403-9814cb834046 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:30.065766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-95e2097a-a606-4555-a403-9814cb834046 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:30.146459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-95e2097a-a606-4555-a403-9814cb834046 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:30.150232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-feaa929a-5d7b-4444-9e52-568933d698ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:30.165208 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-95e2097a-a606-4555-a403-9814cb834046 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1221 microversion: 2.1 time: 0.097517 May 28 21:14:30.165208 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1556/3149] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:30 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:30.165415 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-feaa929a-5d7b-4444-9e52-568933d698ce tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1489 microversion: 2.1 time: 0.251243 May 28 21:14:30.165415 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1594/3150] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:29 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1489 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:30.165588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-35193bce-0c2e-4527-939d-f097c7e40235 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:30.165588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-35193bce-0c2e-4527-939d-f097c7e40235 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:30.171995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35193bce-0c2e-4527-939d-f097c7e40235 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:30.172624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35193bce-0c2e-4527-939d-f097c7e40235 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:30.173686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35193bce-0c2e-4527-939d-f097c7e40235 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:30.174594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35193bce-0c2e-4527-939d-f097c7e40235 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:30.186393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-982f1aa8-230d-4a03-8d61-2ed3a391d75c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:30.186912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-982f1aa8-230d-4a03-8d61-2ed3a391d75c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:30.199664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-982f1aa8-230d-4a03-8d61-2ed3a391d75c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:30.199788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-982f1aa8-230d-4a03-8d61-2ed3a391d75c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:30.200504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-982f1aa8-230d-4a03-8d61-2ed3a391d75c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:30.200958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-982f1aa8-230d-4a03-8d61-2ed3a391d75c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:30.238596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-982f1aa8-230d-4a03-8d61-2ed3a391d75c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:14:30.447291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-35193bce-0c2e-4527-939d-f097c7e40235 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:30.466529 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-35193bce-0c2e-4527-939d-f097c7e40235 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1471 microversion: 2.1 time: 0.305660 May 28 21:14:30.482952 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1557/3151] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:30 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:30.490474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1396217150", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:30.560409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] validate_networks() for [('1d8fb7bc-f468-443c-8ba9-f4cae3a20512', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:14:30.620154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:30.745259 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-982f1aa8-230d-4a03-8d61-2ed3a391d75c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "DELETE /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 204 len: 0 microversion: 2.1 time: 0.561566 May 28 21:14:30.749859 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1595/3152] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:14:30 2022] DELETE /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:14:30.755656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ff880168-8aa6-4a5c-97df-1569b81f2b10 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:30.757736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ff880168-8aa6-4a5c-97df-1569b81f2b10 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:30.775670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff880168-8aa6-4a5c-97df-1569b81f2b10 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:30.776267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff880168-8aa6-4a5c-97df-1569b81f2b10 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:30.777875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff880168-8aa6-4a5c-97df-1569b81f2b10 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:30.779961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff880168-8aa6-4a5c-97df-1569b81f2b10 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:31.289945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ff880168-8aa6-4a5c-97df-1569b81f2b10 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:31.303369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ff880168-8aa6-4a5c-97df-1569b81f2b10 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:31.306772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ff880168-8aa6-4a5c-97df-1569b81f2b10 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:31.308463 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ff880168-8aa6-4a5c-97df-1569b81f2b10 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.559527 May 28 21:14:31.320215 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1596/3153] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:30 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:31.333519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-207e4876-b92a-43dd-9515-2fd9910658dd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:31.333519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-207e4876-b92a-43dd-9515-2fd9910658dd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:31.336165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-207e4876-b92a-43dd-9515-2fd9910658dd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:31.336784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-207e4876-b92a-43dd-9515-2fd9910658dd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:31.338421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-207e4876-b92a-43dd-9515-2fd9910658dd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:31.338844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-207e4876-b92a-43dd-9515-2fd9910658dd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:31.519961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:14:31.520421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:14:31.521427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:14:31.521427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:14:31.521751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:14:31.541937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:31.546736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:31.547745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:31.548212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:31.578677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Getting quotas for project 53b9cfacdbb74a058e52bed331a6f241. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:14:31.585778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Getting quotas for user af446b3d802a42e3bd72b08bace8ea8d and project 53b9cfacdbb74a058e52bed331a6f241. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:14:31.611411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:14:31.614396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:14:31.629863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:31.633902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-207e4876-b92a-43dd-9515-2fd9910658dd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:31.637514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:31.645479 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-207e4876-b92a-43dd-9515-2fd9910658dd tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1495 microversion: 2.1 time: 0.323149 May 28 21:14:31.647413 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1597/3154] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:31 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1495 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:31.666997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b885fe95-4a7b-4641-83f6-e449314862f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:31.667934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b885fe95-4a7b-4641-83f6-e449314862f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:31.676974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b885fe95-4a7b-4641-83f6-e449314862f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:31.677776 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b885fe95-4a7b-4641-83f6-e449314862f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:31.678809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b885fe95-4a7b-4641-83f6-e449314862f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:31.679600 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b885fe95-4a7b-4641-83f6-e449314862f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:31.782533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b885fe95-4a7b-4641-83f6-e449314862f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:31.791955 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b885fe95-4a7b-4641-83f6-e449314862f4 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1471 microversion: 2.1 time: 0.141777 May 28 21:14:31.793114 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1598/3155] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:31 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1471 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:31.816861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-64460d6a-5618-4e9b-8b58-8b15aa70bcbd req-eb9389c6-a46b-4f6d-9b07-758f5196b2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "818f89de-48f1-43d3-9ee2-4ab0e3652353", "name": "network-vif-deleted", "tag": "59de6851-8323-4006-84f5-6c1b327b2c4f"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:31.824006 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1be1f662-c754-4a33-b1ef-0c3dfcb2220d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.338874 May 28 21:14:31.825135 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1558/3156] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:14:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 1341 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:14:31.830145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-64460d6a-5618-4e9b-8b58-8b15aa70bcbd req-eb9389c6-a46b-4f6d-9b07-758f5196b2f8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:31.830145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-64460d6a-5618-4e9b-8b58-8b15aa70bcbd req-eb9389c6-a46b-4f6d-9b07-758f5196b2f8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:31.839370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-9fd835b2-c364-4d7c-9bf6-6c9b0ece4663 req-37ca64bb-6ed7-4059-a5bb-1908adead10f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5feafb80-57d1-47d0-9ad3-fc0a081d66ad", "name": "network-vif-deleted", "tag": "0f14230b-e5f3-45e8-a7d9-0d59804c7822"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:31.857232 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-64460d6a-5618-4e9b-8b58-8b15aa70bcbd req-eb9389c6-a46b-4f6d-9b07-758f5196b2f8 service nova] Creating event network-vif-deleted:59de6851-8323-4006-84f5-6c1b327b2c4f for instance 818f89de-48f1-43d3-9ee2-4ab0e3652353 on nch2-master-1 May 28 21:14:31.860245 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-64460d6a-5618-4e9b-8b58-8b15aa70bcbd req-eb9389c6-a46b-4f6d-9b07-758f5196b2f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065418 May 28 21:14:31.865422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9fd835b2-c364-4d7c-9bf6-6c9b0ece4663 req-37ca64bb-6ed7-4059-a5bb-1908adead10f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:31.865970 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1599/3157] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:31.866291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9fd835b2-c364-4d7c-9bf6-6c9b0ece4663 req-37ca64bb-6ed7-4059-a5bb-1908adead10f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:31.874051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1a1060c8-2b67-43c1-9b63-407c457fd39d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:31.875686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1a1060c8-2b67-43c1-9b63-407c457fd39d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:31.878926 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-9fd835b2-c364-4d7c-9bf6-6c9b0ece4663 req-37ca64bb-6ed7-4059-a5bb-1908adead10f service nova] Creating event network-vif-deleted:0f14230b-e5f3-45e8-a7d9-0d59804c7822 for instance 5feafb80-57d1-47d0-9ad3-fc0a081d66ad on nch2-master-1 May 28 21:14:31.883271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a1060c8-2b67-43c1-9b63-407c457fd39d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:31.883746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a1060c8-2b67-43c1-9b63-407c457fd39d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:31.884773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a1060c8-2b67-43c1-9b63-407c457fd39d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:31.885235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a1060c8-2b67-43c1-9b63-407c457fd39d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:31.885824 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-9fd835b2-c364-4d7c-9bf6-6c9b0ece4663 req-37ca64bb-6ed7-4059-a5bb-1908adead10f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052054 May 28 21:14:31.889631 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1559/3158] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:31.918509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3346d8d9-230f-4139-bc62-6d9116e7f1b7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:31.919231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3346d8d9-230f-4139-bc62-6d9116e7f1b7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:31.993185 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1a1060c8-2b67-43c1-9b63-407c457fd39d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:32.008154 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1a1060c8-2b67-43c1-9b63-407c457fd39d tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1429 microversion: 2.1 time: 0.139830 May 28 21:14:32.018794 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1600/3159] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:31 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1429 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:32.032965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3346d8d9-230f-4139-bc62-6d9116e7f1b7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:32.041926 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3346d8d9-230f-4139-bc62-6d9116e7f1b7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1222 microversion: 2.1 time: 0.131251 May 28 21:14:32.043154 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1560/3160] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:31 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1222 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:32.330393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4691d692-29e9-48c5-954f-880d27047c28 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:32.331051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4691d692-29e9-48c5-954f-880d27047c28 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:32.353537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4691d692-29e9-48c5-954f-880d27047c28 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:32.355161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4691d692-29e9-48c5-954f-880d27047c28 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:32.356019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4691d692-29e9-48c5-954f-880d27047c28 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:32.356482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4691d692-29e9-48c5-954f-880d27047c28 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:32.643678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4691d692-29e9-48c5-954f-880d27047c28 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:32.653517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4691d692-29e9-48c5-954f-880d27047c28 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:32.655173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4691d692-29e9-48c5-954f-880d27047c28 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:32.656512 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4691d692-29e9-48c5-954f-880d27047c28 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.333030 May 28 21:14:32.665787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5f87bf36-abf3-4143-b333-ea8afee8b523 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:32.667530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5f87bf36-abf3-4143-b333-ea8afee8b523 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:32.668346 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1601/3161] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:32 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:32.676953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f87bf36-abf3-4143-b333-ea8afee8b523 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:32.677442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f87bf36-abf3-4143-b333-ea8afee8b523 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:32.678321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f87bf36-abf3-4143-b333-ea8afee8b523 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:32.678976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f87bf36-abf3-4143-b333-ea8afee8b523 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:32.687259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:32.773403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5f87bf36-abf3-4143-b333-ea8afee8b523 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:32.805856 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5f87bf36-abf3-4143-b333-ea8afee8b523 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1453 microversion: 2.1 time: 0.144962 May 28 21:14:32.808826 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1561/3162] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:32 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1453 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:32.820124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-17b85d28-b3f8-4d20-b869-f0879a064197 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:32.822479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-17b85d28-b3f8-4d20-b869-f0879a064197 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:32.837916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17b85d28-b3f8-4d20-b869-f0879a064197 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:32.838805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17b85d28-b3f8-4d20-b869-f0879a064197 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:32.841977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17b85d28-b3f8-4d20-b869-f0879a064197 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:32.845061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17b85d28-b3f8-4d20-b869-f0879a064197 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:32.892762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17b85d28-b3f8-4d20-b869-f0879a064197 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:32.893579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17b85d28-b3f8-4d20-b869-f0879a064197 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:32.894134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-17b85d28-b3f8-4d20-b869-f0879a064197 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lazy-loading 'fault' on Instance uuid 5feafb80-57d1-47d0-9ad3-fc0a081d66ad {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:14:32.956563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-17b85d28-b3f8-4d20-b869-f0879a064197 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b2f1524f7f48149cbc5d2c694a9e2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ecc00f85b54d01aa7dbe2f0386dac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:32.966014 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-17b85d28-b3f8-4d20-b869-f0879a064197 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 200 len: 1308 microversion: 2.1 time: 0.158204 May 28 21:14:32.967072 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1602/3163] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:32 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:33.026141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3f3657c5-21d6-464a-82f1-483befeda6e8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:33.035948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3f3657c5-21d6-464a-82f1-483befeda6e8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:33.049910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f3657c5-21d6-464a-82f1-483befeda6e8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:33.050502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f3657c5-21d6-464a-82f1-483befeda6e8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:33.051636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f3657c5-21d6-464a-82f1-483befeda6e8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:33.052382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f3657c5-21d6-464a-82f1-483befeda6e8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:33.062701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fbe06a8d-5c67-4aa2-b7e1-170d9143bb7b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:33.063614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fbe06a8d-5c67-4aa2-b7e1-170d9143bb7b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:33.181042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f3657c5-21d6-464a-82f1-483befeda6e8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:33.184149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f3657c5-21d6-464a-82f1-483befeda6e8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:33.185137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-3f3657c5-21d6-464a-82f1-483befeda6e8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lazy-loading 'fault' on Instance uuid 818f89de-48f1-43d3-9ee2-4ab0e3652353 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:14:33.295301 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fbe06a8d-5c67-4aa2-b7e1-170d9143bb7b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:33.310040 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fbe06a8d-5c67-4aa2-b7e1-170d9143bb7b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1222 microversion: 2.1 time: 0.252393 May 28 21:14:33.312869 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1603/3164] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:33 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1222 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:33.355232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3f3657c5-21d6-464a-82f1-483befeda6e8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf4bbfcd9bf64e3eabac163461e98f66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149d4937782d47f1b75fcdcfb4a89707', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:33.369663 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3f3657c5-21d6-464a-82f1-483befeda6e8 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 200 len: 1306 microversion: 2.1 time: 0.348940 May 28 21:14:33.371691 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1562/3165] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:33 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 1306 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:33.675538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b39710fb-4a9a-4934-ab71-a3aa424fef81 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:33.676432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b39710fb-4a9a-4934-ab71-a3aa424fef81 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:33.687809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b39710fb-4a9a-4934-ab71-a3aa424fef81 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:33.688622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b39710fb-4a9a-4934-ab71-a3aa424fef81 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:33.689748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b39710fb-4a9a-4934-ab71-a3aa424fef81 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:33.690388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b39710fb-4a9a-4934-ab71-a3aa424fef81 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:33.826275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-16d48111-40e9-43fe-92d2-88235080336a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:33.827638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-16d48111-40e9-43fe-92d2-88235080336a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:33.837552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16d48111-40e9-43fe-92d2-88235080336a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:33.838098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16d48111-40e9-43fe-92d2-88235080336a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:33.839209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16d48111-40e9-43fe-92d2-88235080336a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:33.840117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16d48111-40e9-43fe-92d2-88235080336a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:33.887599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16d48111-40e9-43fe-92d2-88235080336a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:33.888350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16d48111-40e9-43fe-92d2-88235080336a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:33.888981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-16d48111-40e9-43fe-92d2-88235080336a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lazy-loading 'fault' on Instance uuid 90a4d46c-e387-4ba1-962d-71d5fcfe5577 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:14:34.019563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-16d48111-40e9-43fe-92d2-88235080336a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:34.030032 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-16d48111-40e9-43fe-92d2-88235080336a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 200 len: 1304 microversion: 2.1 time: 0.208682 May 28 21:14:34.030640 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1563/3166] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:33 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 1304 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:34.047049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-0ccdef8c-19d4-4e9d-9208-56c4230903fb req-f01b90ef-216e-4027-b8f9-e1572f156452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a4d46c-e387-4ba1-962d-71d5fcfe5577", "name": "network-vif-deleted", "tag": "1c674af8-61de-4365-96e1-e23e1214c3ba"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:34.061400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0ccdef8c-19d4-4e9d-9208-56c4230903fb req-f01b90ef-216e-4027-b8f9-e1572f156452 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:34.061880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0ccdef8c-19d4-4e9d-9208-56c4230903fb req-f01b90ef-216e-4027-b8f9-e1572f156452 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:34.096502 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-0ccdef8c-19d4-4e9d-9208-56c4230903fb req-f01b90ef-216e-4027-b8f9-e1572f156452 service nova] Creating event network-vif-deleted:1c674af8-61de-4365-96e1-e23e1214c3ba for instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 on nch2-master-1 May 28 21:14:34.106419 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-0ccdef8c-19d4-4e9d-9208-56c4230903fb req-f01b90ef-216e-4027-b8f9-e1572f156452 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061535 May 28 21:14:34.111781 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1564/3167] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:34.119781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fdda2c84-6a6c-48f7-b356-3c6c70e4a89a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:34.129359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fdda2c84-6a6c-48f7-b356-3c6c70e4a89a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 5feafb80-57d1-47d0-9ad3-fc0a081d66ad] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:34.145527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdda2c84-6a6c-48f7-b356-3c6c70e4a89a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:34.146019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdda2c84-6a6c-48f7-b356-3c6c70e4a89a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:34.146829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdda2c84-6a6c-48f7-b356-3c6c70e4a89a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:34.147272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdda2c84-6a6c-48f7-b356-3c6c70e4a89a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:34.192527 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-fdda2c84-6a6c-48f7-b356-3c6c70e4a89a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] HTTP exception thrown: Instance 5feafb80-57d1-47d0-9ad3-fc0a081d66ad could not be found. May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fdda2c84-6a6c-48f7-b356-3c6c70e4a89a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Request method failure captured: May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad HTTP/1.1 May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpAe_c45OjIgfI25xgKw2nlLFnumEj8Ei1uKeb1GYtqJMDS5sLrBnAdBzyVC_Qgza4Yx16goC0tS03nm58mWVG2aYH7WcohvrAG2KkWdNBDFJiPzcaYNaNST6wNdtnQn8CF7QS5RwqO-96vbBgc8H-NiQmX_j0br3BT0x1q96Xw8N7I May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 53ecc00f85b54d01aa7dbe2f0386dac6 May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerDiskConfigTestJSON-533226702 May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53ecc00f85b54d01aa7dbe2f0386dac6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53ecc00f85b54d01aa7dbe2f0386dac6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53ecc00f85b54d01aa7dbe2f0386dac6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53ecc00f85b54d01aa7dbe2f0386dac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerDiskConfigTestJSON-533226702 May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 53ecc00f85b54d01aa7dbe2f0386dac6 May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-533226702 May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerDiskConfigTestJSON-533226702-project May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 25b2f1524f7f48149cbc5d2c694a9e2b May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerDiskConfigTestJSON-533226702-project May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 5feafb80-57d1-47d0-9ad3-fc0a081d66ad could not be found. May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '5feafb80-57d1-47d0-9ad3-fc0a081d66ad'} May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5feafb80-57d1-47d0-9ad3-fc0a081d66ad could not be found. May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5feafb80-57d1-47d0-9ad3-fc0a081d66ad could not be found. May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:34.195474 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.207131 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.207131 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:34.207131 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:34.207131 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:34.207131 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:34.207131 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5feafb80-57d1-47d0-9ad3-fc0a081d66ad could not be found. May 28 21:14:34.207131 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.207131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fdda2c84-6a6c-48f7-b356-3c6c70e4a89a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Returning 404 to user: Instance 5feafb80-57d1-47d0-9ad3-fc0a081d66ad could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:34.207131 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fdda2c84-6a6c-48f7-b356-3c6c70e4a89a tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad" status: 404 len: 111 microversion: 2.1 time: 0.085139 May 28 21:14:34.210684 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1565/3168] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:34 2022] GET /compute/v2.1/servers/5feafb80-57d1-47d0-9ad3-fc0a081d66ad => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:34.216146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e62fa4a0-2595-45c7-9627-e4c4128bdef3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:34.217989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e62fa4a0-2595-45c7-9627-e4c4128bdef3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:34.234208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e62fa4a0-2595-45c7-9627-e4c4128bdef3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:34.235201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e62fa4a0-2595-45c7-9627-e4c4128bdef3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:34.237406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e62fa4a0-2595-45c7-9627-e4c4128bdef3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:34.238147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e62fa4a0-2595-45c7-9627-e4c4128bdef3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:34.258598 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-e62fa4a0-2595-45c7-9627-e4c4128bdef3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] HTTP exception thrown: Instance 410adadb-b6ed-4904-83ec-dc9be8451944 could not be found. May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e62fa4a0-2595-45c7-9627-e4c4128bdef3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Request method failure captured: May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 HTTP/1.1 May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpAe_c45OjIgfI25xgKw2nlLFnumEj8Ei1uKeb1GYtqJMDS5sLrBnAdBzyVC_Qgza4Yx16goC0tS03nm58mWVG2aYH7WcohvrAG2KkWdNBDFJiPzcaYNaNST6wNdtnQn8CF7QS5RwqO-96vbBgc8H-NiQmX_j0br3BT0x1q96Xw8N7I May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 53ecc00f85b54d01aa7dbe2f0386dac6 May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerDiskConfigTestJSON-533226702 May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53ecc00f85b54d01aa7dbe2f0386dac6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53ecc00f85b54d01aa7dbe2f0386dac6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53ecc00f85b54d01aa7dbe2f0386dac6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53ecc00f85b54d01aa7dbe2f0386dac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerDiskConfigTestJSON-533226702 May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 53ecc00f85b54d01aa7dbe2f0386dac6 May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-533226702 May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerDiskConfigTestJSON-533226702-project May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 25b2f1524f7f48149cbc5d2c694a9e2b May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerDiskConfigTestJSON-533226702-project May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 410adadb-b6ed-4904-83ec-dc9be8451944 could not be found. May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '410adadb-b6ed-4904-83ec-dc9be8451944'} May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410adadb-b6ed-4904-83ec-dc9be8451944 could not be found. May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:34.261864 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:34.270405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410adadb-b6ed-4904-83ec-dc9be8451944 could not be found. May 28 21:14:34.270405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.270405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:34.270405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.270405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.270405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:34.270405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:34.270405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:34.270405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:34.270405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410adadb-b6ed-4904-83ec-dc9be8451944 could not be found. May 28 21:14:34.270405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.270405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e62fa4a0-2595-45c7-9627-e4c4128bdef3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Returning 404 to user: Instance 410adadb-b6ed-4904-83ec-dc9be8451944 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:34.271584 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e62fa4a0-2595-45c7-9627-e4c4128bdef3 tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "DELETE /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 404 len: 111 microversion: 2.1 time: 0.057086 May 28 21:14:34.271584 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1566/3169] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:14:34 2022] DELETE /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:34.283186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-986cbd89-9751-434e-a66f-b4228199760b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:34.283828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-986cbd89-9751-434e-a66f-b4228199760b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 410adadb-b6ed-4904-83ec-dc9be8451944] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:34.293017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-986cbd89-9751-434e-a66f-b4228199760b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:34.293476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-986cbd89-9751-434e-a66f-b4228199760b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:34.304539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-986cbd89-9751-434e-a66f-b4228199760b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:34.304539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-986cbd89-9751-434e-a66f-b4228199760b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:34.316061 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-986cbd89-9751-434e-a66f-b4228199760b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] HTTP exception thrown: Instance 410adadb-b6ed-4904-83ec-dc9be8451944 could not be found. May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-986cbd89-9751-434e-a66f-b4228199760b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Request method failure captured: May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 HTTP/1.1 May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpAe_c45OjIgfI25xgKw2nlLFnumEj8Ei1uKeb1GYtqJMDS5sLrBnAdBzyVC_Qgza4Yx16goC0tS03nm58mWVG2aYH7WcohvrAG2KkWdNBDFJiPzcaYNaNST6wNdtnQn8CF7QS5RwqO-96vbBgc8H-NiQmX_j0br3BT0x1q96Xw8N7I May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 53ecc00f85b54d01aa7dbe2f0386dac6 May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerDiskConfigTestJSON-533226702 May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53ecc00f85b54d01aa7dbe2f0386dac6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53ecc00f85b54d01aa7dbe2f0386dac6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53ecc00f85b54d01aa7dbe2f0386dac6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53ecc00f85b54d01aa7dbe2f0386dac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerDiskConfigTestJSON-533226702 May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 53ecc00f85b54d01aa7dbe2f0386dac6 May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-533226702 May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerDiskConfigTestJSON-533226702-project May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 25b2f1524f7f48149cbc5d2c694a9e2b May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerDiskConfigTestJSON-533226702-project May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 410adadb-b6ed-4904-83ec-dc9be8451944 could not be found. May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '410adadb-b6ed-4904-83ec-dc9be8451944'} May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410adadb-b6ed-4904-83ec-dc9be8451944 could not be found. May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410adadb-b6ed-4904-83ec-dc9be8451944 could not be found. May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:34.318397 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.332953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.332953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:34.332953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:34.332953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:34.332953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:34.332953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410adadb-b6ed-4904-83ec-dc9be8451944 could not be found. May 28 21:14:34.332953 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.332953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-986cbd89-9751-434e-a66f-b4228199760b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Returning 404 to user: Instance 410adadb-b6ed-4904-83ec-dc9be8451944 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:34.332953 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-986cbd89-9751-434e-a66f-b4228199760b tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944" status: 404 len: 111 microversion: 2.1 time: 0.043667 May 28 21:14:34.332953 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1567/3170] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:34 2022] GET /compute/v2.1/servers/410adadb-b6ed-4904-83ec-dc9be8451944 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:34.343835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ec6cede8-67a9-4dff-94f8-b1130927d1d1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:34.345702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ec6cede8-67a9-4dff-94f8-b1130927d1d1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:34.355072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec6cede8-67a9-4dff-94f8-b1130927d1d1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:34.361777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec6cede8-67a9-4dff-94f8-b1130927d1d1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:34.361777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec6cede8-67a9-4dff-94f8-b1130927d1d1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:34.361777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec6cede8-67a9-4dff-94f8-b1130927d1d1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:34.654801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b39710fb-4a9a-4934-ab71-a3aa424fef81 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:34.657999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ec6cede8-67a9-4dff-94f8-b1130927d1d1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:34.668007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b39710fb-4a9a-4934-ab71-a3aa424fef81 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:34.669653 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ec6cede8-67a9-4dff-94f8-b1130927d1d1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1218 microversion: 2.1 time: 0.340331 May 28 21:14:34.679693 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1568/3171] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:34 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1218 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:34.679903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b39710fb-4a9a-4934-ab71-a3aa424fef81 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:34.679903 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b39710fb-4a9a-4934-ab71-a3aa424fef81 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 1.005557 May 28 21:14:34.679903 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1604/3172] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:33 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:34.697603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5a6d3eb9-6819-451e-aea2-0db963e97c17 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:34.702146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-807e8fa1-6446-4f60-aa80-792ad45734ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:34.702677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-807e8fa1-6446-4f60-aa80-792ad45734ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:34.704801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5a6d3eb9-6819-451e-aea2-0db963e97c17 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] [instance: 818f89de-48f1-43d3-9ee2-4ab0e3652353] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:34.715010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a6d3eb9-6819-451e-aea2-0db963e97c17 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:34.715473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a6d3eb9-6819-451e-aea2-0db963e97c17 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:34.716268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a6d3eb9-6819-451e-aea2-0db963e97c17 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:34.716717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a6d3eb9-6819-451e-aea2-0db963e97c17 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:34.718710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-807e8fa1-6446-4f60-aa80-792ad45734ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:34.719192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-807e8fa1-6446-4f60-aa80-792ad45734ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:34.720121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-807e8fa1-6446-4f60-aa80-792ad45734ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:34.721830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-807e8fa1-6446-4f60-aa80-792ad45734ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-5a6d3eb9-6819-451e-aea2-0db963e97c17 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] HTTP exception thrown: Instance 818f89de-48f1-43d3-9ee2-4ab0e3652353 could not be found. May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5a6d3eb9-6819-451e-aea2-0db963e97c17 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Request method failure captured: May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 HTTP/1.1 May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpBmeXh7FBh0v9mLFu77Yx2_HGDe2y2j7_sHZMOyYfpTVRioMx0ACSZvMmQzSXmgBM0grBmBcio4X9DWjXXZUN_AE-t39yRSLLq9YBdP-32ltEM9RUijhpxh0ZqFtk6GDhfQtitzgihnIoKOqCluUNSxCCYUxiv2lS9-uMe-Nn50aeo May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 149d4937782d47f1b75fcdcfb4a89707 May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ImagesOneServerTestJSON-81255134 May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_149d4937782d47f1b75fcdcfb4a89707", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/149d4937782d47f1b75fcdcfb4a89707"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/149d4937782d47f1b75fcdcfb4a89707"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/149d4937782d47f1b75fcdcfb4a89707"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ImagesOneServerTestJSON-81255134 May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 149d4937782d47f1b75fcdcfb4a89707 May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-81255134 May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ImagesOneServerTestJSON-81255134-project May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: cf4bbfcd9bf64e3eabac163461e98f66 May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ImagesOneServerTestJSON-81255134-project May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 818f89de-48f1-43d3-9ee2-4ab0e3652353 could not be found. May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '818f89de-48f1-43d3-9ee2-4ab0e3652353'} May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 818f89de-48f1-43d3-9ee2-4ab0e3652353 could not be found. May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:34.747053 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:34.751393 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 818f89de-48f1-43d3-9ee2-4ab0e3652353 could not be found. May 28 21:14:34.751393 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:34.751393 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:34.751393 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:34.751393 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.751393 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:34.751393 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:34.751393 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:34.751393 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:34.751393 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 818f89de-48f1-43d3-9ee2-4ab0e3652353 could not be found. May 28 21:14:34.751393 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:34.753512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5a6d3eb9-6819-451e-aea2-0db963e97c17 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] Returning 404 to user: Instance 818f89de-48f1-43d3-9ee2-4ab0e3652353 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:34.754714 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5a6d3eb9-6819-451e-aea2-0db963e97c17 tempest-ImagesOneServerTestJSON-81255134 tempest-ImagesOneServerTestJSON-81255134-project] 10.222.0.33 "GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353" status: 404 len: 111 microversion: 2.1 time: 0.075640 May 28 21:14:34.755542 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1605/3173] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:34 2022] GET /compute/v2.1/servers/818f89de-48f1-43d3-9ee2-4ab0e3652353 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:34.778887 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-807e8fa1-6446-4f60-aa80-792ad45734ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] HTTP exception thrown: Instance 0af7be2b-2058-490c-b258-2103bacdb44f could not be found. May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-807e8fa1-6446-4f60-aa80-792ad45734ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Request method failure captured: May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f HTTP/1.1 May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpAe_c45OjIgfI25xgKw2nlLFnumEj8Ei1uKeb1GYtqJMDS5sLrBnAdBzyVC_Qgza4Yx16goC0tS03nm58mWVG2aYH7WcohvrAG2KkWdNBDFJiPzcaYNaNST6wNdtnQn8CF7QS5RwqO-96vbBgc8H-NiQmX_j0br3BT0x1q96Xw8N7I May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 53ecc00f85b54d01aa7dbe2f0386dac6 May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerDiskConfigTestJSON-533226702 May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53ecc00f85b54d01aa7dbe2f0386dac6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53ecc00f85b54d01aa7dbe2f0386dac6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53ecc00f85b54d01aa7dbe2f0386dac6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53ecc00f85b54d01aa7dbe2f0386dac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerDiskConfigTestJSON-533226702 May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 53ecc00f85b54d01aa7dbe2f0386dac6 May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-533226702 May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerDiskConfigTestJSON-533226702-project May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 25b2f1524f7f48149cbc5d2c694a9e2b May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerDiskConfigTestJSON-533226702-project May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 0af7be2b-2058-490c-b258-2103bacdb44f could not be found. May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '0af7be2b-2058-490c-b258-2103bacdb44f'} May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af7be2b-2058-490c-b258-2103bacdb44f could not be found. May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:34.786241 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:34.791951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af7be2b-2058-490c-b258-2103bacdb44f could not be found. May 28 21:14:34.791951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.791951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:34.791951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.791951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.791951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:34.791951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:34.791951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:34.791951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:34.791951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af7be2b-2058-490c-b258-2103bacdb44f could not be found. May 28 21:14:34.791951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:34.795090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-807e8fa1-6446-4f60-aa80-792ad45734ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Returning 404 to user: Instance 0af7be2b-2058-490c-b258-2103bacdb44f could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:34.809299 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-807e8fa1-6446-4f60-aa80-792ad45734ea tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 404 len: 111 microversion: 2.1 time: 0.136540 May 28 21:14:34.814071 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1569/3174] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:14:34 2022] DELETE /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:34.818961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-304494aa-eb0e-4c90-8b63-35060ef59e7d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:34.820182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-304494aa-eb0e-4c90-8b63-35060ef59e7d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] [instance: 0af7be2b-2058-490c-b258-2103bacdb44f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:34.827142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-304494aa-eb0e-4c90-8b63-35060ef59e7d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:34.827613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-304494aa-eb0e-4c90-8b63-35060ef59e7d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:34.828411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-304494aa-eb0e-4c90-8b63-35060ef59e7d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:34.828862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-304494aa-eb0e-4c90-8b63-35060ef59e7d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:34.863681 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-304494aa-eb0e-4c90-8b63-35060ef59e7d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] HTTP exception thrown: Instance 0af7be2b-2058-490c-b258-2103bacdb44f could not be found. May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-304494aa-eb0e-4c90-8b63-35060ef59e7d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Request method failure captured: May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f HTTP/1.1 May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpAe_c45OjIgfI25xgKw2nlLFnumEj8Ei1uKeb1GYtqJMDS5sLrBnAdBzyVC_Qgza4Yx16goC0tS03nm58mWVG2aYH7WcohvrAG2KkWdNBDFJiPzcaYNaNST6wNdtnQn8CF7QS5RwqO-96vbBgc8H-NiQmX_j0br3BT0x1q96Xw8N7I May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 53ecc00f85b54d01aa7dbe2f0386dac6 May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerDiskConfigTestJSON-533226702 May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53ecc00f85b54d01aa7dbe2f0386dac6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53ecc00f85b54d01aa7dbe2f0386dac6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53ecc00f85b54d01aa7dbe2f0386dac6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53ecc00f85b54d01aa7dbe2f0386dac6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerDiskConfigTestJSON-533226702 May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 53ecc00f85b54d01aa7dbe2f0386dac6 May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-533226702 May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerDiskConfigTestJSON-533226702-project May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 25b2f1524f7f48149cbc5d2c694a9e2b May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerDiskConfigTestJSON-533226702-project May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 0af7be2b-2058-490c-b258-2103bacdb44f could not be found. May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '0af7be2b-2058-490c-b258-2103bacdb44f'} May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af7be2b-2058-490c-b258-2103bacdb44f could not be found. May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af7be2b-2058-490c-b258-2103bacdb44f could not be found. May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:34.869471 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:34.874716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:34.874716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:34.874716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:34.874716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:34.874716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:34.874716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af7be2b-2058-490c-b258-2103bacdb44f could not be found. May 28 21:14:34.874716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:14:34.874716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-304494aa-eb0e-4c90-8b63-35060ef59e7d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] Returning 404 to user: Instance 0af7be2b-2058-490c-b258-2103bacdb44f could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:34.874716 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-304494aa-eb0e-4c90-8b63-35060ef59e7d tempest-ServerDiskConfigTestJSON-533226702 tempest-ServerDiskConfigTestJSON-533226702-project] 10.222.0.33 "GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f" status: 404 len: 111 microversion: 2.1 time: 0.057267 May 28 21:14:34.874716 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1606/3175] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:34 2022] GET /compute/v2.1/servers/0af7be2b-2058-490c-b258-2103bacdb44f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:35.049220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-abc3bbf4-2773-4019-86a6-1d6e5777ba9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:35.050752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-abc3bbf4-2773-4019-86a6-1d6e5777ba9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:35.094175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abc3bbf4-2773-4019-86a6-1d6e5777ba9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:35.103686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abc3bbf4-2773-4019-86a6-1d6e5777ba9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:35.108104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abc3bbf4-2773-4019-86a6-1d6e5777ba9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:35.110112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abc3bbf4-2773-4019-86a6-1d6e5777ba9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:35.154418 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-abc3bbf4-2773-4019-86a6-1d6e5777ba9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-abc3bbf4-2773-4019-86a6-1d6e5777ba9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 HTTP/1.1 May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '90a4d46c-e387-4ba1-962d-71d5fcfe5577'} May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:35.156189 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:35.164020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:35.164020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:35.164020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:35.164020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:35.164020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:35.164020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. May 28 21:14:35.164020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:35.164020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-abc3bbf4-2773-4019-86a6-1d6e5777ba9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:35.164020 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-abc3bbf4-2773-4019-86a6-1d6e5777ba9a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 404 len: 111 microversion: 2.1 time: 0.114055 May 28 21:14:35.164020 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1570/3176] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:35 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:35.584362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1322560787", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "4688fc3e-7c0b-4b45-bce6-c3e05e995935"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:35.647424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] validate_networks() for [('4688fc3e-7c0b-4b45-bce6-c3e05e995935', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:14:35.692382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-91a1bb03-85d8-4585-a20b-25098e8e6b66 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:35.692382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-91a1bb03-85d8-4585-a20b-25098e8e6b66 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:35.702280 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91a1bb03-85d8-4585-a20b-25098e8e6b66 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:35.703880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91a1bb03-85d8-4585-a20b-25098e8e6b66 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:35.704877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91a1bb03-85d8-4585-a20b-25098e8e6b66 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:35.708654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91a1bb03-85d8-4585-a20b-25098e8e6b66 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:35.810252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-91a1bb03-85d8-4585-a20b-25098e8e6b66 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:35.826903 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-91a1bb03-85d8-4585-a20b-25098e8e6b66 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1292 microversion: 2.1 time: 0.143365 May 28 21:14:35.827520 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1571/3177] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:35 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1292 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:35.852405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c8bf3823-74e6-4a90-ad68-5cef3a161859 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:35.853656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c8bf3823-74e6-4a90-ad68-5cef3a161859 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:35.862264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8bf3823-74e6-4a90-ad68-5cef3a161859 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:35.862965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8bf3823-74e6-4a90-ad68-5cef3a161859 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:35.864018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8bf3823-74e6-4a90-ad68-5cef3a161859 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:35.864659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8bf3823-74e6-4a90-ad68-5cef3a161859 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:36.399208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c8bf3823-74e6-4a90-ad68-5cef3a161859 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:36.413888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c8bf3823-74e6-4a90-ad68-5cef3a161859 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:36.416652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c8bf3823-74e6-4a90-ad68-5cef3a161859 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:36.419060 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c8bf3823-74e6-4a90-ad68-5cef3a161859 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.585256 May 28 21:14:36.420006 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1572/3178] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:35 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:36.704220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:14:36.705229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:14:36.705821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:14:36.706382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:14:36.706900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:14:36.724933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:36.725545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:36.727823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:36.728512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:36.761144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Getting quotas for project cf04fd760c54473f83980a385252fa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:14:36.767943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Getting quotas for user bf9c8f66e7d24ca9baca835e41546f22 and project cf04fd760c54473f83980a385252fa3c. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:14:36.793924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:14:36.798374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:14:36.848627 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a4a91ba7-3c99-4109-8610-4169f0dc5c7c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:36.849273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a4a91ba7-3c99-4109-8610-4169f0dc5c7c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:36.861312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4a91ba7-3c99-4109-8610-4169f0dc5c7c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:36.861777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4a91ba7-3c99-4109-8610-4169f0dc5c7c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:36.864078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4a91ba7-3c99-4109-8610-4169f0dc5c7c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:36.868927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4a91ba7-3c99-4109-8610-4169f0dc5c7c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:36.982776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a4a91ba7-3c99-4109-8610-4169f0dc5c7c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:36.991744 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a4a91ba7-3c99-4109-8610-4169f0dc5c7c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1280 microversion: 2.1 time: 0.147452 May 28 21:14:36.995773 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1573/3179] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:36 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1280 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:36.998252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-c11638ef-bfc9-4df7-a8d0-7069cca96800 req-ac7a458e-644b-483a-9493-47fb4c705e11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b76c27e-3a75-40b8-b777-934f969dc6de", "tag": "dd262c9c-9a21-4330-8536-21fd5315edaa"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:37.009771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c11638ef-bfc9-4df7-a8d0-7069cca96800 req-ac7a458e-644b-483a-9493-47fb4c705e11 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:37.010291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c11638ef-bfc9-4df7-a8d0-7069cca96800 req-ac7a458e-644b-483a-9493-47fb4c705e11 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:37.029280 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-c11638ef-bfc9-4df7-a8d0-7069cca96800 req-ac7a458e-644b-483a-9493-47fb4c705e11 service nova] Creating event network-changed:dd262c9c-9a21-4330-8536-21fd5315edaa for instance 4b76c27e-3a75-40b8-b777-934f969dc6de on nch1-master-1 May 28 21:14:37.036700 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-c11638ef-bfc9-4df7-a8d0-7069cca96800 req-ac7a458e-644b-483a-9493-47fb4c705e11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041866 May 28 21:14:37.037778 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1574/3180] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:37.112804 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-54ff09e1-562b-4285-a1c4-7b570d70bb1b tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.532261 May 28 21:14:37.114967 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1607/3181] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:14:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:14:37.127437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f7038f45-edf2-457f-851d-849726ca53f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:37.128262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f7038f45-edf2-457f-851d-849726ca53f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:37.328904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f7038f45-edf2-457f-851d-849726ca53f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:37.364184 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f7038f45-edf2-457f-851d-849726ca53f7 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1215 microversion: 2.1 time: 0.238685 May 28 21:14:37.381352 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1575/3182] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:37 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1215 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:37.445871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c14795a2-4694-4361-8634-40d56dd20e5c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:37.447325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c14795a2-4694-4361-8634-40d56dd20e5c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:37.481402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c14795a2-4694-4361-8634-40d56dd20e5c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:37.482360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c14795a2-4694-4361-8634-40d56dd20e5c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:37.487366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c14795a2-4694-4361-8634-40d56dd20e5c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:37.498021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c14795a2-4694-4361-8634-40d56dd20e5c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:37.919135 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c14795a2-4694-4361-8634-40d56dd20e5c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:37.946659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c14795a2-4694-4361-8634-40d56dd20e5c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:37.953460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c14795a2-4694-4361-8634-40d56dd20e5c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:37.955715 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c14795a2-4694-4361-8634-40d56dd20e5c tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.520832 May 28 21:14:37.957657 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1608/3183] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:37 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:38.009943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3a077ce3-6bde-4bfd-bef2-e3f3552c0e4c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:38.012881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3a077ce3-6bde-4bfd-bef2-e3f3552c0e4c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:38.021697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a077ce3-6bde-4bfd-bef2-e3f3552c0e4c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:38.030101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a077ce3-6bde-4bfd-bef2-e3f3552c0e4c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:38.030101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a077ce3-6bde-4bfd-bef2-e3f3552c0e4c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:38.030101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3a077ce3-6bde-4bfd-bef2-e3f3552c0e4c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:38.282890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3a077ce3-6bde-4bfd-bef2-e3f3552c0e4c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:38.291327 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3a077ce3-6bde-4bfd-bef2-e3f3552c0e4c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1322 microversion: 2.1 time: 0.285646 May 28 21:14:38.292662 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1576/3184] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:38 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:38.386678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-de98ee40-1ad7-40e0-a66c-ce2b3c6e9ed2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:38.387304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-de98ee40-1ad7-40e0-a66c-ce2b3c6e9ed2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:38.442630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-de98ee40-1ad7-40e0-a66c-ce2b3c6e9ed2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:38.449863 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-de98ee40-1ad7-40e0-a66c-ce2b3c6e9ed2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1215 microversion: 2.1 time: 0.067102 May 28 21:14:38.450717 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1609/3185] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:38 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:38.894745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-aadf5cb7-fa8f-45f4-8eae-b9016d6874cb req-ffdbfa89-493d-44fc-845e-fe3860ea3f8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351", "tag": "982c84ba-01d7-43f0-804a-d47803d30337"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:38.907323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-aadf5cb7-fa8f-45f4-8eae-b9016d6874cb req-ffdbfa89-493d-44fc-845e-fe3860ea3f8f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:38.907989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-aadf5cb7-fa8f-45f4-8eae-b9016d6874cb req-ffdbfa89-493d-44fc-845e-fe3860ea3f8f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:38.930496 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-aadf5cb7-fa8f-45f4-8eae-b9016d6874cb req-ffdbfa89-493d-44fc-845e-fe3860ea3f8f service nova] Creating event network-changed:982c84ba-01d7-43f0-804a-d47803d30337 for instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 on nch1-master-1 May 28 21:14:38.935698 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-aadf5cb7-fa8f-45f4-8eae-b9016d6874cb req-ffdbfa89-493d-44fc-845e-fe3860ea3f8f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046070 May 28 21:14:38.938313 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1577/3186] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:38.976103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-36ce37f6-de38-40f1-a425-311873583208 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:38.976670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-36ce37f6-de38-40f1-a425-311873583208 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:38.993999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36ce37f6-de38-40f1-a425-311873583208 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:38.994457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36ce37f6-de38-40f1-a425-311873583208 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:38.995253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36ce37f6-de38-40f1-a425-311873583208 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:38.995705 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36ce37f6-de38-40f1-a425-311873583208 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:39.311347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-011a8b6a-bf1f-40ff-97b5-f7361ffab72a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:39.312062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-011a8b6a-bf1f-40ff-97b5-f7361ffab72a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:39.325657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-011a8b6a-bf1f-40ff-97b5-f7361ffab72a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:39.326145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-011a8b6a-bf1f-40ff-97b5-f7361ffab72a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:39.334112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-011a8b6a-bf1f-40ff-97b5-f7361ffab72a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:39.334112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-011a8b6a-bf1f-40ff-97b5-f7361ffab72a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:39.493561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-36ce37f6-de38-40f1-a425-311873583208 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:39.504184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-36ce37f6-de38-40f1-a425-311873583208 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:39.505727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-36ce37f6-de38-40f1-a425-311873583208 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:39.507251 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-36ce37f6-de38-40f1-a425-311873583208 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.535802 May 28 21:14:39.507918 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1610/3187] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:38 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:39.512566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ec15030a-6925-42d2-9739-b483837cfe26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:39.513187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ec15030a-6925-42d2-9739-b483837cfe26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:39.537774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec15030a-6925-42d2-9739-b483837cfe26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:39.537774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec15030a-6925-42d2-9739-b483837cfe26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:39.537774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec15030a-6925-42d2-9739-b483837cfe26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:39.537774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec15030a-6925-42d2-9739-b483837cfe26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:39.654892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-011a8b6a-bf1f-40ff-97b5-f7361ffab72a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:39.666357 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-011a8b6a-bf1f-40ff-97b5-f7361ffab72a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1322 microversion: 2.1 time: 0.360105 May 28 21:14:39.674093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ec15030a-6925-42d2-9739-b483837cfe26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:39.678399 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1578/3188] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:39 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:39.685330 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ec15030a-6925-42d2-9739-b483837cfe26 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1267 microversion: 2.1 time: 0.176323 May 28 21:14:39.695811 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1611/3189] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:39 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:40.527114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-031a329a-d665-45c0-9c7e-f532ab6257be tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:40.527637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-031a329a-d665-45c0-9c7e-f532ab6257be tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:40.535412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-031a329a-d665-45c0-9c7e-f532ab6257be tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:40.535871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-031a329a-d665-45c0-9c7e-f532ab6257be tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:40.536648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-031a329a-d665-45c0-9c7e-f532ab6257be tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:40.537089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-031a329a-d665-45c0-9c7e-f532ab6257be tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:40.682948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b6a117b6-9b22-4925-8ead-a199181f6db6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:40.684098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b6a117b6-9b22-4925-8ead-a199181f6db6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:40.691624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b6a117b6-9b22-4925-8ead-a199181f6db6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:40.692754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b6a117b6-9b22-4925-8ead-a199181f6db6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:40.693307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b6a117b6-9b22-4925-8ead-a199181f6db6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:40.694114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b6a117b6-9b22-4925-8ead-a199181f6db6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:40.836272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-031a329a-d665-45c0-9c7e-f532ab6257be tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:40.857311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-031a329a-d665-45c0-9c7e-f532ab6257be tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:40.861540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-031a329a-d665-45c0-9c7e-f532ab6257be tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:40.863370 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-031a329a-d665-45c0-9c7e-f532ab6257be tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.340276 May 28 21:14:40.875767 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1579/3190] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:40 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:40.881573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4bbef28c-4e40-40ab-be04-0ed7ad361f48 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:40.883954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4bbef28c-4e40-40ab-be04-0ed7ad361f48 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:40.891829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bbef28c-4e40-40ab-be04-0ed7ad361f48 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:40.892351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bbef28c-4e40-40ab-be04-0ed7ad361f48 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:40.893812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bbef28c-4e40-40ab-be04-0ed7ad361f48 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:40.894287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bbef28c-4e40-40ab-be04-0ed7ad361f48 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:40.913308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b6a117b6-9b22-4925-8ead-a199181f6db6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:40.922558 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b6a117b6-9b22-4925-8ead-a199181f6db6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1322 microversion: 2.1 time: 0.243546 May 28 21:14:40.932547 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1612/3191] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:40 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:41.097130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4bbef28c-4e40-40ab-be04-0ed7ad361f48 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:41.106894 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4bbef28c-4e40-40ab-be04-0ed7ad361f48 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1315 microversion: 2.1 time: 0.240571 May 28 21:14:41.108167 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1580/3192] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:40 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:41.884030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-73256b7a-a04c-41d8-bf3c-adf26b4590b4 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:41.884596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-f2d57b50-237c-453b-a1b0-f2d0de344bd5 req-118a4ac2-6484-4bd7-8d78-9924ee33b609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f64c5f55-2432-4685-9b86-01905d00c58d", "tag": "b1f6d241-af74-4eca-81fb-de8868d62a62"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:41.884987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-73256b7a-a04c-41d8-bf3c-adf26b4590b4 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:41.888861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:41.900521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-73256b7a-a04c-41d8-bf3c-adf26b4590b4 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:41.904183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-73256b7a-a04c-41d8-bf3c-adf26b4590b4 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:41.904324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f2d57b50-237c-453b-a1b0-f2d0de344bd5 req-118a4ac2-6484-4bd7-8d78-9924ee33b609 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:41.906526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f2d57b50-237c-453b-a1b0-f2d0de344bd5 req-118a4ac2-6484-4bd7-8d78-9924ee33b609 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:41.906958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-73256b7a-a04c-41d8-bf3c-adf26b4590b4 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:41.907606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-73256b7a-a04c-41d8-bf3c-adf26b4590b4 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:41.921279 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-f2d57b50-237c-453b-a1b0-f2d0de344bd5 req-118a4ac2-6484-4bd7-8d78-9924ee33b609 service nova] Creating event network-changed:b1f6d241-af74-4eca-81fb-de8868d62a62 for instance f64c5f55-2432-4685-9b86-01905d00c58d on nch2-master-1 May 28 21:14:41.927245 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-f2d57b50-237c-453b-a1b0-f2d0de344bd5 req-118a4ac2-6484-4bd7-8d78-9924ee33b609 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048805 May 28 21:14:41.929512 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1613/3193] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:41.953612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9bb1962a-55c2-4f4a-a248-021b8e58cb27 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:41.954613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9bb1962a-55c2-4f4a-a248-021b8e58cb27 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:41.963468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bb1962a-55c2-4f4a-a248-021b8e58cb27 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:41.964345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bb1962a-55c2-4f4a-a248-021b8e58cb27 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:41.967716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bb1962a-55c2-4f4a-a248-021b8e58cb27 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:41.968380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bb1962a-55c2-4f4a-a248-021b8e58cb27 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:42.228781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-73256b7a-a04c-41d8-bf3c-adf26b4590b4 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:42.244725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-73256b7a-a04c-41d8-bf3c-adf26b4590b4 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:42.247803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-73256b7a-a04c-41d8-bf3c-adf26b4590b4 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:42.256815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9bb1962a-55c2-4f4a-a248-021b8e58cb27 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:42.266251 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-73256b7a-a04c-41d8-bf3c-adf26b4590b4 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.384441 May 28 21:14:42.266418 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9bb1962a-55c2-4f4a-a248-021b8e58cb27 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1322 microversion: 2.1 time: 0.318419 May 28 21:14:42.273887 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1614/3194] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:41 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:42.274061 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1581/3195] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:41 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:14:42.282688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6e67d517-7740-4d30-8567-380417355997 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:42.283325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6e67d517-7740-4d30-8567-380417355997 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:42.290728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e67d517-7740-4d30-8567-380417355997 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:42.291193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e67d517-7740-4d30-8567-380417355997 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:42.292227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e67d517-7740-4d30-8567-380417355997 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:42.292855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e67d517-7740-4d30-8567-380417355997 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:42.379703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-95ee4637-66a9-42d3-bd48-a24a09031390 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57f4e5e0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:42.462662 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-95ee4637-66a9-42d3-bd48-a24a09031390 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/f0736d5f-dee0-4f78-9322-8b36a96dc7c7" status: 200 len: 662 microversion: 2.1 time: 0.087252 May 28 21:14:42.463448 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1582/3196] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:42 2022] GET /compute/v2.1/images/f0736d5f-dee0-4f78-9322-8b36a96dc7c7 => generated 662 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:14:42.465591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6e67d517-7740-4d30-8567-380417355997 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:42.474627 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6e67d517-7740-4d30-8567-380417355997 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1315 microversion: 2.1 time: 0.205816 May 28 21:14:42.485818 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1615/3197] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:42 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:42.486476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2acceda4-6c15-442e-8fe3-e8e34b1518f8 req-a40de8ad-95ba-4dad-b5ed-cc25aaa5c59f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-plugged", "status": "completed", "tag": "b9f06dda-68a6-48bd-8781-3e0aabc602a4"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:42.489423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b004f88a-3fe2-4ef1-ac0a-64204345aea8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d645f08b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:42.497783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2acceda4-6c15-442e-8fe3-e8e34b1518f8 req-a40de8ad-95ba-4dad-b5ed-cc25aaa5c59f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:42.499089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2acceda4-6c15-442e-8fe3-e8e34b1518f8 req-a40de8ad-95ba-4dad-b5ed-cc25aaa5c59f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:42.521573 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2acceda4-6c15-442e-8fe3-e8e34b1518f8 req-a40de8ad-95ba-4dad-b5ed-cc25aaa5c59f service nova] Creating event network-vif-plugged:b9f06dda-68a6-48bd-8781-3e0aabc602a4 for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:14:42.529150 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2acceda4-6c15-442e-8fe3-e8e34b1518f8 req-a40de8ad-95ba-4dad-b5ed-cc25aaa5c59f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061532 May 28 21:14:42.530418 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1583/3198] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:42.559004 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b004f88a-3fe2-4ef1-ac0a-64204345aea8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/f0736d5f-dee0-4f78-9322-8b36a96dc7c7" status: 200 len: 662 microversion: 2.1 time: 0.078994 May 28 21:14:42.560428 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1616/3199] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:42 2022] GET /compute/v2.1/images/f0736d5f-dee0-4f78-9322-8b36a96dc7c7 => generated 662 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:42.961062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-811376279", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "ca803b4d-8584-4327-9f76-66ddebb3c209"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:43.017992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] validate_networks() for [('ca803b4d-8584-4327-9f76-66ddebb3c209', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:14:43.284417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3372c674-d93e-4946-aee4-eba878a6dc8f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:43.285196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3372c674-d93e-4946-aee4-eba878a6dc8f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:43.293437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3372c674-d93e-4946-aee4-eba878a6dc8f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:43.293752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3372c674-d93e-4946-aee4-eba878a6dc8f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:43.294582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3372c674-d93e-4946-aee4-eba878a6dc8f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:43.295153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3372c674-d93e-4946-aee4-eba878a6dc8f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:43.839511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:14:43.839821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:14:43.840264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:14:43.841037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:14:43.841574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:14:43.842749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3372c674-d93e-4946-aee4-eba878a6dc8f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:43.850796 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3372c674-d93e-4946-aee4-eba878a6dc8f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1322 microversion: 2.1 time: 0.571238 May 28 21:14:43.851375 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1617/3200] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:43 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1322 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:43.865775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-882515c9-d031-47b8-b506-670a40d807cf tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:43.867349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-882515c9-d031-47b8-b506-670a40d807cf tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:43.868014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:43.873452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:43.874779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:43.875637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:43.880719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-882515c9-d031-47b8-b506-670a40d807cf tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:43.887897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-882515c9-d031-47b8-b506-670a40d807cf tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:43.889956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-882515c9-d031-47b8-b506-670a40d807cf tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:43.890420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-882515c9-d031-47b8-b506-670a40d807cf tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:43.906015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:14:43.912868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for user 572170ccd67e4facbf10dad7cd1491c1 and project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:14:43.931853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:14:43.935538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:14:44.102944 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e0df60b1-4e9e-4bfe-9f2a-b9da3e8c7889 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.286228 May 28 21:14:44.108790 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1584/3201] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:14:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:14:44.114289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-845b2dc3-6259-42a7-8b90-6e9aa000cfc9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:44.115153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-845b2dc3-6259-42a7-8b90-6e9aa000cfc9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:44.122913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-845b2dc3-6259-42a7-8b90-6e9aa000cfc9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:44.123621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-845b2dc3-6259-42a7-8b90-6e9aa000cfc9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:44.124839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-845b2dc3-6259-42a7-8b90-6e9aa000cfc9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:44.125489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-845b2dc3-6259-42a7-8b90-6e9aa000cfc9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:44.169769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-882515c9-d031-47b8-b506-670a40d807cf tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:44.188349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-882515c9-d031-47b8-b506-670a40d807cf tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:44.188349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-882515c9-d031-47b8-b506-670a40d807cf tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:44.188349 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-882515c9-d031-47b8-b506-670a40d807cf tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.334821 May 28 21:14:44.188349 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1618/3202] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:43 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:44.202106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4ce65405-4f0d-497e-9433-279766f49ad5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:44.203793 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4ce65405-4f0d-497e-9433-279766f49ad5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:44.322989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4ce65405-4f0d-497e-9433-279766f49ad5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:44.338902 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4ce65405-4f0d-497e-9433-279766f49ad5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 200 len: 1192 microversion: 2.1 time: 0.144158 May 28 21:14:44.342853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-845b2dc3-6259-42a7-8b90-6e9aa000cfc9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:44.345307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:44.350498 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1619/3203] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:44 2022] GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 1192 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:44.357360 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-845b2dc3-6259-42a7-8b90-6e9aa000cfc9 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1315 microversion: 2.1 time: 0.247409 May 28 21:14:44.357992 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1585/3204] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:44 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:44.479898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6e32ddcd-652b-474f-87ac-4328a2950a83 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:44.481591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6e32ddcd-652b-474f-87ac-4328a2950a83 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:44.490285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e32ddcd-652b-474f-87ac-4328a2950a83 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:44.491564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e32ddcd-652b-474f-87ac-4328a2950a83 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:44.492508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e32ddcd-652b-474f-87ac-4328a2950a83 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:44.493242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e32ddcd-652b-474f-87ac-4328a2950a83 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:44.544877 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6e32ddcd-652b-474f-87ac-4328a2950a83 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "POST /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3/action" status: 200 len: 24557 microversion: 2.1 time: 0.068849 May 28 21:14:44.545810 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1620/3205] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:14:44 2022] POST /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3/action => generated 24557 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:14:44.567982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1b90b219-6897-4f29-8b30-4424d44fc79e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:44.572116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1b90b219-6897-4f29-8b30-4424d44fc79e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:44.572884 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1b90b219-6897-4f29-8b30-4424d44fc79e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Searching by: {'deleted': False, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:14:44.582966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b90b219-6897-4f29-8b30-4424d44fc79e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:44.588852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b90b219-6897-4f29-8b30-4424d44fc79e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:44.588852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b90b219-6897-4f29-8b30-4424d44fc79e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:44.589207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b90b219-6897-4f29-8b30-4424d44fc79e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:44.605106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-11d6eb8d-c559-40ec-8f78-88cb3ac8f1c0 req-9ecd6c81-89ef-464d-99e4-2009bb7dc762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-plugged", "status": "completed", "tag": "63e35303-0289-4426-8f0f-dfccabdbfba7"}, {"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-plugged", "status": "completed", "tag": "8e9126c9-eb54-4fe2-8d2d-2fd3d4b4fe8d"}, {"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-plugged", "status": "completed", "tag": "ec5c409c-5c1a-40d9-8be5-b5bc17805f84"}, {"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-plugged", "status": "completed", "tag": "cd216d91-0e66-48bd-ba1b-debee67cf784"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:44.623765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-11d6eb8d-c559-40ec-8f78-88cb3ac8f1c0 req-9ecd6c81-89ef-464d-99e4-2009bb7dc762 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:44.624512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-11d6eb8d-c559-40ec-8f78-88cb3ac8f1c0 req-9ecd6c81-89ef-464d-99e4-2009bb7dc762 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:44.642534 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-11d6eb8d-c559-40ec-8f78-88cb3ac8f1c0 req-9ecd6c81-89ef-464d-99e4-2009bb7dc762 service nova] Creating event network-vif-plugged:63e35303-0289-4426-8f0f-dfccabdbfba7 for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:14:44.644078 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-11d6eb8d-c559-40ec-8f78-88cb3ac8f1c0 req-9ecd6c81-89ef-464d-99e4-2009bb7dc762 service nova] Creating event network-vif-plugged:8e9126c9-eb54-4fe2-8d2d-2fd3d4b4fe8d for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:14:44.644199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-1b90b219-6897-4f29-8b30-4424d44fc79e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:14:44.644308 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-11d6eb8d-c559-40ec-8f78-88cb3ac8f1c0 req-9ecd6c81-89ef-464d-99e4-2009bb7dc762 service nova] Creating event network-vif-plugged:ec5c409c-5c1a-40d9-8be5-b5bc17805f84 for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:14:44.644769 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-11d6eb8d-c559-40ec-8f78-88cb3ac8f1c0 req-9ecd6c81-89ef-464d-99e4-2009bb7dc762 service nova] Creating event network-vif-plugged:cd216d91-0e66-48bd-ba1b-debee67cf784 for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:14:44.651390 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-11d6eb8d-c559-40ec-8f78-88cb3ac8f1c0 req-9ecd6c81-89ef-464d-99e4-2009bb7dc762 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.052169 May 28 21:14:44.652325 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1621/3206] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:44.657818 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-60313746-2636-453b-bb4f-6d9397c7051a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57f059d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:44.683170 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1b90b219-6897-4f29-8b30-4424d44fc79e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.119461 May 28 21:14:44.684449 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1586/3207] 10.222.0.33 () {58 vars in 1124 bytes} [Sat May 28 21:14:44 2022] GET /compute/v2.1/servers => generated 344 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:44.701306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e77bccd2-0bff-48ed-8baa-a5dc387e48b0 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:44.704948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e77bccd2-0bff-48ed-8baa-a5dc387e48b0 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:44.706028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e77bccd2-0bff-48ed-8baa-a5dc387e48b0 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Searching by: {'deleted': False, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:14:44.711585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e77bccd2-0bff-48ed-8baa-a5dc387e48b0 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:44.712234 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-60313746-2636-453b-bb4f-6d9397c7051a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/103b6115-c9f0-4cc2-92db-1d647cac081b" status: 200 len: 662 microversion: 2.1 time: 0.058204 May 28 21:14:44.712392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e77bccd2-0bff-48ed-8baa-a5dc387e48b0 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:44.713062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e77bccd2-0bff-48ed-8baa-a5dc387e48b0 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:44.713495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e77bccd2-0bff-48ed-8baa-a5dc387e48b0 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:44.713661 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1622/3208] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:44 2022] GET /compute/v2.1/images/103b6115-c9f0-4cc2-92db-1d647cac081b => generated 662 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:44.732609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7d9dc287-b920-4336-af5a-424c33a7042d tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d6422c940>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:44.754354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-e77bccd2-0bff-48ed-8baa-a5dc387e48b0 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:14:44.799236 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7d9dc287-b920-4336-af5a-424c33a7042d tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/103b6115-c9f0-4cc2-92db-1d647cac081b" status: 200 len: 662 microversion: 2.1 time: 0.076252 May 28 21:14:44.800212 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1623/3209] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:44 2022] GET /compute/v2.1/images/103b6115-c9f0-4cc2-92db-1d647cac081b => generated 662 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:44.824806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e77bccd2-0bff-48ed-8baa-a5dc387e48b0 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:44.831577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e77bccd2-0bff-48ed-8baa-a5dc387e48b0 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:44.832035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e77bccd2-0bff-48ed-8baa-a5dc387e48b0 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:44.869167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-38092192-2dfd-40f7-b87d-759432b4feb6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:44.871456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-38092192-2dfd-40f7-b87d-759432b4feb6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:44.878999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38092192-2dfd-40f7-b87d-759432b4feb6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:44.879731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38092192-2dfd-40f7-b87d-759432b4feb6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:44.881169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38092192-2dfd-40f7-b87d-759432b4feb6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:44.882439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38092192-2dfd-40f7-b87d-759432b4feb6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:44.903143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:45.030676 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e77bccd2-0bff-48ed-8baa-a5dc387e48b0 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 1606 microversion: 2.1 time: 0.332361 May 28 21:14:45.031151 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1587/3210] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:14:44 2022] GET /compute/v2.1/servers/detail => generated 1606 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:45.049352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e7d1554e-3ce6-41be-a4cc-ca8f42d99f20 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:45.087995 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e7d1554e-3ce6-41be-a4cc-ca8f42d99f20 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040332 May 28 21:14:45.088894 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1588/3211] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:14:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:14:45.115492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-38092192-2dfd-40f7-b87d-759432b4feb6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:45.124490 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-38092192-2dfd-40f7-b87d-759432b4feb6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1322 microversion: 2.1 time: 0.259695 May 28 21:14:45.133817 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1624/3212] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:44 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:45.206883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e1ec42ed-6558-4455-9980-c9a763b78275 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:45.208118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e1ec42ed-6558-4455-9980-c9a763b78275 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:45.214899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1ec42ed-6558-4455-9980-c9a763b78275 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:45.215358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1ec42ed-6558-4455-9980-c9a763b78275 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:45.216175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1ec42ed-6558-4455-9980-c9a763b78275 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:45.216692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1ec42ed-6558-4455-9980-c9a763b78275 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:45.358077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b87b463b-3fc3-4fb0-8768-7b22f173609a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:45.358666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b87b463b-3fc3-4fb0-8768-7b22f173609a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:45.448615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b87b463b-3fc3-4fb0-8768-7b22f173609a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:45.456384 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b87b463b-3fc3-4fb0-8768-7b22f173609a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 200 len: 1192 microversion: 2.1 time: 0.103160 May 28 21:14:45.457276 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1625/3213] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:45 2022] GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 1192 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:45.477866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7ea3e326-c8cc-4047-9aeb-a6af09dbd821 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:45.477866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7ea3e326-c8cc-4047-9aeb-a6af09dbd821 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:45.483241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ea3e326-c8cc-4047-9aeb-a6af09dbd821 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:45.483940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ea3e326-c8cc-4047-9aeb-a6af09dbd821 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:45.485550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ea3e326-c8cc-4047-9aeb-a6af09dbd821 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:45.486181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ea3e326-c8cc-4047-9aeb-a6af09dbd821 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:45.486762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e1ec42ed-6558-4455-9980-c9a763b78275 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:45.497598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e1ec42ed-6558-4455-9980-c9a763b78275 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:45.499928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e1ec42ed-6558-4455-9980-c9a763b78275 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:45.505384 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e1ec42ed-6558-4455-9980-c9a763b78275 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.302515 May 28 21:14:45.506232 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1589/3214] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:45 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:45.633892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7ea3e326-c8cc-4047-9aeb-a6af09dbd821 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:45.641670 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7ea3e326-c8cc-4047-9aeb-a6af09dbd821 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1315 microversion: 2.1 time: 0.173539 May 28 21:14:45.642281 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1626/3215] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:45 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:46.144866 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2a163f4a-fb17-48df-819d-537dd1386b21 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:46.146577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2a163f4a-fb17-48df-819d-537dd1386b21 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:46.157403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a163f4a-fb17-48df-819d-537dd1386b21 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:46.163616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a163f4a-fb17-48df-819d-537dd1386b21 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:46.163616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a163f4a-fb17-48df-819d-537dd1386b21 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:46.163616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a163f4a-fb17-48df-819d-537dd1386b21 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:46.330515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2a163f4a-fb17-48df-819d-537dd1386b21 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:46.341518 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2a163f4a-fb17-48df-819d-537dd1386b21 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1322 microversion: 2.1 time: 0.204246 May 28 21:14:46.352355 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1590/3216] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:46 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:46.475141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d8f8eb43-0717-4799-9377-0c125e755b54 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:46.476438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d8f8eb43-0717-4799-9377-0c125e755b54 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:46.483516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8f8eb43-0717-4799-9377-0c125e755b54 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:46.483979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8f8eb43-0717-4799-9377-0c125e755b54 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:46.485106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8f8eb43-0717-4799-9377-0c125e755b54 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:46.485482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8f8eb43-0717-4799-9377-0c125e755b54 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:46.530873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c9b7dcb-ae11-46dd-a18b-67dbdda1bc7a tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:46.532278 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8c9b7dcb-ae11-46dd-a18b-67dbdda1bc7a tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:46.539575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c9b7dcb-ae11-46dd-a18b-67dbdda1bc7a tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:46.543563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c9b7dcb-ae11-46dd-a18b-67dbdda1bc7a tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:46.543563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c9b7dcb-ae11-46dd-a18b-67dbdda1bc7a tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:46.543563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c9b7dcb-ae11-46dd-a18b-67dbdda1bc7a tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:46.564546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d8f8eb43-0717-4799-9377-0c125e755b54 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:46.579220 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d8f8eb43-0717-4799-9377-0c125e755b54 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 200 len: 1244 microversion: 2.1 time: 0.108604 May 28 21:14:46.590718 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1627/3217] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:46 2022] GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 1244 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:46.661990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e45d51e4-6bde-4726-822d-7066176fcbfb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:46.662701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e45d51e4-6bde-4726-822d-7066176fcbfb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:46.670609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e45d51e4-6bde-4726-822d-7066176fcbfb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:46.671156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e45d51e4-6bde-4726-822d-7066176fcbfb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:46.672028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e45d51e4-6bde-4726-822d-7066176fcbfb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:46.672534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e45d51e4-6bde-4726-822d-7066176fcbfb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:46.749783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:46.798319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8c9b7dcb-ae11-46dd-a18b-67dbdda1bc7a tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:46.810103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8c9b7dcb-ae11-46dd-a18b-67dbdda1bc7a tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:46.810103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8c9b7dcb-ae11-46dd-a18b-67dbdda1bc7a tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:46.810355 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8c9b7dcb-ae11-46dd-a18b-67dbdda1bc7a tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.289707 May 28 21:14:46.811443 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1591/3218] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:46 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:14:46.819429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-f04e1a04-52ac-4197-803b-bca911e04e03 req-e6720e67-2acf-487f-aad7-e1fac018e5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-plugged", "status": "completed", "tag": "6b0d782b-1790-41fb-93ea-5c3cb2d2bf1a"}, {"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-plugged", "status": "completed", "tag": "a093c2f2-1530-48bb-9240-39d12badf81f"}, {"server_uuid": "f64c5f55-2432-4685-9b86-01905d00c58d", "name": "network-vif-plugged", "status": "completed", "tag": "b1f6d241-af74-4eca-81fb-de8868d62a62"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:46.828919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f04e1a04-52ac-4197-803b-bca911e04e03 req-e6720e67-2acf-487f-aad7-e1fac018e5c0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:46.834523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f04e1a04-52ac-4197-803b-bca911e04e03 req-e6720e67-2acf-487f-aad7-e1fac018e5c0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:46.843205 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-f04e1a04-52ac-4197-803b-bca911e04e03 req-e6720e67-2acf-487f-aad7-e1fac018e5c0 service nova] Creating event network-vif-plugged:6b0d782b-1790-41fb-93ea-5c3cb2d2bf1a for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:14:46.843735 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-f04e1a04-52ac-4197-803b-bca911e04e03 req-e6720e67-2acf-487f-aad7-e1fac018e5c0 service nova] Creating event network-vif-plugged:a093c2f2-1530-48bb-9240-39d12badf81f for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:14:46.844448 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-f04e1a04-52ac-4197-803b-bca911e04e03 req-e6720e67-2acf-487f-aad7-e1fac018e5c0 service nova] Creating event network-vif-plugged:b1f6d241-af74-4eca-81fb-de8868d62a62 for instance f64c5f55-2432-4685-9b86-01905d00c58d on nch2-master-1 May 28 21:14:46.854007 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-f04e1a04-52ac-4197-803b-bca911e04e03 req-e6720e67-2acf-487f-aad7-e1fac018e5c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039263 May 28 21:14:46.854625 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1592/3219] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:46.879807 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e45d51e4-6bde-4726-822d-7066176fcbfb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:46.887491 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e45d51e4-6bde-4726-822d-7066176fcbfb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1315 microversion: 2.1 time: 0.232069 May 28 21:14:46.888088 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1628/3220] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:46 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:46.913871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8893b467-dae9-4c5d-bdab-663893d8ab4f tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d5746a4c0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:46.960620 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8893b467-dae9-4c5d-bdab-663893d8ab4f tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/187e8a9e-ae1c-493b-9887-fc3353ffa1b5" status: 200 len: 661 microversion: 2.1 time: 0.052119 May 28 21:14:46.961539 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1593/3221] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:46 2022] GET /compute/v2.1/images/187e8a9e-ae1c-493b-9887-fc3353ffa1b5 => generated 661 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:46.973638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-df87988c-24e8-4ac2-95e6-cb0e25feda72 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d640aeca0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:47.021749 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-df87988c-24e8-4ac2-95e6-cb0e25feda72 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/187e8a9e-ae1c-493b-9887-fc3353ffa1b5" status: 200 len: 661 microversion: 2.1 time: 0.052250 May 28 21:14:47.023609 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1629/3222] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:14:46 2022] GET /compute/v2.1/images/187e8a9e-ae1c-493b-9887-fc3353ffa1b5 => generated 661 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:47.175645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-715724947", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:47.228814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:14:47.358733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ddf540ca-aa56-4af2-85fc-95c8dd23f839 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:47.359821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ddf540ca-aa56-4af2-85fc-95c8dd23f839 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:47.366889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddf540ca-aa56-4af2-85fc-95c8dd23f839 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:47.367478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddf540ca-aa56-4af2-85fc-95c8dd23f839 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:47.368490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddf540ca-aa56-4af2-85fc-95c8dd23f839 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:47.369051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddf540ca-aa56-4af2-85fc-95c8dd23f839 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:47.439210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:14:47.439676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:14:47.440165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:14:47.440775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:14:47.441198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:14:47.451014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:47.451476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:47.453101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:47.453808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:47.473221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Getting quotas for project cf454e1b4e6a4c45af04865b154c41a9. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:14:47.475883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:47.486563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Getting quotas for user 98ab12b74029438a9a1d19e505d1fc6d and project cf454e1b4e6a4c45af04865b154c41a9. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:14:47.501256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:14:47.504975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 144ab366-0448-410f-9093-91dec09b838c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:14:47.546511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ddf540ca-aa56-4af2-85fc-95c8dd23f839 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:47.555134 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ddf540ca-aa56-4af2-85fc-95c8dd23f839 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1322 microversion: 2.1 time: 0.200237 May 28 21:14:47.555726 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1630/3223] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:47 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:47.596776 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-85edc232-dcd7-49dd-938e-ae033fe7f36f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:47.597433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-85edc232-dcd7-49dd-938e-ae033fe7f36f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:47.603854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85edc232-dcd7-49dd-938e-ae033fe7f36f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:47.604319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85edc232-dcd7-49dd-938e-ae033fe7f36f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:47.605101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85edc232-dcd7-49dd-938e-ae033fe7f36f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:47.605550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85edc232-dcd7-49dd-938e-ae033fe7f36f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:47.668055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-85edc232-dcd7-49dd-938e-ae033fe7f36f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:47.676403 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-85edc232-dcd7-49dd-938e-ae033fe7f36f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 200 len: 1250 microversion: 2.1 time: 0.083586 May 28 21:14:47.686660 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1631/3224] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:47 2022] GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:47.707502 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-19a78f66-a3a6-41de-81ab-143002a86cd3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537856 May 28 21:14:47.708155 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1594/3225] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:14:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:14:47.828653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aa0d7add-de5c-4a87-af23-f9bb8269ff31 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:47.833691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-412311113", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:47.845474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aa0d7add-de5c-4a87-af23-f9bb8269ff31 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:47.853031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa0d7add-de5c-4a87-af23-f9bb8269ff31 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:47.853675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa0d7add-de5c-4a87-af23-f9bb8269ff31 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:47.857682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa0d7add-de5c-4a87-af23-f9bb8269ff31 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:47.858347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa0d7add-de5c-4a87-af23-f9bb8269ff31 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:47.911001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:14:48.238157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aa0d7add-de5c-4a87-af23-f9bb8269ff31 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:48.256432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aa0d7add-de5c-4a87-af23-f9bb8269ff31 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:48.263308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aa0d7add-de5c-4a87-af23-f9bb8269ff31 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:48.264632 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aa0d7add-de5c-4a87-af23-f9bb8269ff31 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.439813 May 28 21:14:48.265325 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1632/3226] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:47 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:48.276189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:14:48.276475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:14:48.278952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:14:48.278952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:14:48.278952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:14:48.283693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a4888f00-9163-4be9-ac4f-6b5c3473f6a0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:48.285039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a4888f00-9163-4be9-ac4f-6b5c3473f6a0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:48.287743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:48.288239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:48.289056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:48.289507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:48.294793 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4888f00-9163-4be9-ac4f-6b5c3473f6a0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:48.296490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4888f00-9163-4be9-ac4f-6b5c3473f6a0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:48.298594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4888f00-9163-4be9-ac4f-6b5c3473f6a0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:48.299414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4888f00-9163-4be9-ac4f-6b5c3473f6a0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:48.315694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Getting quotas for project cf454e1b4e6a4c45af04865b154c41a9. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:14:48.322509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Getting quotas for user 98ab12b74029438a9a1d19e505d1fc6d and project cf454e1b4e6a4c45af04865b154c41a9. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:14:48.338037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:14:48.340658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:14:48.485952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a4888f00-9163-4be9-ac4f-6b5c3473f6a0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:48.495028 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a4888f00-9163-4be9-ac4f-6b5c3473f6a0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1315 microversion: 2.1 time: 0.218607 May 28 21:14:48.495608 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1633/3227] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:48 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:48.522741 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cdd531cb-108e-48f8-b843-41f9209d935a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.692664 May 28 21:14:48.524362 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1595/3228] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:14:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:14:48.534534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3df490ce-297d-40c4-8787-6fa50c2e10fc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:48.535209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3df490ce-297d-40c4-8787-6fa50c2e10fc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:48.580090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4fd6d0b6-ea36-4295-9ee1-92b09849f6b4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:48.596830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4fd6d0b6-ea36-4295-9ee1-92b09849f6b4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:48.608255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fd6d0b6-ea36-4295-9ee1-92b09849f6b4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:48.608437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3df490ce-297d-40c4-8787-6fa50c2e10fc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:48.608879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fd6d0b6-ea36-4295-9ee1-92b09849f6b4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:48.609509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fd6d0b6-ea36-4295-9ee1-92b09849f6b4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:48.610281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fd6d0b6-ea36-4295-9ee1-92b09849f6b4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:48.616992 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3df490ce-297d-40c4-8787-6fa50c2e10fc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1217 microversion: 2.1 time: 0.086533 May 28 21:14:48.627176 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1634/3229] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:48 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:48.696160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9962c1c7-453b-41f0-a6db-e9189108d677 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:48.713053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9962c1c7-453b-41f0-a6db-e9189108d677 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:48.743155 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9962c1c7-453b-41f0-a6db-e9189108d677 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:48.746844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9962c1c7-453b-41f0-a6db-e9189108d677 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:48.747553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9962c1c7-453b-41f0-a6db-e9189108d677 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:48.748029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9962c1c7-453b-41f0-a6db-e9189108d677 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:48.808372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4fd6d0b6-ea36-4295-9ee1-92b09849f6b4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:48.818524 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4fd6d0b6-ea36-4295-9ee1-92b09849f6b4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1322 microversion: 2.1 time: 0.245025 May 28 21:14:48.829139 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1596/3230] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:48 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:48.873159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-cf603716-459c-482d-b1fc-c5f41ccdefe6 req-4ad5ca41-6316-4fd4-ac4b-9dde7e99562e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b76c27e-3a75-40b8-b777-934f969dc6de", "name": "network-vif-plugged", "status": "completed", "tag": "dd262c9c-9a21-4330-8536-21fd5315edaa"}, {"server_uuid": "6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351", "name": "network-vif-plugged", "status": "completed", "tag": "982c84ba-01d7-43f0-804a-d47803d30337"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:48.884010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cf603716-459c-482d-b1fc-c5f41ccdefe6 req-4ad5ca41-6316-4fd4-ac4b-9dde7e99562e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:48.884453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cf603716-459c-482d-b1fc-c5f41ccdefe6 req-4ad5ca41-6316-4fd4-ac4b-9dde7e99562e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:48.903207 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-cf603716-459c-482d-b1fc-c5f41ccdefe6 req-4ad5ca41-6316-4fd4-ac4b-9dde7e99562e service nova] Creating event network-vif-plugged:dd262c9c-9a21-4330-8536-21fd5315edaa for instance 4b76c27e-3a75-40b8-b777-934f969dc6de on nch1-master-1 May 28 21:14:48.903988 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-cf603716-459c-482d-b1fc-c5f41ccdefe6 req-4ad5ca41-6316-4fd4-ac4b-9dde7e99562e service nova] Creating event network-vif-plugged:982c84ba-01d7-43f0-804a-d47803d30337 for instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 on nch1-master-1 May 28 21:14:48.910736 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-cf603716-459c-482d-b1fc-c5f41ccdefe6 req-4ad5ca41-6316-4fd4-ac4b-9dde7e99562e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041416 May 28 21:14:48.911875 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1597/3231] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:48.941502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9962c1c7-453b-41f0-a6db-e9189108d677 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:48.950850 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9962c1c7-453b-41f0-a6db-e9189108d677 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 200 len: 1292 microversion: 2.1 time: 0.260329 May 28 21:14:48.951662 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1635/3232] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:48 2022] GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 1292 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:49.285980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3866d5ea-de5e-4899-9e23-fd5cd42297fc tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:49.286692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3866d5ea-de5e-4899-9e23-fd5cd42297fc tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:49.293030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3866d5ea-de5e-4899-9e23-fd5cd42297fc tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:49.293421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3866d5ea-de5e-4899-9e23-fd5cd42297fc tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:49.294224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3866d5ea-de5e-4899-9e23-fd5cd42297fc tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:49.294662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3866d5ea-de5e-4899-9e23-fd5cd42297fc tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:49.475857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-b60b3a2b-d5fe-4c47-8f17-364b0d8140f6 req-288986d8-e4b7-4dd5-958b-c186978654e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f2f9407-da1e-473e-a8a9-87ac9a287fa4", "tag": "6a35abfc-dc91-4685-902b-325510a0f642"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:49.482357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:49.487179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b60b3a2b-d5fe-4c47-8f17-364b0d8140f6 req-288986d8-e4b7-4dd5-958b-c186978654e2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:49.487769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b60b3a2b-d5fe-4c47-8f17-364b0d8140f6 req-288986d8-e4b7-4dd5-958b-c186978654e2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:49.491296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3866d5ea-de5e-4899-9e23-fd5cd42297fc tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:49.501362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3866d5ea-de5e-4899-9e23-fd5cd42297fc tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:49.502948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3866d5ea-de5e-4899-9e23-fd5cd42297fc tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:49.504254 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3866d5ea-de5e-4899-9e23-fd5cd42297fc tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1875 microversion: 2.42 time: 0.223566 May 28 21:14:49.505499 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1598/3233] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:49 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1875 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:49.508910 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b60b3a2b-d5fe-4c47-8f17-364b0d8140f6 req-288986d8-e4b7-4dd5-958b-c186978654e2 service nova] Creating event network-changed:6a35abfc-dc91-4685-902b-325510a0f642 for instance 6f2f9407-da1e-473e-a8a9-87ac9a287fa4 on nch2-master-1 May 28 21:14:49.514100 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-b60b3a2b-d5fe-4c47-8f17-364b0d8140f6 req-288986d8-e4b7-4dd5-958b-c186978654e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043063 May 28 21:14:49.515140 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1636/3234] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:14:49.515271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1df1db00-97dd-4bb8-aa7b-fa20a20e72d4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:49.515858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1df1db00-97dd-4bb8-aa7b-fa20a20e72d4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:49.522144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1df1db00-97dd-4bb8-aa7b-fa20a20e72d4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:49.523226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1df1db00-97dd-4bb8-aa7b-fa20a20e72d4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:49.524012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1df1db00-97dd-4bb8-aa7b-fa20a20e72d4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:49.524628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1df1db00-97dd-4bb8-aa7b-fa20a20e72d4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:49.636589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e97a2702-46dd-4f00-a7d6-838129270444 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:49.637712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e97a2702-46dd-4f00-a7d6-838129270444 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:49.708352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e97a2702-46dd-4f00-a7d6-838129270444 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:49.712690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1df1db00-97dd-4bb8-aa7b-fa20a20e72d4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:49.716907 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e97a2702-46dd-4f00-a7d6-838129270444 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1217 microversion: 2.1 time: 0.085719 May 28 21:14:49.718005 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1637/3235] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:49 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:49.721779 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1df1db00-97dd-4bb8-aa7b-fa20a20e72d4 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1502 microversion: 2.1 time: 0.210790 May 28 21:14:49.722397 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1599/3236] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:49 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1502 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:49.738996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-20bd10a2-133f-4d10-85f0-af6bdaca74a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:49.739787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-20bd10a2-133f-4d10-85f0-af6bdaca74a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:49.750444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20bd10a2-133f-4d10-85f0-af6bdaca74a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:49.751057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20bd10a2-133f-4d10-85f0-af6bdaca74a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:49.751997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20bd10a2-133f-4d10-85f0-af6bdaca74a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:49.752675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20bd10a2-133f-4d10-85f0-af6bdaca74a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:49.782768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-20bd10a2-133f-4d10-85f0-af6bdaca74a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lazy-loading 'flavor' on Instance uuid f64c5f55-2432-4685-9b86-01905d00c58d {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:14:49.835359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4f969d0f-f2f5-44c5-b024-95d5827ead86 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:49.836278 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4f969d0f-f2f5-44c5-b024-95d5827ead86 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:49.842826 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f969d0f-f2f5-44c5-b024-95d5827ead86 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:49.843285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f969d0f-f2f5-44c5-b024-95d5827ead86 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:49.845925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f969d0f-f2f5-44c5-b024-95d5827ead86 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:49.845925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f969d0f-f2f5-44c5-b024-95d5827ead86 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:50.017716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4f969d0f-f2f5-44c5-b024-95d5827ead86 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:50.028859 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4f969d0f-f2f5-44c5-b024-95d5827ead86 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1322 microversion: 2.1 time: 0.197126 May 28 21:14:50.031226 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1600/3237] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:49 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:50.038781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-427a22cc-ef0b-4826-b21d-67e658eda2ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:50.039414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-427a22cc-ef0b-4826-b21d-67e658eda2ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:50.051272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-427a22cc-ef0b-4826-b21d-67e658eda2ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:50.051979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-427a22cc-ef0b-4826-b21d-67e658eda2ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:50.052771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-427a22cc-ef0b-4826-b21d-67e658eda2ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:50.053218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-427a22cc-ef0b-4826-b21d-67e658eda2ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:50.104499 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-20bd10a2-133f-4d10-85f0-af6bdaca74a1 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "POST /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d/action" status: 202 len: 0 microversion: 2.1 time: 0.369864 May 28 21:14:50.105778 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1638/3238] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:14:49 2022] POST /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:14:50.114853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b7bbe4ee-4a77-45ee-85d1-80bd4b4fab3a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:50.115688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b7bbe4ee-4a77-45ee-85d1-80bd4b4fab3a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:50.122802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7bbe4ee-4a77-45ee-85d1-80bd4b4fab3a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:50.123363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7bbe4ee-4a77-45ee-85d1-80bd4b4fab3a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:50.124254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7bbe4ee-4a77-45ee-85d1-80bd4b4fab3a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:50.124765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7bbe4ee-4a77-45ee-85d1-80bd4b4fab3a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:50.293162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-427a22cc-ef0b-4826-b21d-67e658eda2ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:50.304761 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-427a22cc-ef0b-4826-b21d-67e658eda2ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 200 len: 1292 microversion: 2.1 time: 0.272215 May 28 21:14:50.318796 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1601/3239] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:50 2022] GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 1292 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:50.322516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b7bbe4ee-4a77-45ee-85d1-80bd4b4fab3a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:50.330607 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b7bbe4ee-4a77-45ee-85d1-80bd4b4fab3a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1510 microversion: 2.1 time: 0.220895 May 28 21:14:50.331540 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1639/3240] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:50 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:50.523547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-28824c0e-1015-43f8-bcc2-59fdefccc543 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:50.524100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-28824c0e-1015-43f8-bcc2-59fdefccc543 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:50.530811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28824c0e-1015-43f8-bcc2-59fdefccc543 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:50.536285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28824c0e-1015-43f8-bcc2-59fdefccc543 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:50.536285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28824c0e-1015-43f8-bcc2-59fdefccc543 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:50.536285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28824c0e-1015-43f8-bcc2-59fdefccc543 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:50.732622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-28824c0e-1015-43f8-bcc2-59fdefccc543 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:50.733776 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7860401b-74dc-4c7c-81be-76b7b17bd372 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:50.734796 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7860401b-74dc-4c7c-81be-76b7b17bd372 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:50.745526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7860401b-74dc-4c7c-81be-76b7b17bd372 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:50.745526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7860401b-74dc-4c7c-81be-76b7b17bd372 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:50.745716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-28824c0e-1015-43f8-bcc2-59fdefccc543 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:50.745825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7860401b-74dc-4c7c-81be-76b7b17bd372 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:50.746093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7860401b-74dc-4c7c-81be-76b7b17bd372 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:50.746463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-28824c0e-1015-43f8-bcc2-59fdefccc543 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:50.748012 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-28824c0e-1015-43f8-bcc2-59fdefccc543 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 2835 microversion: 2.42 time: 0.228354 May 28 21:14:50.748620 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1602/3241] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:14:50 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 2835 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:14:50.769591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7798b614-6282-41ff-9c9f-a575470685ca tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:50.773325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7798b614-6282-41ff-9c9f-a575470685ca tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:50.787422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7798b614-6282-41ff-9c9f-a575470685ca tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:50.788082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7798b614-6282-41ff-9c9f-a575470685ca tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:50.788931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7798b614-6282-41ff-9c9f-a575470685ca tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:50.789753 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7798b614-6282-41ff-9c9f-a575470685ca tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:50.817327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7860401b-74dc-4c7c-81be-76b7b17bd372 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:50.826176 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7860401b-74dc-4c7c-81be-76b7b17bd372 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1269 microversion: 2.1 time: 0.096363 May 28 21:14:50.827219 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1640/3242] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:50 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1269 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:50.928343 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7798b614-6282-41ff-9c9f-a575470685ca tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.162634 May 28 21:14:50.929182 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1603/3243] 10.222.0.33 () {60 vars in 1315 bytes} [Sat May 28 21:14:50 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63/os-interface => generated 1832 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:14:51.047673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-677efd7f-a424-4ab4-b8f7-bd2602419e12 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:51.048303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-677efd7f-a424-4ab4-b8f7-bd2602419e12 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:51.054454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-677efd7f-a424-4ab4-b8f7-bd2602419e12 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:51.055203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-677efd7f-a424-4ab4-b8f7-bd2602419e12 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:51.055994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-677efd7f-a424-4ab4-b8f7-bd2602419e12 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:51.056432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-677efd7f-a424-4ab4-b8f7-bd2602419e12 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:51.336605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2e058fa7-c005-4afc-8fca-29e2753118d4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:51.338615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2e058fa7-c005-4afc-8fca-29e2753118d4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:51.340484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-677efd7f-a424-4ab4-b8f7-bd2602419e12 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:51.344475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e058fa7-c005-4afc-8fca-29e2753118d4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:51.344933 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e058fa7-c005-4afc-8fca-29e2753118d4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:51.345711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e058fa7-c005-4afc-8fca-29e2753118d4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:51.346183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e058fa7-c005-4afc-8fca-29e2753118d4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:51.348649 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-677efd7f-a424-4ab4-b8f7-bd2602419e12 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1515 microversion: 2.1 time: 0.305362 May 28 21:14:51.358737 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1641/3244] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:51 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1515 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:51.358737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40cb0e7f-d7ad-42c1-989e-8871438f738c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:51.361738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-40cb0e7f-d7ad-42c1-989e-8871438f738c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:51.367027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40cb0e7f-d7ad-42c1-989e-8871438f738c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:51.367497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40cb0e7f-d7ad-42c1-989e-8871438f738c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:51.368288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40cb0e7f-d7ad-42c1-989e-8871438f738c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:51.368747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40cb0e7f-d7ad-42c1-989e-8871438f738c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:51.633501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2e058fa7-c005-4afc-8fca-29e2753118d4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:51.641140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-40cb0e7f-d7ad-42c1-989e-8871438f738c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:51.644566 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2e058fa7-c005-4afc-8fca-29e2753118d4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 200 len: 1292 microversion: 2.1 time: 0.312859 May 28 21:14:51.654455 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1604/3245] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:51 2022] GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 1292 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:51.654639 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-40cb0e7f-d7ad-42c1-989e-8871438f738c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1493 microversion: 2.1 time: 0.300750 May 28 21:14:51.654639 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1642/3246] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:51 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1493 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:51.654839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-142e0c1c-5787-410a-a5df-afae60012961 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:51.654839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-142e0c1c-5787-410a-a5df-afae60012961 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:51.659820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-142e0c1c-5787-410a-a5df-afae60012961 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:51.660282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-142e0c1c-5787-410a-a5df-afae60012961 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:51.661062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-142e0c1c-5787-410a-a5df-afae60012961 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:51.661656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-142e0c1c-5787-410a-a5df-afae60012961 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:51.670800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c7798e9b-53bc-4df3-bfaf-29cb4c9c70c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:51.671453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c7798e9b-53bc-4df3-bfaf-29cb4c9c70c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:51.677773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7798e9b-53bc-4df3-bfaf-29cb4c9c70c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:51.678376 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7798e9b-53bc-4df3-bfaf-29cb4c9c70c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:51.679163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7798e9b-53bc-4df3-bfaf-29cb4c9c70c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:51.679604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7798e9b-53bc-4df3-bfaf-29cb4c9c70c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:51.692471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-142e0c1c-5787-410a-a5df-afae60012961 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lazy-loading 'flavor' on Instance uuid 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:14:51.707847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c7798e9b-53bc-4df3-bfaf-29cb4c9c70c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:14:51.724557 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:51.727525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:52.056523 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c7798e9b-53bc-4df3-bfaf-29cb4c9c70c0 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 204 len: 0 microversion: 2.1 time: 0.389683 May 28 21:14:52.068004 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1643/3247] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:14:51 2022] DELETE /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:14:52.073503 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-142e0c1c-5787-410a-a5df-afae60012961 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351/action" status: 200 len: 32 microversion: 2.1 time: 0.426392 May 28 21:14:52.074529 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1605/3248] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:14:51 2022] POST /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351/action => generated 32 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:14:52.088647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-889fda10-7795-4bb9-8ee0-88e69201e893 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:52.089587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6e9e6afd-f60c-40f0-9fa4-845db568cc3c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:52.090199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-889fda10-7795-4bb9-8ee0-88e69201e893 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:52.090404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6e9e6afd-f60c-40f0-9fa4-845db568cc3c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:52.098857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-889fda10-7795-4bb9-8ee0-88e69201e893 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:52.099710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-889fda10-7795-4bb9-8ee0-88e69201e893 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:52.100759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-889fda10-7795-4bb9-8ee0-88e69201e893 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:52.101430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-889fda10-7795-4bb9-8ee0-88e69201e893 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:52.118150 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e9e6afd-f60c-40f0-9fa4-845db568cc3c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:52.118625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e9e6afd-f60c-40f0-9fa4-845db568cc3c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:52.119433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e9e6afd-f60c-40f0-9fa4-845db568cc3c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:52.119877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e9e6afd-f60c-40f0-9fa4-845db568cc3c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:52.219588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-889fda10-7795-4bb9-8ee0-88e69201e893 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:52.228497 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-889fda10-7795-4bb9-8ee0-88e69201e893 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1277 microversion: 2.1 time: 0.148026 May 28 21:14:52.229802 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1644/3249] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:52 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:52.246580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb35a247-dbf0-4bd2-b577-13763252aa4d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:52.248069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fb35a247-dbf0-4bd2-b577-13763252aa4d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:52.257592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb35a247-dbf0-4bd2-b577-13763252aa4d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:52.258578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb35a247-dbf0-4bd2-b577-13763252aa4d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:52.260250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb35a247-dbf0-4bd2-b577-13763252aa4d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:52.260930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb35a247-dbf0-4bd2-b577-13763252aa4d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:52.391922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6e9e6afd-f60c-40f0-9fa4-845db568cc3c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:52.401125 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6e9e6afd-f60c-40f0-9fa4-845db568cc3c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1499 microversion: 2.1 time: 0.325139 May 28 21:14:52.402857 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1606/3250] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:52 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1499 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:52.447457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-99f856bc-d86a-421c-9c30-5356dd2519f9 req-55286525-26cf-400d-ae2e-e4fe4a1eca06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "tag": "a093c2f2-1530-48bb-9240-39d12badf81f"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:52.463097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-99f856bc-d86a-421c-9c30-5356dd2519f9 req-55286525-26cf-400d-ae2e-e4fe4a1eca06 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:52.463767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-99f856bc-d86a-421c-9c30-5356dd2519f9 req-55286525-26cf-400d-ae2e-e4fe4a1eca06 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:52.481260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fb35a247-dbf0-4bd2-b577-13763252aa4d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:52.490569 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb35a247-dbf0-4bd2-b577-13763252aa4d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.259148 May 28 21:14:52.494875 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-99f856bc-d86a-421c-9c30-5356dd2519f9 req-55286525-26cf-400d-ae2e-e4fe4a1eca06 service nova] Creating event network-changed:a093c2f2-1530-48bb-9240-39d12badf81f for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:14:52.495234 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1645/3251] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:52 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:52.509048 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-99f856bc-d86a-421c-9c30-5356dd2519f9 req-55286525-26cf-400d-ae2e-e4fe4a1eca06 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065691 May 28 21:14:52.509971 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1607/3252] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:14:52.665633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f156a417-ebaf-49ad-b847-60b0276332e6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:52.666489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f156a417-ebaf-49ad-b847-60b0276332e6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:52.677306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f156a417-ebaf-49ad-b847-60b0276332e6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:52.686957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f156a417-ebaf-49ad-b847-60b0276332e6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:52.688208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f156a417-ebaf-49ad-b847-60b0276332e6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:52.688831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f156a417-ebaf-49ad-b847-60b0276332e6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:52.991497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f156a417-ebaf-49ad-b847-60b0276332e6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:53.005515 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f156a417-ebaf-49ad-b847-60b0276332e6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 200 len: 1292 microversion: 2.1 time: 0.346768 May 28 21:14:53.006149 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1646/3253] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:52 2022] GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 1292 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:53.249451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0c606d58-2fa9-40d0-b8c2-35d8a7acd1cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:53.250240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0c606d58-2fa9-40d0-b8c2-35d8a7acd1cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:53.259209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c606d58-2fa9-40d0-b8c2-35d8a7acd1cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:53.260538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c606d58-2fa9-40d0-b8c2-35d8a7acd1cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:53.261858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c606d58-2fa9-40d0-b8c2-35d8a7acd1cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:53.263252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c606d58-2fa9-40d0-b8c2-35d8a7acd1cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:53.379041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c606d58-2fa9-40d0-b8c2-35d8a7acd1cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:53.402360 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0c606d58-2fa9-40d0-b8c2-35d8a7acd1cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1277 microversion: 2.1 time: 0.147923 May 28 21:14:53.402360 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1608/3254] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:53 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:53.422451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-34b09a68-e000-47a1-8e02-0905ae3235a2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:53.423117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-34b09a68-e000-47a1-8e02-0905ae3235a2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:53.430432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34b09a68-e000-47a1-8e02-0905ae3235a2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:53.430902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34b09a68-e000-47a1-8e02-0905ae3235a2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:53.432216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34b09a68-e000-47a1-8e02-0905ae3235a2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:53.432681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34b09a68-e000-47a1-8e02-0905ae3235a2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:53.515039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-596dd002-5069-461e-b18f-5f6ab2bd9411 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:53.515687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-596dd002-5069-461e-b18f-5f6ab2bd9411 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:53.523502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-596dd002-5069-461e-b18f-5f6ab2bd9411 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:53.523961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-596dd002-5069-461e-b18f-5f6ab2bd9411 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:53.524899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-596dd002-5069-461e-b18f-5f6ab2bd9411 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:53.525363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-596dd002-5069-461e-b18f-5f6ab2bd9411 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:54.281204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-34b09a68-e000-47a1-8e02-0905ae3235a2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:54.291590 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-34b09a68-e000-47a1-8e02-0905ae3235a2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1499 microversion: 2.1 time: 0.875766 May 28 21:14:54.292452 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1647/3255] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:53 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1499 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:54.297633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9e88b087-a15d-4157-88a1-fcc81b90da5a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:54.298281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9e88b087-a15d-4157-88a1-fcc81b90da5a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:54.305080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e88b087-a15d-4157-88a1-fcc81b90da5a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:54.306008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e88b087-a15d-4157-88a1-fcc81b90da5a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:54.306821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e88b087-a15d-4157-88a1-fcc81b90da5a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:54.307277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e88b087-a15d-4157-88a1-fcc81b90da5a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:54.321300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-596dd002-5069-461e-b18f-5f6ab2bd9411 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:54.329756 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-596dd002-5069-461e-b18f-5f6ab2bd9411 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.821432 May 28 21:14:54.330496 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1609/3256] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:53 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:54.409650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-70e664dc-1a80-46d3-bf5d-665c4012ed7e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:54.410619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-70e664dc-1a80-46d3-bf5d-665c4012ed7e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:54.420083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70e664dc-1a80-46d3-bf5d-665c4012ed7e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:54.421400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70e664dc-1a80-46d3-bf5d-665c4012ed7e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:54.422585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70e664dc-1a80-46d3-bf5d-665c4012ed7e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:54.423232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70e664dc-1a80-46d3-bf5d-665c4012ed7e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:54.590411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-70e664dc-1a80-46d3-bf5d-665c4012ed7e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:54.600999 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-70e664dc-1a80-46d3-bf5d-665c4012ed7e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1275 microversion: 2.1 time: 0.194657 May 28 21:14:54.602666 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1610/3257] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:54 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:54.618839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-46fe7d53-1ca4-43b8-8f5a-cdd150b18372 req-681fd65d-a873-4759-b241-97492abf5acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f2f9407-da1e-473e-a8a9-87ac9a287fa4", "name": "network-vif-plugged", "status": "completed", "tag": "6a35abfc-dc91-4685-902b-325510a0f642"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:54.635386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-46fe7d53-1ca4-43b8-8f5a-cdd150b18372 req-681fd65d-a873-4759-b241-97492abf5acb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:54.636643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-46fe7d53-1ca4-43b8-8f5a-cdd150b18372 req-681fd65d-a873-4759-b241-97492abf5acb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:54.649788 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-46fe7d53-1ca4-43b8-8f5a-cdd150b18372 req-681fd65d-a873-4759-b241-97492abf5acb service nova] Creating event network-vif-plugged:6a35abfc-dc91-4685-902b-325510a0f642 for instance 6f2f9407-da1e-473e-a8a9-87ac9a287fa4 on nch2-master-1 May 28 21:14:54.656500 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-46fe7d53-1ca4-43b8-8f5a-cdd150b18372 req-681fd65d-a873-4759-b241-97492abf5acb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052138 May 28 21:14:54.657547 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1611/3258] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:54.750617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9e88b087-a15d-4157-88a1-fcc81b90da5a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:54.763148 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9e88b087-a15d-4157-88a1-fcc81b90da5a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 200 len: 1292 microversion: 2.1 time: 0.468246 May 28 21:14:54.763841 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1648/3259] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:54 2022] GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 1292 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:55.203031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-940f0023-9d1a-4ad8-ae55-3ef3e9e2c2f1 req-5e249f66-b457-4f25-b910-6832a7dd9ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f64c5f55-2432-4685-9b86-01905d00c58d", "name": "network-vif-deleted", "tag": "b1f6d241-af74-4eca-81fb-de8868d62a62"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:55.218561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-940f0023-9d1a-4ad8-ae55-3ef3e9e2c2f1 req-5e249f66-b457-4f25-b910-6832a7dd9ec4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:55.219864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-940f0023-9d1a-4ad8-ae55-3ef3e9e2c2f1 req-5e249f66-b457-4f25-b910-6832a7dd9ec4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:55.246690 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-940f0023-9d1a-4ad8-ae55-3ef3e9e2c2f1 req-5e249f66-b457-4f25-b910-6832a7dd9ec4 service nova] Creating event network-vif-deleted:b1f6d241-af74-4eca-81fb-de8868d62a62 for instance f64c5f55-2432-4685-9b86-01905d00c58d on nch2-master-1 May 28 21:14:55.261121 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-940f0023-9d1a-4ad8-ae55-3ef3e9e2c2f1 req-5e249f66-b457-4f25-b910-6832a7dd9ec4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062638 May 28 21:14:55.264787 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1612/3260] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:55.309365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2ee424d1-c651-4ebd-8d45-2e0e0913e367 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:55.312603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2ee424d1-c651-4ebd-8d45-2e0e0913e367 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:55.319327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ee424d1-c651-4ebd-8d45-2e0e0913e367 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:55.319788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ee424d1-c651-4ebd-8d45-2e0e0913e367 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:55.321145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ee424d1-c651-4ebd-8d45-2e0e0913e367 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:55.322274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ee424d1-c651-4ebd-8d45-2e0e0913e367 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:55.348726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7f5b4564-c112-4603-9ab0-c7e969c78695 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:55.350121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7f5b4564-c112-4603-9ab0-c7e969c78695 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:55.360281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f5b4564-c112-4603-9ab0-c7e969c78695 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:55.360812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f5b4564-c112-4603-9ab0-c7e969c78695 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:55.361932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f5b4564-c112-4603-9ab0-c7e969c78695 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:55.362387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f5b4564-c112-4603-9ab0-c7e969c78695 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:55.422822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2ee424d1-c651-4ebd-8d45-2e0e0913e367 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:55.431389 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2ee424d1-c651-4ebd-8d45-2e0e0913e367 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1457 microversion: 2.1 time: 0.125894 May 28 21:14:55.432067 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1649/3261] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:55 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1457 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:55.522048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7f5b4564-c112-4603-9ab0-c7e969c78695 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:55.542719 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7f5b4564-c112-4603-9ab0-c7e969c78695 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.198370 May 28 21:14:55.545468 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1613/3262] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:55 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:55.620547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a9af1d5c-0349-4abe-a92b-e8ea3817ccf8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:55.621179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a9af1d5c-0349-4abe-a92b-e8ea3817ccf8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:55.631013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9af1d5c-0349-4abe-a92b-e8ea3817ccf8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:55.632035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9af1d5c-0349-4abe-a92b-e8ea3817ccf8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:55.634745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9af1d5c-0349-4abe-a92b-e8ea3817ccf8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:55.634745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9af1d5c-0349-4abe-a92b-e8ea3817ccf8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:55.793723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1d4a9612-1d4f-481b-bd17-c851034f5f3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:55.798596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1d4a9612-1d4f-481b-bd17-c851034f5f3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:55.811507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d4a9612-1d4f-481b-bd17-c851034f5f3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:55.812201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d4a9612-1d4f-481b-bd17-c851034f5f3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:55.813236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d4a9612-1d4f-481b-bd17-c851034f5f3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:55.813897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d4a9612-1d4f-481b-bd17-c851034f5f3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:56.014782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a9af1d5c-0349-4abe-a92b-e8ea3817ccf8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:56.030986 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a9af1d5c-0349-4abe-a92b-e8ea3817ccf8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1317 microversion: 2.1 time: 0.413375 May 28 21:14:56.043572 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1650/3263] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:55 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:56.049278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-4e4d1706-45fd-4621-a09d-f5de7851d359 req-f8dd6a8b-4a28-485d-85ed-83eba555b42d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "144ab366-0448-410f-9093-91dec09b838c", "tag": "cfbdc8df-e8d0-4012-b243-cfb3e0d4ff83"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:56.061309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4e4d1706-45fd-4621-a09d-f5de7851d359 req-f8dd6a8b-4a28-485d-85ed-83eba555b42d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:56.062131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4e4d1706-45fd-4621-a09d-f5de7851d359 req-f8dd6a8b-4a28-485d-85ed-83eba555b42d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:56.081330 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-4e4d1706-45fd-4621-a09d-f5de7851d359 req-f8dd6a8b-4a28-485d-85ed-83eba555b42d service nova] Creating event network-changed:cfbdc8df-e8d0-4012-b243-cfb3e0d4ff83 for instance 144ab366-0448-410f-9093-91dec09b838c on nch2-master-1 May 28 21:14:56.087644 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-4e4d1706-45fd-4621-a09d-f5de7851d359 req-f8dd6a8b-4a28-485d-85ed-83eba555b42d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041231 May 28 21:14:56.088959 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1651/3264] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:56.243549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1d4a9612-1d4f-481b-bd17-c851034f5f3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:56.251954 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1d4a9612-1d4f-481b-bd17-c851034f5f3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 200 len: 1292 microversion: 2.1 time: 0.474585 May 28 21:14:56.252540 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1614/3265] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:55 2022] GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 1292 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:56.449469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5ae3f09e-c05b-44a7-b191-b4bec1bb3d0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:56.450690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5ae3f09e-c05b-44a7-b191-b4bec1bb3d0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:56.462400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ae3f09e-c05b-44a7-b191-b4bec1bb3d0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:56.463181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ae3f09e-c05b-44a7-b191-b4bec1bb3d0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:56.464193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ae3f09e-c05b-44a7-b191-b4bec1bb3d0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:56.464893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ae3f09e-c05b-44a7-b191-b4bec1bb3d0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:56.520501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ae3f09e-c05b-44a7-b191-b4bec1bb3d0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:56.521202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ae3f09e-c05b-44a7-b191-b4bec1bb3d0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:56.523222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-5ae3f09e-c05b-44a7-b191-b4bec1bb3d0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lazy-loading 'fault' on Instance uuid f64c5f55-2432-4685-9b86-01905d00c58d {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:14:56.563211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a5dd8c8f-d590-4277-a8dd-47055c2acf37 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:56.564440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a5dd8c8f-d590-4277-a8dd-47055c2acf37 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:56.579260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5dd8c8f-d590-4277-a8dd-47055c2acf37 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:56.580084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5dd8c8f-d590-4277-a8dd-47055c2acf37 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:56.581293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5dd8c8f-d590-4277-a8dd-47055c2acf37 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:56.583124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5dd8c8f-d590-4277-a8dd-47055c2acf37 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:56.612425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5ae3f09e-c05b-44a7-b191-b4bec1bb3d0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf9c8f66e7d24ca9baca835e41546f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf04fd760c54473f83980a385252fa3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:56.628168 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5ae3f09e-c05b-44a7-b191-b4bec1bb3d0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 200 len: 1305 microversion: 2.1 time: 0.182059 May 28 21:14:56.630687 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1652/3266] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:56 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 1305 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:56.833449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a5dd8c8f-d590-4277-a8dd-47055c2acf37 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:56.842880 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a5dd8c8f-d590-4277-a8dd-47055c2acf37 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.284190 May 28 21:14:56.843478 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1615/3267] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:56 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:57.051196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eec0e5ea-3a3d-4bb0-bf13-f39eb9d855e9 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:57.059299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eec0e5ea-3a3d-4bb0-bf13-f39eb9d855e9 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:57.063812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eec0e5ea-3a3d-4bb0-bf13-f39eb9d855e9 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.064619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eec0e5ea-3a3d-4bb0-bf13-f39eb9d855e9 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.065619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eec0e5ea-3a3d-4bb0-bf13-f39eb9d855e9 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.066295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eec0e5ea-3a3d-4bb0-bf13-f39eb9d855e9 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.236671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eec0e5ea-3a3d-4bb0-bf13-f39eb9d855e9 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:57.246204 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eec0e5ea-3a3d-4bb0-bf13-f39eb9d855e9 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1317 microversion: 2.1 time: 0.198908 May 28 21:14:57.246793 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1653/3268] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:57 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:57.268767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-757b139c-9647-46eb-ac38-ae6e49a07a0b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:57.269391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-757b139c-9647-46eb-ac38-ae6e49a07a0b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:57.275939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-757b139c-9647-46eb-ac38-ae6e49a07a0b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.276392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-757b139c-9647-46eb-ac38-ae6e49a07a0b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.277160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-757b139c-9647-46eb-ac38-ae6e49a07a0b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.277602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-757b139c-9647-46eb-ac38-ae6e49a07a0b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.282931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-75c2e402-44b9-4c3a-8be6-09e833d238df req-af8aa239-5113-4a4f-8558-043733de951e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d9b7c0-0b10-4aea-9af1-50ede9a13238", "tag": "4e49f946-3e3f-4a15-ba0a-14cb379976e5"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:57.291315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-75c2e402-44b9-4c3a-8be6-09e833d238df req-af8aa239-5113-4a4f-8558-043733de951e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.291779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-75c2e402-44b9-4c3a-8be6-09e833d238df req-af8aa239-5113-4a4f-8558-043733de951e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.302922 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-75c2e402-44b9-4c3a-8be6-09e833d238df req-af8aa239-5113-4a4f-8558-043733de951e service nova] Creating event network-changed:4e49f946-3e3f-4a15-ba0a-14cb379976e5 for instance 58d9b7c0-0b10-4aea-9af1-50ede9a13238 on nch2-master-1 May 28 21:14:57.308140 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-75c2e402-44b9-4c3a-8be6-09e833d238df req-af8aa239-5113-4a4f-8558-043733de951e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029091 May 28 21:14:57.308922 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1654/3269] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:14:57.420360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-757b139c-9647-46eb-ac38-ae6e49a07a0b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:57.428110 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-757b139c-9647-46eb-ac38-ae6e49a07a0b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 200 len: 1474 microversion: 2.1 time: 0.163382 May 28 21:14:57.429507 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1616/3270] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:57 2022] GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 1474 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:57.543020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-873235334", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:57.597673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] validate_networks() for [('ca803b4d-8584-4327-9f76-66ddebb3c209', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:14:57.646197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e28300b5-0836-4e7a-a62f-71852c65f43f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:57.647549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e28300b5-0836-4e7a-a62f-71852c65f43f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:57.662285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e28300b5-0836-4e7a-a62f-71852c65f43f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.663389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e28300b5-0836-4e7a-a62f-71852c65f43f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.664328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e28300b5-0836-4e7a-a62f-71852c65f43f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.664892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e28300b5-0836-4e7a-a62f-71852c65f43f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.684796 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-e28300b5-0836-4e7a-a62f-71852c65f43f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e28300b5-0836-4e7a-a62f-71852c65f43f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d HTTP/1.1 May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'f64c5f55-2432-4685-9b86-01905d00c58d'} May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:57.686946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.699117 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:57.699117 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:57.699117 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:57.699117 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:57.699117 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:57.699117 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. May 28 21:14:57.699117 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.699117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e28300b5-0836-4e7a-a62f-71852c65f43f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:57.699117 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e28300b5-0836-4e7a-a62f-71852c65f43f tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 404 len: 111 microversion: 2.1 time: 0.047097 May 28 21:14:57.699117 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1617/3271] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:57 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:14:57.705070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b511d774-b57b-487e-8610-81c0e91509cc tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:57.705704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b511d774-b57b-487e-8610-81c0e91509cc tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:57.715604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b511d774-b57b-487e-8610-81c0e91509cc tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.716405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b511d774-b57b-487e-8610-81c0e91509cc tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.722780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b511d774-b57b-487e-8610-81c0e91509cc tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.722780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b511d774-b57b-487e-8610-81c0e91509cc tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.734681 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-b511d774-b57b-487e-8610-81c0e91509cc tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b511d774-b57b-487e-8610-81c0e91509cc tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d HTTP/1.1 May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'f64c5f55-2432-4685-9b86-01905d00c58d'} May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:57.736668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:57.746845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. May 28 21:14:57.746845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.746845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:57.746845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.746845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:57.746845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:57.746845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:57.746845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:57.746845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:57.746845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. May 28 21:14:57.746845 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.746845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b511d774-b57b-487e-8610-81c0e91509cc tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:57.746845 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b511d774-b57b-487e-8610-81c0e91509cc tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 404 len: 111 microversion: 2.1 time: 0.038522 May 28 21:14:57.746845 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1618/3272] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:14:57 2022] DELETE /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:57.759794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-46e0b34d-4889-4947-824d-d6f90dfc714e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:57.760883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-46e0b34d-4889-4947-824d-d6f90dfc714e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: f64c5f55-2432-4685-9b86-01905d00c58d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:57.768481 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46e0b34d-4889-4947-824d-d6f90dfc714e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.769122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46e0b34d-4889-4947-824d-d6f90dfc714e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.770143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46e0b34d-4889-4947-824d-d6f90dfc714e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.770599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46e0b34d-4889-4947-824d-d6f90dfc714e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.787623 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-46e0b34d-4889-4947-824d-d6f90dfc714e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-46e0b34d-4889-4947-824d-d6f90dfc714e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d HTTP/1.1 May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'f64c5f55-2432-4685-9b86-01905d00c58d'} May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:57.790792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.796405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:57.796405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:57.796405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:57.796405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:57.796405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:57.796405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. May 28 21:14:57.796405 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.798747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-46e0b34d-4889-4947-824d-d6f90dfc714e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance f64c5f55-2432-4685-9b86-01905d00c58d could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:57.800740 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-46e0b34d-4889-4947-824d-d6f90dfc714e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d" status: 404 len: 111 microversion: 2.1 time: 0.052556 May 28 21:14:57.801963 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1619/3273] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:57 2022] GET /compute/v2.1/servers/f64c5f55-2432-4685-9b86-01905d00c58d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:14:57.814490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-373444b3-47b0-43b6-82b4-608397f16b4e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:57.815347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-373444b3-47b0-43b6-82b4-608397f16b4e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:57.823048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-373444b3-47b0-43b6-82b4-608397f16b4e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.824040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-373444b3-47b0-43b6-82b4-608397f16b4e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.825243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-373444b3-47b0-43b6-82b4-608397f16b4e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.826072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-373444b3-47b0-43b6-82b4-608397f16b4e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.845020 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-373444b3-47b0-43b6-82b4-608397f16b4e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-373444b3-47b0-43b6-82b4-608397f16b4e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 HTTP/1.1 May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '90a4d46c-e387-4ba1-962d-71d5fcfe5577'} May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:57.847272 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:57.857273 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. May 28 21:14:57.857273 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.857273 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:57.857273 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.857273 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:57.857273 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:57.857273 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:57.857273 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:57.857273 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:57.857273 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. May 28 21:14:57.857273 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.857273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-373444b3-47b0-43b6-82b4-608397f16b4e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:57.857273 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-373444b3-47b0-43b6-82b4-608397f16b4e tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "DELETE /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 404 len: 111 microversion: 2.1 time: 0.042622 May 28 21:14:57.857273 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1620/3274] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:14:57 2022] DELETE /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:57.865051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd1784ce-fb32-4a3f-a522-67ed332a8db6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:57.866831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bd1784ce-fb32-4a3f-a522-67ed332a8db6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 90a4d46c-e387-4ba1-962d-71d5fcfe5577] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:57.878075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd1784ce-fb32-4a3f-a522-67ed332a8db6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.878758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd1784ce-fb32-4a3f-a522-67ed332a8db6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.882005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd1784ce-fb32-4a3f-a522-67ed332a8db6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.882005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd1784ce-fb32-4a3f-a522-67ed332a8db6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.906110 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-bd1784ce-fb32-4a3f-a522-67ed332a8db6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd1784ce-fb32-4a3f-a522-67ed332a8db6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 HTTP/1.1 May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '90a4d46c-e387-4ba1-962d-71d5fcfe5577'} May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:57.909020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.913830 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:57.913830 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:57.913830 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:57.913830 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:57.913830 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:57.913830 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. May 28 21:14:57.913830 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:57.913830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd1784ce-fb32-4a3f-a522-67ed332a8db6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance 90a4d46c-e387-4ba1-962d-71d5fcfe5577 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:57.915800 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bd1784ce-fb32-4a3f-a522-67ed332a8db6 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577" status: 404 len: 111 microversion: 2.1 time: 0.053483 May 28 21:14:57.915800 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1621/3275] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:57 2022] GET /compute/v2.1/servers/90a4d46c-e387-4ba1-962d-71d5fcfe5577 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:57.934080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dfe67111-cc99-4aac-85e6-183561494f6e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:57.935036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dfe67111-cc99-4aac-85e6-183561494f6e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:57.945611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfe67111-cc99-4aac-85e6-183561494f6e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.946574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfe67111-cc99-4aac-85e6-183561494f6e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:57.947600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfe67111-cc99-4aac-85e6-183561494f6e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:57.948270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfe67111-cc99-4aac-85e6-183561494f6e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:58.290844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dfe67111-cc99-4aac-85e6-183561494f6e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:58.301226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=10 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:58.312758 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dfe67111-cc99-4aac-85e6-183561494f6e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.395388 May 28 21:14:58.314288 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1622/3276] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:57 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:58.337363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8d586e23-afb2-475b-9d98-90306f5f9584 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:58.338447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8d586e23-afb2-475b-9d98-90306f5f9584 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:58.344443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=32 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:58.347879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d586e23-afb2-475b-9d98-90306f5f9584 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:58.349115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d586e23-afb2-475b-9d98-90306f5f9584 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:58.350679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d586e23-afb2-475b-9d98-90306f5f9584 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:58.351257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d586e23-afb2-475b-9d98-90306f5f9584 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:58.360626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:14:58.361138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:14:58.361517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:14:58.362004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:14:58.362419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:14:58.373958 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-8d586e23-afb2-475b-9d98-90306f5f9584 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8d586e23-afb2-475b-9d98-90306f5f9584 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a HTTP/1.1 May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ce53dda7-d501-475f-a4c0-73853a36630a'} May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:58.375709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:58.380163 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. May 28 21:14:58.380163 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.380163 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:58.380163 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.380163 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.380163 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:58.380163 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:58.380163 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:58.380163 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:58.380163 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. May 28 21:14:58.380163 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.381980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=25 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:58.381980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:58.382258 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8d586e23-afb2-475b-9d98-90306f5f9584 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:58.382393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:58.382393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:58.382758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:58.382921 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8d586e23-afb2-475b-9d98-90306f5f9584 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 404 len: 111 microversion: 2.1 time: 0.052481 May 28 21:14:58.383704 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1623/3277] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:14:58 2022] DELETE /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:58.398504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5c934282-f90f-49c4-a1bd-46073cd812e3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:58.399703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5c934282-f90f-49c4-a1bd-46073cd812e3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:58.406517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c934282-f90f-49c4-a1bd-46073cd812e3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:58.406972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c934282-f90f-49c4-a1bd-46073cd812e3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:58.407809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c934282-f90f-49c4-a1bd-46073cd812e3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:58.408256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c934282-f90f-49c4-a1bd-46073cd812e3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:58.416052 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:14:58.426934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for user 572170ccd67e4facbf10dad7cd1491c1 and project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:14:58.446288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:14:58.453482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 29cb4dc1-1163-4714-8b68-133d8643211a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:14:58.586889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5c934282-f90f-49c4-a1bd-46073cd812e3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:58.596226 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5c934282-f90f-49c4-a1bd-46073cd812e3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1317 microversion: 2.1 time: 0.206737 May 28 21:14:58.597434 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1624/3278] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:58 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:58.603212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-00acd1b9-0565-490e-b2b2-183e7a0a5a0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:58.604312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-00acd1b9-0565-490e-b2b2-183e7a0a5a0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ce53dda7-d501-475f-a4c0-73853a36630a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:58.611779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00acd1b9-0565-490e-b2b2-183e7a0a5a0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:58.612249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00acd1b9-0565-490e-b2b2-183e7a0a5a0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:58.613043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00acd1b9-0565-490e-b2b2-183e7a0a5a0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:58.613490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00acd1b9-0565-490e-b2b2-183e7a0a5a0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:58.615280 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d6c6d1d1-b45b-4b93-968a-f1553f86b0b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077191 May 28 21:14:58.616630 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1655/3279] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:14:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:14:58.627148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e27bf55d-e65e-48c5-b564-cbc1ba377e9a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:58.627664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e27bf55d-e65e-48c5-b564-cbc1ba377e9a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 29cb4dc1-1163-4714-8b68-133d8643211a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:58.629628 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-00acd1b9-0565-490e-b2b2-183e7a0a5a0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-00acd1b9-0565-490e-b2b2-183e7a0a5a0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a HTTP/1.1 May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ce53dda7-d501-475f-a4c0-73853a36630a'} May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:58.631395 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.636151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.636151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:58.636151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:58.636151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:58.636151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:58.636151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. May 28 21:14:58.636151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.636151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-00acd1b9-0565-490e-b2b2-183e7a0a5a0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance ce53dda7-d501-475f-a4c0-73853a36630a could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:58.636151 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-00acd1b9-0565-490e-b2b2-183e7a0a5a0c tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a" status: 404 len: 111 microversion: 2.1 time: 0.034608 May 28 21:14:58.636151 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1625/3280] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:58 2022] GET /compute/v2.1/servers/ce53dda7-d501-475f-a4c0-73853a36630a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:58.647663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b89644ad-e880-49d7-8122-b7ec6ca18e5a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:58.648820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b89644ad-e880-49d7-8122-b7ec6ca18e5a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:58.655966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b89644ad-e880-49d7-8122-b7ec6ca18e5a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:58.656413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b89644ad-e880-49d7-8122-b7ec6ca18e5a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:58.657203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b89644ad-e880-49d7-8122-b7ec6ca18e5a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:58.657645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b89644ad-e880-49d7-8122-b7ec6ca18e5a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:58.675962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e27bf55d-e65e-48c5-b564-cbc1ba377e9a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 29cb4dc1-1163-4714-8b68-133d8643211a] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-b89644ad-e880-49d7-8122-b7ec6ca18e5a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b89644ad-e880-49d7-8122-b7ec6ca18e5a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 HTTP/1.1 May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ea458195-fcf6-455c-873e-de1f07779365'} May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:58.676246 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b89644ad-e880-49d7-8122-b7ec6ca18e5a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b89644ad-e880-49d7-8122-b7ec6ca18e5a tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 404 len: 111 microversion: 2.1 time: 0.037613 May 28 21:14:58.680938 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1626/3281] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:14:58 2022] DELETE /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:14:58.686905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7d899296-65bd-4a6e-8e56-b9b3fd704d71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:58.687650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7d899296-65bd-4a6e-8e56-b9b3fd704d71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea458195-fcf6-455c-873e-de1f07779365] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:58.694827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d899296-65bd-4a6e-8e56-b9b3fd704d71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:58.695449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d899296-65bd-4a6e-8e56-b9b3fd704d71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:58.696329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d899296-65bd-4a6e-8e56-b9b3fd704d71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:58.696893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d899296-65bd-4a6e-8e56-b9b3fd704d71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:58.713668 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-7d899296-65bd-4a6e-8e56-b9b3fd704d71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7d899296-65bd-4a6e-8e56-b9b3fd704d71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 HTTP/1.1 May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ea458195-fcf6-455c-873e-de1f07779365'} May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:58.715838 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.725127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.725127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:58.725127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:58.725127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:58.725127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:58.725127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. May 28 21:14:58.725127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.725127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7d899296-65bd-4a6e-8e56-b9b3fd704d71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance ea458195-fcf6-455c-873e-de1f07779365 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:58.725127 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7d899296-65bd-4a6e-8e56-b9b3fd704d71 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365" status: 404 len: 111 microversion: 2.1 time: 0.034140 May 28 21:14:58.725127 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1627/3282] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:58 2022] GET /compute/v2.1/servers/ea458195-fcf6-455c-873e-de1f07779365 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:58.727944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-58628287-7a5e-4f9e-a9a3-6b2522f4f1cb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:58.728457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-58628287-7a5e-4f9e-a9a3-6b2522f4f1cb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 40e3cea4-71b3-45b0-b832-370b34557bc0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:58.736450 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-58628287-7a5e-4f9e-a9a3-6b2522f4f1cb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-58628287-7a5e-4f9e-a9a3-6b2522f4f1cb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/40e3cea4-71b3-45b0-b832-370b34557bc0 HTTP/1.1 May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '40e3cea4-71b3-45b0-b832-370b34557bc0'} May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:58.739211 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.744659 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.744659 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:58.744659 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:58.744659 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:58.744659 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:58.744659 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. May 28 21:14:58.744659 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.747606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-58628287-7a5e-4f9e-a9a3-6b2522f4f1cb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:58.750316 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-58628287-7a5e-4f9e-a9a3-6b2522f4f1cb tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "DELETE /compute/v2.1/servers/40e3cea4-71b3-45b0-b832-370b34557bc0" status: 404 len: 111 microversion: 2.1 time: 0.027365 May 28 21:14:58.751627 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1628/3283] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:14:58 2022] DELETE /compute/v2.1/servers/40e3cea4-71b3-45b0-b832-370b34557bc0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:58.763324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-50148f23-7f17-4c6a-b2af-041ad6b4ce20 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:58.763324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-50148f23-7f17-4c6a-b2af-041ad6b4ce20 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 40e3cea4-71b3-45b0-b832-370b34557bc0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:58.770334 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-50148f23-7f17-4c6a-b2af-041ad6b4ce20 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-50148f23-7f17-4c6a-b2af-041ad6b4ce20 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/40e3cea4-71b3-45b0-b832-370b34557bc0 HTTP/1.1 May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '40e3cea4-71b3-45b0-b832-370b34557bc0'} May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.773043 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:58.778049 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:58.778049 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:58.778049 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:58.778049 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. May 28 21:14:58.778049 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.779576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-50148f23-7f17-4c6a-b2af-041ad6b4ce20 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance 40e3cea4-71b3-45b0-b832-370b34557bc0 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:58.781089 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-50148f23-7f17-4c6a-b2af-041ad6b4ce20 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/40e3cea4-71b3-45b0-b832-370b34557bc0" status: 404 len: 111 microversion: 2.1 time: 0.024530 May 28 21:14:58.786293 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1629/3284] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:58 2022] GET /compute/v2.1/servers/40e3cea4-71b3-45b0-b832-370b34557bc0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:58.933421 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e27bf55d-e65e-48c5-b564-cbc1ba377e9a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/servers/29cb4dc1-1163-4714-8b68-133d8643211a" status: 204 len: 0 microversion: 2.1 time: 0.310267 May 28 21:14:58.934132 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1656/3285] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:14:58 2022] DELETE /compute/v2.1/servers/29cb4dc1-1163-4714-8b68-133d8643211a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:14:58.946704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4501bcec-f220-45e2-afe1-c16f7efce45f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:58.947337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4501bcec-f220-45e2-afe1-c16f7efce45f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 29cb4dc1-1163-4714-8b68-133d8643211a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:58.962473 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-4501bcec-f220-45e2-afe1-c16f7efce45f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4501bcec-f220-45e2-afe1-c16f7efce45f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/29cb4dc1-1163-4714-8b68-133d8643211a HTTP/1.1 May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '29cb4dc1-1163-4714-8b68-133d8643211a'} May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 29cb4dc1-1163-4714-8b68-133d8643211a May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:58.969441 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4501bcec-f220-45e2-afe1-c16f7efce45f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4501bcec-f220-45e2-afe1-c16f7efce45f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/29cb4dc1-1163-4714-8b68-133d8643211a" status: 404 len: 111 microversion: 2.1 time: 0.028506 May 28 21:14:58.974155 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1630/3286] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:58 2022] GET /compute/v2.1/servers/29cb4dc1-1163-4714-8b68-133d8643211a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:14:59.135513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-57769550", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "ca803b4d-8584-4327-9f76-66ddebb3c209"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:14:59.197560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] validate_networks() for [('ca803b4d-8584-4327-9f76-66ddebb3c209', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:14:59.339782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7dea2aa9-badf-4f85-9828-436b491abab6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:59.340494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7dea2aa9-badf-4f85-9828-436b491abab6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:59.347359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:59.349894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7dea2aa9-badf-4f85-9828-436b491abab6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:59.355870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7dea2aa9-badf-4f85-9828-436b491abab6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:59.355870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7dea2aa9-badf-4f85-9828-436b491abab6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:59.355870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7dea2aa9-badf-4f85-9828-436b491abab6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:59.565891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7dea2aa9-badf-4f85-9828-436b491abab6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:59.573636 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7dea2aa9-badf-4f85-9828-436b491abab6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.245091 May 28 21:14:59.574246 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1631/3287] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:59 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:14:59.618694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f476f330-048f-41a0-a7b3-15fcb56bc450 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:59.619406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f476f330-048f-41a0-a7b3-15fcb56bc450 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:59.625604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f476f330-048f-41a0-a7b3-15fcb56bc450 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:59.626165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f476f330-048f-41a0-a7b3-15fcb56bc450 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:59.627035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f476f330-048f-41a0-a7b3-15fcb56bc450 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:59.627487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f476f330-048f-41a0-a7b3-15fcb56bc450 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:59.631768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:14:59.673141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:14:59.673635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:14:59.674449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:14:59.674828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:14:59.675434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:14:59.684947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:59.685671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:59.687144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:14:59.687904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:14:59.705816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:14:59.712482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for user 572170ccd67e4facbf10dad7cd1491c1 and project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:14:59.729722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:14:59.731983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:14:59.783173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f476f330-048f-41a0-a7b3-15fcb56bc450 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:59.791228 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f476f330-048f-41a0-a7b3-15fcb56bc450 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1317 microversion: 2.1 time: 0.176520 May 28 21:14:59.791804 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1632/3288] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:59 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:14:59.884121 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9f91f7c0-2fd1-44ec-b35b-4a9c6b0db032 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753118 May 28 21:14:59.884903 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1657/3289] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:14:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:14:59.894958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d10ab0f9-ee4f-45db-940e-e7bf317e81fe tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:14:59.895587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d10ab0f9-ee4f-45db-940e-e7bf317e81fe tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:14:59.952959 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d10ab0f9-ee4f-45db-940e-e7bf317e81fe tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:14:59.962032 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d10ab0f9-ee4f-45db-940e-e7bf317e81fe tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1219 microversion: 2.1 time: 0.071050 May 28 21:14:59.964001 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1633/3290] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:14:59 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:00.540863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-3a620b22-ab5f-40f1-8c51-5ac81c6dde7f req-ab196a0e-38bd-49e0-92a6-49f325e066f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144ab366-0448-410f-9093-91dec09b838c", "name": "network-vif-plugged", "status": "completed", "tag": "cfbdc8df-e8d0-4012-b243-cfb3e0d4ff83"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:00.549912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3a620b22-ab5f-40f1-8c51-5ac81c6dde7f req-ab196a0e-38bd-49e0-92a6-49f325e066f1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:00.550445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3a620b22-ab5f-40f1-8c51-5ac81c6dde7f req-ab196a0e-38bd-49e0-92a6-49f325e066f1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:00.562218 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-3a620b22-ab5f-40f1-8c51-5ac81c6dde7f req-ab196a0e-38bd-49e0-92a6-49f325e066f1 service nova] Creating event network-vif-plugged:cfbdc8df-e8d0-4012-b243-cfb3e0d4ff83 for instance 144ab366-0448-410f-9093-91dec09b838c on nch2-master-1 May 28 21:15:00.569922 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-3a620b22-ab5f-40f1-8c51-5ac81c6dde7f req-ab196a0e-38bd-49e0-92a6-49f325e066f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033057 May 28 21:15:00.570906 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1658/3291] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:15:00.593331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1269850c-cdf7-4d3b-81f6-4b2ca1506304 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:00.594104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1269850c-cdf7-4d3b-81f6-4b2ca1506304 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:00.603285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1269850c-cdf7-4d3b-81f6-4b2ca1506304 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:00.603839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1269850c-cdf7-4d3b-81f6-4b2ca1506304 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:00.605660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1269850c-cdf7-4d3b-81f6-4b2ca1506304 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:00.606850 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1269850c-cdf7-4d3b-81f6-4b2ca1506304 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:00.812311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-460c28e4-7960-4f86-8a61-094efa4729e0 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:00.813190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-460c28e4-7960-4f86-8a61-094efa4729e0 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:00.820856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-460c28e4-7960-4f86-8a61-094efa4729e0 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:00.821372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-460c28e4-7960-4f86-8a61-094efa4729e0 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:00.822554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-460c28e4-7960-4f86-8a61-094efa4729e0 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:00.823618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-460c28e4-7960-4f86-8a61-094efa4729e0 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:00.838886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1269850c-cdf7-4d3b-81f6-4b2ca1506304 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:00.849306 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1269850c-cdf7-4d3b-81f6-4b2ca1506304 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.261414 May 28 21:15:00.850281 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1634/3292] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:00 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:00.982008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-399ec3cf-5682-47e0-90d6-bc8679c8e04f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:00.982640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-399ec3cf-5682-47e0-90d6-bc8679c8e04f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:00.989422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-399ec3cf-5682-47e0-90d6-bc8679c8e04f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:00.990030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-399ec3cf-5682-47e0-90d6-bc8679c8e04f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:00.990821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-399ec3cf-5682-47e0-90d6-bc8679c8e04f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:00.991814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-399ec3cf-5682-47e0-90d6-bc8679c8e04f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:01.015994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-460c28e4-7960-4f86-8a61-094efa4729e0 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:01.024132 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-460c28e4-7960-4f86-8a61-094efa4729e0 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1317 microversion: 2.1 time: 0.215992 May 28 21:15:01.024710 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1659/3293] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:00 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:01.055243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-399ec3cf-5682-47e0-90d6-bc8679c8e04f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:01.063953 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-399ec3cf-5682-47e0-90d6-bc8679c8e04f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1223 microversion: 2.1 time: 0.085195 May 28 21:15:01.073662 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1635/3294] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:00 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:01.870265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f68c573c-f882-4a0a-9cc1-881ade135ad7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:01.871092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f68c573c-f882-4a0a-9cc1-881ade135ad7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:01.877399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:01.881654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f68c573c-f882-4a0a-9cc1-881ade135ad7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:01.882484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f68c573c-f882-4a0a-9cc1-881ade135ad7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:01.883527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f68c573c-f882-4a0a-9cc1-881ade135ad7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:01.884055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f68c573c-f882-4a0a-9cc1-881ade135ad7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:02.036489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f68c573c-f882-4a0a-9cc1-881ade135ad7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:02.041550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-319b72bd-bbca-4490-b656-cc6ed40842b6 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:02.042216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-319b72bd-bbca-4490-b656-cc6ed40842b6 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:02.049681 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f68c573c-f882-4a0a-9cc1-881ade135ad7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.183966 May 28 21:15:02.050938 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1660/3295] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:01 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:02.052046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-319b72bd-bbca-4490-b656-cc6ed40842b6 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:02.052516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-319b72bd-bbca-4490-b656-cc6ed40842b6 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:02.053319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-319b72bd-bbca-4490-b656-cc6ed40842b6 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:02.053799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-319b72bd-bbca-4490-b656-cc6ed40842b6 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:02.082046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9ed344a2-a2f4-4c65-88f2-743326bc7d44 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:02.082867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9ed344a2-a2f4-4c65-88f2-743326bc7d44 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:02.090840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ed344a2-a2f4-4c65-88f2-743326bc7d44 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:02.095768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ed344a2-a2f4-4c65-88f2-743326bc7d44 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:02.095768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ed344a2-a2f4-4c65-88f2-743326bc7d44 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:02.095768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ed344a2-a2f4-4c65-88f2-743326bc7d44 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:02.188168 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9ed344a2-a2f4-4c65-88f2-743326bc7d44 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:02.197031 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9ed344a2-a2f4-4c65-88f2-743326bc7d44 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1271 microversion: 2.1 time: 0.119412 May 28 21:15:02.197781 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1661/3296] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:02 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:02.244098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-319b72bd-bbca-4490-b656-cc6ed40842b6 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:02.254128 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-319b72bd-bbca-4490-b656-cc6ed40842b6 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1317 microversion: 2.1 time: 0.216397 May 28 21:15:02.258345 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1636/3297] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:02 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:02.584983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-7eab45e6-e4a5-4bc3-9911-fc3a858910bb req-48d60324-9825-4ca7-97a7-65398b8bcc19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d9b7c0-0b10-4aea-9af1-50ede9a13238", "name": "network-vif-plugged", "status": "completed", "tag": "4e49f946-3e3f-4a15-ba0a-14cb379976e5"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:02.593954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7eab45e6-e4a5-4bc3-9911-fc3a858910bb req-48d60324-9825-4ca7-97a7-65398b8bcc19 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:02.602851 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7eab45e6-e4a5-4bc3-9911-fc3a858910bb req-48d60324-9825-4ca7-97a7-65398b8bcc19 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:02.605712 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-7eab45e6-e4a5-4bc3-9911-fc3a858910bb req-48d60324-9825-4ca7-97a7-65398b8bcc19 service nova] Creating event network-vif-plugged:4e49f946-3e3f-4a15-ba0a-14cb379976e5 for instance 58d9b7c0-0b10-4aea-9af1-50ede9a13238 on nch2-master-1 May 28 21:15:02.610938 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-7eab45e6-e4a5-4bc3-9911-fc3a858910bb req-48d60324-9825-4ca7-97a7-65398b8bcc19 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030069 May 28 21:15:02.611547 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1662/3298] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:15:03.075578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-03c2d1ed-62f3-4dd0-8990-5d21e2e5159d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:03.076800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-03c2d1ed-62f3-4dd0-8990-5d21e2e5159d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:03.096978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03c2d1ed-62f3-4dd0-8990-5d21e2e5159d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:03.097442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03c2d1ed-62f3-4dd0-8990-5d21e2e5159d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:03.098299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03c2d1ed-62f3-4dd0-8990-5d21e2e5159d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:03.098920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03c2d1ed-62f3-4dd0-8990-5d21e2e5159d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:03.216595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8ebcf905-0844-4a2a-8b12-faf2e0731b4d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:03.217265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8ebcf905-0844-4a2a-8b12-faf2e0731b4d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:03.226375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ebcf905-0844-4a2a-8b12-faf2e0731b4d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:03.226968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ebcf905-0844-4a2a-8b12-faf2e0731b4d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:03.227770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ebcf905-0844-4a2a-8b12-faf2e0731b4d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:03.228243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ebcf905-0844-4a2a-8b12-faf2e0731b4d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:03.395440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-03c2d1ed-62f3-4dd0-8990-5d21e2e5159d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:03.403803 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-03c2d1ed-62f3-4dd0-8990-5d21e2e5159d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.336175 May 28 21:15:03.404775 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1637/3299] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:03 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:03.410111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0126d62a-9c02-4f12-ba19-1ff1ba67e164 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:03.410952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0126d62a-9c02-4f12-ba19-1ff1ba67e164 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:03.417918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0126d62a-9c02-4f12-ba19-1ff1ba67e164 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:03.418366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0126d62a-9c02-4f12-ba19-1ff1ba67e164 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:03.419147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0126d62a-9c02-4f12-ba19-1ff1ba67e164 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:03.419594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0126d62a-9c02-4f12-ba19-1ff1ba67e164 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:03.441809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8ebcf905-0844-4a2a-8b12-faf2e0731b4d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:03.444714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:03.451336 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8ebcf905-0844-4a2a-8b12-faf2e0731b4d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1319 microversion: 2.1 time: 0.240521 May 28 21:15:03.452052 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1663/3300] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:03 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:03.659003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0126d62a-9c02-4f12-ba19-1ff1ba67e164 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:03.667073 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0126d62a-9c02-4f12-ba19-1ff1ba67e164 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1317 microversion: 2.1 time: 0.260745 May 28 21:15:03.674536 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1638/3301] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:03 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1317 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:04.413786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-e8956c1d-5982-4199-bef7-73e0f3ab4cfd req-afdc12ca-bd27-4733-8e70-ed3987196f6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae56f66e-ab85-40da-a2b6-0cf501aa93c9", "tag": "beb97cf9-22a8-478e-89ac-e81ad1052d46"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:04.427359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e8956c1d-5982-4199-bef7-73e0f3ab4cfd req-afdc12ca-bd27-4733-8e70-ed3987196f6a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:04.427823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e8956c1d-5982-4199-bef7-73e0f3ab4cfd req-afdc12ca-bd27-4733-8e70-ed3987196f6a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:04.431009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e4ca5981-4173-495d-a5f7-a1ccfa96d16f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:04.431009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e4ca5981-4173-495d-a5f7-a1ccfa96d16f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:04.440900 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4ca5981-4173-495d-a5f7-a1ccfa96d16f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:04.441704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4ca5981-4173-495d-a5f7-a1ccfa96d16f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:04.442227 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e8956c1d-5982-4199-bef7-73e0f3ab4cfd req-afdc12ca-bd27-4733-8e70-ed3987196f6a service nova] Creating event network-changed:beb97cf9-22a8-478e-89ac-e81ad1052d46 for instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 on nch2-master-1 May 28 21:15:04.443267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4ca5981-4173-495d-a5f7-a1ccfa96d16f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:04.443724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4ca5981-4173-495d-a5f7-a1ccfa96d16f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:04.448025 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-e8956c1d-5982-4199-bef7-73e0f3ab4cfd req-afdc12ca-bd27-4733-8e70-ed3987196f6a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038560 May 28 21:15:04.449259 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1664/3302] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:15:04.469712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6aca0d04-df93-4c0b-b351-da8f47bc1756 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:04.470654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6aca0d04-df93-4c0b-b351-da8f47bc1756 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:04.477804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6aca0d04-df93-4c0b-b351-da8f47bc1756 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:04.478310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6aca0d04-df93-4c0b-b351-da8f47bc1756 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:04.479099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6aca0d04-df93-4c0b-b351-da8f47bc1756 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:04.479550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6aca0d04-df93-4c0b-b351-da8f47bc1756 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:05.058527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e4ca5981-4173-495d-a5f7-a1ccfa96d16f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:05.067040 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e4ca5981-4173-495d-a5f7-a1ccfa96d16f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.646322 May 28 21:15:05.067631 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1639/3303] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:04 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:05.072874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-86693b07-ec9f-49f9-ac33-53b059fc8f2b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:05.073489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-86693b07-ec9f-49f9-ac33-53b059fc8f2b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:05.080376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86693b07-ec9f-49f9-ac33-53b059fc8f2b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:05.081030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86693b07-ec9f-49f9-ac33-53b059fc8f2b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:05.082151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86693b07-ec9f-49f9-ac33-53b059fc8f2b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:05.082596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86693b07-ec9f-49f9-ac33-53b059fc8f2b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:05.096690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6aca0d04-df93-4c0b-b351-da8f47bc1756 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:05.107357 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6aca0d04-df93-4c0b-b351-da8f47bc1756 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1319 microversion: 2.1 time: 0.641493 May 28 21:15:05.118026 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1665/3304] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:04 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1319 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:05.281505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-86693b07-ec9f-49f9-ac33-53b059fc8f2b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:05.292675 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-86693b07-ec9f-49f9-ac33-53b059fc8f2b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1466 microversion: 2.1 time: 0.223759 May 28 21:15:05.304193 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1640/3305] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:05 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1466 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:05.309315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7cc90a57-4204-45a0-a7d9-05bc1d9bf65e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:05.310041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7cc90a57-4204-45a0-a7d9-05bc1d9bf65e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 144ab366-0448-410f-9093-91dec09b838c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:05.316262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cc90a57-4204-45a0-a7d9-05bc1d9bf65e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:05.316636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cc90a57-4204-45a0-a7d9-05bc1d9bf65e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:05.317588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cc90a57-4204-45a0-a7d9-05bc1d9bf65e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:05.318224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cc90a57-4204-45a0-a7d9-05bc1d9bf65e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:05.548467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7cc90a57-4204-45a0-a7d9-05bc1d9bf65e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:05.557526 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7cc90a57-4204-45a0-a7d9-05bc1d9bf65e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c" status: 200 len: 1467 microversion: 2.1 time: 0.252135 May 28 21:15:05.558452 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1666/3306] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:05 2022] GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c => generated 1467 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:05.576996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6a8dc7a4-6e8e-4f67-98fd-b54d35ff05bc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1347929479"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:05.579222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6a8dc7a4-6e8e-4f67-98fd-b54d35ff05bc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 144ab366-0448-410f-9093-91dec09b838c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:05.586653 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a8dc7a4-6e8e-4f67-98fd-b54d35ff05bc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:05.587118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a8dc7a4-6e8e-4f67-98fd-b54d35ff05bc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:05.587906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a8dc7a4-6e8e-4f67-98fd-b54d35ff05bc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:05.588355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a8dc7a4-6e8e-4f67-98fd-b54d35ff05bc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:06.085206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-186afbfd-1f25-4477-b16a-6198f6ef1a89 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:06.085761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-186afbfd-1f25-4477-b16a-6198f6ef1a89 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:06.091934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-186afbfd-1f25-4477-b16a-6198f6ef1a89 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:06.092395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-186afbfd-1f25-4477-b16a-6198f6ef1a89 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:06.097130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-186afbfd-1f25-4477-b16a-6198f6ef1a89 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:06.097130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-186afbfd-1f25-4477-b16a-6198f6ef1a89 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:06.126506 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6a8dc7a4-6e8e-4f67-98fd-b54d35ff05bc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "POST /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c/action" status: 202 len: 0 microversion: 2.1 time: 0.553760 May 28 21:15:06.126506 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1641/3307] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:15:05 2022] POST /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 21:15:06.134942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ca73a97a-949c-4ba8-bd0d-c9a05469758a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:06.135654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ca73a97a-949c-4ba8-bd0d-c9a05469758a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:06.142346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca73a97a-949c-4ba8-bd0d-c9a05469758a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:06.142964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca73a97a-949c-4ba8-bd0d-c9a05469758a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:06.143764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca73a97a-949c-4ba8-bd0d-c9a05469758a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:06.144226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca73a97a-949c-4ba8-bd0d-c9a05469758a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:06.294299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-186afbfd-1f25-4477-b16a-6198f6ef1a89 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:06.302387 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-186afbfd-1f25-4477-b16a-6198f6ef1a89 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.221716 May 28 21:15:06.303458 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1667/3308] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:06 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:06.308462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb2b5910-6d1e-42ac-8ed9-62f98dadd158 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57f7fd30>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:06.322669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ca73a97a-949c-4ba8-bd0d-c9a05469758a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:06.330364 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ca73a97a-949c-4ba8-bd0d-c9a05469758a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1319 microversion: 2.1 time: 0.199548 May 28 21:15:06.330948 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1642/3309] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:06 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:06.354350 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb2b5910-6d1e-42ac-8ed9-62f98dadd158 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1453 microversion: 2.1 time: 0.049445 May 28 21:15:06.355730 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1668/3310] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:06 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1453 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:07.319561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a5dbfb3c-ddb6-455b-bee3-50ea4812288d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:07.320216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a5dbfb3c-ddb6-455b-bee3-50ea4812288d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:07.327331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5dbfb3c-ddb6-455b-bee3-50ea4812288d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:07.327793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5dbfb3c-ddb6-455b-bee3-50ea4812288d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:07.328581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5dbfb3c-ddb6-455b-bee3-50ea4812288d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:07.329022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5dbfb3c-ddb6-455b-bee3-50ea4812288d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:07.350316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e30cc415-7cee-4a49-a160-92462a203905 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:07.351308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e30cc415-7cee-4a49-a160-92462a203905 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:07.359877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e30cc415-7cee-4a49-a160-92462a203905 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:07.360408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e30cc415-7cee-4a49-a160-92462a203905 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:07.361387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e30cc415-7cee-4a49-a160-92462a203905 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:07.361969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e30cc415-7cee-4a49-a160-92462a203905 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:07.539953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a5dbfb3c-ddb6-455b-bee3-50ea4812288d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:07.547179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e30cc415-7cee-4a49-a160-92462a203905 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:07.547700 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a5dbfb3c-ddb6-455b-bee3-50ea4812288d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.231990 May 28 21:15:07.548321 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1643/3311] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:07 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:07.552985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-797a32fc-3181-498a-997f-2bcb56e782b8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57f68ca0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:07.556125 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e30cc415-7cee-4a49-a160-92462a203905 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1319 microversion: 2.1 time: 0.212058 May 28 21:15:07.556804 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1669/3312] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:07 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:07.565863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7aac6fc5-e71d-4bed-b05f-5f2a65df8ca2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:07.565863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7aac6fc5-e71d-4bed-b05f-5f2a65df8ca2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:07.569299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7aac6fc5-e71d-4bed-b05f-5f2a65df8ca2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:07.569787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7aac6fc5-e71d-4bed-b05f-5f2a65df8ca2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:07.570741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7aac6fc5-e71d-4bed-b05f-5f2a65df8ca2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:07.571185 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7aac6fc5-e71d-4bed-b05f-5f2a65df8ca2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-7aac6fc5-e71d-4bed-b05f-5f2a65df8ca2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7aac6fc5-e71d-4bed-b05f-5f2a65df8ca2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a HTTP/1.1 May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'ea206247-c6b4-49e5-aafd-92084ea25c9a'} May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:15:07.588742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7aac6fc5-e71d-4bed-b05f-5f2a65df8ca2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7aac6fc5-e71d-4bed-b05f-5f2a65df8ca2 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 404 len: 111 microversion: 2.1 time: 0.031118 May 28 21:15:07.593222 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1670/3313] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:15:07 2022] DELETE /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:15:07.597714 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-797a32fc-3181-498a-997f-2bcb56e782b8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1453 microversion: 2.1 time: 0.048174 May 28 21:15:07.598332 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1644/3314] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:07 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1453 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:07.603385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-99847e9b-ec76-408f-af00-c189ef46f935 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:07.604014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-99847e9b-ec76-408f-af00-c189ef46f935 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: ea206247-c6b4-49e5-aafd-92084ea25c9a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:07.610615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-99847e9b-ec76-408f-af00-c189ef46f935 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:07.615060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-99847e9b-ec76-408f-af00-c189ef46f935 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:07.615060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-99847e9b-ec76-408f-af00-c189ef46f935 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:07.615060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-99847e9b-ec76-408f-af00-c189ef46f935 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:07.628630 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-99847e9b-ec76-408f-af00-c189ef46f935 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-99847e9b-ec76-408f-af00-c189ef46f935 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a HTTP/1.1 May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'ea206247-c6b4-49e5-aafd-92084ea25c9a'} May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:07.630211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:07.639354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:07.639354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:07.639354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:07.639354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:15:07.639354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:15:07.639354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. May 28 21:15:07.639354 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:07.639354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-99847e9b-ec76-408f-af00-c189ef46f935 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance ea206247-c6b4-49e5-aafd-92084ea25c9a could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:15:07.639354 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-99847e9b-ec76-408f-af00-c189ef46f935 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a" status: 404 len: 111 microversion: 2.1 time: 0.032940 May 28 21:15:07.639354 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1671/3315] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:07 2022] GET /compute/v2.1/servers/ea206247-c6b4-49e5-aafd-92084ea25c9a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:15:07.641646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6c7a4976-846a-4a53-882f-8f6c093fa601 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:07.642238 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6c7a4976-846a-4a53-882f-8f6c093fa601 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:07.649087 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c7a4976-846a-4a53-882f-8f6c093fa601 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:07.649559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c7a4976-846a-4a53-882f-8f6c093fa601 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:07.650369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c7a4976-846a-4a53-882f-8f6c093fa601 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:07.650823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c7a4976-846a-4a53-882f-8f6c093fa601 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:07.669669 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-6c7a4976-846a-4a53-882f-8f6c093fa601 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6c7a4976-846a-4a53-882f-8f6c093fa601 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a HTTP/1.1 May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '2df2686a-ce55-4771-b8e5-a67cf87ee98a'} May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:15:07.671432 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:15:07.681380 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. May 28 21:15:07.681380 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:15:07.681380 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:07.681380 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:15:07.681380 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:07.681380 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:07.681380 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:07.681380 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:15:07.681380 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:15:07.681380 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. May 28 21:15:07.681380 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:15:07.681380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6c7a4976-846a-4a53-882f-8f6c093fa601 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:15:07.681380 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6c7a4976-846a-4a53-882f-8f6c093fa601 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 404 len: 111 microversion: 2.1 time: 0.035097 May 28 21:15:07.681380 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1645/3316] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:15:07 2022] DELETE /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:15:07.686261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f5d9b429-71da-453a-bc52-1757a5f97ae8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:07.686891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f5d9b429-71da-453a-bc52-1757a5f97ae8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] [instance: 2df2686a-ce55-4771-b8e5-a67cf87ee98a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:07.692940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5d9b429-71da-453a-bc52-1757a5f97ae8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:07.693424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5d9b429-71da-453a-bc52-1757a5f97ae8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:07.694219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5d9b429-71da-453a-bc52-1757a5f97ae8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:07.694675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5d9b429-71da-453a-bc52-1757a5f97ae8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:07.708340 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-f5d9b429-71da-453a-bc52-1757a5f97ae8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] HTTP exception thrown: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f5d9b429-71da-453a-bc52-1757a5f97ae8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Request method failure captured: May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a HTTP/1.1 May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABiko_SkN3qaxEKADxT1LvDmFe7Vdqq4xIcL7RAGf6Y1C_wxIz4YPp9Y1jQWQ2hN9rY7JoJtAMobxq319xyVRm5I_6FydazLtTjvXWWTKy7n30dMLu64OkieeXPjI7uKr7_g_FtQE4xSpPaCP6Y7TYesu-7By1pQviI8y0h2zOjl03szMc May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: cf04fd760c54473f83980a385252fa3c May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf04fd760c54473f83980a385252fa3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf04fd760c54473f83980a385252fa3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-DeleteServersTestJSON-435436475 May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: cf04fd760c54473f83980a385252fa3c May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-DeleteServersTestJSON-435436475 May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-DeleteServersTestJSON-435436475-project May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: bf9c8f66e7d24ca9baca835e41546f22 May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-DeleteServersTestJSON-435436475-project May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '2df2686a-ce55-4771-b8e5-a67cf87ee98a'} May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:07.709926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:07.718671 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:07.718671 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:07.718671 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:07.718671 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:15:07.718671 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:15:07.718671 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. May 28 21:15:07.718671 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:07.718671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f5d9b429-71da-453a-bc52-1757a5f97ae8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] Returning 404 to user: Instance 2df2686a-ce55-4771-b8e5-a67cf87ee98a could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:15:07.718671 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f5d9b429-71da-453a-bc52-1757a5f97ae8 tempest-DeleteServersTestJSON-435436475 tempest-DeleteServersTestJSON-435436475-project] 10.222.0.33 "GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a" status: 404 len: 111 microversion: 2.1 time: 0.029630 May 28 21:15:07.718671 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1672/3317] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:07 2022] GET /compute/v2.1/servers/2df2686a-ce55-4771-b8e5-a67cf87ee98a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:15:08.566009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fb703003-7dc9-4dbc-9d96-8ac44ab42e77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:08.566713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fb703003-7dc9-4dbc-9d96-8ac44ab42e77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:08.573323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-31047291-765d-498a-911b-16cb1e323c59 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:08.574643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-31047291-765d-498a-911b-16cb1e323c59 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:08.574969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb703003-7dc9-4dbc-9d96-8ac44ab42e77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:08.575414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb703003-7dc9-4dbc-9d96-8ac44ab42e77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:08.576189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb703003-7dc9-4dbc-9d96-8ac44ab42e77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:08.576800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb703003-7dc9-4dbc-9d96-8ac44ab42e77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:08.590669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31047291-765d-498a-911b-16cb1e323c59 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:08.591131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31047291-765d-498a-911b-16cb1e323c59 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:08.591924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31047291-765d-498a-911b-16cb1e323c59 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:08.592370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31047291-765d-498a-911b-16cb1e323c59 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:08.802238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-31047291-765d-498a-911b-16cb1e323c59 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:08.804081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fb703003-7dc9-4dbc-9d96-8ac44ab42e77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:08.812434 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fb703003-7dc9-4dbc-9d96-8ac44ab42e77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.251154 May 28 21:15:08.813028 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1646/3318] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:08 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:08.814590 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-31047291-765d-498a-911b-16cb1e323c59 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1319 microversion: 2.1 time: 0.245839 May 28 21:15:08.815323 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1673/3319] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:08 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:08.817545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a0dfddf1-5fda-4c9d-a90a-98029db53ca8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d64298d30>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:08.865255 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a0dfddf1-5fda-4c9d-a90a-98029db53ca8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1453 microversion: 2.1 time: 0.051154 May 28 21:15:08.865855 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1647/3320] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:08 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1453 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:09.831197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4c57ecd0-411a-4bbc-ba8c-30512cf53365 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:09.832504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd78bd18-4933-475c-b404-e54eebb20bb2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:09.833010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4c57ecd0-411a-4bbc-ba8c-30512cf53365 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:09.833277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bd78bd18-4933-475c-b404-e54eebb20bb2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:09.835565 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:09.836745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=13 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:09.840461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd78bd18-4933-475c-b404-e54eebb20bb2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:09.840899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd78bd18-4933-475c-b404-e54eebb20bb2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:09.841677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd78bd18-4933-475c-b404-e54eebb20bb2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:09.842056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c57ecd0-411a-4bbc-ba8c-30512cf53365 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:09.842180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd78bd18-4933-475c-b404-e54eebb20bb2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:09.842521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c57ecd0-411a-4bbc-ba8c-30512cf53365 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:09.843302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c57ecd0-411a-4bbc-ba8c-30512cf53365 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:09.843751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c57ecd0-411a-4bbc-ba8c-30512cf53365 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:09.961973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:10.067551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bd78bd18-4933-475c-b404-e54eebb20bb2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:10.070592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4c57ecd0-411a-4bbc-ba8c-30512cf53365 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:10.077106 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bd78bd18-4933-475c-b404-e54eebb20bb2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1319 microversion: 2.1 time: 0.249258 May 28 21:15:10.077913 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1648/3321] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:09 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:10.079743 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4c57ecd0-411a-4bbc-ba8c-30512cf53365 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.253054 May 28 21:15:10.080777 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1674/3322] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:09 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:10.083576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6f59f7fe-102a-4a65-9c3e-e9b97c5a4db9 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d642981f0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:10.139447 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6f59f7fe-102a-4a65-9c3e-e9b97c5a4db9 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1453 microversion: 2.1 time: 0.060270 May 28 21:15:10.140663 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1649/3323] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:10 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1453 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:10.628801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-e9890602-d8fa-4fc8-8a8d-5476c034b9b5 req-61619ae6-d8c0-4dd2-8bda-9b895d654ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae56f66e-ab85-40da-a2b6-0cf501aa93c9", "name": "network-vif-plugged", "status": "completed", "tag": "beb97cf9-22a8-478e-89ac-e81ad1052d46"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:10.643621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e9890602-d8fa-4fc8-8a8d-5476c034b9b5 req-61619ae6-d8c0-4dd2-8bda-9b895d654ca6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:10.644113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e9890602-d8fa-4fc8-8a8d-5476c034b9b5 req-61619ae6-d8c0-4dd2-8bda-9b895d654ca6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:10.657411 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e9890602-d8fa-4fc8-8a8d-5476c034b9b5 req-61619ae6-d8c0-4dd2-8bda-9b895d654ca6 service nova] Creating event network-vif-plugged:beb97cf9-22a8-478e-89ac-e81ad1052d46 for instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 on nch2-master-1 May 28 21:15:10.663431 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-e9890602-d8fa-4fc8-8a8d-5476c034b9b5 req-61619ae6-d8c0-4dd2-8bda-9b895d654ca6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038247 May 28 21:15:10.664203 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1650/3324] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:15:10.968633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d43b410a-466c-4fea-afff-42f3779a3f5b tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-799023177", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": "none"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:11.030151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-d43b410a-466c-4fea-afff-42f3779a3f5b tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:15:11.030703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-d43b410a-466c-4fea-afff-42f3779a3f5b tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:15:11.031487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-d43b410a-466c-4fea-afff-42f3779a3f5b tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:15:11.032086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-d43b410a-466c-4fea-afff-42f3779a3f5b tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:15:11.032765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-d43b410a-466c-4fea-afff-42f3779a3f5b tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:15:11.042910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d43b410a-466c-4fea-afff-42f3779a3f5b tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:11.043589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d43b410a-466c-4fea-afff-42f3779a3f5b tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:11.044539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d43b410a-466c-4fea-afff-42f3779a3f5b tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:11.044988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d43b410a-466c-4fea-afff-42f3779a3f5b tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:11.067198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-d43b410a-466c-4fea-afff-42f3779a3f5b tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Getting quotas for project 6846f7be3c13484e92e2bfbe9df3810f. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:15:11.073878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-d43b410a-466c-4fea-afff-42f3779a3f5b tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Getting quotas for user c9d2988731d14049b27283cda69bec93 and project 6846f7be3c13484e92e2bfbe9df3810f. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:15:11.090390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d43b410a-466c-4fea-afff-42f3779a3f5b tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:15:11.093123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d43b410a-466c-4fea-afff-42f3779a3f5b tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] [instance: 48f9b36f-6980-4b84-a3dc-66039a1062b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:15:11.097193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c312f1f3-5df4-4c34-810f-1a805fe2acbb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:11.098161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c312f1f3-5df4-4c34-810f-1a805fe2acbb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:11.114522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c312f1f3-5df4-4c34-810f-1a805fe2acbb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:11.115167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c312f1f3-5df4-4c34-810f-1a805fe2acbb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:11.117892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c312f1f3-5df4-4c34-810f-1a805fe2acbb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:11.118776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c312f1f3-5df4-4c34-810f-1a805fe2acbb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:11.272613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c312f1f3-5df4-4c34-810f-1a805fe2acbb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:11.281971 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c312f1f3-5df4-4c34-810f-1a805fe2acbb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1319 microversion: 2.1 time: 0.189454 May 28 21:15:11.295168 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1651/3325] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:11 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:11.298947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ceac8653-480b-4d33-9ff6-507cb5356f72 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:11.299154 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d43b410a-466c-4fea-afff-42f3779a3f5b tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.737076 May 28 21:15:11.299826 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1675/3326] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:15:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 21:15:11.305821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ceac8653-480b-4d33-9ff6-507cb5356f72 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:11.311157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ceac8653-480b-4d33-9ff6-507cb5356f72 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:11.311627 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ceac8653-480b-4d33-9ff6-507cb5356f72 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:11.312715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ceac8653-480b-4d33-9ff6-507cb5356f72 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:11.313180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ceac8653-480b-4d33-9ff6-507cb5356f72 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:11.316509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a6c5dd8a-526c-47af-9dec-4a7ddc611e7a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d64116160>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:11.390427 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a6c5dd8a-526c-47af-9dec-4a7ddc611e7a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1453 microversion: 2.1 time: 0.080817 May 28 21:15:11.391618 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1676/3327] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:11 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:11.397057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-abfd7f32-c18d-40af-8129-e3a4577de1a7 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:11.397896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-abfd7f32-c18d-40af-8129-e3a4577de1a7 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] [instance: 48f9b36f-6980-4b84-a3dc-66039a1062b4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:11.502865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-abfd7f32-c18d-40af-8129-e3a4577de1a7 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:11.511945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-abfd7f32-c18d-40af-8129-e3a4577de1a7 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:11.518352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-abfd7f32-c18d-40af-8129-e3a4577de1a7 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:11.519658 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-abfd7f32-c18d-40af-8129-e3a4577de1a7 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] 10.222.0.33 "GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4" status: 200 len: 1280 microversion: 2.47 time: 0.126660 May 28 21:15:11.520250 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1677/3328] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:15:11 2022] GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4 => generated 1280 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:15:11.603482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ceac8653-480b-4d33-9ff6-507cb5356f72 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:11.606342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:11.623894 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ceac8653-480b-4d33-9ff6-507cb5356f72 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.327787 May 28 21:15:11.625257 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1652/3329] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:11 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:12.305149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-729c965a-e5d1-4fbb-b0b6-65a77b42ed22 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:12.305778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-729c965a-e5d1-4fbb-b0b6-65a77b42ed22 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:12.322089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-729c965a-e5d1-4fbb-b0b6-65a77b42ed22 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:12.322750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-729c965a-e5d1-4fbb-b0b6-65a77b42ed22 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:12.323724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-729c965a-e5d1-4fbb-b0b6-65a77b42ed22 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:12.324184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-729c965a-e5d1-4fbb-b0b6-65a77b42ed22 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:12.405641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-00105ec7-cfb4-4f8d-8656-d41b4412ed3f tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d642769d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:12.513962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-729c965a-e5d1-4fbb-b0b6-65a77b42ed22 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:12.526957 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-729c965a-e5d1-4fbb-b0b6-65a77b42ed22 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1319 microversion: 2.1 time: 0.231467 May 28 21:15:12.527747 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1678/3330] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:12 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:12.541333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7d0b7e49-9e45-44c9-8195-855f6a77ce9e tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:12.543337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7d0b7e49-9e45-44c9-8195-855f6a77ce9e tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] [instance: 48f9b36f-6980-4b84-a3dc-66039a1062b4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:12.552670 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-00105ec7-cfb4-4f8d-8656-d41b4412ed3f tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1453 microversion: 2.1 time: 0.151880 May 28 21:15:12.554476 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1653/3331] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:12 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:12.609857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7d0b7e49-9e45-44c9-8195-855f6a77ce9e tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:12.617578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7d0b7e49-9e45-44c9-8195-855f6a77ce9e tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:12.619160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7d0b7e49-9e45-44c9-8195-855f6a77ce9e tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:12.620311 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7d0b7e49-9e45-44c9-8195-855f6a77ce9e tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] 10.222.0.33 "GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4" status: 200 len: 1280 microversion: 2.47 time: 0.086087 May 28 21:15:12.622708 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1679/3332] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:15:12 2022] GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4 => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:15:12.642779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a1c27ae2-c79a-498f-ac15-25f0948e6445 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:12.643407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a1c27ae2-c79a-498f-ac15-25f0948e6445 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:12.652797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1c27ae2-c79a-498f-ac15-25f0948e6445 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:12.653632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1c27ae2-c79a-498f-ac15-25f0948e6445 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:12.655419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1c27ae2-c79a-498f-ac15-25f0948e6445 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:12.656099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1c27ae2-c79a-498f-ac15-25f0948e6445 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:12.683621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-546791d6-efae-4b30-a50e-344f9f100f34 req-1b9a76a2-4616-436b-affa-e88550ff1cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144ab366-0448-410f-9093-91dec09b838c", "name": "network-vif-plugged", "status": "completed", "tag": "cfbdc8df-e8d0-4012-b243-cfb3e0d4ff83"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:12.696520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-546791d6-efae-4b30-a50e-344f9f100f34 req-1b9a76a2-4616-436b-affa-e88550ff1cbb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:12.697275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-546791d6-efae-4b30-a50e-344f9f100f34 req-1b9a76a2-4616-436b-affa-e88550ff1cbb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:12.732848 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-546791d6-efae-4b30-a50e-344f9f100f34 req-1b9a76a2-4616-436b-affa-e88550ff1cbb service nova] Creating event network-vif-plugged:cfbdc8df-e8d0-4012-b243-cfb3e0d4ff83 for instance 144ab366-0448-410f-9093-91dec09b838c on nch2-master-1 May 28 21:15:12.749026 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-546791d6-efae-4b30-a50e-344f9f100f34 req-1b9a76a2-4616-436b-affa-e88550ff1cbb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070440 May 28 21:15:12.749936 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1680/3333] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:15:12.838762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a1c27ae2-c79a-498f-ac15-25f0948e6445 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:12.848467 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a1c27ae2-c79a-498f-ac15-25f0948e6445 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.209728 May 28 21:15:12.849935 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1654/3334] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:12 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:13.551297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7efc5e6-1f3c-448c-ab49-6254bdee64c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:13.552077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d7efc5e6-1f3c-448c-ab49-6254bdee64c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:13.561235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7efc5e6-1f3c-448c-ab49-6254bdee64c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:13.561697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7efc5e6-1f3c-448c-ab49-6254bdee64c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:13.562693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7efc5e6-1f3c-448c-ab49-6254bdee64c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:13.563300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7efc5e6-1f3c-448c-ab49-6254bdee64c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:13.573332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-71507d4c-d4bf-4491-94fd-d9de8d7488eb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d64566790>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:13.721097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d7efc5e6-1f3c-448c-ab49-6254bdee64c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:13.730601 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d7efc5e6-1f3c-448c-ab49-6254bdee64c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1500 microversion: 2.1 time: 0.185201 May 28 21:15:13.731344 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1681/3335] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:13 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1500 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:13.746435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-00d3cc06-9c1f-4e3e-b637-f7246b8462ca tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:13.747619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-00d3cc06-9c1f-4e3e-b637-f7246b8462ca tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] [instance: 48f9b36f-6980-4b84-a3dc-66039a1062b4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:13.766637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00d3cc06-9c1f-4e3e-b637-f7246b8462ca tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:13.767428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00d3cc06-9c1f-4e3e-b637-f7246b8462ca tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:13.768406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00d3cc06-9c1f-4e3e-b637-f7246b8462ca tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:13.768860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00d3cc06-9c1f-4e3e-b637-f7246b8462ca tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:13.875782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-00d3cc06-9c1f-4e3e-b637-f7246b8462ca tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:13.886139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-00d3cc06-9c1f-4e3e-b637-f7246b8462ca tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:13.889100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-00d3cc06-9c1f-4e3e-b637-f7246b8462ca tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:13.890460 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-00d3cc06-9c1f-4e3e-b637-f7246b8462ca tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] 10.222.0.33 "GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4" status: 200 len: 1276 microversion: 2.47 time: 0.157902 May 28 21:15:13.897935 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1682/3336] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:15:13 2022] GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:15:13.897935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c4f433b8-572e-45a2-b69e-de284e098ec6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:13.897935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c4f433b8-572e-45a2-b69e-de284e098ec6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:13.904037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4f433b8-572e-45a2-b69e-de284e098ec6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:13.909630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4f433b8-572e-45a2-b69e-de284e098ec6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:13.909630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4f433b8-572e-45a2-b69e-de284e098ec6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:13.909630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4f433b8-572e-45a2-b69e-de284e098ec6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:14.077396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c4f433b8-572e-45a2-b69e-de284e098ec6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:14.089984 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c4f433b8-572e-45a2-b69e-de284e098ec6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1500 microversion: 2.1 time: 0.197426 May 28 21:15:14.091036 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1683/3337] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:13 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1500 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:14.104943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-349942cc-81d0-45d7-a1e9-b37c43f0578e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:14.107296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-349942cc-81d0-45d7-a1e9-b37c43f0578e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:14.119788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-349942cc-81d0-45d7-a1e9-b37c43f0578e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:14.119788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-349942cc-81d0-45d7-a1e9-b37c43f0578e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:14.119788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-349942cc-81d0-45d7-a1e9-b37c43f0578e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:14.119788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-349942cc-81d0-45d7-a1e9-b37c43f0578e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:14.127633 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-71507d4c-d4bf-4491-94fd-d9de8d7488eb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1453 microversion: 2.1 time: 0.560854 May 28 21:15:14.128366 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1655/3338] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:13 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1453 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:14.136075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-712aede3-7186-451c-8775-3363023f24b0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:14.139964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-712aede3-7186-451c-8775-3363023f24b0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:14.155271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-712aede3-7186-451c-8775-3363023f24b0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:14.157555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-712aede3-7186-451c-8775-3363023f24b0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:14.159481 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-712aede3-7186-451c-8775-3363023f24b0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:14.161114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-712aede3-7186-451c-8775-3363023f24b0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:14.214215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-712aede3-7186-451c-8775-3363023f24b0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:15:14.319123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-349942cc-81d0-45d7-a1e9-b37c43f0578e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:14.329122 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-349942cc-81d0-45d7-a1e9-b37c43f0578e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.233477 May 28 21:15:14.329829 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1684/3339] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:14 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:14.721427 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-712aede3-7186-451c-8775-3363023f24b0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 204 len: 0 microversion: 2.1 time: 0.591244 May 28 21:15:14.723317 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1656/3340] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:15:14 2022] DELETE /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:15:14.732319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e8d9b106-5d71-4fd6-ab75-70b9ce654ea6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:14.733591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e8d9b106-5d71-4fd6-ab75-70b9ce654ea6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:14.741543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8d9b106-5d71-4fd6-ab75-70b9ce654ea6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:14.742969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8d9b106-5d71-4fd6-ab75-70b9ce654ea6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:14.743852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8d9b106-5d71-4fd6-ab75-70b9ce654ea6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:14.744569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8d9b106-5d71-4fd6-ab75-70b9ce654ea6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:14.914453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dde7ee98-834b-487c-b529-5d4cabd249ad tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:14.917139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dde7ee98-834b-487c-b529-5d4cabd249ad tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] [instance: 48f9b36f-6980-4b84-a3dc-66039a1062b4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:14.923309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dde7ee98-834b-487c-b529-5d4cabd249ad tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:14.924082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dde7ee98-834b-487c-b529-5d4cabd249ad tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:14.925072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dde7ee98-834b-487c-b529-5d4cabd249ad tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:14.925883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dde7ee98-834b-487c-b529-5d4cabd249ad tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:14.934288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e8d9b106-5d71-4fd6-ab75-70b9ce654ea6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:14.946214 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e8d9b106-5d71-4fd6-ab75-70b9ce654ea6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1506 microversion: 2.1 time: 0.215237 May 28 21:15:14.947254 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1685/3341] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:14 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:15.030987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dde7ee98-834b-487c-b529-5d4cabd249ad tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:15.042383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dde7ee98-834b-487c-b529-5d4cabd249ad tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:15.044194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dde7ee98-834b-487c-b529-5d4cabd249ad tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:15.045342 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dde7ee98-834b-487c-b529-5d4cabd249ad tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] 10.222.0.33 "GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4" status: 200 len: 1340 microversion: 2.47 time: 0.138959 May 28 21:15:15.046096 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1657/3342] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:15:14 2022] GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4 => generated 1340 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:15:15.141821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d6ad3b76-bacc-4590-a732-95fa9b671c81 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d6460d040>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:15.240742 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d6ad3b76-bacc-4590-a732-95fa9b671c81 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1453 microversion: 2.1 time: 0.102875 May 28 21:15:15.241480 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1686/3343] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:15 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:15.350607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ceb19343-04d6-4298-ac4e-59888baccc08 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:15.351618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ceb19343-04d6-4298-ac4e-59888baccc08 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:15.358373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ceb19343-04d6-4298-ac4e-59888baccc08 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:15.360212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ceb19343-04d6-4298-ac4e-59888baccc08 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:15.360805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ceb19343-04d6-4298-ac4e-59888baccc08 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:15.361643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ceb19343-04d6-4298-ac4e-59888baccc08 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:15.517787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ceb19343-04d6-4298-ac4e-59888baccc08 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:15.527970 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ceb19343-04d6-4298-ac4e-59888baccc08 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.182286 May 28 21:15:15.543845 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1658/3344] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:15 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:15.970970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-14aa98ac-5291-4139-92c8-4453ddf4886c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:15.972238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-14aa98ac-5291-4139-92c8-4453ddf4886c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:15.980967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-14aa98ac-5291-4139-92c8-4453ddf4886c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:15.981558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-14aa98ac-5291-4139-92c8-4453ddf4886c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:15.982656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-14aa98ac-5291-4139-92c8-4453ddf4886c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:15.983163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-14aa98ac-5291-4139-92c8-4453ddf4886c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:16.065971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-469fd846-371c-49ad-a3e5-98711610b788 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:16.067179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-469fd846-371c-49ad-a3e5-98711610b788 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] [instance: 48f9b36f-6980-4b84-a3dc-66039a1062b4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:16.080837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-469fd846-371c-49ad-a3e5-98711610b788 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:16.092018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-469fd846-371c-49ad-a3e5-98711610b788 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:16.092018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-469fd846-371c-49ad-a3e5-98711610b788 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:16.092018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-469fd846-371c-49ad-a3e5-98711610b788 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:16.181534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-14aa98ac-5291-4139-92c8-4453ddf4886c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:16.190225 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-14aa98ac-5291-4139-92c8-4453ddf4886c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1506 microversion: 2.1 time: 0.224464 May 28 21:15:16.206113 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1687/3345] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:15 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1506 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:16.222491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-469fd846-371c-49ad-a3e5-98711610b788 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:16.233486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-469fd846-371c-49ad-a3e5-98711610b788 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:16.238441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-469fd846-371c-49ad-a3e5-98711610b788 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:16.238441 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-469fd846-371c-49ad-a3e5-98711610b788 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] 10.222.0.33 "GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4" status: 200 len: 1338 microversion: 2.47 time: 0.175976 May 28 21:15:16.238441 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1659/3346] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:15:16 2022] GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4 => generated 1338 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:15:16.255375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-789838af-707e-4fd2-bb40-d481ed960904 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d64293550>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:16.328431 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-789838af-707e-4fd2-bb40-d481ed960904 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1453 microversion: 2.1 time: 0.077527 May 28 21:15:16.331796 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1688/3347] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:16 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:16.549735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4eab5736-99a8-44bc-a827-9677c0d9a4d3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:16.550967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4eab5736-99a8-44bc-a827-9677c0d9a4d3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:16.561421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4eab5736-99a8-44bc-a827-9677c0d9a4d3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:16.561915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4eab5736-99a8-44bc-a827-9677c0d9a4d3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:16.562717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4eab5736-99a8-44bc-a827-9677c0d9a4d3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:16.563164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4eab5736-99a8-44bc-a827-9677c0d9a4d3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:16.817550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4eab5736-99a8-44bc-a827-9677c0d9a4d3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:16.866119 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4eab5736-99a8-44bc-a827-9677c0d9a4d3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.321785 May 28 21:15:16.876556 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1660/3348] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:16 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:17.223519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-958222de-60aa-49f8-9618-8037443e6df3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:17.224163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-958222de-60aa-49f8-9618-8037443e6df3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:17.294190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-958222de-60aa-49f8-9618-8037443e6df3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:17.294190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-958222de-60aa-49f8-9618-8037443e6df3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:17.294190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-958222de-60aa-49f8-9618-8037443e6df3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:17.294190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-958222de-60aa-49f8-9618-8037443e6df3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:17.295500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8acf6182-b169-4ede-8d3f-4a031477ae21 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:17.295500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8acf6182-b169-4ede-8d3f-4a031477ae21 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] [instance: 48f9b36f-6980-4b84-a3dc-66039a1062b4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:17.295500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8acf6182-b169-4ede-8d3f-4a031477ae21 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:17.295500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8acf6182-b169-4ede-8d3f-4a031477ae21 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:17.295500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8acf6182-b169-4ede-8d3f-4a031477ae21 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:17.295500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8acf6182-b169-4ede-8d3f-4a031477ae21 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:17.435294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-958222de-60aa-49f8-9618-8037443e6df3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:17.440078 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-958222de-60aa-49f8-9618-8037443e6df3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1464 microversion: 2.1 time: 0.221583 May 28 21:15:17.444434 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1689/3349] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:17 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1464 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:17.459845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f81b9d7b-1d21-4858-b3c6-d637ebd51f37 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d6460d280>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:17.461041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8acf6182-b169-4ede-8d3f-4a031477ae21 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:17.485238 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8acf6182-b169-4ede-8d3f-4a031477ae21 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:17.488772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8acf6182-b169-4ede-8d3f-4a031477ae21 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:17.491220 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8acf6182-b169-4ede-8d3f-4a031477ae21 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] 10.222.0.33 "GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4" status: 200 len: 1338 microversion: 2.47 time: 0.235035 May 28 21:15:17.493070 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1661/3350] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:15:17 2022] GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4 => generated 1338 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:15:17.504967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-aa705990-38a6-4062-8d0d-b8ec5845fb0d req-bf7c5260-b141-474b-8a4e-5d34ee0b9f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae56f66e-ab85-40da-a2b6-0cf501aa93c9", "name": "network-vif-deleted", "tag": "beb97cf9-22a8-478e-89ac-e81ad1052d46"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:17.521492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-aa705990-38a6-4062-8d0d-b8ec5845fb0d req-bf7c5260-b141-474b-8a4e-5d34ee0b9f0d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:17.521728 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f81b9d7b-1d21-4858-b3c6-d637ebd51f37 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1453 microversion: 2.1 time: 0.073200 May 28 21:15:17.522776 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1690/3351] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:17 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:17.526573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-aa705990-38a6-4062-8d0d-b8ec5845fb0d req-bf7c5260-b141-474b-8a4e-5d34ee0b9f0d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:17.552010 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-aa705990-38a6-4062-8d0d-b8ec5845fb0d req-bf7c5260-b141-474b-8a4e-5d34ee0b9f0d service nova] Creating event network-vif-deleted:beb97cf9-22a8-478e-89ac-e81ad1052d46 for instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 on nch2-master-1 May 28 21:15:17.561303 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-aa705990-38a6-4062-8d0d-b8ec5845fb0d req-bf7c5260-b141-474b-8a4e-5d34ee0b9f0d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066328 May 28 21:15:17.563475 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1662/3352] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:15:17.884665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6b3bdadd-6781-4bd1-a63e-f95a225a2d26 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:17.884851 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6b3bdadd-6781-4bd1-a63e-f95a225a2d26 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:17.891571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b3bdadd-6781-4bd1-a63e-f95a225a2d26 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:17.892325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b3bdadd-6781-4bd1-a63e-f95a225a2d26 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:17.893329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b3bdadd-6781-4bd1-a63e-f95a225a2d26 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:17.894416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b3bdadd-6781-4bd1-a63e-f95a225a2d26 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:17.909733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:18.026769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6b3bdadd-6781-4bd1-a63e-f95a225a2d26 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:18.034913 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6b3bdadd-6781-4bd1-a63e-f95a225a2d26 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.154738 May 28 21:15:18.039423 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1691/3353] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:17 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:18.465881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-20425d5f-35c7-4e7c-b471-dc4c1b14565c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:18.466600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-20425d5f-35c7-4e7c-b471-dc4c1b14565c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:18.476422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20425d5f-35c7-4e7c-b471-dc4c1b14565c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:18.481096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20425d5f-35c7-4e7c-b471-dc4c1b14565c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:18.481096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20425d5f-35c7-4e7c-b471-dc4c1b14565c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:18.481096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20425d5f-35c7-4e7c-b471-dc4c1b14565c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:18.513566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e14cef26-d29f-46cf-b003-e8d7e691a841 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:18.517173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e14cef26-d29f-46cf-b003-e8d7e691a841 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] [instance: 48f9b36f-6980-4b84-a3dc-66039a1062b4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:18.526170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e14cef26-d29f-46cf-b003-e8d7e691a841 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:18.531532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e14cef26-d29f-46cf-b003-e8d7e691a841 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:18.531670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20425d5f-35c7-4e7c-b471-dc4c1b14565c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:18.531776 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e14cef26-d29f-46cf-b003-e8d7e691a841 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:18.531902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20425d5f-35c7-4e7c-b471-dc4c1b14565c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:18.532010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e14cef26-d29f-46cf-b003-e8d7e691a841 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:18.532110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-20425d5f-35c7-4e7c-b471-dc4c1b14565c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lazy-loading 'fault' on Instance uuid ae56f66e-ab85-40da-a2b6-0cf501aa93c9 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:15:18.604700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-20425d5f-35c7-4e7c-b471-dc4c1b14565c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:18.624366 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-20425d5f-35c7-4e7c-b471-dc4c1b14565c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 200 len: 1309 microversion: 2.1 time: 0.160920 May 28 21:15:18.627620 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1663/3354] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:18 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 1309 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:18.643058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3ca38ef3-a3ea-45d7-9496-00e162a5f5fc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d645283a0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:18.687221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e14cef26-d29f-46cf-b003-e8d7e691a841 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:18.701165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e14cef26-d29f-46cf-b003-e8d7e691a841 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:18.718817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e14cef26-d29f-46cf-b003-e8d7e691a841 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:18.718817 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e14cef26-d29f-46cf-b003-e8d7e691a841 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] 10.222.0.33 "GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4" status: 200 len: 1359 microversion: 2.47 time: 0.196424 May 28 21:15:18.718817 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1692/3355] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:15:18 2022] GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:15:18.728261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f2ad193c-ed42-45a3-b000-8c4817de49b5 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1762257791"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:18.729436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f2ad193c-ed42-45a3-b000-8c4817de49b5 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] [instance: 48f9b36f-6980-4b84-a3dc-66039a1062b4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:18.736643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2ad193c-ed42-45a3-b000-8c4817de49b5 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:18.737151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2ad193c-ed42-45a3-b000-8c4817de49b5 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:18.737984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2ad193c-ed42-45a3-b000-8c4817de49b5 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:18.738440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2ad193c-ed42-45a3-b000-8c4817de49b5 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:18.748273 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3ca38ef3-a3ea-45d7-9496-00e162a5f5fc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1453 microversion: 2.1 time: 0.119274 May 28 21:15:18.751360 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1664/3356] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:18 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1453 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:19.054687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-56604164-d46d-4382-a89d-6dbad0ae186e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:19.055849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-56604164-d46d-4382-a89d-6dbad0ae186e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:19.064955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56604164-d46d-4382-a89d-6dbad0ae186e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:19.065793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56604164-d46d-4382-a89d-6dbad0ae186e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:19.068919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56604164-d46d-4382-a89d-6dbad0ae186e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:19.070085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56604164-d46d-4382-a89d-6dbad0ae186e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:19.293675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-56604164-d46d-4382-a89d-6dbad0ae186e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:19.314148 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-56604164-d46d-4382-a89d-6dbad0ae186e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.264942 May 28 21:15:19.314999 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1665/3357] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:19 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:19.482691 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f2ad193c-ed42-45a3-b000-8c4817de49b5 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] 10.222.0.33 "POST /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4/action" status: 202 len: 52 microversion: 2.47 time: 0.758861 May 28 21:15:19.483844 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1693/3358] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:15:18 2022] POST /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4/action => generated 52 bytes in 761 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) May 28 21:15:19.497222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5152e0e3-2d9d-409c-8a3e-1475a1045e2e tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:19.498420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5152e0e3-2d9d-409c-8a3e-1475a1045e2e tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] [instance: 48f9b36f-6980-4b84-a3dc-66039a1062b4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:19.505771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5152e0e3-2d9d-409c-8a3e-1475a1045e2e tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:19.511674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5152e0e3-2d9d-409c-8a3e-1475a1045e2e tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:19.511674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5152e0e3-2d9d-409c-8a3e-1475a1045e2e tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:19.511674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5152e0e3-2d9d-409c-8a3e-1475a1045e2e tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:19.551523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5152e0e3-2d9d-409c-8a3e-1475a1045e2e tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] [instance: 48f9b36f-6980-4b84-a3dc-66039a1062b4] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:15:19.649614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-770f842d-f17d-4b30-ba36-52bd47ab4f90 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:19.657139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-770f842d-f17d-4b30-ba36-52bd47ab4f90 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:19.676899 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-770f842d-f17d-4b30-ba36-52bd47ab4f90 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:19.677362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-770f842d-f17d-4b30-ba36-52bd47ab4f90 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:19.678200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-770f842d-f17d-4b30-ba36-52bd47ab4f90 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:19.691148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-770f842d-f17d-4b30-ba36-52bd47ab4f90 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:19.738105 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-770f842d-f17d-4b30-ba36-52bd47ab4f90 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-770f842d-f17d-4b30-ba36-52bd47ab4f90 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 HTTP/1.1 May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'ae56f66e-ab85-40da-a2b6-0cf501aa93c9'} May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:19.740140 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:19.745921 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:19.745921 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:19.745921 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:15:19.745921 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:15:19.745921 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. May 28 21:15:19.745921 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:19.747484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-770f842d-f17d-4b30-ba36-52bd47ab4f90 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:15:19.748553 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-770f842d-f17d-4b30-ba36-52bd47ab4f90 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 404 len: 111 microversion: 2.1 time: 0.106018 May 28 21:15:19.752618 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1694/3359] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:19 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:15:19.763817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a9c5d0b6-1dbe-4d9a-84ce-0e78a9fbe056 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Action: 'create', calling method: .version_select at 0x7f4d64560ca0>, body: {"keypair": {"name": "tempest-key-1258563961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE63HZbol25vwIimc44sqjMuFj+Ra6Z4k1IWhic7ZbO0n7UAffcbjKvLbO8WCkeXEJsaaalMZs8aaFPIzypF/jCmmx+AQeIGu6aYS9A/sLEBPmapdvM0EnSQvyT5LpDOXg=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:19.781205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-a9c5d0b6-1dbe-4d9a-84ce-0e78a9fbe056 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:15:19.787560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-a9c5d0b6-1dbe-4d9a-84ce-0e78a9fbe056 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for user 572170ccd67e4facbf10dad7cd1491c1 and project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:15:19.942616 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5152e0e3-2d9d-409c-8a3e-1475a1045e2e tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] 10.222.0.33 "DELETE /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4" status: 204 len: 0 microversion: 2.47 time: 0.447862 May 28 21:15:19.942616 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1666/3360] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:15:19 2022] DELETE /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:15:19.946244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1bdd2829-b4a3-4daa-8fbb-0fb7ebfc0d39 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d64802d30>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:19.947707 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a9c5d0b6-1dbe-4d9a-84ce-0e78a9fbe056 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.188044 May 28 21:15:19.959257 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1695/3361] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:15:19 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:15:19.965131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eff6244d-0193-4583-927b-d40ee052f5e6 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:19.978525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eff6244d-0193-4583-927b-d40ee052f5e6 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] [instance: 48f9b36f-6980-4b84-a3dc-66039a1062b4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:19.999889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eff6244d-0193-4583-927b-d40ee052f5e6 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:20.001510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eff6244d-0193-4583-927b-d40ee052f5e6 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:20.002638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eff6244d-0193-4583-927b-d40ee052f5e6 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:20.002841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eff6244d-0193-4583-927b-d40ee052f5e6 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:20.016851 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1bdd2829-b4a3-4daa-8fbb-0fb7ebfc0d39 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1453 microversion: 2.1 time: 0.074829 May 28 21:15:20.017736 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1667/3362] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:19 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:20.033829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b9e07f6f-20a5-4128-aef5-0eaf7954a298 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '.version_select at 0x7f4d57f68ca0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:20.037340 ncdv-master-1 devstack@n-api.service[143128]: WARNING oslo_db.sqlalchemy.utils [None req-b9e07f6f-20a5-4128-aef5-0eaf7954a298 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Unique keys not in sort_keys. The sorting order may be unstable. May 28 21:15:20.046752 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b9e07f6f-20a5-4128-aef5-0eaf7954a298 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.027769 May 28 21:15:20.047359 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1668/3363] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:15:20 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:15:20.167699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eff6244d-0193-4583-927b-d40ee052f5e6 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:20.175978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eff6244d-0193-4583-927b-d40ee052f5e6 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:20.180542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eff6244d-0193-4583-927b-d40ee052f5e6 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:20.184392 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eff6244d-0193-4583-927b-d40ee052f5e6 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] 10.222.0.33 "GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4" status: 200 len: 1365 microversion: 2.47 time: 0.223633 May 28 21:15:20.193444 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1696/3364] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:15:19 2022] GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:15:20.211797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-796749841", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "key_name": "tempest-key-1258563961", "networks": [{"uuid": "ca803b4d-8584-4327-9f76-66ddebb3c209"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:20.307049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] validate_networks() for [('ca803b4d-8584-4327-9f76-66ddebb3c209', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:15:20.333139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ea0fa7a3-a37e-4b0d-91e5-626441d987cb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:20.333778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ea0fa7a3-a37e-4b0d-91e5-626441d987cb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:20.351980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea0fa7a3-a37e-4b0d-91e5-626441d987cb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:20.352435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea0fa7a3-a37e-4b0d-91e5-626441d987cb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:20.353410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea0fa7a3-a37e-4b0d-91e5-626441d987cb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:20.354045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea0fa7a3-a37e-4b0d-91e5-626441d987cb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:20.616863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ea0fa7a3-a37e-4b0d-91e5-626441d987cb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:20.626362 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ea0fa7a3-a37e-4b0d-91e5-626441d987cb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.297875 May 28 21:15:20.637403 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1697/3365] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:20 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:20.920579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:15:20.921137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:15:20.921539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:15:20.922342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:15:20.923198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:15:20.943353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:20.949330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:20.954599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:20.954599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:20.980511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:15:20.987840 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for user 572170ccd67e4facbf10dad7cd1491c1 and project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:15:21.004194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:15:21.009874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:15:21.052899 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:21.088956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3a166877-1719-4479-b8f8-3eae25a84289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119-project-admin] Calling method '.version_select at 0x7f4d6460d8b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:21.089872 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:15:21.089872 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:15:21.091315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a166877-1719-4479-b8f8-3eae25a84289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:21.101626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a166877-1719-4479-b8f8-3eae25a84289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:21.124812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a166877-1719-4479-b8f8-3eae25a84289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:21.125322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a166877-1719-4479-b8f8-3eae25a84289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:21.136826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a166877-1719-4479-b8f8-3eae25a84289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:21.137484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a166877-1719-4479-b8f8-3eae25a84289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:21.154448 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3a166877-1719-4479-b8f8-3eae25a84289 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1083516119-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.225268 May 28 21:15:21.155474 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1698/3366] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:15:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:15:21.160913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-684f5bdd-7b3d-48d8-b79e-27ee7ce98625 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d645f08b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:21.212368 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ffad19ab-3798-428d-b84c-42999abe26b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.005269 May 28 21:15:21.217938 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1669/3367] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:15:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:15:21.228231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5e20c21f-0898-4f54-99d9-eaf2881b7e8c tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:21.228593 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-684f5bdd-7b3d-48d8-b79e-27ee7ce98625 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1453 microversion: 2.1 time: 0.071837 May 28 21:15:21.228874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5e20c21f-0898-4f54-99d9-eaf2881b7e8c tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] [instance: 48f9b36f-6980-4b84-a3dc-66039a1062b4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:21.235124 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1699/3368] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:21 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:21.237230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e20c21f-0898-4f54-99d9-eaf2881b7e8c tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:21.237693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e20c21f-0898-4f54-99d9-eaf2881b7e8c tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:21.238596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e20c21f-0898-4f54-99d9-eaf2881b7e8c tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:21.238991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e20c21f-0898-4f54-99d9-eaf2881b7e8c tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:21.240595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f552783d-84ac-4aa7-9a42-f59ba889f55b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:21.241230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f552783d-84ac-4aa7-9a42-f59ba889f55b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:21.252384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:21.349109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f552783d-84ac-4aa7-9a42-f59ba889f55b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:21.362446 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f552783d-84ac-4aa7-9a42-f59ba889f55b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1228 microversion: 2.1 time: 0.125638 May 28 21:15:21.366549 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1700/3369] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:21 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1228 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:21.402890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5e20c21f-0898-4f54-99d9-eaf2881b7e8c tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:21.414524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5e20c21f-0898-4f54-99d9-eaf2881b7e8c tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:21.421660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5e20c21f-0898-4f54-99d9-eaf2881b7e8c tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:21.432800 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5e20c21f-0898-4f54-99d9-eaf2881b7e8c tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] 10.222.0.33 "GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4" status: 200 len: 1365 microversion: 2.47 time: 0.210401 May 28 21:15:21.591161 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1670/3370] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:15:21 2022] GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4 => generated 1365 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:15:21.645779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aef30cc6-2ed6-4f33-8896-1e485786914f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:21.646572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aef30cc6-2ed6-4f33-8896-1e485786914f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:21.654372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aef30cc6-2ed6-4f33-8896-1e485786914f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:21.655015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aef30cc6-2ed6-4f33-8896-1e485786914f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:21.655793 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aef30cc6-2ed6-4f33-8896-1e485786914f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:21.656237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aef30cc6-2ed6-4f33-8896-1e485786914f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:21.792468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aef30cc6-2ed6-4f33-8896-1e485786914f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:21.800097 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aef30cc6-2ed6-4f33-8896-1e485786914f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.159365 May 28 21:15:21.800663 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1701/3371] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:21 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:22.241761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-67f72373-3c29-49ef-9a48-17bdd7e98104 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d6418e0d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:22.392125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a2f50ac-defd-4b50-b945-3de938ed1b84 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:22.394284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6a2f50ac-defd-4b50-b945-3de938ed1b84 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:22.484436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a2f50ac-defd-4b50-b945-3de938ed1b84 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:22.493103 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6a2f50ac-defd-4b50-b945-3de938ed1b84 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1228 microversion: 2.1 time: 0.105886 May 28 21:15:22.494391 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1702/3372] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:22 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1228 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:22.499438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c6c58adf-4c0e-4fdd-9ba9-2f3b28a8f414 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:22.500124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c6c58adf-4c0e-4fdd-9ba9-2f3b28a8f414 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] [instance: 48f9b36f-6980-4b84-a3dc-66039a1062b4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:22.508719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6c58adf-4c0e-4fdd-9ba9-2f3b28a8f414 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:22.509676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6c58adf-4c0e-4fdd-9ba9-2f3b28a8f414 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:22.510230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6c58adf-4c0e-4fdd-9ba9-2f3b28a8f414 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:22.510747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6c58adf-4c0e-4fdd-9ba9-2f3b28a8f414 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:22.547682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6c58adf-4c0e-4fdd-9ba9-2f3b28a8f414 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:22.548604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6c58adf-4c0e-4fdd-9ba9-2f3b28a8f414 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:22.548743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-c6c58adf-4c0e-4fdd-9ba9-2f3b28a8f414 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lazy-loading 'fault' on Instance uuid 48f9b36f-6980-4b84-a3dc-66039a1062b4 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:15:22.550922 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-67f72373-3c29-49ef-9a48-17bdd7e98104 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1453 microversion: 2.1 time: 0.313176 May 28 21:15:22.551520 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1671/3373] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:22 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1453 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:22.591723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c6c58adf-4c0e-4fdd-9ba9-2f3b28a8f414 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:22.600093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c6c58adf-4c0e-4fdd-9ba9-2f3b28a8f414 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:22.601691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c6c58adf-4c0e-4fdd-9ba9-2f3b28a8f414 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9d2988731d14049b27283cda69bec93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6846f7be3c13484e92e2bfbe9df3810f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:22.602897 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c6c58adf-4c0e-4fdd-9ba9-2f3b28a8f414 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] 10.222.0.33 "GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4" status: 200 len: 1370 microversion: 2.47 time: 0.107261 May 28 21:15:22.607733 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1703/3374] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:15:22 2022] GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4 => generated 1370 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:15:22.817373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d68943ca-6206-4e85-857f-9128a6822532 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:22.818069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d68943ca-6206-4e85-857f-9128a6822532 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:22.825291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d68943ca-6206-4e85-857f-9128a6822532 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:22.825758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d68943ca-6206-4e85-857f-9128a6822532 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:22.826584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d68943ca-6206-4e85-857f-9128a6822532 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:22.827035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d68943ca-6206-4e85-857f-9128a6822532 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:22.981567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d68943ca-6206-4e85-857f-9128a6822532 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:22.990501 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d68943ca-6206-4e85-857f-9128a6822532 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.177039 May 28 21:15:22.991196 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1672/3375] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:22 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:23.512593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-15db5dd8-9bbc-4e8c-b938-339434150bd3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:23.513133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-15db5dd8-9bbc-4e8c-b938-339434150bd3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:23.520561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15db5dd8-9bbc-4e8c-b938-339434150bd3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:23.521020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15db5dd8-9bbc-4e8c-b938-339434150bd3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:23.521793 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15db5dd8-9bbc-4e8c-b938-339434150bd3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:23.522265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15db5dd8-9bbc-4e8c-b938-339434150bd3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:23.564611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d5a43002-9e09-41b0-a17f-c703def824ec tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d6418ed30>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:23.591786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-15db5dd8-9bbc-4e8c-b938-339434150bd3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:23.600266 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-15db5dd8-9bbc-4e8c-b938-339434150bd3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1224 microversion: 2.1 time: 0.093642 May 28 21:15:23.600848 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1704/3376] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:23 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:23.611787 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d5a43002-9e09-41b0-a17f-c703def824ec tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1462 microversion: 2.1 time: 0.051041 May 28 21:15:23.612366 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1673/3377] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:23 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1462 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:23.622980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e6124a35-8561-47e8-b944-8536b653b177 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:23.628113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e6124a35-8561-47e8-b944-8536b653b177 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] [instance: 48f9b36f-6980-4b84-a3dc-66039a1062b4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:23.628228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-049abeff-b7a4-42ad-a528-c980b6c627da tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57fb8790>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:23.631645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6124a35-8561-47e8-b944-8536b653b177 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:23.632173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6124a35-8561-47e8-b944-8536b653b177 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:23.633499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6124a35-8561-47e8-b944-8536b653b177 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:23.634037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6124a35-8561-47e8-b944-8536b653b177 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:23.653335 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-e6124a35-8561-47e8-b944-8536b653b177 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] HTTP exception thrown: Instance 48f9b36f-6980-4b84-a3dc-66039a1062b4 could not be found. May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e6124a35-8561-47e8-b944-8536b653b177 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Request method failure captured: May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4 HTTP/1.1 May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpDe2NjKBk_yYIaB3pIomianInk6Gmb1UL5xiE2KP2SVH5TY9VwbuLujQGFZYtqLVsfp5cYwh5UoJzqZTX4sQ0KV7qPCuSG9K73JrJIsBHrwlnskrq4YbjtYl3iNC4byi7krkt_e02jVIEYbCZ9-7qHBLoBckV5TbPSFxOnqrA6VkYQ May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Openstack-Nova-Api-Version: 2.47 May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 6846f7be3c13484e92e2bfbe9df3810f May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersAaction247Test-1780987762 May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6846f7be3c13484e92e2bfbe9df3810f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6846f7be3c13484e92e2bfbe9df3810f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6846f7be3c13484e92e2bfbe9df3810f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6846f7be3c13484e92e2bfbe9df3810f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersAaction247Test-1780987762 May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 6846f7be3c13484e92e2bfbe9df3810f May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersAaction247Test-1780987762 May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersAaction247Test-1780987762-project May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: c9d2988731d14049b27283cda69bec93 May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersAaction247Test-1780987762-project May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 48f9b36f-6980-4b84-a3dc-66039a1062b4 could not be found. May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '48f9b36f-6980-4b84-a3dc-66039a1062b4'} May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f9b36f-6980-4b84-a3dc-66039a1062b4 could not be found. May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f9b36f-6980-4b84-a3dc-66039a1062b4 could not be found. May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:23.655015 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:23.665024 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:23.665024 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:23.665024 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:23.665024 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:15:23.665024 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:15:23.665024 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f9b36f-6980-4b84-a3dc-66039a1062b4 could not be found. May 28 21:15:23.665024 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:23.665024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e6124a35-8561-47e8-b944-8536b653b177 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] Returning 404 to user: Instance 48f9b36f-6980-4b84-a3dc-66039a1062b4 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:15:23.665024 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e6124a35-8561-47e8-b944-8536b653b177 tempest-ServersAaction247Test-1780987762 tempest-ServersAaction247Test-1780987762-project] 10.222.0.33 "GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4" status: 404 len: 111 microversion: 2.47 time: 0.037670 May 28 21:15:23.665024 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1705/3378] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:15:23 2022] GET /compute/v2.1/servers/48f9b36f-6980-4b84-a3dc-66039a1062b4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 28 21:15:23.691961 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-049abeff-b7a4-42ad-a528-c980b6c627da tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 200 len: 1462 microversion: 2.1 time: 0.070841 May 28 21:15:23.692558 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1674/3379] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:23 2022] GET /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 1462 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:23.710673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc4cc1ee-af2f-4172-89e3-645350522af8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:23.711317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc4cc1ee-af2f-4172-89e3-645350522af8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 144ab366-0448-410f-9093-91dec09b838c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:23.723080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc4cc1ee-af2f-4172-89e3-645350522af8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:23.723883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc4cc1ee-af2f-4172-89e3-645350522af8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:23.724924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc4cc1ee-af2f-4172-89e3-645350522af8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:23.725546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc4cc1ee-af2f-4172-89e3-645350522af8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:23.893366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc4cc1ee-af2f-4172-89e3-645350522af8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:23.901104 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc4cc1ee-af2f-4172-89e3-645350522af8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c" status: 200 len: 1467 microversion: 2.1 time: 0.200505 May 28 21:15:23.901688 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1706/3380] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:23 2022] GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c => generated 1467 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:23.918474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1f8dcabf-7ee2-4fc5-9ef2-7b0cc7fdb58e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1503731723"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:23.921743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1f8dcabf-7ee2-4fc5-9ef2-7b0cc7fdb58e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:23.922289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:23.926003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f8dcabf-7ee2-4fc5-9ef2-7b0cc7fdb58e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:23.926488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f8dcabf-7ee2-4fc5-9ef2-7b0cc7fdb58e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:23.927264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f8dcabf-7ee2-4fc5-9ef2-7b0cc7fdb58e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:23.927727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f8dcabf-7ee2-4fc5-9ef2-7b0cc7fdb58e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:23.932730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:24.008571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d9993e87-acd8-4df1-a750-20608868b69d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:24.009528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d9993e87-acd8-4df1-a750-20608868b69d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:24.022672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9993e87-acd8-4df1-a750-20608868b69d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:24.022672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9993e87-acd8-4df1-a750-20608868b69d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:24.023766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9993e87-acd8-4df1-a750-20608868b69d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:24.024328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9993e87-acd8-4df1-a750-20608868b69d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:24.195829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d9993e87-acd8-4df1-a750-20608868b69d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:24.203842 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d9993e87-acd8-4df1-a750-20608868b69d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.199989 May 28 21:15:24.204421 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1707/3381] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:24 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:24.589262 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1f8dcabf-7ee2-4fc5-9ef2-7b0cc7fdb58e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "POST /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238/action" status: 202 len: 0 microversion: 2.1 time: 0.675668 May 28 21:15:24.596084 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1675/3382] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:15:23 2022] POST /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 21:15:24.600880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fa351fdb-5cf8-4dac-b652-2e3bea471d9e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69c8a790>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:24.621405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-24d09c69-9341-40bc-b8e3-3abec2dec8af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:24.624445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-24d09c69-9341-40bc-b8e3-3abec2dec8af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:24.631444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24d09c69-9341-40bc-b8e3-3abec2dec8af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:24.632172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24d09c69-9341-40bc-b8e3-3abec2dec8af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:24.633638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24d09c69-9341-40bc-b8e3-3abec2dec8af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:24.634874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24d09c69-9341-40bc-b8e3-3abec2dec8af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:24.660295 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fa351fdb-5cf8-4dac-b652-2e3bea471d9e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.063435 May 28 21:15:24.661712 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1708/3383] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:24 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:24.735227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-24d09c69-9341-40bc-b8e3-3abec2dec8af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:24.745951 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-24d09c69-9341-40bc-b8e3-3abec2dec8af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1298 microversion: 2.1 time: 0.132019 May 28 21:15:24.747260 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1676/3384] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:24 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1298 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:25.222191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bda2a7ca-48e0-4668-a0c1-d5ba93318fa9 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:25.233103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bda2a7ca-48e0-4668-a0c1-d5ba93318fa9 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:25.233103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bda2a7ca-48e0-4668-a0c1-d5ba93318fa9 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:25.234250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bda2a7ca-48e0-4668-a0c1-d5ba93318fa9 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:25.236711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bda2a7ca-48e0-4668-a0c1-d5ba93318fa9 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:25.237446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bda2a7ca-48e0-4668-a0c1-d5ba93318fa9 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:25.677940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-651ec98c-0750-456f-ba76-cca06e045436 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d642769d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:25.768506 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-651ec98c-0750-456f-ba76-cca06e045436 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.096722 May 28 21:15:25.771904 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1677/3385] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:25 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:25.787644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5277c644-cd04-484e-b258-29ce94036779 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:25.789290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5277c644-cd04-484e-b258-29ce94036779 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:25.792045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bda2a7ca-48e0-4668-a0c1-d5ba93318fa9 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:25.806820 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bda2a7ca-48e0-4668-a0c1-d5ba93318fa9 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1521 microversion: 2.1 time: 0.587376 May 28 21:15:25.808028 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1709/3386] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:25 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1521 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:25.814691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5277c644-cd04-484e-b258-29ce94036779 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:25.821782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5277c644-cd04-484e-b258-29ce94036779 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:25.821782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5277c644-cd04-484e-b258-29ce94036779 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:25.821782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5277c644-cd04-484e-b258-29ce94036779 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:26.016865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5277c644-cd04-484e-b258-29ce94036779 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:26.026033 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5277c644-cd04-484e-b258-29ce94036779 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1328 microversion: 2.1 time: 0.250476 May 28 21:15:26.026813 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1678/3387] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:25 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1328 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:26.536686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-beb07841-f106-4584-808e-0473a5fa1690 req-dbdd0a0c-4efc-4092-aee9-f81b999d67bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144ab366-0448-410f-9093-91dec09b838c", "name": "network-vif-unplugged", "status": "completed", "tag": "cfbdc8df-e8d0-4012-b243-cfb3e0d4ff83"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:26.547203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-beb07841-f106-4584-808e-0473a5fa1690 req-dbdd0a0c-4efc-4092-aee9-f81b999d67bf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:26.547951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-beb07841-f106-4584-808e-0473a5fa1690 req-dbdd0a0c-4efc-4092-aee9-f81b999d67bf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:26.563654 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-beb07841-f106-4584-808e-0473a5fa1690 req-dbdd0a0c-4efc-4092-aee9-f81b999d67bf service nova] Creating event network-vif-unplugged:cfbdc8df-e8d0-4012-b243-cfb3e0d4ff83 for instance 144ab366-0448-410f-9093-91dec09b838c on nch2-master-1 May 28 21:15:26.570528 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-beb07841-f106-4584-808e-0473a5fa1690 req-dbdd0a0c-4efc-4092-aee9-f81b999d67bf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037375 May 28 21:15:26.571787 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1710/3388] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:15:26.640436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5277c644-cd04-484e-b258-29ce94036779 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:26.642009 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5277c644-cd04-484e-b258-29ce94036779 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001694 May 28 21:15:26.650010 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1679/3389] 10.222.0.33 () {56 vars in 885 bytes} [Sat May 28 21:15:26 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 28 21:15:26.785897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8f684d99-e173-4bd0-9c8d-5e465d8f3cf4 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69ca8c10>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:26.825557 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7be88ae6-22fb-4a37-8396-df015de07063 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:26.826323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7be88ae6-22fb-4a37-8396-df015de07063 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:26.834449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7be88ae6-22fb-4a37-8396-df015de07063 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:26.834901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7be88ae6-22fb-4a37-8396-df015de07063 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:26.836556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7be88ae6-22fb-4a37-8396-df015de07063 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:26.837223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7be88ae6-22fb-4a37-8396-df015de07063 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:26.874529 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8f684d99-e173-4bd0-9c8d-5e465d8f3cf4 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.092989 May 28 21:15:26.875114 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1711/3390] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:26 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:26.988683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ae54203a-50f6-45c9-820c-1386e237d1ab req-cbd99abe-77ab-4c68-b215-c715e09e5f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6cd313-c4b7-4468-b6d4-70af3088ef89", "tag": "f1906144-4701-45a6-a6ea-3e72787f86bb"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:27.003679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ae54203a-50f6-45c9-820c-1386e237d1ab req-cbd99abe-77ab-4c68-b215-c715e09e5f54 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:27.004404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ae54203a-50f6-45c9-820c-1386e237d1ab req-cbd99abe-77ab-4c68-b215-c715e09e5f54 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:27.030320 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ae54203a-50f6-45c9-820c-1386e237d1ab req-cbd99abe-77ab-4c68-b215-c715e09e5f54 service nova] Creating event network-changed:f1906144-4701-45a6-a6ea-3e72787f86bb for instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 on nch2-master-1 May 28 21:15:27.036878 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ae54203a-50f6-45c9-820c-1386e237d1ab req-cbd99abe-77ab-4c68-b215-c715e09e5f54 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052340 May 28 21:15:27.038518 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1712/3391] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:15:27.048458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7be88ae6-22fb-4a37-8396-df015de07063 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:27.054618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-be838c96-a778-4005-91d9-62604a77ee93 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:27.059047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-be838c96-a778-4005-91d9-62604a77ee93 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:27.059644 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7be88ae6-22fb-4a37-8396-df015de07063 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1501 microversion: 2.1 time: 0.238195 May 28 21:15:27.060677 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1680/3392] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:26 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1501 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:27.079230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-321669fe-7a96-45c5-9aa5-d6786925e6c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:27.079917 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-321669fe-7a96-45c5-9aa5-d6786925e6c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:27.080977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be838c96-a778-4005-91d9-62604a77ee93 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:27.086516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-321669fe-7a96-45c5-9aa5-d6786925e6c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:27.087086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be838c96-a778-4005-91d9-62604a77ee93 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:27.087207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-321669fe-7a96-45c5-9aa5-d6786925e6c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:27.087991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-321669fe-7a96-45c5-9aa5-d6786925e6c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:27.088100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be838c96-a778-4005-91d9-62604a77ee93 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:27.088436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-321669fe-7a96-45c5-9aa5-d6786925e6c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:27.088543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be838c96-a778-4005-91d9-62604a77ee93 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:27.430141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-be838c96-a778-4005-91d9-62604a77ee93 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:27.433699 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-be838c96-a778-4005-91d9-62604a77ee93 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1328 microversion: 2.1 time: 0.392980 May 28 21:15:27.434927 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1713/3393] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:27 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1328 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:27.543491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-321669fe-7a96-45c5-9aa5-d6786925e6c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:27.551371 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-321669fe-7a96-45c5-9aa5-d6786925e6c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1515 microversion: 2.1 time: 0.476171 May 28 21:15:27.552051 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1681/3394] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:27 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1515 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:27.573192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-194d7c89-00cb-4399-a04f-0f1c36a1657e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:27.574488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-194d7c89-00cb-4399-a04f-0f1c36a1657e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: d5f2b151-50ee-4533-b287-4338a51f5ec1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:27.580309 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-194d7c89-00cb-4399-a04f-0f1c36a1657e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] HTTP exception thrown: Instance d5f2b151-50ee-4533-b287-4338a51f5ec1 could not be found. May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-194d7c89-00cb-4399-a04f-0f1c36a1657e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Request method failure captured: May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/d5f2b151-50ee-4533-b287-4338a51f5ec1/action HTTP/1.1 May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 14 May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpC0XaL6nt9hgj0fqNJ-e8egvesT5NjK_jUnUBAtg24_DQiY4yBBswyZZHwMHrBd5ALBI4UbRMzOp6RzZMuwpPVT6pecTgJ4VSwWmnC-cS82dnuXHOnMJSwA47KVatITeM5lcpiario-t9uZicKVzKlAEQs1aEbN7XgO22WG-C22tyY May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53b9cfacdbb74a058e52bed331a6f241", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: af446b3d802a42e3bd72b08bace8ea8d May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: {"rescue": {}} May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance d5f2b151-50ee-4533-b287-4338a51f5ec1 could not be found. May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'd5f2b151-50ee-4533-b287-4338a51f5ec1', 'body': {'rescue': {}}} May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f2b151-50ee-4533-b287-4338a51f5ec1 could not be found. May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f2b151-50ee-4533-b287-4338a51f5ec1 could not be found. May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:27.588964 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:27.594805 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:27.594805 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:27.594805 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:15:27.594805 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:15:27.594805 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f2b151-50ee-4533-b287-4338a51f5ec1 could not be found. May 28 21:15:27.594805 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:27.594805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-194d7c89-00cb-4399-a04f-0f1c36a1657e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Returning 404 to user: Instance d5f2b151-50ee-4533-b287-4338a51f5ec1 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:15:27.594805 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-194d7c89-00cb-4399-a04f-0f1c36a1657e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers/d5f2b151-50ee-4533-b287-4338a51f5ec1/action" status: 404 len: 111 microversion: 2.1 time: 0.021472 May 28 21:15:27.594805 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1714/3395] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:15:27 2022] POST /compute/v2.1/servers/d5f2b151-50ee-4533-b287-4338a51f5ec1/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:15:27.600266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-50ed0bd2-c108-45bb-9f5f-3447f6c460f4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:27.600811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-50ed0bd2-c108-45bb-9f5f-3447f6c460f4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:27.607458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50ed0bd2-c108-45bb-9f5f-3447f6c460f4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:27.607915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50ed0bd2-c108-45bb-9f5f-3447f6c460f4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:27.608690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50ed0bd2-c108-45bb-9f5f-3447f6c460f4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:27.609396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50ed0bd2-c108-45bb-9f5f-3447f6c460f4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:27.875112 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-50ed0bd2-c108-45bb-9f5f-3447f6c460f4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de/action" status: 202 len: 0 microversion: 2.1 time: 0.278457 May 28 21:15:27.880072 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1682/3396] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:15:27 2022] POST /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:15:27.890132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-52974dac-cbc5-4f74-be75-6ac3bf9319d5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:27.894157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-52974dac-cbc5-4f74-be75-6ac3bf9319d5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:27.907205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-20a5cc60-04f7-4e20-918f-7f87a9d5a412 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57fb83a0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:27.912656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52974dac-cbc5-4f74-be75-6ac3bf9319d5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:27.914827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52974dac-cbc5-4f74-be75-6ac3bf9319d5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:27.915770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52974dac-cbc5-4f74-be75-6ac3bf9319d5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:27.916471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52974dac-cbc5-4f74-be75-6ac3bf9319d5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:27.972775 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-20a5cc60-04f7-4e20-918f-7f87a9d5a412 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.072896 May 28 21:15:27.973532 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1683/3397] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:27 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:28.117138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-52974dac-cbc5-4f74-be75-6ac3bf9319d5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:28.129521 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-52974dac-cbc5-4f74-be75-6ac3bf9319d5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1520 microversion: 2.1 time: 0.247889 May 28 21:15:28.130542 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1715/3398] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:27 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:28.451968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-11b386bf-b8b4-4b91-b978-5a9f43c76578 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:28.453096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-11b386bf-b8b4-4b91-b978-5a9f43c76578 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:28.461170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11b386bf-b8b4-4b91-b978-5a9f43c76578 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:28.464433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11b386bf-b8b4-4b91-b978-5a9f43c76578 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:28.464433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11b386bf-b8b4-4b91-b978-5a9f43c76578 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:28.464433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11b386bf-b8b4-4b91-b978-5a9f43c76578 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:28.592302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-803fba6f-e1c3-4598-a98a-9b2dc8f8bdf7 req-20e4dc58-f0c2-4eed-9c1a-fa70b37ee5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d9b7c0-0b10-4aea-9af1-50ede9a13238", "name": "network-vif-plugged", "status": "completed", "tag": "4e49f946-3e3f-4a15-ba0a-14cb379976e5"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:28.602662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-803fba6f-e1c3-4598-a98a-9b2dc8f8bdf7 req-20e4dc58-f0c2-4eed-9c1a-fa70b37ee5c5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:28.603137 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-803fba6f-e1c3-4598-a98a-9b2dc8f8bdf7 req-20e4dc58-f0c2-4eed-9c1a-fa70b37ee5c5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:28.619965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:28.630472 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-803fba6f-e1c3-4598-a98a-9b2dc8f8bdf7 req-20e4dc58-f0c2-4eed-9c1a-fa70b37ee5c5 service nova] Creating event network-vif-plugged:4e49f946-3e3f-4a15-ba0a-14cb379976e5 for instance 58d9b7c0-0b10-4aea-9af1-50ede9a13238 on nch2-master-1 May 28 21:15:28.638045 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-803fba6f-e1c3-4598-a98a-9b2dc8f8bdf7 req-20e4dc58-f0c2-4eed-9c1a-fa70b37ee5c5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052301 May 28 21:15:28.639406 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1716/3399] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:15:28.652128 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-11b386bf-b8b4-4b91-b978-5a9f43c76578 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:28.661785 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-11b386bf-b8b4-4b91-b978-5a9f43c76578 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1328 microversion: 2.1 time: 0.213730 May 28 21:15:28.662663 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1684/3400] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:28 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1328 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:28.990277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b22ab946-6626-4c1b-9073-d197a40cb623 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57f3f1f0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:29.044361 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b22ab946-6626-4c1b-9073-d197a40cb623 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.061107 May 28 21:15:29.045962 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1717/3401] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:28 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:29.147754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0781634f-39dc-4aa6-b2d7-fcf03a06744a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:29.148200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0781634f-39dc-4aa6-b2d7-fcf03a06744a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:29.154952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0781634f-39dc-4aa6-b2d7-fcf03a06744a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:29.155405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0781634f-39dc-4aa6-b2d7-fcf03a06744a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:29.156173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0781634f-39dc-4aa6-b2d7-fcf03a06744a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:29.156619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0781634f-39dc-4aa6-b2d7-fcf03a06744a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:29.307623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0781634f-39dc-4aa6-b2d7-fcf03a06744a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:29.316018 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0781634f-39dc-4aa6-b2d7-fcf03a06744a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1500 microversion: 2.1 time: 0.172745 May 28 21:15:29.320107 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1685/3402] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:29 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1500 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:29.337156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-95d0fa2f-4a05-460a-90c3-97b81c0bb2e1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:29.338604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-95d0fa2f-4a05-460a-90c3-97b81c0bb2e1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:29.346710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95d0fa2f-4a05-460a-90c3-97b81c0bb2e1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:29.347175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95d0fa2f-4a05-460a-90c3-97b81c0bb2e1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:29.348105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95d0fa2f-4a05-460a-90c3-97b81c0bb2e1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:29.348554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95d0fa2f-4a05-460a-90c3-97b81c0bb2e1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:29.373005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-95d0fa2f-4a05-460a-90c3-97b81c0bb2e1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lazy-loading 'flavor' on Instance uuid 4b76c27e-3a75-40b8-b777-934f969dc6de {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:15:29.385520 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-95d0fa2f-4a05-460a-90c3-97b81c0bb2e1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] HTTP exception thrown: Cannot 'rescue' instance 4b76c27e-3a75-40b8-b777-934f969dc6de while it is in vm_state paused May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-95d0fa2f-4a05-460a-90c3-97b81c0bb2e1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Request method failure captured: May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de/action HTTP/1.1 May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 14 May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpC0XaL6nt9hgj0fqNJ-e8egvesT5NjK_jUnUBAtg24_DQiY4yBBswyZZHwMHrBd5ALBI4UbRMzOp6RzZMuwpPVT6pecTgJ4VSwWmnC-cS82dnuXHOnMJSwA47KVatITeM5lcpiario-t9uZicKVzKlAEQs1aEbN7XgO22WG-C22tyY May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53b9cfacdbb74a058e52bed331a6f241", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: af446b3d802a42e3bd72b08bace8ea8d May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: {"rescue": {}} May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: exception: Cannot 'rescue' instance 4b76c27e-3a75-40b8-b777-934f969dc6de while it is in vm_state paused May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '4b76c27e-3a75-40b8-b777-934f969dc6de', 'body': {'rescue': {}}} May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b76c27e-3a75-40b8-b777-934f969dc6de in vm_state paused. Cannot rescue while the instance is in this state. May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 4b76c27e-3a75-40b8-b777-934f969dc6de while it is in vm_state paused May 28 21:15:29.387642 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:29.398411 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:29.398411 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:29.398411 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:29.398411 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:29.398411 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:29.398411 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:15:29.398411 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:15:29.398411 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 4b76c27e-3a75-40b8-b777-934f969dc6de while it is in vm_state paused May 28 21:15:29.398411 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:29.398411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-95d0fa2f-4a05-460a-90c3-97b81c0bb2e1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Returning 409 to user: Cannot 'rescue' instance 4b76c27e-3a75-40b8-b777-934f969dc6de while it is in vm_state paused {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:15:29.398411 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-95d0fa2f-4a05-460a-90c3-97b81c0bb2e1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de/action" status: 409 len: 144 microversion: 2.1 time: 0.058429 May 28 21:15:29.398411 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1718/3403] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:15:29 2022] POST /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de/action => generated 144 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:15:29.399672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6bba240b-4479-401e-9908-d1a073e3c9b8 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:29.399672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6bba240b-4479-401e-9908-d1a073e3c9b8 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:29.405797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6bba240b-4479-401e-9908-d1a073e3c9b8 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:29.406285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6bba240b-4479-401e-9908-d1a073e3c9b8 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:29.407060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6bba240b-4479-401e-9908-d1a073e3c9b8 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:29.407505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6bba240b-4479-401e-9908-d1a073e3c9b8 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:29.679668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-13567092-fdfe-4af3-9d6a-b044b223770b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:29.680228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-13567092-fdfe-4af3-9d6a-b044b223770b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:29.687242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13567092-fdfe-4af3-9d6a-b044b223770b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:29.688065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13567092-fdfe-4af3-9d6a-b044b223770b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:29.689116 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13567092-fdfe-4af3-9d6a-b044b223770b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:29.689629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13567092-fdfe-4af3-9d6a-b044b223770b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:29.692526 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6bba240b-4479-401e-9908-d1a073e3c9b8 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de/action" status: 202 len: 0 microversion: 2.1 time: 0.298316 May 28 21:15:29.694043 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1686/3404] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:15:29 2022] POST /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:15:29.703752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-938d3f62-0fda-47c4-b1a4-bdafcbc24bf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:29.706833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-938d3f62-0fda-47c4-b1a4-bdafcbc24bf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:29.713455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-938d3f62-0fda-47c4-b1a4-bdafcbc24bf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:29.714146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-938d3f62-0fda-47c4-b1a4-bdafcbc24bf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:29.715088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-938d3f62-0fda-47c4-b1a4-bdafcbc24bf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:29.715731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-938d3f62-0fda-47c4-b1a4-bdafcbc24bf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:29.911040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-13567092-fdfe-4af3-9d6a-b044b223770b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:29.920267 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-13567092-fdfe-4af3-9d6a-b044b223770b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1328 microversion: 2.1 time: 0.244591 May 28 21:15:29.932184 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1719/3405] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:29 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1328 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:29.952389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-938d3f62-0fda-47c4-b1a4-bdafcbc24bf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:29.961362 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-938d3f62-0fda-47c4-b1a4-bdafcbc24bf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1507 microversion: 2.1 time: 0.261874 May 28 21:15:29.961982 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1687/3406] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:29 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1507 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:30.071668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7b48534c-66d4-4f0d-9070-02fe77babb84 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57e8eca0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:30.122738 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7b48534c-66d4-4f0d-9070-02fe77babb84 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.064909 May 28 21:15:30.123315 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1720/3407] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:30 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:30.691558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e6e2fa4e-feb0-45f8-ba77-ac11c97e28b6 tempest-ComputeTenantNetworksTest-1834867056 tempest-ComputeTenantNetworksTest-1834867056-project] Calling method '.version_select at 0x7f4d69c9b550>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:30.926660 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e6e2fa4e-feb0-45f8-ba77-ac11c97e28b6 tempest-ComputeTenantNetworksTest-1834867056 tempest-ComputeTenantNetworksTest-1834867056-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.366324 May 28 21:15:30.927577 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1688/3408] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:15:30 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:15:30.937180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5cf25fa8-2645-42a5-8686-c2879697de60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:30.937499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b9fd654a-387a-4793-9729-1b7ec53926a1 tempest-ComputeTenantNetworksTest-1834867056 tempest-ComputeTenantNetworksTest-1834867056-project] Calling method '.version_select at 0x7f4d6418ec10>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:30.938261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5cf25fa8-2645-42a5-8686-c2879697de60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:30.953093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cf25fa8-2645-42a5-8686-c2879697de60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:30.953567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cf25fa8-2645-42a5-8686-c2879697de60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:30.954393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cf25fa8-2645-42a5-8686-c2879697de60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:30.955032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cf25fa8-2645-42a5-8686-c2879697de60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:30.966579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:30.998239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:31.150278 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b9fd654a-387a-4793-9729-1b7ec53926a1 tempest-ComputeTenantNetworksTest-1834867056 tempest-ComputeTenantNetworksTest-1834867056-project] 10.222.0.33 "GET /compute/v2.1/os-tenant-networks/314ddc5c-c73c-4725-a70f-9308ed32ef2e" status: 200 len: 139 microversion: 2.1 time: 0.216778 May 28 21:15:31.151129 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1689/3409] 10.222.0.33 () {58 vars in 1268 bytes} [Sat May 28 21:15:30 2022] GET /compute/v2.1/os-tenant-networks/314ddc5c-c73c-4725-a70f-9308ed32ef2e => generated 139 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:15:31.161296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-786a058e-6c1a-4cfb-97fd-e03c54c5421c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:31.162430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-786a058e-6c1a-4cfb-97fd-e03c54c5421c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:31.171019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-786a058e-6c1a-4cfb-97fd-e03c54c5421c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:31.171887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-786a058e-6c1a-4cfb-97fd-e03c54c5421c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:31.173360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-786a058e-6c1a-4cfb-97fd-e03c54c5421c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:31.174781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-786a058e-6c1a-4cfb-97fd-e03c54c5421c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:31.234151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5cf25fa8-2645-42a5-8686-c2879697de60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:31.247605 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5cf25fa8-2645-42a5-8686-c2879697de60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1328 microversion: 2.1 time: 0.313070 May 28 21:15:31.248568 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1721/3410] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:30 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1328 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:31.264096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-63675df2-9d98-4c06-ac90-c0f24deb0800 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69ccaf70>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:31.326928 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-63675df2-9d98-4c06-ac90-c0f24deb0800 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.066988 May 28 21:15:31.327764 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1722/3411] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:31 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:31.367138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-786a058e-6c1a-4cfb-97fd-e03c54c5421c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:31.375768 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-786a058e-6c1a-4cfb-97fd-e03c54c5421c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1515 microversion: 2.1 time: 0.223423 May 28 21:15:31.377028 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1690/3412] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:31 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1515 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:32.268224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0ea49355-8835-4343-90bb-a7bd0f9835f7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:32.272801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0ea49355-8835-4343-90bb-a7bd0f9835f7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:32.299757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ea49355-8835-4343-90bb-a7bd0f9835f7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:32.300468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ea49355-8835-4343-90bb-a7bd0f9835f7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:32.304612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ea49355-8835-4343-90bb-a7bd0f9835f7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:32.308610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ea49355-8835-4343-90bb-a7bd0f9835f7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:32.340895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-49e6bd8d-fbae-4944-89d0-48b69992654c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57fb85e0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:32.434406 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-49e6bd8d-fbae-4944-89d0-48b69992654c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.096677 May 28 21:15:32.439496 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1691/3413] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:32 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:32.490419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=18 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:32.623372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0ea49355-8835-4343-90bb-a7bd0f9835f7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:32.640192 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0ea49355-8835-4343-90bb-a7bd0f9835f7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1328 microversion: 2.1 time: 0.378138 May 28 21:15:32.642846 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1723/3414] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:32 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1328 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:32.780887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-03c17f64-a6c5-42c1-a34e-2c21a3f42aad req-ba5a273d-1037-41cc-969f-7aa3933baf72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6cd313-c4b7-4468-b6d4-70af3088ef89", "name": "network-vif-plugged", "status": "completed", "tag": "f1906144-4701-45a6-a6ea-3e72787f86bb"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:32.797215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-03c17f64-a6c5-42c1-a34e-2c21a3f42aad req-ba5a273d-1037-41cc-969f-7aa3933baf72 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:32.797675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-03c17f64-a6c5-42c1-a34e-2c21a3f42aad req-ba5a273d-1037-41cc-969f-7aa3933baf72 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:32.815897 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-03c17f64-a6c5-42c1-a34e-2c21a3f42aad req-ba5a273d-1037-41cc-969f-7aa3933baf72 service nova] Creating event network-vif-plugged:f1906144-4701-45a6-a6ea-3e72787f86bb for instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 on nch2-master-1 May 28 21:15:32.821149 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-03c17f64-a6c5-42c1-a34e-2c21a3f42aad req-ba5a273d-1037-41cc-969f-7aa3933baf72 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044868 May 28 21:15:32.822469 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1692/3415] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:15:33.449582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e10703f1-37b9-4ef8-9468-e67c43ba5c26 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69ccaaf0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:33.529662 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e10703f1-37b9-4ef8-9468-e67c43ba5c26 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.084938 May 28 21:15:33.537038 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1724/3416] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:33 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:33.659644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-78fef8ec-2d86-46c8-adee-f455830b2a41 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:33.661032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-78fef8ec-2d86-46c8-adee-f455830b2a41 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:33.674486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78fef8ec-2d86-46c8-adee-f455830b2a41 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:33.676889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78fef8ec-2d86-46c8-adee-f455830b2a41 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:33.680624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78fef8ec-2d86-46c8-adee-f455830b2a41 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:33.680624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78fef8ec-2d86-46c8-adee-f455830b2a41 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:33.952012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-78fef8ec-2d86-46c8-adee-f455830b2a41 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:33.969444 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-78fef8ec-2d86-46c8-adee-f455830b2a41 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1328 microversion: 2.1 time: 0.314921 May 28 21:15:33.971720 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1693/3417] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:33 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1328 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:34.545427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-29d02496-3e21-471d-87a1-2d51dd49000e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69c8a8b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:34.608994 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-29d02496-3e21-471d-87a1-2d51dd49000e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.068767 May 28 21:15:34.611104 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1725/3418] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:34 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:34.989401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-814194ca-c484-466e-9640-72ea10af24a1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:34.990103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-814194ca-c484-466e-9640-72ea10af24a1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:35.011067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-814194ca-c484-466e-9640-72ea10af24a1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:35.011818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-814194ca-c484-466e-9640-72ea10af24a1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:35.012674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-814194ca-c484-466e-9640-72ea10af24a1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:35.013422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-814194ca-c484-466e-9640-72ea10af24a1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:35.421897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-814194ca-c484-466e-9640-72ea10af24a1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:35.423328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e55b0af9-d619-4f02-a095-da36f90b4e41 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:35.424420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e55b0af9-d619-4f02-a095-da36f90b4e41 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:35.437715 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-814194ca-c484-466e-9640-72ea10af24a1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1510 microversion: 2.1 time: 0.452803 May 28 21:15:35.438652 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1694/3419] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:34 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1510 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:35.465083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e55b0af9-d619-4f02-a095-da36f90b4e41 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:35.467245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e55b0af9-d619-4f02-a095-da36f90b4e41 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:35.468293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e55b0af9-d619-4f02-a095-da36f90b4e41 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:35.469208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e55b0af9-d619-4f02-a095-da36f90b4e41 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:35.478054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f1e52342-f087-47e2-b87b-493442f460b3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:35.479926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f1e52342-f087-47e2-b87b-493442f460b3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:35.488435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1e52342-f087-47e2-b87b-493442f460b3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:35.488958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1e52342-f087-47e2-b87b-493442f460b3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:35.489765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1e52342-f087-47e2-b87b-493442f460b3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:35.493031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1e52342-f087-47e2-b87b-493442f460b3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:35.503839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-e55b0af9-d619-4f02-a095-da36f90b4e41 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lazy-loading 'flavor' on Instance uuid 4b76c27e-3a75-40b8-b777-934f969dc6de {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:15:35.512698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:36.018560 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e55b0af9-d619-4f02-a095-da36f90b4e41 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de/action" status: 200 len: 32 microversion: 2.1 time: 0.607673 May 28 21:15:36.020890 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1726/3420] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:15:35 2022] POST /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de/action => generated 32 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 21:15:36.049681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cc0e808f-96c0-4f67-8274-d5c94e975494 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57f7fd30>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:36.155832 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cc0e808f-96c0-4f67-8274-d5c94e975494 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.131290 May 28 21:15:36.160478 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1727/3421] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:36 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:36.190013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f1e52342-f087-47e2-b87b-493442f460b3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:36.200551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a5812e7c-4c0b-479c-a598-29a0c362ee22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:36.201440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a5812e7c-4c0b-479c-a598-29a0c362ee22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:36.214480 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f1e52342-f087-47e2-b87b-493442f460b3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1510 microversion: 2.1 time: 0.750546 May 28 21:15:36.222382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5812e7c-4c0b-479c-a598-29a0c362ee22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:36.223352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5812e7c-4c0b-479c-a598-29a0c362ee22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:36.228304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5812e7c-4c0b-479c-a598-29a0c362ee22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:36.228304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5812e7c-4c0b-479c-a598-29a0c362ee22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:36.229457 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1695/3422] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:35 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1510 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:36.238768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-25a98ca8-3357-48c6-9e27-40447c47e490 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:36.239543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-25a98ca8-3357-48c6-9e27-40447c47e490 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:36.253437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25a98ca8-3357-48c6-9e27-40447c47e490 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:36.254193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25a98ca8-3357-48c6-9e27-40447c47e490 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:36.255166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25a98ca8-3357-48c6-9e27-40447c47e490 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:36.255765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25a98ca8-3357-48c6-9e27-40447c47e490 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:36.317370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-25a98ca8-3357-48c6-9e27-40447c47e490 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:15:36.672862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a5812e7c-4c0b-479c-a598-29a0c362ee22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:36.688201 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a5812e7c-4c0b-479c-a598-29a0c362ee22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.522988 May 28 21:15:36.690044 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1728/3423] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:36 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:36.768785 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-25a98ca8-3357-48c6-9e27-40447c47e490 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 204 len: 0 microversion: 2.1 time: 0.537683 May 28 21:15:36.770022 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1696/3424] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:15:36 2022] DELETE /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:15:36.782078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7f6cfd98-6abb-4870-a55c-13bb91fc5053 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:36.782078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7f6cfd98-6abb-4870-a55c-13bb91fc5053 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:36.790534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f6cfd98-6abb-4870-a55c-13bb91fc5053 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:36.791002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f6cfd98-6abb-4870-a55c-13bb91fc5053 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:36.791799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f6cfd98-6abb-4870-a55c-13bb91fc5053 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:36.792252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f6cfd98-6abb-4870-a55c-13bb91fc5053 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:37.173340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0c30a3db-ffdb-44d7-8ca6-9f8f23536714 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d64298d30>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:37.202208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7f6cfd98-6abb-4870-a55c-13bb91fc5053 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:37.211376 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7f6cfd98-6abb-4870-a55c-13bb91fc5053 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1516 microversion: 2.1 time: 0.436410 May 28 21:15:37.216837 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1729/3425] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:36 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1516 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:37.262008 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0c30a3db-ffdb-44d7-8ca6-9f8f23536714 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.092961 May 28 21:15:37.271178 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1697/3426] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:37 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:37.706037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-39b3565f-94b2-471f-8d67-7729cbf25d1b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:37.706774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-39b3565f-94b2-471f-8d67-7729cbf25d1b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:37.717503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39b3565f-94b2-471f-8d67-7729cbf25d1b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:37.719365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39b3565f-94b2-471f-8d67-7729cbf25d1b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:37.719365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39b3565f-94b2-471f-8d67-7729cbf25d1b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:37.719797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39b3565f-94b2-471f-8d67-7729cbf25d1b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:37.953455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-39b3565f-94b2-471f-8d67-7729cbf25d1b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:37.974493 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-39b3565f-94b2-471f-8d67-7729cbf25d1b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.266561 May 28 21:15:37.975327 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1730/3427] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:37 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:38.233351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5752b89a-7ec6-4d74-8200-ff90ea34d31e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:38.234484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5752b89a-7ec6-4d74-8200-ff90ea34d31e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:38.242677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5752b89a-7ec6-4d74-8200-ff90ea34d31e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:38.245802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5752b89a-7ec6-4d74-8200-ff90ea34d31e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:38.245802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5752b89a-7ec6-4d74-8200-ff90ea34d31e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:38.245802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5752b89a-7ec6-4d74-8200-ff90ea34d31e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:38.280582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-27182918-fe59-453f-be5b-171adc044083 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d645f08b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:38.366173 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-27182918-fe59-453f-be5b-171adc044083 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.089997 May 28 21:15:38.376407 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1731/3428] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:38 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:38.464024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5752b89a-7ec6-4d74-8200-ff90ea34d31e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:38.472949 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5752b89a-7ec6-4d74-8200-ff90ea34d31e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1516 microversion: 2.1 time: 0.244885 May 28 21:15:38.475253 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1698/3429] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:38 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1516 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:38.998240 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-42c890d4-01bf-4ee6-9fc7-928d5820ac38 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:38.999255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-42c890d4-01bf-4ee6-9fc7-928d5820ac38 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:39.017632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42c890d4-01bf-4ee6-9fc7-928d5820ac38 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:39.019640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42c890d4-01bf-4ee6-9fc7-928d5820ac38 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:39.022002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42c890d4-01bf-4ee6-9fc7-928d5820ac38 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:39.023824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42c890d4-01bf-4ee6-9fc7-928d5820ac38 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:39.278937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-42c890d4-01bf-4ee6-9fc7-928d5820ac38 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:39.290639 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-42c890d4-01bf-4ee6-9fc7-928d5820ac38 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.301613 May 28 21:15:39.292283 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1732/3430] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:38 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:39.385183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c0b92a8f-5f81-411f-8bb2-161c4a17a43e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69cc05e0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:39.499433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f8cdee65-68e4-4815-9b04-ccb7aab1b8b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:39.500375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f8cdee65-68e4-4815-9b04-ccb7aab1b8b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:39.522273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8cdee65-68e4-4815-9b04-ccb7aab1b8b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:39.524154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8cdee65-68e4-4815-9b04-ccb7aab1b8b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:39.530431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8cdee65-68e4-4815-9b04-ccb7aab1b8b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:39.531905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8cdee65-68e4-4815-9b04-ccb7aab1b8b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:39.567373 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c0b92a8f-5f81-411f-8bb2-161c4a17a43e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.187744 May 28 21:15:39.568620 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1699/3431] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:39 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:39.750816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f8cdee65-68e4-4815-9b04-ccb7aab1b8b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:39.772151 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f8cdee65-68e4-4815-9b04-ccb7aab1b8b9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1474 microversion: 2.1 time: 0.280303 May 28 21:15:39.775928 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1733/3432] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:39 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1474 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:39.800038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-ef39ef47-ab6a-4a6a-bb8e-00691c28d843 req-6a8ff4e5-bf19-4c89-b208-0185a58418e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6cd313-c4b7-4468-b6d4-70af3088ef89", "name": "network-vif-deleted", "tag": "f1906144-4701-45a6-a6ea-3e72787f86bb"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:39.815237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ef39ef47-ab6a-4a6a-bb8e-00691c28d843 req-6a8ff4e5-bf19-4c89-b208-0185a58418e9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:39.815789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ef39ef47-ab6a-4a6a-bb8e-00691c28d843 req-6a8ff4e5-bf19-4c89-b208-0185a58418e9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:39.828218 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-ef39ef47-ab6a-4a6a-bb8e-00691c28d843 req-6a8ff4e5-bf19-4c89-b208-0185a58418e9 service nova] Creating event network-vif-deleted:f1906144-4701-45a6-a6ea-3e72787f86bb for instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 on nch2-master-1 May 28 21:15:39.835098 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-ef39ef47-ab6a-4a6a-bb8e-00691c28d843 req-6a8ff4e5-bf19-4c89-b208-0185a58418e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037856 May 28 21:15:39.836186 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1700/3433] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:15:40.309073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-98a05071-6138-49b2-bdf4-2c09acfac11a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:40.310242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-98a05071-6138-49b2-bdf4-2c09acfac11a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:40.318156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98a05071-6138-49b2-bdf4-2c09acfac11a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:40.318623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98a05071-6138-49b2-bdf4-2c09acfac11a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:40.319411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98a05071-6138-49b2-bdf4-2c09acfac11a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:40.319858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98a05071-6138-49b2-bdf4-2c09acfac11a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:40.461940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-98a05071-6138-49b2-bdf4-2c09acfac11a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:40.469641 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-98a05071-6138-49b2-bdf4-2c09acfac11a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.166237 May 28 21:15:40.470238 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1734/3434] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:40 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:40.582195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6262d9ef-a2d9-49ba-800c-19ded3ddaad8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69cc0940>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:40.634556 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6262d9ef-a2d9-49ba-800c-19ded3ddaad8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.057467 May 28 21:15:40.638954 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1701/3435] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:40 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:40.790450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-54f09556-41bc-4231-9cce-c617b2a5126f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:40.791088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-54f09556-41bc-4231-9cce-c617b2a5126f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:40.803293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54f09556-41bc-4231-9cce-c617b2a5126f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:40.803764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54f09556-41bc-4231-9cce-c617b2a5126f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:40.804564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54f09556-41bc-4231-9cce-c617b2a5126f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:40.810655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54f09556-41bc-4231-9cce-c617b2a5126f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:40.904814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54f09556-41bc-4231-9cce-c617b2a5126f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:40.905313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54f09556-41bc-4231-9cce-c617b2a5126f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:40.905747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-54f09556-41bc-4231-9cce-c617b2a5126f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lazy-loading 'fault' on Instance uuid ec6cd313-c4b7-4468-b6d4-70af3088ef89 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:15:41.030689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-54f09556-41bc-4231-9cce-c617b2a5126f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:41.041493 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-54f09556-41bc-4231-9cce-c617b2a5126f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 200 len: 1318 microversion: 2.1 time: 0.255618 May 28 21:15:41.046506 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1735/3436] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:40 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:41.488747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a91193e4-77a0-4c4f-8718-014a8cfd74d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:41.489489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a91193e4-77a0-4c4f-8718-014a8cfd74d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:41.499165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a91193e4-77a0-4c4f-8718-014a8cfd74d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:41.502735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a91193e4-77a0-4c4f-8718-014a8cfd74d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:41.502735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a91193e4-77a0-4c4f-8718-014a8cfd74d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:41.502735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a91193e4-77a0-4c4f-8718-014a8cfd74d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:41.655514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d62ae306-ff05-4559-90c8-5726e183ab27 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57f3fc10>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:41.682500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a91193e4-77a0-4c4f-8718-014a8cfd74d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:41.691124 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a91193e4-77a0-4c4f-8718-014a8cfd74d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.206231 May 28 21:15:41.692769 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1702/3437] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:41 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:41.734674 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d62ae306-ff05-4559-90c8-5726e183ab27 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.080669 May 28 21:15:41.735980 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1736/3438] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:41 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:42.081774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e83deb73-2cfc-484b-911d-895791a23fc6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:42.082457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e83deb73-2cfc-484b-911d-895791a23fc6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:42.091274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e83deb73-2cfc-484b-911d-895791a23fc6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:42.097574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e83deb73-2cfc-484b-911d-895791a23fc6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:42.099190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e83deb73-2cfc-484b-911d-895791a23fc6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:42.099908 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e83deb73-2cfc-484b-911d-895791a23fc6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:42.134293 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-e83deb73-2cfc-484b-911d-895791a23fc6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e83deb73-2cfc-484b-911d-895791a23fc6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 HTTP/1.1 May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ec6cd313-c4b7-4468-b6d4-70af3088ef89'} May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:15:42.136743 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:42.143841 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:42.143841 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:42.143841 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:15:42.143841 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:15:42.143841 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. May 28 21:15:42.143841 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:15:42.149503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e83deb73-2cfc-484b-911d-895791a23fc6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:15:42.151565 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e83deb73-2cfc-484b-911d-895791a23fc6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 404 len: 111 microversion: 2.1 time: 0.096114 May 28 21:15:42.152965 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1703/3439] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:42 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:15:42.163402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-67da4644-d03a-464d-be07-630bac5cb5f3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '.version_select at 0x7f4d69ca8820>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:42.261369 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-67da4644-d03a-464d-be07-630bac5cb5f3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-key-1258563961" status: 202 len: 0 microversion: 2.1 time: 0.103066 May 28 21:15:42.263331 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1737/3440] 10.222.0.33 () {58 vars in 1208 bytes} [Sat May 28 21:15:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1258563961 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:15:42.485855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1659589678", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "ca803b4d-8584-4327-9f76-66ddebb3c209"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:42.612515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] validate_networks() for [('ca803b4d-8584-4327-9f76-66ddebb3c209', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:15:42.718693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-31c8987c-4c46-4eec-850a-5a4bbc92b8c2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:42.719975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-31c8987c-4c46-4eec-850a-5a4bbc92b8c2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:42.731791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31c8987c-4c46-4eec-850a-5a4bbc92b8c2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:42.732645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31c8987c-4c46-4eec-850a-5a4bbc92b8c2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:42.733928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31c8987c-4c46-4eec-850a-5a4bbc92b8c2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:42.734553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31c8987c-4c46-4eec-850a-5a4bbc92b8c2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:43.505675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-31c8987c-4c46-4eec-850a-5a4bbc92b8c2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:43.524020 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-31c8987c-4c46-4eec-850a-5a4bbc92b8c2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.811574 May 28 21:15:43.526127 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1738/3441] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:42 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:43.541306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d0ba9130-04da-4cc1-ba3d-6f9513ef1b41 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57f7f9d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:43.606090 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d0ba9130-04da-4cc1-ba3d-6f9513ef1b41 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.078590 May 28 21:15:43.607056 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1739/3442] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:43 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:43.954752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:15:43.955650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:15:43.956186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:15:43.957739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:15:43.957739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:15:43.967975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:43.969075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:43.970800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:43.971778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:43.993648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:15:44.002549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for user 572170ccd67e4facbf10dad7cd1491c1 and project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:15:44.024564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:15:44.027022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:15:44.208131 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-47ad1ef1-2245-4289-bec8-bfc7c3c098bd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.727971 May 28 21:15:44.211092 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1704/3443] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:15:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:15:44.223804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7620417f-8801-4c6a-a6a6-461dfd87a254 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:44.226650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7620417f-8801-4c6a-a6a6-461dfd87a254 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:44.356049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7620417f-8801-4c6a-a6a6-461dfd87a254 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:44.364895 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7620417f-8801-4c6a-a6a6-461dfd87a254 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1209 microversion: 2.1 time: 0.147281 May 28 21:15:44.367690 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1740/3444] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:44 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1209 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:44.549122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-404a0a0a-d7a6-49b0-a4d0-f2669a42eb8a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:44.550299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-404a0a0a-d7a6-49b0-a4d0-f2669a42eb8a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:44.579709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-404a0a0a-d7a6-49b0-a4d0-f2669a42eb8a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:44.580172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-404a0a0a-d7a6-49b0-a4d0-f2669a42eb8a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:44.581312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-404a0a0a-d7a6-49b0-a4d0-f2669a42eb8a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:44.582296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-404a0a0a-d7a6-49b0-a4d0-f2669a42eb8a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:44.620968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-201b173b-bbfd-4bde-897f-450421c8e7f5 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69ca88b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:44.713744 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-201b173b-bbfd-4bde-897f-450421c8e7f5 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.095342 May 28 21:15:44.714769 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1741/3445] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:44 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:44.928289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-404a0a0a-d7a6-49b0-a4d0-f2669a42eb8a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:44.936619 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-404a0a0a-d7a6-49b0-a4d0-f2669a42eb8a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.392991 May 28 21:15:44.937199 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1705/3446] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:44 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:45.387531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f6c781e9-9143-4f0e-9b84-30d1ba36aa0e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:45.388712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f6c781e9-9143-4f0e-9b84-30d1ba36aa0e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:45.463636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f6c781e9-9143-4f0e-9b84-30d1ba36aa0e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:45.471646 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f6c781e9-9143-4f0e-9b84-30d1ba36aa0e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1209 microversion: 2.1 time: 0.091137 May 28 21:15:45.472367 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1742/3447] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:45 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:45.729171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-798f6cf6-58eb-4a9e-90fe-af9fef1ebe95 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d64188280>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:45.776062 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-798f6cf6-58eb-4a9e-90fe-af9fef1ebe95 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1453 microversion: 2.1 time: 0.051403 May 28 21:15:45.776665 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1706/3448] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:45 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1453 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:45.955682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3c3d4338-d48d-492f-9bbd-e0e25db78ad3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:45.956307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3c3d4338-d48d-492f-9bbd-e0e25db78ad3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:45.973808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c3d4338-d48d-492f-9bbd-e0e25db78ad3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:45.974309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c3d4338-d48d-492f-9bbd-e0e25db78ad3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:45.975094 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c3d4338-d48d-492f-9bbd-e0e25db78ad3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:45.976257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c3d4338-d48d-492f-9bbd-e0e25db78ad3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:46.171803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3c3d4338-d48d-492f-9bbd-e0e25db78ad3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:46.184727 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3c3d4338-d48d-492f-9bbd-e0e25db78ad3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.233414 May 28 21:15:46.194036 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1743/3449] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:45 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:46.489204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1cc6921b-a379-4ab2-9c72-bc2030503f48 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:46.490315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1cc6921b-a379-4ab2-9c72-bc2030503f48 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:46.497810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cc6921b-a379-4ab2-9c72-bc2030503f48 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:46.498362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cc6921b-a379-4ab2-9c72-bc2030503f48 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:46.499215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cc6921b-a379-4ab2-9c72-bc2030503f48 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:46.500022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cc6921b-a379-4ab2-9c72-bc2030503f48 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:46.613276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1cc6921b-a379-4ab2-9c72-bc2030503f48 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:46.621551 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1cc6921b-a379-4ab2-9c72-bc2030503f48 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1205 microversion: 2.1 time: 0.136471 May 28 21:15:46.631452 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1707/3450] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:46 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1205 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:46.788404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-21a15171-28c0-4d30-ab3e-cafff8d2afd2 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d5784c550>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:46.853305 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-21a15171-28c0-4d30-ab3e-cafff8d2afd2 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1462 microversion: 2.1 time: 0.068551 May 28 21:15:46.854995 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1744/3451] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:46 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1462 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:46.865737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6cef4b86-1762-4a5e-973b-67cd7198a9c4 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69c7bdc0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:46.918583 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6cef4b86-1762-4a5e-973b-67cd7198a9c4 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 200 len: 1462 microversion: 2.1 time: 0.056564 May 28 21:15:46.919425 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1708/3452] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:46 2022] GET /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 1462 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:46.934775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ae2ec45a-229e-4d1b-8ae6-92ccdee71dcd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:46.936565 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ae2ec45a-229e-4d1b-8ae6-92ccdee71dcd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:46.945187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae2ec45a-229e-4d1b-8ae6-92ccdee71dcd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:46.945950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae2ec45a-229e-4d1b-8ae6-92ccdee71dcd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:46.947654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae2ec45a-229e-4d1b-8ae6-92ccdee71dcd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:46.948292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae2ec45a-229e-4d1b-8ae6-92ccdee71dcd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:46.958223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:47.101603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ae2ec45a-229e-4d1b-8ae6-92ccdee71dcd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:47.115132 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ae2ec45a-229e-4d1b-8ae6-92ccdee71dcd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1466 microversion: 2.1 time: 0.187516 May 28 21:15:47.116781 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1745/3453] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:46 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1466 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:47.137463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1a565c9a-1110-4ef9-8b11-1ff6d678f31c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-226694413"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:47.138826 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1a565c9a-1110-4ef9-8b11-1ff6d678f31c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 144ab366-0448-410f-9093-91dec09b838c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:47.149436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a565c9a-1110-4ef9-8b11-1ff6d678f31c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:47.150159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a565c9a-1110-4ef9-8b11-1ff6d678f31c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:47.150942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a565c9a-1110-4ef9-8b11-1ff6d678f31c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:47.151487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a565c9a-1110-4ef9-8b11-1ff6d678f31c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:47.203117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-49ea6652-2d65-46e8-97cf-f3c18db74619 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:47.203830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-49ea6652-2d65-46e8-97cf-f3c18db74619 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:47.211462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49ea6652-2d65-46e8-97cf-f3c18db74619 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:47.211924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49ea6652-2d65-46e8-97cf-f3c18db74619 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:47.214451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49ea6652-2d65-46e8-97cf-f3c18db74619 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:47.214942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49ea6652-2d65-46e8-97cf-f3c18db74619 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:47.393957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-49ea6652-2d65-46e8-97cf-f3c18db74619 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:47.395863 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-49ea6652-2d65-46e8-97cf-f3c18db74619 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.196758 May 28 21:15:47.396768 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1746/3454] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:47 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:47.641580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4e232179-2b89-4a36-9364-3f107be813aa tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:47.642262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4e232179-2b89-4a36-9364-3f107be813aa tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:47.649357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e232179-2b89-4a36-9364-3f107be813aa tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:47.649813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e232179-2b89-4a36-9364-3f107be813aa tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:47.650912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e232179-2b89-4a36-9364-3f107be813aa tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:47.651538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e232179-2b89-4a36-9364-3f107be813aa tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:47.729601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4e232179-2b89-4a36-9364-3f107be813aa tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:47.737746 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4e232179-2b89-4a36-9364-3f107be813aa tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1269 microversion: 2.1 time: 0.100594 May 28 21:15:47.738350 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1747/3455] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:47 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1269 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:47.797377 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1a565c9a-1110-4ef9-8b11-1ff6d678f31c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "POST /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c/action" status: 202 len: 0 microversion: 2.1 time: 0.660740 May 28 21:15:47.797377 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1709/3456] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:15:47 2022] POST /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c/action => generated 0 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 21:15:47.819056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-98d7f317-4d07-4c44-87fb-ebcd57a6a2ed tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57f05d30>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:47.892527 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-98d7f317-4d07-4c44-87fb-ebcd57a6a2ed tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.091770 May 28 21:15:47.893486 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1748/3457] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:47 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:48.418422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fa0c0c59-9d14-462e-86d0-d2fa45afa564 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:48.418422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fa0c0c59-9d14-462e-86d0-d2fa45afa564 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:48.435746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fa0c0c59-9d14-462e-86d0-d2fa45afa564 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:48.435746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fa0c0c59-9d14-462e-86d0-d2fa45afa564 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:48.435746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fa0c0c59-9d14-462e-86d0-d2fa45afa564 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:48.435746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fa0c0c59-9d14-462e-86d0-d2fa45afa564 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:48.688712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fa0c0c59-9d14-462e-86d0-d2fa45afa564 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:48.700374 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fa0c0c59-9d14-462e-86d0-d2fa45afa564 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.290470 May 28 21:15:48.701182 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1710/3458] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:48 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:48.755890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8685dbcf-6cba-4643-9d2f-b926eb1f50ef tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:48.756522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8685dbcf-6cba-4643-9d2f-b926eb1f50ef tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:48.769212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8685dbcf-6cba-4643-9d2f-b926eb1f50ef tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:48.769757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8685dbcf-6cba-4643-9d2f-b926eb1f50ef tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:48.770758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8685dbcf-6cba-4643-9d2f-b926eb1f50ef tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:48.771266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8685dbcf-6cba-4643-9d2f-b926eb1f50ef tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:48.913868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2b9062c4-ecc3-4ed8-ae8f-bda90f6b7569 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57a36550>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:48.997080 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2b9062c4-ecc3-4ed8-ae8f-bda90f6b7569 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.095022 May 28 21:15:48.998096 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1711/3459] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:48 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:49.013194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8685dbcf-6cba-4643-9d2f-b926eb1f50ef tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:49.023979 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8685dbcf-6cba-4643-9d2f-b926eb1f50ef tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1309 microversion: 2.1 time: 0.272882 May 28 21:15:49.037222 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1749/3460] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:48 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1309 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:49.722982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-af6bb5ab-68bb-4ec2-86e2-fe8d12caf2a8 req-45498246-013f-45c0-b4bc-a99a10dc36cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b", "tag": "7410510e-0992-4f1a-a66b-880cb18938ce"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:49.724803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4adb191b-eb26-485f-ab03-65166c399903 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:49.726284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4adb191b-eb26-485f-ab03-65166c399903 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:49.734386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-af6bb5ab-68bb-4ec2-86e2-fe8d12caf2a8 req-45498246-013f-45c0-b4bc-a99a10dc36cc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:49.735036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-af6bb5ab-68bb-4ec2-86e2-fe8d12caf2a8 req-45498246-013f-45c0-b4bc-a99a10dc36cc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:49.736496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4adb191b-eb26-485f-ab03-65166c399903 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:49.737228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4adb191b-eb26-485f-ab03-65166c399903 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:49.738219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4adb191b-eb26-485f-ab03-65166c399903 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:49.738745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4adb191b-eb26-485f-ab03-65166c399903 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:49.747079 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-af6bb5ab-68bb-4ec2-86e2-fe8d12caf2a8 req-45498246-013f-45c0-b4bc-a99a10dc36cc service nova] Creating event network-changed:7410510e-0992-4f1a-a66b-880cb18938ce for instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b on nch2-master-1 May 28 21:15:49.752567 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-af6bb5ab-68bb-4ec2-86e2-fe8d12caf2a8 req-45498246-013f-45c0-b4bc-a99a10dc36cc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033659 May 28 21:15:49.753728 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1712/3461] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:15:49.992978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4adb191b-eb26-485f-ab03-65166c399903 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:50.012539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5aec3a39-2012-4b1f-8d0f-256009d853b8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69d06040>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:50.018689 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4adb191b-eb26-485f-ab03-65166c399903 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.297979 May 28 21:15:50.031989 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1750/3462] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:49 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:50.049462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-366408fa-7b18-4016-b117-7e9901dc152c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:50.050176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-366408fa-7b18-4016-b117-7e9901dc152c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:50.061360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-366408fa-7b18-4016-b117-7e9901dc152c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:50.069907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-366408fa-7b18-4016-b117-7e9901dc152c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:50.073063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-366408fa-7b18-4016-b117-7e9901dc152c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:50.073063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-366408fa-7b18-4016-b117-7e9901dc152c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:50.090021 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5aec3a39-2012-4b1f-8d0f-256009d853b8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.082087 May 28 21:15:50.101050 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1713/3463] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:50 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:50.282843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-366408fa-7b18-4016-b117-7e9901dc152c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:50.291271 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-366408fa-7b18-4016-b117-7e9901dc152c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1309 microversion: 2.1 time: 0.246496 May 28 21:15:50.292171 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1751/3464] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:50 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1309 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:50.709985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-6472d89f-f3b8-49fd-9407-e632e2e755ee req-a50f464b-2a18-4367-9673-623688a72379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d9b7c0-0b10-4aea-9af1-50ede9a13238", "name": "network-vif-unplugged", "status": "completed", "tag": "4e49f946-3e3f-4a15-ba0a-14cb379976e5"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:50.743820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6472d89f-f3b8-49fd-9407-e632e2e755ee req-a50f464b-2a18-4367-9673-623688a72379 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:50.746381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6472d89f-f3b8-49fd-9407-e632e2e755ee req-a50f464b-2a18-4367-9673-623688a72379 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:50.779534 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-6472d89f-f3b8-49fd-9407-e632e2e755ee req-a50f464b-2a18-4367-9673-623688a72379 service nova] Creating event network-vif-unplugged:4e49f946-3e3f-4a15-ba0a-14cb379976e5 for instance 58d9b7c0-0b10-4aea-9af1-50ede9a13238 on nch2-master-1 May 28 21:15:50.787469 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-6472d89f-f3b8-49fd-9407-e632e2e755ee req-a50f464b-2a18-4367-9673-623688a72379 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081353 May 28 21:15:50.788867 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1714/3465] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:15:51.045195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b47a2eb0-aedd-4fa7-985d-5dd456028911 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:51.046328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b47a2eb0-aedd-4fa7-985d-5dd456028911 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:51.054777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b47a2eb0-aedd-4fa7-985d-5dd456028911 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:51.055511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b47a2eb0-aedd-4fa7-985d-5dd456028911 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:51.064369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b47a2eb0-aedd-4fa7-985d-5dd456028911 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:51.065071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b47a2eb0-aedd-4fa7-985d-5dd456028911 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:51.109608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9321a1e3-fa72-40f7-b4ec-88c18ebc6400 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d64566310>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:51.173167 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9321a1e3-fa72-40f7-b4ec-88c18ebc6400 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.068568 May 28 21:15:51.175240 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1715/3466] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:51 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:51.286810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b47a2eb0-aedd-4fa7-985d-5dd456028911 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:51.296980 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b47a2eb0-aedd-4fa7-985d-5dd456028911 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.256069 May 28 21:15:51.302488 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1752/3467] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:51 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:51.309746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-348543cb-a2f2-4a7b-8e5c-d352f5af42a3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:51.311145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-348543cb-a2f2-4a7b-8e5c-d352f5af42a3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:51.320112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-348543cb-a2f2-4a7b-8e5c-d352f5af42a3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:51.320860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-348543cb-a2f2-4a7b-8e5c-d352f5af42a3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:51.322019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-348543cb-a2f2-4a7b-8e5c-d352f5af42a3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:51.322499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-348543cb-a2f2-4a7b-8e5c-d352f5af42a3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:51.471887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-348543cb-a2f2-4a7b-8e5c-d352f5af42a3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:51.485918 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-348543cb-a2f2-4a7b-8e5c-d352f5af42a3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1309 microversion: 2.1 time: 0.177629 May 28 21:15:51.485918 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1716/3468] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:51 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1309 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:52.188445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-02643d31-70da-4757-a10c-7cc99cb5fbdc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d576624c0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:52.234259 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-02643d31-70da-4757-a10c-7cc99cb5fbdc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.049892 May 28 21:15:52.235024 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1753/3469] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:52 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:52.316050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e84617b5-a482-4e97-b3ef-137f0dfb8ebb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:52.317324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e84617b5-a482-4e97-b3ef-137f0dfb8ebb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:52.325511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e84617b5-a482-4e97-b3ef-137f0dfb8ebb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:52.326088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e84617b5-a482-4e97-b3ef-137f0dfb8ebb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:52.326881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e84617b5-a482-4e97-b3ef-137f0dfb8ebb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:52.327318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e84617b5-a482-4e97-b3ef-137f0dfb8ebb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:52.480776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e84617b5-a482-4e97-b3ef-137f0dfb8ebb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:52.490428 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e84617b5-a482-4e97-b3ef-137f0dfb8ebb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.177897 May 28 21:15:52.493192 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1717/3470] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:52 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:52.513219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7041175a-15e3-4295-af71-e9cc8ecb3f42 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:52.515240 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7041175a-15e3-4295-af71-e9cc8ecb3f42 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:52.528689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7041175a-15e3-4295-af71-e9cc8ecb3f42 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:52.529251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7041175a-15e3-4295-af71-e9cc8ecb3f42 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:52.530324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7041175a-15e3-4295-af71-e9cc8ecb3f42 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:52.531269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7041175a-15e3-4295-af71-e9cc8ecb3f42 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:52.721574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7041175a-15e3-4295-af71-e9cc8ecb3f42 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:52.746896 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7041175a-15e3-4295-af71-e9cc8ecb3f42 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1309 microversion: 2.1 time: 0.246871 May 28 21:15:52.747269 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1754/3471] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:52 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1309 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:52.805024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-d90e9674-141b-414d-8c92-9d9d14a832af req-06934956-d174-4b8a-bbed-23270c6329c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144ab366-0448-410f-9093-91dec09b838c", "name": "network-vif-plugged", "status": "completed", "tag": "cfbdc8df-e8d0-4012-b243-cfb3e0d4ff83"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:52.814027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d90e9674-141b-414d-8c92-9d9d14a832af req-06934956-d174-4b8a-bbed-23270c6329c3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:52.814715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d90e9674-141b-414d-8c92-9d9d14a832af req-06934956-d174-4b8a-bbed-23270c6329c3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:52.827323 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-d90e9674-141b-414d-8c92-9d9d14a832af req-06934956-d174-4b8a-bbed-23270c6329c3 service nova] Creating event network-vif-plugged:cfbdc8df-e8d0-4012-b243-cfb3e0d4ff83 for instance 144ab366-0448-410f-9093-91dec09b838c on nch2-master-1 May 28 21:15:52.832796 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-d90e9674-141b-414d-8c92-9d9d14a832af req-06934956-d174-4b8a-bbed-23270c6329c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033349 May 28 21:15:52.833778 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1718/3472] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:15:53.255701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6ee20c51-61c7-467b-b5d0-24899c7c9cb8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57f053a0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:53.323453 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6ee20c51-61c7-467b-b5d0-24899c7c9cb8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.074707 May 28 21:15:53.325717 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1755/3473] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:53 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:53.514282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a79218ea-635a-4cc8-8748-1c7b9c8ddde6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:53.515698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a79218ea-635a-4cc8-8748-1c7b9c8ddde6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:53.536410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a79218ea-635a-4cc8-8748-1c7b9c8ddde6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:53.537123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a79218ea-635a-4cc8-8748-1c7b9c8ddde6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:53.538799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a79218ea-635a-4cc8-8748-1c7b9c8ddde6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:53.539485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a79218ea-635a-4cc8-8748-1c7b9c8ddde6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:53.770966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8122c191-ebfb-4742-9277-5e0d679ecd51 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:53.773307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8122c191-ebfb-4742-9277-5e0d679ecd51 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:53.785377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:53.791829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8122c191-ebfb-4742-9277-5e0d679ecd51 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:53.794663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8122c191-ebfb-4742-9277-5e0d679ecd51 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:53.795854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8122c191-ebfb-4742-9277-5e0d679ecd51 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:53.797011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8122c191-ebfb-4742-9277-5e0d679ecd51 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:53.983766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:54.011367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:54.292747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8122c191-ebfb-4742-9277-5e0d679ecd51 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:54.310277 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8122c191-ebfb-4742-9277-5e0d679ecd51 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1309 microversion: 2.1 time: 0.535208 May 28 21:15:54.311668 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1756/3474] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:53 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1309 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:54.327742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a79218ea-635a-4cc8-8748-1c7b9c8ddde6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:54.340432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c3f0e543-ffec-409d-9683-a6edef7dc97a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d645f0670>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:54.349405 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a79218ea-635a-4cc8-8748-1c7b9c8ddde6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.840626 May 28 21:15:54.350607 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1719/3475] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:53 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:54.443609 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c3f0e543-ffec-409d-9683-a6edef7dc97a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.099236 May 28 21:15:54.443609 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1757/3476] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:54 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:54.997683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-92f7af8b-cd46-490e-9464-7001049c71be req-7d91c367-0169-4275-a19c-882eab52f8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b", "name": "network-vif-plugged", "status": "completed", "tag": "7410510e-0992-4f1a-a66b-880cb18938ce"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:55.035147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-92f7af8b-cd46-490e-9464-7001049c71be req-7d91c367-0169-4275-a19c-882eab52f8f4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:55.035495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-92f7af8b-cd46-490e-9464-7001049c71be req-7d91c367-0169-4275-a19c-882eab52f8f4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:55.107858 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-92f7af8b-cd46-490e-9464-7001049c71be req-7d91c367-0169-4275-a19c-882eab52f8f4 service nova] Creating event network-vif-plugged:7410510e-0992-4f1a-a66b-880cb18938ce for instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b on nch2-master-1 May 28 21:15:55.133106 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-92f7af8b-cd46-490e-9464-7001049c71be req-7d91c367-0169-4275-a19c-882eab52f8f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139677 May 28 21:15:55.143117 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1720/3477] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:15:55.329386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-78c4ab85-70e4-4373-8daf-744ee98fc8ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:55.330160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-78c4ab85-70e4-4373-8daf-744ee98fc8ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:55.341678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78c4ab85-70e4-4373-8daf-744ee98fc8ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:55.342710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78c4ab85-70e4-4373-8daf-744ee98fc8ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:55.345079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78c4ab85-70e4-4373-8daf-744ee98fc8ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:55.346277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78c4ab85-70e4-4373-8daf-744ee98fc8ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:55.379137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6a769c6a-b2c3-4f2a-a633-1ca9f074b4c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:55.380338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6a769c6a-b2c3-4f2a-a633-1ca9f074b4c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:55.413799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a769c6a-b2c3-4f2a-a633-1ca9f074b4c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:55.418131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a769c6a-b2c3-4f2a-a633-1ca9f074b4c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:55.420232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a769c6a-b2c3-4f2a-a633-1ca9f074b4c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:55.422871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a769c6a-b2c3-4f2a-a633-1ca9f074b4c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:55.471861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:55.491524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:55.823319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-78c4ab85-70e4-4373-8daf-744ee98fc8ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:55.838538 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-78c4ab85-70e4-4373-8daf-744ee98fc8ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1309 microversion: 2.1 time: 0.510870 May 28 21:15:55.848223 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1758/3478] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:55 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1309 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:55.859848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ae0ac9f9-26ec-4e03-aa28-28cd0bab3e4f tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57ec6f70>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:55.946527 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ae0ac9f9-26ec-4e03-aa28-28cd0bab3e4f tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.090347 May 28 21:15:55.955112 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1759/3479] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:55 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:56.004206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6a769c6a-b2c3-4f2a-a633-1ca9f074b4c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:56.025468 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6a769c6a-b2c3-4f2a-a633-1ca9f074b4c1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.657046 May 28 21:15:56.026760 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1721/3480] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:55 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:56.856821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fa2a4b04-9143-4e1d-a507-9efabf0aebd9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:56.857881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fa2a4b04-9143-4e1d-a507-9efabf0aebd9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:56.896951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa2a4b04-9143-4e1d-a507-9efabf0aebd9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:56.897885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa2a4b04-9143-4e1d-a507-9efabf0aebd9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:56.908305 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa2a4b04-9143-4e1d-a507-9efabf0aebd9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:56.909096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa2a4b04-9143-4e1d-a507-9efabf0aebd9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:56.962620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-22e865c1-815d-40cb-bfa7-64e8f425edd8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d643ac700>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:57.079394 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-22e865c1-815d-40cb-bfa7-64e8f425edd8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.121947 May 28 21:15:57.082937 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1722/3481] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:56 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:57.104870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6a1e5844-fa44-4338-9911-3448f9dd9d59 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:57.108122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6a1e5844-fa44-4338-9911-3448f9dd9d59 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:57.128007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a1e5844-fa44-4338-9911-3448f9dd9d59 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:57.130286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a1e5844-fa44-4338-9911-3448f9dd9d59 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:57.131044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a1e5844-fa44-4338-9911-3448f9dd9d59 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:57.132068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a1e5844-fa44-4338-9911-3448f9dd9d59 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:57.355248 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fa2a4b04-9143-4e1d-a507-9efabf0aebd9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:57.369522 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fa2a4b04-9143-4e1d-a507-9efabf0aebd9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1491 microversion: 2.1 time: 0.517781 May 28 21:15:57.370228 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1760/3482] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:56 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1491 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:57.472106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6a1e5844-fa44-4338-9911-3448f9dd9d59 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:57.481087 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6a1e5844-fa44-4338-9911-3448f9dd9d59 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1501 microversion: 2.1 time: 0.394339 May 28 21:15:57.481949 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1723/3483] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:57 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1501 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:57.502252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-42848a9f-07ec-473d-93cf-29d0164c66d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63775810-6872-4bc9-9e90-435936e0987e"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:57.503460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-42848a9f-07ec-473d-93cf-29d0164c66d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:57.514907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42848a9f-07ec-473d-93cf-29d0164c66d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:57.515391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42848a9f-07ec-473d-93cf-29d0164c66d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:57.517600 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42848a9f-07ec-473d-93cf-29d0164c66d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:57.518103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42848a9f-07ec-473d-93cf-29d0164c66d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:57.542088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1659589678", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "ca803b4d-8584-4327-9f76-66ddebb3c209"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:57.554277 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-42848a9f-07ec-473d-93cf-29d0164c66d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] HTTP exception thrown: Cannot 'attach_volume' instance 4b76c27e-3a75-40b8-b777-934f969dc6de while it is in vm_state rescued May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-42848a9f-07ec-473d-93cf-29d0164c66d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Request method failure captured: May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de/os-volume_attachments HTTP/1.1 May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 74 May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpC0XaL6nt9hgj0fqNJ-e8egvesT5NjK_jUnUBAtg24_DQiY4yBBswyZZHwMHrBd5ALBI4UbRMzOp6RzZMuwpPVT6pecTgJ4VSwWmnC-cS82dnuXHOnMJSwA47KVatITeM5lcpiario-t9uZicKVzKlAEQs1aEbN7XgO22WG-C22tyY May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53b9cfacdbb74a058e52bed331a6f241", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: af446b3d802a42e3bd72b08bace8ea8d May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: {"volumeAttachment": {"volumeId": "63775810-6872-4bc9-9e90-435936e0987e"}} May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: exception: Cannot 'attach_volume' instance 4b76c27e-3a75-40b8-b777-934f969dc6de while it is in vm_state rescued May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'server_id': '4b76c27e-3a75-40b8-b777-934f969dc6de', 'body': {'volumeAttachment': {'volumeId': '63775810-6872-4bc9-9e90-435936e0987e'}}} May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b76c27e-3a75-40b8-b777-934f969dc6de in vm_state rescued. Cannot attach_volume while the instance is in this state. May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 28 21:15:57.556834 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 21:15:57.562165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 21:15:57.562165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:15:57.562165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4b76c27e-3a75-40b8-b777-934f969dc6de while it is in vm_state rescued May 28 21:15:57.562165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:57.562165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:15:57.562165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:57.562165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:15:57.562165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:15:57.562165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:15:57.562165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:15:57.562165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:15:57.562165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4b76c27e-3a75-40b8-b777-934f969dc6de while it is in vm_state rescued May 28 21:15:57.562165 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:15:57.564047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-42848a9f-07ec-473d-93cf-29d0164c66d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Returning 409 to user: Cannot 'attach_volume' instance 4b76c27e-3a75-40b8-b777-934f969dc6de while it is in vm_state rescued {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:15:57.565147 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-42848a9f-07ec-473d-93cf-29d0164c66d4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.068532 May 28 21:15:57.566411 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1761/3484] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:15:57 2022] POST /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de/os-volume_attachments => generated 152 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:15:57.594268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7e301b2c-7ef9-4863-aa46-c04167554a83 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:15:57.595378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7e301b2c-7ef9-4863-aa46-c04167554a83 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:57.611835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e301b2c-7ef9-4863-aa46-c04167554a83 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:57.614124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e301b2c-7ef9-4863-aa46-c04167554a83 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:57.615165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e301b2c-7ef9-4863-aa46-c04167554a83 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:57.618068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e301b2c-7ef9-4863-aa46-c04167554a83 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:57.637604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] validate_networks() for [('ca803b4d-8584-4327-9f76-66ddebb3c209', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:15:57.885936 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7e301b2c-7ef9-4863-aa46-c04167554a83 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de/action" status: 202 len: 0 microversion: 2.1 time: 0.314514 May 28 21:15:57.891422 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1762/3485] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:15:57 2022] POST /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:15:57.898730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f024b7c6-cad4-45e3-9ca6-ab76aa85dded tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:57.899717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f024b7c6-cad4-45e3-9ca6-ab76aa85dded tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:57.908215 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f024b7c6-cad4-45e3-9ca6-ab76aa85dded tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:57.908770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f024b7c6-cad4-45e3-9ca6-ab76aa85dded tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:57.910012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f024b7c6-cad4-45e3-9ca6-ab76aa85dded tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:57.910759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f024b7c6-cad4-45e3-9ca6-ab76aa85dded tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:58.557622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f024b7c6-cad4-45e3-9ca6-ab76aa85dded tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:58.557622 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f024b7c6-cad4-45e3-9ca6-ab76aa85dded tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1509 microversion: 2.1 time: 0.651509 May 28 21:15:58.557622 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1763/3486] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:57 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1509 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:58.564479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5718c24c-1af1-4006-836e-dade411a3581 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69cca3a0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:58.635518 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5718c24c-1af1-4006-836e-dade411a3581 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.087774 May 28 21:15:58.637379 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1764/3487] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:58 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:58.864342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:15:58.864869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:15:58.865385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:15:58.866428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:15:58.867163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:15:58.869227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:15:58.877178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:58.877713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:58.878635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:58.879183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:58.899818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:15:58.920491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for user 572170ccd67e4facbf10dad7cd1491c1 and project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:15:58.939667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:15:58.942302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:15:59.108088 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d329552c-da0a-4eda-a2a9-25d5e783acc1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.571719 May 28 21:15:59.109327 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1724/3488] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:15:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:15:59.121666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb82cfbf-007e-4d0a-b3c4-cb2a44939454 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:59.123975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fb82cfbf-007e-4d0a-b3c4-cb2a44939454 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:59.231466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fb82cfbf-007e-4d0a-b3c4-cb2a44939454 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:59.239493 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb82cfbf-007e-4d0a-b3c4-cb2a44939454 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1209 microversion: 2.1 time: 0.122571 May 28 21:15:59.240890 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1765/3489] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:59 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1209 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:15:59.565449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7dd0676c-7c5a-4a19-b3c3-3fa00e165f05 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:59.566418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7dd0676c-7c5a-4a19-b3c3-3fa00e165f05 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:15:59.574918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7dd0676c-7c5a-4a19-b3c3-3fa00e165f05 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:59.575389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7dd0676c-7c5a-4a19-b3c3-3fa00e165f05 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:59.576174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7dd0676c-7c5a-4a19-b3c3-3fa00e165f05 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:15:59.576628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7dd0676c-7c5a-4a19-b3c3-3fa00e165f05 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:15:59.650081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3f5298f9-0edf-4c72-982c-bd66811f0e17 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69c31280>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:15:59.696378 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3f5298f9-0edf-4c72-982c-bd66811f0e17 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.050389 May 28 21:15:59.696892 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1766/3490] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:15:59 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:15:59.718285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7dd0676c-7c5a-4a19-b3c3-3fa00e165f05 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:15:59.724797 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7dd0676c-7c5a-4a19-b3c3-3fa00e165f05 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1509 microversion: 2.1 time: 0.163401 May 28 21:15:59.725946 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1725/3491] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:15:59 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:00.265173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9e15f70a-7fb3-47d4-9e39-a9db11ed88b2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:00.266412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9e15f70a-7fb3-47d4-9e39-a9db11ed88b2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:00.370837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9e15f70a-7fb3-47d4-9e39-a9db11ed88b2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:00.380341 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9e15f70a-7fb3-47d4-9e39-a9db11ed88b2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1209 microversion: 2.1 time: 0.121978 May 28 21:16:00.390462 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1767/3492] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:00 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1209 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:00.711631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-91a2b72d-e682-4639-98d9-39ef9ad0ad57 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d648469d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:00.746169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-add87b64-c6b6-4ed8-8938-8e109f00944e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:00.747985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-add87b64-c6b6-4ed8-8938-8e109f00944e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:00.784032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-add87b64-c6b6-4ed8-8938-8e109f00944e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:00.786004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-add87b64-c6b6-4ed8-8938-8e109f00944e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:00.788871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-add87b64-c6b6-4ed8-8938-8e109f00944e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:00.791856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-add87b64-c6b6-4ed8-8938-8e109f00944e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:00.859360 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-91a2b72d-e682-4639-98d9-39ef9ad0ad57 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.148211 May 28 21:16:00.860550 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1726/3493] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:16:00 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:01.068237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-add87b64-c6b6-4ed8-8938-8e109f00944e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:01.078488 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-add87b64-c6b6-4ed8-8938-8e109f00944e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1509 microversion: 2.1 time: 0.339168 May 28 21:16:01.081687 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1768/3494] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:00 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1509 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:01.398737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7148e3b9-26cc-4d2f-a40f-d29a8b7bb8c8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:01.399845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7148e3b9-26cc-4d2f-a40f-d29a8b7bb8c8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:01.409053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7148e3b9-26cc-4d2f-a40f-d29a8b7bb8c8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:01.409893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7148e3b9-26cc-4d2f-a40f-d29a8b7bb8c8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:01.411254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7148e3b9-26cc-4d2f-a40f-d29a8b7bb8c8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:01.412167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7148e3b9-26cc-4d2f-a40f-d29a8b7bb8c8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:01.508483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7148e3b9-26cc-4d2f-a40f-d29a8b7bb8c8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:01.526772 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7148e3b9-26cc-4d2f-a40f-d29a8b7bb8c8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1261 microversion: 2.1 time: 0.132417 May 28 21:16:01.527705 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1727/3495] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:01 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1261 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:01.874108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d0827a21-c561-4b89-8669-47936c03c952 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d64116040>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:01.924104 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d0827a21-c561-4b89-8669-47936c03c952 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.055193 May 28 21:16:01.925669 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1769/3496] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:16:01 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:02.103580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f3faee37-f215-4ded-9530-24a85b4ed15b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:02.103580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f3faee37-f215-4ded-9530-24a85b4ed15b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:02.112539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3faee37-f215-4ded-9530-24a85b4ed15b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:02.119075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3faee37-f215-4ded-9530-24a85b4ed15b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:02.126403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3faee37-f215-4ded-9530-24a85b4ed15b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:02.126403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3faee37-f215-4ded-9530-24a85b4ed15b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:02.466259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f3faee37-f215-4ded-9530-24a85b4ed15b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:02.474292 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f3faee37-f215-4ded-9530-24a85b4ed15b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1515 microversion: 2.1 time: 0.379957 May 28 21:16:02.494560 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1728/3497] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:02 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1515 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:02.545220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-729bd973-c68e-42d2-997b-f64662319a10 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:02.545989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-729bd973-c68e-42d2-997b-f64662319a10 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:02.572287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-729bd973-c68e-42d2-997b-f64662319a10 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:02.576081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-729bd973-c68e-42d2-997b-f64662319a10 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:02.578743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-729bd973-c68e-42d2-997b-f64662319a10 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:02.579216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-729bd973-c68e-42d2-997b-f64662319a10 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:02.672165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-729bd973-c68e-42d2-997b-f64662319a10 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:02.688952 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-729bd973-c68e-42d2-997b-f64662319a10 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1267 microversion: 2.1 time: 0.148473 May 28 21:16:02.689870 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1770/3498] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:02 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:02.941829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6de05c8b-cbac-455d-9fe6-9f2cb442de16 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69ca19d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:02.998317 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6de05c8b-cbac-455d-9fe6-9f2cb442de16 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.062776 May 28 21:16:03.004671 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1729/3499] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:16:02 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:03.710626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-12630552-51d2-4c90-93f3-48122e5f2d7b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:03.711548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-12630552-51d2-4c90-93f3-48122e5f2d7b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:03.725627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12630552-51d2-4c90-93f3-48122e5f2d7b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:03.726453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12630552-51d2-4c90-93f3-48122e5f2d7b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:03.727631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12630552-51d2-4c90-93f3-48122e5f2d7b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:03.728407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12630552-51d2-4c90-93f3-48122e5f2d7b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:03.734395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:03.873667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-12630552-51d2-4c90-93f3-48122e5f2d7b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:03.882765 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-12630552-51d2-4c90-93f3-48122e5f2d7b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1309 microversion: 2.1 time: 0.177527 May 28 21:16:03.883051 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1771/3500] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:03 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1309 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:04.012862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-592608ab-22bd-4258-a23c-be0b7a372aab tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57a36ee0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:04.060558 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-592608ab-22bd-4258-a23c-be0b7a372aab tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.052619 May 28 21:16:04.061143 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1730/3501] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:16:04 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:04.903488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e7d9d8e6-dbff-4254-ada7-c60fcb65f013 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:04.904809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e7d9d8e6-dbff-4254-ada7-c60fcb65f013 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:04.931314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7d9d8e6-dbff-4254-ada7-c60fcb65f013 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:04.932474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7d9d8e6-dbff-4254-ada7-c60fcb65f013 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:04.936628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7d9d8e6-dbff-4254-ada7-c60fcb65f013 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:04.936628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7d9d8e6-dbff-4254-ada7-c60fcb65f013 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:05.077009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e324d146-34ab-4aca-95e1-22409ecaf4e9 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69cb2790>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:05.157793 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e324d146-34ab-4aca-95e1-22409ecaf4e9 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.086379 May 28 21:16:05.159995 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1731/3502] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:16:05 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:05.228295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e7d9d8e6-dbff-4254-ada7-c60fcb65f013 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:05.244672 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e7d9d8e6-dbff-4254-ada7-c60fcb65f013 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1309 microversion: 2.1 time: 0.348835 May 28 21:16:05.247047 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1772/3503] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:04 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1309 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:05.312859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-8ce89935-0cc1-410e-a38e-1289ac5eddfa req-ec315f39-c05e-4ce5-b94b-bcafd670deb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49282ea3-fb61-4ec6-9443-a2fa47fdddc1", "tag": "ad77cbe5-0049-4032-9613-f3e21596fbf9"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:05.367032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8ce89935-0cc1-410e-a38e-1289ac5eddfa req-ec315f39-c05e-4ce5-b94b-bcafd670deb1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:05.367758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8ce89935-0cc1-410e-a38e-1289ac5eddfa req-ec315f39-c05e-4ce5-b94b-bcafd670deb1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:05.387295 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-8ce89935-0cc1-410e-a38e-1289ac5eddfa req-ec315f39-c05e-4ce5-b94b-bcafd670deb1 service nova] Creating event network-changed:ad77cbe5-0049-4032-9613-f3e21596fbf9 for instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 on nch2-master-1 May 28 21:16:05.394051 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-8ce89935-0cc1-410e-a38e-1289ac5eddfa req-ec315f39-c05e-4ce5-b94b-bcafd670deb1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087491 May 28 21:16:05.395121 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1732/3504] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:05.471036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f4091900-cd15-4064-b320-c1cfb0b3ca2f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'create', calling method: .version_select at 0x7f4d6466f8b0>, body: {"keypair": {"name": "tempest-keypair-805344502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8euYLUsGxATY2C9+q0g0RGyMSnRyMW9zqat6qRVQN8VoCyDDaquRQpQjLzqBKjUakSE8wedZ+rtvCh3WmAWiKdIgyiG/X9cTdeE3KVMR1qMmodwAsg76jw08IEAwqIQg=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:05.502811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-f4091900-cd15-4064-b320-c1cfb0b3ca2f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Getting quotas for project 53b9cfacdbb74a058e52bed331a6f241. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:16:05.510780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-f4091900-cd15-4064-b320-c1cfb0b3ca2f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Getting quotas for user af446b3d802a42e3bd72b08bace8ea8d and project 53b9cfacdbb74a058e52bed331a6f241. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:16:05.660934 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f4091900-cd15-4064-b320-c1cfb0b3ca2f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.194159 May 28 21:16:05.671627 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1773/3505] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:16:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:06.176672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ebca58bd-b01a-4160-99af-a40ab43a34cc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d64aba9d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:06.268068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-754556f1-689b-4602-95e7-2e6bc3659092 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:06.269338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-754556f1-689b-4602-95e7-2e6bc3659092 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:06.279940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-754556f1-689b-4602-95e7-2e6bc3659092 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:06.281047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-754556f1-689b-4602-95e7-2e6bc3659092 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:06.286588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-754556f1-689b-4602-95e7-2e6bc3659092 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:06.287333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-754556f1-689b-4602-95e7-2e6bc3659092 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:06.292422 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ebca58bd-b01a-4160-99af-a40ab43a34cc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.117567 May 28 21:16:06.292422 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1733/3506] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:16:06 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:06.619828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-754556f1-689b-4602-95e7-2e6bc3659092 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:06.629059 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-754556f1-689b-4602-95e7-2e6bc3659092 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1309 microversion: 2.1 time: 0.365536 May 28 21:16:06.642844 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1774/3507] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:06 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1309 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:07.305578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-79e764eb-47bd-4eb7-9e51-c687fee7a16e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d6455da60>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:07.378921 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-79e764eb-47bd-4eb7-9e51-c687fee7a16e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.078545 May 28 21:16:07.387223 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1734/3508] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:16:07 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:07.650200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-37c767af-50e8-4e61-b92c-379ada285027 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:07.654292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-37c767af-50e8-4e61-b92c-379ada285027 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:07.665434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37c767af-50e8-4e61-b92c-379ada285027 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:07.666204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37c767af-50e8-4e61-b92c-379ada285027 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:07.667832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37c767af-50e8-4e61-b92c-379ada285027 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:07.669481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37c767af-50e8-4e61-b92c-379ada285027 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:07.991238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-37c767af-50e8-4e61-b92c-379ada285027 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:07.999116 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-37c767af-50e8-4e61-b92c-379ada285027 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1309 microversion: 2.1 time: 0.352793 May 28 21:16:08.003804 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1775/3509] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:07 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1309 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:08.395412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-178b2761-d284-4db1-94df-5def8e69e7bf tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69cb2550>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:08.469138 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-178b2761-d284-4db1-94df-5def8e69e7bf tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.078800 May 28 21:16:08.472583 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1735/3510] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:16:08 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:09.027159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c561e557-892b-4b95-9839-a17ebffada49 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:09.027797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c561e557-892b-4b95-9839-a17ebffada49 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:09.035418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c561e557-892b-4b95-9839-a17ebffada49 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:09.035909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c561e557-892b-4b95-9839-a17ebffada49 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:09.036695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c561e557-892b-4b95-9839-a17ebffada49 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:09.037157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c561e557-892b-4b95-9839-a17ebffada49 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:09.184241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c561e557-892b-4b95-9839-a17ebffada49 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:09.191728 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c561e557-892b-4b95-9839-a17ebffada49 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1309 microversion: 2.1 time: 0.168674 May 28 21:16:09.192297 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1776/3511] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:09 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1309 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:09.485091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:09.485830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:09.491327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8d00f3f3-01d7-41a3-af5b-8ddd220d13a8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69c7bca0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:09.537220 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8d00f3f3-01d7-41a3-af5b-8ddd220d13a8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.052902 May 28 21:16:09.538510 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1736/3512] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:16:09 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:09.661991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-625143395", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1d8fb7bc-f468-443c-8ba9-f4cae3a20512"}], "security_groups": [{"name": "tempest-securitygroup--2024803117"}], "key_name": "tempest-keypair-805344502", "user_data": "}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:09.826530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-91c8b0b4-2dc0-4c50-a871-4d7e85d48061 tempest-PortsAdminExtendedAttrsTestJSON-1387487662 tempest-PortsAdminExtendedAttrsTestJSON-1387487662-project-admin] Calling method '.version_select at 0x7f4d64043310>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:09.828041 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:16:09.828041 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:16:09.829806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91c8b0b4-2dc0-4c50-a871-4d7e85d48061 tempest-PortsAdminExtendedAttrsTestJSON-1387487662 tempest-PortsAdminExtendedAttrsTestJSON-1387487662-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:09.830422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91c8b0b4-2dc0-4c50-a871-4d7e85d48061 tempest-PortsAdminExtendedAttrsTestJSON-1387487662 tempest-PortsAdminExtendedAttrsTestJSON-1387487662-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:09.841994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] validate_networks() for [('1d8fb7bc-f468-443c-8ba9-f4cae3a20512', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:16:09.860863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91c8b0b4-2dc0-4c50-a871-4d7e85d48061 tempest-PortsAdminExtendedAttrsTestJSON-1387487662 tempest-PortsAdminExtendedAttrsTestJSON-1387487662-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:09.861537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91c8b0b4-2dc0-4c50-a871-4d7e85d48061 tempest-PortsAdminExtendedAttrsTestJSON-1387487662 tempest-PortsAdminExtendedAttrsTestJSON-1387487662-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:09.882729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91c8b0b4-2dc0-4c50-a871-4d7e85d48061 tempest-PortsAdminExtendedAttrsTestJSON-1387487662 tempest-PortsAdminExtendedAttrsTestJSON-1387487662-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:09.883566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91c8b0b4-2dc0-4c50-a871-4d7e85d48061 tempest-PortsAdminExtendedAttrsTestJSON-1387487662 tempest-PortsAdminExtendedAttrsTestJSON-1387487662-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:09.893206 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-91c8b0b4-2dc0-4c50-a871-4d7e85d48061 tempest-PortsAdminExtendedAttrsTestJSON-1387487662 tempest-PortsAdminExtendedAttrsTestJSON-1387487662-project-admin] 10.222.0.33 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.323947 May 28 21:16:09.894636 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1777/3513] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:16:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:10.212702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-853e9ded-edb2-4455-aa9f-b265cbd78aa3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:10.213409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-853e9ded-edb2-4455-aa9f-b265cbd78aa3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:10.221230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-853e9ded-edb2-4455-aa9f-b265cbd78aa3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:10.222671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-853e9ded-edb2-4455-aa9f-b265cbd78aa3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:10.223702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-853e9ded-edb2-4455-aa9f-b265cbd78aa3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:10.224349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-853e9ded-edb2-4455-aa9f-b265cbd78aa3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:10.472443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-853e9ded-edb2-4455-aa9f-b265cbd78aa3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:10.481626 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-853e9ded-edb2-4455-aa9f-b265cbd78aa3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1309 microversion: 2.1 time: 0.272835 May 28 21:16:10.485117 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1778/3514] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:10 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1309 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:10.551624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-abde0926-a2c3-4afb-8d88-c976f4f228e8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d64043af0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:10.626675 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-abde0926-a2c3-4afb-8d88-c976f4f228e8 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1452 microversion: 2.1 time: 0.079304 May 28 21:16:10.633752 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1779/3515] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:16:10 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:10.833283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:16:10.833798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:16:10.834233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:16:10.834651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:16:10.835078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:16:10.855102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:10.861467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:10.862610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:10.866611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:10.898251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Getting quotas for project 53b9cfacdbb74a058e52bed331a6f241. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:16:10.904541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Getting quotas for user af446b3d802a42e3bd72b08bace8ea8d and project 53b9cfacdbb74a058e52bed331a6f241. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:16:10.919937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:16:10.922438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:16:11.205112 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a10f20ba-c50e-4778-8da3-748be6c85977 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.547513 May 28 21:16:11.210768 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1737/3516] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:16:09 2022] POST /compute/v2.1/servers => generated 409 bytes in 1550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:16:11.218335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc6c627d-eb3f-469c-89dc-496e9273ee1c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:11.219350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc6c627d-eb3f-469c-89dc-496e9273ee1c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:11.349828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc6c627d-eb3f-469c-89dc-496e9273ee1c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:11.356805 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc6c627d-eb3f-469c-89dc-496e9273ee1c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1244 microversion: 2.1 time: 0.144445 May 28 21:16:11.359927 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1780/3517] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:11 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1244 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:11.520956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d9045184-88ef-4e9f-8483-2a4ee14d412c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:11.526893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d9045184-88ef-4e9f-8483-2a4ee14d412c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:11.539152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9045184-88ef-4e9f-8483-2a4ee14d412c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:11.539801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9045184-88ef-4e9f-8483-2a4ee14d412c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:11.541016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9045184-88ef-4e9f-8483-2a4ee14d412c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:11.541518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9045184-88ef-4e9f-8483-2a4ee14d412c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:11.644921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b65a80f1-15c0-401a-8119-7300d02098fa tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69c19820>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:11.741287 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b65a80f1-15c0-401a-8119-7300d02098fa tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1461 microversion: 2.1 time: 0.102529 May 28 21:16:11.749157 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1781/3518] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:16:11 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1461 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:11.757959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-769b62d2-0883-4a28-9525-4f1925ae9a0b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69c2dca0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:11.854509 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-769b62d2-0883-4a28-9525-4f1925ae9a0b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 200 len: 1461 microversion: 2.1 time: 0.102976 May 28 21:16:11.858935 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1782/3519] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:16:11 2022] GET /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 1461 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:11.871862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0605bbcc-1d38-4c73-a8cd-096bda8aecda tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:11.872570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0605bbcc-1d38-4c73-a8cd-096bda8aecda tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 144ab366-0448-410f-9093-91dec09b838c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:11.880854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0605bbcc-1d38-4c73-a8cd-096bda8aecda tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:11.882010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0605bbcc-1d38-4c73-a8cd-096bda8aecda tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:11.882873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0605bbcc-1d38-4c73-a8cd-096bda8aecda tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:11.883390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0605bbcc-1d38-4c73-a8cd-096bda8aecda tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:11.944753 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d9045184-88ef-4e9f-8483-2a4ee14d412c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:11.964438 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d9045184-88ef-4e9f-8483-2a4ee14d412c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1309 microversion: 2.1 time: 0.457209 May 28 21:16:11.964438 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1738/3520] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:11 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1309 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:12.374887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0d190396-19ca-4935-9aa0-d189c8a5f332 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:12.376630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0d190396-19ca-4935-9aa0-d189c8a5f332 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:12.448399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0605bbcc-1d38-4c73-a8cd-096bda8aecda tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:12.460159 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0605bbcc-1d38-4c73-a8cd-096bda8aecda tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c" status: 200 len: 1480 microversion: 2.1 time: 0.592124 May 28 21:16:12.461594 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1783/3521] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:11 2022] GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c => generated 1480 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:12.515162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0d190396-19ca-4935-9aa0-d189c8a5f332 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:12.529189 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0d190396-19ca-4935-9aa0-d189c8a5f332 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1244 microversion: 2.1 time: 0.156567 May 28 21:16:12.530705 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1739/3522] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:12 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1244 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:12.972500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bde560f4-682a-451c-bcd3-5fd57395bd55 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:12.981560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bde560f4-682a-451c-bcd3-5fd57395bd55 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:13.007416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bde560f4-682a-451c-bcd3-5fd57395bd55 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:13.008641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bde560f4-682a-451c-bcd3-5fd57395bd55 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:13.010621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bde560f4-682a-451c-bcd3-5fd57395bd55 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:13.011473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bde560f4-682a-451c-bcd3-5fd57395bd55 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:13.088438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-ba045c77-91c8-4343-aa7f-ac14a0ea0614 req-32a2eeda-029d-4692-b24c-c4ea41881d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49282ea3-fb61-4ec6-9443-a2fa47fdddc1", "name": "network-vif-plugged", "status": "completed", "tag": "ad77cbe5-0049-4032-9613-f3e21596fbf9"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:13.116288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ba045c77-91c8-4343-aa7f-ac14a0ea0614 req-32a2eeda-029d-4692-b24c-c4ea41881d96 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:13.118521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ba045c77-91c8-4343-aa7f-ac14a0ea0614 req-32a2eeda-029d-4692-b24c-c4ea41881d96 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:13.157149 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-ba045c77-91c8-4343-aa7f-ac14a0ea0614 req-32a2eeda-029d-4692-b24c-c4ea41881d96 service nova] Creating event network-vif-plugged:ad77cbe5-0049-4032-9613-f3e21596fbf9 for instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 on nch2-master-1 May 28 21:16:13.167304 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-ba045c77-91c8-4343-aa7f-ac14a0ea0614 req-32a2eeda-029d-4692-b24c-c4ea41881d96 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083926 May 28 21:16:13.176702 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1740/3523] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:16:13.382832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bde560f4-682a-451c-bcd3-5fd57395bd55 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:13.398261 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bde560f4-682a-451c-bcd3-5fd57395bd55 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1309 microversion: 2.1 time: 0.424857 May 28 21:16:13.399618 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1784/3524] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:12 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1309 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:13.478971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-be142b9e-eacd-4c0c-a966-bb3fca5cb008 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:13.480991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-be142b9e-eacd-4c0c-a966-bb3fca5cb008 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 144ab366-0448-410f-9093-91dec09b838c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:13.489603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-be142b9e-eacd-4c0c-a966-bb3fca5cb008 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:13.490353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-be142b9e-eacd-4c0c-a966-bb3fca5cb008 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:13.491159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-be142b9e-eacd-4c0c-a966-bb3fca5cb008 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:13.491677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-be142b9e-eacd-4c0c-a966-bb3fca5cb008 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:13.550961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-385e9dfb-7481-4823-9234-9a238393a5b3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:13.550961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-385e9dfb-7481-4823-9234-9a238393a5b3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:13.558310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-385e9dfb-7481-4823-9234-9a238393a5b3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:13.558861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-385e9dfb-7481-4823-9234-9a238393a5b3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:13.559743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-385e9dfb-7481-4823-9234-9a238393a5b3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:13.560328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-385e9dfb-7481-4823-9234-9a238393a5b3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:13.734980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-385e9dfb-7481-4823-9234-9a238393a5b3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:13.743831 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-385e9dfb-7481-4823-9234-9a238393a5b3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1296 microversion: 2.1 time: 0.199728 May 28 21:16:13.745667 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1785/3525] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:13 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1296 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:13.785209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-be142b9e-eacd-4c0c-a966-bb3fca5cb008 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:13.805475 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-be142b9e-eacd-4c0c-a966-bb3fca5cb008 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c" status: 200 len: 1467 microversion: 2.1 time: 0.330975 May 28 21:16:13.806397 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1741/3526] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:13 2022] GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c => generated 1467 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:13.824748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1a539d1f-f7eb-4932-aa00-5dfce5152ef3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69cca5e0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:13.946151 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1a539d1f-f7eb-4932-aa00-5dfce5152ef3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images?changes-since=2022-05-28T21%3A14%3A45Z" status: 200 len: 1902 microversion: 2.1 time: 0.126910 May 28 21:16:13.947250 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1786/3527] 10.222.0.33 () {58 vars in 1198 bytes} [Sat May 28 21:16:13 2022] GET /compute/v2.1/images?changes-since=2022-05-28T21%3A14%3A45Z => generated 1902 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:13.960929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-58225f57-88bf-4832-b245-9bcba0be14dc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69c9b0d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:14.062220 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-58225f57-88bf-4832-b245-9bcba0be14dc tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1179470622" status: 200 len: 485 microversion: 2.1 time: 0.105626 May 28 21:16:14.063824 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1742/3528] 10.222.0.33 () {58 vars in 1230 bytes} [Sat May 28 21:16:13 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1179470622 => generated 485 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:14.076284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1109f9c6-cd90-4137-b3ff-59ad37ec2f0a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69c190d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:14.222180 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1109f9c6-cd90-4137-b3ff-59ad37ec2f0a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images?server=144ab366-0448-410f-9093-91dec09b838c" status: 200 len: 957 microversion: 2.1 time: 0.147931 May 28 21:16:14.223580 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1787/3529] 10.222.0.33 () {58 vars in 1208 bytes} [Sat May 28 21:16:14 2022] GET /compute/v2.1/images?server=144ab366-0448-410f-9093-91dec09b838c => generated 957 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:14.239150 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-07f37645-c8ea-4a49-b982-12e6d87d7ddd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d642983a0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:14.335035 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-07f37645-c8ea-4a49-b982-12e6d87d7ddd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 485 microversion: 2.1 time: 0.100892 May 28 21:16:14.340370 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1743/3530] 10.222.0.33 () {58 vars in 1316 bytes} [Sat May 28 21:16:14 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 485 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:14.344972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-67883e56-d265-48e5-bbfd-8d34b71b4420 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69cca5e0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:14.410850 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-67883e56-d265-48e5-bbfd-8d34b71b4420 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 485 microversion: 2.1 time: 0.069622 May 28 21:16:14.411779 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1788/3531] 10.222.0.33 () {58 vars in 1302 bytes} [Sat May 28 21:16:14 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 485 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:14.426511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-85bc3a6c-68c9-4df0-8c71-bb7ca92cabdb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:14.426511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-85bc3a6c-68c9-4df0-8c71-bb7ca92cabdb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:14.426699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a16f4143-c11a-4ccf-afc4-4fe93f4a0f5c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69c23310>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:14.436658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85bc3a6c-68c9-4df0-8c71-bb7ca92cabdb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:14.437480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85bc3a6c-68c9-4df0-8c71-bb7ca92cabdb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:14.438549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85bc3a6c-68c9-4df0-8c71-bb7ca92cabdb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:14.440743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85bc3a6c-68c9-4df0-8c71-bb7ca92cabdb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:14.581430 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a16f4143-c11a-4ccf-afc4-4fe93f4a0f5c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.160957 May 28 21:16:14.586554 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1789/3532] 10.222.0.33 () {58 vars in 1148 bytes} [Sat May 28 21:16:14 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:14.595854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2c82b70b-f15c-452c-809d-bd54506a31a6 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57e8e160>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:14.694929 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2c82b70b-f15c-452c-809d-bd54506a31a6 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.102852 May 28 21:16:14.696203 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1790/3533] 10.222.0.33 () {58 vars in 1148 bytes} [Sat May 28 21:16:14 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:14.711285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e14b2375-497b-4d31-b41f-b927123bf71b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d6422c0d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:14.800293 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e14b2375-497b-4d31-b41f-b927123bf71b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.093403 May 28 21:16:14.802463 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1791/3534] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:16:14 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:16:14.808076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-68931cec-82a6-491d-97be-5cab3fb8e5f3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:14.809573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-68931cec-82a6-491d-97be-5cab3fb8e5f3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:14.830881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68931cec-82a6-491d-97be-5cab3fb8e5f3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:14.831810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68931cec-82a6-491d-97be-5cab3fb8e5f3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:14.832859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68931cec-82a6-491d-97be-5cab3fb8e5f3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:14.833547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68931cec-82a6-491d-97be-5cab3fb8e5f3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:14.877811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-85bc3a6c-68c9-4df0-8c71-bb7ca92cabdb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:14.891585 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-85bc3a6c-68c9-4df0-8c71-bb7ca92cabdb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1309 microversion: 2.1 time: 0.479307 May 28 21:16:14.892731 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1744/3535] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:14 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1309 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:14.898024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-267ed432-c9c6-4acb-8987-c9951305131c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d579f1430>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:14.936327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-68931cec-82a6-491d-97be-5cab3fb8e5f3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:14.979689 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-68931cec-82a6-491d-97be-5cab3fb8e5f3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1302 microversion: 2.1 time: 0.175020 May 28 21:16:14.982095 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1792/3536] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:14 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1302 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:15.116176 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 21:16:15.116387 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 21:16:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/detail?changes-since=2022-05-28T21%3A14%3A40Z (ip 10.222.0.33) !!! May 28 21:16:15.154556 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-267ed432-c9c6-4acb-8987-c9951305131c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/detail?changes-since=2022-05-28T21%3A14%3A40Z" status: 200 len: 6328 microversion: 2.1 time: 0.260503 May 28 21:16:15.167660 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1745/3537] 10.222.0.33 () {58 vars in 1219 bytes} [Sat May 28 21:16:14 2022] GET /compute/v2.1/images/detail?changes-since=2022-05-28T21%3A14%3A40Z => generated 6328 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:15.173945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7b890a8e-d191-4c7e-b3ef-c26f0937ecfe tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d646f03a0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:15.258109 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7b890a8e-d191-4c7e-b3ef-c26f0937ecfe tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1179470622" status: 200 len: 665 microversion: 2.1 time: 0.091081 May 28 21:16:15.259029 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1793/3538] 10.222.0.33 () {58 vars in 1251 bytes} [Sat May 28 21:16:15 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1179470622 => generated 665 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:16:15.274418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dc4d193a-78b8-4c26-842b-0c4bbd7719f4 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d6469c310>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:15.340532 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dc4d193a-78b8-4c26-842b-0c4bbd7719f4 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1465 microversion: 2.1 time: 0.071214 May 28 21:16:15.349407 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1746/3539] 10.222.0.33 () {58 vars in 1337 bytes} [Sat May 28 21:16:15 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fv2.1%2Fservers%2F58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1465 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:15.355452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-26e75ef0-cd0b-4c49-a356-3e38d67f7f69 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d5727f820>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:15.443724 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-26e75ef0-cd0b-4c49-a356-3e38d67f7f69 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1465 microversion: 2.1 time: 0.093188 May 28 21:16:15.449152 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1794/3540] 10.222.0.33 () {58 vars in 1323 bytes} [Sat May 28 21:16:15 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.33%2Fcompute%2Fservers%2F58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1465 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:15.464064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f3ba767a-95ef-4020-9e84-00fa854c5140 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69cb2040>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:15.562284 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f3ba767a-95ef-4020-9e84-00fa854c5140 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7103 microversion: 2.1 time: 0.102102 May 28 21:16:15.563293 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1747/3541] 10.222.0.33 () {58 vars in 1169 bytes} [Sat May 28 21:16:15 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7103 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:15.579377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9654cf98-2555-40eb-a3a0-eeaafc97dfed tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d5784c9d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:15.656232 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9654cf98-2555-40eb-a3a0-eeaafc97dfed tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.080770 May 28 21:16:15.657486 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1795/3542] 10.222.0.33 () {58 vars in 1169 bytes} [Sat May 28 21:16:15 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:15.671516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2244e23e-0cce-41d3-be05-802690a628ae tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69cb2e50>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:15.716518 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2244e23e-0cce-41d3-be05-802690a628ae tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/9586d0d3-c540-4636-bb36-06bb4b16c195" status: 200 len: 784 microversion: 2.1 time: 0.048856 May 28 21:16:15.717108 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1748/3543] 10.222.0.33 () {58 vars in 1232 bytes} [Sat May 28 21:16:15 2022] GET /compute/v2.1/images/9586d0d3-c540-4636-bb36-06bb4b16c195 => generated 784 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:15.730039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f6407f4f-ffd9-4be3-ad14-4907739622d1 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69ccaca0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:15.782475 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f6407f4f-ffd9-4be3-ad14-4907739622d1 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.055587 May 28 21:16:15.783068 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1796/3544] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:16:15 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:15.797326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd9ff020-e041-47f9-9986-ddc8b8f69f9c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d579f1af0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:15.913099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5dddef03-ac8e-45b2-af0e-ca9a9418a2c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:15.921535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5dddef03-ac8e-45b2-af0e-ca9a9418a2c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:15.930003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5dddef03-ac8e-45b2-af0e-ca9a9418a2c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:15.930665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5dddef03-ac8e-45b2-af0e-ca9a9418a2c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:15.931859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5dddef03-ac8e-45b2-af0e-ca9a9418a2c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:15.932485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5dddef03-ac8e-45b2-af0e-ca9a9418a2c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:16.356283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5dddef03-ac8e-45b2-af0e-ca9a9418a2c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:16.364447 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5dddef03-ac8e-45b2-af0e-ca9a9418a2c1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1490 microversion: 2.1 time: 0.459631 May 28 21:16:16.365037 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1797/3545] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:15 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1490 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:16.383438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3b0ffcf8-984a-4bc3-9485-13b260e8a086 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:16.383438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3b0ffcf8-984a-4bc3-9485-13b260e8a086 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:16.389264 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b0ffcf8-984a-4bc3-9485-13b260e8a086 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:16.389982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b0ffcf8-984a-4bc3-9485-13b260e8a086 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:16.390576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b0ffcf8-984a-4bc3-9485-13b260e8a086 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:16.391032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b0ffcf8-984a-4bc3-9485-13b260e8a086 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:16.709713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3b0ffcf8-984a-4bc3-9485-13b260e8a086 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:16.727858 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3b0ffcf8-984a-4bc3-9485-13b260e8a086 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1370 microversion: 2.1 time: 0.351174 May 28 21:16:16.728947 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1798/3546] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:16 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1370 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:16.738863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-81eec8b3-ee43-4315-85e6-9ee86d024f8b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:16.741576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-81eec8b3-ee43-4315-85e6-9ee86d024f8b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:16.759296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81eec8b3-ee43-4315-85e6-9ee86d024f8b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:16.761741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81eec8b3-ee43-4315-85e6-9ee86d024f8b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:16.761741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81eec8b3-ee43-4315-85e6-9ee86d024f8b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:16.761741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81eec8b3-ee43-4315-85e6-9ee86d024f8b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:16.987842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-81eec8b3-ee43-4315-85e6-9ee86d024f8b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:17.002315 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-81eec8b3-ee43-4315-85e6-9ee86d024f8b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1491 microversion: 2.1 time: 0.271415 May 28 21:16:17.003974 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1799/3547] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:16 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1491 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:17.011174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-f36f0c0f-9882-4a62-8b75-1ceb04f8f1b7 req-c70460ed-25d7-4bdd-8070-31269727137b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144ab366-0448-410f-9093-91dec09b838c", "name": "network-vif-unplugged", "status": "completed", "tag": "cfbdc8df-e8d0-4012-b243-cfb3e0d4ff83"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:17.020037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f36f0c0f-9882-4a62-8b75-1ceb04f8f1b7 req-c70460ed-25d7-4bdd-8070-31269727137b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:17.020842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f36f0c0f-9882-4a62-8b75-1ceb04f8f1b7 req-c70460ed-25d7-4bdd-8070-31269727137b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:17.034180 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-f36f0c0f-9882-4a62-8b75-1ceb04f8f1b7 req-c70460ed-25d7-4bdd-8070-31269727137b service nova] Creating event network-vif-unplugged:cfbdc8df-e8d0-4012-b243-cfb3e0d4ff83 for instance 144ab366-0448-410f-9093-91dec09b838c on nch2-master-1 May 28 21:16:17.041222 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-f36f0c0f-9882-4a62-8b75-1ceb04f8f1b7 req-c70460ed-25d7-4bdd-8070-31269727137b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035646 May 28 21:16:17.042174 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1800/3548] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:17.048471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5b638a95-739d-41a3-881c-2527a83b96fe tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:17.049195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5b638a95-739d-41a3-881c-2527a83b96fe tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:17.057402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b638a95-739d-41a3-881c-2527a83b96fe tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:17.058187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b638a95-739d-41a3-881c-2527a83b96fe tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:17.059133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b638a95-739d-41a3-881c-2527a83b96fe tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:17.059695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b638a95-739d-41a3-881c-2527a83b96fe tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:17.567853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5b638a95-739d-41a3-881c-2527a83b96fe tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:17.578409 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5b638a95-739d-41a3-881c-2527a83b96fe tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1490 microversion: 2.1 time: 0.534783 May 28 21:16:17.579006 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1801/3549] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:17 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1490 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:17.598065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-648d2f3f-f023-4c82-9694-b322d71c3cb0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:17.598576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-648d2f3f-f023-4c82-9694-b322d71c3cb0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:17.606140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-648d2f3f-f023-4c82-9694-b322d71c3cb0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:17.606613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-648d2f3f-f023-4c82-9694-b322d71c3cb0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:17.607408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-648d2f3f-f023-4c82-9694-b322d71c3cb0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:17.608308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-648d2f3f-f023-4c82-9694-b322d71c3cb0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:17.639799 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bd9ff020-e041-47f9-9986-ddc8b8f69f9c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "DELETE /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a" status: 204 len: 0 microversion: 2.1 time: 1.846353 May 28 21:16:17.640341 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1749/3550] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:15 2022] DELETE /compute/v2.1/images/26a32bce-aad3-47d4-9afc-a999428ce20a => generated 0 bytes in 1848 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:16:17.648712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-21f10386-96c1-460e-9e3a-4f409802f949 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d6455dd30>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:17.665170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-648d2f3f-f023-4c82-9694-b322d71c3cb0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:16:17.715669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:18.071812 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-648d2f3f-f023-4c82-9694-b322d71c3cb0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 204 len: 0 microversion: 2.1 time: 0.477381 May 28 21:16:18.073404 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1802/3551] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:16:17 2022] DELETE /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:16:18.079749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d13862c2-2b1d-4b44-8416-6de8723406d2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:18.080897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d13862c2-2b1d-4b44-8416-6de8723406d2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:18.092317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d13862c2-2b1d-4b44-8416-6de8723406d2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:18.092777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d13862c2-2b1d-4b44-8416-6de8723406d2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:18.093582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d13862c2-2b1d-4b44-8416-6de8723406d2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:18.102396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d13862c2-2b1d-4b44-8416-6de8723406d2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:18.493351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d13862c2-2b1d-4b44-8416-6de8723406d2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:18.507013 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d13862c2-2b1d-4b44-8416-6de8723406d2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1370 microversion: 2.1 time: 0.431672 May 28 21:16:18.507888 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1803/3552] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:18 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1370 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:18.512756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-6d3ec45e-4b75-4438-acff-31fd8c20355d req-8fa45eed-4fef-406a-a5ce-8628d6a83958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ee8dd9-d59f-422a-a29d-2732e2573958", "tag": "011cb162-2172-4519-8fcc-9bf7016b04a4"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:18.524686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6d3ec45e-4b75-4438-acff-31fd8c20355d req-8fa45eed-4fef-406a-a5ce-8628d6a83958 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:18.525460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6d3ec45e-4b75-4438-acff-31fd8c20355d req-8fa45eed-4fef-406a-a5ce-8628d6a83958 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:18.542761 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-6d3ec45e-4b75-4438-acff-31fd8c20355d req-8fa45eed-4fef-406a-a5ce-8628d6a83958 service nova] Creating event network-changed:011cb162-2172-4519-8fcc-9bf7016b04a4 for instance 43ee8dd9-d59f-422a-a29d-2732e2573958 on nch1-master-1 May 28 21:16:18.549681 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-6d3ec45e-4b75-4438-acff-31fd8c20355d req-8fa45eed-4fef-406a-a5ce-8628d6a83958 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040264 May 28 21:16:18.550908 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1804/3553] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:18.557220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-86955e9a-fed9-416e-b54b-94bb7353bd72 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:18.558185 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-86955e9a-fed9-416e-b54b-94bb7353bd72 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:18.565727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-86955e9a-fed9-416e-b54b-94bb7353bd72 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:18.568335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-86955e9a-fed9-416e-b54b-94bb7353bd72 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:18.568335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-86955e9a-fed9-416e-b54b-94bb7353bd72 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:18.568335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-86955e9a-fed9-416e-b54b-94bb7353bd72 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:18.896043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-86955e9a-fed9-416e-b54b-94bb7353bd72 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:18.910454 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-86955e9a-fed9-416e-b54b-94bb7353bd72 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1496 microversion: 2.1 time: 0.357916 May 28 21:16:18.912822 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1805/3554] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:18 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1496 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:19.410996 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-21f10386-96c1-460e-9e3a-4f409802f949 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "DELETE /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65" status: 204 len: 0 microversion: 2.1 time: 1.766495 May 28 21:16:19.411619 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1750/3555] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:17 2022] DELETE /compute/v2.1/images/395b9200-af94-412c-853f-d559647a9c65 => generated 0 bytes in 1768 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:16:19.420240 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0ac126b5-3583-42c8-9131-f59c0c6ab6ad tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69cbfc10>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:19.525569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9cf257d4-3c58-43d0-8e95-3c2373917ec7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:19.526378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9cf257d4-3c58-43d0-8e95-3c2373917ec7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:19.534025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cf257d4-3c58-43d0-8e95-3c2373917ec7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:19.537769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cf257d4-3c58-43d0-8e95-3c2373917ec7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:19.537769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cf257d4-3c58-43d0-8e95-3c2373917ec7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:19.537769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cf257d4-3c58-43d0-8e95-3c2373917ec7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:19.937554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9cf257d4-3c58-43d0-8e95-3c2373917ec7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:19.950987 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9cf257d4-3c58-43d0-8e95-3c2373917ec7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1370 microversion: 2.1 time: 0.430189 May 28 21:16:19.953580 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1751/3556] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:19 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1370 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:19.959451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6e1ff0f4-5afa-47e0-97d6-e39920cb6657 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:19.960072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6e1ff0f4-5afa-47e0-97d6-e39920cb6657 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:19.983883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e1ff0f4-5afa-47e0-97d6-e39920cb6657 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:19.984899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e1ff0f4-5afa-47e0-97d6-e39920cb6657 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:19.985976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e1ff0f4-5afa-47e0-97d6-e39920cb6657 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:19.986757 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e1ff0f4-5afa-47e0-97d6-e39920cb6657 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:20.379727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6e1ff0f4-5afa-47e0-97d6-e39920cb6657 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:20.403606 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6e1ff0f4-5afa-47e0-97d6-e39920cb6657 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1496 microversion: 2.1 time: 0.447806 May 28 21:16:20.410266 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1752/3557] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:19 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1496 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:20.652471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-545bf7e0-6f91-481e-9c69-5be238c88080 req-30bb1303-ef3c-46a9-8368-c81276d7c3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49282ea3-fb61-4ec6-9443-a2fa47fdddc1", "name": "network-vif-deleted", "tag": "ad77cbe5-0049-4032-9613-f3e21596fbf9"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:20.696226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-545bf7e0-6f91-481e-9c69-5be238c88080 req-30bb1303-ef3c-46a9-8368-c81276d7c3b2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:20.696833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-545bf7e0-6f91-481e-9c69-5be238c88080 req-30bb1303-ef3c-46a9-8368-c81276d7c3b2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:20.712822 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-545bf7e0-6f91-481e-9c69-5be238c88080 req-30bb1303-ef3c-46a9-8368-c81276d7c3b2 service nova] Creating event network-vif-deleted:ad77cbe5-0049-4032-9613-f3e21596fbf9 for instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 on nch2-master-1 May 28 21:16:20.719053 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-545bf7e0-6f91-481e-9c69-5be238c88080 req-30bb1303-ef3c-46a9-8368-c81276d7c3b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073961 May 28 21:16:20.720366 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1753/3558] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:20.972603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:20.978094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-04f7b343-809e-4ed4-a69f-bc215e4bcc84 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:20.980659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-04f7b343-809e-4ed4-a69f-bc215e4bcc84 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:20.989443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04f7b343-809e-4ed4-a69f-bc215e4bcc84 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:20.990126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04f7b343-809e-4ed4-a69f-bc215e4bcc84 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:20.991115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04f7b343-809e-4ed4-a69f-bc215e4bcc84 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:20.992112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04f7b343-809e-4ed4-a69f-bc215e4bcc84 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:21.120957 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0ac126b5-3583-42c8-9131-f59c0c6ab6ad tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "DELETE /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82" status: 204 len: 0 microversion: 2.1 time: 1.704571 May 28 21:16:21.124757 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1806/3559] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:19 2022] DELETE /compute/v2.1/images/e8cf8bb2-e918-476a-883c-2a1f4a9cbd82 => generated 0 bytes in 1706 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:16:21.130248 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cd6a467c-f008-4360-9ea7-7511d522ad0c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:21.131597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cd6a467c-f008-4360-9ea7-7511d522ad0c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:21.141456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd6a467c-f008-4360-9ea7-7511d522ad0c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:21.142423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd6a467c-f008-4360-9ea7-7511d522ad0c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:21.147194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd6a467c-f008-4360-9ea7-7511d522ad0c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:21.147194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd6a467c-f008-4360-9ea7-7511d522ad0c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:21.152881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-04f7b343-809e-4ed4-a69f-bc215e4bcc84 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:21.176611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cd6a467c-f008-4360-9ea7-7511d522ad0c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:16:21.177114 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-04f7b343-809e-4ed4-a69f-bc215e4bcc84 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1370 microversion: 2.1 time: 0.211281 May 28 21:16:21.178361 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1754/3560] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:20 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:21.354954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=10 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:21.424725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e6e16e64-e08a-42e8-a118-dcf584dadeb9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:21.425528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e6e16e64-e08a-42e8-a118-dcf584dadeb9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:21.429897 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cd6a467c-f008-4360-9ea7-7511d522ad0c tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "DELETE /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 204 len: 0 microversion: 2.1 time: 0.303665 May 28 21:16:21.430509 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1807/3561] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:16:21 2022] DELETE /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:16:21.437688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6e16e64-e08a-42e8-a118-dcf584dadeb9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:21.443694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6e16e64-e08a-42e8-a118-dcf584dadeb9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:21.443694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6e16e64-e08a-42e8-a118-dcf584dadeb9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:21.443694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6e16e64-e08a-42e8-a118-dcf584dadeb9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:21.450142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d82f35da-c759-4ce5-b97c-9d6efcdf915b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:21.450866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d82f35da-c759-4ce5-b97c-9d6efcdf915b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:21.462916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d82f35da-c759-4ce5-b97c-9d6efcdf915b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:21.463380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d82f35da-c759-4ce5-b97c-9d6efcdf915b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:21.464170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d82f35da-c759-4ce5-b97c-9d6efcdf915b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:21.464616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d82f35da-c759-4ce5-b97c-9d6efcdf915b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:21.493904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6e16e64-e08a-42e8-a118-dcf584dadeb9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:21.494833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6e16e64-e08a-42e8-a118-dcf584dadeb9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:21.495517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-e6e16e64-e08a-42e8-a118-dcf584dadeb9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lazy-loading 'fault' on Instance uuid 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:16:21.610735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e6e16e64-e08a-42e8-a118-dcf584dadeb9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:21.620575 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e6e16e64-e08a-42e8-a118-dcf584dadeb9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1299 microversion: 2.1 time: 0.202539 May 28 21:16:21.621190 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1755/3562] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:21 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1299 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:21.773313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d82f35da-c759-4ce5-b97c-9d6efcdf915b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:21.783622 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d82f35da-c759-4ce5-b97c-9d6efcdf915b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1472 microversion: 2.1 time: 0.337738 May 28 21:16:21.784390 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1808/3563] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:21 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1472 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:22.195596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e50b16ef-cf5e-4abd-92ec-1096ae2dd01d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:22.196356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e50b16ef-cf5e-4abd-92ec-1096ae2dd01d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:22.203582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e50b16ef-cf5e-4abd-92ec-1096ae2dd01d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:22.204190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e50b16ef-cf5e-4abd-92ec-1096ae2dd01d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:22.205024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e50b16ef-cf5e-4abd-92ec-1096ae2dd01d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:22.205468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e50b16ef-cf5e-4abd-92ec-1096ae2dd01d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:22.418123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e50b16ef-cf5e-4abd-92ec-1096ae2dd01d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:22.426986 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e50b16ef-cf5e-4abd-92ec-1096ae2dd01d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1370 microversion: 2.1 time: 0.235971 May 28 21:16:22.431463 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1756/3564] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:22 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:22.645186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-645b135d-185b-4ee0-8e5c-467d11e8c816 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:22.646607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-645b135d-185b-4ee0-8e5c-467d11e8c816 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:22.655785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-645b135d-185b-4ee0-8e5c-467d11e8c816 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:22.656431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-645b135d-185b-4ee0-8e5c-467d11e8c816 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:22.657397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-645b135d-185b-4ee0-8e5c-467d11e8c816 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:22.658064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-645b135d-185b-4ee0-8e5c-467d11e8c816 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:22.694212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:22.695984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-645b135d-185b-4ee0-8e5c-467d11e8c816 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:22.696791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-645b135d-185b-4ee0-8e5c-467d11e8c816 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:22.700963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-645b135d-185b-4ee0-8e5c-467d11e8c816 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lazy-loading 'fault' on Instance uuid 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:16:22.751227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-645b135d-185b-4ee0-8e5c-467d11e8c816 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:22.759721 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-645b135d-185b-4ee0-8e5c-467d11e8c816 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 200 len: 1299 microversion: 2.1 time: 0.120380 May 28 21:16:22.760295 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1809/3565] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:22 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:22.809403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-32402adb-25a0-4963-8173-d78da1ff39d3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:22.810316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-32402adb-25a0-4963-8173-d78da1ff39d3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:22.813668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:22.827996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32402adb-25a0-4963-8173-d78da1ff39d3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:22.828711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32402adb-25a0-4963-8173-d78da1ff39d3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:22.829526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32402adb-25a0-4963-8173-d78da1ff39d3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:22.830000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32402adb-25a0-4963-8173-d78da1ff39d3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:23.390658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-32402adb-25a0-4963-8173-d78da1ff39d3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:23.392467 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-32402adb-25a0-4963-8173-d78da1ff39d3 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1472 microversion: 2.1 time: 0.586772 May 28 21:16:23.393253 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1757/3566] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:22 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1472 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:23.445205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-10afd810-9ad1-4353-95e8-a23be9961142 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:23.445883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-10afd810-9ad1-4353-95e8-a23be9961142 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:23.454863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10afd810-9ad1-4353-95e8-a23be9961142 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:23.455609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10afd810-9ad1-4353-95e8-a23be9961142 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:23.456743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10afd810-9ad1-4353-95e8-a23be9961142 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:23.457224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10afd810-9ad1-4353-95e8-a23be9961142 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:23.724382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-10afd810-9ad1-4353-95e8-a23be9961142 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:23.737588 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-10afd810-9ad1-4353-95e8-a23be9961142 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1370 microversion: 2.1 time: 0.296053 May 28 21:16:23.739222 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1810/3567] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:23 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1370 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:23.777940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-56e73275-03c1-4c2e-b52d-2c337f729d4c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:23.778568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-56e73275-03c1-4c2e-b52d-2c337f729d4c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:23.785081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56e73275-03c1-4c2e-b52d-2c337f729d4c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:23.785544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56e73275-03c1-4c2e-b52d-2c337f729d4c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:23.786451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56e73275-03c1-4c2e-b52d-2c337f729d4c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:23.786920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56e73275-03c1-4c2e-b52d-2c337f729d4c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:23.811996 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-56e73275-03c1-4c2e-b52d-2c337f729d4c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-56e73275-03c1-4c2e-b52d-2c337f729d4c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 HTTP/1.1 May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '49282ea3-fb61-4ec6-9443-a2fa47fdddc1'} May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:23.817342 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:23.828059 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:16:23.828059 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:16:23.828059 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:16:23.828059 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:16:23.828059 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. May 28 21:16:23.828059 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:23.828059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-56e73275-03c1-4c2e-b52d-2c337f729d4c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:16:23.828059 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-56e73275-03c1-4c2e-b52d-2c337f729d4c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 404 len: 111 microversion: 2.1 time: 0.050430 May 28 21:16:23.828059 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1758/3568] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:23 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:16:23.833034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-61724f7a-b4c1-402c-a360-5b6dc2447418 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:23.833904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-61724f7a-b4c1-402c-a360-5b6dc2447418 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:23.840556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61724f7a-b4c1-402c-a360-5b6dc2447418 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:23.841014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61724f7a-b4c1-402c-a360-5b6dc2447418 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:23.841792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61724f7a-b4c1-402c-a360-5b6dc2447418 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:23.842265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61724f7a-b4c1-402c-a360-5b6dc2447418 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:23.870651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-61724f7a-b4c1-402c-a360-5b6dc2447418 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:16:24.175506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2b4dd035-d4c7-4580-b7cc-570cf1f5d619 req-a107d6fc-d89d-4571-a10a-499d86fed2eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d9b7c0-0b10-4aea-9af1-50ede9a13238", "name": "network-vif-deleted", "tag": "4e49f946-3e3f-4a15-ba0a-14cb379976e5"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:24.215366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2b4dd035-d4c7-4580-b7cc-570cf1f5d619 req-a107d6fc-d89d-4571-a10a-499d86fed2eb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:24.218061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2b4dd035-d4c7-4580-b7cc-570cf1f5d619 req-a107d6fc-d89d-4571-a10a-499d86fed2eb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:24.230362 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2b4dd035-d4c7-4580-b7cc-570cf1f5d619 req-a107d6fc-d89d-4571-a10a-499d86fed2eb service nova] Creating event network-vif-deleted:4e49f946-3e3f-4a15-ba0a-14cb379976e5 for instance 58d9b7c0-0b10-4aea-9af1-50ede9a13238 on nch2-master-1 May 28 21:16:24.239022 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2b4dd035-d4c7-4580-b7cc-570cf1f5d619 req-a107d6fc-d89d-4571-a10a-499d86fed2eb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067847 May 28 21:16:24.239701 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1759/3569] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:24.315780 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-61724f7a-b4c1-402c-a360-5b6dc2447418 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 204 len: 0 microversion: 2.1 time: 0.486205 May 28 21:16:24.316859 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1811/3570] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:16:23 2022] DELETE /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:16:24.329211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9f88c6db-bf0f-4cf0-8331-f561d7f3b00d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:24.330454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9f88c6db-bf0f-4cf0-8331-f561d7f3b00d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:24.338407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f88c6db-bf0f-4cf0-8331-f561d7f3b00d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:24.339115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f88c6db-bf0f-4cf0-8331-f561d7f3b00d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:24.340646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f88c6db-bf0f-4cf0-8331-f561d7f3b00d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:24.341447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f88c6db-bf0f-4cf0-8331-f561d7f3b00d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:24.357317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:24.412745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5f844e47-18f5-438f-a168-df3501050fd4 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:24.414150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5f844e47-18f5-438f-a168-df3501050fd4 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:24.424246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f844e47-18f5-438f-a168-df3501050fd4 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:24.424820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f844e47-18f5-438f-a168-df3501050fd4 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:24.426673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f844e47-18f5-438f-a168-df3501050fd4 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:24.427308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f844e47-18f5-438f-a168-df3501050fd4 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:24.557111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5f844e47-18f5-438f-a168-df3501050fd4 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:24.561772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9f88c6db-bf0f-4cf0-8331-f561d7f3b00d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:24.568904 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9f88c6db-bf0f-4cf0-8331-f561d7f3b00d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1497 microversion: 2.1 time: 0.243988 May 28 21:16:24.569782 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1760/3571] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:24 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1497 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:24.580232 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5f844e47-18f5-438f-a168-df3501050fd4 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1302 microversion: 2.1 time: 0.162232 May 28 21:16:24.582613 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1812/3572] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:24 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1302 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:24.596010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-65fb6e7d-65d5-4e8d-98a8-040e2d6d4712 req-f9f0fb2d-52a5-4334-bba9-df9dff791537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ee8dd9-d59f-422a-a29d-2732e2573958", "name": "network-vif-plugged", "status": "completed", "tag": "011cb162-2172-4519-8fcc-9bf7016b04a4"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:24.609048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-65fb6e7d-65d5-4e8d-98a8-040e2d6d4712 req-f9f0fb2d-52a5-4334-bba9-df9dff791537 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:24.609876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-65fb6e7d-65d5-4e8d-98a8-040e2d6d4712 req-f9f0fb2d-52a5-4334-bba9-df9dff791537 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:24.625951 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-65fb6e7d-65d5-4e8d-98a8-040e2d6d4712 req-f9f0fb2d-52a5-4334-bba9-df9dff791537 service nova] Creating event network-vif-plugged:011cb162-2172-4519-8fcc-9bf7016b04a4 for instance 43ee8dd9-d59f-422a-a29d-2732e2573958 on nch1-master-1 May 28 21:16:24.631493 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-65fb6e7d-65d5-4e8d-98a8-040e2d6d4712 req-f9f0fb2d-52a5-4334-bba9-df9dff791537 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059870 May 28 21:16:24.632259 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1761/3573] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:24.755710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3aaf30c9-a5ab-4e37-93b5-b155d0ba56ed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:24.756888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3aaf30c9-a5ab-4e37-93b5-b155d0ba56ed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:24.764066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3aaf30c9-a5ab-4e37-93b5-b155d0ba56ed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:24.764532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3aaf30c9-a5ab-4e37-93b5-b155d0ba56ed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:24.765315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3aaf30c9-a5ab-4e37-93b5-b155d0ba56ed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:24.765755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3aaf30c9-a5ab-4e37-93b5-b155d0ba56ed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:25.001584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3aaf30c9-a5ab-4e37-93b5-b155d0ba56ed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:25.009481 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3aaf30c9-a5ab-4e37-93b5-b155d0ba56ed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1370 microversion: 2.1 time: 0.258157 May 28 21:16:25.010099 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1813/3574] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:24 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1370 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:25.587498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ee94a8d8-c3d4-47a6-8145-8812fb5629be tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:25.588456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ee94a8d8-c3d4-47a6-8145-8812fb5629be tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:25.596814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ee94a8d8-c3d4-47a6-8145-8812fb5629be tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:25.597420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ee94a8d8-c3d4-47a6-8145-8812fb5629be tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:25.597705 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e91c039b-dc46-4a03-961d-05e7d0091769 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:25.598438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ee94a8d8-c3d4-47a6-8145-8812fb5629be tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:25.598741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e91c039b-dc46-4a03-961d-05e7d0091769 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:25.599160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ee94a8d8-c3d4-47a6-8145-8812fb5629be tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:25.606727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e91c039b-dc46-4a03-961d-05e7d0091769 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:25.607184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e91c039b-dc46-4a03-961d-05e7d0091769 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:25.608917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e91c039b-dc46-4a03-961d-05e7d0091769 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:25.608917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e91c039b-dc46-4a03-961d-05e7d0091769 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:25.649330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e91c039b-dc46-4a03-961d-05e7d0091769 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:25.649798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e91c039b-dc46-4a03-961d-05e7d0091769 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:25.650417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-e91c039b-dc46-4a03-961d-05e7d0091769 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lazy-loading 'fault' on Instance uuid 58d9b7c0-0b10-4aea-9af1-50ede9a13238 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:16:25.744407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e91c039b-dc46-4a03-961d-05e7d0091769 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:25.752084 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e91c039b-dc46-4a03-961d-05e7d0091769 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 200 len: 1307 microversion: 2.1 time: 0.158693 May 28 21:16:25.752692 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1814/3575] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:25 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 1307 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:25.841929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ee94a8d8-c3d4-47a6-8145-8812fb5629be tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:25.850518 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ee94a8d8-c3d4-47a6-8145-8812fb5629be tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1497 microversion: 2.1 time: 0.267143 May 28 21:16:25.851217 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1762/3576] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:25 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1497 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:26.027251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-818f4ab8-3e94-4ec9-b764-62c128c0ba8b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:26.027919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-818f4ab8-3e94-4ec9-b764-62c128c0ba8b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:26.034762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-818f4ab8-3e94-4ec9-b764-62c128c0ba8b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:26.035266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-818f4ab8-3e94-4ec9-b764-62c128c0ba8b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:26.036076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-818f4ab8-3e94-4ec9-b764-62c128c0ba8b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:26.036557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-818f4ab8-3e94-4ec9-b764-62c128c0ba8b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:26.424655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-818f4ab8-3e94-4ec9-b764-62c128c0ba8b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:26.432727 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-818f4ab8-3e94-4ec9-b764-62c128c0ba8b tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1370 microversion: 2.1 time: 0.409480 May 28 21:16:26.433314 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1815/3577] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:26 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1370 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:26.769473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-26075494-1ff4-4983-b439-5a9f5b5bbc04 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:26.770560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-26075494-1ff4-4983-b439-5a9f5b5bbc04 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 58d9b7c0-0b10-4aea-9af1-50ede9a13238] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:26.780818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26075494-1ff4-4983-b439-5a9f5b5bbc04 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:26.781491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26075494-1ff4-4983-b439-5a9f5b5bbc04 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:26.782413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26075494-1ff4-4983-b439-5a9f5b5bbc04 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:26.783105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26075494-1ff4-4983-b439-5a9f5b5bbc04 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:26.802529 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-26075494-1ff4-4983-b439-5a9f5b5bbc04 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] HTTP exception thrown: Instance 58d9b7c0-0b10-4aea-9af1-50ede9a13238 could not be found. May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-26075494-1ff4-4983-b439-5a9f5b5bbc04 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Request method failure captured: May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 HTTP/1.1 May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpC_-g8W_9IkN2fXK8Ukp2TZJMMwWXceBxCO8FbGGgCIQ82ZMUKN56cm9DKHQmMvPA_GG-uak4zl4k2f7NRXvX54_D6os3eSQEoWXfcJDB8ut-qSX5HA8SBg4-aHjrRQsNO1Xfdn7F4RYksvlHwrdAutEhhWCEMtpej2q1GcXZerdLM May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf454e1b4e6a4c45af04865b154c41a9 May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ListImageFiltersTestJSON-650312215 May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf454e1b4e6a4c45af04865b154c41a9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf454e1b4e6a4c45af04865b154c41a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf454e1b4e6a4c45af04865b154c41a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf454e1b4e6a4c45af04865b154c41a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ListImageFiltersTestJSON-650312215 May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf454e1b4e6a4c45af04865b154c41a9 May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-650312215 May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ListImageFiltersTestJSON-650312215-project May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 98ab12b74029438a9a1d19e505d1fc6d May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ListImageFiltersTestJSON-650312215-project May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 58d9b7c0-0b10-4aea-9af1-50ede9a13238 could not be found. May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '58d9b7c0-0b10-4aea-9af1-50ede9a13238'} May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58d9b7c0-0b10-4aea-9af1-50ede9a13238 could not be found. May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58d9b7c0-0b10-4aea-9af1-50ede9a13238 could not be found. May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:16:26.804389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:26.809055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:26.809055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:16:26.809055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:16:26.809055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:16:26.809055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:16:26.809055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58d9b7c0-0b10-4aea-9af1-50ede9a13238 could not be found. May 28 21:16:26.809055 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:26.809908 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-26075494-1ff4-4983-b439-5a9f5b5bbc04 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Returning 404 to user: Instance 58d9b7c0-0b10-4aea-9af1-50ede9a13238 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:16:26.811391 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-26075494-1ff4-4983-b439-5a9f5b5bbc04 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238" status: 404 len: 111 microversion: 2.1 time: 0.046694 May 28 21:16:26.812318 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1763/3578] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:26 2022] GET /compute/v2.1/servers/58d9b7c0-0b10-4aea-9af1-50ede9a13238 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:16:26.822475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-69dde577-96c6-4a38-89e5-bc09bb751a6e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:26.822922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-69dde577-96c6-4a38-89e5-bc09bb751a6e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 144ab366-0448-410f-9093-91dec09b838c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:26.831392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69dde577-96c6-4a38-89e5-bc09bb751a6e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:26.831928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69dde577-96c6-4a38-89e5-bc09bb751a6e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:26.833172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69dde577-96c6-4a38-89e5-bc09bb751a6e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:26.833634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69dde577-96c6-4a38-89e5-bc09bb751a6e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:26.840069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:26.868173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4e63641c-7d89-466f-aa24-c3acd8d33fe1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:26.868817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4e63641c-7d89-466f-aa24-c3acd8d33fe1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:26.874413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-69dde577-96c6-4a38-89e5-bc09bb751a6e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 144ab366-0448-410f-9093-91dec09b838c] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:16:26.879240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e63641c-7d89-466f-aa24-c3acd8d33fe1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:26.879910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e63641c-7d89-466f-aa24-c3acd8d33fe1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:26.881613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e63641c-7d89-466f-aa24-c3acd8d33fe1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:26.882263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e63641c-7d89-466f-aa24-c3acd8d33fe1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:27.050052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4e63641c-7d89-466f-aa24-c3acd8d33fe1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:27.059473 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4e63641c-7d89-466f-aa24-c3acd8d33fe1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1455 microversion: 2.1 time: 0.195412 May 28 21:16:27.060630 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1764/3579] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:26 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1455 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:27.065820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-dfc26c2a-0615-4ce7-86ce-cbcf1e0bc96a req-ac11fbfd-8d5d-424d-ab07-8f8c591e0c52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b", "name": "network-vif-deleted", "tag": "7410510e-0992-4f1a-a66b-880cb18938ce"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:27.076360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-dfc26c2a-0615-4ce7-86ce-cbcf1e0bc96a req-ac11fbfd-8d5d-424d-ab07-8f8c591e0c52 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:27.077005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-dfc26c2a-0615-4ce7-86ce-cbcf1e0bc96a req-ac11fbfd-8d5d-424d-ab07-8f8c591e0c52 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:27.089902 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-dfc26c2a-0615-4ce7-86ce-cbcf1e0bc96a req-ac11fbfd-8d5d-424d-ab07-8f8c591e0c52 service nova] Creating event network-vif-deleted:7410510e-0992-4f1a-a66b-880cb18938ce for instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b on nch2-master-1 May 28 21:16:27.095011 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-dfc26c2a-0615-4ce7-86ce-cbcf1e0bc96a req-ac11fbfd-8d5d-424d-ab07-8f8c591e0c52 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033026 May 28 21:16:27.095891 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1765/3580] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:27.266720 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-69dde577-96c6-4a38-89e5-bc09bb751a6e tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "DELETE /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c" status: 204 len: 0 microversion: 2.1 time: 0.448882 May 28 21:16:27.267513 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1816/3581] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:16:26 2022] DELETE /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:16:27.276325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6abba946-f9d8-49f3-9517-8113da0347cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:27.277375 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6abba946-f9d8-49f3-9517-8113da0347cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 144ab366-0448-410f-9093-91dec09b838c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:27.284156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6abba946-f9d8-49f3-9517-8113da0347cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:27.284624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6abba946-f9d8-49f3-9517-8113da0347cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:27.285406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6abba946-f9d8-49f3-9517-8113da0347cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:27.285864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6abba946-f9d8-49f3-9517-8113da0347cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:27.451374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-90473136-69ef-4ea5-956e-67a408f41c20 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:27.452262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-90473136-69ef-4ea5-956e-67a408f41c20 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:27.460308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90473136-69ef-4ea5-956e-67a408f41c20 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:27.461165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90473136-69ef-4ea5-956e-67a408f41c20 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:27.462097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90473136-69ef-4ea5-956e-67a408f41c20 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:27.462766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90473136-69ef-4ea5-956e-67a408f41c20 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:27.467697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6abba946-f9d8-49f3-9517-8113da0347cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:27.476544 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6abba946-f9d8-49f3-9517-8113da0347cb tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c" status: 200 len: 1473 microversion: 2.1 time: 0.204358 May 28 21:16:27.478002 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1766/3582] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:27 2022] GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c => generated 1473 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:27.620955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-90473136-69ef-4ea5-956e-67a408f41c20 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:27.629047 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-90473136-69ef-4ea5-956e-67a408f41c20 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1564 microversion: 2.1 time: 0.182589 May 28 21:16:27.629988 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1817/3583] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:27 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:27.646786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fbb912d2-30f6-4b08-82f8-980c54ccfb1d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:27.647300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fbb912d2-30f6-4b08-82f8-980c54ccfb1d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:27.654706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fbb912d2-30f6-4b08-82f8-980c54ccfb1d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:27.655163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fbb912d2-30f6-4b08-82f8-980c54ccfb1d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:27.655954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fbb912d2-30f6-4b08-82f8-980c54ccfb1d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:27.656397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fbb912d2-30f6-4b08-82f8-980c54ccfb1d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:27.742819 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fbb912d2-30f6-4b08-82f8-980c54ccfb1d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100169 May 28 21:16:27.744294 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1767/3584] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:16:27 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:28.077307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a2de7f13-fd22-4600-841e-867e58e03647 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:28.077678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a2de7f13-fd22-4600-841e-867e58e03647 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:28.086496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2de7f13-fd22-4600-841e-867e58e03647 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:28.089066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2de7f13-fd22-4600-841e-867e58e03647 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:28.089066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2de7f13-fd22-4600-841e-867e58e03647 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:28.089066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2de7f13-fd22-4600-841e-867e58e03647 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:28.126048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2de7f13-fd22-4600-841e-867e58e03647 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:28.126832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2de7f13-fd22-4600-841e-867e58e03647 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:28.127498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-a2de7f13-fd22-4600-841e-867e58e03647 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lazy-loading 'fault' on Instance uuid 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:16:28.203689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a2de7f13-fd22-4600-841e-867e58e03647 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:28.220556 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a2de7f13-fd22-4600-841e-867e58e03647 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1299 microversion: 2.1 time: 0.147640 May 28 21:16:28.222296 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1818/3585] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:28 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1299 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:28.497160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-990b6bb0-0b79-4bb4-a368-343f14229c21 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:28.498547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-990b6bb0-0b79-4bb4-a368-343f14229c21 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 144ab366-0448-410f-9093-91dec09b838c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:28.505660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-990b6bb0-0b79-4bb4-a368-343f14229c21 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:28.506545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-990b6bb0-0b79-4bb4-a368-343f14229c21 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:28.507415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-990b6bb0-0b79-4bb4-a368-343f14229c21 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:28.507960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-990b6bb0-0b79-4bb4-a368-343f14229c21 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:28.714222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-990b6bb0-0b79-4bb4-a368-343f14229c21 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:28.733135 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-990b6bb0-0b79-4bb4-a368-343f14229c21 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c" status: 200 len: 1473 microversion: 2.1 time: 0.240061 May 28 21:16:28.738247 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1768/3586] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:28 2022] GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c => generated 1473 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:29.256022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e6feae8d-8ad5-4aee-a079-c3db6d21ef66 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:29.256725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e6feae8d-8ad5-4aee-a079-c3db6d21ef66 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:29.264841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6feae8d-8ad5-4aee-a079-c3db6d21ef66 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:29.265429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6feae8d-8ad5-4aee-a079-c3db6d21ef66 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:29.266341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6feae8d-8ad5-4aee-a079-c3db6d21ef66 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:29.266908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6feae8d-8ad5-4aee-a079-c3db6d21ef66 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:29.319975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6feae8d-8ad5-4aee-a079-c3db6d21ef66 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:29.320729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6feae8d-8ad5-4aee-a079-c3db6d21ef66 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:29.321460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-e6feae8d-8ad5-4aee-a079-c3db6d21ef66 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lazy-loading 'fault' on Instance uuid 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:16:29.674404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e6feae8d-8ad5-4aee-a079-c3db6d21ef66 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:29.682958 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e6feae8d-8ad5-4aee-a079-c3db6d21ef66 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 200 len: 1299 microversion: 2.1 time: 0.446151 May 28 21:16:29.684175 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1819/3587] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:29 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 1299 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:29.752286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-508687c2-ec61-482a-86c7-0edf166b7ecd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:29.753030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-508687c2-ec61-482a-86c7-0edf166b7ecd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 144ab366-0448-410f-9093-91dec09b838c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:29.761467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-508687c2-ec61-482a-86c7-0edf166b7ecd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:29.762461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-508687c2-ec61-482a-86c7-0edf166b7ecd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:29.763382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-508687c2-ec61-482a-86c7-0edf166b7ecd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:29.763948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-508687c2-ec61-482a-86c7-0edf166b7ecd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:29.963296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-508687c2-ec61-482a-86c7-0edf166b7ecd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:29.971678 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-508687c2-ec61-482a-86c7-0edf166b7ecd tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c" status: 200 len: 1473 microversion: 2.1 time: 0.223957 May 28 21:16:29.972376 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1769/3588] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:29 2022] GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c => generated 1473 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:30.172795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-065e3f18-df30-449c-a050-e85cdb1c594e req-1a57ae62-79cf-455e-86b5-db5c5841e0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "144ab366-0448-410f-9093-91dec09b838c", "name": "network-vif-deleted", "tag": "cfbdc8df-e8d0-4012-b243-cfb3e0d4ff83"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:30.181691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-065e3f18-df30-449c-a050-e85cdb1c594e req-1a57ae62-79cf-455e-86b5-db5c5841e0b4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:30.182239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-065e3f18-df30-449c-a050-e85cdb1c594e req-1a57ae62-79cf-455e-86b5-db5c5841e0b4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:30.197174 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-065e3f18-df30-449c-a050-e85cdb1c594e req-1a57ae62-79cf-455e-86b5-db5c5841e0b4 service nova] Creating event network-vif-deleted:cfbdc8df-e8d0-4012-b243-cfb3e0d4ff83 for instance 144ab366-0448-410f-9093-91dec09b838c on nch2-master-1 May 28 21:16:30.203705 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-065e3f18-df30-449c-a050-e85cdb1c594e req-1a57ae62-79cf-455e-86b5-db5c5841e0b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034504 May 28 21:16:30.204770 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1820/3589] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:30.348443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-709f4904-8ad9-474c-a2a0-85c1f06a4732 req-86d04115-d43c-4ecc-9f05-c91a752b6c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ee8dd9-d59f-422a-a29d-2732e2573958", "tag": "011cb162-2172-4519-8fcc-9bf7016b04a4"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:30.360944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-709f4904-8ad9-474c-a2a0-85c1f06a4732 req-86d04115-d43c-4ecc-9f05-c91a752b6c95 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:30.361397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-709f4904-8ad9-474c-a2a0-85c1f06a4732 req-86d04115-d43c-4ecc-9f05-c91a752b6c95 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:30.378004 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-709f4904-8ad9-474c-a2a0-85c1f06a4732 req-86d04115-d43c-4ecc-9f05-c91a752b6c95 service nova] Creating event network-changed:011cb162-2172-4519-8fcc-9bf7016b04a4 for instance 43ee8dd9-d59f-422a-a29d-2732e2573958 on nch1-master-1 May 28 21:16:30.395693 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-709f4904-8ad9-474c-a2a0-85c1f06a4732 req-86d04115-d43c-4ecc-9f05-c91a752b6c95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047930 May 28 21:16:30.405699 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1770/3590] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:30.700971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c674cf05-04a3-4174-b93a-a79a887ae87a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:30.702044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c674cf05-04a3-4174-b93a-a79a887ae87a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:30.718720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c674cf05-04a3-4174-b93a-a79a887ae87a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:30.719263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c674cf05-04a3-4174-b93a-a79a887ae87a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:30.720596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c674cf05-04a3-4174-b93a-a79a887ae87a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:30.723031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c674cf05-04a3-4174-b93a-a79a887ae87a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:30.763655 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-c674cf05-04a3-4174-b93a-a79a887ae87a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c674cf05-04a3-4174-b93a-a79a887ae87a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b HTTP/1.1 May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b'} May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:16:30.765973 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:30.770812 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:16:30.770812 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:16:30.770812 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:16:30.770812 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:16:30.770812 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. May 28 21:16:30.770812 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:16:30.800425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c674cf05-04a3-4174-b93a-a79a887ae87a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:16:30.803721 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c674cf05-04a3-4174-b93a-a79a887ae87a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 404 len: 111 microversion: 2.1 time: 0.105192 May 28 21:16:30.806175 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1821/3591] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:30 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:16:30.990863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c6956ac8-e1e8-46c1-95ac-532a1837942a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:30.992969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1846373951", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "ca803b4d-8584-4327-9f76-66ddebb3c209"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:30.998233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c6956ac8-e1e8-46c1-95ac-532a1837942a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 144ab366-0448-410f-9093-91dec09b838c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:31.009199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6956ac8-e1e8-46c1-95ac-532a1837942a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:31.009704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6956ac8-e1e8-46c1-95ac-532a1837942a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:31.010491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6956ac8-e1e8-46c1-95ac-532a1837942a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:31.010946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6956ac8-e1e8-46c1-95ac-532a1837942a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:31.075362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] validate_networks() for [('ca803b4d-8584-4327-9f76-66ddebb3c209', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:16:31.110309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6956ac8-e1e8-46c1-95ac-532a1837942a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:31.110967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6956ac8-e1e8-46c1-95ac-532a1837942a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:31.111597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-c6956ac8-e1e8-46c1-95ac-532a1837942a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lazy-loading 'fault' on Instance uuid 144ab366-0448-410f-9093-91dec09b838c {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:16:31.239610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c6956ac8-e1e8-46c1-95ac-532a1837942a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ab12b74029438a9a1d19e505d1fc6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf454e1b4e6a4c45af04865b154c41a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:31.249109 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c6956ac8-e1e8-46c1-95ac-532a1837942a tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c" status: 200 len: 1307 microversion: 2.1 time: 0.263500 May 28 21:16:31.255008 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1822/3592] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:30 2022] GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c => generated 1307 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:31.883249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:16:31.884251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:16:31.884950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:16:31.885540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:16:31.886163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:16:31.900169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:31.904713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:31.905713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:31.906224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:31.931316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:16:31.932944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:31.938311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for user 572170ccd67e4facbf10dad7cd1491c1 and project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:16:31.956017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:16:31.959713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:16:32.152187 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c8ef9eee-9761-4cab-bc2a-69de205eea9c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.162781 May 28 21:16:32.157220 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1771/3593] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:16:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:16:32.167318 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0007e676-10f3-406a-8972-4a15300348bf tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:32.168295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0007e676-10f3-406a-8972-4a15300348bf tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:32.266231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0007e676-10f3-406a-8972-4a15300348bf tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:32.275266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c9ef1af2-9349-4e98-8e9b-81c3faf8dc44 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:32.275492 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0007e676-10f3-406a-8972-4a15300348bf tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1209 microversion: 2.1 time: 0.114358 May 28 21:16:32.275857 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1823/3594] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:32 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1209 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:32.275974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c9ef1af2-9349-4e98-8e9b-81c3faf8dc44 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] [instance: 144ab366-0448-410f-9093-91dec09b838c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:32.290194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9ef1af2-9349-4e98-8e9b-81c3faf8dc44 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:32.290642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9ef1af2-9349-4e98-8e9b-81c3faf8dc44 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:32.291440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9ef1af2-9349-4e98-8e9b-81c3faf8dc44 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:32.291920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9ef1af2-9349-4e98-8e9b-81c3faf8dc44 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:32.325664 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-c9ef1af2-9349-4e98-8e9b-81c3faf8dc44 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] HTTP exception thrown: Instance 144ab366-0448-410f-9093-91dec09b838c could not be found. May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c9ef1af2-9349-4e98-8e9b-81c3faf8dc44 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Request method failure captured: May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c HTTP/1.1 May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpC_-g8W_9IkN2fXK8Ukp2TZJMMwWXceBxCO8FbGGgCIQ82ZMUKN56cm9DKHQmMvPA_GG-uak4zl4k2f7NRXvX54_D6os3eSQEoWXfcJDB8ut-qSX5HA8SBg4-aHjrRQsNO1Xfdn7F4RYksvlHwrdAutEhhWCEMtpej2q1GcXZerdLM May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: cf454e1b4e6a4c45af04865b154c41a9 May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ListImageFiltersTestJSON-650312215 May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cf454e1b4e6a4c45af04865b154c41a9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf454e1b4e6a4c45af04865b154c41a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cf454e1b4e6a4c45af04865b154c41a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cf454e1b4e6a4c45af04865b154c41a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ListImageFiltersTestJSON-650312215 May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: cf454e1b4e6a4c45af04865b154c41a9 May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-650312215 May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ListImageFiltersTestJSON-650312215-project May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 98ab12b74029438a9a1d19e505d1fc6d May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ListImageFiltersTestJSON-650312215-project May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 144ab366-0448-410f-9093-91dec09b838c could not be found. May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '144ab366-0448-410f-9093-91dec09b838c'} May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 144ab366-0448-410f-9093-91dec09b838c could not be found. May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 144ab366-0448-410f-9093-91dec09b838c could not be found. May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:16:32.336113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:32.340559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:32.340559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:16:32.340559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:16:32.340559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:16:32.340559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:16:32.340559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 144ab366-0448-410f-9093-91dec09b838c could not be found. May 28 21:16:32.340559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:32.340559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c9ef1af2-9349-4e98-8e9b-81c3faf8dc44 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Returning 404 to user: Instance 144ab366-0448-410f-9093-91dec09b838c could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:16:32.340559 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c9ef1af2-9349-4e98-8e9b-81c3faf8dc44 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c" status: 404 len: 111 microversion: 2.1 time: 0.067759 May 28 21:16:32.340559 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1772/3595] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:32 2022] GET /compute/v2.1/servers/144ab366-0448-410f-9093-91dec09b838c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:16:32.347608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b6531063-338e-4c77-8b00-334a46a0a885 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69c23ca0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:33.134048 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b6531063-338e-4c77-8b00-334a46a0a885 tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "DELETE /compute/v2.1/images/187e8a9e-ae1c-493b-9887-fc3353ffa1b5" status: 204 len: 0 microversion: 2.1 time: 0.790736 May 28 21:16:33.134747 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1824/3596] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:32 2022] DELETE /compute/v2.1/images/187e8a9e-ae1c-493b-9887-fc3353ffa1b5 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:16:33.145787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2bc16084-1b31-4420-84f0-829e64476aaf tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d69c50dc0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:33.296358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bf3edf92-6045-4487-b5e0-cf594a9e8413 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:33.296358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bf3edf92-6045-4487-b5e0-cf594a9e8413 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:33.330192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf3edf92-6045-4487-b5e0-cf594a9e8413 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:33.331349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf3edf92-6045-4487-b5e0-cf594a9e8413 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:33.332400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf3edf92-6045-4487-b5e0-cf594a9e8413 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:33.332930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf3edf92-6045-4487-b5e0-cf594a9e8413 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:33.466171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bf3edf92-6045-4487-b5e0-cf594a9e8413 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:33.476570 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bf3edf92-6045-4487-b5e0-cf594a9e8413 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1213 microversion: 2.1 time: 0.187517 May 28 21:16:33.477515 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1825/3597] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:33 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1213 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:33.788867 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2bc16084-1b31-4420-84f0-829e64476aaf tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "DELETE /compute/v2.1/images/103b6115-c9f0-4cc2-92db-1d647cac081b" status: 204 len: 0 microversion: 2.1 time: 0.649898 May 28 21:16:33.789551 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1773/3598] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:33 2022] DELETE /compute/v2.1/images/103b6115-c9f0-4cc2-92db-1d647cac081b => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:16:33.798323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-63055307-7794-4e45-940f-b4f7db0ba12b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] Calling method '.version_select at 0x7f4d57875940>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:34.494801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7226719f-38a0-4ffe-afd8-708195b99998 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:34.496046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7226719f-38a0-4ffe-afd8-708195b99998 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:34.504716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7226719f-38a0-4ffe-afd8-708195b99998 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:34.505265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7226719f-38a0-4ffe-afd8-708195b99998 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:34.506714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7226719f-38a0-4ffe-afd8-708195b99998 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:34.507155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7226719f-38a0-4ffe-afd8-708195b99998 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:34.743448 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-63055307-7794-4e45-940f-b4f7db0ba12b tempest-ListImageFiltersTestJSON-650312215 tempest-ListImageFiltersTestJSON-650312215-project] 10.222.0.33 "DELETE /compute/v2.1/images/f0736d5f-dee0-4f78-9322-8b36a96dc7c7" status: 204 len: 0 microversion: 2.1 time: 0.949496 May 28 21:16:34.746621 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1826/3599] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:33 2022] DELETE /compute/v2.1/images/f0736d5f-dee0-4f78-9322-8b36a96dc7c7 => generated 0 bytes in 951 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:16:34.835928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7226719f-38a0-4ffe-afd8-708195b99998 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:34.853675 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7226719f-38a0-4ffe-afd8-708195b99998 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1261 microversion: 2.1 time: 0.363552 May 28 21:16:34.858527 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1774/3600] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:34 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1261 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:35.887125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2c787d02-48bf-45b1-832c-74b95c7e1c5e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:35.887125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2c787d02-48bf-45b1-832c-74b95c7e1c5e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:35.913868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2c787d02-48bf-45b1-832c-74b95c7e1c5e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:35.916501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2c787d02-48bf-45b1-832c-74b95c7e1c5e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:35.917594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2c787d02-48bf-45b1-832c-74b95c7e1c5e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:35.920815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2c787d02-48bf-45b1-832c-74b95c7e1c5e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:36.105859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2c787d02-48bf-45b1-832c-74b95c7e1c5e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:36.119167 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2c787d02-48bf-45b1-832c-74b95c7e1c5e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1267 microversion: 2.1 time: 0.244900 May 28 21:16:36.130336 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1827/3601] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:35 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1267 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:37.137189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-abc25d5e-a75c-4aea-b1df-54c8814dd443 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:37.137813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-abc25d5e-a75c-4aea-b1df-54c8814dd443 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:37.152181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abc25d5e-a75c-4aea-b1df-54c8814dd443 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:37.153074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abc25d5e-a75c-4aea-b1df-54c8814dd443 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:37.154175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abc25d5e-a75c-4aea-b1df-54c8814dd443 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:37.154849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abc25d5e-a75c-4aea-b1df-54c8814dd443 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:37.476568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-abc25d5e-a75c-4aea-b1df-54c8814dd443 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:37.502382 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-abc25d5e-a75c-4aea-b1df-54c8814dd443 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1309 microversion: 2.1 time: 0.368129 May 28 21:16:37.504507 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1775/3602] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:37 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1309 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:37.916397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bed6af35-24ec-4e44-af17-6a2c01028059 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Action: 'create', calling method: .version_select at 0x7f4d69c19700>, body: {"keypair": {"name": "tempest-keypair-653553738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNImfNFwMMd7wl5hc7j272vWFZUEaC5L4YHOaf8SNc8sjxbgmUMjYW8nG41sYT+0kPn47Ma/A3omIugnK/nswq8BZ4/T82DOu+aWLQZsonpg7tExHz9UchQg+DDkBle1/g=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:37.943318 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-bed6af35-24ec-4e44-af17-6a2c01028059 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:16:37.973197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-bed6af35-24ec-4e44-af17-6a2c01028059 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for user 45c035c80888410ba53f9834fda06f2c and project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:16:38.105225 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bed6af35-24ec-4e44-af17-6a2c01028059 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.396421 May 28 21:16:38.106136 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1828/3603] 10.222.0.33 () {62 vars in 1198 bytes} [Sat May 28 21:16:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 398 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 28 21:16:38.117629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-11d4a114-2c9e-4fec-9571-3e79782c689a tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Calling method '.version_select at 0x7f4d57a364c0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:38.125609 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-11d4a114-2c9e-4fec-9571-3e79782c689a tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-653553738" status: 200 len: 512 microversion: 2.2 time: 0.012776 May 28 21:16:38.127783 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1776/3604] 10.222.0.33 () {60 vars in 1254 bytes} [Sat May 28 21:16:38 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-653553738 => generated 512 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:38.149220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-22300f9e-e8de-487e-b9b4-5c4a9d4f39f7 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Calling method '.version_select at 0x7f4d57ed64c0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:38.276080 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-22300f9e-e8de-487e-b9b4-5c4a9d4f39f7 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-653553738" status: 204 len: 0 microversion: 2.2 time: 0.132383 May 28 21:16:38.277760 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1829/3605] 10.222.0.33 () {60 vars in 1257 bytes} [Sat May 28 21:16:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-653553738 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:16:38.297950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-85b4408a-6fdb-40c3-8206-2c9d9fb963d8 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Action: 'create', calling method: .version_select at 0x7f4d5754c160>, body: {"keypair": {"name": "tempest-keypair-1004836744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYU6Nn2dY8JjQjb2QmEFALlzjQeP2hjLpDHZCKJyNJOIubqIPjCxW3scjFT7SjzdDTq0YQ2/3j/AvOZCKGT7fQA64N7YACLcDzYcoxfmyRoRTbVXKcYhojHbiRKkQLefg=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:38.314386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-85b4408a-6fdb-40c3-8206-2c9d9fb963d8 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:16:38.321226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-85b4408a-6fdb-40c3-8206-2c9d9fb963d8 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for user 45c035c80888410ba53f9834fda06f2c and project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:16:38.483871 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-85b4408a-6fdb-40c3-8206-2c9d9fb963d8 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.190335 May 28 21:16:38.488757 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1777/3606] 10.222.0.33 () {62 vars in 1198 bytes} [Sat May 28 21:16:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 192 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) May 28 21:16:38.494821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-efca87ec-ab93-4aad-9e01-780719d09e6d tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Calling method '.version_select at 0x7f4d5779fee0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:38.527550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-710fe73b-5cc9-4e6e-9464-521e50a5d939 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:38.528210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-710fe73b-5cc9-4e6e-9464-521e50a5d939 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:38.547385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-710fe73b-5cc9-4e6e-9464-521e50a5d939 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:38.550461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-710fe73b-5cc9-4e6e-9464-521e50a5d939 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:38.552805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-710fe73b-5cc9-4e6e-9464-521e50a5d939 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:38.553950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-710fe73b-5cc9-4e6e-9464-521e50a5d939 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:38.590525 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-efca87ec-ab93-4aad-9e01-780719d09e6d tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1004836744" status: 204 len: 0 microversion: 2.2 time: 0.099475 May 28 21:16:38.591328 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1830/3607] 10.222.0.33 () {60 vars in 1260 bytes} [Sat May 28 21:16:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1004836744 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:16:38.605295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-1fa5dbb1-fee0-4218-88c5-32a3ab58432d req-6b0bf25d-dc8d-48a1-b428-9486eb97dfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c85c17-a3ea-418f-871d-e4541573a775", "tag": "9636ab82-7633-4ecc-9e40-0b9dfe5e696b"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:38.640968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1fa5dbb1-fee0-4218-88c5-32a3ab58432d req-6b0bf25d-dc8d-48a1-b428-9486eb97dfd7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:38.642074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1fa5dbb1-fee0-4218-88c5-32a3ab58432d req-6b0bf25d-dc8d-48a1-b428-9486eb97dfd7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:38.661477 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-1fa5dbb1-fee0-4218-88c5-32a3ab58432d req-6b0bf25d-dc8d-48a1-b428-9486eb97dfd7 service nova] Creating event network-changed:9636ab82-7633-4ecc-9e40-0b9dfe5e696b for instance 86c85c17-a3ea-418f-871d-e4541573a775 on nch2-master-1 May 28 21:16:38.688607 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-1fa5dbb1-fee0-4218-88c5-32a3ab58432d req-6b0bf25d-dc8d-48a1-b428-9486eb97dfd7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094111 May 28 21:16:38.691083 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1831/3608] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:38.698465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7a003f8a-69dc-40e5-b180-20fb7ca2abe8 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Action: 'create', calling method: .version_select at 0x7f4d69c1b0d0>, body: {"keypair": {"name": "tempest-keypair-331032475", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:38.744256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-7a003f8a-69dc-40e5-b180-20fb7ca2abe8 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:16:38.754027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-7a003f8a-69dc-40e5-b180-20fb7ca2abe8 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for user 45c035c80888410ba53f9834fda06f2c and project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:16:38.889502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-710fe73b-5cc9-4e6e-9464-521e50a5d939 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:38.898600 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-710fe73b-5cc9-4e6e-9464-521e50a5d939 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1309 microversion: 2.1 time: 0.380287 May 28 21:16:38.899239 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1778/3609] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:38 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1309 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:38.916452 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7a003f8a-69dc-40e5-b180-20fb7ca2abe8 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.223576 May 28 21:16:38.917780 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1832/3610] 10.222.0.33 () {62 vars in 1198 bytes} [Sat May 28 21:16:38 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 225 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 28 21:16:38.927124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bac31ad8-55f6-4a60-ae83-7d277ce37f69 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Calling method '.version_select at 0x7f4d57a12940>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:39.071377 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bac31ad8-55f6-4a60-ae83-7d277ce37f69 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-331032475" status: 204 len: 0 microversion: 2.2 time: 0.148217 May 28 21:16:39.073297 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1779/3611] 10.222.0.33 () {60 vars in 1257 bytes} [Sat May 28 21:16:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-331032475 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:16:39.093411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2380c1cb-86ce-40df-bc25-79ef7d0b3fb4 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Action: 'create', calling method: .version_select at 0x7f4d57867d30>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-709595680", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBActnHoDD4rQJCfF2Gjv7PPlmnQR7EH4pVwW0S6hgRCxTn6tni2IBUuNbWPZtDtlZMRxA2UZy/pGkFLneyyci6U76BFPYLi+LfWkevL9AG/fdIfZ0HGGd5lCYRFQCYMCDg=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:39.114502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-2380c1cb-86ce-40df-bc25-79ef7d0b3fb4 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:16:39.121255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-2380c1cb-86ce-40df-bc25-79ef7d0b3fb4 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for user 45c035c80888410ba53f9834fda06f2c and project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:16:39.160259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:39.255149 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2380c1cb-86ce-40df-bc25-79ef7d0b3fb4 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.170882 May 28 21:16:39.256088 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1833/3612] 10.222.0.33 () {62 vars in 1198 bytes} [Sat May 28 21:16:39 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 176 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 28 21:16:39.269476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a5d80b49-790e-4a5e-8567-d226a4520d8a tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Action: 'create', calling method: .version_select at 0x7f4d57fb8dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1449505975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQDT0qJWiXC0ghL/RBdeePpkrzvGwU7kjqPD9T5diSXNkcsEUn/QduyySnNl+gp2FsRQ3uaWHLSUgZOWMfKC1NJ9ODofQPJp5H1UJ8OiJeAxp5rzBDyRHsFWSwRV5ihBg=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:39.287506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-a5d80b49-790e-4a5e-8567-d226a4520d8a tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:16:39.293968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-a5d80b49-790e-4a5e-8567-d226a4520d8a tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for user 45c035c80888410ba53f9834fda06f2c and project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:16:39.430988 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a5d80b49-790e-4a5e-8567-d226a4520d8a tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.166110 May 28 21:16:39.434418 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1780/3613] 10.222.0.33 () {62 vars in 1198 bytes} [Sat May 28 21:16:39 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 168 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 28 21:16:39.444857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c83b661f-a59b-4360-b666-b79136f7226d tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Action: 'create', calling method: .version_select at 0x7f4d69c1b310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2081507832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuBXfe5TslaThddv6Oe6CNOkNQPooPqKsTMxTjTWn4TOb1ZLxvORB3v0hUQuJWYw7A5rvmt9+BbDsESk9mM/9HFBctQjXKJdzOMkn5PZnUEZJJTmnT8HgPVV2UgA2hkdw=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:39.460249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-c83b661f-a59b-4360-b666-b79136f7226d tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:16:39.465826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-c83b661f-a59b-4360-b666-b79136f7226d tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for user 45c035c80888410ba53f9834fda06f2c and project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:16:39.619086 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c83b661f-a59b-4360-b666-b79136f7226d tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.178734 May 28 21:16:39.620706 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1834/3614] 10.222.0.33 () {62 vars in 1198 bytes} [Sat May 28 21:16:39 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) May 28 21:16:39.629910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2055e12d-710e-486e-8d3c-f37d8827d284 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Calling method '.version_select at 0x7f4d57a36f70>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:39.633243 ncdv-master-1 devstack@n-api.service[143128]: WARNING oslo_db.sqlalchemy.utils [None req-2055e12d-710e-486e-8d3c-f37d8827d284 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Unique keys not in sort_keys. The sorting order may be unstable. May 28 21:16:39.642272 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2055e12d-710e-486e-8d3c-f37d8827d284 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.016247 May 28 21:16:39.643753 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1781/3615] 10.222.0.33 () {60 vars in 1176 bytes} [Sat May 28 21:16:39 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:39.654166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-26a21760-90e3-4b72-89ae-e8abd38d81bc tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Calling method '.version_select at 0x7f4d57757790>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:39.825210 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-26a21760-90e3-4b72-89ae-e8abd38d81bc tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2081507832" status: 204 len: 0 microversion: 2.2 time: 0.175529 May 28 21:16:39.827666 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1835/3616] 10.222.0.33 () {60 vars in 1320 bytes} [Sat May 28 21:16:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2081507832 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:16:39.843016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b1093f13-1aae-4ac1-8ae5-156d4e9801ba tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Calling method '.version_select at 0x7f4d64566700>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:39.916442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-182da128-bda2-4c70-8521-ebc9c2937c7c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:39.918026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-182da128-bda2-4c70-8521-ebc9c2937c7c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:39.926028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-182da128-bda2-4c70-8521-ebc9c2937c7c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:39.926489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-182da128-bda2-4c70-8521-ebc9c2937c7c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:39.927834 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-182da128-bda2-4c70-8521-ebc9c2937c7c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:39.928279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-182da128-bda2-4c70-8521-ebc9c2937c7c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:39.938977 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b1093f13-1aae-4ac1-8ae5-156d4e9801ba tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1449505975" status: 204 len: 0 microversion: 2.2 time: 0.107383 May 28 21:16:39.939816 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1782/3617] 10.222.0.33 () {60 vars in 1320 bytes} [Sat May 28 21:16:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1449505975 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:16:39.952607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7ab6bce4-e14c-415e-b321-fbc278c53f51 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Calling method '.version_select at 0x7f4d57971040>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:40.048395 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7ab6bce4-e14c-415e-b321-fbc278c53f51 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-709595680" status: 204 len: 0 microversion: 2.2 time: 0.099782 May 28 21:16:40.049603 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1783/3618] 10.222.0.33 () {60 vars in 1317 bytes} [Sat May 28 21:16:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-709595680 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:16:40.070460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2588d111-2999-4b10-8c93-27d08027579a tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Action: 'create', calling method: .version_select at 0x7f4d57971d30>, body: {"keypair": {"name": "tempest-keypair-1447366543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLK/92F2/wq44NGOlTMUTpiZRoUYmqE5VTDGCooDJ3/qPoHzs3l86a9pBYF8fNQA/pWYcZC3/nBMqmdve3eSC90fBJqNPg/9f1dAJVR8aJ4U4NiD3YOJOgAjk5X1Eb0RvA=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:40.089800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-2588d111-2999-4b10-8c93-27d08027579a tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:16:40.095289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-2588d111-2999-4b10-8c93-27d08027579a tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for user 45c035c80888410ba53f9834fda06f2c and project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:16:40.174003 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2588d111-2999-4b10-8c93-27d08027579a tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.109223 May 28 21:16:40.174837 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1784/3619] 10.222.0.33 () {62 vars in 1198 bytes} [Sat May 28 21:16:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) May 28 21:16:40.186604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f091358f-dfbd-4fa4-91f6-0b6195df439a tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Calling method '.version_select at 0x7f4d64566820>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:40.194229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-182da128-bda2-4c70-8521-ebc9c2937c7c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:40.197857 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f091358f-dfbd-4fa4-91f6-0b6195df439a tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1447366543" status: 200 len: 513 microversion: 2.2 time: 0.015070 May 28 21:16:40.198678 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1785/3620] 10.222.0.33 () {60 vars in 1257 bytes} [Sat May 28 21:16:40 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1447366543 => generated 513 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:16:40.210537 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-182da128-bda2-4c70-8521-ebc9c2937c7c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1309 microversion: 2.1 time: 0.299021 May 28 21:16:40.210718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e4f65745-9e30-40c1-aa35-55e3259b07f7 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Calling method '.version_select at 0x7f4d57a36160>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:40.212248 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1836/3621] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:39 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1309 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:40.222716 ncdv-master-1 devstack@n-api.service[143128]: WARNING oslo_db.sqlalchemy.utils [None req-e4f65745-9e30-40c1-aa35-55e3259b07f7 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Unique keys not in sort_keys. The sorting order may be unstable. May 28 21:16:40.228543 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e4f65745-9e30-40c1-aa35-55e3259b07f7 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.023037 May 28 21:16:40.229124 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1786/3622] 10.222.0.33 () {60 vars in 1176 bytes} [Sat May 28 21:16:40 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:16:40.239253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fee98d8c-6bb0-4a8e-93ca-f5db0ab2bbc5 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Calling method '.version_select at 0x7f4d69c1b3a0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:40.340046 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fee98d8c-6bb0-4a8e-93ca-f5db0ab2bbc5 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447366543" status: 204 len: 0 microversion: 2.2 time: 0.103643 May 28 21:16:40.340648 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1837/3623] 10.222.0.33 () {60 vars in 1260 bytes} [Sat May 28 21:16:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1447366543 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:16:40.353126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6bd7666c-00f0-469b-af7e-ab940aa1e345 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Action: 'create', calling method: .version_select at 0x7f4d579a29d0>, body: {"keypair": {"name": "tempest-keypair-1097278712", "type": "x509"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:40.372947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-6bd7666c-00f0-469b-af7e-ab940aa1e345 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:16:40.378390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-6bd7666c-00f0-469b-af7e-ab940aa1e345 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for user 45c035c80888410ba53f9834fda06f2c and project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:16:40.394821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.processutils [None req-6bd7666c-00f0-469b-af7e-ab940aa1e345 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp5srqwad3/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp5srqwad3/temp.key -subj /CN=45c035c80888410ba53f9834fda06f2c -extensions v3_req_client {{(pid=143128) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 28 21:16:41.058277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.processutils [None req-6bd7666c-00f0-469b-af7e-ab940aa1e345 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp5srqwad3/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp5srqwad3/temp.key -subj /CN=45c035c80888410ba53f9834fda06f2c -extensions v3_req_client" returned: 0 in 0.659s {{(pid=143128) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 28 21:16:41.060372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.processutils [None req-6bd7666c-00f0-469b-af7e-ab940aa1e345 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp5srqwad3/temp.key -password pass: {{(pid=143128) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} May 28 21:16:41.125181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.processutils [None req-6bd7666c-00f0-469b-af7e-ab940aa1e345 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp5srqwad3/temp.key -password pass:" returned: 0 in 0.064s {{(pid=143128) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} May 28 21:16:41.237746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-689938c7-08d3-484d-bdb5-5d2ff7c36c63 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:41.237746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-689938c7-08d3-484d-bdb5-5d2ff7c36c63 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:41.249868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-689938c7-08d3-484d-bdb5-5d2ff7c36c63 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:41.250360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-689938c7-08d3-484d-bdb5-5d2ff7c36c63 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:41.251171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-689938c7-08d3-484d-bdb5-5d2ff7c36c63 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:41.251758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-689938c7-08d3-484d-bdb5-5d2ff7c36c63 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:41.271285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-6bd7666c-00f0-469b-af7e-ab940aa1e345 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:16:41.277013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-6bd7666c-00f0-469b-af7e-ab940aa1e345 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Getting quotas for user 45c035c80888410ba53f9834fda06f2c and project f97101c788064513a47e7a3ad8611ce5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:16:41.297241 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6bd7666c-00f0-469b-af7e-ab940aa1e345 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.949987 May 28 21:16:41.298957 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1787/3624] 10.222.0.33 () {62 vars in 1197 bytes} [Sat May 28 21:16:40 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 953 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) May 28 21:16:41.313395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-08f112e0-f0f6-44dd-96ae-6760fcda2544 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Calling method '.version_select at 0x7f4d579a2af0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:41.322263 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-08f112e0-f0f6-44dd-96ae-6760fcda2544 tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs/tempest-keypair-1097278712" status: 200 len: 1534 microversion: 2.2 time: 0.014945 May 28 21:16:41.328403 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1788/3625] 10.222.0.33 () {60 vars in 1257 bytes} [Sat May 28 21:16:41 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1097278712 => generated 1534 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:41.334049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-62006bb6-b02a-4b40-92b3-91727842343d tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Calling method '.version_select at 0x7f4d641ad790>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:41.336839 ncdv-master-1 devstack@n-api.service[143128]: WARNING oslo_db.sqlalchemy.utils [None req-62006bb6-b02a-4b40-92b3-91727842343d tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Unique keys not in sort_keys. The sorting order may be unstable. May 28 21:16:41.342384 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-62006bb6-b02a-4b40-92b3-91727842343d tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.012871 May 28 21:16:41.347618 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1789/3626] 10.222.0.33 () {60 vars in 1176 bytes} [Sat May 28 21:16:41 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:41.353488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6c3e57d3-c632-432c-a61d-0b9dca822b3b tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] Calling method '.version_select at 0x7f4d579dc5e0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:41.359718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:41.425003 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6c3e57d3-c632-432c-a61d-0b9dca822b3b tempest-KeyPairsV22TestJSON-867230965 tempest-KeyPairsV22TestJSON-867230965-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1097278712" status: 204 len: 0 microversion: 2.2 time: 0.076014 May 28 21:16:41.426097 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1790/3627] 10.222.0.33 () {60 vars in 1260 bytes} [Sat May 28 21:16:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1097278712 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:16:41.632709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-689938c7-08d3-484d-bdb5-5d2ff7c36c63 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:41.643874 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-689938c7-08d3-484d-bdb5-5d2ff7c36c63 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1309 microversion: 2.1 time: 0.415328 May 28 21:16:41.643874 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1838/3628] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:41 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1309 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:42.664422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-385d7510-71c1-4d42-834d-63527bc6d984 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:42.664422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-385d7510-71c1-4d42-834d-63527bc6d984 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:42.666531 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:42.673633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-385d7510-71c1-4d42-834d-63527bc6d984 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:42.674500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-385d7510-71c1-4d42-834d-63527bc6d984 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:42.675575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-385d7510-71c1-4d42-834d-63527bc6d984 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:42.676259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-385d7510-71c1-4d42-834d-63527bc6d984 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:42.839728 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-385d7510-71c1-4d42-834d-63527bc6d984 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:42.848010 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-385d7510-71c1-4d42-834d-63527bc6d984 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1309 microversion: 2.1 time: 0.192524 May 28 21:16:42.858293 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1791/3629] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:42 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1309 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:42.948543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-b4fd7898-f8c3-4143-b4ea-6c5f5043b1a7 req-548b4c1f-6b98-43db-8b2b-2f43af04f7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c85c17-a3ea-418f-871d-e4541573a775", "name": "network-vif-plugged", "status": "completed", "tag": "9636ab82-7633-4ecc-9e40-0b9dfe5e696b"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:42.962509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b4fd7898-f8c3-4143-b4ea-6c5f5043b1a7 req-548b4c1f-6b98-43db-8b2b-2f43af04f7fb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:42.963420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b4fd7898-f8c3-4143-b4ea-6c5f5043b1a7 req-548b4c1f-6b98-43db-8b2b-2f43af04f7fb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:42.979852 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b4fd7898-f8c3-4143-b4ea-6c5f5043b1a7 req-548b4c1f-6b98-43db-8b2b-2f43af04f7fb service nova] Creating event network-vif-plugged:9636ab82-7633-4ecc-9e40-0b9dfe5e696b for instance 86c85c17-a3ea-418f-871d-e4541573a775 on nch2-master-1 May 28 21:16:42.986617 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-b4fd7898-f8c3-4143-b4ea-6c5f5043b1a7 req-548b4c1f-6b98-43db-8b2b-2f43af04f7fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050003 May 28 21:16:42.987816 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1839/3630] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:43.869038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-11c13f7d-7805-45f0-a43d-ce19b60e0853 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:43.871640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-11c13f7d-7805-45f0-a43d-ce19b60e0853 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:43.886718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11c13f7d-7805-45f0-a43d-ce19b60e0853 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:43.891389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11c13f7d-7805-45f0-a43d-ce19b60e0853 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:43.895633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11c13f7d-7805-45f0-a43d-ce19b60e0853 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:43.895633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11c13f7d-7805-45f0-a43d-ce19b60e0853 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:44.082367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-11c13f7d-7805-45f0-a43d-ce19b60e0853 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:44.092708 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-11c13f7d-7805-45f0-a43d-ce19b60e0853 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1309 microversion: 2.1 time: 0.229942 May 28 21:16:44.100176 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1792/3631] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:43 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1309 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:45.112060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2b1fd844-8dcf-4d82-9bda-a5c326690f8f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:45.113300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2b1fd844-8dcf-4d82-9bda-a5c326690f8f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:45.126507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b1fd844-8dcf-4d82-9bda-a5c326690f8f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:45.132233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b1fd844-8dcf-4d82-9bda-a5c326690f8f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:45.133436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b1fd844-8dcf-4d82-9bda-a5c326690f8f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:45.134261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b1fd844-8dcf-4d82-9bda-a5c326690f8f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:45.414783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2b1fd844-8dcf-4d82-9bda-a5c326690f8f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:45.423253 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2b1fd844-8dcf-4d82-9bda-a5c326690f8f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1490 microversion: 2.1 time: 0.315935 May 28 21:16:45.432900 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1840/3632] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:45 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1490 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:45.444260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f495768a-f4ff-43e4-b9e7-9d0fdb9fd4d9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:45.445618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f495768a-f4ff-43e4-b9e7-9d0fdb9fd4d9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:45.452638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f495768a-f4ff-43e4-b9e7-9d0fdb9fd4d9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:45.453094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f495768a-f4ff-43e4-b9e7-9d0fdb9fd4d9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:45.453874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f495768a-f4ff-43e4-b9e7-9d0fdb9fd4d9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:45.454338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f495768a-f4ff-43e4-b9e7-9d0fdb9fd4d9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:45.634832 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f495768a-f4ff-43e4-b9e7-9d0fdb9fd4d9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "PUT /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1085 microversion: 2.1 time: 0.195405 May 28 21:16:45.636143 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1793/3633] 10.222.0.33 () {60 vars in 1255 bytes} [Sat May 28 21:16:45 2022] PUT /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1085 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:45.650710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ffc85f81-53e3-4bb4-8ccb-f7503ef69362 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:45.651308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ffc85f81-53e3-4bb4-8ccb-f7503ef69362 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:45.659227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffc85f81-53e3-4bb4-8ccb-f7503ef69362 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:45.661812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffc85f81-53e3-4bb4-8ccb-f7503ef69362 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:45.661812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffc85f81-53e3-4bb4-8ccb-f7503ef69362 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:45.662578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffc85f81-53e3-4bb4-8ccb-f7503ef69362 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:45.891423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ffc85f81-53e3-4bb4-8ccb-f7503ef69362 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:45.903065 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ffc85f81-53e3-4bb4-8ccb-f7503ef69362 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1511 microversion: 2.1 time: 0.257289 May 28 21:16:45.903985 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1841/3634] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:45 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1511 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:45.919412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ffd6d7e3-6f69-4e9c-b024-f33ef11f97d1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:45.920219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ffd6d7e3-6f69-4e9c-b024-f33ef11f97d1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:45.928338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ffd6d7e3-6f69-4e9c-b024-f33ef11f97d1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:45.928950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ffd6d7e3-6f69-4e9c-b024-f33ef11f97d1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:45.930104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ffd6d7e3-6f69-4e9c-b024-f33ef11f97d1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:45.930842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ffd6d7e3-6f69-4e9c-b024-f33ef11f97d1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:46.137739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ffd6d7e3-6f69-4e9c-b024-f33ef11f97d1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:46.143812 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ffd6d7e3-6f69-4e9c-b024-f33ef11f97d1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1511 microversion: 2.1 time: 0.228647 May 28 21:16:46.147608 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1794/3635] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:45 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1511 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:46.160615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2fc6f503-ebe4-4b98-a283-66ab0eed7f45 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:46.161240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2fc6f503-ebe4-4b98-a283-66ab0eed7f45 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:46.169365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2fc6f503-ebe4-4b98-a283-66ab0eed7f45 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:46.170607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2fc6f503-ebe4-4b98-a283-66ab0eed7f45 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:46.171976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2fc6f503-ebe4-4b98-a283-66ab0eed7f45 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:46.172669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2fc6f503-ebe4-4b98-a283-66ab0eed7f45 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:46.207120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8eb460be-26a5-4f3a-830b-7557506ba855 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Action: 'create', calling method: .version_select at 0x7f4d69c2d160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-995328416", "description": "tempest-description-2068937639"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:46.221491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2fc6f503-ebe4-4b98-a283-66ab0eed7f45 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:16:46.226372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:46.677044 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2fc6f503-ebe4-4b98-a283-66ab0eed7f45 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 204 len: 0 microversion: 2.1 time: 0.518937 May 28 21:16:46.677044 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1795/3636] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:16:46 2022] DELETE /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:16:46.685552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e0969262-a048-4b45-a416-18de3c36fa83 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:46.687285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e0969262-a048-4b45-a416-18de3c36fa83 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:46.696336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0969262-a048-4b45-a416-18de3c36fa83 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:46.699098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0969262-a048-4b45-a416-18de3c36fa83 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:46.700763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0969262-a048-4b45-a416-18de3c36fa83 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:46.701365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0969262-a048-4b45-a416-18de3c36fa83 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:46.943411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e0969262-a048-4b45-a416-18de3c36fa83 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:46.951729 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e0969262-a048-4b45-a416-18de3c36fa83 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1517 microversion: 2.1 time: 0.270772 May 28 21:16:46.952517 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1796/3637] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:46 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1517 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:47.126640 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8eb460be-26a5-4f3a-830b-7557506ba855 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.099432 May 28 21:16:47.127280 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1842/3638] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:16:46 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:16:47.139229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-46293723-b34c-4db4-ac26-85dcb6456675 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Action: 'create', calling method: .version_select at 0x7f4d64188790>, body: {"security_group_rule": {"parent_group_id": "51a6b801-a9aa-4a8c-8b1e-112a4bcc0145", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:47.774810 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-46293723-b34c-4db4-ac26-85dcb6456675 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.639765 May 28 21:16:47.776072 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1797/3639] 10.222.0.33 () {60 vars in 1194 bytes} [Sat May 28 21:16:47 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:47.792430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-13043107-2b9f-4651-be71-35248ae68d38 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Action: 'create', calling method: .version_select at 0x7f4d5779fc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1639626296", "description": "tempest-description-1432954759"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:47.978912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7c6b25f7-576f-4c57-9f3a-2cb88d3a386c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:47.979551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7c6b25f7-576f-4c57-9f3a-2cb88d3a386c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:47.999134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c6b25f7-576f-4c57-9f3a-2cb88d3a386c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:48.000055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c6b25f7-576f-4c57-9f3a-2cb88d3a386c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:48.001295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c6b25f7-576f-4c57-9f3a-2cb88d3a386c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:48.002024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c6b25f7-576f-4c57-9f3a-2cb88d3a386c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:48.330554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7c6b25f7-576f-4c57-9f3a-2cb88d3a386c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:48.356582 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7c6b25f7-576f-4c57-9f3a-2cb88d3a386c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1517 microversion: 2.1 time: 0.389745 May 28 21:16:48.357206 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1798/3640] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:47 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1517 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:48.485585 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-13043107-2b9f-4651-be71-35248ae68d38 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.697837 May 28 21:16:48.485585 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1843/3641] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:16:47 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:48.497001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b428d99a-6e46-4254-bd25-80a96b600f42 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Action: 'create', calling method: .version_select at 0x7f4d57a129d0>, body: {"security_group_rule": {"parent_group_id": "3dcb0c6b-7e42-494f-a6ef-b8819418200b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:48.851779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-94d9515e-810d-484a-8837-c9d83f1a5bfb req-03043a7c-7d3d-4221-856e-5791b4fcc4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c85c17-a3ea-418f-871d-e4541573a775", "name": "network-vif-deleted", "tag": "9636ab82-7633-4ecc-9e40-0b9dfe5e696b"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:48.875970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-94d9515e-810d-484a-8837-c9d83f1a5bfb req-03043a7c-7d3d-4221-856e-5791b4fcc4e6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:48.876709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-94d9515e-810d-484a-8837-c9d83f1a5bfb req-03043a7c-7d3d-4221-856e-5791b4fcc4e6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:48.897030 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-94d9515e-810d-484a-8837-c9d83f1a5bfb req-03043a7c-7d3d-4221-856e-5791b4fcc4e6 service nova] Creating event network-vif-deleted:9636ab82-7633-4ecc-9e40-0b9dfe5e696b for instance 86c85c17-a3ea-418f-871d-e4541573a775 on nch2-master-1 May 28 21:16:48.902318 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-94d9515e-810d-484a-8837-c9d83f1a5bfb req-03043a7c-7d3d-4221-856e-5791b4fcc4e6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059909 May 28 21:16:48.907296 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1844/3642] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:49.033542 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b428d99a-6e46-4254-bd25-80a96b600f42 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.542964 May 28 21:16:49.034233 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1799/3643] 10.222.0.33 () {60 vars in 1194 bytes} [Sat May 28 21:16:48 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:49.049750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cb8d2b96-8eff-4ddf-876e-4a0531331db8 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Action: 'create', calling method: .version_select at 0x7f4d57875ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-842401974", "description": "tempest-description-327310700"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:49.374628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0dcd13d0-cbab-452e-90f8-9281f94c9b80 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:49.375454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0dcd13d0-cbab-452e-90f8-9281f94c9b80 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:49.381995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0dcd13d0-cbab-452e-90f8-9281f94c9b80 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:49.382458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0dcd13d0-cbab-452e-90f8-9281f94c9b80 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:49.391367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0dcd13d0-cbab-452e-90f8-9281f94c9b80 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:49.391985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0dcd13d0-cbab-452e-90f8-9281f94c9b80 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:49.438255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0dcd13d0-cbab-452e-90f8-9281f94c9b80 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:49.438730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0dcd13d0-cbab-452e-90f8-9281f94c9b80 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:49.439197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-0dcd13d0-cbab-452e-90f8-9281f94c9b80 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lazy-loading 'fault' on Instance uuid 86c85c17-a3ea-418f-871d-e4541573a775 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:16:49.477566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=18 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:49.503619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0dcd13d0-cbab-452e-90f8-9281f94c9b80 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:49.514395 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0dcd13d0-cbab-452e-90f8-9281f94c9b80 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 200 len: 1320 microversion: 2.1 time: 0.143049 May 28 21:16:49.518096 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1800/3644] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:49 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 1320 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:49.612275 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cb8d2b96-8eff-4ddf-876e-4a0531331db8 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.566916 May 28 21:16:49.613378 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1845/3645] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:16:49 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:49.625601 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-126fab28-4c9b-475b-be6b-f504b9add3ca tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Action: 'create', calling method: .version_select at 0x7f4d69d063a0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-421964958", "description": "tempest-description-492062089"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:50.202099 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-126fab28-4c9b-475b-be6b-f504b9add3ca tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.580858 May 28 21:16:50.203854 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1801/3646] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:16:49 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:50.218374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c8d83f4b-fb74-4e44-8cdf-844743c81e0b tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Action: 'create', calling method: .version_select at 0x7f4d69c1b040>, body: {"security_group_rule": {"parent_group_id": "3ba7c822-2ec4-4fe6-a9e2-38c1fe922644", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "6a3a2363-dd77-493f-8fef-07c779270303"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:50.534326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3d2bdde4-2db2-48b0-a8f0-40851b8575a7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:50.535402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3d2bdde4-2db2-48b0-a8f0-40851b8575a7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:50.543511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d2bdde4-2db2-48b0-a8f0-40851b8575a7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:50.553027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d2bdde4-2db2-48b0-a8f0-40851b8575a7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:50.553027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d2bdde4-2db2-48b0-a8f0-40851b8575a7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:50.553027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d2bdde4-2db2-48b0-a8f0-40851b8575a7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:50.566381 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-3d2bdde4-2db2-48b0-a8f0-40851b8575a7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3d2bdde4-2db2-48b0-a8f0-40851b8575a7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 HTTP/1.1 May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '86c85c17-a3ea-418f-871d-e4541573a775'} May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:50.568664 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:50.573358 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:16:50.573358 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:16:50.573358 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:16:50.573358 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:16:50.573358 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. May 28 21:16:50.573358 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:50.573358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3d2bdde4-2db2-48b0-a8f0-40851b8575a7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:16:50.573358 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3d2bdde4-2db2-48b0-a8f0-40851b8575a7 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 404 len: 111 microversion: 2.1 time: 0.040564 May 28 21:16:50.573358 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1802/3647] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:50 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:16:50.680253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1255362137", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "ca803b4d-8584-4327-9f76-66ddebb3c209"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:50.742960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] validate_networks() for [('ca803b4d-8584-4327-9f76-66ddebb3c209', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:16:51.053491 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c8d83f4b-fb74-4e44-8cdf-844743c81e0b tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.840443 May 28 21:16:51.054225 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1846/3648] 10.222.0.33 () {60 vars in 1194 bytes} [Sat May 28 21:16:50 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:51.066224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7aa7ef20-14f3-4a65-aa82-9d698f459084 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Action: 'create', calling method: .version_select at 0x7f4d5783a5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1334394368", "description": "tempest-description-1197355234"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:51.285886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=26 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:51.417553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:16:51.418032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:16:51.418519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:16:51.418962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:16:51.419395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:16:51.429129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:51.429591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:51.430701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:51.437253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:51.452313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:16:51.459998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Getting quotas for user 572170ccd67e4facbf10dad7cd1491c1 and project 5905c4b42ecd40298340a8a2ce4d5e24. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:16:51.476586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:16:51.480532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:16:51.655843 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-20ae0752-7183-4913-bc02-759370c6dd9b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980282 May 28 21:16:51.661686 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1803/3649] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:16:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:16:51.666835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5b926bce-b92b-46bf-b57a-58225ebd430e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:51.667460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5b926bce-b92b-46bf-b57a-58225ebd430e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:51.726488 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7aa7ef20-14f3-4a65-aa82-9d698f459084 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.663911 May 28 21:16:51.739858 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1847/3650] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:16:51 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:51.750518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cb176340-0376-4203-ae21-a9bc9654316e tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Action: 'create', calling method: .version_select at 0x7f4d5779f280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-242049300", "description": "tempest-description-1347690889"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:51.783428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5b926bce-b92b-46bf-b57a-58225ebd430e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:51.790793 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5b926bce-b92b-46bf-b57a-58225ebd430e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1209 microversion: 2.1 time: 0.127953 May 28 21:16:51.791931 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1804/3651] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:51 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1209 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:52.742960 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cb176340-0376-4203-ae21-a9bc9654316e tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.000733 May 28 21:16:52.743568 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1848/3652] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:16:51 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:52.754984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-77fbd0aa-024b-424d-b17a-294a8d5ca8b8 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Action: 'create', calling method: .version_select at 0x7f4d64188790>, body: {"security_group_rule": {"parent_group_id": "e4399e56-c371-4140-9948-6db66926e1ce", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "66a3b136-2dc0-4545-b4a3-077fc65db8c4"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:52.811030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2d83f3a1-dce1-4c8b-b847-c107caf5a85f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:52.812333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2d83f3a1-dce1-4c8b-b847-c107caf5a85f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:52.820814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d83f3a1-dce1-4c8b-b847-c107caf5a85f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:52.821659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d83f3a1-dce1-4c8b-b847-c107caf5a85f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:52.823420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d83f3a1-dce1-4c8b-b847-c107caf5a85f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:52.824392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d83f3a1-dce1-4c8b-b847-c107caf5a85f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:52.944614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2d83f3a1-dce1-4c8b-b847-c107caf5a85f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:52.960326 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2d83f3a1-dce1-4c8b-b847-c107caf5a85f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1213 microversion: 2.1 time: 0.156174 May 28 21:16:52.961502 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1849/3653] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:52 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1213 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:53.857661 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-77fbd0aa-024b-424d-b17a-294a8d5ca8b8 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.100431 May 28 21:16:53.865180 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1805/3654] 10.222.0.33 () {60 vars in 1194 bytes} [Sat May 28 21:16:52 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:53.866024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3c8a9ec7-272b-4f07-833a-c11947ba7c79 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Calling method '.version_select at 0x7f4d5779f040>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:53.979357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ab7bc87-4441-4ea2-8bd9-ae6059ab8463 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:53.980035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8ab7bc87-4441-4ea2-8bd9-ae6059ab8463 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:53.994877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ab7bc87-4441-4ea2-8bd9-ae6059ab8463 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:53.995464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ab7bc87-4441-4ea2-8bd9-ae6059ab8463 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:53.996779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ab7bc87-4441-4ea2-8bd9-ae6059ab8463 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:53.997304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ab7bc87-4441-4ea2-8bd9-ae6059ab8463 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:54.182849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8ab7bc87-4441-4ea2-8bd9-ae6059ab8463 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:54.192653 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8ab7bc87-4441-4ea2-8bd9-ae6059ab8463 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1269 microversion: 2.1 time: 0.218674 May 28 21:16:54.193702 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1806/3655] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:53 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1269 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:54.915741 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3c8a9ec7-272b-4f07-833a-c11947ba7c79 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/66a3b136-2dc0-4545-b4a3-077fc65db8c4" status: 202 len: 0 microversion: 2.1 time: 1.054272 May 28 21:16:54.916813 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1850/3656] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:16:53 2022] DELETE /compute/v2.1/os-security-groups/66a3b136-2dc0-4545-b4a3-077fc65db8c4 => generated 0 bytes in 1058 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:16:54.925363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2d6b151a-d451-4c79-99cb-6f64ac6b4c28 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Calling method '.version_select at 0x7f4d643ac670>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:55.165188 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2d6b151a-d451-4c79-99cb-6f64ac6b4c28 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/e4399e56-c371-4140-9948-6db66926e1ce" status: 200 len: 248 microversion: 2.1 time: 0.244007 May 28 21:16:55.166020 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1807/3657] 10.222.0.33 () {58 vars in 1268 bytes} [Sat May 28 21:16:54 2022] GET /compute/v2.1/os-security-groups/e4399e56-c371-4140-9948-6db66926e1ce => generated 248 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:55.180645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-580b4bf6-024a-495b-b84b-23f57051c757 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Action: 'create', calling method: .version_select at 0x7f4d57875280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1383281736", "description": "tempest-description-1635668571"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:55.215913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-05d895e9-837e-41e5-8b15-4db699e5364d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:55.216880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-05d895e9-837e-41e5-8b15-4db699e5364d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:55.224726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-05d895e9-837e-41e5-8b15-4db699e5364d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:55.225696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-05d895e9-837e-41e5-8b15-4db699e5364d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:55.226650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-05d895e9-837e-41e5-8b15-4db699e5364d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:55.227101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-05d895e9-837e-41e5-8b15-4db699e5364d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:55.325551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-05d895e9-837e-41e5-8b15-4db699e5364d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:55.335047 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-05d895e9-837e-41e5-8b15-4db699e5364d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1267 microversion: 2.1 time: 0.123362 May 28 21:16:55.335906 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1808/3658] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:55 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1267 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:56.260850 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-580b4bf6-024a-495b-b84b-23f57051c757 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.085480 May 28 21:16:56.262185 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1851/3659] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:16:55 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:56.274534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ec180dfe-4335-4621-870c-2ad8aeca8c29 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Action: 'create', calling method: .version_select at 0x7f4d57970790>, body: {"security_group_rule": {"parent_group_id": "ce6930dc-a9a7-413f-acb2-2935fa3dbf07", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:56.353962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-93567841-7fba-42cc-808a-2fb8ea8635a9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:56.354587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-93567841-7fba-42cc-808a-2fb8ea8635a9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:56.362092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93567841-7fba-42cc-808a-2fb8ea8635a9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:56.362594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93567841-7fba-42cc-808a-2fb8ea8635a9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:56.363554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93567841-7fba-42cc-808a-2fb8ea8635a9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:56.363999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93567841-7fba-42cc-808a-2fb8ea8635a9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:56.388810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:16:56.709151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-93567841-7fba-42cc-808a-2fb8ea8635a9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:56.718703 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-93567841-7fba-42cc-808a-2fb8ea8635a9 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1309 microversion: 2.1 time: 0.369895 May 28 21:16:56.719599 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1852/3660] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:56 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1309 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:56.993297 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ec180dfe-4335-4621-870c-2ad8aeca8c29 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.723692 May 28 21:16:56.999887 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1809/3661] 10.222.0.33 () {60 vars in 1194 bytes} [Sat May 28 21:16:56 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:57.007269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-74006b5c-fe66-4134-8905-cb04371683ec tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Action: 'create', calling method: .version_select at 0x7f4d57742dc0>, body: {"security_group_rule": {"parent_group_id": "ce6930dc-a9a7-413f-acb2-2935fa3dbf07", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:57.682646 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-74006b5c-fe66-4134-8905-cb04371683ec tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.681409 May 28 21:16:57.683256 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1853/3662] 10.222.0.33 () {60 vars in 1194 bytes} [Sat May 28 21:16:56 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:57.698354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-af278dce-dd66-4da7-ada5-ca4219198bdb tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Calling method '.version_select at 0x7f4d577fb700>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:57.736961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-04c9047a-3ba8-4b6e-89b5-9b79c953d992 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:57.737591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-04c9047a-3ba8-4b6e-89b5-9b79c953d992 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:57.744071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04c9047a-3ba8-4b6e-89b5-9b79c953d992 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:57.744607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04c9047a-3ba8-4b6e-89b5-9b79c953d992 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:57.745458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04c9047a-3ba8-4b6e-89b5-9b79c953d992 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:57.746010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04c9047a-3ba8-4b6e-89b5-9b79c953d992 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:57.884332 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-af278dce-dd66-4da7-ada5-ca4219198bdb tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "GET /compute/v2.1/os-security-groups/ce6930dc-a9a7-413f-acb2-2935fa3dbf07" status: 200 len: 665 microversion: 2.1 time: 0.193562 May 28 21:16:57.891836 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1810/3663] 10.222.0.33 () {58 vars in 1268 bytes} [Sat May 28 21:16:57 2022] GET /compute/v2.1/os-security-groups/ce6930dc-a9a7-413f-acb2-2935fa3dbf07 => generated 665 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:57.891836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-786438a9-3f33-4813-9f1b-663087ba6de0 req-c53bea66-debf-452b-96c9-4c392cfebe79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4597b001-5689-4b06-ba9b-a5a239582fe0", "tag": "30aa1257-4676-4fd6-83a2-caf629e2564b"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:16:57.905857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-786438a9-3f33-4813-9f1b-663087ba6de0 req-c53bea66-debf-452b-96c9-4c392cfebe79 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:57.906511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-786438a9-3f33-4813-9f1b-663087ba6de0 req-c53bea66-debf-452b-96c9-4c392cfebe79 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:57.917710 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-786438a9-3f33-4813-9f1b-663087ba6de0 req-c53bea66-debf-452b-96c9-4c392cfebe79 service nova] Creating event network-changed:30aa1257-4676-4fd6-83a2-caf629e2564b for instance 4597b001-5689-4b06-ba9b-a5a239582fe0 on nch2-master-1 May 28 21:16:57.923591 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-786438a9-3f33-4813-9f1b-663087ba6de0 req-c53bea66-debf-452b-96c9-4c392cfebe79 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036529 May 28 21:16:57.924508 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1811/3664] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:16:57.930550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-87537488-28ca-48d8-97d3-d1e8dcdf4708 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Calling method '.version_select at 0x7f4d578a85e0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:58.161830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-04c9047a-3ba8-4b6e-89b5-9b79c953d992 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:58.166506 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-04c9047a-3ba8-4b6e-89b5-9b79c953d992 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1309 microversion: 2.1 time: 0.433444 May 28 21:16:58.167316 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1854/3665] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:57 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1309 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:16:58.503620 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-87537488-28ca-48d8-97d3-d1e8dcdf4708 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/41191bbd-2e0e-45be-a088-f3db9c0e32e6" status: 202 len: 0 microversion: 2.1 time: 0.577807 May 28 21:16:58.504541 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1812/3666] 10.222.0.33 () {58 vars in 1286 bytes} [Sat May 28 21:16:57 2022] DELETE /compute/v2.1/os-security-group-rules/41191bbd-2e0e-45be-a088-f3db9c0e32e6 => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:16:58.514520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d19df7c2-e737-4378-810e-600f8f09cc93 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Calling method '.version_select at 0x7f4d57f21040>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:59.097990 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d19df7c2-e737-4378-810e-600f8f09cc93 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/ce6930dc-a9a7-413f-acb2-2935fa3dbf07" status: 202 len: 0 microversion: 2.1 time: 0.588319 May 28 21:16:59.099754 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1855/3667] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:16:58 2022] DELETE /compute/v2.1/os-security-groups/ce6930dc-a9a7-413f-acb2-2935fa3dbf07 => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:16:59.108483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6f9f5278-b7e5-4ee5-99d6-7d375d3210ef tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Calling method '.version_select at 0x7f4d57970310>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:59.150663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG neutronclient.v2_0.client [None req-6f9f5278-b7e5-4ee5-99d6-7d375d3210ef tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 66a3b136-2dc0-4545-b4a3-077fc65db8c4 does not exist", "detail": ""}} {{(pid=143128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:16:59.151489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.security_group_api [None req-6f9f5278-b7e5-4ee5-99d6-7d375d3210ef tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Neutron security group 66a3b136-2dc0-4545-b4a3-077fc65db8c4 not found {{(pid=143128) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:16:59.152037 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-6f9f5278-b7e5-4ee5-99d6-7d375d3210ef tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] HTTP exception thrown: Security group 66a3b136-2dc0-4545-b4a3-077fc65db8c4 does not exist May 28 21:16:59.152037 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-ff9cc043-c184-4c70-b140-4d937f42b937'] May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6f9f5278-b7e5-4ee5-99d6-7d375d3210ef tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Request method failure captured: May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-security-groups/66a3b136-2dc0-4545-b4a3-077fc65db8c4 HTTP/1.1 May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpE94mz0FkI67dHDenXhbvk8X_CiZ8hfRv2dVz_dsV12-R4Yot6YWYgvu_f5PPQHQRpVnF1Bxw5F2cavt_OlTVyFFV3tiCPKmUcHTlPl2X_7RBZeFhfBKa9fuzO8a9m6Utu9fK5wk7OCAfSmY_fSmZ_i_-vGpwIr57PAgbrPRiRfXJE May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5e2aed4ec2e74e69bb5eea2e65ab92bb May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1780787247 May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5e2aed4ec2e74e69bb5eea2e65ab92bb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e2aed4ec2e74e69bb5eea2e65ab92bb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5e2aed4ec2e74e69bb5eea2e65ab92bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5e2aed4ec2e74e69bb5eea2e65ab92bb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1780787247 May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5e2aed4ec2e74e69bb5eea2e65ab92bb May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1780787247 May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupRulesTestJSON-1780787247-project May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 665ce91603f24affb78017790130f733 May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1780787247-project May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: exception: Security group 66a3b136-2dc0-4545-b4a3-077fc65db8c4 does not exist May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-ff9cc043-c184-4c70-b140-4d937f42b937'] May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '66a3b136-2dc0-4545-b4a3-077fc65db8c4'} May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:16:59.154420 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 66a3b136-2dc0-4545-b4a3-077fc65db8c4 does not exist May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff9cc043-c184-4c70-b140-4d937f42b937'] May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 66a3b136-2dc0-4545-b4a3-077fc65db8c4 does not exist May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff9cc043-c184-4c70-b140-4d937f42b937'] May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 66a3b136-2dc0-4545-b4a3-077fc65db8c4 does not exist May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff9cc043-c184-4c70-b140-4d937f42b937'] May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 66a3b136-2dc0-4545-b4a3-077fc65db8c4 does not exist May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff9cc043-c184-4c70-b140-4d937f42b937'] May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6f9f5278-b7e5-4ee5-99d6-7d375d3210ef tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Returning 404 to user: Security group 66a3b136-2dc0-4545-b4a3-077fc65db8c4 does not exist May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-ff9cc043-c184-4c70-b140-4d937f42b937'] {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6f9f5278-b7e5-4ee5-99d6-7d375d3210ef tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/66a3b136-2dc0-4545-b4a3-077fc65db8c4" status: 404 len: 194 microversion: 2.1 time: 0.053146 May 28 21:16:59.166304 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1813/3668] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:16:59 2022] DELETE /compute/v2.1/os-security-groups/66a3b136-2dc0-4545-b4a3-077fc65db8c4 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:16:59.173721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0a371075-61f3-4cd8-9086-51a478327514 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Calling method '.version_select at 0x7f4d5783a3a0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:59.185079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7571ccd7-e5d0-498c-9031-d1145dcdb71e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:59.185891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7571ccd7-e5d0-498c-9031-d1145dcdb71e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:16:59.193501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7571ccd7-e5d0-498c-9031-d1145dcdb71e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:59.194640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7571ccd7-e5d0-498c-9031-d1145dcdb71e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:59.195678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7571ccd7-e5d0-498c-9031-d1145dcdb71e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:16:59.196227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7571ccd7-e5d0-498c-9031-d1145dcdb71e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:16:59.398167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7571ccd7-e5d0-498c-9031-d1145dcdb71e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:16:59.408503 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7571ccd7-e5d0-498c-9031-d1145dcdb71e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1309 microversion: 2.1 time: 0.229452 May 28 21:16:59.409372 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1814/3669] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:16:59 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1309 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:16:59.564352 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0a371075-61f3-4cd8-9086-51a478327514 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/e4399e56-c371-4140-9948-6db66926e1ce" status: 202 len: 0 microversion: 2.1 time: 0.390082 May 28 21:16:59.564352 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1856/3670] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:16:59 2022] DELETE /compute/v2.1/os-security-groups/e4399e56-c371-4140-9948-6db66926e1ce => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:16:59.566648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1e08de58-f923-497b-9ece-6b2589e32391 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Calling method '.version_select at 0x7f4d579708b0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:16:59.829948 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1e08de58-f923-497b-9ece-6b2589e32391 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/6a3a2363-dd77-493f-8fef-07c779270303" status: 202 len: 0 microversion: 2.1 time: 0.268524 May 28 21:16:59.834342 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1815/3671] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:16:59 2022] DELETE /compute/v2.1/os-security-groups/6a3a2363-dd77-493f-8fef-07c779270303 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:16:59.841080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0b5c26d3-3f0f-4cd4-b36f-c402d44a997f tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Calling method '.version_select at 0x7f4d69c1b8b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:00.342343 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0b5c26d3-3f0f-4cd4-b36f-c402d44a997f tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/3ba7c822-2ec4-4fe6-a9e2-38c1fe922644" status: 202 len: 0 microversion: 2.1 time: 0.505234 May 28 21:17:00.343313 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1857/3672] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:16:59 2022] DELETE /compute/v2.1/os-security-groups/3ba7c822-2ec4-4fe6-a9e2-38c1fe922644 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:17:00.355876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ae0571cf-2179-4f9f-b69b-84c6b6199cfc tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Calling method '.version_select at 0x7f4d579709d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:00.436080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-16ee2e89-a96e-4a20-aff1-c6d8f0f4e722 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:00.437641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-16ee2e89-a96e-4a20-aff1-c6d8f0f4e722 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:00.449487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-16ee2e89-a96e-4a20-aff1-c6d8f0f4e722 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:00.450316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-16ee2e89-a96e-4a20-aff1-c6d8f0f4e722 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:00.451408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-16ee2e89-a96e-4a20-aff1-c6d8f0f4e722 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:00.452506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-16ee2e89-a96e-4a20-aff1-c6d8f0f4e722 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:01.011193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-16ee2e89-a96e-4a20-aff1-c6d8f0f4e722 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:01.038864 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-16ee2e89-a96e-4a20-aff1-c6d8f0f4e722 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1309 microversion: 2.1 time: 0.614243 May 28 21:17:01.042063 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1858/3673] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:00 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1309 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:01.222234 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ae0571cf-2179-4f9f-b69b-84c6b6199cfc tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/3dcb0c6b-7e42-494f-a6ef-b8819418200b" status: 202 len: 0 microversion: 2.1 time: 0.871869 May 28 21:17:01.226633 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1816/3674] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:17:00 2022] DELETE /compute/v2.1/os-security-groups/3dcb0c6b-7e42-494f-a6ef-b8819418200b => generated 0 bytes in 879 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:17:01.231516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b5588e57-005a-41dc-bc93-c049815f4b74 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] Calling method '.version_select at 0x7f4d57742dc0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:01.497553 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b5588e57-005a-41dc-bc93-c049815f4b74 tempest-SecurityGroupRulesTestJSON-1780787247 tempest-SecurityGroupRulesTestJSON-1780787247-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/51a6b801-a9aa-4a8c-8b1e-112a4bcc0145" status: 202 len: 0 microversion: 2.1 time: 0.266391 May 28 21:17:01.497553 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1859/3675] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:17:01 2022] DELETE /compute/v2.1/os-security-groups/51a6b801-a9aa-4a8c-8b1e-112a4bcc0145 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:17:02.058294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:17:02.059916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:17:02.070944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-37c2f2f9-7660-4a92-b923-3833ff54ad61 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:02.070944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-37c2f2f9-7660-4a92-b923-3833ff54ad61 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:02.079772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37c2f2f9-7660-4a92-b923-3833ff54ad61 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:02.080888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37c2f2f9-7660-4a92-b923-3833ff54ad61 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:02.081781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37c2f2f9-7660-4a92-b923-3833ff54ad61 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:02.082447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37c2f2f9-7660-4a92-b923-3833ff54ad61 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:02.700328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-37c2f2f9-7660-4a92-b923-3833ff54ad61 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:02.724147 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-37c2f2f9-7660-4a92-b923-3833ff54ad61 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1309 microversion: 2.1 time: 0.667029 May 28 21:17:02.725873 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1817/3676] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:02 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1309 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:03.755602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6ff70df3-fe13-4f77-9620-82cb7c8cfba8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:03.755602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6ff70df3-fe13-4f77-9620-82cb7c8cfba8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:03.771987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ff70df3-fe13-4f77-9620-82cb7c8cfba8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:03.773700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ff70df3-fe13-4f77-9620-82cb7c8cfba8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:03.775236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ff70df3-fe13-4f77-9620-82cb7c8cfba8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:03.779111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ff70df3-fe13-4f77-9620-82cb7c8cfba8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:03.992942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c68549e6-e894-4d4f-b402-13ceecb328da tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91db7a6e-9511-44a8-bcd6-90cbdc41f7f0"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:03.994254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c68549e6-e894-4d4f-b402-13ceecb328da tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:04.014705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c68549e6-e894-4d4f-b402-13ceecb328da tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:04.018515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c68549e6-e894-4d4f-b402-13ceecb328da tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:04.021743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c68549e6-e894-4d4f-b402-13ceecb328da tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:04.023274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c68549e6-e894-4d4f-b402-13ceecb328da tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:04.313818 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6ff70df3-fe13-4f77-9620-82cb7c8cfba8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:04.325157 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6ff70df3-fe13-4f77-9620-82cb7c8cfba8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1309 microversion: 2.1 time: 0.586568 May 28 21:17:04.344525 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1860/3677] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:03 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1309 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:05.342349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-51c1d879-b786-47c1-b07d-1a7330ad0b9a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:05.343039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-51c1d879-b786-47c1-b07d-1a7330ad0b9a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:05.354131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51c1d879-b786-47c1-b07d-1a7330ad0b9a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:05.355036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51c1d879-b786-47c1-b07d-1a7330ad0b9a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:05.355924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51c1d879-b786-47c1-b07d-1a7330ad0b9a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:05.356443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51c1d879-b786-47c1-b07d-1a7330ad0b9a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:05.513526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-51c1d879-b786-47c1-b07d-1a7330ad0b9a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:05.540301 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-51c1d879-b786-47c1-b07d-1a7330ad0b9a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1309 microversion: 2.1 time: 0.193242 May 28 21:17:05.540301 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1861/3678] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:05 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1309 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:05.640419 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c68549e6-e894-4d4f-b402-13ceecb328da tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.653536 May 28 21:17:05.648961 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1818/3679] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:17:03 2022] POST /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-volume_attachments => generated 194 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:17:06.555471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-43e91f56-112e-4660-8da0-e3938477ef7e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:06.557536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-43e91f56-112e-4660-8da0-e3938477ef7e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:06.570977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-43e91f56-112e-4660-8da0-e3938477ef7e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:06.571704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-43e91f56-112e-4660-8da0-e3938477ef7e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:06.572919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-43e91f56-112e-4660-8da0-e3938477ef7e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:06.573580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-43e91f56-112e-4660-8da0-e3938477ef7e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:06.847973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-43e91f56-112e-4660-8da0-e3938477ef7e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:06.861460 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-43e91f56-112e-4660-8da0-e3938477ef7e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1309 microversion: 2.1 time: 0.312103 May 28 21:17:06.873028 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1862/3680] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:06 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1309 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:07.224241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-38848469-fb4a-4133-b868-a180f731a825 req-79b96fb1-7e3c-4288-8ce7-93926f2e30e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4597b001-5689-4b06-ba9b-a5a239582fe0", "name": "network-vif-plugged", "status": "completed", "tag": "30aa1257-4676-4fd6-83a2-caf629e2564b"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:07.235247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-38848469-fb4a-4133-b868-a180f731a825 req-79b96fb1-7e3c-4288-8ce7-93926f2e30e8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:07.235703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-38848469-fb4a-4133-b868-a180f731a825 req-79b96fb1-7e3c-4288-8ce7-93926f2e30e8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:07.247303 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-38848469-fb4a-4133-b868-a180f731a825 req-79b96fb1-7e3c-4288-8ce7-93926f2e30e8 service nova] Creating event network-vif-plugged:30aa1257-4676-4fd6-83a2-caf629e2564b for instance 4597b001-5689-4b06-ba9b-a5a239582fe0 on nch2-master-1 May 28 21:17:07.252384 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-38848469-fb4a-4133-b868-a180f731a825 req-79b96fb1-7e3c-4288-8ce7-93926f2e30e8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033645 May 28 21:17:07.253085 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1819/3681] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:07.880350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-95c5079b-e682-4313-b77a-18e4a09a1c3b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:07.881924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-95c5079b-e682-4313-b77a-18e4a09a1c3b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:07.889324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95c5079b-e682-4313-b77a-18e4a09a1c3b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:07.892782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95c5079b-e682-4313-b77a-18e4a09a1c3b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:07.892782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95c5079b-e682-4313-b77a-18e4a09a1c3b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:07.892782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95c5079b-e682-4313-b77a-18e4a09a1c3b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:08.082707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-95c5079b-e682-4313-b77a-18e4a09a1c3b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:08.107575 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-95c5079b-e682-4313-b77a-18e4a09a1c3b tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1309 microversion: 2.1 time: 0.226170 May 28 21:17:08.107575 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1863/3682] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:07 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1309 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:08.584662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3e51895a-6671-47dd-aff3-ebaa5b13208a tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Action: 'create', calling method: .version_select at 0x7f4d57970b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-20316466", "description": "tempest-description-942424447"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:09.106904 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3e51895a-6671-47dd-aff3-ebaa5b13208a tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 253 microversion: 2.1 time: 0.709744 May 28 21:17:09.108023 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1820/3683] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:17:08 2022] POST /compute/v2.1/os-security-groups => generated 253 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:09.119086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3d336de2-682d-4222-adff-463856a7dd30 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Action: 'create', calling method: .version_select at 0x7f4d579a2160>, body: {"security_group_rule": {"parent_group_id": "f06efdfb-5f0f-4924-b3a6-0eb6dd1211f3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:09.119468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-22b60073-6da8-40b7-9714-cafcea672d75 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:09.120168 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-22b60073-6da8-40b7-9714-cafcea672d75 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:09.137099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22b60073-6da8-40b7-9714-cafcea672d75 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:09.144514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22b60073-6da8-40b7-9714-cafcea672d75 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:09.144514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22b60073-6da8-40b7-9714-cafcea672d75 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:09.144514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22b60073-6da8-40b7-9714-cafcea672d75 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:09.320979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-22b60073-6da8-40b7-9714-cafcea672d75 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:09.329711 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-22b60073-6da8-40b7-9714-cafcea672d75 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1491 microversion: 2.1 time: 0.214423 May 28 21:17:09.330326 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1864/3684] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:09 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1491 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:09.352259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ddf23068-d88a-40e9-af78-e0fed09a49ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1357218516"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:09.353465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ddf23068-d88a-40e9-af78-e0fed09a49ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:09.360046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddf23068-d88a-40e9-af78-e0fed09a49ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:09.360502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddf23068-d88a-40e9-af78-e0fed09a49ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:09.361286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddf23068-d88a-40e9-af78-e0fed09a49ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:09.361721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddf23068-d88a-40e9-af78-e0fed09a49ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:09.558224 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ddf23068-d88a-40e9-af78-e0fed09a49ac tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "PUT /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1076 microversion: 2.1 time: 0.210407 May 28 21:17:09.558939 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1865/3685] 10.222.0.33 () {60 vars in 1255 bytes} [Sat May 28 21:17:09 2022] PUT /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1076 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:09.575254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8bca4414-cc7c-4bb2-8397-358eaacd9621 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:09.575877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8bca4414-cc7c-4bb2-8397-358eaacd9621 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:09.584417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bca4414-cc7c-4bb2-8397-358eaacd9621 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:09.584880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bca4414-cc7c-4bb2-8397-358eaacd9621 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:09.586245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bca4414-cc7c-4bb2-8397-358eaacd9621 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:09.586701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bca4414-cc7c-4bb2-8397-358eaacd9621 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:09.694460 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3d336de2-682d-4222-adff-463856a7dd30 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.576843 May 28 21:17:09.694460 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1821/3686] 10.222.0.33 () {60 vars in 1194 bytes} [Sat May 28 21:17:09 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:17:09.704475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-be1d9a67-754c-41a0-9d0c-fc3667918e90 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Action: 'create', calling method: .version_select at 0x7f4d57871820>, body: {"security_group_rule": {"parent_group_id": "f06efdfb-5f0f-4924-b3a6-0eb6dd1211f3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:09.746441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8bca4414-cc7c-4bb2-8397-358eaacd9621 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:09.755077 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8bca4414-cc7c-4bb2-8397-358eaacd9621 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1502 microversion: 2.1 time: 0.184117 May 28 21:17:09.755667 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1866/3687] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:09 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-be1d9a67-754c-41a0-9d0c-fc3667918e90 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] HTTP exception thrown: This rule already exists in group f06efdfb-5f0f-4924-b3a6-0eb6dd1211f3 May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-be1d9a67-754c-41a0-9d0c-fc3667918e90 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Request method failure captured: May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 138 May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpFUziAJj3AsRBYoo9MdDc7pf1p89ybDNWL7wze8JYeDdjazfvDmRhZyB4QLwRQJO4ftEfYvD1Uu0kTgGhQU4YbiQChGLRgfHFhin6jrtHhJDBvmC4nfs6eCCya6q4b3acGacY9gJTeHpBynMvRXhewSkdYj32ijZvSirhGv_aMlTkA May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2be6782605ab4d8f8e4289aaa8b19bcd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 4c425cfffaea4e86ab29da7bb1f4c2ff May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: {"security_group_rule": {"parent_group_id": "f06efdfb-5f0f-4924-b3a6-0eb6dd1211f3", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: exception: This rule already exists in group f06efdfb-5f0f-4924-b3a6-0eb6dd1211f3 May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f06efdfb-5f0f-4924-b3a6-0eb6dd1211f3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group f06efdfb-5f0f-4924-b3a6-0eb6dd1211f3 May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group f06efdfb-5f0f-4924-b3a6-0eb6dd1211f3 May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:09.772297 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:09.777168 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:09.777168 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:09.777168 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:09.777168 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:09.777168 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:09.777168 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group f06efdfb-5f0f-4924-b3a6-0eb6dd1211f3 May 28 21:17:09.777168 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:09.777168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-be1d9a67-754c-41a0-9d0c-fc3667918e90 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Returning 400 to user: This rule already exists in group f06efdfb-5f0f-4924-b3a6-0eb6dd1211f3 {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:09.777168 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-be1d9a67-754c-41a0-9d0c-fc3667918e90 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.071614 May 28 21:17:09.777168 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1822/3688] 10.222.0.33 () {60 vars in 1194 bytes} [Sat May 28 21:17:09 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 21:17:09.784943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f93b0c1d-ceb4-437c-9710-676e5ee9c3e8 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Calling method '.version_select at 0x7f4d579a24c0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:09.785115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ffbd3f46-ed7d-45eb-b788-9ad0106bc52c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:09.785679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ffbd3f46-ed7d-45eb-b788-9ad0106bc52c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:09.792508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffbd3f46-ed7d-45eb-b788-9ad0106bc52c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:09.795232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffbd3f46-ed7d-45eb-b788-9ad0106bc52c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:09.795232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffbd3f46-ed7d-45eb-b788-9ad0106bc52c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:09.795232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffbd3f46-ed7d-45eb-b788-9ad0106bc52c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:09.970727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ffbd3f46-ed7d-45eb-b788-9ad0106bc52c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:09.979723 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ffbd3f46-ed7d-45eb-b788-9ad0106bc52c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1502 microversion: 2.1 time: 0.198493 May 28 21:17:09.980827 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1867/3689] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:09 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1502 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:09.997442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d70fc7a4-b776-4492-907f-7872d418ed7f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:10.004305 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d70fc7a4-b776-4492-907f-7872d418ed7f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:10.005389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d70fc7a4-b776-4492-907f-7872d418ed7f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:10.031828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d70fc7a4-b776-4492-907f-7872d418ed7f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Going to try to stop instance {{(pid=143129) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 21:17:10.115261 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f93b0c1d-ceb4-437c-9710-676e5ee9c3e8 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/83a8a1e1-c8af-4941-80de-79454578fdbf" status: 202 len: 0 microversion: 2.1 time: 0.330885 May 28 21:17:10.115261 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1823/3690] 10.222.0.33 () {58 vars in 1286 bytes} [Sat May 28 21:17:09 2022] DELETE /compute/v2.1/os-security-group-rules/83a8a1e1-c8af-4941-80de-79454578fdbf => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:17:10.122771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-428d8220-bad0-463e-83d1-b3b66ef93bf8 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Action: 'create', calling method: .version_select at 0x7f4d579a2160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-294952021", "description": "tempest-description-1073279053"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:10.307451 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d70fc7a4-b776-4492-907f-7872d418ed7f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "POST /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0/action" status: 202 len: 0 microversion: 2.1 time: 0.314363 May 28 21:17:10.309584 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1868/3691] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:17:09 2022] POST /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:17:10.328889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b9c9afa2-cff5-44f1-ae70-6eb89785a299 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:10.336315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b9c9afa2-cff5-44f1-ae70-6eb89785a299 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:10.346624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9c9afa2-cff5-44f1-ae70-6eb89785a299 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:10.347507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9c9afa2-cff5-44f1-ae70-6eb89785a299 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:10.349202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9c9afa2-cff5-44f1-ae70-6eb89785a299 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:10.349759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9c9afa2-cff5-44f1-ae70-6eb89785a299 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:10.395788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-b9c9afa2-cff5-44f1-ae70-6eb89785a299 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lazy-loading 'flavor' on Instance uuid 43ee8dd9-d59f-422a-a29d-2732e2573958 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:17:10.536384 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-428d8220-bad0-463e-83d1-b3b66ef93bf8 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.416979 May 28 21:17:10.542884 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1824/3692] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:17:10 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:10.542884 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fadbc3af-9615-427d-8890-4807809bb6de tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:10.543114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fadbc3af-9615-427d-8890-4807809bb6de tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:10.550549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fadbc3af-9615-427d-8890-4807809bb6de tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:10.551118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fadbc3af-9615-427d-8890-4807809bb6de tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:10.552721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fadbc3af-9615-427d-8890-4807809bb6de tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:10.553495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fadbc3af-9615-427d-8890-4807809bb6de tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:10.715328 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b9c9afa2-cff5-44f1-ae70-6eb89785a299 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/action" status: 200 len: 32 microversion: 2.1 time: 0.403428 May 28 21:17:10.716944 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1869/3693] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:17:10 2022] POST /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/action => generated 32 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:17:10.743021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-604f508b-ef75-4142-b7a9-7e4613092c08 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Action: 'create', calling method: .version_select at 0x7f4d64116040>, body: {"security_group_rule": {"parent_group_id": "9c6f9a7a-7821-4ad5-b81d-faefaebbd26b", "ip_protocol": "tcp", "from_port": 299627632, "to_port": 22}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:10.835714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fadbc3af-9615-427d-8890-4807809bb6de tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:10.846176 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fadbc3af-9615-427d-8890-4807809bb6de tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.308069 May 28 21:17:10.846821 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1825/3694] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:10 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:10.862944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-10c94168-f30d-4a0d-9297-5f53c910a3ba tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:10.864214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-10c94168-f30d-4a0d-9297-5f53c910a3ba tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:10.891493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10c94168-f30d-4a0d-9297-5f53c910a3ba tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:10.892283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10c94168-f30d-4a0d-9297-5f53c910a3ba tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:10.892650 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-604f508b-ef75-4142-b7a9-7e4613092c08 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] HTTP exception thrown: Invalid port range 299627632:22. Former value cannot be greater than the later May 28 21:17:10.893567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10c94168-f30d-4a0d-9297-5f53c910a3ba tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:10.894259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10c94168-f30d-4a0d-9297-5f53c910a3ba tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-604f508b-ef75-4142-b7a9-7e4613092c08 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Request method failure captured: May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 145 May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpFUziAJj3AsRBYoo9MdDc7pf1p89ybDNWL7wze8JYeDdjazfvDmRhZyB4QLwRQJO4ftEfYvD1Uu0kTgGhQU4YbiQChGLRgfHFhin6jrtHhJDBvmC4nfs6eCCya6q4b3acGacY9gJTeHpBynMvRXhewSkdYj32ijZvSirhGv_aMlTkA May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2be6782605ab4d8f8e4289aaa8b19bcd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 4c425cfffaea4e86ab29da7bb1f4c2ff May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: {"security_group_rule": {"parent_group_id": "9c6f9a7a-7821-4ad5-b81d-faefaebbd26b", "ip_protocol": "tcp", "from_port": 299627632, "to_port": 22}} May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid port range 299627632:22. Former value cannot be greater than the later May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9c6f9a7a-7821-4ad5-b81d-faefaebbd26b', 'ip_protocol': 'tcp', 'from_port': 299627632, 'to_port': 22}}} May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 299627632:22. Former value cannot be greater than the later May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 299627632:22. Former value cannot be greater than the later May 28 21:17:10.896776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:10.900882 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:10.900882 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:10.900882 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:10.900882 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:10.900882 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:10.900882 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:10.900882 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:10.900882 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 299627632:22. Former value cannot be greater than the later May 28 21:17:10.900882 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:10.900882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-604f508b-ef75-4142-b7a9-7e4613092c08 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Returning 400 to user: Invalid port range 299627632:22. Former value cannot be greater than the later {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:10.900882 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-604f508b-ef75-4142-b7a9-7e4613092c08 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.179628 May 28 21:17:10.900882 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1870/3695] 10.222.0.33 () {60 vars in 1194 bytes} [Sat May 28 21:17:10 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:17:10.915158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7c170244-4ac9-4f88-b171-1c4d2522fbf6 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Action: 'create', calling method: .version_select at 0x7f4d69c1b940>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-143972234", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:10.917242 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-7c170244-4ac9-4f88-b171-1c4d2522fbf6 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] HTTP exception thrown: Security group id should be uuid May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7c170244-4ac9-4f88-b171-1c4d2522fbf6 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Request method failure captured: May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 130 May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpFUziAJj3AsRBYoo9MdDc7pf1p89ybDNWL7wze8JYeDdjazfvDmRhZyB4QLwRQJO4ftEfYvD1Uu0kTgGhQU4YbiQChGLRgfHFhin6jrtHhJDBvmC4nfs6eCCya6q4b3acGacY9gJTeHpBynMvRXhewSkdYj32ijZvSirhGv_aMlTkA May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2be6782605ab4d8f8e4289aaa8b19bcd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 4c425cfffaea4e86ab29da7bb1f4c2ff May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-143972234", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: exception: Security group id should be uuid May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-143972234', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:10.918905 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:10.924458 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid May 28 21:17:10.924458 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:10.924458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7c170244-4ac9-4f88-b171-1c4d2522fbf6 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Returning 400 to user: Security group id should be uuid {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:10.924702 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7c170244-4ac9-4f88-b171-1c4d2522fbf6 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.014563 May 28 21:17:10.927998 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1871/3696] 10.222.0.33 () {60 vars in 1194 bytes} [Sat May 28 21:17:10 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 21:17:10.948546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb282e7a-2e06-401a-b51a-74902bcc83ec tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Action: 'create', calling method: .version_select at 0x7f4d57875940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-211171148", "description": "tempest-description-1862184420"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:11.294090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-10c94168-f30d-4a0d-9297-5f53c910a3ba tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:11.303868 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-10c94168-f30d-4a0d-9297-5f53c910a3ba tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.455759 May 28 21:17:11.312205 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1826/3697] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:10 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:11.864735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-72a4d73b-c14a-4942-b689-7893b08149f5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:11.871496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-72a4d73b-c14a-4942-b689-7893b08149f5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:11.874459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72a4d73b-c14a-4942-b689-7893b08149f5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:11.875023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72a4d73b-c14a-4942-b689-7893b08149f5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:11.875863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72a4d73b-c14a-4942-b689-7893b08149f5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:11.876587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72a4d73b-c14a-4942-b689-7893b08149f5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:12.138853 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb282e7a-2e06-401a-b51a-74902bcc83ec tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 1.206966 May 28 21:17:12.146676 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1872/3698] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:17:10 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:12.152026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-349af18a-0373-49ee-92a7-a61e0a1ec579 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Action: 'create', calling method: .version_select at 0x7f4d57800790>, body: {"security_group_rule": {"parent_group_id": "754b442a-9dd5-460b-8bf1-d2a713db3bb9", "ip_protocol": "tempest-999-95515647", "from_port": 22, "to_port": 22}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:12.186409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-72a4d73b-c14a-4942-b689-7893b08149f5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:12.195246 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-72a4d73b-c14a-4942-b689-7893b08149f5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.335120 May 28 21:17:12.196242 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1827/3699] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:11 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:12.235307 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-349af18a-0373-49ee-92a7-a61e0a1ec579 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] HTTP exception thrown: Invalid IP protocol tempest-999-95515647. May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-349af18a-0373-49ee-92a7-a61e0a1ec579 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Request method failure captured: May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 155 May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpFUziAJj3AsRBYoo9MdDc7pf1p89ybDNWL7wze8JYeDdjazfvDmRhZyB4QLwRQJO4ftEfYvD1Uu0kTgGhQU4YbiQChGLRgfHFhin6jrtHhJDBvmC4nfs6eCCya6q4b3acGacY9gJTeHpBynMvRXhewSkdYj32ijZvSirhGv_aMlTkA May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2be6782605ab4d8f8e4289aaa8b19bcd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 4c425cfffaea4e86ab29da7bb1f4c2ff May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: {"security_group_rule": {"parent_group_id": "754b442a-9dd5-460b-8bf1-d2a713db3bb9", "ip_protocol": "tempest-999-95515647", "from_port": 22, "to_port": 22}} May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid IP protocol tempest-999-95515647. May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'security_group_rule': {'parent_group_id': '754b442a-9dd5-460b-8bf1-d2a713db3bb9', 'ip_protocol': 'tempest-999-95515647', 'from_port': 22, 'to_port': 22}}} May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-95515647. May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-95515647. May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:12.237742 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:12.242664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:12.242664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:12.242664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:12.242664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:12.242664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:12.242664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:12.242664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-95515647. May 28 21:17:12.242664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:12.242664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-349af18a-0373-49ee-92a7-a61e0a1ec579 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Returning 400 to user: Invalid IP protocol tempest-999-95515647. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:12.243330 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-349af18a-0373-49ee-92a7-a61e0a1ec579 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 85 microversion: 2.1 time: 0.094500 May 28 21:17:12.243980 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1873/3700] 10.222.0.33 () {60 vars in 1194 bytes} [Sat May 28 21:17:12 2022] POST /compute/v2.1/os-security-group-rules => generated 85 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 21:17:12.256578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6af64bc0-27b6-427a-b4af-d8bb13435d58 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Action: 'create', calling method: .version_select at 0x7f4d578719d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2141369322", "description": "tempest-description-1535401354"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:12.325069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-634b9cd9-6767-4dfc-abb8-7ed9087bc404 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:12.326032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-634b9cd9-6767-4dfc-abb8-7ed9087bc404 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:12.337586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-634b9cd9-6767-4dfc-abb8-7ed9087bc404 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:12.339042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-634b9cd9-6767-4dfc-abb8-7ed9087bc404 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:12.340114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-634b9cd9-6767-4dfc-abb8-7ed9087bc404 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:12.340749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-634b9cd9-6767-4dfc-abb8-7ed9087bc404 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:12.359733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:17:12.513662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-634b9cd9-6767-4dfc-abb8-7ed9087bc404 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:12.523295 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-634b9cd9-6767-4dfc-abb8-7ed9087bc404 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.202619 May 28 21:17:12.524432 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1874/3701] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:12 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:12.814071 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6af64bc0-27b6-427a-b4af-d8bb13435d58 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.563009 May 28 21:17:12.814971 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1828/3702] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:17:12 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:12.828669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c2a00119-f226-4f3d-81f5-cbc6883762ed tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Action: 'create', calling method: .version_select at 0x7f4d5779f550>, body: {"security_group_rule": {"parent_group_id": "a953afe7-d4f0-4fe7-98d7-0095c4d6f7ec", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:13.080692 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-c2a00119-f226-4f3d-81f5-cbc6883762ed tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c2a00119-f226-4f3d-81f5-cbc6883762ed tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Request method failure captured: May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 138 May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpFUziAJj3AsRBYoo9MdDc7pf1p89ybDNWL7wze8JYeDdjazfvDmRhZyB4QLwRQJO4ftEfYvD1Uu0kTgGhQU4YbiQChGLRgfHFhin6jrtHhJDBvmC4nfs6eCCya6q4b3acGacY9gJTeHpBynMvRXhewSkdYj32ijZvSirhGv_aMlTkA May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2be6782605ab4d8f8e4289aaa8b19bcd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 4c425cfffaea4e86ab29da7bb1f4c2ff May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: {"security_group_rule": {"parent_group_id": "a953afe7-d4f0-4fe7-98d7-0095c4d6f7ec", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid port range 22:21. Former value cannot be greater than the later May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a953afe7-d4f0-4fe7-98d7-0095c4d6f7ec', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later May 28 21:17:13.082323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:13.089434 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:13.089434 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:13.089434 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:13.089434 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:13.089434 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:13.089434 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:13.089434 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:13.089434 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later May 28 21:17:13.089434 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:13.089434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c2a00119-f226-4f3d-81f5-cbc6883762ed tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:13.089434 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c2a00119-f226-4f3d-81f5-cbc6883762ed tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.261179 May 28 21:17:13.089434 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1875/3703] 10.222.0.33 () {60 vars in 1194 bytes} [Sat May 28 21:17:12 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 262 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:17:13.096101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eb08eb17-bb9e-4b13-87f8-1a2a70e5a279 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Action: 'create', calling method: .version_select at 0x7f4d64566700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1953337808", "description": "tempest-description-796060780"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:13.216165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-28406da4-f944-4942-80d3-df25fa2f4278 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:13.217033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-28406da4-f944-4942-80d3-df25fa2f4278 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:13.223756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=60,nova_api:DELETE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:17:13.228122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28406da4-f944-4942-80d3-df25fa2f4278 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:13.228581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28406da4-f944-4942-80d3-df25fa2f4278 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:13.229931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28406da4-f944-4942-80d3-df25fa2f4278 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:13.230392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28406da4-f944-4942-80d3-df25fa2f4278 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:13.566673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-28406da4-f944-4942-80d3-df25fa2f4278 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:13.575362 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-28406da4-f944-4942-80d3-df25fa2f4278 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.365222 May 28 21:17:13.576101 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1876/3704] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:13 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:13.581169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9ca7050c-d40a-482a-829c-77af24e38cc0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:13.582088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9ca7050c-d40a-482a-829c-77af24e38cc0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:13.589752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ca7050c-d40a-482a-829c-77af24e38cc0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:13.590245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ca7050c-d40a-482a-829c-77af24e38cc0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:13.591049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ca7050c-d40a-482a-829c-77af24e38cc0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:13.591499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ca7050c-d40a-482a-829c-77af24e38cc0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:13.771525 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eb08eb17-bb9e-4b13-87f8-1a2a70e5a279 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.680005 May 28 21:17:13.772143 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1829/3705] 10.222.0.33 () {60 vars in 1179 bytes} [Sat May 28 21:17:13 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:13.782911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ed323829-fa98-4386-b6cb-86dd344ad98d tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Action: 'create', calling method: .version_select at 0x7f4d69ca1dc0>, body: {"security_group_rule": {"parent_group_id": "406e11a7-809d-4fee-8f5c-06f1339891a5", "ip_protocol": "tcp", "from_port": 22, "to_port": 1092643596}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:13.909581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9ca7050c-d40a-482a-829c-77af24e38cc0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:13.912749 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-ed323829-fa98-4386-b6cb-86dd344ad98d tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] HTTP exception thrown: Invalid port range 22:1092643596. Valid TCP ports should be between 1-65535 May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ed323829-fa98-4386-b6cb-86dd344ad98d tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Request method failure captured: May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 146 May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpFUziAJj3AsRBYoo9MdDc7pf1p89ybDNWL7wze8JYeDdjazfvDmRhZyB4QLwRQJO4ftEfYvD1Uu0kTgGhQU4YbiQChGLRgfHFhin6jrtHhJDBvmC4nfs6eCCya6q4b3acGacY9gJTeHpBynMvRXhewSkdYj32ijZvSirhGv_aMlTkA May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2be6782605ab4d8f8e4289aaa8b19bcd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 4c425cfffaea4e86ab29da7bb1f4c2ff May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: {"security_group_rule": {"parent_group_id": "406e11a7-809d-4fee-8f5c-06f1339891a5", "ip_protocol": "tcp", "from_port": 22, "to_port": 1092643596}} May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid port range 22:1092643596. Valid TCP ports should be between 1-65535 May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'security_group_rule': {'parent_group_id': '406e11a7-809d-4fee-8f5c-06f1339891a5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1092643596}}} May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1092643596. Valid TCP ports should be between 1-65535 May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1092643596. Valid TCP ports should be between 1-65535 May 28 21:17:13.914697 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:13.919537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:13.919537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:13.919537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:13.919537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:13.919537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:13.919537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:13.919537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:13.919537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1092643596. Valid TCP ports should be between 1-65535 May 28 21:17:13.919537 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:13.919537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ed323829-fa98-4386-b6cb-86dd344ad98d tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Returning 400 to user: Invalid port range 22:1092643596. Valid TCP ports should be between 1-65535 {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:13.919537 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ed323829-fa98-4386-b6cb-86dd344ad98d tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.139809 May 28 21:17:13.919537 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1830/3706] 10.222.0.33 () {60 vars in 1194 bytes} [Sat May 28 21:17:13 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 21:17:13.936207 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9ca7050c-d40a-482a-829c-77af24e38cc0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.358217 May 28 21:17:13.950090 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1877/3707] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:13 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:13.950207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fcc7946d-8ff6-4cfe-8310-7468233e7b7f tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Action: 'create', calling method: .version_select at 0x7f4d579dc790>, body: {"security_group_rule": {"parent_group_id": "fa4bdfbe-124d-4c12-8ad0-d00cdca844a0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:13.969038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG neutronclient.v2_0.client [None req-fcc7946d-8ff6-4cfe-8310-7468233e7b7f tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fa4bdfbe-124d-4c12-8ad0-d00cdca844a0 does not exist", "detail": ""}} {{(pid=143128) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.security_group_api [None req-fcc7946d-8ff6-4cfe-8310-7468233e7b7f tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Neutron security group fa4bdfbe-124d-4c12-8ad0-d00cdca844a0 not found {{(pid=143128) get /opt/stack/nova/nova/network/security_group_api.py:313}} May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-fcc7946d-8ff6-4cfe-8310-7468233e7b7f tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] HTTP exception thrown: Security group fa4bdfbe-124d-4c12-8ad0-d00cdca844a0 does not exist May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-57ead9d6-5965-4a92-88a9-b97d14955f77'] May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fcc7946d-8ff6-4cfe-8310-7468233e7b7f tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Request method failure captured: May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 138 May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpFUziAJj3AsRBYoo9MdDc7pf1p89ybDNWL7wze8JYeDdjazfvDmRhZyB4QLwRQJO4ftEfYvD1Uu0kTgGhQU4YbiQChGLRgfHFhin6jrtHhJDBvmC4nfs6eCCya6q4b3acGacY9gJTeHpBynMvRXhewSkdYj32ijZvSirhGv_aMlTkA May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2be6782605ab4d8f8e4289aaa8b19bcd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 4c425cfffaea4e86ab29da7bb1f4c2ff May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: {"security_group_rule": {"parent_group_id": "fa4bdfbe-124d-4c12-8ad0-d00cdca844a0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: exception: Security group fa4bdfbe-124d-4c12-8ad0-d00cdca844a0 does not exist May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-57ead9d6-5965-4a92-88a9-b97d14955f77'] May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fa4bdfbe-124d-4c12-8ad0-d00cdca844a0', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:17:13.976819 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fa4bdfbe-124d-4c12-8ad0-d00cdca844a0 does not exist May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57ead9d6-5965-4a92-88a9-b97d14955f77'] May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fa4bdfbe-124d-4c12-8ad0-d00cdca844a0 does not exist May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57ead9d6-5965-4a92-88a9-b97d14955f77'] May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fa4bdfbe-124d-4c12-8ad0-d00cdca844a0 does not exist May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57ead9d6-5965-4a92-88a9-b97d14955f77'] May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fa4bdfbe-124d-4c12-8ad0-d00cdca844a0 does not exist May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57ead9d6-5965-4a92-88a9-b97d14955f77'] May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fcc7946d-8ff6-4cfe-8310-7468233e7b7f tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Returning 404 to user: Security group fa4bdfbe-124d-4c12-8ad0-d00cdca844a0 does not exist May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: Neutron server returns request_ids: ['req-57ead9d6-5965-4a92-88a9-b97d14955f77'] {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fcc7946d-8ff6-4cfe-8310-7468233e7b7f tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.048771 May 28 21:17:13.981058 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1831/3708] 10.222.0.33 () {60 vars in 1194 bytes} [Sat May 28 21:17:13 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:17:13.985294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b69b72d0-c17c-43da-baef-1e7626246342 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Calling method '.version_select at 0x7f4d69c19d30>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:14.014925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG neutronclient.v2_0.client [None req-b69b72d0-c17c-43da-baef-1e7626246342 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 94ece5a0-9adc-43da-9c6e-06ae87d10c30 does not exist", "detail": ""}} {{(pid=143129) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} May 28 21:17:14.015585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.security_group_api [None req-b69b72d0-c17c-43da-baef-1e7626246342 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Neutron security group rule 94ece5a0-9adc-43da-9c6e-06ae87d10c30 not found {{(pid=143129) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} May 28 21:17:14.016301 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-b69b72d0-c17c-43da-baef-1e7626246342 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] HTTP exception thrown: Security group rule 94ece5a0-9adc-43da-9c6e-06ae87d10c30 does not exist May 28 21:17:14.016301 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-03f6e538-3f6f-444d-bf88-3a2afcb70c55'] May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b69b72d0-c17c-43da-baef-1e7626246342 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Request method failure captured: May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/os-security-group-rules/94ece5a0-9adc-43da-9c6e-06ae87d10c30 HTTP/1.1 May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpFUziAJj3AsRBYoo9MdDc7pf1p89ybDNWL7wze8JYeDdjazfvDmRhZyB4QLwRQJO4ftEfYvD1Uu0kTgGhQU4YbiQChGLRgfHFhin6jrtHhJDBvmC4nfs6eCCya6q4b3acGacY9gJTeHpBynMvRXhewSkdYj32ijZvSirhGv_aMlTkA May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2be6782605ab4d8f8e4289aaa8b19bcd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2be6782605ab4d8f8e4289aaa8b19bcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2be6782605ab4d8f8e4289aaa8b19bcd May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190 May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 4c425cfffaea4e86ab29da7bb1f4c2ff May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-650450190-project May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: exception: Security group rule 94ece5a0-9adc-43da-9c6e-06ae87d10c30 does not exist May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-03f6e538-3f6f-444d-bf88-3a2afcb70c55'] May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '94ece5a0-9adc-43da-9c6e-06ae87d10c30'} May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, May 28 21:17:14.018296 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 94ece5a0-9adc-43da-9c6e-06ae87d10c30 does not exist May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03f6e538-3f6f-444d-bf88-3a2afcb70c55'] May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 94ece5a0-9adc-43da-9c6e-06ae87d10c30 does not exist May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03f6e538-3f6f-444d-bf88-3a2afcb70c55'] May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 94ece5a0-9adc-43da-9c6e-06ae87d10c30 does not exist May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03f6e538-3f6f-444d-bf88-3a2afcb70c55'] May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 94ece5a0-9adc-43da-9c6e-06ae87d10c30 does not exist May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-03f6e538-3f6f-444d-bf88-3a2afcb70c55'] May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b69b72d0-c17c-43da-baef-1e7626246342 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Returning 404 to user: Security group rule 94ece5a0-9adc-43da-9c6e-06ae87d10c30 does not exist May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: Neutron server returns request_ids: ['req-03f6e538-3f6f-444d-bf88-3a2afcb70c55'] {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b69b72d0-c17c-43da-baef-1e7626246342 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-group-rules/94ece5a0-9adc-43da-9c6e-06ae87d10c30" status: 404 len: 199 microversion: 2.1 time: 0.039482 May 28 21:17:14.026731 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1878/3709] 10.222.0.33 () {58 vars in 1286 bytes} [Sat May 28 21:17:13 2022] DELETE /compute/v2.1/os-security-group-rules/94ece5a0-9adc-43da-9c6e-06ae87d10c30 => generated 199 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:14.034022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1cba7196-aaff-4a9d-8826-be90392bb35a tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Calling method '.version_select at 0x7f4d64566790>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:14.366582 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1cba7196-aaff-4a9d-8826-be90392bb35a tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/406e11a7-809d-4fee-8f5c-06f1339891a5" status: 202 len: 0 microversion: 2.1 time: 0.337368 May 28 21:17:14.377139 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1832/3710] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:17:14 2022] DELETE /compute/v2.1/os-security-groups/406e11a7-809d-4fee-8f5c-06f1339891a5 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:17:14.378872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7deb0bd4-53d2-474f-bd2c-d6a5e26af04a tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Calling method '.version_select at 0x7f4d5765b280>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:14.592530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f2e24152-d948-4fc7-9f2b-385ca45448f4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:14.596846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f2e24152-d948-4fc7-9f2b-385ca45448f4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:14.600709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2e24152-d948-4fc7-9f2b-385ca45448f4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:14.601356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2e24152-d948-4fc7-9f2b-385ca45448f4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:14.602695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2e24152-d948-4fc7-9f2b-385ca45448f4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:14.603306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2e24152-d948-4fc7-9f2b-385ca45448f4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:14.886762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f2e24152-d948-4fc7-9f2b-385ca45448f4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:14.889132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:17:14.895903 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f2e24152-d948-4fc7-9f2b-385ca45448f4 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.307312 May 28 21:17:14.897400 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1833/3711] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:14 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:14.956257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8f75eccd-df7d-40a7-a30c-43b1fb2eea6a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:14.957035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8f75eccd-df7d-40a7-a30c-43b1fb2eea6a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:14.963705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f75eccd-df7d-40a7-a30c-43b1fb2eea6a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:14.964199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f75eccd-df7d-40a7-a30c-43b1fb2eea6a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:14.965183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f75eccd-df7d-40a7-a30c-43b1fb2eea6a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:14.965672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f75eccd-df7d-40a7-a30c-43b1fb2eea6a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:14.992771 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7deb0bd4-53d2-474f-bd2c-d6a5e26af04a tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/a953afe7-d4f0-4fe7-98d7-0095c4d6f7ec" status: 202 len: 0 microversion: 2.1 time: 0.619736 May 28 21:17:14.997146 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1879/3712] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:17:14 2022] DELETE /compute/v2.1/os-security-groups/a953afe7-d4f0-4fe7-98d7-0095c4d6f7ec => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:17:15.006120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-643005b1-b13d-4f5c-aa0c-e78ec51d549a tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Calling method '.version_select at 0x7f4d645f0670>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:15.218321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8f75eccd-df7d-40a7-a30c-43b1fb2eea6a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:15.229619 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8f75eccd-df7d-40a7-a30c-43b1fb2eea6a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.276912 May 28 21:17:15.230545 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1834/3713] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:14 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:15.450535 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-643005b1-b13d-4f5c-aa0c-e78ec51d549a tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/754b442a-9dd5-460b-8bf1-d2a713db3bb9" status: 202 len: 0 microversion: 2.1 time: 0.452111 May 28 21:17:15.457510 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1880/3714] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:17:14 2022] DELETE /compute/v2.1/os-security-groups/754b442a-9dd5-460b-8bf1-d2a713db3bb9 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:17:15.460732 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2cd9b631-b6aa-47dd-ad85-fd6117c95b36 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Calling method '.version_select at 0x7f4d578719d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:15.809389 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2cd9b631-b6aa-47dd-ad85-fd6117c95b36 tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/9c6f9a7a-7821-4ad5-b81d-faefaebbd26b" status: 202 len: 0 microversion: 2.1 time: 0.353363 May 28 21:17:15.810144 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1835/3715] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:17:15 2022] DELETE /compute/v2.1/os-security-groups/9c6f9a7a-7821-4ad5-b81d-faefaebbd26b => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:17:15.821882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c54aff1f-9df5-466c-ae9a-dec6af13e28c tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] Calling method '.version_select at 0x7f4d5778cd30>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:15.921345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8085fd90-098e-4112-8e7f-0ea630793c88 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:15.922015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8085fd90-098e-4112-8e7f-0ea630793c88 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:15.925555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:17:15.932215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8085fd90-098e-4112-8e7f-0ea630793c88 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:15.932965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8085fd90-098e-4112-8e7f-0ea630793c88 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:15.934084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8085fd90-098e-4112-8e7f-0ea630793c88 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:15.934585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8085fd90-098e-4112-8e7f-0ea630793c88 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:16.149377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8085fd90-098e-4112-8e7f-0ea630793c88 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:16.166832 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8085fd90-098e-4112-8e7f-0ea630793c88 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.258271 May 28 21:17:16.167420 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1836/3716] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:15 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:16.249638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c4e4676-919a-4203-bb84-5fea6c45f722 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:16.251691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3c4e4676-919a-4203-bb84-5fea6c45f722 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:16.253352 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c54aff1f-9df5-466c-ae9a-dec6af13e28c tempest-SecurityGroupRulesNegativeTestJSON-650450190 tempest-SecurityGroupRulesNegativeTestJSON-650450190-project] 10.222.0.33 "DELETE /compute/v2.1/os-security-groups/f06efdfb-5f0f-4924-b3a6-0eb6dd1211f3" status: 202 len: 0 microversion: 2.1 time: 0.435623 May 28 21:17:16.254545 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1881/3717] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:17:15 2022] DELETE /compute/v2.1/os-security-groups/f06efdfb-5f0f-4924-b3a6-0eb6dd1211f3 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:17:16.260374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c4e4676-919a-4203-bb84-5fea6c45f722 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:16.261036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c4e4676-919a-4203-bb84-5fea6c45f722 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:16.261912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c4e4676-919a-4203-bb84-5fea6c45f722 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:16.262364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c4e4676-919a-4203-bb84-5fea6c45f722 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:16.609374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3c4e4676-919a-4203-bb84-5fea6c45f722 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:16.618147 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3c4e4676-919a-4203-bb84-5fea6c45f722 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.373662 May 28 21:17:16.619340 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1837/3718] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:16 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:17.183753 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9bd9209c-5c48-4c61-95a3-4777a8120ee0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:17.184450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9bd9209c-5c48-4c61-95a3-4777a8120ee0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:17.192423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bd9209c-5c48-4c61-95a3-4777a8120ee0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:17.192929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bd9209c-5c48-4c61-95a3-4777a8120ee0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:17.193944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bd9209c-5c48-4c61-95a3-4777a8120ee0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:17.194555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9bd9209c-5c48-4c61-95a3-4777a8120ee0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:17.235165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f2e0927d-9ca8-426f-8a76-5e1a74c90c93 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:17.236170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f2e0927d-9ca8-426f-8a76-5e1a74c90c93 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:17.243489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2e0927d-9ca8-426f-8a76-5e1a74c90c93 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:17.244111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2e0927d-9ca8-426f-8a76-5e1a74c90c93 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:17.247051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2e0927d-9ca8-426f-8a76-5e1a74c90c93 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:17.247051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2e0927d-9ca8-426f-8a76-5e1a74c90c93 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:17.305370 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f2e0927d-9ca8-426f-8a76-5e1a74c90c93 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "POST /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2/action" status: 200 len: 24590 microversion: 2.32 time: 0.309049 May 28 21:17:17.306339 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1882/3719] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:17:16 2022] POST /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2/action => generated 24590 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 21:17:17.389854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9bd9209c-5c48-4c61-95a3-4777a8120ee0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:17.398372 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9bd9209c-5c48-4c61-95a3-4777a8120ee0 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.219075 May 28 21:17:17.398980 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1838/3720] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:17 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:17.636835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8e11b70c-976d-4bef-869d-4df51f7cc6fe tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:17.637804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8e11b70c-976d-4bef-869d-4df51f7cc6fe tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:17.649726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e11b70c-976d-4bef-869d-4df51f7cc6fe tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:17.650212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e11b70c-976d-4bef-869d-4df51f7cc6fe tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:17.651002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e11b70c-976d-4bef-869d-4df51f7cc6fe tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:17.651449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e11b70c-976d-4bef-869d-4df51f7cc6fe tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:17.846449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8e11b70c-976d-4bef-869d-4df51f7cc6fe tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:17.860518 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8e11b70c-976d-4bef-869d-4df51f7cc6fe tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.227870 May 28 21:17:17.866825 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1883/3721] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:17 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:18.416620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-90338408-f98f-4832-bee3-f14cb9c0af21 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:18.417282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-90338408-f98f-4832-bee3-f14cb9c0af21 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:18.434335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90338408-f98f-4832-bee3-f14cb9c0af21 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:18.434335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90338408-f98f-4832-bee3-f14cb9c0af21 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:18.434335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90338408-f98f-4832-bee3-f14cb9c0af21 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:18.434335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90338408-f98f-4832-bee3-f14cb9c0af21 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:18.709216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-90338408-f98f-4832-bee3-f14cb9c0af21 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:18.717451 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-90338408-f98f-4832-bee3-f14cb9c0af21 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.304847 May 28 21:17:18.734366 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1839/3722] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:18 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:18.883704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-61830354-58e5-40ee-8263-14c1bd8ac6c5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:18.884339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-61830354-58e5-40ee-8263-14c1bd8ac6c5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:18.896048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61830354-58e5-40ee-8263-14c1bd8ac6c5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:18.902554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61830354-58e5-40ee-8263-14c1bd8ac6c5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:18.903646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61830354-58e5-40ee-8263-14c1bd8ac6c5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:18.904268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61830354-58e5-40ee-8263-14c1bd8ac6c5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:19.474143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-61830354-58e5-40ee-8263-14c1bd8ac6c5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:19.488776 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-61830354-58e5-40ee-8263-14c1bd8ac6c5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.609514 May 28 21:17:19.493229 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1884/3723] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:18 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:19.735289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d457551c-c52a-41ca-8544-1d013dac2df5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:19.735982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d457551c-c52a-41ca-8544-1d013dac2df5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:19.755581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d457551c-c52a-41ca-8544-1d013dac2df5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:19.756052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d457551c-c52a-41ca-8544-1d013dac2df5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:19.757012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d457551c-c52a-41ca-8544-1d013dac2df5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:19.757313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d457551c-c52a-41ca-8544-1d013dac2df5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:20.043891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d457551c-c52a-41ca-8544-1d013dac2df5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:20.052685 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d457551c-c52a-41ca-8544-1d013dac2df5 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.321659 May 28 21:17:20.053289 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1840/3724] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:19 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:20.508471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1e4d80f9-fa52-4f16-aabf-cae6092e0fb1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:20.508986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1e4d80f9-fa52-4f16-aabf-cae6092e0fb1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:20.519237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e4d80f9-fa52-4f16-aabf-cae6092e0fb1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:20.520737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e4d80f9-fa52-4f16-aabf-cae6092e0fb1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:20.522183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e4d80f9-fa52-4f16-aabf-cae6092e0fb1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:20.523844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e4d80f9-fa52-4f16-aabf-cae6092e0fb1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:20.926964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1e4d80f9-fa52-4f16-aabf-cae6092e0fb1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:20.936533 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1e4d80f9-fa52-4f16-aabf-cae6092e0fb1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.433487 May 28 21:17:20.938148 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1885/3725] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:20 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:21.079733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e0384c47-c4be-4160-b519-c589584f32d6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:21.080371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e0384c47-c4be-4160-b519-c589584f32d6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:21.088291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0384c47-c4be-4160-b519-c589584f32d6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:21.088983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0384c47-c4be-4160-b519-c589584f32d6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:21.089999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0384c47-c4be-4160-b519-c589584f32d6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:21.090437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0384c47-c4be-4160-b519-c589584f32d6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:21.381439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e0384c47-c4be-4160-b519-c589584f32d6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:21.394031 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e0384c47-c4be-4160-b519-c589584f32d6 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.327459 May 28 21:17:21.396762 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1841/3726] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:21 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:21.959910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cc4f580a-231c-4301-9627-294d938a5935 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:21.962621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cc4f580a-231c-4301-9627-294d938a5935 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:21.974706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc4f580a-231c-4301-9627-294d938a5935 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:21.974706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc4f580a-231c-4301-9627-294d938a5935 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:21.974706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc4f580a-231c-4301-9627-294d938a5935 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:21.975605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc4f580a-231c-4301-9627-294d938a5935 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:22.166263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1406935544", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "a0fc552a-84e7-471a-aeb9-a9c6cbdb0d39"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:22.226078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] validate_networks() for [('a0fc552a-84e7-471a-aeb9-a9c6cbdb0d39', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:17:22.277334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cc4f580a-231c-4301-9627-294d938a5935 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:22.286017 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cc4f580a-231c-4301-9627-294d938a5935 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.333332 May 28 21:17:22.286611 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1886/3727] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:21 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:22.412633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-95de1685-c18b-4de3-b6bd-9dcf23617f18 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:22.413259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-95de1685-c18b-4de3-b6bd-9dcf23617f18 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:22.419436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95de1685-c18b-4de3-b6bd-9dcf23617f18 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:22.419890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95de1685-c18b-4de3-b6bd-9dcf23617f18 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:22.420657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95de1685-c18b-4de3-b6bd-9dcf23617f18 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:22.421096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95de1685-c18b-4de3-b6bd-9dcf23617f18 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:22.723500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-95de1685-c18b-4de3-b6bd-9dcf23617f18 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:22.744700 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-95de1685-c18b-4de3-b6bd-9dcf23617f18 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.335943 May 28 21:17:22.746151 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1887/3728] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:22 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:22.768988 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:17:22.769547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:17:22.770078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:17:22.770494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:17:22.770933 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:17:22.781821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:22.782323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:22.783133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:22.783576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:22.802270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Getting quotas for project c9dd563271c04f6dae47402935636bb8. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:17:22.808254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Getting quotas for user a952d7989d3945b6a3ed38c2e444a7ba and project c9dd563271c04f6dae47402935636bb8. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:17:22.821970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:17:22.824418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:17:22.966999 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-94cc37fc-7c7e-48be-a345-f3c4a4c5b076 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.987759 May 28 21:17:22.967742 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1842/3729] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:17:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:17:22.979220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ae299cf1-e4ad-448e-8783-b1524e0affeb tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:22.980448 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ae299cf1-e4ad-448e-8783-b1524e0affeb tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:23.061379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ae299cf1-e4ad-448e-8783-b1524e0affeb tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a952d7989d3945b6a3ed38c2e444a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dd563271c04f6dae47402935636bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:23.076108 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ae299cf1-e4ad-448e-8783-b1524e0affeb tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 200 len: 1225 microversion: 2.1 time: 0.101078 May 28 21:17:23.080167 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1888/3730] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:22 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:23.304542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-59bc7148-44f9-48ad-9402-b7aff7db15b8 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:23.305150 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-59bc7148-44f9-48ad-9402-b7aff7db15b8 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:23.313149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59bc7148-44f9-48ad-9402-b7aff7db15b8 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:23.313606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59bc7148-44f9-48ad-9402-b7aff7db15b8 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:23.314418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59bc7148-44f9-48ad-9402-b7aff7db15b8 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:23.314856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59bc7148-44f9-48ad-9402-b7aff7db15b8 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:23.507640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-59bc7148-44f9-48ad-9402-b7aff7db15b8 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:23.518365 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-59bc7148-44f9-48ad-9402-b7aff7db15b8 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.218247 May 28 21:17:23.523756 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1843/3731] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:23 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:23.763579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1df6295c-741a-49fa-bac7-78cdbd9e4e60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:23.764232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1df6295c-741a-49fa-bac7-78cdbd9e4e60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:23.776444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1df6295c-741a-49fa-bac7-78cdbd9e4e60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:23.777408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1df6295c-741a-49fa-bac7-78cdbd9e4e60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:23.778503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1df6295c-741a-49fa-bac7-78cdbd9e4e60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:23.778946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1df6295c-741a-49fa-bac7-78cdbd9e4e60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:24.015414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1df6295c-741a-49fa-bac7-78cdbd9e4e60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:24.027571 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1df6295c-741a-49fa-bac7-78cdbd9e4e60 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.267992 May 28 21:17:24.028290 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1889/3732] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:23 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:24.096830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-54cf2b6f-2e21-433e-a8aa-87e9520c02dc tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:24.097465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-54cf2b6f-2e21-433e-a8aa-87e9520c02dc tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:24.151567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-54cf2b6f-2e21-433e-a8aa-87e9520c02dc tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a952d7989d3945b6a3ed38c2e444a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dd563271c04f6dae47402935636bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:24.158778 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-54cf2b6f-2e21-433e-a8aa-87e9520c02dc tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 200 len: 1225 microversion: 2.1 time: 0.066133 May 28 21:17:24.159616 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1844/3733] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:24 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 1225 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:24.539274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d56aa0fd-f51e-4034-9f82-63dc635a5204 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:24.541384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d56aa0fd-f51e-4034-9f82-63dc635a5204 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:24.549250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d56aa0fd-f51e-4034-9f82-63dc635a5204 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:24.550270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d56aa0fd-f51e-4034-9f82-63dc635a5204 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:24.552086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d56aa0fd-f51e-4034-9f82-63dc635a5204 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:24.552542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d56aa0fd-f51e-4034-9f82-63dc635a5204 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:25.033372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d56aa0fd-f51e-4034-9f82-63dc635a5204 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:25.045451 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d56aa0fd-f51e-4034-9f82-63dc635a5204 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.512543 May 28 21:17:25.045690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ec15b8e0-f5e7-4fb4-ad56-06e7206829dd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:25.046189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ec15b8e0-f5e7-4fb4-ad56-06e7206829dd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:25.056709 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1890/3734] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:24 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:25.071167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec15b8e0-f5e7-4fb4-ad56-06e7206829dd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:25.075624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec15b8e0-f5e7-4fb4-ad56-06e7206829dd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:25.076504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec15b8e0-f5e7-4fb4-ad56-06e7206829dd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:25.076964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec15b8e0-f5e7-4fb4-ad56-06e7206829dd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:25.175876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b2ba2767-152a-4dfa-9b5b-fadade832d9b tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:25.176508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b2ba2767-152a-4dfa-9b5b-fadade832d9b tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:25.183851 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2ba2767-152a-4dfa-9b5b-fadade832d9b tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:25.184425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2ba2767-152a-4dfa-9b5b-fadade832d9b tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:25.185220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2ba2767-152a-4dfa-9b5b-fadade832d9b tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:25.185724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2ba2767-152a-4dfa-9b5b-fadade832d9b tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:25.289936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ec15b8e0-f5e7-4fb4-ad56-06e7206829dd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:25.298649 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ec15b8e0-f5e7-4fb4-ad56-06e7206829dd tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.257788 May 28 21:17:25.302444 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1845/3735] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:25 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:25.303379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b2ba2767-152a-4dfa-9b5b-fadade832d9b tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a952d7989d3945b6a3ed38c2e444a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dd563271c04f6dae47402935636bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:25.312500 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b2ba2767-152a-4dfa-9b5b-fadade832d9b tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 200 len: 1277 microversion: 2.1 time: 0.140544 May 28 21:17:25.313396 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1891/3736] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:25 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:26.064024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1b5dbb9f-49c4-47e4-a029-8513ade961bb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:26.064655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1b5dbb9f-49c4-47e4-a029-8513ade961bb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:26.075471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b5dbb9f-49c4-47e4-a029-8513ade961bb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:26.075927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b5dbb9f-49c4-47e4-a029-8513ade961bb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:26.076880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b5dbb9f-49c4-47e4-a029-8513ade961bb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:26.081689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b5dbb9f-49c4-47e4-a029-8513ade961bb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:26.316099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1b5dbb9f-49c4-47e4-a029-8513ade961bb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:26.319428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c038b493-b741-4c75-81ce-559dd3fef1a8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:26.320058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c038b493-b741-4c75-81ce-559dd3fef1a8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:26.328887 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1b5dbb9f-49c4-47e4-a029-8513ade961bb tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.268730 May 28 21:17:26.330901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c038b493-b741-4c75-81ce-559dd3fef1a8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:26.333323 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1846/3737] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:26 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:26.333893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c038b493-b741-4c75-81ce-559dd3fef1a8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:26.335592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c038b493-b741-4c75-81ce-559dd3fef1a8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:26.336198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c038b493-b741-4c75-81ce-559dd3fef1a8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:26.352860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e7cdf3e7-ae71-4600-bc1a-2cf0e01218e8 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:26.353798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e7cdf3e7-ae71-4600-bc1a-2cf0e01218e8 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:26.368303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7cdf3e7-ae71-4600-bc1a-2cf0e01218e8 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:26.368703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7cdf3e7-ae71-4600-bc1a-2cf0e01218e8 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:26.369497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7cdf3e7-ae71-4600-bc1a-2cf0e01218e8 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:26.374056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7cdf3e7-ae71-4600-bc1a-2cf0e01218e8 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:26.515173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e7cdf3e7-ae71-4600-bc1a-2cf0e01218e8 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a952d7989d3945b6a3ed38c2e444a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dd563271c04f6dae47402935636bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:26.526932 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e7cdf3e7-ae71-4600-bc1a-2cf0e01218e8 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 200 len: 1283 microversion: 2.1 time: 0.183138 May 28 21:17:26.546719 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1847/3738] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:26 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 1283 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:26.563775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c038b493-b741-4c75-81ce-559dd3fef1a8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:26.572878 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c038b493-b741-4c75-81ce-559dd3fef1a8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.257852 May 28 21:17:26.574160 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1892/3739] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:26 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:27.351746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-60fc0371-c688-4b7a-9317-b3cd67c495f2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:27.351746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-60fc0371-c688-4b7a-9317-b3cd67c495f2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:27.359206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60fc0371-c688-4b7a-9317-b3cd67c495f2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:27.359668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60fc0371-c688-4b7a-9317-b3cd67c495f2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:27.360503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60fc0371-c688-4b7a-9317-b3cd67c495f2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:27.361140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60fc0371-c688-4b7a-9317-b3cd67c495f2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:27.548465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6b6ac62b-3561-4311-8f2d-4929df35731a tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:27.550181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6b6ac62b-3561-4311-8f2d-4929df35731a tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:27.561406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b6ac62b-3561-4311-8f2d-4929df35731a tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:27.562924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b6ac62b-3561-4311-8f2d-4929df35731a tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:27.564260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b6ac62b-3561-4311-8f2d-4929df35731a tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:27.564995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b6ac62b-3561-4311-8f2d-4929df35731a tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:27.622651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-60fc0371-c688-4b7a-9317-b3cd67c495f2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:27.637646 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-60fc0371-c688-4b7a-9317-b3cd67c495f2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.291279 May 28 21:17:27.638420 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1848/3740] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:27 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:27.643762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d13bd619-fb26-4289-913e-f0278685ef26 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:27.644309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d13bd619-fb26-4289-913e-f0278685ef26 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:27.651367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d13bd619-fb26-4289-913e-f0278685ef26 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:27.652187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d13bd619-fb26-4289-913e-f0278685ef26 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:27.653119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d13bd619-fb26-4289-913e-f0278685ef26 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:27.655307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d13bd619-fb26-4289-913e-f0278685ef26 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:27.845877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6b6ac62b-3561-4311-8f2d-4929df35731a tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a952d7989d3945b6a3ed38c2e444a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dd563271c04f6dae47402935636bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:27.858495 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6b6ac62b-3561-4311-8f2d-4929df35731a tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 200 len: 1325 microversion: 2.1 time: 0.316970 May 28 21:17:27.876355 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1893/3741] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:27 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 1325 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:27.890242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d13bd619-fb26-4289-913e-f0278685ef26 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:27.914870 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d13bd619-fb26-4289-913e-f0278685ef26 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.274778 May 28 21:17:27.919979 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1849/3742] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:27 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:28.326286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-b8e0ee9f-70ff-487c-978e-22262446b074 req-bf4a4c2a-bef5-4cc0-bc2e-3a8a54e44a96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c9c3c1b-c9a5-487c-a289-8819e3d55917", "tag": "166e39a1-67c3-42fa-88f7-f56ef7402365"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:28.349083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b8e0ee9f-70ff-487c-978e-22262446b074 req-bf4a4c2a-bef5-4cc0-bc2e-3a8a54e44a96 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:28.350036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b8e0ee9f-70ff-487c-978e-22262446b074 req-bf4a4c2a-bef5-4cc0-bc2e-3a8a54e44a96 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:28.370159 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b8e0ee9f-70ff-487c-978e-22262446b074 req-bf4a4c2a-bef5-4cc0-bc2e-3a8a54e44a96 service nova] Creating event network-changed:166e39a1-67c3-42fa-88f7-f56ef7402365 for instance 8c9c3c1b-c9a5-487c-a289-8819e3d55917 on nch1-master-1 May 28 21:17:28.379691 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-b8e0ee9f-70ff-487c-978e-22262446b074 req-bf4a4c2a-bef5-4cc0-bc2e-3a8a54e44a96 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058295 May 28 21:17:28.380704 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1894/3743] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:28.657621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fb9cbb28-9c00-4870-b056-2761f2f15114 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:28.659052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fb9cbb28-9c00-4870-b056-2761f2f15114 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:28.670397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb9cbb28-9c00-4870-b056-2761f2f15114 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:28.670397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb9cbb28-9c00-4870-b056-2761f2f15114 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:28.670397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb9cbb28-9c00-4870-b056-2761f2f15114 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:28.670397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb9cbb28-9c00-4870-b056-2761f2f15114 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:28.857508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fb9cbb28-9c00-4870-b056-2761f2f15114 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:28.872285 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fb9cbb28-9c00-4870-b056-2761f2f15114 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.219752 May 28 21:17:28.873258 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1850/3744] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:28 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:28.885589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3867ebea-ed6d-41a9-a44d-77aaa2cbda36 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:28.888609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3867ebea-ed6d-41a9-a44d-77aaa2cbda36 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:28.895221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3867ebea-ed6d-41a9-a44d-77aaa2cbda36 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:28.895680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3867ebea-ed6d-41a9-a44d-77aaa2cbda36 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:28.896463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3867ebea-ed6d-41a9-a44d-77aaa2cbda36 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:28.896905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3867ebea-ed6d-41a9-a44d-77aaa2cbda36 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:28.937750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-248238ae-a31a-4e97-bf24-b9082e517116 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:28.938602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-248238ae-a31a-4e97-bf24-b9082e517116 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:28.947316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-248238ae-a31a-4e97-bf24-b9082e517116 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:28.948049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-248238ae-a31a-4e97-bf24-b9082e517116 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:28.949094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-248238ae-a31a-4e97-bf24-b9082e517116 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:28.949692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-248238ae-a31a-4e97-bf24-b9082e517116 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:29.387912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3867ebea-ed6d-41a9-a44d-77aaa2cbda36 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a952d7989d3945b6a3ed38c2e444a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dd563271c04f6dae47402935636bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:29.401129 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3867ebea-ed6d-41a9-a44d-77aaa2cbda36 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 200 len: 1325 microversion: 2.1 time: 0.521874 May 28 21:17:29.403494 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1895/3745] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:28 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 1325 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:29.430374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-248238ae-a31a-4e97-bf24-b9082e517116 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:29.450443 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-248238ae-a31a-4e97-bf24-b9082e517116 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.517008 May 28 21:17:29.458334 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1851/3746] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:28 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:29.894125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f0d72276-b6f1-46da-a2d7-75082cf53346 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:29.896045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f0d72276-b6f1-46da-a2d7-75082cf53346 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:29.904023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0d72276-b6f1-46da-a2d7-75082cf53346 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:29.904885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0d72276-b6f1-46da-a2d7-75082cf53346 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:29.905937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0d72276-b6f1-46da-a2d7-75082cf53346 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:29.906617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0d72276-b6f1-46da-a2d7-75082cf53346 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:30.082320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f0d72276-b6f1-46da-a2d7-75082cf53346 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:30.093004 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f0d72276-b6f1-46da-a2d7-75082cf53346 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.206711 May 28 21:17:30.093937 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1896/3747] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:29 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:30.421125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-96060716-cf22-422e-ae61-d22a160a82fe tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:30.423492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-96060716-cf22-422e-ae61-d22a160a82fe tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:30.432442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96060716-cf22-422e-ae61-d22a160a82fe tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:30.433495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96060716-cf22-422e-ae61-d22a160a82fe tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:30.434604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96060716-cf22-422e-ae61-d22a160a82fe tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:30.435153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96060716-cf22-422e-ae61-d22a160a82fe tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:30.472157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e8b7bae8-4c04-42f5-97b0-e4d7c25739d2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:30.473385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e8b7bae8-4c04-42f5-97b0-e4d7c25739d2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:30.499559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8b7bae8-4c04-42f5-97b0-e4d7c25739d2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:30.499692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8b7bae8-4c04-42f5-97b0-e4d7c25739d2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:30.500461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8b7bae8-4c04-42f5-97b0-e4d7c25739d2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:30.500920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8b7bae8-4c04-42f5-97b0-e4d7c25739d2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:30.768631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-96060716-cf22-422e-ae61-d22a160a82fe tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a952d7989d3945b6a3ed38c2e444a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dd563271c04f6dae47402935636bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:30.778731 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-96060716-cf22-422e-ae61-d22a160a82fe tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 200 len: 1325 microversion: 2.1 time: 0.362556 May 28 21:17:30.784797 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1852/3748] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:30 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 1325 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:30.851262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e8b7bae8-4c04-42f5-97b0-e4d7c25739d2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:30.864169 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e8b7bae8-4c04-42f5-97b0-e4d7c25739d2 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.399947 May 28 21:17:30.875631 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1897/3749] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:30 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:31.111155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-772cf9dc-7042-4e38-9dca-66482a6f1e49 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:31.111788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-772cf9dc-7042-4e38-9dca-66482a6f1e49 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:31.118025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-772cf9dc-7042-4e38-9dca-66482a6f1e49 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:31.125958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-772cf9dc-7042-4e38-9dca-66482a6f1e49 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:31.126921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-772cf9dc-7042-4e38-9dca-66482a6f1e49 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:31.127386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-772cf9dc-7042-4e38-9dca-66482a6f1e49 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:31.132581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:17:31.702833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-772cf9dc-7042-4e38-9dca-66482a6f1e49 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:31.739414 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-772cf9dc-7042-4e38-9dca-66482a6f1e49 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.630378 May 28 21:17:31.739414 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1853/3750] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:31 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:31.796755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6aad855a-9337-4b55-a035-ed861c82b9e1 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:31.797381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6aad855a-9337-4b55-a035-ed861c82b9e1 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:31.805395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6aad855a-9337-4b55-a035-ed861c82b9e1 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:31.806085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6aad855a-9337-4b55-a035-ed861c82b9e1 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:31.806863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6aad855a-9337-4b55-a035-ed861c82b9e1 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:31.807518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6aad855a-9337-4b55-a035-ed861c82b9e1 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:31.812463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:17:31.885596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c971cf4a-23f0-4770-9181-978be2c3b883 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:31.886528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c971cf4a-23f0-4770-9181-978be2c3b883 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:31.893711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c971cf4a-23f0-4770-9181-978be2c3b883 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:31.894596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c971cf4a-23f0-4770-9181-978be2c3b883 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:31.895955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c971cf4a-23f0-4770-9181-978be2c3b883 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:31.896676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c971cf4a-23f0-4770-9181-978be2c3b883 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:32.161390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6aad855a-9337-4b55-a035-ed861c82b9e1 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a952d7989d3945b6a3ed38c2e444a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dd563271c04f6dae47402935636bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:32.171005 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6aad855a-9337-4b55-a035-ed861c82b9e1 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 200 len: 1325 microversion: 2.1 time: 0.378126 May 28 21:17:32.177952 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1898/3751] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:31 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 1325 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:32.207536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c971cf4a-23f0-4770-9181-978be2c3b883 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:32.215874 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c971cf4a-23f0-4770-9181-978be2c3b883 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.337824 May 28 21:17:32.216703 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1854/3752] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:31 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:32.757246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2d95c3e5-4aec-4554-a5e4-0032a93b81d7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:32.757932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2d95c3e5-4aec-4554-a5e4-0032a93b81d7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:32.767277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d95c3e5-4aec-4554-a5e4-0032a93b81d7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:32.768188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d95c3e5-4aec-4554-a5e4-0032a93b81d7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:32.770177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d95c3e5-4aec-4554-a5e4-0032a93b81d7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:32.770816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d95c3e5-4aec-4554-a5e4-0032a93b81d7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:32.928495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2d95c3e5-4aec-4554-a5e4-0032a93b81d7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:32.937052 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2d95c3e5-4aec-4554-a5e4-0032a93b81d7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.184237 May 28 21:17:32.937647 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1899/3753] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:32 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:33.188542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-90d41a1b-e809-4c32-acee-b9b4dd29d99e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:33.189165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-90d41a1b-e809-4c32-acee-b9b4dd29d99e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:33.192523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:17:33.205630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90d41a1b-e809-4c32-acee-b9b4dd29d99e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:33.206538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90d41a1b-e809-4c32-acee-b9b4dd29d99e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:33.206888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90d41a1b-e809-4c32-acee-b9b4dd29d99e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:33.207516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90d41a1b-e809-4c32-acee-b9b4dd29d99e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:33.238911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c5559ba6-2855-4396-a471-0c503a3e766e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:33.239757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c5559ba6-2855-4396-a471-0c503a3e766e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:33.246629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:17:33.249164 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5559ba6-2855-4396-a471-0c503a3e766e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:33.249805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5559ba6-2855-4396-a471-0c503a3e766e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:33.251662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5559ba6-2855-4396-a471-0c503a3e766e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:33.252296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5559ba6-2855-4396-a471-0c503a3e766e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:33.477405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-90d41a1b-e809-4c32-acee-b9b4dd29d99e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a952d7989d3945b6a3ed38c2e444a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dd563271c04f6dae47402935636bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:33.513338 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-90d41a1b-e809-4c32-acee-b9b4dd29d99e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 200 len: 1325 microversion: 2.1 time: 0.327929 May 28 21:17:33.515131 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1855/3754] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:33 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 1325 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:33.581709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c5559ba6-2855-4396-a471-0c503a3e766e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:33.593285 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c5559ba6-2855-4396-a471-0c503a3e766e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.362890 May 28 21:17:33.599230 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1900/3755] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:33 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:33.955131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a061ff02-a180-4149-bfb5-ac208c256239 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:33.955801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a061ff02-a180-4149-bfb5-ac208c256239 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:33.962615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a061ff02-a180-4149-bfb5-ac208c256239 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:33.963084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a061ff02-a180-4149-bfb5-ac208c256239 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:33.963875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a061ff02-a180-4149-bfb5-ac208c256239 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:33.964327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a061ff02-a180-4149-bfb5-ac208c256239 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:34.156179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:17:34.164068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a061ff02-a180-4149-bfb5-ac208c256239 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:34.175477 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a061ff02-a180-4149-bfb5-ac208c256239 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1735 microversion: 2.1 time: 0.222441 May 28 21:17:34.176137 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1856/3756] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:33 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:34.532378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1814987c-3e70-47d4-a437-2311030f6520 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:34.533001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1814987c-3e70-47d4-a437-2311030f6520 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:34.540798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1814987c-3e70-47d4-a437-2311030f6520 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:34.545245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1814987c-3e70-47d4-a437-2311030f6520 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:34.545245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1814987c-3e70-47d4-a437-2311030f6520 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:34.545245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1814987c-3e70-47d4-a437-2311030f6520 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:34.617722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-407feb03-72bf-4bcd-8a86-6e19b390451d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:34.618512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-407feb03-72bf-4bcd-8a86-6e19b390451d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:34.628000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-407feb03-72bf-4bcd-8a86-6e19b390451d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:34.628837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-407feb03-72bf-4bcd-8a86-6e19b390451d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:34.631140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-407feb03-72bf-4bcd-8a86-6e19b390451d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:34.638732 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-407feb03-72bf-4bcd-8a86-6e19b390451d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:34.885498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1814987c-3e70-47d4-a437-2311030f6520 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a952d7989d3945b6a3ed38c2e444a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dd563271c04f6dae47402935636bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:34.899740 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1814987c-3e70-47d4-a437-2311030f6520 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 200 len: 1325 microversion: 2.1 time: 0.369773 May 28 21:17:34.899740 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1901/3757] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:34 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 1325 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:35.047762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-407feb03-72bf-4bcd-8a86-6e19b390451d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:35.067865 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-407feb03-72bf-4bcd-8a86-6e19b390451d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1512 microversion: 2.1 time: 0.455395 May 28 21:17:35.069115 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1857/3758] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:34 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1512 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:35.103244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-95e3d375-f4d4-49c1-923f-989ea0b0fdab req-481b1dd7-535c-41fe-8761-fdde6a2fa9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c9c3c1b-c9a5-487c-a289-8819e3d55917", "name": "network-vif-plugged", "status": "completed", "tag": "166e39a1-67c3-42fa-88f7-f56ef7402365"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:35.112420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-95e3d375-f4d4-49c1-923f-989ea0b0fdab req-481b1dd7-535c-41fe-8761-fdde6a2fa9d1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:35.112948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-95e3d375-f4d4-49c1-923f-989ea0b0fdab req-481b1dd7-535c-41fe-8761-fdde6a2fa9d1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:35.131442 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-95e3d375-f4d4-49c1-923f-989ea0b0fdab req-481b1dd7-535c-41fe-8761-fdde6a2fa9d1 service nova] Creating event network-vif-plugged:166e39a1-67c3-42fa-88f7-f56ef7402365 for instance 8c9c3c1b-c9a5-487c-a289-8819e3d55917 on nch1-master-1 May 28 21:17:35.137618 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-95e3d375-f4d4-49c1-923f-989ea0b0fdab req-481b1dd7-535c-41fe-8761-fdde6a2fa9d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038452 May 28 21:17:35.138663 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1902/3759] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:35.193088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd5d8141-ffa2-4916-a738-b1e900360b57 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:35.195450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bd5d8141-ffa2-4916-a738-b1e900360b57 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:35.217263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd5d8141-ffa2-4916-a738-b1e900360b57 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:35.220202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd5d8141-ffa2-4916-a738-b1e900360b57 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:35.223304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd5d8141-ffa2-4916-a738-b1e900360b57 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:35.225457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd5d8141-ffa2-4916-a738-b1e900360b57 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:35.506128 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bd5d8141-ffa2-4916-a738-b1e900360b57 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:35.514245 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bd5d8141-ffa2-4916-a738-b1e900360b57 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1715 microversion: 2.1 time: 0.325590 May 28 21:17:35.514838 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1858/3760] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:35 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1715 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:35.638416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b8bdfafc-8112-4d4c-b211-6d2be6571da7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:35.638967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b8bdfafc-8112-4d4c-b211-6d2be6571da7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:35.646103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b8bdfafc-8112-4d4c-b211-6d2be6571da7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:35.646561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b8bdfafc-8112-4d4c-b211-6d2be6571da7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:35.647364 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b8bdfafc-8112-4d4c-b211-6d2be6571da7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:35.647910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b8bdfafc-8112-4d4c-b211-6d2be6571da7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:35.737644 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-b8bdfafc-8112-4d4c-b211-6d2be6571da7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] HTTP exception thrown: Cannot 'detach_volume' instance 43ee8dd9-d59f-422a-a29d-2732e2573958 while it is in vm_state rescued May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b8bdfafc-8112-4d4c-b211-6d2be6571da7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Request method failure captured: May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-volume_attachments/91db7a6e-9511-44a8-bcd6-90cbdc41f7f0 HTTP/1.1 May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpC0XaL6nt9hgj0fqNJ-e8egvesT5NjK_jUnUBAtg24_DQiY4yBBswyZZHwMHrBd5ALBI4UbRMzOp6RzZMuwpPVT6pecTgJ4VSwWmnC-cS82dnuXHOnMJSwA47KVatITeM5lcpiario-t9uZicKVzKlAEQs1aEbN7XgO22WG-C22tyY May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53b9cfacdbb74a058e52bed331a6f241", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: af446b3d802a42e3bd72b08bace8ea8d May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: exception: Cannot 'detach_volume' instance 43ee8dd9-d59f-422a-a29d-2732e2573958 while it is in vm_state rescued May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'server_id': '43ee8dd9-d59f-422a-a29d-2732e2573958', 'id': '91db7a6e-9511-44a8-bcd6-90cbdc41f7f0'} May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 43ee8dd9-d59f-422a-a29d-2732e2573958 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 43ee8dd9-d59f-422a-a29d-2732e2573958 while it is in vm_state rescued May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:35.739400 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:35.744010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:35.744010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:35.744010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:35.744010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:35.744010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 43ee8dd9-d59f-422a-a29d-2732e2573958 while it is in vm_state rescued May 28 21:17:35.744010 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:35.744010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b8bdfafc-8112-4d4c-b211-6d2be6571da7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Returning 409 to user: Cannot 'detach_volume' instance 43ee8dd9-d59f-422a-a29d-2732e2573958 while it is in vm_state rescued {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:35.744010 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b8bdfafc-8112-4d4c-b211-6d2be6571da7 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "DELETE /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-volume_attachments/91db7a6e-9511-44a8-bcd6-90cbdc41f7f0" status: 409 len: 152 microversion: 2.1 time: 0.108151 May 28 21:17:35.744010 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1903/3761] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:17:35 2022] DELETE /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-volume_attachments/91db7a6e-9511-44a8-bcd6-90cbdc41f7f0 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:17:35.751684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bb2a1e42-4049-43db-bb30-35d776dc97f1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:35.752324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bb2a1e42-4049-43db-bb30-35d776dc97f1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:35.760074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb2a1e42-4049-43db-bb30-35d776dc97f1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:35.760528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb2a1e42-4049-43db-bb30-35d776dc97f1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:35.761391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb2a1e42-4049-43db-bb30-35d776dc97f1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:35.761769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb2a1e42-4049-43db-bb30-35d776dc97f1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:35.915616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-21851493-f78d-4c99-8f79-a0c661952782 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:35.927340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-21851493-f78d-4c99-8f79-a0c661952782 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:35.935887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21851493-f78d-4c99-8f79-a0c661952782 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:35.936541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21851493-f78d-4c99-8f79-a0c661952782 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:35.937489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21851493-f78d-4c99-8f79-a0c661952782 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:35.938120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21851493-f78d-4c99-8f79-a0c661952782 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:36.086584 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bb2a1e42-4049-43db-bb30-35d776dc97f1 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/action" status: 202 len: 0 microversion: 2.1 time: 0.287772 May 28 21:17:36.086584 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1859/3762] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:17:35 2022] POST /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:17:36.087962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cc1837a4-34a0-4588-970c-12db4d1fbc3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:36.090495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cc1837a4-34a0-4588-970c-12db4d1fbc3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:36.097222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc1837a4-34a0-4588-970c-12db4d1fbc3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:36.097811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc1837a4-34a0-4588-970c-12db4d1fbc3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:36.098780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc1837a4-34a0-4588-970c-12db4d1fbc3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:36.099442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc1837a4-34a0-4588-970c-12db4d1fbc3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:36.328266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-21851493-f78d-4c99-8f79-a0c661952782 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a952d7989d3945b6a3ed38c2e444a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dd563271c04f6dae47402935636bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:36.336582 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-21851493-f78d-4c99-8f79-a0c661952782 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 200 len: 1325 microversion: 2.1 time: 0.426085 May 28 21:17:36.337281 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1904/3763] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:35 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 1325 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:36.342104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d32836ed-d773-48f3-b65e-2da8541c1cf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:36.342788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d32836ed-d773-48f3-b65e-2da8541c1cf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:36.349348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d32836ed-d773-48f3-b65e-2da8541c1cf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:36.350090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d32836ed-d773-48f3-b65e-2da8541c1cf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:36.350901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d32836ed-d773-48f3-b65e-2da8541c1cf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:36.351564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d32836ed-d773-48f3-b65e-2da8541c1cf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:36.496574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cc1837a4-34a0-4588-970c-12db4d1fbc3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:36.507269 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cc1837a4-34a0-4588-970c-12db4d1fbc3d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1489 microversion: 2.1 time: 0.426400 May 28 21:17:36.518731 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1860/3764] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:36 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1489 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:36.524263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5bffe55f-78be-447a-84e1-35fe2e85b66c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1275093495"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:36.528413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5bffe55f-78be-447a-84e1-35fe2e85b66c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:36.534914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bffe55f-78be-447a-84e1-35fe2e85b66c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:36.536162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bffe55f-78be-447a-84e1-35fe2e85b66c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:36.537138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bffe55f-78be-447a-84e1-35fe2e85b66c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:36.537754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bffe55f-78be-447a-84e1-35fe2e85b66c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:36.671334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d32836ed-d773-48f3-b65e-2da8541c1cf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:36.680428 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d32836ed-d773-48f3-b65e-2da8541c1cf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1723 microversion: 2.1 time: 0.342052 May 28 21:17:36.691570 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1905/3765] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:36 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1723 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:36.815268 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5bffe55f-78be-447a-84e1-35fe2e85b66c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "PUT /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1062 microversion: 2.1 time: 0.295301 May 28 21:17:36.816483 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1861/3766] 10.222.0.33 () {60 vars in 1255 bytes} [Sat May 28 21:17:36 2022] PUT /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1062 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:36.829677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c3c0c99b-7690-440f-880a-35d7fee323e3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:36.830325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c3c0c99b-7690-440f-880a-35d7fee323e3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:36.837208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3c0c99b-7690-440f-880a-35d7fee323e3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:36.837975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3c0c99b-7690-440f-880a-35d7fee323e3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:36.838921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3c0c99b-7690-440f-880a-35d7fee323e3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:36.839525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3c0c99b-7690-440f-880a-35d7fee323e3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:37.354284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-01997425-61f5-4c88-be76-694e48efb791 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:37.355450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-01997425-61f5-4c88-be76-694e48efb791 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:37.362220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01997425-61f5-4c88-be76-694e48efb791 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:37.362675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01997425-61f5-4c88-be76-694e48efb791 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:37.363509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01997425-61f5-4c88-be76-694e48efb791 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:37.363951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01997425-61f5-4c88-be76-694e48efb791 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:37.551592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c3c0c99b-7690-440f-880a-35d7fee323e3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:37.559319 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c3c0c99b-7690-440f-880a-35d7fee323e3 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1489 microversion: 2.1 time: 0.733580 May 28 21:17:37.559905 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1906/3767] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:36 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1489 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:37.575069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dea398f3-3cc2-4bf8-a30a-477a78f0883a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:37.575714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dea398f3-3cc2-4bf8-a30a-477a78f0883a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:37.582662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dea398f3-3cc2-4bf8-a30a-477a78f0883a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:37.583149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dea398f3-3cc2-4bf8-a30a-477a78f0883a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:37.584044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dea398f3-3cc2-4bf8-a30a-477a78f0883a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:37.584823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dea398f3-3cc2-4bf8-a30a-477a78f0883a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:37.797289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-01997425-61f5-4c88-be76-694e48efb791 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a952d7989d3945b6a3ed38c2e444a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dd563271c04f6dae47402935636bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:37.805202 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-01997425-61f5-4c88-be76-694e48efb791 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 200 len: 1521 microversion: 2.1 time: 0.454893 May 28 21:17:37.805797 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1862/3768] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:37 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:37.810657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ebd7cf96-687e-4839-ad3a-4b3a0e0f9580 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:37.813106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ebd7cf96-687e-4839-ad3a-4b3a0e0f9580 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:37.817873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebd7cf96-687e-4839-ad3a-4b3a0e0f9580 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:37.818997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebd7cf96-687e-4839-ad3a-4b3a0e0f9580 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:37.819868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebd7cf96-687e-4839-ad3a-4b3a0e0f9580 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:37.820323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebd7cf96-687e-4839-ad3a-4b3a0e0f9580 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:37.956234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dea398f3-3cc2-4bf8-a30a-477a78f0883a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:37.965796 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dea398f3-3cc2-4bf8-a30a-477a78f0883a tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1489 microversion: 2.1 time: 0.393425 May 28 21:17:37.965796 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1907/3769] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:37 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1489 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:17:37.969978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5eda7aff-f269-45b4-9ec8-217dab66fd3f tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:37.970522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5eda7aff-f269-45b4-9ec8-217dab66fd3f tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:37.976801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5eda7aff-f269-45b4-9ec8-217dab66fd3f tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:37.977269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5eda7aff-f269-45b4-9ec8-217dab66fd3f tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:37.978109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5eda7aff-f269-45b4-9ec8-217dab66fd3f tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:37.978558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5eda7aff-f269-45b4-9ec8-217dab66fd3f tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:38.010180 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-5eda7aff-f269-45b4-9ec8-217dab66fd3f tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] HTTP exception thrown: Action 999 not found May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5eda7aff-f269-45b4-9ec8-217dab66fd3f tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Request method failure captured: May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917/os-instance-actions/999 HTTP/1.1 May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpFhP1HJenM7W-yxKDKg4RMHpqSQIdQpSeuffgn08rrzDkIu69qG9cVUXccfC2xb9p83PtF3JCJ2QBaEiZe_ZDLuu2jopG9uQ-iUGurgHBc7OsUlGSTdvFTjVGcGqT0VYV1xCsekCLuXznbCG_FdPwWZ1sL4n-mkFwi_7qq1zNNiLR8 May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: c9dd563271c04f6dae47402935636bb8 May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1602687618 May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9dd563271c04f6dae47402935636bb8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9dd563271c04f6dae47402935636bb8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9dd563271c04f6dae47402935636bb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9dd563271c04f6dae47402935636bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1602687618 May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: c9dd563271c04f6dae47402935636bb8 May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1602687618 May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-InstanceActionsNegativeTestJSON-1602687618-project May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: a952d7989d3945b6a3ed38c2e444a7ba May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1602687618-project May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: exception: Action 999 not found May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'server_id': '8c9c3c1b-c9a5-487c-a289-8819e3d55917', 'id': '999'} May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found May 28 21:17:38.020116 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:38.024402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5eda7aff-f269-45b4-9ec8-217dab66fd3f tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Returning 404 to user: Action 999 not found {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:38.024402 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5eda7aff-f269-45b4-9ec8-217dab66fd3f tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.055816 May 28 21:17:38.024402 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1908/3770] 10.222.0.33 () {58 vars in 1307 bytes} [Sat May 28 21:17:37 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917/os-instance-actions/999 => generated 66 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:17:38.029417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fca28f87-52bd-4682-b5ff-17044f1101db tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:38.029921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fca28f87-52bd-4682-b5ff-17044f1101db tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:38.036205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fca28f87-52bd-4682-b5ff-17044f1101db tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:38.036666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fca28f87-52bd-4682-b5ff-17044f1101db tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:38.037436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fca28f87-52bd-4682-b5ff-17044f1101db tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:38.038083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fca28f87-52bd-4682-b5ff-17044f1101db tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:38.061405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ebd7cf96-687e-4839-ad3a-4b3a0e0f9580 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:38.064438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fca28f87-52bd-4682-b5ff-17044f1101db tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:17:38.080623 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ebd7cf96-687e-4839-ad3a-4b3a0e0f9580 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1723 microversion: 2.1 time: 0.273742 May 28 21:17:38.081262 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1863/3771] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:37 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:38.092721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2e394f36-24da-433e-b084-a9e72d9e8096 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '.version_select at 0x7f4d57971c10>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:38.093360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2e394f36-24da-433e-b084-a9e72d9e8096 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 6202fc34-2864-4b9f-b48a-fa98784ad6c0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:38.101170 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-2e394f36-24da-433e-b084-a9e72d9e8096 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] HTTP exception thrown: Instance 6202fc34-2864-4b9f-b48a-fa98784ad6c0 could not be found. May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2e394f36-24da-433e-b084-a9e72d9e8096 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Request method failure captured: May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/6202fc34-2864-4b9f-b48a-fa98784ad6c0/os-instance-actions HTTP/1.1 May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpFhP1HJenM7W-yxKDKg4RMHpqSQIdQpSeuffgn08rrzDkIu69qG9cVUXccfC2xb9p83PtF3JCJ2QBaEiZe_ZDLuu2jopG9uQ-iUGurgHBc7OsUlGSTdvFTjVGcGqT0VYV1xCsekCLuXznbCG_FdPwWZ1sL4n-mkFwi_7qq1zNNiLR8 May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: c9dd563271c04f6dae47402935636bb8 May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1602687618 May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9dd563271c04f6dae47402935636bb8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9dd563271c04f6dae47402935636bb8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9dd563271c04f6dae47402935636bb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9dd563271c04f6dae47402935636bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1602687618 May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: c9dd563271c04f6dae47402935636bb8 May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1602687618 May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-InstanceActionsNegativeTestJSON-1602687618-project May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: a952d7989d3945b6a3ed38c2e444a7ba May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1602687618-project May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 6202fc34-2864-4b9f-b48a-fa98784ad6c0 could not be found. May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'server_id': '6202fc34-2864-4b9f-b48a-fa98784ad6c0'} May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6202fc34-2864-4b9f-b48a-fa98784ad6c0 could not be found. May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:38.103328 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:38.117767 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6202fc34-2864-4b9f-b48a-fa98784ad6c0 could not be found. May 28 21:17:38.117767 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:38.117767 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:38.117767 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:38.117767 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:38.117767 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:38.117767 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:38.117767 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:38.117767 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:38.117767 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6202fc34-2864-4b9f-b48a-fa98784ad6c0 could not be found. May 28 21:17:38.117767 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:38.117767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2e394f36-24da-433e-b084-a9e72d9e8096 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Returning 404 to user: Instance 6202fc34-2864-4b9f-b48a-fa98784ad6c0 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:38.117767 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2e394f36-24da-433e-b084-a9e72d9e8096 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/6202fc34-2864-4b9f-b48a-fa98784ad6c0/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.016335 May 28 21:17:38.117767 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1864/3772] 10.222.0.33 () {58 vars in 1295 bytes} [Sat May 28 21:17:38 2022] GET /compute/v2.1/servers/6202fc34-2864-4b9f-b48a-fa98784ad6c0/os-instance-actions => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:38.121361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0831ee4e-db6e-47d1-a706-af5f508a1732 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:38.123130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0831ee4e-db6e-47d1-a706-af5f508a1732 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:38.130984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0831ee4e-db6e-47d1-a706-af5f508a1732 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:38.130984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0831ee4e-db6e-47d1-a706-af5f508a1732 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:38.130984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0831ee4e-db6e-47d1-a706-af5f508a1732 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:38.135295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0831ee4e-db6e-47d1-a706-af5f508a1732 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:38.156859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0831ee4e-db6e-47d1-a706-af5f508a1732 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:17:38.445104 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fca28f87-52bd-4682-b5ff-17044f1101db tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 204 len: 0 microversion: 2.1 time: 0.420455 May 28 21:17:38.449408 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1909/3773] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:17:38 2022] DELETE /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:17:38.457666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a20681fe-66fa-44eb-b1e1-997e9512d7eb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:38.458598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a20681fe-66fa-44eb-b1e1-997e9512d7eb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:38.465058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a20681fe-66fa-44eb-b1e1-997e9512d7eb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:38.465733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a20681fe-66fa-44eb-b1e1-997e9512d7eb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:38.467751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a20681fe-66fa-44eb-b1e1-997e9512d7eb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:38.468362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a20681fe-66fa-44eb-b1e1-997e9512d7eb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:38.474372 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0831ee4e-db6e-47d1-a706-af5f508a1732 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 204 len: 0 microversion: 2.1 time: 0.356596 May 28 21:17:38.478387 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1865/3774] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:17:38 2022] DELETE /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:17:38.484701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2bb27a93-6e56-4509-b771-7426fcd39b2e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:38.485627 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2bb27a93-6e56-4509-b771-7426fcd39b2e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:38.492432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bb27a93-6e56-4509-b771-7426fcd39b2e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:38.493122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bb27a93-6e56-4509-b771-7426fcd39b2e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:38.494947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bb27a93-6e56-4509-b771-7426fcd39b2e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:38.495562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bb27a93-6e56-4509-b771-7426fcd39b2e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:38.872213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2bb27a93-6e56-4509-b771-7426fcd39b2e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a952d7989d3945b6a3ed38c2e444a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dd563271c04f6dae47402935636bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:38.877921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a20681fe-66fa-44eb-b1e1-997e9512d7eb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:38.885222 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a20681fe-66fa-44eb-b1e1-997e9512d7eb tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1495 microversion: 2.1 time: 0.432139 May 28 21:17:38.885884 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1910/3775] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:38 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1495 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:38.892515 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2bb27a93-6e56-4509-b771-7426fcd39b2e tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 200 len: 1527 microversion: 2.1 time: 0.403991 May 28 21:17:38.901248 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1866/3776] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:38 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 1527 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:39.100791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8e8ccb96-f3d1-4d8c-8250-ff25b596c2a6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:39.102338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8e8ccb96-f3d1-4d8c-8250-ff25b596c2a6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:39.109037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e8ccb96-f3d1-4d8c-8250-ff25b596c2a6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:39.109573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e8ccb96-f3d1-4d8c-8250-ff25b596c2a6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:39.110522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e8ccb96-f3d1-4d8c-8250-ff25b596c2a6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:39.111039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e8ccb96-f3d1-4d8c-8250-ff25b596c2a6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:39.258348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8e8ccb96-f3d1-4d8c-8250-ff25b596c2a6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:39.266982 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8e8ccb96-f3d1-4d8c-8250-ff25b596c2a6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1723 microversion: 2.1 time: 0.171937 May 28 21:17:39.278000 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1911/3777] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:39 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:39.909790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-809fb1a8-c22a-4363-b919-95c2546ad261 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:39.910485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-809fb1a8-c22a-4363-b919-95c2546ad261 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:39.917357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c7e2f4b6-3ebc-4280-95fb-a6f7dec3d735 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:39.918063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c7e2f4b6-3ebc-4280-95fb-a6f7dec3d735 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:39.932233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7e2f4b6-3ebc-4280-95fb-a6f7dec3d735 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:39.932697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7e2f4b6-3ebc-4280-95fb-a6f7dec3d735 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:39.938713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-809fb1a8-c22a-4363-b919-95c2546ad261 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:39.939302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-809fb1a8-c22a-4363-b919-95c2546ad261 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:39.945004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-809fb1a8-c22a-4363-b919-95c2546ad261 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:39.945004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-809fb1a8-c22a-4363-b919-95c2546ad261 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:39.945535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7e2f4b6-3ebc-4280-95fb-a6f7dec3d735 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:39.945535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7e2f4b6-3ebc-4280-95fb-a6f7dec3d735 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:39.974494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:17:40.539311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c7e2f4b6-3ebc-4280-95fb-a6f7dec3d735 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:40.547491 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c7e2f4b6-3ebc-4280-95fb-a6f7dec3d735 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1495 microversion: 2.1 time: 0.642460 May 28 21:17:40.548086 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1867/3778] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:39 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1495 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:40.557241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e3973254-7b46-4d86-8d85-3471c32fa2bd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:40.558141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e3973254-7b46-4d86-8d85-3471c32fa2bd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:40.567899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3973254-7b46-4d86-8d85-3471c32fa2bd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:40.568609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3973254-7b46-4d86-8d85-3471c32fa2bd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:40.569584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3973254-7b46-4d86-8d85-3471c32fa2bd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:40.570229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3973254-7b46-4d86-8d85-3471c32fa2bd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:40.585868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-809fb1a8-c22a-4363-b919-95c2546ad261 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a952d7989d3945b6a3ed38c2e444a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dd563271c04f6dae47402935636bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:40.620253 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-809fb1a8-c22a-4363-b919-95c2546ad261 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 200 len: 1527 microversion: 2.1 time: 0.711945 May 28 21:17:40.623419 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1912/3779] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:39 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 1527 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:41.401632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e3973254-7b46-4d86-8d85-3471c32fa2bd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:41.411000 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e3973254-7b46-4d86-8d85-3471c32fa2bd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1729 microversion: 2.1 time: 0.861653 May 28 21:17:41.411968 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1868/3780] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:40 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1729 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:41.430062 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-db7f82e8-952a-4393-a09f-2ce399eb247d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:41.431022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-db7f82e8-952a-4393-a09f-2ce399eb247d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:41.445766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-db7f82e8-952a-4393-a09f-2ce399eb247d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:41.446473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-db7f82e8-952a-4393-a09f-2ce399eb247d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:41.447508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-db7f82e8-952a-4393-a09f-2ce399eb247d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:41.448146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-db7f82e8-952a-4393-a09f-2ce399eb247d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:41.554123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-1fe2b397-7ba3-4d9e-bca8-4c16ad93269e req-18aeecc1-b592-4beb-af78-9306b8ef6b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4597b001-5689-4b06-ba9b-a5a239582fe0", "name": "network-vif-deleted", "tag": "30aa1257-4676-4fd6-83a2-caf629e2564b"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:41.584487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1fe2b397-7ba3-4d9e-bca8-4c16ad93269e req-18aeecc1-b592-4beb-af78-9306b8ef6b66 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:41.585347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1fe2b397-7ba3-4d9e-bca8-4c16ad93269e req-18aeecc1-b592-4beb-af78-9306b8ef6b66 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:41.624275 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-1fe2b397-7ba3-4d9e-bca8-4c16ad93269e req-18aeecc1-b592-4beb-af78-9306b8ef6b66 service nova] Creating event network-vif-deleted:30aa1257-4676-4fd6-83a2-caf629e2564b for instance 4597b001-5689-4b06-ba9b-a5a239582fe0 on nch2-master-1 May 28 21:17:41.655231 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-1fe2b397-7ba3-4d9e-bca8-4c16ad93269e req-18aeecc1-b592-4beb-af78-9306b8ef6b66 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125170 May 28 21:17:41.658083 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1869/3781] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:41.689210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4140c5fd-db19-49ee-805a-05cdc8bbbaae tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:41.691523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4140c5fd-db19-49ee-805a-05cdc8bbbaae tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:41.713096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4140c5fd-db19-49ee-805a-05cdc8bbbaae tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:41.714000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4140c5fd-db19-49ee-805a-05cdc8bbbaae tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:41.715036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4140c5fd-db19-49ee-805a-05cdc8bbbaae tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:41.716606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4140c5fd-db19-49ee-805a-05cdc8bbbaae tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:41.811089 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-db7f82e8-952a-4393-a09f-2ce399eb247d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.387030 May 28 21:17:41.812669 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1913/3782] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:17:41 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-interface => generated 285 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:41.818746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-8e0b3474-1178-4e9e-8cd0-8fa523e68cf4 req-7d8f95cc-b880-46c0-bc8e-6d7c0ea18ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c9c3c1b-c9a5-487c-a289-8819e3d55917", "name": "network-vif-deleted", "tag": "166e39a1-67c3-42fa-88f7-f56ef7402365"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:41.879127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8e0b3474-1178-4e9e-8cd0-8fa523e68cf4 req-7d8f95cc-b880-46c0-bc8e-6d7c0ea18ba1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:41.883320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8e0b3474-1178-4e9e-8cd0-8fa523e68cf4 req-7d8f95cc-b880-46c0-bc8e-6d7c0ea18ba1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:41.898249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:17:41.938501 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-8e0b3474-1178-4e9e-8cd0-8fa523e68cf4 req-7d8f95cc-b880-46c0-bc8e-6d7c0ea18ba1 service nova] Creating event network-vif-deleted:166e39a1-67c3-42fa-88f7-f56ef7402365 for instance 8c9c3c1b-c9a5-487c-a289-8819e3d55917 on nch1-master-1 May 28 21:17:41.941679 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-8e0b3474-1178-4e9e-8cd0-8fa523e68cf4 req-7d8f95cc-b880-46c0-bc8e-6d7c0ea18ba1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127374 May 28 21:17:41.943418 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1914/3783] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:41.957024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2ccaede4-0104-4c76-af6d-9548e4387251 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:41.959673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2ccaede4-0104-4c76-af6d-9548e4387251 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:41.978272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ccaede4-0104-4c76-af6d-9548e4387251 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:41.979796 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ccaede4-0104-4c76-af6d-9548e4387251 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:41.980779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ccaede4-0104-4c76-af6d-9548e4387251 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:41.981252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ccaede4-0104-4c76-af6d-9548e4387251 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:42.033549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4140c5fd-db19-49ee-805a-05cdc8bbbaae tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:42.044681 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4140c5fd-db19-49ee-805a-05cdc8bbbaae tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 200 len: 1453 microversion: 2.1 time: 0.386447 May 28 21:17:42.048092 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1870/3784] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:41 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 1453 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:42.192649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2ccaede4-0104-4c76-af6d-9548e4387251 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a952d7989d3945b6a3ed38c2e444a7ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9dd563271c04f6dae47402935636bb8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:42.200311 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2ccaede4-0104-4c76-af6d-9548e4387251 tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 200 len: 1310 microversion: 2.1 time: 0.255433 May 28 21:17:42.200908 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1915/3785] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:41 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 1310 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:43.072127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-852f1e68-0fa4-482a-a3a0-dec7213317af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.076589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-852f1e68-0fa4-482a-a3a0-dec7213317af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.084762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-852f1e68-0fa4-482a-a3a0-dec7213317af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.085321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-852f1e68-0fa4-482a-a3a0-dec7213317af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.086463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-852f1e68-0fa4-482a-a3a0-dec7213317af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.087048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-852f1e68-0fa4-482a-a3a0-dec7213317af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.105418 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-852f1e68-0fa4-482a-a3a0-dec7213317af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-852f1e68-0fa4-482a-a3a0-dec7213317af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 HTTP/1.1 May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '4597b001-5689-4b06-ba9b-a5a239582fe0'} May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.108008 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.113548 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.113548 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.113548 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.113548 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.113548 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. May 28 21:17:43.113548 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.113548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-852f1e68-0fa4-482a-a3a0-dec7213317af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.118135 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-852f1e68-0fa4-482a-a3a0-dec7213317af tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 404 len: 111 microversion: 2.1 time: 0.051925 May 28 21:17:43.118135 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1871/3786] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:43 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:43.127280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-454b094d-6922-4e8a-999c-0de83a0841ca tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.127827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-454b094d-6922-4e8a-999c-0de83a0841ca tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.137935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-454b094d-6922-4e8a-999c-0de83a0841ca tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.139829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-454b094d-6922-4e8a-999c-0de83a0841ca tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.139829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-454b094d-6922-4e8a-999c-0de83a0841ca tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.139829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-454b094d-6922-4e8a-999c-0de83a0841ca tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.154017 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-454b094d-6922-4e8a-999c-0de83a0841ca tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-454b094d-6922-4e8a-999c-0de83a0841ca tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 HTTP/1.1 May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '4597b001-5689-4b06-ba9b-a5a239582fe0'} May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.155896 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. May 28 21:17:43.166250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.166250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.166250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.166250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.166250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.166250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.166250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.166250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.166250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. May 28 21:17:43.166250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.166250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-454b094d-6922-4e8a-999c-0de83a0841ca tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.166250 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-454b094d-6922-4e8a-999c-0de83a0841ca tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 404 len: 111 microversion: 2.1 time: 0.034428 May 28 21:17:43.166250 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1916/3787] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:17:43 2022] DELETE /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:43.167548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c5b156d8-22a2-4286-92d3-f199676d9c2c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.167779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c5b156d8-22a2-4286-92d3-f199676d9c2c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 4597b001-5689-4b06-ba9b-a5a239582fe0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.174536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5b156d8-22a2-4286-92d3-f199676d9c2c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.175000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5b156d8-22a2-4286-92d3-f199676d9c2c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.176483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5b156d8-22a2-4286-92d3-f199676d9c2c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.176940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5b156d8-22a2-4286-92d3-f199676d9c2c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-c5b156d8-22a2-4286-92d3-f199676d9c2c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c5b156d8-22a2-4286-92d3-f199676d9c2c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 HTTP/1.1 May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '4597b001-5689-4b06-ba9b-a5a239582fe0'} May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.196231 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.201792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. May 28 21:17:43.201792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.201792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.201792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.201792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.201792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.201792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.201792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.201792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.201792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. May 28 21:17:43.201792 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.201792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c5b156d8-22a2-4286-92d3-f199676d9c2c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 4597b001-5689-4b06-ba9b-a5a239582fe0 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.201792 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c5b156d8-22a2-4286-92d3-f199676d9c2c tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0" status: 404 len: 111 microversion: 2.1 time: 0.033286 May 28 21:17:43.201792 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1872/3788] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:43 2022] GET /compute/v2.1/servers/4597b001-5689-4b06-ba9b-a5a239582fe0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:43.208300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-150c3959-4ec0-4f6f-91a6-e9ba47509415 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.208977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-150c3959-4ec0-4f6f-91a6-e9ba47509415 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.223319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3842c40d-e8f6-47b2-bca0-763abdcf456d tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.224072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3842c40d-e8f6-47b2-bca0-763abdcf456d tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] [instance: 8c9c3c1b-c9a5-487c-a289-8819e3d55917] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.230809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-150c3959-4ec0-4f6f-91a6-e9ba47509415 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.231952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-150c3959-4ec0-4f6f-91a6-e9ba47509415 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.233103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-150c3959-4ec0-4f6f-91a6-e9ba47509415 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.233551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-150c3959-4ec0-4f6f-91a6-e9ba47509415 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.239626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3842c40d-e8f6-47b2-bca0-763abdcf456d tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.240083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3842c40d-e8f6-47b2-bca0-763abdcf456d tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.242651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3842c40d-e8f6-47b2-bca0-763abdcf456d tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.243435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3842c40d-e8f6-47b2-bca0-763abdcf456d tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.257268 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-150c3959-4ec0-4f6f-91a6-e9ba47509415 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-150c3959-4ec0-4f6f-91a6-e9ba47509415 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 HTTP/1.1 May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '86c85c17-a3ea-418f-871d-e4541573a775'} May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.259359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. May 28 21:17:43.263351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.263351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.263351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.263351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.263351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.263351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.263351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.263351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.263351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. May 28 21:17:43.263351 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.263351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-150c3959-4ec0-4f6f-91a6-e9ba47509415 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.264057 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-150c3959-4ec0-4f6f-91a6-e9ba47509415 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 404 len: 111 microversion: 2.1 time: 0.059994 May 28 21:17:43.264709 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1917/3789] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:17:43 2022] DELETE /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:43.271929 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-3842c40d-e8f6-47b2-bca0-763abdcf456d tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] HTTP exception thrown: Instance 8c9c3c1b-c9a5-487c-a289-8819e3d55917 could not be found. May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3842c40d-e8f6-47b2-bca0-763abdcf456d tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Request method failure captured: May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 HTTP/1.1 May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpFhP1HJenM7W-yxKDKg4RMHpqSQIdQpSeuffgn08rrzDkIu69qG9cVUXccfC2xb9p83PtF3JCJ2QBaEiZe_ZDLuu2jopG9uQ-iUGurgHBc7OsUlGSTdvFTjVGcGqT0VYV1xCsekCLuXznbCG_FdPwWZ1sL4n-mkFwi_7qq1zNNiLR8 May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: c9dd563271c04f6dae47402935636bb8 May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1602687618 May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9dd563271c04f6dae47402935636bb8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9dd563271c04f6dae47402935636bb8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9dd563271c04f6dae47402935636bb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9dd563271c04f6dae47402935636bb8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1602687618 May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: c9dd563271c04f6dae47402935636bb8 May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1602687618 May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-InstanceActionsNegativeTestJSON-1602687618-project May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: a952d7989d3945b6a3ed38c2e444a7ba May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1602687618-project May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 8c9c3c1b-c9a5-487c-a289-8819e3d55917 could not be found. May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '8c9c3c1b-c9a5-487c-a289-8819e3d55917'} May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c9c3c1b-c9a5-487c-a289-8819e3d55917 could not be found. May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c9c3c1b-c9a5-487c-a289-8819e3d55917 could not be found. May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.273568 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.281205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.281205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.281205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.281205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.281205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.281205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.281205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c9c3c1b-c9a5-487c-a289-8819e3d55917 could not be found. May 28 21:17:43.281205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.283331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ba451350-7690-45ac-8361-e735dc74cfde tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.283562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3842c40d-e8f6-47b2-bca0-763abdcf456d tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] Returning 404 to user: Instance 8c9c3c1b-c9a5-487c-a289-8819e3d55917 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.283670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ba451350-7690-45ac-8361-e735dc74cfde tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 86c85c17-a3ea-418f-871d-e4541573a775] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.283766 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3842c40d-e8f6-47b2-bca0-763abdcf456d tempest-InstanceActionsNegativeTestJSON-1602687618 tempest-InstanceActionsNegativeTestJSON-1602687618-project] 10.222.0.33 "GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917" status: 404 len: 111 microversion: 2.1 time: 0.057331 May 28 21:17:43.283766 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1873/3790] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:43 2022] GET /compute/v2.1/servers/8c9c3c1b-c9a5-487c-a289-8819e3d55917 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:43.304949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba451350-7690-45ac-8361-e735dc74cfde tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.305414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba451350-7690-45ac-8361-e735dc74cfde tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.306238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba451350-7690-45ac-8361-e735dc74cfde tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.306686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba451350-7690-45ac-8361-e735dc74cfde tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.345656 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-ba451350-7690-45ac-8361-e735dc74cfde tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ba451350-7690-45ac-8361-e735dc74cfde tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 HTTP/1.1 May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '86c85c17-a3ea-418f-871d-e4541573a775'} May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.348118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.352493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.352493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.352493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.352493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.352493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. May 28 21:17:43.352493 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.354538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ba451350-7690-45ac-8361-e735dc74cfde tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 86c85c17-a3ea-418f-871d-e4541573a775 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.355602 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ba451350-7690-45ac-8361-e735dc74cfde tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775" status: 404 len: 111 microversion: 2.1 time: 0.087105 May 28 21:17:43.356184 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1918/3791] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:43 2022] GET /compute/v2.1/servers/86c85c17-a3ea-418f-871d-e4541573a775 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:17:43.369578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f7151056-3890-4aba-9ecd-f9008cbf82e1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.370111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f7151056-3890-4aba-9ecd-f9008cbf82e1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.377406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7151056-3890-4aba-9ecd-f9008cbf82e1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.384730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7151056-3890-4aba-9ecd-f9008cbf82e1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.386022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7151056-3890-4aba-9ecd-f9008cbf82e1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.386714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7151056-3890-4aba-9ecd-f9008cbf82e1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.418139 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-f7151056-3890-4aba-9ecd-f9008cbf82e1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f7151056-3890-4aba-9ecd-f9008cbf82e1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 HTTP/1.1 May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '49282ea3-fb61-4ec6-9443-a2fa47fdddc1'} May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.420112 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. May 28 21:17:43.426406 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.426406 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.426406 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.426406 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.426406 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.426406 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.426406 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.426406 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.426406 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. May 28 21:17:43.426406 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.429871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f7151056-3890-4aba-9ecd-f9008cbf82e1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.430082 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f7151056-3890-4aba-9ecd-f9008cbf82e1 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 404 len: 111 microversion: 2.1 time: 0.064327 May 28 21:17:43.437182 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1874/3792] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:17:43 2022] DELETE /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:43.440686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b0d2048d-709c-45b0-92c7-82fe87016076 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.442340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b0d2048d-709c-45b0-92c7-82fe87016076 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 49282ea3-fb61-4ec6-9443-a2fa47fdddc1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.455463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0d2048d-709c-45b0-92c7-82fe87016076 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.456320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0d2048d-709c-45b0-92c7-82fe87016076 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.457482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0d2048d-709c-45b0-92c7-82fe87016076 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.458150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0d2048d-709c-45b0-92c7-82fe87016076 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.479036 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-b0d2048d-709c-45b0-92c7-82fe87016076 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b0d2048d-709c-45b0-92c7-82fe87016076 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 HTTP/1.1 May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '49282ea3-fb61-4ec6-9443-a2fa47fdddc1'} May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.480627 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.487419 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.487419 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.487419 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.487419 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.487419 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. May 28 21:17:43.487419 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.489742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b0d2048d-709c-45b0-92c7-82fe87016076 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 49282ea3-fb61-4ec6-9443-a2fa47fdddc1 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.490782 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b0d2048d-709c-45b0-92c7-82fe87016076 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1" status: 404 len: 111 microversion: 2.1 time: 0.055529 May 28 21:17:43.491707 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1919/3793] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:43 2022] GET /compute/v2.1/servers/49282ea3-fb61-4ec6-9443-a2fa47fdddc1 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:43.503668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f2f059e2-3045-4ca3-a5a1-384b4a60033f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.505582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f2f059e2-3045-4ca3-a5a1-384b4a60033f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.509800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:17:43.513643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2f059e2-3045-4ca3-a5a1-384b4a60033f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.514215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2f059e2-3045-4ca3-a5a1-384b4a60033f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.515076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2f059e2-3045-4ca3-a5a1-384b4a60033f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.516733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2f059e2-3045-4ca3-a5a1-384b4a60033f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.538986 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-f2f059e2-3045-4ca3-a5a1-384b4a60033f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f2f059e2-3045-4ca3-a5a1-384b4a60033f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b HTTP/1.1 May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b'} May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.541332 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. May 28 21:17:43.550212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.550212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.550212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.550212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.550212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.550212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.550212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.550212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.550212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. May 28 21:17:43.550212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.550212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f2f059e2-3045-4ca3-a5a1-384b4a60033f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.550212 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f2f059e2-3045-4ca3-a5a1-384b4a60033f tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 404 len: 111 microversion: 2.1 time: 0.045958 May 28 21:17:43.550212 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1875/3794] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:17:43 2022] DELETE /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:43.557007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ab22d965-f617-4f3e-bc4e-2ae39685e37e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.557645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ab22d965-f617-4f3e-bc4e-2ae39685e37e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.575332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab22d965-f617-4f3e-bc4e-2ae39685e37e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.575803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab22d965-f617-4f3e-bc4e-2ae39685e37e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.577216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab22d965-f617-4f3e-bc4e-2ae39685e37e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.577967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ab22d965-f617-4f3e-bc4e-2ae39685e37e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.594609 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-ab22d965-f617-4f3e-bc4e-2ae39685e37e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ab22d965-f617-4f3e-bc4e-2ae39685e37e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b HTTP/1.1 May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b'} May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.598505 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.602696 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.602696 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.602696 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.602696 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.602696 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. May 28 21:17:43.602696 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.605125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ab22d965-f617-4f3e-bc4e-2ae39685e37e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.606292 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ab22d965-f617-4f3e-bc4e-2ae39685e37e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b" status: 404 len: 111 microversion: 2.1 time: 0.053123 May 28 21:17:43.609106 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1920/3795] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:43 2022] GET /compute/v2.1/servers/460b0346-5e7e-4c5c-b44b-fd0b3f5ae16b => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:43.618607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2b72dbd6-f3f5-4efa-8744-01e165c9cb8e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.619130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2b72dbd6-f3f5-4efa-8744-01e165c9cb8e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.625241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b72dbd6-f3f5-4efa-8744-01e165c9cb8e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.625701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b72dbd6-f3f5-4efa-8744-01e165c9cb8e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.626517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b72dbd6-f3f5-4efa-8744-01e165c9cb8e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.626965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b72dbd6-f3f5-4efa-8744-01e165c9cb8e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.642728 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-2b72dbd6-f3f5-4efa-8744-01e165c9cb8e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2b72dbd6-f3f5-4efa-8744-01e165c9cb8e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 HTTP/1.1 May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ec6cd313-c4b7-4468-b6d4-70af3088ef89'} May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.645071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. May 28 21:17:43.652854 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.652854 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.652854 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.652854 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.652854 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.652854 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.652854 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.652854 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.652854 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. May 28 21:17:43.652854 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.652854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2b72dbd6-f3f5-4efa-8744-01e165c9cb8e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.652854 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2b72dbd6-f3f5-4efa-8744-01e165c9cb8e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 404 len: 111 microversion: 2.1 time: 0.033219 May 28 21:17:43.656798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3b8165ae-6bdf-4f7c-8307-0ad03acc908d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.657423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3b8165ae-6bdf-4f7c-8307-0ad03acc908d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ec6cd313-c4b7-4468-b6d4-70af3088ef89] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.662574 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1876/3796] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:17:43 2022] DELETE /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:43.668886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b8165ae-6bdf-4f7c-8307-0ad03acc908d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.669619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b8165ae-6bdf-4f7c-8307-0ad03acc908d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.670687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b8165ae-6bdf-4f7c-8307-0ad03acc908d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.671397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b8165ae-6bdf-4f7c-8307-0ad03acc908d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.690916 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-3b8165ae-6bdf-4f7c-8307-0ad03acc908d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3b8165ae-6bdf-4f7c-8307-0ad03acc908d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 HTTP/1.1 May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'ec6cd313-c4b7-4468-b6d4-70af3088ef89'} May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.692631 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.697319 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.697319 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.697319 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.697319 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.697319 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. May 28 21:17:43.697319 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.697319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3b8165ae-6bdf-4f7c-8307-0ad03acc908d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance ec6cd313-c4b7-4468-b6d4-70af3088ef89 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.697319 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3b8165ae-6bdf-4f7c-8307-0ad03acc908d tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89" status: 404 len: 111 microversion: 2.1 time: 0.041087 May 28 21:17:43.703146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b6d35282-a286-4b9d-81c2-047dc3a13f40 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.703657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b6d35282-a286-4b9d-81c2-047dc3a13f40 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.708091 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1921/3797] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:43 2022] GET /compute/v2.1/servers/ec6cd313-c4b7-4468-b6d4-70af3088ef89 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:43.712163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6d35282-a286-4b9d-81c2-047dc3a13f40 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.712622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6d35282-a286-4b9d-81c2-047dc3a13f40 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.713416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6d35282-a286-4b9d-81c2-047dc3a13f40 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.713911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6d35282-a286-4b9d-81c2-047dc3a13f40 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.729125 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-b6d35282-a286-4b9d-81c2-047dc3a13f40 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b6d35282-a286-4b9d-81c2-047dc3a13f40 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 HTTP/1.1 May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ae56f66e-ab85-40da-a2b6-0cf501aa93c9'} May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.730941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. May 28 21:17:43.737624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.737624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.737624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.737624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.737624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.737624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.737624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.737624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.737624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. May 28 21:17:43.737624 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.737624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b6d35282-a286-4b9d-81c2-047dc3a13f40 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.737624 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b6d35282-a286-4b9d-81c2-047dc3a13f40 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 404 len: 111 microversion: 2.1 time: 0.033672 May 28 21:17:43.737624 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1877/3798] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:17:43 2022] DELETE /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:43.744219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-252ec6e3-c7b5-42f8-a5d3-1cba5fb0a6ec tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.746402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-252ec6e3-c7b5-42f8-a5d3-1cba5fb0a6ec tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: ae56f66e-ab85-40da-a2b6-0cf501aa93c9] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.754844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-252ec6e3-c7b5-42f8-a5d3-1cba5fb0a6ec tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.755405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-252ec6e3-c7b5-42f8-a5d3-1cba5fb0a6ec tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.756340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-252ec6e3-c7b5-42f8-a5d3-1cba5fb0a6ec tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.756785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-252ec6e3-c7b5-42f8-a5d3-1cba5fb0a6ec tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.775544 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-252ec6e3-c7b5-42f8-a5d3-1cba5fb0a6ec tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-252ec6e3-c7b5-42f8-a5d3-1cba5fb0a6ec tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 HTTP/1.1 May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'ae56f66e-ab85-40da-a2b6-0cf501aa93c9'} May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.777359 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.782380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.782380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.782380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.782380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.782380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. May 28 21:17:43.782380 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.785463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-252ec6e3-c7b5-42f8-a5d3-1cba5fb0a6ec tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance ae56f66e-ab85-40da-a2b6-0cf501aa93c9 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.786583 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-252ec6e3-c7b5-42f8-a5d3-1cba5fb0a6ec tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9" status: 404 len: 111 microversion: 2.1 time: 0.048825 May 28 21:17:43.796295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-354160a2-3033-4e10-bac0-113cbe32dd36 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.797209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-354160a2-3033-4e10-bac0-113cbe32dd36 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 29cb4dc1-1163-4714-8b68-133d8643211a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.800524 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1922/3799] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:43 2022] GET /compute/v2.1/servers/ae56f66e-ab85-40da-a2b6-0cf501aa93c9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:17:43.806433 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-354160a2-3033-4e10-bac0-113cbe32dd36 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-354160a2-3033-4e10-bac0-113cbe32dd36 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/29cb4dc1-1163-4714-8b68-133d8643211a HTTP/1.1 May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '29cb4dc1-1163-4714-8b68-133d8643211a'} May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.808020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.814646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.814646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.814646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.814646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.814646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.814646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. May 28 21:17:43.814646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:43.814646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-354160a2-3033-4e10-bac0-113cbe32dd36 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.814646 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-354160a2-3033-4e10-bac0-113cbe32dd36 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/servers/29cb4dc1-1163-4714-8b68-133d8643211a" status: 404 len: 111 microversion: 2.1 time: 0.017534 May 28 21:17:43.820746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a4d9fe5c-66aa-4116-a7cd-d855523f0e69 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.821392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a4d9fe5c-66aa-4116-a7cd-d855523f0e69 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 29cb4dc1-1163-4714-8b68-133d8643211a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.824237 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1878/3800] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:17:43 2022] DELETE /compute/v2.1/servers/29cb4dc1-1163-4714-8b68-133d8643211a => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-a4d9fe5c-66aa-4116-a7cd-d855523f0e69 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a4d9fe5c-66aa-4116-a7cd-d855523f0e69 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/29cb4dc1-1163-4714-8b68-133d8643211a HTTP/1.1 May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '29cb4dc1-1163-4714-8b68-133d8643211a'} May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:43.834250 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.839768 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:43.839768 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:43.839768 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:43.839768 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:43.839768 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:43.839768 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. May 28 21:17:43.839768 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:17:43.839768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a4d9fe5c-66aa-4116-a7cd-d855523f0e69 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 29cb4dc1-1163-4714-8b68-133d8643211a could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:43.840490 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a4d9fe5c-66aa-4116-a7cd-d855523f0e69 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/29cb4dc1-1163-4714-8b68-133d8643211a" status: 404 len: 111 microversion: 2.1 time: 0.024214 May 28 21:17:43.841373 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1923/3801] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:43 2022] GET /compute/v2.1/servers/29cb4dc1-1163-4714-8b68-133d8643211a => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:43.850230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a601efb5-47f4-4da9-b63c-8d04bf256ec8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:43.850976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a601efb5-47f4-4da9-b63c-8d04bf256ec8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:43.861166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a601efb5-47f4-4da9-b63c-8d04bf256ec8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.868872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a601efb5-47f4-4da9-b63c-8d04bf256ec8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.868872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a601efb5-47f4-4da9-b63c-8d04bf256ec8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:43.868872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a601efb5-47f4-4da9-b63c-8d04bf256ec8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:43.900491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a601efb5-47f4-4da9-b63c-8d04bf256ec8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:17:44.268891 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a601efb5-47f4-4da9-b63c-8d04bf256ec8 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 204 len: 0 microversion: 2.1 time: 0.422982 May 28 21:17:44.270226 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1879/3802] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:17:43 2022] DELETE /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:17:44.278461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb12b80d-35be-46bd-825b-5239aaa35ecf tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:44.279891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fb12b80d-35be-46bd-825b-5239aaa35ecf tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:44.288982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb12b80d-35be-46bd-825b-5239aaa35ecf tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:44.289820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb12b80d-35be-46bd-825b-5239aaa35ecf tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:44.290914 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb12b80d-35be-46bd-825b-5239aaa35ecf tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:44.291589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb12b80d-35be-46bd-825b-5239aaa35ecf tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:44.829228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fb12b80d-35be-46bd-825b-5239aaa35ecf tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:44.839549 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb12b80d-35be-46bd-825b-5239aaa35ecf tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 200 len: 1480 microversion: 2.1 time: 0.564870 May 28 21:17:44.843249 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1924/3803] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:44 2022] GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 1480 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:45.478973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-e0861d2b-b860-4245-9610-895ef838527d req-08842067-cc20-4ecc-a0ce-e9e8a256f5a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ee8dd9-d59f-422a-a29d-2732e2573958", "tag": "011cb162-2172-4519-8fcc-9bf7016b04a4"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:45.501494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e0861d2b-b860-4245-9610-895ef838527d req-08842067-cc20-4ecc-a0ce-e9e8a256f5a9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:45.503332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e0861d2b-b860-4245-9610-895ef838527d req-08842067-cc20-4ecc-a0ce-e9e8a256f5a9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:45.540532 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e0861d2b-b860-4245-9610-895ef838527d req-08842067-cc20-4ecc-a0ce-e9e8a256f5a9 service nova] Creating event network-changed:011cb162-2172-4519-8fcc-9bf7016b04a4 for instance 43ee8dd9-d59f-422a-a29d-2732e2573958 on nch1-master-1 May 28 21:17:45.547812 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-e0861d2b-b860-4245-9610-895ef838527d req-08842067-cc20-4ecc-a0ce-e9e8a256f5a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073372 May 28 21:17:45.549581 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1880/3804] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:45.858517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ef3691e7-8049-4db0-aafe-09780b27866e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:45.859139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ef3691e7-8049-4db0-aafe-09780b27866e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:45.879158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:17:45.890172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef3691e7-8049-4db0-aafe-09780b27866e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:45.890641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef3691e7-8049-4db0-aafe-09780b27866e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:45.891451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef3691e7-8049-4db0-aafe-09780b27866e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:45.891881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef3691e7-8049-4db0-aafe-09780b27866e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:46.314302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ef3691e7-8049-4db0-aafe-09780b27866e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:46.322172 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ef3691e7-8049-4db0-aafe-09780b27866e tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 200 len: 1480 microversion: 2.1 time: 0.467805 May 28 21:17:46.327407 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1925/3805] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:45 2022] GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 1480 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:47.344479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6d367ad9-178c-45d1-b26d-26f31b170d11 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:47.344479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6d367ad9-178c-45d1-b26d-26f31b170d11 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:47.359378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d367ad9-178c-45d1-b26d-26f31b170d11 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:47.360545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d367ad9-178c-45d1-b26d-26f31b170d11 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:47.367907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d367ad9-178c-45d1-b26d-26f31b170d11 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:47.367907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d367ad9-178c-45d1-b26d-26f31b170d11 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:47.426137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d367ad9-178c-45d1-b26d-26f31b170d11 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:47.426913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d367ad9-178c-45d1-b26d-26f31b170d11 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:47.427540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-6d367ad9-178c-45d1-b26d-26f31b170d11 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lazy-loading 'fault' on Instance uuid 6f2f9407-da1e-473e-a8a9-87ac9a287fa4 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:17:47.494676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6d367ad9-178c-45d1-b26d-26f31b170d11 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '572170ccd67e4facbf10dad7cd1491c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5905c4b42ecd40298340a8a2ce4d5e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:47.506227 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6d367ad9-178c-45d1-b26d-26f31b170d11 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 200 len: 1282 microversion: 2.1 time: 0.170146 May 28 21:17:47.507994 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1881/3806] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:47 2022] GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 1282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:47.582088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-2851e582-605b-450a-9bf3-f237990f7014 req-899b7198-af79-42c2-8f68-f2c2144810a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ee8dd9-d59f-422a-a29d-2732e2573958", "tag": "011cb162-2172-4519-8fcc-9bf7016b04a4"}, {"server_uuid": "6f2f9407-da1e-473e-a8a9-87ac9a287fa4", "name": "network-vif-deleted", "tag": "6a35abfc-dc91-4685-902b-325510a0f642"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:47.605282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2851e582-605b-450a-9bf3-f237990f7014 req-899b7198-af79-42c2-8f68-f2c2144810a9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:47.607444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2851e582-605b-450a-9bf3-f237990f7014 req-899b7198-af79-42c2-8f68-f2c2144810a9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:47.641204 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-2851e582-605b-450a-9bf3-f237990f7014 req-899b7198-af79-42c2-8f68-f2c2144810a9 service nova] Creating event network-changed:011cb162-2172-4519-8fcc-9bf7016b04a4 for instance 43ee8dd9-d59f-422a-a29d-2732e2573958 on nch1-master-1 May 28 21:17:47.641547 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-2851e582-605b-450a-9bf3-f237990f7014 req-899b7198-af79-42c2-8f68-f2c2144810a9 service nova] Creating event network-vif-deleted:6a35abfc-dc91-4685-902b-325510a0f642 for instance 6f2f9407-da1e-473e-a8a9-87ac9a287fa4 on nch2-master-1 May 28 21:17:47.651718 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-2851e582-605b-450a-9bf3-f237990f7014 req-899b7198-af79-42c2-8f68-f2c2144810a9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.074220 May 28 21:17:47.653163 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1926/3807] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:48.526851 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-62859d37-8fb4-40db-97c9-f97257b72b65 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:48.527684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-62859d37-8fb4-40db-97c9-f97257b72b65 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] [instance: 6f2f9407-da1e-473e-a8a9-87ac9a287fa4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:48.546420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62859d37-8fb4-40db-97c9-f97257b72b65 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:48.548801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62859d37-8fb4-40db-97c9-f97257b72b65 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:48.551158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62859d37-8fb4-40db-97c9-f97257b72b65 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:48.552058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62859d37-8fb4-40db-97c9-f97257b72b65 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:48.575701 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-62859d37-8fb4-40db-97c9-f97257b72b65 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] HTTP exception thrown: Instance 6f2f9407-da1e-473e-a8a9-87ac9a287fa4 could not be found. May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-62859d37-8fb4-40db-97c9-f97257b72b65 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Request method failure captured: May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 HTTP/1.1 May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpDCBmY-gVDguAmT0TTfn5pEGxw03Gu-McpwtHLPRtoOIim33D9s7iXCIaiDExGxpDALE9dfLTDI4lsfOOkCcnIzBHXvky9A8H-RKKxyPNkh56Sf_142KNp3yxrhf9yRMpgclwsR2LUNRgMbILZNgNNRThbKq8AYJCDbM2cWl1S1-4g May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5905c4b42ecd40298340a8a2ce4d5e24", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5905c4b42ecd40298340a8a2ce4d5e24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestJSON-1961907688 May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5905c4b42ecd40298340a8a2ce4d5e24 May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestJSON-1961907688 May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestJSON-1961907688-project May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 572170ccd67e4facbf10dad7cd1491c1 May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestJSON-1961907688-project May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 6f2f9407-da1e-473e-a8a9-87ac9a287fa4 could not be found. May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '6f2f9407-da1e-473e-a8a9-87ac9a287fa4'} May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f2f9407-da1e-473e-a8a9-87ac9a287fa4 could not be found. May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f2f9407-da1e-473e-a8a9-87ac9a287fa4 could not be found. May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:48.577472 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:17:48.582442 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:17:48.582442 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:17:48.582442 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:17:48.582442 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:17:48.582442 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f2f9407-da1e-473e-a8a9-87ac9a287fa4 could not be found. May 28 21:17:48.582442 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:17:48.584875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-62859d37-8fb4-40db-97c9-f97257b72b65 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] Returning 404 to user: Instance 6f2f9407-da1e-473e-a8a9-87ac9a287fa4 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:17:48.586100 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-62859d37-8fb4-40db-97c9-f97257b72b65 tempest-ServersTestJSON-1961907688 tempest-ServersTestJSON-1961907688-project] 10.222.0.33 "GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4" status: 404 len: 111 microversion: 2.1 time: 0.065378 May 28 21:17:48.588255 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1882/3808] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:48 2022] GET /compute/v2.1/servers/6f2f9407-da1e-473e-a8a9-87ac9a287fa4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:17:51.029486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-737789618", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "bc0be511-2ab9-496c-8e1a-6c9324f20262"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:51.124922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] validate_networks() for [('bc0be511-2ab9-496c-8e1a-6c9324f20262', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:17:51.991989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:17:51.992431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:17:51.992953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:17:51.993377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:17:51.993802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:17:52.007327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:52.007766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:52.008623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:52.009040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:52.039886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Getting quotas for project 12b9ffa69df641558691a33ba072f78d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:17:52.046156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Getting quotas for user a01fd3c4a0184b41864b9184c507a8ff and project 12b9ffa69df641558691a33ba072f78d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:17:52.078459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:17:52.081181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:17:52.221549 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-630bcfcb-845c-4e47-b47d-3e3b442b4a6e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554534 May 28 21:17:52.225634 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1927/3809] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:17:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:17:52.375926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2039828024", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "bc0be511-2ab9-496c-8e1a-6c9324f20262"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:52.446655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] validate_networks() for [('bc0be511-2ab9-496c-8e1a-6c9324f20262', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:17:53.015584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:17:53.016020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:17:53.016547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:17:53.016917 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:17:53.017333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:17:53.027816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:53.028269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:53.029066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:53.029503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:53.054869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Getting quotas for project 12b9ffa69df641558691a33ba072f78d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:17:53.066990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Getting quotas for user a01fd3c4a0184b41864b9184c507a8ff and project 12b9ffa69df641558691a33ba072f78d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:17:53.087736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:17:53.090225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 6045585e-1ad5-4d1d-a523-e58730ef1df1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:17:53.258235 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886088 May 28 21:17:53.259288 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1883/3810] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:17:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:17:53.351829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2105340705", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "451", "networks": [{"uuid": "bc0be511-2ab9-496c-8e1a-6c9324f20262"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:53.466367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] validate_networks() for [('bc0be511-2ab9-496c-8e1a-6c9324f20262', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:17:54.238997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:17:54.239719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:17:54.240377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:17:54.241069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:17:54.242068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:17:54.262839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:54.263765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:54.264755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:54.265388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:54.295014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Getting quotas for project 12b9ffa69df641558691a33ba072f78d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:17:54.320585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Getting quotas for user a01fd3c4a0184b41864b9184c507a8ff and project 12b9ffa69df641558691a33ba072f78d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:17:54.352605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:17:54.359295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:17:54.566204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:54.567209 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c3343e68-4cba-4b0e-a9e4-5a34d0efbb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001392 May 28 21:17:54.573906 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8998c60c-c91c-4181-9ef8-9971bb1367ad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230533 May 28 21:17:54.573906 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1928/3811] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:17:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:17:54.574161 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1884/3812] 10.222.0.33 () {56 vars in 885 bytes} [Sat May 28 21:17:54 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 28 21:17:54.589333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cdc9a504-548a-4806-8ad6-8d7d7c6a1a70 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:54.591620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cdc9a504-548a-4806-8ad6-8d7d7c6a1a70 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:54.739463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cdc9a504-548a-4806-8ad6-8d7d7c6a1a70 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:54.746361 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cdc9a504-548a-4806-8ad6-8d7d7c6a1a70 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1221 microversion: 2.1 time: 0.163188 May 28 21:17:54.746945 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1929/3813] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:54 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1221 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:55.763283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-26dda890-2124-4754-9470-4afac0883fc7 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:55.764911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-26dda890-2124-4754-9470-4afac0883fc7 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:55.861504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-26dda890-2124-4754-9470-4afac0883fc7 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:55.877810 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-26dda890-2124-4754-9470-4afac0883fc7 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1221 microversion: 2.1 time: 0.117257 May 28 21:17:55.879654 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1885/3814] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:55 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1221 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:56.905417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-97f6f95b-6fda-4720-8a7e-03c1df56920a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:56.906754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-97f6f95b-6fda-4720-8a7e-03c1df56920a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:56.916304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97f6f95b-6fda-4720-8a7e-03c1df56920a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:56.916959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97f6f95b-6fda-4720-8a7e-03c1df56920a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:56.918611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97f6f95b-6fda-4720-8a7e-03c1df56920a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:56.919234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97f6f95b-6fda-4720-8a7e-03c1df56920a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:56.998392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-97f6f95b-6fda-4720-8a7e-03c1df56920a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:57.006545 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-97f6f95b-6fda-4720-8a7e-03c1df56920a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1273 microversion: 2.1 time: 0.109931 May 28 21:17:57.007050 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1930/3815] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:56 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1273 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:58.024179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-16282331-283d-4a75-b7d3-a7cc62885284 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:58.025604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-16282331-283d-4a75-b7d3-a7cc62885284 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:58.043495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16282331-283d-4a75-b7d3-a7cc62885284 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:58.044250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16282331-283d-4a75-b7d3-a7cc62885284 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:58.045284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16282331-283d-4a75-b7d3-a7cc62885284 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:58.046368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16282331-283d-4a75-b7d3-a7cc62885284 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:58.213180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-16282331-283d-4a75-b7d3-a7cc62885284 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:58.226761 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-16282331-283d-4a75-b7d3-a7cc62885284 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1279 microversion: 2.1 time: 0.206296 May 28 21:17:58.227617 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1886/3816] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:58 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1279 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:58.663073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-730924ce-9e11-4599-a102-04407ac15e29 tempest-QuotasTestJSON-91403286 tempest-QuotasTestJSON-91403286-project] Calling method '.version_select at 0x7f4d572d1e50>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:58.721366 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-730924ce-9e11-4599-a102-04407ac15e29 tempest-QuotasTestJSON-91403286 tempest-QuotasTestJSON-91403286-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/4e8feb29be1c40919845f2b37184cd15/defaults" status: 200 len: 371 microversion: 2.1 time: 0.255629 May 28 21:17:58.732577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e3b27920-8523-4414-8836-35157c3565f0 tempest-QuotasTestJSON-91403286 tempest-QuotasTestJSON-91403286-project] Calling method '.version_select at 0x7f4d5740a5e0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:58.749566 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1931/3817] 10.222.0.33 () {58 vars in 1268 bytes} [Sat May 28 21:17:58 2022] GET /compute/v2.1/os-quota-sets/4e8feb29be1c40919845f2b37184cd15/defaults => generated 371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:58.818583 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e3b27920-8523-4414-8836-35157c3565f0 tempest-QuotasTestJSON-91403286 tempest-QuotasTestJSON-91403286-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/4e8feb29be1c40919845f2b37184cd15" status: 200 len: 371 microversion: 2.1 time: 0.089807 May 28 21:17:58.819485 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1887/3818] 10.222.0.33 () {58 vars in 1241 bytes} [Sat May 28 21:17:58 2022] GET /compute/v2.1/os-quota-sets/4e8feb29be1c40919845f2b37184cd15 => generated 371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:17:58.836191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb6aa92d-c3fd-4e14-a97a-6a9fb948f734 tempest-QuotasTestJSON-91403286 tempest-QuotasTestJSON-91403286-project] Calling method '.version_select at 0x7f4d572d1b80>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:58.934806 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb6aa92d-c3fd-4e14-a97a-6a9fb948f734 tempest-QuotasTestJSON-91403286 tempest-QuotasTestJSON-91403286-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/4e8feb29be1c40919845f2b37184cd15/defaults" status: 200 len: 371 microversion: 2.1 time: 0.101422 May 28 21:17:58.936769 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1932/3819] 10.222.0.33 () {58 vars in 1268 bytes} [Sat May 28 21:17:58 2022] GET /compute/v2.1/os-quota-sets/4e8feb29be1c40919845f2b37184cd15/defaults => generated 371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:58.948879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-562f19b9-8291-4b11-a21b-931bcfbefbfa tempest-QuotasTestJSON-91403286 tempest-QuotasTestJSON-91403286-project] Calling method '.version_select at 0x7f4d5757edc0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:59.078821 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-562f19b9-8291-4b11-a21b-931bcfbefbfa tempest-QuotasTestJSON-91403286 tempest-QuotasTestJSON-91403286-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/4e8feb29be1c40919845f2b37184cd15" status: 200 len: 371 microversion: 2.1 time: 0.134085 May 28 21:17:59.080973 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1888/3820] 10.222.0.33 () {58 vars in 1241 bytes} [Sat May 28 21:17:58 2022] GET /compute/v2.1/os-quota-sets/4e8feb29be1c40919845f2b37184cd15 => generated 371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:59.092751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b6dc181c-1444-481f-8515-e151bf4d4d3f tempest-QuotasTestJSON-91403286 tempest-QuotasTestJSON-91403286-project] Calling method '.version_select at 0x7f4d572d1c10>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:59.194725 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b6dc181c-1444-481f-8515-e151bf4d4d3f tempest-QuotasTestJSON-91403286 tempest-QuotasTestJSON-91403286-project] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/4e8feb29be1c40919845f2b37184cd15?user_id=c47dfc5d531849f78d888c2d65df0c5d" status: 200 len: 371 microversion: 2.1 time: 0.106397 May 28 21:17:59.195635 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1933/3821] 10.222.0.33 () {58 vars in 1322 bytes} [Sat May 28 21:17:59 2022] GET /compute/v2.1/os-quota-sets/4e8feb29be1c40919845f2b37184cd15?user_id=c47dfc5d531849f78d888c2d65df0c5d => generated 371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:17:59.247431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1f2fde6f-8770-4b99-8553-1a03636f6fa4 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:17:59.248263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1f2fde6f-8770-4b99-8553-1a03636f6fa4 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:17:59.261997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f2fde6f-8770-4b99-8553-1a03636f6fa4 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:59.264621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f2fde6f-8770-4b99-8553-1a03636f6fa4 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:59.268129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f2fde6f-8770-4b99-8553-1a03636f6fa4 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:59.269157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f2fde6f-8770-4b99-8553-1a03636f6fa4 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:59.851218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1f2fde6f-8770-4b99-8553-1a03636f6fa4 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:17:59.862579 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1f2fde6f-8770-4b99-8553-1a03636f6fa4 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1321 microversion: 2.1 time: 0.619186 May 28 21:17:59.865772 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1889/3822] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:17:59 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1321 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:17:59.961650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-3910a9ac-f034-4f1e-b3f4-d16d0a3fe7e8 req-28c53d59-2d28-4693-ae35-2468e9e97ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6045585e-1ad5-4d1d-a523-e58730ef1df1", "tag": "92489437-6231-4eb8-8311-f32d174aa7a8"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:17:59.977221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3910a9ac-f034-4f1e-b3f4-d16d0a3fe7e8 req-28c53d59-2d28-4693-ae35-2468e9e97ef1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:17:59.978264 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3910a9ac-f034-4f1e-b3f4-d16d0a3fe7e8 req-28c53d59-2d28-4693-ae35-2468e9e97ef1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:17:59.998543 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-3910a9ac-f034-4f1e-b3f4-d16d0a3fe7e8 req-28c53d59-2d28-4693-ae35-2468e9e97ef1 service nova] Creating event network-changed:92489437-6231-4eb8-8311-f32d174aa7a8 for instance 6045585e-1ad5-4d1d-a523-e58730ef1df1 on nch2-master-1 May 28 21:18:00.006801 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-3910a9ac-f034-4f1e-b3f4-d16d0a3fe7e8 req-28c53d59-2d28-4693-ae35-2468e9e97ef1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050850 May 28 21:18:00.007536 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1934/3823] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:00.127942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-199ef053-f680-4a89-a330-c811dc44cb04 req-62c9b5c6-b99f-4cb0-80c8-2c5e3e15f9be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8439cb6f-af4c-4657-8376-36dac061b8d1", "tag": "309da8ad-3cc8-431e-aba9-ffe947aaf5d4"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:00.141858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-199ef053-f680-4a89-a330-c811dc44cb04 req-62c9b5c6-b99f-4cb0-80c8-2c5e3e15f9be service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:00.142622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-199ef053-f680-4a89-a330-c811dc44cb04 req-62c9b5c6-b99f-4cb0-80c8-2c5e3e15f9be service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:00.169557 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-199ef053-f680-4a89-a330-c811dc44cb04 req-62c9b5c6-b99f-4cb0-80c8-2c5e3e15f9be service nova] Creating event network-changed:309da8ad-3cc8-431e-aba9-ffe947aaf5d4 for instance 8439cb6f-af4c-4657-8376-36dac061b8d1 on nch2-master-1 May 28 21:18:00.179833 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-199ef053-f680-4a89-a330-c811dc44cb04 req-62c9b5c6-b99f-4cb0-80c8-2c5e3e15f9be service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057071 May 28 21:18:00.181678 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1890/3824] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:00.884124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bffa2d65-77ed-4154-87a3-938bba52e0f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:00.884859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bffa2d65-77ed-4154-87a3-938bba52e0f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:00.898548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bffa2d65-77ed-4154-87a3-938bba52e0f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:00.899646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bffa2d65-77ed-4154-87a3-938bba52e0f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:00.900737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bffa2d65-77ed-4154-87a3-938bba52e0f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:00.901208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bffa2d65-77ed-4154-87a3-938bba52e0f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:01.828156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bffa2d65-77ed-4154-87a3-938bba52e0f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:01.836363 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bffa2d65-77ed-4154-87a3-938bba52e0f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1321 microversion: 2.1 time: 0.959041 May 28 21:18:01.840277 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1935/3825] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:00 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1321 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:02.026171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-4838caeb-f35f-4c65-a676-9f53780e1b89 req-b7a27439-b9a3-4d43-bd87-51cf8056dc34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63ba3a76-d7d4-462f-9f1d-eacfef201b55", "tag": "f995244c-309a-489d-ab0e-ff58724ee2bc"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:02.043964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-4838caeb-f35f-4c65-a676-9f53780e1b89 req-b7a27439-b9a3-4d43-bd87-51cf8056dc34 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:02.044696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-4838caeb-f35f-4c65-a676-9f53780e1b89 req-b7a27439-b9a3-4d43-bd87-51cf8056dc34 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:02.062139 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-4838caeb-f35f-4c65-a676-9f53780e1b89 req-b7a27439-b9a3-4d43-bd87-51cf8056dc34 service nova] Creating event network-changed:f995244c-309a-489d-ab0e-ff58724ee2bc for instance 63ba3a76-d7d4-462f-9f1d-eacfef201b55 on nch1-master-1 May 28 21:18:02.077878 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-4838caeb-f35f-4c65-a676-9f53780e1b89 req-b7a27439-b9a3-4d43-bd87-51cf8056dc34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059322 May 28 21:18:02.081757 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1891/3826] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:18:02.853437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1ba6dae5-33ba-44eb-94c7-d9b65e74e508 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:02.854013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1ba6dae5-33ba-44eb-94c7-d9b65e74e508 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:02.867491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ba6dae5-33ba-44eb-94c7-d9b65e74e508 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:02.868103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ba6dae5-33ba-44eb-94c7-d9b65e74e508 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:02.869517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ba6dae5-33ba-44eb-94c7-d9b65e74e508 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:02.870080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ba6dae5-33ba-44eb-94c7-d9b65e74e508 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:03.091268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1ba6dae5-33ba-44eb-94c7-d9b65e74e508 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:03.102599 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1ba6dae5-33ba-44eb-94c7-d9b65e74e508 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1321 microversion: 2.1 time: 0.253105 May 28 21:18:03.103852 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1936/3827] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:02 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:03.319964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:03.860674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-685e46b1-2af2-439a-b22e-a9cdb48cbb34 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:03.861970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-685e46b1-2af2-439a-b22e-a9cdb48cbb34 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:03.881459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-685e46b1-2af2-439a-b22e-a9cdb48cbb34 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:03.882330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-685e46b1-2af2-439a-b22e-a9cdb48cbb34 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:03.884750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-685e46b1-2af2-439a-b22e-a9cdb48cbb34 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:03.886634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-685e46b1-2af2-439a-b22e-a9cdb48cbb34 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:03.938188 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-685e46b1-2af2-439a-b22e-a9cdb48cbb34 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "POST /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3/action" status: 200 len: 24557 microversion: 2.1 time: 0.619668 May 28 21:18:03.941884 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1892/3828] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:18:03 2022] POST /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3/action => generated 24557 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:18:03.967835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2a61c647-0153-4c44-bce1-4096f4a87a58 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:03.968967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2a61c647-0153-4c44-bce1-4096f4a87a58 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:03.978246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a61c647-0153-4c44-bce1-4096f4a87a58 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:03.978944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a61c647-0153-4c44-bce1-4096f4a87a58 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:03.980221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a61c647-0153-4c44-bce1-4096f4a87a58 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:03.981426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a61c647-0153-4c44-bce1-4096f4a87a58 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:04.039336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2a61c647-0153-4c44-bce1-4096f4a87a58 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:18:04.127335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9a19f359-5d69-4bd0-a4fb-478b24f2dbad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:04.131905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9a19f359-5d69-4bd0-a4fb-478b24f2dbad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:04.154245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a19f359-5d69-4bd0-a4fb-478b24f2dbad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:04.158207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a19f359-5d69-4bd0-a4fb-478b24f2dbad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:04.161385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a19f359-5d69-4bd0-a4fb-478b24f2dbad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:04.162345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a19f359-5d69-4bd0-a4fb-478b24f2dbad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:04.276848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:04.473561 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2a61c647-0153-4c44-bce1-4096f4a87a58 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 204 len: 0 microversion: 2.1 time: 0.510173 May 28 21:18:04.474212 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1937/3829] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:18:03 2022] DELETE /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:18:04.494531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-266b2f5d-6ccb-42ff-b946-69f248007d6e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:04.498132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-266b2f5d-6ccb-42ff-b946-69f248007d6e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:04.515246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-266b2f5d-6ccb-42ff-b946-69f248007d6e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:04.515246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-266b2f5d-6ccb-42ff-b946-69f248007d6e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:04.515246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-266b2f5d-6ccb-42ff-b946-69f248007d6e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:04.515246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-266b2f5d-6ccb-42ff-b946-69f248007d6e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:05.028363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-266b2f5d-6ccb-42ff-b946-69f248007d6e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:05.045207 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-266b2f5d-6ccb-42ff-b946-69f248007d6e tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 200 len: 1609 microversion: 2.1 time: 0.565473 May 28 21:18:05.046355 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1938/3830] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:04 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 1609 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:05.122753 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9a19f359-5d69-4bd0-a4fb-478b24f2dbad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:05.131218 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9a19f359-5d69-4bd0-a4fb-478b24f2dbad tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1321 microversion: 2.1 time: 1.014739 May 28 21:18:05.131807 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1893/3831] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:04 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1321 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:06.067153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c32c8666-76d4-4dc9-b451-8156ac5e36c3 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:06.068968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c32c8666-76d4-4dc9-b451-8156ac5e36c3 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:06.079927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c32c8666-76d4-4dc9-b451-8156ac5e36c3 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:06.080256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c32c8666-76d4-4dc9-b451-8156ac5e36c3 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:06.081746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c32c8666-76d4-4dc9-b451-8156ac5e36c3 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:06.082380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c32c8666-76d4-4dc9-b451-8156ac5e36c3 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:06.148742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-23afee3e-858e-43c7-ab24-d9fd62357f6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:06.150116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-23afee3e-858e-43c7-ab24-d9fd62357f6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:06.168746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c32c8666-76d4-4dc9-b451-8156ac5e36c3 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:06.180671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-23afee3e-858e-43c7-ab24-d9fd62357f6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:06.184762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-23afee3e-858e-43c7-ab24-d9fd62357f6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:06.185271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-23afee3e-858e-43c7-ab24-d9fd62357f6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:06.185670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-23afee3e-858e-43c7-ab24-d9fd62357f6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:06.192708 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c32c8666-76d4-4dc9-b451-8156ac5e36c3 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 200 len: 1541 microversion: 2.1 time: 0.132527 May 28 21:18:06.203211 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1939/3832] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:06 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 1541 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:06.607592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-23afee3e-858e-43c7-ab24-d9fd62357f6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:06.626553 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-23afee3e-858e-43c7-ab24-d9fd62357f6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1321 microversion: 2.1 time: 0.482690 May 28 21:18:06.628018 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1894/3833] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:06 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1321 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:06.648328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-3c515695-165c-4ece-8e4f-7d99b6e01ec1 req-1d6bc2dd-4ce5-4eb4-aa35-ad572fe99ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0e0703e-5c6e-4c58-8497-36a81542fec3", "name": "network-vif-deleted", "tag": "b8b43638-9f68-46f7-847c-6c5e90163d68"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:06.662469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3c515695-165c-4ece-8e4f-7d99b6e01ec1 req-1d6bc2dd-4ce5-4eb4-aa35-ad572fe99ffd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:06.664103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3c515695-165c-4ece-8e4f-7d99b6e01ec1 req-1d6bc2dd-4ce5-4eb4-aa35-ad572fe99ffd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:06.698024 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-3c515695-165c-4ece-8e4f-7d99b6e01ec1 req-1d6bc2dd-4ce5-4eb4-aa35-ad572fe99ffd service nova] Creating event network-vif-deleted:b8b43638-9f68-46f7-847c-6c5e90163d68 for instance f0e0703e-5c6e-4c58-8497-36a81542fec3 on nch1-master-1 May 28 21:18:06.713783 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-3c515695-165c-4ece-8e4f-7d99b6e01ec1 req-1d6bc2dd-4ce5-4eb4-aa35-ad572fe99ffd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076672 May 28 21:18:06.718101 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1940/3834] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:18:07.210243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cc1d0a07-e8c5-4902-895b-9d67f56bbbc4 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:07.210898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cc1d0a07-e8c5-4902-895b-9d67f56bbbc4 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:07.224898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc1d0a07-e8c5-4902-895b-9d67f56bbbc4 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:07.225465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc1d0a07-e8c5-4902-895b-9d67f56bbbc4 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:07.230192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc1d0a07-e8c5-4902-895b-9d67f56bbbc4 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:07.230711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc1d0a07-e8c5-4902-895b-9d67f56bbbc4 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:07.350697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cc1d0a07-e8c5-4902-895b-9d67f56bbbc4 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:07.363881 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cc1d0a07-e8c5-4902-895b-9d67f56bbbc4 tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 200 len: 1253 microversion: 2.1 time: 0.156077 May 28 21:18:07.375816 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1895/3835] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:07 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 1253 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:07.648392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d05aa4c8-9420-4fd0-9a63-dd8c928dd6fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:07.650389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d05aa4c8-9420-4fd0-9a63-dd8c928dd6fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:07.671130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d05aa4c8-9420-4fd0-9a63-dd8c928dd6fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:07.676898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d05aa4c8-9420-4fd0-9a63-dd8c928dd6fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:07.676898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d05aa4c8-9420-4fd0-9a63-dd8c928dd6fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:07.676898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d05aa4c8-9420-4fd0-9a63-dd8c928dd6fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:08.005757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d05aa4c8-9420-4fd0-9a63-dd8c928dd6fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:08.022070 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d05aa4c8-9420-4fd0-9a63-dd8c928dd6fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1321 microversion: 2.1 time: 0.375048 May 28 21:18:08.022070 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1941/3836] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:07 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:08.383148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-98ab1d56-80cb-4c14-b8d3-49296ba0299a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:08.384478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-98ab1d56-80cb-4c14-b8d3-49296ba0299a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:08.392215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98ab1d56-80cb-4c14-b8d3-49296ba0299a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:08.394737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98ab1d56-80cb-4c14-b8d3-49296ba0299a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:08.394737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98ab1d56-80cb-4c14-b8d3-49296ba0299a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:08.395228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98ab1d56-80cb-4c14-b8d3-49296ba0299a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:08.400082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:08.445159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98ab1d56-80cb-4c14-b8d3-49296ba0299a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:08.445615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98ab1d56-80cb-4c14-b8d3-49296ba0299a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:08.446609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-98ab1d56-80cb-4c14-b8d3-49296ba0299a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lazy-loading 'fault' on Instance uuid f0e0703e-5c6e-4c58-8497-36a81542fec3 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:18:08.491934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-98ab1d56-80cb-4c14-b8d3-49296ba0299a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94f224e3fd2142d0991cb173e2a2c880', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4be72b7f8c54528b1c0a2a1505416c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:08.512447 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-98ab1d56-80cb-4c14-b8d3-49296ba0299a tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 200 len: 1258 microversion: 2.1 time: 0.133333 May 28 21:18:08.515096 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1896/3837] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:08 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 1258 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:09.035210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-68026997-4cdf-412e-894c-6ca6aebd7169 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:09.038599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-68026997-4cdf-412e-894c-6ca6aebd7169 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:09.048858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68026997-4cdf-412e-894c-6ca6aebd7169 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:09.049590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68026997-4cdf-412e-894c-6ca6aebd7169 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:09.051306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68026997-4cdf-412e-894c-6ca6aebd7169 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:09.052181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68026997-4cdf-412e-894c-6ca6aebd7169 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:09.189249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=18 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:09.334040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-68026997-4cdf-412e-894c-6ca6aebd7169 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:09.336639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:09.343715 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-68026997-4cdf-412e-894c-6ca6aebd7169 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1321 microversion: 2.1 time: 0.313506 May 28 21:18:09.344654 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1942/3838] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:09 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:09.531064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-60e64a92-440e-4024-a03c-9d733a0bc20b tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:09.531835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-60e64a92-440e-4024-a03c-9d733a0bc20b tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] [instance: f0e0703e-5c6e-4c58-8497-36a81542fec3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:09.546859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=12 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:09.552425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60e64a92-440e-4024-a03c-9d733a0bc20b tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:09.553198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60e64a92-440e-4024-a03c-9d733a0bc20b tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:09.554263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60e64a92-440e-4024-a03c-9d733a0bc20b tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:09.554899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60e64a92-440e-4024-a03c-9d733a0bc20b tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:09.572121 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-60e64a92-440e-4024-a03c-9d733a0bc20b tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] HTTP exception thrown: Instance f0e0703e-5c6e-4c58-8497-36a81542fec3 could not be found. May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-60e64a92-440e-4024-a03c-9d733a0bc20b tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Request method failure captured: May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 HTTP/1.1 May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABiko_Kjn6ccQkf0pj8Q1ye_QCe0Gyj7AsP10cO2LW1hg6qPnSh8drAx5ozaHPDCM6TMOnfk4297ESoIaJTKF2rurTFZTtBF1H1SRPHi6HTkC8-8buXAQCVqnqi5unxH-IZYvGqphSbyuJ245T0n4O8Ge0W5NJdz8792FvyzQePesmMaYQ May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: b4be72b7f8c54528b1c0a2a1505416c1 May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersTestBootFromVolume-78716756 May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b4be72b7f8c54528b1c0a2a1505416c1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4be72b7f8c54528b1c0a2a1505416c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b4be72b7f8c54528b1c0a2a1505416c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b4be72b7f8c54528b1c0a2a1505416c1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersTestBootFromVolume-78716756 May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: b4be72b7f8c54528b1c0a2a1505416c1 May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersTestBootFromVolume-78716756 May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersTestBootFromVolume-78716756-project May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 94f224e3fd2142d0991cb173e2a2c880 May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersTestBootFromVolume-78716756-project May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance f0e0703e-5c6e-4c58-8497-36a81542fec3 could not be found. May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'f0e0703e-5c6e-4c58-8497-36a81542fec3'} May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0e0703e-5c6e-4c58-8497-36a81542fec3 could not be found. May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0e0703e-5c6e-4c58-8497-36a81542fec3 could not be found. May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:18:09.574223 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:18:09.579000 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:18:09.579000 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:18:09.579000 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:18:09.579000 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:18:09.579000 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:18:09.579000 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0e0703e-5c6e-4c58-8497-36a81542fec3 could not be found. May 28 21:18:09.579000 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:18:09.582048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-60e64a92-440e-4024-a03c-9d733a0bc20b tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Returning 404 to user: Instance f0e0703e-5c6e-4c58-8497-36a81542fec3 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:18:09.583177 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-60e64a92-440e-4024-a03c-9d733a0bc20b tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3" status: 404 len: 111 microversion: 2.1 time: 0.057068 May 28 21:18:09.584349 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1897/3839] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:09 2022] GET /compute/v2.1/servers/f0e0703e-5c6e-4c58-8497-36a81542fec3 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:18:09.592629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-beaef99e-e018-4621-b0d2-f61ffa24bf2d tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] Calling method '.version_select at 0x7f4d572c4b80>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:09.717178 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-beaef99e-e018-4621-b0d2-f61ffa24bf2d tempest-ServersTestBootFromVolume-78716756 tempest-ServersTestBootFromVolume-78716756-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409767074" status: 202 len: 0 microversion: 2.1 time: 0.125583 May 28 21:18:09.717178 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1943/3840] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 21:18:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409767074 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:18:09.998951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-1c929141-b77a-4dc5-951f-a2b81e6aa361 req-5504fab1-0d64-489b-920a-cb5050c8fd2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ba3a76-d7d4-462f-9f1d-eacfef201b55", "name": "network-vif-plugged", "status": "completed", "tag": "f995244c-309a-489d-ab0e-ff58724ee2bc"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:10.008812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1c929141-b77a-4dc5-951f-a2b81e6aa361 req-5504fab1-0d64-489b-920a-cb5050c8fd2e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:10.009441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1c929141-b77a-4dc5-951f-a2b81e6aa361 req-5504fab1-0d64-489b-920a-cb5050c8fd2e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:10.030634 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-1c929141-b77a-4dc5-951f-a2b81e6aa361 req-5504fab1-0d64-489b-920a-cb5050c8fd2e service nova] Creating event network-vif-plugged:f995244c-309a-489d-ab0e-ff58724ee2bc for instance 63ba3a76-d7d4-462f-9f1d-eacfef201b55 on nch1-master-1 May 28 21:18:10.039173 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-1c929141-b77a-4dc5-951f-a2b81e6aa361 req-5504fab1-0d64-489b-920a-cb5050c8fd2e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055652 May 28 21:18:10.041823 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1898/3841] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:10.362355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-587143a3-7542-4323-aa9e-c11755267400 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:10.363019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-587143a3-7542-4323-aa9e-c11755267400 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:10.396075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-587143a3-7542-4323-aa9e-c11755267400 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:10.399524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-587143a3-7542-4323-aa9e-c11755267400 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:10.400351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-587143a3-7542-4323-aa9e-c11755267400 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:10.400912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-587143a3-7542-4323-aa9e-c11755267400 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:11.258588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-587143a3-7542-4323-aa9e-c11755267400 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:11.277042 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-587143a3-7542-4323-aa9e-c11755267400 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1321 microversion: 2.1 time: 0.919415 May 28 21:18:11.278345 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1944/3842] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:10 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1321 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:12.098673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-610f4a2c-c3f8-4244-aae5-3ae23f3f6c7c req-58b3641b-afce-4107-b0e6-6529e1b8a25e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8439cb6f-af4c-4657-8376-36dac061b8d1", "name": "network-vif-plugged", "status": "completed", "tag": "309da8ad-3cc8-431e-aba9-ffe947aaf5d4"}, {"server_uuid": "6045585e-1ad5-4d1d-a523-e58730ef1df1", "name": "network-vif-plugged", "status": "completed", "tag": "92489437-6231-4eb8-8311-f32d174aa7a8"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:12.136678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-610f4a2c-c3f8-4244-aae5-3ae23f3f6c7c req-58b3641b-afce-4107-b0e6-6529e1b8a25e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:12.138765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-610f4a2c-c3f8-4244-aae5-3ae23f3f6c7c req-58b3641b-afce-4107-b0e6-6529e1b8a25e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:12.156578 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-610f4a2c-c3f8-4244-aae5-3ae23f3f6c7c req-58b3641b-afce-4107-b0e6-6529e1b8a25e service nova] Creating event network-vif-plugged:309da8ad-3cc8-431e-aba9-ffe947aaf5d4 for instance 8439cb6f-af4c-4657-8376-36dac061b8d1 on nch2-master-1 May 28 21:18:12.163763 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-610f4a2c-c3f8-4244-aae5-3ae23f3f6c7c req-58b3641b-afce-4107-b0e6-6529e1b8a25e service nova] Creating event network-vif-plugged:92489437-6231-4eb8-8311-f32d174aa7a8 for instance 6045585e-1ad5-4d1d-a523-e58730ef1df1 on nch2-master-1 May 28 21:18:12.204000 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-610f4a2c-c3f8-4244-aae5-3ae23f3f6c7c req-58b3641b-afce-4107-b0e6-6529e1b8a25e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.114985 May 28 21:18:12.205061 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1899/3843] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:12.300992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-51e1a266-1d8a-430d-835d-897e04f3f15f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:12.301778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-51e1a266-1d8a-430d-835d-897e04f3f15f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:12.329046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51e1a266-1d8a-430d-835d-897e04f3f15f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:12.329657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51e1a266-1d8a-430d-835d-897e04f3f15f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:12.333498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51e1a266-1d8a-430d-835d-897e04f3f15f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:12.335362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51e1a266-1d8a-430d-835d-897e04f3f15f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:12.766695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-51e1a266-1d8a-430d-835d-897e04f3f15f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:12.778802 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-51e1a266-1d8a-430d-835d-897e04f3f15f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1512 microversion: 2.1 time: 0.485068 May 28 21:18:12.779792 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1945/3844] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:12 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1512 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:12.804672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1f31b21f-7aba-4760-af5b-e5e173304a6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:12.807453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1f31b21f-7aba-4760-af5b-e5e173304a6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:12.821262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f31b21f-7aba-4760-af5b-e5e173304a6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:12.825769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f31b21f-7aba-4760-af5b-e5e173304a6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:12.825769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f31b21f-7aba-4760-af5b-e5e173304a6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:12.825769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f31b21f-7aba-4760-af5b-e5e173304a6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:13.026761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1f31b21f-7aba-4760-af5b-e5e173304a6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:13.074848 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1f31b21f-7aba-4760-af5b-e5e173304a6d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1320 microversion: 2.1 time: 0.276854 May 28 21:18:13.077038 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1900/3845] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:12 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1320 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:14.104497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-afade00c-35ec-4d9f-a3b0-61c2bd6984ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:14.105149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-afade00c-35ec-4d9f-a3b0-61c2bd6984ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:14.136397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afade00c-35ec-4d9f-a3b0-61c2bd6984ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:14.139019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afade00c-35ec-4d9f-a3b0-61c2bd6984ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:14.139935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afade00c-35ec-4d9f-a3b0-61c2bd6984ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:14.140403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afade00c-35ec-4d9f-a3b0-61c2bd6984ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:14.620963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-afade00c-35ec-4d9f-a3b0-61c2bd6984ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:14.644953 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-afade00c-35ec-4d9f-a3b0-61c2bd6984ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1511 microversion: 2.1 time: 0.546966 May 28 21:18:14.648594 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1946/3846] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:14 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1511 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:14.667656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-13f0e47c-0562-47aa-b7cd-a3b53701d903 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:14.668924 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-13f0e47c-0562-47aa-b7cd-a3b53701d903 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 6045585e-1ad5-4d1d-a523-e58730ef1df1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:14.698424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13f0e47c-0562-47aa-b7cd-a3b53701d903 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:14.699173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13f0e47c-0562-47aa-b7cd-a3b53701d903 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:14.700382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13f0e47c-0562-47aa-b7cd-a3b53701d903 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:14.702435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13f0e47c-0562-47aa-b7cd-a3b53701d903 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:15.119291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-13f0e47c-0562-47aa-b7cd-a3b53701d903 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:15.137285 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-13f0e47c-0562-47aa-b7cd-a3b53701d903 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1" status: 200 len: 1511 microversion: 2.1 time: 0.467194 May 28 21:18:15.137285 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1901/3847] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:14 2022] GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1 => generated 1511 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:15.156051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6abb7c8c-1f90-4e97-aefe-da255e6b8d25 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:15.160346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6abb7c8c-1f90-4e97-aefe-da255e6b8d25 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:15.165183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6abb7c8c-1f90-4e97-aefe-da255e6b8d25 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:15.217383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6abb7c8c-1f90-4e97-aefe-da255e6b8d25 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:15.217815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6abb7c8c-1f90-4e97-aefe-da255e6b8d25 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:15.218651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6abb7c8c-1f90-4e97-aefe-da255e6b8d25 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:15.231289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6abb7c8c-1f90-4e97-aefe-da255e6b8d25 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:15.268151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fb5a6227-aa46-4cbd-ac7f-5b355d4c8065 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:15.268722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fb5a6227-aa46-4cbd-ac7f-5b355d4c8065 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:15.278821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb5a6227-aa46-4cbd-ac7f-5b355d4c8065 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:15.279285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb5a6227-aa46-4cbd-ac7f-5b355d4c8065 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:15.280074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb5a6227-aa46-4cbd-ac7f-5b355d4c8065 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:15.288161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb5a6227-aa46-4cbd-ac7f-5b355d4c8065 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:15.577390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-6abb7c8c-1f90-4e97-aefe-da255e6b8d25 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:15.578501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-fb5a6227-aa46-4cbd-ac7f-5b355d4c8065 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lazy-loading 'services' on Instance uuid 43ee8dd9-d59f-422a-a29d-2732e2573958 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:18:15.727271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6abb7c8c-1f90-4e97-aefe-da255e6b8d25 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:15.743183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6abb7c8c-1f90-4e97-aefe-da255e6b8d25 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:15.746140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6abb7c8c-1f90-4e97-aefe-da255e6b8d25 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:15.991526 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fb5a6227-aa46-4cbd-ac7f-5b355d4c8065 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "DELETE /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-volume_attachments/91db7a6e-9511-44a8-bcd6-90cbdc41f7f0" status: 202 len: 0 microversion: 2.1 time: 0.729644 May 28 21:18:15.992459 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1902/3848] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:18:15 2022] DELETE /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-volume_attachments/91db7a6e-9511-44a8-bcd6-90cbdc41f7f0 => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:18:16.011464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-390918c8-49e3-4260-a187-6281868e3ed2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:16.012672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-390918c8-49e3-4260-a187-6281868e3ed2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:16.030342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-390918c8-49e3-4260-a187-6281868e3ed2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:16.030812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-390918c8-49e3-4260-a187-6281868e3ed2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:16.031619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-390918c8-49e3-4260-a187-6281868e3ed2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:16.032069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-390918c8-49e3-4260-a187-6281868e3ed2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:16.125556 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-390918c8-49e3-4260-a187-6281868e3ed2 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125089 May 28 21:18:16.125556 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1903/3849] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:18:15 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:16.241748 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6abb7c8c-1f90-4e97-aefe-da255e6b8d25 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.090474 May 28 21:18:16.253764 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1947/3850] 10.222.0.33 () {58 vars in 1166 bytes} [Sat May 28 21:18:15 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:16.266756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d8efcd5d-b265-4bcf-8ee6-ff520fa7d38a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:16.285428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d8efcd5d-b265-4bcf-8ee6-ff520fa7d38a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:16.288183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d8efcd5d-b265-4bcf-8ee6-ff520fa7d38a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-737789618', 'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:16.302644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8efcd5d-b265-4bcf-8ee6-ff520fa7d38a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:16.305007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8efcd5d-b265-4bcf-8ee6-ff520fa7d38a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:16.308989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8efcd5d-b265-4bcf-8ee6-ff520fa7d38a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:16.314963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8efcd5d-b265-4bcf-8ee6-ff520fa7d38a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:16.507739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-d8efcd5d-b265-4bcf-8ee6-ff520fa7d38a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:16.622415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d8efcd5d-b265-4bcf-8ee6-ff520fa7d38a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:16.632033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8efcd5d-b265-4bcf-8ee6-ff520fa7d38a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:16.634593 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8efcd5d-b265-4bcf-8ee6-ff520fa7d38a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:17.080517 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d8efcd5d-b265-4bcf-8ee6-ff520fa7d38a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-737789618" status: 200 len: 1514 microversion: 2.1 time: 0.816967 May 28 21:18:17.081811 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1904/3851] 10.222.0.33 () {58 vars in 1260 bytes} [Sat May 28 21:18:16 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-737789618 => generated 1514 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:17.100910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d73c884f-2500-417e-a978-43dd15e03ff1 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:17.107020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d73c884f-2500-417e-a978-43dd15e03ff1 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:17.108246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d73c884f-2500-417e-a978-43dd15e03ff1 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:17.119059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d73c884f-2500-417e-a978-43dd15e03ff1 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:17.119866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d73c884f-2500-417e-a978-43dd15e03ff1 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:17.121007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d73c884f-2500-417e-a978-43dd15e03ff1 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:17.121692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d73c884f-2500-417e-a978-43dd15e03ff1 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:17.140505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-41f11c50-d777-4a31-a56c-4c755bce441a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:17.142045 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-41f11c50-d777-4a31-a56c-4c755bce441a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:17.156082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41f11c50-d777-4a31-a56c-4c755bce441a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:17.158133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41f11c50-d777-4a31-a56c-4c755bce441a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:17.159097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41f11c50-d777-4a31-a56c-4c755bce441a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:17.160782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41f11c50-d777-4a31-a56c-4c755bce441a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:17.241097 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-41f11c50-d777-4a31-a56c-4c755bce441a tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109569 May 28 21:18:17.245959 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1905/3852] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:18:17 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:17.281237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-d73c884f-2500-417e-a978-43dd15e03ff1 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:17.460870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d73c884f-2500-417e-a978-43dd15e03ff1 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:17.478827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d73c884f-2500-417e-a978-43dd15e03ff1 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:17.479298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d73c884f-2500-417e-a978-43dd15e03ff1 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:17.971087 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d73c884f-2500-417e-a978-43dd15e03ff1 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4517 microversion: 2.1 time: 0.873920 May 28 21:18:17.972256 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1948/3853] 10.222.0.33 () {58 vars in 1172 bytes} [Sat May 28 21:18:17 2022] GET /compute/v2.1/servers/detail?status=active => generated 4517 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:17.997222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d30b9aa6-2b20-4e40-9fda-01bfa08bd9a5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:18.001798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d30b9aa6-2b20-4e40-9fda-01bfa08bd9a5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:18.002670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.compute.servers [None req-d30b9aa6-2b20-4e40-9fda-01bfa08bd9a5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Removing options 'limit' from query {{(pid=143128) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 28 21:18:18.003624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d30b9aa6-2b20-4e40-9fda-01bfa08bd9a5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:18.009694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:18.012050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d30b9aa6-2b20-4e40-9fda-01bfa08bd9a5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:18.013022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d30b9aa6-2b20-4e40-9fda-01bfa08bd9a5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:18.014068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d30b9aa6-2b20-4e40-9fda-01bfa08bd9a5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:18.014683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d30b9aa6-2b20-4e40-9fda-01bfa08bd9a5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:18.054034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d30b9aa6-2b20-4e40-9fda-01bfa08bd9a5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:18.061070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d30b9aa6-2b20-4e40-9fda-01bfa08bd9a5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:18.061771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d30b9aa6-2b20-4e40-9fda-01bfa08bd9a5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:18.256035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-64007325-20b4-4cad-a1c1-640b773925c5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:18.257610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-64007325-20b4-4cad-a1c1-640b773925c5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:18.274332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64007325-20b4-4cad-a1c1-640b773925c5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:18.275552 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64007325-20b4-4cad-a1c1-640b773925c5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:18.277245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64007325-20b4-4cad-a1c1-640b773925c5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:18.278190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64007325-20b4-4cad-a1c1-640b773925c5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:18.316503 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-64007325-20b4-4cad-a1c1-640b773925c5 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066492 May 28 21:18:18.318214 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1949/3854] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:18:18 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:18:18.441962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f6d20e00-f7e7-49fd-830d-564451fd6069 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:18.447599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f6d20e00-f7e7-49fd-830d-564451fd6069 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:18.459484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6d20e00-f7e7-49fd-830d-564451fd6069 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:18.460370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6d20e00-f7e7-49fd-830d-564451fd6069 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:18.461467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6d20e00-f7e7-49fd-830d-564451fd6069 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:18.462275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6d20e00-f7e7-49fd-830d-564451fd6069 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:18.528794 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-f6d20e00-f7e7-49fd-830d-564451fd6069 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] HTTP exception thrown: Cannot 'reboot' instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 while it is in vm_state rescued May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f6d20e00-f7e7-49fd-830d-564451fd6069 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Request method failure captured: May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351/action HTTP/1.1 May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 28 May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpC0XaL6nt9hgj0fqNJ-e8egvesT5NjK_jUnUBAtg24_DQiY4yBBswyZZHwMHrBd5ALBI4UbRMzOp6RzZMuwpPVT6pecTgJ4VSwWmnC-cS82dnuXHOnMJSwA47KVatITeM5lcpiario-t9uZicKVzKlAEQs1aEbN7XgO22WG-C22tyY May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53b9cfacdbb74a058e52bed331a6f241", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: af446b3d802a42e3bd72b08bace8ea8d May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: {"reboot": {"type": "HARD"}} May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: exception: Cannot 'reboot' instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 while it is in vm_state rescued May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351', 'body': {'reboot': {'type': 'HARD'}}} May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 21:18:18.530891 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:18:18.541483 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 while it is in vm_state rescued May 28 21:18:18.541483 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:18:18.541483 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:18:18.541483 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:18:18.541483 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:18:18.541483 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:18:18.541483 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:18:18.541483 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:18:18.541483 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:18:18.541483 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 while it is in vm_state rescued May 28 21:18:18.541483 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:18:18.541483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f6d20e00-f7e7-49fd-830d-564451fd6069 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Returning 409 to user: Cannot 'reboot' instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 while it is in vm_state rescued {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:18:18.541483 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f6d20e00-f7e7-49fd-830d-564451fd6069 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351/action" status: 409 len: 145 microversion: 2.1 time: 0.103790 May 28 21:18:18.541483 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1950/3855] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:18:18 2022] POST /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351/action => generated 145 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 28 21:18:18.547647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6ee165c9-81a1-4c6d-89bd-38d2d63b9bf4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:18.553392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6ee165c9-81a1-4c6d-89bd-38d2d63b9bf4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:18.555314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:18.559510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ee165c9-81a1-4c6d-89bd-38d2d63b9bf4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:18.560369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ee165c9-81a1-4c6d-89bd-38d2d63b9bf4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:18.561473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ee165c9-81a1-4c6d-89bd-38d2d63b9bf4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:18.562257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ee165c9-81a1-4c6d-89bd-38d2d63b9bf4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:18.595101 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-6ee165c9-81a1-4c6d-89bd-38d2d63b9bf4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] HTTP exception thrown: Cannot 'rebuild' instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 while it is in vm_state rescued May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6ee165c9-81a1-4c6d-89bd-38d2d63b9bf4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Request method failure captured: May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351/action HTTP/1.1 May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 65 May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpC0XaL6nt9hgj0fqNJ-e8egvesT5NjK_jUnUBAtg24_DQiY4yBBswyZZHwMHrBd5ALBI4UbRMzOp6RzZMuwpPVT6pecTgJ4VSwWmnC-cS82dnuXHOnMJSwA47KVatITeM5lcpiario-t9uZicKVzKlAEQs1aEbN7XgO22WG-C22tyY May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53b9cfacdbb74a058e52bed331a6f241", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: af446b3d802a42e3bd72b08bace8ea8d May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: {"rebuild": {"imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195"}} May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: exception: Cannot 'rebuild' instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 while it is in vm_state rescued May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351', 'body': {'rebuild': {'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195'}}} May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 in vm_state rescued. Cannot rebuild while the instance is in this state. May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:18:18.597159 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 while it is in vm_state rescued May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 while it is in vm_state rescued May 28 21:18:18.601370 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:18:18.605512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6ee165c9-81a1-4c6d-89bd-38d2d63b9bf4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Returning 409 to user: Cannot 'rebuild' instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 while it is in vm_state rescued {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:18:18.605512 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6ee165c9-81a1-4c6d-89bd-38d2d63b9bf4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "POST /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351/action" status: 409 len: 146 microversion: 2.1 time: 0.065362 May 28 21:18:18.606682 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1951/3856] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:18:18 2022] POST /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351/action => generated 146 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:18:18.616890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-65ad62ea-4776-4407-9993-db23000fab77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:18.617943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-65ad62ea-4776-4407-9993-db23000fab77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:18.626780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65ad62ea-4776-4407-9993-db23000fab77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:18.628243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65ad62ea-4776-4407-9993-db23000fab77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:18.629347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65ad62ea-4776-4407-9993-db23000fab77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:18.630167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65ad62ea-4776-4407-9993-db23000fab77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:18.681033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-65ad62ea-4776-4407-9993-db23000fab77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:18:18.777719 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d30b9aa6-2b20-4e40-9fda-01bfa08bd9a5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.784291 May 28 21:18:18.790917 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1906/3857] 10.222.0.33 () {58 vars in 1160 bytes} [Sat May 28 21:18:17 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:18.803818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ca78e48a-8e24-41d3-bf47-459e3bc3d99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:18.808970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ca78e48a-8e24-41d3-bf47-459e3bc3d99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:18.810162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ca78e48a-8e24-41d3-bf47-459e3bc3d99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:18.817416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca78e48a-8e24-41d3-bf47-459e3bc3d99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:18.818338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca78e48a-8e24-41d3-bf47-459e3bc3d99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:18.819364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca78e48a-8e24-41d3-bf47-459e3bc3d99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:18.821187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca78e48a-8e24-41d3-bf47-459e3bc3d99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:18.880369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-ca78e48a-8e24-41d3-bf47-459e3bc3d99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:18.930738 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ca78e48a-8e24-41d3-bf47-459e3bc3d99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.134060 May 28 21:18:18.951298 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1907/3858] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:18:18 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:18.967097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5f621899-4970-4b57-8c4c-e2eb0949b457 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:18.972758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5f621899-4970-4b57-8c4c-e2eb0949b457 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:18.974367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.compute.servers [None req-5f621899-4970-4b57-8c4c-e2eb0949b457 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Removing options 'limit' from query {{(pid=143128) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 28 21:18:18.975291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5f621899-4970-4b57-8c4c-e2eb0949b457 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:18.981299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f621899-4970-4b57-8c4c-e2eb0949b457 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:18.981866 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f621899-4970-4b57-8c4c-e2eb0949b457 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:18.983479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f621899-4970-4b57-8c4c-e2eb0949b457 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:18.984442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f621899-4970-4b57-8c4c-e2eb0949b457 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:19.025112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-5f621899-4970-4b57-8c4c-e2eb0949b457 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:19.046175 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-65ad62ea-4776-4407-9993-db23000fab77 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "DELETE /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 204 len: 0 microversion: 2.1 time: 0.433177 May 28 21:18:19.046890 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1952/3859] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:18:18 2022] DELETE /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:18:19.064596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cfe96fa4-1e46-45e7-a6ae-ca31b69e9927 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:19.066555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cfe96fa4-1e46-45e7-a6ae-ca31b69e9927 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:19.077098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cfe96fa4-1e46-45e7-a6ae-ca31b69e9927 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:19.082233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cfe96fa4-1e46-45e7-a6ae-ca31b69e9927 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:19.084936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cfe96fa4-1e46-45e7-a6ae-ca31b69e9927 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:19.084936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cfe96fa4-1e46-45e7-a6ae-ca31b69e9927 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:19.113071 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5f621899-4970-4b57-8c4c-e2eb0949b457 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.160735 May 28 21:18:19.119814 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1908/3860] 10.222.0.33 () {58 vars in 1149 bytes} [Sat May 28 21:18:18 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:19.124645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-71d8e85d-7390-4a9b-9dc7-c11ccf4ff18e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:19.140367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-71d8e85d-7390-4a9b-9dc7-c11ccf4ff18e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:19.144483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-71d8e85d-7390-4a9b-9dc7-c11ccf4ff18e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:19.158501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71d8e85d-7390-4a9b-9dc7-c11ccf4ff18e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:19.162160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71d8e85d-7390-4a9b-9dc7-c11ccf4ff18e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:19.166974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71d8e85d-7390-4a9b-9dc7-c11ccf4ff18e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:19.167428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71d8e85d-7390-4a9b-9dc7-c11ccf4ff18e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:19.209893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-71d8e85d-7390-4a9b-9dc7-c11ccf4ff18e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:19.254599 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-71d8e85d-7390-4a9b-9dc7-c11ccf4ff18e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.133487 May 28 21:18:19.258255 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1909/3861] 10.222.0.33 () {58 vars in 1124 bytes} [Sat May 28 21:18:19 2022] GET /compute/v2.1/servers => generated 1011 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:19.269517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-825e78f9-7f3d-49a3-9101-f09fdb28dffb tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:19.282774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-825e78f9-7f3d-49a3-9101-f09fdb28dffb tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:19.282774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-825e78f9-7f3d-49a3-9101-f09fdb28dffb tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:19.291657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-825e78f9-7f3d-49a3-9101-f09fdb28dffb tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:19.292426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-825e78f9-7f3d-49a3-9101-f09fdb28dffb tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:19.293339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-825e78f9-7f3d-49a3-9101-f09fdb28dffb tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:19.293787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-825e78f9-7f3d-49a3-9101-f09fdb28dffb tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:19.457413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cfe96fa4-1e46-45e7-a6ae-ca31b69e9927 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:19.459932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-825e78f9-7f3d-49a3-9101-f09fdb28dffb tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:19.467893 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cfe96fa4-1e46-45e7-a6ae-ca31b69e9927 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1689 microversion: 2.1 time: 0.406580 May 28 21:18:19.468876 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1953/3862] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:19 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1689 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:19.556437 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-825e78f9-7f3d-49a3-9101-f09fdb28dffb tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.291869 May 28 21:18:19.565242 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1910/3863] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:18:19 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:18:19.571796 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4fee1340-bb70-41e9-89eb-ffb3a8104f0e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:19.575696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4fee1340-bb70-41e9-89eb-ffb3a8104f0e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:19.577644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.compute.servers [None req-4fee1340-bb70-41e9-89eb-ffb3a8104f0e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Removing options 'limit' from query {{(pid=143129) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 28 21:18:19.578867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4fee1340-bb70-41e9-89eb-ffb3a8104f0e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:19.592042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fee1340-bb70-41e9-89eb-ffb3a8104f0e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:19.599946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fee1340-bb70-41e9-89eb-ffb3a8104f0e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:19.603103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fee1340-bb70-41e9-89eb-ffb3a8104f0e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:19.603772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4fee1340-bb70-41e9-89eb-ffb3a8104f0e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:19.640236 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4fee1340-bb70-41e9-89eb-ffb3a8104f0e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.073364 May 28 21:18:19.647800 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1954/3864] 10.222.0.33 () {58 vars in 1139 bytes} [Sat May 28 21:18:19 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:19.654061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7600f0c3-8c16-4495-8437-8666d003b7f5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:19.657795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7600f0c3-8c16-4495-8437-8666d003b7f5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:19.658632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7600f0c3-8c16-4495-8437-8666d003b7f5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-737789618', 'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:19.667848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7600f0c3-8c16-4495-8437-8666d003b7f5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:19.669145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7600f0c3-8c16-4495-8437-8666d003b7f5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:19.670106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7600f0c3-8c16-4495-8437-8666d003b7f5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:19.675463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7600f0c3-8c16-4495-8437-8666d003b7f5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:19.827329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-7600f0c3-8c16-4495-8437-8666d003b7f5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:19.864189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:19.961653 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7600f0c3-8c16-4495-8437-8666d003b7f5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-737789618" status: 200 len: 345 microversion: 2.1 time: 0.312261 May 28 21:18:19.968934 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1911/3865] 10.222.0.33 () {58 vars in 1239 bytes} [Sat May 28 21:18:19 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-737789618 => generated 345 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:19.974432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-263cd0ea-fcc4-43ae-983b-9c9625aff44c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:19.989759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-263cd0ea-fcc4-43ae-983b-9c9625aff44c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:19.992647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-263cd0ea-fcc4-43ae-983b-9c9625aff44c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:20.057650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-263cd0ea-fcc4-43ae-983b-9c9625aff44c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Going to try to stop instance {{(pid=143129) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 21:18:20.339440 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-263cd0ea-fcc4-43ae-983b-9c9625aff44c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "POST /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1/action" status: 202 len: 0 microversion: 2.1 time: 0.369072 May 28 21:18:20.344905 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1955/3866] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:18:19 2022] POST /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:18:20.360751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-59e0f642-1b01-4a01-bf4b-9ce98019a63c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:20.360970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-59e0f642-1b01-4a01-bf4b-9ce98019a63c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:20.376824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59e0f642-1b01-4a01-bf4b-9ce98019a63c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:20.378741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59e0f642-1b01-4a01-bf4b-9ce98019a63c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:20.379762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59e0f642-1b01-4a01-bf4b-9ce98019a63c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:20.380450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59e0f642-1b01-4a01-bf4b-9ce98019a63c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:20.493075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0224b651-2f03-4004-ae5e-673e9bae2ad6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:20.494420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0224b651-2f03-4004-ae5e-673e9bae2ad6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:20.504322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0224b651-2f03-4004-ae5e-673e9bae2ad6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:20.505089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0224b651-2f03-4004-ae5e-673e9bae2ad6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:20.506195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0224b651-2f03-4004-ae5e-673e9bae2ad6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:20.506815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0224b651-2f03-4004-ae5e-673e9bae2ad6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:20.859133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-59e0f642-1b01-4a01-bf4b-9ce98019a63c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:20.867991 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-59e0f642-1b01-4a01-bf4b-9ce98019a63c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.518354 May 28 21:18:20.869245 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1912/3867] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:20 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:20.901006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0224b651-2f03-4004-ae5e-673e9bae2ad6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:20.914668 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0224b651-2f03-4004-ae5e-673e9bae2ad6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1689 microversion: 2.1 time: 0.425584 May 28 21:18:20.915921 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1956/3868] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:20 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1689 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:18:21.892713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-353faa97-6e6a-4f0b-a9b6-8b80b5cc996a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:21.896492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-353faa97-6e6a-4f0b-a9b6-8b80b5cc996a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:21.916105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-353faa97-6e6a-4f0b-a9b6-8b80b5cc996a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:21.918646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-353faa97-6e6a-4f0b-a9b6-8b80b5cc996a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:21.921638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-353faa97-6e6a-4f0b-a9b6-8b80b5cc996a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:21.922495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-353faa97-6e6a-4f0b-a9b6-8b80b5cc996a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:21.933990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ed37cfaa-da90-40cb-a806-73533d8e824e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:21.935452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ed37cfaa-da90-40cb-a806-73533d8e824e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:21.956272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed37cfaa-da90-40cb-a806-73533d8e824e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:21.956777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed37cfaa-da90-40cb-a806-73533d8e824e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:21.957592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed37cfaa-da90-40cb-a806-73533d8e824e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:21.958071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed37cfaa-da90-40cb-a806-73533d8e824e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:22.051811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:22.603351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-353faa97-6e6a-4f0b-a9b6-8b80b5cc996a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:22.613000 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-353faa97-6e6a-4f0b-a9b6-8b80b5cc996a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.729869 May 28 21:18:22.621586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ed37cfaa-da90-40cb-a806-73533d8e824e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:22.626492 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1913/3869] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:21 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:22.636090 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ed37cfaa-da90-40cb-a806-73533d8e824e tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1689 microversion: 2.1 time: 0.707155 May 28 21:18:22.637578 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1957/3870] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:21 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1689 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:23.630677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-151b4f24-7a45-47be-89a4-2683f23e89de tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:23.631302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-151b4f24-7a45-47be-89a4-2683f23e89de tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:23.648610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-151b4f24-7a45-47be-89a4-2683f23e89de tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:23.649129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-151b4f24-7a45-47be-89a4-2683f23e89de tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:23.652603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-151b4f24-7a45-47be-89a4-2683f23e89de tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:23.653067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-151b4f24-7a45-47be-89a4-2683f23e89de tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:23.653549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1571e89b-8649-407f-b79e-d820fbb14416 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:23.654217 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1571e89b-8649-407f-b79e-d820fbb14416 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:23.671420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1571e89b-8649-407f-b79e-d820fbb14416 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:23.672657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1571e89b-8649-407f-b79e-d820fbb14416 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:23.673642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1571e89b-8649-407f-b79e-d820fbb14416 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:23.675216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1571e89b-8649-407f-b79e-d820fbb14416 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:24.365993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-151b4f24-7a45-47be-89a4-2683f23e89de tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:24.374864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1571e89b-8649-407f-b79e-d820fbb14416 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:24.384220 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1571e89b-8649-407f-b79e-d820fbb14416 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1689 microversion: 2.1 time: 0.734396 May 28 21:18:24.385503 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-151b4f24-7a45-47be-89a4-2683f23e89de tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.759284 May 28 21:18:24.386809 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1914/3871] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:23 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:24.387592 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1958/3872] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:23 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1689 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:25.410802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a1ba39f1-5b53-496a-9f49-274fe5f45b13 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:25.412658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a1ba39f1-5b53-496a-9f49-274fe5f45b13 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:25.425653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a1ba39f1-5b53-496a-9f49-274fe5f45b13 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:25.426392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a1ba39f1-5b53-496a-9f49-274fe5f45b13 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:25.427547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a1ba39f1-5b53-496a-9f49-274fe5f45b13 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:25.428156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a1ba39f1-5b53-496a-9f49-274fe5f45b13 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:25.713458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-7328977c-77b4-4347-aee6-057d5a69df00 req-c1901e10-3b3b-4946-a734-183fbcc9273f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ee8dd9-d59f-422a-a29d-2732e2573958", "name": "network-vif-deleted", "tag": "011cb162-2172-4519-8fcc-9bf7016b04a4"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:25.723213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7328977c-77b4-4347-aee6-057d5a69df00 req-c1901e10-3b3b-4946-a734-183fbcc9273f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:25.724003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7328977c-77b4-4347-aee6-057d5a69df00 req-c1901e10-3b3b-4946-a734-183fbcc9273f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:25.751229 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-7328977c-77b4-4347-aee6-057d5a69df00 req-c1901e10-3b3b-4946-a734-183fbcc9273f service nova] Creating event network-vif-deleted:011cb162-2172-4519-8fcc-9bf7016b04a4 for instance 43ee8dd9-d59f-422a-a29d-2732e2573958 on nch1-master-1 May 28 21:18:25.761890 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-7328977c-77b4-4347-aee6-057d5a69df00 req-c1901e10-3b3b-4946-a734-183fbcc9273f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.382032 May 28 21:18:25.763823 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1915/3873] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:18:25.775483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-df3d1d1d-93f0-4420-9284-0a532504f0d0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:25.775673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-df3d1d1d-93f0-4420-9284-0a532504f0d0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:25.798605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df3d1d1d-93f0-4420-9284-0a532504f0d0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:25.802187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df3d1d1d-93f0-4420-9284-0a532504f0d0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:25.803278 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df3d1d1d-93f0-4420-9284-0a532504f0d0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:25.805689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df3d1d1d-93f0-4420-9284-0a532504f0d0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:25.867644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df3d1d1d-93f0-4420-9284-0a532504f0d0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:25.868367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df3d1d1d-93f0-4420-9284-0a532504f0d0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:25.869172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-df3d1d1d-93f0-4420-9284-0a532504f0d0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lazy-loading 'fault' on Instance uuid 43ee8dd9-d59f-422a-a29d-2732e2573958 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:18:25.910584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a1ba39f1-5b53-496a-9f49-274fe5f45b13 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:25.919125 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a1ba39f1-5b53-496a-9f49-274fe5f45b13 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.516932 May 28 21:18:25.919833 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1959/3874] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:25 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:25.934941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-df3d1d1d-93f0-4420-9284-0a532504f0d0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:25.944671 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-df3d1d1d-93f0-4420-9284-0a532504f0d0 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 200 len: 1334 microversion: 2.1 time: 0.179684 May 28 21:18:25.945720 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1916/3875] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:25 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 1334 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:26.869778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-76418fa3-4d53-42dd-a850-5bb0ad4a3a42 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:26.870821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-76418fa3-4d53-42dd-a850-5bb0ad4a3a42 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:26.879566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76418fa3-4d53-42dd-a850-5bb0ad4a3a42 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:26.880021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76418fa3-4d53-42dd-a850-5bb0ad4a3a42 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:26.880791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76418fa3-4d53-42dd-a850-5bb0ad4a3a42 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:26.892151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76418fa3-4d53-42dd-a850-5bb0ad4a3a42 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:26.937480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e0d59a75-41d7-4a34-9307-eb700663920c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:26.939032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e0d59a75-41d7-4a34-9307-eb700663920c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:26.952012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0d59a75-41d7-4a34-9307-eb700663920c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:26.954530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0d59a75-41d7-4a34-9307-eb700663920c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:26.957100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0d59a75-41d7-4a34-9307-eb700663920c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:26.959507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0d59a75-41d7-4a34-9307-eb700663920c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:27.027483 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-76418fa3-4d53-42dd-a850-5bb0ad4a3a42 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "POST /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63/action" status: 200 len: 24588 microversion: 2.42 time: 1.004441 May 28 21:18:27.038774 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1960/3876] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:18:26 2022] POST /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63/action => generated 24588 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 21:18:27.042608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-24c231d4-724e-4f96-90f2-9d33784b6c17 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:27.044430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-24c231d4-724e-4f96-90f2-9d33784b6c17 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 43ee8dd9-d59f-422a-a29d-2732e2573958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:27.054054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24c231d4-724e-4f96-90f2-9d33784b6c17 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:27.054924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24c231d4-724e-4f96-90f2-9d33784b6c17 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:27.056028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24c231d4-724e-4f96-90f2-9d33784b6c17 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:27.066529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24c231d4-724e-4f96-90f2-9d33784b6c17 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:27.089215 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-24c231d4-724e-4f96-90f2-9d33784b6c17 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] HTTP exception thrown: Instance 43ee8dd9-d59f-422a-a29d-2732e2573958 could not be found. May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-24c231d4-724e-4f96-90f2-9d33784b6c17 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Request method failure captured: May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 HTTP/1.1 May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpC0XaL6nt9hgj0fqNJ-e8egvesT5NjK_jUnUBAtg24_DQiY4yBBswyZZHwMHrBd5ALBI4UbRMzOp6RzZMuwpPVT6pecTgJ4VSwWmnC-cS82dnuXHOnMJSwA47KVatITeM5lcpiario-t9uZicKVzKlAEQs1aEbN7XgO22WG-C22tyY May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53b9cfacdbb74a058e52bed331a6f241", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: af446b3d802a42e3bd72b08bace8ea8d May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 43ee8dd9-d59f-422a-a29d-2732e2573958 could not be found. May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '43ee8dd9-d59f-422a-a29d-2732e2573958'} May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ee8dd9-d59f-422a-a29d-2732e2573958 could not be found. May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ee8dd9-d59f-422a-a29d-2732e2573958 could not be found. May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:18:27.096858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:18:27.102968 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:18:27.102968 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:18:27.102968 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:18:27.102968 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:18:27.102968 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:18:27.102968 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:18:27.102968 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ee8dd9-d59f-422a-a29d-2732e2573958 could not be found. May 28 21:18:27.102968 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:18:27.104470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-24c231d4-724e-4f96-90f2-9d33784b6c17 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Returning 404 to user: Instance 43ee8dd9-d59f-422a-a29d-2732e2573958 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:18:27.106136 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-24c231d4-724e-4f96-90f2-9d33784b6c17 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958" status: 404 len: 111 microversion: 2.1 time: 0.069425 May 28 21:18:27.107245 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1961/3877] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:27 2022] GET /compute/v2.1/servers/43ee8dd9-d59f-422a-a29d-2732e2573958 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:18:27.116946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb26423d-ac27-406b-b524-2cc0efab8f2c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '.version_select at 0x7f4d571695e0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:27.280217 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb26423d-ac27-406b-b524-2cc0efab8f2c tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-805344502" status: 202 len: 0 microversion: 2.1 time: 0.168470 May 28 21:18:27.281358 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1962/3878] 10.222.0.33 () {58 vars in 1217 bytes} [Sat May 28 21:18:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-805344502 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:18:27.393440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e0d59a75-41d7-4a34-9307-eb700663920c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:27.416529 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e0d59a75-41d7-4a34-9307-eb700663920c tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.483792 May 28 21:18:27.417387 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1917/3879] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:26 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:28.433209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:28.439122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-31dd4c9e-ee83-4a3f-a620-bcd40904621e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:28.439748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-31dd4c9e-ee83-4a3f-a620-bcd40904621e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:28.460653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31dd4c9e-ee83-4a3f-a620-bcd40904621e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:28.461144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31dd4c9e-ee83-4a3f-a620-bcd40904621e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:28.461976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31dd4c9e-ee83-4a3f-a620-bcd40904621e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:28.462427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31dd4c9e-ee83-4a3f-a620-bcd40904621e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:28.834518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-31dd4c9e-ee83-4a3f-a620-bcd40904621e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:28.846620 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-31dd4c9e-ee83-4a3f-a620-bcd40904621e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.415619 May 28 21:18:28.855454 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1963/3880] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:28 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:29.874614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1a7dedbe-7eb8-4bbf-a33f-745a6825cfbd tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:29.876031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1a7dedbe-7eb8-4bbf-a33f-745a6825cfbd tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:29.895851 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:29.898477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=14 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:29.903631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a7dedbe-7eb8-4bbf-a33f-745a6825cfbd tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:29.904789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a7dedbe-7eb8-4bbf-a33f-745a6825cfbd tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:29.906048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a7dedbe-7eb8-4bbf-a33f-745a6825cfbd tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:29.906756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a7dedbe-7eb8-4bbf-a33f-745a6825cfbd tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:30.470754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1a7dedbe-7eb8-4bbf-a33f-745a6825cfbd tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:30.485265 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1a7dedbe-7eb8-4bbf-a33f-745a6825cfbd tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.617451 May 28 21:18:30.504438 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1918/3881] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:29 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:31.196713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:31.376328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-2127809479", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "a494bc09-1f4f-42cf-9108-4b6f112fcc07"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:31.483353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] validate_networks() for [('a494bc09-1f4f-42cf-9108-4b6f112fcc07', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:18:31.508510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a588f4aa-d269-4577-86b2-fa8e00b743f6 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:31.509215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a588f4aa-d269-4577-86b2-fa8e00b743f6 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:31.535284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a588f4aa-d269-4577-86b2-fa8e00b743f6 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:31.535284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a588f4aa-d269-4577-86b2-fa8e00b743f6 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:31.535284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a588f4aa-d269-4577-86b2-fa8e00b743f6 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:31.535284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a588f4aa-d269-4577-86b2-fa8e00b743f6 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:32.029485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a588f4aa-d269-4577-86b2-fa8e00b743f6 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:32.042973 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a588f4aa-d269-4577-86b2-fa8e00b743f6 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.538861 May 28 21:18:32.044377 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1919/3882] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:31 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:32.656340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:18:32.656839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:18:32.657233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:18:32.657675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:18:32.658126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:18:32.680578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:32.680578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:32.680578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:32.681177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:32.703131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Getting quotas for project 84e22c442b0241f18af6ee9408d47223. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:18:32.710092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Getting quotas for user cb285a5e922745bbbd61f4c6ca663c71 and project 84e22c442b0241f18af6ee9408d47223. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:18:32.725398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:18:32.728107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:18:32.951041 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f7efed6b-54e3-4df3-a7fe-7524abaec681 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.759566 May 28 21:18:32.951643 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1964/3883] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:18:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:18:32.962582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bf9bd509-4b5b-424c-88f4-7f9065d56864 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:32.963458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bf9bd509-4b5b-424c-88f4-7f9065d56864 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:33.076465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7aa7a553-487c-45c2-a7e8-7e55a8ea225f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:33.077505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7aa7a553-487c-45c2-a7e8-7e55a8ea225f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:33.089350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bf9bd509-4b5b-424c-88f4-7f9065d56864 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:33.099371 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bf9bd509-4b5b-424c-88f4-7f9065d56864 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1217 microversion: 2.1 time: 0.140899 May 28 21:18:33.101980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7aa7a553-487c-45c2-a7e8-7e55a8ea225f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:33.102428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7aa7a553-487c-45c2-a7e8-7e55a8ea225f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:33.103269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7aa7a553-487c-45c2-a7e8-7e55a8ea225f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:33.110875 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1920/3884] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:32 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:33.124317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7aa7a553-487c-45c2-a7e8-7e55a8ea225f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:33.449637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7aa7a553-487c-45c2-a7e8-7e55a8ea225f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:33.470308 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7aa7a553-487c-45c2-a7e8-7e55a8ea225f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.413282 May 28 21:18:33.481161 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1965/3885] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:33 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:34.120300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-008afdb8-286d-4e72-a4e6-e4a9b48668c8 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:34.121943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-008afdb8-286d-4e72-a4e6-e4a9b48668c8 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:34.338968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-008afdb8-286d-4e72-a4e6-e4a9b48668c8 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:34.350318 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-008afdb8-286d-4e72-a4e6-e4a9b48668c8 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1217 microversion: 2.1 time: 0.236051 May 28 21:18:34.351553 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1921/3886] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:34 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1217 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:34.491411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-03ec00a3-235f-468d-a222-cb99d79adb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:34.492841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-03ec00a3-235f-468d-a222-cb99d79adb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:34.503327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-03ec00a3-235f-468d-a222-cb99d79adb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:34.504177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-03ec00a3-235f-468d-a222-cb99d79adb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:34.505449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-03ec00a3-235f-468d-a222-cb99d79adb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:34.506258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-03ec00a3-235f-468d-a222-cb99d79adb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:34.761354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-03ec00a3-235f-468d-a222-cb99d79adb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:34.770858 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-03ec00a3-235f-468d-a222-cb99d79adb2e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.287326 May 28 21:18:34.771449 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1966/3887] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:34 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:35.370861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7317f851-2299-49e0-9672-4f5ba7713750 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:35.371725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7317f851-2299-49e0-9672-4f5ba7713750 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:35.385823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7317f851-2299-49e0-9672-4f5ba7713750 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:35.386313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7317f851-2299-49e0-9672-4f5ba7713750 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:35.387669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7317f851-2299-49e0-9672-4f5ba7713750 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:35.388109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7317f851-2299-49e0-9672-4f5ba7713750 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:35.789175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-77ed6df1-07b9-4413-bbad-ed6b2e6b0f4a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:35.790012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-77ed6df1-07b9-4413-bbad-ed6b2e6b0f4a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:35.807670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77ed6df1-07b9-4413-bbad-ed6b2e6b0f4a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:35.809251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77ed6df1-07b9-4413-bbad-ed6b2e6b0f4a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:35.810045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77ed6df1-07b9-4413-bbad-ed6b2e6b0f4a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:35.810511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77ed6df1-07b9-4413-bbad-ed6b2e6b0f4a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:35.987128 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7317f851-2299-49e0-9672-4f5ba7713750 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:36.009632 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7317f851-2299-49e0-9672-4f5ba7713750 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1213 microversion: 2.1 time: 0.642996 May 28 21:18:36.011402 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1922/3888] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:35 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1213 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:36.265020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-77ed6df1-07b9-4413-bbad-ed6b2e6b0f4a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:36.274914 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-77ed6df1-07b9-4413-bbad-ed6b2e6b0f4a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.489832 May 28 21:18:36.276488 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1967/3889] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:35 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:37.027479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fca7e721-9305-493b-bf78-d427147d635f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:37.028114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fca7e721-9305-493b-bf78-d427147d635f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:37.036171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fca7e721-9305-493b-bf78-d427147d635f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:37.036643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fca7e721-9305-493b-bf78-d427147d635f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:37.037437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fca7e721-9305-493b-bf78-d427147d635f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:37.037919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fca7e721-9305-493b-bf78-d427147d635f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:37.147545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fca7e721-9305-493b-bf78-d427147d635f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:37.157030 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fca7e721-9305-493b-bf78-d427147d635f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1275 microversion: 2.1 time: 0.133304 May 28 21:18:37.158214 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1923/3890] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:37 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1275 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:37.298034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dd33f952-0b83-41fb-8edf-8fe36e5e6959 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:37.298034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dd33f952-0b83-41fb-8edf-8fe36e5e6959 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:37.314038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd33f952-0b83-41fb-8edf-8fe36e5e6959 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:37.315192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd33f952-0b83-41fb-8edf-8fe36e5e6959 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:37.316035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd33f952-0b83-41fb-8edf-8fe36e5e6959 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:37.316540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd33f952-0b83-41fb-8edf-8fe36e5e6959 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:37.610497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dd33f952-0b83-41fb-8edf-8fe36e5e6959 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:37.623761 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dd33f952-0b83-41fb-8edf-8fe36e5e6959 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.333323 May 28 21:18:37.624672 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1968/3891] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:37 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:38.179787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e466d323-4958-4013-aca1-5edf1a92a421 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:38.180416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e466d323-4958-4013-aca1-5edf1a92a421 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:38.187370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e466d323-4958-4013-aca1-5edf1a92a421 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:38.187828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e466d323-4958-4013-aca1-5edf1a92a421 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:38.188598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e466d323-4958-4013-aca1-5edf1a92a421 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:38.189046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e466d323-4958-4013-aca1-5edf1a92a421 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:38.323456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e466d323-4958-4013-aca1-5edf1a92a421 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:38.331537 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e466d323-4958-4013-aca1-5edf1a92a421 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1317 microversion: 2.1 time: 0.155647 May 28 21:18:38.332139 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1924/3892] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:38 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:38.642340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4ac92049-5ecc-4411-bbe5-a5a2d0a6dc7b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:38.644269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4ac92049-5ecc-4411-bbe5-a5a2d0a6dc7b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:38.652589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ac92049-5ecc-4411-bbe5-a5a2d0a6dc7b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:38.653284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ac92049-5ecc-4411-bbe5-a5a2d0a6dc7b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:38.654337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ac92049-5ecc-4411-bbe5-a5a2d0a6dc7b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:38.654778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ac92049-5ecc-4411-bbe5-a5a2d0a6dc7b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:38.906589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4ac92049-5ecc-4411-bbe5-a5a2d0a6dc7b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:38.912735 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4ac92049-5ecc-4411-bbe5-a5a2d0a6dc7b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.274797 May 28 21:18:38.923602 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1969/3893] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:38 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:39.351432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8a86eefd-95d9-4bab-87f0-06367de5a968 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:39.353258 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8a86eefd-95d9-4bab-87f0-06367de5a968 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:39.382121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8a86eefd-95d9-4bab-87f0-06367de5a968 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:39.382949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8a86eefd-95d9-4bab-87f0-06367de5a968 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:39.385212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8a86eefd-95d9-4bab-87f0-06367de5a968 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:39.387163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8a86eefd-95d9-4bab-87f0-06367de5a968 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:39.624189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8a86eefd-95d9-4bab-87f0-06367de5a968 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:39.631732 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8a86eefd-95d9-4bab-87f0-06367de5a968 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1317 microversion: 2.1 time: 0.286844 May 28 21:18:39.632520 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1925/3894] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:39 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:39.750449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-7cc7d934-f617-4fa9-a6b3-78ebe240ce39 req-0337e05d-751a-4ca4-9373-4267d0cda1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72ab4714-dd31-4c65-96ad-8afb2f7135a0", "tag": "32483dae-1287-4a5c-86b4-05eda44fc022"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:39.762414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7cc7d934-f617-4fa9-a6b3-78ebe240ce39 req-0337e05d-751a-4ca4-9373-4267d0cda1b5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:39.764694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7cc7d934-f617-4fa9-a6b3-78ebe240ce39 req-0337e05d-751a-4ca4-9373-4267d0cda1b5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:39.776366 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-7cc7d934-f617-4fa9-a6b3-78ebe240ce39 req-0337e05d-751a-4ca4-9373-4267d0cda1b5 service nova] Creating event network-changed:32483dae-1287-4a5c-86b4-05eda44fc022 for instance 72ab4714-dd31-4c65-96ad-8afb2f7135a0 on nch1-master-1 May 28 21:18:39.782202 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-7cc7d934-f617-4fa9-a6b3-78ebe240ce39 req-0337e05d-751a-4ca4-9373-4267d0cda1b5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041263 May 28 21:18:39.783683 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1970/3895] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:39.929631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8738b444-831b-47f0-98e0-3314d7304c91 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:39.930285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8738b444-831b-47f0-98e0-3314d7304c91 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:39.937107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8738b444-831b-47f0-98e0-3314d7304c91 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:39.937554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8738b444-831b-47f0-98e0-3314d7304c91 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:39.941101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8738b444-831b-47f0-98e0-3314d7304c91 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:39.941755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8738b444-831b-47f0-98e0-3314d7304c91 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:40.172449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8738b444-831b-47f0-98e0-3314d7304c91 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:40.184911 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8738b444-831b-47f0-98e0-3314d7304c91 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.258663 May 28 21:18:40.194764 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1926/3896] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:39 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:40.649647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8bc8428f-5e88-4819-9835-0fb8303df4c4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:40.650990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8bc8428f-5e88-4819-9835-0fb8303df4c4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:40.656964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bc8428f-5e88-4819-9835-0fb8303df4c4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:40.657508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bc8428f-5e88-4819-9835-0fb8303df4c4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:40.658959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bc8428f-5e88-4819-9835-0fb8303df4c4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:40.659667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bc8428f-5e88-4819-9835-0fb8303df4c4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:41.026702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8bc8428f-5e88-4819-9835-0fb8303df4c4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:41.039651 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8bc8428f-5e88-4819-9835-0fb8303df4c4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1317 microversion: 2.1 time: 0.394367 May 28 21:18:41.052245 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1971/3897] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:40 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:41.207475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2b90918b-99e3-4e6f-b501-c98f0fe0c1bf tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:41.208030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2b90918b-99e3-4e6f-b501-c98f0fe0c1bf tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:41.218772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b90918b-99e3-4e6f-b501-c98f0fe0c1bf tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:41.219410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b90918b-99e3-4e6f-b501-c98f0fe0c1bf tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:41.221745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b90918b-99e3-4e6f-b501-c98f0fe0c1bf tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:41.227106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b90918b-99e3-4e6f-b501-c98f0fe0c1bf tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:41.421307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2b90918b-99e3-4e6f-b501-c98f0fe0c1bf tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:41.433746 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2b90918b-99e3-4e6f-b501-c98f0fe0c1bf tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.234863 May 28 21:18:41.444789 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1927/3898] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:41 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:42.056905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-69a445b8-e977-4b6c-92c5-f08a5aca303a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:42.058154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-69a445b8-e977-4b6c-92c5-f08a5aca303a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:42.067031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69a445b8-e977-4b6c-92c5-f08a5aca303a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:42.067479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69a445b8-e977-4b6c-92c5-f08a5aca303a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:42.068282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69a445b8-e977-4b6c-92c5-f08a5aca303a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:42.068772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69a445b8-e977-4b6c-92c5-f08a5aca303a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:42.216743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-69a445b8-e977-4b6c-92c5-f08a5aca303a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:42.224718 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-69a445b8-e977-4b6c-92c5-f08a5aca303a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1317 microversion: 2.1 time: 0.171939 May 28 21:18:42.225302 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1972/3899] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:42 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:42.450638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f3807a59-b12e-4a93-ad4d-ba38f2bc8f20 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:42.451271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f3807a59-b12e-4a93-ad4d-ba38f2bc8f20 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:42.460794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3807a59-b12e-4a93-ad4d-ba38f2bc8f20 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:42.461517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3807a59-b12e-4a93-ad4d-ba38f2bc8f20 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:42.462549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3807a59-b12e-4a93-ad4d-ba38f2bc8f20 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:42.463160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3807a59-b12e-4a93-ad4d-ba38f2bc8f20 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:42.724608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f3807a59-b12e-4a93-ad4d-ba38f2bc8f20 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:42.740891 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f3807a59-b12e-4a93-ad4d-ba38f2bc8f20 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.293040 May 28 21:18:42.742171 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1928/3900] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:42 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:43.242283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-22a452e6-6732-41d7-a08f-bddaad638296 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:43.242695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-22a452e6-6732-41d7-a08f-bddaad638296 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:43.246107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:43.246870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:43.251355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22a452e6-6732-41d7-a08f-bddaad638296 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:43.252566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22a452e6-6732-41d7-a08f-bddaad638296 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:43.256993 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22a452e6-6732-41d7-a08f-bddaad638296 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:43.256993 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22a452e6-6732-41d7-a08f-bddaad638296 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:43.532334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-22a452e6-6732-41d7-a08f-bddaad638296 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:43.551181 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-22a452e6-6732-41d7-a08f-bddaad638296 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1317 microversion: 2.1 time: 0.308691 May 28 21:18:43.567001 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1973/3901] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:43 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1317 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:43.775121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-db01b5e9-eb02-44ec-a850-fe636e6f985a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:43.776327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-db01b5e9-eb02-44ec-a850-fe636e6f985a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:43.785981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db01b5e9-eb02-44ec-a850-fe636e6f985a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:43.788881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db01b5e9-eb02-44ec-a850-fe636e6f985a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:43.788881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db01b5e9-eb02-44ec-a850-fe636e6f985a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:43.788881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db01b5e9-eb02-44ec-a850-fe636e6f985a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:43.972299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-db01b5e9-eb02-44ec-a850-fe636e6f985a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:43.982546 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-db01b5e9-eb02-44ec-a850-fe636e6f985a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.211523 May 28 21:18:43.992981 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1929/3902] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:43 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:44.570615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-33185239-f5c8-46f6-81e7-82514fe3072e tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:44.572998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-33185239-f5c8-46f6-81e7-82514fe3072e tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:44.582143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33185239-f5c8-46f6-81e7-82514fe3072e tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:44.582887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33185239-f5c8-46f6-81e7-82514fe3072e tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:44.584020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33185239-f5c8-46f6-81e7-82514fe3072e tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:44.584632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33185239-f5c8-46f6-81e7-82514fe3072e tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:44.762849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-33185239-f5c8-46f6-81e7-82514fe3072e tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:44.771793 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-33185239-f5c8-46f6-81e7-82514fe3072e tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1317 microversion: 2.1 time: 0.207904 May 28 21:18:44.772424 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1974/3903] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:44 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:44.999451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-52266449-bb1d-4d9b-bed1-4aaaeb7d1cef tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:45.000081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-52266449-bb1d-4d9b-bed1-4aaaeb7d1cef tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:45.003663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:45.012950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52266449-bb1d-4d9b-bed1-4aaaeb7d1cef tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:45.013419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52266449-bb1d-4d9b-bed1-4aaaeb7d1cef tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:45.014528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52266449-bb1d-4d9b-bed1-4aaaeb7d1cef tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:45.016469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52266449-bb1d-4d9b-bed1-4aaaeb7d1cef tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:45.082697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:45.318542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-52266449-bb1d-4d9b-bed1-4aaaeb7d1cef tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:45.351050 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-52266449-bb1d-4d9b-bed1-4aaaeb7d1cef tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.355608 May 28 21:18:45.355898 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1930/3904] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:44 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:45.622096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-1f418fb4-a19d-4c48-9b1f-83dad7b88555 req-0935f872-384b-457b-96a1-7ef25030dd38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ab4714-dd31-4c65-96ad-8afb2f7135a0", "name": "network-vif-plugged", "status": "completed", "tag": "32483dae-1287-4a5c-86b4-05eda44fc022"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:45.631713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1f418fb4-a19d-4c48-9b1f-83dad7b88555 req-0935f872-384b-457b-96a1-7ef25030dd38 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:45.632198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1f418fb4-a19d-4c48-9b1f-83dad7b88555 req-0935f872-384b-457b-96a1-7ef25030dd38 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:45.645021 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-1f418fb4-a19d-4c48-9b1f-83dad7b88555 req-0935f872-384b-457b-96a1-7ef25030dd38 service nova] Creating event network-vif-plugged:32483dae-1287-4a5c-86b4-05eda44fc022 for instance 72ab4714-dd31-4c65-96ad-8afb2f7135a0 on nch1-master-1 May 28 21:18:45.650204 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-1f418fb4-a19d-4c48-9b1f-83dad7b88555 req-0935f872-384b-457b-96a1-7ef25030dd38 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175581 May 28 21:18:45.651143 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1975/3905] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:45.789594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4696afaa-9862-4d7c-b90c-aaead7272f96 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:45.789877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4696afaa-9862-4d7c-b90c-aaead7272f96 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:45.800207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4696afaa-9862-4d7c-b90c-aaead7272f96 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:45.801929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4696afaa-9862-4d7c-b90c-aaead7272f96 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:45.806623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4696afaa-9862-4d7c-b90c-aaead7272f96 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:45.807105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4696afaa-9862-4d7c-b90c-aaead7272f96 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:46.109736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4696afaa-9862-4d7c-b90c-aaead7272f96 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:46.126240 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4696afaa-9862-4d7c-b90c-aaead7272f96 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1317 microversion: 2.1 time: 0.340992 May 28 21:18:46.127658 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1931/3906] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:45 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:46.373334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c4a65954-7445-4c87-aa35-7f57557e3a5f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:46.374093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c4a65954-7445-4c87-aa35-7f57557e3a5f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:46.380925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4a65954-7445-4c87-aa35-7f57557e3a5f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:46.381392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4a65954-7445-4c87-aa35-7f57557e3a5f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:46.382204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4a65954-7445-4c87-aa35-7f57557e3a5f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:46.382655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4a65954-7445-4c87-aa35-7f57557e3a5f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:46.540061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c4a65954-7445-4c87-aa35-7f57557e3a5f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:46.548283 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c4a65954-7445-4c87-aa35-7f57557e3a5f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.179234 May 28 21:18:46.566661 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1976/3907] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:46 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:47.146059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-099dccac-a18a-4ec4-91d0-6bc0bef0ba0f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:47.146658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-099dccac-a18a-4ec4-91d0-6bc0bef0ba0f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:47.156762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-099dccac-a18a-4ec4-91d0-6bc0bef0ba0f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:47.157856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-099dccac-a18a-4ec4-91d0-6bc0bef0ba0f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:47.158867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-099dccac-a18a-4ec4-91d0-6bc0bef0ba0f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:47.159319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-099dccac-a18a-4ec4-91d0-6bc0bef0ba0f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:47.333268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-099dccac-a18a-4ec4-91d0-6bc0bef0ba0f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:47.342410 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-099dccac-a18a-4ec4-91d0-6bc0bef0ba0f tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1317 microversion: 2.1 time: 0.201009 May 28 21:18:47.343310 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1932/3908] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:47 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:47.567428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ce3e11de-6bcc-4e81-b934-b74163737465 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:47.567811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ce3e11de-6bcc-4e81-b934-b74163737465 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:47.578512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce3e11de-6bcc-4e81-b934-b74163737465 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:47.579203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce3e11de-6bcc-4e81-b934-b74163737465 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:47.580906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce3e11de-6bcc-4e81-b934-b74163737465 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:47.581441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce3e11de-6bcc-4e81-b934-b74163737465 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:47.820589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ce3e11de-6bcc-4e81-b934-b74163737465 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:47.829908 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ce3e11de-6bcc-4e81-b934-b74163737465 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.267911 May 28 21:18:47.835909 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1977/3909] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:47 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:48.363466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3dcd9c0c-ad5a-49fa-a0eb-f23f07a304d0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:48.365403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3dcd9c0c-ad5a-49fa-a0eb-f23f07a304d0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:48.374471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3dcd9c0c-ad5a-49fa-a0eb-f23f07a304d0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:48.375021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3dcd9c0c-ad5a-49fa-a0eb-f23f07a304d0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:48.376215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3dcd9c0c-ad5a-49fa-a0eb-f23f07a304d0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:48.376866 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3dcd9c0c-ad5a-49fa-a0eb-f23f07a304d0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:48.657234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3dcd9c0c-ad5a-49fa-a0eb-f23f07a304d0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:48.666974 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3dcd9c0c-ad5a-49fa-a0eb-f23f07a304d0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1506 microversion: 2.1 time: 0.310188 May 28 21:18:48.668680 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1933/3910] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:48 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1506 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:48.687231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-787410b4-dff7-450a-b5a1-cfe1d82dd891 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:48.687231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-787410b4-dff7-450a-b5a1-cfe1d82dd891 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:48.695906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-787410b4-dff7-450a-b5a1-cfe1d82dd891 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:48.696396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-787410b4-dff7-450a-b5a1-cfe1d82dd891 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:48.697188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-787410b4-dff7-450a-b5a1-cfe1d82dd891 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:48.697925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-787410b4-dff7-450a-b5a1-cfe1d82dd891 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:48.702338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:48.732521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-787410b4-dff7-450a-b5a1-cfe1d82dd891 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:48.734668 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-787410b4-dff7-450a-b5a1-cfe1d82dd891 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0/os-instance-actions/req-f7efed6b-54e3-4df3-a7fe-7524abaec681" status: 200 len: 313 microversion: 2.1 time: 0.051816 May 28 21:18:48.734949 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1978/3911] 10.222.0.33 () {58 vars in 1418 bytes} [Sat May 28 21:18:48 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0/os-instance-actions/req-f7efed6b-54e3-4df3-a7fe-7524abaec681 => generated 313 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:48.753162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-24ab9e36-a8b9-4976-af8c-7d469fb5bf98 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:48.754376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-24ab9e36-a8b9-4976-af8c-7d469fb5bf98 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:48.766315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24ab9e36-a8b9-4976-af8c-7d469fb5bf98 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:48.767182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24ab9e36-a8b9-4976-af8c-7d469fb5bf98 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:48.769026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24ab9e36-a8b9-4976-af8c-7d469fb5bf98 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:48.769642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24ab9e36-a8b9-4976-af8c-7d469fb5bf98 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:48.848735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6f1ed8bf-be87-4544-ae6b-399931feb7c0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:48.849367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6f1ed8bf-be87-4544-ae6b-399931feb7c0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:48.857142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f1ed8bf-be87-4544-ae6b-399931feb7c0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:48.858219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f1ed8bf-be87-4544-ae6b-399931feb7c0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:48.859140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f1ed8bf-be87-4544-ae6b-399931feb7c0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:48.859595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f1ed8bf-be87-4544-ae6b-399931feb7c0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:49.019986 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-24ab9e36-a8b9-4976-af8c-7d469fb5bf98 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "POST /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0/action" status: 202 len: 0 microversion: 2.1 time: 0.272052 May 28 21:18:49.021447 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1934/3912] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:18:48 2022] POST /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:18:49.038652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-88ac3cd4-e2d4-4c0f-99a0-8ae966f11072 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:49.042436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-88ac3cd4-e2d4-4c0f-99a0-8ae966f11072 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:49.078479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88ac3cd4-e2d4-4c0f-99a0-8ae966f11072 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:49.078969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88ac3cd4-e2d4-4c0f-99a0-8ae966f11072 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:49.080342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88ac3cd4-e2d4-4c0f-99a0-8ae966f11072 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:49.080987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88ac3cd4-e2d4-4c0f-99a0-8ae966f11072 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:49.310992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6f1ed8bf-be87-4544-ae6b-399931feb7c0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:49.328076 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6f1ed8bf-be87-4544-ae6b-399931feb7c0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.484182 May 28 21:18:49.339660 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1979/3913] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:48 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:18:49.521569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-88ac3cd4-e2d4-4c0f-99a0-8ae966f11072 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:49.532468 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-88ac3cd4-e2d4-4c0f-99a0-8ae966f11072 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1508 microversion: 2.1 time: 0.503888 May 28 21:18:49.538038 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1935/3914] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:49 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1508 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:50.115136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cf4ac227-ac4d-49c5-b9a8-be267a8ecbf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:50.115879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cf4ac227-ac4d-49c5-b9a8-be267a8ecbf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:50.123188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf4ac227-ac4d-49c5-b9a8-be267a8ecbf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:50.124519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf4ac227-ac4d-49c5-b9a8-be267a8ecbf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:50.126231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf4ac227-ac4d-49c5-b9a8-be267a8ecbf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:50.126349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf4ac227-ac4d-49c5-b9a8-be267a8ecbf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:50.152294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cf4ac227-ac4d-49c5-b9a8-be267a8ecbf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:18:50.347501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-22678685-2da9-4bda-9f5a-7f6613c315d9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:50.348144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-22678685-2da9-4bda-9f5a-7f6613c315d9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:50.354993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22678685-2da9-4bda-9f5a-7f6613c315d9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:50.355697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22678685-2da9-4bda-9f5a-7f6613c315d9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:50.356468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22678685-2da9-4bda-9f5a-7f6613c315d9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:50.356907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22678685-2da9-4bda-9f5a-7f6613c315d9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:50.540554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-22678685-2da9-4bda-9f5a-7f6613c315d9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:50.551108 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-22678685-2da9-4bda-9f5a-7f6613c315d9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1521 microversion: 2.1 time: 0.208052 May 28 21:18:50.551701 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1936/3915] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:50 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:18:50.558086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-23b9c316-adce-4c04-bb60-7fbe25c712e0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:50.558915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-23b9c316-adce-4c04-bb60-7fbe25c712e0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:50.565969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-23b9c316-adce-4c04-bb60-7fbe25c712e0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:50.566347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-23b9c316-adce-4c04-bb60-7fbe25c712e0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:50.569614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-23b9c316-adce-4c04-bb60-7fbe25c712e0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:50.569614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-23b9c316-adce-4c04-bb60-7fbe25c712e0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:50.678464 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cf4ac227-ac4d-49c5-b9a8-be267a8ecbf3 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 204 len: 0 microversion: 2.1 time: 0.566611 May 28 21:18:50.683312 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1980/3916] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:18:50 2022] DELETE /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:18:50.689791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ea557936-b7b0-4b40-a689-b2484f81b250 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:50.691712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ea557936-b7b0-4b40-a689-b2484f81b250 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:50.700183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea557936-b7b0-4b40-a689-b2484f81b250 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:50.700880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea557936-b7b0-4b40-a689-b2484f81b250 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:50.701864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea557936-b7b0-4b40-a689-b2484f81b250 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:50.707486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea557936-b7b0-4b40-a689-b2484f81b250 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:50.725423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-23b9c316-adce-4c04-bb60-7fbe25c712e0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:50.739352 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-23b9c316-adce-4c04-bb60-7fbe25c712e0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1513 microversion: 2.1 time: 0.186326 May 28 21:18:50.741195 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1937/3917] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:50 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:50.895594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ea557936-b7b0-4b40-a689-b2484f81b250 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:50.929235 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ea557936-b7b0-4b40-a689-b2484f81b250 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1507 microversion: 2.1 time: 0.242622 May 28 21:18:50.930754 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1981/3918] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:50 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:51.568949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1c8a2bc5-a2eb-483b-b7ab-0603a4b2e7fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:51.569594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1c8a2bc5-a2eb-483b-b7ab-0603a4b2e7fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:51.572463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=74 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:51.577427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c8a2bc5-a2eb-483b-b7ab-0603a4b2e7fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:51.577941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c8a2bc5-a2eb-483b-b7ab-0603a4b2e7fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:51.578719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c8a2bc5-a2eb-483b-b7ab-0603a4b2e7fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:51.582897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c8a2bc5-a2eb-483b-b7ab-0603a4b2e7fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:51.731166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1c8a2bc5-a2eb-483b-b7ab-0603a4b2e7fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:51.739069 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1c8a2bc5-a2eb-483b-b7ab-0603a4b2e7fe tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1498 microversion: 2.1 time: 0.174751 May 28 21:18:51.739646 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1938/3919] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:51 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1498 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:51.763983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-73eb5beb-0bfc-4aaf-988a-63a3861a9a29 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:51.763983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-73eb5beb-0bfc-4aaf-988a-63a3861a9a29 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:51.763983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-73eb5beb-0bfc-4aaf-988a-63a3861a9a29 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:51.768957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a1873cbb-fade-45e2-9f5f-39fd97953229 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:51.769464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73eb5beb-0bfc-4aaf-988a-63a3861a9a29 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:51.770096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73eb5beb-0bfc-4aaf-988a-63a3861a9a29 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:51.770881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73eb5beb-0bfc-4aaf-988a-63a3861a9a29 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:51.771294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73eb5beb-0bfc-4aaf-988a-63a3861a9a29 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:51.771522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a1873cbb-fade-45e2-9f5f-39fd97953229 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:51.780688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1873cbb-fade-45e2-9f5f-39fd97953229 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:51.782769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1873cbb-fade-45e2-9f5f-39fd97953229 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:51.784410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1873cbb-fade-45e2-9f5f-39fd97953229 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:51.785019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1873cbb-fade-45e2-9f5f-39fd97953229 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:51.896571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-73eb5beb-0bfc-4aaf-988a-63a3861a9a29 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:51.954293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a1873cbb-fade-45e2-9f5f-39fd97953229 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:51.958441 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-73eb5beb-0bfc-4aaf-988a-63a3861a9a29 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.206680 May 28 21:18:51.959039 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1982/3920] 10.222.0.33 () {58 vars in 1153 bytes} [Sat May 28 21:18:51 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:51.963820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-20f700f5-41ec-47d5-b17f-6913351a67cd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:51.964431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-20f700f5-41ec-47d5-b17f-6913351a67cd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:51.965147 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a1873cbb-fade-45e2-9f5f-39fd97953229 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1513 microversion: 2.1 time: 0.201589 May 28 21:18:51.967371 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1939/3921] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:51 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1513 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:51.973046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20f700f5-41ec-47d5-b17f-6913351a67cd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:51.973046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20f700f5-41ec-47d5-b17f-6913351a67cd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:51.973284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b83c4006-767e-47b6-be7e-6a7bfdfa7c09 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:51.973382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20f700f5-41ec-47d5-b17f-6913351a67cd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:51.973382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20f700f5-41ec-47d5-b17f-6913351a67cd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:51.978612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b83c4006-767e-47b6-be7e-6a7bfdfa7c09 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:51.979075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b83c4006-767e-47b6-be7e-6a7bfdfa7c09 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:52.010064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b83c4006-767e-47b6-be7e-6a7bfdfa7c09 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Going to try to start instance {{(pid=143128) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 21:18:52.161378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-20f700f5-41ec-47d5-b17f-6913351a67cd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:52.169407 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-20f700f5-41ec-47d5-b17f-6913351a67cd tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1507 microversion: 2.1 time: 0.209382 May 28 21:18:52.170002 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1983/3922] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:51 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:52.349763 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b83c4006-767e-47b6-be7e-6a7bfdfa7c09 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "POST /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1/action" status: 202 len: 0 microversion: 2.1 time: 0.381690 May 28 21:18:52.350838 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1940/3923] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:18:51 2022] POST /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:18:52.373743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b87ae02e-105b-4180-8812-096cdc6cb2a0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:52.376381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b87ae02e-105b-4180-8812-096cdc6cb2a0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:52.389231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b87ae02e-105b-4180-8812-096cdc6cb2a0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:52.389927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b87ae02e-105b-4180-8812-096cdc6cb2a0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:52.390944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b87ae02e-105b-4180-8812-096cdc6cb2a0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:52.391554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b87ae02e-105b-4180-8812-096cdc6cb2a0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:52.627114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b87ae02e-105b-4180-8812-096cdc6cb2a0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:52.638164 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b87ae02e-105b-4180-8812-096cdc6cb2a0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1507 microversion: 2.1 time: 0.273727 May 28 21:18:52.638786 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1984/3924] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:52 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:52.990851 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-53450d12-c550-4c16-ae59-08135aebb2c2 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:52.991983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-53450d12-c550-4c16-ae59-08135aebb2c2 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:52.999569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53450d12-c550-4c16-ae59-08135aebb2c2 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:53.000179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53450d12-c550-4c16-ae59-08135aebb2c2 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:53.002395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53450d12-c550-4c16-ae59-08135aebb2c2 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:53.003114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53450d12-c550-4c16-ae59-08135aebb2c2 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:53.192714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7d218272-7523-4d94-ac93-b9517441f92d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:53.192714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7d218272-7523-4d94-ac93-b9517441f92d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:53.195846 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:53.197257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d218272-7523-4d94-ac93-b9517441f92d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:53.198278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d218272-7523-4d94-ac93-b9517441f92d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:53.199243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d218272-7523-4d94-ac93-b9517441f92d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:53.199761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d218272-7523-4d94-ac93-b9517441f92d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:53.631547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-53450d12-c550-4c16-ae59-08135aebb2c2 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:53.640677 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-53450d12-c550-4c16-ae59-08135aebb2c2 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1513 microversion: 2.1 time: 0.655254 May 28 21:18:53.641867 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1941/3925] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:52 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1513 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:53.661614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2a385e97-1a47-4487-a5c4-d2b23a9716c2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:53.662743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2a385e97-1a47-4487-a5c4-d2b23a9716c2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:53.671516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a385e97-1a47-4487-a5c4-d2b23a9716c2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:53.672410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a385e97-1a47-4487-a5c4-d2b23a9716c2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:53.673530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a385e97-1a47-4487-a5c4-d2b23a9716c2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:53.674777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a385e97-1a47-4487-a5c4-d2b23a9716c2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:53.699386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7d218272-7523-4d94-ac93-b9517441f92d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:53.720007 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7d218272-7523-4d94-ac93-b9517441f92d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1507 microversion: 2.1 time: 0.536544 May 28 21:18:53.721158 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1985/3926] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:53 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1507 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:54.044604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2a385e97-1a47-4487-a5c4-d2b23a9716c2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:54.055432 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2a385e97-1a47-4487-a5c4-d2b23a9716c2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1507 microversion: 2.1 time: 0.402825 May 28 21:18:54.066794 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1942/3927] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:53 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1507 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:18:54.654355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-f5da9407-94ea-4366-8322-56636c0f6a56 req-6b84e3c9-bc20-43ff-bcbb-d42d8601605a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351", "name": "network-vif-deleted", "tag": "982c84ba-01d7-43f0-804a-d47803d30337"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:54.657886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84559e02-1617-4aef-b209-ac0d52ba7ac3 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:54.658661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-84559e02-1617-4aef-b209-ac0d52ba7ac3 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:54.664795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f5da9407-94ea-4366-8322-56636c0f6a56 req-6b84e3c9-bc20-43ff-bcbb-d42d8601605a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:54.665244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84559e02-1617-4aef-b209-ac0d52ba7ac3 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:54.665687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f5da9407-94ea-4366-8322-56636c0f6a56 req-6b84e3c9-bc20-43ff-bcbb-d42d8601605a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:54.667818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84559e02-1617-4aef-b209-ac0d52ba7ac3 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:54.667818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84559e02-1617-4aef-b209-ac0d52ba7ac3 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:54.667818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84559e02-1617-4aef-b209-ac0d52ba7ac3 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:54.684363 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-f5da9407-94ea-4366-8322-56636c0f6a56 req-6b84e3c9-bc20-43ff-bcbb-d42d8601605a service nova] Creating event network-vif-deleted:982c84ba-01d7-43f0-804a-d47803d30337 for instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 on nch1-master-1 May 28 21:18:54.696378 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-f5da9407-94ea-4366-8322-56636c0f6a56 req-6b84e3c9-bc20-43ff-bcbb-d42d8601605a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207588 May 28 21:18:54.696378 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1986/3928] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:54.739210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-30daa3d3-0d74-4519-a94e-b18a79566cbf tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:54.739929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-30daa3d3-0d74-4519-a94e-b18a79566cbf tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:54.746710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30daa3d3-0d74-4519-a94e-b18a79566cbf tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:54.747180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30daa3d3-0d74-4519-a94e-b18a79566cbf tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:54.747969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30daa3d3-0d74-4519-a94e-b18a79566cbf tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:54.748545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30daa3d3-0d74-4519-a94e-b18a79566cbf tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:54.848046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-30daa3d3-0d74-4519-a94e-b18a79566cbf tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:54.856343 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-30daa3d3-0d74-4519-a94e-b18a79566cbf tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 200 len: 1293 microversion: 2.1 time: 0.121721 May 28 21:18:54.857286 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1987/3929] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:54 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 1293 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:18:54.978918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-84559e02-1617-4aef-b209-ac0d52ba7ac3 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:54.985533 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-84559e02-1617-4aef-b209-ac0d52ba7ac3 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1506 microversion: 2.1 time: 0.331748 May 28 21:18:54.994335 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1943/3930] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:54 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:18:55.004558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cc42b6bc-b1e2-4ce0-80ea-2d91e7a4c309 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '.version_select at 0x7f4d5717c040>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:55.005241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cc42b6bc-b1e2-4ce0-80ea-2d91e7a4c309 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:55.012510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc42b6bc-b1e2-4ce0-80ea-2d91e7a4c309 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:55.012976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc42b6bc-b1e2-4ce0-80ea-2d91e7a4c309 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:55.016165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc42b6bc-b1e2-4ce0-80ea-2d91e7a4c309 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:55.016636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc42b6bc-b1e2-4ce0-80ea-2d91e7a4c309 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:55.054903 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cc42b6bc-b1e2-4ce0-80ea-2d91e7a4c309 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.055603 May 28 21:18:55.055938 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1988/3931] 10.222.0.33 () {58 vars in 1295 bytes} [Sat May 28 21:18:54 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0/os-instance-actions => generated 611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:55.068647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f9d07ac7-6774-4070-bd3e-09463b45d462 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:55.069250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f9d07ac7-6774-4070-bd3e-09463b45d462 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:55.074724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d8912224-efd8-4982-8fbb-2ef0c9be883b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:55.076059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d8912224-efd8-4982-8fbb-2ef0c9be883b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:55.076513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9d07ac7-6774-4070-bd3e-09463b45d462 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:55.076971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9d07ac7-6774-4070-bd3e-09463b45d462 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:55.077979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9d07ac7-6774-4070-bd3e-09463b45d462 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:55.078581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9d07ac7-6774-4070-bd3e-09463b45d462 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:55.085794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8912224-efd8-4982-8fbb-2ef0c9be883b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:55.086542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8912224-efd8-4982-8fbb-2ef0c9be883b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:55.088218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8912224-efd8-4982-8fbb-2ef0c9be883b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:55.088781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8912224-efd8-4982-8fbb-2ef0c9be883b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:55.112239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f9d07ac7-6774-4070-bd3e-09463b45d462 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:18:55.127512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:55.240128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d8912224-efd8-4982-8fbb-2ef0c9be883b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:55.250311 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d8912224-efd8-4982-8fbb-2ef0c9be883b tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1507 microversion: 2.1 time: 0.181372 May 28 21:18:55.251105 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1989/3932] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:55 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:55.535316 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f9d07ac7-6774-4070-bd3e-09463b45d462 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "DELETE /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 204 len: 0 microversion: 2.1 time: 0.471622 May 28 21:18:55.535979 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1944/3933] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:18:55 2022] DELETE /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:18:55.544179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-56af6ae7-5911-493a-86e0-7af17d456e2a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:55.546038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-56af6ae7-5911-493a-86e0-7af17d456e2a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:55.552288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56af6ae7-5911-493a-86e0-7af17d456e2a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:55.552744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56af6ae7-5911-493a-86e0-7af17d456e2a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:55.553519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56af6ae7-5911-493a-86e0-7af17d456e2a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:55.554035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56af6ae7-5911-493a-86e0-7af17d456e2a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:55.718907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-56af6ae7-5911-493a-86e0-7af17d456e2a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:55.729371 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-56af6ae7-5911-493a-86e0-7af17d456e2a tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1512 microversion: 2.1 time: 0.188669 May 28 21:18:55.730534 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1990/3934] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:55 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:55.875563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bf14d2d5-8a5d-4b4e-8ffa-d1ce215de1e4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:55.876414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bf14d2d5-8a5d-4b4e-8ffa-d1ce215de1e4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:55.883136 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf14d2d5-8a5d-4b4e-8ffa-d1ce215de1e4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:55.883626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf14d2d5-8a5d-4b4e-8ffa-d1ce215de1e4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:55.884520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf14d2d5-8a5d-4b4e-8ffa-d1ce215de1e4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:55.884975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf14d2d5-8a5d-4b4e-8ffa-d1ce215de1e4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:55.902636 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-bf14d2d5-8a5d-4b4e-8ffa-d1ce215de1e4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] HTTP exception thrown: Instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 could not be found. May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bf14d2d5-8a5d-4b4e-8ffa-d1ce215de1e4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Request method failure captured: May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 HTTP/1.1 May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpC0XaL6nt9hgj0fqNJ-e8egvesT5NjK_jUnUBAtg24_DQiY4yBBswyZZHwMHrBd5ALBI4UbRMzOp6RzZMuwpPVT6pecTgJ4VSwWmnC-cS82dnuXHOnMJSwA47KVatITeM5lcpiario-t9uZicKVzKlAEQs1aEbN7XgO22WG-C22tyY May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53b9cfacdbb74a058e52bed331a6f241", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: af446b3d802a42e3bd72b08bace8ea8d May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 could not be found. May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351'} May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 could not be found. May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 could not be found. May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:18:55.904630 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:18:55.912319 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:18:55.912319 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:18:55.912319 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:18:55.912319 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:18:55.912319 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:18:55.912319 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:18:55.912319 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 could not be found. May 28 21:18:55.912319 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:18:55.913881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bf14d2d5-8a5d-4b4e-8ffa-d1ce215de1e4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Returning 404 to user: Instance 6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:18:55.914918 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bf14d2d5-8a5d-4b4e-8ffa-d1ce215de1e4 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351" status: 404 len: 111 microversion: 2.1 time: 0.044263 May 28 21:18:55.919481 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1945/3935] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:55 2022] GET /compute/v2.1/servers/6d8dc3cd-e71e-44e2-91e5-c6e9ec5dc351 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:18:55.926205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5887674e-ceb5-4c5e-b80b-0b7e8be175ee tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:55.927082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5887674e-ceb5-4c5e-b80b-0b7e8be175ee tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:55.935606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5887674e-ceb5-4c5e-b80b-0b7e8be175ee tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:55.936157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5887674e-ceb5-4c5e-b80b-0b7e8be175ee tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:55.937075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5887674e-ceb5-4c5e-b80b-0b7e8be175ee tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:55.937519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5887674e-ceb5-4c5e-b80b-0b7e8be175ee tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:55.964605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5887674e-ceb5-4c5e-b80b-0b7e8be175ee tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:18:56.102411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:18:56.280142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8a4b588a-746c-4dca-aa9c-fc706c377bb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:56.280974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8a4b588a-746c-4dca-aa9c-fc706c377bb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:56.289961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8a4b588a-746c-4dca-aa9c-fc706c377bb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:56.290333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8a4b588a-746c-4dca-aa9c-fc706c377bb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:56.291236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8a4b588a-746c-4dca-aa9c-fc706c377bb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:56.291649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8a4b588a-746c-4dca-aa9c-fc706c377bb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:56.300440 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5887674e-ceb5-4c5e-b80b-0b7e8be175ee tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 204 len: 0 microversion: 2.1 time: 0.379643 May 28 21:18:56.301355 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1991/3936] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:18:55 2022] DELETE /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:18:56.311502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-766c36ce-1570-43a8-bd67-c3fb6ba30fed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:56.312907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-766c36ce-1570-43a8-bd67-c3fb6ba30fed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:56.322556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-766c36ce-1570-43a8-bd67-c3fb6ba30fed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:56.323121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-766c36ce-1570-43a8-bd67-c3fb6ba30fed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:56.324202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-766c36ce-1570-43a8-bd67-c3fb6ba30fed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:56.324718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-766c36ce-1570-43a8-bd67-c3fb6ba30fed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:56.514624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-766c36ce-1570-43a8-bd67-c3fb6ba30fed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:56.519752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8a4b588a-746c-4dca-aa9c-fc706c377bb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:56.523936 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-766c36ce-1570-43a8-bd67-c3fb6ba30fed tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.218110 May 28 21:18:56.526185 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1992/3937] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:56 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:18:56.536540 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8a4b588a-746c-4dca-aa9c-fc706c377bb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1511 microversion: 2.1 time: 0.262450 May 28 21:18:56.537883 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1946/3938] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:56 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1511 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:56.559443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-825dcab3-8764-4067-b44d-62c59bd71f4e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:56.563246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-825dcab3-8764-4067-b44d-62c59bd71f4e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:56.563695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.compute.servers [None req-825dcab3-8764-4067-b44d-62c59bd71f4e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Removing options 'limit' from query {{(pid=143129) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 28 21:18:56.565100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-825dcab3-8764-4067-b44d-62c59bd71f4e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:56.566564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-825dcab3-8764-4067-b44d-62c59bd71f4e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:56.567019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-825dcab3-8764-4067-b44d-62c59bd71f4e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:56.567831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-825dcab3-8764-4067-b44d-62c59bd71f4e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:56.568277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-825dcab3-8764-4067-b44d-62c59bd71f4e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:56.570499 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-825dcab3-8764-4067-b44d-62c59bd71f4e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.015765 May 28 21:18:56.571123 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1993/3939] 10.222.0.33 () {58 vars in 1139 bytes} [Sat May 28 21:18:56 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:18:56.582127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f8a47408-33d7-4500-b5b8-c362da7943c3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:56.582751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f8a47408-33d7-4500-b5b8-c362da7943c3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:56.588909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8a47408-33d7-4500-b5b8-c362da7943c3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:56.589374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8a47408-33d7-4500-b5b8-c362da7943c3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:56.590185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8a47408-33d7-4500-b5b8-c362da7943c3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:56.590633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8a47408-33d7-4500-b5b8-c362da7943c3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:56.748771 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3d6b39d1-0b8f-40f4-a8fa-7929ff500784 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:56.748771 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3d6b39d1-0b8f-40f4-a8fa-7929ff500784 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:56.750970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f8a47408-33d7-4500-b5b8-c362da7943c3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:56.756722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d6b39d1-0b8f-40f4-a8fa-7929ff500784 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:56.757183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d6b39d1-0b8f-40f4-a8fa-7929ff500784 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:56.758218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d6b39d1-0b8f-40f4-a8fa-7929ff500784 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:56.758677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d6b39d1-0b8f-40f4-a8fa-7929ff500784 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:56.759592 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f8a47408-33d7-4500-b5b8-c362da7943c3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1511 microversion: 2.1 time: 0.181514 May 28 21:18:56.760474 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1947/3940] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:56 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:56.782589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0c9e9399-d46d-48e2-9640-8e39f30a792e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:56.784052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0c9e9399-d46d-48e2-9640-8e39f30a792e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 6045585e-1ad5-4d1d-a523-e58730ef1df1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:56.794975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c9e9399-d46d-48e2-9640-8e39f30a792e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:56.795693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c9e9399-d46d-48e2-9640-8e39f30a792e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:56.796794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c9e9399-d46d-48e2-9640-8e39f30a792e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:56.803283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c9e9399-d46d-48e2-9640-8e39f30a792e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:57.002486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3d6b39d1-0b8f-40f4-a8fa-7929ff500784 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:57.012957 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3d6b39d1-0b8f-40f4-a8fa-7929ff500784 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1512 microversion: 2.1 time: 0.270440 May 28 21:18:57.024098 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1994/3941] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:56 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1512 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:18:57.024482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c9e9399-d46d-48e2-9640-8e39f30a792e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:57.028580 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0c9e9399-d46d-48e2-9640-8e39f30a792e tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1" status: 200 len: 1511 microversion: 2.1 time: 0.249772 May 28 21:18:57.040936 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1948/3942] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:56 2022] GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1 => generated 1511 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:18:57.050540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-df2c2704-f9f2-44c5-8c5b-c0fa9e7080ff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:57.051508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-df2c2704-f9f2-44c5-8c5b-c0fa9e7080ff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:57.079462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df2c2704-f9f2-44c5-8c5b-c0fa9e7080ff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:57.080483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df2c2704-f9f2-44c5-8c5b-c0fa9e7080ff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:57.081288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df2c2704-f9f2-44c5-8c5b-c0fa9e7080ff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:57.081739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df2c2704-f9f2-44c5-8c5b-c0fa9e7080ff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:57.255764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-df2c2704-f9f2-44c5-8c5b-c0fa9e7080ff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:57.278917 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-df2c2704-f9f2-44c5-8c5b-c0fa9e7080ff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1512 microversion: 2.1 time: 0.236749 May 28 21:18:57.279724 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1995/3943] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:57 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1512 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:57.311236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-62e96aa1-4e47-47d3-b9f1-f69a7917acf8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:57.319732 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-62e96aa1-4e47-47d3-b9f1-f69a7917acf8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:57.319732 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-62e96aa1-4e47-47d3-b9f1-f69a7917acf8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:57.416514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62e96aa1-4e47-47d3-b9f1-f69a7917acf8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:57.417031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62e96aa1-4e47-47d3-b9f1-f69a7917acf8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:57.418072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62e96aa1-4e47-47d3-b9f1-f69a7917acf8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:57.418518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62e96aa1-4e47-47d3-b9f1-f69a7917acf8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:57.504250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-62e96aa1-4e47-47d3-b9f1-f69a7917acf8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:57.545501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ef7d71e0-c039-4341-81cd-4c7b098df97f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:57.546144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ef7d71e0-c039-4341-81cd-4c7b098df97f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:57.553050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef7d71e0-c039-4341-81cd-4c7b098df97f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:57.553741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef7d71e0-c039-4341-81cd-4c7b098df97f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:57.554808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef7d71e0-c039-4341-81cd-4c7b098df97f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:57.559235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef7d71e0-c039-4341-81cd-4c7b098df97f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:57.563860 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-62e96aa1-4e47-47d3-b9f1-f69a7917acf8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 345 microversion: 2.1 time: 0.256604 May 28 21:18:57.565004 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1949/3944] 10.222.0.33 () {58 vars in 1153 bytes} [Sat May 28 21:18:57 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 345 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:57.577106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-37a7221f-9814-409e-9866-bef1afb9fb7d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:57.577669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-37a7221f-9814-409e-9866-bef1afb9fb7d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:57.585551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37a7221f-9814-409e-9866-bef1afb9fb7d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:57.586315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37a7221f-9814-409e-9866-bef1afb9fb7d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:57.587589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37a7221f-9814-409e-9866-bef1afb9fb7d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:57.588347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37a7221f-9814-409e-9866-bef1afb9fb7d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:57.776799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ef7d71e0-c039-4341-81cd-4c7b098df97f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:57.778505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-37a7221f-9814-409e-9866-bef1afb9fb7d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:57.790839 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-37a7221f-9814-409e-9866-bef1afb9fb7d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1511 microversion: 2.1 time: 0.217907 May 28 21:18:57.792005 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1950/3945] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:57 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:57.796402 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ef7d71e0-c039-4341-81cd-4c7b098df97f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.252590 May 28 21:18:57.796402 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1996/3946] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:57 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:57.815085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d6cedfc5-4bdc-4ca4-a9b9-4d48d56e45c8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:57.815722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d6cedfc5-4bdc-4ca4-a9b9-4d48d56e45c8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 6045585e-1ad5-4d1d-a523-e58730ef1df1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:57.825092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6cedfc5-4bdc-4ca4-a9b9-4d48d56e45c8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:57.826621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6cedfc5-4bdc-4ca4-a9b9-4d48d56e45c8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:57.826809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6cedfc5-4bdc-4ca4-a9b9-4d48d56e45c8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:57.827463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6cedfc5-4bdc-4ca4-a9b9-4d48d56e45c8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:57.982255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d6cedfc5-4bdc-4ca4-a9b9-4d48d56e45c8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:57.990340 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d6cedfc5-4bdc-4ca4-a9b9-4d48d56e45c8 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1" status: 200 len: 1511 microversion: 2.1 time: 0.181157 May 28 21:18:57.990912 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1951/3947] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:57 2022] GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1 => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:58.007284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9172d701-a9a7-44ac-a31f-cf7811c35823 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:58.007908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9172d701-a9a7-44ac-a31f-cf7811c35823 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:58.014203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9172d701-a9a7-44ac-a31f-cf7811c35823 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:58.014673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9172d701-a9a7-44ac-a31f-cf7811c35823 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:58.015453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9172d701-a9a7-44ac-a31f-cf7811c35823 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:58.015900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9172d701-a9a7-44ac-a31f-cf7811c35823 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:58.031887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7ba57ff9-ce80-4b7e-b469-df1389971412 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:58.032968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7ba57ff9-ce80-4b7e-b469-df1389971412 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:58.039125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ba57ff9-ce80-4b7e-b469-df1389971412 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:58.039590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ba57ff9-ce80-4b7e-b469-df1389971412 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:58.040556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ba57ff9-ce80-4b7e-b469-df1389971412 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:58.041232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ba57ff9-ce80-4b7e-b469-df1389971412 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:58.192835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9172d701-a9a7-44ac-a31f-cf7811c35823 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:58.201762 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9172d701-a9a7-44ac-a31f-cf7811c35823 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1512 microversion: 2.1 time: 0.198365 May 28 21:18:58.202781 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1997/3948] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:58 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1512 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:58.220124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5dbd9d1a-f94f-492d-aa06-65d3f69aea0a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:58.232008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5dbd9d1a-f94f-492d-aa06-65d3f69aea0a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:58.233965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5dbd9d1a-f94f-492d-aa06-65d3f69aea0a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:58.248803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5dbd9d1a-f94f-492d-aa06-65d3f69aea0a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:58.249614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5dbd9d1a-f94f-492d-aa06-65d3f69aea0a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:58.250872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5dbd9d1a-f94f-492d-aa06-65d3f69aea0a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:58.251622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5dbd9d1a-f94f-492d-aa06-65d3f69aea0a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:58.290886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-5dbd9d1a-f94f-492d-aa06-65d3f69aea0a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:58.355266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5dbd9d1a-f94f-492d-aa06-65d3f69aea0a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:58.365297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5dbd9d1a-f94f-492d-aa06-65d3f69aea0a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:58.366151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5dbd9d1a-f94f-492d-aa06-65d3f69aea0a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:58.651107 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5dbd9d1a-f94f-492d-aa06-65d3f69aea0a tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 4517 microversion: 2.1 time: 0.436434 May 28 21:18:58.652526 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1998/3949] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:18:58 2022] GET /compute/v2.1/servers/detail => generated 4517 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:58.654006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7ba57ff9-ce80-4b7e-b469-df1389971412 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:58.662721 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7ba57ff9-ce80-4b7e-b469-df1389971412 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1512 microversion: 2.1 time: 0.635044 May 28 21:18:58.663377 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1952/3950] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:58 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1512 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:18:58.675681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a2ee2dc-3929-46ee-921e-93f3cacdf5f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:58.679649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a2ee2dc-3929-46ee-921e-93f3cacdf5f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:58.679950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6a2ee2dc-3929-46ee-921e-93f3cacdf5f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:58.765945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a2ee2dc-3929-46ee-921e-93f3cacdf5f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:58.766745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a2ee2dc-3929-46ee-921e-93f3cacdf5f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:58.768729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a2ee2dc-3929-46ee-921e-93f3cacdf5f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:58.769419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a2ee2dc-3929-46ee-921e-93f3cacdf5f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:58.814214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cf117269-8611-4aa5-ad81-de44ed4cae3f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:58.814903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cf117269-8611-4aa5-ad81-de44ed4cae3f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:58.821090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf117269-8611-4aa5-ad81-de44ed4cae3f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:58.821479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf117269-8611-4aa5-ad81-de44ed4cae3f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:58.822284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf117269-8611-4aa5-ad81-de44ed4cae3f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:58.822721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf117269-8611-4aa5-ad81-de44ed4cae3f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:58.873894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-6a2ee2dc-3929-46ee-921e-93f3cacdf5f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:58.962617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cf117269-8611-4aa5-ad81-de44ed4cae3f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:58.971571 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cf117269-8611-4aa5-ad81-de44ed4cae3f tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.161477 May 28 21:18:58.972177 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1953/3951] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:58 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:18:59.201190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-99abeabb-1713-400a-a459-ce4b85c1e2c2 req-1163910a-3571-45bc-8179-58dd619f9766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ab4714-dd31-4c65-96ad-8afb2f7135a0", "name": "network-vif-unplugged", "status": "completed", "tag": "32483dae-1287-4a5c-86b4-05eda44fc022"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:18:59.212046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-99abeabb-1713-400a-a459-ce4b85c1e2c2 req-1163910a-3571-45bc-8179-58dd619f9766 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:59.212502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-99abeabb-1713-400a-a459-ce4b85c1e2c2 req-1163910a-3571-45bc-8179-58dd619f9766 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:59.226971 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-99abeabb-1713-400a-a459-ce4b85c1e2c2 req-1163910a-3571-45bc-8179-58dd619f9766 service nova] Creating event network-vif-unplugged:32483dae-1287-4a5c-86b4-05eda44fc022 for instance 72ab4714-dd31-4c65-96ad-8afb2f7135a0 on nch1-master-1 May 28 21:18:59.232497 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-99abeabb-1713-400a-a459-ce4b85c1e2c2 req-1163910a-3571-45bc-8179-58dd619f9766 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035284 May 28 21:18:59.233083 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1954/3952] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:18:59.234292 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6a2ee2dc-3929-46ee-921e-93f3cacdf5f0 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.567148 May 28 21:18:59.234876 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 1999/3953] 10.222.0.33 () {58 vars in 1149 bytes} [Sat May 28 21:18:58 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:59.249884 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aea040ce-25ed-4258-b19f-d79dd543cb6f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:59.254154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aea040ce-25ed-4258-b19f-d79dd543cb6f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:59.254936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aea040ce-25ed-4258-b19f-d79dd543cb6f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:59.260414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aea040ce-25ed-4258-b19f-d79dd543cb6f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:59.260910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aea040ce-25ed-4258-b19f-d79dd543cb6f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:59.261709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aea040ce-25ed-4258-b19f-d79dd543cb6f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:59.262248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aea040ce-25ed-4258-b19f-d79dd543cb6f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:59.367658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-aea040ce-25ed-4258-b19f-d79dd543cb6f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:59.431296 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aea040ce-25ed-4258-b19f-d79dd543cb6f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.185962 May 28 21:18:59.431913 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1955/3954] 10.222.0.33 () {58 vars in 1211 bytes} [Sat May 28 21:18:59 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:18:59.443730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc45a2df-736d-4ba0-9d58-34a7310b8d77 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:59.447575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc45a2df-736d-4ba0-9d58-34a7310b8d77 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:59.448254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc45a2df-736d-4ba0-9d58-34a7310b8d77 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:59.453763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc45a2df-736d-4ba0-9d58-34a7310b8d77 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:59.454284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc45a2df-736d-4ba0-9d58-34a7310b8d77 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:59.455209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc45a2df-736d-4ba0-9d58-34a7310b8d77 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:59.455659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc45a2df-736d-4ba0-9d58-34a7310b8d77 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:59.551550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-fc45a2df-736d-4ba0-9d58-34a7310b8d77 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:59.616479 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc45a2df-736d-4ba0-9d58-34a7310b8d77 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.177621 May 28 21:18:59.617172 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2000/3955] 10.222.0.33 () {58 vars in 1195 bytes} [Sat May 28 21:18:59 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:18:59.628431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ce038627-ef2d-417e-a157-511588b56eff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:59.632194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ce038627-ef2d-417e-a157-511588b56eff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:59.632878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ce038627-ef2d-417e-a157-511588b56eff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'name': '-737789618', 'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:59.638971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce038627-ef2d-417e-a157-511588b56eff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:59.639638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce038627-ef2d-417e-a157-511588b56eff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:59.640920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce038627-ef2d-417e-a157-511588b56eff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:59.641371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce038627-ef2d-417e-a157-511588b56eff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:59.680609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4a0bdb3d-0f2f-4cb9-bbca-85c781048cc1 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:59.681462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4a0bdb3d-0f2f-4cb9-bbca-85c781048cc1 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:59.694359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4a0bdb3d-0f2f-4cb9-bbca-85c781048cc1 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:59.694359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4a0bdb3d-0f2f-4cb9-bbca-85c781048cc1 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:59.694359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4a0bdb3d-0f2f-4cb9-bbca-85c781048cc1 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:59.694359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4a0bdb3d-0f2f-4cb9-bbca-85c781048cc1 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:59.735478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-ce038627-ef2d-417e-a157-511588b56eff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:59.802383 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ce038627-ef2d-417e-a157-511588b56eff tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers?name=-737789618" status: 200 len: 345 microversion: 2.1 time: 0.177557 May 28 21:18:59.803256 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1956/3956] 10.222.0.33 () {58 vars in 1155 bytes} [Sat May 28 21:18:59 2022] GET /compute/v2.1/servers?name=-737789618 => generated 345 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:18:59.814301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-65fc43c9-ca42-42a2-8156-5e7e9d65aaa2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:59.818549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-65fc43c9-ca42-42a2-8156-5e7e9d65aaa2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:59.824070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-65fc43c9-ca42-42a2-8156-5e7e9d65aaa2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:18:59.829997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65fc43c9-ca42-42a2-8156-5e7e9d65aaa2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:59.830503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65fc43c9-ca42-42a2-8156-5e7e9d65aaa2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:59.831344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65fc43c9-ca42-42a2-8156-5e7e9d65aaa2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:18:59.834700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65fc43c9-ca42-42a2-8156-5e7e9d65aaa2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:18:59.877112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4a0bdb3d-0f2f-4cb9-bbca-85c781048cc1 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:18:59.885234 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4a0bdb3d-0f2f-4cb9-bbca-85c781048cc1 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1512 microversion: 2.1 time: 0.208699 May 28 21:18:59.885876 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2001/3957] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:59 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1512 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:18:59.931753 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-65fc43c9-ca42-42a2-8156-5e7e9d65aaa2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:18:59.989616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1752b35c-4836-47bf-a623-46a104620c7d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:18:59.990935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1752b35c-4836-47bf-a623-46a104620c7d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:18:59.994639 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-65fc43c9-ca42-42a2-8156-5e7e9d65aaa2 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.184092 May 28 21:19:00.000652 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1957/3958] 10.222.0.33 () {58 vars in 1153 bytes} [Sat May 28 21:18:59 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:00.006642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1752b35c-4836-47bf-a623-46a104620c7d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:00.007027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1752b35c-4836-47bf-a623-46a104620c7d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:00.008139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1752b35c-4836-47bf-a623-46a104620c7d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:00.008970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1752b35c-4836-47bf-a623-46a104620c7d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:00.011819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-869417f6-344a-4e5a-8b27-2f292df1d741 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:00.015568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-869417f6-344a-4e5a-8b27-2f292df1d741 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:00.016248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-869417f6-344a-4e5a-8b27-2f292df1d741 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-73778961', 'deleted': False, 'project_id': '12b9ffa69df641558691a33ba072f78d'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:19:00.022803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-869417f6-344a-4e5a-8b27-2f292df1d741 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:00.026211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-869417f6-344a-4e5a-8b27-2f292df1d741 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:00.026211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-869417f6-344a-4e5a-8b27-2f292df1d741 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:00.026211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-869417f6-344a-4e5a-8b27-2f292df1d741 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:00.172620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-869417f6-344a-4e5a-8b27-2f292df1d741 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:19:00.248946 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-869417f6-344a-4e5a-8b27-2f292df1d741 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-73778961" status: 200 len: 345 microversion: 2.1 time: 0.241628 May 28 21:19:00.258562 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1958/3959] 10.222.0.33 () {58 vars in 1225 bytes} [Sat May 28 21:19:00 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-73778961 => generated 345 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:19:00.264317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3991fdc0-f68d-414c-b471-e864c69364a3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:00.264966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3991fdc0-f68d-414c-b471-e864c69364a3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:00.272214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3991fdc0-f68d-414c-b471-e864c69364a3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:00.272679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3991fdc0-f68d-414c-b471-e864c69364a3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:00.273562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3991fdc0-f68d-414c-b471-e864c69364a3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:00.274107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3991fdc0-f68d-414c-b471-e864c69364a3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:00.307390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3991fdc0-f68d-414c-b471-e864c69364a3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:19:00.312176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:00.405632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1752b35c-4836-47bf-a623-46a104620c7d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:00.421160 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1752b35c-4836-47bf-a623-46a104620c7d tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1521 microversion: 2.1 time: 0.434751 May 28 21:19:00.422583 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2002/3960] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:18:59 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:00.664144 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3991fdc0-f68d-414c-b471-e864c69364a3 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "DELETE /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 204 len: 0 microversion: 2.1 time: 0.401816 May 28 21:19:00.666165 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1959/3961] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:19:00 2022] DELETE /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:19:00.674104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3adb5ac5-c0c9-4260-be2c-55a06ef606ae tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:00.674963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3adb5ac5-c0c9-4260-be2c-55a06ef606ae tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:00.683541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3adb5ac5-c0c9-4260-be2c-55a06ef606ae tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:00.683541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3adb5ac5-c0c9-4260-be2c-55a06ef606ae tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:00.683775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3adb5ac5-c0c9-4260-be2c-55a06ef606ae tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:00.684177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3adb5ac5-c0c9-4260-be2c-55a06ef606ae tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:00.888401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-cb9aa442-b82c-40ae-bea4-a9adc8b404b3 req-b2d17d94-a488-44a5-9900-72c40cbafc5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b76c27e-3a75-40b8-b777-934f969dc6de", "name": "network-vif-deleted", "tag": "dd262c9c-9a21-4330-8536-21fd5315edaa"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:00.907277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cb9aa442-b82c-40ae-bea4-a9adc8b404b3 req-b2d17d94-a488-44a5-9900-72c40cbafc5f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:00.914202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cb9aa442-b82c-40ae-bea4-a9adc8b404b3 req-b2d17d94-a488-44a5-9900-72c40cbafc5f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:00.952272 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-cb9aa442-b82c-40ae-bea4-a9adc8b404b3 req-b2d17d94-a488-44a5-9900-72c40cbafc5f service nova] Creating event network-vif-deleted:dd262c9c-9a21-4330-8536-21fd5315edaa for instance 4b76c27e-3a75-40b8-b777-934f969dc6de on nch1-master-1 May 28 21:19:00.959452 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-cb9aa442-b82c-40ae-bea4-a9adc8b404b3 req-b2d17d94-a488-44a5-9900-72c40cbafc5f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074908 May 28 21:19:00.962304 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1960/3962] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:19:00.969758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-85606361-8b05-4821-90cc-649edde4aa63 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:00.970974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-85606361-8b05-4821-90cc-649edde4aa63 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:00.981696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85606361-8b05-4821-90cc-649edde4aa63 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:00.982517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85606361-8b05-4821-90cc-649edde4aa63 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:00.983365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85606361-8b05-4821-90cc-649edde4aa63 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:00.983819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85606361-8b05-4821-90cc-649edde4aa63 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:00.984000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3adb5ac5-c0c9-4260-be2c-55a06ef606ae tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:00.997629 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3adb5ac5-c0c9-4260-be2c-55a06ef606ae tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1518 microversion: 2.1 time: 0.327531 May 28 21:19:00.999838 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2003/3963] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:00 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1518 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:01.005404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ddd972dd-2f4a-40a4-9823-83df8ac2d9e0 req-627a1317-dcdb-4914-ad62-527fa3a7f3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72ab4714-dd31-4c65-96ad-8afb2f7135a0", "name": "network-vif-deleted", "tag": "32483dae-1287-4a5c-86b4-05eda44fc022"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:01.014149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ddd972dd-2f4a-40a4-9823-83df8ac2d9e0 req-627a1317-dcdb-4914-ad62-527fa3a7f3cc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:01.017184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ddd972dd-2f4a-40a4-9823-83df8ac2d9e0 req-627a1317-dcdb-4914-ad62-527fa3a7f3cc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:01.037668 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ddd972dd-2f4a-40a4-9823-83df8ac2d9e0 req-627a1317-dcdb-4914-ad62-527fa3a7f3cc service nova] Creating event network-vif-deleted:32483dae-1287-4a5c-86b4-05eda44fc022 for instance 72ab4714-dd31-4c65-96ad-8afb2f7135a0 on nch1-master-1 May 28 21:19:01.043168 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ddd972dd-2f4a-40a4-9823-83df8ac2d9e0 req-627a1317-dcdb-4914-ad62-527fa3a7f3cc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042029 May 28 21:19:01.046025 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2004/3964] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:19:01.073039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-85606361-8b05-4821-90cc-649edde4aa63 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:01.082877 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-85606361-8b05-4821-90cc-649edde4aa63 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1470 microversion: 2.1 time: 0.118595 May 28 21:19:01.083827 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1961/3965] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:00 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1470 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:01.439722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-22399f46-36ce-418c-a6db-a3c5058163aa tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:01.441120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-22399f46-36ce-418c-a6db-a3c5058163aa tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:01.452669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22399f46-36ce-418c-a6db-a3c5058163aa tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:01.452669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22399f46-36ce-418c-a6db-a3c5058163aa tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:01.452669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22399f46-36ce-418c-a6db-a3c5058163aa tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:01.452669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22399f46-36ce-418c-a6db-a3c5058163aa tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:01.867085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-22399f46-36ce-418c-a6db-a3c5058163aa tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:01.878584 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-22399f46-36ce-418c-a6db-a3c5058163aa tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1479 microversion: 2.1 time: 0.443636 May 28 21:19:01.888780 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2005/3966] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:01 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1479 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:02.025153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7be034b9-ca8c-4f45-bbe6-4859c75e6036 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:02.027996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7be034b9-ca8c-4f45-bbe6-4859c75e6036 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:02.046998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7be034b9-ca8c-4f45-bbe6-4859c75e6036 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:02.047474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7be034b9-ca8c-4f45-bbe6-4859c75e6036 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:02.048301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7be034b9-ca8c-4f45-bbe6-4859c75e6036 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:02.050128 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7be034b9-ca8c-4f45-bbe6-4859c75e6036 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:02.101401 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bafb1628-08cf-45fd-92b3-85bc68dd24c0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:02.102751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bafb1628-08cf-45fd-92b3-85bc68dd24c0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:02.111272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bafb1628-08cf-45fd-92b3-85bc68dd24c0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:02.112057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bafb1628-08cf-45fd-92b3-85bc68dd24c0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:02.126286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bafb1628-08cf-45fd-92b3-85bc68dd24c0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:02.127760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bafb1628-08cf-45fd-92b3-85bc68dd24c0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:02.197458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bafb1628-08cf-45fd-92b3-85bc68dd24c0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:02.197951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bafb1628-08cf-45fd-92b3-85bc68dd24c0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:02.198430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-bafb1628-08cf-45fd-92b3-85bc68dd24c0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lazy-loading 'fault' on Instance uuid 72ab4714-dd31-4c65-96ad-8afb2f7135a0 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:19:02.276749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bafb1628-08cf-45fd-92b3-85bc68dd24c0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb285a5e922745bbbd61f4c6ca663c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84e22c442b0241f18af6ee9408d47223', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:02.286440 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bafb1628-08cf-45fd-92b3-85bc68dd24c0 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 200 len: 1307 microversion: 2.1 time: 0.190087 May 28 21:19:02.295823 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2006/3967] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:02 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 1307 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:19:02.316426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7be034b9-ca8c-4f45-bbe6-4859c75e6036 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:02.324491 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7be034b9-ca8c-4f45-bbe6-4859c75e6036 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1518 microversion: 2.1 time: 0.311500 May 28 21:19:02.325071 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1962/3968] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:02 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1518 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:02.896130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0c678d79-b4a4-43a6-8330-d001a30885f6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:02.896863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0c678d79-b4a4-43a6-8330-d001a30885f6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:02.905362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c678d79-b4a4-43a6-8330-d001a30885f6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:02.905858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c678d79-b4a4-43a6-8330-d001a30885f6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:02.909213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c678d79-b4a4-43a6-8330-d001a30885f6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:02.909213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c678d79-b4a4-43a6-8330-d001a30885f6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:02.961985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c678d79-b4a4-43a6-8330-d001a30885f6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:02.962721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0c678d79-b4a4-43a6-8330-d001a30885f6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:02.963194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-0c678d79-b4a4-43a6-8330-d001a30885f6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lazy-loading 'fault' on Instance uuid 4b76c27e-3a75-40b8-b777-934f969dc6de {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:19:02.983836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a77a146b-df70-4c54-9917-c48af909ef69 req-aa260afa-8df1-4769-88a6-f39f1c2613ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63ba3a76-d7d4-462f-9f1d-eacfef201b55", "name": "network-vif-deleted", "tag": "f995244c-309a-489d-ab0e-ff58724ee2bc"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:02.994276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a77a146b-df70-4c54-9917-c48af909ef69 req-aa260afa-8df1-4769-88a6-f39f1c2613ad service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:02.997810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a77a146b-df70-4c54-9917-c48af909ef69 req-aa260afa-8df1-4769-88a6-f39f1c2613ad service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:03.015892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0c678d79-b4a4-43a6-8330-d001a30885f6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af446b3d802a42e3bd72b08bace8ea8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b9cfacdbb74a058e52bed331a6f241', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:03.019249 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a77a146b-df70-4c54-9917-c48af909ef69 req-aa260afa-8df1-4769-88a6-f39f1c2613ad service nova] Creating event network-vif-deleted:f995244c-309a-489d-ab0e-ff58724ee2bc for instance 63ba3a76-d7d4-462f-9f1d-eacfef201b55 on nch1-master-1 May 28 21:19:03.028291 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a77a146b-df70-4c54-9917-c48af909ef69 req-aa260afa-8df1-4769-88a6-f39f1c2613ad service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054548 May 28 21:19:03.033926 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0c678d79-b4a4-43a6-8330-d001a30885f6 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 200 len: 1311 microversion: 2.1 time: 0.137694 May 28 21:19:03.033926 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2007/3969] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:02 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 1311 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:03.037829 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1963/3970] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:19:03.305450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-675a2efb-ab75-4ed6-8f49-5d2a7e500bf4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:03.306117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-675a2efb-ab75-4ed6-8f49-5d2a7e500bf4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] [instance: 72ab4714-dd31-4c65-96ad-8afb2f7135a0] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:03.312714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-675a2efb-ab75-4ed6-8f49-5d2a7e500bf4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:03.313415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-675a2efb-ab75-4ed6-8f49-5d2a7e500bf4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:03.314580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-675a2efb-ab75-4ed6-8f49-5d2a7e500bf4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:03.315194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-675a2efb-ab75-4ed6-8f49-5d2a7e500bf4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:03.330261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:03.331961 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-675a2efb-ab75-4ed6-8f49-5d2a7e500bf4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] HTTP exception thrown: Instance 72ab4714-dd31-4c65-96ad-8afb2f7135a0 could not be found. May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-675a2efb-ab75-4ed6-8f49-5d2a7e500bf4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Request method failure captured: May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 HTTP/1.1 May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpGnsiou1FqU3q4dToDK51R558N7WCVWVq_YHxLkgycmmKzrmcXIA7Fgqn94CLrgRBUkT1rJ60E1_Y31dvYiWQXkpxv1ZMWcyMfftoHSNmdun708RzjDChczj-6a9-xaK13Wqct6rec6cVOoKuNLOv-ktvAOIVljcPxnIPdPUN4QpGc May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 84e22c442b0241f18af6ee9408d47223 May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-InstanceActionsTestJSON-1294174553 May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_84e22c442b0241f18af6ee9408d47223", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/84e22c442b0241f18af6ee9408d47223"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/84e22c442b0241f18af6ee9408d47223"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/84e22c442b0241f18af6ee9408d47223"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-InstanceActionsTestJSON-1294174553 May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 84e22c442b0241f18af6ee9408d47223 May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1294174553 May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-InstanceActionsTestJSON-1294174553-project May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: cb285a5e922745bbbd61f4c6ca663c71 May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-InstanceActionsTestJSON-1294174553-project May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 72ab4714-dd31-4c65-96ad-8afb2f7135a0 could not be found. May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '72ab4714-dd31-4c65-96ad-8afb2f7135a0'} May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72ab4714-dd31-4c65-96ad-8afb2f7135a0 could not be found. May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72ab4714-dd31-4c65-96ad-8afb2f7135a0 could not be found. May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:03.333607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:03.344925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:03.344925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:03.344925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:03.344925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:19:03.344925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:19:03.344925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72ab4714-dd31-4c65-96ad-8afb2f7135a0 could not be found. May 28 21:19:03.344925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:03.344925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-675a2efb-ab75-4ed6-8f49-5d2a7e500bf4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] Returning 404 to user: Instance 72ab4714-dd31-4c65-96ad-8afb2f7135a0 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:19:03.344925 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-675a2efb-ab75-4ed6-8f49-5d2a7e500bf4 tempest-InstanceActionsTestJSON-1294174553 tempest-InstanceActionsTestJSON-1294174553-project] 10.222.0.33 "GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0" status: 404 len: 111 microversion: 2.1 time: 0.035091 May 28 21:19:03.344925 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2008/3971] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:03 2022] GET /compute/v2.1/servers/72ab4714-dd31-4c65-96ad-8afb2f7135a0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:19:03.346488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a7c2350e-3f45-4c47-ac07-5504c3e9fdb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:03.346488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a7c2350e-3f45-4c47-ac07-5504c3e9fdb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:03.351579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7c2350e-3f45-4c47-ac07-5504c3e9fdb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:03.352060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7c2350e-3f45-4c47-ac07-5504c3e9fdb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:03.352830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7c2350e-3f45-4c47-ac07-5504c3e9fdb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:03.353281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7c2350e-3f45-4c47-ac07-5504c3e9fdb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:03.400673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7c2350e-3f45-4c47-ac07-5504c3e9fdb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:03.401404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7c2350e-3f45-4c47-ac07-5504c3e9fdb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:03.402198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-a7c2350e-3f45-4c47-ac07-5504c3e9fdb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lazy-loading 'fault' on Instance uuid 63ba3a76-d7d4-462f-9f1d-eacfef201b55 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:19:03.471240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a7c2350e-3f45-4c47-ac07-5504c3e9fdb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:03.477649 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a7c2350e-3f45-4c47-ac07-5504c3e9fdb5 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 200 len: 1311 microversion: 2.1 time: 0.140112 May 28 21:19:03.478434 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1964/3972] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:03 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 1311 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:04.051288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-660a1f12-b39e-42bb-9a19-2584906dcd22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:04.051288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-660a1f12-b39e-42bb-9a19-2584906dcd22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] [instance: 4b76c27e-3a75-40b8-b777-934f969dc6de] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:04.090634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-660a1f12-b39e-42bb-9a19-2584906dcd22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:04.091192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-660a1f12-b39e-42bb-9a19-2584906dcd22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:04.092641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-660a1f12-b39e-42bb-9a19-2584906dcd22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:04.093329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-660a1f12-b39e-42bb-9a19-2584906dcd22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:04.113791 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-660a1f12-b39e-42bb-9a19-2584906dcd22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] HTTP exception thrown: Instance 4b76c27e-3a75-40b8-b777-934f969dc6de could not be found. May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-660a1f12-b39e-42bb-9a19-2584906dcd22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Request method failure captured: May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de HTTP/1.1 May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpC0XaL6nt9hgj0fqNJ-e8egvesT5NjK_jUnUBAtg24_DQiY4yBBswyZZHwMHrBd5ALBI4UbRMzOp6RzZMuwpPVT6pecTgJ4VSwWmnC-cS82dnuXHOnMJSwA47KVatITeM5lcpiario-t9uZicKVzKlAEQs1aEbN7XgO22WG-C22tyY May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_53b9cfacdbb74a058e52bed331a6f241", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/53b9cfacdbb74a058e52bed331a6f241"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 53b9cfacdbb74a058e52bed331a6f241 May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1405524112 May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: af446b3d802a42e3bd72b08bace8ea8d May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1405524112-project May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 4b76c27e-3a75-40b8-b777-934f969dc6de could not be found. May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '4b76c27e-3a75-40b8-b777-934f969dc6de'} May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b76c27e-3a75-40b8-b777-934f969dc6de could not be found. May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b76c27e-3a75-40b8-b777-934f969dc6de could not be found. May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:04.115494 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:04.119925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:04.119925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:04.119925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:04.119925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:04.119925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:19:04.119925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:19:04.119925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b76c27e-3a75-40b8-b777-934f969dc6de could not be found. May 28 21:19:04.119925 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:04.119925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-660a1f12-b39e-42bb-9a19-2584906dcd22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] Returning 404 to user: Instance 4b76c27e-3a75-40b8-b777-934f969dc6de could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:19:04.119925 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-660a1f12-b39e-42bb-9a19-2584906dcd22 tempest-ServerRescueNegativeTestJSON-1405524112 tempest-ServerRescueNegativeTestJSON-1405524112-project] 10.222.0.33 "GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de" status: 404 len: 111 microversion: 2.1 time: 0.071641 May 28 21:19:04.119925 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2009/3973] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:04 2022] GET /compute/v2.1/servers/4b76c27e-3a75-40b8-b777-934f969dc6de => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:19:04.504531 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c70ec38f-0f1b-45d5-8a18-eec0b25661ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:04.505152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c70ec38f-0f1b-45d5-8a18-eec0b25661ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 63ba3a76-d7d4-462f-9f1d-eacfef201b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:04.512683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c70ec38f-0f1b-45d5-8a18-eec0b25661ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:04.513211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c70ec38f-0f1b-45d5-8a18-eec0b25661ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:04.514139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c70ec38f-0f1b-45d5-8a18-eec0b25661ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:04.514646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c70ec38f-0f1b-45d5-8a18-eec0b25661ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:04.532012 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-c70ec38f-0f1b-45d5-8a18-eec0b25661ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] HTTP exception thrown: Instance 63ba3a76-d7d4-462f-9f1d-eacfef201b55 could not be found. May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c70ec38f-0f1b-45d5-8a18-eec0b25661ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Request method failure captured: May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 HTTP/1.1 May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpF-Hu3FoJY0WdJLCrI3g1G6v5g2ZyR876mQEJxLIy-_vzRwvSdyMeCRHAbFBy9APCy2Ji2n1oyuXlRncCQ9Mg510diBJW24JM-A2YD-tQJx4RUjp7e8HhSZybHEs_04SZBz08TSFTaHCAxaYYI4xu6RvYzgxMQLbavJL4sL4xio6UY May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 12b9ffa69df641558691a33ba072f78d May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ListServerFiltersTestJSON-961926024 May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_12b9ffa69df641558691a33ba072f78d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12b9ffa69df641558691a33ba072f78d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/12b9ffa69df641558691a33ba072f78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12b9ffa69df641558691a33ba072f78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ListServerFiltersTestJSON-961926024 May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 12b9ffa69df641558691a33ba072f78d May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-961926024 May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ListServerFiltersTestJSON-961926024-project May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: a01fd3c4a0184b41864b9184c507a8ff May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ListServerFiltersTestJSON-961926024-project May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 63ba3a76-d7d4-462f-9f1d-eacfef201b55 could not be found. May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '63ba3a76-d7d4-462f-9f1d-eacfef201b55'} May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63ba3a76-d7d4-462f-9f1d-eacfef201b55 could not be found. May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63ba3a76-d7d4-462f-9f1d-eacfef201b55 could not be found. May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:04.533788 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:04.538690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:04.538690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:04.538690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:04.538690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:19:04.538690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:19:04.538690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63ba3a76-d7d4-462f-9f1d-eacfef201b55 could not be found. May 28 21:19:04.538690 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:04.538690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c70ec38f-0f1b-45d5-8a18-eec0b25661ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Returning 404 to user: Instance 63ba3a76-d7d4-462f-9f1d-eacfef201b55 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:19:04.538690 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c70ec38f-0f1b-45d5-8a18-eec0b25661ed tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55" status: 404 len: 111 microversion: 2.1 time: 0.035243 May 28 21:19:04.538690 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1965/3974] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:04 2022] GET /compute/v2.1/servers/63ba3a76-d7d4-462f-9f1d-eacfef201b55 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:19:04.546032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-282e7085-cadd-408b-a7cc-4febe20b5f23 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:04.547341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-282e7085-cadd-408b-a7cc-4febe20b5f23 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 6045585e-1ad5-4d1d-a523-e58730ef1df1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:04.555508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-282e7085-cadd-408b-a7cc-4febe20b5f23 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:04.556277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-282e7085-cadd-408b-a7cc-4febe20b5f23 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:04.557291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-282e7085-cadd-408b-a7cc-4febe20b5f23 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:04.557949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-282e7085-cadd-408b-a7cc-4febe20b5f23 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:04.597435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-282e7085-cadd-408b-a7cc-4febe20b5f23 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 6045585e-1ad5-4d1d-a523-e58730ef1df1] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:19:05.121177 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-282e7085-cadd-408b-a7cc-4febe20b5f23 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1" status: 204 len: 0 microversion: 2.1 time: 0.579716 May 28 21:19:05.124801 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2010/3975] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:19:04 2022] DELETE /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:19:05.135622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d08e1e9c-e610-4cfd-9fcb-14fa28ba868f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:05.136292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d08e1e9c-e610-4cfd-9fcb-14fa28ba868f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 6045585e-1ad5-4d1d-a523-e58730ef1df1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:05.171877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d08e1e9c-e610-4cfd-9fcb-14fa28ba868f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:05.173222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d08e1e9c-e610-4cfd-9fcb-14fa28ba868f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:05.174308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d08e1e9c-e610-4cfd-9fcb-14fa28ba868f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:05.174925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d08e1e9c-e610-4cfd-9fcb-14fa28ba868f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:05.365459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d08e1e9c-e610-4cfd-9fcb-14fa28ba868f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:05.373104 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d08e1e9c-e610-4cfd-9fcb-14fa28ba868f tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1" status: 200 len: 1517 microversion: 2.1 time: 0.244116 May 28 21:19:05.373666 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1966/3976] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:05 2022] GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1 => generated 1517 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:06.392597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ade45b95-ae28-4796-80fe-ffced5852301 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:06.393264 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ade45b95-ae28-4796-80fe-ffced5852301 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 6045585e-1ad5-4d1d-a523-e58730ef1df1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:06.409642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ade45b95-ae28-4796-80fe-ffced5852301 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:06.410146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ade45b95-ae28-4796-80fe-ffced5852301 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:06.411001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ade45b95-ae28-4796-80fe-ffced5852301 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:06.413163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ade45b95-ae28-4796-80fe-ffced5852301 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:06.736316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ade45b95-ae28-4796-80fe-ffced5852301 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:06.745750 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ade45b95-ae28-4796-80fe-ffced5852301 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1" status: 200 len: 1517 microversion: 2.1 time: 0.358783 May 28 21:19:06.747198 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2011/3977] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:06 2022] GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1 => generated 1517 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:07.660723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-72b03555-2ec7-4063-9d62-9ad60d1ef686 req-14c6a057-ae9d-4487-bce1-1dd84a3e7b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6045585e-1ad5-4d1d-a523-e58730ef1df1", "name": "network-vif-deleted", "tag": "92489437-6231-4eb8-8311-f32d174aa7a8"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:07.674268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-72b03555-2ec7-4063-9d62-9ad60d1ef686 req-14c6a057-ae9d-4487-bce1-1dd84a3e7b24 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:07.674813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-72b03555-2ec7-4063-9d62-9ad60d1ef686 req-14c6a057-ae9d-4487-bce1-1dd84a3e7b24 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:07.752292 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-72b03555-2ec7-4063-9d62-9ad60d1ef686 req-14c6a057-ae9d-4487-bce1-1dd84a3e7b24 service nova] Creating event network-vif-deleted:92489437-6231-4eb8-8311-f32d174aa7a8 for instance 6045585e-1ad5-4d1d-a523-e58730ef1df1 on nch2-master-1 May 28 21:19:07.761407 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-72b03555-2ec7-4063-9d62-9ad60d1ef686 req-14c6a057-ae9d-4487-bce1-1dd84a3e7b24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106022 May 28 21:19:07.762535 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1967/3978] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:19:07.763875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c6d6a89b-f159-4bdf-829c-c8c879f6c99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:07.764530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c6d6a89b-f159-4bdf-829c-c8c879f6c99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 6045585e-1ad5-4d1d-a523-e58730ef1df1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:07.783304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6d6a89b-f159-4bdf-829c-c8c879f6c99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:07.783304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6d6a89b-f159-4bdf-829c-c8c879f6c99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:07.783304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6d6a89b-f159-4bdf-829c-c8c879f6c99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:07.783304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6d6a89b-f159-4bdf-829c-c8c879f6c99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:07.878451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c6d6a89b-f159-4bdf-829c-c8c879f6c99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:07.886678 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c6d6a89b-f159-4bdf-829c-c8c879f6c99d tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1" status: 200 len: 1475 microversion: 2.1 time: 0.126702 May 28 21:19:07.887411 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2012/3979] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:07 2022] GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1 => generated 1475 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:19:08.904284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e8d78881-194f-48ab-a4bf-2516e916e6da tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:08.905000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e8d78881-194f-48ab-a4bf-2516e916e6da tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 6045585e-1ad5-4d1d-a523-e58730ef1df1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:08.922012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e8d78881-194f-48ab-a4bf-2516e916e6da tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:08.922472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e8d78881-194f-48ab-a4bf-2516e916e6da tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:08.923370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e8d78881-194f-48ab-a4bf-2516e916e6da tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:08.923819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e8d78881-194f-48ab-a4bf-2516e916e6da tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:08.961105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e8d78881-194f-48ab-a4bf-2516e916e6da tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:08.961776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e8d78881-194f-48ab-a4bf-2516e916e6da tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:08.962363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-e8d78881-194f-48ab-a4bf-2516e916e6da tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lazy-loading 'fault' on Instance uuid 6045585e-1ad5-4d1d-a523-e58730ef1df1 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:19:09.033230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e8d78881-194f-48ab-a4bf-2516e916e6da tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:09.033230 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e8d78881-194f-48ab-a4bf-2516e916e6da tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1" status: 200 len: 1311 microversion: 2.1 time: 0.112887 May 28 21:19:09.033230 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1968/3980] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:08 2022] GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1 => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:19:10.043136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-47710faa-a08c-4107-9d37-e330a1fc0f40 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:10.044836 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-47710faa-a08c-4107-9d37-e330a1fc0f40 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 6045585e-1ad5-4d1d-a523-e58730ef1df1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:10.048505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:10.051182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=8 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:10.064568 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-47710faa-a08c-4107-9d37-e330a1fc0f40 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:10.065147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-47710faa-a08c-4107-9d37-e330a1fc0f40 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:10.066203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-47710faa-a08c-4107-9d37-e330a1fc0f40 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:10.066739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-47710faa-a08c-4107-9d37-e330a1fc0f40 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:10.083500 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-47710faa-a08c-4107-9d37-e330a1fc0f40 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] HTTP exception thrown: Instance 6045585e-1ad5-4d1d-a523-e58730ef1df1 could not be found. May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-47710faa-a08c-4107-9d37-e330a1fc0f40 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Request method failure captured: May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1 HTTP/1.1 May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpF-Hu3FoJY0WdJLCrI3g1G6v5g2ZyR876mQEJxLIy-_vzRwvSdyMeCRHAbFBy9APCy2Ji2n1oyuXlRncCQ9Mg510diBJW24JM-A2YD-tQJx4RUjp7e8HhSZybHEs_04SZBz08TSFTaHCAxaYYI4xu6RvYzgxMQLbavJL4sL4xio6UY May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 12b9ffa69df641558691a33ba072f78d May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ListServerFiltersTestJSON-961926024 May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_12b9ffa69df641558691a33ba072f78d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12b9ffa69df641558691a33ba072f78d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/12b9ffa69df641558691a33ba072f78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12b9ffa69df641558691a33ba072f78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ListServerFiltersTestJSON-961926024 May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 12b9ffa69df641558691a33ba072f78d May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-961926024 May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ListServerFiltersTestJSON-961926024-project May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: a01fd3c4a0184b41864b9184c507a8ff May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ListServerFiltersTestJSON-961926024-project May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 6045585e-1ad5-4d1d-a523-e58730ef1df1 could not be found. May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '6045585e-1ad5-4d1d-a523-e58730ef1df1'} May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6045585e-1ad5-4d1d-a523-e58730ef1df1 could not be found. May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6045585e-1ad5-4d1d-a523-e58730ef1df1 could not be found. May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:10.088153 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:10.099415 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:10.099415 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:10.099415 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:10.099415 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:19:10.099415 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:19:10.099415 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6045585e-1ad5-4d1d-a523-e58730ef1df1 could not be found. May 28 21:19:10.099415 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:10.099415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-47710faa-a08c-4107-9d37-e330a1fc0f40 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Returning 404 to user: Instance 6045585e-1ad5-4d1d-a523-e58730ef1df1 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:19:10.099415 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-47710faa-a08c-4107-9d37-e330a1fc0f40 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1" status: 404 len: 111 microversion: 2.1 time: 0.059790 May 28 21:19:10.099415 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2013/3981] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:10 2022] GET /compute/v2.1/servers/6045585e-1ad5-4d1d-a523-e58730ef1df1 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:19:10.106793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2fc9a9af-4a0d-4b59-bdc6-6683298ea238 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:10.107901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2fc9a9af-4a0d-4b59-bdc6-6683298ea238 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:10.112945 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=10 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:10.117085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2fc9a9af-4a0d-4b59-bdc6-6683298ea238 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:10.117915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2fc9a9af-4a0d-4b59-bdc6-6683298ea238 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:10.119054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2fc9a9af-4a0d-4b59-bdc6-6683298ea238 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:10.119976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2fc9a9af-4a0d-4b59-bdc6-6683298ea238 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:10.156562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2fc9a9af-4a0d-4b59-bdc6-6683298ea238 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:19:10.518473 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2fc9a9af-4a0d-4b59-bdc6-6683298ea238 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 204 len: 0 microversion: 2.1 time: 0.415365 May 28 21:19:10.519552 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1969/3982] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:19:10 2022] DELETE /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:19:10.528541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2936a161-73cd-4f72-8f0a-4bda76d41901 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:10.529471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2936a161-73cd-4f72-8f0a-4bda76d41901 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:10.537764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2936a161-73cd-4f72-8f0a-4bda76d41901 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:10.538528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2936a161-73cd-4f72-8f0a-4bda76d41901 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:10.539333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2936a161-73cd-4f72-8f0a-4bda76d41901 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:10.539881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2936a161-73cd-4f72-8f0a-4bda76d41901 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:10.701592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2936a161-73cd-4f72-8f0a-4bda76d41901 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:10.713908 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2936a161-73cd-4f72-8f0a-4bda76d41901 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1517 microversion: 2.1 time: 0.190139 May 28 21:19:10.714774 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2014/3983] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:10 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1517 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:10.972117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-503877900", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "7131fbfe-fb0a-4f32-b410-7ba035cc97d8"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:11.046668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] validate_networks() for [('7131fbfe-fb0a-4f32-b410-7ba035cc97d8', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:19:11.686755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:19:11.690369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:19:11.690369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:19:11.690369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:19:11.690859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:19:11.705075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:11.705534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:11.706544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:11.707001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:11.728062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Getting quotas for project 2f1ab0fa428c4239ae77e49feabf77f3. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:19:11.733007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2daf1f96-07ae-4e2f-99a7-49a2d08d84e9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:11.734143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2daf1f96-07ae-4e2f-99a7-49a2d08d84e9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:11.734683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Getting quotas for user e567fd5a2683491281fab7551a485a4d and project 2f1ab0fa428c4239ae77e49feabf77f3. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:19:11.743779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2daf1f96-07ae-4e2f-99a7-49a2d08d84e9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:11.744719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2daf1f96-07ae-4e2f-99a7-49a2d08d84e9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:11.745628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2daf1f96-07ae-4e2f-99a7-49a2d08d84e9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:11.746275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2daf1f96-07ae-4e2f-99a7-49a2d08d84e9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:11.754887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:19:11.757551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:19:11.905981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2daf1f96-07ae-4e2f-99a7-49a2d08d84e9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:11.913923 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2daf1f96-07ae-4e2f-99a7-49a2d08d84e9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1517 microversion: 2.1 time: 0.186666 May 28 21:19:11.914467 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2015/3984] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:11 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1517 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:19:11.943953 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3694eae8-c538-48f4-b011-843718358565 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.238753 May 28 21:19:11.944625 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1970/3985] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:19:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 21:19:11.956502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40ceaf6e-4772-46d9-aaa8-7ea21629f07d tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:11.957400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-40ceaf6e-4772-46d9-aaa8-7ea21629f07d tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:12.042442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-40ceaf6e-4772-46d9-aaa8-7ea21629f07d tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:12.066800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-40ceaf6e-4772-46d9-aaa8-7ea21629f07d tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:12.071584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-40ceaf6e-4772-46d9-aaa8-7ea21629f07d tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:12.074817 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-40ceaf6e-4772-46d9-aaa8-7ea21629f07d tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 200 len: 1258 microversion: 2.21 time: 0.123941 May 28 21:19:12.077930 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2016/3986] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:11 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 1258 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:12.738538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-0d7b16c9-d454-475d-bfed-c519358be473 req-5031463f-999a-4772-987b-cfc8e9ce483c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8439cb6f-af4c-4657-8376-36dac061b8d1", "name": "network-vif-deleted", "tag": "309da8ad-3cc8-431e-aba9-ffe947aaf5d4"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:12.759023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:12.779793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0d7b16c9-d454-475d-bfed-c519358be473 req-5031463f-999a-4772-987b-cfc8e9ce483c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:12.780439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0d7b16c9-d454-475d-bfed-c519358be473 req-5031463f-999a-4772-987b-cfc8e9ce483c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:12.801682 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-0d7b16c9-d454-475d-bfed-c519358be473 req-5031463f-999a-4772-987b-cfc8e9ce483c service nova] Creating event network-vif-deleted:309da8ad-3cc8-431e-aba9-ffe947aaf5d4 for instance 8439cb6f-af4c-4657-8376-36dac061b8d1 on nch2-master-1 May 28 21:19:12.815614 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-0d7b16c9-d454-475d-bfed-c519358be473 req-5031463f-999a-4772-987b-cfc8e9ce483c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099488 May 28 21:19:12.817507 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1971/3987] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:19:12.950917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-486038ab-d8d3-4049-aea2-f5b1edab1eb9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:12.955163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-486038ab-d8d3-4049-aea2-f5b1edab1eb9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:12.987739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-486038ab-d8d3-4049-aea2-f5b1edab1eb9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:12.991269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-486038ab-d8d3-4049-aea2-f5b1edab1eb9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:12.995005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-486038ab-d8d3-4049-aea2-f5b1edab1eb9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:12.997916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-486038ab-d8d3-4049-aea2-f5b1edab1eb9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:13.097470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bad320f4-9643-4b0d-b7c3-e4405a816e3b tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:13.098956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bad320f4-9643-4b0d-b7c3-e4405a816e3b tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:13.212991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-486038ab-d8d3-4049-aea2-f5b1edab1eb9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01fd3c4a0184b41864b9184c507a8ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b9ffa69df641558691a33ba072f78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:13.235209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bad320f4-9643-4b0d-b7c3-e4405a816e3b tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:13.237510 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-486038ab-d8d3-4049-aea2-f5b1edab1eb9 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 200 len: 1305 microversion: 2.1 time: 0.309417 May 28 21:19:13.238606 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2017/3988] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:12 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 1305 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:13.245031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bad320f4-9643-4b0d-b7c3-e4405a816e3b tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:13.249887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bad320f4-9643-4b0d-b7c3-e4405a816e3b tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:13.254748 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bad320f4-9643-4b0d-b7c3-e4405a816e3b tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 200 len: 1258 microversion: 2.21 time: 0.160175 May 28 21:19:13.258131 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1972/3989] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:13 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:19:13.522222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3d9e87b0-9554-4e1a-8630-b12e51ec1545 tempest-ExtensionsTest-226969968 tempest-ExtensionsTest-226969968-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:13.524658 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3d9e87b0-9554-4e1a-8630-b12e51ec1545 tempest-ExtensionsTest-226969968 tempest-ExtensionsTest-226969968-project] 10.222.0.33 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.268242 May 28 21:19:13.525761 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2018/3990] 10.222.0.33 () {58 vars in 1169 bytes} [Sat May 28 21:19:13 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:19:13.534579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0e081927-fd18-4651-b6d2-336e46256410 tempest-ExtensionsTest-226969968 tempest-ExtensionsTest-226969968-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:13.537003 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0e081927-fd18-4651-b6d2-336e46256410 tempest-ExtensionsTest-226969968 tempest-ExtensionsTest-226969968-project] 10.222.0.33 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006443 May 28 21:19:13.552432 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1973/3991] 10.222.0.33 () {58 vars in 1133 bytes} [Sat May 28 21:19:13 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:19:14.256458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f8599b4a-7828-4fc0-9ab7-e8944bbd3d12 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:14.257176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f8599b4a-7828-4fc0-9ab7-e8944bbd3d12 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] [instance: 8439cb6f-af4c-4657-8376-36dac061b8d1] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:14.263948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8599b4a-7828-4fc0-9ab7-e8944bbd3d12 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:14.264314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8599b4a-7828-4fc0-9ab7-e8944bbd3d12 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:14.265091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8599b4a-7828-4fc0-9ab7-e8944bbd3d12 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:14.265538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8599b4a-7828-4fc0-9ab7-e8944bbd3d12 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:14.277337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-89ec72fa-840a-41be-9186-3f3940599c29 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:14.278592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-89ec72fa-840a-41be-9186-3f3940599c29 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:14.281202 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-f8599b4a-7828-4fc0-9ab7-e8944bbd3d12 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] HTTP exception thrown: Instance 8439cb6f-af4c-4657-8376-36dac061b8d1 could not be found. May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f8599b4a-7828-4fc0-9ab7-e8944bbd3d12 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Request method failure captured: May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 HTTP/1.1 May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpF-Hu3FoJY0WdJLCrI3g1G6v5g2ZyR876mQEJxLIy-_vzRwvSdyMeCRHAbFBy9APCy2Ji2n1oyuXlRncCQ9Mg510diBJW24JM-A2YD-tQJx4RUjp7e8HhSZybHEs_04SZBz08TSFTaHCAxaYYI4xu6RvYzgxMQLbavJL4sL4xio6UY May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 12b9ffa69df641558691a33ba072f78d May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ListServerFiltersTestJSON-961926024 May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_12b9ffa69df641558691a33ba072f78d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12b9ffa69df641558691a33ba072f78d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/12b9ffa69df641558691a33ba072f78d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/12b9ffa69df641558691a33ba072f78d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ListServerFiltersTestJSON-961926024 May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 12b9ffa69df641558691a33ba072f78d May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-961926024 May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ListServerFiltersTestJSON-961926024-project May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: a01fd3c4a0184b41864b9184c507a8ff May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ListServerFiltersTestJSON-961926024-project May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 8439cb6f-af4c-4657-8376-36dac061b8d1 could not be found. May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '8439cb6f-af4c-4657-8376-36dac061b8d1'} May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8439cb6f-af4c-4657-8376-36dac061b8d1 could not be found. May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8439cb6f-af4c-4657-8376-36dac061b8d1 could not be found. May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:14.283688 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:14.288481 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:14.288481 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:14.288481 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:14.288481 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:19:14.288481 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:19:14.288481 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8439cb6f-af4c-4657-8376-36dac061b8d1 could not be found. May 28 21:19:14.288481 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:14.288481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f8599b4a-7828-4fc0-9ab7-e8944bbd3d12 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] Returning 404 to user: Instance 8439cb6f-af4c-4657-8376-36dac061b8d1 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:19:14.288481 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f8599b4a-7828-4fc0-9ab7-e8944bbd3d12 tempest-ListServerFiltersTestJSON-961926024 tempest-ListServerFiltersTestJSON-961926024-project] 10.222.0.33 "GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1" status: 404 len: 111 microversion: 2.1 time: 0.033697 May 28 21:19:14.288481 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2019/3992] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:14 2022] GET /compute/v2.1/servers/8439cb6f-af4c-4657-8376-36dac061b8d1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:19:14.294159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89ec72fa-840a-41be-9186-3f3940599c29 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:14.294640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89ec72fa-840a-41be-9186-3f3940599c29 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:14.295503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89ec72fa-840a-41be-9186-3f3940599c29 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:14.296038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89ec72fa-840a-41be-9186-3f3940599c29 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:14.378648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89ec72fa-840a-41be-9186-3f3940599c29 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:14.385733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89ec72fa-840a-41be-9186-3f3940599c29 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:14.387916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89ec72fa-840a-41be-9186-3f3940599c29 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:14.389062 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-89ec72fa-840a-41be-9186-3f3940599c29 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 200 len: 1254 microversion: 2.21 time: 0.116938 May 28 21:19:14.389628 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1974/3993] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:14 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 1254 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:19:15.419603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c7745769-011b-47be-9979-7957a14674e6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:15.420897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c7745769-011b-47be-9979-7957a14674e6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:15.447524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7745769-011b-47be-9979-7957a14674e6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:15.447524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7745769-011b-47be-9979-7957a14674e6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:15.447524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7745769-011b-47be-9979-7957a14674e6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:15.447524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7745769-011b-47be-9979-7957a14674e6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:15.660894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c7745769-011b-47be-9979-7957a14674e6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:15.672813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c7745769-011b-47be-9979-7957a14674e6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:15.675923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c7745769-011b-47be-9979-7957a14674e6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:15.675923 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c7745769-011b-47be-9979-7957a14674e6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 200 len: 1328 microversion: 2.21 time: 0.262799 May 28 21:19:15.682369 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2020/3994] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:15 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 1328 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:16.699603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-120c225a-28e2-4a01-8743-4409d91740f6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:16.700361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-120c225a-28e2-4a01-8743-4409d91740f6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:16.708800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-120c225a-28e2-4a01-8743-4409d91740f6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:16.709274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-120c225a-28e2-4a01-8743-4409d91740f6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:16.710104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-120c225a-28e2-4a01-8743-4409d91740f6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:16.710569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-120c225a-28e2-4a01-8743-4409d91740f6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:16.996302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-120c225a-28e2-4a01-8743-4409d91740f6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:17.018638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-120c225a-28e2-4a01-8743-4409d91740f6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:17.020554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-120c225a-28e2-4a01-8743-4409d91740f6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:17.023066 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-120c225a-28e2-4a01-8743-4409d91740f6 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 200 len: 1358 microversion: 2.21 time: 0.327100 May 28 21:19:17.024184 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1975/3995] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:16 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 1358 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:17.157877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1861f453-417a-417b-951b-d2ae6002e1c4 tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Action: 'create', calling method: .version_select at 0x7f4d57780040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-190496027", "metadata": {"Type": "work"}}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1861f453-417a-417b-951b-d2ae6002e1c4 tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Request method failure captured: May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 121 May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpHUBOtvEJKkXza6vUFZHGSDGRfOrxfYaD9_ZipuNCIeyAzP792mpBp0pJ5hyviDiWs2rBn6zE4PHZAbnvqVJ4bs5j-FhrdwO2vdmKGNdPzQc5jPfPY4qGX5iuOYqIJyGoKsEPbIsmqw8pANIivaJ9t7RD5BrQhHkxY42qTLVntw0xo May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f4d533da7bb7424e9239a0fa9cac4818 May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4d533da7bb7424e9239a0fa9cac4818", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f4d533da7bb7424e9239a0fa9cac4818 May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-VolumesNegativeTest-1949743987-project May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: e0ce748086004c5d89c7c29c1655cf09 May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-VolumesNegativeTest-1949743987-project May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-190496027", "metadata": {"Type": "work"}}} May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-190496027', 'metadata': {'Type': 'work'}}}} May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['volume']: May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi '#$%' May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:19:17.162485 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:19:17.168261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 28 21:19:17.168261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.168261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:17.168261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.168261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.168261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:17.168261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:17.168261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:19:17.168261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:19:17.168261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 28 21:19:17.168261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.168261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1861f453-417a-417b-951b-d2ae6002e1c4 tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:19:17.168261 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1861f453-417a-417b-951b-d2ae6002e1c4 tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.200492 May 28 21:19:17.175224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c588014-9aa1-472c-9cd4-4cb664db7f10 tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Action: 'create', calling method: .version_select at 0x7f4d5757ea60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-911459433", "metadata": {"Type": "work"}}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c588014-9aa1-472c-9cd4-4cb664db7f10 tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Request method failure captured: May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 119 May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpHUBOtvEJKkXza6vUFZHGSDGRfOrxfYaD9_ZipuNCIeyAzP792mpBp0pJ5hyviDiWs2rBn6zE4PHZAbnvqVJ4bs5j-FhrdwO2vdmKGNdPzQc5jPfPY4qGX5iuOYqIJyGoKsEPbIsmqw8pANIivaJ9t7RD5BrQhHkxY42qTLVntw0xo May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: f4d533da7bb7424e9239a0fa9cac4818 May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4d533da7bb7424e9239a0fa9cac4818", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: f4d533da7bb7424e9239a0fa9cac4818 May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-VolumesNegativeTest-1949743987-project May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: e0ce748086004c5d89c7c29c1655cf09 May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-VolumesNegativeTest-1949743987-project May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-911459433", "metadata": {"Type": "work"}}} May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-911459433', 'metadata': {'Type': 'work'}}}} May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise error May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi On instance['volume']: May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi '0' May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:19:17.179160 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:19:17.189971 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 28 21:19:17.189971 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.189971 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:17.189971 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.189971 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.189971 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:17.189971 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:17.189971 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:19:17.189971 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:19:17.189971 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 28 21:19:17.189971 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.189971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c588014-9aa1-472c-9cd4-4cb664db7f10 tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:19:17.189971 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8c588014-9aa1-472c-9cd4-4cb664db7f10 tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011262 May 28 21:19:17.192142 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1976/3997] 10.222.0.33 () {60 vars in 1155 bytes} [Sat May 28 21:19:17 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:19:17.192298 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2021/3997] 10.222.0.33 () {60 vars in 1155 bytes} [Sat May 28 21:19:16 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 227 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 21:19:17.211629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ffdf9785-0c5a-4044-9e8a-f7314af980da tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Action: 'create', calling method: .version_select at 0x7f4d579f5ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1523903000", "metadata": {"Type": "work"}}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ffdf9785-0c5a-4044-9e8a-f7314af980da tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Request method failure captured: May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 119 May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpHUBOtvEJKkXza6vUFZHGSDGRfOrxfYaD9_ZipuNCIeyAzP792mpBp0pJ5hyviDiWs2rBn6zE4PHZAbnvqVJ4bs5j-FhrdwO2vdmKGNdPzQc5jPfPY4qGX5iuOYqIJyGoKsEPbIsmqw8pANIivaJ9t7RD5BrQhHkxY42qTLVntw0xo May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: f4d533da7bb7424e9239a0fa9cac4818 May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4d533da7bb7424e9239a0fa9cac4818", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: f4d533da7bb7424e9239a0fa9cac4818 May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-VolumesNegativeTest-1949743987-project May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: e0ce748086004c5d89c7c29c1655cf09 May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-VolumesNegativeTest-1949743987-project May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1523903000", "metadata": {"Type": "work"}}} May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1523903000', 'metadata': {'Type': 'work'}}}} May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise error May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi On instance['volume']: May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi '' May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:19:17.218668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:19:17.223706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 28 21:19:17.223706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.223706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:17.223706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.223706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.223706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:17.223706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:17.223706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:19:17.223706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:19:17.223706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 28 21:19:17.223706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.223706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ffdf9785-0c5a-4044-9e8a-f7314af980da tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:19:17.226231 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ffdf9785-0c5a-4044-9e8a-f7314af980da tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025719 May 28 21:19:17.227381 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1977/3998] 10.222.0.33 () {60 vars in 1155 bytes} [Sat May 28 21:19:17 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:19:17.243033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ea79db11-a538-48de-bf97-0504737bb94f tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Calling method '.version_select at 0x7f4d57875820>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:17.284732 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-ea79db11-a538-48de-bf97-0504737bb94f tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] HTTP exception thrown: Volume tempest-invalid-76416045 could not be found. May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ea79db11-a538-48de-bf97-0504737bb94f tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Request method failure captured: May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-76416045 HTTP/1.1 May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpHUBOtvEJKkXza6vUFZHGSDGRfOrxfYaD9_ZipuNCIeyAzP792mpBp0pJ5hyviDiWs2rBn6zE4PHZAbnvqVJ4bs5j-FhrdwO2vdmKGNdPzQc5jPfPY4qGX5iuOYqIJyGoKsEPbIsmqw8pANIivaJ9t7RD5BrQhHkxY42qTLVntw0xo May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f4d533da7bb7424e9239a0fa9cac4818 May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4d533da7bb7424e9239a0fa9cac4818", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f4d533da7bb7424e9239a0fa9cac4818 May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-VolumesNegativeTest-1949743987-project May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: e0ce748086004c5d89c7c29c1655cf09 May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-VolumesNegativeTest-1949743987-project May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: exception: Volume tempest-invalid-76416045 could not be found. May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'tempest-invalid-76416045'} May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-76416045 could not be found. (HTTP 404) (Request-ID: req-dda1d137-1683-4b00-bd20-7eb759da5dd5) May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:19:17.290982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-76416045 could not be found. May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-76416045 could not be found. May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-76416045 could not be found. May 28 21:19:17.295605 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.306852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ea79db11-a538-48de-bf97-0504737bb94f tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Returning 404 to user: Volume tempest-invalid-76416045 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:19:17.307475 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ea79db11-a538-48de-bf97-0504737bb94f tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-76416045" status: 404 len: 97 microversion: 2.1 time: 0.073921 May 28 21:19:17.314487 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2022/3999] 10.222.0.33 () {58 vars in 1211 bytes} [Sat May 28 21:19:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-76416045 => generated 97 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:19:17.320367 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e6df14eb-48db-445e-a896-017d7ed23359 tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005541 May 28 21:19:17.326072 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1978/4000] 10.222.0.33 () {58 vars in 1139 bytes} [Sat May 28 21:19:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 28 21:19:17.338915 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7775d7fd-4ec0-4692-aaad-d9228ff14417 tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010903 May 28 21:19:17.340977 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2023/4001] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:19:17 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 28 21:19:17.352185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ca72d66e-7206-45cb-adb1-edfa05341e34 tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Calling method '.version_select at 0x7f4d571c44c0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:17.392901 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-ca72d66e-7206-45cb-adb1-edfa05341e34 tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] HTTP exception thrown: Volume e080c1f3-a088-4c90-9d42-36a9855900fc could not be found. May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ca72d66e-7206-45cb-adb1-edfa05341e34 tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Request method failure captured: May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/os-volumes/e080c1f3-a088-4c90-9d42-36a9855900fc HTTP/1.1 May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpHUBOtvEJKkXza6vUFZHGSDGRfOrxfYaD9_ZipuNCIeyAzP792mpBp0pJ5hyviDiWs2rBn6zE4PHZAbnvqVJ4bs5j-FhrdwO2vdmKGNdPzQc5jPfPY4qGX5iuOYqIJyGoKsEPbIsmqw8pANIivaJ9t7RD5BrQhHkxY42qTLVntw0xo May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: f4d533da7bb7424e9239a0fa9cac4818 May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4d533da7bb7424e9239a0fa9cac4818", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: f4d533da7bb7424e9239a0fa9cac4818 May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-VolumesNegativeTest-1949743987-project May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: e0ce748086004c5d89c7c29c1655cf09 May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-VolumesNegativeTest-1949743987-project May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: exception: Volume e080c1f3-a088-4c90-9d42-36a9855900fc could not be found. May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'e080c1f3-a088-4c90-9d42-36a9855900fc'} May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e080c1f3-a088-4c90-9d42-36a9855900fc could not be found. (HTTP 404) (Request-ID: req-015b07fc-1fad-438f-9b63-7f71e29ae9c5) May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 21:19:17.395195 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e080c1f3-a088-4c90-9d42-36a9855900fc could not be found. May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e080c1f3-a088-4c90-9d42-36a9855900fc could not be found. May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e080c1f3-a088-4c90-9d42-36a9855900fc could not be found. May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ca72d66e-7206-45cb-adb1-edfa05341e34 tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Returning 404 to user: Volume e080c1f3-a088-4c90-9d42-36a9855900fc could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ca72d66e-7206-45cb-adb1-edfa05341e34 tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/e080c1f3-a088-4c90-9d42-36a9855900fc" status: 404 len: 109 microversion: 2.1 time: 0.049440 May 28 21:19:17.402768 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1979/4002] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 21:19:17 2022] DELETE /compute/v2.1/os-volumes/e080c1f3-a088-4c90-9d42-36a9855900fc => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:19:17.416080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bdb7e2e3-5557-40fc-b751-f3a692be06fa tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Calling method '.version_select at 0x7f4d57780550>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:17.473329 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-bdb7e2e3-5557-40fc-b751-f3a692be06fa tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] HTTP exception thrown: Volume 5022d7bc-3c9d-4b65-bf8b-beb9927dd8ad could not be found. May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bdb7e2e3-5557-40fc-b751-f3a692be06fa tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Request method failure captured: May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/os-volumes/5022d7bc-3c9d-4b65-bf8b-beb9927dd8ad HTTP/1.1 May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpHUBOtvEJKkXza6vUFZHGSDGRfOrxfYaD9_ZipuNCIeyAzP792mpBp0pJ5hyviDiWs2rBn6zE4PHZAbnvqVJ4bs5j-FhrdwO2vdmKGNdPzQc5jPfPY4qGX5iuOYqIJyGoKsEPbIsmqw8pANIivaJ9t7RD5BrQhHkxY42qTLVntw0xo May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f4d533da7bb7424e9239a0fa9cac4818 May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f4d533da7bb7424e9239a0fa9cac4818", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f4d533da7bb7424e9239a0fa9cac4818"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f4d533da7bb7424e9239a0fa9cac4818 May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-VolumesNegativeTest-1949743987 May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-VolumesNegativeTest-1949743987-project May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: e0ce748086004c5d89c7c29c1655cf09 May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-VolumesNegativeTest-1949743987-project May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: method: May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: exception: Volume 5022d7bc-3c9d-4b65-bf8b-beb9927dd8ad could not be found. May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '5022d7bc-3c9d-4b65-bf8b-beb9927dd8ad'} May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5022d7bc-3c9d-4b65-bf8b-beb9927dd8ad could not be found. (HTTP 404) (Request-ID: req-f47a47ee-d706-4598-8830-1bed451e0b8c) May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 21:19:17.473690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5022d7bc-3c9d-4b65-bf8b-beb9927dd8ad could not be found. May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5022d7bc-3c9d-4b65-bf8b-beb9927dd8ad could not be found. May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5022d7bc-3c9d-4b65-bf8b-beb9927dd8ad could not be found. May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bdb7e2e3-5557-40fc-b751-f3a692be06fa tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] Returning 404 to user: Volume 5022d7bc-3c9d-4b65-bf8b-beb9927dd8ad could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bdb7e2e3-5557-40fc-b751-f3a692be06fa tempest-VolumesNegativeTest-1949743987 tempest-VolumesNegativeTest-1949743987-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/5022d7bc-3c9d-4b65-bf8b-beb9927dd8ad" status: 404 len: 109 microversion: 2.1 time: 0.072344 May 28 21:19:17.478066 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2024/4003] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:19:17 2022] GET /compute/v2.1/os-volumes/5022d7bc-3c9d-4b65-bf8b-beb9927dd8ad => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:19:18.042968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-261b6086-0fcc-4300-aa31-1b423461f697 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:18.045143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-261b6086-0fcc-4300-aa31-1b423461f697 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:18.058556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-261b6086-0fcc-4300-aa31-1b423461f697 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:18.059347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-261b6086-0fcc-4300-aa31-1b423461f697 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:18.060373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-261b6086-0fcc-4300-aa31-1b423461f697 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:18.061071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-261b6086-0fcc-4300-aa31-1b423461f697 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:18.368191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-261b6086-0fcc-4300-aa31-1b423461f697 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:18.390198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-261b6086-0fcc-4300-aa31-1b423461f697 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:18.397010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-261b6086-0fcc-4300-aa31-1b423461f697 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:18.397010 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-261b6086-0fcc-4300-aa31-1b423461f697 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 200 len: 1358 microversion: 2.21 time: 0.356291 May 28 21:19:18.397010 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1980/4004] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:18 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 1358 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:18.755610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-c2f072d5-3fee-46ae-a4db-acf84c098b8f req-74f4a8a1-e9e7-4958-8160-d52f16ca2f9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23d5992e-710d-45c0-9a6b-831facf59647", "tag": "b9a756a9-5256-4caa-98fa-e912e5d9a285"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:18.766619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c2f072d5-3fee-46ae-a4db-acf84c098b8f req-74f4a8a1-e9e7-4958-8160-d52f16ca2f9a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:18.771641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c2f072d5-3fee-46ae-a4db-acf84c098b8f req-74f4a8a1-e9e7-4958-8160-d52f16ca2f9a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:18.780479 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-c2f072d5-3fee-46ae-a4db-acf84c098b8f req-74f4a8a1-e9e7-4958-8160-d52f16ca2f9a service nova] Creating event network-changed:b9a756a9-5256-4caa-98fa-e912e5d9a285 for instance 23d5992e-710d-45c0-9a6b-831facf59647 on nch2-master-1 May 28 21:19:18.786249 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-c2f072d5-3fee-46ae-a4db-acf84c098b8f req-74f4a8a1-e9e7-4958-8160-d52f16ca2f9a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036634 May 28 21:19:18.787593 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2025/4005] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:19:19.416249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-be21ac8d-33c7-4dd5-9259-96656053eb09 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:19.417334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-be21ac8d-33c7-4dd5-9259-96656053eb09 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:19.428385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-be21ac8d-33c7-4dd5-9259-96656053eb09 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:19.429641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-be21ac8d-33c7-4dd5-9259-96656053eb09 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:19.430632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-be21ac8d-33c7-4dd5-9259-96656053eb09 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:19.431076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-be21ac8d-33c7-4dd5-9259-96656053eb09 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:19.762918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-be21ac8d-33c7-4dd5-9259-96656053eb09 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:19.773882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-be21ac8d-33c7-4dd5-9259-96656053eb09 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:19.775844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-be21ac8d-33c7-4dd5-9259-96656053eb09 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:19.777109 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-be21ac8d-33c7-4dd5-9259-96656053eb09 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 200 len: 1358 microversion: 2.21 time: 0.367863 May 28 21:19:19.788499 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1981/4006] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:19 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 1358 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:20.798871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7f724b40-a307-4798-a54b-307003d59821 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:20.800238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7f724b40-a307-4798-a54b-307003d59821 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:20.807109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f724b40-a307-4798-a54b-307003d59821 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:20.807661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f724b40-a307-4798-a54b-307003d59821 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:20.808489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f724b40-a307-4798-a54b-307003d59821 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:20.809183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f724b40-a307-4798-a54b-307003d59821 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:21.105663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7f724b40-a307-4798-a54b-307003d59821 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:21.116948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7f724b40-a307-4798-a54b-307003d59821 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:21.120174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7f724b40-a307-4798-a54b-307003d59821 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:21.121048 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7f724b40-a307-4798-a54b-307003d59821 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 200 len: 1358 microversion: 2.21 time: 0.327905 May 28 21:19:21.122224 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2026/4007] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:20 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 1358 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:19:22.143069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1a3f788d-be2b-4e5d-9da1-014570e1bb7a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:22.143879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1a3f788d-be2b-4e5d-9da1-014570e1bb7a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:22.152518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:22.155206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a3f788d-be2b-4e5d-9da1-014570e1bb7a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:22.155864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a3f788d-be2b-4e5d-9da1-014570e1bb7a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:22.160514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a3f788d-be2b-4e5d-9da1-014570e1bb7a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:22.160514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a3f788d-be2b-4e5d-9da1-014570e1bb7a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:22.187633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:22.418025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1a3f788d-be2b-4e5d-9da1-014570e1bb7a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:22.427475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1a3f788d-be2b-4e5d-9da1-014570e1bb7a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:22.429042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1a3f788d-be2b-4e5d-9da1-014570e1bb7a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:22.430288 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1a3f788d-be2b-4e5d-9da1-014570e1bb7a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 200 len: 1358 microversion: 2.21 time: 0.294494 May 28 21:19:22.431045 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1982/4008] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:22 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:23.448567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2b9b4aec-6aff-4121-958b-2afaf15478dd tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:23.449207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2b9b4aec-6aff-4121-958b-2afaf15478dd tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:23.453696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:23.470811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b9b4aec-6aff-4121-958b-2afaf15478dd tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:23.471565 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b9b4aec-6aff-4121-958b-2afaf15478dd tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:23.474933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b9b4aec-6aff-4121-958b-2afaf15478dd tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:23.475519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b9b4aec-6aff-4121-958b-2afaf15478dd tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:23.857265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2b9b4aec-6aff-4121-958b-2afaf15478dd tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:23.886291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2b9b4aec-6aff-4121-958b-2afaf15478dd tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:23.887661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2b9b4aec-6aff-4121-958b-2afaf15478dd tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:23.890658 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2b9b4aec-6aff-4121-958b-2afaf15478dd tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 200 len: 1358 microversion: 2.21 time: 0.446243 May 28 21:19:23.902038 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2027/4009] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:23 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 1358 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:24.540526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-56840c26-ea98-4c08-a07a-c9929c2edd49 req-4127208f-708a-479b-98ca-e55457b12ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d5992e-710d-45c0-9a6b-831facf59647", "name": "network-vif-plugged", "status": "completed", "tag": "b9a756a9-5256-4caa-98fa-e912e5d9a285"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:24.556274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:24.559818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-56840c26-ea98-4c08-a07a-c9929c2edd49 req-4127208f-708a-479b-98ca-e55457b12ed6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:24.561597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-56840c26-ea98-4c08-a07a-c9929c2edd49 req-4127208f-708a-479b-98ca-e55457b12ed6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:24.581267 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-56840c26-ea98-4c08-a07a-c9929c2edd49 req-4127208f-708a-479b-98ca-e55457b12ed6 service nova] Creating event network-vif-plugged:b9a756a9-5256-4caa-98fa-e912e5d9a285 for instance 23d5992e-710d-45c0-9a6b-831facf59647 on nch2-master-1 May 28 21:19:24.591374 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-56840c26-ea98-4c08-a07a-c9929c2edd49 req-4127208f-708a-479b-98ca-e55457b12ed6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058236 May 28 21:19:24.592354 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1983/4010] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:19:24.925078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1f4a1d14-9d2e-4518-8a22-c6c313183655 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:24.925772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1f4a1d14-9d2e-4518-8a22-c6c313183655 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:24.936065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f4a1d14-9d2e-4518-8a22-c6c313183655 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:24.936812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f4a1d14-9d2e-4518-8a22-c6c313183655 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:24.937781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f4a1d14-9d2e-4518-8a22-c6c313183655 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:24.938980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f4a1d14-9d2e-4518-8a22-c6c313183655 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:25.253358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1f4a1d14-9d2e-4518-8a22-c6c313183655 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:25.269699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1f4a1d14-9d2e-4518-8a22-c6c313183655 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:25.276050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1f4a1d14-9d2e-4518-8a22-c6c313183655 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:25.277389 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1f4a1d14-9d2e-4518-8a22-c6c313183655 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 200 len: 1358 microversion: 2.21 time: 0.357659 May 28 21:19:25.280235 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2028/4011] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:24 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 1358 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:26.298949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0114071f-d55e-465f-8a93-7da6d5ca08fc tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:26.299828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0114071f-d55e-465f-8a93-7da6d5ca08fc tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:26.316363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0114071f-d55e-465f-8a93-7da6d5ca08fc tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:26.318478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0114071f-d55e-465f-8a93-7da6d5ca08fc tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:26.320503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0114071f-d55e-465f-8a93-7da6d5ca08fc tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:26.322405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0114071f-d55e-465f-8a93-7da6d5ca08fc tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:26.523061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0114071f-d55e-465f-8a93-7da6d5ca08fc tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:26.534876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0114071f-d55e-465f-8a93-7da6d5ca08fc tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:26.536476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0114071f-d55e-465f-8a93-7da6d5ca08fc tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:26.538036 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0114071f-d55e-465f-8a93-7da6d5ca08fc tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 200 len: 1550 microversion: 2.21 time: 0.244534 May 28 21:19:26.539124 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1984/4012] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:26 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 1550 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:26.560824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ac1ee607-6758-4368-8145-ac3519fe8eb4 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:26.562122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ac1ee607-6758-4368-8145-ac3519fe8eb4 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:26.569254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:26.571463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac1ee607-6758-4368-8145-ac3519fe8eb4 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:26.572196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac1ee607-6758-4368-8145-ac3519fe8eb4 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:26.573239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac1ee607-6758-4368-8145-ac3519fe8eb4 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:26.574912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac1ee607-6758-4368-8145-ac3519fe8eb4 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:26.604637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ac1ee607-6758-4368-8145-ac3519fe8eb4 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:19:27.175092 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ac1ee607-6758-4368-8145-ac3519fe8eb4 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "DELETE /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 204 len: 0 microversion: 2.21 time: 0.618753 May 28 21:19:27.179044 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2029/4013] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:19:26 2022] DELETE /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:19:27.184416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e3d74526-ccde-42cc-88a8-ecc07672e035 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:27.186038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e3d74526-ccde-42cc-88a8-ecc07672e035 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:27.193682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3d74526-ccde-42cc-88a8-ecc07672e035 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:27.210310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3d74526-ccde-42cc-88a8-ecc07672e035 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:27.211528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3d74526-ccde-42cc-88a8-ecc07672e035 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:27.212215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3d74526-ccde-42cc-88a8-ecc07672e035 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:27.685962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e3d74526-ccde-42cc-88a8-ecc07672e035 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:27.700518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e3d74526-ccde-42cc-88a8-ecc07672e035 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:27.704683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e3d74526-ccde-42cc-88a8-ecc07672e035 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:27.708367 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e3d74526-ccde-42cc-88a8-ecc07672e035 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 200 len: 1556 microversion: 2.21 time: 0.527955 May 28 21:19:27.708978 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1985/4014] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:27 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 1556 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:28.727817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-10ebf76f-0056-4fa8-bb73-e37a100e249a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:28.731086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-10ebf76f-0056-4fa8-bb73-e37a100e249a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:28.737007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10ebf76f-0056-4fa8-bb73-e37a100e249a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:28.742453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10ebf76f-0056-4fa8-bb73-e37a100e249a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:28.743912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10ebf76f-0056-4fa8-bb73-e37a100e249a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:28.744805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10ebf76f-0056-4fa8-bb73-e37a100e249a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:29.235686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-10ebf76f-0056-4fa8-bb73-e37a100e249a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:29.239959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:29.256298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-10ebf76f-0056-4fa8-bb73-e37a100e249a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:29.260729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-10ebf76f-0056-4fa8-bb73-e37a100e249a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:29.265101 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-10ebf76f-0056-4fa8-bb73-e37a100e249a tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 200 len: 1556 microversion: 2.21 time: 0.542103 May 28 21:19:29.267800 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2030/4015] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:28 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 1556 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:29.426275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-83a1c9f3-cece-4a5f-9608-22d3ce8b0659 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Action: 'create', calling method: .version_select at 0x7f4d69ccb1f0>, body: {"keypair": {"name": "tempest-keypair-1606278230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO4YRfePe7q5c45InWu+fLGmEPEaRsa0sCTtjqRq9OWCj2fHtSmoxe4JQXPR14XV38dxDVfzbm80EHu898HCJ4Xqdps99crBeRAa9lF905FOVMdwlx0Sr+dEA7pOrRM/vA=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:29.459296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-83a1c9f3-cece-4a5f-9608-22d3ce8b0659 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Getting quotas for project 5a8841fa441d413a92a15510a9d082c6. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:19:29.476980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-83a1c9f3-cece-4a5f-9608-22d3ce8b0659 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Getting quotas for user 857a887b6c7c41588afb2845eed6f309 and project 5a8841fa441d413a92a15510a9d082c6. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:19:29.533644 ncdv-master-1 devstack@n-api.service[143128]: ERROR oslo.messaging._drivers.impl_rabbit [None req-83a1c9f3-cece-4a5f-9608-22d3ce8b0659 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [fb1d99c3-41a8-46eb-baf5-f3f4213aebdb] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 21:19:29.709039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d680eb92-516b-46d0-b823-e3db2e96cb2e req-693a0de9-6a2b-4c6e-ab3a-5ba882482ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23d5992e-710d-45c0-9a6b-831facf59647", "name": "network-vif-deleted", "tag": "b9a756a9-5256-4caa-98fa-e912e5d9a285"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:29.719556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d680eb92-516b-46d0-b823-e3db2e96cb2e req-693a0de9-6a2b-4c6e-ab3a-5ba882482ffc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:29.720387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d680eb92-516b-46d0-b823-e3db2e96cb2e req-693a0de9-6a2b-4c6e-ab3a-5ba882482ffc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:29.743339 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d680eb92-516b-46d0-b823-e3db2e96cb2e req-693a0de9-6a2b-4c6e-ab3a-5ba882482ffc service nova] Creating event network-vif-deleted:b9a756a9-5256-4caa-98fa-e912e5d9a285 for instance 23d5992e-710d-45c0-9a6b-831facf59647 on nch2-master-1 May 28 21:19:29.754686 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d680eb92-516b-46d0-b823-e3db2e96cb2e req-693a0de9-6a2b-4c6e-ab3a-5ba882482ffc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051622 May 28 21:19:29.762268 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2031/4016] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:19:30.297791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4257146f-29f0-4d14-a908-0a748b99c7a3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:30.301347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4257146f-29f0-4d14-a908-0a748b99c7a3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:30.321167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4257146f-29f0-4d14-a908-0a748b99c7a3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:30.321647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4257146f-29f0-4d14-a908-0a748b99c7a3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:30.324766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4257146f-29f0-4d14-a908-0a748b99c7a3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:30.325230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4257146f-29f0-4d14-a908-0a748b99c7a3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:30.398089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4257146f-29f0-4d14-a908-0a748b99c7a3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:30.398798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4257146f-29f0-4d14-a908-0a748b99c7a3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:30.399362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-4257146f-29f0-4d14-a908-0a748b99c7a3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lazy-loading 'fault' on Instance uuid 23d5992e-710d-45c0-9a6b-831facf59647 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:19:30.447139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4257146f-29f0-4d14-a908-0a748b99c7a3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:30.456813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4257146f-29f0-4d14-a908-0a748b99c7a3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:30.458884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4257146f-29f0-4d14-a908-0a748b99c7a3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e567fd5a2683491281fab7551a485a4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f1ab0fa428c4239ae77e49feabf77f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:30.460227 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4257146f-29f0-4d14-a908-0a748b99c7a3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 200 len: 1348 microversion: 2.21 time: 0.177063 May 28 21:19:30.461064 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2032/4017] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:30 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 1348 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:30.542140 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [None req-83a1c9f3-cece-4a5f-9608-22d3ce8b0659 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [fb1d99c3-41a8-46eb-baf5-f3f4213aebdb] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 44222. May 28 21:19:30.694642 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-83a1c9f3-cece-4a5f-9608-22d3ce8b0659 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.673368 May 28 21:19:30.695357 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1986/4018] 10.222.0.33 () {62 vars in 1199 bytes} [Sat May 28 21:19:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1675 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 28 21:19:31.483083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-62d1fb94-f9bf-4582-964b-9f42ad004ac3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:31.483839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-62d1fb94-f9bf-4582-964b-9f42ad004ac3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:31.494827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62d1fb94-f9bf-4582-964b-9f42ad004ac3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:31.495407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62d1fb94-f9bf-4582-964b-9f42ad004ac3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:31.497650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62d1fb94-f9bf-4582-964b-9f42ad004ac3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:31.498373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62d1fb94-f9bf-4582-964b-9f42ad004ac3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:31.557061 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-62d1fb94-f9bf-4582-964b-9f42ad004ac3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] HTTP exception thrown: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-62d1fb94-f9bf-4582-964b-9f42ad004ac3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Request method failure captured: May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 HTTP/1.1 May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpHOTadhmMR5V_BoPXgWxn-tznwi256siKZV40PhoJa3Z1_L1g-eRvoBpB9_Jfz3ravFt8His5QEAjp0Q1EdTQBbVFz8cYQWDYalI97M741g2ixqbDL_uZz0xk3ij_oX0pE1TAYIG5to0HuscuNfqKhmKha-iTNQVqvKMumFDDnoxcw May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Openstack-Nova-Api-Version: 2.21 May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2f1ab0fa428c4239ae77e49feabf77f3 May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-InstanceActionsV221TestJSON-314198743 May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f1ab0fa428c4239ae77e49feabf77f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f1ab0fa428c4239ae77e49feabf77f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f1ab0fa428c4239ae77e49feabf77f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f1ab0fa428c4239ae77e49feabf77f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-InstanceActionsV221TestJSON-314198743 May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2f1ab0fa428c4239ae77e49feabf77f3 May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-314198743 May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-InstanceActionsV221TestJSON-314198743-project May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: e567fd5a2683491281fab7551a485a4d May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-InstanceActionsV221TestJSON-314198743-project May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '23d5992e-710d-45c0-9a6b-831facf59647'} May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:31.558932 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:31.564697 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:31.564697 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:31.564697 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:31.564697 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:31.564697 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:19:31.564697 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:19:31.564697 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. May 28 21:19:31.564697 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:31.571358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-62d1fb94-f9bf-4582-964b-9f42ad004ac3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Returning 404 to user: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:19:31.571358 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-62d1fb94-f9bf-4582-964b-9f42ad004ac3 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 404 len: 111 microversion: 2.21 time: 0.093489 May 28 21:19:31.572507 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2033/4019] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:31 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:19:31.577802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-29bb6bea-cd7a-46cd-8508-5185c1a3070f tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '.version_select at 0x7f4d57970dc0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:31.579535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-29bb6bea-cd7a-46cd-8508-5185c1a3070f tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:31.597556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29bb6bea-cd7a-46cd-8508-5185c1a3070f tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:31.598308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29bb6bea-cd7a-46cd-8508-5185c1a3070f tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:31.600152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29bb6bea-cd7a-46cd-8508-5185c1a3070f tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:31.604885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29bb6bea-cd7a-46cd-8508-5185c1a3070f tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:31.775883 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-29bb6bea-cd7a-46cd-8508-5185c1a3070f tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.200477 May 28 21:19:31.784898 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1987/4020] 10.222.0.33 () {60 vars in 1336 bytes} [Sat May 28 21:19:31 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647/os-instance-actions => generated 611 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 21:19:31.791482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-35620ee7-9236-447d-a619-9c6759d52fb9 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:31.792900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-35620ee7-9236-447d-a619-9c6759d52fb9 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:31.804935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35620ee7-9236-447d-a619-9c6759d52fb9 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:31.807936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35620ee7-9236-447d-a619-9c6759d52fb9 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:31.808967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35620ee7-9236-447d-a619-9c6759d52fb9 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:31.809710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35620ee7-9236-447d-a619-9c6759d52fb9 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:31.847112 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-35620ee7-9236-447d-a619-9c6759d52fb9 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] HTTP exception thrown: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-35620ee7-9236-447d-a619-9c6759d52fb9 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Request method failure captured: May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 HTTP/1.1 May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpHOTadhmMR5V_BoPXgWxn-tznwi256siKZV40PhoJa3Z1_L1g-eRvoBpB9_Jfz3ravFt8His5QEAjp0Q1EdTQBbVFz8cYQWDYalI97M741g2ixqbDL_uZz0xk3ij_oX0pE1TAYIG5to0HuscuNfqKhmKha-iTNQVqvKMumFDDnoxcw May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Openstack-Nova-Api-Version: 2.21 May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 2f1ab0fa428c4239ae77e49feabf77f3 May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-InstanceActionsV221TestJSON-314198743 May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f1ab0fa428c4239ae77e49feabf77f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f1ab0fa428c4239ae77e49feabf77f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f1ab0fa428c4239ae77e49feabf77f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f1ab0fa428c4239ae77e49feabf77f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-InstanceActionsV221TestJSON-314198743 May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 2f1ab0fa428c4239ae77e49feabf77f3 May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-314198743 May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-InstanceActionsV221TestJSON-314198743-project May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: e567fd5a2683491281fab7551a485a4d May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-InstanceActionsV221TestJSON-314198743-project May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '23d5992e-710d-45c0-9a6b-831facf59647'} May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:19:31.848741 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:19:31.853740 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. May 28 21:19:31.853740 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:31.853740 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:31.853740 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:31.853740 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:31.853740 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:31.853740 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:31.853740 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:19:31.853740 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:19:31.853740 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. May 28 21:19:31.853740 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:19:31.855824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-35620ee7-9236-447d-a619-9c6759d52fb9 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Returning 404 to user: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:19:31.857038 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-35620ee7-9236-447d-a619-9c6759d52fb9 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "DELETE /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 404 len: 111 microversion: 2.21 time: 0.073586 May 28 21:19:31.858266 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2034/4021] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:19:31 2022] DELETE /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:19:31.869985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a422845b-d358-43f8-b152-795f80551142 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:31.870732 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a422845b-d358-43f8-b152-795f80551142 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] [instance: 23d5992e-710d-45c0-9a6b-831facf59647] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:31.892962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a422845b-d358-43f8-b152-795f80551142 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:31.892962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a422845b-d358-43f8-b152-795f80551142 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:31.892962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a422845b-d358-43f8-b152-795f80551142 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:31.892962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a422845b-d358-43f8-b152-795f80551142 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:31.951673 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-a422845b-d358-43f8-b152-795f80551142 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] HTTP exception thrown: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a422845b-d358-43f8-b152-795f80551142 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Request method failure captured: May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 HTTP/1.1 May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpHOTadhmMR5V_BoPXgWxn-tznwi256siKZV40PhoJa3Z1_L1g-eRvoBpB9_Jfz3ravFt8His5QEAjp0Q1EdTQBbVFz8cYQWDYalI97M741g2ixqbDL_uZz0xk3ij_oX0pE1TAYIG5to0HuscuNfqKhmKha-iTNQVqvKMumFDDnoxcw May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Openstack-Nova-Api-Version: 2.21 May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 2f1ab0fa428c4239ae77e49feabf77f3 May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-InstanceActionsV221TestJSON-314198743 May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2f1ab0fa428c4239ae77e49feabf77f3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f1ab0fa428c4239ae77e49feabf77f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2f1ab0fa428c4239ae77e49feabf77f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2f1ab0fa428c4239ae77e49feabf77f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-InstanceActionsV221TestJSON-314198743 May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 2f1ab0fa428c4239ae77e49feabf77f3 May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-314198743 May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-InstanceActionsV221TestJSON-314198743-project May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: e567fd5a2683491281fab7551a485a4d May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-InstanceActionsV221TestJSON-314198743-project May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '23d5992e-710d-45c0-9a6b-831facf59647'} May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:31.953550 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:19:31.961214 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:31.961214 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:19:31.961214 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:19:31.961214 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:19:31.961214 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:19:31.961214 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:19:31.961214 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. May 28 21:19:31.961214 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:19:31.966115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a422845b-d358-43f8-b152-795f80551142 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] Returning 404 to user: Instance 23d5992e-710d-45c0-9a6b-831facf59647 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:19:31.967127 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a422845b-d358-43f8-b152-795f80551142 tempest-InstanceActionsV221TestJSON-314198743 tempest-InstanceActionsV221TestJSON-314198743-project] 10.222.0.33 "GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647" status: 404 len: 111 microversion: 2.21 time: 0.102984 May 28 21:19:31.967723 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1988/4022] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:31 2022] GET /compute/v2.1/servers/23d5992e-710d-45c0-9a6b-831facf59647 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:19:35.953704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2006521796", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7d9b85a9-8812-4298-8752-c53e38dbb44b"}], "security_groups": [{"name": "tempest-securitygroup--385025539"}], "key_name": "tempest-keypair-1606278230", "user_data": "}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:36.077023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] validate_networks() for [('7d9b85a9-8812-4298-8752-c53e38dbb44b', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:19:36.727347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:19:36.727347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:19:36.727347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:19:36.727347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:19:36.727347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:19:36.733594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:36.734188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:36.735170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:36.735786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:36.759366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Getting quotas for project 5a8841fa441d413a92a15510a9d082c6. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:19:36.765462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Getting quotas for user 857a887b6c7c41588afb2845eed6f309 and project 5a8841fa441d413a92a15510a9d082c6. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:19:36.784102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:19:36.786847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:19:36.998080 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-be08c049-9915-445a-a87d-d62a2821d1a1 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.048806 May 28 21:19:36.998775 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2035/4023] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:19:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 28 21:19:37.010046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8d1fa353-0595-4a33-81c0-aa23665278a9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:37.010682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8d1fa353-0595-4a33-81c0-aa23665278a9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:37.080631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8d1fa353-0595-4a33-81c0-aa23665278a9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:37.091924 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8d1fa353-0595-4a33-81c0-aa23665278a9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:37.093548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8d1fa353-0595-4a33-81c0-aa23665278a9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:37.095550 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8d1fa353-0595-4a33-81c0-aa23665278a9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1282 microversion: 2.20 time: 0.089632 May 28 21:19:37.096783 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1989/4024] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:37 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:38.114657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-436a212d-3865-4fc3-9af1-a3222a99a578 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:38.115280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-436a212d-3865-4fc3-9af1-a3222a99a578 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:38.212298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-436a212d-3865-4fc3-9af1-a3222a99a578 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:38.221541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-436a212d-3865-4fc3-9af1-a3222a99a578 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:38.223270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-436a212d-3865-4fc3-9af1-a3222a99a578 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:38.229665 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-436a212d-3865-4fc3-9af1-a3222a99a578 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1282 microversion: 2.20 time: 0.114984 May 28 21:19:38.229665 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2036/4025] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:38 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1282 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:19:39.243538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6ce0a319-0a67-4c10-a0e9-ec3adcccfa06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:39.244742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6ce0a319-0a67-4c10-a0e9-ec3adcccfa06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:39.253374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ce0a319-0a67-4c10-a0e9-ec3adcccfa06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:39.254172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ce0a319-0a67-4c10-a0e9-ec3adcccfa06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:39.254968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ce0a319-0a67-4c10-a0e9-ec3adcccfa06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:39.255644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ce0a319-0a67-4c10-a0e9-ec3adcccfa06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:39.334195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6ce0a319-0a67-4c10-a0e9-ec3adcccfa06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:39.344772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6ce0a319-0a67-4c10-a0e9-ec3adcccfa06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:39.347529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6ce0a319-0a67-4c10-a0e9-ec3adcccfa06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:39.347789 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6ce0a319-0a67-4c10-a0e9-ec3adcccfa06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1334 microversion: 2.20 time: 0.108414 May 28 21:19:39.348547 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2037/4026] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:39 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1334 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:19:39.401182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-321369834", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "9cfd6d32-31f1-487b-b926-8934ce9a5732"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:39.456348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] validate_networks() for [('9cfd6d32-31f1-487b-b926-8934ce9a5732', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:19:39.827634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:19:39.828083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:19:39.829118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:19:39.830109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:19:39.830532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:19:39.841402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:39.842102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:39.842923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:39.843365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:39.864941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Getting quotas for project e398fd1bbf124b01b5a8a155d040f21c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:19:39.872578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Getting quotas for user 7ea0fccc16364b7a92e1ee7308268c09 and project e398fd1bbf124b01b5a8a155d040f21c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:19:39.886399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Going to run 3 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:19:39.888731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: da9e5d08-1eb5-4a4d-bf6e-9634815fd157] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:19:40.311927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 4e297091-bdfd-43d2-9a3f-743d366778ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=da9e5d08-1eb5-4a4d-bf6e-9634815fd157,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:19:40.366940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-191778c7-7ae1-4bea-add2-fda37afeb95b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:40.367560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-191778c7-7ae1-4bea-add2-fda37afeb95b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:40.381398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-191778c7-7ae1-4bea-add2-fda37afeb95b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:40.383912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-191778c7-7ae1-4bea-add2-fda37afeb95b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:40.385619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-191778c7-7ae1-4bea-add2-fda37afeb95b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:40.386278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-191778c7-7ae1-4bea-add2-fda37afeb95b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:40.457613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=4e297091-bdfd-43d2-9a3f-743d366778ca,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:19:40.486761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-191778c7-7ae1-4bea-add2-fda37afeb95b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:40.504679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-191778c7-7ae1-4bea-add2-fda37afeb95b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:40.511211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-191778c7-7ae1-4bea-add2-fda37afeb95b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:40.520440 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-191778c7-7ae1-4bea-add2-fda37afeb95b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1342 microversion: 2.20 time: 0.153095 May 28 21:19:40.521792 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2038/4027] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:40 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:40.716288 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1f2a8bfd-d8e3-48a2-9152-07c111bf23da tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.497715 May 28 21:19:40.717607 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1990/4028] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:19:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:19:40.728798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eba8d835-6a95-420e-ba26-de6801defb81 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:40.733606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eba8d835-6a95-420e-ba26-de6801defb81 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:40.735216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eba8d835-6a95-420e-ba26-de6801defb81 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Searching by: {'deleted': False, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:19:40.759379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eba8d835-6a95-420e-ba26-de6801defb81 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:40.760181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eba8d835-6a95-420e-ba26-de6801defb81 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:40.761282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eba8d835-6a95-420e-ba26-de6801defb81 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:40.762013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eba8d835-6a95-420e-ba26-de6801defb81 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:40.790553 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eba8d835-6a95-420e-ba26-de6801defb81 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.066882 May 28 21:19:40.791840 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2039/4029] 10.222.0.33 () {58 vars in 1124 bytes} [Sat May 28 21:19:40 2022] GET /compute/v2.1/servers => generated 1015 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:40.803814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6c51cb7f-3482-4cdb-badd-47cf8f5f2959 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:40.805102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6c51cb7f-3482-4cdb-badd-47cf8f5f2959 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:40.879297 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6c51cb7f-3482-4cdb-badd-47cf8f5f2959 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:40.888752 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6c51cb7f-3482-4cdb-badd-47cf8f5f2959 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1222 microversion: 2.1 time: 0.089727 May 28 21:19:40.900735 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1991/4030] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:40 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:41.542152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a5a42209-b436-4151-a89f-57e834946928 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:41.543659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a5a42209-b436-4151-a89f-57e834946928 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:41.552874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5a42209-b436-4151-a89f-57e834946928 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:41.553928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5a42209-b436-4151-a89f-57e834946928 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:41.555005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5a42209-b436-4151-a89f-57e834946928 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:41.555684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5a42209-b436-4151-a89f-57e834946928 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:41.930849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8a261ae1-8312-4f60-a9a7-581f4dd3240d tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:41.934552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8a261ae1-8312-4f60-a9a7-581f4dd3240d tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:42.094064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8a261ae1-8312-4f60-a9a7-581f4dd3240d tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:42.105460 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8a261ae1-8312-4f60-a9a7-581f4dd3240d tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1222 microversion: 2.1 time: 0.197298 May 28 21:19:42.105460 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1992/4031] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:41 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1222 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:42.301201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a5a42209-b436-4151-a89f-57e834946928 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:42.317781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a5a42209-b436-4151-a89f-57e834946928 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:42.319495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a5a42209-b436-4151-a89f-57e834946928 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:42.320914 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a5a42209-b436-4151-a89f-57e834946928 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1407 microversion: 2.20 time: 0.782848 May 28 21:19:42.322044 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2040/4032] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:41 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1407 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:43.126349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-921d59b9-1c7b-4431-8038-128ef4c9b6d0 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:43.132587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-921d59b9-1c7b-4431-8038-128ef4c9b6d0 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:43.246468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-921d59b9-1c7b-4431-8038-128ef4c9b6d0 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:43.254932 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-921d59b9-1c7b-4431-8038-128ef4c9b6d0 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1222 microversion: 2.1 time: 0.138199 May 28 21:19:43.255726 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1993/4033] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:43 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1222 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:43.340013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-acd50d5c-2f19-4921-834e-c55559d90226 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:43.343765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-acd50d5c-2f19-4921-834e-c55559d90226 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:43.372692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-acd50d5c-2f19-4921-834e-c55559d90226 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:43.374657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-acd50d5c-2f19-4921-834e-c55559d90226 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:43.378828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-acd50d5c-2f19-4921-834e-c55559d90226 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:43.380815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-acd50d5c-2f19-4921-834e-c55559d90226 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:43.570502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a126df2f-2b1d-4a7e-9197-81813000007a req-f6c73c8e-0760-4c5c-a885-1feecf5c51d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6232e7b0-68db-43d6-a836-fb2f96c54658", "tag": "5f12e599-b5ae-4dcf-ac2c-9827b4ca4a75"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:43.585168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a126df2f-2b1d-4a7e-9197-81813000007a req-f6c73c8e-0760-4c5c-a885-1feecf5c51d2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:43.585632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a126df2f-2b1d-4a7e-9197-81813000007a req-f6c73c8e-0760-4c5c-a885-1feecf5c51d2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:43.618099 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a126df2f-2b1d-4a7e-9197-81813000007a req-f6c73c8e-0760-4c5c-a885-1feecf5c51d2 service nova] Creating event network-changed:5f12e599-b5ae-4dcf-ac2c-9827b4ca4a75 for instance 6232e7b0-68db-43d6-a836-fb2f96c54658 on nch2-master-1 May 28 21:19:43.629000 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a126df2f-2b1d-4a7e-9197-81813000007a req-f6c73c8e-0760-4c5c-a885-1feecf5c51d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063205 May 28 21:19:43.630831 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1994/4034] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:19:43.801797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-acd50d5c-2f19-4921-834e-c55559d90226 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:43.838246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-acd50d5c-2f19-4921-834e-c55559d90226 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:43.845115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-acd50d5c-2f19-4921-834e-c55559d90226 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:43.847304 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-acd50d5c-2f19-4921-834e-c55559d90226 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1407 microversion: 2.20 time: 0.512084 May 28 21:19:43.849445 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2041/4035] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:43 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1407 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:44.274407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-61d1c4b5-4da7-429b-8a97-8d07ad3ea3c3 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:44.276869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-61d1c4b5-4da7-429b-8a97-8d07ad3ea3c3 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:44.450954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-61d1c4b5-4da7-429b-8a97-8d07ad3ea3c3 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:44.462614 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-61d1c4b5-4da7-429b-8a97-8d07ad3ea3c3 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1222 microversion: 2.1 time: 0.193964 May 28 21:19:44.465225 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1995/4036] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:44 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1222 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:44.869362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1a058e3f-f315-4cc2-9886-b6d7bbffad8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:44.870519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1a058e3f-f315-4cc2-9886-b6d7bbffad8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:44.887770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a058e3f-f315-4cc2-9886-b6d7bbffad8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:44.888240 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a058e3f-f315-4cc2-9886-b6d7bbffad8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:44.889046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a058e3f-f315-4cc2-9886-b6d7bbffad8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:44.889501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a058e3f-f315-4cc2-9886-b6d7bbffad8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:45.132161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1a058e3f-f315-4cc2-9886-b6d7bbffad8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:45.146725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1a058e3f-f315-4cc2-9886-b6d7bbffad8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:45.154896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1a058e3f-f315-4cc2-9886-b6d7bbffad8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:45.157429 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1a058e3f-f315-4cc2-9886-b6d7bbffad8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1407 microversion: 2.20 time: 0.292539 May 28 21:19:45.158135 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2042/4037] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:44 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:45.482965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d0952361-3ad9-4f94-9eab-71c2095a0449 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:45.483670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d0952361-3ad9-4f94-9eab-71c2095a0449 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:45.494310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0952361-3ad9-4f94-9eab-71c2095a0449 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:45.495790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0952361-3ad9-4f94-9eab-71c2095a0449 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:45.503124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0952361-3ad9-4f94-9eab-71c2095a0449 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:45.505309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0952361-3ad9-4f94-9eab-71c2095a0449 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:45.620883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d0952361-3ad9-4f94-9eab-71c2095a0449 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:45.630206 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d0952361-3ad9-4f94-9eab-71c2095a0449 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1218 microversion: 2.1 time: 0.151917 May 28 21:19:45.630797 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1996/4038] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:45 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:46.176873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9b7cbe35-934a-481a-affc-68bf24a31eb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:46.178272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9b7cbe35-934a-481a-affc-68bf24a31eb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:46.196299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b7cbe35-934a-481a-affc-68bf24a31eb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:46.198806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b7cbe35-934a-481a-affc-68bf24a31eb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:46.198806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b7cbe35-934a-481a-affc-68bf24a31eb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:46.199544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b7cbe35-934a-481a-affc-68bf24a31eb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:46.649073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c86d670d-fef9-4169-97e1-6168070c1ba9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:46.649695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c86d670d-fef9-4169-97e1-6168070c1ba9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:46.667666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c86d670d-fef9-4169-97e1-6168070c1ba9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:46.668043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c86d670d-fef9-4169-97e1-6168070c1ba9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:46.669032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c86d670d-fef9-4169-97e1-6168070c1ba9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:46.669540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c86d670d-fef9-4169-97e1-6168070c1ba9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:46.900471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9b7cbe35-934a-481a-affc-68bf24a31eb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:46.915439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9b7cbe35-934a-481a-affc-68bf24a31eb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:46.922881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9b7cbe35-934a-481a-affc-68bf24a31eb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:46.933391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c86d670d-fef9-4169-97e1-6168070c1ba9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:46.939986 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9b7cbe35-934a-481a-affc-68bf24a31eb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1407 microversion: 2.20 time: 0.767901 May 28 21:19:46.959558 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2043/4039] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:46 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1407 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:46.970465 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c86d670d-fef9-4169-97e1-6168070c1ba9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1282 microversion: 2.1 time: 0.316598 May 28 21:19:46.973402 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1997/4040] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:46 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1282 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:19:47.988204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d9e8375d-eff8-437d-9308-a2a9d36e1902 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:47.988845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d9e8375d-eff8-437d-9308-a2a9d36e1902 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:47.989572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ebcb1c57-0d48-44ff-8632-e291a5e1eacd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:47.990581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ebcb1c57-0d48-44ff-8632-e291a5e1eacd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:48.006685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9e8375d-eff8-437d-9308-a2a9d36e1902 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:48.009116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9e8375d-eff8-437d-9308-a2a9d36e1902 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:48.009462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ebcb1c57-0d48-44ff-8632-e291a5e1eacd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:48.010719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ebcb1c57-0d48-44ff-8632-e291a5e1eacd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:48.011605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9e8375d-eff8-437d-9308-a2a9d36e1902 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:48.013027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ebcb1c57-0d48-44ff-8632-e291a5e1eacd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:48.013476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ebcb1c57-0d48-44ff-8632-e291a5e1eacd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:48.015071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9e8375d-eff8-437d-9308-a2a9d36e1902 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:48.161072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d9e8375d-eff8-437d-9308-a2a9d36e1902 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:48.180193 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d9e8375d-eff8-437d-9308-a2a9d36e1902 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1280 microversion: 2.1 time: 0.203767 May 28 21:19:48.188405 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1998/4041] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:47 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:48.216763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=8 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:48.243484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ebcb1c57-0d48-44ff-8632-e291a5e1eacd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:48.255333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ebcb1c57-0d48-44ff-8632-e291a5e1eacd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:48.257387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ebcb1c57-0d48-44ff-8632-e291a5e1eacd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:48.258978 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ebcb1c57-0d48-44ff-8632-e291a5e1eacd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1407 microversion: 2.20 time: 0.283594 May 28 21:19:48.270786 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2044/4042] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:47 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:48.601985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-54a4cec6-0696-4df2-9f43-03bedc33a2a5 req-f560ac1c-2096-482e-8b57-3d08bbbcb13e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6232e7b0-68db-43d6-a836-fb2f96c54658", "name": "network-vif-plugged", "status": "completed", "tag": "5f12e599-b5ae-4dcf-ac2c-9827b4ca4a75"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:48.612304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=10 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:48.628680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-54a4cec6-0696-4df2-9f43-03bedc33a2a5 req-f560ac1c-2096-482e-8b57-3d08bbbcb13e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:48.628680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-54a4cec6-0696-4df2-9f43-03bedc33a2a5 req-f560ac1c-2096-482e-8b57-3d08bbbcb13e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:48.646828 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-54a4cec6-0696-4df2-9f43-03bedc33a2a5 req-f560ac1c-2096-482e-8b57-3d08bbbcb13e service nova] Creating event network-vif-plugged:5f12e599-b5ae-4dcf-ac2c-9827b4ca4a75 for instance 6232e7b0-68db-43d6-a836-fb2f96c54658 on nch2-master-1 May 28 21:19:48.660900 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-54a4cec6-0696-4df2-9f43-03bedc33a2a5 req-f560ac1c-2096-482e-8b57-3d08bbbcb13e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062609 May 28 21:19:48.662350 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 1999/4043] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:19:49.207011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3b727225-562c-4763-a8f6-c7a83266c2f1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:49.214426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3b727225-562c-4763-a8f6-c7a83266c2f1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:49.221318 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b727225-562c-4763-a8f6-c7a83266c2f1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:49.222921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b727225-562c-4763-a8f6-c7a83266c2f1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:49.226976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b727225-562c-4763-a8f6-c7a83266c2f1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:49.227653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b727225-562c-4763-a8f6-c7a83266c2f1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:49.280338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d111805b-e5f8-4646-b32b-3835d9eaecd5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:49.281225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d111805b-e5f8-4646-b32b-3835d9eaecd5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:49.303852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d111805b-e5f8-4646-b32b-3835d9eaecd5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:49.309794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d111805b-e5f8-4646-b32b-3835d9eaecd5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:49.311789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d111805b-e5f8-4646-b32b-3835d9eaecd5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:49.314813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d111805b-e5f8-4646-b32b-3835d9eaecd5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:49.733509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3b727225-562c-4763-a8f6-c7a83266c2f1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:49.747042 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3b727225-562c-4763-a8f6-c7a83266c2f1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1322 microversion: 2.1 time: 0.546267 May 28 21:19:49.748561 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2045/4044] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:49 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1322 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:49.852848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:50.258250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d111805b-e5f8-4646-b32b-3835d9eaecd5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:50.270843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d111805b-e5f8-4646-b32b-3835d9eaecd5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:50.274005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d111805b-e5f8-4646-b32b-3835d9eaecd5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:50.274005 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d111805b-e5f8-4646-b32b-3835d9eaecd5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1407 microversion: 2.20 time: 0.999585 May 28 21:19:50.284652 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2000/4045] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:49 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1407 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:19:50.360428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d0121778-fbeb-4391-bb85-f08135a22460 req-6bcbde8e-2e9b-4b04-b01c-8406021112bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da9e5d08-1eb5-4a4d-bf6e-9634815fd157", "tag": "2582d44b-dcff-44b6-97ea-c76d3d3f0d82"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:50.375979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d0121778-fbeb-4391-bb85-f08135a22460 req-6bcbde8e-2e9b-4b04-b01c-8406021112bf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:50.376851 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d0121778-fbeb-4391-bb85-f08135a22460 req-6bcbde8e-2e9b-4b04-b01c-8406021112bf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:50.391693 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d0121778-fbeb-4391-bb85-f08135a22460 req-6bcbde8e-2e9b-4b04-b01c-8406021112bf service nova] Creating event network-changed:2582d44b-dcff-44b6-97ea-c76d3d3f0d82 for instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 on nch1-master-1 May 28 21:19:50.397024 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d0121778-fbeb-4391-bb85-f08135a22460 req-6bcbde8e-2e9b-4b04-b01c-8406021112bf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040381 May 28 21:19:50.397649 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2046/4046] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:19:50.766323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-22dd68dc-8f92-4902-831d-67fd08342f7a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:50.767245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-22dd68dc-8f92-4902-831d-67fd08342f7a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:50.776841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22dd68dc-8f92-4902-831d-67fd08342f7a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:50.777998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22dd68dc-8f92-4902-831d-67fd08342f7a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:50.779015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22dd68dc-8f92-4902-831d-67fd08342f7a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:50.779690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22dd68dc-8f92-4902-831d-67fd08342f7a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:51.067190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-22dd68dc-8f92-4902-831d-67fd08342f7a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:51.089205 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-22dd68dc-8f92-4902-831d-67fd08342f7a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1322 microversion: 2.1 time: 0.327642 May 28 21:19:51.090380 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2001/4047] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:50 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:51.208212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:51.229293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-0f6c2507-bacc-49de-b8b7-c488e29b5774 req-04d81b7e-a0fe-499d-a101-58bd51d1a551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e277bdf-0c4c-4857-b20e-8a444684b8d2", "tag": "2287f112-60a3-4149-ad90-544ff0f8ab69"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:51.272512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0f6c2507-bacc-49de-b8b7-c488e29b5774 req-04d81b7e-a0fe-499d-a101-58bd51d1a551 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:51.273083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0f6c2507-bacc-49de-b8b7-c488e29b5774 req-04d81b7e-a0fe-499d-a101-58bd51d1a551 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:51.295336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f0d56195-6795-4a53-aee8-35d43be34171 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:51.295336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f0d56195-6795-4a53-aee8-35d43be34171 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:51.305563 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-0f6c2507-bacc-49de-b8b7-c488e29b5774 req-04d81b7e-a0fe-499d-a101-58bd51d1a551 service nova] Creating event network-changed:2287f112-60a3-4149-ad90-544ff0f8ab69 for instance 7e277bdf-0c4c-4857-b20e-8a444684b8d2 on nch1-master-1 May 28 21:19:51.308950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0d56195-6795-4a53-aee8-35d43be34171 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:51.309343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0d56195-6795-4a53-aee8-35d43be34171 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:51.311437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0d56195-6795-4a53-aee8-35d43be34171 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:51.311952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0d56195-6795-4a53-aee8-35d43be34171 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:51.313397 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-0f6c2507-bacc-49de-b8b7-c488e29b5774 req-04d81b7e-a0fe-499d-a101-58bd51d1a551 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106260 May 28 21:19:51.315214 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2047/4048] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:19:51.718872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f0d56195-6795-4a53-aee8-35d43be34171 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:51.727217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f0d56195-6795-4a53-aee8-35d43be34171 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:51.728762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f0d56195-6795-4a53-aee8-35d43be34171 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:51.730309 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f0d56195-6795-4a53-aee8-35d43be34171 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1598 microversion: 2.20 time: 0.441828 May 28 21:19:51.730885 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2002/4049] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:19:51 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1598 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:19:51.750886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9cfd0ea6-c20e-4be2-9023-19fd3ad52b7e tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:51.751599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9cfd0ea6-c20e-4be2-9023-19fd3ad52b7e tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:51.758155 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9cfd0ea6-c20e-4be2-9023-19fd3ad52b7e tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:51.758809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9cfd0ea6-c20e-4be2-9023-19fd3ad52b7e tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:51.763780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9cfd0ea6-c20e-4be2-9023-19fd3ad52b7e tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:51.763780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9cfd0ea6-c20e-4be2-9023-19fd3ad52b7e tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:51.887834 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9cfd0ea6-c20e-4be2-9023-19fd3ad52b7e tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.142829 May 28 21:19:51.890431 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2048/4050] 10.222.0.33 () {60 vars in 1315 bytes} [Sat May 28 21:19:51 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:19:52.107314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-64a4739f-8929-4c8f-83a3-8c72d770a647 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:52.108306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-64a4739f-8929-4c8f-83a3-8c72d770a647 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:52.119001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64a4739f-8929-4c8f-83a3-8c72d770a647 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:52.119464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64a4739f-8929-4c8f-83a3-8c72d770a647 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:52.121711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64a4739f-8929-4c8f-83a3-8c72d770a647 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:52.121711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64a4739f-8929-4c8f-83a3-8c72d770a647 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:52.361060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-64a4739f-8929-4c8f-83a3-8c72d770a647 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:52.370113 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-64a4739f-8929-4c8f-83a3-8c72d770a647 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1322 microversion: 2.1 time: 0.267470 May 28 21:19:52.379815 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2003/4051] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:52 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:53.349941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-f4721887-53fe-4fa6-8b35-b1597e2eb354 req-85f9e4cb-8bfe-499e-bb61-7e7cfcd18fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e297091-bdfd-43d2-9a3f-743d366778ca", "tag": "a9f5eb7a-5cd8-4d74-971a-8c93fc6950b0"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:53.364112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f4721887-53fe-4fa6-8b35-b1597e2eb354 req-85f9e4cb-8bfe-499e-bb61-7e7cfcd18fe6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:53.364844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f4721887-53fe-4fa6-8b35-b1597e2eb354 req-85f9e4cb-8bfe-499e-bb61-7e7cfcd18fe6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:53.387726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ba722594-ab9d-44ad-bf7a-2ed6bb88dc95 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:53.388708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ba722594-ab9d-44ad-bf7a-2ed6bb88dc95 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:53.395272 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-f4721887-53fe-4fa6-8b35-b1597e2eb354 req-85f9e4cb-8bfe-499e-bb61-7e7cfcd18fe6 service nova] Creating event network-changed:a9f5eb7a-5cd8-4d74-971a-8c93fc6950b0 for instance 4e297091-bdfd-43d2-9a3f-743d366778ca on nch2-master-1 May 28 21:19:53.401917 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba722594-ab9d-44ad-bf7a-2ed6bb88dc95 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:53.404778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba722594-ab9d-44ad-bf7a-2ed6bb88dc95 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:53.409462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba722594-ab9d-44ad-bf7a-2ed6bb88dc95 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:53.409462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba722594-ab9d-44ad-bf7a-2ed6bb88dc95 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:53.410709 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-f4721887-53fe-4fa6-8b35-b1597e2eb354 req-85f9e4cb-8bfe-499e-bb61-7e7cfcd18fe6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062392 May 28 21:19:53.411361 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2049/4052] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:19:53.523414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-8f57f976-97ad-4116-b923-46927e494f50 req-4856d881-736d-4049-964d-396619303278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6232e7b0-68db-43d6-a836-fb2f96c54658", "tag": "5f12e599-b5ae-4dcf-ac2c-9827b4ca4a75"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:53.548232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8f57f976-97ad-4116-b923-46927e494f50 req-4856d881-736d-4049-964d-396619303278 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:53.548881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8f57f976-97ad-4116-b923-46927e494f50 req-4856d881-736d-4049-964d-396619303278 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:53.587493 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-8f57f976-97ad-4116-b923-46927e494f50 req-4856d881-736d-4049-964d-396619303278 service nova] Creating event network-changed:5f12e599-b5ae-4dcf-ac2c-9827b4ca4a75 for instance 6232e7b0-68db-43d6-a836-fb2f96c54658 on nch2-master-1 May 28 21:19:53.602802 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-8f57f976-97ad-4116-b923-46927e494f50 req-4856d881-736d-4049-964d-396619303278 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083291 May 28 21:19:53.603601 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2050/4053] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:19:53.705800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ba722594-ab9d-44ad-bf7a-2ed6bb88dc95 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:53.716616 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ba722594-ab9d-44ad-bf7a-2ed6bb88dc95 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1322 microversion: 2.1 time: 0.333308 May 28 21:19:53.717943 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2004/4054] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:53 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:54.742939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-167e484c-5fa7-4c17-8c41-d25134ff736b tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:54.744542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-167e484c-5fa7-4c17-8c41-d25134ff736b tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:54.755897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-167e484c-5fa7-4c17-8c41-d25134ff736b tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:54.756235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-167e484c-5fa7-4c17-8c41-d25134ff736b tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:54.757595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-167e484c-5fa7-4c17-8c41-d25134ff736b tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:54.758278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-167e484c-5fa7-4c17-8c41-d25134ff736b tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:54.958493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-167e484c-5fa7-4c17-8c41-d25134ff736b tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:54.970260 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-167e484c-5fa7-4c17-8c41-d25134ff736b tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1322 microversion: 2.1 time: 0.231445 May 28 21:19:54.971857 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2051/4055] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:54 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:55.988911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-01d5d978-0150-438d-b419-84168f8a2c72 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:55.989589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-01d5d978-0150-438d-b419-84168f8a2c72 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:55.992262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=20 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:55.997164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01d5d978-0150-438d-b419-84168f8a2c72 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:55.997617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01d5d978-0150-438d-b419-84168f8a2c72 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:55.998526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01d5d978-0150-438d-b419-84168f8a2c72 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:55.998970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01d5d978-0150-438d-b419-84168f8a2c72 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:56.171319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-01d5d978-0150-438d-b419-84168f8a2c72 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:56.180747 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-01d5d978-0150-438d-b419-84168f8a2c72 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1322 microversion: 2.1 time: 0.195666 May 28 21:19:56.192745 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2005/4056] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:55 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:56.499133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-99a6dda9-cad7-4a29-855b-5f283a7a697a req-16819466-608e-4203-96cd-748ca4039f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e297091-bdfd-43d2-9a3f-743d366778ca", "name": "network-vif-plugged", "status": "completed", "tag": "a9f5eb7a-5cd8-4d74-971a-8c93fc6950b0"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:56.512909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-99a6dda9-cad7-4a29-855b-5f283a7a697a req-16819466-608e-4203-96cd-748ca4039f9f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:56.518479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-99a6dda9-cad7-4a29-855b-5f283a7a697a req-16819466-608e-4203-96cd-748ca4039f9f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:56.529093 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-99a6dda9-cad7-4a29-855b-5f283a7a697a req-16819466-608e-4203-96cd-748ca4039f9f service nova] Creating event network-vif-plugged:a9f5eb7a-5cd8-4d74-971a-8c93fc6950b0 for instance 4e297091-bdfd-43d2-9a3f-743d366778ca on nch2-master-1 May 28 21:19:56.534259 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-99a6dda9-cad7-4a29-855b-5f283a7a697a req-16819466-608e-4203-96cd-748ca4039f9f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039117 May 28 21:19:56.534879 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2052/4057] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:19:57.212734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-990c89bf-06ae-45f0-a60b-3d2b3d137164 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:57.214130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-990c89bf-06ae-45f0-a60b-3d2b3d137164 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:57.229692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-990c89bf-06ae-45f0-a60b-3d2b3d137164 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:57.230722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-990c89bf-06ae-45f0-a60b-3d2b3d137164 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:57.231695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-990c89bf-06ae-45f0-a60b-3d2b3d137164 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:57.238445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-990c89bf-06ae-45f0-a60b-3d2b3d137164 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:57.466809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-990c89bf-06ae-45f0-a60b-3d2b3d137164 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:57.476953 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-990c89bf-06ae-45f0-a60b-3d2b3d137164 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1322 microversion: 2.1 time: 0.270716 May 28 21:19:57.483596 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2006/4058] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:57 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:58.496691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b44ef40f-0f99-42b6-8670-d2ea6f0a4a90 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:58.497414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b44ef40f-0f99-42b6-8670-d2ea6f0a4a90 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:58.514195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b44ef40f-0f99-42b6-8670-d2ea6f0a4a90 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:58.514666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b44ef40f-0f99-42b6-8670-d2ea6f0a4a90 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:58.515473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b44ef40f-0f99-42b6-8670-d2ea6f0a4a90 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:58.515924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b44ef40f-0f99-42b6-8670-d2ea6f0a4a90 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:58.564754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-151ab6dc-cfa7-4649-9bef-f4f5bcd19ef2 req-a1247c50-a797-44ab-baf0-85898b686184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9e5d08-1eb5-4a4d-bf6e-9634815fd157", "name": "network-vif-plugged", "status": "completed", "tag": "2582d44b-dcff-44b6-97ea-c76d3d3f0d82"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:19:58.581160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-151ab6dc-cfa7-4649-9bef-f4f5bcd19ef2 req-a1247c50-a797-44ab-baf0-85898b686184 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:58.581654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-151ab6dc-cfa7-4649-9bef-f4f5bcd19ef2 req-a1247c50-a797-44ab-baf0-85898b686184 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:58.586059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=91 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:19:58.595626 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-151ab6dc-cfa7-4649-9bef-f4f5bcd19ef2 req-a1247c50-a797-44ab-baf0-85898b686184 service nova] Creating event network-vif-plugged:2582d44b-dcff-44b6-97ea-c76d3d3f0d82 for instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 on nch1-master-1 May 28 21:19:58.601421 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-151ab6dc-cfa7-4649-9bef-f4f5bcd19ef2 req-a1247c50-a797-44ab-baf0-85898b686184 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040775 May 28 21:19:58.602905 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2007/4059] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:19:58.683646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b44ef40f-0f99-42b6-8670-d2ea6f0a4a90 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:19:58.692016 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b44ef40f-0f99-42b6-8670-d2ea6f0a4a90 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1322 microversion: 2.1 time: 0.200856 May 28 21:19:58.692917 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2053/4060] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:58 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:19:59.716020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4d777116-f62e-456f-b679-8fcab6d216d3 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:19:59.716731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4d777116-f62e-456f-b679-8fcab6d216d3 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:19:59.731445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d777116-f62e-456f-b679-8fcab6d216d3 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:59.734009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d777116-f62e-456f-b679-8fcab6d216d3 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:19:59.734009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d777116-f62e-456f-b679-8fcab6d216d3 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:19:59.734009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d777116-f62e-456f-b679-8fcab6d216d3 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:00.018931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4d777116-f62e-456f-b679-8fcab6d216d3 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:00.028274 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4d777116-f62e-456f-b679-8fcab6d216d3 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1322 microversion: 2.1 time: 0.318544 May 28 21:20:00.028972 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2008/4061] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:19:59 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:00.629438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-59904fec-70a9-4bf7-9736-faf1ad053ae2 req-41d1434a-5db1-4d3e-97bc-075b2c920656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e277bdf-0c4c-4857-b20e-8a444684b8d2", "name": "network-vif-plugged", "status": "completed", "tag": "2287f112-60a3-4149-ad90-544ff0f8ab69"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:00.637881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:20:00.645011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-59904fec-70a9-4bf7-9736-faf1ad053ae2 req-41d1434a-5db1-4d3e-97bc-075b2c920656 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:00.645736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-59904fec-70a9-4bf7-9736-faf1ad053ae2 req-41d1434a-5db1-4d3e-97bc-075b2c920656 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:00.658955 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-59904fec-70a9-4bf7-9736-faf1ad053ae2 req-41d1434a-5db1-4d3e-97bc-075b2c920656 service nova] Creating event network-vif-plugged:2287f112-60a3-4149-ad90-544ff0f8ab69 for instance 7e277bdf-0c4c-4857-b20e-8a444684b8d2 on nch1-master-1 May 28 21:20:00.665172 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-59904fec-70a9-4bf7-9736-faf1ad053ae2 req-41d1434a-5db1-4d3e-97bc-075b2c920656 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045873 May 28 21:20:00.676210 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2054/4062] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:20:01.059618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-13ca8a12-23c4-484c-9ad2-00fae8e8e9d1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:01.066655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-13ca8a12-23c4-484c-9ad2-00fae8e8e9d1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:01.080236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13ca8a12-23c4-484c-9ad2-00fae8e8e9d1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:01.083188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13ca8a12-23c4-484c-9ad2-00fae8e8e9d1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:01.084269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13ca8a12-23c4-484c-9ad2-00fae8e8e9d1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:01.084973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13ca8a12-23c4-484c-9ad2-00fae8e8e9d1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:01.371675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-13ca8a12-23c4-484c-9ad2-00fae8e8e9d1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:01.380717 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-13ca8a12-23c4-484c-9ad2-00fae8e8e9d1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1322 microversion: 2.1 time: 0.338801 May 28 21:20:01.390189 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2009/4063] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:01 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:02.398211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8d7eb9e8-39d2-4f86-8afc-25902bcb1996 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:02.398947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8d7eb9e8-39d2-4f86-8afc-25902bcb1996 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:02.406984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d7eb9e8-39d2-4f86-8afc-25902bcb1996 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:02.407440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d7eb9e8-39d2-4f86-8afc-25902bcb1996 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:02.408295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d7eb9e8-39d2-4f86-8afc-25902bcb1996 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:02.408738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d7eb9e8-39d2-4f86-8afc-25902bcb1996 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:02.598432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8d7eb9e8-39d2-4f86-8afc-25902bcb1996 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:02.601182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:20:02.611310 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8d7eb9e8-39d2-4f86-8afc-25902bcb1996 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 200 len: 1515 microversion: 2.1 time: 0.217687 May 28 21:20:02.612016 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2055/4064] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:02 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 1515 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:20:02.628351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-99c5f05c-a130-43a5-b107-a428c432a320 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:02.628970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-99c5f05c-a130-43a5-b107-a428c432a320 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 4e297091-bdfd-43d2-9a3f-743d366778ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:02.636275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99c5f05c-a130-43a5-b107-a428c432a320 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:02.636744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99c5f05c-a130-43a5-b107-a428c432a320 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:02.637697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99c5f05c-a130-43a5-b107-a428c432a320 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:02.638333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99c5f05c-a130-43a5-b107-a428c432a320 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:02.791287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-99c5f05c-a130-43a5-b107-a428c432a320 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:02.800512 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-99c5f05c-a130-43a5-b107-a428c432a320 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/4e297091-bdfd-43d2-9a3f-743d366778ca" status: 200 len: 1514 microversion: 2.1 time: 0.176487 May 28 21:20:02.801109 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2010/4065] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:02 2022] GET /compute/v2.1/servers/4e297091-bdfd-43d2-9a3f-743d366778ca => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:20:02.817824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-170f28f6-e148-46b7-a088-2c542a12df16 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:02.818488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-170f28f6-e148-46b7-a088-2c542a12df16 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: da9e5d08-1eb5-4a4d-bf6e-9634815fd157] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:02.825871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-170f28f6-e148-46b7-a088-2c542a12df16 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:02.826370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-170f28f6-e148-46b7-a088-2c542a12df16 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:02.827476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-170f28f6-e148-46b7-a088-2c542a12df16 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:02.828153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-170f28f6-e148-46b7-a088-2c542a12df16 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:03.099411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-170f28f6-e148-46b7-a088-2c542a12df16 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:03.109370 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-170f28f6-e148-46b7-a088-2c542a12df16 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157" status: 200 len: 1515 microversion: 2.1 time: 0.296055 May 28 21:20:03.110635 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2056/4066] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:02 2022] GET /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157 => generated 1515 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:03.125934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bb61c8d0-6d4c-4c9f-ab1b-c7ff85818a29 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:03.126687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bb61c8d0-6d4c-4c9f-ab1b-c7ff85818a29 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: da9e5d08-1eb5-4a4d-bf6e-9634815fd157] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:03.133754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb61c8d0-6d4c-4c9f-ab1b-c7ff85818a29 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:03.134149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb61c8d0-6d4c-4c9f-ab1b-c7ff85818a29 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:03.134930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb61c8d0-6d4c-4c9f-ab1b-c7ff85818a29 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:03.135373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb61c8d0-6d4c-4c9f-ab1b-c7ff85818a29 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:03.162920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bb61c8d0-6d4c-4c9f-ab1b-c7ff85818a29 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: da9e5d08-1eb5-4a4d-bf6e-9634815fd157] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:20:03.629956 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bb61c8d0-6d4c-4c9f-ab1b-c7ff85818a29 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "DELETE /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157" status: 204 len: 0 microversion: 2.1 time: 0.507615 May 28 21:20:03.631189 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2011/4067] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:20:03 2022] DELETE /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:20:03.638936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-77dc8d47-dcf1-41b7-b2cb-01a6696a5f42 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:03.640123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-77dc8d47-dcf1-41b7-b2cb-01a6696a5f42 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: da9e5d08-1eb5-4a4d-bf6e-9634815fd157] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:03.647791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77dc8d47-dcf1-41b7-b2cb-01a6696a5f42 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:03.648272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77dc8d47-dcf1-41b7-b2cb-01a6696a5f42 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:03.649045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77dc8d47-dcf1-41b7-b2cb-01a6696a5f42 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:03.650292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77dc8d47-dcf1-41b7-b2cb-01a6696a5f42 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:04.216932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-77dc8d47-dcf1-41b7-b2cb-01a6696a5f42 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:04.225175 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-77dc8d47-dcf1-41b7-b2cb-01a6696a5f42 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157" status: 200 len: 1521 microversion: 2.1 time: 0.590374 May 28 21:20:04.225753 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2057/4068] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:03 2022] GET /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157 => generated 1521 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:05.243759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cb55a692-6548-4f76-89b3-bd53fd1acadf tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:05.244484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cb55a692-6548-4f76-89b3-bd53fd1acadf tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: da9e5d08-1eb5-4a4d-bf6e-9634815fd157] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:05.252667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb55a692-6548-4f76-89b3-bd53fd1acadf tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:05.253131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb55a692-6548-4f76-89b3-bd53fd1acadf tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:05.253976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb55a692-6548-4f76-89b3-bd53fd1acadf tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:05.254433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb55a692-6548-4f76-89b3-bd53fd1acadf tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:05.497982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cb55a692-6548-4f76-89b3-bd53fd1acadf tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:05.506648 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cb55a692-6548-4f76-89b3-bd53fd1acadf tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157" status: 200 len: 1521 microversion: 2.1 time: 0.267378 May 28 21:20:05.507617 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2012/4069] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:05 2022] GET /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:05.741124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-32d7b339-1129-4a76-a352-86c5c39f239b req-8108957c-de86-4024-af62-63744296ad40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da9e5d08-1eb5-4a4d-bf6e-9634815fd157", "name": "network-vif-deleted", "tag": "2582d44b-dcff-44b6-97ea-c76d3d3f0d82"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:05.755345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-32d7b339-1129-4a76-a352-86c5c39f239b req-8108957c-de86-4024-af62-63744296ad40 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:05.757469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-32d7b339-1129-4a76-a352-86c5c39f239b req-8108957c-de86-4024-af62-63744296ad40 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:05.786898 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-32d7b339-1129-4a76-a352-86c5c39f239b req-8108957c-de86-4024-af62-63744296ad40 service nova] Creating event network-vif-deleted:2582d44b-dcff-44b6-97ea-c76d3d3f0d82 for instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 on nch1-master-1 May 28 21:20:05.792164 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-32d7b339-1129-4a76-a352-86c5c39f239b req-8108957c-de86-4024-af62-63744296ad40 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054644 May 28 21:20:05.793379 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2058/4070] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:20:06.523966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-44534b9a-4eba-4476-964a-e2e0731ad655 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:06.524762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-44534b9a-4eba-4476-964a-e2e0731ad655 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: da9e5d08-1eb5-4a4d-bf6e-9634815fd157] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:06.537778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-44534b9a-4eba-4476-964a-e2e0731ad655 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:06.538274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-44534b9a-4eba-4476-964a-e2e0731ad655 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:06.539065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-44534b9a-4eba-4476-964a-e2e0731ad655 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:06.539507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-44534b9a-4eba-4476-964a-e2e0731ad655 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:06.575592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-44534b9a-4eba-4476-964a-e2e0731ad655 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:06.576051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-44534b9a-4eba-4476-964a-e2e0731ad655 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:06.576520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-44534b9a-4eba-4476-964a-e2e0731ad655 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lazy-loading 'fault' on Instance uuid da9e5d08-1eb5-4a4d-bf6e-9634815fd157 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:20:06.631722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-44534b9a-4eba-4476-964a-e2e0731ad655 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:06.641930 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-44534b9a-4eba-4476-964a-e2e0731ad655 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157" status: 200 len: 1312 microversion: 2.1 time: 0.122017 May 28 21:20:06.651575 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2013/4071] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:06 2022] GET /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157 => generated 1312 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:07.668735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c15be32e-e53b-414c-b027-7ebe2a28d471 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:07.670430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c15be32e-e53b-414c-b027-7ebe2a28d471 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: da9e5d08-1eb5-4a4d-bf6e-9634815fd157] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:07.692979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c15be32e-e53b-414c-b027-7ebe2a28d471 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:07.693860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c15be32e-e53b-414c-b027-7ebe2a28d471 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:07.695983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c15be32e-e53b-414c-b027-7ebe2a28d471 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:07.696349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c15be32e-e53b-414c-b027-7ebe2a28d471 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:07.719905 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-c15be32e-e53b-414c-b027-7ebe2a28d471 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] HTTP exception thrown: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c15be32e-e53b-414c-b027-7ebe2a28d471 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Request method failure captured: May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157 HTTP/1.1 May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpHrHKqzaDOkYjAND4Xw1RP0Of4PKe6nKwP337ASsAKW_BDBPsbkX0CpFZ_Y_NwfkEhU82cIb_i6GDK8VxT3tiKAMSMlMg_YoI44CJgUMUfhFkpbjAjLuPsLUXyQRVo_BFb_a__0NygL3BzxqCzyGejghJtfHyvKikJSAeglkHFTV-M May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e398fd1bbf124b01b5a8a155d040f21c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "tempest-type-1137641950", "name": "tempest-service-628656508", "endpoints": [{"region": "tempest-region-1558968175", "publicURL": "https://url-1989113160.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "tempest-type-1715531072", "name": "tempest-service-1646254108", "endpoints": [{"region": "tempest-region-1138982789", "internalURL": "https://url-1923250413.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 7ea0fccc16364b7a92e1ee7308268c09 May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'da9e5d08-1eb5-4a4d-bf6e-9634815fd157'} May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:20:07.722158 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:20:07.732673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:20:07.732673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. May 28 21:20:07.732673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:07.732673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:07.732673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:07.732673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:07.732673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:07.732673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:07.732673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:20:07.732673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:20:07.732673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. May 28 21:20:07.732673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:07.732673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c15be32e-e53b-414c-b027-7ebe2a28d471 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Returning 404 to user: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:07.732673 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c15be32e-e53b-414c-b027-7ebe2a28d471 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157" status: 404 len: 111 microversion: 2.1 time: 0.067143 May 28 21:20:07.732673 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2059/4072] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:07 2022] GET /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:20:07.738743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7f314089-5733-4a8f-9e8f-300fa5d48d60 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:07.743744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7f314089-5733-4a8f-9e8f-300fa5d48d60 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:07.744783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7f314089-5733-4a8f-9e8f-300fa5d48d60 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:20:07.751536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f314089-5733-4a8f-9e8f-300fa5d48d60 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:07.752080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f314089-5733-4a8f-9e8f-300fa5d48d60 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:07.752896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f314089-5733-4a8f-9e8f-300fa5d48d60 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:07.753344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f314089-5733-4a8f-9e8f-300fa5d48d60 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:07.838589 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7f314089-5733-4a8f-9e8f-300fa5d48d60 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.107936 May 28 21:20:07.839201 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2014/4073] 10.222.0.33 () {58 vars in 1229 bytes} [Sat May 28 21:20:07 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 21:20:07.856320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9b9c8e50-120c-4f4b-9701-4a92bd417fbd tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9b9c8e50-120c-4f4b-9701-4a92bd417fbd tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Request method failure captured: May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpHrHKqzaDOkYjAND4Xw1RP0Of4PKe6nKwP337ASsAKW_BDBPsbkX0CpFZ_Y_NwfkEhU82cIb_i6GDK8VxT3tiKAMSMlMg_YoI44CJgUMUfhFkpbjAjLuPsLUXyQRVo_BFb_a__0NygL3BzxqCzyGejghJtfHyvKikJSAeglkHFTV-M May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e398fd1bbf124b01b5a8a155d040f21c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "tempest-type-1137641950", "name": "tempest-service-628656508", "endpoints": [{"region": "tempest-region-1558968175", "publicURL": "https://url-1989113160.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "tempest-type-1715531072", "name": "tempest-service-1646254108", "endpoints": [{"region": "tempest-region-1138982789", "internalURL": "https://url-1923250413.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 7ea0fccc16364b7a92e1ee7308268c09 May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: action_args: {} May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance[0]: May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi '2011/01/01' May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:20:07.859162 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9b9c8e50-120c-4f4b-9701-4a92bd417fbd tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9b9c8e50-120c-4f4b-9701-4a92bd417fbd tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.012132 May 28 21:20:07.864108 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2060/4074] 10.222.0.33 () {58 vars in 1181 bytes} [Sat May 28 21:20:07 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:20:07.872325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f01183ef-0b36-4445-8bb0-b32fec2b764a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:07.875915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f01183ef-0b36-4445-8bb0-b32fec2b764a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:07.876590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f01183ef-0b36-4445-8bb0-b32fec2b764a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Searching by: {'deleted': False, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:20:07.882022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f01183ef-0b36-4445-8bb0-b32fec2b764a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:07.882612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f01183ef-0b36-4445-8bb0-b32fec2b764a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:07.883426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f01183ef-0b36-4445-8bb0-b32fec2b764a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:07.883872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f01183ef-0b36-4445-8bb0-b32fec2b764a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:07.911686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-f01183ef-0b36-4445-8bb0-b32fec2b764a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:20:07.953610 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f01183ef-0b36-4445-8bb0-b32fec2b764a tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.085223 May 28 21:20:07.954404 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2015/4075] 10.222.0.33 () {58 vars in 1124 bytes} [Sat May 28 21:20:07 2022] GET /compute/v2.1/servers => generated 681 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:20:07.965712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-17804726-a8c4-4a2d-982c-7e868f7f9e58 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:07.970276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-17804726-a8c4-4a2d-982c-7e868f7f9e58 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:07.971898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.compute.servers [None req-17804726-a8c4-4a2d-982c-7e868f7f9e58 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Removing options 'limit' from query {{(pid=143129) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} May 28 21:20:07.973080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-17804726-a8c4-4a2d-982c-7e868f7f9e58 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Searching by: {'deleted': False, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:20:07.981359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17804726-a8c4-4a2d-982c-7e868f7f9e58 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:07.982111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17804726-a8c4-4a2d-982c-7e868f7f9e58 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:07.983162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17804726-a8c4-4a2d-982c-7e868f7f9e58 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:07.983865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17804726-a8c4-4a2d-982c-7e868f7f9e58 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:08.034938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-17804726-a8c4-4a2d-982c-7e868f7f9e58 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:20:08.075363 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-17804726-a8c4-4a2d-982c-7e868f7f9e58 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.114068 May 28 21:20:08.078755 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2061/4076] 10.222.0.33 () {58 vars in 1143 bytes} [Sat May 28 21:20:07 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:20:08.088669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f5ffebc1-df9f-479d-a41a-7e3a248463fc tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f5ffebc1-df9f-479d-a41a-7e3a248463fc tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Request method failure captured: May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpHrHKqzaDOkYjAND4Xw1RP0Of4PKe6nKwP337ASsAKW_BDBPsbkX0CpFZ_Y_NwfkEhU82cIb_i6GDK8VxT3tiKAMSMlMg_YoI44CJgUMUfhFkpbjAjLuPsLUXyQRVo_BFb_a__0NygL3BzxqCzyGejghJtfHyvKikJSAeglkHFTV-M May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e398fd1bbf124b01b5a8a155d040f21c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "tempest-type-1137641950", "name": "tempest-service-628656508", "endpoints": [{"region": "tempest-region-1558968175", "publicURL": "https://url-1989113160.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "tempest-type-1715531072", "name": "tempest-service-1646254108", "endpoints": [{"region": "tempest-region-1138982789", "internalURL": "https://url-1923250413.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 7ea0fccc16364b7a92e1ee7308268c09 May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: action_args: {} May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise error May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi On instance[0]: May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi '-1' May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:20:08.091706 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f5ffebc1-df9f-479d-a41a-7e3a248463fc tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f5ffebc1-df9f-479d-a41a-7e3a248463fc tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.008901 May 28 21:20:08.105124 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2016/4077] 10.222.0.33 () {58 vars in 1141 bytes} [Sat May 28 21:20:08 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:20:08.113082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-306b64b1-5936-4458-977e-2a7e48cde658 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-306b64b1-5936-4458-977e-2a7e48cde658 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Request method failure captured: May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpHrHKqzaDOkYjAND4Xw1RP0Of4PKe6nKwP337ASsAKW_BDBPsbkX0CpFZ_Y_NwfkEhU82cIb_i6GDK8VxT3tiKAMSMlMg_YoI44CJgUMUfhFkpbjAjLuPsLUXyQRVo_BFb_a__0NygL3BzxqCzyGejghJtfHyvKikJSAeglkHFTV-M May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e398fd1bbf124b01b5a8a155d040f21c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "tempest-type-1137641950", "name": "tempest-service-628656508", "endpoints": [{"region": "tempest-region-1558968175", "publicURL": "https://url-1989113160.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "tempest-type-1715531072", "name": "tempest-service-1646254108", "endpoints": [{"region": "tempest-region-1138982789", "internalURL": "https://url-1923250413.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 7ea0fccc16364b7a92e1ee7308268c09 May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: action_args: {} May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'minLength': 1, May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'minimum': 0, May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance[0]: May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'testing' May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:20:08.115941 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-306b64b1-5936-4458-977e-2a7e48cde658 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:08.121609 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-306b64b1-5936-4458-977e-2a7e48cde658 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.009075 May 28 21:20:08.130378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3b5c93cf-5f0b-4d17-a62f-211b26484459 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:08.134035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3b5c93cf-5f0b-4d17-a62f-211b26484459 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:08.134720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3b5c93cf-5f0b-4d17-a62f-211b26484459 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:20:08.138271 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2062/4078] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:20:08 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:20:08.143349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.compute.servers [None req-3b5c93cf-5f0b-4d17-a62f-211b26484459 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Flavor 'non_existing_flavor' could not be found {{(pid=143128) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} May 28 21:20:08.144404 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3b5c93cf-5f0b-4d17-a62f-211b26484459 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.018390 May 28 21:20:08.144983 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2017/4079] 10.222.0.33 () {58 vars in 1177 bytes} [Sat May 28 21:20:08 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:20:08.165773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6cd02164-f58f-4b3f-8e2b-2ea7d390acd1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:08.172089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6cd02164-f58f-4b3f-8e2b-2ea7d390acd1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:08.174434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6cd02164-f58f-4b3f-8e2b-2ea7d390acd1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:20:08.181621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cd02164-f58f-4b3f-8e2b-2ea7d390acd1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:08.182193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cd02164-f58f-4b3f-8e2b-2ea7d390acd1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:08.183014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cd02164-f58f-4b3f-8e2b-2ea7d390acd1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:08.183468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cd02164-f58f-4b3f-8e2b-2ea7d390acd1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:08.272444 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6cd02164-f58f-4b3f-8e2b-2ea7d390acd1 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.114385 May 28 21:20:08.273199 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2063/4080] 10.222.0.33 () {58 vars in 1173 bytes} [Sat May 28 21:20:08 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:20:08.284129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-10b1207e-5fc6-4f48-af17-6e7d5b4e1b17 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:08.287917 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-10b1207e-5fc6-4f48-af17-6e7d5b4e1b17 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:08.291839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-10b1207e-5fc6-4f48-af17-6e7d5b4e1b17 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:20:08.294045 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10b1207e-5fc6-4f48-af17-6e7d5b4e1b17 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:08.294511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10b1207e-5fc6-4f48-af17-6e7d5b4e1b17 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:08.295440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10b1207e-5fc6-4f48-af17-6e7d5b4e1b17 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:08.295888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10b1207e-5fc6-4f48-af17-6e7d5b4e1b17 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:08.383767 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-10b1207e-5fc6-4f48-af17-6e7d5b4e1b17 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.103498 May 28 21:20:08.384359 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2018/4081] 10.222.0.33 () {58 vars in 1183 bytes} [Sat May 28 21:20:08 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:20:08.395651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-213efd3d-1dfb-4fae-ac7a-98fb5ffacd9f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:08.399213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-213efd3d-1dfb-4fae-ac7a-98fb5ffacd9f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:08.399989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-213efd3d-1dfb-4fae-ac7a-98fb5ffacd9f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Searching by: {'deleted': False, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:20:08.405395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-213efd3d-1dfb-4fae-ac7a-98fb5ffacd9f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:08.405916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-213efd3d-1dfb-4fae-ac7a-98fb5ffacd9f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:08.406723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-213efd3d-1dfb-4fae-ac7a-98fb5ffacd9f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:08.407379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-213efd3d-1dfb-4fae-ac7a-98fb5ffacd9f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:08.440166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-213efd3d-1dfb-4fae-ac7a-98fb5ffacd9f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:20:08.480650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-213efd3d-1dfb-4fae-ac7a-98fb5ffacd9f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:08.489058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-213efd3d-1dfb-4fae-ac7a-98fb5ffacd9f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:08.489427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-213efd3d-1dfb-4fae-ac7a-98fb5ffacd9f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:08.631074 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-213efd3d-1dfb-4fae-ac7a-98fb5ffacd9f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 3022 microversion: 2.1 time: 0.239231 May 28 21:20:08.632489 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2064/4082] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:20:08 2022] GET /compute/v2.1/servers/detail => generated 3022 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:08.650857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5685607c-43a4-47f2-8ee0-56556e062550 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:08.654789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5685607c-43a4-47f2-8ee0-56556e062550 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:08.655770 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5685607c-43a4-47f2-8ee0-56556e062550 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.009085 May 28 21:20:08.656858 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2019/4083] 10.222.0.33 () {58 vars in 1177 bytes} [Sat May 28 21:20:08 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:20:08.668371 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-393dc138-b9b5-4b4d-b3b9-489b0c760ea7 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:08.672475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-393dc138-b9b5-4b4d-b3b9-489b0c760ea7 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:08.673155 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-393dc138-b9b5-4b4d-b3b9-489b0c760ea7 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Searching by: {'deleted': False, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:20:08.678845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-393dc138-b9b5-4b4d-b3b9-489b0c760ea7 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:08.679308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-393dc138-b9b5-4b4d-b3b9-489b0c760ea7 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:08.680109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-393dc138-b9b5-4b4d-b3b9-489b0c760ea7 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:08.680556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-393dc138-b9b5-4b4d-b3b9-489b0c760ea7 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:08.708402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-393dc138-b9b5-4b4d-b3b9-489b0c760ea7 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:20:08.777761 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-393dc138-b9b5-4b4d-b3b9-489b0c760ea7 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.101737 May 28 21:20:08.777761 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2065/4084] 10.222.0.33 () {58 vars in 1124 bytes} [Sat May 28 21:20:08 2022] GET /compute/v2.1/servers => generated 681 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:20:08.789149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-badf21b7-13ef-4c85-8101-76c36cc50743 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:08.790311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-badf21b7-13ef-4c85-8101-76c36cc50743 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: da9e5d08-1eb5-4a4d-bf6e-9634815fd157] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:08.800130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-badf21b7-13ef-4c85-8101-76c36cc50743 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:08.801724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-badf21b7-13ef-4c85-8101-76c36cc50743 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:08.802759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-badf21b7-13ef-4c85-8101-76c36cc50743 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:08.803355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-badf21b7-13ef-4c85-8101-76c36cc50743 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:08.818746 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-badf21b7-13ef-4c85-8101-76c36cc50743 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] HTTP exception thrown: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-badf21b7-13ef-4c85-8101-76c36cc50743 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Request method failure captured: May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157 HTTP/1.1 May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpHrHKqzaDOkYjAND4Xw1RP0Of4PKe6nKwP337ASsAKW_BDBPsbkX0CpFZ_Y_NwfkEhU82cIb_i6GDK8VxT3tiKAMSMlMg_YoI44CJgUMUfhFkpbjAjLuPsLUXyQRVo_BFb_a__0NygL3BzxqCzyGejghJtfHyvKikJSAeglkHFTV-M May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e398fd1bbf124b01b5a8a155d040f21c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "tempest-type-1137641950", "name": "tempest-service-628656508", "endpoints": [{"region": "tempest-region-1558968175", "publicURL": "https://url-1989113160.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "tempest-type-1715531072", "name": "tempest-service-1646254108", "endpoints": [{"region": "tempest-region-1138982789", "internalURL": "https://url-1923250413.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 7ea0fccc16364b7a92e1ee7308268c09 May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'da9e5d08-1eb5-4a4d-bf6e-9634815fd157'} May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:20:08.820308 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:20:08.825356 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:20:08.825356 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:20:08.825356 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:20:08.825356 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. May 28 21:20:08.825356 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:08.825356 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:08.825356 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:08.825356 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:08.825356 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:08.825356 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:08.825356 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:20:08.825356 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:20:08.825356 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. May 28 21:20:08.825356 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:08.827884 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-badf21b7-13ef-4c85-8101-76c36cc50743 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Returning 404 to user: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:08.829134 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-badf21b7-13ef-4c85-8101-76c36cc50743 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "DELETE /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157" status: 404 len: 111 microversion: 2.1 time: 0.047720 May 28 21:20:08.833432 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2020/4085] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:20:08 2022] DELETE /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:20:08.838449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fe7f7968-7aa6-4b8d-aa04-b0238920654c tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:08.840033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fe7f7968-7aa6-4b8d-aa04-b0238920654c tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 4e297091-bdfd-43d2-9a3f-743d366778ca] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:08.846459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe7f7968-7aa6-4b8d-aa04-b0238920654c tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:08.846979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe7f7968-7aa6-4b8d-aa04-b0238920654c tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:08.847861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe7f7968-7aa6-4b8d-aa04-b0238920654c tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:08.848315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe7f7968-7aa6-4b8d-aa04-b0238920654c tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:08.878865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fe7f7968-7aa6-4b8d-aa04-b0238920654c tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 4e297091-bdfd-43d2-9a3f-743d366778ca] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:20:09.258179 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fe7f7968-7aa6-4b8d-aa04-b0238920654c tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4e297091-bdfd-43d2-9a3f-743d366778ca" status: 204 len: 0 microversion: 2.1 time: 0.423469 May 28 21:20:09.258778 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2066/4086] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:20:08 2022] DELETE /compute/v2.1/servers/4e297091-bdfd-43d2-9a3f-743d366778ca => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:20:09.267632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9b01e10c-ed5b-4d7b-912d-3587083eac47 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:09.268172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9b01e10c-ed5b-4d7b-912d-3587083eac47 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:09.275035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b01e10c-ed5b-4d7b-912d-3587083eac47 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:09.275559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b01e10c-ed5b-4d7b-912d-3587083eac47 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:09.276361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b01e10c-ed5b-4d7b-912d-3587083eac47 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:09.276989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b01e10c-ed5b-4d7b-912d-3587083eac47 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:09.317342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9b01e10c-ed5b-4d7b-912d-3587083eac47 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:20:09.708797 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9b01e10c-ed5b-4d7b-912d-3587083eac47 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 204 len: 0 microversion: 2.1 time: 0.441124 May 28 21:20:09.708797 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2021/4087] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:20:09 2022] DELETE /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:20:09.713683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a5cc892b-6c21-49ef-ba7e-81826b0df7d9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:09.714433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a5cc892b-6c21-49ef-ba7e-81826b0df7d9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: da9e5d08-1eb5-4a4d-bf6e-9634815fd157] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:09.721633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5cc892b-6c21-49ef-ba7e-81826b0df7d9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:09.722370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5cc892b-6c21-49ef-ba7e-81826b0df7d9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:09.723157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5cc892b-6c21-49ef-ba7e-81826b0df7d9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:09.723601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a5cc892b-6c21-49ef-ba7e-81826b0df7d9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:09.738933 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-a5cc892b-6c21-49ef-ba7e-81826b0df7d9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] HTTP exception thrown: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a5cc892b-6c21-49ef-ba7e-81826b0df7d9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Request method failure captured: May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157 HTTP/1.1 May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpHrHKqzaDOkYjAND4Xw1RP0Of4PKe6nKwP337ASsAKW_BDBPsbkX0CpFZ_Y_NwfkEhU82cIb_i6GDK8VxT3tiKAMSMlMg_YoI44CJgUMUfhFkpbjAjLuPsLUXyQRVo_BFb_a__0NygL3BzxqCzyGejghJtfHyvKikJSAeglkHFTV-M May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e398fd1bbf124b01b5a8a155d040f21c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "tempest-type-1137641950", "name": "tempest-service-628656508", "endpoints": [{"region": "tempest-region-1558968175", "publicURL": "https://url-1989113160.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "tempest-type-1715531072", "name": "tempest-service-1646254108", "endpoints": [{"region": "tempest-region-1138982789", "internalURL": "https://url-1923250413.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 7ea0fccc16364b7a92e1ee7308268c09 May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'da9e5d08-1eb5-4a4d-bf6e-9634815fd157'} May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:20:09.741205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:20:09.747289 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:20:09.747289 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. May 28 21:20:09.747289 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:09.747289 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:09.747289 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:09.747289 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:09.747289 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:09.747289 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:09.747289 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:20:09.747289 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:20:09.747289 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. May 28 21:20:09.747289 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:09.747289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a5cc892b-6c21-49ef-ba7e-81826b0df7d9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Returning 404 to user: Instance da9e5d08-1eb5-4a4d-bf6e-9634815fd157 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:09.747289 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a5cc892b-6c21-49ef-ba7e-81826b0df7d9 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157" status: 404 len: 111 microversion: 2.1 time: 0.032804 May 28 21:20:09.747289 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2067/4088] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:09 2022] GET /compute/v2.1/servers/da9e5d08-1eb5-4a4d-bf6e-9634815fd157 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:20:09.752033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a60cfc9d-2b66-4bcc-8750-77cff7752d34 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:09.752748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a60cfc9d-2b66-4bcc-8750-77cff7752d34 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 4e297091-bdfd-43d2-9a3f-743d366778ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:09.759204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a60cfc9d-2b66-4bcc-8750-77cff7752d34 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:09.759667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a60cfc9d-2b66-4bcc-8750-77cff7752d34 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:09.760452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a60cfc9d-2b66-4bcc-8750-77cff7752d34 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:09.761023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a60cfc9d-2b66-4bcc-8750-77cff7752d34 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:09.950733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a60cfc9d-2b66-4bcc-8750-77cff7752d34 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:09.960798 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a60cfc9d-2b66-4bcc-8750-77cff7752d34 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/4e297091-bdfd-43d2-9a3f-743d366778ca" status: 200 len: 1520 microversion: 2.1 time: 0.213627 May 28 21:20:09.961589 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2022/4089] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:09 2022] GET /compute/v2.1/servers/4e297091-bdfd-43d2-9a3f-743d366778ca => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:11.003202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4d74e0ea-4116-4ae1-8fd1-4d6d1e0f1684 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:11.003919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4d74e0ea-4116-4ae1-8fd1-4d6d1e0f1684 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 4e297091-bdfd-43d2-9a3f-743d366778ca] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:11.011289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d74e0ea-4116-4ae1-8fd1-4d6d1e0f1684 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:11.011760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d74e0ea-4116-4ae1-8fd1-4d6d1e0f1684 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:11.012565 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d74e0ea-4116-4ae1-8fd1-4d6d1e0f1684 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:11.013021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d74e0ea-4116-4ae1-8fd1-4d6d1e0f1684 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:11.288228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4d74e0ea-4116-4ae1-8fd1-4d6d1e0f1684 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:11.296290 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4d74e0ea-4116-4ae1-8fd1-4d6d1e0f1684 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/4e297091-bdfd-43d2-9a3f-743d366778ca" status: 200 len: 1520 microversion: 2.1 time: 0.297121 May 28 21:20:11.301377 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2068/4090] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:10 2022] GET /compute/v2.1/servers/4e297091-bdfd-43d2-9a3f-743d366778ca => generated 1520 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:11.574848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-3e4bbc84-9a17-4e55-9d43-77cc514354ff req-a869ed99-7378-4fc8-b69b-f32a9197919e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e297091-bdfd-43d2-9a3f-743d366778ca", "name": "network-vif-deleted", "tag": "a9f5eb7a-5cd8-4d74-971a-8c93fc6950b0"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:11.592628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3e4bbc84-9a17-4e55-9d43-77cc514354ff req-a869ed99-7378-4fc8-b69b-f32a9197919e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:11.594660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3e4bbc84-9a17-4e55-9d43-77cc514354ff req-a869ed99-7378-4fc8-b69b-f32a9197919e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:11.623187 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-3e4bbc84-9a17-4e55-9d43-77cc514354ff req-a869ed99-7378-4fc8-b69b-f32a9197919e service nova] Creating event network-vif-deleted:a9f5eb7a-5cd8-4d74-971a-8c93fc6950b0 for instance 4e297091-bdfd-43d2-9a3f-743d366778ca on nch2-master-1 May 28 21:20:11.630297 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-3e4bbc84-9a17-4e55-9d43-77cc514354ff req-a869ed99-7378-4fc8-b69b-f32a9197919e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062546 May 28 21:20:11.630912 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2023/4091] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:20:11.775211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-176e8a17-73db-46af-bdc9-dc903e23811b req-0ae98ca3-f500-44df-9fec-9a423a1e86e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e277bdf-0c4c-4857-b20e-8a444684b8d2", "name": "network-vif-deleted", "tag": "2287f112-60a3-4149-ad90-544ff0f8ab69"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:11.785051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-176e8a17-73db-46af-bdc9-dc903e23811b req-0ae98ca3-f500-44df-9fec-9a423a1e86e7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:11.785934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-176e8a17-73db-46af-bdc9-dc903e23811b req-0ae98ca3-f500-44df-9fec-9a423a1e86e7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:11.803275 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-176e8a17-73db-46af-bdc9-dc903e23811b req-0ae98ca3-f500-44df-9fec-9a423a1e86e7 service nova] Creating event network-vif-deleted:2287f112-60a3-4149-ad90-544ff0f8ab69 for instance 7e277bdf-0c4c-4857-b20e-8a444684b8d2 on nch1-master-1 May 28 21:20:11.808597 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-176e8a17-73db-46af-bdc9-dc903e23811b req-0ae98ca3-f500-44df-9fec-9a423a1e86e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037141 May 28 21:20:11.815742 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2069/4092] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:20:12.317662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5b4b9adc-bd74-4e40-81ef-9bdb1ba602ea tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:12.318584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5b4b9adc-bd74-4e40-81ef-9bdb1ba602ea tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 4e297091-bdfd-43d2-9a3f-743d366778ca] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:12.340734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b4b9adc-bd74-4e40-81ef-9bdb1ba602ea tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:12.342467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b4b9adc-bd74-4e40-81ef-9bdb1ba602ea tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:12.344687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b4b9adc-bd74-4e40-81ef-9bdb1ba602ea tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:12.347418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b4b9adc-bd74-4e40-81ef-9bdb1ba602ea tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:12.434878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b4b9adc-bd74-4e40-81ef-9bdb1ba602ea tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:12.435328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b4b9adc-bd74-4e40-81ef-9bdb1ba602ea tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:12.435974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-5b4b9adc-bd74-4e40-81ef-9bdb1ba602ea tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lazy-loading 'fault' on Instance uuid 4e297091-bdfd-43d2-9a3f-743d366778ca {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:20:12.536534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5b4b9adc-bd74-4e40-81ef-9bdb1ba602ea tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ea0fccc16364b7a92e1ee7308268c09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e398fd1bbf124b01b5a8a155d040f21c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:12.546194 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5b4b9adc-bd74-4e40-81ef-9bdb1ba602ea tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/4e297091-bdfd-43d2-9a3f-743d366778ca" status: 200 len: 1312 microversion: 2.1 time: 0.233523 May 28 21:20:12.547500 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2024/4093] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:12 2022] GET /compute/v2.1/servers/4e297091-bdfd-43d2-9a3f-743d366778ca => generated 1312 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:13.569857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-76976690-0c0f-4070-8c45-aceacfc2595f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:13.569857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-76976690-0c0f-4070-8c45-aceacfc2595f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 4e297091-bdfd-43d2-9a3f-743d366778ca] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:13.573641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76976690-0c0f-4070-8c45-aceacfc2595f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:13.574138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76976690-0c0f-4070-8c45-aceacfc2595f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:13.574969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76976690-0c0f-4070-8c45-aceacfc2595f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:13.575412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76976690-0c0f-4070-8c45-aceacfc2595f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:13.591995 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-76976690-0c0f-4070-8c45-aceacfc2595f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] HTTP exception thrown: Instance 4e297091-bdfd-43d2-9a3f-743d366778ca could not be found. May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-76976690-0c0f-4070-8c45-aceacfc2595f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Request method failure captured: May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/4e297091-bdfd-43d2-9a3f-743d366778ca HTTP/1.1 May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpHrHKqzaDOkYjAND4Xw1RP0Of4PKe6nKwP337ASsAKW_BDBPsbkX0CpFZ_Y_NwfkEhU82cIb_i6GDK8VxT3tiKAMSMlMg_YoI44CJgUMUfhFkpbjAjLuPsLUXyQRVo_BFb_a__0NygL3BzxqCzyGejghJtfHyvKikJSAeglkHFTV-M May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e398fd1bbf124b01b5a8a155d040f21c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "tempest-type-1137641950", "name": "tempest-service-628656508", "endpoints": [{"region": "tempest-region-1558968175", "publicURL": "https://url-1989113160.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "tempest-type-1715531072", "name": "tempest-service-1646254108", "endpoints": [{"region": "tempest-region-1138982789", "internalURL": "https://url-1923250413.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 7ea0fccc16364b7a92e1ee7308268c09 May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 4e297091-bdfd-43d2-9a3f-743d366778ca could not be found. May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '4e297091-bdfd-43d2-9a3f-743d366778ca'} May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e297091-bdfd-43d2-9a3f-743d366778ca could not be found. May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:20:13.594355 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:20:13.599612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:20:13.599612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e297091-bdfd-43d2-9a3f-743d366778ca could not be found. May 28 21:20:13.599612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:13.599612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:13.599612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:13.599612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:13.599612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:13.599612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:13.599612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:20:13.599612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:20:13.599612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e297091-bdfd-43d2-9a3f-743d366778ca could not be found. May 28 21:20:13.599612 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:13.599612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-76976690-0c0f-4070-8c45-aceacfc2595f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Returning 404 to user: Instance 4e297091-bdfd-43d2-9a3f-743d366778ca could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:13.599612 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-76976690-0c0f-4070-8c45-aceacfc2595f tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/4e297091-bdfd-43d2-9a3f-743d366778ca" status: 404 len: 111 microversion: 2.1 time: 0.036806 May 28 21:20:13.600807 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2070/4094] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:13 2022] GET /compute/v2.1/servers/4e297091-bdfd-43d2-9a3f-743d366778ca => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:20:13.605095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-018e9632-6de6-4b8b-bc6c-05be2d162411 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:13.605722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-018e9632-6de6-4b8b-bc6c-05be2d162411 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] [instance: 7e277bdf-0c4c-4857-b20e-8a444684b8d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:13.612925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-018e9632-6de6-4b8b-bc6c-05be2d162411 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:13.614994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-018e9632-6de6-4b8b-bc6c-05be2d162411 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:13.614994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-018e9632-6de6-4b8b-bc6c-05be2d162411 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:13.614994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-018e9632-6de6-4b8b-bc6c-05be2d162411 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:13.628370 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-018e9632-6de6-4b8b-bc6c-05be2d162411 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] HTTP exception thrown: Instance 7e277bdf-0c4c-4857-b20e-8a444684b8d2 could not be found. May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-018e9632-6de6-4b8b-bc6c-05be2d162411 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Request method failure captured: May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 HTTP/1.1 May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpHrHKqzaDOkYjAND4Xw1RP0Of4PKe6nKwP337ASsAKW_BDBPsbkX0CpFZ_Y_NwfkEhU82cIb_i6GDK8VxT3tiKAMSMlMg_YoI44CJgUMUfhFkpbjAjLuPsLUXyQRVo_BFb_a__0NygL3BzxqCzyGejghJtfHyvKikJSAeglkHFTV-M May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e398fd1bbf124b01b5a8a155d040f21c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "tempest-type-1137641950", "name": "tempest-service-628656508", "endpoints": [{"region": "tempest-region-1558968175", "publicURL": "https://url-1989113160.com"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "tempest-type-1715531072", "name": "tempest-service-1646254108", "endpoints": [{"region": "tempest-region-1138982789", "internalURL": "https://url-1923250413.com"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e398fd1bbf124b01b5a8a155d040f21c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e398fd1bbf124b01b5a8a155d040f21c May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-762045155 May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 7ea0fccc16364b7a92e1ee7308268c09 May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ListServersNegativeTestJSON-762045155-project May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 7e277bdf-0c4c-4857-b20e-8a444684b8d2 could not be found. May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '7e277bdf-0c4c-4857-b20e-8a444684b8d2'} May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e277bdf-0c4c-4857-b20e-8a444684b8d2 could not be found. May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:20:13.630065 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:20:13.639123 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:20:13.639123 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e277bdf-0c4c-4857-b20e-8a444684b8d2 could not be found. May 28 21:20:13.639123 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:13.639123 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:13.639123 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:13.639123 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:13.639123 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:13.639123 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:13.639123 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:20:13.639123 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:20:13.639123 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e277bdf-0c4c-4857-b20e-8a444684b8d2 could not be found. May 28 21:20:13.639123 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:13.639123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-018e9632-6de6-4b8b-bc6c-05be2d162411 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] Returning 404 to user: Instance 7e277bdf-0c4c-4857-b20e-8a444684b8d2 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:13.639123 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-018e9632-6de6-4b8b-bc6c-05be2d162411 tempest-ListServersNegativeTestJSON-762045155 tempest-ListServersNegativeTestJSON-762045155-project] 10.222.0.33 "GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2" status: 404 len: 111 microversion: 2.1 time: 0.030727 May 28 21:20:13.639123 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2025/4095] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:13 2022] GET /compute/v2.1/servers/7e277bdf-0c4c-4857-b20e-8a444684b8d2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:20:19.860158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:20:19.860930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=8 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:20:20.166622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-273230876", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "1b11d924-731c-41b3-84aa-d5be952a72df"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:20.228996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] validate_networks() for [('1b11d924-731c-41b3-84aa-d5be952a72df', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:20:21.231063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:20:21.231718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:20:21.232073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:20:21.232407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:20:21.232832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:20:21.242903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:21.243380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:21.244193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:21.244646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:21.267136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Getting quotas for project f03a2cfe8fd94e4e8581358beadaf177. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:20:21.272722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Getting quotas for user 2fb3ef26871e4b30a9bc4a5045fe62ad and project f03a2cfe8fd94e4e8581358beadaf177. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:20:21.289911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:20:21.292232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:20:21.463978 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-059d0fe8-86ad-4adf-a770-1efe473dd1a2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.601780 May 28 21:20:21.463978 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2071/4096] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:20:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:20:21.483018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4daa1109-7c60-4140-8f6a-fd0baf144b07 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:21.485695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4daa1109-7c60-4140-8f6a-fd0baf144b07 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:21.510634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:20:21.511507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:20:21.612957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4daa1109-7c60-4140-8f6a-fd0baf144b07 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:21.622167 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4daa1109-7c60-4140-8f6a-fd0baf144b07 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1223 microversion: 2.1 time: 0.148396 May 28 21:20:21.638361 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2026/4097] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:21 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1223 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:22.646040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f7b6fdbd-2599-4295-b7c2-b6febedca9d7 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:22.646040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f7b6fdbd-2599-4295-b7c2-b6febedca9d7 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:22.710719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f7b6fdbd-2599-4295-b7c2-b6febedca9d7 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:22.714460 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f7b6fdbd-2599-4295-b7c2-b6febedca9d7 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1223 microversion: 2.1 time: 0.078970 May 28 21:20:22.715041 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2072/4098] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:22 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:23.732622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-377c2f94-0ee3-4f97-8b6c-c0393fffa78f tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:23.733240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-377c2f94-0ee3-4f97-8b6c-c0393fffa78f tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:23.750210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:20:23.760708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-377c2f94-0ee3-4f97-8b6c-c0393fffa78f tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:23.761173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-377c2f94-0ee3-4f97-8b6c-c0393fffa78f tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:23.761989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-377c2f94-0ee3-4f97-8b6c-c0393fffa78f tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:23.762434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-377c2f94-0ee3-4f97-8b6c-c0393fffa78f tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:23.838084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-377c2f94-0ee3-4f97-8b6c-c0393fffa78f tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:23.846064 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-377c2f94-0ee3-4f97-8b6c-c0393fffa78f tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1275 microversion: 2.1 time: 0.118346 May 28 21:20:23.846649 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2027/4099] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:23 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:24.863548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a4f1afba-0cd6-44e8-b5a7-32bd78f6924a tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:24.864197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a4f1afba-0cd6-44e8-b5a7-32bd78f6924a tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:24.872477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4f1afba-0cd6-44e8-b5a7-32bd78f6924a tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:24.872933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4f1afba-0cd6-44e8-b5a7-32bd78f6924a tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:24.873757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4f1afba-0cd6-44e8-b5a7-32bd78f6924a tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:24.874976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4f1afba-0cd6-44e8-b5a7-32bd78f6924a tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:25.059599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a4f1afba-0cd6-44e8-b5a7-32bd78f6924a tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:25.069637 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a4f1afba-0cd6-44e8-b5a7-32bd78f6924a tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1323 microversion: 2.1 time: 0.210658 May 28 21:20:25.070494 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2073/4100] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:24 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1323 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:25.908789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-8f1fcd9f-d5f3-4175-a6ee-82582bfee73e req-5701e418-4cbe-4842-83b0-90af620765f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0bcc813-f74d-4596-94d1-ef3a21701a18", "tag": "b1dc2933-b701-47ed-a519-845aecb95dfd"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:25.924476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8f1fcd9f-d5f3-4175-a6ee-82582bfee73e req-5701e418-4cbe-4842-83b0-90af620765f5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:25.925061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8f1fcd9f-d5f3-4175-a6ee-82582bfee73e req-5701e418-4cbe-4842-83b0-90af620765f5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:25.940908 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-8f1fcd9f-d5f3-4175-a6ee-82582bfee73e req-5701e418-4cbe-4842-83b0-90af620765f5 service nova] Creating event network-changed:b1dc2933-b701-47ed-a519-845aecb95dfd for instance c0bcc813-f74d-4596-94d1-ef3a21701a18 on nch1-master-1 May 28 21:20:25.946250 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-8f1fcd9f-d5f3-4175-a6ee-82582bfee73e req-5701e418-4cbe-4842-83b0-90af620765f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048302 May 28 21:20:25.947279 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2028/4101] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:20:26.087604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a6b4a797-c423-465e-bae8-5b461c8a169c tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:26.088259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a6b4a797-c423-465e-bae8-5b461c8a169c tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:26.097380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6b4a797-c423-465e-bae8-5b461c8a169c tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:26.098217 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6b4a797-c423-465e-bae8-5b461c8a169c tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:26.103070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6b4a797-c423-465e-bae8-5b461c8a169c tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:26.103070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6b4a797-c423-465e-bae8-5b461c8a169c tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:26.366302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a6b4a797-c423-465e-bae8-5b461c8a169c tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:26.374443 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a6b4a797-c423-465e-bae8-5b461c8a169c tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1323 microversion: 2.1 time: 0.291541 May 28 21:20:26.375341 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2074/4102] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:26 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1323 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:27.393098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f6ce2844-c168-488f-b063-6da8f3eabb7b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:27.393813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f6ce2844-c168-488f-b063-6da8f3eabb7b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:27.401615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6ce2844-c168-488f-b063-6da8f3eabb7b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:27.402105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6ce2844-c168-488f-b063-6da8f3eabb7b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:27.402891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6ce2844-c168-488f-b063-6da8f3eabb7b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:27.404321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6ce2844-c168-488f-b063-6da8f3eabb7b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:27.564158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f6ce2844-c168-488f-b063-6da8f3eabb7b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:27.575575 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f6ce2844-c168-488f-b063-6da8f3eabb7b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1323 microversion: 2.1 time: 0.187746 May 28 21:20:27.576276 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2029/4103] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:27 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1323 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:27.972108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9759b693-f5b5-48ad-b92c-562e3e96860b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:27.972658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9759b693-f5b5-48ad-b92c-562e3e96860b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:27.979946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9759b693-f5b5-48ad-b92c-562e3e96860b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:27.980907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9759b693-f5b5-48ad-b92c-562e3e96860b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:27.981259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9759b693-f5b5-48ad-b92c-562e3e96860b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:27.981718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9759b693-f5b5-48ad-b92c-562e3e96860b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:28.006776 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9759b693-f5b5-48ad-b92c-562e3e96860b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/ips" status: 200 len: 151 microversion: 2.20 time: 0.038812 May 28 21:20:28.007370 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2075/4104] 10.222.0.33 () {60 vars in 1288 bytes} [Sat May 28 21:20:27 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:20:28.597664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f00f2039-df5f-46f6-b276-df60cda7e13b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:28.598479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f00f2039-df5f-46f6-b276-df60cda7e13b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:28.605473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f00f2039-df5f-46f6-b276-df60cda7e13b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:28.605963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f00f2039-df5f-46f6-b276-df60cda7e13b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:28.606746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f00f2039-df5f-46f6-b276-df60cda7e13b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:28.607199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f00f2039-df5f-46f6-b276-df60cda7e13b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:28.814596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f00f2039-df5f-46f6-b276-df60cda7e13b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:28.826125 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f00f2039-df5f-46f6-b276-df60cda7e13b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1323 microversion: 2.1 time: 0.233395 May 28 21:20:28.827007 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2030/4105] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:28 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1323 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:29.846245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9ffe0486-c7fc-49e0-8328-dabc8efc3b52 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:29.846886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9ffe0486-c7fc-49e0-8328-dabc8efc3b52 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:29.854637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ffe0486-c7fc-49e0-8328-dabc8efc3b52 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:29.855104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ffe0486-c7fc-49e0-8328-dabc8efc3b52 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:29.855887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ffe0486-c7fc-49e0-8328-dabc8efc3b52 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:29.856340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ffe0486-c7fc-49e0-8328-dabc8efc3b52 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:30.037328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9ffe0486-c7fc-49e0-8328-dabc8efc3b52 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:30.045638 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9ffe0486-c7fc-49e0-8328-dabc8efc3b52 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1323 microversion: 2.1 time: 0.203345 May 28 21:20:30.055640 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2076/4106] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:29 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1323 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:31.063240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-21b44d33-9881-40c7-a81c-8e6b708975a9 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:31.063861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-21b44d33-9881-40c7-a81c-8e6b708975a9 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:31.071038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21b44d33-9881-40c7-a81c-8e6b708975a9 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:31.071504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21b44d33-9881-40c7-a81c-8e6b708975a9 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:31.072457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21b44d33-9881-40c7-a81c-8e6b708975a9 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:31.072906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21b44d33-9881-40c7-a81c-8e6b708975a9 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:31.252567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-21b44d33-9881-40c7-a81c-8e6b708975a9 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:31.252567 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-21b44d33-9881-40c7-a81c-8e6b708975a9 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1323 microversion: 2.1 time: 0.192499 May 28 21:20:31.253895 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2031/4107] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:31 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1323 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:31.355654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-71266ef3-53a1-4e8b-b2b4-25ccf96677c9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:31.356314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-71266ef3-53a1-4e8b-b2b4-25ccf96677c9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:31.360352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:20:31.366151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71266ef3-53a1-4e8b-b2b4-25ccf96677c9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:31.366618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71266ef3-53a1-4e8b-b2b4-25ccf96677c9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:31.368228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71266ef3-53a1-4e8b-b2b4-25ccf96677c9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:31.368921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71266ef3-53a1-4e8b-b2b4-25ccf96677c9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:31.392165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:20:31.400965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-71266ef3-53a1-4e8b-b2b4-25ccf96677c9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lazy-loading 'flavor' on Instance uuid 6232e7b0-68db-43d6-a836-fb2f96c54658 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:20:32.180640 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-71266ef3-53a1-4e8b-b2b4-25ccf96677c9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "POST /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/action" status: 202 len: 0 microversion: 2.20 time: 0.829342 May 28 21:20:32.184981 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2077/4108] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:20:31 2022] POST /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/action => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 21:20:32.191525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9852718b-e98b-4655-a44b-10cd4e96ffcd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:32.192326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9852718b-e98b-4655-a44b-10cd4e96ffcd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:32.195183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:20:32.201461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9852718b-e98b-4655-a44b-10cd4e96ffcd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:32.202102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9852718b-e98b-4655-a44b-10cd4e96ffcd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:32.208481 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9852718b-e98b-4655-a44b-10cd4e96ffcd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:32.209057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9852718b-e98b-4655-a44b-10cd4e96ffcd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:32.273697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dd753f03-2b16-44b7-8d4e-6bc84ca65537 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:32.274857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dd753f03-2b16-44b7-8d4e-6bc84ca65537 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:32.291166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd753f03-2b16-44b7-8d4e-6bc84ca65537 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:32.293229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd753f03-2b16-44b7-8d4e-6bc84ca65537 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:32.295617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd753f03-2b16-44b7-8d4e-6bc84ca65537 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:32.301122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd753f03-2b16-44b7-8d4e-6bc84ca65537 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:32.474948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9852718b-e98b-4655-a44b-10cd4e96ffcd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:32.489103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9852718b-e98b-4655-a44b-10cd4e96ffcd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:32.493770 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9852718b-e98b-4655-a44b-10cd4e96ffcd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:32.495054 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9852718b-e98b-4655-a44b-10cd4e96ffcd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1723 microversion: 2.20 time: 0.308629 May 28 21:20:32.498985 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2032/4109] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:32 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:32.518458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dd753f03-2b16-44b7-8d4e-6bc84ca65537 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:32.527886 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dd753f03-2b16-44b7-8d4e-6bc84ca65537 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1323 microversion: 2.1 time: 0.259714 May 28 21:20:32.528911 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2078/4110] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:32 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1323 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:33.518389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d8d47f93-f1ec-43fe-ba28-b4b029cfafca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:33.520122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d8d47f93-f1ec-43fe-ba28-b4b029cfafca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:33.545208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8d47f93-f1ec-43fe-ba28-b4b029cfafca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:33.546380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8d47f93-f1ec-43fe-ba28-b4b029cfafca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:33.547452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8d47f93-f1ec-43fe-ba28-b4b029cfafca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:33.548466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8d47f93-f1ec-43fe-ba28-b4b029cfafca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:33.549033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-108cfe2e-164a-4066-adca-5410850d8607 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:33.549886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-108cfe2e-164a-4066-adca-5410850d8607 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:33.561491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=8 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:20:33.836367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-108cfe2e-164a-4066-adca-5410850d8607 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:33.836367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-108cfe2e-164a-4066-adca-5410850d8607 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:33.836367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-108cfe2e-164a-4066-adca-5410850d8607 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:33.836367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-108cfe2e-164a-4066-adca-5410850d8607 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:33.839643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d8d47f93-f1ec-43fe-ba28-b4b029cfafca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:33.839643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d8d47f93-f1ec-43fe-ba28-b4b029cfafca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:33.839643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d8d47f93-f1ec-43fe-ba28-b4b029cfafca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:33.840515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-108cfe2e-164a-4066-adca-5410850d8607 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:33.844396 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-108cfe2e-164a-4066-adca-5410850d8607 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1323 microversion: 2.1 time: 0.302348 May 28 21:20:33.845344 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d8d47f93-f1ec-43fe-ba28-b4b029cfafca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1723 microversion: 2.20 time: 0.330532 May 28 21:20:33.846197 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2033/4111] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:33 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:33.851504 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2079/4112] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:33 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1323 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:33.852475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-19ab96a2-a11f-4fe4-ac1c-fdb9230794be req-07153876-3004-4747-bf31-8e3f4c433ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0bcc813-f74d-4596-94d1-ef3a21701a18", "name": "network-vif-plugged", "status": "completed", "tag": "b1dc2933-b701-47ed-a519-845aecb95dfd"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:33.866126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-19ab96a2-a11f-4fe4-ac1c-fdb9230794be req-07153876-3004-4747-bf31-8e3f4c433ea6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:33.866681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-19ab96a2-a11f-4fe4-ac1c-fdb9230794be req-07153876-3004-4747-bf31-8e3f4c433ea6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:33.885087 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-19ab96a2-a11f-4fe4-ac1c-fdb9230794be req-07153876-3004-4747-bf31-8e3f4c433ea6 service nova] Creating event network-vif-plugged:b1dc2933-b701-47ed-a519-845aecb95dfd for instance c0bcc813-f74d-4596-94d1-ef3a21701a18 on nch1-master-1 May 28 21:20:33.891845 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-19ab96a2-a11f-4fe4-ac1c-fdb9230794be req-07153876-3004-4747-bf31-8e3f4c433ea6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043624 May 28 21:20:33.892798 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2034/4113] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:20:34.446987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9374032f-6f3a-4a5a-9f4b-a125b0e6478c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:34.448039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9374032f-6f3a-4a5a-9f4b-a125b0e6478c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:34.454622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9374032f-6f3a-4a5a-9f4b-a125b0e6478c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:34.455316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9374032f-6f3a-4a5a-9f4b-a125b0e6478c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:34.456279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9374032f-6f3a-4a5a-9f4b-a125b0e6478c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:34.456930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9374032f-6f3a-4a5a-9f4b-a125b0e6478c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:34.715886 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9374032f-6f3a-4a5a-9f4b-a125b0e6478c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "POST /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2/action" status: 200 len: 40224 microversion: 2.32 time: 0.273781 May 28 21:20:34.717419 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2080/4114] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:20:34 2022] POST /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2/action => generated 40224 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 21:20:34.728665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ccb0393b-dfe1-4030-b45c-87c7211a8a86 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:34.729340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ccb0393b-dfe1-4030-b45c-87c7211a8a86 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:34.739157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccb0393b-dfe1-4030-b45c-87c7211a8a86 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:34.741226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccb0393b-dfe1-4030-b45c-87c7211a8a86 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:34.741226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccb0393b-dfe1-4030-b45c-87c7211a8a86 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:34.741226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccb0393b-dfe1-4030-b45c-87c7211a8a86 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:34.779851 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ccb0393b-dfe1-4030-b45c-87c7211a8a86 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:20:34.868099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-97c15c10-8509-46a2-be12-e396798fd0ac tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:34.869097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-97c15c10-8509-46a2-be12-e396798fd0ac tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:34.882693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97c15c10-8509-46a2-be12-e396798fd0ac tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:34.883147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97c15c10-8509-46a2-be12-e396798fd0ac tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:34.883939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97c15c10-8509-46a2-be12-e396798fd0ac tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:34.884382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97c15c10-8509-46a2-be12-e396798fd0ac tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:35.109688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-97c15c10-8509-46a2-be12-e396798fd0ac tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:35.125026 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ccb0393b-dfe1-4030-b45c-87c7211a8a86 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 204 len: 0 microversion: 2.32 time: 0.400529 May 28 21:20:35.129223 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2035/4115] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:20:34 2022] DELETE /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:20:35.129329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-97c15c10-8509-46a2-be12-e396798fd0ac tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:35.129329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-97c15c10-8509-46a2-be12-e396798fd0ac tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:35.131068 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-97c15c10-8509-46a2-be12-e396798fd0ac tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1723 microversion: 2.20 time: 0.269081 May 28 21:20:35.131644 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2081/4116] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:34 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:35.133571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1e33a216-4602-4e6e-8858-0f6521bcb74e tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:35.134348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1e33a216-4602-4e6e-8858-0f6521bcb74e tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:35.141172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e33a216-4602-4e6e-8858-0f6521bcb74e tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:35.141805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e33a216-4602-4e6e-8858-0f6521bcb74e tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:35.142765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e33a216-4602-4e6e-8858-0f6521bcb74e tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:35.143346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e33a216-4602-4e6e-8858-0f6521bcb74e tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:35.147968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0d1461e9-f2c3-41e8-8b9b-d40a850a2010 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:35.150352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0d1461e9-f2c3-41e8-8b9b-d40a850a2010 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:35.157586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d1461e9-f2c3-41e8-8b9b-d40a850a2010 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:35.158327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d1461e9-f2c3-41e8-8b9b-d40a850a2010 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:35.159129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d1461e9-f2c3-41e8-8b9b-d40a850a2010 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:35.159716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d1461e9-f2c3-41e8-8b9b-d40a850a2010 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:35.433652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1e33a216-4602-4e6e-8858-0f6521bcb74e tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:35.447602 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1e33a216-4602-4e6e-8858-0f6521bcb74e tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1323 microversion: 2.1 time: 0.314848 May 28 21:20:35.448259 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2036/4117] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:35 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:35.465362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0d1461e9-f2c3-41e8-8b9b-d40a850a2010 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:35.477740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0d1461e9-f2c3-41e8-8b9b-d40a850a2010 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:35.480280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0d1461e9-f2c3-41e8-8b9b-d40a850a2010 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:35.481657 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0d1461e9-f2c3-41e8-8b9b-d40a850a2010 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 2952 microversion: 2.32 time: 0.338716 May 28 21:20:35.482633 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2082/4118] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:35 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 2952 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:36.149119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ede53b31-0a9e-4e12-ae60-04150e4927af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:36.151428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ede53b31-0a9e-4e12-ae60-04150e4927af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:36.164253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ede53b31-0a9e-4e12-ae60-04150e4927af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:36.164724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ede53b31-0a9e-4e12-ae60-04150e4927af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:36.165512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ede53b31-0a9e-4e12-ae60-04150e4927af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:36.166022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ede53b31-0a9e-4e12-ae60-04150e4927af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:36.398069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ede53b31-0a9e-4e12-ae60-04150e4927af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:36.412409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ede53b31-0a9e-4e12-ae60-04150e4927af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:36.414057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ede53b31-0a9e-4e12-ae60-04150e4927af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:36.415307 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ede53b31-0a9e-4e12-ae60-04150e4927af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1723 microversion: 2.20 time: 0.270370 May 28 21:20:36.415869 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2037/4119] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:36 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:36.467267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3347c574-be73-482e-ae94-edc46390ecf2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:36.468026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3347c574-be73-482e-ae94-edc46390ecf2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:36.479852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:20:36.487346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3347c574-be73-482e-ae94-edc46390ecf2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:36.488262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3347c574-be73-482e-ae94-edc46390ecf2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:36.489114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3347c574-be73-482e-ae94-edc46390ecf2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:36.489736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3347c574-be73-482e-ae94-edc46390ecf2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:36.502986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4abc729b-1cfb-4b60-9856-9ad446b96b88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:36.503774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4abc729b-1cfb-4b60-9856-9ad446b96b88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:36.510809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4abc729b-1cfb-4b60-9856-9ad446b96b88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:36.511490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4abc729b-1cfb-4b60-9856-9ad446b96b88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:36.512438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4abc729b-1cfb-4b60-9856-9ad446b96b88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:36.513025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4abc729b-1cfb-4b60-9856-9ad446b96b88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:37.214432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3347c574-be73-482e-ae94-edc46390ecf2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:37.224033 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3347c574-be73-482e-ae94-edc46390ecf2 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1520 microversion: 2.1 time: 0.763256 May 28 21:20:37.224630 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2083/4120] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:36 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1520 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:37.257232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4abc729b-1cfb-4b60-9856-9ad446b96b88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:37.272741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4abc729b-1cfb-4b60-9856-9ad446b96b88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:37.274866 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4abc729b-1cfb-4b60-9856-9ad446b96b88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:37.276166 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4abc729b-1cfb-4b60-9856-9ad446b96b88 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 2952 microversion: 2.32 time: 0.778046 May 28 21:20:37.276750 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2038/4121] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:36 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 2952 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:20:37.421049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d3847e41-fd6d-44bb-bb66-c58559f1df54 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2021507975", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1b11d924-731c-41b3-84aa-d5be952a72df"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d3847e41-fd6d-44bb-bb66-c58559f1df54 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Request method failure captured: May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 243 May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpIT81kLaiuDIPDzvm13I2lw3p5PhP_Ih_E-kcDhlAgH47U4ZAueyv45UvAV_OLA5_9xqWZ10Jo1RxV_EhUhAU150BZEl4Ng8RXxRdeQD_cSNPsPrGd8CMJZfZTXjsl0sKh5CW6yETJobzhb-cHbetDq6Q-qRGdIbrtsxw3Z4m8Pk4Q May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f03a2cfe8fd94e4e8581358beadaf177", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 2fb3ef26871e4b30a9bc4a5045fe62ad May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2021507975", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "1b11d924-731c-41b3-84aa-d5be952a72df"}]}} May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2021507975', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '1b11d924-731c-41b3-84aa-d5be952a72df'}]}}} May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'': 'data1'} May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:20:37.424564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.427625 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.436345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a635d400-cb08-42bd-9168-ef4d35670bf8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:37.437419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a635d400-cb08-42bd-9168-ef4d35670bf8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:37.441014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d3847e41-fd6d-44bb-bb66-c58559f1df54 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:37.445079 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d3847e41-fd6d-44bb-bb66-c58559f1df54 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.027977 May 28 21:20:37.448316 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2084/4122] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:20:37 2022] POST /compute/v2.1/servers => generated 175 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:20:37.456504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a635d400-cb08-42bd-9168-ef4d35670bf8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:37.461795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-055a825f-63b4-4cee-aec2-9f09298585ea tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:37.462326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-055a825f-63b4-4cee-aec2-9f09298585ea tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: 5d438635-b564-4ef1-b896-6f8cf131f01d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:37.470281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a635d400-cb08-42bd-9168-ef4d35670bf8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:37.471291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a635d400-cb08-42bd-9168-ef4d35670bf8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:37.471700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a635d400-cb08-42bd-9168-ef4d35670bf8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:37.496688 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-055a825f-63b4-4cee-aec2-9f09298585ea tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] HTTP exception thrown: Instance 5d438635-b564-4ef1-b896-6f8cf131f01d could not be found. May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-055a825f-63b4-4cee-aec2-9f09298585ea tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Request method failure captured: May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/5d438635-b564-4ef1-b896-6f8cf131f01d/metadata HTTP/1.1 May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpIT81kLaiuDIPDzvm13I2lw3p5PhP_Ih_E-kcDhlAgH47U4ZAueyv45UvAV_OLA5_9xqWZ10Jo1RxV_EhUhAU150BZEl4Ng8RXxRdeQD_cSNPsPrGd8CMJZfZTXjsl0sKh5CW6yETJobzhb-cHbetDq6Q-qRGdIbrtsxw3Z4m8Pk4Q May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f03a2cfe8fd94e4e8581358beadaf177", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 2fb3ef26871e4b30a9bc4a5045fe62ad May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 5d438635-b564-4ef1-b896-6f8cf131f01d could not be found. May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'server_id': '5d438635-b564-4ef1-b896-6f8cf131f01d'} May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d438635-b564-4ef1-b896-6f8cf131f01d could not be found. May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d438635-b564-4ef1-b896-6f8cf131f01d could not be found. May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:37.517981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:37.521483 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:20:37.521483 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:20:37.521483 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d438635-b564-4ef1-b896-6f8cf131f01d could not be found. May 28 21:20:37.521483 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.521483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-055a825f-63b4-4cee-aec2-9f09298585ea tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Returning 404 to user: Instance 5d438635-b564-4ef1-b896-6f8cf131f01d could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:37.522912 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-055a825f-63b4-4cee-aec2-9f09298585ea tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/5d438635-b564-4ef1-b896-6f8cf131f01d/metadata" status: 404 len: 111 microversion: 2.1 time: 0.064885 May 28 21:20:37.524027 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2085/4123] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:20:37 2022] GET /compute/v2.1/servers/5d438635-b564-4ef1-b896-6f8cf131f01d/metadata => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:20:37.588782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-65440ee7-515a-4bee-a7e4-c147fa31f160 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-132072623", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1b11d924-731c-41b3-84aa-d5be952a72df"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-65440ee7-515a-4bee-a7e4-c147fa31f160 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Request method failure captured: May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 498 May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpIT81kLaiuDIPDzvm13I2lw3p5PhP_Ih_E-kcDhlAgH47U4ZAueyv45UvAV_OLA5_9xqWZ10Jo1RxV_EhUhAU150BZEl4Ng8RXxRdeQD_cSNPsPrGd8CMJZfZTXjsl0sKh5CW6yETJobzhb-cHbetDq6Q-qRGdIbrtsxw3Z4m8Pk4Q May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f03a2cfe8fd94e4e8581358beadaf177", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 2fb3ef26871e4b30a9bc4a5045fe62ad May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-132072623", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1b11d924-731c-41b3-84aa-d5be952a72df"}]}} May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-132072623', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1b11d924-731c-41b3-84aa-d5be952a72df'}]}}} May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 28 21:20:37.591845 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-65440ee7-515a-4bee-a7e4-c147fa31f160 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-65440ee7-515a-4bee-a7e4-c147fa31f160 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.014710 May 28 21:20:37.599770 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2086/4124] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:20:37 2022] POST /compute/v2.1/servers => generated 687 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:20:37.683583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c1deb564-2bc3-473b-806d-8fe7a51c24f7 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1204151307", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1b11d924-731c-41b3-84aa-d5be952a72df"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c1deb564-2bc3-473b-806d-8fe7a51c24f7 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Request method failure captured: May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 500 May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpIT81kLaiuDIPDzvm13I2lw3p5PhP_Ih_E-kcDhlAgH47U4ZAueyv45UvAV_OLA5_9xqWZ10Jo1RxV_EhUhAU150BZEl4Ng8RXxRdeQD_cSNPsPrGd8CMJZfZTXjsl0sKh5CW6yETJobzhb-cHbetDq6Q-qRGdIbrtsxw3Z4m8Pk4Q May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f03a2cfe8fd94e4e8581358beadaf177", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 2fb3ef26871e4b30a9bc4a5045fe62ad May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1204151307", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1b11d924-731c-41b3-84aa-d5be952a72df"}]}} May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1204151307', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1b11d924-731c-41b3-84aa-d5be952a72df'}]}}} May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 28 21:20:37.690205 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.693059 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.695785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c1deb564-2bc3-473b-806d-8fe7a51c24f7 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:37.696461 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c1deb564-2bc3-473b-806d-8fe7a51c24f7 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.016984 May 28 21:20:37.697057 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2087/4125] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:20:37 2022] POST /compute/v2.1/servers => generated 689 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:20:37.788173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9a0a1252-35b4-4829-ad34-d40ec1ed5861 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1653967442", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1b11d924-731c-41b3-84aa-d5be952a72df"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9a0a1252-35b4-4829-ad34-d40ec1ed5861 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Request method failure captured: May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 754 May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpIT81kLaiuDIPDzvm13I2lw3p5PhP_Ih_E-kcDhlAgH47U4ZAueyv45UvAV_OLA5_9xqWZ10Jo1RxV_EhUhAU150BZEl4Ng8RXxRdeQD_cSNPsPrGd8CMJZfZTXjsl0sKh5CW6yETJobzhb-cHbetDq6Q-qRGdIbrtsxw3Z4m8Pk4Q May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f03a2cfe8fd94e4e8581358beadaf177", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 2fb3ef26871e4b30a9bc4a5045fe62ad May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1653967442", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1b11d924-731c-41b3-84aa-d5be952a72df"}]}} May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1653967442', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1b11d924-731c-41b3-84aa-d5be952a72df'}]}}} May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:20:37.791174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:20:37.793407 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:20:37.795439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.795439 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.795439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9a0a1252-35b4-4829-ad34-d40ec1ed5861 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:37.795439 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9a0a1252-35b4-4829-ad34-d40ec1ed5861 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.009246 May 28 21:20:37.805870 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2088/4126] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:20:37 2022] POST /compute/v2.1/servers => generated 1197 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) May 28 21:20:37.850406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6c0db70e-e296-4dc6-8b29-b96bb88d431b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1750581321", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1b11d924-731c-41b3-84aa-d5be952a72df"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6c0db70e-e296-4dc6-8b29-b96bb88d431b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Request method failure captured: May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 1266 May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpIT81kLaiuDIPDzvm13I2lw3p5PhP_Ih_E-kcDhlAgH47U4ZAueyv45UvAV_OLA5_9xqWZ10Jo1RxV_EhUhAU150BZEl4Ng8RXxRdeQD_cSNPsPrGd8CMJZfZTXjsl0sKh5CW6yETJobzhb-cHbetDq6Q-qRGdIbrtsxw3Z4m8Pk4Q May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f03a2cfe8fd94e4e8581358beadaf177", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 2fb3ef26871e4b30a9bc4a5045fe62ad May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1750581321", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "1b11d924-731c-41b3-84aa-d5be952a72df"}]}} May 28 21:20:37.854147 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1750581321', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '1b11d924-731c-41b3-84aa-d5be952a72df'}]}}} May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'type': 'object'} May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.856129 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:20:37.859043 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:20:37.860876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' May 28 21:20:37.860876 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.860876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6c0db70e-e296-4dc6-8b29-b96bb88d431b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:37.860876 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6c0db70e-e296-4dc6-8b29-b96bb88d431b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.010604 May 28 21:20:37.862635 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2089/4127] 10.222.0.33 () {60 vars in 1147 bytes} [Sat May 28 21:20:37 2022] POST /compute/v2.1/servers => generated 2221 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) May 28 21:20:37.877200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-24f8279d-a99f-457b-88a1-f5f26a8dc640 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:37.880965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-24f8279d-a99f-457b-88a1-f5f26a8dc640 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: ea05735d-fd9f-4909-9655-eb376bfc7df8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:37.892071 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-24f8279d-a99f-457b-88a1-f5f26a8dc640 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] HTTP exception thrown: Instance ea05735d-fd9f-4909-9655-eb376bfc7df8 could not be found. May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-24f8279d-a99f-457b-88a1-f5f26a8dc640 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Request method failure captured: May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/ea05735d-fd9f-4909-9655-eb376bfc7df8/metadata/test2 HTTP/1.1 May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpIT81kLaiuDIPDzvm13I2lw3p5PhP_Ih_E-kcDhlAgH47U4ZAueyv45UvAV_OLA5_9xqWZ10Jo1RxV_EhUhAU150BZEl4Ng8RXxRdeQD_cSNPsPrGd8CMJZfZTXjsl0sKh5CW6yETJobzhb-cHbetDq6Q-qRGdIbrtsxw3Z4m8Pk4Q May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f03a2cfe8fd94e4e8581358beadaf177", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 2fb3ef26871e4b30a9bc4a5045fe62ad May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance ea05735d-fd9f-4909-9655-eb376bfc7df8 could not be found. May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'server_id': 'ea05735d-fd9f-4909-9655-eb376bfc7df8', 'id': 'test2'} May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea05735d-fd9f-4909-9655-eb376bfc7df8 could not be found. May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea05735d-fd9f-4909-9655-eb376bfc7df8 could not be found. May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:37.894179 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:37.897997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:20:37.897997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:20:37.897997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea05735d-fd9f-4909-9655-eb376bfc7df8 could not be found. May 28 21:20:37.897997 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:37.897997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-24f8279d-a99f-457b-88a1-f5f26a8dc640 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Returning 404 to user: Instance ea05735d-fd9f-4909-9655-eb376bfc7df8 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:37.899283 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-24f8279d-a99f-457b-88a1-f5f26a8dc640 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/ea05735d-fd9f-4909-9655-eb376bfc7df8/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.034933 May 28 21:20:37.900025 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2090/4128] 10.222.0.33 () {58 vars in 1280 bytes} [Sat May 28 21:20:37 2022] GET /compute/v2.1/servers/ea05735d-fd9f-4909-9655-eb376bfc7df8/metadata/test2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:20:37.918951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-915ef207-6b42-4de1-9ffd-4ad4588e282b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:37.919435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-915ef207-6b42-4de1-9ffd-4ad4588e282b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:37.920949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a635d400-cb08-42bd-9168-ef4d35670bf8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:37.928713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-915ef207-6b42-4de1-9ffd-4ad4588e282b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:37.929254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-915ef207-6b42-4de1-9ffd-4ad4588e282b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:37.931143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-915ef207-6b42-4de1-9ffd-4ad4588e282b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:37.931674 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-915ef207-6b42-4de1-9ffd-4ad4588e282b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:37.936557 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a635d400-cb08-42bd-9168-ef4d35670bf8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:37.939407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a635d400-cb08-42bd-9168-ef4d35670bf8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:37.940901 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a635d400-cb08-42bd-9168-ef4d35670bf8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1723 microversion: 2.20 time: 0.509880 May 28 21:20:37.952247 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2039/4129] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:37 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1723 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:20:37.971987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-915ef207-6b42-4de1-9ffd-4ad4588e282b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:20:38.305741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-35dc8661-79cb-4714-a026-5e6d02352d7f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:38.306798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-35dc8661-79cb-4714-a026-5e6d02352d7f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:38.327643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35dc8661-79cb-4714-a026-5e6d02352d7f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:38.330434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35dc8661-79cb-4714-a026-5e6d02352d7f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:38.331769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35dc8661-79cb-4714-a026-5e6d02352d7f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:38.333460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35dc8661-79cb-4714-a026-5e6d02352d7f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:38.393795 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-915ef207-6b42-4de1-9ffd-4ad4588e282b tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 204 len: 0 microversion: 2.1 time: 0.478391 May 28 21:20:38.394451 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2091/4130] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:20:37 2022] DELETE /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:20:38.403882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2082588f-b372-4456-b448-c52de850f93d tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:38.404657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2082588f-b372-4456-b448-c52de850f93d tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:38.419938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2082588f-b372-4456-b448-c52de850f93d tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:38.421032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2082588f-b372-4456-b448-c52de850f93d tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:38.423892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2082588f-b372-4456-b448-c52de850f93d tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:38.424553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2082588f-b372-4456-b448-c52de850f93d tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:38.643324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-35dc8661-79cb-4714-a026-5e6d02352d7f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:38.653654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-35dc8661-79cb-4714-a026-5e6d02352d7f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:38.655380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-35dc8661-79cb-4714-a026-5e6d02352d7f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:38.656632 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-35dc8661-79cb-4714-a026-5e6d02352d7f tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 2931 microversion: 2.32 time: 0.357350 May 28 21:20:38.658030 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2040/4131] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:38 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 2931 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:38.685610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2082588f-b372-4456-b448-c52de850f93d tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:38.694191 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2082588f-b372-4456-b448-c52de850f93d tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1526 microversion: 2.1 time: 0.295127 May 28 21:20:38.695081 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2092/4132] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:38 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1526 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:38.959802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f9356e6f-58c1-44aa-8b87-f2b755f4ed08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:38.960714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f9356e6f-58c1-44aa-8b87-f2b755f4ed08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:38.970666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9356e6f-58c1-44aa-8b87-f2b755f4ed08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:38.971269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9356e6f-58c1-44aa-8b87-f2b755f4ed08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:38.972260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9356e6f-58c1-44aa-8b87-f2b755f4ed08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:38.978379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9356e6f-58c1-44aa-8b87-f2b755f4ed08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:39.218664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f9356e6f-58c1-44aa-8b87-f2b755f4ed08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:39.231797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f9356e6f-58c1-44aa-8b87-f2b755f4ed08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:39.237669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f9356e6f-58c1-44aa-8b87-f2b755f4ed08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:39.239411 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f9356e6f-58c1-44aa-8b87-f2b755f4ed08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1723 microversion: 2.20 time: 0.283499 May 28 21:20:39.242651 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2041/4133] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:38 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:39.678748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f99a8798-dcd3-4a41-9b77-3069f496fa7b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:39.679602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f99a8798-dcd3-4a41-9b77-3069f496fa7b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:39.697681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f99a8798-dcd3-4a41-9b77-3069f496fa7b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:39.699440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f99a8798-dcd3-4a41-9b77-3069f496fa7b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:39.700388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f99a8798-dcd3-4a41-9b77-3069f496fa7b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:39.701759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f99a8798-dcd3-4a41-9b77-3069f496fa7b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:39.718717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d731770a-4d8d-4a68-bcb5-3e5242c2e115 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:39.720366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d731770a-4d8d-4a68-bcb5-3e5242c2e115 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:39.746236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d731770a-4d8d-4a68-bcb5-3e5242c2e115 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:39.747189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d731770a-4d8d-4a68-bcb5-3e5242c2e115 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:39.748846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d731770a-4d8d-4a68-bcb5-3e5242c2e115 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:39.750368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d731770a-4d8d-4a68-bcb5-3e5242c2e115 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:40.246011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f99a8798-dcd3-4a41-9b77-3069f496fa7b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:40.271758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f99a8798-dcd3-4a41-9b77-3069f496fa7b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:40.274945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f99a8798-dcd3-4a41-9b77-3069f496fa7b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:40.277956 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f99a8798-dcd3-4a41-9b77-3069f496fa7b tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 2910 microversion: 2.32 time: 0.603579 May 28 21:20:40.307046 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2093/4134] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:39 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 2910 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:40.321230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0483729d-06c2-4f9c-a4e5-ff882db340f3 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:40.324042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0483729d-06c2-4f9c-a4e5-ff882db340f3 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:40.346985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0483729d-06c2-4f9c-a4e5-ff882db340f3 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:40.349041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0483729d-06c2-4f9c-a4e5-ff882db340f3 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:40.351260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0483729d-06c2-4f9c-a4e5-ff882db340f3 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:40.352789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0483729d-06c2-4f9c-a4e5-ff882db340f3 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:40.465342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d731770a-4d8d-4a68-bcb5-3e5242c2e115 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:40.481151 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d731770a-4d8d-4a68-bcb5-3e5242c2e115 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1526 microversion: 2.1 time: 0.771503 May 28 21:20:40.482667 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2042/4135] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:39 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1526 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:20:40.691434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-0869c182-d63a-4f84-ba7e-fa41bffac3f7 req-3cf30027-dd6b-4ba1-884f-93d1274f2aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "name": "network-vif-deleted", "tag": "bd03c494-abd0-49ea-9ef3-2c2229cfd371"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:40.700609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0869c182-d63a-4f84-ba7e-fa41bffac3f7 req-3cf30027-dd6b-4ba1-884f-93d1274f2aec service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:40.709260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0869c182-d63a-4f84-ba7e-fa41bffac3f7 req-3cf30027-dd6b-4ba1-884f-93d1274f2aec service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:40.709260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:20:40.709435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0483729d-06c2-4f9c-a4e5-ff882db340f3 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:40.719190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0483729d-06c2-4f9c-a4e5-ff882db340f3 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:40.723691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0483729d-06c2-4f9c-a4e5-ff882db340f3 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:40.724179 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-0869c182-d63a-4f84-ba7e-fa41bffac3f7 req-3cf30027-dd6b-4ba1-884f-93d1274f2aec service nova] Creating event network-vif-deleted:bd03c494-abd0-49ea-9ef3-2c2229cfd371 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:20:40.731913 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-0869c182-d63a-4f84-ba7e-fa41bffac3f7 req-3cf30027-dd6b-4ba1-884f-93d1274f2aec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050318 May 28 21:20:40.732630 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2043/4136] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:20:40.733301 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0483729d-06c2-4f9c-a4e5-ff882db340f3 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1723 microversion: 2.20 time: 0.424784 May 28 21:20:40.733907 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2094/4137] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:40 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1723 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:41.306647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-76d758a5-a6d1-493a-8799-b2c3ef47eb05 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:41.308362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-76d758a5-a6d1-493a-8799-b2c3ef47eb05 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:41.335184 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-76d758a5-a6d1-493a-8799-b2c3ef47eb05 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:41.335655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-76d758a5-a6d1-493a-8799-b2c3ef47eb05 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:41.339165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-76d758a5-a6d1-493a-8799-b2c3ef47eb05 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:41.342641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-76d758a5-a6d1-493a-8799-b2c3ef47eb05 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:41.500801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e23bf49d-bbc6-4754-b161-3a42b125ba13 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:41.503335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e23bf49d-bbc6-4754-b161-3a42b125ba13 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:41.516399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e23bf49d-bbc6-4754-b161-3a42b125ba13 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:41.518313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e23bf49d-bbc6-4754-b161-3a42b125ba13 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:41.520693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e23bf49d-bbc6-4754-b161-3a42b125ba13 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:41.521512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e23bf49d-bbc6-4754-b161-3a42b125ba13 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:41.568722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e23bf49d-bbc6-4754-b161-3a42b125ba13 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:41.569304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e23bf49d-bbc6-4754-b161-3a42b125ba13 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:41.569915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-e23bf49d-bbc6-4754-b161-3a42b125ba13 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lazy-loading 'fault' on Instance uuid c0bcc813-f74d-4596-94d1-ef3a21701a18 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:20:41.786215 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e23bf49d-bbc6-4754-b161-3a42b125ba13 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fb3ef26871e4b30a9bc4a5045fe62ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f03a2cfe8fd94e4e8581358beadaf177', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:41.798505 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e23bf49d-bbc6-4754-b161-3a42b125ba13 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 200 len: 1313 microversion: 2.1 time: 0.303517 May 28 21:20:41.799122 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2095/4138] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:41 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:41.821031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c8c87180-c056-4ce0-a544-5e04a9f9ce9d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:41.821678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c8c87180-c056-4ce0-a544-5e04a9f9ce9d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:41.832721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8c87180-c056-4ce0-a544-5e04a9f9ce9d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:41.833189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8c87180-c056-4ce0-a544-5e04a9f9ce9d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:41.838209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8c87180-c056-4ce0-a544-5e04a9f9ce9d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:41.838687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8c87180-c056-4ce0-a544-5e04a9f9ce9d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:42.083827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-76d758a5-a6d1-493a-8799-b2c3ef47eb05 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:42.108075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-76d758a5-a6d1-493a-8799-b2c3ef47eb05 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:42.110710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-76d758a5-a6d1-493a-8799-b2c3ef47eb05 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:42.113928 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-76d758a5-a6d1-493a-8799-b2c3ef47eb05 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 2750 microversion: 2.32 time: 0.814049 May 28 21:20:42.117178 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2044/4139] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:41 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 2750 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:42.406136 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-cd1d2bbc-fa74-4fcd-a765-4867c704d353 req-435e8fe3-587e-47fb-bfc0-09d4928bf85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "name": "network-vif-unplugged", "status": "completed", "tag": "8441633d-d2d5-43e9-899c-acfbbc72f929"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:42.435308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cd1d2bbc-fa74-4fcd-a765-4867c704d353 req-435e8fe3-587e-47fb-bfc0-09d4928bf85d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:42.435771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cd1d2bbc-fa74-4fcd-a765-4867c704d353 req-435e8fe3-587e-47fb-bfc0-09d4928bf85d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:42.436043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c8c87180-c056-4ce0-a544-5e04a9f9ce9d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:42.460135 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c8c87180-c056-4ce0-a544-5e04a9f9ce9d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:42.460619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c8c87180-c056-4ce0-a544-5e04a9f9ce9d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:42.468994 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c8c87180-c056-4ce0-a544-5e04a9f9ce9d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1723 microversion: 2.20 time: 0.652058 May 28 21:20:42.473076 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2096/4140] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:41 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1723 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:42.477787 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-cd1d2bbc-fa74-4fcd-a765-4867c704d353 req-435e8fe3-587e-47fb-bfc0-09d4928bf85d service nova] Creating event network-vif-unplugged:8441633d-d2d5-43e9-899c-acfbbc72f929 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:20:42.490901 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-cd1d2bbc-fa74-4fcd-a765-4867c704d353 req-435e8fe3-587e-47fb-bfc0-09d4928bf85d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088120 May 28 21:20:42.491978 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2045/4141] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:20:42.773467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-4fb75167-cd17-4638-af91-9fd78528c892 req-e776bef1-faf7-405f-91ee-fdae874d4525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0bcc813-f74d-4596-94d1-ef3a21701a18", "name": "network-vif-deleted", "tag": "b1dc2933-b701-47ed-a519-845aecb95dfd"}, {"server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "name": "network-vif-deleted", "tag": "f081357a-b6d4-48c4-bf24-83685b0f0b05"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:42.787273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4fb75167-cd17-4638-af91-9fd78528c892 req-e776bef1-faf7-405f-91ee-fdae874d4525 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:42.788405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4fb75167-cd17-4638-af91-9fd78528c892 req-e776bef1-faf7-405f-91ee-fdae874d4525 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:42.816159 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-4fb75167-cd17-4638-af91-9fd78528c892 req-e776bef1-faf7-405f-91ee-fdae874d4525 service nova] Creating event network-vif-deleted:b1dc2933-b701-47ed-a519-845aecb95dfd for instance c0bcc813-f74d-4596-94d1-ef3a21701a18 on nch1-master-1 May 28 21:20:42.818334 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-4fb75167-cd17-4638-af91-9fd78528c892 req-e776bef1-faf7-405f-91ee-fdae874d4525 service nova] Creating event network-vif-deleted:f081357a-b6d4-48c4-bf24-83685b0f0b05 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:20:42.820622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0031471b-9ccb-4518-a0a7-0283687a28f0 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:42.824878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0031471b-9ccb-4518-a0a7-0283687a28f0 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] [instance: c0bcc813-f74d-4596-94d1-ef3a21701a18] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:42.841715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0031471b-9ccb-4518-a0a7-0283687a28f0 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:42.841715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0031471b-9ccb-4518-a0a7-0283687a28f0 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:42.841715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0031471b-9ccb-4518-a0a7-0283687a28f0 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:42.841715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0031471b-9ccb-4518-a0a7-0283687a28f0 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:42.854843 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-4fb75167-cd17-4638-af91-9fd78528c892 req-e776bef1-faf7-405f-91ee-fdae874d4525 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079139 May 28 21:20:42.854843 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2097/4142] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:20:42.883622 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-0031471b-9ccb-4518-a0a7-0283687a28f0 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] HTTP exception thrown: Instance c0bcc813-f74d-4596-94d1-ef3a21701a18 could not be found. May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0031471b-9ccb-4518-a0a7-0283687a28f0 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Request method failure captured: May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 HTTP/1.1 May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpIT81kLaiuDIPDzvm13I2lw3p5PhP_Ih_E-kcDhlAgH47U4ZAueyv45UvAV_OLA5_9xqWZ10Jo1RxV_EhUhAU150BZEl4Ng8RXxRdeQD_cSNPsPrGd8CMJZfZTXjsl0sKh5CW6yETJobzhb-cHbetDq6Q-qRGdIbrtsxw3Z4m8Pk4Q May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f03a2cfe8fd94e4e8581358beadaf177", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f03a2cfe8fd94e4e8581358beadaf177"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: f03a2cfe8fd94e4e8581358beadaf177 May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-682516032 May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 2fb3ef26871e4b30a9bc4a5045fe62ad May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-682516032-project May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance c0bcc813-f74d-4596-94d1-ef3a21701a18 could not be found. May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'c0bcc813-f74d-4596-94d1-ef3a21701a18'} May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0bcc813-f74d-4596-94d1-ef3a21701a18 could not be found. May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0bcc813-f74d-4596-94d1-ef3a21701a18 could not be found. May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:42.886985 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:42.890822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:42.890822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:42.890822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:42.890822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:42.890822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:20:42.890822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:20:42.890822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0bcc813-f74d-4596-94d1-ef3a21701a18 could not be found. May 28 21:20:42.890822 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:20:42.892817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0031471b-9ccb-4518-a0a7-0283687a28f0 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] Returning 404 to user: Instance c0bcc813-f74d-4596-94d1-ef3a21701a18 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:42.893928 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0031471b-9ccb-4518-a0a7-0283687a28f0 tempest-ServerMetadataNegativeTestJSON-682516032 tempest-ServerMetadataNegativeTestJSON-682516032-project] 10.222.0.33 "GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18" status: 404 len: 111 microversion: 2.1 time: 0.081340 May 28 21:20:42.895071 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2046/4143] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:42 2022] GET /compute/v2.1/servers/c0bcc813-f74d-4596-94d1-ef3a21701a18 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:20:43.139965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-af76fa4a-dd4f-4365-93a4-c15014068cf3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:43.140831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-af76fa4a-dd4f-4365-93a4-c15014068cf3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:43.153450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af76fa4a-dd4f-4365-93a4-c15014068cf3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:43.153947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af76fa4a-dd4f-4365-93a4-c15014068cf3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:43.154756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af76fa4a-dd4f-4365-93a4-c15014068cf3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:43.155210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af76fa4a-dd4f-4365-93a4-c15014068cf3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:43.165171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:20:43.493755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1e2204e2-8a11-4a1b-a33c-7dce78a23ebf tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:43.494419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1e2204e2-8a11-4a1b-a33c-7dce78a23ebf tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:43.508922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e2204e2-8a11-4a1b-a33c-7dce78a23ebf tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:43.509340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e2204e2-8a11-4a1b-a33c-7dce78a23ebf tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:43.512446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e2204e2-8a11-4a1b-a33c-7dce78a23ebf tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:43.512927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e2204e2-8a11-4a1b-a33c-7dce78a23ebf tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:43.751229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-af76fa4a-dd4f-4365-93a4-c15014068cf3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:43.763244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-af76fa4a-dd4f-4365-93a4-c15014068cf3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:43.765295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-af76fa4a-dd4f-4365-93a4-c15014068cf3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:43.767520 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-af76fa4a-dd4f-4365-93a4-c15014068cf3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 2590 microversion: 2.32 time: 0.632049 May 28 21:20:43.769622 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2098/4144] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:43 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 2590 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:44.335651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1e2204e2-8a11-4a1b-a33c-7dce78a23ebf tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:44.359173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1e2204e2-8a11-4a1b-a33c-7dce78a23ebf tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:44.365408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1e2204e2-8a11-4a1b-a33c-7dce78a23ebf tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:44.368790 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1e2204e2-8a11-4a1b-a33c-7dce78a23ebf tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1744 microversion: 2.20 time: 0.879857 May 28 21:20:44.370014 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2047/4145] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:43 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1744 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:44.541874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-806cfee4-3247-485f-b5ee-84ec612aa196 req-43053891-789e-4b71-af89-3479efbf2db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "name": "network-vif-unplugged", "status": "completed", "tag": "deee404e-9d98-4fc9-a566-770085e51d43"}, {"server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "name": "network-vif-unplugged", "status": "completed", "tag": "41835e77-75bb-49d7-a493-54f3f8518d81"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:44.552296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-806cfee4-3247-485f-b5ee-84ec612aa196 req-43053891-789e-4b71-af89-3479efbf2db8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:44.553238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-806cfee4-3247-485f-b5ee-84ec612aa196 req-43053891-789e-4b71-af89-3479efbf2db8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:44.566643 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-806cfee4-3247-485f-b5ee-84ec612aa196 req-43053891-789e-4b71-af89-3479efbf2db8 service nova] Creating event network-vif-unplugged:deee404e-9d98-4fc9-a566-770085e51d43 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:20:44.567443 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-806cfee4-3247-485f-b5ee-84ec612aa196 req-43053891-789e-4b71-af89-3479efbf2db8 service nova] Creating event network-vif-unplugged:41835e77-75bb-49d7-a493-54f3f8518d81 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:20:44.575189 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-806cfee4-3247-485f-b5ee-84ec612aa196 req-43053891-789e-4b71-af89-3479efbf2db8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.036942 May 28 21:20:44.575879 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2099/4146] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:20:44.790743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ab284c05-7c6a-444f-b1d1-be17552ff707 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:44.791385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ab284c05-7c6a-444f-b1d1-be17552ff707 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:44.801445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab284c05-7c6a-444f-b1d1-be17552ff707 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:44.801972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab284c05-7c6a-444f-b1d1-be17552ff707 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:44.802808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab284c05-7c6a-444f-b1d1-be17552ff707 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:44.810483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab284c05-7c6a-444f-b1d1-be17552ff707 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:45.025868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ab284c05-7c6a-444f-b1d1-be17552ff707 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:45.054653 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ab284c05-7c6a-444f-b1d1-be17552ff707 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:45.081943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ab284c05-7c6a-444f-b1d1-be17552ff707 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:45.084038 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ab284c05-7c6a-444f-b1d1-be17552ff707 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 2544 microversion: 2.32 time: 0.296815 May 28 21:20:45.102070 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2048/4147] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:44 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 2544 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:45.132501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-bbb68d47-99c6-4512-94e8-54925ea4171f req-d36fda28-e9b9-4d53-91c4-789b356f6375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "name": "network-vif-deleted", "tag": "8441633d-d2d5-43e9-899c-acfbbc72f929"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:45.146964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-bbb68d47-99c6-4512-94e8-54925ea4171f req-d36fda28-e9b9-4d53-91c4-789b356f6375 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:45.148146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-bbb68d47-99c6-4512-94e8-54925ea4171f req-d36fda28-e9b9-4d53-91c4-789b356f6375 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:45.168842 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-bbb68d47-99c6-4512-94e8-54925ea4171f req-d36fda28-e9b9-4d53-91c4-789b356f6375 service nova] Creating event network-vif-deleted:8441633d-d2d5-43e9-899c-acfbbc72f929 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:20:45.178308 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-bbb68d47-99c6-4512-94e8-54925ea4171f req-d36fda28-e9b9-4d53-91c4-789b356f6375 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057217 May 28 21:20:45.179389 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2100/4148] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:20:45.390264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f582c2c9-57b2-4eaa-aa59-f43d7fc9dcd0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:45.392896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f582c2c9-57b2-4eaa-aa59-f43d7fc9dcd0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:45.409302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f582c2c9-57b2-4eaa-aa59-f43d7fc9dcd0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:45.412871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f582c2c9-57b2-4eaa-aa59-f43d7fc9dcd0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:45.412871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f582c2c9-57b2-4eaa-aa59-f43d7fc9dcd0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:45.419092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f582c2c9-57b2-4eaa-aa59-f43d7fc9dcd0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:45.674270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f582c2c9-57b2-4eaa-aa59-f43d7fc9dcd0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:45.686398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f582c2c9-57b2-4eaa-aa59-f43d7fc9dcd0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:45.688582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f582c2c9-57b2-4eaa-aa59-f43d7fc9dcd0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:45.691718 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f582c2c9-57b2-4eaa-aa59-f43d7fc9dcd0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1739 microversion: 2.20 time: 0.307456 May 28 21:20:45.694539 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2049/4149] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:45 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:46.115746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-09df764b-d02b-4450-9ac9-c3df5c3a658d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:46.116620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-09df764b-d02b-4450-9ac9-c3df5c3a658d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:46.155913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-09df764b-d02b-4450-9ac9-c3df5c3a658d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:46.156952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-09df764b-d02b-4450-9ac9-c3df5c3a658d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:46.160683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-09df764b-d02b-4450-9ac9-c3df5c3a658d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:46.162265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-09df764b-d02b-4450-9ac9-c3df5c3a658d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:46.665406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-09df764b-d02b-4450-9ac9-c3df5c3a658d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:46.679260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-7560e140-0ff5-4380-a530-715ba422b4c5 req-d2d593ef-bf8b-4898-bb2d-066cd7231242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6232e7b0-68db-43d6-a836-fb2f96c54658", "name": "network-vif-plugged", "status": "completed", "tag": "5f12e599-b5ae-4dcf-ac2c-9827b4ca4a75"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:46.692100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-09df764b-d02b-4450-9ac9-c3df5c3a658d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:46.701682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-09df764b-d02b-4450-9ac9-c3df5c3a658d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:46.704856 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-09df764b-d02b-4450-9ac9-c3df5c3a658d tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 2259 microversion: 2.32 time: 0.598918 May 28 21:20:46.706687 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2101/4150] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:46 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 2259 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:46.717510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-61e58418-4e1b-4f5e-ab19-058d7a8e32ec tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:46.718832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-61e58418-4e1b-4f5e-ab19-058d7a8e32ec tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:46.721279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7560e140-0ff5-4380-a530-715ba422b4c5 req-d2d593ef-bf8b-4898-bb2d-066cd7231242 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:46.721962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7560e140-0ff5-4380-a530-715ba422b4c5 req-d2d593ef-bf8b-4898-bb2d-066cd7231242 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:46.745164 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61e58418-4e1b-4f5e-ab19-058d7a8e32ec tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:46.745990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61e58418-4e1b-4f5e-ab19-058d7a8e32ec tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:46.750127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61e58418-4e1b-4f5e-ab19-058d7a8e32ec tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:46.752637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61e58418-4e1b-4f5e-ab19-058d7a8e32ec tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:46.780007 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-7560e140-0ff5-4380-a530-715ba422b4c5 req-d2d593ef-bf8b-4898-bb2d-066cd7231242 service nova] Creating event network-vif-plugged:5f12e599-b5ae-4dcf-ac2c-9827b4ca4a75 for instance 6232e7b0-68db-43d6-a836-fb2f96c54658 on nch2-master-1 May 28 21:20:46.795970 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-7560e140-0ff5-4380-a530-715ba422b4c5 req-d2d593ef-bf8b-4898-bb2d-066cd7231242 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121061 May 28 21:20:46.798630 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2050/4151] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:20:47.236818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-e30e1274-447a-43c5-a6b7-52425824b86a req-6611b3dc-1cd5-49ec-8d26-af4276185170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "name": "network-vif-deleted", "tag": "41835e77-75bb-49d7-a493-54f3f8518d81"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:47.272301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e30e1274-447a-43c5-a6b7-52425824b86a req-6611b3dc-1cd5-49ec-8d26-af4276185170 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:47.273252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e30e1274-447a-43c5-a6b7-52425824b86a req-6611b3dc-1cd5-49ec-8d26-af4276185170 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:47.311823 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e30e1274-447a-43c5-a6b7-52425824b86a req-6611b3dc-1cd5-49ec-8d26-af4276185170 service nova] Creating event network-vif-deleted:41835e77-75bb-49d7-a493-54f3f8518d81 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:20:47.327462 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-e30e1274-447a-43c5-a6b7-52425824b86a req-6611b3dc-1cd5-49ec-8d26-af4276185170 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094476 May 28 21:20:47.331682 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2051/4152] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:20:47.340108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-61e58418-4e1b-4f5e-ab19-058d7a8e32ec tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:47.350915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-61e58418-4e1b-4f5e-ab19-058d7a8e32ec tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:47.353300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-61e58418-4e1b-4f5e-ab19-058d7a8e32ec tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:47.354746 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-61e58418-4e1b-4f5e-ab19-058d7a8e32ec tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1739 microversion: 2.20 time: 0.643458 May 28 21:20:47.355976 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2102/4153] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:46 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1739 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:47.726814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d25268c9-c63e-4650-a253-78d1f1ebc737 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:47.727534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d25268c9-c63e-4650-a253-78d1f1ebc737 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:47.744350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d25268c9-c63e-4650-a253-78d1f1ebc737 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:47.748009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d25268c9-c63e-4650-a253-78d1f1ebc737 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:47.749008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d25268c9-c63e-4650-a253-78d1f1ebc737 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:47.749606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d25268c9-c63e-4650-a253-78d1f1ebc737 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:47.971958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d25268c9-c63e-4650-a253-78d1f1ebc737 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:47.987529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d25268c9-c63e-4650-a253-78d1f1ebc737 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:47.989449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d25268c9-c63e-4650-a253-78d1f1ebc737 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:47.990942 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d25268c9-c63e-4650-a253-78d1f1ebc737 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 2032 microversion: 2.32 time: 0.269447 May 28 21:20:47.991511 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2052/4154] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:47 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 2032 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:48.402855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a8539353-7f48-4ac8-a33d-c37eb9c6c891 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:48.402855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a8539353-7f48-4ac8-a33d-c37eb9c6c891 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:48.409254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8539353-7f48-4ac8-a33d-c37eb9c6c891 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:48.411972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8539353-7f48-4ac8-a33d-c37eb9c6c891 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:48.414368 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8539353-7f48-4ac8-a33d-c37eb9c6c891 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:48.416091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8539353-7f48-4ac8-a33d-c37eb9c6c891 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:48.870880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a8539353-7f48-4ac8-a33d-c37eb9c6c891 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:48.883735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a8539353-7f48-4ac8-a33d-c37eb9c6c891 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:48.885949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a8539353-7f48-4ac8-a33d-c37eb9c6c891 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:48.888194 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a8539353-7f48-4ac8-a33d-c37eb9c6c891 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1739 microversion: 2.20 time: 0.516501 May 28 21:20:48.889037 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2103/4155] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:48 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1739 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:49.012595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9218eb0e-84b8-4ca6-b698-2f5a39bee571 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:49.014281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9218eb0e-84b8-4ca6-b698-2f5a39bee571 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:49.029719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9218eb0e-84b8-4ca6-b698-2f5a39bee571 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:49.030532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9218eb0e-84b8-4ca6-b698-2f5a39bee571 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:49.032631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9218eb0e-84b8-4ca6-b698-2f5a39bee571 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:49.033230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9218eb0e-84b8-4ca6-b698-2f5a39bee571 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:49.159036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9218eb0e-84b8-4ca6-b698-2f5a39bee571 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:49.184585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9218eb0e-84b8-4ca6-b698-2f5a39bee571 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:49.197243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9218eb0e-84b8-4ca6-b698-2f5a39bee571 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:49.205535 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9218eb0e-84b8-4ca6-b698-2f5a39bee571 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1605 microversion: 2.32 time: 0.196210 May 28 21:20:49.208455 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2053/4156] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:49 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1605 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:49.357861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-700297ad-9d1c-4eae-b2fe-eb12ef5f763e req-8c87f5a9-0feb-402d-9e84-a0e6816ea24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca51ad7-e610-463b-b962-238f2430c5a2", "name": "network-vif-deleted", "tag": "deee404e-9d98-4fc9-a566-770085e51d43"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:49.384281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-700297ad-9d1c-4eae-b2fe-eb12ef5f763e req-8c87f5a9-0feb-402d-9e84-a0e6816ea24f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:49.390192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-700297ad-9d1c-4eae-b2fe-eb12ef5f763e req-8c87f5a9-0feb-402d-9e84-a0e6816ea24f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:49.440465 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-700297ad-9d1c-4eae-b2fe-eb12ef5f763e req-8c87f5a9-0feb-402d-9e84-a0e6816ea24f service nova] Creating event network-vif-deleted:deee404e-9d98-4fc9-a566-770085e51d43 for instance cca51ad7-e610-463b-b962-238f2430c5a2 on nch1-master-1 May 28 21:20:49.459229 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-700297ad-9d1c-4eae-b2fe-eb12ef5f763e req-8c87f5a9-0feb-402d-9e84-a0e6816ea24f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105931 May 28 21:20:49.464179 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2104/4157] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:20:49.909253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a84c9670-27ae-42d8-84e0-fd10c3dcf0d0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:49.915712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a84c9670-27ae-42d8-84e0-fd10c3dcf0d0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:49.934297 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a84c9670-27ae-42d8-84e0-fd10c3dcf0d0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:49.947568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a84c9670-27ae-42d8-84e0-fd10c3dcf0d0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:49.953758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a84c9670-27ae-42d8-84e0-fd10c3dcf0d0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:49.954413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a84c9670-27ae-42d8-84e0-fd10c3dcf0d0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:50.232082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-87d7901b-a1f8-4f96-9c98-87b6970dba7c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:50.232892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-87d7901b-a1f8-4f96-9c98-87b6970dba7c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:50.262003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87d7901b-a1f8-4f96-9c98-87b6970dba7c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:50.262003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87d7901b-a1f8-4f96-9c98-87b6970dba7c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:50.263439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87d7901b-a1f8-4f96-9c98-87b6970dba7c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:50.265927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87d7901b-a1f8-4f96-9c98-87b6970dba7c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:50.407201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87d7901b-a1f8-4f96-9c98-87b6970dba7c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:50.407669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87d7901b-a1f8-4f96-9c98-87b6970dba7c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:50.411207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-87d7901b-a1f8-4f96-9c98-87b6970dba7c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lazy-loading 'fault' on Instance uuid cca51ad7-e610-463b-b962-238f2430c5a2 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:20:50.622712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-87d7901b-a1f8-4f96-9c98-87b6970dba7c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:50.645632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-87d7901b-a1f8-4f96-9c98-87b6970dba7c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:50.650644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-87d7901b-a1f8-4f96-9c98-87b6970dba7c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cafc81a185c645e893a77b7fd297d950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f20390f83d3407e93a3d8d2a196281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:50.659669 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-87d7901b-a1f8-4f96-9c98-87b6970dba7c tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 200 len: 1610 microversion: 2.32 time: 0.428437 May 28 21:20:50.672653 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2105/4158] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:50 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 1610 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:20:50.826781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a84c9670-27ae-42d8-84e0-fd10c3dcf0d0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:50.837122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a84c9670-27ae-42d8-84e0-fd10c3dcf0d0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:50.842098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a84c9670-27ae-42d8-84e0-fd10c3dcf0d0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:50.844574 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a84c9670-27ae-42d8-84e0-fd10c3dcf0d0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1739 microversion: 2.20 time: 0.940634 May 28 21:20:50.858517 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2054/4159] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:49 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1739 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:51.688229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7b431b39-c49a-4d72-8e2e-4019afd83795 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:51.689651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7b431b39-c49a-4d72-8e2e-4019afd83795 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] [instance: cca51ad7-e610-463b-b962-238f2430c5a2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:51.700113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b431b39-c49a-4d72-8e2e-4019afd83795 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:51.700957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b431b39-c49a-4d72-8e2e-4019afd83795 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:51.702209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b431b39-c49a-4d72-8e2e-4019afd83795 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:51.702901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b431b39-c49a-4d72-8e2e-4019afd83795 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:51.752416 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-7b431b39-c49a-4d72-8e2e-4019afd83795 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] HTTP exception thrown: Instance cca51ad7-e610-463b-b962-238f2430c5a2 could not be found. May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7b431b39-c49a-4d72-8e2e-4019afd83795 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Request method failure captured: May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 HTTP/1.1 May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpASZpWuqsPBMAi3iTadBVfeiImgTOOwKMH4ULHfngk9W0dwCYl5qImec84wuE4H1TY2B8j9V6m8j6WN1Qe0nv6BEFm4Za09oGwCvB01vsveYLSPxelhtz-EbpeqzKzWA6DX2_VVZn-g-YvLzL-NdAC2O5v0Rp8r4m3IEU6zUJv6Dzg May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Openstack-Nova-Api-Version: 2.32 May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 8f20390f83d3407e93a3d8d2a196281b May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TaggedBootDevicesTest-427054523 May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8f20390f83d3407e93a3d8d2a196281b", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f20390f83d3407e93a3d8d2a196281b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8f20390f83d3407e93a3d8d2a196281b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8f20390f83d3407e93a3d8d2a196281b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TaggedBootDevicesTest-427054523 May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 8f20390f83d3407e93a3d8d2a196281b May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TaggedBootDevicesTest-427054523 May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TaggedBootDevicesTest-427054523-project May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: cafc81a185c645e893a77b7fd297d950 May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TaggedBootDevicesTest-427054523-project May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance cca51ad7-e610-463b-b962-238f2430c5a2 could not be found. May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'cca51ad7-e610-463b-b962-238f2430c5a2'} May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca51ad7-e610-463b-b962-238f2430c5a2 could not be found. May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca51ad7-e610-463b-b962-238f2430c5a2 could not be found. May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:20:51.759655 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:51.767912 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:20:51.767912 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:20:51.767912 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:20:51.767912 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:20:51.767912 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:20:51.767912 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca51ad7-e610-463b-b962-238f2430c5a2 could not be found. May 28 21:20:51.767912 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:20:51.769885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7b431b39-c49a-4d72-8e2e-4019afd83795 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Returning 404 to user: Instance cca51ad7-e610-463b-b962-238f2430c5a2 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:20:51.770859 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7b431b39-c49a-4d72-8e2e-4019afd83795 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2" status: 404 len: 111 microversion: 2.32 time: 0.087752 May 28 21:20:51.771658 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2106/4160] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:51 2022] GET /compute/v2.1/servers/cca51ad7-e610-463b-b962-238f2430c5a2 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:20:51.869196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5bee72e3-a7c0-4c3b-a1cf-8e284f884264 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:51.870087 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5bee72e3-a7c0-4c3b-a1cf-8e284f884264 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:51.879567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bee72e3-a7c0-4c3b-a1cf-8e284f884264 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:51.880031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bee72e3-a7c0-4c3b-a1cf-8e284f884264 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:51.880943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bee72e3-a7c0-4c3b-a1cf-8e284f884264 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:51.881551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bee72e3-a7c0-4c3b-a1cf-8e284f884264 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:51.923336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-838cbac5-ca77-48b6-bce6-f1130b8aa7b3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] Calling method '.version_select at 0x7f4d69c2d5e0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:52.019175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5bee72e3-a7c0-4c3b-a1cf-8e284f884264 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:52.030901 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-838cbac5-ca77-48b6-bce6-f1130b8aa7b3 tempest-TaggedBootDevicesTest-427054523 tempest-TaggedBootDevicesTest-427054523-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065388250" status: 204 len: 0 microversion: 2.32 time: 0.119584 May 28 21:20:52.030901 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2107/4161] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:20:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2065388250 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 28 21:20:52.042683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5bee72e3-a7c0-4c3b-a1cf-8e284f884264 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:52.042683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5bee72e3-a7c0-4c3b-a1cf-8e284f884264 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:52.042683 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5bee72e3-a7c0-4c3b-a1cf-8e284f884264 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1739 microversion: 2.20 time: 0.170875 May 28 21:20:52.042683 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2055/4162] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:51 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:53.059284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cd361215-090c-4373-960b-5980158abc3a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:53.060658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cd361215-090c-4373-960b-5980158abc3a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:53.119981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd361215-090c-4373-960b-5980158abc3a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:53.122566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd361215-090c-4373-960b-5980158abc3a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:53.123738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd361215-090c-4373-960b-5980158abc3a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:53.128297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd361215-090c-4373-960b-5980158abc3a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:53.520716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cd361215-090c-4373-960b-5980158abc3a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:53.550963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cd361215-090c-4373-960b-5980158abc3a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:53.564891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cd361215-090c-4373-960b-5980158abc3a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:53.568870 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cd361215-090c-4373-960b-5980158abc3a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1739 microversion: 2.20 time: 0.513535 May 28 21:20:53.578065 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2108/4163] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:53 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1739 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:53.774595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-465762133", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "be68ec51-0c83-4a48-a09e-37960ea0741f"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:20:53.859054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] validate_networks() for [('be68ec51-0c83-4a48-a09e-37960ea0741f', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:20:54.593814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7937775e-6492-4c37-aa62-1ea7fc1add3d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:54.598867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7937775e-6492-4c37-aa62-1ea7fc1add3d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:54.612476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7937775e-6492-4c37-aa62-1ea7fc1add3d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:54.613384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7937775e-6492-4c37-aa62-1ea7fc1add3d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:54.614426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7937775e-6492-4c37-aa62-1ea7fc1add3d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:54.615246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7937775e-6492-4c37-aa62-1ea7fc1add3d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:54.938580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7937775e-6492-4c37-aa62-1ea7fc1add3d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:54.958643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7937775e-6492-4c37-aa62-1ea7fc1add3d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:54.960520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7937775e-6492-4c37-aa62-1ea7fc1add3d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:54.962621 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7937775e-6492-4c37-aa62-1ea7fc1add3d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1739 microversion: 2.20 time: 0.373380 May 28 21:20:54.963376 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2109/4164] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:54 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1739 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:55.114018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:20:55.114771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:20:55.115271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:20:55.115754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:20:55.116228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:20:55.137183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:55.140014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:55.143709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:55.144111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:55.174155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Getting quotas for project 877bd1cd8912437c8e4871df8a5f7260. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:20:55.180136 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Getting quotas for user 84f18f11aad344c18bb6b3997370576b and project 877bd1cd8912437c8e4871df8a5f7260. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:20:55.196503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:20:55.199130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:20:55.346141 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-30c70c1d-f74d-455e-ad43-5ae9e669bf90 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.576563 May 28 21:20:55.347248 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2056/4165] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:20:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:20:55.360141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5b2d0de8-c43d-4a0e-80a5-eea418e6e4e8 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:55.361722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5b2d0de8-c43d-4a0e-80a5-eea418e6e4e8 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:55.530508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5b2d0de8-c43d-4a0e-80a5-eea418e6e4e8 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:55.538671 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5b2d0de8-c43d-4a0e-80a5-eea418e6e4e8 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1213 microversion: 2.1 time: 0.184055 May 28 21:20:55.551044 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2110/4166] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:55 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1213 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:55.981759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-04aaf4e7-f742-435f-ac2b-8a349ae1693a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:55.982698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-04aaf4e7-f742-435f-ac2b-8a349ae1693a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:55.996767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:20:56.000373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04aaf4e7-f742-435f-ac2b-8a349ae1693a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:56.002514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04aaf4e7-f742-435f-ac2b-8a349ae1693a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:56.003563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04aaf4e7-f742-435f-ac2b-8a349ae1693a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:56.006065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04aaf4e7-f742-435f-ac2b-8a349ae1693a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:56.412355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-04aaf4e7-f742-435f-ac2b-8a349ae1693a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:56.423747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-04aaf4e7-f742-435f-ac2b-8a349ae1693a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:56.425326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-04aaf4e7-f742-435f-ac2b-8a349ae1693a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:56.426516 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-04aaf4e7-f742-435f-ac2b-8a349ae1693a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1739 microversion: 2.20 time: 0.449879 May 28 21:20:56.427095 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2057/4167] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:55 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1739 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:56.563921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-df4b0012-9ccd-45ee-8535-6eff687b7b62 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:56.566389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-df4b0012-9ccd-45ee-8535-6eff687b7b62 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:56.713997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-df4b0012-9ccd-45ee-8535-6eff687b7b62 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:56.721969 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-df4b0012-9ccd-45ee-8535-6eff687b7b62 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1213 microversion: 2.1 time: 0.164022 May 28 21:20:56.722940 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2111/4168] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:56 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1213 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:20:57.452662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dfb8f9d2-d874-4b70-82c2-5bdd4a540ebe tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:57.453829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dfb8f9d2-d874-4b70-82c2-5bdd4a540ebe tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:57.471987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfb8f9d2-d874-4b70-82c2-5bdd4a540ebe tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:57.472178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfb8f9d2-d874-4b70-82c2-5bdd4a540ebe tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:57.489727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfb8f9d2-d874-4b70-82c2-5bdd4a540ebe tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:57.491138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfb8f9d2-d874-4b70-82c2-5bdd4a540ebe tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:57.740922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5ed55736-d118-4d06-bf36-b132be01beb5 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:57.741542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5ed55736-d118-4d06-bf36-b132be01beb5 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:57.761435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ed55736-d118-4d06-bf36-b132be01beb5 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:57.778842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ed55736-d118-4d06-bf36-b132be01beb5 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:57.780388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ed55736-d118-4d06-bf36-b132be01beb5 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:57.780964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ed55736-d118-4d06-bf36-b132be01beb5 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:58.268462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5ed55736-d118-4d06-bf36-b132be01beb5 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:58.282218 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5ed55736-d118-4d06-bf36-b132be01beb5 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1217 microversion: 2.1 time: 0.540704 May 28 21:20:58.283646 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2112/4169] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:57 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1217 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:20:58.778153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dfb8f9d2-d874-4b70-82c2-5bdd4a540ebe tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:58.799465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dfb8f9d2-d874-4b70-82c2-5bdd4a540ebe tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:58.804877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dfb8f9d2-d874-4b70-82c2-5bdd4a540ebe tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:58.807881 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dfb8f9d2-d874-4b70-82c2-5bdd4a540ebe tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1739 microversion: 2.20 time: 1.357693 May 28 21:20:58.819715 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2058/4170] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:57 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1739 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:20:59.306487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-541cb09d-71b1-4475-856a-046cfce73b6a tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:59.308345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-541cb09d-71b1-4475-856a-046cfce73b6a tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:59.341611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-541cb09d-71b1-4475-856a-046cfce73b6a tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:59.356455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-541cb09d-71b1-4475-856a-046cfce73b6a tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:59.357351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-541cb09d-71b1-4475-856a-046cfce73b6a tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:59.358351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-541cb09d-71b1-4475-856a-046cfce73b6a tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:59.827406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2263cfa6-d587-4bb1-80f8-d5f27c7792f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:20:59.828034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2263cfa6-d587-4bb1-80f8-d5f27c7792f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:20:59.855284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2263cfa6-d587-4bb1-80f8-d5f27c7792f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:59.857609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2263cfa6-d587-4bb1-80f8-d5f27c7792f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:59.860307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2263cfa6-d587-4bb1-80f8-d5f27c7792f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:20:59.863140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2263cfa6-d587-4bb1-80f8-d5f27c7792f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:20:59.962307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-541cb09d-71b1-4475-856a-046cfce73b6a tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:20:59.996546 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-541cb09d-71b1-4475-856a-046cfce73b6a tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1273 microversion: 2.1 time: 0.681387 May 28 21:20:59.996546 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2113/4171] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:20:59 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1273 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:01.004009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b4131dc4-0cb1-4198-9d5b-9a2b02ca712f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:01.004728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b4131dc4-0cb1-4198-9d5b-9a2b02ca712f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:01.015270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4131dc4-0cb1-4198-9d5b-9a2b02ca712f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:01.015910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4131dc4-0cb1-4198-9d5b-9a2b02ca712f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:01.018129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4131dc4-0cb1-4198-9d5b-9a2b02ca712f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:01.018704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4131dc4-0cb1-4198-9d5b-9a2b02ca712f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:01.055137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2263cfa6-d587-4bb1-80f8-d5f27c7792f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:01.068258 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2263cfa6-d587-4bb1-80f8-d5f27c7792f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:01.068258 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2263cfa6-d587-4bb1-80f8-d5f27c7792f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:01.082590 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2263cfa6-d587-4bb1-80f8-d5f27c7792f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1739 microversion: 2.20 time: 1.246108 May 28 21:21:01.083537 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2059/4172] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:20:59 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1739 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:21:01.292571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b4131dc4-0cb1-4198-9d5b-9a2b02ca712f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:01.315192 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b4131dc4-0cb1-4198-9d5b-9a2b02ca712f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1271 microversion: 2.1 time: 0.313846 May 28 21:21:01.323204 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2114/4173] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:00 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1271 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:21:02.103103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-707b5459-28a1-4a58-a63b-e59ae61462c4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:02.104273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-707b5459-28a1-4a58-a63b-e59ae61462c4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:02.115781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-707b5459-28a1-4a58-a63b-e59ae61462c4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:02.117598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-707b5459-28a1-4a58-a63b-e59ae61462c4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:02.118925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-707b5459-28a1-4a58-a63b-e59ae61462c4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:02.120659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-707b5459-28a1-4a58-a63b-e59ae61462c4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:02.337985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f4f38d0f-9cb2-43af-af45-b2f46e4ba6b6 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:02.340542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f4f38d0f-9cb2-43af-af45-b2f46e4ba6b6 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:02.366086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4f38d0f-9cb2-43af-af45-b2f46e4ba6b6 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:02.366086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4f38d0f-9cb2-43af-af45-b2f46e4ba6b6 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:02.366086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4f38d0f-9cb2-43af-af45-b2f46e4ba6b6 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:02.366086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4f38d0f-9cb2-43af-af45-b2f46e4ba6b6 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:02.569035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f4f38d0f-9cb2-43af-af45-b2f46e4ba6b6 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:02.581542 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f4f38d0f-9cb2-43af-af45-b2f46e4ba6b6 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1271 microversion: 2.1 time: 0.251306 May 28 21:21:02.583914 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2115/4174] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:02 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:02.639281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-707b5459-28a1-4a58-a63b-e59ae61462c4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:02.649035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-707b5459-28a1-4a58-a63b-e59ae61462c4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:02.650650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-707b5459-28a1-4a58-a63b-e59ae61462c4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:02.651920 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-707b5459-28a1-4a58-a63b-e59ae61462c4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1739 microversion: 2.20 time: 0.553159 May 28 21:21:02.652509 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2060/4175] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:02 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1739 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:03.601460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cd474f4b-29df-4558-a85b-b2f00ff00413 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:03.603359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cd474f4b-29df-4558-a85b-b2f00ff00413 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:03.613877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd474f4b-29df-4558-a85b-b2f00ff00413 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:03.615582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd474f4b-29df-4558-a85b-b2f00ff00413 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:03.616600 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd474f4b-29df-4558-a85b-b2f00ff00413 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:03.618083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd474f4b-29df-4558-a85b-b2f00ff00413 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:03.678712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f5a4a75d-2d98-4cde-b34d-000411dfe89d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:03.682386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f5a4a75d-2d98-4cde-b34d-000411dfe89d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:03.692840 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5a4a75d-2d98-4cde-b34d-000411dfe89d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:03.694833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5a4a75d-2d98-4cde-b34d-000411dfe89d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:03.703149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5a4a75d-2d98-4cde-b34d-000411dfe89d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:03.703849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5a4a75d-2d98-4cde-b34d-000411dfe89d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:04.317215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f5a4a75d-2d98-4cde-b34d-000411dfe89d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:04.329488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f5a4a75d-2d98-4cde-b34d-000411dfe89d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:04.337107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f5a4a75d-2d98-4cde-b34d-000411dfe89d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:04.342230 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f5a4a75d-2d98-4cde-b34d-000411dfe89d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1739 microversion: 2.20 time: 0.667253 May 28 21:21:04.343480 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2061/4176] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:03 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1739 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:04.525061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cd474f4b-29df-4558-a85b-b2f00ff00413 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:04.537899 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cd474f4b-29df-4558-a85b-b2f00ff00413 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1313 microversion: 2.1 time: 0.938056 May 28 21:21:04.540182 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2116/4177] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:03 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1313 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:04.760758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-292733776", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:04.879572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] validate_networks() for [('552cc0b1-9ce3-409c-8b18-de0982668863', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:21:05.162891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:05.191777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:05.362861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-e9a8669e-0106-46fa-8967-94e65391a612 req-34887029-b9e6-42fe-9c0d-019963dc8f6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa4578da-78a1-462f-a859-07686f886f99", "tag": "02a8ebd7-4855-4264-ac46-23c866e6437d"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:05.379818 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e9a8669e-0106-46fa-8967-94e65391a612 req-34887029-b9e6-42fe-9c0d-019963dc8f6f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:05.380579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e9a8669e-0106-46fa-8967-94e65391a612 req-34887029-b9e6-42fe-9c0d-019963dc8f6f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:05.396513 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e9a8669e-0106-46fa-8967-94e65391a612 req-34887029-b9e6-42fe-9c0d-019963dc8f6f service nova] Creating event network-changed:02a8ebd7-4855-4264-ac46-23c866e6437d for instance aa4578da-78a1-462f-a859-07686f886f99 on nch2-master-1 May 28 21:21:05.402735 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-e9a8669e-0106-46fa-8967-94e65391a612 req-34887029-b9e6-42fe-9c0d-019963dc8f6f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049904 May 28 21:21:05.403998 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2117/4178] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:21:05.426560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d02793b6-34e6-4c77-ab34-43c65c48a6ad tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:05.428473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d02793b6-34e6-4c77-ab34-43c65c48a6ad tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:05.440713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d02793b6-34e6-4c77-ab34-43c65c48a6ad tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:05.442147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d02793b6-34e6-4c77-ab34-43c65c48a6ad tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:05.443367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d02793b6-34e6-4c77-ab34-43c65c48a6ad tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:05.443976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d02793b6-34e6-4c77-ab34-43c65c48a6ad tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:05.719667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d02793b6-34e6-4c77-ab34-43c65c48a6ad tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:05.759062 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d02793b6-34e6-4c77-ab34-43c65c48a6ad tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:05.760610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d02793b6-34e6-4c77-ab34-43c65c48a6ad tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:05.761865 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d02793b6-34e6-4c77-ab34-43c65c48a6ad tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1739 microversion: 2.20 time: 0.355961 May 28 21:21:05.776903 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2118/4179] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:05 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1739 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:05.796974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9be528a9-32e5-4cc1-805a-3fb1353bba2f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:05.802092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9be528a9-32e5-4cc1-805a-3fb1353bba2f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:05.821788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9be528a9-32e5-4cc1-805a-3fb1353bba2f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:05.822615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9be528a9-32e5-4cc1-805a-3fb1353bba2f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:05.824871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9be528a9-32e5-4cc1-805a-3fb1353bba2f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:05.825580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9be528a9-32e5-4cc1-805a-3fb1353bba2f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:06.703070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:21:06.703952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:21:06.704295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:21:06.704808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:21:06.705606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:21:06.722633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:06.738488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:06.744700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:06.752223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:06.757009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:06.802317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Getting quotas for project 3c6886d8b684413da24b02f5b5fb6ef8. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:21:06.819137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Getting quotas for user f1acb2fffdc64ce29b71b2b40e2285f0 and project 3c6886d8b684413da24b02f5b5fb6ef8. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:21:06.847567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:21:06.853730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:21:06.943384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9be528a9-32e5-4cc1-805a-3fb1353bba2f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:06.954112 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9be528a9-32e5-4cc1-805a-3fb1353bba2f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1313 microversion: 2.1 time: 1.173629 May 28 21:21:06.954904 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2119/4180] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:05 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1313 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:06.968399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7a19d756-df53-450d-8292-c0f1b05d0f20 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:06.974920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7a19d756-df53-450d-8292-c0f1b05d0f20 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:06.997431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a19d756-df53-450d-8292-c0f1b05d0f20 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:07.003523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a19d756-df53-450d-8292-c0f1b05d0f20 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:07.004907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a19d756-df53-450d-8292-c0f1b05d0f20 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:07.022613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a19d756-df53-450d-8292-c0f1b05d0f20 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:07.172167 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0dff925e-28b7-4b67-845b-5fb407a060f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.826489 May 28 21:21:07.181649 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2062/4181] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:21:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 2828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:21:07.195273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-981680dc-2391-4298-9ffe-fb8907afd303 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:07.196047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-981680dc-2391-4298-9ffe-fb8907afd303 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:07.688539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-981680dc-2391-4298-9ffe-fb8907afd303 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:07.688539 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-981680dc-2391-4298-9ffe-fb8907afd303 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1213 microversion: 2.1 time: 0.331033 May 28 21:21:07.688539 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2063/4182] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:07 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1213 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:07.692100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7a19d756-df53-450d-8292-c0f1b05d0f20 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:07.692100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:07.692100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7a19d756-df53-450d-8292-c0f1b05d0f20 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:07.692100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7a19d756-df53-450d-8292-c0f1b05d0f20 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:07.699491 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7a19d756-df53-450d-8292-c0f1b05d0f20 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1739 microversion: 2.20 time: 0.728902 May 28 21:21:07.701320 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2120/4183] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:06 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1739 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:07.971756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2f79fe95-16e1-486d-a846-d52f56ea7be0 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:07.972400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2f79fe95-16e1-486d-a846-d52f56ea7be0 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:07.986575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f79fe95-16e1-486d-a846-d52f56ea7be0 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:07.986575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f79fe95-16e1-486d-a846-d52f56ea7be0 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:07.987705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f79fe95-16e1-486d-a846-d52f56ea7be0 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:07.988165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f79fe95-16e1-486d-a846-d52f56ea7be0 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:08.519927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2f79fe95-16e1-486d-a846-d52f56ea7be0 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:08.534976 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2f79fe95-16e1-486d-a846-d52f56ea7be0 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1313 microversion: 2.1 time: 0.567159 May 28 21:21:08.536246 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2064/4184] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:07 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:08.538136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-95a8c2b5-f2f7-4f71-b4fd-bb8a47460417 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:08.538771 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-95a8c2b5-f2f7-4f71-b4fd-bb8a47460417 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:08.697365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-95a8c2b5-f2f7-4f71-b4fd-bb8a47460417 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:08.707193 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-95a8c2b5-f2f7-4f71-b4fd-bb8a47460417 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1213 microversion: 2.1 time: 0.174320 May 28 21:21:08.709001 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2121/4185] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:08 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:21:08.720106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b0f1a039-f1e4-4655-8feb-84f3d0874c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:08.720731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b0f1a039-f1e4-4655-8feb-84f3d0874c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:08.740800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0f1a039-f1e4-4655-8feb-84f3d0874c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:08.743954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0f1a039-f1e4-4655-8feb-84f3d0874c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:08.745033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0f1a039-f1e4-4655-8feb-84f3d0874c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:08.747005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0f1a039-f1e4-4655-8feb-84f3d0874c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:08.783383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:09.014979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b0f1a039-f1e4-4655-8feb-84f3d0874c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:09.030893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b0f1a039-f1e4-4655-8feb-84f3d0874c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:09.033409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b0f1a039-f1e4-4655-8feb-84f3d0874c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:09.035077 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b0f1a039-f1e4-4655-8feb-84f3d0874c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1739 microversion: 2.20 time: 0.322443 May 28 21:21:09.037468 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2065/4186] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:08 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1739 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:09.552688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1f7b1724-344d-4bc6-b15c-2cd9023048de tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:09.553327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1f7b1724-344d-4bc6-b15c-2cd9023048de tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:09.563207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f7b1724-344d-4bc6-b15c-2cd9023048de tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:09.564099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f7b1724-344d-4bc6-b15c-2cd9023048de tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:09.565480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f7b1724-344d-4bc6-b15c-2cd9023048de tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:09.566360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f7b1724-344d-4bc6-b15c-2cd9023048de tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:09.733322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-339b87d8-e592-4dbe-a39e-31a65c010807 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:09.734598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-339b87d8-e592-4dbe-a39e-31a65c010807 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:09.746598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-339b87d8-e592-4dbe-a39e-31a65c010807 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:09.752143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-339b87d8-e592-4dbe-a39e-31a65c010807 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:09.752143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-339b87d8-e592-4dbe-a39e-31a65c010807 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:09.752143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-339b87d8-e592-4dbe-a39e-31a65c010807 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:09.895432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1f7b1724-344d-4bc6-b15c-2cd9023048de tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:09.906797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-339b87d8-e592-4dbe-a39e-31a65c010807 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:09.907876 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1f7b1724-344d-4bc6-b15c-2cd9023048de tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1313 microversion: 2.1 time: 0.359531 May 28 21:21:09.908470 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2122/4187] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:09 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:09.926484 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-339b87d8-e592-4dbe-a39e-31a65c010807 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1209 microversion: 2.1 time: 0.205544 May 28 21:21:09.927142 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2066/4188] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:09 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1209 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:10.062876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8b4a56e4-cc51-44f0-8e42-d7a735a62fbb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:10.062876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8b4a56e4-cc51-44f0-8e42-d7a735a62fbb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:10.064757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:10.066413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b4a56e4-cc51-44f0-8e42-d7a735a62fbb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:10.067049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b4a56e4-cc51-44f0-8e42-d7a735a62fbb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:10.069214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b4a56e4-cc51-44f0-8e42-d7a735a62fbb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:10.069884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b4a56e4-cc51-44f0-8e42-d7a735a62fbb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:10.296940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8b4a56e4-cc51-44f0-8e42-d7a735a62fbb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:10.315578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8b4a56e4-cc51-44f0-8e42-d7a735a62fbb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:10.319451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8b4a56e4-cc51-44f0-8e42-d7a735a62fbb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:10.320802 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8b4a56e4-cc51-44f0-8e42-d7a735a62fbb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1721 microversion: 2.20 time: 0.269164 May 28 21:21:10.321485 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2123/4189] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:10 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:10.925116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2847f905-373a-4a33-87c3-2c3792a28e83 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:10.925821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2847f905-373a-4a33-87c3-2c3792a28e83 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:10.943848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2847f905-373a-4a33-87c3-2c3792a28e83 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:10.944947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2847f905-373a-4a33-87c3-2c3792a28e83 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:10.945808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2847f905-373a-4a33-87c3-2c3792a28e83 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:10.946744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e5f7bf41-5f7a-4df4-9721-58e5ddf75997 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:10.947378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e5f7bf41-5f7a-4df4-9721-58e5ddf75997 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:10.949816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2847f905-373a-4a33-87c3-2c3792a28e83 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:10.985131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5f7bf41-5f7a-4df4-9721-58e5ddf75997 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:10.985598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5f7bf41-5f7a-4df4-9721-58e5ddf75997 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:10.986481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5f7bf41-5f7a-4df4-9721-58e5ddf75997 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:10.986929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5f7bf41-5f7a-4df4-9721-58e5ddf75997 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:11.122928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e5f7bf41-5f7a-4df4-9721-58e5ddf75997 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:11.133545 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e5f7bf41-5f7a-4df4-9721-58e5ddf75997 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1271 microversion: 2.1 time: 0.193554 May 28 21:21:11.139803 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2124/4190] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:10 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1271 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:21:11.307709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2847f905-373a-4a33-87c3-2c3792a28e83 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:11.320158 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2847f905-373a-4a33-87c3-2c3792a28e83 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1313 microversion: 2.1 time: 0.398625 May 28 21:21:11.321510 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2067/4191] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:10 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:11.356540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8a986a6c-2ca2-4a40-90c6-5693ce4edd4c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:11.356540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8a986a6c-2ca2-4a40-90c6-5693ce4edd4c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:11.365996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8a986a6c-2ca2-4a40-90c6-5693ce4edd4c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:11.366898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8a986a6c-2ca2-4a40-90c6-5693ce4edd4c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:11.368169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8a986a6c-2ca2-4a40-90c6-5693ce4edd4c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:11.368965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8a986a6c-2ca2-4a40-90c6-5693ce4edd4c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:11.642277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8a986a6c-2ca2-4a40-90c6-5693ce4edd4c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:11.654963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8a986a6c-2ca2-4a40-90c6-5693ce4edd4c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:11.666581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8a986a6c-2ca2-4a40-90c6-5693ce4edd4c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:11.666581 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8a986a6c-2ca2-4a40-90c6-5693ce4edd4c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1721 microversion: 2.20 time: 0.319918 May 28 21:21:11.666581 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2125/4192] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:11 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1721 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:12.154886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-89a71803-1401-42fc-83fe-9145a8f06625 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:12.155451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-89a71803-1401-42fc-83fe-9145a8f06625 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:12.164196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89a71803-1401-42fc-83fe-9145a8f06625 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:12.164935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89a71803-1401-42fc-83fe-9145a8f06625 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:12.165725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89a71803-1401-42fc-83fe-9145a8f06625 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:12.166367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89a71803-1401-42fc-83fe-9145a8f06625 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:12.338420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3a23e713-8ec5-4c7b-a3bb-1c755ac5769f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:12.339038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3a23e713-8ec5-4c7b-a3bb-1c755ac5769f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:12.349461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a23e713-8ec5-4c7b-a3bb-1c755ac5769f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:12.350279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a23e713-8ec5-4c7b-a3bb-1c755ac5769f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:12.351219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a23e713-8ec5-4c7b-a3bb-1c755ac5769f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:12.351568 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a23e713-8ec5-4c7b-a3bb-1c755ac5769f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:12.929508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89a71803-1401-42fc-83fe-9145a8f06625 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:12.943958 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-89a71803-1401-42fc-83fe-9145a8f06625 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1313 microversion: 2.1 time: 0.793263 May 28 21:21:12.944713 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2068/4193] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:12 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1313 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:12.949444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-6517fb6e-a32b-4b05-8d9f-9ecb8273e823 req-2b6f1624-9d0f-4a40-96f9-7e70b59b81c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6232e7b0-68db-43d6-a836-fb2f96c54658", "name": "network-vif-unplugged", "status": "completed", "tag": "5f12e599-b5ae-4dcf-ac2c-9827b4ca4a75"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:12.959416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6517fb6e-a32b-4b05-8d9f-9ecb8273e823 req-2b6f1624-9d0f-4a40-96f9-7e70b59b81c2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:12.959869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6517fb6e-a32b-4b05-8d9f-9ecb8273e823 req-2b6f1624-9d0f-4a40-96f9-7e70b59b81c2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:12.982805 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-6517fb6e-a32b-4b05-8d9f-9ecb8273e823 req-2b6f1624-9d0f-4a40-96f9-7e70b59b81c2 service nova] Creating event network-vif-unplugged:5f12e599-b5ae-4dcf-ac2c-9827b4ca4a75 for instance 6232e7b0-68db-43d6-a836-fb2f96c54658 on nch2-master-1 May 28 21:21:13.004811 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-6517fb6e-a32b-4b05-8d9f-9ecb8273e823 req-2b6f1624-9d0f-4a40-96f9-7e70b59b81c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058594 May 28 21:21:13.005970 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2069/4194] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:21:13.013518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f176b033-f8d1-47c4-ba10-de096bf177db tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:13.019775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f176b033-f8d1-47c4-ba10-de096bf177db tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:13.022990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f176b033-f8d1-47c4-ba10-de096bf177db tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:13.023838 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f176b033-f8d1-47c4-ba10-de096bf177db tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:13.024547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f176b033-f8d1-47c4-ba10-de096bf177db tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:13.024997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f176b033-f8d1-47c4-ba10-de096bf177db tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:13.210969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3a23e713-8ec5-4c7b-a3bb-1c755ac5769f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:13.228454 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3a23e713-8ec5-4c7b-a3bb-1c755ac5769f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1313 microversion: 2.1 time: 0.893674 May 28 21:21:13.229699 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2126/4195] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:12 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1313 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:21:13.244161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-e3fc20cc-e187-42b9-9f3a-06178d7e80f8 req-09b26c90-8b71-4425-9f86-ce66db31d513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d5a8b4e-8727-49ed-bafc-228fbecea520", "tag": "d0c72081-4f9a-47cd-ab5d-cb1d70d27321"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:13.262234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e3fc20cc-e187-42b9-9f3a-06178d7e80f8 req-09b26c90-8b71-4425-9f86-ce66db31d513 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:13.262718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e3fc20cc-e187-42b9-9f3a-06178d7e80f8 req-09b26c90-8b71-4425-9f86-ce66db31d513 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:13.284134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f176b033-f8d1-47c4-ba10-de096bf177db tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:13.297663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f176b033-f8d1-47c4-ba10-de096bf177db tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:13.299332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f176b033-f8d1-47c4-ba10-de096bf177db tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:13.303232 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f176b033-f8d1-47c4-ba10-de096bf177db tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1724 microversion: 2.20 time: 0.295836 May 28 21:21:13.307545 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2070/4196] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:13 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:13.314931 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e3fc20cc-e187-42b9-9f3a-06178d7e80f8 req-09b26c90-8b71-4425-9f86-ce66db31d513 service nova] Creating event network-changed:d0c72081-4f9a-47cd-ab5d-cb1d70d27321 for instance 2d5a8b4e-8727-49ed-bafc-228fbecea520 on nch1-master-1 May 28 21:21:13.324972 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-e3fc20cc-e187-42b9-9f3a-06178d7e80f8 req-09b26c90-8b71-4425-9f86-ce66db31d513 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093765 May 28 21:21:13.325906 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2127/4197] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:21:13.331042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-587831f0-512d-4e4a-9597-6ff21746ef07 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aca16bed-3410-4df8-b98d-9a6854483c48"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:13.331042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-587831f0-512d-4e4a-9597-6ff21746ef07 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:13.339437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-587831f0-512d-4e4a-9597-6ff21746ef07 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:13.340207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-587831f0-512d-4e4a-9597-6ff21746ef07 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:13.341175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-587831f0-512d-4e4a-9597-6ff21746ef07 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:13.343829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-587831f0-512d-4e4a-9597-6ff21746ef07 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:13.963093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-74491997-891b-4973-9694-b302dd2a73f8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:13.964665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-74491997-891b-4973-9694-b302dd2a73f8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:13.985077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74491997-891b-4973-9694-b302dd2a73f8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:13.985077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74491997-891b-4973-9694-b302dd2a73f8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:13.985077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74491997-891b-4973-9694-b302dd2a73f8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:13.985077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74491997-891b-4973-9694-b302dd2a73f8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:14.368379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-74491997-891b-4973-9694-b302dd2a73f8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:14.378779 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-74491997-891b-4973-9694-b302dd2a73f8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1313 microversion: 2.1 time: 0.421459 May 28 21:21:14.380486 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2128/4198] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:13 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:21:14.386222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4520e2a3-cafd-45d0-80ce-860f5ad297a3 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:14.387261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4520e2a3-cafd-45d0-80ce-860f5ad297a3 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:14.395759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4520e2a3-cafd-45d0-80ce-860f5ad297a3 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:14.396453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4520e2a3-cafd-45d0-80ce-860f5ad297a3 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:14.397807 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4520e2a3-cafd-45d0-80ce-860f5ad297a3 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:14.398433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4520e2a3-cafd-45d0-80ce-860f5ad297a3 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:14.587293 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-587831f0-512d-4e4a-9597-6ff21746ef07 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "POST /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.265835 May 28 21:21:14.589064 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2071/4199] 10.222.0.33 () {62 vars in 1363 bytes} [Sat May 28 21:21:13 2022] POST /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/os-volume_attachments => generated 188 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 21:21:14.800212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c7b91485-83ae-4795-b6e0-bda82b8a4c68 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:14.801255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c7b91485-83ae-4795-b6e0-bda82b8a4c68 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:14.810298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7b91485-83ae-4795-b6e0-bda82b8a4c68 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:14.814689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7b91485-83ae-4795-b6e0-bda82b8a4c68 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:14.814689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7b91485-83ae-4795-b6e0-bda82b8a4c68 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:14.814689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7b91485-83ae-4795-b6e0-bda82b8a4c68 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:14.854739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4520e2a3-cafd-45d0-80ce-860f5ad297a3 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:14.863091 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4520e2a3-cafd-45d0-80ce-860f5ad297a3 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1313 microversion: 2.1 time: 0.481168 May 28 21:21:14.865313 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2129/4200] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:14 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:15.127010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-51948e61-2e23-43fc-8555-3ad98680b51f req-57d9e55e-960f-41e7-9cd1-fc9f2a525a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4578da-78a1-462f-a859-07686f886f99", "name": "network-vif-plugged", "status": "completed", "tag": "02a8ebd7-4855-4264-ac46-23c866e6437d"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:15.135970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-51948e61-2e23-43fc-8555-3ad98680b51f req-57d9e55e-960f-41e7-9cd1-fc9f2a525a72 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:15.136481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-51948e61-2e23-43fc-8555-3ad98680b51f req-57d9e55e-960f-41e7-9cd1-fc9f2a525a72 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:15.150127 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-51948e61-2e23-43fc-8555-3ad98680b51f req-57d9e55e-960f-41e7-9cd1-fc9f2a525a72 service nova] Creating event network-vif-plugged:02a8ebd7-4855-4264-ac46-23c866e6437d for instance aa4578da-78a1-462f-a859-07686f886f99 on nch2-master-1 May 28 21:21:15.157054 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-51948e61-2e23-43fc-8555-3ad98680b51f req-57d9e55e-960f-41e7-9cd1-fc9f2a525a72 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033253 May 28 21:21:15.160374 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2130/4201] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:21:15.225464 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c7b91485-83ae-4795-b6e0-bda82b8a4c68 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "POST /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/action" status: 202 len: 0 microversion: 2.20 time: 0.431157 May 28 21:21:15.227221 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2072/4202] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:21:14 2022] POST /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 28 21:21:15.238418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ef53e8c5-2ff0-45a1-9487-944150390273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:15.239371 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ef53e8c5-2ff0-45a1-9487-944150390273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:15.247015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef53e8c5-2ff0-45a1-9487-944150390273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:15.247700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef53e8c5-2ff0-45a1-9487-944150390273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:15.248645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef53e8c5-2ff0-45a1-9487-944150390273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:15.249244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef53e8c5-2ff0-45a1-9487-944150390273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:15.397523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eb8878e8-f7c9-4441-ad01-6c2c233443da tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:15.398332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eb8878e8-f7c9-4441-ad01-6c2c233443da tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:15.404943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb8878e8-f7c9-4441-ad01-6c2c233443da tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:15.405411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb8878e8-f7c9-4441-ad01-6c2c233443da tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:15.406835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb8878e8-f7c9-4441-ad01-6c2c233443da tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:15.407645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb8878e8-f7c9-4441-ad01-6c2c233443da tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:15.445669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ef53e8c5-2ff0-45a1-9487-944150390273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:15.457578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ef53e8c5-2ff0-45a1-9487-944150390273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:15.459392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ef53e8c5-2ff0-45a1-9487-944150390273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:15.461830 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ef53e8c5-2ff0-45a1-9487-944150390273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1750 microversion: 2.20 time: 0.228865 May 28 21:21:15.461830 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2131/4203] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:15 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1750 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:15.575764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eb8878e8-f7c9-4441-ad01-6c2c233443da tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:15.590890 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eb8878e8-f7c9-4441-ad01-6c2c233443da tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1313 microversion: 2.1 time: 0.197733 May 28 21:21:15.601102 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2073/4204] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:15 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:21:15.885108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a7093a0-e519-43f7-ab07-1e4d892a3281 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:15.885735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6a7093a0-e519-43f7-ab07-1e4d892a3281 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:15.894898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a7093a0-e519-43f7-ab07-1e4d892a3281 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:15.897093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a7093a0-e519-43f7-ab07-1e4d892a3281 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:15.898128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a7093a0-e519-43f7-ab07-1e4d892a3281 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:15.898773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a7093a0-e519-43f7-ab07-1e4d892a3281 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:16.156152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a7093a0-e519-43f7-ab07-1e4d892a3281 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:16.169782 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6a7093a0-e519-43f7-ab07-1e4d892a3281 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1313 microversion: 2.1 time: 0.288479 May 28 21:21:16.171041 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2132/4205] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:15 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:16.480236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dbc60ca8-b8e0-4c4d-af24-eda8b0dba2b9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:16.480856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dbc60ca8-b8e0-4c4d-af24-eda8b0dba2b9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:16.488469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dbc60ca8-b8e0-4c4d-af24-eda8b0dba2b9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:16.488925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dbc60ca8-b8e0-4c4d-af24-eda8b0dba2b9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:16.489754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dbc60ca8-b8e0-4c4d-af24-eda8b0dba2b9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:16.490247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dbc60ca8-b8e0-4c4d-af24-eda8b0dba2b9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:16.608724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-80f70537-2842-45ea-92d4-4dcd7b6710b4 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:16.609946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-80f70537-2842-45ea-92d4-4dcd7b6710b4 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:16.616138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80f70537-2842-45ea-92d4-4dcd7b6710b4 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:16.616593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80f70537-2842-45ea-92d4-4dcd7b6710b4 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:16.617358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80f70537-2842-45ea-92d4-4dcd7b6710b4 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:16.617801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80f70537-2842-45ea-92d4-4dcd7b6710b4 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:16.778115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dbc60ca8-b8e0-4c4d-af24-eda8b0dba2b9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:16.780698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:16.788787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dbc60ca8-b8e0-4c4d-af24-eda8b0dba2b9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:16.791165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dbc60ca8-b8e0-4c4d-af24-eda8b0dba2b9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:16.796308 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dbc60ca8-b8e0-4c4d-af24-eda8b0dba2b9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1750 microversion: 2.20 time: 0.316493 May 28 21:21:16.796308 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2074/4206] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:16 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1750 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:16.910182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-80f70537-2842-45ea-92d4-4dcd7b6710b4 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:16.919716 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-80f70537-2842-45ea-92d4-4dcd7b6710b4 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1313 microversion: 2.1 time: 0.314735 May 28 21:21:16.921111 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2133/4207] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:16 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:21:17.187242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ccde2852-c995-4a68-87b1-079aba0801af tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:17.188499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ccde2852-c995-4a68-87b1-079aba0801af tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:17.195824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccde2852-c995-4a68-87b1-079aba0801af tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:17.196414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccde2852-c995-4a68-87b1-079aba0801af tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:17.197660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccde2852-c995-4a68-87b1-079aba0801af tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:17.198137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccde2852-c995-4a68-87b1-079aba0801af tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:17.344107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ccde2852-c995-4a68-87b1-079aba0801af tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:17.352138 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ccde2852-c995-4a68-87b1-079aba0801af tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1496 microversion: 2.1 time: 0.169090 May 28 21:21:17.353007 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2075/4208] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:17 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1496 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:17.811893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9ea27f61-372c-4c5b-be03-9c0d9a6b1196 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:17.813088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9ea27f61-372c-4c5b-be03-9c0d9a6b1196 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:17.820401 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ea27f61-372c-4c5b-be03-9c0d9a6b1196 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:17.821272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ea27f61-372c-4c5b-be03-9c0d9a6b1196 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:17.822251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ea27f61-372c-4c5b-be03-9c0d9a6b1196 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:17.822848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ea27f61-372c-4c5b-be03-9c0d9a6b1196 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:17.939072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b23f6bf8-1523-4df5-9297-76f06d169f88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:17.940466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b23f6bf8-1523-4df5-9297-76f06d169f88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:17.955975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:17.958266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b23f6bf8-1523-4df5-9297-76f06d169f88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:17.958864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b23f6bf8-1523-4df5-9297-76f06d169f88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:17.960530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b23f6bf8-1523-4df5-9297-76f06d169f88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:17.961131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b23f6bf8-1523-4df5-9297-76f06d169f88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:18.294812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9ea27f61-372c-4c5b-be03-9c0d9a6b1196 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:18.326871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b23f6bf8-1523-4df5-9297-76f06d169f88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:18.337120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9ea27f61-372c-4c5b-be03-9c0d9a6b1196 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:18.339696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9ea27f61-372c-4c5b-be03-9c0d9a6b1196 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:18.340311 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b23f6bf8-1523-4df5-9297-76f06d169f88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1313 microversion: 2.1 time: 0.403278 May 28 21:21:18.342822 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2076/4209] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:17 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:18.343959 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9ea27f61-372c-4c5b-be03-9c0d9a6b1196 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1752 microversion: 2.20 time: 0.535964 May 28 21:21:18.347258 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2134/4210] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:17 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1752 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:19.065877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bcb6010f-b95e-4c95-8603-26408f99b8ce tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:19.065877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bcb6010f-b95e-4c95-8603-26408f99b8ce tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:19.075522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bcb6010f-b95e-4c95-8603-26408f99b8ce tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:19.075982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bcb6010f-b95e-4c95-8603-26408f99b8ce tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:19.076893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bcb6010f-b95e-4c95-8603-26408f99b8ce tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:19.077202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bcb6010f-b95e-4c95-8603-26408f99b8ce tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:19.119569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bcb6010f-b95e-4c95-8603-26408f99b8ce tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:21:19.274129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:19.357666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-de09aa33-da8c-41fe-965f-53e8e86d302e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:19.358355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-de09aa33-da8c-41fe-965f-53e8e86d302e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:19.360626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:19.368109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de09aa33-da8c-41fe-965f-53e8e86d302e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:19.373810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de09aa33-da8c-41fe-965f-53e8e86d302e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:19.373810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de09aa33-da8c-41fe-965f-53e8e86d302e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:19.373810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de09aa33-da8c-41fe-965f-53e8e86d302e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:19.536192 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bcb6010f-b95e-4c95-8603-26408f99b8ce tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "DELETE /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 204 len: 0 microversion: 2.1 time: 0.475119 May 28 21:21:19.546000 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2077/4211] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:21:19 2022] DELETE /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:21:19.546000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-61eb01f9-ad4c-44cb-a239-d384c86edb90 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:19.546000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-61eb01f9-ad4c-44cb-a239-d384c86edb90 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:19.551891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61eb01f9-ad4c-44cb-a239-d384c86edb90 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:19.552978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61eb01f9-ad4c-44cb-a239-d384c86edb90 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:19.554099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61eb01f9-ad4c-44cb-a239-d384c86edb90 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:19.554756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61eb01f9-ad4c-44cb-a239-d384c86edb90 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:20.131406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-de09aa33-da8c-41fe-965f-53e8e86d302e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:20.145370 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-de09aa33-da8c-41fe-965f-53e8e86d302e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1313 microversion: 2.1 time: 0.788936 May 28 21:21:20.150904 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2135/4212] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:19 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1313 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:21:20.156620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d435c360-71e2-418b-b91d-f3c78df539ff tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:20.158827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d435c360-71e2-418b-b91d-f3c78df539ff tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:20.168830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d435c360-71e2-418b-b91d-f3c78df539ff tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:20.170290 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d435c360-71e2-418b-b91d-f3c78df539ff tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:20.173895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d435c360-71e2-418b-b91d-f3c78df539ff tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:20.173895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d435c360-71e2-418b-b91d-f3c78df539ff tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:20.338328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-61eb01f9-ad4c-44cb-a239-d384c86edb90 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:20.356220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-61eb01f9-ad4c-44cb-a239-d384c86edb90 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:20.369173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-61eb01f9-ad4c-44cb-a239-d384c86edb90 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:20.370453 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-61eb01f9-ad4c-44cb-a239-d384c86edb90 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1752 microversion: 2.20 time: 0.832425 May 28 21:21:20.371029 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2078/4213] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:19 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1752 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:20.375712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-f5e10932-0c03-4e54-9e7c-644f64c9a8c9 req-54464294-e6d7-4ced-9708-a1e692dd8fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5a8b4e-8727-49ed-bafc-228fbecea520", "name": "network-vif-plugged", "status": "completed", "tag": "d0c72081-4f9a-47cd-ab5d-cb1d70d27321"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:20.399372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f5e10932-0c03-4e54-9e7c-644f64c9a8c9 req-54464294-e6d7-4ced-9708-a1e692dd8fee service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:20.399824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f5e10932-0c03-4e54-9e7c-644f64c9a8c9 req-54464294-e6d7-4ced-9708-a1e692dd8fee service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:20.412867 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-f5e10932-0c03-4e54-9e7c-644f64c9a8c9 req-54464294-e6d7-4ced-9708-a1e692dd8fee service nova] Creating event network-vif-plugged:d0c72081-4f9a-47cd-ab5d-cb1d70d27321 for instance 2d5a8b4e-8727-49ed-bafc-228fbecea520 on nch1-master-1 May 28 21:21:20.418153 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-f5e10932-0c03-4e54-9e7c-644f64c9a8c9 req-54464294-e6d7-4ced-9708-a1e692dd8fee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045751 May 28 21:21:20.419480 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2079/4214] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:21:20.609900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d435c360-71e2-418b-b91d-f3c78df539ff tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:20.624291 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d435c360-71e2-418b-b91d-f3c78df539ff tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1502 microversion: 2.1 time: 0.476986 May 28 21:21:20.627548 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2136/4215] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:20 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1502 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:21.165586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fcb02eec-2b2d-46ef-ac8c-fc3733faf0f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:21.166512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fcb02eec-2b2d-46ef-ac8c-fc3733faf0f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:21.181509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fcb02eec-2b2d-46ef-ac8c-fc3733faf0f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:21.182636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fcb02eec-2b2d-46ef-ac8c-fc3733faf0f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:21.185380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fcb02eec-2b2d-46ef-ac8c-fc3733faf0f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:21.187115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fcb02eec-2b2d-46ef-ac8c-fc3733faf0f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:21.390584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc8f1650-8364-4296-ac5d-f4978c6c5483 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:21.391513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc8f1650-8364-4296-ac5d-f4978c6c5483 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:21.406437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc8f1650-8364-4296-ac5d-f4978c6c5483 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:21.408441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc8f1650-8364-4296-ac5d-f4978c6c5483 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:21.412727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc8f1650-8364-4296-ac5d-f4978c6c5483 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:21.412727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc8f1650-8364-4296-ac5d-f4978c6c5483 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:21.817081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fcb02eec-2b2d-46ef-ac8c-fc3733faf0f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:21.849881 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fcb02eec-2b2d-46ef-ac8c-fc3733faf0f9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1313 microversion: 2.1 time: 0.684632 May 28 21:21:21.852815 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2080/4216] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:21 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1313 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:21.867314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9e71b9ab-52a7-4274-a4d6-caf2a17e16b9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:21.867699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9e71b9ab-52a7-4274-a4d6-caf2a17e16b9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:21.900050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e71b9ab-52a7-4274-a4d6-caf2a17e16b9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:21.900431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e71b9ab-52a7-4274-a4d6-caf2a17e16b9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:21.901236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e71b9ab-52a7-4274-a4d6-caf2a17e16b9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:21.901678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e71b9ab-52a7-4274-a4d6-caf2a17e16b9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:22.290416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc8f1650-8364-4296-ac5d-f4978c6c5483 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:22.303599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc8f1650-8364-4296-ac5d-f4978c6c5483 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:22.305164 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc8f1650-8364-4296-ac5d-f4978c6c5483 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:22.306425 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc8f1650-8364-4296-ac5d-f4978c6c5483 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.921488 May 28 21:21:22.308198 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2137/4217] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:21 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:22.389743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9e71b9ab-52a7-4274-a4d6-caf2a17e16b9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:22.399618 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9e71b9ab-52a7-4274-a4d6-caf2a17e16b9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 200 len: 1502 microversion: 2.1 time: 0.543135 May 28 21:21:22.400219 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2081/4218] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:21 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 1502 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:22.417600 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-e44cfcea-0bd2-4cd7-8cd0-b01cfde7bddf req-b151b5f3-c755-4aee-8882-bf6179f9d129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa4578da-78a1-462f-a859-07686f886f99", "name": "network-vif-deleted", "tag": "02a8ebd7-4855-4264-ac46-23c866e6437d"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:22.428154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e44cfcea-0bd2-4cd7-8cd0-b01cfde7bddf req-b151b5f3-c755-4aee-8882-bf6179f9d129 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:22.428829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e44cfcea-0bd2-4cd7-8cd0-b01cfde7bddf req-b151b5f3-c755-4aee-8882-bf6179f9d129 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:22.448735 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e44cfcea-0bd2-4cd7-8cd0-b01cfde7bddf req-b151b5f3-c755-4aee-8882-bf6179f9d129 service nova] Creating event network-vif-deleted:02a8ebd7-4855-4264-ac46-23c866e6437d for instance aa4578da-78a1-462f-a859-07686f886f99 on nch2-master-1 May 28 21:21:22.457704 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-e44cfcea-0bd2-4cd7-8cd0-b01cfde7bddf req-b151b5f3-c755-4aee-8882-bf6179f9d129 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044782 May 28 21:21:22.459025 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2138/4219] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:21:22.870613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ef1fc7b8-1e2c-48f7-bb5b-9f1db0446c19 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:22.877501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ef1fc7b8-1e2c-48f7-bb5b-9f1db0446c19 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:22.905376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef1fc7b8-1e2c-48f7-bb5b-9f1db0446c19 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:22.906251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef1fc7b8-1e2c-48f7-bb5b-9f1db0446c19 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:22.909591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef1fc7b8-1e2c-48f7-bb5b-9f1db0446c19 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:22.911556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef1fc7b8-1e2c-48f7-bb5b-9f1db0446c19 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:23.261351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ef1fc7b8-1e2c-48f7-bb5b-9f1db0446c19 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:23.271244 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ef1fc7b8-1e2c-48f7-bb5b-9f1db0446c19 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1500 microversion: 2.1 time: 0.408306 May 28 21:21:23.272310 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2082/4220] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:22 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1500 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:23.300679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b14e46ef-c398-4f29-8afc-b3fed529dc9a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:23.302652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b14e46ef-c398-4f29-8afc-b3fed529dc9a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:23.310793 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b14e46ef-c398-4f29-8afc-b3fed529dc9a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:23.311496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b14e46ef-c398-4f29-8afc-b3fed529dc9a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:23.312508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b14e46ef-c398-4f29-8afc-b3fed529dc9a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:23.313115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b14e46ef-c398-4f29-8afc-b3fed529dc9a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:23.325617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-43916209-99ed-4499-8105-d7bb6d151833 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:23.326576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-43916209-99ed-4499-8105-d7bb6d151833 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:23.351872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43916209-99ed-4499-8105-d7bb6d151833 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:23.358284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43916209-99ed-4499-8105-d7bb6d151833 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:23.359726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43916209-99ed-4499-8105-d7bb6d151833 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:23.360188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43916209-99ed-4499-8105-d7bb6d151833 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:23.389041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-b14e46ef-c398-4f29-8afc-b3fed529dc9a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lazy-loading 'flavor' on Instance uuid 2d5a8b4e-8727-49ed-bafc-228fbecea520 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:21:23.431942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:23.587983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-43916209-99ed-4499-8105-d7bb6d151833 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:23.601213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-43916209-99ed-4499-8105-d7bb6d151833 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:23.607582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-43916209-99ed-4499-8105-d7bb6d151833 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:23.610474 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-43916209-99ed-4499-8105-d7bb6d151833 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.288910 May 28 21:21:23.613511 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2083/4221] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:23 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:23.634701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-21299437-94b5-462d-a6ae-e2d9d8cf6f58 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:23.635692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-21299437-94b5-462d-a6ae-e2d9d8cf6f58 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: aa4578da-78a1-462f-a859-07686f886f99] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:23.654030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21299437-94b5-462d-a6ae-e2d9d8cf6f58 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:23.654511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21299437-94b5-462d-a6ae-e2d9d8cf6f58 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:23.655318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21299437-94b5-462d-a6ae-e2d9d8cf6f58 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:23.655803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21299437-94b5-462d-a6ae-e2d9d8cf6f58 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:23.700359 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-21299437-94b5-462d-a6ae-e2d9d8cf6f58 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] HTTP exception thrown: Instance aa4578da-78a1-462f-a859-07686f886f99 could not be found. May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-21299437-94b5-462d-a6ae-e2d9d8cf6f58 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Request method failure captured: May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 HTTP/1.1 May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpIwaYmDsgZ0cs847iMMi5pdIktxusrwiQTHO7hc8UuQz0pMQJ7Lpq-K5_JMZP-UmRJbWNT7DUg6N5YTObP34CWSDGFi_46MPP8jQTE5xDUJcS-VO_sTCZcWUB07UekhRI0FDg1Q1ls5GqDVW5-jtc98wd7tLAVnPFVmVuZnQDvpeWI May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 877bd1cd8912437c8e4871df8a5f7260 May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-VolumesActionsTest-514564619 May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_877bd1cd8912437c8e4871df8a5f7260", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/877bd1cd8912437c8e4871df8a5f7260"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/877bd1cd8912437c8e4871df8a5f7260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/877bd1cd8912437c8e4871df8a5f7260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-VolumesActionsTest-514564619 May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 877bd1cd8912437c8e4871df8a5f7260 May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-VolumesActionsTest-514564619 May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-VolumesActionsTest-514564619-project May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 84f18f11aad344c18bb6b3997370576b May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-VolumesActionsTest-514564619-project May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance aa4578da-78a1-462f-a859-07686f886f99 could not be found. May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'aa4578da-78a1-462f-a859-07686f886f99'} May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa4578da-78a1-462f-a859-07686f886f99 could not be found. May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa4578da-78a1-462f-a859-07686f886f99 could not be found. May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:21:23.702546 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:21:23.707009 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:21:23.707009 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:21:23.707009 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:21:23.707009 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:21:23.707009 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:21:23.707009 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa4578da-78a1-462f-a859-07686f886f99 could not be found. May 28 21:21:23.707009 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:21:23.707009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-21299437-94b5-462d-a6ae-e2d9d8cf6f58 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Returning 404 to user: Instance aa4578da-78a1-462f-a859-07686f886f99 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:21:23.707009 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-21299437-94b5-462d-a6ae-e2d9d8cf6f58 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99" status: 404 len: 111 microversion: 2.1 time: 0.088532 May 28 21:21:23.707009 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2084/4222] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:23 2022] GET /compute/v2.1/servers/aa4578da-78a1-462f-a859-07686f886f99 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:21:23.805691 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b14e46ef-c398-4f29-8afc-b3fed529dc9a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "POST /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520/action" status: 200 len: 32 microversion: 2.1 time: 0.510098 May 28 21:21:23.811153 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2139/4223] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:21:23 2022] POST /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520/action => generated 32 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:21:23.816941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8fbf1a26-6b1e-4c30-80a8-8f85b4e5640f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:23.817934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8fbf1a26-6b1e-4c30-80a8-8f85b4e5640f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:23.830951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fbf1a26-6b1e-4c30-80a8-8f85b4e5640f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:23.832104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fbf1a26-6b1e-4c30-80a8-8f85b4e5640f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:23.833480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fbf1a26-6b1e-4c30-80a8-8f85b4e5640f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:23.836114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fbf1a26-6b1e-4c30-80a8-8f85b4e5640f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:23.860730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-286510482", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "be68ec51-0c83-4a48-a09e-37960ea0741f"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:23.947151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] validate_networks() for [('be68ec51-0c83-4a48-a09e-37960ea0741f', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:21:24.221819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8fbf1a26-6b1e-4c30-80a8-8f85b4e5640f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:24.236478 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8fbf1a26-6b1e-4c30-80a8-8f85b4e5640f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.423763 May 28 21:21:24.238559 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2085/4224] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:23 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:21:24.630414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e6b7419f-9511-49fe-8ff1-6904cc1765df tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:24.631297 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e6b7419f-9511-49fe-8ff1-6904cc1765df tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:24.645129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6b7419f-9511-49fe-8ff1-6904cc1765df tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:24.646017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6b7419f-9511-49fe-8ff1-6904cc1765df tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:24.647174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6b7419f-9511-49fe-8ff1-6904cc1765df tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:24.648030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6b7419f-9511-49fe-8ff1-6904cc1765df tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:24.753154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:21:24.754913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:21:24.756834 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:21:24.758633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:21:24.761694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:21:24.795677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:24.796287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:24.796987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:24.797438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:24.854510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Getting quotas for project 877bd1cd8912437c8e4871df8a5f7260. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:21:24.863351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Getting quotas for user 84f18f11aad344c18bb6b3997370576b and project 877bd1cd8912437c8e4871df8a5f7260. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:21:24.886666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:21:24.892697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:21:24.934763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e6b7419f-9511-49fe-8ff1-6904cc1765df tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:24.948301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e6b7419f-9511-49fe-8ff1-6904cc1765df tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:24.950538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e6b7419f-9511-49fe-8ff1-6904cc1765df tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:24.951875 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e6b7419f-9511-49fe-8ff1-6904cc1765df tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.325746 May 28 21:21:24.963638 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2086/4225] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:24 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:25.112583 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-abe95e89-f236-4feb-9b4c-8fa9c25447d4 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.256805 May 28 21:21:25.113476 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2140/4226] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:21:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:21:25.125160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-23678ec7-5bee-4abe-afc4-c0e2335edabd tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:25.125793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-23678ec7-5bee-4abe-afc4-c0e2335edabd tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:25.258017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-686a6144-b26c-4ff0-b6f0-33b0601c86b9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:25.262288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-23678ec7-5bee-4abe-afc4-c0e2335edabd tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:25.267053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-686a6144-b26c-4ff0-b6f0-33b0601c86b9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:25.274615 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-23678ec7-5bee-4abe-afc4-c0e2335edabd tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1213 microversion: 2.1 time: 0.154495 May 28 21:21:25.289720 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2087/4227] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:25 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:25.299649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-686a6144-b26c-4ff0-b6f0-33b0601c86b9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:25.300363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-686a6144-b26c-4ff0-b6f0-33b0601c86b9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:25.301377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-686a6144-b26c-4ff0-b6f0-33b0601c86b9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:25.302605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-686a6144-b26c-4ff0-b6f0-33b0601c86b9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:25.597507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-686a6144-b26c-4ff0-b6f0-33b0601c86b9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:25.609374 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-686a6144-b26c-4ff0-b6f0-33b0601c86b9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.356497 May 28 21:21:25.609997 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2141/4228] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:25 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:25.972552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-50590572-525c-4e6f-9747-cf26243fbbef tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:25.974164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-50590572-525c-4e6f-9747-cf26243fbbef tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:25.986594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50590572-525c-4e6f-9747-cf26243fbbef tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:25.987062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50590572-525c-4e6f-9747-cf26243fbbef tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:25.987859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50590572-525c-4e6f-9747-cf26243fbbef tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:25.988307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50590572-525c-4e6f-9747-cf26243fbbef tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:26.296419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cf8194c8-1466-4430-91eb-d2e800fe1c08 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:26.298036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cf8194c8-1466-4430-91eb-d2e800fe1c08 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:26.523731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cf8194c8-1466-4430-91eb-d2e800fe1c08 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:26.533258 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cf8194c8-1466-4430-91eb-d2e800fe1c08 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1213 microversion: 2.1 time: 0.240724 May 28 21:21:26.549219 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2142/4229] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:26 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1213 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:26.628216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5bf7dd53-5e18-46f6-816e-714cb0501a0f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:26.629782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5bf7dd53-5e18-46f6-816e-714cb0501a0f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:26.652462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bf7dd53-5e18-46f6-816e-714cb0501a0f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:26.654125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bf7dd53-5e18-46f6-816e-714cb0501a0f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:26.655170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bf7dd53-5e18-46f6-816e-714cb0501a0f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:26.664190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bf7dd53-5e18-46f6-816e-714cb0501a0f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:26.689116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-50590572-525c-4e6f-9747-cf26243fbbef tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:26.704666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-50590572-525c-4e6f-9747-cf26243fbbef tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:26.709036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-50590572-525c-4e6f-9747-cf26243fbbef tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:26.723074 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-50590572-525c-4e6f-9747-cf26243fbbef tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.750364 May 28 21:21:26.723074 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2088/4230] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:25 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:26.894559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5bf7dd53-5e18-46f6-816e-714cb0501a0f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:26.904614 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5bf7dd53-5e18-46f6-816e-714cb0501a0f tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.282085 May 28 21:21:26.917252 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2143/4231] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:26 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:21:27.562825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-30f9e103-1bd7-4553-b7f6-4eb38bddee01 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:27.562825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-30f9e103-1bd7-4553-b7f6-4eb38bddee01 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:27.564817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30f9e103-1bd7-4553-b7f6-4eb38bddee01 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:27.565465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30f9e103-1bd7-4553-b7f6-4eb38bddee01 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:27.566616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30f9e103-1bd7-4553-b7f6-4eb38bddee01 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:27.567380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30f9e103-1bd7-4553-b7f6-4eb38bddee01 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:27.729624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-30f9e103-1bd7-4553-b7f6-4eb38bddee01 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:27.739265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-12d2ea17-a776-4604-8d8b-e99b19cb4717 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:27.747089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-12d2ea17-a776-4604-8d8b-e99b19cb4717 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:27.753981 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-30f9e103-1bd7-4553-b7f6-4eb38bddee01 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1265 microversion: 2.1 time: 0.200416 May 28 21:21:27.754845 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2089/4232] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:27 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:27.756261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12d2ea17-a776-4604-8d8b-e99b19cb4717 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:27.756986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12d2ea17-a776-4604-8d8b-e99b19cb4717 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:27.758041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12d2ea17-a776-4604-8d8b-e99b19cb4717 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:27.758704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12d2ea17-a776-4604-8d8b-e99b19cb4717 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:27.924536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1cb94be9-0922-4d70-8316-993ed4e5aa29 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:27.925254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1cb94be9-0922-4d70-8316-993ed4e5aa29 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:27.939493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cb94be9-0922-4d70-8316-993ed4e5aa29 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:27.940072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cb94be9-0922-4d70-8316-993ed4e5aa29 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:27.940973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cb94be9-0922-4d70-8316-993ed4e5aa29 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:27.946960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cb94be9-0922-4d70-8316-993ed4e5aa29 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:27.971865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-12d2ea17-a776-4604-8d8b-e99b19cb4717 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:27.981902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-12d2ea17-a776-4604-8d8b-e99b19cb4717 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:27.987987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-12d2ea17-a776-4604-8d8b-e99b19cb4717 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:27.991586 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-12d2ea17-a776-4604-8d8b-e99b19cb4717 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.255194 May 28 21:21:27.992183 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2144/4233] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:27 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:21:28.256191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1cb94be9-0922-4d70-8316-993ed4e5aa29 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:28.270686 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1cb94be9-0922-4d70-8316-993ed4e5aa29 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.350594 May 28 21:21:28.271857 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2090/4234] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:27 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:21:28.773347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-befae989-00ef-4c4e-afb0-f218ac4d0b34 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:28.774654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-befae989-00ef-4c4e-afb0-f218ac4d0b34 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:28.795432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-befae989-00ef-4c4e-afb0-f218ac4d0b34 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:28.797611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-befae989-00ef-4c4e-afb0-f218ac4d0b34 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:28.800050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-befae989-00ef-4c4e-afb0-f218ac4d0b34 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:28.802424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-befae989-00ef-4c4e-afb0-f218ac4d0b34 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:29.015046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2a94036b-422d-4c35-bf26-800a22f839a5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:29.017779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2a94036b-422d-4c35-bf26-800a22f839a5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:29.039965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a94036b-422d-4c35-bf26-800a22f839a5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:29.041743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a94036b-422d-4c35-bf26-800a22f839a5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:29.044063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a94036b-422d-4c35-bf26-800a22f839a5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:29.044536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a94036b-422d-4c35-bf26-800a22f839a5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:29.049229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-befae989-00ef-4c4e-afb0-f218ac4d0b34 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:29.066707 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-befae989-00ef-4c4e-afb0-f218ac4d0b34 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1273 microversion: 2.1 time: 0.297996 May 28 21:21:29.073969 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2145/4235] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:28 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1273 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:29.302481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5d7b6cde-eeab-4577-9cdf-c03ccdc041c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:29.303167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5d7b6cde-eeab-4577-9cdf-c03ccdc041c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:29.315965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d7b6cde-eeab-4577-9cdf-c03ccdc041c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:29.318421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d7b6cde-eeab-4577-9cdf-c03ccdc041c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:29.322561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d7b6cde-eeab-4577-9cdf-c03ccdc041c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:29.323245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d7b6cde-eeab-4577-9cdf-c03ccdc041c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:29.979848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2a94036b-422d-4c35-bf26-800a22f839a5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:29.990551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2a94036b-422d-4c35-bf26-800a22f839a5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:29.998680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2a94036b-422d-4c35-bf26-800a22f839a5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:30.003225 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2a94036b-422d-4c35-bf26-800a22f839a5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.994170 May 28 21:21:30.006169 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2091/4236] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:29 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:21:30.088636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-94b97ea6-52d4-424a-a9b3-f7ca22800ce2 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:30.089269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-94b97ea6-52d4-424a-a9b3-f7ca22800ce2 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:30.100939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94b97ea6-52d4-424a-a9b3-f7ca22800ce2 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:30.101403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94b97ea6-52d4-424a-a9b3-f7ca22800ce2 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:30.111558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94b97ea6-52d4-424a-a9b3-f7ca22800ce2 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:30.112392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94b97ea6-52d4-424a-a9b3-f7ca22800ce2 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:30.360523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-94b97ea6-52d4-424a-a9b3-f7ca22800ce2 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:30.369109 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-94b97ea6-52d4-424a-a9b3-f7ca22800ce2 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1271 microversion: 2.1 time: 0.284292 May 28 21:21:30.383289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5d7b6cde-eeab-4577-9cdf-c03ccdc041c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:30.386021 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2092/4237] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:30 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1271 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:30.392433 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5d7b6cde-eeab-4577-9cdf-c03ccdc041c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 1.105071 May 28 21:21:30.393027 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2146/4238] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:29 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:21:31.022772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ae300059-386c-490c-b634-b6e6bb67395f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:31.023392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ae300059-386c-490c-b634-b6e6bb67395f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:31.025473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:31.038061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae300059-386c-490c-b634-b6e6bb67395f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:31.038519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae300059-386c-490c-b634-b6e6bb67395f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:31.039302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae300059-386c-490c-b634-b6e6bb67395f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:31.039742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae300059-386c-490c-b634-b6e6bb67395f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:31.284709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ae300059-386c-490c-b634-b6e6bb67395f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:31.293295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ae300059-386c-490c-b634-b6e6bb67395f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:31.295132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ae300059-386c-490c-b634-b6e6bb67395f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:31.296852 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ae300059-386c-490c-b634-b6e6bb67395f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.277974 May 28 21:21:31.297776 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2093/4239] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:31 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:31.387503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b4a4e5e5-72c2-465c-96fb-ba0632b44712 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:31.388068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b4a4e5e5-72c2-465c-96fb-ba0632b44712 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:31.395994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4a4e5e5-72c2-465c-96fb-ba0632b44712 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:31.396461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4a4e5e5-72c2-465c-96fb-ba0632b44712 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:31.397580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4a4e5e5-72c2-465c-96fb-ba0632b44712 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:31.398289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4a4e5e5-72c2-465c-96fb-ba0632b44712 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:31.410868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-46f116a5-25f4-4181-aee0-59abefdfce9b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:31.411785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-46f116a5-25f4-4181-aee0-59abefdfce9b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:31.423144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46f116a5-25f4-4181-aee0-59abefdfce9b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:31.423847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46f116a5-25f4-4181-aee0-59abefdfce9b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:31.424637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46f116a5-25f4-4181-aee0-59abefdfce9b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:31.425076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46f116a5-25f4-4181-aee0-59abefdfce9b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:31.771439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b4a4e5e5-72c2-465c-96fb-ba0632b44712 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:31.783083 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b4a4e5e5-72c2-465c-96fb-ba0632b44712 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1313 microversion: 2.1 time: 0.399452 May 28 21:21:31.797678 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2147/4240] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:31 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:31.822527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-46f116a5-25f4-4181-aee0-59abefdfce9b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:31.855381 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-46f116a5-25f4-4181-aee0-59abefdfce9b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.447733 May 28 21:21:31.863314 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2094/4241] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:31 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:32.317279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4c724d73-f6d5-4c55-bfc9-b798cb512d7f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:32.318440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4c724d73-f6d5-4c55-bfc9-b798cb512d7f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:32.330803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c724d73-f6d5-4c55-bfc9-b798cb512d7f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:32.331368 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c724d73-f6d5-4c55-bfc9-b798cb512d7f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:32.334049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c724d73-f6d5-4c55-bfc9-b798cb512d7f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:32.335922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c724d73-f6d5-4c55-bfc9-b798cb512d7f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:32.790517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4c724d73-f6d5-4c55-bfc9-b798cb512d7f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:32.806051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2d610a05-85e6-4ebd-9a23-63fb3a2fe1ec tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:32.807469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2d610a05-85e6-4ebd-9a23-63fb3a2fe1ec tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:32.821344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4c724d73-f6d5-4c55-bfc9-b798cb512d7f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:32.825952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d610a05-85e6-4ebd-9a23-63fb3a2fe1ec tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:32.828915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4c724d73-f6d5-4c55-bfc9-b798cb512d7f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:32.833785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d610a05-85e6-4ebd-9a23-63fb3a2fe1ec tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:32.835239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d610a05-85e6-4ebd-9a23-63fb3a2fe1ec tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:32.835485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d610a05-85e6-4ebd-9a23-63fb3a2fe1ec tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:32.837878 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4c724d73-f6d5-4c55-bfc9-b798cb512d7f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.524997 May 28 21:21:32.841747 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2148/4242] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:32 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:32.873114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b394d658-b6d8-437a-bcb2-e9711f59f36e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:32.874012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b394d658-b6d8-437a-bcb2-e9711f59f36e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:32.883790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b394d658-b6d8-437a-bcb2-e9711f59f36e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:32.885946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b394d658-b6d8-437a-bcb2-e9711f59f36e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:32.887791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b394d658-b6d8-437a-bcb2-e9711f59f36e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:32.896254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b394d658-b6d8-437a-bcb2-e9711f59f36e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:33.556874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b394d658-b6d8-437a-bcb2-e9711f59f36e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:33.579944 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b394d658-b6d8-437a-bcb2-e9711f59f36e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.707153 May 28 21:21:33.584909 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2149/4243] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:32 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:33.596948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2d610a05-85e6-4ebd-9a23-63fb3a2fe1ec tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:33.616961 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2d610a05-85e6-4ebd-9a23-63fb3a2fe1ec tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1313 microversion: 2.1 time: 0.814543 May 28 21:21:33.634458 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2095/4244] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:32 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1313 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:33.857157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0804b157-72d0-4880-9db9-1002e6af4f06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:33.858111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0804b157-72d0-4880-9db9-1002e6af4f06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:33.869078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0804b157-72d0-4880-9db9-1002e6af4f06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:33.879719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0804b157-72d0-4880-9db9-1002e6af4f06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:33.880832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0804b157-72d0-4880-9db9-1002e6af4f06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:33.881499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0804b157-72d0-4880-9db9-1002e6af4f06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:34.120739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-1549ecc8-4e88-4e53-8e04-7c8bd93d8ef5 req-7da5b2f5-a144-4d57-bd20-383288bc6c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "717c375c-142d-4538-ada9-ac7ae5e58dbc", "tag": "94e95393-1f03-4443-9ff3-e2ea1ebe7635"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:34.150612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1549ecc8-4e88-4e53-8e04-7c8bd93d8ef5 req-7da5b2f5-a144-4d57-bd20-383288bc6c41 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:34.156473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1549ecc8-4e88-4e53-8e04-7c8bd93d8ef5 req-7da5b2f5-a144-4d57-bd20-383288bc6c41 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:34.183202 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-1549ecc8-4e88-4e53-8e04-7c8bd93d8ef5 req-7da5b2f5-a144-4d57-bd20-383288bc6c41 service nova] Creating event network-changed:94e95393-1f03-4443-9ff3-e2ea1ebe7635 for instance 717c375c-142d-4538-ada9-ac7ae5e58dbc on nch2-master-1 May 28 21:21:34.193538 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-1549ecc8-4e88-4e53-8e04-7c8bd93d8ef5 req-7da5b2f5-a144-4d57-bd20-383288bc6c41 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076694 May 28 21:21:34.196923 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2096/4245] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:21:34.300103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0804b157-72d0-4880-9db9-1002e6af4f06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:34.312746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0804b157-72d0-4880-9db9-1002e6af4f06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:34.319969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0804b157-72d0-4880-9db9-1002e6af4f06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:34.321543 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0804b157-72d0-4880-9db9-1002e6af4f06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.468421 May 28 21:21:34.334920 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2150/4246] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:33 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:34.600477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-53583a42-a910-4e10-b592-501eff862335 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:34.601431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-53583a42-a910-4e10-b592-501eff862335 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:34.610870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53583a42-a910-4e10-b592-501eff862335 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:34.611778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53583a42-a910-4e10-b592-501eff862335 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:34.613155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53583a42-a910-4e10-b592-501eff862335 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:34.613794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53583a42-a910-4e10-b592-501eff862335 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:34.633206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:34.643726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-be4f10cb-a5f8-4030-a11e-de3bc6260acf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:34.644449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-be4f10cb-a5f8-4030-a11e-de3bc6260acf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:34.657112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be4f10cb-a5f8-4030-a11e-de3bc6260acf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:34.661503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be4f10cb-a5f8-4030-a11e-de3bc6260acf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:34.661503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be4f10cb-a5f8-4030-a11e-de3bc6260acf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:34.661503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be4f10cb-a5f8-4030-a11e-de3bc6260acf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:34.834357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:35.274775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:35.292705 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-be4f10cb-a5f8-4030-a11e-de3bc6260acf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:35.315471 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-be4f10cb-a5f8-4030-a11e-de3bc6260acf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1313 microversion: 2.1 time: 0.675714 May 28 21:21:35.328188 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2151/4247] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:34 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1313 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:35.362280 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-53583a42-a910-4e10-b592-501eff862335 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:35.368447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-930692be-e033-4b96-ab52-caf961e0c951 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:35.370390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-930692be-e033-4b96-ab52-caf961e0c951 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:35.381112 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-53583a42-a910-4e10-b592-501eff862335 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.785077 May 28 21:21:35.398424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-930692be-e033-4b96-ab52-caf961e0c951 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:35.399056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-930692be-e033-4b96-ab52-caf961e0c951 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:35.399972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-930692be-e033-4b96-ab52-caf961e0c951 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:35.400736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-930692be-e033-4b96-ab52-caf961e0c951 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:35.402383 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2097/4248] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:34 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:35.979735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-930692be-e033-4b96-ab52-caf961e0c951 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:35.979735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-930692be-e033-4b96-ab52-caf961e0c951 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:35.979735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-930692be-e033-4b96-ab52-caf961e0c951 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:35.979735 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-930692be-e033-4b96-ab52-caf961e0c951 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.621360 May 28 21:21:35.979735 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2152/4249] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:35 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:36.336331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-33914ee3-eadb-409a-b77a-09e76a123e61 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:36.338126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-33914ee3-eadb-409a-b77a-09e76a123e61 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:36.369532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33914ee3-eadb-409a-b77a-09e76a123e61 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:36.381385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33914ee3-eadb-409a-b77a-09e76a123e61 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:36.382745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33914ee3-eadb-409a-b77a-09e76a123e61 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:36.383679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33914ee3-eadb-409a-b77a-09e76a123e61 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:36.402082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6e125a8a-52cc-4840-92ad-5f9119837c88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:36.402714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6e125a8a-52cc-4840-92ad-5f9119837c88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:36.442824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e125a8a-52cc-4840-92ad-5f9119837c88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:36.443306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e125a8a-52cc-4840-92ad-5f9119837c88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:36.452795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e125a8a-52cc-4840-92ad-5f9119837c88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:36.456153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e125a8a-52cc-4840-92ad-5f9119837c88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:36.533811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=8 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:37.422559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-33914ee3-eadb-409a-b77a-09e76a123e61 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:37.441405 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-33914ee3-eadb-409a-b77a-09e76a123e61 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1313 microversion: 2.1 time: 1.107924 May 28 21:21:37.441405 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2098/4250] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:36 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1313 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:37.445286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f5456935-1bf0-4c31-bc6d-7231d72f74d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:37.446168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f5456935-1bf0-4c31-bc6d-7231d72f74d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:37.456091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5456935-1bf0-4c31-bc6d-7231d72f74d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:37.456609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5456935-1bf0-4c31-bc6d-7231d72f74d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:37.457493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5456935-1bf0-4c31-bc6d-7231d72f74d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:37.457979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5456935-1bf0-4c31-bc6d-7231d72f74d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:37.497311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6e125a8a-52cc-4840-92ad-5f9119837c88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:37.509828 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6e125a8a-52cc-4840-92ad-5f9119837c88 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 1.113686 May 28 21:21:37.525928 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2153/4251] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:36 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:37.769438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f5456935-1bf0-4c31-bc6d-7231d72f74d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:37.783824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f5456935-1bf0-4c31-bc6d-7231d72f74d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:37.785746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f5456935-1bf0-4c31-bc6d-7231d72f74d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:37.787412 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f5456935-1bf0-4c31-bc6d-7231d72f74d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.346124 May 28 21:21:37.788156 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2099/4252] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:37 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:38.456574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bce70573-ffc1-46f5-9d5b-661ddb482baf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:38.457266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bce70573-ffc1-46f5-9d5b-661ddb482baf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:38.470054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bce70573-ffc1-46f5-9d5b-661ddb482baf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:38.470054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bce70573-ffc1-46f5-9d5b-661ddb482baf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:38.470054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bce70573-ffc1-46f5-9d5b-661ddb482baf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:38.470054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bce70573-ffc1-46f5-9d5b-661ddb482baf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:38.526864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a1f15d62-c67d-45ed-b51d-7e1362b235bf tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:38.527485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a1f15d62-c67d-45ed-b51d-7e1362b235bf tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:38.541326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1f15d62-c67d-45ed-b51d-7e1362b235bf tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:38.542544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1f15d62-c67d-45ed-b51d-7e1362b235bf tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:38.544968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1f15d62-c67d-45ed-b51d-7e1362b235bf tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:38.548879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1f15d62-c67d-45ed-b51d-7e1362b235bf tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:38.789512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bce70573-ffc1-46f5-9d5b-661ddb482baf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:38.799090 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bce70573-ffc1-46f5-9d5b-661ddb482baf tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1313 microversion: 2.1 time: 0.346346 May 28 21:21:38.802737 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2154/4253] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:38 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:38.811948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6fd1f3ad-9014-4bfd-a9a7-10c70af6ac2d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:38.812574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6fd1f3ad-9014-4bfd-a9a7-10c70af6ac2d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:38.827645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6fd1f3ad-9014-4bfd-a9a7-10c70af6ac2d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:38.828606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6fd1f3ad-9014-4bfd-a9a7-10c70af6ac2d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:38.831492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6fd1f3ad-9014-4bfd-a9a7-10c70af6ac2d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:38.831492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6fd1f3ad-9014-4bfd-a9a7-10c70af6ac2d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:38.940458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a1f15d62-c67d-45ed-b51d-7e1362b235bf tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:38.957098 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a1f15d62-c67d-45ed-b51d-7e1362b235bf tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.434328 May 28 21:21:38.958587 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2100/4254] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:38 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:39.067682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6fd1f3ad-9014-4bfd-a9a7-10c70af6ac2d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:39.079489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6fd1f3ad-9014-4bfd-a9a7-10c70af6ac2d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:39.087260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6fd1f3ad-9014-4bfd-a9a7-10c70af6ac2d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:39.088724 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6fd1f3ad-9014-4bfd-a9a7-10c70af6ac2d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.281038 May 28 21:21:39.089422 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2155/4255] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:38 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:39.819971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1f0504f8-d9de-4028-8658-ebe85f96d7e9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:39.820662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1f0504f8-d9de-4028-8658-ebe85f96d7e9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:39.831320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f0504f8-d9de-4028-8658-ebe85f96d7e9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:39.833554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f0504f8-d9de-4028-8658-ebe85f96d7e9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:39.833554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f0504f8-d9de-4028-8658-ebe85f96d7e9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:39.833554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f0504f8-d9de-4028-8658-ebe85f96d7e9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:39.976292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d09210c1-b136-4927-8d1c-487770cf7d27 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:39.977275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d09210c1-b136-4927-8d1c-487770cf7d27 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:39.987971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d09210c1-b136-4927-8d1c-487770cf7d27 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:39.988669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d09210c1-b136-4927-8d1c-487770cf7d27 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:39.993676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d09210c1-b136-4927-8d1c-487770cf7d27 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:39.993676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d09210c1-b136-4927-8d1c-487770cf7d27 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:40.334237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1f0504f8-d9de-4028-8658-ebe85f96d7e9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:40.335672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d09210c1-b136-4927-8d1c-487770cf7d27 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:40.350555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:40.360401 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d09210c1-b136-4927-8d1c-487770cf7d27 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.385134 May 28 21:21:40.360401 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2156/4256] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:39 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:40.360954 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1f0504f8-d9de-4028-8658-ebe85f96d7e9 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1313 microversion: 2.1 time: 0.544835 May 28 21:21:40.362086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f2e9e19a-5840-4e94-adc7-9ab7061fd0ca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:40.362471 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2101/4257] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:39 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1313 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:40.363060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f2e9e19a-5840-4e94-adc7-9ab7061fd0ca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:40.369888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2e9e19a-5840-4e94-adc7-9ab7061fd0ca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:40.370564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2e9e19a-5840-4e94-adc7-9ab7061fd0ca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:40.372277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2e9e19a-5840-4e94-adc7-9ab7061fd0ca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:40.373096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2e9e19a-5840-4e94-adc7-9ab7061fd0ca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:40.527982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f2e9e19a-5840-4e94-adc7-9ab7061fd0ca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:40.559215 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f2e9e19a-5840-4e94-adc7-9ab7061fd0ca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:40.562744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f2e9e19a-5840-4e94-adc7-9ab7061fd0ca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:40.575087 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f2e9e19a-5840-4e94-adc7-9ab7061fd0ca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.206383 May 28 21:21:40.575087 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2157/4258] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:40 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:41.381713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0144a782-c2c6-4c60-8f01-b589ee139bc7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:41.382280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7669d3c1-2d16-4ecc-90fb-2e51126a9e86 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:41.382629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7669d3c1-2d16-4ecc-90fb-2e51126a9e86 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:41.383560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0144a782-c2c6-4c60-8f01-b589ee139bc7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:41.389907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7669d3c1-2d16-4ecc-90fb-2e51126a9e86 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:41.390384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7669d3c1-2d16-4ecc-90fb-2e51126a9e86 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:41.391160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7669d3c1-2d16-4ecc-90fb-2e51126a9e86 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:41.391606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7669d3c1-2d16-4ecc-90fb-2e51126a9e86 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:41.392754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0144a782-c2c6-4c60-8f01-b589ee139bc7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:41.393265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0144a782-c2c6-4c60-8f01-b589ee139bc7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:41.394310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0144a782-c2c6-4c60-8f01-b589ee139bc7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:41.395022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0144a782-c2c6-4c60-8f01-b589ee139bc7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:41.769744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7669d3c1-2d16-4ecc-90fb-2e51126a9e86 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:41.781641 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7669d3c1-2d16-4ecc-90fb-2e51126a9e86 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1313 microversion: 2.1 time: 0.403840 May 28 21:21:41.795885 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2158/4259] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:41 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:41.805576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0144a782-c2c6-4c60-8f01-b589ee139bc7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:41.805742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-79e4506f-551b-4333-9cc8-53f01740297f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:41.805742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-79e4506f-551b-4333-9cc8-53f01740297f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:41.810032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79e4506f-551b-4333-9cc8-53f01740297f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:41.810193 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0144a782-c2c6-4c60-8f01-b589ee139bc7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.433172 May 28 21:21:41.810738 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2102/4260] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:41 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:41.811149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79e4506f-551b-4333-9cc8-53f01740297f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:41.812296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79e4506f-551b-4333-9cc8-53f01740297f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:41.813054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79e4506f-551b-4333-9cc8-53f01740297f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:42.047843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-79e4506f-551b-4333-9cc8-53f01740297f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:42.056364 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-79e4506f-551b-4333-9cc8-53f01740297f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:42.057906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-79e4506f-551b-4333-9cc8-53f01740297f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:42.059483 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-79e4506f-551b-4333-9cc8-53f01740297f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.262132 May 28 21:21:42.064376 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2159/4261] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:41 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:42.804724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd5aea64-8615-4a18-b910-3ebea120288d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:42.809337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bd5aea64-8615-4a18-b910-3ebea120288d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:42.821144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd5aea64-8615-4a18-b910-3ebea120288d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:42.827681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-30d2a9b5-80a7-4015-9329-4adbfd359022 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:42.834021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-30d2a9b5-80a7-4015-9329-4adbfd359022 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:42.845552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd5aea64-8615-4a18-b910-3ebea120288d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:42.845552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd5aea64-8615-4a18-b910-3ebea120288d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:42.845552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd5aea64-8615-4a18-b910-3ebea120288d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:42.873811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30d2a9b5-80a7-4015-9329-4adbfd359022 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:42.879952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30d2a9b5-80a7-4015-9329-4adbfd359022 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:42.880875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30d2a9b5-80a7-4015-9329-4adbfd359022 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:42.881372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30d2a9b5-80a7-4015-9329-4adbfd359022 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:43.333575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bd5aea64-8615-4a18-b910-3ebea120288d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:43.362052 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bd5aea64-8615-4a18-b910-3ebea120288d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1313 microversion: 2.1 time: 0.562932 May 28 21:21:43.362753 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2103/4262] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:42 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:43.374801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-13c255a8-1ac5-4d88-9cd3-1f47b2f7c0b6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:43.375730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-13c255a8-1ac5-4d88-9cd3-1f47b2f7c0b6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:43.390465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13c255a8-1ac5-4d88-9cd3-1f47b2f7c0b6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:43.391649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13c255a8-1ac5-4d88-9cd3-1f47b2f7c0b6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:43.398845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13c255a8-1ac5-4d88-9cd3-1f47b2f7c0b6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:43.399617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13c255a8-1ac5-4d88-9cd3-1f47b2f7c0b6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:43.930565 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-30d2a9b5-80a7-4015-9329-4adbfd359022 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:43.956300 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-30d2a9b5-80a7-4015-9329-4adbfd359022 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 1.131907 May 28 21:21:43.962598 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2160/4263] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:42 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:43.980810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-fcd397f6-9910-413a-a5b8-e03e0760a623 req-b096daa0-9eb2-4a86-812b-fd0b261fb35f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717c375c-142d-4538-ada9-ac7ae5e58dbc", "name": "network-vif-plugged", "status": "completed", "tag": "94e95393-1f03-4443-9ff3-e2ea1ebe7635"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:44.014014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:44.018818 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-fcd397f6-9910-413a-a5b8-e03e0760a623 req-b096daa0-9eb2-4a86-812b-fd0b261fb35f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:44.021636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-fcd397f6-9910-413a-a5b8-e03e0760a623 req-b096daa0-9eb2-4a86-812b-fd0b261fb35f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:44.053000 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-fcd397f6-9910-413a-a5b8-e03e0760a623 req-b096daa0-9eb2-4a86-812b-fd0b261fb35f service nova] Creating event network-vif-plugged:94e95393-1f03-4443-9ff3-e2ea1ebe7635 for instance 717c375c-142d-4538-ada9-ac7ae5e58dbc on nch2-master-1 May 28 21:21:44.059215 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-fcd397f6-9910-413a-a5b8-e03e0760a623 req-b096daa0-9eb2-4a86-812b-fd0b261fb35f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091828 May 28 21:21:44.060809 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2161/4264] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:21:44.096803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-13c255a8-1ac5-4d88-9cd3-1f47b2f7c0b6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:44.117570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-13c255a8-1ac5-4d88-9cd3-1f47b2f7c0b6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:44.122127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-13c255a8-1ac5-4d88-9cd3-1f47b2f7c0b6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:44.126022 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-13c255a8-1ac5-4d88-9cd3-1f47b2f7c0b6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.761402 May 28 21:21:44.131932 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2104/4265] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:43 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:44.394632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9f374557-8b4d-4203-9580-d4dbfa4273e7 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:44.401117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9f374557-8b4d-4203-9580-d4dbfa4273e7 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:44.420815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f374557-8b4d-4203-9580-d4dbfa4273e7 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:44.421629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f374557-8b4d-4203-9580-d4dbfa4273e7 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:44.422660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f374557-8b4d-4203-9580-d4dbfa4273e7 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:44.423916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f374557-8b4d-4203-9580-d4dbfa4273e7 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:44.801041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9f374557-8b4d-4203-9580-d4dbfa4273e7 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:44.813027 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9f374557-8b4d-4203-9580-d4dbfa4273e7 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1313 microversion: 2.1 time: 0.436718 May 28 21:21:44.815185 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2162/4266] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:44 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:44.979896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-19204a56-2ae5-425f-8f54-b9e6db28ea3c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:44.980756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-19204a56-2ae5-425f-8f54-b9e6db28ea3c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:44.990997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19204a56-2ae5-425f-8f54-b9e6db28ea3c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:44.992128 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19204a56-2ae5-425f-8f54-b9e6db28ea3c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:44.994252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19204a56-2ae5-425f-8f54-b9e6db28ea3c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:44.995087 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19204a56-2ae5-425f-8f54-b9e6db28ea3c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:45.144974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-24f82746-363a-4e1a-a479-de2ab447a5af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:45.145605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-24f82746-363a-4e1a-a479-de2ab447a5af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:45.153094 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24f82746-363a-4e1a-a479-de2ab447a5af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:45.153563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24f82746-363a-4e1a-a479-de2ab447a5af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:45.154517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24f82746-363a-4e1a-a479-de2ab447a5af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:45.155877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24f82746-363a-4e1a-a479-de2ab447a5af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:45.353404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-19204a56-2ae5-425f-8f54-b9e6db28ea3c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:45.366494 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-19204a56-2ae5-425f-8f54-b9e6db28ea3c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.389635 May 28 21:21:45.379701 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2105/4267] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:44 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:45.517586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-24f82746-363a-4e1a-a479-de2ab447a5af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:45.531079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-24f82746-363a-4e1a-a479-de2ab447a5af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:45.533032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-24f82746-363a-4e1a-a479-de2ab447a5af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:45.534455 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-24f82746-363a-4e1a-a479-de2ab447a5af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.393752 May 28 21:21:45.546307 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2163/4268] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:45 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:21:45.831138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1c853fda-5c09-41ed-8b42-fa9581c0f18b tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:45.832392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1c853fda-5c09-41ed-8b42-fa9581c0f18b tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:45.847133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c853fda-5c09-41ed-8b42-fa9581c0f18b tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:45.847914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c853fda-5c09-41ed-8b42-fa9581c0f18b tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:45.848862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c853fda-5c09-41ed-8b42-fa9581c0f18b tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:45.854268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c853fda-5c09-41ed-8b42-fa9581c0f18b tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:46.087997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-e1855aac-3411-4b6e-9789-d53602bcb029 req-f68d7a99-c873-4c49-92f4-ec4e234017de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6232e7b0-68db-43d6-a836-fb2f96c54658", "name": "network-vif-plugged", "status": "completed", "tag": "5f12e599-b5ae-4dcf-ac2c-9827b4ca4a75"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:46.098983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e1855aac-3411-4b6e-9789-d53602bcb029 req-f68d7a99-c873-4c49-92f4-ec4e234017de service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:46.099452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e1855aac-3411-4b6e-9789-d53602bcb029 req-f68d7a99-c873-4c49-92f4-ec4e234017de service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:46.129376 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e1855aac-3411-4b6e-9789-d53602bcb029 req-f68d7a99-c873-4c49-92f4-ec4e234017de service nova] Creating event network-vif-plugged:5f12e599-b5ae-4dcf-ac2c-9827b4ca4a75 for instance 6232e7b0-68db-43d6-a836-fb2f96c54658 on nch2-master-1 May 28 21:21:46.143730 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-e1855aac-3411-4b6e-9789-d53602bcb029 req-f68d7a99-c873-4c49-92f4-ec4e234017de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059574 May 28 21:21:46.144491 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2164/4269] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:21:46.318249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1c853fda-5c09-41ed-8b42-fa9581c0f18b tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:46.327191 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1c853fda-5c09-41ed-8b42-fa9581c0f18b tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1497 microversion: 2.1 time: 0.500074 May 28 21:21:46.335986 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2106/4270] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:45 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1497 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:46.386632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-23ed269d-b0e4-47ad-86ed-a9c4e2e37840 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:46.387351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-23ed269d-b0e4-47ad-86ed-a9c4e2e37840 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:46.399157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23ed269d-b0e4-47ad-86ed-a9c4e2e37840 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:46.399628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23ed269d-b0e4-47ad-86ed-a9c4e2e37840 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:46.406394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23ed269d-b0e4-47ad-86ed-a9c4e2e37840 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:46.407054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23ed269d-b0e4-47ad-86ed-a9c4e2e37840 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:46.555801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6abb8721-aef7-409a-9d07-6a9c1f2817d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:46.556460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6abb8721-aef7-409a-9d07-6a9c1f2817d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:46.565547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6abb8721-aef7-409a-9d07-6a9c1f2817d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:46.584874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6abb8721-aef7-409a-9d07-6a9c1f2817d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:46.585737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6abb8721-aef7-409a-9d07-6a9c1f2817d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:46.595450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6abb8721-aef7-409a-9d07-6a9c1f2817d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:47.065138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-23ed269d-b0e4-47ad-86ed-a9c4e2e37840 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:47.082519 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-23ed269d-b0e4-47ad-86ed-a9c4e2e37840 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.693848 May 28 21:21:47.083495 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2165/4271] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:46 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:47.157966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6abb8721-aef7-409a-9d07-6a9c1f2817d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:47.171893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6abb8721-aef7-409a-9d07-6a9c1f2817d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:47.175297 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6abb8721-aef7-409a-9d07-6a9c1f2817d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:47.181580 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6abb8721-aef7-409a-9d07-6a9c1f2817d2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.628768 May 28 21:21:47.192342 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2107/4272] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:46 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:21:47.611549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-72b0a259-bcd1-403a-9775-54940572310f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:47.612064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-72b0a259-bcd1-403a-9775-54940572310f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:47.619362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72b0a259-bcd1-403a-9775-54940572310f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:47.619829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72b0a259-bcd1-403a-9775-54940572310f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:47.620631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72b0a259-bcd1-403a-9775-54940572310f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:47.621083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72b0a259-bcd1-403a-9775-54940572310f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:47.653074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-72b0a259-bcd1-403a-9775-54940572310f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:21:48.100716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f6c29a8f-c9eb-4d7d-bdd3-009bc449abf2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:48.101513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f6c29a8f-c9eb-4d7d-bdd3-009bc449abf2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:48.113091 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-72b0a259-bcd1-403a-9775-54940572310f tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "DELETE /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 204 len: 0 microversion: 2.1 time: 0.504920 May 28 21:21:48.116678 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2166/4273] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:21:47 2022] DELETE /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:21:48.124429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-62eb4186-7d1a-4d6a-a3f4-fec28910bd4d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:48.125161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-62eb4186-7d1a-4d6a-a3f4-fec28910bd4d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:48.135790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6c29a8f-c9eb-4d7d-bdd3-009bc449abf2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:48.139936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62eb4186-7d1a-4d6a-a3f4-fec28910bd4d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:48.140602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6c29a8f-c9eb-4d7d-bdd3-009bc449abf2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:48.140862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62eb4186-7d1a-4d6a-a3f4-fec28910bd4d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:48.141569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6c29a8f-c9eb-4d7d-bdd3-009bc449abf2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:48.141697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62eb4186-7d1a-4d6a-a3f4-fec28910bd4d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:48.142166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62eb4186-7d1a-4d6a-a3f4-fec28910bd4d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:48.142302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6c29a8f-c9eb-4d7d-bdd3-009bc449abf2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:48.515395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-62eb4186-7d1a-4d6a-a3f4-fec28910bd4d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:48.530808 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-62eb4186-7d1a-4d6a-a3f4-fec28910bd4d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1503 microversion: 2.1 time: 0.411611 May 28 21:21:48.532116 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2167/4274] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:48 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1503 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:48.537624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c0a74d8e-851c-4a05-8207-c1629c7d6063 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:48.538415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c0a74d8e-851c-4a05-8207-c1629c7d6063 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:48.550662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0a74d8e-851c-4a05-8207-c1629c7d6063 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:48.550754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0a74d8e-851c-4a05-8207-c1629c7d6063 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:48.551532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0a74d8e-851c-4a05-8207-c1629c7d6063 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:48.552354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0a74d8e-851c-4a05-8207-c1629c7d6063 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:48.559664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f6c29a8f-c9eb-4d7d-bdd3-009bc449abf2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:48.573897 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f6c29a8f-c9eb-4d7d-bdd3-009bc449abf2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.477816 May 28 21:21:48.574747 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2108/4275] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:48 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:48.697964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c0a74d8e-851c-4a05-8207-c1629c7d6063 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:48.708258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c0a74d8e-851c-4a05-8207-c1629c7d6063 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:48.709998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c0a74d8e-851c-4a05-8207-c1629c7d6063 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:48.711255 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c0a74d8e-851c-4a05-8207-c1629c7d6063 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.177726 May 28 21:21:48.712054 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2168/4276] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:48 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:49.551030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e9d0b98a-b7ea-45fb-b4d4-5d85aa3bf562 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:49.557744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e9d0b98a-b7ea-45fb-b4d4-5d85aa3bf562 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:49.574174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9d0b98a-b7ea-45fb-b4d4-5d85aa3bf562 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:49.574757 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9d0b98a-b7ea-45fb-b4d4-5d85aa3bf562 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:49.578176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9d0b98a-b7ea-45fb-b4d4-5d85aa3bf562 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:49.578634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9d0b98a-b7ea-45fb-b4d4-5d85aa3bf562 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:49.594798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-726d2317-bbdd-40ec-897d-dd7fb7e4d941 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:49.595437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-726d2317-bbdd-40ec-897d-dd7fb7e4d941 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:49.615492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-726d2317-bbdd-40ec-897d-dd7fb7e4d941 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:49.615957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-726d2317-bbdd-40ec-897d-dd7fb7e4d941 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:49.616761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-726d2317-bbdd-40ec-897d-dd7fb7e4d941 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:49.617213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-726d2317-bbdd-40ec-897d-dd7fb7e4d941 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:50.036110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e9d0b98a-b7ea-45fb-b4d4-5d85aa3bf562 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:50.043989 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e9d0b98a-b7ea-45fb-b4d4-5d85aa3bf562 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1503 microversion: 2.1 time: 0.499636 May 28 21:21:50.055101 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2109/4277] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:49 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1503 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:50.060690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2402c0e8-cd14-4583-a9b1-09bfb16d4e08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:50.062673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2402c0e8-cd14-4583-a9b1-09bfb16d4e08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:50.069265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2402c0e8-cd14-4583-a9b1-09bfb16d4e08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:50.069944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2402c0e8-cd14-4583-a9b1-09bfb16d4e08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:50.070907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2402c0e8-cd14-4583-a9b1-09bfb16d4e08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:50.071489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2402c0e8-cd14-4583-a9b1-09bfb16d4e08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:50.081416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-726d2317-bbdd-40ec-897d-dd7fb7e4d941 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:50.094192 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-726d2317-bbdd-40ec-897d-dd7fb7e4d941 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.502835 May 28 21:21:50.095934 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2169/4278] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:49 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:50.441922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2402c0e8-cd14-4583-a9b1-09bfb16d4e08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:50.470070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2402c0e8-cd14-4583-a9b1-09bfb16d4e08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:50.472780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2402c0e8-cd14-4583-a9b1-09bfb16d4e08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:50.475134 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2402c0e8-cd14-4583-a9b1-09bfb16d4e08 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1808 microversion: 2.20 time: 0.418639 May 28 21:21:50.476273 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2110/4279] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:50 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1808 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:50.659958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-87ba43bb-6e3d-4f01-b019-ca022f2b49b7 req-b17758de-eb9c-46ac-a670-c2fdab95e15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717c375c-142d-4538-ada9-ac7ae5e58dbc", "name": "network-vif-deleted", "tag": "94e95393-1f03-4443-9ff3-e2ea1ebe7635"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:50.693377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-87ba43bb-6e3d-4f01-b019-ca022f2b49b7 req-b17758de-eb9c-46ac-a670-c2fdab95e15f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:50.694176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-87ba43bb-6e3d-4f01-b019-ca022f2b49b7 req-b17758de-eb9c-46ac-a670-c2fdab95e15f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:50.716381 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-87ba43bb-6e3d-4f01-b019-ca022f2b49b7 req-b17758de-eb9c-46ac-a670-c2fdab95e15f service nova] Creating event network-vif-deleted:94e95393-1f03-4443-9ff3-e2ea1ebe7635 for instance 717c375c-142d-4538-ada9-ac7ae5e58dbc on nch2-master-1 May 28 21:21:50.723344 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-87ba43bb-6e3d-4f01-b019-ca022f2b49b7 req-b17758de-eb9c-46ac-a670-c2fdab95e15f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071772 May 28 21:21:50.724541 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2170/4280] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:21:51.077046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84555d47-dab0-41a7-82bc-ee3e086f229d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:51.078290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-84555d47-dab0-41a7-82bc-ee3e086f229d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:51.088921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84555d47-dab0-41a7-82bc-ee3e086f229d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:51.089382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84555d47-dab0-41a7-82bc-ee3e086f229d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:51.090211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84555d47-dab0-41a7-82bc-ee3e086f229d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:51.090662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84555d47-dab0-41a7-82bc-ee3e086f229d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:51.114173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c6313d41-91f7-44e6-9600-23907e71d87e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:51.114958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c6313d41-91f7-44e6-9600-23907e71d87e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:51.125781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6313d41-91f7-44e6-9600-23907e71d87e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:51.132228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6313d41-91f7-44e6-9600-23907e71d87e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:51.132228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6313d41-91f7-44e6-9600-23907e71d87e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:51.132228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6313d41-91f7-44e6-9600-23907e71d87e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:51.132702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84555d47-dab0-41a7-82bc-ee3e086f229d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:51.133344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84555d47-dab0-41a7-82bc-ee3e086f229d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:51.134021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-84555d47-dab0-41a7-82bc-ee3e086f229d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lazy-loading 'fault' on Instance uuid 717c375c-142d-4538-ada9-ac7ae5e58dbc {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:21:51.214652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-84555d47-dab0-41a7-82bc-ee3e086f229d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84f18f11aad344c18bb6b3997370576b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '877bd1cd8912437c8e4871df8a5f7260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:51.223355 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-84555d47-dab0-41a7-82bc-ee3e086f229d tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 200 len: 1303 microversion: 2.1 time: 0.158874 May 28 21:21:51.223994 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2111/4281] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:51 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:51.320727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c6313d41-91f7-44e6-9600-23907e71d87e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:51.328850 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c6313d41-91f7-44e6-9600-23907e71d87e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.221009 May 28 21:21:51.329519 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2171/4282] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:51 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:51.494335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1ffc96c2-0ae0-4904-abe9-489f29146a50 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:51.494952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1ffc96c2-0ae0-4904-abe9-489f29146a50 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:51.501986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ffc96c2-0ae0-4904-abe9-489f29146a50 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:51.502449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ffc96c2-0ae0-4904-abe9-489f29146a50 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:51.503237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ffc96c2-0ae0-4904-abe9-489f29146a50 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:51.503682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ffc96c2-0ae0-4904-abe9-489f29146a50 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:51.698579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1ffc96c2-0ae0-4904-abe9-489f29146a50 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:51.710565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1ffc96c2-0ae0-4904-abe9-489f29146a50 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:51.715529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1ffc96c2-0ae0-4904-abe9-489f29146a50 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:51.720145 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1ffc96c2-0ae0-4904-abe9-489f29146a50 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1795 microversion: 2.20 time: 0.230031 May 28 21:21:51.721312 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2112/4283] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:51 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1795 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:52.244511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-23b2b2a2-71dd-4c83-a6de-0959e00c45e1 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:52.245132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-23b2b2a2-71dd-4c83-a6de-0959e00c45e1 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] [instance: 717c375c-142d-4538-ada9-ac7ae5e58dbc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:52.253438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23b2b2a2-71dd-4c83-a6de-0959e00c45e1 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:52.253811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23b2b2a2-71dd-4c83-a6de-0959e00c45e1 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:52.254616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23b2b2a2-71dd-4c83-a6de-0959e00c45e1 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:52.255061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23b2b2a2-71dd-4c83-a6de-0959e00c45e1 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:52.269876 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-23b2b2a2-71dd-4c83-a6de-0959e00c45e1 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] HTTP exception thrown: Instance 717c375c-142d-4538-ada9-ac7ae5e58dbc could not be found. May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-23b2b2a2-71dd-4c83-a6de-0959e00c45e1 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Request method failure captured: May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc HTTP/1.1 May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpIwaYmDsgZ0cs847iMMi5pdIktxusrwiQTHO7hc8UuQz0pMQJ7Lpq-K5_JMZP-UmRJbWNT7DUg6N5YTObP34CWSDGFi_46MPP8jQTE5xDUJcS-VO_sTCZcWUB07UekhRI0FDg1Q1ls5GqDVW5-jtc98wd7tLAVnPFVmVuZnQDvpeWI May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 877bd1cd8912437c8e4871df8a5f7260 May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-VolumesActionsTest-514564619 May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_877bd1cd8912437c8e4871df8a5f7260", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/877bd1cd8912437c8e4871df8a5f7260"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/877bd1cd8912437c8e4871df8a5f7260"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/877bd1cd8912437c8e4871df8a5f7260"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-VolumesActionsTest-514564619 May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 877bd1cd8912437c8e4871df8a5f7260 May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-VolumesActionsTest-514564619 May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-VolumesActionsTest-514564619-project May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 84f18f11aad344c18bb6b3997370576b May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-VolumesActionsTest-514564619-project May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 717c375c-142d-4538-ada9-ac7ae5e58dbc could not be found. May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '717c375c-142d-4538-ada9-ac7ae5e58dbc'} May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 717c375c-142d-4538-ada9-ac7ae5e58dbc could not be found. May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 717c375c-142d-4538-ada9-ac7ae5e58dbc could not be found. May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:21:52.271596 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:21:52.276183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:21:52.276183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:21:52.276183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:21:52.276183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:21:52.276183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:21:52.276183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 717c375c-142d-4538-ada9-ac7ae5e58dbc could not be found. May 28 21:21:52.276183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:21:52.276183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-23b2b2a2-71dd-4c83-a6de-0959e00c45e1 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] Returning 404 to user: Instance 717c375c-142d-4538-ada9-ac7ae5e58dbc could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:21:52.276183 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-23b2b2a2-71dd-4c83-a6de-0959e00c45e1 tempest-VolumesActionsTest-514564619 tempest-VolumesActionsTest-514564619-project] 10.222.0.33 "GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc" status: 404 len: 111 microversion: 2.1 time: 0.033345 May 28 21:21:52.276183 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2172/4284] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:52 2022] GET /compute/v2.1/servers/717c375c-142d-4538-ada9-ac7ae5e58dbc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:21:52.346439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-72620806-671b-4541-bd6d-24872cb98c67 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:52.347058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-72620806-671b-4541-bd6d-24872cb98c67 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:52.354554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72620806-671b-4541-bd6d-24872cb98c67 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:52.355007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72620806-671b-4541-bd6d-24872cb98c67 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:52.362678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72620806-671b-4541-bd6d-24872cb98c67 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:52.363685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72620806-671b-4541-bd6d-24872cb98c67 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:52.384027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:52.540892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-72620806-671b-4541-bd6d-24872cb98c67 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:52.551653 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-72620806-671b-4541-bd6d-24872cb98c67 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1506 microversion: 2.1 time: 0.209160 May 28 21:21:52.552247 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2113/4285] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:52 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:53.572082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aa4624e1-ce9c-4e43-8630-23851bcfaee2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:53.572652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aa4624e1-ce9c-4e43-8630-23851bcfaee2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:53.584102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa4624e1-ce9c-4e43-8630-23851bcfaee2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:53.584102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa4624e1-ce9c-4e43-8630-23851bcfaee2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:53.584375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa4624e1-ce9c-4e43-8630-23851bcfaee2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:53.584821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa4624e1-ce9c-4e43-8630-23851bcfaee2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:53.797746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aa4624e1-ce9c-4e43-8630-23851bcfaee2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:53.805591 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aa4624e1-ce9c-4e43-8630-23851bcfaee2 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1486 microversion: 2.1 time: 0.238433 May 28 21:21:53.810591 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2173/4286] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:53 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1486 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:53.942116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-818629831", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:54.000592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] validate_networks() for [('552cc0b1-9ce3-409c-8b18-de0982668863', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:21:54.413194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-15df180e-b8c7-4a9d-9030-918bbfb0e279 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:21:54.414511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-15df180e-b8c7-4a9d-9030-918bbfb0e279 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:54.423528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15df180e-b8c7-4a9d-9030-918bbfb0e279 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:54.424197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15df180e-b8c7-4a9d-9030-918bbfb0e279 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:54.425205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15df180e-b8c7-4a9d-9030-918bbfb0e279 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:54.427543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15df180e-b8c7-4a9d-9030-918bbfb0e279 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:54.447700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:21:54.501597 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-15df180e-b8c7-4a9d-9030-918bbfb0e279 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "POST /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63/action" status: 200 len: 32497 microversion: 2.42 time: 0.093551 May 28 21:21:54.502726 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2174/4287] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:21:54 2022] POST /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63/action => generated 32497 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 28 21:21:54.515185 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8edf0118-b07e-49d1-9829-45445c5ec665 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:54.516259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8edf0118-b07e-49d1-9829-45445c5ec665 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:54.535485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8edf0118-b07e-49d1-9829-45445c5ec665 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:54.537088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8edf0118-b07e-49d1-9829-45445c5ec665 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:54.538573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8edf0118-b07e-49d1-9829-45445c5ec665 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:54.540856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8edf0118-b07e-49d1-9829-45445c5ec665 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:54.615243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8edf0118-b07e-49d1-9829-45445c5ec665 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:21:55.061176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:21:55.062314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:21:55.063305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:21:55.064054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:21:55.064715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:21:55.075187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:55.075681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:55.076479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:55.076968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:55.131816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Getting quotas for project 3c6886d8b684413da24b02f5b5fb6ef8. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:21:55.172612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Getting quotas for user f1acb2fffdc64ce29b71b2b40e2285f0 and project 3c6886d8b684413da24b02f5b5fb6ef8. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:21:55.208598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:21:55.211033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:21:55.227884 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8edf0118-b07e-49d1-9829-45445c5ec665 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 204 len: 0 microversion: 2.42 time: 0.718199 May 28 21:21:55.228501 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2175/4288] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:21:54 2022] DELETE /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 28 21:21:55.249395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-04f2dd3a-c1db-4976-9f65-b0e8e1df372f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:55.250227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-04f2dd3a-c1db-4976-9f65-b0e8e1df372f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:55.261521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04f2dd3a-c1db-4976-9f65-b0e8e1df372f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:55.262031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04f2dd3a-c1db-4976-9f65-b0e8e1df372f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:55.263375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04f2dd3a-c1db-4976-9f65-b0e8e1df372f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:55.263649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04f2dd3a-c1db-4976-9f65-b0e8e1df372f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:55.443296 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-de489310-75b0-4fc6-9b98-d6e1f349daa7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.505920 May 28 21:21:55.452860 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2114/4289] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:21:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:21:55.459662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-68db903b-81a2-494f-acdc-125f14a0dcde tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:55.461267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-68db903b-81a2-494f-acdc-125f14a0dcde tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:55.590199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-68db903b-81a2-494f-acdc-125f14a0dcde tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:55.601406 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-68db903b-81a2-494f-acdc-125f14a0dcde tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1213 microversion: 2.1 time: 0.146855 May 28 21:21:55.612662 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2115/4290] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:55 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1213 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:55.688493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-04f2dd3a-c1db-4976-9f65-b0e8e1df372f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:55.704224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-04f2dd3a-c1db-4976-9f65-b0e8e1df372f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:55.708892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-04f2dd3a-c1db-4976-9f65-b0e8e1df372f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:55.710481 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-04f2dd3a-c1db-4976-9f65-b0e8e1df372f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 2960 microversion: 2.42 time: 0.475240 May 28 21:21:55.739887 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2176/4291] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:55 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 2960 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:56.620063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a130b871-49ca-4532-9241-2b2cead22425 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:56.621439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a130b871-49ca-4532-9241-2b2cead22425 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:56.732438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9e3e1f90-e9e6-41bb-a4bf-5f636d10256f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:56.733113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9e3e1f90-e9e6-41bb-a4bf-5f636d10256f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:56.744500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e3e1f90-e9e6-41bb-a4bf-5f636d10256f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:56.744967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e3e1f90-e9e6-41bb-a4bf-5f636d10256f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:56.756459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e3e1f90-e9e6-41bb-a4bf-5f636d10256f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:56.757215 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e3e1f90-e9e6-41bb-a4bf-5f636d10256f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:56.770514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a130b871-49ca-4532-9241-2b2cead22425 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:56.790854 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a130b871-49ca-4532-9241-2b2cead22425 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1213 microversion: 2.1 time: 0.174373 May 28 21:21:56.805851 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2116/4292] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:56 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1213 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:57.520220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9e3e1f90-e9e6-41bb-a4bf-5f636d10256f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:57.537134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9e3e1f90-e9e6-41bb-a4bf-5f636d10256f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:57.541823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9e3e1f90-e9e6-41bb-a4bf-5f636d10256f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:57.546174 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9e3e1f90-e9e6-41bb-a4bf-5f636d10256f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 2960 microversion: 2.42 time: 0.815628 May 28 21:21:57.547808 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2177/4293] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:56 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 2960 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:57.808514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d65f6ada-2328-4ea3-9265-a0901b760203 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:57.809141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d65f6ada-2328-4ea3-9265-a0901b760203 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:57.822103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d65f6ada-2328-4ea3-9265-a0901b760203 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:57.826455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d65f6ada-2328-4ea3-9265-a0901b760203 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:57.827508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d65f6ada-2328-4ea3-9265-a0901b760203 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:57.830042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d65f6ada-2328-4ea3-9265-a0901b760203 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:58.139953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d65f6ada-2328-4ea3-9265-a0901b760203 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:58.153160 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d65f6ada-2328-4ea3-9265-a0901b760203 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1209 microversion: 2.1 time: 0.346172 May 28 21:21:58.155430 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2117/4294] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:57 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1209 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:58.567535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d6b0c179-7118-4b1c-ab1f-37604ae7f806 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:58.568158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d6b0c179-7118-4b1c-ab1f-37604ae7f806 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:58.578178 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6b0c179-7118-4b1c-ab1f-37604ae7f806 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:58.589075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6b0c179-7118-4b1c-ab1f-37604ae7f806 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:58.590147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6b0c179-7118-4b1c-ab1f-37604ae7f806 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:58.590850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6b0c179-7118-4b1c-ab1f-37604ae7f806 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:58.945020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d6b0c179-7118-4b1c-ab1f-37604ae7f806 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:58.963902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d6b0c179-7118-4b1c-ab1f-37604ae7f806 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:58.966860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d6b0c179-7118-4b1c-ab1f-37604ae7f806 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:58.971808 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d6b0c179-7118-4b1c-ab1f-37604ae7f806 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 2939 microversion: 2.42 time: 0.407548 May 28 21:21:58.975498 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2178/4295] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:58 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 2939 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:21:59.172104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3cc59987-918e-45a4-8cc9-19e4c92cf1c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:21:59.174116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3cc59987-918e-45a4-8cc9-19e4c92cf1c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:21:59.189495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cc59987-918e-45a4-8cc9-19e4c92cf1c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:59.192092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cc59987-918e-45a4-8cc9-19e4c92cf1c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:59.195661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cc59987-918e-45a4-8cc9-19e4c92cf1c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:21:59.196792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cc59987-918e-45a4-8cc9-19e4c92cf1c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:21:59.378542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3cc59987-918e-45a4-8cc9-19e4c92cf1c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:21:59.392719 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3cc59987-918e-45a4-8cc9-19e4c92cf1c7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1271 microversion: 2.1 time: 0.224514 May 28 21:21:59.406977 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2118/4296] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:21:59 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1271 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:21:59.997087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5c9c620e-689c-4de0-b656-0ce7c5a27a09 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:00.001711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5c9c620e-689c-4de0-b656-0ce7c5a27a09 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:00.022098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c9c620e-689c-4de0-b656-0ce7c5a27a09 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:00.033114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c9c620e-689c-4de0-b656-0ce7c5a27a09 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:00.038736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c9c620e-689c-4de0-b656-0ce7c5a27a09 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:00.042522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c9c620e-689c-4de0-b656-0ce7c5a27a09 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:00.412434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e037c58d-59ed-40cf-ac9e-c2a7bb54ba25 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:00.413563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e037c58d-59ed-40cf-ac9e-c2a7bb54ba25 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:00.440315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e037c58d-59ed-40cf-ac9e-c2a7bb54ba25 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:00.443855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e037c58d-59ed-40cf-ac9e-c2a7bb54ba25 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:00.445298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e037c58d-59ed-40cf-ac9e-c2a7bb54ba25 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:00.456604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e037c58d-59ed-40cf-ac9e-c2a7bb54ba25 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:00.777022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e037c58d-59ed-40cf-ac9e-c2a7bb54ba25 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:00.794113 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e037c58d-59ed-40cf-ac9e-c2a7bb54ba25 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1271 microversion: 2.1 time: 0.385774 May 28 21:22:00.795348 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2119/4297] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:00 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1271 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:00.816458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a4657fa8-3e65-442d-ba92-f6cade7c0b5b req-17aecce9-ac60-4cc0-9a6b-718f86e1bee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-unplugged", "status": "completed", "tag": "a093c2f2-1530-48bb-9240-39d12badf81f"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:00.854760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a4657fa8-3e65-442d-ba92-f6cade7c0b5b req-17aecce9-ac60-4cc0-9a6b-718f86e1bee0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:00.857361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a4657fa8-3e65-442d-ba92-f6cade7c0b5b req-17aecce9-ac60-4cc0-9a6b-718f86e1bee0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:00.906366 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a4657fa8-3e65-442d-ba92-f6cade7c0b5b req-17aecce9-ac60-4cc0-9a6b-718f86e1bee0 service nova] Creating event network-vif-unplugged:a093c2f2-1530-48bb-9240-39d12badf81f for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:22:00.921499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5c9c620e-689c-4de0-b656-0ce7c5a27a09 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:00.940097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5c9c620e-689c-4de0-b656-0ce7c5a27a09 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:00.944504 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a4657fa8-3e65-442d-ba92-f6cade7c0b5b req-17aecce9-ac60-4cc0-9a6b-718f86e1bee0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.146434 May 28 21:22:00.944504 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2120/4298] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:22:00.948056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5c9c620e-689c-4de0-b656-0ce7c5a27a09 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:00.958277 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5c9c620e-689c-4de0-b656-0ce7c5a27a09 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 2939 microversion: 2.42 time: 0.966660 May 28 21:22:00.959552 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2179/4299] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:21:59 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 2939 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:01.815535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4536afa5-39f6-432e-a3fc-6e047d383218 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:01.827163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4536afa5-39f6-432e-a3fc-6e047d383218 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:01.845993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4536afa5-39f6-432e-a3fc-6e047d383218 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:01.845993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4536afa5-39f6-432e-a3fc-6e047d383218 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:01.845993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4536afa5-39f6-432e-a3fc-6e047d383218 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:01.845993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4536afa5-39f6-432e-a3fc-6e047d383218 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:02.000953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4536afa5-39f6-432e-a3fc-6e047d383218 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:02.001277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc3f4014-c13c-4ccf-a922-e0f9d604c358 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:02.001277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc3f4014-c13c-4ccf-a922-e0f9d604c358 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:02.001861 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4536afa5-39f6-432e-a3fc-6e047d383218 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1271 microversion: 2.1 time: 0.181896 May 28 21:22:02.001861 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2121/4300] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:01 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1271 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:02.002076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc3f4014-c13c-4ccf-a922-e0f9d604c358 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:02.002076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc3f4014-c13c-4ccf-a922-e0f9d604c358 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:02.003357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc3f4014-c13c-4ccf-a922-e0f9d604c358 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:02.003836 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc3f4014-c13c-4ccf-a922-e0f9d604c358 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:02.587044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc3f4014-c13c-4ccf-a922-e0f9d604c358 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:02.587044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc3f4014-c13c-4ccf-a922-e0f9d604c358 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:02.587044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc3f4014-c13c-4ccf-a922-e0f9d604c358 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:02.587044 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc3f4014-c13c-4ccf-a922-e0f9d604c358 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 2939 microversion: 2.42 time: 0.604640 May 28 21:22:02.601284 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2180/4301] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:01 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 2939 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:22:03.022305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-06116e22-ed88-47da-9820-7262004f0fa5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:03.023109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-06116e22-ed88-47da-9820-7262004f0fa5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:03.030586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-e307a62d-4939-4c66-91d5-2ba2e36aa0f9 req-d143784b-b61c-4a49-bc27-6f506ddeb78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-unplugged", "status": "completed", "tag": "b9f06dda-68a6-48bd-8781-3e0aabc602a4"}, {"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-unplugged", "status": "completed", "tag": "63e35303-0289-4426-8f0f-dfccabdbfba7"}, {"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-unplugged", "status": "completed", "tag": "8e9126c9-eb54-4fe2-8d2d-2fd3d4b4fe8d"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:03.043877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06116e22-ed88-47da-9820-7262004f0fa5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:03.049160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06116e22-ed88-47da-9820-7262004f0fa5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:03.056134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e307a62d-4939-4c66-91d5-2ba2e36aa0f9 req-d143784b-b61c-4a49-bc27-6f506ddeb78b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:03.057949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06116e22-ed88-47da-9820-7262004f0fa5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:03.058783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06116e22-ed88-47da-9820-7262004f0fa5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:03.094613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e307a62d-4939-4c66-91d5-2ba2e36aa0f9 req-d143784b-b61c-4a49-bc27-6f506ddeb78b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:03.162690 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e307a62d-4939-4c66-91d5-2ba2e36aa0f9 req-d143784b-b61c-4a49-bc27-6f506ddeb78b service nova] Creating event network-vif-unplugged:b9f06dda-68a6-48bd-8781-3e0aabc602a4 for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:22:03.168394 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e307a62d-4939-4c66-91d5-2ba2e36aa0f9 req-d143784b-b61c-4a49-bc27-6f506ddeb78b service nova] Creating event network-vif-unplugged:63e35303-0289-4426-8f0f-dfccabdbfba7 for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:22:03.175302 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e307a62d-4939-4c66-91d5-2ba2e36aa0f9 req-d143784b-b61c-4a49-bc27-6f506ddeb78b service nova] Creating event network-vif-unplugged:8e9126c9-eb54-4fe2-8d2d-2fd3d4b4fe8d for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:22:03.213992 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-e307a62d-4939-4c66-91d5-2ba2e36aa0f9 req-d143784b-b61c-4a49-bc27-6f506ddeb78b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.189837 May 28 21:22:03.238408 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2181/4302] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:22:03.606656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-04e83795-bf7f-4b08-aa94-389129aac4d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:03.607381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-04e83795-bf7f-4b08-aa94-389129aac4d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:03.627691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04e83795-bf7f-4b08-aa94-389129aac4d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:03.629459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04e83795-bf7f-4b08-aa94-389129aac4d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:03.630350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04e83795-bf7f-4b08-aa94-389129aac4d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:03.630808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04e83795-bf7f-4b08-aa94-389129aac4d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:04.000926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-06116e22-ed88-47da-9820-7262004f0fa5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:04.010641 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-06116e22-ed88-47da-9820-7262004f0fa5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1313 microversion: 2.1 time: 0.995061 May 28 21:22:04.026237 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2122/4303] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:03 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1313 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:04.607227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-04e83795-bf7f-4b08-aa94-389129aac4d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:04.620835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-04e83795-bf7f-4b08-aa94-389129aac4d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:04.624663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-04e83795-bf7f-4b08-aa94-389129aac4d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:04.630174 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-04e83795-bf7f-4b08-aa94-389129aac4d6 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 2918 microversion: 2.42 time: 1.024659 May 28 21:22:04.630174 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2182/4304] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:03 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 2918 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:05.035901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bbbb6708-4bea-4d80-896d-e1c427a4bc61 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:05.036991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bbbb6708-4bea-4d80-896d-e1c427a4bc61 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:05.050340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:05.052575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbbb6708-4bea-4d80-896d-e1c427a4bc61 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:05.053269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbbb6708-4bea-4d80-896d-e1c427a4bc61 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:05.054296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbbb6708-4bea-4d80-896d-e1c427a4bc61 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:05.058468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbbb6708-4bea-4d80-896d-e1c427a4bc61 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:05.142945 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:05.349187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-fc5cafc7-99fd-4038-85fb-fc0b38d3950a req-e4a17984-5a3b-4ddf-a3ca-ba38b85cd894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-unplugged", "status": "completed", "tag": "6b0d782b-1790-41fb-93ea-5c3cb2d2bf1a"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:05.383901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-fc5cafc7-99fd-4038-85fb-fc0b38d3950a req-e4a17984-5a3b-4ddf-a3ca-ba38b85cd894 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:05.386170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-fc5cafc7-99fd-4038-85fb-fc0b38d3950a req-e4a17984-5a3b-4ddf-a3ca-ba38b85cd894 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:05.439974 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-fc5cafc7-99fd-4038-85fb-fc0b38d3950a req-e4a17984-5a3b-4ddf-a3ca-ba38b85cd894 service nova] Creating event network-vif-unplugged:6b0d782b-1790-41fb-93ea-5c3cb2d2bf1a for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:22:05.456789 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-fc5cafc7-99fd-4038-85fb-fc0b38d3950a req-e4a17984-5a3b-4ddf-a3ca-ba38b85cd894 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.120464 May 28 21:22:05.460851 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2183/4305] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:22:05.632742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bbbb6708-4bea-4d80-896d-e1c427a4bc61 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:05.711585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2c69f464-d3d5-44e8-b601-e56f75983bee tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:05.718830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2c69f464-d3d5-44e8-b601-e56f75983bee tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:05.743077 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bbbb6708-4bea-4d80-896d-e1c427a4bc61 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1313 microversion: 2.1 time: 0.712960 May 28 21:22:05.743769 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2123/4306] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:05 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1313 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:05.746962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2c69f464-d3d5-44e8-b601-e56f75983bee tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:05.752429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2c69f464-d3d5-44e8-b601-e56f75983bee tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:05.753047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2c69f464-d3d5-44e8-b601-e56f75983bee tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:05.754254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2c69f464-d3d5-44e8-b601-e56f75983bee tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:06.269790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-593dff9f-a643-4f9f-9732-4110780a28c5 req-e8e3f9c5-849a-404d-9ff8-d60d27ca4183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-deleted", "tag": "63e35303-0289-4426-8f0f-dfccabdbfba7"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:06.293467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-593dff9f-a643-4f9f-9732-4110780a28c5 req-e8e3f9c5-849a-404d-9ff8-d60d27ca4183 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:06.294369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-593dff9f-a643-4f9f-9732-4110780a28c5 req-e8e3f9c5-849a-404d-9ff8-d60d27ca4183 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:06.330454 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-593dff9f-a643-4f9f-9732-4110780a28c5 req-e8e3f9c5-849a-404d-9ff8-d60d27ca4183 service nova] Creating event network-vif-deleted:63e35303-0289-4426-8f0f-dfccabdbfba7 for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:22:06.344040 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-593dff9f-a643-4f9f-9732-4110780a28c5 req-e8e3f9c5-849a-404d-9ff8-d60d27ca4183 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079805 May 28 21:22:06.347374 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2124/4307] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:22:06.713375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2c69f464-d3d5-44e8-b601-e56f75983bee tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:06.734793 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2c69f464-d3d5-44e8-b601-e56f75983bee tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:06.739006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2c69f464-d3d5-44e8-b601-e56f75983bee tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:06.739006 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2c69f464-d3d5-44e8-b601-e56f75983bee tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 2872 microversion: 2.42 time: 1.088046 May 28 21:22:06.760646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84de97b5-0568-4c13-9d34-596825cb6c31 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:06.763878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-84de97b5-0568-4c13-9d34-596825cb6c31 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:06.766235 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2184/4308] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:05 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 2872 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:06.777530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84de97b5-0568-4c13-9d34-596825cb6c31 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:06.778301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84de97b5-0568-4c13-9d34-596825cb6c31 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:06.780809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84de97b5-0568-4c13-9d34-596825cb6c31 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:06.782889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84de97b5-0568-4c13-9d34-596825cb6c31 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:06.786288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=10 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:07.245494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-84de97b5-0568-4c13-9d34-596825cb6c31 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:07.257693 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-84de97b5-0568-4c13-9d34-596825cb6c31 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1313 microversion: 2.1 time: 0.501014 May 28 21:22:07.259574 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2125/4309] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:06 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:22:07.758888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ae68b9bd-5631-41e4-ba4e-c4eac9baa5c7 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:07.759684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ae68b9bd-5631-41e4-ba4e-c4eac9baa5c7 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:07.770716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae68b9bd-5631-41e4-ba4e-c4eac9baa5c7 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:07.774406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae68b9bd-5631-41e4-ba4e-c4eac9baa5c7 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:07.776491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae68b9bd-5631-41e4-ba4e-c4eac9baa5c7 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:07.776491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae68b9bd-5631-41e4-ba4e-c4eac9baa5c7 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:08.084880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ae68b9bd-5631-41e4-ba4e-c4eac9baa5c7 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:08.098867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ae68b9bd-5631-41e4-ba4e-c4eac9baa5c7 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:08.109038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ae68b9bd-5631-41e4-ba4e-c4eac9baa5c7 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:08.118421 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ae68b9bd-5631-41e4-ba4e-c4eac9baa5c7 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 2712 microversion: 2.42 time: 0.363317 May 28 21:22:08.121296 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2185/4310] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:07 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 2712 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:08.277030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-71e0f574-e7e0-41cc-8941-124476851781 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:08.278032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-71e0f574-e7e0-41cc-8941-124476851781 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:08.300940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71e0f574-e7e0-41cc-8941-124476851781 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:08.301419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71e0f574-e7e0-41cc-8941-124476851781 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:08.302255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71e0f574-e7e0-41cc-8941-124476851781 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:08.302704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71e0f574-e7e0-41cc-8941-124476851781 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:08.403388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d6dfa901-dd8f-4488-aa14-2782caab0649 req-dfdf8a8e-bbb6-44ff-b600-2fe0a55f22e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7589d921-27f0-4afd-9d6f-e41f99941b55", "tag": "9010d898-903d-4ba8-bc8b-fdffa09d7867"}, {"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-deleted", "tag": "b9f06dda-68a6-48bd-8781-3e0aabc602a4"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:08.432227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d6dfa901-dd8f-4488-aa14-2782caab0649 req-dfdf8a8e-bbb6-44ff-b600-2fe0a55f22e2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:08.432699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d6dfa901-dd8f-4488-aa14-2782caab0649 req-dfdf8a8e-bbb6-44ff-b600-2fe0a55f22e2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:08.490014 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d6dfa901-dd8f-4488-aa14-2782caab0649 req-dfdf8a8e-bbb6-44ff-b600-2fe0a55f22e2 service nova] Creating event network-changed:9010d898-903d-4ba8-bc8b-fdffa09d7867 for instance 7589d921-27f0-4afd-9d6f-e41f99941b55 on nch2-master-1 May 28 21:22:08.490777 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d6dfa901-dd8f-4488-aa14-2782caab0649 req-dfdf8a8e-bbb6-44ff-b600-2fe0a55f22e2 service nova] Creating event network-vif-deleted:b9f06dda-68a6-48bd-8781-3e0aabc602a4 for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:22:08.527822 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d6dfa901-dd8f-4488-aa14-2782caab0649 req-dfdf8a8e-bbb6-44ff-b600-2fe0a55f22e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.128491 May 28 21:22:08.528475 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2186/4311] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:22:09.048957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-71e0f574-e7e0-41cc-8941-124476851781 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:09.085169 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-71e0f574-e7e0-41cc-8941-124476851781 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1313 microversion: 2.1 time: 0.808399 May 28 21:22:09.089454 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2126/4312] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:08 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1313 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:09.141097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-22300195-cc7f-431e-964c-747586884d44 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:09.141965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-22300195-cc7f-431e-964c-747586884d44 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:09.153273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22300195-cc7f-431e-964c-747586884d44 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:09.154041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22300195-cc7f-431e-964c-747586884d44 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:09.155798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22300195-cc7f-431e-964c-747586884d44 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:09.156451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22300195-cc7f-431e-964c-747586884d44 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:09.537395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-22300195-cc7f-431e-964c-747586884d44 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:09.547942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-22300195-cc7f-431e-964c-747586884d44 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:09.549959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-22300195-cc7f-431e-964c-747586884d44 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:09.551527 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-22300195-cc7f-431e-964c-747586884d44 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 2598 microversion: 2.42 time: 0.415047 May 28 21:22:09.565329 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2187/4313] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:09 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 2598 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:10.112056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-96fea63e-9747-4a7a-876b-6df6ea2b1713 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:10.114140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-96fea63e-9747-4a7a-876b-6df6ea2b1713 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:10.152081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96fea63e-9747-4a7a-876b-6df6ea2b1713 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:10.152547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96fea63e-9747-4a7a-876b-6df6ea2b1713 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:10.153357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96fea63e-9747-4a7a-876b-6df6ea2b1713 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:10.153805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96fea63e-9747-4a7a-876b-6df6ea2b1713 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:10.432836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-96fea63e-9747-4a7a-876b-6df6ea2b1713 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:10.445909 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-96fea63e-9747-4a7a-876b-6df6ea2b1713 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1313 microversion: 2.1 time: 0.342173 May 28 21:22:10.451723 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2127/4314] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:10 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:10.573162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3e2c2572-f7a4-42e6-a48c-a81b298c5259 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:10.574433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3e2c2572-f7a4-42e6-a48c-a81b298c5259 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:10.603767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e2c2572-f7a4-42e6-a48c-a81b298c5259 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:10.604562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e2c2572-f7a4-42e6-a48c-a81b298c5259 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:10.605678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e2c2572-f7a4-42e6-a48c-a81b298c5259 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:10.611224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e2c2572-f7a4-42e6-a48c-a81b298c5259 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:11.302000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3e2c2572-f7a4-42e6-a48c-a81b298c5259 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:11.313001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3e2c2572-f7a4-42e6-a48c-a81b298c5259 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:11.323014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3e2c2572-f7a4-42e6-a48c-a81b298c5259 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:11.324935 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3e2c2572-f7a4-42e6-a48c-a81b298c5259 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 2552 microversion: 2.42 time: 0.756199 May 28 21:22:11.326000 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2188/4315] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:10 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 2552 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:11.470284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dcd8acd3-6c37-45cb-abfe-4dd2a6366c94 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:11.474680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dcd8acd3-6c37-45cb-abfe-4dd2a6366c94 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:11.498825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcd8acd3-6c37-45cb-abfe-4dd2a6366c94 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:11.499281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcd8acd3-6c37-45cb-abfe-4dd2a6366c94 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:11.500077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcd8acd3-6c37-45cb-abfe-4dd2a6366c94 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:11.510276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcd8acd3-6c37-45cb-abfe-4dd2a6366c94 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:11.734350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-2e8685da-1085-4d31-a5d8-58b3a3090ee9 req-28ff1b10-d8e8-4bd7-8f07-2ad597e41999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-deleted", "tag": "a093c2f2-1530-48bb-9240-39d12badf81f"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:11.756267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2e8685da-1085-4d31-a5d8-58b3a3090ee9 req-28ff1b10-d8e8-4bd7-8f07-2ad597e41999 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:11.756853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2e8685da-1085-4d31-a5d8-58b3a3090ee9 req-28ff1b10-d8e8-4bd7-8f07-2ad597e41999 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:11.809827 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-2e8685da-1085-4d31-a5d8-58b3a3090ee9 req-28ff1b10-d8e8-4bd7-8f07-2ad597e41999 service nova] Creating event network-vif-deleted:a093c2f2-1530-48bb-9240-39d12badf81f for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:22:11.828292 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-2e8685da-1085-4d31-a5d8-58b3a3090ee9 req-28ff1b10-d8e8-4bd7-8f07-2ad597e41999 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101663 May 28 21:22:11.830035 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2189/4316] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:22:12.125090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dcd8acd3-6c37-45cb-abfe-4dd2a6366c94 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:12.138022 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dcd8acd3-6c37-45cb-abfe-4dd2a6366c94 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1313 microversion: 2.1 time: 0.676955 May 28 21:22:12.138022 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2128/4317] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:11 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1313 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:12.348567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5487c446-540a-4256-91ae-f1f134f19a0f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:12.349296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5487c446-540a-4256-91ae-f1f134f19a0f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:12.363917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5487c446-540a-4256-91ae-f1f134f19a0f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:12.364379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5487c446-540a-4256-91ae-f1f134f19a0f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:12.365189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5487c446-540a-4256-91ae-f1f134f19a0f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:12.365639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5487c446-540a-4256-91ae-f1f134f19a0f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:13.157279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a0efe540-513a-4b2f-bba0-ca13053c510b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:13.159698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a0efe540-513a-4b2f-bba0-ca13053c510b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:13.185084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a0efe540-513a-4b2f-bba0-ca13053c510b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:13.185620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a0efe540-513a-4b2f-bba0-ca13053c510b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:13.186626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a0efe540-513a-4b2f-bba0-ca13053c510b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:13.187091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a0efe540-513a-4b2f-bba0-ca13053c510b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:13.565531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5487c446-540a-4256-91ae-f1f134f19a0f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:13.598309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5487c446-540a-4256-91ae-f1f134f19a0f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:13.615750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5487c446-540a-4256-91ae-f1f134f19a0f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:13.617279 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5487c446-540a-4256-91ae-f1f134f19a0f tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 2213 microversion: 2.42 time: 1.276205 May 28 21:22:13.620584 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2190/4318] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:12 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 2213 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:13.840332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a0efe540-513a-4b2f-bba0-ca13053c510b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:13.852266 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a0efe540-513a-4b2f-bba0-ca13053c510b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1313 microversion: 2.1 time: 0.696928 May 28 21:22:13.854846 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2129/4319] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:13 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1313 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:13.911373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-c40093b1-f897-400c-b18b-8ed82aaca64e req-de1fa11a-c21f-4f03-a7fa-d58a1dac1c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-deleted", "tag": "6b0d782b-1790-41fb-93ea-5c3cb2d2bf1a"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:13.936456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c40093b1-f897-400c-b18b-8ed82aaca64e req-de1fa11a-c21f-4f03-a7fa-d58a1dac1c32 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:13.945023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c40093b1-f897-400c-b18b-8ed82aaca64e req-de1fa11a-c21f-4f03-a7fa-d58a1dac1c32 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:13.976133 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-c40093b1-f897-400c-b18b-8ed82aaca64e req-de1fa11a-c21f-4f03-a7fa-d58a1dac1c32 service nova] Creating event network-vif-deleted:6b0d782b-1790-41fb-93ea-5c3cb2d2bf1a for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:22:13.991592 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-c40093b1-f897-400c-b18b-8ed82aaca64e req-de1fa11a-c21f-4f03-a7fa-d58a1dac1c32 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084293 May 28 21:22:13.992751 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2191/4320] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:22:14.641956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d53c43ac-5a2f-477a-bdac-cb476dab4a82 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:14.647410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d53c43ac-5a2f-477a-bdac-cb476dab4a82 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:14.659375 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d53c43ac-5a2f-477a-bdac-cb476dab4a82 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:14.664321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d53c43ac-5a2f-477a-bdac-cb476dab4a82 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:14.664321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d53c43ac-5a2f-477a-bdac-cb476dab4a82 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:14.664321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d53c43ac-5a2f-477a-bdac-cb476dab4a82 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:14.953805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6cf5dac5-86b1-4118-96aa-abb3263bf5ec tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:14.953805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6cf5dac5-86b1-4118-96aa-abb3263bf5ec tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:14.953805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cf5dac5-86b1-4118-96aa-abb3263bf5ec tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:14.953805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cf5dac5-86b1-4118-96aa-abb3263bf5ec tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:14.953805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cf5dac5-86b1-4118-96aa-abb3263bf5ec tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:14.953805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cf5dac5-86b1-4118-96aa-abb3263bf5ec tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:15.981042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6cf5dac5-86b1-4118-96aa-abb3263bf5ec tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:16.012339 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6cf5dac5-86b1-4118-96aa-abb3263bf5ec tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1313 microversion: 2.1 time: 1.141511 May 28 21:22:16.018635 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2192/4321] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:14 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1313 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:16.071436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d53c43ac-5a2f-477a-bdac-cb476dab4a82 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:16.092679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d53c43ac-5a2f-477a-bdac-cb476dab4a82 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:16.100534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d53c43ac-5a2f-477a-bdac-cb476dab4a82 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:16.115557 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d53c43ac-5a2f-477a-bdac-cb476dab4a82 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 2099 microversion: 2.42 time: 1.479778 May 28 21:22:16.116189 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2130/4322] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:14 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 2099 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:16.145367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-3cba122c-353c-4234-8136-4c3081dbc8f6 req-1c68ebc6-3739-48fa-a466-2747b7c247a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f18bf165-cf8b-4939-a484-cffa6aebbe63", "name": "network-vif-deleted", "tag": "8e9126c9-eb54-4fe2-8d2d-2fd3d4b4fe8d"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:16.156308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:16.159626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3cba122c-353c-4234-8136-4c3081dbc8f6 req-1c68ebc6-3739-48fa-a466-2747b7c247a1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:16.163076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3cba122c-353c-4234-8136-4c3081dbc8f6 req-1c68ebc6-3739-48fa-a466-2747b7c247a1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:16.174220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:16.187403 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-3cba122c-353c-4234-8136-4c3081dbc8f6 req-1c68ebc6-3739-48fa-a466-2747b7c247a1 service nova] Creating event network-vif-deleted:8e9126c9-eb54-4fe2-8d2d-2fd3d4b4fe8d for instance f18bf165-cf8b-4939-a484-cffa6aebbe63 on nch1-master-1 May 28 21:22:16.214054 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-3cba122c-353c-4234-8136-4c3081dbc8f6 req-1c68ebc6-3739-48fa-a466-2747b7c247a1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072649 May 28 21:22:16.216459 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2193/4323] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:22:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:22:17.034669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9316d107-9509-49ed-b23b-5d26d79fa972 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:17.036777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9316d107-9509-49ed-b23b-5d26d79fa972 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:17.051924 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9316d107-9509-49ed-b23b-5d26d79fa972 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:17.053806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9316d107-9509-49ed-b23b-5d26d79fa972 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:17.056366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9316d107-9509-49ed-b23b-5d26d79fa972 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:17.064636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9316d107-9509-49ed-b23b-5d26d79fa972 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:17.680895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a6e54bf5-5f59-4ceb-82d0-e03ee012c97c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'create', calling method: .version_select at 0x7f4d640a58b0>, body: {"keypair": {"name": "tempest-keypair-1574782717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPTY3GfsFrpb9oseiPtDwaL5ugmUKKiV9ura474FZhu3xLuSjIP/LgoONgUslznxpAFhQkvNtJV4eHuWJM9K5dQiO0p+DgCpj0+LMpXbktreUPziUz9GGZCLlvdwvi9nbg=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:17.721331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-a6e54bf5-5f59-4ceb-82d0-e03ee012c97c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Getting quotas for project 54447ea481574a128f06c24315f34e46. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:22:17.742316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-a6e54bf5-5f59-4ceb-82d0-e03ee012c97c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Getting quotas for user 02d5fbb072814fd7923ecf12c7ecad7b and project 54447ea481574a128f06c24315f34e46. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:22:17.891460 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a6e54bf5-5f59-4ceb-82d0-e03ee012c97c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.807644 May 28 21:22:17.893856 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2194/4324] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:22:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:22:17.902353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-37426730-c0f3-4a3b-a50e-85ac0eaa7d67 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:17.903461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-37426730-c0f3-4a3b-a50e-85ac0eaa7d67 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:17.920171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37426730-c0f3-4a3b-a50e-85ac0eaa7d67 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:17.922309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37426730-c0f3-4a3b-a50e-85ac0eaa7d67 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:17.926185 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37426730-c0f3-4a3b-a50e-85ac0eaa7d67 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:17.927016 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37426730-c0f3-4a3b-a50e-85ac0eaa7d67 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:18.020368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9316d107-9509-49ed-b23b-5d26d79fa972 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:18.032658 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9316d107-9509-49ed-b23b-5d26d79fa972 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1313 microversion: 2.1 time: 1.002094 May 28 21:22:18.035464 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2131/4325] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:17 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1313 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:18.050752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37426730-c0f3-4a3b-a50e-85ac0eaa7d67 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:18.051520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37426730-c0f3-4a3b-a50e-85ac0eaa7d67 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:18.052409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-37426730-c0f3-4a3b-a50e-85ac0eaa7d67 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lazy-loading 'fault' on Instance uuid f18bf165-cf8b-4939-a484-cffa6aebbe63 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:22:18.441728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-37426730-c0f3-4a3b-a50e-85ac0eaa7d67 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:18.467222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-37426730-c0f3-4a3b-a50e-85ac0eaa7d67 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:18.471779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-37426730-c0f3-4a3b-a50e-85ac0eaa7d67 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eb7c3a01b54f4db2841f4836635eff2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca680361a7b349e39f77a7f7c96934f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:18.471779 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-37426730-c0f3-4a3b-a50e-85ac0eaa7d67 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 200 len: 1879 microversion: 2.42 time: 0.575316 May 28 21:22:18.489370 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2195/4326] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:17 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 1879 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:18.580351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-613b6f5d-de6b-408a-81ac-942f6b131d9d req-94c94c04-da11-42b4-ae8b-d1add571223b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7589d921-27f0-4afd-9d6f-e41f99941b55", "name": "network-vif-plugged", "status": "completed", "tag": "9010d898-903d-4ba8-bc8b-fdffa09d7867"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:18.593812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-613b6f5d-de6b-408a-81ac-942f6b131d9d req-94c94c04-da11-42b4-ae8b-d1add571223b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:18.596554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-613b6f5d-de6b-408a-81ac-942f6b131d9d req-94c94c04-da11-42b4-ae8b-d1add571223b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:18.613505 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-613b6f5d-de6b-408a-81ac-942f6b131d9d req-94c94c04-da11-42b4-ae8b-d1add571223b service nova] Creating event network-vif-plugged:9010d898-903d-4ba8-bc8b-fdffa09d7867 for instance 7589d921-27f0-4afd-9d6f-e41f99941b55 on nch2-master-1 May 28 21:22:18.620739 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-613b6f5d-de6b-408a-81ac-942f6b131d9d req-94c94c04-da11-42b4-ae8b-d1add571223b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044551 May 28 21:22:18.622083 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2132/4327] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:22:19.061163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ffa5445e-fad3-4c50-b44f-387119fc1531 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:19.061163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ffa5445e-fad3-4c50-b44f-387119fc1531 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:19.119319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffa5445e-fad3-4c50-b44f-387119fc1531 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:19.124325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffa5445e-fad3-4c50-b44f-387119fc1531 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:19.124325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffa5445e-fad3-4c50-b44f-387119fc1531 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:19.124325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffa5445e-fad3-4c50-b44f-387119fc1531 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:19.463182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ffa5445e-fad3-4c50-b44f-387119fc1531 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:19.481873 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ffa5445e-fad3-4c50-b44f-387119fc1531 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1313 microversion: 2.1 time: 0.430325 May 28 21:22:19.484515 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2196/4328] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:19 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1313 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:19.494289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-89ac9af7-d49c-481f-9f78-2e8b69a20ade tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:19.495888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-89ac9af7-d49c-481f-9f78-2e8b69a20ade tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] [instance: f18bf165-cf8b-4939-a484-cffa6aebbe63] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:19.520289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89ac9af7-d49c-481f-9f78-2e8b69a20ade tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:19.529252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89ac9af7-d49c-481f-9f78-2e8b69a20ade tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:19.533331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89ac9af7-d49c-481f-9f78-2e8b69a20ade tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:19.534871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89ac9af7-d49c-481f-9f78-2e8b69a20ade tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:19.560133 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-89ac9af7-d49c-481f-9f78-2e8b69a20ade tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] HTTP exception thrown: Instance f18bf165-cf8b-4939-a484-cffa6aebbe63 could not be found. May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-89ac9af7-d49c-481f-9f78-2e8b69a20ade tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Request method failure captured: May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 HTTP/1.1 May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpBfL8FTPfgiWbp67LMcW3ApzY37ExoXpgYb6clz0mT1pVgkuTUW0kcA4bWRc93GKJxpzQUCNTlpe7M-pbhiOYygka5IviU_dVyU0AiOodbv5HOyxLz0xQ5LWQGiNmsK4OzZhaaZDrEteBD-GhyCrNYn8hs7XlLlG5VfUoVh-w9vbU8 May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Openstack-Nova-Api-Version: 2.42 May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: ca680361a7b349e39f77a7f7c96934f8 May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1600206585 May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ca680361a7b349e39f77a7f7c96934f8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca680361a7b349e39f77a7f7c96934f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ca680361a7b349e39f77a7f7c96934f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ca680361a7b349e39f77a7f7c96934f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1600206585 May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: ca680361a7b349e39f77a7f7c96934f8 May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1600206585 May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TaggedBootDevicesTest_v242-1600206585-project May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: eb7c3a01b54f4db2841f4836635eff2e May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1600206585-project May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance f18bf165-cf8b-4939-a484-cffa6aebbe63 could not be found. May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'f18bf165-cf8b-4939-a484-cffa6aebbe63'} May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f18bf165-cf8b-4939-a484-cffa6aebbe63 could not be found. May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f18bf165-cf8b-4939-a484-cffa6aebbe63 could not be found. May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:22:19.562992 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:22:19.567320 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:22:19.567320 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:22:19.567320 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:22:19.567320 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:22:19.567320 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:22:19.567320 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:22:19.567320 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f18bf165-cf8b-4939-a484-cffa6aebbe63 could not be found. May 28 21:22:19.567320 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:22:19.567320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-89ac9af7-d49c-481f-9f78-2e8b69a20ade tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Returning 404 to user: Instance f18bf165-cf8b-4939-a484-cffa6aebbe63 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:22:19.567320 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-89ac9af7-d49c-481f-9f78-2e8b69a20ade tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63" status: 404 len: 111 microversion: 2.42 time: 0.075294 May 28 21:22:19.570438 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2133/4329] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:19 2022] GET /compute/v2.1/servers/f18bf165-cf8b-4939-a484-cffa6aebbe63 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:22:19.576707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cc41def3-6954-4bdc-b026-179e68cf8015 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] Calling method '.version_select at 0x7f4d641160d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:19.690744 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cc41def3-6954-4bdc-b026-179e68cf8015 tempest-TaggedBootDevicesTest_v242-1600206585 tempest-TaggedBootDevicesTest_v242-1600206585-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1067773748" status: 204 len: 0 microversion: 2.42 time: 0.118543 May 28 21:22:19.696564 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2197/4330] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:22:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1067773748 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:22:20.504164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9cc66dfb-04b8-44b8-bdc2-e21afabd941b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:20.504164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9cc66dfb-04b8-44b8-bdc2-e21afabd941b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:20.540427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cc66dfb-04b8-44b8-bdc2-e21afabd941b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:20.550914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cc66dfb-04b8-44b8-bdc2-e21afabd941b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:20.554973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cc66dfb-04b8-44b8-bdc2-e21afabd941b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:20.556364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cc66dfb-04b8-44b8-bdc2-e21afabd941b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:21.179202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9cc66dfb-04b8-44b8-bdc2-e21afabd941b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:21.192662 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9cc66dfb-04b8-44b8-bdc2-e21afabd941b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1500 microversion: 2.1 time: 0.692373 May 28 21:22:21.220359 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2134/4331] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:20 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1500 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:21.257887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-18d5ace1-7121-4c6d-b167-eafaa5ccb787 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:21.266926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-18d5ace1-7121-4c6d-b167-eafaa5ccb787 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:21.289422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18d5ace1-7121-4c6d-b167-eafaa5ccb787 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:21.290085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18d5ace1-7121-4c6d-b167-eafaa5ccb787 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:21.295948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18d5ace1-7121-4c6d-b167-eafaa5ccb787 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:21.296668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18d5ace1-7121-4c6d-b167-eafaa5ccb787 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:21.349920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:21.374889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-18d5ace1-7121-4c6d-b167-eafaa5ccb787 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lazy-loading 'flavor' on Instance uuid 7589d921-27f0-4afd-9d6f-e41f99941b55 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:22:21.497621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a20651b6-1ae0-4275-9888-5277cab4458e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'create', calling method: .version_select at 0x7f4d6424e550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2029188104", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKe1UB32Vn3E2RTU0sClKJXzbJMqhh2ZHMQVcwW8eu22i3r0A9HLiNzCVBIT543ekO27+otfaYQjIkvl79y06Mhbufe8z47BuqgK6ZdvvOEjmQO+Rc2MzAbVm8L33sVuqA=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:21.546185 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-a20651b6-1ae0-4275-9888-5277cab4458e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for project c3588eab36044e439158f876836ea514. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:22:21.566443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-a20651b6-1ae0-4275-9888-5277cab4458e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for user f3468a0b2d324603ab6c3080993bc0c8 and project c3588eab36044e439158f876836ea514. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:22:21.742588 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a20651b6-1ae0-4275-9888-5277cab4458e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.928465 May 28 21:22:21.745612 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2198/4332] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:22:20 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:22:21.772545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fd53c535-b6cb-4fd6-9258-11fc5ccf7ce2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:21.775014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fd53c535-b6cb-4fd6-9258-11fc5ccf7ce2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:21.790120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd53c535-b6cb-4fd6-9258-11fc5ccf7ce2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:21.790721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd53c535-b6cb-4fd6-9258-11fc5ccf7ce2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:21.792747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd53c535-b6cb-4fd6-9258-11fc5ccf7ce2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:21.793405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd53c535-b6cb-4fd6-9258-11fc5ccf7ce2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:21.884000 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-18d5ace1-7121-4c6d-b167-eafaa5ccb787 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "POST /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55/action" status: 200 len: 32 microversion: 2.1 time: 0.648478 May 28 21:22:21.885502 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2135/4333] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:22:21 2022] POST /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55/action => generated 32 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:22:21.920753 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fd53c535-b6cb-4fd6-9258-11fc5ccf7ce2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/os-volume_attachments/aca16bed-3410-4df8-b98d-9a6854483c48" status: 200 len: 194 microversion: 2.20 time: 0.167745 May 28 21:22:21.924900 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2199/4334] 10.222.0.33 () {60 vars in 1453 bytes} [Sat May 28 21:22:21 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/os-volume_attachments/aca16bed-3410-4df8-b98d-9a6854483c48 => generated 194 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:22:21.927930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fc75e975-a820-4dec-ae46-1007f8520abb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:21.932789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fc75e975-a820-4dec-ae46-1007f8520abb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:21.967918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc75e975-a820-4dec-ae46-1007f8520abb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:21.968319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc75e975-a820-4dec-ae46-1007f8520abb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:21.976828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc75e975-a820-4dec-ae46-1007f8520abb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:21.977349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc75e975-a820-4dec-ae46-1007f8520abb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:22.078363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-afd5a436-f329-4caf-a019-4b6a6d80d229 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:22.079302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-afd5a436-f329-4caf-a019-4b6a6d80d229 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:22.089217 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afd5a436-f329-4caf-a019-4b6a6d80d229 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:22.090143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afd5a436-f329-4caf-a019-4b6a6d80d229 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:22.091315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afd5a436-f329-4caf-a019-4b6a6d80d229 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:22.093025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afd5a436-f329-4caf-a019-4b6a6d80d229 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:22.362913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-afd5a436-f329-4caf-a019-4b6a6d80d229 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lazy-loading 'services' on Instance uuid 6232e7b0-68db-43d6-a836-fb2f96c54658 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:22:22.684195 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-afd5a436-f329-4caf-a019-4b6a6d80d229 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/os-volume_attachments/aca16bed-3410-4df8-b98d-9a6854483c48" status: 202 len: 0 microversion: 2.20 time: 0.633859 May 28 21:22:22.685157 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2200/4335] 10.222.0.33 () {60 vars in 1456 bytes} [Sat May 28 21:22:22 2022] DELETE /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/os-volume_attachments/aca16bed-3410-4df8-b98d-9a6854483c48 => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 21:22:22.717181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4313f8aa-c202-442b-b324-2a12e52f797f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:22.718663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4313f8aa-c202-442b-b324-2a12e52f797f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:22.739320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4313f8aa-c202-442b-b324-2a12e52f797f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:22.740986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4313f8aa-c202-442b-b324-2a12e52f797f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:22.745644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4313f8aa-c202-442b-b324-2a12e52f797f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:22.747294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4313f8aa-c202-442b-b324-2a12e52f797f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:22.785057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fc75e975-a820-4dec-ae46-1007f8520abb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:22.795421 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fc75e975-a820-4dec-ae46-1007f8520abb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.894101 May 28 21:22:22.808260 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2136/4336] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:21 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:22.833901 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4313f8aa-c202-442b-b324-2a12e52f797f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.134397 May 28 21:22:22.838958 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2201/4337] 10.222.0.33 () {60 vars in 1342 bytes} [Sat May 28 21:22:22 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:22:23.819194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-29b0c1f1-49bd-4335-b6fd-179d687c80a7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:23.819923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-29b0c1f1-49bd-4335-b6fd-179d687c80a7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:23.850889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-04b3cc30-1cd7-40a3-939d-5a082ec63cb6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:23.850889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-04b3cc30-1cd7-40a3-939d-5a082ec63cb6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:23.860714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29b0c1f1-49bd-4335-b6fd-179d687c80a7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:23.861223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29b0c1f1-49bd-4335-b6fd-179d687c80a7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:23.867762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29b0c1f1-49bd-4335-b6fd-179d687c80a7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:23.869479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29b0c1f1-49bd-4335-b6fd-179d687c80a7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:23.872371 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04b3cc30-1cd7-40a3-939d-5a082ec63cb6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:23.874564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04b3cc30-1cd7-40a3-939d-5a082ec63cb6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:23.884342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04b3cc30-1cd7-40a3-939d-5a082ec63cb6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:23.886996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04b3cc30-1cd7-40a3-939d-5a082ec63cb6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:23.973220 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-04b3cc30-1cd7-40a3-939d-5a082ec63cb6 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.130774 May 28 21:22:23.992886 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2202/4338] 10.222.0.33 () {60 vars in 1342 bytes} [Sat May 28 21:22:23 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:24.117152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7fee43d2-b39a-4e0f-945f-bc152e51b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:24.122782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7fee43d2-b39a-4e0f-945f-bc152e51b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:24.145553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fee43d2-b39a-4e0f-945f-bc152e51b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:24.146065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fee43d2-b39a-4e0f-945f-bc152e51b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:24.147248 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fee43d2-b39a-4e0f-945f-bc152e51b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:24.149447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fee43d2-b39a-4e0f-945f-bc152e51b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:24.220286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7fee43d2-b39a-4e0f-945f-bc152e51b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:22:24.399598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-29b0c1f1-49bd-4335-b6fd-179d687c80a7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:24.415771 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-29b0c1f1-49bd-4335-b6fd-179d687c80a7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.602642 May 28 21:22:24.415771 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2137/4339] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:23 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:24.694679 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7fee43d2-b39a-4e0f-945f-bc152e51b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 204 len: 0 microversion: 2.20 time: 0.584779 May 28 21:22:24.703694 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2203/4340] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:22:24 2022] DELETE /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 28 21:22:24.704988 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-076cd574-265c-4de6-bf16-e0bc4f6df2c8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:24.705817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-076cd574-265c-4de6-bf16-e0bc4f6df2c8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:24.713343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-076cd574-265c-4de6-bf16-e0bc4f6df2c8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:24.714881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-076cd574-265c-4de6-bf16-e0bc4f6df2c8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:24.720492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-076cd574-265c-4de6-bf16-e0bc4f6df2c8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:24.720965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-076cd574-265c-4de6-bf16-e0bc4f6df2c8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:25.444119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2b8119e5-40c7-49f9-a9d8-7948d94aaef9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:25.444119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2b8119e5-40c7-49f9-a9d8-7948d94aaef9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:25.449314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b8119e5-40c7-49f9-a9d8-7948d94aaef9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:25.451471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b8119e5-40c7-49f9-a9d8-7948d94aaef9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:25.457052 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b8119e5-40c7-49f9-a9d8-7948d94aaef9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:25.458048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b8119e5-40c7-49f9-a9d8-7948d94aaef9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:25.930811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-076cd574-265c-4de6-bf16-e0bc4f6df2c8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:25.940736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-076cd574-265c-4de6-bf16-e0bc4f6df2c8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:25.951936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-076cd574-265c-4de6-bf16-e0bc4f6df2c8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:25.959562 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-076cd574-265c-4de6-bf16-e0bc4f6df2c8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1723 microversion: 2.20 time: 1.259826 May 28 21:22:25.960696 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2138/4341] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:24 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1723 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:25.975753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2b8119e5-40c7-49f9-a9d8-7948d94aaef9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:26.002805 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2b8119e5-40c7-49f9-a9d8-7948d94aaef9 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.575500 May 28 21:22:26.003409 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2204/4342] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:25 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:22:26.823405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1237758568", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d304eff3-8e4f-4892-8a6c-ef6717920bb8"}], "security_groups": [{"name": "tempest-securitygroup--566743874"}], "key_name": "tempest-keypair-1574782717", "user_data": "}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:26.979555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f1639b24-5a8e-49a0-82bb-73de0202e824 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:26.983891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f1639b24-5a8e-49a0-82bb-73de0202e824 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:26.994190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1639b24-5a8e-49a0-82bb-73de0202e824 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:26.995925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1639b24-5a8e-49a0-82bb-73de0202e824 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:26.996869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1639b24-5a8e-49a0-82bb-73de0202e824 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:26.999130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1639b24-5a8e-49a0-82bb-73de0202e824 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:27.461039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] validate_networks() for [('d304eff3-8e4f-4892-8a6c-ef6717920bb8', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:22:27.921040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f1639b24-5a8e-49a0-82bb-73de0202e824 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:27.939931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f1639b24-5a8e-49a0-82bb-73de0202e824 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:27.950247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f1639b24-5a8e-49a0-82bb-73de0202e824 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:27.955553 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f1639b24-5a8e-49a0-82bb-73de0202e824 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 200 len: 1723 microversion: 2.20 time: 0.978342 May 28 21:22:27.957274 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2205/4343] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:26 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 1723 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:22:27.980783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6e931613-c7ff-43d7-8900-81d7c9f77125 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:27.986697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6e931613-c7ff-43d7-8900-81d7c9f77125 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:28.009783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e931613-c7ff-43d7-8900-81d7c9f77125 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:28.010900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e931613-c7ff-43d7-8900-81d7c9f77125 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:28.012949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e931613-c7ff-43d7-8900-81d7c9f77125 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:28.014034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e931613-c7ff-43d7-8900-81d7c9f77125 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:28.667901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6e931613-c7ff-43d7-8900-81d7c9f77125 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:28.699605 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6e931613-c7ff-43d7-8900-81d7c9f77125 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.740143 May 28 21:22:28.700219 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2206/4344] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:27 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:28.706422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-1da039ad-726f-48ee-ba51-355c07870094 req-8f0d7b55-cf7a-4eaa-91ef-5d2e3ec1cfa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6232e7b0-68db-43d6-a836-fb2f96c54658", "name": "network-vif-deleted", "tag": "5f12e599-b5ae-4dcf-ac2c-9827b4ca4a75"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:28.735280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1da039ad-726f-48ee-ba51-355c07870094 req-8f0d7b55-cf7a-4eaa-91ef-5d2e3ec1cfa0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:28.735740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1da039ad-726f-48ee-ba51-355c07870094 req-8f0d7b55-cf7a-4eaa-91ef-5d2e3ec1cfa0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:28.759945 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-1da039ad-726f-48ee-ba51-355c07870094 req-8f0d7b55-cf7a-4eaa-91ef-5d2e3ec1cfa0 service nova] Creating event network-vif-deleted:5f12e599-b5ae-4dcf-ac2c-9827b4ca4a75 for instance 6232e7b0-68db-43d6-a836-fb2f96c54658 on nch2-master-1 May 28 21:22:28.767624 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-1da039ad-726f-48ee-ba51-355c07870094 req-8f0d7b55-cf7a-4eaa-91ef-5d2e3ec1cfa0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064613 May 28 21:22:28.768252 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2207/4345] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:22:28.809348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:22:28.809870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:22:28.810983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:22:28.812657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:22:28.812657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:22:28.837195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:28.841346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:28.841346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:28.841346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:28.898527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Getting quotas for project 54447ea481574a128f06c24315f34e46. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:22:28.907130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Getting quotas for user 02d5fbb072814fd7923ecf12c7ecad7b and project 54447ea481574a128f06c24315f34e46. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:22:28.953901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:22:28.959575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:22:28.978236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-744f30f5-66cf-4975-b766-0261336a4fb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:28.979031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-744f30f5-66cf-4975-b766-0261336a4fb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:28.999140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-744f30f5-66cf-4975-b766-0261336a4fb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:29.000321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-744f30f5-66cf-4975-b766-0261336a4fb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:29.001352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-744f30f5-66cf-4975-b766-0261336a4fb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:29.007305 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-744f30f5-66cf-4975-b766-0261336a4fb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:29.049458 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-744f30f5-66cf-4975-b766-0261336a4fb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] HTTP exception thrown: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-744f30f5-66cf-4975-b766-0261336a4fb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Request method failure captured: May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 HTTP/1.1 May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpHgQsHrY8-tq6Lwhk_kgt3Xn4L_MidLfd6t6e1kt_vBLOS7gz_CdRphRZe8jlNCfAjP4WEQVlYKxEr43W08fmlIXyzbk2DCiVB54W72qgC2txvk8K6J5cHEGo02tw5b8QBHyCk2dla8Zm2cYLbHUihbqsiMTPUFEU0q9nplGTe2zlo May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Openstack-Nova-Api-Version: 2.20 May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5a8841fa441d413a92a15510a9d082c6 May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a8841fa441d413a92a15510a9d082c6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5a8841fa441d413a92a15510a9d082c6 May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AttachVolumeShelveTestJSON-1592071011-project May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 857a887b6c7c41588afb2845eed6f309 May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1592071011-project May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '6232e7b0-68db-43d6-a836-fb2f96c54658'} May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:22:29.052858 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:22:29.056537 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:22:29.056537 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:22:29.056537 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:22:29.056537 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:22:29.056537 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:22:29.056537 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:22:29.056537 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. May 28 21:22:29.056537 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:22:29.060826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-744f30f5-66cf-4975-b766-0261336a4fb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Returning 404 to user: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:22:29.069425 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-744f30f5-66cf-4975-b766-0261336a4fb0 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 404 len: 111 microversion: 2.20 time: 0.097370 May 28 21:22:29.081234 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2208/4346] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:28 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 28 21:22:29.086712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-332b5a8c-d2a3-4036-a2d6-c5c93852d203 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '.version_select at 0x7f4d6424ec10>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:29.129165 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5dc2c6f6-99ae-4003-af64-4c3336cbe7ad tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.311489 May 28 21:22:29.130939 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2139/4347] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:22:26 2022] POST /compute/v2.1/servers => generated 408 bytes in 2314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:22:29.143314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8a879955-e7ae-42ac-bdc9-83fc13355031 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:29.145691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8a879955-e7ae-42ac-bdc9-83fc13355031 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:29.232728 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-332b5a8c-d2a3-4036-a2d6-c5c93852d203 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1606278230" status: 204 len: 0 microversion: 2.20 time: 0.149823 May 28 21:22:29.233406 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2209/4348] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:22:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1606278230 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:22:29.389631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8a879955-e7ae-42ac-bdc9-83fc13355031 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:29.401632 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8a879955-e7ae-42ac-bdc9-83fc13355031 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1239 microversion: 2.1 time: 0.261714 May 28 21:22:29.411020 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2140/4349] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:29 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1239 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:29.717190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a9f84924-a51f-4d63-9a04-ad033cf21862 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:29.718371 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a9f84924-a51f-4d63-9a04-ad033cf21862 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:29.731408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9f84924-a51f-4d63-9a04-ad033cf21862 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:29.732763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9f84924-a51f-4d63-9a04-ad033cf21862 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:29.735963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9f84924-a51f-4d63-9a04-ad033cf21862 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:29.736700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9f84924-a51f-4d63-9a04-ad033cf21862 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:30.203687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a9f84924-a51f-4d63-9a04-ad033cf21862 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:30.217463 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a9f84924-a51f-4d63-9a04-ad033cf21862 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.499845 May 28 21:22:30.218692 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2210/4350] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:29 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:30.418329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c46c58c8-47fd-4607-8aa9-0b7e0c4a88db tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:30.426582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c46c58c8-47fd-4607-8aa9-0b7e0c4a88db tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:30.611043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c46c58c8-47fd-4607-8aa9-0b7e0c4a88db tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:30.621548 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c46c58c8-47fd-4607-8aa9-0b7e0c4a88db tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1239 microversion: 2.1 time: 0.206337 May 28 21:22:30.626934 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2141/4351] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:30 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1239 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:31.235540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d8116205-679e-427c-a973-f5a5ac652a0b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:31.236048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d8116205-679e-427c-a973-f5a5ac652a0b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:31.253237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8116205-679e-427c-a973-f5a5ac652a0b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:31.254015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8116205-679e-427c-a973-f5a5ac652a0b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:31.255146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8116205-679e-427c-a973-f5a5ac652a0b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:31.255809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d8116205-679e-427c-a973-f5a5ac652a0b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:31.602983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=8 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:31.641019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8455cc6b-bfe2-4bcd-9a20-c31c7fa6e3ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:31.641691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8455cc6b-bfe2-4bcd-9a20-c31c7fa6e3ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:31.658552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8455cc6b-bfe2-4bcd-9a20-c31c7fa6e3ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:31.660702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8455cc6b-bfe2-4bcd-9a20-c31c7fa6e3ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:31.661861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8455cc6b-bfe2-4bcd-9a20-c31c7fa6e3ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:31.664830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8455cc6b-bfe2-4bcd-9a20-c31c7fa6e3ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:31.871172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d8116205-679e-427c-a973-f5a5ac652a0b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:31.883643 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d8116205-679e-427c-a973-f5a5ac652a0b tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.649489 May 28 21:22:31.884443 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2211/4352] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:31 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:31.931914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8455cc6b-bfe2-4bcd-9a20-c31c7fa6e3ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:31.940615 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8455cc6b-bfe2-4bcd-9a20-c31c7fa6e3ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1243 microversion: 2.1 time: 0.303809 May 28 21:22:31.948404 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2142/4353] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:31 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1243 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:32.078042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-697123a7-b57a-44d9-90bb-e4d12bc88f12 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Action: 'create', calling method: .version_select at 0x7f4d6424eca0>, body: {"keypair": {"name": "tempest-keypair-1507761769", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHWJvBhGFVCOG/JzN1EJCPchZZ9B7Lq1G3xnszMpADy40LL57p3OJtP2zqAM7ZFF4+nxsdm/Lh5YwfM7bCGIfEBTGVBBNcgr5ITTTd9GbKWearSu0OYtuZskDGmRZpkoA=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:32.142857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-697123a7-b57a-44d9-90bb-e4d12bc88f12 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Getting quotas for project 5a8841fa441d413a92a15510a9d082c6. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:22:32.160515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-697123a7-b57a-44d9-90bb-e4d12bc88f12 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Getting quotas for user 857a887b6c7c41588afb2845eed6f309 and project 5a8841fa441d413a92a15510a9d082c6. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:22:32.291745 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-697123a7-b57a-44d9-90bb-e4d12bc88f12 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.218587 May 28 21:22:32.297003 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2212/4354] 10.222.0.33 () {62 vars in 1199 bytes} [Sat May 28 21:22:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 220 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 28 21:22:32.900799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e9a1eac7-96eb-428f-a26c-8600184ee2cd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:32.901775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e9a1eac7-96eb-428f-a26c-8600184ee2cd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:32.911274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9a1eac7-96eb-428f-a26c-8600184ee2cd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:32.912186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9a1eac7-96eb-428f-a26c-8600184ee2cd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:32.913080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9a1eac7-96eb-428f-a26c-8600184ee2cd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:32.913575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9a1eac7-96eb-428f-a26c-8600184ee2cd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:32.967912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-459af322-0135-4cb5-9c48-7c18924b6bde tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:32.968624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-459af322-0135-4cb5-9c48-7c18924b6bde tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:32.992267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-459af322-0135-4cb5-9c48-7c18924b6bde tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:32.994020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-459af322-0135-4cb5-9c48-7c18924b6bde tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:32.999147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-459af322-0135-4cb5-9c48-7c18924b6bde tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:32.999837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-459af322-0135-4cb5-9c48-7c18924b6bde tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:34.211119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-459af322-0135-4cb5-9c48-7c18924b6bde tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:34.235473 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-459af322-0135-4cb5-9c48-7c18924b6bde tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1299 microversion: 2.1 time: 1.273033 May 28 21:22:34.238290 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2213/4355] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:32 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1299 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:34.595751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e9a1eac7-96eb-428f-a26c-8600184ee2cd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:34.621742 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e9a1eac7-96eb-428f-a26c-8600184ee2cd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 1.723701 May 28 21:22:34.636022 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2143/4356] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:32 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:35.259393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7e10f498-32ec-443d-82cd-b4c823bf9953 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:35.260685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7e10f498-32ec-443d-82cd-b4c823bf9953 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:35.278201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e10f498-32ec-443d-82cd-b4c823bf9953 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:35.281748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e10f498-32ec-443d-82cd-b4c823bf9953 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:35.282876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e10f498-32ec-443d-82cd-b4c823bf9953 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:35.288710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e10f498-32ec-443d-82cd-b4c823bf9953 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:35.299133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:35.400733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7e10f498-32ec-443d-82cd-b4c823bf9953 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:35.412409 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7e10f498-32ec-443d-82cd-b4c823bf9953 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1297 microversion: 2.1 time: 0.157470 May 28 21:22:35.413029 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2214/4357] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:35 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1297 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:35.639613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-76521265-e798-40b2-897c-5170ba2fe057 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:35.640570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-76521265-e798-40b2-897c-5170ba2fe057 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:35.670837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-76521265-e798-40b2-897c-5170ba2fe057 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:35.673193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-76521265-e798-40b2-897c-5170ba2fe057 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:35.676873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-76521265-e798-40b2-897c-5170ba2fe057 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:35.683299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-76521265-e798-40b2-897c-5170ba2fe057 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:35.995171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-76521265-e798-40b2-897c-5170ba2fe057 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:36.019519 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-76521265-e798-40b2-897c-5170ba2fe057 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.384278 May 28 21:22:36.020293 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2144/4358] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:35 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:36.430776 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dc0b9571-0d63-431c-898a-0efcf6470e97 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:36.432019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dc0b9571-0d63-431c-898a-0efcf6470e97 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:36.442948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc0b9571-0d63-431c-898a-0efcf6470e97 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:36.444290 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc0b9571-0d63-431c-898a-0efcf6470e97 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:36.445343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc0b9571-0d63-431c-898a-0efcf6470e97 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:36.446025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc0b9571-0d63-431c-898a-0efcf6470e97 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:36.775916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dc0b9571-0d63-431c-898a-0efcf6470e97 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:36.802969 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dc0b9571-0d63-431c-898a-0efcf6470e97 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1364 microversion: 2.1 time: 0.378186 May 28 21:22:36.813102 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2215/4359] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:36 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1364 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:37.036777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dcf7a963-c14b-453a-bde5-2350fbdc882e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:37.037445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dcf7a963-c14b-453a-bde5-2350fbdc882e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:37.040470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:37.059756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcf7a963-c14b-453a-bde5-2350fbdc882e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:37.063427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcf7a963-c14b-453a-bde5-2350fbdc882e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:37.064501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcf7a963-c14b-453a-bde5-2350fbdc882e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:37.066910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcf7a963-c14b-453a-bde5-2350fbdc882e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:37.567414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dcf7a963-c14b-453a-bde5-2350fbdc882e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:37.588440 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dcf7a963-c14b-453a-bde5-2350fbdc882e tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.547945 May 28 21:22:37.588440 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2145/4360] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:37 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:37.823904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f4f6791a-b213-445d-86b1-a37a3d72607b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:37.828577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f4f6791a-b213-445d-86b1-a37a3d72607b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:37.841593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4f6791a-b213-445d-86b1-a37a3d72607b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:37.842236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4f6791a-b213-445d-86b1-a37a3d72607b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:37.843205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4f6791a-b213-445d-86b1-a37a3d72607b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:37.843813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4f6791a-b213-445d-86b1-a37a3d72607b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:38.393642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f4f6791a-b213-445d-86b1-a37a3d72607b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:38.407242 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f4f6791a-b213-445d-86b1-a37a3d72607b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1364 microversion: 2.1 time: 0.588240 May 28 21:22:38.408459 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2216/4361] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:37 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1364 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:38.592793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-17edd963-5971-4ae2-b466-ea1b6baf814a req-91082d03-2dba-484b-8e9f-e02a4fcf56ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "226cec1f-9523-4d1f-95cf-e2d994bd1f88", "tag": "b98532fb-0692-4c80-9ec0-a5445175d125"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:38.603679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7d0e5cef-6831-4480-a6e0-698f1268e7c8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:38.603914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-17edd963-5971-4ae2-b466-ea1b6baf814a req-91082d03-2dba-484b-8e9f-e02a4fcf56ab service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:38.604314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7d0e5cef-6831-4480-a6e0-698f1268e7c8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:38.614429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-17edd963-5971-4ae2-b466-ea1b6baf814a req-91082d03-2dba-484b-8e9f-e02a4fcf56ab service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:38.626803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d0e5cef-6831-4480-a6e0-698f1268e7c8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:38.629281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d0e5cef-6831-4480-a6e0-698f1268e7c8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:38.631196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d0e5cef-6831-4480-a6e0-698f1268e7c8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:38.631965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d0e5cef-6831-4480-a6e0-698f1268e7c8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:38.648212 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-17edd963-5971-4ae2-b466-ea1b6baf814a req-91082d03-2dba-484b-8e9f-e02a4fcf56ab service nova] Creating event network-changed:b98532fb-0692-4c80-9ec0-a5445175d125 for instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 on nch2-master-1 May 28 21:22:38.670736 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-17edd963-5971-4ae2-b466-ea1b6baf814a req-91082d03-2dba-484b-8e9f-e02a4fcf56ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081629 May 28 21:22:38.673817 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2146/4362] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:22:39.420071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7d0e5cef-6831-4480-a6e0-698f1268e7c8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:39.422300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:39.429260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0c3f09d4-5591-4a94-abfb-495097385634 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:39.429260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0c3f09d4-5591-4a94-abfb-495097385634 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:39.430201 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7d0e5cef-6831-4480-a6e0-698f1268e7c8 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.829223 May 28 21:22:39.441661 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2217/4363] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:38 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:39.448175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c3f09d4-5591-4a94-abfb-495097385634 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:39.448641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c3f09d4-5591-4a94-abfb-495097385634 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:39.449505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c3f09d4-5591-4a94-abfb-495097385634 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:39.450228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c3f09d4-5591-4a94-abfb-495097385634 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:40.247621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c3f09d4-5591-4a94-abfb-495097385634 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:40.259299 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0c3f09d4-5591-4a94-abfb-495097385634 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1364 microversion: 2.1 time: 0.837735 May 28 21:22:40.260836 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2147/4364] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:39 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1364 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:22:40.448490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1ff23de5-389d-4102-aace-bacdea234fcb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:40.449914 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1ff23de5-389d-4102-aace-bacdea234fcb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:40.463011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ff23de5-389d-4102-aace-bacdea234fcb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:40.464222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ff23de5-389d-4102-aace-bacdea234fcb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:40.465274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ff23de5-389d-4102-aace-bacdea234fcb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:40.466059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ff23de5-389d-4102-aace-bacdea234fcb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:40.639077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1ff23de5-389d-4102-aace-bacdea234fcb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:40.647278 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1ff23de5-389d-4102-aace-bacdea234fcb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.205734 May 28 21:22:40.647878 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2218/4365] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:40 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:41.269780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1370692609", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7d9b85a9-8812-4298-8752-c53e38dbb44b"}], "security_groups": [{"name": "tempest-securitygroup--1233404217"}], "key_name": "tempest-keypair-1507761769", "user_data": "}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:41.279775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-63521ba2-6ab2-47b6-a0ff-c0419c246046 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:41.280410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-63521ba2-6ab2-47b6-a0ff-c0419c246046 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:41.291110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63521ba2-6ab2-47b6-a0ff-c0419c246046 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:41.291567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63521ba2-6ab2-47b6-a0ff-c0419c246046 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:41.292412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63521ba2-6ab2-47b6-a0ff-c0419c246046 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:41.292852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63521ba2-6ab2-47b6-a0ff-c0419c246046 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:41.295417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=10 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:41.705725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] validate_networks() for [('7d9b85a9-8812-4298-8752-c53e38dbb44b', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:22:41.717455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-63521ba2-6ab2-47b6-a0ff-c0419c246046 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:41.757430 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-63521ba2-6ab2-47b6-a0ff-c0419c246046 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1364 microversion: 2.1 time: 0.484571 May 28 21:22:41.796074 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2219/4366] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:41 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1364 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:41.815082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c74af798-5996-4354-a685-6a38f378f813 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:41.815082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c74af798-5996-4354-a685-6a38f378f813 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:41.845286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c74af798-5996-4354-a685-6a38f378f813 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:41.846452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c74af798-5996-4354-a685-6a38f378f813 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:41.847664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c74af798-5996-4354-a685-6a38f378f813 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:41.848126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c74af798-5996-4354-a685-6a38f378f813 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:42.550812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c74af798-5996-4354-a685-6a38f378f813 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:42.572877 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c74af798-5996-4354-a685-6a38f378f813 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.775526 May 28 21:22:42.576449 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2220/4367] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:41 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:42.832838 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bfa15440-bfc3-4f87-bea9-46a4cc60ffb9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:42.837313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bfa15440-bfc3-4f87-bea9-46a4cc60ffb9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:42.862403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bfa15440-bfc3-4f87-bea9-46a4cc60ffb9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:42.867345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bfa15440-bfc3-4f87-bea9-46a4cc60ffb9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:42.869710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bfa15440-bfc3-4f87-bea9-46a4cc60ffb9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:42.871755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bfa15440-bfc3-4f87-bea9-46a4cc60ffb9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:42.972307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:43.161148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:22:43.161675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:22:43.162278 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:22:43.162792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:22:43.163312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:22:43.176994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:43.180454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:43.183427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:43.184721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:43.230264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Getting quotas for project 5a8841fa441d413a92a15510a9d082c6. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:22:43.243339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Getting quotas for user 857a887b6c7c41588afb2845eed6f309 and project 5a8841fa441d413a92a15510a9d082c6. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:22:43.272436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:22:43.275319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:22:43.470382 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5d859fc0-095d-4c14-85a2-75821d777a9c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.201034 May 28 21:22:43.474879 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2148/4368] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:22:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 2212 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 21:22:43.502413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-392b854f-870b-4286-969d-e3be8b22cd8a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:43.506692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-392b854f-870b-4286-969d-e3be8b22cd8a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:43.544645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bfa15440-bfc3-4f87-bea9-46a4cc60ffb9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:43.553253 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bfa15440-bfc3-4f87-bea9-46a4cc60ffb9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1364 microversion: 2.1 time: 0.742448 May 28 21:22:43.569641 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2221/4369] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:42 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1364 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:43.605800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e5e933f1-05e6-4092-9e9a-7c17ab00b3b0 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:43.609029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e5e933f1-05e6-4092-9e9a-7c17ab00b3b0 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:43.612003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:43.631169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5e933f1-05e6-4092-9e9a-7c17ab00b3b0 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:43.636023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5e933f1-05e6-4092-9e9a-7c17ab00b3b0 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:43.639188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5e933f1-05e6-4092-9e9a-7c17ab00b3b0 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:43.641123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5e933f1-05e6-4092-9e9a-7c17ab00b3b0 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:43.790594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-392b854f-870b-4286-969d-e3be8b22cd8a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:43.829471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-392b854f-870b-4286-969d-e3be8b22cd8a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:43.841762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-392b854f-870b-4286-969d-e3be8b22cd8a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:43.841762 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-392b854f-870b-4286-969d-e3be8b22cd8a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1282 microversion: 2.20 time: 0.357543 May 28 21:22:43.842507 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2149/4370] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:43 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1282 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:44.123654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e5e933f1-05e6-4092-9e9a-7c17ab00b3b0 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:44.149470 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e5e933f1-05e6-4092-9e9a-7c17ab00b3b0 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.558634 May 28 21:22:44.159844 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2222/4371] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:43 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:44.576236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f15e27d8-5cba-4c3e-8b04-42c845c4168f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:44.577612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f15e27d8-5cba-4c3e-8b04-42c845c4168f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:44.596904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f15e27d8-5cba-4c3e-8b04-42c845c4168f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:44.597370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f15e27d8-5cba-4c3e-8b04-42c845c4168f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:44.598196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f15e27d8-5cba-4c3e-8b04-42c845c4168f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:44.598631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f15e27d8-5cba-4c3e-8b04-42c845c4168f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:44.856260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c7a8e3cf-e4ab-4c98-abaa-47e0d60fb0a9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:44.858541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c7a8e3cf-e4ab-4c98-abaa-47e0d60fb0a9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:45.410186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c7a8e3cf-e4ab-4c98-abaa-47e0d60fb0a9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:45.450120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c7a8e3cf-e4ab-4c98-abaa-47e0d60fb0a9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:45.450120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c7a8e3cf-e4ab-4c98-abaa-47e0d60fb0a9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:45.450120 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c7a8e3cf-e4ab-4c98-abaa-47e0d60fb0a9 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1282 microversion: 2.20 time: 0.598726 May 28 21:22:45.452036 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2223/4372] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:44 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1282 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:22:45.464540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c30e127b-adfc-4eb2-bf25-4948a9ebaebd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:45.467121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c30e127b-adfc-4eb2-bf25-4948a9ebaebd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:45.487654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c30e127b-adfc-4eb2-bf25-4948a9ebaebd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:45.488110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c30e127b-adfc-4eb2-bf25-4948a9ebaebd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:45.488918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c30e127b-adfc-4eb2-bf25-4948a9ebaebd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:45.489368 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c30e127b-adfc-4eb2-bf25-4948a9ebaebd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:45.527029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f15e27d8-5cba-4c3e-8b04-42c845c4168f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:45.543223 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f15e27d8-5cba-4c3e-8b04-42c845c4168f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1364 microversion: 2.1 time: 0.969888 May 28 21:22:45.545778 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2150/4373] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:44 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1364 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:45.768497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c30e127b-adfc-4eb2-bf25-4948a9ebaebd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:45.780525 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c30e127b-adfc-4eb2-bf25-4948a9ebaebd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1486 microversion: 2.1 time: 0.325814 May 28 21:22:45.790431 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2224/4374] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:45 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1486 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:45.801132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7cc8bb07-8eef-450e-9771-23082858a456 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:45.802848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7cc8bb07-8eef-450e-9771-23082858a456 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:45.828643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7cc8bb07-8eef-450e-9771-23082858a456 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:45.835666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7cc8bb07-8eef-450e-9771-23082858a456 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:45.838668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7cc8bb07-8eef-450e-9771-23082858a456 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:45.839144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7cc8bb07-8eef-450e-9771-23082858a456 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:46.165121 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7cc8bb07-8eef-450e-9771-23082858a456 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "POST /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55/action" status: 202 len: 0 microversion: 2.1 time: 0.365170 May 28 21:22:46.165121 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2151/4375] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:22:45 2022] POST /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:22:46.177687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ba21fca8-f21f-4a67-921b-13d6bf73d032 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:46.178389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ba21fca8-f21f-4a67-921b-13d6bf73d032 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:46.200035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba21fca8-f21f-4a67-921b-13d6bf73d032 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:46.201077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba21fca8-f21f-4a67-921b-13d6bf73d032 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:46.201945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba21fca8-f21f-4a67-921b-13d6bf73d032 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:46.202403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba21fca8-f21f-4a67-921b-13d6bf73d032 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:46.470575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6fd912c7-8d50-4bbb-bc68-3efda4334d41 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:46.479044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6fd912c7-8d50-4bbb-bc68-3efda4334d41 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:46.479939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fd912c7-8d50-4bbb-bc68-3efda4334d41 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:46.480553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fd912c7-8d50-4bbb-bc68-3efda4334d41 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:46.484163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fd912c7-8d50-4bbb-bc68-3efda4334d41 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:46.484828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fd912c7-8d50-4bbb-bc68-3efda4334d41 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:46.707592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6fd912c7-8d50-4bbb-bc68-3efda4334d41 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:46.722110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6fd912c7-8d50-4bbb-bc68-3efda4334d41 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:46.724004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6fd912c7-8d50-4bbb-bc68-3efda4334d41 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:46.727604 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6fd912c7-8d50-4bbb-bc68-3efda4334d41 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1334 microversion: 2.20 time: 0.262520 May 28 21:22:46.730199 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2152/4376] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:46 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1334 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:22:46.740113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f8a4d362-1fd2-438b-925f-337b11ca5e01 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:46.742621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f8a4d362-1fd2-438b-925f-337b11ca5e01 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:46.755773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8a4d362-1fd2-438b-925f-337b11ca5e01 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:46.759320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8a4d362-1fd2-438b-925f-337b11ca5e01 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:46.768195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8a4d362-1fd2-438b-925f-337b11ca5e01 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:46.769597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8a4d362-1fd2-438b-925f-337b11ca5e01 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:47.020538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ba21fca8-f21f-4a67-921b-13d6bf73d032 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:47.029964 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ba21fca8-f21f-4a67-921b-13d6bf73d032 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1494 microversion: 2.1 time: 0.861300 May 28 21:22:47.031210 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2225/4377] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:46 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1494 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:47.311812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f8a4d362-1fd2-438b-925f-337b11ca5e01 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:47.328470 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f8a4d362-1fd2-438b-925f-337b11ca5e01 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1364 microversion: 2.1 time: 0.596758 May 28 21:22:47.329535 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2153/4378] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:46 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1364 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:47.752934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bd98f0ca-1b82-43b7-b8a3-48077ef81aca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:47.753554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bd98f0ca-1b82-43b7-b8a3-48077ef81aca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:47.774270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd98f0ca-1b82-43b7-b8a3-48077ef81aca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:47.774732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd98f0ca-1b82-43b7-b8a3-48077ef81aca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:47.775523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd98f0ca-1b82-43b7-b8a3-48077ef81aca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:47.775970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd98f0ca-1b82-43b7-b8a3-48077ef81aca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:47.921264 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bd98f0ca-1b82-43b7-b8a3-48077ef81aca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:47.932328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bd98f0ca-1b82-43b7-b8a3-48077ef81aca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:47.933917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bd98f0ca-1b82-43b7-b8a3-48077ef81aca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:47.936286 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bd98f0ca-1b82-43b7-b8a3-48077ef81aca tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1340 microversion: 2.20 time: 0.187932 May 28 21:22:47.948357 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2226/4379] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:47 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1340 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:48.050518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-70da8021-ddd4-441a-b7a7-2c9f17b7e05c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:48.053140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-70da8021-ddd4-441a-b7a7-2c9f17b7e05c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:48.072534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70da8021-ddd4-441a-b7a7-2c9f17b7e05c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:48.073541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70da8021-ddd4-441a-b7a7-2c9f17b7e05c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:48.076504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70da8021-ddd4-441a-b7a7-2c9f17b7e05c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:48.077214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70da8021-ddd4-441a-b7a7-2c9f17b7e05c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:48.083690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:48.330657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-9b321994-9194-4a71-970d-87de7dec20ac req-b8a28e7c-15b4-4214-aa8a-ee0bfbf69d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226cec1f-9523-4d1f-95cf-e2d994bd1f88", "name": "network-vif-plugged", "status": "completed", "tag": "b98532fb-0692-4c80-9ec0-a5445175d125"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:48.347401 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9b321994-9194-4a71-970d-87de7dec20ac req-b8a28e7c-15b4-4214-aa8a-ee0bfbf69d10 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:48.347878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9b321994-9194-4a71-970d-87de7dec20ac req-b8a28e7c-15b4-4214-aa8a-ee0bfbf69d10 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:48.381214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-70da8021-ddd4-441a-b7a7-2c9f17b7e05c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:48.399172 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-70da8021-ddd4-441a-b7a7-2c9f17b7e05c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1494 microversion: 2.1 time: 0.354573 May 28 21:22:48.403810 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-9b321994-9194-4a71-970d-87de7dec20ac req-b8a28e7c-15b4-4214-aa8a-ee0bfbf69d10 service nova] Creating event network-vif-plugged:b98532fb-0692-4c80-9ec0-a5445175d125 for instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 on nch2-master-1 May 28 21:22:48.403900 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2154/4380] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:48 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1494 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:48.420412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a1dc187c-0e0f-49b0-b2de-6d3486df7c61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:48.421046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a1dc187c-0e0f-49b0-b2de-6d3486df7c61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:48.435112 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-9b321994-9194-4a71-970d-87de7dec20ac req-b8a28e7c-15b4-4214-aa8a-ee0bfbf69d10 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101821 May 28 21:22:48.437382 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2227/4381] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:22:48.446484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1dc187c-0e0f-49b0-b2de-6d3486df7c61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:48.446484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1dc187c-0e0f-49b0-b2de-6d3486df7c61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:48.447108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1dc187c-0e0f-49b0-b2de-6d3486df7c61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:48.447200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1dc187c-0e0f-49b0-b2de-6d3486df7c61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:48.695283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1775144738", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "ddc2fd9e-57fd-4647-a490-06a841a76673"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2029188104", "security_groups": [{"name": "tempest-secgroup-smoke-381979025"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:48.744411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a1dc187c-0e0f-49b0-b2de-6d3486df7c61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:48.765925 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a1dc187c-0e0f-49b0-b2de-6d3486df7c61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1364 microversion: 2.1 time: 0.355717 May 28 21:22:48.765925 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2155/4382] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:48 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1364 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:48.956215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-89c82ed0-20d0-4ca4-a907-e0db9e49a98c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:48.956970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-89c82ed0-20d0-4ca4-a907-e0db9e49a98c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:48.968927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89c82ed0-20d0-4ca4-a907-e0db9e49a98c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:48.978083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89c82ed0-20d0-4ca4-a907-e0db9e49a98c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:48.979221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89c82ed0-20d0-4ca4-a907-e0db9e49a98c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:48.983849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89c82ed0-20d0-4ca4-a907-e0db9e49a98c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:49.132995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] validate_networks() for [('ddc2fd9e-57fd-4647-a490-06a841a76673', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:22:49.819792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89c82ed0-20d0-4ca4-a907-e0db9e49a98c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:49.837622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89c82ed0-20d0-4ca4-a907-e0db9e49a98c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:49.842073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89c82ed0-20d0-4ca4-a907-e0db9e49a98c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:49.847302 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-89c82ed0-20d0-4ca4-a907-e0db9e49a98c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1408 microversion: 2.20 time: 0.896170 May 28 21:22:49.859246 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2156/4383] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:48 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1408 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:49.859246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b98f4a61-f433-4aa7-a243-63e59142d245 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:49.862352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b98f4a61-f433-4aa7-a243-63e59142d245 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:49.882731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b98f4a61-f433-4aa7-a243-63e59142d245 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:49.884725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b98f4a61-f433-4aa7-a243-63e59142d245 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:49.888914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b98f4a61-f433-4aa7-a243-63e59142d245 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:49.889599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b98f4a61-f433-4aa7-a243-63e59142d245 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:50.709236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b98f4a61-f433-4aa7-a243-63e59142d245 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:50.724877 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b98f4a61-f433-4aa7-a243-63e59142d245 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1500 microversion: 2.1 time: 0.873382 May 28 21:22:50.726148 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2157/4384] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:49 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1500 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:50.745502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f973e2e8-3bf2-49de-aa87-090a53409bc1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:50.747386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f973e2e8-3bf2-49de-aa87-090a53409bc1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:50.762270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f973e2e8-3bf2-49de-aa87-090a53409bc1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:50.763914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f973e2e8-3bf2-49de-aa87-090a53409bc1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:50.764928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f973e2e8-3bf2-49de-aa87-090a53409bc1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:50.765583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f973e2e8-3bf2-49de-aa87-090a53409bc1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:50.883391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:22:50.883878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:22:50.884357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:22:50.888434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:22:50.890105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:22:50.922407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:50.923924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:50.928436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:50.942206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:51.001549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for project c3588eab36044e439158f876836ea514. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:22:51.016453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for user f3468a0b2d324603ab6c3080993bc0c8 and project c3588eab36044e439158f876836ea514. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:22:51.041961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:22:51.046015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:22:51.057500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f973e2e8-3bf2-49de-aa87-090a53409bc1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:51.116015 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f973e2e8-3bf2-49de-aa87-090a53409bc1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1364 microversion: 2.1 time: 0.369491 May 28 21:22:51.118531 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2158/4385] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:50 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1364 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:51.144760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-513c6a83-033d-4a46-ad8a-0a206b46d9a1 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:51.145312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-513c6a83-033d-4a46-ad8a-0a206b46d9a1 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:51.156445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-513c6a83-033d-4a46-ad8a-0a206b46d9a1 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:51.156561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-513c6a83-033d-4a46-ad8a-0a206b46d9a1 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:51.157317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-513c6a83-033d-4a46-ad8a-0a206b46d9a1 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:51.158014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-513c6a83-033d-4a46-ad8a-0a206b46d9a1 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:51.203812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-513c6a83-033d-4a46-ad8a-0a206b46d9a1 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:22:51.283322 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d3b1fe03-6df0-4d5e-98ba-ed343b8452b7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.591403 May 28 21:22:51.285166 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2228/4386] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:22:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 2595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:22:51.297604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6949c217-b5ce-4170-8ebe-4536ffb319a2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:51.298755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6949c217-b5ce-4170-8ebe-4536ffb319a2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:51.306978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6949c217-b5ce-4170-8ebe-4536ffb319a2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:51.307495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6949c217-b5ce-4170-8ebe-4536ffb319a2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:51.308600 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6949c217-b5ce-4170-8ebe-4536ffb319a2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:51.309209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6949c217-b5ce-4170-8ebe-4536ffb319a2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:51.673215 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-513c6a83-033d-4a46-ad8a-0a206b46d9a1 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "DELETE /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 204 len: 0 microversion: 2.1 time: 0.553149 May 28 21:22:51.681779 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2159/4387] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:22:51 2022] DELETE /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:22:51.695232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-65c08abe-1bfc-4798-96c4-42de92aaf89a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:51.697832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-65c08abe-1bfc-4798-96c4-42de92aaf89a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:51.750141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6949c217-b5ce-4170-8ebe-4536ffb319a2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:51.760279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6949c217-b5ce-4170-8ebe-4536ffb319a2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:51.767392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6949c217-b5ce-4170-8ebe-4536ffb319a2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:51.771847 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6949c217-b5ce-4170-8ebe-4536ffb319a2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1408 microversion: 2.20 time: 0.480708 May 28 21:22:51.782381 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2229/4388] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:51 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1408 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:51.818869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-57a28460-7039-4f88-bf75-b8c73f30f98c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:51.826328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-57a28460-7039-4f88-bf75-b8c73f30f98c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:51.857632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57a28460-7039-4f88-bf75-b8c73f30f98c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:51.858133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57a28460-7039-4f88-bf75-b8c73f30f98c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:51.870882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57a28460-7039-4f88-bf75-b8c73f30f98c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:51.871413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57a28460-7039-4f88-bf75-b8c73f30f98c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:51.907090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-65c08abe-1bfc-4798-96c4-42de92aaf89a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:51.930190 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-65c08abe-1bfc-4798-96c4-42de92aaf89a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1267 microversion: 2.1 time: 0.233443 May 28 21:22:51.938780 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2160/4389] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:51 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1267 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:52.138352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-365cad93-a771-4ff8-a9c1-e7ebec63634c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:52.139023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-365cad93-a771-4ff8-a9c1-e7ebec63634c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:52.159232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-365cad93-a771-4ff8-a9c1-e7ebec63634c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:52.160111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-57a28460-7039-4f88-bf75-b8c73f30f98c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:52.160562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-365cad93-a771-4ff8-a9c1-e7ebec63634c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:52.163525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-365cad93-a771-4ff8-a9c1-e7ebec63634c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:52.165068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-365cad93-a771-4ff8-a9c1-e7ebec63634c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:52.178445 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-57a28460-7039-4f88-bf75-b8c73f30f98c tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.394632 May 28 21:22:52.179584 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2230/4390] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:51 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:52.524686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-365cad93-a771-4ff8-a9c1-e7ebec63634c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:52.536119 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-365cad93-a771-4ff8-a9c1-e7ebec63634c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1364 microversion: 2.1 time: 0.402314 May 28 21:22:52.536743 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2161/4391] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:52 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1364 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:22:52.795945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5ddd1aaa-e26f-41c4-9043-b5c6e5ee5892 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:52.797918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5ddd1aaa-e26f-41c4-9043-b5c6e5ee5892 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:52.811580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ddd1aaa-e26f-41c4-9043-b5c6e5ee5892 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:52.812082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ddd1aaa-e26f-41c4-9043-b5c6e5ee5892 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:52.812861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ddd1aaa-e26f-41c4-9043-b5c6e5ee5892 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:52.815659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ddd1aaa-e26f-41c4-9043-b5c6e5ee5892 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:52.955671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ab4ac7b-3705-434a-9834-48e10ad2c52e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:52.956426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8ab4ac7b-3705-434a-9834-48e10ad2c52e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:53.107744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8ab4ac7b-3705-434a-9834-48e10ad2c52e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:53.118529 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8ab4ac7b-3705-434a-9834-48e10ad2c52e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1267 microversion: 2.1 time: 0.167272 May 28 21:22:53.139846 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2162/4392] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:52 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:22:53.173016 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5ddd1aaa-e26f-41c4-9043-b5c6e5ee5892 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:53.192630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5ddd1aaa-e26f-41c4-9043-b5c6e5ee5892 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:53.196890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-60cea553-23b4-4588-a688-2f1990112feb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:53.197608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-60cea553-23b4-4588-a688-2f1990112feb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:53.201048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5ddd1aaa-e26f-41c4-9043-b5c6e5ee5892 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:53.202899 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5ddd1aaa-e26f-41c4-9043-b5c6e5ee5892 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1408 microversion: 2.20 time: 0.414513 May 28 21:22:53.204007 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2231/4393] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:52 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1408 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:53.216591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:53.226701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60cea553-23b4-4588-a688-2f1990112feb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:53.227477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60cea553-23b4-4588-a688-2f1990112feb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:53.228559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60cea553-23b4-4588-a688-2f1990112feb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:53.229170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-60cea553-23b4-4588-a688-2f1990112feb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:53.513095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-60cea553-23b4-4588-a688-2f1990112feb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:53.521971 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-60cea553-23b4-4588-a688-2f1990112feb tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.330123 May 28 21:22:53.522785 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2163/4394] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:53 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:53.553237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ca0eae86-d2a5-4816-9019-6b6cb61eeb0a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:53.554317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ca0eae86-d2a5-4816-9019-6b6cb61eeb0a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:53.567361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca0eae86-d2a5-4816-9019-6b6cb61eeb0a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:53.568117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca0eae86-d2a5-4816-9019-6b6cb61eeb0a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:53.573350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca0eae86-d2a5-4816-9019-6b6cb61eeb0a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:53.573350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca0eae86-d2a5-4816-9019-6b6cb61eeb0a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:53.859969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ca0eae86-d2a5-4816-9019-6b6cb61eeb0a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:53.891597 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ca0eae86-d2a5-4816-9019-6b6cb61eeb0a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1364 microversion: 2.1 time: 0.320771 May 28 21:22:53.892556 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2232/4395] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:53 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1364 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:54.123859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-099ce3c8-6c1d-41cd-a65a-298a7250c085 req-115070fc-b570-4ad8-955c-d5051f2e9bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd20dd19-f26b-4e32-9114-715558d5aa3b", "tag": "4c95deb6-3882-40f5-af0e-fd2149216c59"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:54.137775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-099ce3c8-6c1d-41cd-a65a-298a7250c085 req-115070fc-b570-4ad8-955c-d5051f2e9bb0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:54.138284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-099ce3c8-6c1d-41cd-a65a-298a7250c085 req-115070fc-b570-4ad8-955c-d5051f2e9bb0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:54.147119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d638e171-8556-4d6d-8868-769be70a41b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:54.147746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d638e171-8556-4d6d-8868-769be70a41b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:54.156530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d638e171-8556-4d6d-8868-769be70a41b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:54.164140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d638e171-8556-4d6d-8868-769be70a41b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:54.171002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d638e171-8556-4d6d-8868-769be70a41b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:54.171533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d638e171-8556-4d6d-8868-769be70a41b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:54.176305 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:54.184863 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-099ce3c8-6c1d-41cd-a65a-298a7250c085 req-115070fc-b570-4ad8-955c-d5051f2e9bb0 service nova] Creating event network-changed:4c95deb6-3882-40f5-af0e-fd2149216c59 for instance cd20dd19-f26b-4e32-9114-715558d5aa3b on nch1-master-1 May 28 21:22:54.197901 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-099ce3c8-6c1d-41cd-a65a-298a7250c085 req-115070fc-b570-4ad8-955c-d5051f2e9bb0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077996 May 28 21:22:54.199075 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2164/4396] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:22:54.223006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9ea18fb0-8042-495e-bf32-62c9776f0016 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:54.224010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9ea18fb0-8042-495e-bf32-62c9776f0016 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:54.250967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ea18fb0-8042-495e-bf32-62c9776f0016 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:54.253937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ea18fb0-8042-495e-bf32-62c9776f0016 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:54.257335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ea18fb0-8042-495e-bf32-62c9776f0016 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:54.258106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ea18fb0-8042-495e-bf32-62c9776f0016 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:54.296687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d638e171-8556-4d6d-8868-769be70a41b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:54.305432 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d638e171-8556-4d6d-8868-769be70a41b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1319 microversion: 2.1 time: 0.162030 May 28 21:22:54.306075 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2233/4397] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:54 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:54.545875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a8718426-3b4e-4232-a37d-83041d4ff072 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:54.546916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a8718426-3b4e-4232-a37d-83041d4ff072 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:54.559948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8718426-3b4e-4232-a37d-83041d4ff072 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:54.560476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8718426-3b4e-4232-a37d-83041d4ff072 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:54.561311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8718426-3b4e-4232-a37d-83041d4ff072 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:54.561762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a8718426-3b4e-4232-a37d-83041d4ff072 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:54.636257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9ea18fb0-8042-495e-bf32-62c9776f0016 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:54.651348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9ea18fb0-8042-495e-bf32-62c9776f0016 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:54.652822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9ea18fb0-8042-495e-bf32-62c9776f0016 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:54.658436 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9ea18fb0-8042-495e-bf32-62c9776f0016 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1408 microversion: 2.20 time: 0.440851 May 28 21:22:54.665680 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2165/4398] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:54 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1408 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:54.910980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4ec20e9e-787f-45f4-88fe-a0bc50e5d5cf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:54.912092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4ec20e9e-787f-45f4-88fe-a0bc50e5d5cf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:54.924086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ec20e9e-787f-45f4-88fe-a0bc50e5d5cf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:54.924933 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ec20e9e-787f-45f4-88fe-a0bc50e5d5cf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:54.925921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ec20e9e-787f-45f4-88fe-a0bc50e5d5cf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:54.926558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ec20e9e-787f-45f4-88fe-a0bc50e5d5cf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:55.162396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a8718426-3b4e-4232-a37d-83041d4ff072 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:55.176847 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a8718426-3b4e-4232-a37d-83041d4ff072 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.641140 May 28 21:22:55.177888 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2234/4399] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:54 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:55.325490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7cc2a5e0-595b-4d9d-ba20-b6cff92679b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:55.326664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7cc2a5e0-595b-4d9d-ba20-b6cff92679b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:55.335351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cc2a5e0-595b-4d9d-ba20-b6cff92679b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:55.336209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cc2a5e0-595b-4d9d-ba20-b6cff92679b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:55.337207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cc2a5e0-595b-4d9d-ba20-b6cff92679b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:55.337797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cc2a5e0-595b-4d9d-ba20-b6cff92679b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:55.426521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4ec20e9e-787f-45f4-88fe-a0bc50e5d5cf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:55.437537 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4ec20e9e-787f-45f4-88fe-a0bc50e5d5cf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1552 microversion: 2.1 time: 0.532123 May 28 21:22:55.438292 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2166/4400] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:54 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1552 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:22:55.454974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-18837c01-9dd1-4ead-a2ef-4916789af85e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:55.455867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-18837c01-9dd1-4ead-a2ef-4916789af85e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:55.462935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18837c01-9dd1-4ead-a2ef-4916789af85e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:55.463775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18837c01-9dd1-4ead-a2ef-4916789af85e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:55.464785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18837c01-9dd1-4ead-a2ef-4916789af85e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:55.465445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18837c01-9dd1-4ead-a2ef-4916789af85e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:55.480425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7cc2a5e0-595b-4d9d-ba20-b6cff92679b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:55.488870 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7cc2a5e0-595b-4d9d-ba20-b6cff92679b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1325 microversion: 2.1 time: 0.169669 May 28 21:22:55.490153 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2235/4401] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:55 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1325 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:55.684232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-575e0182-9fd3-4c3f-a0b7-0c68e6a7c108 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:55.685684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-575e0182-9fd3-4c3f-a0b7-0c68e6a7c108 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:55.688120 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-18837c01-9dd1-4ead-a2ef-4916789af85e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.237703 May 28 21:22:55.688719 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2167/4402] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:22:55 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/os-interface => generated 285 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:22:55.696993 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-575e0182-9fd3-4c3f-a0b7-0c68e6a7c108 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:55.697462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-575e0182-9fd3-4c3f-a0b7-0c68e6a7c108 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:55.698293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-575e0182-9fd3-4c3f-a0b7-0c68e6a7c108 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:55.698754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-575e0182-9fd3-4c3f-a0b7-0c68e6a7c108 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:56.196896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0574d82e-18e8-44ca-9629-d04f4770e8b5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:56.198130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0574d82e-18e8-44ca-9629-d04f4770e8b5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:56.219238 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0574d82e-18e8-44ca-9629-d04f4770e8b5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:56.221439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0574d82e-18e8-44ca-9629-d04f4770e8b5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:56.221439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0574d82e-18e8-44ca-9629-d04f4770e8b5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:56.221439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0574d82e-18e8-44ca-9629-d04f4770e8b5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:56.708531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-575e0182-9fd3-4c3f-a0b7-0c68e6a7c108 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:56.722090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-575e0182-9fd3-4c3f-a0b7-0c68e6a7c108 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:56.724006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-575e0182-9fd3-4c3f-a0b7-0c68e6a7c108 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:56.726579 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-575e0182-9fd3-4c3f-a0b7-0c68e6a7c108 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1408 microversion: 2.20 time: 1.046684 May 28 21:22:56.741470 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2236/4403] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:55 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1408 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:56.746570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-00104de7-a99b-40ab-b521-7901effecc96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:56.748077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-00104de7-a99b-40ab-b521-7901effecc96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:56.756245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00104de7-a99b-40ab-b521-7901effecc96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:56.756992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00104de7-a99b-40ab-b521-7901effecc96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:56.758598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00104de7-a99b-40ab-b521-7901effecc96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:56.759854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00104de7-a99b-40ab-b521-7901effecc96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:56.783602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0574d82e-18e8-44ca-9629-d04f4770e8b5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:56.808877 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0574d82e-18e8-44ca-9629-d04f4770e8b5 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1506 microversion: 2.1 time: 0.614267 May 28 21:22:56.813295 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2168/4404] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:56 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1506 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:57.034437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-00104de7-a99b-40ab-b521-7901effecc96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:57.047531 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-00104de7-a99b-40ab-b521-7901effecc96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1325 microversion: 2.1 time: 0.317452 May 28 21:22:57.048634 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2237/4405] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:56 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1325 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:57.214925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-e6841eda-90b4-482c-8da4-be750e0d4376 req-662d65ec-4b43-4e76-b6b2-82c1b5082280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7589d921-27f0-4afd-9d6f-e41f99941b55", "name": "network-vif-deleted", "tag": "9010d898-903d-4ba8-bc8b-fdffa09d7867"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:57.226925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e6841eda-90b4-482c-8da4-be750e0d4376 req-662d65ec-4b43-4e76-b6b2-82c1b5082280 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:57.227541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e6841eda-90b4-482c-8da4-be750e0d4376 req-662d65ec-4b43-4e76-b6b2-82c1b5082280 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:57.250110 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e6841eda-90b4-482c-8da4-be750e0d4376 req-662d65ec-4b43-4e76-b6b2-82c1b5082280 service nova] Creating event network-vif-deleted:9010d898-903d-4ba8-bc8b-fdffa09d7867 for instance 7589d921-27f0-4afd-9d6f-e41f99941b55 on nch2-master-1 May 28 21:22:57.256295 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-e6841eda-90b4-482c-8da4-be750e0d4376 req-662d65ec-4b43-4e76-b6b2-82c1b5082280 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045104 May 28 21:22:57.258299 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2169/4406] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:22:57.750717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f089d4be-a9c7-4ab6-8e94-610a9fb0e705 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:57.751362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f089d4be-a9c7-4ab6-8e94-610a9fb0e705 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:57.769137 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f089d4be-a9c7-4ab6-8e94-610a9fb0e705 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:57.770699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f089d4be-a9c7-4ab6-8e94-610a9fb0e705 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:57.771943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f089d4be-a9c7-4ab6-8e94-610a9fb0e705 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:57.772622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f089d4be-a9c7-4ab6-8e94-610a9fb0e705 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:57.830566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-98ced91b-465a-4d42-aebb-fcc380cbd472 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:57.831607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-98ced91b-465a-4d42-aebb-fcc380cbd472 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:57.849655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98ced91b-465a-4d42-aebb-fcc380cbd472 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:57.850300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98ced91b-465a-4d42-aebb-fcc380cbd472 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:57.853110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98ced91b-465a-4d42-aebb-fcc380cbd472 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:57.854040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98ced91b-465a-4d42-aebb-fcc380cbd472 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:57.953042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98ced91b-465a-4d42-aebb-fcc380cbd472 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:57.953927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98ced91b-465a-4d42-aebb-fcc380cbd472 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:57.956795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-98ced91b-465a-4d42-aebb-fcc380cbd472 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lazy-loading 'fault' on Instance uuid 7589d921-27f0-4afd-9d6f-e41f99941b55 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:22:58.195296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-98ced91b-465a-4d42-aebb-fcc380cbd472 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:58.220540 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-98ced91b-465a-4d42-aebb-fcc380cbd472 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 200 len: 1303 microversion: 2.1 time: 0.385023 May 28 21:22:58.220540 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2170/4407] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:57 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 1303 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:58.222031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4b218083-5b22-470e-8152-f53cd92e43b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:58.222700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4b218083-5b22-470e-8152-f53cd92e43b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:58.252250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b218083-5b22-470e-8152-f53cd92e43b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:58.252988 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b218083-5b22-470e-8152-f53cd92e43b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:58.254028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b218083-5b22-470e-8152-f53cd92e43b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:58.259286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b218083-5b22-470e-8152-f53cd92e43b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:58.766948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f089d4be-a9c7-4ab6-8e94-610a9fb0e705 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:58.787274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f089d4be-a9c7-4ab6-8e94-610a9fb0e705 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:58.789306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f089d4be-a9c7-4ab6-8e94-610a9fb0e705 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:58.791120 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f089d4be-a9c7-4ab6-8e94-610a9fb0e705 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1408 microversion: 2.20 time: 1.045651 May 28 21:22:58.796545 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2238/4408] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:57 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1408 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:22:58.985268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4b218083-5b22-470e-8152-f53cd92e43b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:22:59.005571 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4b218083-5b22-470e-8152-f53cd92e43b5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1392 microversion: 2.1 time: 0.783413 May 28 21:22:59.005571 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2171/4409] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:58 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1392 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:22:59.235303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c8d14d25-665c-4bcc-a224-3f1d0f78a4dd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:59.236267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c8d14d25-665c-4bcc-a224-3f1d0f78a4dd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 7589d921-27f0-4afd-9d6f-e41f99941b55] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:59.246019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8d14d25-665c-4bcc-a224-3f1d0f78a4dd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:59.246387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8d14d25-665c-4bcc-a224-3f1d0f78a4dd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:59.257955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8d14d25-665c-4bcc-a224-3f1d0f78a4dd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:59.257955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8d14d25-665c-4bcc-a224-3f1d0f78a4dd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:59.279802 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-c8d14d25-665c-4bcc-a224-3f1d0f78a4dd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] HTTP exception thrown: Instance 7589d921-27f0-4afd-9d6f-e41f99941b55 could not be found. May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c8d14d25-665c-4bcc-a224-3f1d0f78a4dd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Request method failure captured: May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 HTTP/1.1 May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpI_L_MCx4VVd3FWwrxPpBmNMDM_x_-LBOKDAr1lN_jfiC-KZ1CtkNyiBBGZuZJS2cYpLaXqA33Uy2mBE_m4o8SU4-falsI-pnAfn-CBdfl_l5b0lMBlpX1kCHpVVh3B_LoVPCihFhm8NinUYQmZxn6NZOx1HO8bTO-hD6db1JJmEII May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 3c6886d8b684413da24b02f5b5fb6ef8 May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerRescueTestJSON-123622654 May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3c6886d8b684413da24b02f5b5fb6ef8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3c6886d8b684413da24b02f5b5fb6ef8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3c6886d8b684413da24b02f5b5fb6ef8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3c6886d8b684413da24b02f5b5fb6ef8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerRescueTestJSON-123622654 May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 3c6886d8b684413da24b02f5b5fb6ef8 May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerRescueTestJSON-123622654 May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerRescueTestJSON-123622654-project May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f1acb2fffdc64ce29b71b2b40e2285f0 May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerRescueTestJSON-123622654-project May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 7589d921-27f0-4afd-9d6f-e41f99941b55 could not be found. May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '7589d921-27f0-4afd-9d6f-e41f99941b55'} May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7589d921-27f0-4afd-9d6f-e41f99941b55 could not be found. May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7589d921-27f0-4afd-9d6f-e41f99941b55 could not be found. May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:22:59.283738 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:22:59.300123 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:22:59.300123 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:22:59.300123 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:22:59.300123 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:22:59.300123 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:22:59.300123 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7589d921-27f0-4afd-9d6f-e41f99941b55 could not be found. May 28 21:22:59.300123 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:22:59.300123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c8d14d25-665c-4bcc-a224-3f1d0f78a4dd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Returning 404 to user: Instance 7589d921-27f0-4afd-9d6f-e41f99941b55 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:22:59.300123 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c8d14d25-665c-4bcc-a224-3f1d0f78a4dd tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55" status: 404 len: 111 microversion: 2.1 time: 0.053802 May 28 21:22:59.300123 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2239/4410] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:59 2022] GET /compute/v2.1/servers/7589d921-27f0-4afd-9d6f-e41f99941b55 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:22:59.301919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4a681954-c80b-47b7-b121-d2303a7f5c47 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:59.301919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4a681954-c80b-47b7-b121-d2303a7f5c47 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:59.312228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a681954-c80b-47b7-b121-d2303a7f5c47 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:59.313956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a681954-c80b-47b7-b121-d2303a7f5c47 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:59.316497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a681954-c80b-47b7-b121-d2303a7f5c47 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:59.317295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a681954-c80b-47b7-b121-d2303a7f5c47 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:59.394924 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:22:59.406762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4a681954-c80b-47b7-b121-d2303a7f5c47 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:22:59.543393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-025fb007-e16c-40cb-82df-e1dbbe68fff0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:59.545814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-025fb007-e16c-40cb-82df-e1dbbe68fff0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:22:59.592955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-025fb007-e16c-40cb-82df-e1dbbe68fff0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:59.599151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-025fb007-e16c-40cb-82df-e1dbbe68fff0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:59.602280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-025fb007-e16c-40cb-82df-e1dbbe68fff0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:59.603012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-025fb007-e16c-40cb-82df-e1dbbe68fff0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:59.870500 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4a681954-c80b-47b7-b121-d2303a7f5c47 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 204 len: 0 microversion: 2.1 time: 0.576271 May 28 21:22:59.872452 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2172/4411] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:22:59 2022] DELETE /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:22:59.878041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-ad88a11f-b9dc-44c6-96e1-d1707063c4bd req-2bbd1bf0-c35e-4c88-8527-2682ec96d810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "226cec1f-9523-4d1f-95cf-e2d994bd1f88", "tag": "b98532fb-0692-4c80-9ec0-a5445175d125"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:22:59.896076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ad88a11f-b9dc-44c6-96e1-d1707063c4bd req-2bbd1bf0-c35e-4c88-8527-2682ec96d810 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:22:59.898575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ad88a11f-b9dc-44c6-96e1-d1707063c4bd req-2bbd1bf0-c35e-4c88-8527-2682ec96d810 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:22:59.941727 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-ad88a11f-b9dc-44c6-96e1-d1707063c4bd req-2bbd1bf0-c35e-4c88-8527-2682ec96d810 service nova] Creating event network-changed:b98532fb-0692-4c80-9ec0-a5445175d125 for instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 on nch2-master-1 May 28 21:22:59.958768 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-ad88a11f-b9dc-44c6-96e1-d1707063c4bd req-2bbd1bf0-c35e-4c88-8527-2682ec96d810 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082716 May 28 21:22:59.961736 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2173/4412] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:22:59.974461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1aed1938-bf05-4a83-8a30-344bb0ef3872 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:22:59.976148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1aed1938-bf05-4a83-8a30-344bb0ef3872 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:00.004741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1aed1938-bf05-4a83-8a30-344bb0ef3872 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:00.005826 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1aed1938-bf05-4a83-8a30-344bb0ef3872 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:00.009175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1aed1938-bf05-4a83-8a30-344bb0ef3872 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:00.010173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1aed1938-bf05-4a83-8a30-344bb0ef3872 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:00.493407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-025fb007-e16c-40cb-82df-e1dbbe68fff0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:00.505543 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-025fb007-e16c-40cb-82df-e1dbbe68fff0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1552 microversion: 2.1 time: 0.967946 May 28 21:23:00.506170 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2240/4413] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:22:59 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1552 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:23:00.532434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c95675a7-8eda-4524-9f94-50bd7be6d998 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:00.537791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c95675a7-8eda-4524-9f94-50bd7be6d998 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:00.551651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c95675a7-8eda-4524-9f94-50bd7be6d998 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:00.552662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c95675a7-8eda-4524-9f94-50bd7be6d998 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:00.554214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c95675a7-8eda-4524-9f94-50bd7be6d998 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:00.555096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c95675a7-8eda-4524-9f94-50bd7be6d998 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:00.570079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1aed1938-bf05-4a83-8a30-344bb0ef3872 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:00.595741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1aed1938-bf05-4a83-8a30-344bb0ef3872 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:00.613528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1aed1938-bf05-4a83-8a30-344bb0ef3872 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:00.624992 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1aed1938-bf05-4a83-8a30-344bb0ef3872 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1408 microversion: 2.20 time: 0.658635 May 28 21:23:00.633958 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2174/4414] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:22:59 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1408 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:00.662646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1b8eb4e9-cd80-421e-9270-842662c97176 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:00.665305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1b8eb4e9-cd80-421e-9270-842662c97176 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:00.689167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b8eb4e9-cd80-421e-9270-842662c97176 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:00.691290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b8eb4e9-cd80-421e-9270-842662c97176 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:00.696448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b8eb4e9-cd80-421e-9270-842662c97176 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:00.696934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b8eb4e9-cd80-421e-9270-842662c97176 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:00.976911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:01.036334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=8 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:01.142549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c95675a7-8eda-4524-9f94-50bd7be6d998 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:01.156403 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c95675a7-8eda-4524-9f94-50bd7be6d998 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1492 microversion: 2.1 time: 0.634570 May 28 21:23:01.157240 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2241/4415] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:00 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1492 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:01.178683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1a2c90d1-77d9-4adb-9ada-c9c8c8c1895e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:01.179838 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1a2c90d1-77d9-4adb-9ada-c9c8c8c1895e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:01.187560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a2c90d1-77d9-4adb-9ada-c9c8c8c1895e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:01.196352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a2c90d1-77d9-4adb-9ada-c9c8c8c1895e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:01.197461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a2c90d1-77d9-4adb-9ada-c9c8c8c1895e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:01.198171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a2c90d1-77d9-4adb-9ada-c9c8c8c1895e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:01.221244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1b8eb4e9-cd80-421e-9270-842662c97176 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:01.243282 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1b8eb4e9-cd80-421e-9270-842662c97176 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1392 microversion: 2.1 time: 0.602034 May 28 21:23:01.243946 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2175/4416] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:00 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1392 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:01.666787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b94c133d-4c48-47de-954c-13700145ac35 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:01.667628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b94c133d-4c48-47de-954c-13700145ac35 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:01.683860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b94c133d-4c48-47de-954c-13700145ac35 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:01.687148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b94c133d-4c48-47de-954c-13700145ac35 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:01.687148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b94c133d-4c48-47de-954c-13700145ac35 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:01.690265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b94c133d-4c48-47de-954c-13700145ac35 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:02.414246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b94c133d-4c48-47de-954c-13700145ac35 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:02.429278 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b94c133d-4c48-47de-954c-13700145ac35 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:02.431579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b94c133d-4c48-47de-954c-13700145ac35 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:02.432838 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b94c133d-4c48-47de-954c-13700145ac35 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1408 microversion: 2.20 time: 0.770306 May 28 21:23:02.434613 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2176/4417] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:01 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1408 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:02.441330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-325ae787-7038-4e06-bd08-d1853706656a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:02.443096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-325ae787-7038-4e06-bd08-d1853706656a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:02.446797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:02.452605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-325ae787-7038-4e06-bd08-d1853706656a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:02.452904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-325ae787-7038-4e06-bd08-d1853706656a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:02.453901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-325ae787-7038-4e06-bd08-d1853706656a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:02.454496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-325ae787-7038-4e06-bd08-d1853706656a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:02.455554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1a2c90d1-77d9-4adb-9ada-c9c8c8c1895e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:02.465961 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1a2c90d1-77d9-4adb-9ada-c9c8c8c1895e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1552 microversion: 2.1 time: 1.295007 May 28 21:23:02.466927 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2242/4418] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:01 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1552 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:02.477374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f8aaa12e-c542-48fe-a69f-fac82ede988b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:02.477374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f8aaa12e-c542-48fe-a69f-fac82ede988b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:02.483662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8aaa12e-c542-48fe-a69f-fac82ede988b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:02.484291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8aaa12e-c542-48fe-a69f-fac82ede988b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:02.486350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8aaa12e-c542-48fe-a69f-fac82ede988b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:02.486350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8aaa12e-c542-48fe-a69f-fac82ede988b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:02.960982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f8aaa12e-c542-48fe-a69f-fac82ede988b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:02.971008 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f8aaa12e-c542-48fe-a69f-fac82ede988b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1392 microversion: 2.1 time: 0.502182 May 28 21:23:02.971892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-325ae787-7038-4e06-bd08-d1853706656a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:02.980819 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-325ae787-7038-4e06-bd08-d1853706656a tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1492 microversion: 2.1 time: 0.544941 May 28 21:23:02.983278 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2177/4419] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:02 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1492 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:02.983652 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2243/4420] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:02 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1392 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:02.988225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-b6a66eb7-1a6d-449f-8b7f-6adb5100a1a6 req-281d4e93-0838-439a-a0b6-d15dce46ebcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd20dd19-f26b-4e32-9114-715558d5aa3b", "name": "network-vif-plugged", "status": "completed", "tag": "4c95deb6-3882-40f5-af0e-fd2149216c59"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:02.997782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b6a66eb7-1a6d-449f-8b7f-6adb5100a1a6 req-281d4e93-0838-439a-a0b6-d15dce46ebcd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:02.998482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b6a66eb7-1a6d-449f-8b7f-6adb5100a1a6 req-281d4e93-0838-439a-a0b6-d15dce46ebcd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:03.021703 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-b6a66eb7-1a6d-449f-8b7f-6adb5100a1a6 req-281d4e93-0838-439a-a0b6-d15dce46ebcd service nova] Creating event network-vif-plugged:4c95deb6-3882-40f5-af0e-fd2149216c59 for instance cd20dd19-f26b-4e32-9114-715558d5aa3b on nch1-master-1 May 28 21:23:03.028804 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-b6a66eb7-1a6d-449f-8b7f-6adb5100a1a6 req-281d4e93-0838-439a-a0b6-d15dce46ebcd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043492 May 28 21:23:03.029633 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2178/4421] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:23:03.255172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-4486dad8-de33-4b63-8326-53f706657a2f req-f7beb5d5-b0fe-48aa-936b-bbb639adb016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a7a3bfa-2077-4b86-8670-bd2428861958", "tag": "31f937d0-8453-4ce1-8d41-4a95e908e103"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:03.277145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4486dad8-de33-4b63-8326-53f706657a2f req-f7beb5d5-b0fe-48aa-936b-bbb639adb016 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:03.277643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4486dad8-de33-4b63-8326-53f706657a2f req-f7beb5d5-b0fe-48aa-936b-bbb639adb016 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:03.308394 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-4486dad8-de33-4b63-8326-53f706657a2f req-f7beb5d5-b0fe-48aa-936b-bbb639adb016 service nova] Creating event network-changed:31f937d0-8453-4ce1-8d41-4a95e908e103 for instance 6a7a3bfa-2077-4b86-8670-bd2428861958 on nch1-master-1 May 28 21:23:03.315091 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-4486dad8-de33-4b63-8326-53f706657a2f req-f7beb5d5-b0fe-48aa-936b-bbb639adb016 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089219 May 28 21:23:03.316472 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2244/4422] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:23:03.428379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=12 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:03.432971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2afc8861-e082-4da1-88be-d863b3fde0cc req-5aec5c6c-9489-418d-bda1-d33bc0b8c4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5a8b4e-8727-49ed-bafc-228fbecea520", "name": "network-vif-deleted", "tag": "d0c72081-4f9a-47cd-ab5d-cb1d70d27321"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:03.452104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2afc8861-e082-4da1-88be-d863b3fde0cc req-5aec5c6c-9489-418d-bda1-d33bc0b8c4f6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:03.452936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2afc8861-e082-4da1-88be-d863b3fde0cc req-5aec5c6c-9489-418d-bda1-d33bc0b8c4f6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:03.454575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-13b9d5bd-f523-436d-9afa-c5231296bb5c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:03.455298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-13b9d5bd-f523-436d-9afa-c5231296bb5c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:03.467491 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2afc8861-e082-4da1-88be-d863b3fde0cc req-5aec5c6c-9489-418d-bda1-d33bc0b8c4f6 service nova] Creating event network-vif-deleted:d0c72081-4f9a-47cd-ab5d-cb1d70d27321 for instance 2d5a8b4e-8727-49ed-bafc-228fbecea520 on nch1-master-1 May 28 21:23:03.472582 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2afc8861-e082-4da1-88be-d863b3fde0cc req-5aec5c6c-9489-418d-bda1-d33bc0b8c4f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044975 May 28 21:23:03.473195 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2179/4423] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:23:03.479059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13b9d5bd-f523-436d-9afa-c5231296bb5c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:03.484316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13b9d5bd-f523-436d-9afa-c5231296bb5c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:03.485390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13b9d5bd-f523-436d-9afa-c5231296bb5c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:03.486098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13b9d5bd-f523-436d-9afa-c5231296bb5c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:03.489131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-132e79c7-1cf9-49a3-915e-87f1c1b4d581 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:03.492893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-132e79c7-1cf9-49a3-915e-87f1c1b4d581 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:03.506759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-132e79c7-1cf9-49a3-915e-87f1c1b4d581 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:03.507641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-132e79c7-1cf9-49a3-915e-87f1c1b4d581 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:03.508680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-132e79c7-1cf9-49a3-915e-87f1c1b4d581 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:03.515190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-132e79c7-1cf9-49a3-915e-87f1c1b4d581 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:04.284774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-132e79c7-1cf9-49a3-915e-87f1c1b4d581 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:04.298027 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-132e79c7-1cf9-49a3-915e-87f1c1b4d581 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.816338 May 28 21:23:04.299901 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2180/4424] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:03 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:04.306382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1c34314e-44a8-4421-8db3-5e6582f276ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:04.307354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1c34314e-44a8-4421-8db3-5e6582f276ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:04.320731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c34314e-44a8-4421-8db3-5e6582f276ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:04.321408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c34314e-44a8-4421-8db3-5e6582f276ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:04.322587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c34314e-44a8-4421-8db3-5e6582f276ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:04.323032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c34314e-44a8-4421-8db3-5e6582f276ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:04.469223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-13b9d5bd-f523-436d-9afa-c5231296bb5c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:04.484962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-13b9d5bd-f523-436d-9afa-c5231296bb5c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:04.487814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-13b9d5bd-f523-436d-9afa-c5231296bb5c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:04.490735 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-13b9d5bd-f523-436d-9afa-c5231296bb5c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1408 microversion: 2.20 time: 1.042051 May 28 21:23:04.493933 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2245/4425] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:03 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1408 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:04.505560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-be1b19de-afae-48d6-9f69-90c6d0e39a05 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:04.506338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-be1b19de-afae-48d6-9f69-90c6d0e39a05 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:04.521391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be1b19de-afae-48d6-9f69-90c6d0e39a05 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:04.522166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be1b19de-afae-48d6-9f69-90c6d0e39a05 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:04.525596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be1b19de-afae-48d6-9f69-90c6d0e39a05 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:04.526087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be1b19de-afae-48d6-9f69-90c6d0e39a05 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:04.568335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be1b19de-afae-48d6-9f69-90c6d0e39a05 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:04.580981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be1b19de-afae-48d6-9f69-90c6d0e39a05 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:04.581880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-be1b19de-afae-48d6-9f69-90c6d0e39a05 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lazy-loading 'fault' on Instance uuid 2d5a8b4e-8727-49ed-bafc-228fbecea520 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:23:04.674226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-be1b19de-afae-48d6-9f69-90c6d0e39a05 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1acb2fffdc64ce29b71b2b40e2285f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c6886d8b684413da24b02f5b5fb6ef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:04.690531 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-be1b19de-afae-48d6-9f69-90c6d0e39a05 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 200 len: 1303 microversion: 2.1 time: 0.195695 May 28 21:23:04.691298 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2246/4426] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:04 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 1303 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:04.697224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-87393366-94b3-4fe0-ad7d-a4f72d0e7640 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:04.698162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-87393366-94b3-4fe0-ad7d-a4f72d0e7640 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:04.705561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87393366-94b3-4fe0-ad7d-a4f72d0e7640 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:04.706373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87393366-94b3-4fe0-ad7d-a4f72d0e7640 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:04.707570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87393366-94b3-4fe0-ad7d-a4f72d0e7640 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:04.708955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87393366-94b3-4fe0-ad7d-a4f72d0e7640 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:04.961676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1c34314e-44a8-4421-8db3-5e6582f276ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:04.974230 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1c34314e-44a8-4421-8db3-5e6582f276ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1392 microversion: 2.1 time: 0.672768 May 28 21:23:04.978792 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2181/4427] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:04 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1392 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:05.222511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-87393366-94b3-4fe0-ad7d-a4f72d0e7640 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:05.233887 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-87393366-94b3-4fe0-ad7d-a4f72d0e7640 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.540359 May 28 21:23:05.248463 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2247/4428] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:04 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:05.259566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-92f8f3c6-fd54-4df7-9ae4-f683d0b0c13c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1797325593"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:05.259566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-92f8f3c6-fd54-4df7-9ae4-f683d0b0c13c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:05.263630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92f8f3c6-fd54-4df7-9ae4-f683d0b0c13c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:05.264093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92f8f3c6-fd54-4df7-9ae4-f683d0b0c13c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:05.264902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92f8f3c6-fd54-4df7-9ae4-f683d0b0c13c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:05.265323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92f8f3c6-fd54-4df7-9ae4-f683d0b0c13c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:05.514535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1b73ff15-44a9-4a1f-851a-200eedfa4c8f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:05.515390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1b73ff15-44a9-4a1f-851a-200eedfa4c8f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:05.521626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b73ff15-44a9-4a1f-851a-200eedfa4c8f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:05.522348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b73ff15-44a9-4a1f-851a-200eedfa4c8f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:05.523139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b73ff15-44a9-4a1f-851a-200eedfa4c8f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:05.523587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b73ff15-44a9-4a1f-851a-200eedfa4c8f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:05.890479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1b73ff15-44a9-4a1f-851a-200eedfa4c8f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:05.902050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1b73ff15-44a9-4a1f-851a-200eedfa4c8f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:05.910021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1b73ff15-44a9-4a1f-851a-200eedfa4c8f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:05.911607 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1b73ff15-44a9-4a1f-851a-200eedfa4c8f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1600 microversion: 2.20 time: 0.402934 May 28 21:23:05.912763 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2248/4429] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:05 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1600 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:23:05.922056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ee00ddc1-0d78-4f33-a189-7ab3b29c25d7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:05.924430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ee00ddc1-0d78-4f33-a189-7ab3b29c25d7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] [instance: 2d5a8b4e-8727-49ed-bafc-228fbecea520] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:05.930017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee00ddc1-0d78-4f33-a189-7ab3b29c25d7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:05.930651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee00ddc1-0d78-4f33-a189-7ab3b29c25d7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:05.932064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee00ddc1-0d78-4f33-a189-7ab3b29c25d7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:05.932548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee00ddc1-0d78-4f33-a189-7ab3b29c25d7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:05.952788 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-ee00ddc1-0d78-4f33-a189-7ab3b29c25d7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] HTTP exception thrown: Instance 2d5a8b4e-8727-49ed-bafc-228fbecea520 could not be found. May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ee00ddc1-0d78-4f33-a189-7ab3b29c25d7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Request method failure captured: May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 HTTP/1.1 May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpI_L_MCx4VVd3FWwrxPpBmNMDM_x_-LBOKDAr1lN_jfiC-KZ1CtkNyiBBGZuZJS2cYpLaXqA33Uy2mBE_m4o8SU4-falsI-pnAfn-CBdfl_l5b0lMBlpX1kCHpVVh3B_LoVPCihFhm8NinUYQmZxn6NZOx1HO8bTO-hD6db1JJmEII May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 3c6886d8b684413da24b02f5b5fb6ef8 May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerRescueTestJSON-123622654 May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3c6886d8b684413da24b02f5b5fb6ef8", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3c6886d8b684413da24b02f5b5fb6ef8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3c6886d8b684413da24b02f5b5fb6ef8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3c6886d8b684413da24b02f5b5fb6ef8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerRescueTestJSON-123622654 May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 3c6886d8b684413da24b02f5b5fb6ef8 May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerRescueTestJSON-123622654 May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerRescueTestJSON-123622654-project May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f1acb2fffdc64ce29b71b2b40e2285f0 May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerRescueTestJSON-123622654-project May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 2d5a8b4e-8727-49ed-bafc-228fbecea520 could not be found. May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '2d5a8b4e-8727-49ed-bafc-228fbecea520'} May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d5a8b4e-8727-49ed-bafc-228fbecea520 could not be found. May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d5a8b4e-8727-49ed-bafc-228fbecea520 could not be found. May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:23:05.975580 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:23:05.980782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:23:05.980782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:23:05.980782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:23:05.980782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:23:05.980782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:23:05.980782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d5a8b4e-8727-49ed-bafc-228fbecea520 could not be found. May 28 21:23:05.980782 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:23:05.980782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ee00ddc1-0d78-4f33-a189-7ab3b29c25d7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] Returning 404 to user: Instance 2d5a8b4e-8727-49ed-bafc-228fbecea520 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:23:05.980782 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ee00ddc1-0d78-4f33-a189-7ab3b29c25d7 tempest-ServerRescueTestJSON-123622654 tempest-ServerRescueTestJSON-123622654-project] 10.222.0.33 "GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520" status: 404 len: 111 microversion: 2.1 time: 0.040467 May 28 21:23:05.980782 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2249/4430] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:05 2022] GET /compute/v2.1/servers/2d5a8b4e-8727-49ed-bafc-228fbecea520 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:23:05.980782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1e95e1aa-3533-493f-87ee-d83e91b36539 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:05.980782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1e95e1aa-3533-493f-87ee-d83e91b36539 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:05.986067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e95e1aa-3533-493f-87ee-d83e91b36539 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:05.986751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e95e1aa-3533-493f-87ee-d83e91b36539 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:05.988851 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e95e1aa-3533-493f-87ee-d83e91b36539 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:05.989547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1e95e1aa-3533-493f-87ee-d83e91b36539 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:06.062840 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-92f8f3c6-fd54-4df7-9ae4-f683d0b0c13c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.815740 May 28 21:23:06.077237 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2182/4431] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:23:05 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) May 28 21:23:06.087939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-65cedb40-a4ca-491b-815d-1ad02f508f93 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:06.088944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-65cedb40-a4ca-491b-815d-1ad02f508f93 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:06.099535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65cedb40-a4ca-491b-815d-1ad02f508f93 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:06.100751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65cedb40-a4ca-491b-815d-1ad02f508f93 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:06.101932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65cedb40-a4ca-491b-815d-1ad02f508f93 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:06.102609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65cedb40-a4ca-491b-815d-1ad02f508f93 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:06.321766 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1e95e1aa-3533-493f-87ee-d83e91b36539 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.359029 May 28 21:23:06.323083 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2250/4432] 10.222.0.33 () {60 vars in 1315 bytes} [Sat May 28 21:23:05 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b/os-interface => generated 285 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:23:06.558498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-65cedb40-a4ca-491b-815d-1ad02f508f93 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:06.571407 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-65cedb40-a4ca-491b-815d-1ad02f508f93 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1392 microversion: 2.1 time: 0.490670 May 28 21:23:06.578014 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2183/4433] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:06 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1392 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:07.589912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e7d559fc-b759-4f26-b6da-d5fe7a21a261 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:07.590587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e7d559fc-b759-4f26-b6da-d5fe7a21a261 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:07.599825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7d559fc-b759-4f26-b6da-d5fe7a21a261 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:07.600560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7d559fc-b759-4f26-b6da-d5fe7a21a261 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:07.604700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7d559fc-b759-4f26-b6da-d5fe7a21a261 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:07.605351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7d559fc-b759-4f26-b6da-d5fe7a21a261 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:08.024259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e7d559fc-b759-4f26-b6da-d5fe7a21a261 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:08.027978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:08.033053 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e7d559fc-b759-4f26-b6da-d5fe7a21a261 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1392 microversion: 2.1 time: 0.448153 May 28 21:23:08.035618 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2251/4434] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:07 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1392 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:09.051569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d776582a-53c7-4b1b-b237-bd4d61a9f3e6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:09.052368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d776582a-53c7-4b1b-b237-bd4d61a9f3e6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:09.065708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d776582a-53c7-4b1b-b237-bd4d61a9f3e6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:09.067344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d776582a-53c7-4b1b-b237-bd4d61a9f3e6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:09.068196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d776582a-53c7-4b1b-b237-bd4d61a9f3e6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:09.070458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d776582a-53c7-4b1b-b237-bd4d61a9f3e6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:09.375869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-02546fd6-c44a-4c07-9002-18faae6c33cd req-404d3905-9547-4766-ba7d-4933b4a4ce39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd20dd19-f26b-4e32-9114-715558d5aa3b", "tag": "4c95deb6-3882-40f5-af0e-fd2149216c59"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:09.410843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-02546fd6-c44a-4c07-9002-18faae6c33cd req-404d3905-9547-4766-ba7d-4933b4a4ce39 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:09.411906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-02546fd6-c44a-4c07-9002-18faae6c33cd req-404d3905-9547-4766-ba7d-4933b4a4ce39 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:09.425799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d776582a-53c7-4b1b-b237-bd4d61a9f3e6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:09.433251 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-02546fd6-c44a-4c07-9002-18faae6c33cd req-404d3905-9547-4766-ba7d-4933b4a4ce39 service nova] Creating event network-changed:4c95deb6-3882-40f5-af0e-fd2149216c59 for instance cd20dd19-f26b-4e32-9114-715558d5aa3b on nch1-master-1 May 28 21:23:09.436402 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d776582a-53c7-4b1b-b237-bd4d61a9f3e6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1392 microversion: 2.1 time: 0.389054 May 28 21:23:09.437004 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2184/4435] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:09 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1392 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:09.440446 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-02546fd6-c44a-4c07-9002-18faae6c33cd req-404d3905-9547-4766-ba7d-4933b4a4ce39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071895 May 28 21:23:09.442151 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2252/4436] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:23:10.441803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-04fd8d89-d29d-49f2-b394-2a04be809313 req-cdbc158a-7054-498a-bfc8-366c363ac05e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226cec1f-9523-4d1f-95cf-e2d994bd1f88", "name": "network-vif-plugged", "status": "completed", "tag": "b98532fb-0692-4c80-9ec0-a5445175d125"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:10.456269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-661ea22d-8fa9-455d-90fe-4776b51b2f5a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:10.456897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-661ea22d-8fa9-455d-90fe-4776b51b2f5a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:10.481740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-661ea22d-8fa9-455d-90fe-4776b51b2f5a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:10.482365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-661ea22d-8fa9-455d-90fe-4776b51b2f5a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:10.483481 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-661ea22d-8fa9-455d-90fe-4776b51b2f5a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:10.483825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-661ea22d-8fa9-455d-90fe-4776b51b2f5a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:10.485713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-04fd8d89-d29d-49f2-b394-2a04be809313 req-cdbc158a-7054-498a-bfc8-366c363ac05e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:10.493380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-04fd8d89-d29d-49f2-b394-2a04be809313 req-cdbc158a-7054-498a-bfc8-366c363ac05e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:10.575900 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-04fd8d89-d29d-49f2-b394-2a04be809313 req-cdbc158a-7054-498a-bfc8-366c363ac05e service nova] Creating event network-vif-plugged:b98532fb-0692-4c80-9ec0-a5445175d125 for instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 on nch2-master-1 May 28 21:23:10.606661 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-04fd8d89-d29d-49f2-b394-2a04be809313 req-cdbc158a-7054-498a-bfc8-366c363ac05e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169929 May 28 21:23:10.616901 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2253/4437] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:23:11.542586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-661ea22d-8fa9-455d-90fe-4776b51b2f5a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:11.553273 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-661ea22d-8fa9-455d-90fe-4776b51b2f5a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1392 microversion: 2.1 time: 1.102146 May 28 21:23:11.559935 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2185/4438] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:10 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1392 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:12.579322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aef1a440-cb7d-474a-80ad-616b4fd7e441 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:12.581511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aef1a440-cb7d-474a-80ad-616b4fd7e441 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:12.595925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aef1a440-cb7d-474a-80ad-616b4fd7e441 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:12.596689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aef1a440-cb7d-474a-80ad-616b4fd7e441 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:12.597649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aef1a440-cb7d-474a-80ad-616b4fd7e441 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:12.598397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aef1a440-cb7d-474a-80ad-616b4fd7e441 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:13.024646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aef1a440-cb7d-474a-80ad-616b4fd7e441 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:13.075004 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aef1a440-cb7d-474a-80ad-616b4fd7e441 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1392 microversion: 2.1 time: 0.460815 May 28 21:23:13.075922 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2254/4439] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:12 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1392 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:13.467320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-3b7466b1-3cc8-413f-a71c-5b1016126f00 req-f6ccbf0b-9405-4e1f-84e6-b2ddfa0e7963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7a3bfa-2077-4b86-8670-bd2428861958", "name": "network-vif-plugged", "status": "completed", "tag": "31f937d0-8453-4ce1-8d41-4a95e908e103"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:13.482736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3b7466b1-3cc8-413f-a71c-5b1016126f00 req-f6ccbf0b-9405-4e1f-84e6-b2ddfa0e7963 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:13.486666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3b7466b1-3cc8-413f-a71c-5b1016126f00 req-f6ccbf0b-9405-4e1f-84e6-b2ddfa0e7963 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:13.517522 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-3b7466b1-3cc8-413f-a71c-5b1016126f00 req-f6ccbf0b-9405-4e1f-84e6-b2ddfa0e7963 service nova] Creating event network-vif-plugged:31f937d0-8453-4ce1-8d41-4a95e908e103 for instance 6a7a3bfa-2077-4b86-8670-bd2428861958 on nch1-master-1 May 28 21:23:13.523641 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-3b7466b1-3cc8-413f-a71c-5b1016126f00 req-f6ccbf0b-9405-4e1f-84e6-b2ddfa0e7963 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060901 May 28 21:23:13.527986 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2186/4440] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:23:14.107018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e44f5f13-4058-48cd-9d1a-015258b974f4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:14.108532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e44f5f13-4058-48cd-9d1a-015258b974f4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:14.120012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e44f5f13-4058-48cd-9d1a-015258b974f4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:14.120751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e44f5f13-4058-48cd-9d1a-015258b974f4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:14.125113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e44f5f13-4058-48cd-9d1a-015258b974f4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:14.125808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e44f5f13-4058-48cd-9d1a-015258b974f4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:14.689512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e44f5f13-4058-48cd-9d1a-015258b974f4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:14.702022 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e44f5f13-4058-48cd-9d1a-015258b974f4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1392 microversion: 2.1 time: 0.612846 May 28 21:23:14.703814 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2255/4441] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:14 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1392 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:15.728912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d9748cc2-af5f-4d1a-b760-4b8d209657ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:15.729762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d9748cc2-af5f-4d1a-b760-4b8d209657ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:15.737121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9748cc2-af5f-4d1a-b760-4b8d209657ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:15.737789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9748cc2-af5f-4d1a-b760-4b8d209657ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:15.738903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9748cc2-af5f-4d1a-b760-4b8d209657ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:15.739516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9748cc2-af5f-4d1a-b760-4b8d209657ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:15.951704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d9748cc2-af5f-4d1a-b760-4b8d209657ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:15.975319 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d9748cc2-af5f-4d1a-b760-4b8d209657ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1563 microversion: 2.1 time: 0.250409 May 28 21:23:15.976451 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2187/4442] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:15 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1563 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:16.000496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3e4c4d6a-6076-4bbd-9590-fc93cd93c257 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:16.001114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3e4c4d6a-6076-4bbd-9590-fc93cd93c257 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:16.028346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e4c4d6a-6076-4bbd-9590-fc93cd93c257 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:16.029548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e4c4d6a-6076-4bbd-9590-fc93cd93c257 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:16.030560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e4c4d6a-6076-4bbd-9590-fc93cd93c257 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:16.031162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e4c4d6a-6076-4bbd-9590-fc93cd93c257 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:16.454182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3e4c4d6a-6076-4bbd-9590-fc93cd93c257 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:16.462854 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3e4c4d6a-6076-4bbd-9590-fc93cd93c257 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1563 microversion: 2.1 time: 0.467133 May 28 21:23:16.466976 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2256/4443] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:15 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1563 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:23:18.400072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4f422b16-073e-465d-916c-7fc1b9602939 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1070328962", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": "none"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:18.536837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-4f422b16-073e-465d-916c-7fc1b9602939 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:23:18.536837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-4f422b16-073e-465d-916c-7fc1b9602939 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:23:18.536837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-4f422b16-073e-465d-916c-7fc1b9602939 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:23:18.536837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-4f422b16-073e-465d-916c-7fc1b9602939 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:23:18.536837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-4f422b16-073e-465d-916c-7fc1b9602939 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:23:18.558318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f422b16-073e-465d-916c-7fc1b9602939 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:18.558814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f422b16-073e-465d-916c-7fc1b9602939 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:18.559610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f422b16-073e-465d-916c-7fc1b9602939 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:18.567130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f422b16-073e-465d-916c-7fc1b9602939 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:18.599529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-4f422b16-073e-465d-916c-7fc1b9602939 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Getting quotas for project 4c998d22b841432b828345edcf54af63. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:23:18.626524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-4f422b16-073e-465d-916c-7fc1b9602939 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Getting quotas for user 8149349295714b1791af1b88fb565f74 and project 4c998d22b841432b828345edcf54af63. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:23:18.663968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4f422b16-073e-465d-916c-7fc1b9602939 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:23:18.674970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4f422b16-073e-465d-916c-7fc1b9602939 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: 1e9d76d1-5a49-4a29-8fde-d394b10d11d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:23:18.939424 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4f422b16-073e-465d-916c-7fc1b9602939 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.090129 May 28 21:23:18.946209 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2188/4444] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:23:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 21:23:18.959772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4657c920-01a4-4c60-9588-8328fac1fa13 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:18.961667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4657c920-01a4-4c60-9588-8328fac1fa13 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: 1e9d76d1-5a49-4a29-8fde-d394b10d11d2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:18.968461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:19.404544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4657c920-01a4-4c60-9588-8328fac1fa13 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:19.413104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4657c920-01a4-4c60-9588-8328fac1fa13 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:19.423939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4657c920-01a4-4c60-9588-8328fac1fa13 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:19.432593 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4657c920-01a4-4c60-9588-8328fac1fa13 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/1e9d76d1-5a49-4a29-8fde-d394b10d11d2" status: 200 len: 1278 microversion: 2.47 time: 0.478205 May 28 21:23:19.448031 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2257/4445] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:18 2022] GET /compute/v2.1/servers/1e9d76d1-5a49-4a29-8fde-d394b10d11d2 => generated 1278 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:23:19.866435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3ffeee55-7ef8-4ce9-8f7c-cd1118081e74 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1684261291", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": "none"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:20.004671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-3ffeee55-7ef8-4ce9-8f7c-cd1118081e74 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:23:20.005188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-3ffeee55-7ef8-4ce9-8f7c-cd1118081e74 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:23:20.011683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-3ffeee55-7ef8-4ce9-8f7c-cd1118081e74 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:23:20.011683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-3ffeee55-7ef8-4ce9-8f7c-cd1118081e74 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:23:20.011683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-3ffeee55-7ef8-4ce9-8f7c-cd1118081e74 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:23:20.042019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ffeee55-7ef8-4ce9-8f7c-cd1118081e74 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:20.043787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ffeee55-7ef8-4ce9-8f7c-cd1118081e74 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:20.053718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ffeee55-7ef8-4ce9-8f7c-cd1118081e74 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:20.056539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ffeee55-7ef8-4ce9-8f7c-cd1118081e74 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:20.131610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-3ffeee55-7ef8-4ce9-8f7c-cd1118081e74 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Getting quotas for project 4c998d22b841432b828345edcf54af63. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:23:20.147324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-3ffeee55-7ef8-4ce9-8f7c-cd1118081e74 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Getting quotas for user 8149349295714b1791af1b88fb565f74 and project 4c998d22b841432b828345edcf54af63. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:23:20.196342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3ffeee55-7ef8-4ce9-8f7c-cd1118081e74 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:23:20.202417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3ffeee55-7ef8-4ce9-8f7c-cd1118081e74 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:23:20.368332 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3ffeee55-7ef8-4ce9-8f7c-cd1118081e74 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.505313 May 28 21:23:20.372233 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2189/4446] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:23:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 21:23:20.381923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aae52cb2-c035-48e5-a76a-02d279990cdf tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:20.384318 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aae52cb2-c035-48e5-a76a-02d279990cdf tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:20.475734 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aae52cb2-c035-48e5-a76a-02d279990cdf tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "PUT /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 992 microversion: 2.47 time: 0.098087 May 28 21:23:20.477006 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2258/4447] 10.222.0.33 () {62 vars in 1296 bytes} [Sat May 28 21:23:20 2022] PUT /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 992 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 28 21:23:20.493072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-368326c1-94d3-488d-9777-5100f35badb9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:20.493775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-368326c1-94d3-488d-9777-5100f35badb9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:20.626942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-368326c1-94d3-488d-9777-5100f35badb9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:20.640615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-368326c1-94d3-488d-9777-5100f35badb9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:20.647708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-368326c1-94d3-488d-9777-5100f35badb9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:20.649208 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-368326c1-94d3-488d-9777-5100f35badb9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1278 microversion: 2.47 time: 0.161044 May 28 21:23:20.654948 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2190/4448] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:20 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:23:21.677633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c8349168-204b-466f-9f3f-da3922463836 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:21.682465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c8349168-204b-466f-9f3f-da3922463836 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:21.780980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c8349168-204b-466f-9f3f-da3922463836 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:21.806273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f0231c06-db64-4e2a-8818-547dd0e9906d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:21.807871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f0231c06-db64-4e2a-8818-547dd0e9906d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:21.816879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c8349168-204b-466f-9f3f-da3922463836 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:21.827389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c8349168-204b-466f-9f3f-da3922463836 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:21.829037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0231c06-db64-4e2a-8818-547dd0e9906d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:21.830038 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c8349168-204b-466f-9f3f-da3922463836 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1278 microversion: 2.47 time: 0.159020 May 28 21:23:21.831296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0231c06-db64-4e2a-8818-547dd0e9906d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:21.846372 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2259/4449] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:21 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:21.851281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0231c06-db64-4e2a-8818-547dd0e9906d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:21.856040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0231c06-db64-4e2a-8818-547dd0e9906d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:21.869142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-28945444-eacc-4e2f-99c3-cffa44cc8ad6 req-14b53968-6b70-4d8c-9a40-5cdc9fae4f6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a7a3bfa-2077-4b86-8670-bd2428861958", "tag": "31f937d0-8453-4ce1-8d41-4a95e908e103"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:21.872157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:21.900341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-28945444-eacc-4e2f-99c3-cffa44cc8ad6 req-14b53968-6b70-4d8c-9a40-5cdc9fae4f6d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:21.907541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-28945444-eacc-4e2f-99c3-cffa44cc8ad6 req-14b53968-6b70-4d8c-9a40-5cdc9fae4f6d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:21.959125 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-28945444-eacc-4e2f-99c3-cffa44cc8ad6 req-14b53968-6b70-4d8c-9a40-5cdc9fae4f6d service nova] Creating event network-changed:31f937d0-8453-4ce1-8d41-4a95e908e103 for instance 6a7a3bfa-2077-4b86-8670-bd2428861958 on nch1-master-1 May 28 21:23:21.972654 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-28945444-eacc-4e2f-99c3-cffa44cc8ad6 req-14b53968-6b70-4d8c-9a40-5cdc9fae4f6d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122952 May 28 21:23:21.974353 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2260/4450] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:23:22.854427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dd3d9691-24b8-4f0b-91b7-74e04f8b72ed tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:22.855144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dd3d9691-24b8-4f0b-91b7-74e04f8b72ed tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:22.885131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd3d9691-24b8-4f0b-91b7-74e04f8b72ed tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:22.885525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd3d9691-24b8-4f0b-91b7-74e04f8b72ed tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:22.899128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd3d9691-24b8-4f0b-91b7-74e04f8b72ed tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:22.900025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd3d9691-24b8-4f0b-91b7-74e04f8b72ed tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:22.968968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f0231c06-db64-4e2a-8818-547dd0e9906d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:22.980341 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f0231c06-db64-4e2a-8818-547dd0e9906d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1563 microversion: 2.1 time: 1.176857 May 28 21:23:22.981006 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2191/4451] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:21 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1563 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:23:23.170663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dd3d9691-24b8-4f0b-91b7-74e04f8b72ed tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:23.185641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dd3d9691-24b8-4f0b-91b7-74e04f8b72ed tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:23.200361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dd3d9691-24b8-4f0b-91b7-74e04f8b72ed tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:23.202083 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dd3d9691-24b8-4f0b-91b7-74e04f8b72ed tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1330 microversion: 2.47 time: 0.350877 May 28 21:23:23.218224 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2261/4452] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:22 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1330 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:23:24.229904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-191d5b8d-7561-40ba-89fd-0f59724ee154 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:24.231064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-191d5b8d-7561-40ba-89fd-0f59724ee154 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:24.261333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-191d5b8d-7561-40ba-89fd-0f59724ee154 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:24.261449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-191d5b8d-7561-40ba-89fd-0f59724ee154 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:24.262278 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-191d5b8d-7561-40ba-89fd-0f59724ee154 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:24.263272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-191d5b8d-7561-40ba-89fd-0f59724ee154 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:24.397576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-191d5b8d-7561-40ba-89fd-0f59724ee154 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:24.410595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-191d5b8d-7561-40ba-89fd-0f59724ee154 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:24.413351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-191d5b8d-7561-40ba-89fd-0f59724ee154 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:24.415210 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-191d5b8d-7561-40ba-89fd-0f59724ee154 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1338 microversion: 2.47 time: 0.191979 May 28 21:23:24.416360 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2192/4453] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:24 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1338 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:25.439358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8546bbf1-b62d-4dc5-bf4f-91b684b99519 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:25.439990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8546bbf1-b62d-4dc5-bf4f-91b684b99519 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:25.440405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-434684966", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "3e6c7b29-e14f-42e1-b305-704db918321d"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:25.464900 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8546bbf1-b62d-4dc5-bf4f-91b684b99519 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:25.467910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8546bbf1-b62d-4dc5-bf4f-91b684b99519 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:25.468929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8546bbf1-b62d-4dc5-bf4f-91b684b99519 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:25.470349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8546bbf1-b62d-4dc5-bf4f-91b684b99519 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:25.579399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] validate_networks() for [('3e6c7b29-e14f-42e1-b305-704db918321d', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:23:25.623500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8546bbf1-b62d-4dc5-bf4f-91b684b99519 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:25.633434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8546bbf1-b62d-4dc5-bf4f-91b684b99519 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:25.653885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8546bbf1-b62d-4dc5-bf4f-91b684b99519 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:25.656266 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8546bbf1-b62d-4dc5-bf4f-91b684b99519 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1336 microversion: 2.47 time: 0.226298 May 28 21:23:25.657407 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2193/4454] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:25 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1336 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:23:26.303314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:23:26.303314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:23:26.303314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:23:26.303314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:23:26.303314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:23:26.303314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:26.303314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:26.303314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:26.303314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:26.327472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Getting quotas for project d3112549c42f41cda4a54ec51c131023. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:23:26.335323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Getting quotas for user f7c1a400e0dd462da3bb33b7e3fe57fc and project d3112549c42f41cda4a54ec51c131023. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:23:26.349029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Going to run 2 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:23:26.351665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 0000af21-fb59-4c9d-b417-340c0bddcd3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:23:26.677027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f5d8842f-ae76-4638-b03f-11a87ce01f77 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:26.677658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f5d8842f-ae76-4638-b03f-11a87ce01f77 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:26.689402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5d8842f-ae76-4638-b03f-11a87ce01f77 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:26.689934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5d8842f-ae76-4638-b03f-11a87ce01f77 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:26.695288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5d8842f-ae76-4638-b03f-11a87ce01f77 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:26.695288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5d8842f-ae76-4638-b03f-11a87ce01f77 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:26.763175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=0000af21-fb59-4c9d-b417-340c0bddcd3e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:23:26.806567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f5d8842f-ae76-4638-b03f-11a87ce01f77 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:26.825729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f5d8842f-ae76-4638-b03f-11a87ce01f77 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:26.828699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f5d8842f-ae76-4638-b03f-11a87ce01f77 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:26.832185 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f5d8842f-ae76-4638-b03f-11a87ce01f77 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1336 microversion: 2.47 time: 0.158956 May 28 21:23:26.834700 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2194/4455] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:26 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1336 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:23:27.035991 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-df0be0c3-9e46-444f-8d72-c330d635edea tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.905135 May 28 21:23:27.036668 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2262/4456] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:23:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:23:27.049755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9c10e7e8-e766-4a57-9209-1cd8fbe846eb tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:27.055212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9c10e7e8-e766-4a57-9209-1cd8fbe846eb tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:27.058068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9c10e7e8-e766-4a57-9209-1cd8fbe846eb tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Searching by: {'deleted': False, 'project_id': 'd3112549c42f41cda4a54ec51c131023'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:23:27.131616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c10e7e8-e766-4a57-9209-1cd8fbe846eb tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:27.132572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c10e7e8-e766-4a57-9209-1cd8fbe846eb tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:27.138647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c10e7e8-e766-4a57-9209-1cd8fbe846eb tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:27.140610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c10e7e8-e766-4a57-9209-1cd8fbe846eb tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:27.190400 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9c10e7e8-e766-4a57-9209-1cd8fbe846eb tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.147393 May 28 21:23:27.192132 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2195/4457] 10.222.0.33 () {58 vars in 1124 bytes} [Sat May 28 21:23:27 2022] GET /compute/v2.1/servers => generated 675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:23:27.203557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e681a331-9fc0-40d3-b82c-ae1e43b98b45 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:27.204190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e681a331-9fc0-40d3-b82c-ae1e43b98b45 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:27.326624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e681a331-9fc0-40d3-b82c-ae1e43b98b45 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:27.336036 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e681a331-9fc0-40d3-b82c-ae1e43b98b45 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75" status: 200 len: 1219 microversion: 2.1 time: 0.137148 May 28 21:23:27.337531 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2263/4458] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:27 2022] GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75 => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:27.865068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-89d76ec8-2e6f-4cd7-a97d-658f1b32f182 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:27.866744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-89d76ec8-2e6f-4cd7-a97d-658f1b32f182 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:27.889472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89d76ec8-2e6f-4cd7-a97d-658f1b32f182 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:27.891237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89d76ec8-2e6f-4cd7-a97d-658f1b32f182 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:27.896837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89d76ec8-2e6f-4cd7-a97d-658f1b32f182 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:27.896837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89d76ec8-2e6f-4cd7-a97d-658f1b32f182 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:28.035688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89d76ec8-2e6f-4cd7-a97d-658f1b32f182 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:28.048674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89d76ec8-2e6f-4cd7-a97d-658f1b32f182 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:28.061376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89d76ec8-2e6f-4cd7-a97d-658f1b32f182 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:28.064098 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-89d76ec8-2e6f-4cd7-a97d-658f1b32f182 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1357 microversion: 2.47 time: 0.214294 May 28 21:23:28.065556 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2196/4459] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:27 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:28.085654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:28.087127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:28.108821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:28.110288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:28.113980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:28.115408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:28.264254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:23:28.265076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:23:28.265737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:23:28.266354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:23:28.266969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:23:28.361282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84b2cf8e-cefe-406f-a561-e11999ab2fc1 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:28.361282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-84b2cf8e-cefe-406f-a561-e11999ab2fc1 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:28.450997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-84b2cf8e-cefe-406f-a561-e11999ab2fc1 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:28.484311 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-84b2cf8e-cefe-406f-a561-e11999ab2fc1 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75" status: 200 len: 1219 microversion: 2.1 time: 0.132949 May 28 21:23:28.491405 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2197/4460] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:28 2022] GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75 => generated 1219 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:23:28.667599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:28.686012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:28.687243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:28.689659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:28.692027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:28.780338 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-44f25976-1a4c-43d7-b1ee-4fda78b2b6df tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "POST /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa/action" status: 202 len: 1079 microversion: 2.47 time: 0.700190 May 28 21:23:28.798802 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2264/4461] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:23:28 2022] POST /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa/action => generated 1079 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 28 21:23:28.805066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-25fe74a4-5905-4a96-bd1a-58c1efdb8d39 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:28.806039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-25fe74a4-5905-4a96-bd1a-58c1efdb8d39 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:28.828005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25fe74a4-5905-4a96-bd1a-58c1efdb8d39 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:28.829012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25fe74a4-5905-4a96-bd1a-58c1efdb8d39 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:28.829304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25fe74a4-5905-4a96-bd1a-58c1efdb8d39 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:28.830469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25fe74a4-5905-4a96-bd1a-58c1efdb8d39 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:29.169897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-25fe74a4-5905-4a96-bd1a-58c1efdb8d39 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:29.180719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-25fe74a4-5905-4a96-bd1a-58c1efdb8d39 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:29.184051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-25fe74a4-5905-4a96-bd1a-58c1efdb8d39 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:29.185784 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-25fe74a4-5905-4a96-bd1a-58c1efdb8d39 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.385508 May 28 21:23:29.186604 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2198/4462] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:28 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:29.502702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b7eb5277-1595-4ee8-8cae-a9a0809560fa tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:29.503271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b7eb5277-1595-4ee8-8cae-a9a0809560fa tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:29.644493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b7eb5277-1595-4ee8-8cae-a9a0809560fa tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:29.662197 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b7eb5277-1595-4ee8-8cae-a9a0809560fa tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75" status: 200 len: 1219 microversion: 2.1 time: 0.157445 May 28 21:23:29.663467 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2265/4463] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:29 2022] GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75 => generated 1219 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:30.205310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1c1ff28c-c6a9-49fe-8ecb-0289ac9dd5b9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:30.206016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1c1ff28c-c6a9-49fe-8ecb-0289ac9dd5b9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:30.215981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c1ff28c-c6a9-49fe-8ecb-0289ac9dd5b9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:30.216436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c1ff28c-c6a9-49fe-8ecb-0289ac9dd5b9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:30.217228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c1ff28c-c6a9-49fe-8ecb-0289ac9dd5b9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:30.225892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c1ff28c-c6a9-49fe-8ecb-0289ac9dd5b9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:30.681823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c0d09460-1026-49f6-849a-afed17b0f2de tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:30.683791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c0d09460-1026-49f6-849a-afed17b0f2de tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:30.713670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0d09460-1026-49f6-849a-afed17b0f2de tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:30.714166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0d09460-1026-49f6-849a-afed17b0f2de tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:30.715536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0d09460-1026-49f6-849a-afed17b0f2de tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:30.716001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0d09460-1026-49f6-849a-afed17b0f2de tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:31.010716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c0d09460-1026-49f6-849a-afed17b0f2de tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:31.025487 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c0d09460-1026-49f6-849a-afed17b0f2de tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75" status: 200 len: 1215 microversion: 2.1 time: 0.344111 May 28 21:23:31.025487 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2266/4464] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:30 2022] GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75 => generated 1215 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:31.064237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1c1ff28c-c6a9-49fe-8ecb-0289ac9dd5b9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:31.083514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1c1ff28c-c6a9-49fe-8ecb-0289ac9dd5b9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:31.092788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1c1ff28c-c6a9-49fe-8ecb-0289ac9dd5b9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:31.102558 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1c1ff28c-c6a9-49fe-8ecb-0289ac9dd5b9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.897443 May 28 21:23:31.103608 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2199/4465] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:30 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:32.038770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-77159e3f-874c-440a-ae31-d07330b204f7 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:32.039479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-77159e3f-874c-440a-ae31-d07330b204f7 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:32.048269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77159e3f-874c-440a-ae31-d07330b204f7 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:32.048740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77159e3f-874c-440a-ae31-d07330b204f7 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:32.049659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77159e3f-874c-440a-ae31-d07330b204f7 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:32.050107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77159e3f-874c-440a-ae31-d07330b204f7 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:32.122645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-77159e3f-874c-440a-ae31-d07330b204f7 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:32.124606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-77b7d1ee-6c09-4c34-8f11-23df0eaa7656 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:32.125256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-77b7d1ee-6c09-4c34-8f11-23df0eaa7656 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:32.132450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77b7d1ee-6c09-4c34-8f11-23df0eaa7656 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:32.132766 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-77159e3f-874c-440a-ae31-d07330b204f7 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75" status: 200 len: 1271 microversion: 2.1 time: 0.098420 May 28 21:23:32.132946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77b7d1ee-6c09-4c34-8f11-23df0eaa7656 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:32.133432 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2267/4466] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:32 2022] GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:32.133698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77b7d1ee-6c09-4c34-8f11-23df0eaa7656 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:32.134174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77b7d1ee-6c09-4c34-8f11-23df0eaa7656 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:32.262570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-77b7d1ee-6c09-4c34-8f11-23df0eaa7656 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:32.262570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-77b7d1ee-6c09-4c34-8f11-23df0eaa7656 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:32.262570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-77b7d1ee-6c09-4c34-8f11-23df0eaa7656 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:32.262570 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-77b7d1ee-6c09-4c34-8f11-23df0eaa7656 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.095037 May 28 21:23:32.262570 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2200/4467] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:32 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:23:33.153507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3d21beb0-ecd5-4e41-862f-4ac5b49fc828 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:33.154491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3d21beb0-ecd5-4e41-862f-4ac5b49fc828 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:33.161929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d21beb0-ecd5-4e41-862f-4ac5b49fc828 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:33.162387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d21beb0-ecd5-4e41-862f-4ac5b49fc828 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:33.163165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d21beb0-ecd5-4e41-862f-4ac5b49fc828 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:33.163601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d21beb0-ecd5-4e41-862f-4ac5b49fc828 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:33.268220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3d21beb0-ecd5-4e41-862f-4ac5b49fc828 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:33.283086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-629cbdce-6471-4b55-a5e9-34683734bc06 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:33.284860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-629cbdce-6471-4b55-a5e9-34683734bc06 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:33.289283 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3d21beb0-ecd5-4e41-862f-4ac5b49fc828 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75" status: 200 len: 1277 microversion: 2.1 time: 0.137949 May 28 21:23:33.301394 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2268/4468] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:33 2022] GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75 => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:33.302247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-629cbdce-6471-4b55-a5e9-34683734bc06 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:33.302716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-629cbdce-6471-4b55-a5e9-34683734bc06 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:33.303749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-629cbdce-6471-4b55-a5e9-34683734bc06 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:33.304408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-629cbdce-6471-4b55-a5e9-34683734bc06 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:33.476965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-629cbdce-6471-4b55-a5e9-34683734bc06 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:33.486065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-629cbdce-6471-4b55-a5e9-34683734bc06 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:33.488479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-629cbdce-6471-4b55-a5e9-34683734bc06 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:33.490249 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-629cbdce-6471-4b55-a5e9-34683734bc06 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.214516 May 28 21:23:33.505615 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2201/4469] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:33 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:34.310016 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-29a27911-ec83-4fb5-87bf-b3dcb505c28f tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:34.310823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-29a27911-ec83-4fb5-87bf-b3dcb505c28f tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:34.318600 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29a27911-ec83-4fb5-87bf-b3dcb505c28f tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:34.319320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29a27911-ec83-4fb5-87bf-b3dcb505c28f tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:34.320219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29a27911-ec83-4fb5-87bf-b3dcb505c28f tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:34.320786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29a27911-ec83-4fb5-87bf-b3dcb505c28f tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:34.509106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1c442e6d-1936-4cb8-bd22-4dc0a1df4082 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:34.510714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1c442e6d-1936-4cb8-bd22-4dc0a1df4082 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:34.529714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c442e6d-1936-4cb8-bd22-4dc0a1df4082 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:34.530614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c442e6d-1936-4cb8-bd22-4dc0a1df4082 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:34.531717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c442e6d-1936-4cb8-bd22-4dc0a1df4082 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:34.532324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c442e6d-1936-4cb8-bd22-4dc0a1df4082 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:34.769244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-29a27911-ec83-4fb5-87bf-b3dcb505c28f tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:34.781880 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-29a27911-ec83-4fb5-87bf-b3dcb505c28f tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75" status: 200 len: 1319 microversion: 2.1 time: 0.476557 May 28 21:23:34.794474 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2269/4470] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:34 2022] GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75 => generated 1319 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:34.799758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-059ff8a3-f0d4-483a-b339-6beb19d89753 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:34.802097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-059ff8a3-f0d4-483a-b339-6beb19d89753 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:34.811939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-059ff8a3-f0d4-483a-b339-6beb19d89753 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:34.812981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-059ff8a3-f0d4-483a-b339-6beb19d89753 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:34.814105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-059ff8a3-f0d4-483a-b339-6beb19d89753 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:34.814777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-059ff8a3-f0d4-483a-b339-6beb19d89753 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:34.936057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1c442e6d-1936-4cb8-bd22-4dc0a1df4082 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:34.948553 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1c442e6d-1936-4cb8-bd22-4dc0a1df4082 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.443756 May 28 21:23:34.954751 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2202/4471] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:34 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:34.967528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e9aabe9e-0e3e-47f7-8e56-379c9a2fbf72 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-407258132"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:34.968690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e9aabe9e-0e3e-47f7-8e56-379c9a2fbf72 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:34.973465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:34.984143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9aabe9e-0e3e-47f7-8e56-379c9a2fbf72 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:34.984612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9aabe9e-0e3e-47f7-8e56-379c9a2fbf72 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:34.985415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9aabe9e-0e3e-47f7-8e56-379c9a2fbf72 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:34.989696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9aabe9e-0e3e-47f7-8e56-379c9a2fbf72 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:35.067702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-059ff8a3-f0d4-483a-b339-6beb19d89753 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:35.076751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-059ff8a3-f0d4-483a-b339-6beb19d89753 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:35.078325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-059ff8a3-f0d4-483a-b339-6beb19d89753 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:35.095417 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-059ff8a3-f0d4-483a-b339-6beb19d89753 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.299404 May 28 21:23:35.096019 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2270/4472] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:34 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:35.799942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d0416e9a-3449-4be3-831f-c2a9b3675033 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:35.800623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d0416e9a-3449-4be3-831f-c2a9b3675033 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:35.808261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d0416e9a-3449-4be3-831f-c2a9b3675033 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:35.809241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d0416e9a-3449-4be3-831f-c2a9b3675033 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:35.810090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d0416e9a-3449-4be3-831f-c2a9b3675033 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:35.810724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d0416e9a-3449-4be3-831f-c2a9b3675033 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:35.874682 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e9aabe9e-0e3e-47f7-8e56-379c9a2fbf72 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.912305 May 28 21:23:35.879721 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2203/4473] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:23:34 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 914 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) May 28 21:23:36.120105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-99c1942b-fd2c-40f7-a1cb-0252ab67ac6a tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:36.121152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-99c1942b-fd2c-40f7-a1cb-0252ab67ac6a tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:36.136462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99c1942b-fd2c-40f7-a1cb-0252ab67ac6a tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:36.137543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99c1942b-fd2c-40f7-a1cb-0252ab67ac6a tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:36.138586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99c1942b-fd2c-40f7-a1cb-0252ab67ac6a tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:36.139055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99c1942b-fd2c-40f7-a1cb-0252ab67ac6a tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:36.299738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-99c1942b-fd2c-40f7-a1cb-0252ab67ac6a tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:36.314629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-99c1942b-fd2c-40f7-a1cb-0252ab67ac6a tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:36.317229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:36.319992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-99c1942b-fd2c-40f7-a1cb-0252ab67ac6a tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:36.325999 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-99c1942b-fd2c-40f7-a1cb-0252ab67ac6a tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.209970 May 28 21:23:36.325999 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2204/4474] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:36 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:23:36.378903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d0416e9a-3449-4be3-831f-c2a9b3675033 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:36.405698 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d0416e9a-3449-4be3-831f-c2a9b3675033 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75" status: 200 len: 1319 microversion: 2.1 time: 0.594621 May 28 21:23:36.405698 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2271/4475] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:35 2022] GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75 => generated 1319 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:36.694664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-74bb2ad1-890a-4857-829b-c76f8f97653c req-779b8432-33cc-46bd-8805-4fce11d430aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0000af21-fb59-4c9d-b417-340c0bddcd3e", "tag": "930f15ed-415b-4c08-ba61-70dcca02cf78"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:36.713457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-74bb2ad1-890a-4857-829b-c76f8f97653c req-779b8432-33cc-46bd-8805-4fce11d430aa service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:36.715236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-74bb2ad1-890a-4857-829b-c76f8f97653c req-779b8432-33cc-46bd-8805-4fce11d430aa service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:36.728170 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-74bb2ad1-890a-4857-829b-c76f8f97653c req-779b8432-33cc-46bd-8805-4fce11d430aa service nova] Creating event network-changed:930f15ed-415b-4c08-ba61-70dcca02cf78 for instance 0000af21-fb59-4c9d-b417-340c0bddcd3e on nch1-master-1 May 28 21:23:36.734772 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-74bb2ad1-890a-4857-829b-c76f8f97653c req-779b8432-33cc-46bd-8805-4fce11d430aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044502 May 28 21:23:36.735965 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2205/4476] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:23:37.386137 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-adc50e66-34fa-4ed9-a076-23de0fb25c73 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:37.387474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-adc50e66-34fa-4ed9-a076-23de0fb25c73 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:37.410782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e81d0940-23f7-4d31-97b0-6fc7061f86f4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:37.412175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e81d0940-23f7-4d31-97b0-6fc7061f86f4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:37.416348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:37.423257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e81d0940-23f7-4d31-97b0-6fc7061f86f4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:37.423892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e81d0940-23f7-4d31-97b0-6fc7061f86f4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:37.425666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e81d0940-23f7-4d31-97b0-6fc7061f86f4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:37.426418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e81d0940-23f7-4d31-97b0-6fc7061f86f4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:37.440364 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-adc50e66-34fa-4ed9-a076-23de0fb25c73 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:37.441220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-adc50e66-34fa-4ed9-a076-23de0fb25c73 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:37.447941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-adc50e66-34fa-4ed9-a076-23de0fb25c73 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:37.448943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-adc50e66-34fa-4ed9-a076-23de0fb25c73 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:37.669524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-adc50e66-34fa-4ed9-a076-23de0fb25c73 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:37.679358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-adc50e66-34fa-4ed9-a076-23de0fb25c73 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:37.681701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-adc50e66-34fa-4ed9-a076-23de0fb25c73 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:37.682979 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-adc50e66-34fa-4ed9-a076-23de0fb25c73 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.343301 May 28 21:23:37.684079 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2272/4477] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:37 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:37.761410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-9270915a-6a21-45b1-bcf9-62840865c1c8 req-8b60e107-096a-4fea-8313-3975c6ec1990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226cec1f-9523-4d1f-95cf-e2d994bd1f88", "name": "network-vif-unplugged", "status": "completed", "tag": "b98532fb-0692-4c80-9ec0-a5445175d125"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:37.791157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9270915a-6a21-45b1-bcf9-62840865c1c8 req-8b60e107-096a-4fea-8313-3975c6ec1990 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:37.791635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9270915a-6a21-45b1-bcf9-62840865c1c8 req-8b60e107-096a-4fea-8313-3975c6ec1990 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:37.828274 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-9270915a-6a21-45b1-bcf9-62840865c1c8 req-8b60e107-096a-4fea-8313-3975c6ec1990 service nova] Creating event network-vif-unplugged:b98532fb-0692-4c80-9ec0-a5445175d125 for instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 on nch2-master-1 May 28 21:23:37.843150 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-9270915a-6a21-45b1-bcf9-62840865c1c8 req-8b60e107-096a-4fea-8313-3975c6ec1990 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085705 May 28 21:23:37.845660 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2273/4478] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:23:37.918021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e81d0940-23f7-4d31-97b0-6fc7061f86f4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:37.935330 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e81d0940-23f7-4d31-97b0-6fc7061f86f4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75" status: 200 len: 1319 microversion: 2.1 time: 0.531872 May 28 21:23:37.936251 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2206/4479] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:37 2022] GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75 => generated 1319 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:38.703247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-81032231-5fc4-4e40-82e3-e73d8635aa62 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:38.704542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-81032231-5fc4-4e40-82e3-e73d8635aa62 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:38.712629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81032231-5fc4-4e40-82e3-e73d8635aa62 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:38.713250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81032231-5fc4-4e40-82e3-e73d8635aa62 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:38.714261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81032231-5fc4-4e40-82e3-e73d8635aa62 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:38.715249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81032231-5fc4-4e40-82e3-e73d8635aa62 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:38.755049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-90327696-e475-4563-aa29-cefc3773e5c2 req-76e7b2e7-be7c-4f38-a605-ae9ce5f9e188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1415e0fb-001d-4d01-b96b-fb4bd8608d75", "tag": "87287c5e-4b2f-4f7b-8e61-4e5f14780d27"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:38.763057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=16 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:38.770448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-90327696-e475-4563-aa29-cefc3773e5c2 req-76e7b2e7-be7c-4f38-a605-ae9ce5f9e188 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:38.771131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-90327696-e475-4563-aa29-cefc3773e5c2 req-76e7b2e7-be7c-4f38-a605-ae9ce5f9e188 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:38.789934 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-90327696-e475-4563-aa29-cefc3773e5c2 req-76e7b2e7-be7c-4f38-a605-ae9ce5f9e188 service nova] Creating event network-changed:87287c5e-4b2f-4f7b-8e61-4e5f14780d27 for instance 1415e0fb-001d-4d01-b96b-fb4bd8608d75 on nch2-master-1 May 28 21:23:38.795991 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-90327696-e475-4563-aa29-cefc3773e5c2 req-76e7b2e7-be7c-4f38-a605-ae9ce5f9e188 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045701 May 28 21:23:38.796676 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2207/4480] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:23:38.797001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-81032231-5fc4-4e40-82e3-e73d8635aa62 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:38.804950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:38.806670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-81032231-5fc4-4e40-82e3-e73d8635aa62 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:38.808361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-81032231-5fc4-4e40-82e3-e73d8635aa62 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:38.809560 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-81032231-5fc4-4e40-82e3-e73d8635aa62 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.111491 May 28 21:23:38.820991 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2274/4481] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:38 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:38.953104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-82750ecc-4fc9-47a7-bddc-b7699e842f3c tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:38.954303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-82750ecc-4fc9-47a7-bddc-b7699e842f3c tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:38.962864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82750ecc-4fc9-47a7-bddc-b7699e842f3c tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:38.963616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82750ecc-4fc9-47a7-bddc-b7699e842f3c tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:38.965792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82750ecc-4fc9-47a7-bddc-b7699e842f3c tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:38.967993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82750ecc-4fc9-47a7-bddc-b7699e842f3c tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:39.136048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-82750ecc-4fc9-47a7-bddc-b7699e842f3c tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:39.146706 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-82750ecc-4fc9-47a7-bddc-b7699e842f3c tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75" status: 200 len: 1319 microversion: 2.1 time: 0.198329 May 28 21:23:39.161174 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2208/4482] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:38 2022] GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:39.830277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc8af026-e12a-4903-92e8-5791231ac7f8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:39.831523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc8af026-e12a-4903-92e8-5791231ac7f8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:39.840781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=14 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:39.843836 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc8af026-e12a-4903-92e8-5791231ac7f8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:39.844551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc8af026-e12a-4903-92e8-5791231ac7f8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:39.845520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc8af026-e12a-4903-92e8-5791231ac7f8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:39.846843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc8af026-e12a-4903-92e8-5791231ac7f8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:39.945429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc8af026-e12a-4903-92e8-5791231ac7f8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:39.960239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc8af026-e12a-4903-92e8-5791231ac7f8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:39.961775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-fc4931ae-8e17-405e-8e87-f258d136875a req-7de0c3bf-7dad-487b-b5b2-feb7b3d39971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226cec1f-9523-4d1f-95cf-e2d994bd1f88", "name": "network-vif-plugged", "status": "completed", "tag": "b98532fb-0692-4c80-9ec0-a5445175d125"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:39.962992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc8af026-e12a-4903-92e8-5791231ac7f8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:39.965224 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc8af026-e12a-4903-92e8-5791231ac7f8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.138419 May 28 21:23:39.966026 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2275/4483] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:39 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:39.997516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-fc4931ae-8e17-405e-8e87-f258d136875a req-7de0c3bf-7dad-487b-b5b2-feb7b3d39971 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:39.997516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-fc4931ae-8e17-405e-8e87-f258d136875a req-7de0c3bf-7dad-487b-b5b2-feb7b3d39971 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:40.010055 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-fc4931ae-8e17-405e-8e87-f258d136875a req-7de0c3bf-7dad-487b-b5b2-feb7b3d39971 service nova] Creating event network-vif-plugged:b98532fb-0692-4c80-9ec0-a5445175d125 for instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 on nch2-master-1 May 28 21:23:40.015214 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-fc4931ae-8e17-405e-8e87-f258d136875a req-7de0c3bf-7dad-487b-b5b2-feb7b3d39971 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058375 May 28 21:23:40.016367 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2209/4484] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:23:40.182032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-af91d37c-9948-4060-8f6a-8cba8c8383e8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:40.184337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-af91d37c-9948-4060-8f6a-8cba8c8383e8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:40.210658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af91d37c-9948-4060-8f6a-8cba8c8383e8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:40.210658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af91d37c-9948-4060-8f6a-8cba8c8383e8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:40.210658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af91d37c-9948-4060-8f6a-8cba8c8383e8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:40.210658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af91d37c-9948-4060-8f6a-8cba8c8383e8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:40.553339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-af91d37c-9948-4060-8f6a-8cba8c8383e8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:40.570036 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-af91d37c-9948-4060-8f6a-8cba8c8383e8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75" status: 200 len: 1319 microversion: 2.1 time: 0.400234 May 28 21:23:40.570789 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2276/4485] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:40 2022] GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75 => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:40.988770 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1d2c5bd9-7eba-47fa-bd1e-0a2d34b50074 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:40.989684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1d2c5bd9-7eba-47fa-bd1e-0a2d34b50074 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:41.005734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d2c5bd9-7eba-47fa-bd1e-0a2d34b50074 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:41.006343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d2c5bd9-7eba-47fa-bd1e-0a2d34b50074 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:41.007019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d2c5bd9-7eba-47fa-bd1e-0a2d34b50074 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:41.014523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d2c5bd9-7eba-47fa-bd1e-0a2d34b50074 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:41.020295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:41.255094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1d2c5bd9-7eba-47fa-bd1e-0a2d34b50074 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:41.265143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1d2c5bd9-7eba-47fa-bd1e-0a2d34b50074 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:41.278600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1d2c5bd9-7eba-47fa-bd1e-0a2d34b50074 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:41.279923 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1d2c5bd9-7eba-47fa-bd1e-0a2d34b50074 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.298079 May 28 21:23:41.280521 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2210/4486] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:40 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:41.596632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7090a922-4a48-4e20-b18a-2d639aa2fad8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:41.599979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7090a922-4a48-4e20-b18a-2d639aa2fad8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:41.607550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-add26d58-4a4c-43d8-bb5b-1811dbcdf40c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:41.608734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-add26d58-4a4c-43d8-bb5b-1811dbcdf40c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:41.615962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-add26d58-4a4c-43d8-bb5b-1811dbcdf40c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:41.621980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-add26d58-4a4c-43d8-bb5b-1811dbcdf40c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:41.621980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-add26d58-4a4c-43d8-bb5b-1811dbcdf40c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:41.621980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-add26d58-4a4c-43d8-bb5b-1811dbcdf40c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:41.629347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7090a922-4a48-4e20-b18a-2d639aa2fad8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:41.629812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7090a922-4a48-4e20-b18a-2d639aa2fad8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:41.630645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7090a922-4a48-4e20-b18a-2d639aa2fad8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:41.631095 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7090a922-4a48-4e20-b18a-2d639aa2fad8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:41.679138 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-add26d58-4a4c-43d8-bb5b-1811dbcdf40c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958/action" status: 200 len: 24573 microversion: 2.1 time: 0.073075 May 28 21:23:41.690170 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2211/4487] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:23:41 2022] POST /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958/action => generated 24573 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:23:41.697605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3f1c6e30-2ec6-4f30-bb46-3794a3c51e32 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:41.698238 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3f1c6e30-2ec6-4f30-bb46-3794a3c51e32 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:41.724740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f1c6e30-2ec6-4f30-bb46-3794a3c51e32 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:41.725219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f1c6e30-2ec6-4f30-bb46-3794a3c51e32 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:41.726044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f1c6e30-2ec6-4f30-bb46-3794a3c51e32 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:41.726491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f1c6e30-2ec6-4f30-bb46-3794a3c51e32 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:41.770754 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3f1c6e30-2ec6-4f30-bb46-3794a3c51e32 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b/ips" status: 200 len: 151 microversion: 2.20 time: 0.078797 May 28 21:23:41.771592 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2212/4488] 10.222.0.33 () {60 vars in 1288 bytes} [Sat May 28 21:23:41 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b/ips => generated 151 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:23:41.958398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7090a922-4a48-4e20-b18a-2d639aa2fad8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:41.977727 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7090a922-4a48-4e20-b18a-2d639aa2fad8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75" status: 200 len: 1319 microversion: 2.1 time: 0.385856 May 28 21:23:41.985086 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2277/4489] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:41 2022] GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75 => generated 1319 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:42.086133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-20955cf2-8c83-42d7-8609-9ff2d8065acc req-7b506ba9-cade-4d17-9415-582d33713772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1415e0fb-001d-4d01-b96b-fb4bd8608d75", "name": "network-vif-plugged", "status": "completed", "tag": "87287c5e-4b2f-4f7b-8e61-4e5f14780d27"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:42.102820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-20955cf2-8c83-42d7-8609-9ff2d8065acc req-7b506ba9-cade-4d17-9415-582d33713772 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:42.103755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-20955cf2-8c83-42d7-8609-9ff2d8065acc req-7b506ba9-cade-4d17-9415-582d33713772 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:42.117636 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-20955cf2-8c83-42d7-8609-9ff2d8065acc req-7b506ba9-cade-4d17-9415-582d33713772 service nova] Creating event network-vif-plugged:87287c5e-4b2f-4f7b-8e61-4e5f14780d27 for instance 1415e0fb-001d-4d01-b96b-fb4bd8608d75 on nch2-master-1 May 28 21:23:42.124150 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-20955cf2-8c83-42d7-8609-9ff2d8065acc req-7b506ba9-cade-4d17-9415-582d33713772 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044833 May 28 21:23:42.124999 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2213/4490] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:23:42.300579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6661475d-b6c1-4b07-a53f-ffc00284d36d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:42.303200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6661475d-b6c1-4b07-a53f-ffc00284d36d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:42.327560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6661475d-b6c1-4b07-a53f-ffc00284d36d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:42.331968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6661475d-b6c1-4b07-a53f-ffc00284d36d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:42.338794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6661475d-b6c1-4b07-a53f-ffc00284d36d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:42.344912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6661475d-b6c1-4b07-a53f-ffc00284d36d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:42.627190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6661475d-b6c1-4b07-a53f-ffc00284d36d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:42.637368 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6661475d-b6c1-4b07-a53f-ffc00284d36d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:42.647750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6661475d-b6c1-4b07-a53f-ffc00284d36d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:42.655120 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6661475d-b6c1-4b07-a53f-ffc00284d36d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.360404 May 28 21:23:42.661337 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2278/4491] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:42 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:43.003104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-df40a3b3-8ab7-4dec-9a80-7770f1dedea4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:43.004202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-df40a3b3-8ab7-4dec-9a80-7770f1dedea4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:43.018673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df40a3b3-8ab7-4dec-9a80-7770f1dedea4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:43.021422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df40a3b3-8ab7-4dec-9a80-7770f1dedea4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:43.028298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df40a3b3-8ab7-4dec-9a80-7770f1dedea4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:43.029181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df40a3b3-8ab7-4dec-9a80-7770f1dedea4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:43.370912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-df40a3b3-8ab7-4dec-9a80-7770f1dedea4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:43.393621 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-df40a3b3-8ab7-4dec-9a80-7770f1dedea4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75" status: 200 len: 1319 microversion: 2.1 time: 0.396331 May 28 21:23:43.396094 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2214/4492] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:42 2022] GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75 => generated 1319 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:43.672559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dbb035cc-7e36-4b7e-b4e5-4e36a742c751 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:43.673180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dbb035cc-7e36-4b7e-b4e5-4e36a742c751 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:43.682795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbb035cc-7e36-4b7e-b4e5-4e36a742c751 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:43.683801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbb035cc-7e36-4b7e-b4e5-4e36a742c751 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:43.684591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbb035cc-7e36-4b7e-b4e5-4e36a742c751 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:43.685031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbb035cc-7e36-4b7e-b4e5-4e36a742c751 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:43.912181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dbb035cc-7e36-4b7e-b4e5-4e36a742c751 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:43.929619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dbb035cc-7e36-4b7e-b4e5-4e36a742c751 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:43.935629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dbb035cc-7e36-4b7e-b4e5-4e36a742c751 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:43.937694 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dbb035cc-7e36-4b7e-b4e5-4e36a742c751 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.264058 May 28 21:23:43.948692 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2279/4493] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:43 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:44.141686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-836010e8-0f26-47bd-8193-a18d2f08a119 req-ca8622e8-3ebb-4de0-9d3f-5cb94265d569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0000af21-fb59-4c9d-b417-340c0bddcd3e", "name": "network-vif-plugged", "status": "completed", "tag": "930f15ed-415b-4c08-ba61-70dcca02cf78"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:44.156870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-836010e8-0f26-47bd-8193-a18d2f08a119 req-ca8622e8-3ebb-4de0-9d3f-5cb94265d569 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:44.162455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-836010e8-0f26-47bd-8193-a18d2f08a119 req-ca8622e8-3ebb-4de0-9d3f-5cb94265d569 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:44.198733 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-836010e8-0f26-47bd-8193-a18d2f08a119 req-ca8622e8-3ebb-4de0-9d3f-5cb94265d569 service nova] Creating event network-vif-plugged:930f15ed-415b-4c08-ba61-70dcca02cf78 for instance 0000af21-fb59-4c9d-b417-340c0bddcd3e on nch1-master-1 May 28 21:23:44.215785 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-836010e8-0f26-47bd-8193-a18d2f08a119 req-ca8622e8-3ebb-4de0-9d3f-5cb94265d569 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077176 May 28 21:23:44.217905 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2215/4494] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:23:44.390857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ffa82bbd-92de-4680-921d-34954f91eda8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:44.391583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ffa82bbd-92de-4680-921d-34954f91eda8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:44.404983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffa82bbd-92de-4680-921d-34954f91eda8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:44.406954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffa82bbd-92de-4680-921d-34954f91eda8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:44.415530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f328cdf9-e734-42f5-9550-61ff12aaafc8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:44.416258 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f328cdf9-e734-42f5-9550-61ff12aaafc8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:44.420282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffa82bbd-92de-4680-921d-34954f91eda8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:44.429775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffa82bbd-92de-4680-921d-34954f91eda8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:44.451592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f328cdf9-e734-42f5-9550-61ff12aaafc8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:44.452657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f328cdf9-e734-42f5-9550-61ff12aaafc8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:44.458042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f328cdf9-e734-42f5-9550-61ff12aaafc8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:44.458557 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f328cdf9-e734-42f5-9550-61ff12aaafc8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:44.556777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-ffa82bbd-92de-4680-921d-34954f91eda8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lazy-loading 'flavor' on Instance uuid cd20dd19-f26b-4e32-9114-715558d5aa3b {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:23:44.852495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f328cdf9-e734-42f5-9550-61ff12aaafc8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:44.862827 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f328cdf9-e734-42f5-9550-61ff12aaafc8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75" status: 200 len: 1508 microversion: 2.1 time: 0.452616 May 28 21:23:44.864032 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2216/4495] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:44 2022] GET /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75 => generated 1508 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:23:44.880094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e5df7d5f-5dfd-42cd-9931-109928a482f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:44.881002 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e5df7d5f-5dfd-42cd-9931-109928a482f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 0000af21-fb59-4c9d-b417-340c0bddcd3e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:44.897656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5df7d5f-5dfd-42cd-9931-109928a482f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:44.899012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5df7d5f-5dfd-42cd-9931-109928a482f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:44.900033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5df7d5f-5dfd-42cd-9931-109928a482f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:44.903307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5df7d5f-5dfd-42cd-9931-109928a482f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:45.504874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e5df7d5f-5dfd-42cd-9931-109928a482f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:45.519050 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e5df7d5f-5dfd-42cd-9931-109928a482f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/0000af21-fb59-4c9d-b417-340c0bddcd3e" status: 200 len: 1319 microversion: 2.1 time: 0.643193 May 28 21:23:45.529143 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2217/4496] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:44 2022] GET /compute/v2.1/servers/0000af21-fb59-4c9d-b417-340c0bddcd3e => generated 1319 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:45.534768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b5b7607f-280c-4356-9a28-bd646b5d8ecc tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:45.535600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b5b7607f-280c-4356-9a28-bd646b5d8ecc tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:45.546470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5b7607f-280c-4356-9a28-bd646b5d8ecc tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:45.549418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5b7607f-280c-4356-9a28-bd646b5d8ecc tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:45.551699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5b7607f-280c-4356-9a28-bd646b5d8ecc tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:45.553209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5b7607f-280c-4356-9a28-bd646b5d8ecc tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:45.734773 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ffa82bbd-92de-4680-921d-34954f91eda8 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "POST /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b/action" status: 202 len: 0 microversion: 2.20 time: 1.348935 May 28 21:23:45.737048 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2280/4497] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:23:44 2022] POST /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b/action => generated 0 bytes in 1354 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 21:23:45.756146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d06155f6-949c-4148-bfcc-fcd52ef1acdd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:45.759226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d06155f6-949c-4148-bfcc-fcd52ef1acdd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:45.802122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d06155f6-949c-4148-bfcc-fcd52ef1acdd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:45.802891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d06155f6-949c-4148-bfcc-fcd52ef1acdd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:45.806239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d06155f6-949c-4148-bfcc-fcd52ef1acdd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:45.807395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d06155f6-949c-4148-bfcc-fcd52ef1acdd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:45.844875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b5b7607f-280c-4356-9a28-bd646b5d8ecc tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:45.892064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b5b7607f-280c-4356-9a28-bd646b5d8ecc tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:45.896581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b5b7607f-280c-4356-9a28-bd646b5d8ecc tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:45.899336 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b5b7607f-280c-4356-9a28-bd646b5d8ecc tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.368337 May 28 21:23:45.901037 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2218/4498] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:45 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:46.457343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d06155f6-949c-4148-bfcc-fcd52ef1acdd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:46.483837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d06155f6-949c-4148-bfcc-fcd52ef1acdd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:46.485510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d06155f6-949c-4148-bfcc-fcd52ef1acdd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:46.487110 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d06155f6-949c-4148-bfcc-fcd52ef1acdd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1724 microversion: 2.20 time: 0.746345 May 28 21:23:46.487794 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2281/4499] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:45 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1724 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:46.536121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0a695200-5a27-4c01-9659-8f797d04a619 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:46.536843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0a695200-5a27-4c01-9659-8f797d04a619 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 0000af21-fb59-4c9d-b417-340c0bddcd3e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:46.551166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a695200-5a27-4c01-9659-8f797d04a619 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:46.552164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a695200-5a27-4c01-9659-8f797d04a619 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:46.553307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a695200-5a27-4c01-9659-8f797d04a619 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:46.553818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a695200-5a27-4c01-9659-8f797d04a619 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:46.869023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0a695200-5a27-4c01-9659-8f797d04a619 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:46.884194 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0a695200-5a27-4c01-9659-8f797d04a619 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/0000af21-fb59-4c9d-b417-340c0bddcd3e" status: 200 len: 1508 microversion: 2.1 time: 0.349524 May 28 21:23:46.884868 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2219/4500] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:46 2022] GET /compute/v2.1/servers/0000af21-fb59-4c9d-b417-340c0bddcd3e => generated 1508 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:46.901260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6b7eb3f4-ce9f-4414-a5e5-92a212745648 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:46.904483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6b7eb3f4-ce9f-4414-a5e5-92a212745648 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 0000af21-fb59-4c9d-b417-340c0bddcd3e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:46.911933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b7eb3f4-ce9f-4414-a5e5-92a212745648 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:46.915890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b7eb3f4-ce9f-4414-a5e5-92a212745648 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:46.917161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b7eb3f4-ce9f-4414-a5e5-92a212745648 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:46.921570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0214c6ca-4037-401b-81e4-edd183419f2e tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:46.922899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0214c6ca-4037-401b-81e4-edd183419f2e tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:46.923523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b7eb3f4-ce9f-4414-a5e5-92a212745648 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:46.935006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0214c6ca-4037-401b-81e4-edd183419f2e tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:46.939120 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0214c6ca-4037-401b-81e4-edd183419f2e tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:46.940126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0214c6ca-4037-401b-81e4-edd183419f2e tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:46.947933 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0214c6ca-4037-401b-81e4-edd183419f2e tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:46.983898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6b7eb3f4-ce9f-4414-a5e5-92a212745648 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 0000af21-fb59-4c9d-b417-340c0bddcd3e] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:23:47.077400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0214c6ca-4037-401b-81e4-edd183419f2e tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:47.085959 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0214c6ca-4037-401b-81e4-edd183419f2e tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:47.087471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0214c6ca-4037-401b-81e4-edd183419f2e tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:47.088653 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0214c6ca-4037-401b-81e4-edd183419f2e tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.173179 May 28 21:23:47.099994 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2220/4501] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:46 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:47.366846 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6b7eb3f4-ce9f-4414-a5e5-92a212745648 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0000af21-fb59-4c9d-b417-340c0bddcd3e" status: 204 len: 0 microversion: 2.1 time: 0.469088 May 28 21:23:47.372037 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2282/4502] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:23:46 2022] DELETE /compute/v2.1/servers/0000af21-fb59-4c9d-b417-340c0bddcd3e => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:23:47.380635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ac2395d3-aa44-4489-a5df-6601b237fcfc tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:47.381157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ac2395d3-aa44-4489-a5df-6601b237fcfc tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:47.403442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac2395d3-aa44-4489-a5df-6601b237fcfc tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:47.404571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac2395d3-aa44-4489-a5df-6601b237fcfc tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:47.406799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac2395d3-aa44-4489-a5df-6601b237fcfc tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:47.408801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac2395d3-aa44-4489-a5df-6601b237fcfc tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:47.445864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ac2395d3-aa44-4489-a5df-6601b237fcfc tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: 1415e0fb-001d-4d01-b96b-fb4bd8608d75] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:23:47.513615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-380a5233-a4fb-4983-8aa2-9215f481c700 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:47.514553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-380a5233-a4fb-4983-8aa2-9215f481c700 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:47.524803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-380a5233-a4fb-4983-8aa2-9215f481c700 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:47.525445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-380a5233-a4fb-4983-8aa2-9215f481c700 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:47.526447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-380a5233-a4fb-4983-8aa2-9215f481c700 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:47.527855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-380a5233-a4fb-4983-8aa2-9215f481c700 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:47.822675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-380a5233-a4fb-4983-8aa2-9215f481c700 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:47.835146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-380a5233-a4fb-4983-8aa2-9215f481c700 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:47.836926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-380a5233-a4fb-4983-8aa2-9215f481c700 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:47.839901 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-380a5233-a4fb-4983-8aa2-9215f481c700 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1724 microversion: 2.20 time: 0.330229 May 28 21:23:47.841056 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2283/4503] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:47 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:47.944306 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ac2395d3-aa44-4489-a5df-6601b237fcfc tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75" status: 204 len: 0 microversion: 2.1 time: 0.567807 May 28 21:23:47.946405 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2221/4504] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:23:47 2022] DELETE /compute/v2.1/servers/1415e0fb-001d-4d01-b96b-fb4bd8608d75 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:23:48.111901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-899c6625-8082-43ce-b33d-9b7a56ba3511 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:48.112689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-899c6625-8082-43ce-b33d-9b7a56ba3511 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:48.114828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1505489684", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "3e6c7b29-e14f-42e1-b305-704db918321d"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:48.132742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-899c6625-8082-43ce-b33d-9b7a56ba3511 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:48.133619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-899c6625-8082-43ce-b33d-9b7a56ba3511 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:48.137060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-899c6625-8082-43ce-b33d-9b7a56ba3511 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:48.139862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-899c6625-8082-43ce-b33d-9b7a56ba3511 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:48.248367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] validate_networks() for [('3e6c7b29-e14f-42e1-b305-704db918321d', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:23:48.322960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-899c6625-8082-43ce-b33d-9b7a56ba3511 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:48.334137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-899c6625-8082-43ce-b33d-9b7a56ba3511 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:48.336533 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-899c6625-8082-43ce-b33d-9b7a56ba3511 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:48.338367 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-899c6625-8082-43ce-b33d-9b7a56ba3511 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.232836 May 28 21:23:48.339630 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2222/4505] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:48 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:48.859688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-376b5d0c-0f6e-4338-b4ee-2fbd76f6757b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:48.860325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-376b5d0c-0f6e-4338-b4ee-2fbd76f6757b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:48.867952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-376b5d0c-0f6e-4338-b4ee-2fbd76f6757b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:48.868683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-376b5d0c-0f6e-4338-b4ee-2fbd76f6757b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:48.869479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-376b5d0c-0f6e-4338-b4ee-2fbd76f6757b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:48.870118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-376b5d0c-0f6e-4338-b4ee-2fbd76f6757b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:49.541232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:23:49.541717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:23:49.542278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:23:49.542706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:23:49.543479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:23:49.598034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:49.604451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:49.608122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:49.613528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:49.685267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:49.720372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Getting quotas for project d3112549c42f41cda4a54ec51c131023. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:23:49.749781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Getting quotas for user f7c1a400e0dd462da3bb33b7e3fe57fc and project d3112549c42f41cda4a54ec51c131023. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:23:49.796294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Going to run 2 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:23:49.803217 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b3be7259-f0f9-4940-b2b8-7eb1954ae27b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:23:50.070254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=b3be7259-f0f9-4940-b2b8-7eb1954ae27b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:23:50.255838 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f96ed1cb-6eb3-447b-979c-c14bda02d61d tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.154974 May 28 21:23:50.259583 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2284/4506] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:23:48 2022] POST /compute/v2.1/servers => generated 32 bytes in 2159 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) May 28 21:23:50.280406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d9136751-3b59-4951-a928-fdb57e69ad45 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:50.283865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d9136751-3b59-4951-a928-fdb57e69ad45 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:50.311489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-376b5d0c-0f6e-4338-b4ee-2fbd76f6757b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:50.321825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-376b5d0c-0f6e-4338-b4ee-2fbd76f6757b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:50.323581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9136751-3b59-4951-a928-fdb57e69ad45 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:50.323829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-376b5d0c-0f6e-4338-b4ee-2fbd76f6757b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:50.325075 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-376b5d0c-0f6e-4338-b4ee-2fbd76f6757b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1724 microversion: 2.20 time: 1.470250 May 28 21:23:50.325722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9136751-3b59-4951-a928-fdb57e69ad45 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:50.327553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9136751-3b59-4951-a928-fdb57e69ad45 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:50.330228 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2223/4507] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:48 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1724 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:23:50.332731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9136751-3b59-4951-a928-fdb57e69ad45 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:50.341148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-27f9a246-36e0-4eaf-b510-3a801bb853ff tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:50.350648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-27f9a246-36e0-4eaf-b510-3a801bb853ff tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:50.351454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-27f9a246-36e0-4eaf-b510-3a801bb853ff tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Searching by: {'deleted': False, 'project_id': 'd3112549c42f41cda4a54ec51c131023'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:23:50.396890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-27f9a246-36e0-4eaf-b510-3a801bb853ff tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:50.397387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-27f9a246-36e0-4eaf-b510-3a801bb853ff tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:50.398330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-27f9a246-36e0-4eaf-b510-3a801bb853ff tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:50.398785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-27f9a246-36e0-4eaf-b510-3a801bb853ff tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:50.451691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-27f9a246-36e0-4eaf-b510-3a801bb853ff tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:23:50.525177 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-27f9a246-36e0-4eaf-b510-3a801bb853ff tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.193732 May 28 21:23:50.535323 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2224/4508] 10.222.0.33 () {58 vars in 1124 bytes} [Sat May 28 21:23:50 2022] GET /compute/v2.1/servers => generated 1335 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:50.556056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-41178a59-ffa5-4d86-add0-fdb56fd597eb tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:50.556945 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-41178a59-ffa5-4d86-add0-fdb56fd597eb tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:50.603719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d9136751-3b59-4951-a928-fdb57e69ad45 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:50.625328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d9136751-3b59-4951-a928-fdb57e69ad45 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:50.635842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d9136751-3b59-4951-a928-fdb57e69ad45 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:50.640150 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d9136751-3b59-4951-a928-fdb57e69ad45 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.379256 May 28 21:23:50.643064 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2285/4509] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:50 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:50.696347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-41178a59-ffa5-4d86-add0-fdb56fd597eb tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:50.704740 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-41178a59-ffa5-4d86-add0-fdb56fd597eb tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1218 microversion: 2.1 time: 0.152750 May 28 21:23:50.708255 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2225/4510] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:50 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1218 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:51.177088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-af57f493-584a-43f6-9e84-158cde1e5774 req-8e5c30d8-5e4a-446a-95d9-ea4261fc1e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0000af21-fb59-4c9d-b417-340c0bddcd3e", "name": "network-vif-deleted", "tag": "930f15ed-415b-4c08-ba61-70dcca02cf78"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:51.202943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-af57f493-584a-43f6-9e84-158cde1e5774 req-8e5c30d8-5e4a-446a-95d9-ea4261fc1e07 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:51.204705 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-af57f493-584a-43f6-9e84-158cde1e5774 req-8e5c30d8-5e4a-446a-95d9-ea4261fc1e07 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:51.288582 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-af57f493-584a-43f6-9e84-158cde1e5774 req-8e5c30d8-5e4a-446a-95d9-ea4261fc1e07 service nova] Creating event network-vif-deleted:930f15ed-415b-4c08-ba61-70dcca02cf78 for instance 0000af21-fb59-4c9d-b417-340c0bddcd3e on nch1-master-1 May 28 21:23:51.302966 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-af57f493-584a-43f6-9e84-158cde1e5774 req-8e5c30d8-5e4a-446a-95d9-ea4261fc1e07 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137233 May 28 21:23:51.310352 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2286/4511] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:23:51.371943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5ec5e4a7-4078-43be-b36b-2167192a809b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:51.379980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5ec5e4a7-4078-43be-b36b-2167192a809b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:51.429548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ec5e4a7-4078-43be-b36b-2167192a809b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:51.430255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ec5e4a7-4078-43be-b36b-2167192a809b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:51.431112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ec5e4a7-4078-43be-b36b-2167192a809b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:51.431565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ec5e4a7-4078-43be-b36b-2167192a809b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:51.665571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a978c07d-bad4-4814-bedf-5d54825fa290 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:51.666354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a978c07d-bad4-4814-bedf-5d54825fa290 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:51.676945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a978c07d-bad4-4814-bedf-5d54825fa290 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:51.685143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a978c07d-bad4-4814-bedf-5d54825fa290 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:51.690526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a978c07d-bad4-4814-bedf-5d54825fa290 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:51.696638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a978c07d-bad4-4814-bedf-5d54825fa290 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:51.850354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a978c07d-bad4-4814-bedf-5d54825fa290 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:51.895008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a978c07d-bad4-4814-bedf-5d54825fa290 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:51.915812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a978c07d-bad4-4814-bedf-5d54825fa290 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:51.922573 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a978c07d-bad4-4814-bedf-5d54825fa290 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.260812 May 28 21:23:51.942862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5ec5e4a7-4078-43be-b36b-2167192a809b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:51.957329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5ec5e4a7-4078-43be-b36b-2167192a809b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:51.959002 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5ec5e4a7-4078-43be-b36b-2167192a809b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:51.960985 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5ec5e4a7-4078-43be-b36b-2167192a809b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1724 microversion: 2.20 time: 0.616916 May 28 21:23:51.962096 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2226/4512] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:51 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1724 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:51.967066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8da871ce-f5e0-430a-a25d-52320064626a tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:51.968061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8da871ce-f5e0-430a-a25d-52320064626a tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:51.973057 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2287/4513] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:51 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:52.037177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8da871ce-f5e0-430a-a25d-52320064626a tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:52.047491 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8da871ce-f5e0-430a-a25d-52320064626a tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1218 microversion: 2.1 time: 0.082946 May 28 21:23:52.048491 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2227/4514] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:51 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:52.606961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cb127469-ed4b-4fb6-9f22-32d53b7e6787 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:52.608161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cb127469-ed4b-4fb6-9f22-32d53b7e6787 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:52.638458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cb127469-ed4b-4fb6-9f22-32d53b7e6787 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:52.638942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cb127469-ed4b-4fb6-9f22-32d53b7e6787 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:52.643578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cb127469-ed4b-4fb6-9f22-32d53b7e6787 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:52.665286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cb127469-ed4b-4fb6-9f22-32d53b7e6787 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:52.950889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7ad0a633-d1f3-4b08-b584-8f5e4225745d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:52.951642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7ad0a633-d1f3-4b08-b584-8f5e4225745d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:52.972677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ad0a633-d1f3-4b08-b584-8f5e4225745d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:52.982235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ad0a633-d1f3-4b08-b584-8f5e4225745d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:52.983347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ad0a633-d1f3-4b08-b584-8f5e4225745d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:52.983918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7ad0a633-d1f3-4b08-b584-8f5e4225745d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:53.216010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7ad0a633-d1f3-4b08-b584-8f5e4225745d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:53.220085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:53.228319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7ad0a633-d1f3-4b08-b584-8f5e4225745d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:53.231351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7ad0a633-d1f3-4b08-b584-8f5e4225745d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:53.235245 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7ad0a633-d1f3-4b08-b584-8f5e4225745d tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.287542 May 28 21:23:53.237241 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2228/4515] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:52 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:53.242758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bdba0830-6bf2-4d84-9d90-e9ecbbd5b60f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:53.243663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bdba0830-6bf2-4d84-9d90-e9ecbbd5b60f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:53.266747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdba0830-6bf2-4d84-9d90-e9ecbbd5b60f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:53.270509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdba0830-6bf2-4d84-9d90-e9ecbbd5b60f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:53.271656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdba0830-6bf2-4d84-9d90-e9ecbbd5b60f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:53.294451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdba0830-6bf2-4d84-9d90-e9ecbbd5b60f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:53.611392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bdba0830-6bf2-4d84-9d90-e9ecbbd5b60f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:53.626167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bdba0830-6bf2-4d84-9d90-e9ecbbd5b60f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:53.628389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bdba0830-6bf2-4d84-9d90-e9ecbbd5b60f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:53.633496 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bdba0830-6bf2-4d84-9d90-e9ecbbd5b60f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1724 microversion: 2.20 time: 0.394252 May 28 21:23:53.646993 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2229/4516] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:53 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1724 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:53.659079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f9c7d048-7137-406d-ad3f-c2b5136d7422 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:53.660185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f9c7d048-7137-406d-ad3f-c2b5136d7422 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:53.667202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9c7d048-7137-406d-ad3f-c2b5136d7422 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:53.667901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9c7d048-7137-406d-ad3f-c2b5136d7422 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:53.669287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9c7d048-7137-406d-ad3f-c2b5136d7422 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:53.670014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9c7d048-7137-406d-ad3f-c2b5136d7422 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:53.720802 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cb127469-ed4b-4fb6-9f22-32d53b7e6787 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1832 microversion: 2.1 time: 1.125697 May 28 21:23:53.721406 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2288/4517] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:52 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1832 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:53.893468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f9c7d048-7137-406d-ad3f-c2b5136d7422 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:53.903075 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f9c7d048-7137-406d-ad3f-c2b5136d7422 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1222 microversion: 2.1 time: 0.254731 May 28 21:23:53.911862 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2230/4518] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:53 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1222 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:53.931210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-89dc50ee-7c19-4478-aa2e-d68b6f546b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:53.938089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-89dc50ee-7c19-4478-aa2e-d68b6f546b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:53.962896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89dc50ee-7c19-4478-aa2e-d68b6f546b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:53.967063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89dc50ee-7c19-4478-aa2e-d68b6f546b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:53.968740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89dc50ee-7c19-4478-aa2e-d68b6f546b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:53.971887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89dc50ee-7c19-4478-aa2e-d68b6f546b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:54.054763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-a8e9a420-f79a-471f-ba5f-3ba4f8c70326 req-b7d4ce77-33b5-479e-bbfb-67453746008d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1415e0fb-001d-4d01-b96b-fb4bd8608d75", "name": "network-vif-deleted", "tag": "87287c5e-4b2f-4f7b-8e61-4e5f14780d27"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:54.077303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a8e9a420-f79a-471f-ba5f-3ba4f8c70326 req-b7d4ce77-33b5-479e-bbfb-67453746008d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:54.079258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a8e9a420-f79a-471f-ba5f-3ba4f8c70326 req-b7d4ce77-33b5-479e-bbfb-67453746008d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:54.094889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:54.129918 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a8e9a420-f79a-471f-ba5f-3ba4f8c70326 req-b7d4ce77-33b5-479e-bbfb-67453746008d service nova] Creating event network-vif-deleted:87287c5e-4b2f-4f7b-8e61-4e5f14780d27 for instance 1415e0fb-001d-4d01-b96b-fb4bd8608d75 on nch2-master-1 May 28 21:23:54.142792 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-a8e9a420-f79a-471f-ba5f-3ba4f8c70326 req-b7d4ce77-33b5-479e-bbfb-67453746008d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.415644 May 28 21:23:54.145989 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2289/4519] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:23:54.270196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dc498017-5262-4463-894c-a0d8d1eef9e4 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:54.274814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dc498017-5262-4463-894c-a0d8d1eef9e4 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:54.307101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc498017-5262-4463-894c-a0d8d1eef9e4 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:54.310337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc498017-5262-4463-894c-a0d8d1eef9e4 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:54.312833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc498017-5262-4463-894c-a0d8d1eef9e4 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:54.313688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc498017-5262-4463-894c-a0d8d1eef9e4 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:54.347887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89dc50ee-7c19-4478-aa2e-d68b6f546b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:54.357868 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-89dc50ee-7c19-4478-aa2e-d68b6f546b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1681 microversion: 2.1 time: 0.444410 May 28 21:23:54.362242 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2231/4520] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:53 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1681 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:54.475367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dc498017-5262-4463-894c-a0d8d1eef9e4 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:54.492307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dc498017-5262-4463-894c-a0d8d1eef9e4 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:54.500541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dc498017-5262-4463-894c-a0d8d1eef9e4 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:54.502151 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dc498017-5262-4463-894c-a0d8d1eef9e4 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.243607 May 28 21:23:54.502957 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2290/4521] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:54 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:54.634032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cb1e242d-e624-40b5-9af1-bfb4047e4dde tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:54.635109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cb1e242d-e624-40b5-9af1-bfb4047e4dde tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:54.646520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb1e242d-e624-40b5-9af1-bfb4047e4dde tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:54.646964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb1e242d-e624-40b5-9af1-bfb4047e4dde tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:54.655487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-04d81922-c733-482e-98f4-bec7bc13da57 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:54.656812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-04d81922-c733-482e-98f4-bec7bc13da57 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:54.660305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb1e242d-e624-40b5-9af1-bfb4047e4dde tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:54.661035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb1e242d-e624-40b5-9af1-bfb4047e4dde tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:54.671848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04d81922-c733-482e-98f4-bec7bc13da57 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:54.674683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04d81922-c733-482e-98f4-bec7bc13da57 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:54.675643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04d81922-c733-482e-98f4-bec7bc13da57 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:54.682877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04d81922-c733-482e-98f4-bec7bc13da57 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:54.812359 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cb1e242d-e624-40b5-9af1-bfb4047e4dde tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958/action" status: 200 len: 32644 microversion: 2.1 time: 0.135608 May 28 21:23:54.812359 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2232/4522] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:23:54 2022] POST /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958/action => generated 32644 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:23:54.901136 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1dfb760e-d132-4179-96c3-38d55de7efe1 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:23:54.902766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1dfb760e-d132-4179-96c3-38d55de7efe1 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:54.914973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-04d81922-c733-482e-98f4-bec7bc13da57 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:54.922656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1dfb760e-d132-4179-96c3-38d55de7efe1 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:54.928531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-04d81922-c733-482e-98f4-bec7bc13da57 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:54.930322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1dfb760e-d132-4179-96c3-38d55de7efe1 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:54.931370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1dfb760e-d132-4179-96c3-38d55de7efe1 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:54.931824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1dfb760e-d132-4179-96c3-38d55de7efe1 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:54.936815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-04d81922-c733-482e-98f4-bec7bc13da57 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:54.938102 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-04d81922-c733-482e-98f4-bec7bc13da57 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1724 microversion: 2.20 time: 0.289459 May 28 21:23:54.950305 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2291/4523] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:54 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:54.957248 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9af4c083-cbfe-4dc4-ad1e-d195bb129ff4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:54.958258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9af4c083-cbfe-4dc4-ad1e-d195bb129ff4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:54.965752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9af4c083-cbfe-4dc4-ad1e-d195bb129ff4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:54.966522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9af4c083-cbfe-4dc4-ad1e-d195bb129ff4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:54.967595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9af4c083-cbfe-4dc4-ad1e-d195bb129ff4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:54.968210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9af4c083-cbfe-4dc4-ad1e-d195bb129ff4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:54.993982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1dfb760e-d132-4179-96c3-38d55de7efe1 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e2da25bb9fdc42fbbc3665d6618ecd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dae9dd6b0b54bf2954f3d8427e092ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:54.996115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1dfb760e-d132-4179-96c3-38d55de7efe1 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] flavor_id is None. Assuming migration. {{(pid=143128) resize /opt/stack/nova/nova/compute/api.py:4142}} May 28 21:23:54.996793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1dfb760e-d132-4179-96c3-38d55de7efe1 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=143128) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 21:23:55.077302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9af4c083-cbfe-4dc4-ad1e-d195bb129ff4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:55.085827 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9af4c083-cbfe-4dc4-ad1e-d195bb129ff4 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1270 microversion: 2.1 time: 0.133801 May 28 21:23:55.086896 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2292/4524] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:54 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:55.536001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-620ad838-ea0b-41e0-a51f-cfd001912cf8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:55.536855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-620ad838-ea0b-41e0-a51f-cfd001912cf8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:55.547734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-620ad838-ea0b-41e0-a51f-cfd001912cf8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:55.553331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-620ad838-ea0b-41e0-a51f-cfd001912cf8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:55.555070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-620ad838-ea0b-41e0-a51f-cfd001912cf8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:55.571153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-620ad838-ea0b-41e0-a51f-cfd001912cf8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:55.675961 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1dfb760e-d132-4179-96c3-38d55de7efe1 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958/action" status: 202 len: 0 microversion: 2.1 time: 0.778027 May 28 21:23:55.679785 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2233/4525] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:23:54 2022] POST /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958/action => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:23:55.698934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aba97687-81d0-4781-a442-032cb491649e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:55.703152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aba97687-81d0-4781-a442-032cb491649e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:55.727299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aba97687-81d0-4781-a442-032cb491649e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:55.727591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aba97687-81d0-4781-a442-032cb491649e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:55.729008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aba97687-81d0-4781-a442-032cb491649e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:55.730796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aba97687-81d0-4781-a442-032cb491649e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:55.985370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-620ad838-ea0b-41e0-a51f-cfd001912cf8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:55.999423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-620ad838-ea0b-41e0-a51f-cfd001912cf8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:56.005202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-620ad838-ea0b-41e0-a51f-cfd001912cf8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:56.007910 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-620ad838-ea0b-41e0-a51f-cfd001912cf8 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.477460 May 28 21:23:56.011082 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2293/4526] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:55 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:23:56.032353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1abce381-eb11-4b3a-abb8-f32205ffeaee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:56.034976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1abce381-eb11-4b3a-abb8-f32205ffeaee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:56.050941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1abce381-eb11-4b3a-abb8-f32205ffeaee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:56.058519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1abce381-eb11-4b3a-abb8-f32205ffeaee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:56.061037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1abce381-eb11-4b3a-abb8-f32205ffeaee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:56.061722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1abce381-eb11-4b3a-abb8-f32205ffeaee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:56.888156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1abce381-eb11-4b3a-abb8-f32205ffeaee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:56.900028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1abce381-eb11-4b3a-abb8-f32205ffeaee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:56.908245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1abce381-eb11-4b3a-abb8-f32205ffeaee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:56.909576 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1abce381-eb11-4b3a-abb8-f32205ffeaee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1724 microversion: 2.20 time: 0.897360 May 28 21:23:56.911740 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2294/4527] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:56 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1724 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:56.927412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5aa2941b-9fe8-4ea6-ba04-6245dd32d191 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:56.930731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5aa2941b-9fe8-4ea6-ba04-6245dd32d191 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:56.941483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5aa2941b-9fe8-4ea6-ba04-6245dd32d191 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:56.941964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5aa2941b-9fe8-4ea6-ba04-6245dd32d191 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:56.942889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5aa2941b-9fe8-4ea6-ba04-6245dd32d191 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:56.943336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5aa2941b-9fe8-4ea6-ba04-6245dd32d191 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:56.951471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aba97687-81d0-4781-a442-032cb491649e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:56.965138 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aba97687-81d0-4781-a442-032cb491649e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1690 microversion: 2.1 time: 1.276505 May 28 21:23:56.965138 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2234/4528] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:55 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1690 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:57.029006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-15a140f0-cd04-4f3f-9a73-79a9584930af tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:57.029561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-15a140f0-cd04-4f3f-9a73-79a9584930af tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:57.057451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15a140f0-cd04-4f3f-9a73-79a9584930af tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:57.057982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15a140f0-cd04-4f3f-9a73-79a9584930af tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:57.058777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15a140f0-cd04-4f3f-9a73-79a9584930af tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:57.078804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15a140f0-cd04-4f3f-9a73-79a9584930af tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:57.141131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5aa2941b-9fe8-4ea6-ba04-6245dd32d191 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:57.150607 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5aa2941b-9fe8-4ea6-ba04-6245dd32d191 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1276 microversion: 2.1 time: 0.235335 May 28 21:23:57.171356 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2295/4529] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:56 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1276 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:57.516656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-15a140f0-cd04-4f3f-9a73-79a9584930af tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:57.527235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-15a140f0-cd04-4f3f-9a73-79a9584930af tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:57.528758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-15a140f0-cd04-4f3f-9a73-79a9584930af tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:57.542310 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-15a140f0-cd04-4f3f-9a73-79a9584930af tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.505639 May 28 21:23:57.543974 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2235/4530] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:57 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:57.929623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-50f2e781-0d5d-4975-a03b-19fff3d85634 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:57.933698 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-50f2e781-0d5d-4975-a03b-19fff3d85634 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:57.954370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50f2e781-0d5d-4975-a03b-19fff3d85634 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:57.956245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50f2e781-0d5d-4975-a03b-19fff3d85634 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:57.957277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50f2e781-0d5d-4975-a03b-19fff3d85634 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:57.957908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50f2e781-0d5d-4975-a03b-19fff3d85634 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:57.986101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-668ebdce-a806-45ef-939a-feb5faed638c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:57.993615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-668ebdce-a806-45ef-939a-feb5faed638c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:58.007364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-668ebdce-a806-45ef-939a-feb5faed638c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:58.007834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-668ebdce-a806-45ef-939a-feb5faed638c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:58.022240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-668ebdce-a806-45ef-939a-feb5faed638c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:58.024732 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-668ebdce-a806-45ef-939a-feb5faed638c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:58.621597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-668ebdce-a806-45ef-939a-feb5faed638c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:58.657622 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-668ebdce-a806-45ef-939a-feb5faed638c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1690 microversion: 2.1 time: 0.674708 May 28 21:23:58.664448 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2236/4531] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:57 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1690 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:23:58.681464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-50f2e781-0d5d-4975-a03b-19fff3d85634 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:58.704061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b52e1111-793b-4262-9327-4d2df1dbf4c2 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:58.705888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b52e1111-793b-4262-9327-4d2df1dbf4c2 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:58.706426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-50f2e781-0d5d-4975-a03b-19fff3d85634 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:58.716409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-50f2e781-0d5d-4975-a03b-19fff3d85634 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:58.720366 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-50f2e781-0d5d-4975-a03b-19fff3d85634 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1745 microversion: 2.20 time: 0.794586 May 28 21:23:58.740222 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2296/4532] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:57 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1745 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:58.743361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b52e1111-793b-4262-9327-4d2df1dbf4c2 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:58.751690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b52e1111-793b-4262-9327-4d2df1dbf4c2 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:58.755340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b52e1111-793b-4262-9327-4d2df1dbf4c2 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:58.755859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b52e1111-793b-4262-9327-4d2df1dbf4c2 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:58.771915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-76b2c508-398b-4530-9a54-2388acf91913 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:58.772701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-76b2c508-398b-4530-9a54-2388acf91913 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:58.797355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76b2c508-398b-4530-9a54-2388acf91913 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:58.797355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76b2c508-398b-4530-9a54-2388acf91913 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:58.797779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76b2c508-398b-4530-9a54-2388acf91913 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:58.798276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76b2c508-398b-4530-9a54-2388acf91913 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:59.352614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-76b2c508-398b-4530-9a54-2388acf91913 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:59.370419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-76b2c508-398b-4530-9a54-2388acf91913 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:59.375315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-76b2c508-398b-4530-9a54-2388acf91913 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:59.378370 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-76b2c508-398b-4530-9a54-2388acf91913 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.633801 May 28 21:23:59.387824 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2297/4533] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:23:58 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:23:59.488136 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b52e1111-793b-4262-9327-4d2df1dbf4c2 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:23:59.509436 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b52e1111-793b-4262-9327-4d2df1dbf4c2 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1318 microversion: 2.1 time: 0.842180 May 28 21:23:59.512843 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2237/4534] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:58 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1318 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:23:59.674597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:59.678748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f890f06a-96a2-4222-b615-8a90e7df0642 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:23:59.679472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f890f06a-96a2-4222-b615-8a90e7df0642 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:23:59.706286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f890f06a-96a2-4222-b615-8a90e7df0642 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:59.708754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f890f06a-96a2-4222-b615-8a90e7df0642 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:59.713084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f890f06a-96a2-4222-b615-8a90e7df0642 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:23:59.719503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f890f06a-96a2-4222-b615-8a90e7df0642 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:23:59.778827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:23:59.990028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-6f88384d-a452-4c5e-ba67-9b2dbc0a0eb1 req-f2ea4606-d068-4e38-ad39-3d0be08f07e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3be7259-f0f9-4940-b2b8-7eb1954ae27b", "tag": "a88a3bb1-47d4-4b86-b493-1102f69d80dc"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:00.011453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6f88384d-a452-4c5e-ba67-9b2dbc0a0eb1 req-f2ea4606-d068-4e38-ad39-3d0be08f07e6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:00.014510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6f88384d-a452-4c5e-ba67-9b2dbc0a0eb1 req-f2ea4606-d068-4e38-ad39-3d0be08f07e6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:00.038073 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-6f88384d-a452-4c5e-ba67-9b2dbc0a0eb1 req-f2ea4606-d068-4e38-ad39-3d0be08f07e6 service nova] Creating event network-changed:a88a3bb1-47d4-4b86-b493-1102f69d80dc for instance b3be7259-f0f9-4940-b2b8-7eb1954ae27b on nch2-master-1 May 28 21:24:00.044775 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-6f88384d-a452-4c5e-ba67-9b2dbc0a0eb1 req-f2ea4606-d068-4e38-ad39-3d0be08f07e6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.377596 May 28 21:24:00.046258 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2298/4535] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:00.109022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-708972db-e9d6-44a5-812e-a49c2cb81c51 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:00.115580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-708972db-e9d6-44a5-812e-a49c2cb81c51 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:00.134019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-708972db-e9d6-44a5-812e-a49c2cb81c51 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:00.147407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-708972db-e9d6-44a5-812e-a49c2cb81c51 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:00.148422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-708972db-e9d6-44a5-812e-a49c2cb81c51 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:00.150369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-708972db-e9d6-44a5-812e-a49c2cb81c51 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:00.424779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:00.916850 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f890f06a-96a2-4222-b615-8a90e7df0642 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:00.930355 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f890f06a-96a2-4222-b615-8a90e7df0642 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1690 microversion: 2.1 time: 1.252577 May 28 21:24:00.942981 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2238/4536] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:23:59 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1690 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:00.958272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-55adbd4a-c265-40a9-bbcf-dec33e5419ad tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:00.959627 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-55adbd4a-c265-40a9-bbcf-dec33e5419ad tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:00.971347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55adbd4a-c265-40a9-bbcf-dec33e5419ad tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:00.975082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55adbd4a-c265-40a9-bbcf-dec33e5419ad tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:00.977178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55adbd4a-c265-40a9-bbcf-dec33e5419ad tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:00.980258 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55adbd4a-c265-40a9-bbcf-dec33e5419ad tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:01.263062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-55adbd4a-c265-40a9-bbcf-dec33e5419ad tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:01.280516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-55adbd4a-c265-40a9-bbcf-dec33e5419ad tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:01.285038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-55adbd4a-c265-40a9-bbcf-dec33e5419ad tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:01.289266 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-55adbd4a-c265-40a9-bbcf-dec33e5419ad tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1366 microversion: 2.47 time: 0.339124 May 28 21:24:01.292695 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2239/4537] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:00 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:01.309148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3d988c3b-72af-45a0-8552-1c419b7ce098 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:01.325280 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3d988c3b-72af-45a0-8552-1c419b7ce098 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:01.325280 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d988c3b-72af-45a0-8552-1c419b7ce098 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:01.325280 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d988c3b-72af-45a0-8552-1c419b7ce098 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:01.330107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d988c3b-72af-45a0-8552-1c419b7ce098 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:01.331007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3d988c3b-72af-45a0-8552-1c419b7ce098 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:01.451336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-708972db-e9d6-44a5-812e-a49c2cb81c51 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:01.483308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-708972db-e9d6-44a5-812e-a49c2cb81c51 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:01.485021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-708972db-e9d6-44a5-812e-a49c2cb81c51 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:01.486309 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-708972db-e9d6-44a5-812e-a49c2cb81c51 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1740 microversion: 2.20 time: 1.395399 May 28 21:24:01.486892 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2299/4538] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:00 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1740 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:01.659251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-42425f46-b7af-4f7a-bb7f-a70a94af177b req-602387fc-3790-4419-9fb3-baf3c866e432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd20dd19-f26b-4e32-9114-715558d5aa3b", "name": "network-vif-plugged", "status": "completed", "tag": "4c95deb6-3882-40f5-af0e-fd2149216c59"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:01.684157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3d988c3b-72af-45a0-8552-1c419b7ce098 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:01.695193 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3d988c3b-72af-45a0-8552-1c419b7ce098 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1318 microversion: 2.1 time: 0.399925 May 28 21:24:01.696325 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2240/4539] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:01 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:01.710032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-42425f46-b7af-4f7a-bb7f-a70a94af177b req-602387fc-3790-4419-9fb3-baf3c866e432 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:01.712114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-42425f46-b7af-4f7a-bb7f-a70a94af177b req-602387fc-3790-4419-9fb3-baf3c866e432 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:01.749630 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-42425f46-b7af-4f7a-bb7f-a70a94af177b req-602387fc-3790-4419-9fb3-baf3c866e432 service nova] Creating event network-vif-plugged:4c95deb6-3882-40f5-af0e-fd2149216c59 for instance cd20dd19-f26b-4e32-9114-715558d5aa3b on nch1-master-1 May 28 21:24:01.762921 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-42425f46-b7af-4f7a-bb7f-a70a94af177b req-602387fc-3790-4419-9fb3-baf3c866e432 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254692 May 28 21:24:01.763737 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2300/4540] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:01.949016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c5ca4c29-5b21-4ea8-9ec0-d4df88dd269a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:01.949651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c5ca4c29-5b21-4ea8-9ec0-d4df88dd269a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:01.970803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5ca4c29-5b21-4ea8-9ec0-d4df88dd269a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:01.971545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5ca4c29-5b21-4ea8-9ec0-d4df88dd269a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:01.972509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5ca4c29-5b21-4ea8-9ec0-d4df88dd269a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:01.973117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5ca4c29-5b21-4ea8-9ec0-d4df88dd269a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:02.076871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:02.332572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b42e3225-0ea4-4c66-9ed9-38435944c7d9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:02.333950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b42e3225-0ea4-4c66-9ed9-38435944c7d9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:02.352956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b42e3225-0ea4-4c66-9ed9-38435944c7d9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:02.354102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b42e3225-0ea4-4c66-9ed9-38435944c7d9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:02.358978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b42e3225-0ea4-4c66-9ed9-38435944c7d9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:02.359744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b42e3225-0ea4-4c66-9ed9-38435944c7d9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:02.755002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b42e3225-0ea4-4c66-9ed9-38435944c7d9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:02.780932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b42e3225-0ea4-4c66-9ed9-38435944c7d9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:02.795657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b42e3225-0ea4-4c66-9ed9-38435944c7d9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:02.803382 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b42e3225-0ea4-4c66-9ed9-38435944c7d9 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1372 microversion: 2.47 time: 0.496195 May 28 21:24:02.806282 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2301/4541] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:02 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1372 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:02.832813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-20cc8a27-9d3c-424c-ada1-a1cd5a384086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:02.833881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-20cc8a27-9d3c-424c-ada1-a1cd5a384086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:02.869758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20cc8a27-9d3c-424c-ada1-a1cd5a384086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:02.872853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20cc8a27-9d3c-424c-ada1-a1cd5a384086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:02.873735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20cc8a27-9d3c-424c-ada1-a1cd5a384086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:02.876935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20cc8a27-9d3c-424c-ada1-a1cd5a384086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:03.179064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c5ca4c29-5b21-4ea8-9ec0-d4df88dd269a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:03.193755 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c5ca4c29-5b21-4ea8-9ec0-d4df88dd269a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1690 microversion: 2.1 time: 1.248966 May 28 21:24:03.195293 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2241/4542] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:01 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1690 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:03.211153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-57a86174-6dd5-4a63-a64b-e478a3a0d31e tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:03.214403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-57a86174-6dd5-4a63-a64b-e478a3a0d31e tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:03.240803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57a86174-6dd5-4a63-a64b-e478a3a0d31e tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:03.243444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57a86174-6dd5-4a63-a64b-e478a3a0d31e tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:03.246309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57a86174-6dd5-4a63-a64b-e478a3a0d31e tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:03.247678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57a86174-6dd5-4a63-a64b-e478a3a0d31e tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:03.551379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-20cc8a27-9d3c-424c-ada1-a1cd5a384086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:03.584792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-20cc8a27-9d3c-424c-ada1-a1cd5a384086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:03.588187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-20cc8a27-9d3c-424c-ada1-a1cd5a384086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:03.588187 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-20cc8a27-9d3c-424c-ada1-a1cd5a384086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1740 microversion: 2.20 time: 0.771389 May 28 21:24:03.612526 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2302/4543] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:02 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1740 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:03.628294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d4860e1b-82ed-43b4-a118-bf1c4d817626 req-6e42f057-0e0c-4fc1-a0a8-679fdd3b3e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2779804-f38d-48cb-93a2-eba1bb0d93d2", "tag": "92dbd246-3626-42ca-9a94-1687fa746cd2"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:03.644687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d4860e1b-82ed-43b4-a118-bf1c4d817626 req-6e42f057-0e0c-4fc1-a0a8-679fdd3b3e56 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:03.645538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d4860e1b-82ed-43b4-a118-bf1c4d817626 req-6e42f057-0e0c-4fc1-a0a8-679fdd3b3e56 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:03.676681 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d4860e1b-82ed-43b4-a118-bf1c4d817626 req-6e42f057-0e0c-4fc1-a0a8-679fdd3b3e56 service nova] Creating event network-changed:92dbd246-3626-42ca-9a94-1687fa746cd2 for instance b2779804-f38d-48cb-93a2-eba1bb0d93d2 on nch2-master-1 May 28 21:24:03.684264 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d4860e1b-82ed-43b4-a118-bf1c4d817626 req-6e42f057-0e0c-4fc1-a0a8-679fdd3b3e56 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077207 May 28 21:24:03.684915 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2303/4544] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:03.721995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-57a86174-6dd5-4a63-a64b-e478a3a0d31e tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:03.732310 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-57a86174-6dd5-4a63-a64b-e478a3a0d31e tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1318 microversion: 2.1 time: 0.534653 May 28 21:24:03.744106 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2242/4545] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:03 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1318 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:03.829793 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5f0fbc10-25e6-4aad-826f-8b0f875483fa tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:03.832300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5f0fbc10-25e6-4aad-826f-8b0f875483fa tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:03.876569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f0fbc10-25e6-4aad-826f-8b0f875483fa tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:03.877188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f0fbc10-25e6-4aad-826f-8b0f875483fa tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:03.883576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f0fbc10-25e6-4aad-826f-8b0f875483fa tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:03.884037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f0fbc10-25e6-4aad-826f-8b0f875483fa tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:04.044389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5f0fbc10-25e6-4aad-826f-8b0f875483fa tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:04.053292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5f0fbc10-25e6-4aad-826f-8b0f875483fa tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:04.054893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5f0fbc10-25e6-4aad-826f-8b0f875483fa tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:04.056211 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5f0fbc10-25e6-4aad-826f-8b0f875483fa tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1372 microversion: 2.47 time: 0.233749 May 28 21:24:04.079684 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2304/4546] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:03 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1372 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:04.214649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f3dc6dcd-5e48-4a7a-a7ce-219654cbc6fb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:04.216200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f3dc6dcd-5e48-4a7a-a7ce-219654cbc6fb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:04.274082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3dc6dcd-5e48-4a7a-a7ce-219654cbc6fb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:04.280787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3dc6dcd-5e48-4a7a-a7ce-219654cbc6fb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:04.288687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3dc6dcd-5e48-4a7a-a7ce-219654cbc6fb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:04.290852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3dc6dcd-5e48-4a7a-a7ce-219654cbc6fb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:04.622968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-153867ff-5fd4-4945-9d73-26557f4b649b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:04.623792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-153867ff-5fd4-4945-9d73-26557f4b649b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:04.644250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-153867ff-5fd4-4945-9d73-26557f4b649b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:04.646408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-153867ff-5fd4-4945-9d73-26557f4b649b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:04.650069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-153867ff-5fd4-4945-9d73-26557f4b649b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:04.653453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-153867ff-5fd4-4945-9d73-26557f4b649b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:05.193545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f3dc6dcd-5e48-4a7a-a7ce-219654cbc6fb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:05.222653 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f3dc6dcd-5e48-4a7a-a7ce-219654cbc6fb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1690 microversion: 2.1 time: 1.011315 May 28 21:24:05.232696 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2243/4547] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:04 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1690 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:24:05.296696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ce2a670b-3d42-4972-a393-593331e89a49 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:05.305049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ce2a670b-3d42-4972-a393-593331e89a49 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:05.330675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce2a670b-3d42-4972-a393-593331e89a49 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:05.333873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce2a670b-3d42-4972-a393-593331e89a49 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:05.336567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce2a670b-3d42-4972-a393-593331e89a49 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:05.343101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce2a670b-3d42-4972-a393-593331e89a49 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:05.361206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:05.628719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-153867ff-5fd4-4945-9d73-26557f4b649b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:05.648302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-153867ff-5fd4-4945-9d73-26557f4b649b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:05.657452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-153867ff-5fd4-4945-9d73-26557f4b649b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:05.659736 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-153867ff-5fd4-4945-9d73-26557f4b649b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1740 microversion: 2.20 time: 1.042416 May 28 21:24:05.661149 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2305/4548] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:04 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1740 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:05.681640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eb09b9af-1e9d-45ec-a1cc-fd350d481488 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:05.682814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eb09b9af-1e9d-45ec-a1cc-fd350d481488 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:05.735023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb09b9af-1e9d-45ec-a1cc-fd350d481488 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:05.735785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb09b9af-1e9d-45ec-a1cc-fd350d481488 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:05.743229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb09b9af-1e9d-45ec-a1cc-fd350d481488 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:05.752639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb09b9af-1e9d-45ec-a1cc-fd350d481488 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:06.209022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eb09b9af-1e9d-45ec-a1cc-fd350d481488 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:06.221283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eb09b9af-1e9d-45ec-a1cc-fd350d481488 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:06.225692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eb09b9af-1e9d-45ec-a1cc-fd350d481488 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:06.228021 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eb09b9af-1e9d-45ec-a1cc-fd350d481488 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1357 microversion: 2.47 time: 0.564909 May 28 21:24:06.228861 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2306/4549] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:05 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1357 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:06.255395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bb51263c-0194-4c9d-88eb-2bdadf15c53b tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:06.259022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bb51263c-0194-4c9d-88eb-2bdadf15c53b tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:06.262900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bb51263c-0194-4c9d-88eb-2bdadf15c53b tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Searching by: {'deleted': False, 'project_id': '4c998d22b841432b828345edcf54af63'} {{(pid=143129) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:24:06.269643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb51263c-0194-4c9d-88eb-2bdadf15c53b tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:06.270558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb51263c-0194-4c9d-88eb-2bdadf15c53b tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:06.271546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb51263c-0194-4c9d-88eb-2bdadf15c53b tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:06.272445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb51263c-0194-4c9d-88eb-2bdadf15c53b tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:06.301493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ce2a670b-3d42-4972-a393-593331e89a49 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:06.313686 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ce2a670b-3d42-4972-a393-593331e89a49 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1318 microversion: 2.1 time: 1.079113 May 28 21:24:06.316993 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2244/4550] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:05 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1318 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:06.325984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-315cffbd-1516-4e89-bc57-4e73ae49b395 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:06.332065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-315cffbd-1516-4e89-bc57-4e73ae49b395 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:06.348860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-315cffbd-1516-4e89-bc57-4e73ae49b395 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:06.353076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-315cffbd-1516-4e89-bc57-4e73ae49b395 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:06.354263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-315cffbd-1516-4e89-bc57-4e73ae49b395 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:06.354879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-315cffbd-1516-4e89-bc57-4e73ae49b395 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:06.539176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.multi_cell_list [None req-bb51263c-0194-4c9d-88eb-2bdadf15c53b tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=143129) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:24:06.695041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bb51263c-0194-4c9d-88eb-2bdadf15c53b tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:06.715479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb51263c-0194-4c9d-88eb-2bdadf15c53b tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:06.715479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb51263c-0194-4c9d-88eb-2bdadf15c53b tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:06.720678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:06.749228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bb51263c-0194-4c9d-88eb-2bdadf15c53b tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:06.757076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bb51263c-0194-4c9d-88eb-2bdadf15c53b tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:06.860256 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bb51263c-0194-4c9d-88eb-2bdadf15c53b tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.613174 May 28 21:24:06.861307 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2307/4551] 10.222.0.33 () {60 vars in 1186 bytes} [Sat May 28 21:24:06 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:06.867257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e84ba155-b81c-42de-ac47-f31bbd5b98e4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:06.868091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e84ba155-b81c-42de-ac47-f31bbd5b98e4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:06.886243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e84ba155-b81c-42de-ac47-f31bbd5b98e4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:06.886951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e84ba155-b81c-42de-ac47-f31bbd5b98e4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:06.888685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e84ba155-b81c-42de-ac47-f31bbd5b98e4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:06.889736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e84ba155-b81c-42de-ac47-f31bbd5b98e4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:06.945110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-315cffbd-1516-4e89-bc57-4e73ae49b395 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:06.954671 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-315cffbd-1516-4e89-bc57-4e73ae49b395 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1695 microversion: 2.1 time: 0.634687 May 28 21:24:06.969175 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2245/4552] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:06 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1695 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:06.982920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9334de11-c081-4edf-bc34-75f1b8600353 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:06.984382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9334de11-c081-4edf-bc34-75f1b8600353 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:06.990908 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9334de11-c081-4edf-bc34-75f1b8600353 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:06.991370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9334de11-c081-4edf-bc34-75f1b8600353 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:06.992163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9334de11-c081-4edf-bc34-75f1b8600353 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:06.992614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9334de11-c081-4edf-bc34-75f1b8600353 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:07.303487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e84ba155-b81c-42de-ac47-f31bbd5b98e4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:07.312023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e84ba155-b81c-42de-ac47-f31bbd5b98e4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:07.313595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e84ba155-b81c-42de-ac47-f31bbd5b98e4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:07.314855 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e84ba155-b81c-42de-ac47-f31bbd5b98e4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1740 microversion: 2.20 time: 0.452036 May 28 21:24:07.326711 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2308/4553] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:06 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1740 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:07.326711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ef72b607-9165-4c94-86c6-deccb6ba5819 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:07.326711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ef72b607-9165-4c94-86c6-deccb6ba5819 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:07.329615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef72b607-9165-4c94-86c6-deccb6ba5819 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:07.329615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef72b607-9165-4c94-86c6-deccb6ba5819 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:07.330196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef72b607-9165-4c94-86c6-deccb6ba5819 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:07.330653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ef72b607-9165-4c94-86c6-deccb6ba5819 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:07.361550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ef72b607-9165-4c94-86c6-deccb6ba5819 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:24:07.375465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9334de11-c081-4edf-bc34-75f1b8600353 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:07.391049 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9334de11-c081-4edf-bc34-75f1b8600353 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1684 microversion: 2.1 time: 0.418240 May 28 21:24:07.392211 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2246/4554] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:06 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1684 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:07.403284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-605b5ba4-b5b4-4247-aae3-ffe1da3f9724 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:07.404282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-605b5ba4-b5b4-4247-aae3-ffe1da3f9724 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:07.406467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:07.411415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-605b5ba4-b5b4-4247-aae3-ffe1da3f9724 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:07.411899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-605b5ba4-b5b4-4247-aae3-ffe1da3f9724 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:07.412677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-605b5ba4-b5b4-4247-aae3-ffe1da3f9724 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:07.413108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-605b5ba4-b5b4-4247-aae3-ffe1da3f9724 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:07.600476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-605b5ba4-b5b4-4247-aae3-ffe1da3f9724 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:07.608523 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-605b5ba4-b5b4-4247-aae3-ffe1da3f9724 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1318 microversion: 2.1 time: 0.209566 May 28 21:24:07.618317 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2247/4555] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:07 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:07.860209 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ef72b607-9165-4c94-86c6-deccb6ba5819 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 204 len: 0 microversion: 2.47 time: 0.541795 May 28 21:24:07.861467 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2309/4556] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:24:07 2022] DELETE /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:24:07.871253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e1496027-201e-4fff-8d77-8e1f037d1062 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:07.872269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e1496027-201e-4fff-8d77-8e1f037d1062 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:07.879107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1496027-201e-4fff-8d77-8e1f037d1062 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:07.879787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1496027-201e-4fff-8d77-8e1f037d1062 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:07.880736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1496027-201e-4fff-8d77-8e1f037d1062 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:07.881400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1496027-201e-4fff-8d77-8e1f037d1062 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:07.981263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8be5e1b3-3f83-4830-b549-b080a4a6efab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:07.982026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8be5e1b3-3f83-4830-b549-b080a4a6efab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:07.994432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8be5e1b3-3f83-4830-b549-b080a4a6efab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:08.004646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8be5e1b3-3f83-4830-b549-b080a4a6efab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:08.004646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8be5e1b3-3f83-4830-b549-b080a4a6efab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:08.004646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8be5e1b3-3f83-4830-b549-b080a4a6efab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:08.016712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e1496027-201e-4fff-8d77-8e1f037d1062 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:08.027030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e1496027-201e-4fff-8d77-8e1f037d1062 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:08.045890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e1496027-201e-4fff-8d77-8e1f037d1062 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:08.047417 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e1496027-201e-4fff-8d77-8e1f037d1062 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1363 microversion: 2.47 time: 0.181725 May 28 21:24:08.050731 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2248/4557] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:07 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:08.339882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5c879344-35fe-4969-be40-e99e34db84f4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:08.341324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5c879344-35fe-4969-be40-e99e34db84f4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:08.359431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c879344-35fe-4969-be40-e99e34db84f4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:08.361307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c879344-35fe-4969-be40-e99e34db84f4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:08.362604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c879344-35fe-4969-be40-e99e34db84f4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:08.365832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c879344-35fe-4969-be40-e99e34db84f4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:08.408909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8be5e1b3-3f83-4830-b549-b080a4a6efab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:08.420486 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8be5e1b3-3f83-4830-b549-b080a4a6efab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1695 microversion: 2.1 time: 0.444209 May 28 21:24:08.429908 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2310/4558] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:07 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1695 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:24:08.429908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4906e692-8baa-4559-958b-1acc743d76ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:08.429908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4906e692-8baa-4559-958b-1acc743d76ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:08.454079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4906e692-8baa-4559-958b-1acc743d76ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:08.454564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4906e692-8baa-4559-958b-1acc743d76ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:08.455421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4906e692-8baa-4559-958b-1acc743d76ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:08.455867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4906e692-8baa-4559-958b-1acc743d76ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:08.765915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5c879344-35fe-4969-be40-e99e34db84f4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:08.780755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5c879344-35fe-4969-be40-e99e34db84f4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:08.784976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5c879344-35fe-4969-be40-e99e34db84f4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:08.789031 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5c879344-35fe-4969-be40-e99e34db84f4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1740 microversion: 2.20 time: 0.456138 May 28 21:24:08.807038 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2249/4559] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:08 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1740 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:08.823422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4906e692-8baa-4559-958b-1acc743d76ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:08.828998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7e50a72a-7362-4f6f-80fa-d91e7adda368 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:08.834206 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4906e692-8baa-4559-958b-1acc743d76ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.411802 May 28 21:24:08.835344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7e50a72a-7362-4f6f-80fa-d91e7adda368 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:08.839234 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2311/4560] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:08 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:08.863476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40584dc7-bef9-4dfa-b226-e9406c7f0a79 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1213975897"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:08.865745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e50a72a-7362-4f6f-80fa-d91e7adda368 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:08.866825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e50a72a-7362-4f6f-80fa-d91e7adda368 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:08.867860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e50a72a-7362-4f6f-80fa-d91e7adda368 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:08.869470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-40584dc7-bef9-4dfa-b226-e9406c7f0a79 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:08.871199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e50a72a-7362-4f6f-80fa-d91e7adda368 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:08.885472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40584dc7-bef9-4dfa-b226-e9406c7f0a79 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:08.891796 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40584dc7-bef9-4dfa-b226-e9406c7f0a79 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:08.893140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40584dc7-bef9-4dfa-b226-e9406c7f0a79 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:08.893824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40584dc7-bef9-4dfa-b226-e9406c7f0a79 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:09.191282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7e50a72a-7362-4f6f-80fa-d91e7adda368 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:09.206916 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7e50a72a-7362-4f6f-80fa-d91e7adda368 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1318 microversion: 2.1 time: 0.394158 May 28 21:24:09.209554 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2250/4561] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:08 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:09.225241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6ad6b655-010d-4bb6-98b4-3bda79d02116 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:09.231208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6ad6b655-010d-4bb6-98b4-3bda79d02116 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:09.257526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ad6b655-010d-4bb6-98b4-3bda79d02116 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:09.258511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ad6b655-010d-4bb6-98b4-3bda79d02116 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:09.261102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ad6b655-010d-4bb6-98b4-3bda79d02116 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:09.263268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ad6b655-010d-4bb6-98b4-3bda79d02116 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:09.417492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6ad6b655-010d-4bb6-98b4-3bda79d02116 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:09.435750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6ad6b655-010d-4bb6-98b4-3bda79d02116 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:09.439234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6ad6b655-010d-4bb6-98b4-3bda79d02116 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:09.440735 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6ad6b655-010d-4bb6-98b4-3bda79d02116 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1363 microversion: 2.47 time: 0.229305 May 28 21:24:09.441571 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2251/4562] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:09 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:09.464515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f625b3f1-c6da-4901-8598-9ddb562f8691 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:09.464515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f625b3f1-c6da-4901-8598-9ddb562f8691 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:09.474384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f625b3f1-c6da-4901-8598-9ddb562f8691 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:09.475235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f625b3f1-c6da-4901-8598-9ddb562f8691 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:09.476339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f625b3f1-c6da-4901-8598-9ddb562f8691 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:09.477033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f625b3f1-c6da-4901-8598-9ddb562f8691 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:09.698834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f625b3f1-c6da-4901-8598-9ddb562f8691 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:09.708081 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f625b3f1-c6da-4901-8598-9ddb562f8691 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1695 microversion: 2.1 time: 0.264801 May 28 21:24:09.720729 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2252/4563] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:09 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1695 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:09.814139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ef7ace2a-78cd-4f3b-ba19-e8ef247aa2f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:09.815392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ef7ace2a-78cd-4f3b-ba19-e8ef247aa2f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:09.823887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef7ace2a-78cd-4f3b-ba19-e8ef247aa2f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:09.824595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef7ace2a-78cd-4f3b-ba19-e8ef247aa2f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:09.846620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef7ace2a-78cd-4f3b-ba19-e8ef247aa2f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:09.846620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef7ace2a-78cd-4f3b-ba19-e8ef247aa2f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:09.881455 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-40584dc7-bef9-4dfa-b226-e9406c7f0a79 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 1.024871 May 28 21:24:09.882418 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2312/4564] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:24:08 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) May 28 21:24:09.904983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-22b16825-13f0-49a9-bda0-bc6b6ad66f9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:09.905741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-22b16825-13f0-49a9-bda0-bc6b6ad66f9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:09.935880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22b16825-13f0-49a9-bda0-bc6b6ad66f9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:09.935880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22b16825-13f0-49a9-bda0-bc6b6ad66f9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:09.935880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22b16825-13f0-49a9-bda0-bc6b6ad66f9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:09.935880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22b16825-13f0-49a9-bda0-bc6b6ad66f9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:10.518924 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ef7ace2a-78cd-4f3b-ba19-e8ef247aa2f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:10.527585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ef7ace2a-78cd-4f3b-ba19-e8ef247aa2f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:10.529111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ef7ace2a-78cd-4f3b-ba19-e8ef247aa2f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:10.530332 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ef7ace2a-78cd-4f3b-ba19-e8ef247aa2f2 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1740 microversion: 2.20 time: 0.720514 May 28 21:24:10.530904 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2253/4565] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:09 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1740 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:24:10.549884 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ce46cb08-5c40-4241-9f6a-acde0b0c6dad tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:10.550861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ce46cb08-5c40-4241-9f6a-acde0b0c6dad tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:10.563722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-22b16825-13f0-49a9-bda0-bc6b6ad66f9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:10.572985 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-22b16825-13f0-49a9-bda0-bc6b6ad66f9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.682822 May 28 21:24:10.578605 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2313/4566] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:09 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:10.586864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-fc78a6fc-b699-4497-a505-e8a19d218924 req-f0858d8d-f174-474b-b5da-8f19950555c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3be7259-f0f9-4940-b2b8-7eb1954ae27b", "name": "network-vif-plugged", "status": "completed", "tag": "a88a3bb1-47d4-4b86-b493-1102f69d80dc"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:10.589503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce46cb08-5c40-4241-9f6a-acde0b0c6dad tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:10.590191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce46cb08-5c40-4241-9f6a-acde0b0c6dad tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:10.591146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce46cb08-5c40-4241-9f6a-acde0b0c6dad tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:10.596800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce46cb08-5c40-4241-9f6a-acde0b0c6dad tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:10.611128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-fc78a6fc-b699-4497-a505-e8a19d218924 req-f0858d8d-f174-474b-b5da-8f19950555c3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:10.615065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-fc78a6fc-b699-4497-a505-e8a19d218924 req-f0858d8d-f174-474b-b5da-8f19950555c3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:10.640264 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-fc78a6fc-b699-4497-a505-e8a19d218924 req-f0858d8d-f174-474b-b5da-8f19950555c3 service nova] Creating event network-vif-plugged:a88a3bb1-47d4-4b86-b493-1102f69d80dc for instance b3be7259-f0f9-4940-b2b8-7eb1954ae27b on nch2-master-1 May 28 21:24:10.653375 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-fc78a6fc-b699-4497-a505-e8a19d218924 req-f0858d8d-f174-474b-b5da-8f19950555c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071261 May 28 21:24:10.654303 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2314/4567] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:10.659339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-07eab617-1d7a-4c5a-8b9b-f1dcf531b0b7 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:10.668916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-07eab617-1d7a-4c5a-8b9b-f1dcf531b0b7 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:10.681450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07eab617-1d7a-4c5a-8b9b-f1dcf531b0b7 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:10.681932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07eab617-1d7a-4c5a-8b9b-f1dcf531b0b7 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:10.682750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07eab617-1d7a-4c5a-8b9b-f1dcf531b0b7 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:10.683196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-07eab617-1d7a-4c5a-8b9b-f1dcf531b0b7 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:10.851718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-07eab617-1d7a-4c5a-8b9b-f1dcf531b0b7 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:10.861024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-07eab617-1d7a-4c5a-8b9b-f1dcf531b0b7 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:10.867575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-07eab617-1d7a-4c5a-8b9b-f1dcf531b0b7 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:10.873440 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-07eab617-1d7a-4c5a-8b9b-f1dcf531b0b7 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1363 microversion: 2.47 time: 0.216997 May 28 21:24:10.874434 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2315/4568] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:10 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:10.888261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e19bee7e-53aa-4176-80a1-1abfd0e03f79 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:10.894860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e19bee7e-53aa-4176-80a1-1abfd0e03f79 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:10.902137 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e19bee7e-53aa-4176-80a1-1abfd0e03f79 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:10.903522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e19bee7e-53aa-4176-80a1-1abfd0e03f79 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:10.904513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e19bee7e-53aa-4176-80a1-1abfd0e03f79 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:10.905296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e19bee7e-53aa-4176-80a1-1abfd0e03f79 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:10.949216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ce46cb08-5c40-4241-9f6a-acde0b0c6dad tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:10.964854 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ce46cb08-5c40-4241-9f6a-acde0b0c6dad tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1318 microversion: 2.1 time: 0.432878 May 28 21:24:10.967080 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2254/4569] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:10 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:11.193266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e19bee7e-53aa-4176-80a1-1abfd0e03f79 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:11.205412 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e19bee7e-53aa-4176-80a1-1abfd0e03f79 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1695 microversion: 2.1 time: 0.320468 May 28 21:24:11.206050 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2316/4570] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:10 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1695 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:11.549890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-63f46bd2-26ad-45a5-9525-fc822fe92486 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:11.550902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-63f46bd2-26ad-45a5-9525-fc822fe92486 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:11.566823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63f46bd2-26ad-45a5-9525-fc822fe92486 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:11.567912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63f46bd2-26ad-45a5-9525-fc822fe92486 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:11.569012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63f46bd2-26ad-45a5-9525-fc822fe92486 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:11.570273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63f46bd2-26ad-45a5-9525-fc822fe92486 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:11.602388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-27d0ae2f-9e0b-4fb9-994c-a2b706a85588 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:11.612954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-27d0ae2f-9e0b-4fb9-994c-a2b706a85588 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:11.636826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27d0ae2f-9e0b-4fb9-994c-a2b706a85588 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:11.637828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27d0ae2f-9e0b-4fb9-994c-a2b706a85588 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:11.638650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27d0ae2f-9e0b-4fb9-994c-a2b706a85588 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:11.642221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27d0ae2f-9e0b-4fb9-994c-a2b706a85588 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:12.019794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-63f46bd2-26ad-45a5-9525-fc822fe92486 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:12.029508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-63f46bd2-26ad-45a5-9525-fc822fe92486 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:12.035065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-63f46bd2-26ad-45a5-9525-fc822fe92486 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:12.045461 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-63f46bd2-26ad-45a5-9525-fc822fe92486 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1740 microversion: 2.20 time: 0.500127 May 28 21:24:12.046104 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2255/4571] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:11 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1740 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:12.050958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f2d9c37d-968a-41ba-92b1-273d2472ac0f tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:12.051802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f2d9c37d-968a-41ba-92b1-273d2472ac0f tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:12.069122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2d9c37d-968a-41ba-92b1-273d2472ac0f tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:12.069855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2d9c37d-968a-41ba-92b1-273d2472ac0f tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:12.071424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2d9c37d-968a-41ba-92b1-273d2472ac0f tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:12.074524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2d9c37d-968a-41ba-92b1-273d2472ac0f tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:12.167277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-27d0ae2f-9e0b-4fb9-994c-a2b706a85588 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:12.174426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2d9c37d-968a-41ba-92b1-273d2472ac0f tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:12.174905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2d9c37d-968a-41ba-92b1-273d2472ac0f tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:12.175381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-f2d9c37d-968a-41ba-92b1-273d2472ac0f tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lazy-loading 'fault' on Instance uuid ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:24:12.177686 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-27d0ae2f-9e0b-4fb9-994c-a2b706a85588 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.585684 May 28 21:24:12.183140 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2317/4572] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:11 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:12.193760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0aa4bb65-34e3-4c3d-887e-5a69f75c6540 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:12.194659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0aa4bb65-34e3-4c3d-887e-5a69f75c6540 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:12.212981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0aa4bb65-34e3-4c3d-887e-5a69f75c6540 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:12.214425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0aa4bb65-34e3-4c3d-887e-5a69f75c6540 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:12.215426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0aa4bb65-34e3-4c3d-887e-5a69f75c6540 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:12.216026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0aa4bb65-34e3-4c3d-887e-5a69f75c6540 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:12.300816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f2d9c37d-968a-41ba-92b1-273d2472ac0f tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:12.316510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f2d9c37d-968a-41ba-92b1-273d2472ac0f tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:12.318488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f2d9c37d-968a-41ba-92b1-273d2472ac0f tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:12.323197 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f2d9c37d-968a-41ba-92b1-273d2472ac0f tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 200 len: 1368 microversion: 2.47 time: 0.275648 May 28 21:24:12.324484 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2256/4573] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:12 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:12.338922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4dd849d7-3edf-49c7-ab6d-0e62eae68eb9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:12.339876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4dd849d7-3edf-49c7-ab6d-0e62eae68eb9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:12.354849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4dd849d7-3edf-49c7-ab6d-0e62eae68eb9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:12.358993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4dd849d7-3edf-49c7-ab6d-0e62eae68eb9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:12.360196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4dd849d7-3edf-49c7-ab6d-0e62eae68eb9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:12.360919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4dd849d7-3edf-49c7-ab6d-0e62eae68eb9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:12.620463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0aa4bb65-34e3-4c3d-887e-5a69f75c6540 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:12.633793 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0aa4bb65-34e3-4c3d-887e-5a69f75c6540 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1318 microversion: 2.1 time: 0.446163 May 28 21:24:12.634819 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2318/4574] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:12 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:12.735864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4dd849d7-3edf-49c7-ab6d-0e62eae68eb9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:12.746321 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4dd849d7-3edf-49c7-ab6d-0e62eae68eb9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1695 microversion: 2.1 time: 0.420333 May 28 21:24:12.751009 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2257/4575] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:12 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1695 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:13.076720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-97a9c911-1ff2-4eca-998b-a5e979ea29a7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:13.078427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-97a9c911-1ff2-4eca-998b-a5e979ea29a7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:13.109729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97a9c911-1ff2-4eca-998b-a5e979ea29a7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:13.115027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97a9c911-1ff2-4eca-998b-a5e979ea29a7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:13.116083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97a9c911-1ff2-4eca-998b-a5e979ea29a7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:13.116701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97a9c911-1ff2-4eca-998b-a5e979ea29a7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:13.199849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5bb05df0-4db2-4150-a6c4-298997f7aa43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:13.201657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5bb05df0-4db2-4150-a6c4-298997f7aa43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:13.208867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bb05df0-4db2-4150-a6c4-298997f7aa43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:13.209331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bb05df0-4db2-4150-a6c4-298997f7aa43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:13.210142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bb05df0-4db2-4150-a6c4-298997f7aa43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:13.210588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5bb05df0-4db2-4150-a6c4-298997f7aa43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:13.451024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-97a9c911-1ff2-4eca-998b-a5e979ea29a7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:13.469298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-97a9c911-1ff2-4eca-998b-a5e979ea29a7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:13.475454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-97a9c911-1ff2-4eca-998b-a5e979ea29a7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:13.479176 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-97a9c911-1ff2-4eca-998b-a5e979ea29a7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1740 microversion: 2.20 time: 0.418051 May 28 21:24:13.481522 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2319/4576] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:13 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1740 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:13.483898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5bb05df0-4db2-4150-a6c4-298997f7aa43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:13.501720 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5bb05df0-4db2-4150-a6c4-298997f7aa43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1689 microversion: 2.1 time: 0.301178 May 28 21:24:13.504869 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2258/4577] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:13 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1689 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:13.505630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-143ab4cc-0b97-46f0-a882-613e6415b3d6 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:13.506676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-143ab4cc-0b97-46f0-a882-613e6415b3d6 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:13.523099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-143ab4cc-0b97-46f0-a882-613e6415b3d6 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:13.523589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-143ab4cc-0b97-46f0-a882-613e6415b3d6 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:13.530617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-143ab4cc-0b97-46f0-a882-613e6415b3d6 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:13.531106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-143ab4cc-0b97-46f0-a882-613e6415b3d6 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:13.559322 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-143ab4cc-0b97-46f0-a882-613e6415b3d6 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] HTTP exception thrown: Instance ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa could not be found. May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-143ab4cc-0b97-46f0-a882-613e6415b3d6 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Request method failure captured: May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa HTTP/1.1 May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpLFTrgqsLh6MxTERDACGXQbZ9NBbwr1Aa11NFFLzaGzzs59WreK3M8dEqX3xXxIrgOzONP2gc1jF0k4786x0W5Hsd0RAhQUPjIohxK5eJo1DtWRiV9zhYkq-CUV-Qqkm10at0XxNlig_CeZEC7KEN163H43zwjEciIiP7TmqKjeLI8 May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Openstack-Nova-Api-Version: 2.47 May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 4c998d22b841432b828345edcf54af63 May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerShowV247Test-520849387 May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4c998d22b841432b828345edcf54af63", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c998d22b841432b828345edcf54af63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4c998d22b841432b828345edcf54af63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c998d22b841432b828345edcf54af63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerShowV247Test-520849387 May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 4c998d22b841432b828345edcf54af63 May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerShowV247Test-520849387 May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerShowV247Test-520849387-project May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 8149349295714b1791af1b88fb565f74 May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerShowV247Test-520849387-project May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa could not be found. May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa'} May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa could not be found. May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa could not be found. May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:24:13.561058 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:24:13.567309 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:24:13.567309 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:24:13.567309 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:24:13.567309 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:24:13.567309 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:24:13.567309 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa could not be found. May 28 21:24:13.567309 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:24:13.567309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-143ab4cc-0b97-46f0-a882-613e6415b3d6 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Returning 404 to user: Instance ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:24:13.567309 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-143ab4cc-0b97-46f0-a882-613e6415b3d6 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa" status: 404 len: 111 microversion: 2.47 time: 0.081448 May 28 21:24:13.567309 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2320/4578] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:13 2022] GET /compute/v2.1/servers/ce80ba36-9eb4-40ab-94f4-8fe4f82f78aa => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:24:13.572171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1c388a58-5938-434c-bf37-848d38307019 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:13.573808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1c388a58-5938-434c-bf37-848d38307019 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: 1e9d76d1-5a49-4a29-8fde-d394b10d11d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:13.594050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c388a58-5938-434c-bf37-848d38307019 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:13.594718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c388a58-5938-434c-bf37-848d38307019 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:13.595530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c388a58-5938-434c-bf37-848d38307019 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:13.595983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1c388a58-5938-434c-bf37-848d38307019 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:13.654342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89ce2a1a-1d0f-43e6-afd0-bc00c9259fe6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:13.655277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-89ce2a1a-1d0f-43e6-afd0-bc00c9259fe6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:13.663628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1c388a58-5938-434c-bf37-848d38307019 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: 1e9d76d1-5a49-4a29-8fde-d394b10d11d2] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:24:13.672723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89ce2a1a-1d0f-43e6-afd0-bc00c9259fe6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:13.673535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89ce2a1a-1d0f-43e6-afd0-bc00c9259fe6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:13.686049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89ce2a1a-1d0f-43e6-afd0-bc00c9259fe6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:13.686049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89ce2a1a-1d0f-43e6-afd0-bc00c9259fe6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:13.732913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:13.860960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-89ce2a1a-1d0f-43e6-afd0-bc00c9259fe6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:13.870477 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-89ce2a1a-1d0f-43e6-afd0-bc00c9259fe6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1318 microversion: 2.1 time: 0.222360 May 28 21:24:13.878529 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2321/4579] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:13 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:13.886727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7c295ade-2d37-4a90-aa64-cd27df9a6c96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:13.887808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7c295ade-2d37-4a90-aa64-cd27df9a6c96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:13.895386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c295ade-2d37-4a90-aa64-cd27df9a6c96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:13.895945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c295ade-2d37-4a90-aa64-cd27df9a6c96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:13.896879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c295ade-2d37-4a90-aa64-cd27df9a6c96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:13.897324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c295ade-2d37-4a90-aa64-cd27df9a6c96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:14.076269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7c295ade-2d37-4a90-aa64-cd27df9a6c96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:14.081585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:14.086165 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7c295ade-2d37-4a90-aa64-cd27df9a6c96 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1695 microversion: 2.1 time: 0.205769 May 28 21:24:14.086740 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2322/4580] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:13 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1695 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:14.307162 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1c388a58-5938-434c-bf37-848d38307019 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e9d76d1-5a49-4a29-8fde-d394b10d11d2" status: 204 len: 0 microversion: 2.47 time: 0.738956 May 28 21:24:14.308606 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2259/4581] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:24:13 2022] DELETE /compute/v2.1/servers/1e9d76d1-5a49-4a29-8fde-d394b10d11d2 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:24:14.318552 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6eb88133-dc01-430c-9780-cf8a4a5ab15c tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:14.319548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6eb88133-dc01-430c-9780-cf8a4a5ab15c tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: 1e9d76d1-5a49-4a29-8fde-d394b10d11d2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:14.323541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:14.330434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6eb88133-dc01-430c-9780-cf8a4a5ab15c tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:14.331256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6eb88133-dc01-430c-9780-cf8a4a5ab15c tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:14.332145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6eb88133-dc01-430c-9780-cf8a4a5ab15c tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:14.332689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6eb88133-dc01-430c-9780-cf8a4a5ab15c tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:14.506590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-15eb1707-0781-4dda-bb59-a25a2369c644 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:14.506590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-15eb1707-0781-4dda-bb59-a25a2369c644 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:14.514053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6eb88133-dc01-430c-9780-cf8a4a5ab15c tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:14.539813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15eb1707-0781-4dda-bb59-a25a2369c644 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:14.543304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6eb88133-dc01-430c-9780-cf8a4a5ab15c tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:14.545784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15eb1707-0781-4dda-bb59-a25a2369c644 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:14.547144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15eb1707-0781-4dda-bb59-a25a2369c644 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:14.549102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6eb88133-dc01-430c-9780-cf8a4a5ab15c tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:14.551427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15eb1707-0781-4dda-bb59-a25a2369c644 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:14.556237 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6eb88133-dc01-430c-9780-cf8a4a5ab15c tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/1e9d76d1-5a49-4a29-8fde-d394b10d11d2" status: 200 len: 1363 microversion: 2.47 time: 0.243191 May 28 21:24:14.560919 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2323/4582] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:14 2022] GET /compute/v2.1/servers/1e9d76d1-5a49-4a29-8fde-d394b10d11d2 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:14.577001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-65891882-7a46-4c43-b238-851acdd9972b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:14.579679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-65891882-7a46-4c43-b238-851acdd9972b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:14.605006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65891882-7a46-4c43-b238-851acdd9972b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:14.605474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65891882-7a46-4c43-b238-851acdd9972b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:14.606321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65891882-7a46-4c43-b238-851acdd9972b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:14.607797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65891882-7a46-4c43-b238-851acdd9972b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:14.876020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-15eb1707-0781-4dda-bb59-a25a2369c644 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:14.886479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-15eb1707-0781-4dda-bb59-a25a2369c644 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:14.889247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-15eb1707-0781-4dda-bb59-a25a2369c644 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:14.891128 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-15eb1707-0781-4dda-bb59-a25a2369c644 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1740 microversion: 2.20 time: 0.394845 May 28 21:24:14.903038 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2260/4583] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:14 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1740 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:14.904157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-65891882-7a46-4c43-b238-851acdd9972b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:14.909377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f07eacd1-2351-49aa-b8a8-1289827a4a58 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:14.910439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f07eacd1-2351-49aa-b8a8-1289827a4a58 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:14.917296 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-65891882-7a46-4c43-b238-851acdd9972b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1689 microversion: 2.1 time: 0.350331 May 28 21:24:14.919618 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2324/4584] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:14 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1689 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:14.928252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f07eacd1-2351-49aa-b8a8-1289827a4a58 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:14.929145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f07eacd1-2351-49aa-b8a8-1289827a4a58 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:14.930253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f07eacd1-2351-49aa-b8a8-1289827a4a58 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:14.930857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f07eacd1-2351-49aa-b8a8-1289827a4a58 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:14.932473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-5c3ffa1a-ef05-403d-b456-22a6f47a4090 req-3e897c2e-c918-4fbd-8bac-b8fdb2895896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2779804-f38d-48cb-93a2-eba1bb0d93d2", "name": "network-vif-plugged", "status": "completed", "tag": "92dbd246-3626-42ca-9a94-1687fa746cd2"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:14.953428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5c3ffa1a-ef05-403d-b456-22a6f47a4090 req-3e897c2e-c918-4fbd-8bac-b8fdb2895896 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:14.954242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5c3ffa1a-ef05-403d-b456-22a6f47a4090 req-3e897c2e-c918-4fbd-8bac-b8fdb2895896 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:14.984351 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-5c3ffa1a-ef05-403d-b456-22a6f47a4090 req-3e897c2e-c918-4fbd-8bac-b8fdb2895896 service nova] Creating event network-vif-plugged:92dbd246-3626-42ca-9a94-1687fa746cd2 for instance b2779804-f38d-48cb-93a2-eba1bb0d93d2 on nch2-master-1 May 28 21:24:14.998022 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-5c3ffa1a-ef05-403d-b456-22a6f47a4090 req-3e897c2e-c918-4fbd-8bac-b8fdb2895896 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076680 May 28 21:24:14.999216 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2325/4585] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:15.106628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-148d071b-5937-429c-bb2f-8a8baedd9afe tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:15.107887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-148d071b-5937-429c-bb2f-8a8baedd9afe tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:15.117651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-148d071b-5937-429c-bb2f-8a8baedd9afe tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:15.118620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-148d071b-5937-429c-bb2f-8a8baedd9afe tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:15.119680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-148d071b-5937-429c-bb2f-8a8baedd9afe tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:15.120359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-148d071b-5937-429c-bb2f-8a8baedd9afe tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:15.137418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f07eacd1-2351-49aa-b8a8-1289827a4a58 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:15.149182 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f07eacd1-2351-49aa-b8a8-1289827a4a58 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1318 microversion: 2.1 time: 0.242316 May 28 21:24:15.150339 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2261/4586] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:14 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:15.318107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-148d071b-5937-429c-bb2f-8a8baedd9afe tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:15.335493 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-148d071b-5937-429c-bb2f-8a8baedd9afe tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1695 microversion: 2.1 time: 0.235038 May 28 21:24:15.340670 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2326/4587] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:15 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1695 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:15.578529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f920103c-8df2-4477-94a6-e7f0760afc64 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:15.586961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f920103c-8df2-4477-94a6-e7f0760afc64 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: 1e9d76d1-5a49-4a29-8fde-d394b10d11d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:15.586961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f920103c-8df2-4477-94a6-e7f0760afc64 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:15.586961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f920103c-8df2-4477-94a6-e7f0760afc64 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:15.587561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f920103c-8df2-4477-94a6-e7f0760afc64 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:15.587892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f920103c-8df2-4477-94a6-e7f0760afc64 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:15.749018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f920103c-8df2-4477-94a6-e7f0760afc64 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:15.766934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f920103c-8df2-4477-94a6-e7f0760afc64 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:15.775891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f920103c-8df2-4477-94a6-e7f0760afc64 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:15.787237 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f920103c-8df2-4477-94a6-e7f0760afc64 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/1e9d76d1-5a49-4a29-8fde-d394b10d11d2" status: 200 len: 1363 microversion: 2.47 time: 0.206980 May 28 21:24:15.791050 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2262/4588] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:15 2022] GET /compute/v2.1/servers/1e9d76d1-5a49-4a29-8fde-d394b10d11d2 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:15.911518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-32d0df58-df43-405f-add1-d6946f3950ce tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:15.912161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-32d0df58-df43-405f-add1-d6946f3950ce tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:15.929221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32d0df58-df43-405f-add1-d6946f3950ce tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:15.930070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32d0df58-df43-405f-add1-d6946f3950ce tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:15.931004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32d0df58-df43-405f-add1-d6946f3950ce tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:15.931344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32d0df58-df43-405f-add1-d6946f3950ce tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:15.938683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3dea0ebf-65eb-411d-b86f-b8472fd635ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:15.939409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3dea0ebf-65eb-411d-b86f-b8472fd635ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:15.968418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3dea0ebf-65eb-411d-b86f-b8472fd635ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:15.969953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3dea0ebf-65eb-411d-b86f-b8472fd635ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:15.970772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3dea0ebf-65eb-411d-b86f-b8472fd635ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:15.971221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3dea0ebf-65eb-411d-b86f-b8472fd635ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:16.365920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:16.512058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3dea0ebf-65eb-411d-b86f-b8472fd635ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:16.525010 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3dea0ebf-65eb-411d-b86f-b8472fd635ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1684 microversion: 2.1 time: 0.590223 May 28 21:24:16.538185 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2263/4589] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:15 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1684 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:16.549532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-581527b6-3276-48cf-82d2-53ef6a1fa4fd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:16.550201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-581527b6-3276-48cf-82d2-53ef6a1fa4fd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:16.579865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-581527b6-3276-48cf-82d2-53ef6a1fa4fd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:16.580746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-581527b6-3276-48cf-82d2-53ef6a1fa4fd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:16.587824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-581527b6-3276-48cf-82d2-53ef6a1fa4fd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:16.588975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-581527b6-3276-48cf-82d2-53ef6a1fa4fd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:16.682996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-32d0df58-df43-405f-add1-d6946f3950ce tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:16.686849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:16.705613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-32d0df58-df43-405f-add1-d6946f3950ce tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:16.716928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-32d0df58-df43-405f-add1-d6946f3950ce tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:16.735150 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-32d0df58-df43-405f-add1-d6946f3950ce tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1740 microversion: 2.20 time: 0.821784 May 28 21:24:16.752142 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2327/4590] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:15 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1740 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:16.771036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a0186809-ea20-48bd-b273-0a0a452e6d46 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:16.771036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a0186809-ea20-48bd-b273-0a0a452e6d46 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:16.799344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0186809-ea20-48bd-b273-0a0a452e6d46 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:16.799814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0186809-ea20-48bd-b273-0a0a452e6d46 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:16.800715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0186809-ea20-48bd-b273-0a0a452e6d46 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:16.801202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0186809-ea20-48bd-b273-0a0a452e6d46 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:16.839184 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-581527b6-3276-48cf-82d2-53ef6a1fa4fd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:16.850383 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-581527b6-3276-48cf-82d2-53ef6a1fa4fd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1318 microversion: 2.1 time: 0.309054 May 28 21:24:16.851530 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2264/4591] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:16 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:16.865463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7b59c55c-3f16-4dd8-82f3-6b1022b15237 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:16.868784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7b59c55c-3f16-4dd8-82f3-6b1022b15237 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: 1e9d76d1-5a49-4a29-8fde-d394b10d11d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:16.875777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b59c55c-3f16-4dd8-82f3-6b1022b15237 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:16.876324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b59c55c-3f16-4dd8-82f3-6b1022b15237 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:16.877195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b59c55c-3f16-4dd8-82f3-6b1022b15237 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:16.877785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b59c55c-3f16-4dd8-82f3-6b1022b15237 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:16.962850 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b59c55c-3f16-4dd8-82f3-6b1022b15237 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:16.966508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b59c55c-3f16-4dd8-82f3-6b1022b15237 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:16.967202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-7b59c55c-3f16-4dd8-82f3-6b1022b15237 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lazy-loading 'fault' on Instance uuid 1e9d76d1-5a49-4a29-8fde-d394b10d11d2 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:24:17.134696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7b59c55c-3f16-4dd8-82f3-6b1022b15237 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:17.156049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7b59c55c-3f16-4dd8-82f3-6b1022b15237 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:17.165991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7b59c55c-3f16-4dd8-82f3-6b1022b15237 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8149349295714b1791af1b88fb565f74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c998d22b841432b828345edcf54af63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:17.168459 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7b59c55c-3f16-4dd8-82f3-6b1022b15237 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/1e9d76d1-5a49-4a29-8fde-d394b10d11d2" status: 200 len: 1368 microversion: 2.47 time: 0.314258 May 28 21:24:17.168459 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2265/4592] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:16 2022] GET /compute/v2.1/servers/1e9d76d1-5a49-4a29-8fde-d394b10d11d2 => generated 1368 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:17.180303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-b3354dae-1215-476d-bb7b-ab187125e3b8 req-ea86d05f-d3fd-4d59-8196-d2747f12408b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226cec1f-9523-4d1f-95cf-e2d994bd1f88", "name": "network-vif-plugged", "status": "completed", "tag": "b98532fb-0692-4c80-9ec0-a5445175d125"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:17.209733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b3354dae-1215-476d-bb7b-ab187125e3b8 req-ea86d05f-d3fd-4d59-8196-d2747f12408b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:17.210267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b3354dae-1215-476d-bb7b-ab187125e3b8 req-ea86d05f-d3fd-4d59-8196-d2747f12408b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:17.252890 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-b3354dae-1215-476d-bb7b-ab187125e3b8 req-ea86d05f-d3fd-4d59-8196-d2747f12408b service nova] Creating event network-vif-plugged:b98532fb-0692-4c80-9ec0-a5445175d125 for instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 on nch2-master-1 May 28 21:24:17.273123 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-b3354dae-1215-476d-bb7b-ab187125e3b8 req-ea86d05f-d3fd-4d59-8196-d2747f12408b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103387 May 28 21:24:17.276316 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2266/4593] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:17.303200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a0186809-ea20-48bd-b273-0a0a452e6d46 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:17.317179 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a0186809-ea20-48bd-b273-0a0a452e6d46 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1695 microversion: 2.1 time: 0.563840 May 28 21:24:17.318204 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2328/4594] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:16 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1695 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:17.544934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-28796365-2157-455a-b73a-738c34e75236 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:17.546503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-28796365-2157-455a-b73a-738c34e75236 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:17.559258 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28796365-2157-455a-b73a-738c34e75236 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:17.567722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28796365-2157-455a-b73a-738c34e75236 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:17.569357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28796365-2157-455a-b73a-738c34e75236 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:17.570040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-28796365-2157-455a-b73a-738c34e75236 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:17.757198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-17bf6688-48fb-4dce-8e50-645f30c726ee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:17.758226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-17bf6688-48fb-4dce-8e50-645f30c726ee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:17.771664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17bf6688-48fb-4dce-8e50-645f30c726ee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:17.772130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17bf6688-48fb-4dce-8e50-645f30c726ee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:17.782903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17bf6688-48fb-4dce-8e50-645f30c726ee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:17.783376 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17bf6688-48fb-4dce-8e50-645f30c726ee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:18.047729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-28796365-2157-455a-b73a-738c34e75236 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:18.074095 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-28796365-2157-455a-b73a-738c34e75236 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1684 microversion: 2.1 time: 0.525420 May 28 21:24:18.086809 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2267/4595] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:17 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1684 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:18.108261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-13fa37ab-8432-469d-ac29-7a94344f437b tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:18.109147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-13fa37ab-8432-469d-ac29-7a94344f437b tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:18.116173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13fa37ab-8432-469d-ac29-7a94344f437b tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:18.116999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13fa37ab-8432-469d-ac29-7a94344f437b tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:18.118141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13fa37ab-8432-469d-ac29-7a94344f437b tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:18.118734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13fa37ab-8432-469d-ac29-7a94344f437b tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:18.578548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-17bf6688-48fb-4dce-8e50-645f30c726ee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:18.595278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-17bf6688-48fb-4dce-8e50-645f30c726ee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:18.597273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-17bf6688-48fb-4dce-8e50-645f30c726ee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:18.604502 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-17bf6688-48fb-4dce-8e50-645f30c726ee tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1740 microversion: 2.20 time: 0.853537 May 28 21:24:18.607057 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2329/4596] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:17 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1740 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:18.616763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e207d0d3-955c-45f9-b025-5d1c0045f650 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:18.634745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e207d0d3-955c-45f9-b025-5d1c0045f650 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] [instance: 1e9d76d1-5a49-4a29-8fde-d394b10d11d2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:18.647176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-13fa37ab-8432-469d-ac29-7a94344f437b tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:18.661671 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-13fa37ab-8432-469d-ac29-7a94344f437b tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1318 microversion: 2.1 time: 0.573212 May 28 21:24:18.667155 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2268/4597] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:18 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:18.669854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e207d0d3-955c-45f9-b025-5d1c0045f650 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:18.670400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e207d0d3-955c-45f9-b025-5d1c0045f650 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:18.671608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e207d0d3-955c-45f9-b025-5d1c0045f650 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:18.672707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e207d0d3-955c-45f9-b025-5d1c0045f650 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:18.679947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-12b2ee75-72e7-4eb0-b132-45f0e56d04ba tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:18.680941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-12b2ee75-72e7-4eb0-b132-45f0e56d04ba tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:18.693900 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12b2ee75-72e7-4eb0-b132-45f0e56d04ba tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:18.694689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12b2ee75-72e7-4eb0-b132-45f0e56d04ba tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:18.695961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12b2ee75-72e7-4eb0-b132-45f0e56d04ba tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:18.696649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12b2ee75-72e7-4eb0-b132-45f0e56d04ba tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:18.752242 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-e207d0d3-955c-45f9-b025-5d1c0045f650 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] HTTP exception thrown: Instance 1e9d76d1-5a49-4a29-8fde-d394b10d11d2 could not be found. May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e207d0d3-955c-45f9-b025-5d1c0045f650 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Request method failure captured: May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/1e9d76d1-5a49-4a29-8fde-d394b10d11d2 HTTP/1.1 May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpLFTrgqsLh6MxTERDACGXQbZ9NBbwr1Aa11NFFLzaGzzs59WreK3M8dEqX3xXxIrgOzONP2gc1jF0k4786x0W5Hsd0RAhQUPjIohxK5eJo1DtWRiV9zhYkq-CUV-Qqkm10at0XxNlig_CeZEC7KEN163H43zwjEciIiP7TmqKjeLI8 May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Openstack-Nova-Api-Version: 2.47 May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 4c998d22b841432b828345edcf54af63 May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerShowV247Test-520849387 May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4c998d22b841432b828345edcf54af63", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c998d22b841432b828345edcf54af63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4c998d22b841432b828345edcf54af63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4c998d22b841432b828345edcf54af63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerShowV247Test-520849387 May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 4c998d22b841432b828345edcf54af63 May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerShowV247Test-520849387 May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerShowV247Test-520849387-project May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 8149349295714b1791af1b88fb565f74 May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerShowV247Test-520849387-project May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 1e9d76d1-5a49-4a29-8fde-d394b10d11d2 could not be found. May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '1e9d76d1-5a49-4a29-8fde-d394b10d11d2'} May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e9d76d1-5a49-4a29-8fde-d394b10d11d2 could not be found. May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e9d76d1-5a49-4a29-8fde-d394b10d11d2 could not be found. May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:24:18.758708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:24:18.763790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:24:18.763790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:24:18.763790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:24:18.763790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:24:18.763790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:24:18.763790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e9d76d1-5a49-4a29-8fde-d394b10d11d2 could not be found. May 28 21:24:18.763790 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:24:18.765563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e207d0d3-955c-45f9-b025-5d1c0045f650 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] Returning 404 to user: Instance 1e9d76d1-5a49-4a29-8fde-d394b10d11d2 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:24:18.773318 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e207d0d3-955c-45f9-b025-5d1c0045f650 tempest-ServerShowV247Test-520849387 tempest-ServerShowV247Test-520849387-project] 10.222.0.33 "GET /compute/v2.1/servers/1e9d76d1-5a49-4a29-8fde-d394b10d11d2" status: 404 len: 111 microversion: 2.47 time: 0.161414 May 28 21:24:18.774250 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2330/4598] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:18 2022] GET /compute/v2.1/servers/1e9d76d1-5a49-4a29-8fde-d394b10d11d2 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:24:18.963119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-12b2ee75-72e7-4eb0-b132-45f0e56d04ba tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:18.976442 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-12b2ee75-72e7-4eb0-b132-45f0e56d04ba tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1695 microversion: 2.1 time: 0.307687 May 28 21:24:18.996256 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2269/4599] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:18 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1695 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:19.094146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aad44261-1bc1-4d4c-bd7e-6c0edafb482d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:19.095608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aad44261-1bc1-4d4c-bd7e-6c0edafb482d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:19.115800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aad44261-1bc1-4d4c-bd7e-6c0edafb482d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:19.116604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aad44261-1bc1-4d4c-bd7e-6c0edafb482d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:19.121069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aad44261-1bc1-4d4c-bd7e-6c0edafb482d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:19.127059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aad44261-1bc1-4d4c-bd7e-6c0edafb482d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:19.405906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aad44261-1bc1-4d4c-bd7e-6c0edafb482d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:19.425642 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aad44261-1bc1-4d4c-bd7e-6c0edafb482d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1684 microversion: 2.1 time: 0.336566 May 28 21:24:19.431031 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2331/4600] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:19 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1684 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:19.626942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-86df667f-4976-4ee0-af6b-c48ff23b56fb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:19.629217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-86df667f-4976-4ee0-af6b-c48ff23b56fb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:19.655470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86df667f-4976-4ee0-af6b-c48ff23b56fb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:19.656727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86df667f-4976-4ee0-af6b-c48ff23b56fb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:19.657787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86df667f-4976-4ee0-af6b-c48ff23b56fb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:19.661469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-86df667f-4976-4ee0-af6b-c48ff23b56fb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:19.690439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2efdb276-2301-43de-86b0-50e8d80749cd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:19.690439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2efdb276-2301-43de-86b0-50e8d80749cd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:19.725184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2efdb276-2301-43de-86b0-50e8d80749cd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:19.734284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2efdb276-2301-43de-86b0-50e8d80749cd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:19.735598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2efdb276-2301-43de-86b0-50e8d80749cd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:19.739471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2efdb276-2301-43de-86b0-50e8d80749cd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:20.378323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-86df667f-4976-4ee0-af6b-c48ff23b56fb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:20.402277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-86df667f-4976-4ee0-af6b-c48ff23b56fb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:20.405716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-86df667f-4976-4ee0-af6b-c48ff23b56fb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:20.417329 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-86df667f-4976-4ee0-af6b-c48ff23b56fb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1740 microversion: 2.20 time: 0.787405 May 28 21:24:20.418522 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2270/4601] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:19 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1740 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:20.437396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ab19077-ce0b-44a4-9c8b-1e5ba5bad844 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:20.438405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8ab19077-ce0b-44a4-9c8b-1e5ba5bad844 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:20.463969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ab19077-ce0b-44a4-9c8b-1e5ba5bad844 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:20.464346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ab19077-ce0b-44a4-9c8b-1e5ba5bad844 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:20.468253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ab19077-ce0b-44a4-9c8b-1e5ba5bad844 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:20.468822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ab19077-ce0b-44a4-9c8b-1e5ba5bad844 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:20.550897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2efdb276-2301-43de-86b0-50e8d80749cd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:20.555639 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2efdb276-2301-43de-86b0-50e8d80749cd tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 200 len: 1507 microversion: 2.1 time: 0.874822 May 28 21:24:20.565468 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2332/4602] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:19 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 1507 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:20.567928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9868ccd6-2756-4501-b41a-bb1f4e30e617 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:20.571855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9868ccd6-2756-4501-b41a-bb1f4e30e617 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:20.595820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9868ccd6-2756-4501-b41a-bb1f4e30e617 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:20.596302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9868ccd6-2756-4501-b41a-bb1f4e30e617 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:20.597289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9868ccd6-2756-4501-b41a-bb1f4e30e617 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:20.597733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9868ccd6-2756-4501-b41a-bb1f4e30e617 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:21.016949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9868ccd6-2756-4501-b41a-bb1f4e30e617 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:21.027078 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9868ccd6-2756-4501-b41a-bb1f4e30e617 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1684 microversion: 2.1 time: 0.457528 May 28 21:24:21.029373 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2333/4603] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:20 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1684 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:21.036050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e12bacb8-2cb4-4b31-b6f2-3ee0928211ef tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:21.036680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e12bacb8-2cb4-4b31-b6f2-3ee0928211ef tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b3be7259-f0f9-4940-b2b8-7eb1954ae27b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:21.048113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e12bacb8-2cb4-4b31-b6f2-3ee0928211ef tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:21.048113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e12bacb8-2cb4-4b31-b6f2-3ee0928211ef tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:21.048113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e12bacb8-2cb4-4b31-b6f2-3ee0928211ef tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:21.048113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e12bacb8-2cb4-4b31-b6f2-3ee0928211ef tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:21.049782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8ab19077-ce0b-44a4-9c8b-1e5ba5bad844 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:21.076923 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8ab19077-ce0b-44a4-9c8b-1e5ba5bad844 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1695 microversion: 2.1 time: 0.656299 May 28 21:24:21.086727 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2271/4604] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:20 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1695 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:21.332197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e12bacb8-2cb4-4b31-b6f2-3ee0928211ef tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:21.341167 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e12bacb8-2cb4-4b31-b6f2-3ee0928211ef tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b3be7259-f0f9-4940-b2b8-7eb1954ae27b" status: 200 len: 1506 microversion: 2.1 time: 0.310618 May 28 21:24:21.353597 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2334/4605] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:21 2022] GET /compute/v2.1/servers/b3be7259-f0f9-4940-b2b8-7eb1954ae27b => generated 1506 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:21.374098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7d75b3f5-10a4-4fef-b41c-35cf031f42a9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:21.377074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7d75b3f5-10a4-4fef-b41c-35cf031f42a9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b3be7259-f0f9-4940-b2b8-7eb1954ae27b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:21.395827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d75b3f5-10a4-4fef-b41c-35cf031f42a9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:21.396290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d75b3f5-10a4-4fef-b41c-35cf031f42a9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:21.397094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d75b3f5-10a4-4fef-b41c-35cf031f42a9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:21.406091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d75b3f5-10a4-4fef-b41c-35cf031f42a9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:21.438745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cfde2692-ce7b-4098-b5bf-feea94849966 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:21.439766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cfde2692-ce7b-4098-b5bf-feea94849966 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:21.449983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cfde2692-ce7b-4098-b5bf-feea94849966 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:21.455928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cfde2692-ce7b-4098-b5bf-feea94849966 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:21.460273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cfde2692-ce7b-4098-b5bf-feea94849966 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:21.467044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cfde2692-ce7b-4098-b5bf-feea94849966 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:21.508212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7d75b3f5-10a4-4fef-b41c-35cf031f42a9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b3be7259-f0f9-4940-b2b8-7eb1954ae27b] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:24:22.015596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cfde2692-ce7b-4098-b5bf-feea94849966 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:22.028939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cfde2692-ce7b-4098-b5bf-feea94849966 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:22.033180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cfde2692-ce7b-4098-b5bf-feea94849966 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:22.034419 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cfde2692-ce7b-4098-b5bf-feea94849966 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1740 microversion: 2.20 time: 0.599569 May 28 21:24:22.034990 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2335/4606] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:21 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1740 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:22.039972 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7d75b3f5-10a4-4fef-b41c-35cf031f42a9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b3be7259-f0f9-4940-b2b8-7eb1954ae27b" status: 204 len: 0 microversion: 2.1 time: 0.670475 May 28 21:24:22.042750 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2272/4607] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:24:21 2022] DELETE /compute/v2.1/servers/b3be7259-f0f9-4940-b2b8-7eb1954ae27b => generated 0 bytes in 673 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:24:22.063114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d105e93f-f690-4a9f-9180-ad1e3a1ba7ed tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:22.063744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d105e93f-f690-4a9f-9180-ad1e3a1ba7ed tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:22.080571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d105e93f-f690-4a9f-9180-ad1e3a1ba7ed tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:22.081035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d105e93f-f690-4a9f-9180-ad1e3a1ba7ed tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:22.081827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d105e93f-f690-4a9f-9180-ad1e3a1ba7ed tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:22.083452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-840d2a18-2600-42b0-8aad-a941706e2cd8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:22.084073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-840d2a18-2600-42b0-8aad-a941706e2cd8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:22.089708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d105e93f-f690-4a9f-9180-ad1e3a1ba7ed tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:22.111080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-840d2a18-2600-42b0-8aad-a941706e2cd8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:22.111548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-840d2a18-2600-42b0-8aad-a941706e2cd8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:22.117498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-840d2a18-2600-42b0-8aad-a941706e2cd8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:22.117956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-840d2a18-2600-42b0-8aad-a941706e2cd8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:22.197422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d105e93f-f690-4a9f-9180-ad1e3a1ba7ed tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:24:22.308038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:22.502553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-840d2a18-2600-42b0-8aad-a941706e2cd8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:22.519172 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-840d2a18-2600-42b0-8aad-a941706e2cd8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1684 microversion: 2.1 time: 0.447936 May 28 21:24:22.522405 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2336/4608] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:22 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1684 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:22.545089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1400e6aa-dc44-4397-bc45-8c72542b0aa8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:22.546246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1400e6aa-dc44-4397-bc45-8c72542b0aa8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:22.566498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1400e6aa-dc44-4397-bc45-8c72542b0aa8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:22.566962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1400e6aa-dc44-4397-bc45-8c72542b0aa8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:22.568733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1400e6aa-dc44-4397-bc45-8c72542b0aa8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:22.569182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1400e6aa-dc44-4397-bc45-8c72542b0aa8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:22.606536 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d105e93f-f690-4a9f-9180-ad1e3a1ba7ed tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 204 len: 0 microversion: 2.1 time: 0.547970 May 28 21:24:22.607512 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2273/4609] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:24:22 2022] DELETE /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:24:22.616434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e4d13f18-40a8-4405-9ec2-832647697e67 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:22.617072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e4d13f18-40a8-4405-9ec2-832647697e67 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b3be7259-f0f9-4940-b2b8-7eb1954ae27b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:22.658114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4d13f18-40a8-4405-9ec2-832647697e67 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:22.658637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4d13f18-40a8-4405-9ec2-832647697e67 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:22.659459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4d13f18-40a8-4405-9ec2-832647697e67 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:22.660798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4d13f18-40a8-4405-9ec2-832647697e67 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:23.000747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1400e6aa-dc44-4397-bc45-8c72542b0aa8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:23.016150 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1400e6aa-dc44-4397-bc45-8c72542b0aa8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1694 microversion: 2.1 time: 0.492297 May 28 21:24:23.016746 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2337/4610] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:22 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1694 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:23.054775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-62708bd7-cfde-4be3-9912-26a6f6c45e15 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:23.056075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-62708bd7-cfde-4be3-9912-26a6f6c45e15 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:23.112022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62708bd7-cfde-4be3-9912-26a6f6c45e15 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:23.114458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62708bd7-cfde-4be3-9912-26a6f6c45e15 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:23.115514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62708bd7-cfde-4be3-9912-26a6f6c45e15 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:23.116180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62708bd7-cfde-4be3-9912-26a6f6c45e15 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:23.138194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e4d13f18-40a8-4405-9ec2-832647697e67 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:23.148716 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e4d13f18-40a8-4405-9ec2-832647697e67 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b3be7259-f0f9-4940-b2b8-7eb1954ae27b" status: 200 len: 1512 microversion: 2.1 time: 0.537103 May 28 21:24:23.149708 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2274/4611] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:22 2022] GET /compute/v2.1/servers/b3be7259-f0f9-4940-b2b8-7eb1954ae27b => generated 1512 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:23.388446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-62708bd7-cfde-4be3-9912-26a6f6c45e15 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:23.404987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-62708bd7-cfde-4be3-9912-26a6f6c45e15 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:23.406854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-62708bd7-cfde-4be3-9912-26a6f6c45e15 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:23.408271 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-62708bd7-cfde-4be3-9912-26a6f6c45e15 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1740 microversion: 2.20 time: 0.357520 May 28 21:24:23.418274 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2338/4612] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:23 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1740 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:24:23.540516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-350cd5c4-6ceb-41a0-9fe8-7dec11cb041c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:23.541412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-350cd5c4-6ceb-41a0-9fe8-7dec11cb041c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:23.549493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-350cd5c4-6ceb-41a0-9fe8-7dec11cb041c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:23.550099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-350cd5c4-6ceb-41a0-9fe8-7dec11cb041c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:23.550919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-350cd5c4-6ceb-41a0-9fe8-7dec11cb041c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:23.551367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-350cd5c4-6ceb-41a0-9fe8-7dec11cb041c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:23.701532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-350cd5c4-6ceb-41a0-9fe8-7dec11cb041c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:23.709613 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-350cd5c4-6ceb-41a0-9fe8-7dec11cb041c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1684 microversion: 2.1 time: 0.174180 May 28 21:24:23.710628 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2275/4613] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:23 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1684 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:24.036707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2e54b57d-2e55-47fc-814c-48a631ae4f34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:24.037328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2e54b57d-2e55-47fc-814c-48a631ae4f34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:24.043945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e54b57d-2e55-47fc-814c-48a631ae4f34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:24.044407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e54b57d-2e55-47fc-814c-48a631ae4f34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:24.045184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e54b57d-2e55-47fc-814c-48a631ae4f34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:24.045633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e54b57d-2e55-47fc-814c-48a631ae4f34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:24.171253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1804887a-d9b3-4d0a-aa8f-ad67c943db80 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:24.171862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1804887a-d9b3-4d0a-aa8f-ad67c943db80 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b3be7259-f0f9-4940-b2b8-7eb1954ae27b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:24.179179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1804887a-d9b3-4d0a-aa8f-ad67c943db80 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:24.179741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1804887a-d9b3-4d0a-aa8f-ad67c943db80 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:24.180556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1804887a-d9b3-4d0a-aa8f-ad67c943db80 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:24.181254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1804887a-d9b3-4d0a-aa8f-ad67c943db80 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:24.193394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2e54b57d-2e55-47fc-814c-48a631ae4f34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:24.202388 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2e54b57d-2e55-47fc-814c-48a631ae4f34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1694 microversion: 2.1 time: 0.169283 May 28 21:24:24.203123 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2339/4614] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:24 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:24.437639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f9bb71d9-5fbf-474a-ae3f-8ff95f33b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:24.438296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f9bb71d9-5fbf-474a-ae3f-8ff95f33b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:24.449014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9bb71d9-5fbf-474a-ae3f-8ff95f33b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:24.449713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9bb71d9-5fbf-474a-ae3f-8ff95f33b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:24.452486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9bb71d9-5fbf-474a-ae3f-8ff95f33b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:24.453160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9bb71d9-5fbf-474a-ae3f-8ff95f33b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:24.730087 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1804887a-d9b3-4d0a-aa8f-ad67c943db80 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:24.747516 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1804887a-d9b3-4d0a-aa8f-ad67c943db80 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b3be7259-f0f9-4940-b2b8-7eb1954ae27b" status: 200 len: 1512 microversion: 2.1 time: 0.578789 May 28 21:24:24.751185 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2276/4615] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:24 2022] GET /compute/v2.1/servers/b3be7259-f0f9-4940-b2b8-7eb1954ae27b => generated 1512 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:24:24.756801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ab8d28b2-6933-4646-a036-1fb2d04742d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:24.757810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ab8d28b2-6933-4646-a036-1fb2d04742d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:24.766596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab8d28b2-6933-4646-a036-1fb2d04742d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:24.767473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab8d28b2-6933-4646-a036-1fb2d04742d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:24.768540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab8d28b2-6933-4646-a036-1fb2d04742d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:24.769217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab8d28b2-6933-4646-a036-1fb2d04742d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:25.607176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f9bb71d9-5fbf-474a-ae3f-8ff95f33b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:25.611375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:25.620920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f9bb71d9-5fbf-474a-ae3f-8ff95f33b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:25.629419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f9bb71d9-5fbf-474a-ae3f-8ff95f33b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:25.636193 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f9bb71d9-5fbf-474a-ae3f-8ff95f33b2b7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1740 microversion: 2.20 time: 1.200620 May 28 21:24:25.637534 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2340/4616] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:24 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1740 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:24:25.649704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-90ef4993-68f3-47ca-9550-29c956a88a87 req-fcc1059e-339d-4987-a65a-27b1071fdfe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7a3bfa-2077-4b86-8670-bd2428861958", "name": "network-vif-unplugged", "status": "completed", "tag": "31f937d0-8453-4ce1-8d41-4a95e908e103"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:25.668270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-90ef4993-68f3-47ca-9550-29c956a88a87 req-fcc1059e-339d-4987-a65a-27b1071fdfe7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:25.669193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-90ef4993-68f3-47ca-9550-29c956a88a87 req-fcc1059e-339d-4987-a65a-27b1071fdfe7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:25.712564 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-90ef4993-68f3-47ca-9550-29c956a88a87 req-fcc1059e-339d-4987-a65a-27b1071fdfe7 service nova] Creating event network-vif-unplugged:31f937d0-8453-4ce1-8d41-4a95e908e103 for instance 6a7a3bfa-2077-4b86-8670-bd2428861958 on nch2-master-1 May 28 21:24:25.725905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-90ef4993-68f3-47ca-9550-29c956a88a87 req-fcc1059e-339d-4987-a65a-27b1071fdfe7 service nova] Instance 6a7a3bfa-2077-4b86-8670-bd2428861958 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:24:25.747636 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-90ef4993-68f3-47ca-9550-29c956a88a87 req-fcc1059e-339d-4987-a65a-27b1071fdfe7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106550 May 28 21:24:25.748532 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2341/4617] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:25.755258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-17a626dd-7a5c-4e35-a377-c6c7d45d1e33 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:25.756168 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-17a626dd-7a5c-4e35-a377-c6c7d45d1e33 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:25.781166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17a626dd-7a5c-4e35-a377-c6c7d45d1e33 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:25.781635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17a626dd-7a5c-4e35-a377-c6c7d45d1e33 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:25.782493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17a626dd-7a5c-4e35-a377-c6c7d45d1e33 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:25.782941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17a626dd-7a5c-4e35-a377-c6c7d45d1e33 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:27.084552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ab8d28b2-6933-4646-a036-1fb2d04742d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:27.098999 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ab8d28b2-6933-4646-a036-1fb2d04742d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1684 microversion: 2.1 time: 2.341292 May 28 21:24:27.113397 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2277/4618] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:24 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1684 bytes in 2359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:27.134910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-42c595a9-cf3f-4a43-9fb5-d0d1245009f8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:27.149980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-42c595a9-cf3f-4a43-9fb5-d0d1245009f8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b3be7259-f0f9-4940-b2b8-7eb1954ae27b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:27.170909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42c595a9-cf3f-4a43-9fb5-d0d1245009f8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:27.175931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42c595a9-cf3f-4a43-9fb5-d0d1245009f8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:27.176782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42c595a9-cf3f-4a43-9fb5-d0d1245009f8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:27.177230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-42c595a9-cf3f-4a43-9fb5-d0d1245009f8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:27.731513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-17a626dd-7a5c-4e35-a377-c6c7d45d1e33 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:27.761507 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-17a626dd-7a5c-4e35-a377-c6c7d45d1e33 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1694 microversion: 2.1 time: 2.007725 May 28 21:24:27.762693 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2342/4619] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:25 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1694 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:27.778532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-b545b107-2ddf-4e99-9ae1-93bd84dab0d5 req-a865fbd0-1185-4030-8a9b-0b3ac194eb08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3be7259-f0f9-4940-b2b8-7eb1954ae27b", "name": "network-vif-unplugged", "status": "completed", "tag": "a88a3bb1-47d4-4b86-b493-1102f69d80dc"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:27.797278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b545b107-2ddf-4e99-9ae1-93bd84dab0d5 req-a865fbd0-1185-4030-8a9b-0b3ac194eb08 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:27.798867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b545b107-2ddf-4e99-9ae1-93bd84dab0d5 req-a865fbd0-1185-4030-8a9b-0b3ac194eb08 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:27.839930 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b545b107-2ddf-4e99-9ae1-93bd84dab0d5 req-a865fbd0-1185-4030-8a9b-0b3ac194eb08 service nova] Creating event network-vif-unplugged:a88a3bb1-47d4-4b86-b493-1102f69d80dc for instance b3be7259-f0f9-4940-b2b8-7eb1954ae27b on nch2-master-1 May 28 21:24:27.856227 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-b545b107-2ddf-4e99-9ae1-93bd84dab0d5 req-a865fbd0-1185-4030-8a9b-0b3ac194eb08 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091459 May 28 21:24:27.863390 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2343/4620] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:27.894208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-25932d32-e595-49e6-88d9-b314fef3af09 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:27.895656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-25932d32-e595-49e6-88d9-b314fef3af09 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:27.927439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25932d32-e595-49e6-88d9-b314fef3af09 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:27.929823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25932d32-e595-49e6-88d9-b314fef3af09 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:27.932899 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25932d32-e595-49e6-88d9-b314fef3af09 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:27.937489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25932d32-e595-49e6-88d9-b314fef3af09 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:28.043951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-42c595a9-cf3f-4a43-9fb5-d0d1245009f8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:28.057857 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-42c595a9-cf3f-4a43-9fb5-d0d1245009f8 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b3be7259-f0f9-4940-b2b8-7eb1954ae27b" status: 200 len: 1512 microversion: 2.1 time: 0.940997 May 28 21:24:28.058822 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2278/4621] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:27 2022] GET /compute/v2.1/servers/b3be7259-f0f9-4940-b2b8-7eb1954ae27b => generated 1512 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:28.116604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7284ee34-ef93-4a67-8d14-d466400c2dc2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:28.117934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7284ee34-ef93-4a67-8d14-d466400c2dc2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:28.130986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7284ee34-ef93-4a67-8d14-d466400c2dc2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:28.139151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7284ee34-ef93-4a67-8d14-d466400c2dc2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:28.139151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7284ee34-ef93-4a67-8d14-d466400c2dc2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:28.139151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7284ee34-ef93-4a67-8d14-d466400c2dc2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:28.936518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-25932d32-e595-49e6-88d9-b314fef3af09 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:28.951582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-25932d32-e595-49e6-88d9-b314fef3af09 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:28.955213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-25932d32-e595-49e6-88d9-b314fef3af09 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:28.962272 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-25932d32-e595-49e6-88d9-b314fef3af09 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1722 microversion: 2.20 time: 1.095429 May 28 21:24:28.963768 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2344/4622] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:27 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1722 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:28.976232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-13ac6175-01f1-4abf-81cd-e061cfdfc3c7 req-c8b3fe64-d437-466c-a900-6a93a9eeb9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a7a3bfa-2077-4b86-8670-bd2428861958", "tag": "31f937d0-8453-4ce1-8d41-4a95e908e103"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:28.996272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-13ac6175-01f1-4abf-81cd-e061cfdfc3c7 req-c8b3fe64-d437-466c-a900-6a93a9eeb9c0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:28.999530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-13ac6175-01f1-4abf-81cd-e061cfdfc3c7 req-c8b3fe64-d437-466c-a900-6a93a9eeb9c0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:29.037189 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-13ac6175-01f1-4abf-81cd-e061cfdfc3c7 req-c8b3fe64-d437-466c-a900-6a93a9eeb9c0 service nova] Creating event network-changed:31f937d0-8453-4ce1-8d41-4a95e908e103 for instance 6a7a3bfa-2077-4b86-8670-bd2428861958 on nch2-master-1 May 28 21:24:29.049973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-13ac6175-01f1-4abf-81cd-e061cfdfc3c7 req-c8b3fe64-d437-466c-a900-6a93a9eeb9c0 service nova] Instance 6a7a3bfa-2077-4b86-8670-bd2428861958 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:24:29.098989 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-13ac6175-01f1-4abf-81cd-e061cfdfc3c7 req-c8b3fe64-d437-466c-a900-6a93a9eeb9c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133128 May 28 21:24:29.099910 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2345/4623] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:29.120587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-64e29aa0-1e97-44b6-8d20-317d86534d21 req-9a931f43-2005-44ea-add9-959ceb5346f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3be7259-f0f9-4940-b2b8-7eb1954ae27b", "name": "network-vif-deleted", "tag": "a88a3bb1-47d4-4b86-b493-1102f69d80dc"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:29.138592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-64e29aa0-1e97-44b6-8d20-317d86534d21 req-9a931f43-2005-44ea-add9-959ceb5346f5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:29.140561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-64e29aa0-1e97-44b6-8d20-317d86534d21 req-9a931f43-2005-44ea-add9-959ceb5346f5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:29.169239 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-64e29aa0-1e97-44b6-8d20-317d86534d21 req-9a931f43-2005-44ea-add9-959ceb5346f5 service nova] Creating event network-vif-deleted:a88a3bb1-47d4-4b86-b493-1102f69d80dc for instance b3be7259-f0f9-4940-b2b8-7eb1954ae27b on nch2-master-1 May 28 21:24:29.177676 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-64e29aa0-1e97-44b6-8d20-317d86534d21 req-9a931f43-2005-44ea-add9-959ceb5346f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068693 May 28 21:24:29.182488 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2346/4624] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:29.188103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-57c0afec-8493-4e4c-b828-7835b2f3bad0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:29.189186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-57c0afec-8493-4e4c-b828-7835b2f3bad0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:29.196103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57c0afec-8493-4e4c-b828-7835b2f3bad0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:29.196982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57c0afec-8493-4e4c-b828-7835b2f3bad0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:29.199038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57c0afec-8493-4e4c-b828-7835b2f3bad0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:29.199663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57c0afec-8493-4e4c-b828-7835b2f3bad0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:29.295813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7284ee34-ef93-4a67-8d14-d466400c2dc2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:29.313494 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7284ee34-ef93-4a67-8d14-d466400c2dc2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1684 microversion: 2.1 time: 1.200723 May 28 21:24:29.314852 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2279/4625] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:28 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1684 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:29.322547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-364a47f8-d412-40f4-b316-ba72bb1645f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:29.324225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-364a47f8-d412-40f4-b316-ba72bb1645f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b3be7259-f0f9-4940-b2b8-7eb1954ae27b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:29.333586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-364a47f8-d412-40f4-b316-ba72bb1645f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:29.335379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-364a47f8-d412-40f4-b316-ba72bb1645f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:29.336440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-364a47f8-d412-40f4-b316-ba72bb1645f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:29.337129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-364a47f8-d412-40f4-b316-ba72bb1645f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:29.616414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-364a47f8-d412-40f4-b316-ba72bb1645f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7c1a400e0dd462da3bb33b7e3fe57fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3112549c42f41cda4a54ec51c131023', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:29.627347 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-364a47f8-d412-40f4-b316-ba72bb1645f9 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b3be7259-f0f9-4940-b2b8-7eb1954ae27b" status: 200 len: 1303 microversion: 2.1 time: 0.311126 May 28 21:24:29.638683 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2280/4626] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:29 2022] GET /compute/v2.1/servers/b3be7259-f0f9-4940-b2b8-7eb1954ae27b => generated 1303 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:29.684125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-57c0afec-8493-4e4c-b828-7835b2f3bad0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:29.694244 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-57c0afec-8493-4e4c-b828-7835b2f3bad0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1692 microversion: 2.1 time: 0.510104 May 28 21:24:29.699404 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2347/4627] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:29 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1692 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:29.930752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-afba7d49-b6be-49d1-9d0e-b993018fde0f req-ee939fa6-2b9a-4a90-b13f-221497c0ddd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2779804-f38d-48cb-93a2-eba1bb0d93d2", "name": "network-vif-unplugged", "status": "completed", "tag": "92dbd246-3626-42ca-9a94-1687fa746cd2"}, {"server_uuid": "cd20dd19-f26b-4e32-9114-715558d5aa3b", "name": "network-vif-unplugged", "status": "completed", "tag": "4c95deb6-3882-40f5-af0e-fd2149216c59"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:29.949001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-afba7d49-b6be-49d1-9d0e-b993018fde0f req-ee939fa6-2b9a-4a90-b13f-221497c0ddd9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:29.963000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-afba7d49-b6be-49d1-9d0e-b993018fde0f req-ee939fa6-2b9a-4a90-b13f-221497c0ddd9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:29.999737 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-afba7d49-b6be-49d1-9d0e-b993018fde0f req-ee939fa6-2b9a-4a90-b13f-221497c0ddd9 service nova] Creating event network-vif-unplugged:92dbd246-3626-42ca-9a94-1687fa746cd2 for instance b2779804-f38d-48cb-93a2-eba1bb0d93d2 on nch2-master-1 May 28 21:24:30.008102 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-afba7d49-b6be-49d1-9d0e-b993018fde0f req-ee939fa6-2b9a-4a90-b13f-221497c0ddd9 service nova] Creating event network-vif-unplugged:4c95deb6-3882-40f5-af0e-fd2149216c59 for instance cd20dd19-f26b-4e32-9114-715558d5aa3b on nch1-master-1 May 28 21:24:30.057862 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-afba7d49-b6be-49d1-9d0e-b993018fde0f req-ee939fa6-2b9a-4a90-b13f-221497c0ddd9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.130010 May 28 21:24:30.066621 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2281/4628] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:30.332232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8bcf8638-14c4-4b6e-8ffc-21de52c58f1e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:30.333257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8bcf8638-14c4-4b6e-8ffc-21de52c58f1e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:30.343653 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8bcf8638-14c4-4b6e-8ffc-21de52c58f1e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:30.344451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8bcf8638-14c4-4b6e-8ffc-21de52c58f1e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:30.346747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8bcf8638-14c4-4b6e-8ffc-21de52c58f1e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:30.348102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8bcf8638-14c4-4b6e-8ffc-21de52c58f1e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:30.431593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8669d849-73b6-4a10-8580-d62f5ad6f575 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:30.434762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8669d849-73b6-4a10-8580-d62f5ad6f575 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:30.463999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8669d849-73b6-4a10-8580-d62f5ad6f575 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:30.466110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8669d849-73b6-4a10-8580-d62f5ad6f575 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:30.467009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8669d849-73b6-4a10-8580-d62f5ad6f575 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:30.467468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8669d849-73b6-4a10-8580-d62f5ad6f575 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:31.549202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8669d849-73b6-4a10-8580-d62f5ad6f575 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:31.582078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8669d849-73b6-4a10-8580-d62f5ad6f575 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:31.589262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8669d849-73b6-4a10-8580-d62f5ad6f575 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:31.593927 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8669d849-73b6-4a10-8580-d62f5ad6f575 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1722 microversion: 2.20 time: 1.615272 May 28 21:24:31.607808 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2348/4629] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:29 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1722 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:31.631598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b207ca45-3422-468a-b54d-e7b52d8730e6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:31.632798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b207ca45-3422-468a-b54d-e7b52d8730e6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b3be7259-f0f9-4940-b2b8-7eb1954ae27b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:31.646910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8bcf8638-14c4-4b6e-8ffc-21de52c58f1e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:31.647498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b207ca45-3422-468a-b54d-e7b52d8730e6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:31.647933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b207ca45-3422-468a-b54d-e7b52d8730e6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:31.648790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b207ca45-3422-468a-b54d-e7b52d8730e6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:31.649244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b207ca45-3422-468a-b54d-e7b52d8730e6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:31.660176 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8bcf8638-14c4-4b6e-8ffc-21de52c58f1e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1684 microversion: 2.1 time: 1.332485 May 28 21:24:31.670839 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-b207ca45-3422-468a-b54d-e7b52d8730e6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] HTTP exception thrown: Instance b3be7259-f0f9-4940-b2b8-7eb1954ae27b could not be found. May 28 21:24:31.677090 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2282/4630] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:30 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1684 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b207ca45-3422-468a-b54d-e7b52d8730e6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Request method failure captured: May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/b3be7259-f0f9-4940-b2b8-7eb1954ae27b HTTP/1.1 May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpLMuGk5kxE3WodBY0lHVQnZBhe_WO1kQ5HUarwSQFdhnqKooh6AvCH1SHYh5VqGYZcIYz94V6sAFd-D_TI3k-G9azxGkLYlR0aclW-h8NSzD0KN1r14yR72DdpI4l0Cc6Uhz3UwjuZ0p-KgJkLWOGtKTm7vzjXKwk5otBs8PFYLf44 May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: d3112549c42f41cda4a54ec51c131023 May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-MultipleCreateTestJSON-1310522615 May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d3112549c42f41cda4a54ec51c131023", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d3112549c42f41cda4a54ec51c131023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d3112549c42f41cda4a54ec51c131023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d3112549c42f41cda4a54ec51c131023"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-MultipleCreateTestJSON-1310522615 May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: d3112549c42f41cda4a54ec51c131023 May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1310522615 May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-MultipleCreateTestJSON-1310522615-project May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f7c1a400e0dd462da3bb33b7e3fe57fc May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-MultipleCreateTestJSON-1310522615-project May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance b3be7259-f0f9-4940-b2b8-7eb1954ae27b could not be found. May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'b3be7259-f0f9-4940-b2b8-7eb1954ae27b'} May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3be7259-f0f9-4940-b2b8-7eb1954ae27b could not be found. May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3be7259-f0f9-4940-b2b8-7eb1954ae27b could not be found. May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:24:31.680477 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:24:31.685275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:24:31.685275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:24:31.685275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:24:31.685275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:24:31.685275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:24:31.685275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3be7259-f0f9-4940-b2b8-7eb1954ae27b could not be found. May 28 21:24:31.685275 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:24:31.685275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b207ca45-3422-468a-b54d-e7b52d8730e6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Returning 404 to user: Instance b3be7259-f0f9-4940-b2b8-7eb1954ae27b could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:24:31.685275 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b207ca45-3422-468a-b54d-e7b52d8730e6 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b3be7259-f0f9-4940-b2b8-7eb1954ae27b" status: 404 len: 111 microversion: 2.1 time: 0.075382 May 28 21:24:31.685831 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2349/4631] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:31 2022] GET /compute/v2.1/servers/b3be7259-f0f9-4940-b2b8-7eb1954ae27b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:24:31.691445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-30703da3-3e8f-47ff-97a4-ac983a2a2059 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:31.692348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-30703da3-3e8f-47ff-97a4-ac983a2a2059 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:31.700314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30703da3-3e8f-47ff-97a4-ac983a2a2059 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:31.700775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30703da3-3e8f-47ff-97a4-ac983a2a2059 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:31.701605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30703da3-3e8f-47ff-97a4-ac983a2a2059 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:31.704268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30703da3-3e8f-47ff-97a4-ac983a2a2059 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:31.801807 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-96855996", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:31.896217 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] validate_networks() for [('3a3043e0-048b-4e2b-ab77-16b78a2870c5', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:24:32.179356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-30703da3-3e8f-47ff-97a4-ac983a2a2059 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:32.190427 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-30703da3-3e8f-47ff-97a4-ac983a2a2059 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1689 microversion: 2.1 time: 0.511700 May 28 21:24:32.191053 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2283/4632] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:31 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1689 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:32.202722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-42d6a6bf-60f6-4b3a-8d5a-9f77dc31b97c req-d010ba10-eba3-4c89-919c-2527f37ee747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2779804-f38d-48cb-93a2-eba1bb0d93d2", "name": "network-vif-deleted", "tag": "92dbd246-3626-42ca-9a94-1687fa746cd2"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:32.217192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-42d6a6bf-60f6-4b3a-8d5a-9f77dc31b97c req-d010ba10-eba3-4c89-919c-2527f37ee747 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:32.225084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-42d6a6bf-60f6-4b3a-8d5a-9f77dc31b97c req-d010ba10-eba3-4c89-919c-2527f37ee747 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:32.244051 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-42d6a6bf-60f6-4b3a-8d5a-9f77dc31b97c req-d010ba10-eba3-4c89-919c-2527f37ee747 service nova] Creating event network-vif-deleted:92dbd246-3626-42ca-9a94-1687fa746cd2 for instance b2779804-f38d-48cb-93a2-eba1bb0d93d2 on nch2-master-1 May 28 21:24:32.260381 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-42d6a6bf-60f6-4b3a-8d5a-9f77dc31b97c req-d010ba10-eba3-4c89-919c-2527f37ee747 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066801 May 28 21:24:32.264134 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2284/4633] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:32.272077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-869c1ccc-fe42-46d9-aceb-0a2c5177de86 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:32.278571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-869c1ccc-fe42-46d9-aceb-0a2c5177de86 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] [instance: b2779804-f38d-48cb-93a2-eba1bb0d93d2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:32.292586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-869c1ccc-fe42-46d9-aceb-0a2c5177de86 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:32.293255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-869c1ccc-fe42-46d9-aceb-0a2c5177de86 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:32.294299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-869c1ccc-fe42-46d9-aceb-0a2c5177de86 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:32.294902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-869c1ccc-fe42-46d9-aceb-0a2c5177de86 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:32.317254 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-869c1ccc-fe42-46d9-aceb-0a2c5177de86 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] HTTP exception thrown: Instance b2779804-f38d-48cb-93a2-eba1bb0d93d2 could not be found. May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-869c1ccc-fe42-46d9-aceb-0a2c5177de86 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Request method failure captured: May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 HTTP/1.1 May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpLMuGk5kxE3WodBY0lHVQnZBhe_WO1kQ5HUarwSQFdhnqKooh6AvCH1SHYh5VqGYZcIYz94V6sAFd-D_TI3k-G9azxGkLYlR0aclW-h8NSzD0KN1r14yR72DdpI4l0Cc6Uhz3UwjuZ0p-KgJkLWOGtKTm7vzjXKwk5otBs8PFYLf44 May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: d3112549c42f41cda4a54ec51c131023 May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-MultipleCreateTestJSON-1310522615 May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d3112549c42f41cda4a54ec51c131023", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d3112549c42f41cda4a54ec51c131023"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d3112549c42f41cda4a54ec51c131023"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d3112549c42f41cda4a54ec51c131023"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-MultipleCreateTestJSON-1310522615 May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: d3112549c42f41cda4a54ec51c131023 May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1310522615 May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-MultipleCreateTestJSON-1310522615-project May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f7c1a400e0dd462da3bb33b7e3fe57fc May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-MultipleCreateTestJSON-1310522615-project May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance b2779804-f38d-48cb-93a2-eba1bb0d93d2 could not be found. May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'b2779804-f38d-48cb-93a2-eba1bb0d93d2'} May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2779804-f38d-48cb-93a2-eba1bb0d93d2 could not be found. May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2779804-f38d-48cb-93a2-eba1bb0d93d2 could not be found. May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:24:32.319559 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:24:32.325284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:24:32.325284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:24:32.325284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:24:32.325284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:24:32.325284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:24:32.325284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2779804-f38d-48cb-93a2-eba1bb0d93d2 could not be found. May 28 21:24:32.325284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:24:32.335896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-869c1ccc-fe42-46d9-aceb-0a2c5177de86 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] Returning 404 to user: Instance b2779804-f38d-48cb-93a2-eba1bb0d93d2 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:24:32.336793 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-869c1ccc-fe42-46d9-aceb-0a2c5177de86 tempest-MultipleCreateTestJSON-1310522615 tempest-MultipleCreateTestJSON-1310522615-project] 10.222.0.33 "GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2" status: 404 len: 111 microversion: 2.1 time: 0.071398 May 28 21:24:32.337379 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2285/4634] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:32 2022] GET /compute/v2.1/servers/b2779804-f38d-48cb-93a2-eba1bb0d93d2 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:24:32.350939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-162bf268-bb8f-476d-b2de-3f3c60de9d0f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:32.351471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-162bf268-bb8f-476d-b2de-3f3c60de9d0f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:32.367928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:32.378602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-162bf268-bb8f-476d-b2de-3f3c60de9d0f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:32.379190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-162bf268-bb8f-476d-b2de-3f3c60de9d0f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:32.380045 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-162bf268-bb8f-476d-b2de-3f3c60de9d0f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:32.380497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-162bf268-bb8f-476d-b2de-3f3c60de9d0f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:32.653714 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-162bf268-bb8f-476d-b2de-3f3c60de9d0f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958/action" status: 204 len: 0 microversion: 2.1 time: 0.306665 May 28 21:24:32.654388 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2286/4635] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:24:32 2022] POST /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958/action => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:24:32.667861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-dbba72af-dad8-4f59-a265-63719dbc7d5e req-c7116d54-41a8-4c52-bc2a-b69e6d378525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7a3bfa-2077-4b86-8670-bd2428861958", "name": "network-vif-plugged", "status": "completed", "tag": "31f937d0-8453-4ce1-8d41-4a95e908e103"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:32.686974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-dbba72af-dad8-4f59-a265-63719dbc7d5e req-c7116d54-41a8-4c52-bc2a-b69e6d378525 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:32.687462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-dbba72af-dad8-4f59-a265-63719dbc7d5e req-c7116d54-41a8-4c52-bc2a-b69e6d378525 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:32.695452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:24:32.696572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:24:32.697326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:24:32.697964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:24:32.698592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:24:32.705164 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-dbba72af-dad8-4f59-a265-63719dbc7d5e req-c7116d54-41a8-4c52-bc2a-b69e6d378525 service nova] Creating event network-vif-plugged:31f937d0-8453-4ce1-8d41-4a95e908e103 for instance 6a7a3bfa-2077-4b86-8670-bd2428861958 on nch2-master-1 May 28 21:24:32.711097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-dbba72af-dad8-4f59-a265-63719dbc7d5e req-c7116d54-41a8-4c52-bc2a-b69e6d378525 service nova] Instance 6a7a3bfa-2077-4b86-8670-bd2428861958 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:24:32.711346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:32.712060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:32.713176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:32.713925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:32.722476 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-dbba72af-dad8-4f59-a265-63719dbc7d5e req-c7116d54-41a8-4c52-bc2a-b69e6d378525 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066425 May 28 21:24:32.723898 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2287/4636] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:32.731484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e93ae33e-82ce-4aa3-b7fa-4e0785cbce72 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:32.735664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e93ae33e-82ce-4aa3-b7fa-4e0785cbce72 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:32.739285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e93ae33e-82ce-4aa3-b7fa-4e0785cbce72 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:32.739968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e93ae33e-82ce-4aa3-b7fa-4e0785cbce72 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:32.740645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Getting quotas for project 01fa7893b58741ce84a316632efe7882. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:24:32.741188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e93ae33e-82ce-4aa3-b7fa-4e0785cbce72 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:32.741829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e93ae33e-82ce-4aa3-b7fa-4e0785cbce72 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:32.761969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Getting quotas for user ebc8e00965334bd1bb811a0eefd64b84 and project 01fa7893b58741ce84a316632efe7882. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:24:32.804206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:24:32.813407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:24:32.953947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e93ae33e-82ce-4aa3-b7fa-4e0785cbce72 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:32.971783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e93ae33e-82ce-4aa3-b7fa-4e0785cbce72 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:32.977272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e93ae33e-82ce-4aa3-b7fa-4e0785cbce72 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:32.977272 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e93ae33e-82ce-4aa3-b7fa-4e0785cbce72 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1665 microversion: 2.20 time: 0.249993 May 28 21:24:32.978025 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2288/4637] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:32 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1665 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:32.984579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c1ab0ba9-7b88-4928-b6f9-465fd344907f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:32.985594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c1ab0ba9-7b88-4928-b6f9-465fd344907f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:32.995922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1ab0ba9-7b88-4928-b6f9-465fd344907f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:32.997199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1ab0ba9-7b88-4928-b6f9-465fd344907f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:32.998762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1ab0ba9-7b88-4928-b6f9-465fd344907f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:33.001490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1ab0ba9-7b88-4928-b6f9-465fd344907f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:33.050620 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-33b45225-4413-47af-9438-c5c3402edd54 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.363112 May 28 21:24:33.053976 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2350/4638] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:24:33.072654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2834a6fe-c186-4592-b9b3-5df5610f16b4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:33.077033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2834a6fe-c186-4592-b9b3-5df5610f16b4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:33.096075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2834a6fe-c186-4592-b9b3-5df5610f16b4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:33.096764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2834a6fe-c186-4592-b9b3-5df5610f16b4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:33.097736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2834a6fe-c186-4592-b9b3-5df5610f16b4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:33.098364 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2834a6fe-c186-4592-b9b3-5df5610f16b4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:33.579453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2834a6fe-c186-4592-b9b3-5df5610f16b4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:33.601922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c1ab0ba9-7b88-4928-b6f9-465fd344907f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:33.608592 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2834a6fe-c186-4592-b9b3-5df5610f16b4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1684 microversion: 2.1 time: 0.553022 May 28 21:24:33.610342 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2351/4639] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:33 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1684 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:33.624766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2e60bb3e-869b-46b4-9031-f76a8ca5284a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd319c3c-84f3-4f60-b04f-30c14dbe419f"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:33.631367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2e60bb3e-869b-46b4-9031-f76a8ca5284a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:33.633399 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c1ab0ba9-7b88-4928-b6f9-465fd344907f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1689 microversion: 2.1 time: 0.653068 May 28 21:24:33.652801 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2289/4640] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:32 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1689 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:33.652981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e60bb3e-869b-46b4-9031-f76a8ca5284a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:33.652981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e60bb3e-869b-46b4-9031-f76a8ca5284a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:33.652981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e60bb3e-869b-46b4-9031-f76a8ca5284a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:33.652981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e60bb3e-869b-46b4-9031-f76a8ca5284a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:33.668860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-df00d56e-1e9e-44e2-8dd0-2f3366ee95f1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:33.670371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-df00d56e-1e9e-44e2-8dd0-2f3366ee95f1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:33.961623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-df00d56e-1e9e-44e2-8dd0-2f3366ee95f1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:33.970101 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-df00d56e-1e9e-44e2-8dd0-2f3366ee95f1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1215 microversion: 2.1 time: 0.314357 May 28 21:24:33.975617 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2290/4641] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:33 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1215 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:34.627996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-06e0add6-8e89-4a29-8701-0d98c9f8a914 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:34.628406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-06e0add6-8e89-4a29-8701-0d98c9f8a914 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:34.642423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06e0add6-8e89-4a29-8701-0d98c9f8a914 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:34.644867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06e0add6-8e89-4a29-8701-0d98c9f8a914 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:34.646636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06e0add6-8e89-4a29-8701-0d98c9f8a914 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:34.648041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06e0add6-8e89-4a29-8701-0d98c9f8a914 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:34.674225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:35.045520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-06e0add6-8e89-4a29-8701-0d98c9f8a914 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:35.079089 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-06e0add6-8e89-4a29-8701-0d98c9f8a914 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1684 microversion: 2.1 time: 0.455628 May 28 21:24:35.086614 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2291/4642] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:34 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1684 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:35.095454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-533784f4-3f66-4378-839e-dc9e17ba9418 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:35.106995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-533784f4-3f66-4378-839e-dc9e17ba9418 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:35.106995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-533784f4-3f66-4378-839e-dc9e17ba9418 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:35.106995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-533784f4-3f66-4378-839e-dc9e17ba9418 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:35.106995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-533784f4-3f66-4378-839e-dc9e17ba9418 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:35.106995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-533784f4-3f66-4378-839e-dc9e17ba9418 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:35.135276 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 21:24:35.135523 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 21:24:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 (ip 10.222.0.33) !!! May 28 21:24:35.289951 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2e60bb3e-869b-46b4-9031-f76a8ca5284a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "POST /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.673661 May 28 21:24:35.290810 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2352/4643] 10.222.0.33 () {62 vars in 1363 bytes} [Sat May 28 21:24:33 2022] POST /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b/os-volume_attachments => generated 188 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:24:35.300547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-451035ae-7c67-462f-8c68-f3d7b70eef99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:35.301211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-451035ae-7c67-462f-8c68-f3d7b70eef99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:35.322177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-451035ae-7c67-462f-8c68-f3d7b70eef99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:35.326684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-451035ae-7c67-462f-8c68-f3d7b70eef99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:35.326684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-451035ae-7c67-462f-8c68-f3d7b70eef99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:35.326684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-451035ae-7c67-462f-8c68-f3d7b70eef99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:35.411621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-533784f4-3f66-4378-839e-dc9e17ba9418 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:35.422739 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-533784f4-3f66-4378-839e-dc9e17ba9418 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1689 microversion: 2.1 time: 0.331785 May 28 21:24:35.423665 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2292/4644] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:35 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1689 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:35.458417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-451035ae-7c67-462f-8c68-f3d7b70eef99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:35.467509 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-451035ae-7c67-462f-8c68-f3d7b70eef99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1219 microversion: 2.1 time: 0.175227 May 28 21:24:35.468490 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2353/4645] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:35 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1219 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:35.533610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1828db8b-a902-4ed8-9bf3-be3ec5fd6094 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:35.535254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1828db8b-a902-4ed8-9bf3-be3ec5fd6094 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:35.544517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1828db8b-a902-4ed8-9bf3-be3ec5fd6094 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:35.545074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1828db8b-a902-4ed8-9bf3-be3ec5fd6094 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:35.546353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1828db8b-a902-4ed8-9bf3-be3ec5fd6094 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:35.547060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1828db8b-a902-4ed8-9bf3-be3ec5fd6094 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:36.105430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5a2f56da-2131-4df3-8dbc-16f06664701c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:36.106610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5a2f56da-2131-4df3-8dbc-16f06664701c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:36.123144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a2f56da-2131-4df3-8dbc-16f06664701c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:36.123943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a2f56da-2131-4df3-8dbc-16f06664701c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:36.124988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a2f56da-2131-4df3-8dbc-16f06664701c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:36.126883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a2f56da-2131-4df3-8dbc-16f06664701c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:36.333402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5a2f56da-2131-4df3-8dbc-16f06664701c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:36.350912 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5a2f56da-2131-4df3-8dbc-16f06664701c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1684 microversion: 2.1 time: 0.250700 May 28 21:24:36.362412 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2354/4646] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:36 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1684 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:36.444467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-754591ae-4bd0-4ddc-87de-421308404560 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:36.445234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-754591ae-4bd0-4ddc-87de-421308404560 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:36.456902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-754591ae-4bd0-4ddc-87de-421308404560 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:36.457369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-754591ae-4bd0-4ddc-87de-421308404560 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:36.458190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-754591ae-4bd0-4ddc-87de-421308404560 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:36.461501 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1828db8b-a902-4ed8-9bf3-be3ec5fd6094 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b/os-volume_attachments/bd319c3c-84f3-4f60-b04f-30c14dbe419f" status: 202 len: 0 microversion: 2.20 time: 0.933706 May 28 21:24:36.465484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-754591ae-4bd0-4ddc-87de-421308404560 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:36.466898 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2293/4647] 10.222.0.33 () {60 vars in 1456 bytes} [Sat May 28 21:24:35 2022] DELETE /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b/os-volume_attachments/bd319c3c-84f3-4f60-b04f-30c14dbe419f => generated 0 bytes in 940 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 21:24:36.484656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cb41bab2-dc6b-47c4-805d-a12c2ed31faf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:36.485291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cb41bab2-dc6b-47c4-805d-a12c2ed31faf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:36.532914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb41bab2-dc6b-47c4-805d-a12c2ed31faf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:36.533409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb41bab2-dc6b-47c4-805d-a12c2ed31faf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:36.538997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb41bab2-dc6b-47c4-805d-a12c2ed31faf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:36.539884 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb41bab2-dc6b-47c4-805d-a12c2ed31faf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:36.751775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cb41bab2-dc6b-47c4-805d-a12c2ed31faf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:36.769122 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cb41bab2-dc6b-47c4-805d-a12c2ed31faf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1267 microversion: 2.1 time: 0.288218 May 28 21:24:36.769733 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2294/4648] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:36 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1267 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:24:36.775112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7b1fd60e-3119-4849-a457-9c2776a4a413 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:36.784765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7b1fd60e-3119-4849-a457-9c2776a4a413 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:36.784765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b1fd60e-3119-4849-a457-9c2776a4a413 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:36.784765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b1fd60e-3119-4849-a457-9c2776a4a413 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:36.784765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b1fd60e-3119-4849-a457-9c2776a4a413 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:36.784765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b1fd60e-3119-4849-a457-9c2776a4a413 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:36.875719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-754591ae-4bd0-4ddc-87de-421308404560 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:36.886117 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-754591ae-4bd0-4ddc-87de-421308404560 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1681 microversion: 2.1 time: 0.446237 May 28 21:24:36.889886 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2355/4649] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:36 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1681 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:37.368530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-91f543f9-c1d2-4b14-9fe6-35bf5dccb1e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:37.369260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-91f543f9-c1d2-4b14-9fe6-35bf5dccb1e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:37.378196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91f543f9-c1d2-4b14-9fe6-35bf5dccb1e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:37.378955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91f543f9-c1d2-4b14-9fe6-35bf5dccb1e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:37.379770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91f543f9-c1d2-4b14-9fe6-35bf5dccb1e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:37.380369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91f543f9-c1d2-4b14-9fe6-35bf5dccb1e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:37.537071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-91f543f9-c1d2-4b14-9fe6-35bf5dccb1e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:37.545086 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-91f543f9-c1d2-4b14-9fe6-35bf5dccb1e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1684 microversion: 2.1 time: 0.180224 May 28 21:24:37.555295 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2356/4650] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:37 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1684 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:24:37.591560 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7b1fd60e-3119-4849-a457-9c2776a4a413 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "POST /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b/action" status: 202 len: 0 microversion: 2.20 time: 0.820498 May 28 21:24:37.592809 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2295/4651] 10.222.0.33 () {62 vars in 1318 bytes} [Sat May 28 21:24:36 2022] POST /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b/action => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 28 21:24:37.601587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-12e97b73-38fe-4d39-baa1-11e373b7a4eb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:37.602260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-12e97b73-38fe-4d39-baa1-11e373b7a4eb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:37.610261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12e97b73-38fe-4d39-baa1-11e373b7a4eb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:37.610731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12e97b73-38fe-4d39-baa1-11e373b7a4eb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:37.611522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12e97b73-38fe-4d39-baa1-11e373b7a4eb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:37.612003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12e97b73-38fe-4d39-baa1-11e373b7a4eb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:37.651906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7b1fd60e-3119-4849-a457-9c2776a4a413 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:37.653095 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7b1fd60e-3119-4849-a457-9c2776a4a413 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001728 May 28 21:24:37.664781 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2296/4652] 10.222.0.33 () {56 vars in 885 bytes} [Sat May 28 21:24:37 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 28 21:24:37.666594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7b1fd60e-3119-4849-a457-9c2776a4a413 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:37.668055 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7b1fd60e-3119-4849-a457-9c2776a4a413 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002175 May 28 21:24:37.668755 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2297/4653] 10.222.0.33 () {54 vars in 1034 bytes} [Sat May 28 21:24:37 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) May 28 21:24:37.674805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7b1fd60e-3119-4849-a457-9c2776a4a413 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:37.676143 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7b1fd60e-3119-4849-a457-9c2776a4a413 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001889 May 28 21:24:37.684169 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2298/4654] 10.222.0.33 () {54 vars in 1040 bytes} [Sat May 28 21:24:37 2022] GET /compute/v2.1/ => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:24:37.690486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7b1fd60e-3119-4849-a457-9c2776a4a413 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:37.691572 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7b1fd60e-3119-4849-a457-9c2776a4a413 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001903 May 28 21:24:37.698604 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2299/4655] 10.222.0.33 () {56 vars in 885 bytes} [Sat May 28 21:24:37 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) May 28 21:24:37.803814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-01488f46-c5c1-4fcb-8570-6b6768e05c98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:37.804344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-01488f46-c5c1-4fcb-8570-6b6768e05c98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:37.826635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01488f46-c5c1-4fcb-8570-6b6768e05c98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:37.827409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01488f46-c5c1-4fcb-8570-6b6768e05c98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:37.828606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01488f46-c5c1-4fcb-8570-6b6768e05c98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:37.829719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01488f46-c5c1-4fcb-8570-6b6768e05c98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:37.946664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-12e97b73-38fe-4d39-baa1-11e373b7a4eb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:37.958061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-12e97b73-38fe-4d39-baa1-11e373b7a4eb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:37.971788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-12e97b73-38fe-4d39-baa1-11e373b7a4eb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:37.973623 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-12e97b73-38fe-4d39-baa1-11e373b7a4eb tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1673 microversion: 2.20 time: 0.375979 May 28 21:24:37.974724 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2357/4656] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:37 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1673 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:37.997803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-01488f46-c5c1-4fcb-8570-6b6768e05c98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:38.010884 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-01488f46-c5c1-4fcb-8570-6b6768e05c98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1285 microversion: 2.1 time: 0.207939 May 28 21:24:38.010884 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2300/4657] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:37 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:38.562791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-718d0292-b426-48e8-97a3-d51a1195a0f0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:38.563417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-718d0292-b426-48e8-97a3-d51a1195a0f0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:38.571131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-718d0292-b426-48e8-97a3-d51a1195a0f0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:38.571775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-718d0292-b426-48e8-97a3-d51a1195a0f0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:38.572921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-718d0292-b426-48e8-97a3-d51a1195a0f0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:38.573575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-718d0292-b426-48e8-97a3-d51a1195a0f0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:38.602723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:38.795320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-718d0292-b426-48e8-97a3-d51a1195a0f0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:38.816291 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-718d0292-b426-48e8-97a3-d51a1195a0f0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1684 microversion: 2.1 time: 0.254832 May 28 21:24:38.817707 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2358/4658] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:38 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1684 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:38.994641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-628e74e9-c91d-4077-ba70-9a9804c14564 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:38.995920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-628e74e9-c91d-4077-ba70-9a9804c14564 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:39.004307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-628e74e9-c91d-4077-ba70-9a9804c14564 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:39.005072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-628e74e9-c91d-4077-ba70-9a9804c14564 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:39.006172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-628e74e9-c91d-4077-ba70-9a9804c14564 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:39.006773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-628e74e9-c91d-4077-ba70-9a9804c14564 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:39.027698 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-724295c9-9e06-4dcc-964d-12cfba3fe6ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:39.028467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-724295c9-9e06-4dcc-964d-12cfba3fe6ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:39.036558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-724295c9-9e06-4dcc-964d-12cfba3fe6ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:39.038202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-724295c9-9e06-4dcc-964d-12cfba3fe6ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:39.039585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-724295c9-9e06-4dcc-964d-12cfba3fe6ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:39.041639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-724295c9-9e06-4dcc-964d-12cfba3fe6ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:39.363696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-628e74e9-c91d-4077-ba70-9a9804c14564 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:39.366701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-724295c9-9e06-4dcc-964d-12cfba3fe6ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:39.377158 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-724295c9-9e06-4dcc-964d-12cfba3fe6ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1315 microversion: 2.1 time: 0.351345 May 28 21:24:39.378204 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2359/4659] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:39 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:39.382074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-628e74e9-c91d-4077-ba70-9a9804c14564 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:39.383996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-628e74e9-c91d-4077-ba70-9a9804c14564 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:39.387144 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-628e74e9-c91d-4077-ba70-9a9804c14564 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1673 microversion: 2.20 time: 0.397352 May 28 21:24:39.387980 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2301/4660] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:38 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1673 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:39.842187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d5685290-29fa-4ac8-9161-f6c9f362edae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:39.843668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d5685290-29fa-4ac8-9161-f6c9f362edae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:39.857081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5685290-29fa-4ac8-9161-f6c9f362edae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:39.857813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5685290-29fa-4ac8-9161-f6c9f362edae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:39.859120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5685290-29fa-4ac8-9161-f6c9f362edae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:39.859916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5685290-29fa-4ac8-9161-f6c9f362edae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:40.177832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d5685290-29fa-4ac8-9161-f6c9f362edae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:40.187483 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d5685290-29fa-4ac8-9161-f6c9f362edae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.355343 May 28 21:24:40.202397 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2360/4661] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:39 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:40.395835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-01384c7c-35c7-4e78-b449-ac9d7808ecee tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:40.396469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-01384c7c-35c7-4e78-b449-ac9d7808ecee tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:40.406363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b66e2171-c7a5-4eeb-abba-2170486d241f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:40.407576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b66e2171-c7a5-4eeb-abba-2170486d241f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:40.428407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b66e2171-c7a5-4eeb-abba-2170486d241f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:40.428407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b66e2171-c7a5-4eeb-abba-2170486d241f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:40.429337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b66e2171-c7a5-4eeb-abba-2170486d241f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:40.429747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b66e2171-c7a5-4eeb-abba-2170486d241f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:40.436682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01384c7c-35c7-4e78-b449-ac9d7808ecee tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:40.437252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01384c7c-35c7-4e78-b449-ac9d7808ecee tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:40.437977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01384c7c-35c7-4e78-b449-ac9d7808ecee tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:40.438430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01384c7c-35c7-4e78-b449-ac9d7808ecee tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:41.059167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b66e2171-c7a5-4eeb-abba-2170486d241f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:41.068115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-01384c7c-35c7-4e78-b449-ac9d7808ecee tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:41.071102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b66e2171-c7a5-4eeb-abba-2170486d241f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:41.073060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b66e2171-c7a5-4eeb-abba-2170486d241f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:41.078705 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-01384c7c-35c7-4e78-b449-ac9d7808ecee tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1315 microversion: 2.1 time: 0.686824 May 28 21:24:41.082758 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2302/4662] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:40 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:41.089122 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b66e2171-c7a5-4eeb-abba-2170486d241f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.681799 May 28 21:24:41.089275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-36ff85d6-5980-4485-a2b7-da2282fcea67 req-b9b4a5f1-461a-43e4-add1-7767a139afc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a798306b-2df0-4ef0-b523-13a226b16120", "tag": "04aa786c-dc09-4f75-981b-7d1b73608c2b"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:41.090285 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2361/4663] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:40 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:41.112196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-36ff85d6-5980-4485-a2b7-da2282fcea67 req-b9b4a5f1-461a-43e4-add1-7767a139afc8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:41.112196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-36ff85d6-5980-4485-a2b7-da2282fcea67 req-b9b4a5f1-461a-43e4-add1-7767a139afc8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:41.124905 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-36ff85d6-5980-4485-a2b7-da2282fcea67 req-b9b4a5f1-461a-43e4-add1-7767a139afc8 service nova] Creating event network-changed:04aa786c-dc09-4f75-981b-7d1b73608c2b for instance a798306b-2df0-4ef0-b523-13a226b16120 on nch1-master-1 May 28 21:24:41.132645 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-36ff85d6-5980-4485-a2b7-da2282fcea67 req-b9b4a5f1-461a-43e4-add1-7767a139afc8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048513 May 28 21:24:41.134312 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2303/4664] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:41.998405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-1ba71983-1606-4da7-8c6d-5e169c06ce86 req-62826b7f-e3db-40b2-8b5b-2bae1b7626f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226cec1f-9523-4d1f-95cf-e2d994bd1f88", "name": "network-vif-unplugged", "status": "completed", "tag": "b98532fb-0692-4c80-9ec0-a5445175d125"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:42.012886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1ba71983-1606-4da7-8c6d-5e169c06ce86 req-62826b7f-e3db-40b2-8b5b-2bae1b7626f0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:42.013371 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1ba71983-1606-4da7-8c6d-5e169c06ce86 req-62826b7f-e3db-40b2-8b5b-2bae1b7626f0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:42.030796 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-1ba71983-1606-4da7-8c6d-5e169c06ce86 req-62826b7f-e3db-40b2-8b5b-2bae1b7626f0 service nova] Creating event network-vif-unplugged:b98532fb-0692-4c80-9ec0-a5445175d125 for instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 on nch2-master-1 May 28 21:24:42.038342 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-1ba71983-1606-4da7-8c6d-5e169c06ce86 req-62826b7f-e3db-40b2-8b5b-2bae1b7626f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043455 May 28 21:24:42.038342 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2362/4665] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:42.098899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2519ea12-8b2c-4cf1-8f23-d1d3ff7b3b77 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:42.107558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2519ea12-8b2c-4cf1-8f23-d1d3ff7b3b77 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:42.111890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-be0ec7f7-3cbc-4421-9310-83f05984bb9a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:42.113549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-be0ec7f7-3cbc-4421-9310-83f05984bb9a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:42.125627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be0ec7f7-3cbc-4421-9310-83f05984bb9a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:42.130895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2519ea12-8b2c-4cf1-8f23-d1d3ff7b3b77 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:42.131367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2519ea12-8b2c-4cf1-8f23-d1d3ff7b3b77 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:42.132087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be0ec7f7-3cbc-4421-9310-83f05984bb9a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:42.136002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be0ec7f7-3cbc-4421-9310-83f05984bb9a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:42.136002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be0ec7f7-3cbc-4421-9310-83f05984bb9a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:42.137807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2519ea12-8b2c-4cf1-8f23-d1d3ff7b3b77 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:42.139302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2519ea12-8b2c-4cf1-8f23-d1d3ff7b3b77 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:42.730973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:42.791725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:42.941295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-be0ec7f7-3cbc-4421-9310-83f05984bb9a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:42.954324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-be0ec7f7-3cbc-4421-9310-83f05984bb9a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:42.956614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-be0ec7f7-3cbc-4421-9310-83f05984bb9a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:42.958375 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-be0ec7f7-3cbc-4421-9310-83f05984bb9a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.851686 May 28 21:24:42.970592 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2363/4666] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:42 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:42.976551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ad7264d4-15e4-4d28-9645-52b59588be13 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:42.978174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ad7264d4-15e4-4d28-9645-52b59588be13 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:42.984997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad7264d4-15e4-4d28-9645-52b59588be13 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:42.985657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad7264d4-15e4-4d28-9645-52b59588be13 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:42.986750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad7264d4-15e4-4d28-9645-52b59588be13 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:42.987525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ad7264d4-15e4-4d28-9645-52b59588be13 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:43.089951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2519ea12-8b2c-4cf1-8f23-d1d3ff7b3b77 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:43.103508 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2519ea12-8b2c-4cf1-8f23-d1d3ff7b3b77 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1315 microversion: 2.1 time: 1.011268 May 28 21:24:43.105425 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2304/4667] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:42 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1315 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:43.308289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ad7264d4-15e4-4d28-9645-52b59588be13 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:43.319889 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ad7264d4-15e4-4d28-9645-52b59588be13 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.347329 May 28 21:24:43.320710 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2364/4668] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:42 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:43.624639 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-3c404227-a7db-4ef6-b710-c70ad16146d1 req-7453c975-c4cf-454a-ab3a-db6f6ab606b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd20dd19-f26b-4e32-9114-715558d5aa3b", "tag": "4c95deb6-3882-40f5-af0e-fd2149216c59"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:43.646430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3c404227-a7db-4ef6-b710-c70ad16146d1 req-7453c975-c4cf-454a-ab3a-db6f6ab606b2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:43.646430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3c404227-a7db-4ef6-b710-c70ad16146d1 req-7453c975-c4cf-454a-ab3a-db6f6ab606b2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:43.657716 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-3c404227-a7db-4ef6-b710-c70ad16146d1 req-7453c975-c4cf-454a-ab3a-db6f6ab606b2 service nova] Creating event network-changed:4c95deb6-3882-40f5-af0e-fd2149216c59 for instance cd20dd19-f26b-4e32-9114-715558d5aa3b on nch2-master-1 May 28 21:24:43.694944 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-3c404227-a7db-4ef6-b710-c70ad16146d1 req-7453c975-c4cf-454a-ab3a-db6f6ab606b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079562 May 28 21:24:43.695980 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2305/4669] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:43.983139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bae7e894-c39b-4e1b-bb0a-d21f5e7c5273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:43.983767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bae7e894-c39b-4e1b-bb0a-d21f5e7c5273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:43.994252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bae7e894-c39b-4e1b-bb0a-d21f5e7c5273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:43.994914 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bae7e894-c39b-4e1b-bb0a-d21f5e7c5273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:43.996596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bae7e894-c39b-4e1b-bb0a-d21f5e7c5273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:43.997215 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bae7e894-c39b-4e1b-bb0a-d21f5e7c5273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:44.126577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-afa5dfa1-1e1d-448f-8849-8c6c06fa141e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:44.129505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-afa5dfa1-1e1d-448f-8849-8c6c06fa141e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:44.139304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:44.141215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afa5dfa1-1e1d-448f-8849-8c6c06fa141e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:44.141909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afa5dfa1-1e1d-448f-8849-8c6c06fa141e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:44.144287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afa5dfa1-1e1d-448f-8849-8c6c06fa141e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:44.146652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afa5dfa1-1e1d-448f-8849-8c6c06fa141e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:44.382698 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bae7e894-c39b-4e1b-bb0a-d21f5e7c5273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:44.397465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bae7e894-c39b-4e1b-bb0a-d21f5e7c5273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:44.398181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bae7e894-c39b-4e1b-bb0a-d21f5e7c5273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:44.399573 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bae7e894-c39b-4e1b-bb0a-d21f5e7c5273 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.425216 May 28 21:24:44.400178 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2365/4670] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:43 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:44.432551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-afa5dfa1-1e1d-448f-8849-8c6c06fa141e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:44.441045 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-afa5dfa1-1e1d-448f-8849-8c6c06fa141e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1315 microversion: 2.1 time: 0.322582 May 28 21:24:44.442065 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2306/4671] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:44 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:44.533349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d9fb04bf-8999-47bf-955f-5483e5112e33 tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] Calling method '.version_select at 0x7f4d57114dc0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:44.624848 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d9fb04bf-8999-47bf-955f-5483e5112e33 tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/46279274-f89b-4df1-a37e-12f9448d2ce6" status: 200 len: 344 microversion: 2.1 time: 0.103818 May 28 21:24:44.625700 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2366/4672] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:24:44 2022] GET /compute/v2.1/os-volumes/46279274-f89b-4df1-a37e-12f9448d2ce6 => generated 344 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:45.428806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0c311886-68c5-4fc2-af1b-e3451f10cfd7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:45.437645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0c311886-68c5-4fc2-af1b-e3451f10cfd7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:45.472027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f4807234-62c1-4c52-bfbf-49944b1fa956 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:45.475776 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f4807234-62c1-4c52-bfbf-49944b1fa956 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:45.499103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c311886-68c5-4fc2-af1b-e3451f10cfd7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:45.500122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:45.504314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c311886-68c5-4fc2-af1b-e3451f10cfd7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:45.504314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c311886-68c5-4fc2-af1b-e3451f10cfd7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:45.504314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c311886-68c5-4fc2-af1b-e3451f10cfd7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:45.508471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4807234-62c1-4c52-bfbf-49944b1fa956 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:45.512678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4807234-62c1-4c52-bfbf-49944b1fa956 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:45.514697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4807234-62c1-4c52-bfbf-49944b1fa956 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:45.515378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4807234-62c1-4c52-bfbf-49944b1fa956 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:45.942682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c311886-68c5-4fc2-af1b-e3451f10cfd7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:45.951395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c311886-68c5-4fc2-af1b-e3451f10cfd7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:45.960161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c311886-68c5-4fc2-af1b-e3451f10cfd7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:45.963905 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0c311886-68c5-4fc2-af1b-e3451f10cfd7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.547788 May 28 21:24:45.979000 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2307/4673] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:45 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:46.003987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f4807234-62c1-4c52-bfbf-49944b1fa956 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:46.017241 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f4807234-62c1-4c52-bfbf-49944b1fa956 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1315 microversion: 2.1 time: 0.559622 May 28 21:24:46.019067 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2367/4674] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:45 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:46.914390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-90457482-8933-4949-ac13-110ca97378ef req-fe84399b-fbd8-415e-a9a3-acd82e7b246a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a798306b-2df0-4ef0-b523-13a226b16120", "name": "network-vif-plugged", "status": "completed", "tag": "04aa786c-dc09-4f75-981b-7d1b73608c2b"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:46.933651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-90457482-8933-4949-ac13-110ca97378ef req-fe84399b-fbd8-415e-a9a3-acd82e7b246a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:46.934140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-90457482-8933-4949-ac13-110ca97378ef req-fe84399b-fbd8-415e-a9a3-acd82e7b246a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:46.955701 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-90457482-8933-4949-ac13-110ca97378ef req-fe84399b-fbd8-415e-a9a3-acd82e7b246a service nova] Creating event network-vif-plugged:04aa786c-dc09-4f75-981b-7d1b73608c2b for instance a798306b-2df0-4ef0-b523-13a226b16120 on nch1-master-1 May 28 21:24:46.960802 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-90457482-8933-4949-ac13-110ca97378ef req-fe84399b-fbd8-415e-a9a3-acd82e7b246a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051066 May 28 21:24:46.961422 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2308/4675] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:46.983968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-641fb1e2-bdb1-4895-a31d-81930d78618f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:46.985764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-641fb1e2-bdb1-4895-a31d-81930d78618f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:46.995520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-641fb1e2-bdb1-4895-a31d-81930d78618f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:46.995520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-641fb1e2-bdb1-4895-a31d-81930d78618f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:46.996223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-641fb1e2-bdb1-4895-a31d-81930d78618f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:46.996863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-641fb1e2-bdb1-4895-a31d-81930d78618f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:47.040250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-85d807e1-25e8-43d7-8ee3-1d77c91bc3a4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:47.041651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-85d807e1-25e8-43d7-8ee3-1d77c91bc3a4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:47.050523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85d807e1-25e8-43d7-8ee3-1d77c91bc3a4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:47.051292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85d807e1-25e8-43d7-8ee3-1d77c91bc3a4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:47.052794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85d807e1-25e8-43d7-8ee3-1d77c91bc3a4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:47.053489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85d807e1-25e8-43d7-8ee3-1d77c91bc3a4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:47.620013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-641fb1e2-bdb1-4895-a31d-81930d78618f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:47.627058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-85d807e1-25e8-43d7-8ee3-1d77c91bc3a4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:47.649863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-641fb1e2-bdb1-4895-a31d-81930d78618f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:47.652187 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-85d807e1-25e8-43d7-8ee3-1d77c91bc3a4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1315 microversion: 2.1 time: 0.617364 May 28 21:24:47.663378 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2309/4676] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:47 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:47.667928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-641fb1e2-bdb1-4895-a31d-81930d78618f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:47.669487 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-641fb1e2-bdb1-4895-a31d-81930d78618f tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.690184 May 28 21:24:47.670629 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2368/4677] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:46 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:47.848015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3e284145-a437-4926-954f-5fbb2898028e tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] Calling method '.version_select at 0x7f4d57903af0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:47.945214 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3e284145-a437-4926-954f-5fbb2898028e tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/6d93bb09-25ee-4bb3-9e92-bc6e8f9bd4ee" status: 200 len: 342 microversion: 2.1 time: 0.102525 May 28 21:24:47.946233 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2310/4678] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:24:47 2022] GET /compute/v2.1/os-volumes/6d93bb09-25ee-4bb3-9e92-bc6e8f9bd4ee => generated 342 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:47.973016 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-42a74b71-5414-4a3c-a66a-2813bb2ef49f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:47.983675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-42a74b71-5414-4a3c-a66a-2813bb2ef49f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:48.014269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42a74b71-5414-4a3c-a66a-2813bb2ef49f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:48.014933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42a74b71-5414-4a3c-a66a-2813bb2ef49f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:48.017394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42a74b71-5414-4a3c-a66a-2813bb2ef49f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:48.017985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42a74b71-5414-4a3c-a66a-2813bb2ef49f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:48.449966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-42a74b71-5414-4a3c-a66a-2813bb2ef49f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:48.482235 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-42a74b71-5414-4a3c-a66a-2813bb2ef49f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.513024 May 28 21:24:48.485801 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2369/4679] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:47 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:48.501691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-001648d5-7a71-4adb-a561-d86927199ddc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:48.502891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-001648d5-7a71-4adb-a561-d86927199ddc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:48.520050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-001648d5-7a71-4adb-a561-d86927199ddc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:48.522268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-001648d5-7a71-4adb-a561-d86927199ddc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:48.523354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-001648d5-7a71-4adb-a561-d86927199ddc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:48.526712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-001648d5-7a71-4adb-a561-d86927199ddc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:48.555491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:48.674670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d38d4b86-314b-48ab-9454-4c5c2d653a23 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:48.675411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d38d4b86-314b-48ab-9454-4c5c2d653a23 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:48.698863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d38d4b86-314b-48ab-9454-4c5c2d653a23 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:48.699820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d38d4b86-314b-48ab-9454-4c5c2d653a23 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:48.700821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d38d4b86-314b-48ab-9454-4c5c2d653a23 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:48.701432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d38d4b86-314b-48ab-9454-4c5c2d653a23 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:48.809507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-001648d5-7a71-4adb-a561-d86927199ddc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:48.820277 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-001648d5-7a71-4adb-a561-d86927199ddc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.323694 May 28 21:24:48.839999 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2311/4680] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:48 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:48.859113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ebd5183c-6242-49d2-a9ca-805f075db33d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:48.863752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ebd5183c-6242-49d2-a9ca-805f075db33d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:48.873028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebd5183c-6242-49d2-a9ca-805f075db33d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:48.873687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebd5183c-6242-49d2-a9ca-805f075db33d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:48.874721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebd5183c-6242-49d2-a9ca-805f075db33d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:48.875346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebd5183c-6242-49d2-a9ca-805f075db33d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:49.215358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d38d4b86-314b-48ab-9454-4c5c2d653a23 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:49.230300 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d38d4b86-314b-48ab-9454-4c5c2d653a23 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.559503 May 28 21:24:49.234043 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2370/4681] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:48 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:49.256125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d9b05c74-6d1f-4112-976e-fb92c9507577 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:49.256125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d9b05c74-6d1f-4112-976e-fb92c9507577 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:49.275730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9b05c74-6d1f-4112-976e-fb92c9507577 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:49.282177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9b05c74-6d1f-4112-976e-fb92c9507577 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:49.283326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9b05c74-6d1f-4112-976e-fb92c9507577 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:49.286108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9b05c74-6d1f-4112-976e-fb92c9507577 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:49.318896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ebd5183c-6242-49d2-a9ca-805f075db33d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:49.332467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ebd5183c-6242-49d2-a9ca-805f075db33d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:49.335676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ebd5183c-6242-49d2-a9ca-805f075db33d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:49.338894 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ebd5183c-6242-49d2-a9ca-805f075db33d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.492165 May 28 21:24:49.346639 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2312/4682] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:48 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:49.476864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d9b05c74-6d1f-4112-976e-fb92c9507577 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:49.481097 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d9b05c74-6d1f-4112-976e-fb92c9507577 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.245896 May 28 21:24:49.481746 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2371/4683] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:49 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:49.501110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1435025204", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:49.521205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-055e99a0-fe9a-4139-bca0-9342db20f5a2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:49.522332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-055e99a0-fe9a-4139-bca0-9342db20f5a2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:49.539826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-055e99a0-fe9a-4139-bca0-9342db20f5a2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:49.540669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-055e99a0-fe9a-4139-bca0-9342db20f5a2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:49.541649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-055e99a0-fe9a-4139-bca0-9342db20f5a2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:49.564766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-055e99a0-fe9a-4139-bca0-9342db20f5a2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:49.600314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] validate_networks() for [('3a3043e0-048b-4e2b-ab77-16b78a2870c5', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:24:49.934566 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-055e99a0-fe9a-4139-bca0-9342db20f5a2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.426303 May 28 21:24:49.938001 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2372/4684] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:24:49 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:24:49.945765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6872e874-4b03-4270-b846-08b5d5ffd648 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:49.946859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6872e874-4b03-4270-b846-08b5d5ffd648 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:49.954236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6872e874-4b03-4270-b846-08b5d5ffd648 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:49.955457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6872e874-4b03-4270-b846-08b5d5ffd648 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:49.956679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6872e874-4b03-4270-b846-08b5d5ffd648 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:49.981742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6872e874-4b03-4270-b846-08b5d5ffd648 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:50.574828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6872e874-4b03-4270-b846-08b5d5ffd648 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:50.587861 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6872e874-4b03-4270-b846-08b5d5ffd648 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1673 microversion: 2.1 time: 0.642764 May 28 21:24:50.587861 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2373/4685] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:49 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1673 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:24:50.597760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-85d2ee75-321a-435c-8905-e95c433fd29d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:50.598691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-85d2ee75-321a-435c-8905-e95c433fd29d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:50.610114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85d2ee75-321a-435c-8905-e95c433fd29d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:50.610699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85d2ee75-321a-435c-8905-e95c433fd29d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:50.611580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85d2ee75-321a-435c-8905-e95c433fd29d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:50.612113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85d2ee75-321a-435c-8905-e95c433fd29d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:51.128883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:24:51.130356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:24:51.130955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:24:51.131635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:24:51.132298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:24:51.159002 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:51.161355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:51.163790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:51.169241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:51.220655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Getting quotas for project 01fa7893b58741ce84a316632efe7882. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:24:51.232761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Getting quotas for user ebc8e00965334bd1bb811a0eefd64b84 and project 01fa7893b58741ce84a316632efe7882. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:24:51.257889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:24:51.260940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:24:51.280833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-85d2ee75-321a-435c-8905-e95c433fd29d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:51.293033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-85d2ee75-321a-435c-8905-e95c433fd29d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:51.297195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-85d2ee75-321a-435c-8905-e95c433fd29d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:51.304233 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-85d2ee75-321a-435c-8905-e95c433fd29d tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.719386 May 28 21:24:51.307239 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2374/4686] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:50 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:51.316304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c3a73e35-e1ca-4ab3-bec7-cc20b448e9ec tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] Calling method '.version_select at 0x7f4d56da95e0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:51.415055 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c3a73e35-e1ca-4ab3-bec7-cc20b448e9ec tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/1b3e0b48-0fd1-4613-859e-334ac1076750" status: 200 len: 344 microversion: 2.1 time: 0.107556 May 28 21:24:51.415699 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2375/4687] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:24:51 2022] GET /compute/v2.1/os-volumes/1b3e0b48-0fd1-4613-859e-334ac1076750 => generated 344 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:51.427127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb3df92b-3466-4ac5-9c1d-313c83f83968 tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] Calling method '.version_select at 0x7f4d69c1b550>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:51.439064 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1ce07b15-4c9b-4374-9f27-1003ac20b3f3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.945790 May 28 21:24:51.440120 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2313/4688] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:24:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:24:51.451276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0b05f76f-7be3-4509-a36e-09a8d3830f59 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:51.452240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0b05f76f-7be3-4509-a36e-09a8d3830f59 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:51.574617 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb3df92b-3466-4ac5-9c1d-313c83f83968 tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.151327 May 28 21:24:51.576709 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2376/4689] 10.222.0.33 () {58 vars in 1133 bytes} [Sat May 28 21:24:51 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:24:51.590815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b17386a5-5e79-41e2-bcdd-f40d51f9e37c tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] Calling method '.version_select at 0x7f4d56dd3700>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:51.628519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0b05f76f-7be3-4509-a36e-09a8d3830f59 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:51.637487 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0b05f76f-7be3-4509-a36e-09a8d3830f59 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1217 microversion: 2.1 time: 0.191021 May 28 21:24:51.662076 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2314/4690] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:51 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1217 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:24:51.670637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-93358559-aaef-4a82-9091-6bb0500185b6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:51.674223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-93358559-aaef-4a82-9091-6bb0500185b6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:51.691112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93358559-aaef-4a82-9091-6bb0500185b6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:51.694935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93358559-aaef-4a82-9091-6bb0500185b6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:51.696066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93358559-aaef-4a82-9091-6bb0500185b6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:51.701878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93358559-aaef-4a82-9091-6bb0500185b6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:51.858667 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b17386a5-5e79-41e2-bcdd-f40d51f9e37c tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.273888 May 28 21:24:51.859963 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2377/4691] 10.222.0.33 () {58 vars in 1148 bytes} [Sat May 28 21:24:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 679 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:51.874860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8c1df9f0-b066-4ce4-9959-67a2d06a353d tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] Calling method '.version_select at 0x7f4d56dd30d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:52.038195 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8c1df9f0-b066-4ce4-9959-67a2d06a353d tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.170146 May 28 21:24:52.039040 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2378/4692] 10.222.0.33 () {58 vars in 1133 bytes} [Sat May 28 21:24:51 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:24:52.053776 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e5c9c673-297c-4b9f-bbff-df93fdc5d1de tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] Calling method '.version_select at 0x7f4d5706a940>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:52.072579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-93358559-aaef-4a82-9091-6bb0500185b6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:52.087005 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-93358559-aaef-4a82-9091-6bb0500185b6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1673 microversion: 2.1 time: 0.422341 May 28 21:24:52.088700 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2315/4693] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:51 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1673 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:52.190979 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e5c9c673-297c-4b9f-bbff-df93fdc5d1de tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 345 microversion: 2.1 time: 0.143301 May 28 21:24:52.192276 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2379/4694] 10.222.0.33 () {58 vars in 1166 bytes} [Sat May 28 21:24:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 345 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:52.204448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5a8277c5-def3-4266-80ce-b8ebc6566b32 tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] Calling method '.version_select at 0x7f4d575ebe50>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:52.326161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8a90af70-2fc2-4b26-8bfd-7f28a4207de7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:52.326802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8a90af70-2fc2-4b26-8bfd-7f28a4207de7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:52.330327 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5a8277c5-def3-4266-80ce-b8ebc6566b32 tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.129960 May 28 21:24:52.331490 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2316/4695] 10.222.0.33 () {58 vars in 1169 bytes} [Sat May 28 21:24:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 679 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:52.346024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8a90af70-2fc2-4b26-8bfd-7f28a4207de7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:52.347657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8a90af70-2fc2-4b26-8bfd-7f28a4207de7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:52.347818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6aa5ac5e-9b25-43ae-85ea-daaeece80691 tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] Calling method '.version_select at 0x7f4d575e93a0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:52.351620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8a90af70-2fc2-4b26-8bfd-7f28a4207de7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:52.352861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8a90af70-2fc2-4b26-8bfd-7f28a4207de7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:52.411779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:24:52.450554 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6aa5ac5e-9b25-43ae-85ea-daaeece80691 tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.110512 May 28 21:24:52.451537 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2317/4696] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:24:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:24:52.470842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-78a15079-fd12-41e9-a601-7d469a76d306 tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] Calling method '.version_select at 0x7f4d575e9160>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:52.658429 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-78a15079-fd12-41e9-a601-7d469a76d306 tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 345 microversion: 2.1 time: 0.199256 May 28 21:24:52.659018 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2318/4697] 10.222.0.33 () {58 vars in 1187 bytes} [Sat May 28 21:24:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 345 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:52.675548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-03037edf-d45f-4691-88af-f5c5d8eca4ec tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:52.675548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-03037edf-d45f-4691-88af-f5c5d8eca4ec tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:52.781047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-03037edf-d45f-4691-88af-f5c5d8eca4ec tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:52.800175 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-03037edf-d45f-4691-88af-f5c5d8eca4ec tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1217 microversion: 2.1 time: 0.132066 May 28 21:24:52.803508 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2319/4698] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:52 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:52.816825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-509b019e-a452-4cbc-b3f2-6aed0f538727 tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] Calling method '.version_select at 0x7f4d575ebca0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:52.844323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8a90af70-2fc2-4b26-8bfd-7f28a4207de7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:52.859175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8a90af70-2fc2-4b26-8bfd-7f28a4207de7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:52.861624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8a90af70-2fc2-4b26-8bfd-7f28a4207de7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:52.864207 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8a90af70-2fc2-4b26-8bfd-7f28a4207de7 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.543216 May 28 21:24:52.865928 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2380/4699] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:52 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:53.074801 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-509b019e-a452-4cbc-b3f2-6aed0f538727 tempest-VolumesTestJSON-934406337 tempest-VolumesTestJSON-934406337-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.242495 May 28 21:24:53.074801 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2320/4700] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:24:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:53.109140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-518190e4-7bc6-4ab4-8043-6f2f1bbc07f8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:53.115400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-518190e4-7bc6-4ab4-8043-6f2f1bbc07f8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:53.140239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-518190e4-7bc6-4ab4-8043-6f2f1bbc07f8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:53.141356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-518190e4-7bc6-4ab4-8043-6f2f1bbc07f8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:53.143566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-518190e4-7bc6-4ab4-8043-6f2f1bbc07f8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:53.148618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-518190e4-7bc6-4ab4-8043-6f2f1bbc07f8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:53.453269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-518190e4-7bc6-4ab4-8043-6f2f1bbc07f8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:53.467021 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-518190e4-7bc6-4ab4-8043-6f2f1bbc07f8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1673 microversion: 2.1 time: 0.365221 May 28 21:24:53.471242 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2381/4701] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:53 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1673 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:53.828841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3e5b1c87-0acd-4f5a-9b35-9232973215a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:53.829524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3e5b1c87-0acd-4f5a-9b35-9232973215a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:53.842973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e5b1c87-0acd-4f5a-9b35-9232973215a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:53.846443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e5b1c87-0acd-4f5a-9b35-9232973215a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:53.847644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e5b1c87-0acd-4f5a-9b35-9232973215a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:53.851051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e5b1c87-0acd-4f5a-9b35-9232973215a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:53.883735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f91578e9-4b8c-4fae-80a0-4a2259d06724 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:53.885518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f91578e9-4b8c-4fae-80a0-4a2259d06724 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:53.904000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f91578e9-4b8c-4fae-80a0-4a2259d06724 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:53.904736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f91578e9-4b8c-4fae-80a0-4a2259d06724 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:53.906798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f91578e9-4b8c-4fae-80a0-4a2259d06724 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:53.907400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f91578e9-4b8c-4fae-80a0-4a2259d06724 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:54.119601 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3e5b1c87-0acd-4f5a-9b35-9232973215a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:54.136262 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3e5b1c87-0acd-4f5a-9b35-9232973215a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1221 microversion: 2.1 time: 0.312592 May 28 21:24:54.137247 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2321/4702] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:53 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1221 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:54.233089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f91578e9-4b8c-4fae-80a0-4a2259d06724 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:54.243340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f91578e9-4b8c-4fae-80a0-4a2259d06724 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:54.245957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f91578e9-4b8c-4fae-80a0-4a2259d06724 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:54.247817 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f91578e9-4b8c-4fae-80a0-4a2259d06724 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.368464 May 28 21:24:54.249674 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2382/4703] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:53 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:54.487908 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-89221398-031a-4b58-b222-724f53fdd486 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:54.488710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-89221398-031a-4b58-b222-724f53fdd486 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:54.499804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89221398-031a-4b58-b222-724f53fdd486 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:54.499804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89221398-031a-4b58-b222-724f53fdd486 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:54.506822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89221398-031a-4b58-b222-724f53fdd486 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:54.508882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89221398-031a-4b58-b222-724f53fdd486 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:54.796195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-89221398-031a-4b58-b222-724f53fdd486 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:54.829495 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-89221398-031a-4b58-b222-724f53fdd486 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1678 microversion: 2.1 time: 0.347846 May 28 21:24:54.833417 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2322/4704] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:54 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1678 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:55.154145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5ef4a0a5-de31-4219-860c-cffa25ea799b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:55.158827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5ef4a0a5-de31-4219-860c-cffa25ea799b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:55.168017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ef4a0a5-de31-4219-860c-cffa25ea799b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:55.171289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ef4a0a5-de31-4219-860c-cffa25ea799b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:55.172521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ef4a0a5-de31-4219-860c-cffa25ea799b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:55.175462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ef4a0a5-de31-4219-860c-cffa25ea799b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:55.267735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7cf8bb73-97be-482b-bbb3-6ced484b8b42 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:55.268362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7cf8bb73-97be-482b-bbb3-6ced484b8b42 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:55.286145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7cf8bb73-97be-482b-bbb3-6ced484b8b42 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:55.289139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7cf8bb73-97be-482b-bbb3-6ced484b8b42 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:55.291285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7cf8bb73-97be-482b-bbb3-6ced484b8b42 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:55.298595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7cf8bb73-97be-482b-bbb3-6ced484b8b42 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:55.327890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5ef4a0a5-de31-4219-860c-cffa25ea799b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:55.337912 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5ef4a0a5-de31-4219-860c-cffa25ea799b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1269 microversion: 2.1 time: 0.188591 May 28 21:24:55.346941 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2383/4705] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:55 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1269 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:55.526589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7cf8bb73-97be-482b-bbb3-6ced484b8b42 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:55.549103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7cf8bb73-97be-482b-bbb3-6ced484b8b42 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:55.551081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7cf8bb73-97be-482b-bbb3-6ced484b8b42 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:55.552285 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7cf8bb73-97be-482b-bbb3-6ced484b8b42 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.288566 May 28 21:24:55.563007 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2323/4706] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:55 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:24:55.855897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-41db9547-49d4-4854-9ffe-0af95b8f810a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:55.855897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-41db9547-49d4-4854-9ffe-0af95b8f810a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:55.862543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41db9547-49d4-4854-9ffe-0af95b8f810a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:55.863214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41db9547-49d4-4854-9ffe-0af95b8f810a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:55.864208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41db9547-49d4-4854-9ffe-0af95b8f810a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:55.864821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41db9547-49d4-4854-9ffe-0af95b8f810a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:56.076380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-41db9547-49d4-4854-9ffe-0af95b8f810a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:56.091542 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-41db9547-49d4-4854-9ffe-0af95b8f810a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.241307 May 28 21:24:56.092483 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2384/4707] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:55 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:56.112262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2a9560f8-76f1-46c8-9723-60ab71c6dca7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:56.114209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2a9560f8-76f1-46c8-9723-60ab71c6dca7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:56.128981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a9560f8-76f1-46c8-9723-60ab71c6dca7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:56.129706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a9560f8-76f1-46c8-9723-60ab71c6dca7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:56.130708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a9560f8-76f1-46c8-9723-60ab71c6dca7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:56.131320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a9560f8-76f1-46c8-9723-60ab71c6dca7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:56.263174 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2a9560f8-76f1-46c8-9723-60ab71c6dca7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 200 len: 322 microversion: 2.1 time: 0.154392 May 28 21:24:56.264797 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2324/4708] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:24:56 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:24:56.274012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-754b2356-45af-4bd3-83a0-ebd7f85f0a0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:56.276423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-754b2356-45af-4bd3-83a0-ebd7f85f0a0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:56.292419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-754b2356-45af-4bd3-83a0-ebd7f85f0a0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:56.292419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-754b2356-45af-4bd3-83a0-ebd7f85f0a0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:56.292419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-754b2356-45af-4bd3-83a0-ebd7f85f0a0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:56.299101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-754b2356-45af-4bd3-83a0-ebd7f85f0a0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:56.369159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7449125e-2b7b-46b2-a6d0-a52a69f48633 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:56.370228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7449125e-2b7b-46b2-a6d0-a52a69f48633 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:56.379313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7449125e-2b7b-46b2-a6d0-a52a69f48633 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:56.384978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7449125e-2b7b-46b2-a6d0-a52a69f48633 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:56.384978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7449125e-2b7b-46b2-a6d0-a52a69f48633 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:56.384978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7449125e-2b7b-46b2-a6d0-a52a69f48633 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:56.745157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7449125e-2b7b-46b2-a6d0-a52a69f48633 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:56.763677 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7449125e-2b7b-46b2-a6d0-a52a69f48633 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1277 microversion: 2.1 time: 0.400797 May 28 21:24:56.790187 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2325/4709] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:56 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1277 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:24:56.796933 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0e4dc141-484f-4b20-8f66-8f43ab58414b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:56.797939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0e4dc141-484f-4b20-8f66-8f43ab58414b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:56.809944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0e4dc141-484f-4b20-8f66-8f43ab58414b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:56.810917 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0e4dc141-484f-4b20-8f66-8f43ab58414b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:56.812855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0e4dc141-484f-4b20-8f66-8f43ab58414b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:56.814023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0e4dc141-484f-4b20-8f66-8f43ab58414b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:57.000119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-754b2356-45af-4bd3-83a0-ebd7f85f0a0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:57.009316 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-754b2356-45af-4bd3-83a0-ebd7f85f0a0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.739661 May 28 21:24:57.028176 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2385/4710] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:56 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:57.041037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b4cf3ae1-6c8a-4ca2-8855-1079fe19088e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:57.041950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b4cf3ae1-6c8a-4ca2-8855-1079fe19088e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:57.050164 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4cf3ae1-6c8a-4ca2-8855-1079fe19088e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:57.053677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4cf3ae1-6c8a-4ca2-8855-1079fe19088e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:57.053677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4cf3ae1-6c8a-4ca2-8855-1079fe19088e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:57.053677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b4cf3ae1-6c8a-4ca2-8855-1079fe19088e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:57.192295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0e4dc141-484f-4b20-8f66-8f43ab58414b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:57.205201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0e4dc141-484f-4b20-8f66-8f43ab58414b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:57.207329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0e4dc141-484f-4b20-8f66-8f43ab58414b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:57.210881 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0e4dc141-484f-4b20-8f66-8f43ab58414b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.418353 May 28 21:24:57.213661 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2326/4711] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:56 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:57.231547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a93d93e7-ec50-4f78-b719-1ef6e6cbe8c2 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:57.232797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a93d93e7-ec50-4f78-b719-1ef6e6cbe8c2 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:57.258463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a93d93e7-ec50-4f78-b719-1ef6e6cbe8c2 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:57.260006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a93d93e7-ec50-4f78-b719-1ef6e6cbe8c2 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:57.263804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a93d93e7-ec50-4f78-b719-1ef6e6cbe8c2 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:57.264480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a93d93e7-ec50-4f78-b719-1ef6e6cbe8c2 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:57.356163 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a93d93e7-ec50-4f78-b719-1ef6e6cbe8c2 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958/action" status: 200 len: 24569 microversion: 2.1 time: 0.136698 May 28 21:24:57.363506 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2327/4712] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:24:57 2022] POST /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958/action => generated 24569 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:24:57.441678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b4cf3ae1-6c8a-4ca2-8855-1079fe19088e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:57.452549 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b4cf3ae1-6c8a-4ca2-8855-1079fe19088e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.428098 May 28 21:24:57.453153 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2386/4713] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:57 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:57.471489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5e07e9c0-52b4-423f-b2a1-739daa344ba2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:57.475423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5e07e9c0-52b4-423f-b2a1-739daa344ba2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:57.482914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e07e9c0-52b4-423f-b2a1-739daa344ba2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:57.483637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e07e9c0-52b4-423f-b2a1-739daa344ba2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:57.485034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e07e9c0-52b4-423f-b2a1-739daa344ba2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:57.485651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5e07e9c0-52b4-423f-b2a1-739daa344ba2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:57.715659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5e07e9c0-52b4-423f-b2a1-739daa344ba2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:57.724949 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5e07e9c0-52b4-423f-b2a1-739daa344ba2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.258151 May 28 21:24:57.727653 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2328/4714] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:57 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:57.743218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-04ccf275-0ebb-4b43-937d-fa6e6b0dcc32 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:57.744640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-04ccf275-0ebb-4b43-937d-fa6e6b0dcc32 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:57.756058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04ccf275-0ebb-4b43-937d-fa6e6b0dcc32 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:57.757246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04ccf275-0ebb-4b43-937d-fa6e6b0dcc32 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:57.758763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04ccf275-0ebb-4b43-937d-fa6e6b0dcc32 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:57.761262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04ccf275-0ebb-4b43-937d-fa6e6b0dcc32 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:57.799530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-62d0eb07-2a9c-4eee-9eb6-36867d1293a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:57.800423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-62d0eb07-2a9c-4eee-9eb6-36867d1293a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:57.808999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62d0eb07-2a9c-4eee-9eb6-36867d1293a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:57.809860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62d0eb07-2a9c-4eee-9eb6-36867d1293a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:57.810877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62d0eb07-2a9c-4eee-9eb6-36867d1293a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:57.811500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62d0eb07-2a9c-4eee-9eb6-36867d1293a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:57.941396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-62d0eb07-2a9c-4eee-9eb6-36867d1293a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:57.949499 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-62d0eb07-2a9c-4eee-9eb6-36867d1293a3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1275 microversion: 2.1 time: 0.154202 May 28 21:24:57.956361 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2329/4715] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:57 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1275 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:24:58.058171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-04ccf275-0ebb-4b43-937d-fa6e6b0dcc32 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:58.066508 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-04ccf275-0ebb-4b43-937d-fa6e6b0dcc32 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.327107 May 28 21:24:58.067482 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2387/4716] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:57 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:58.232197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1703fdc7-b67a-4a98-a455-25569dcd5f77 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:58.232875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1703fdc7-b67a-4a98-a455-25569dcd5f77 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:58.239930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2134513714", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "d304eff3-8e4f-4892-8a6c-ef6717920bb8"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:24:58.243309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1703fdc7-b67a-4a98-a455-25569dcd5f77 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:58.246972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1703fdc7-b67a-4a98-a455-25569dcd5f77 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:58.248886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1703fdc7-b67a-4a98-a455-25569dcd5f77 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:58.249364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1703fdc7-b67a-4a98-a455-25569dcd5f77 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:58.363757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] validate_networks() for [('d304eff3-8e4f-4892-8a6c-ef6717920bb8', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:24:58.676173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1703fdc7-b67a-4a98-a455-25569dcd5f77 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:58.685337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1703fdc7-b67a-4a98-a455-25569dcd5f77 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:58.686920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1703fdc7-b67a-4a98-a455-25569dcd5f77 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:58.700198 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1703fdc7-b67a-4a98-a455-25569dcd5f77 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.461304 May 28 21:24:58.700198 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2330/4717] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:58 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:24:58.977773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-797cd532-c645-46ec-be81-1de6bd223cea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:58.978444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-797cd532-c645-46ec-be81-1de6bd223cea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:58.985385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-797cd532-c645-46ec-be81-1de6bd223cea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:58.985827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-797cd532-c645-46ec-be81-1de6bd223cea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:58.986648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-797cd532-c645-46ec-be81-1de6bd223cea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:58.987098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-797cd532-c645-46ec-be81-1de6bd223cea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:59.334088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:24:59.337663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:24:59.337663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:24:59.338187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:24:59.338830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:24:59.355187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:59.356680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:59.358054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:59.360687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:59.361623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-797cd532-c645-46ec-be81-1de6bd223cea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:59.376507 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-797cd532-c645-46ec-be81-1de6bd223cea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1317 microversion: 2.1 time: 0.402641 May 28 21:24:59.383239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Getting quotas for project 54447ea481574a128f06c24315f34e46. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:24:59.386484 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2331/4718] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:58 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:59.391400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Getting quotas for user 02d5fbb072814fd7923ecf12c7ecad7b and project 54447ea481574a128f06c24315f34e46. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:24:59.406307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:24:59.408966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:24:59.587374 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6d0994c1-ce8c-4bd2-b38b-34c9c4c0329e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.351889 May 28 21:24:59.588058 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2388/4719] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:24:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:24:59.599361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eec89739-9cd8-41e6-8f31-d26086f2359a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:59.600248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eec89739-9cd8-41e6-8f31-d26086f2359a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:59.678462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eec89739-9cd8-41e6-8f31-d26086f2359a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:24:59.687313 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eec89739-9cd8-41e6-8f31-d26086f2359a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1215 microversion: 2.1 time: 0.091663 May 28 21:24:59.696946 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2332/4720] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:24:59 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:24:59.727328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eeba2493-ef45-48de-8ab4-44a3fa445a56 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:24:59.729177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eeba2493-ef45-48de-8ab4-44a3fa445a56 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:24:59.768103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eeba2493-ef45-48de-8ab4-44a3fa445a56 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:59.769124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eeba2493-ef45-48de-8ab4-44a3fa445a56 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:24:59.770878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eeba2493-ef45-48de-8ab4-44a3fa445a56 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:24:59.771494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eeba2493-ef45-48de-8ab4-44a3fa445a56 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:00.111590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eeba2493-ef45-48de-8ab4-44a3fa445a56 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:00.122195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eeba2493-ef45-48de-8ab4-44a3fa445a56 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:00.136177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eeba2493-ef45-48de-8ab4-44a3fa445a56 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:00.136177 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eeba2493-ef45-48de-8ab4-44a3fa445a56 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.421251 May 28 21:25:00.137691 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2389/4721] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:24:59 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:25:00.286109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-5aec420b-086d-476f-b1ed-ee0b80b9d37e req-5b171904-90d5-4a3a-a4d2-b4a5122b1fcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa085b6-1742-4a91-a55f-aeb8b73824e7", "tag": "ecc2ca19-9082-4880-b151-fca5b4f499cb"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:00.302667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:00.305187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5aec420b-086d-476f-b1ed-ee0b80b9d37e req-5b171904-90d5-4a3a-a4d2-b4a5122b1fcb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:00.305941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5aec420b-086d-476f-b1ed-ee0b80b9d37e req-5b171904-90d5-4a3a-a4d2-b4a5122b1fcb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:00.323784 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-5aec420b-086d-476f-b1ed-ee0b80b9d37e req-5b171904-90d5-4a3a-a4d2-b4a5122b1fcb service nova] Creating event network-changed:ecc2ca19-9082-4880-b151-fca5b4f499cb for instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 on nch2-master-1 May 28 21:25:00.323784 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-5aec420b-086d-476f-b1ed-ee0b80b9d37e req-5b171904-90d5-4a3a-a4d2-b4a5122b1fcb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040862 May 28 21:25:00.325354 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2333/4722] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:25:00.393825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-04c50dd7-4876-4ecc-aa65-0ea8eb0db327 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:00.394469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-04c50dd7-4876-4ecc-aa65-0ea8eb0db327 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:00.408251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04c50dd7-4876-4ecc-aa65-0ea8eb0db327 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:00.409812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04c50dd7-4876-4ecc-aa65-0ea8eb0db327 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:00.410244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04c50dd7-4876-4ecc-aa65-0ea8eb0db327 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:00.410765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04c50dd7-4876-4ecc-aa65-0ea8eb0db327 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:00.687058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-04c50dd7-4876-4ecc-aa65-0ea8eb0db327 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:00.695896 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-04c50dd7-4876-4ecc-aa65-0ea8eb0db327 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1317 microversion: 2.1 time: 0.306076 May 28 21:25:00.706253 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2390/4723] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:00 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:00.708877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7c6d9b37-66f7-4ee0-8d0d-81987e117d87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:00.715892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7c6d9b37-66f7-4ee0-8d0d-81987e117d87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:00.719320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c6d9b37-66f7-4ee0-8d0d-81987e117d87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:00.719789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c6d9b37-66f7-4ee0-8d0d-81987e117d87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:00.720786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c6d9b37-66f7-4ee0-8d0d-81987e117d87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:00.721406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c6d9b37-66f7-4ee0-8d0d-81987e117d87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:00.841956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7c6d9b37-66f7-4ee0-8d0d-81987e117d87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:00.858304 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7c6d9b37-66f7-4ee0-8d0d-81987e117d87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1219 microversion: 2.1 time: 0.155779 May 28 21:25:00.859326 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2334/4724] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:00 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1219 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:01.154474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8ffb58f2-1b2b-4d55-b199-891e8b6c5086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:01.156378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8ffb58f2-1b2b-4d55-b199-891e8b6c5086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:01.167894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ffb58f2-1b2b-4d55-b199-891e8b6c5086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:01.168861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ffb58f2-1b2b-4d55-b199-891e8b6c5086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:01.169954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ffb58f2-1b2b-4d55-b199-891e8b6c5086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:01.170622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ffb58f2-1b2b-4d55-b199-891e8b6c5086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:01.450820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8ffb58f2-1b2b-4d55-b199-891e8b6c5086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:01.468377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8ffb58f2-1b2b-4d55-b199-891e8b6c5086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:01.474953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8ffb58f2-1b2b-4d55-b199-891e8b6c5086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:01.484293 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8ffb58f2-1b2b-4d55-b199-891e8b6c5086 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.336286 May 28 21:25:01.484293 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2391/4725] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:25:01 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:25:01.719628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-14c9d8b5-5198-4a61-ac3b-d0c51672c14a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:01.720970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-14c9d8b5-5198-4a61-ac3b-d0c51672c14a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:01.732858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:01.735667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14c9d8b5-5198-4a61-ac3b-d0c51672c14a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:01.736147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14c9d8b5-5198-4a61-ac3b-d0c51672c14a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:01.736981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14c9d8b5-5198-4a61-ac3b-d0c51672c14a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:01.737426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14c9d8b5-5198-4a61-ac3b-d0c51672c14a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:01.880908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6ca67df2-48ac-40d3-afaa-3924e9ae658b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:01.881532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6ca67df2-48ac-40d3-afaa-3924e9ae658b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:01.897984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ca67df2-48ac-40d3-afaa-3924e9ae658b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:01.897984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ca67df2-48ac-40d3-afaa-3924e9ae658b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:01.897984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ca67df2-48ac-40d3-afaa-3924e9ae658b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:01.897984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ca67df2-48ac-40d3-afaa-3924e9ae658b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:01.958228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-14c9d8b5-5198-4a61-ac3b-d0c51672c14a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:01.963270 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-14c9d8b5-5198-4a61-ac3b-d0c51672c14a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1317 microversion: 2.1 time: 0.251986 May 28 21:25:01.964084 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2335/4726] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:01 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:02.016273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6ca67df2-48ac-40d3-afaa-3924e9ae658b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:02.024831 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6ca67df2-48ac-40d3-afaa-3924e9ae658b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1267 microversion: 2.1 time: 0.147711 May 28 21:25:02.025421 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2392/4727] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:01 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:02.496138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-493df1a6-ea74-40f8-a8d3-53e2fa8ccbd4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:02.496772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-493df1a6-ea74-40f8-a8d3-53e2fa8ccbd4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:02.514402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-493df1a6-ea74-40f8-a8d3-53e2fa8ccbd4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:02.516122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-493df1a6-ea74-40f8-a8d3-53e2fa8ccbd4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:02.516122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-493df1a6-ea74-40f8-a8d3-53e2fa8ccbd4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:02.516122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-493df1a6-ea74-40f8-a8d3-53e2fa8ccbd4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:02.980926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-52fd5dad-ae15-46b7-aa9a-e0bd05a30afb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:02.981560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-52fd5dad-ae15-46b7-aa9a-e0bd05a30afb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:03.000477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52fd5dad-ae15-46b7-aa9a-e0bd05a30afb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:03.001261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52fd5dad-ae15-46b7-aa9a-e0bd05a30afb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:03.002170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52fd5dad-ae15-46b7-aa9a-e0bd05a30afb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:03.002627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52fd5dad-ae15-46b7-aa9a-e0bd05a30afb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:03.265556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-493df1a6-ea74-40f8-a8d3-53e2fa8ccbd4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:03.284435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-493df1a6-ea74-40f8-a8d3-53e2fa8ccbd4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:03.293216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-493df1a6-ea74-40f8-a8d3-53e2fa8ccbd4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:03.295741 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-493df1a6-ea74-40f8-a8d3-53e2fa8ccbd4 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.803811 May 28 21:25:03.296781 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2336/4728] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:25:02 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:25:03.321126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-348c38f8-afcf-4dee-af14-6a6d195b58e4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:03.322242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-348c38f8-afcf-4dee-af14-6a6d195b58e4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:03.332652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-348c38f8-afcf-4dee-af14-6a6d195b58e4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:03.333425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-348c38f8-afcf-4dee-af14-6a6d195b58e4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:03.337715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-348c38f8-afcf-4dee-af14-6a6d195b58e4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:03.337715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-348c38f8-afcf-4dee-af14-6a6d195b58e4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:03.346817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:03.424915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-52fd5dad-ae15-46b7-aa9a-e0bd05a30afb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:03.434603 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-52fd5dad-ae15-46b7-aa9a-e0bd05a30afb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1317 microversion: 2.1 time: 0.457884 May 28 21:25:03.436656 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2393/4729] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:02 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:03.448715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-348c38f8-afcf-4dee-af14-6a6d195b58e4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:03.461785 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-348c38f8-afcf-4dee-af14-6a6d195b58e4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1273 microversion: 2.1 time: 0.147619 May 28 21:25:03.463169 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2337/4730] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:03 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:03.609661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b7f66173-33cf-4b76-8869-923cc44b25e6 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:03.610316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b7f66173-33cf-4b76-8869-923cc44b25e6 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:03.616476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7f66173-33cf-4b76-8869-923cc44b25e6 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:03.616937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7f66173-33cf-4b76-8869-923cc44b25e6 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:03.617757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7f66173-33cf-4b76-8869-923cc44b25e6 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:03.618189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b7f66173-33cf-4b76-8869-923cc44b25e6 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:03.761640 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b7f66173-33cf-4b76-8869-923cc44b25e6 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1832 microversion: 2.1 time: 0.155632 May 28 21:25:03.762270 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2394/4731] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:03 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1832 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:04.315254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4bdeb51e-4334-4ca9-9688-588d12fc795a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:04.316511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4bdeb51e-4334-4ca9-9688-588d12fc795a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:04.326689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bdeb51e-4334-4ca9-9688-588d12fc795a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:04.327799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bdeb51e-4334-4ca9-9688-588d12fc795a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:04.328792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bdeb51e-4334-4ca9-9688-588d12fc795a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:04.329452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bdeb51e-4334-4ca9-9688-588d12fc795a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:04.439859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d7f1df7d-e426-4ae8-8e5b-62de4f83ce57 req-6e1f4591-5274-4ea9-a634-69dff299d04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd20dd19-f26b-4e32-9114-715558d5aa3b", "name": "network-vif-plugged", "status": "completed", "tag": "4c95deb6-3882-40f5-af0e-fd2149216c59"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:04.465711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d7f1df7d-e426-4ae8-8e5b-62de4f83ce57 req-6e1f4591-5274-4ea9-a634-69dff299d04e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:04.466242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d7f1df7d-e426-4ae8-8e5b-62de4f83ce57 req-6e1f4591-5274-4ea9-a634-69dff299d04e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:04.499986 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d7f1df7d-e426-4ae8-8e5b-62de4f83ce57 req-6e1f4591-5274-4ea9-a634-69dff299d04e service nova] Creating event network-vif-plugged:4c95deb6-3882-40f5-af0e-fd2149216c59 for instance cd20dd19-f26b-4e32-9114-715558d5aa3b on nch2-master-1 May 28 21:25:04.505941 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d7f1df7d-e426-4ae8-8e5b-62de4f83ce57 req-6e1f4591-5274-4ea9-a634-69dff299d04e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071024 May 28 21:25:04.507586 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2395/4732] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:25:04.513054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-187064b1-55ca-4c64-89ba-c4984067e221 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:04.514076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-187064b1-55ca-4c64-89ba-c4984067e221 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:04.535630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-187064b1-55ca-4c64-89ba-c4984067e221 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:04.536454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-187064b1-55ca-4c64-89ba-c4984067e221 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:04.537598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-187064b1-55ca-4c64-89ba-c4984067e221 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:04.538283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-187064b1-55ca-4c64-89ba-c4984067e221 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:04.718225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4bdeb51e-4334-4ca9-9688-588d12fc795a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:04.733098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4bdeb51e-4334-4ca9-9688-588d12fc795a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:04.734886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4bdeb51e-4334-4ca9-9688-588d12fc795a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:04.736086 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4bdeb51e-4334-4ca9-9688-588d12fc795a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.426285 May 28 21:25:04.746654 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2338/4733] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:25:04 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:25:04.747326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e7c15d1a-e69f-4445-8bd5-e7aa40d42946 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:04.747949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e7c15d1a-e69f-4445-8bd5-e7aa40d42946 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:04.769803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7c15d1a-e69f-4445-8bd5-e7aa40d42946 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:04.770467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7c15d1a-e69f-4445-8bd5-e7aa40d42946 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:04.771438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7c15d1a-e69f-4445-8bd5-e7aa40d42946 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:04.778994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7c15d1a-e69f-4445-8bd5-e7aa40d42946 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:05.112109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-187064b1-55ca-4c64-89ba-c4984067e221 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:05.124370 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-187064b1-55ca-4c64-89ba-c4984067e221 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1317 microversion: 2.1 time: 0.615184 May 28 21:25:05.125571 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2396/4734] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:04 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:05.130766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-f4c68569-8d9e-4600-9db7-0e52179af548 req-ac6a0f06-bcd1-40cb-8c8c-7ee7744f8c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7fdc441-5fd2-4945-8749-ad17d0140a5d", "tag": "d2d5eed9-fe81-4c87-8dc3-8afcae96de04"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:05.148612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f4c68569-8d9e-4600-9db7-0e52179af548 req-ac6a0f06-bcd1-40cb-8c8c-7ee7744f8c39 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:05.148612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f4c68569-8d9e-4600-9db7-0e52179af548 req-ac6a0f06-bcd1-40cb-8c8c-7ee7744f8c39 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:05.162595 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-f4c68569-8d9e-4600-9db7-0e52179af548 req-ac6a0f06-bcd1-40cb-8c8c-7ee7744f8c39 service nova] Creating event network-changed:d2d5eed9-fe81-4c87-8dc3-8afcae96de04 for instance d7fdc441-5fd2-4945-8749-ad17d0140a5d on nch1-master-1 May 28 21:25:05.172035 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-f4c68569-8d9e-4600-9db7-0e52179af548 req-ac6a0f06-bcd1-40cb-8c8c-7ee7744f8c39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044237 May 28 21:25:05.180337 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2397/4735] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:25:05.324371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e7c15d1a-e69f-4445-8bd5-e7aa40d42946 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:05.334282 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e7c15d1a-e69f-4445-8bd5-e7aa40d42946 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1315 microversion: 2.1 time: 0.590694 May 28 21:25:05.334862 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2339/4736] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:04 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:05.755391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d55b580e-cf09-4cd5-b85e-e28e82456e76 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:05.756689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d55b580e-cf09-4cd5-b85e-e28e82456e76 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:05.764538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d55b580e-cf09-4cd5-b85e-e28e82456e76 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:05.765977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d55b580e-cf09-4cd5-b85e-e28e82456e76 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:05.765977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d55b580e-cf09-4cd5-b85e-e28e82456e76 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:05.766260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d55b580e-cf09-4cd5-b85e-e28e82456e76 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:05.995975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d55b580e-cf09-4cd5-b85e-e28e82456e76 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:06.005749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d55b580e-cf09-4cd5-b85e-e28e82456e76 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:06.007573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d55b580e-cf09-4cd5-b85e-e28e82456e76 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:06.009547 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d55b580e-cf09-4cd5-b85e-e28e82456e76 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.258946 May 28 21:25:06.010674 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2398/4737] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:25:05 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:25:06.142827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9f364099-f736-4d13-b38e-eaf9704a21be tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:06.143349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9f364099-f736-4d13-b38e-eaf9704a21be tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:06.145281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5bb73920-b54b-4497-914c-a345bc572a4c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:06.146167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5bb73920-b54b-4497-914c-a345bc572a4c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:06.152036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f364099-f736-4d13-b38e-eaf9704a21be tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:06.152502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f364099-f736-4d13-b38e-eaf9704a21be tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:06.156636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f364099-f736-4d13-b38e-eaf9704a21be tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:06.157153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f364099-f736-4d13-b38e-eaf9704a21be tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:06.167588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bb73920-b54b-4497-914c-a345bc572a4c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:06.167588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bb73920-b54b-4497-914c-a345bc572a4c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:06.167588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bb73920-b54b-4497-914c-a345bc572a4c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:06.168289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bb73920-b54b-4497-914c-a345bc572a4c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:06.197621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9f364099-f736-4d13-b38e-eaf9704a21be tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:25:06.202368 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:06.353366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5bb73920-b54b-4497-914c-a345bc572a4c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:06.362163 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5bb73920-b54b-4497-914c-a345bc572a4c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1317 microversion: 2.1 time: 0.223132 May 28 21:25:06.362981 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2399/4738] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:06 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:06.368013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-fadbd7e1-e307-4bb3-a2e7-69d4ca11f7df req-df1a2f14-062c-46e0-a8ae-bd3318c4edb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a7a3bfa-2077-4b86-8670-bd2428861958", "tag": "31f937d0-8453-4ce1-8d41-4a95e908e103"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:06.377061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-fadbd7e1-e307-4bb3-a2e7-69d4ca11f7df req-df1a2f14-062c-46e0-a8ae-bd3318c4edb1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:06.377902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-fadbd7e1-e307-4bb3-a2e7-69d4ca11f7df req-df1a2f14-062c-46e0-a8ae-bd3318c4edb1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:06.395383 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-fadbd7e1-e307-4bb3-a2e7-69d4ca11f7df req-df1a2f14-062c-46e0-a8ae-bd3318c4edb1 service nova] Creating event network-changed:31f937d0-8453-4ce1-8d41-4a95e908e103 for instance 6a7a3bfa-2077-4b86-8670-bd2428861958 on nch2-master-1 May 28 21:25:06.401227 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-fadbd7e1-e307-4bb3-a2e7-69d4ca11f7df req-df1a2f14-062c-46e0-a8ae-bd3318c4edb1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036567 May 28 21:25:06.401874 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2400/4739] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:25:06.414074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-81ed8db1-f336-4328-8871-84e1d9881e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:06.414074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-81ed8db1-f336-4328-8871-84e1d9881e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:06.434220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81ed8db1-f336-4328-8871-84e1d9881e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:06.434960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81ed8db1-f336-4328-8871-84e1d9881e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:06.435410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81ed8db1-f336-4328-8871-84e1d9881e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:06.435886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81ed8db1-f336-4328-8871-84e1d9881e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:06.710740 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9f364099-f736-4d13-b38e-eaf9704a21be tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 204 len: 0 microversion: 2.1 time: 0.571410 May 28 21:25:06.713664 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2340/4740] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:25:06 2022] DELETE /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:25:06.723242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ca237422-d589-4717-98c7-e75e30147ecc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:06.724243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ca237422-d589-4717-98c7-e75e30147ecc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:06.736961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca237422-d589-4717-98c7-e75e30147ecc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:06.739760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca237422-d589-4717-98c7-e75e30147ecc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:06.740874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca237422-d589-4717-98c7-e75e30147ecc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:06.741236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca237422-d589-4717-98c7-e75e30147ecc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:06.954854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-81ed8db1-f336-4328-8871-84e1d9881e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:06.987779 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-81ed8db1-f336-4328-8871-84e1d9881e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1315 microversion: 2.1 time: 0.584294 May 28 21:25:06.989076 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2401/4741] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:06 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:07.002926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ca237422-d589-4717-98c7-e75e30147ecc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:07.013620 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ca237422-d589-4717-98c7-e75e30147ecc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1687 microversion: 2.1 time: 0.295307 May 28 21:25:07.014594 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2341/4742] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:06 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1687 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:07.028240 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7d1deb8d-6cf7-47d9-a7e4-66948c33ad06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:07.029116 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7d1deb8d-6cf7-47d9-a7e4-66948c33ad06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:07.037362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d1deb8d-6cf7-47d9-a7e4-66948c33ad06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:07.038078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d1deb8d-6cf7-47d9-a7e4-66948c33ad06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:07.039501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d1deb8d-6cf7-47d9-a7e4-66948c33ad06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:07.040890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d1deb8d-6cf7-47d9-a7e4-66948c33ad06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:07.237571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7d1deb8d-6cf7-47d9-a7e4-66948c33ad06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:07.267673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7d1deb8d-6cf7-47d9-a7e4-66948c33ad06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:07.277285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7d1deb8d-6cf7-47d9-a7e4-66948c33ad06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:07.279036 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7d1deb8d-6cf7-47d9-a7e4-66948c33ad06 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1731 microversion: 2.20 time: 0.255102 May 28 21:25:07.280367 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2402/4743] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:25:07 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1731 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:25:07.380231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-da29a1a3-b8e7-439c-9867-c244cf15f99a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:07.381556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-da29a1a3-b8e7-439c-9867-c244cf15f99a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:07.390729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da29a1a3-b8e7-439c-9867-c244cf15f99a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:07.392667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da29a1a3-b8e7-439c-9867-c244cf15f99a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:07.392667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da29a1a3-b8e7-439c-9867-c244cf15f99a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:07.392667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da29a1a3-b8e7-439c-9867-c244cf15f99a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:07.587672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-da29a1a3-b8e7-439c-9867-c244cf15f99a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:07.598293 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-da29a1a3-b8e7-439c-9867-c244cf15f99a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1317 microversion: 2.1 time: 0.222166 May 28 21:25:07.598906 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2342/4744] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:07 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:08.005361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eb4bf82a-ecd5-4a65-8c19-354a739150fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:08.006041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eb4bf82a-ecd5-4a65-8c19-354a739150fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:08.015010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb4bf82a-ecd5-4a65-8c19-354a739150fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:08.015717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb4bf82a-ecd5-4a65-8c19-354a739150fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:08.016669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb4bf82a-ecd5-4a65-8c19-354a739150fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:08.017106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb4bf82a-ecd5-4a65-8c19-354a739150fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:08.034877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-474193b5-2f5c-4e43-b5a1-ec53edadb446 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:08.035723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-474193b5-2f5c-4e43-b5a1-ec53edadb446 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:08.047751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-474193b5-2f5c-4e43-b5a1-ec53edadb446 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:08.047751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-474193b5-2f5c-4e43-b5a1-ec53edadb446 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:08.047751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-474193b5-2f5c-4e43-b5a1-ec53edadb446 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:08.048423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-474193b5-2f5c-4e43-b5a1-ec53edadb446 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:08.930097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eb4bf82a-ecd5-4a65-8c19-354a739150fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:08.931557 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-474193b5-2f5c-4e43-b5a1-ec53edadb446 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:08.932273 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eb4bf82a-ecd5-4a65-8c19-354a739150fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1315 microversion: 2.1 time: 0.930747 May 28 21:25:08.932865 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2403/4745] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:08 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1315 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:08.938113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-52b392ff-e3d2-4181-962a-c56093bd95d6 req-48d3c49e-070b-4af8-8705-21635a7f4c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa085b6-1742-4a91-a55f-aeb8b73824e7", "name": "network-vif-plugged", "status": "completed", "tag": "ecc2ca19-9082-4880-b151-fca5b4f499cb"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:08.947529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-52b392ff-e3d2-4181-962a-c56093bd95d6 req-48d3c49e-070b-4af8-8705-21635a7f4c39 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:08.948254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-52b392ff-e3d2-4181-962a-c56093bd95d6 req-48d3c49e-070b-4af8-8705-21635a7f4c39 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:08.948472 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-474193b5-2f5c-4e43-b5a1-ec53edadb446 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1687 microversion: 2.1 time: 0.919692 May 28 21:25:08.950509 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2343/4746] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:08 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1687 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:08.955568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6a46bde3-75ad-4690-be97-cf695ac042cd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:08.960149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6a46bde3-75ad-4690-be97-cf695ac042cd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:08.963322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a46bde3-75ad-4690-be97-cf695ac042cd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:08.963983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a46bde3-75ad-4690-be97-cf695ac042cd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:08.964952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a46bde3-75ad-4690-be97-cf695ac042cd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:08.965396 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-52b392ff-e3d2-4181-962a-c56093bd95d6 req-48d3c49e-070b-4af8-8705-21635a7f4c39 service nova] Creating event network-vif-plugged:ecc2ca19-9082-4880-b151-fca5b4f499cb for instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 on nch2-master-1 May 28 21:25:08.965734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a46bde3-75ad-4690-be97-cf695ac042cd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:08.971088 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-52b392ff-e3d2-4181-962a-c56093bd95d6 req-48d3c49e-070b-4af8-8705-21635a7f4c39 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036514 May 28 21:25:08.972214 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2404/4747] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:25:08.981375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9e65053c-810f-4c70-9ce1-c9643ae86372 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:08.983761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9e65053c-810f-4c70-9ce1-c9643ae86372 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:08.995030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e65053c-810f-4c70-9ce1-c9643ae86372 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:08.996390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e65053c-810f-4c70-9ce1-c9643ae86372 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:08.999893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e65053c-810f-4c70-9ce1-c9643ae86372 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:08.999893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e65053c-810f-4c70-9ce1-c9643ae86372 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:09.369040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:09.396141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6a46bde3-75ad-4690-be97-cf695ac042cd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:09.406851 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:09.418814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6a46bde3-75ad-4690-be97-cf695ac042cd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:09.420600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6a46bde3-75ad-4690-be97-cf695ac042cd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:09.422089 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6a46bde3-75ad-4690-be97-cf695ac042cd tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1718 microversion: 2.20 time: 0.470421 May 28 21:25:09.423297 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2344/4748] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:25:08 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1718 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:25:09.441464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9e65053c-810f-4c70-9ce1-c9643ae86372 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:09.450712 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9e65053c-810f-4c70-9ce1-c9643ae86372 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1317 microversion: 2.1 time: 0.476688 May 28 21:25:09.451548 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2405/4749] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:08 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:09.829984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-322a6b8a-7ea1-4367-91b0-0c11eaaa3a33 req-e5c26fda-51b2-4044-b57a-ac7110cd6ea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7a3bfa-2077-4b86-8670-bd2428861958", "name": "network-vif-deleted", "tag": "31f937d0-8453-4ce1-8d41-4a95e908e103"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:09.843022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=12 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:09.854631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-322a6b8a-7ea1-4367-91b0-0c11eaaa3a33 req-e5c26fda-51b2-4044-b57a-ac7110cd6ea8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:09.855455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-322a6b8a-7ea1-4367-91b0-0c11eaaa3a33 req-e5c26fda-51b2-4044-b57a-ac7110cd6ea8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:09.885056 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-322a6b8a-7ea1-4367-91b0-0c11eaaa3a33 req-e5c26fda-51b2-4044-b57a-ac7110cd6ea8 service nova] Creating event network-vif-deleted:31f937d0-8453-4ce1-8d41-4a95e908e103 for instance 6a7a3bfa-2077-4b86-8670-bd2428861958 on nch2-master-1 May 28 21:25:09.893494 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-322a6b8a-7ea1-4367-91b0-0c11eaaa3a33 req-e5c26fda-51b2-4044-b57a-ac7110cd6ea8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071909 May 28 21:25:09.907230 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2345/4750] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:25:09.949977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e532acf2-9281-4b7a-b3fb-743b314bc76d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:09.950576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e532acf2-9281-4b7a-b3fb-743b314bc76d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:09.957622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e532acf2-9281-4b7a-b3fb-743b314bc76d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:09.958121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e532acf2-9281-4b7a-b3fb-743b314bc76d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:09.959100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e532acf2-9281-4b7a-b3fb-743b314bc76d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:09.959549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e532acf2-9281-4b7a-b3fb-743b314bc76d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:09.977371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c16dd34c-37ae-4301-99af-6cefe0d91ee1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:09.983430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c16dd34c-37ae-4301-99af-6cefe0d91ee1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:09.995397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c16dd34c-37ae-4301-99af-6cefe0d91ee1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:09.997271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c16dd34c-37ae-4301-99af-6cefe0d91ee1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:09.998304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c16dd34c-37ae-4301-99af-6cefe0d91ee1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:09.999220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c16dd34c-37ae-4301-99af-6cefe0d91ee1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:10.095171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c16dd34c-37ae-4301-99af-6cefe0d91ee1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:10.104135 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c16dd34c-37ae-4301-99af-6cefe0d91ee1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1502 microversion: 2.1 time: 0.131555 May 28 21:25:10.105071 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2346/4751] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:09 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1502 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:10.246379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e532acf2-9281-4b7a-b3fb-743b314bc76d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:10.254536 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e532acf2-9281-4b7a-b3fb-743b314bc76d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1315 microversion: 2.1 time: 0.309105 May 28 21:25:10.264834 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2406/4752] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:09 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:10.468005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1dde36ca-cf63-4539-bf8a-d48d35716f99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:10.468633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1dde36ca-cf63-4539-bf8a-d48d35716f99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:10.476326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1dde36ca-cf63-4539-bf8a-d48d35716f99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:10.482657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1dde36ca-cf63-4539-bf8a-d48d35716f99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:10.482657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1dde36ca-cf63-4539-bf8a-d48d35716f99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:10.482657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1dde36ca-cf63-4539-bf8a-d48d35716f99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:10.699395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1dde36ca-cf63-4539-bf8a-d48d35716f99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:10.711698 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1dde36ca-cf63-4539-bf8a-d48d35716f99 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1317 microversion: 2.1 time: 0.247630 May 28 21:25:10.713401 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2347/4753] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:10 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:11.058441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d3d918da-fa99-4b2d-af9e-103408b3fe79 req-259661db-c374-48d6-8ada-a5f6986d411c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fdc441-5fd2-4945-8749-ad17d0140a5d", "name": "network-vif-plugged", "status": "completed", "tag": "d2d5eed9-fe81-4c87-8dc3-8afcae96de04"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:11.069828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d3d918da-fa99-4b2d-af9e-103408b3fe79 req-259661db-c374-48d6-8ada-a5f6986d411c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:11.071310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d3d918da-fa99-4b2d-af9e-103408b3fe79 req-259661db-c374-48d6-8ada-a5f6986d411c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:11.089113 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d3d918da-fa99-4b2d-af9e-103408b3fe79 req-259661db-c374-48d6-8ada-a5f6986d411c service nova] Creating event network-vif-plugged:d2d5eed9-fe81-4c87-8dc3-8afcae96de04 for instance d7fdc441-5fd2-4945-8749-ad17d0140a5d on nch1-master-1 May 28 21:25:11.100055 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d3d918da-fa99-4b2d-af9e-103408b3fe79 req-259661db-c374-48d6-8ada-a5f6986d411c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051558 May 28 21:25:11.101689 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2407/4754] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:25:11.122715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0fdd3199-6f91-4cc5-aa70-28ad6e9071ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:11.123338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0fdd3199-6f91-4cc5-aa70-28ad6e9071ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:11.134604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0fdd3199-6f91-4cc5-aa70-28ad6e9071ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:11.135066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0fdd3199-6f91-4cc5-aa70-28ad6e9071ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:11.141421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0fdd3199-6f91-4cc5-aa70-28ad6e9071ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:11.145204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0fdd3199-6f91-4cc5-aa70-28ad6e9071ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:11.230849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0fdd3199-6f91-4cc5-aa70-28ad6e9071ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:11.235709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0fdd3199-6f91-4cc5-aa70-28ad6e9071ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:11.236213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-0fdd3199-6f91-4cc5-aa70-28ad6e9071ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lazy-loading 'fault' on Instance uuid 6a7a3bfa-2077-4b86-8670-bd2428861958 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:25:11.277610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ae3e1634-42f1-4b62-81dd-914d52fcf0a5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:11.278478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ae3e1634-42f1-4b62-81dd-914d52fcf0a5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:11.293864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae3e1634-42f1-4b62-81dd-914d52fcf0a5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:11.294580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae3e1634-42f1-4b62-81dd-914d52fcf0a5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:11.295693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae3e1634-42f1-4b62-81dd-914d52fcf0a5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:11.296300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae3e1634-42f1-4b62-81dd-914d52fcf0a5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:11.310095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0fdd3199-6f91-4cc5-aa70-28ad6e9071ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:11.318922 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0fdd3199-6f91-4cc5-aa70-28ad6e9071ec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 200 len: 1357 microversion: 2.1 time: 0.200992 May 28 21:25:11.320175 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2348/4755] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:11 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:11.474787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ae3e1634-42f1-4b62-81dd-914d52fcf0a5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:11.484262 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ae3e1634-42f1-4b62-81dd-914d52fcf0a5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1315 microversion: 2.1 time: 0.215983 May 28 21:25:11.484983 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2408/4756] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:11 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:11.728948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-64ea3436-d333-4226-8ae3-a5a82ef22c87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:11.729615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-64ea3436-d333-4226-8ae3-a5a82ef22c87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:11.742519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64ea3436-d333-4226-8ae3-a5a82ef22c87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:11.743264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64ea3436-d333-4226-8ae3-a5a82ef22c87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:11.744211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64ea3436-d333-4226-8ae3-a5a82ef22c87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:11.744850 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64ea3436-d333-4226-8ae3-a5a82ef22c87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:11.902264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-64ea3436-d333-4226-8ae3-a5a82ef22c87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:11.916002 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-64ea3436-d333-4226-8ae3-a5a82ef22c87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1505 microversion: 2.1 time: 0.190824 May 28 21:25:11.925303 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2349/4757] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:11 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:11.934356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-753539e4-4930-4623-824d-493d15387dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:11.934869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-753539e4-4930-4623-824d-493d15387dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:11.945361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-753539e4-4930-4623-824d-493d15387dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:11.946069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-753539e4-4930-4623-824d-493d15387dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:11.947389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-753539e4-4930-4623-824d-493d15387dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:11.947958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-753539e4-4930-4623-824d-493d15387dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:11.982436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-753539e4-4930-4623-824d-493d15387dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:25:12.274429 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-753539e4-4930-4623-824d-493d15387dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 204 len: 0 microversion: 2.1 time: 0.343827 May 28 21:25:12.278139 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2409/4758] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:25:11 2022] DELETE /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:25:12.285701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4f967092-6b6c-4ef0-afd9-2ab8c0126362 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:12.286591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4f967092-6b6c-4ef0-afd9-2ab8c0126362 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:12.292971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f967092-6b6c-4ef0-afd9-2ab8c0126362 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:12.293439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f967092-6b6c-4ef0-afd9-2ab8c0126362 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:12.294324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f967092-6b6c-4ef0-afd9-2ab8c0126362 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:12.294784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f967092-6b6c-4ef0-afd9-2ab8c0126362 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:12.347151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-15228ea7-2c26-4037-9596-72dc016102ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:12.348649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-15228ea7-2c26-4037-9596-72dc016102ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 6a7a3bfa-2077-4b86-8670-bd2428861958] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:12.356410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15228ea7-2c26-4037-9596-72dc016102ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:12.357118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15228ea7-2c26-4037-9596-72dc016102ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:12.358179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15228ea7-2c26-4037-9596-72dc016102ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:12.358832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15228ea7-2c26-4037-9596-72dc016102ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:12.376727 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-15228ea7-2c26-4037-9596-72dc016102ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] HTTP exception thrown: Instance 6a7a3bfa-2077-4b86-8670-bd2428861958 could not be found. May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-15228ea7-2c26-4037-9596-72dc016102ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Request method failure captured: May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 HTTP/1.1 May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpKKy1DVesaj_dysVbGqpWcHx4cpHNtNqkxvMKKXBNqPepistzKKj5agiD8mz188E2_RFwo_f1as_TQInxyhgm3IcOuVM4c5upLUW3nrJ4MRI1Ng4P0UpvRwuZdeq2foyGDCzH24UQIOA6NcxtlTNzFgs85sIrFiF6Be00fINdCNhb0 May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: c3588eab36044e439158f876836ea514 May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-174864934 May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3588eab36044e439158f876836ea514", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3588eab36044e439158f876836ea514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3588eab36044e439158f876836ea514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3588eab36044e439158f876836ea514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestNetworkAdvancedServerOps-174864934 May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: c3588eab36044e439158f876836ea514 May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-174864934 May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestNetworkAdvancedServerOps-174864934-project May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: f3468a0b2d324603ab6c3080993bc0c8 May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestNetworkAdvancedServerOps-174864934-project May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 6a7a3bfa-2077-4b86-8670-bd2428861958 could not be found. May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '6a7a3bfa-2077-4b86-8670-bd2428861958'} May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a7a3bfa-2077-4b86-8670-bd2428861958 could not be found. May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a7a3bfa-2077-4b86-8670-bd2428861958 could not be found. May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:12.378746 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:12.383130 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:12.383130 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:12.383130 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:12.383130 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:12.383130 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:12.383130 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a7a3bfa-2077-4b86-8670-bd2428861958 could not be found. May 28 21:25:12.383130 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:12.385479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-15228ea7-2c26-4037-9596-72dc016102ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Returning 404 to user: Instance 6a7a3bfa-2077-4b86-8670-bd2428861958 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:12.386795 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-15228ea7-2c26-4037-9596-72dc016102ed tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958" status: 404 len: 111 microversion: 2.1 time: 0.053295 May 28 21:25:12.388228 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2410/4759] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:12 2022] GET /compute/v2.1/servers/6a7a3bfa-2077-4b86-8670-bd2428861958 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:25:12.477193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4f967092-6b6c-4ef0-afd9-2ab8c0126362 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:12.494788 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4f967092-6b6c-4ef0-afd9-2ab8c0126362 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1511 microversion: 2.1 time: 0.210224 May 28 21:25:12.499269 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2350/4760] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:12 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1511 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:12.508016 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ed271f4e-931b-44c8-8794-fd03cf5160db tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:12.508864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ed271f4e-931b-44c8-8794-fd03cf5160db tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:12.519963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed271f4e-931b-44c8-8794-fd03cf5160db tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:12.522604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed271f4e-931b-44c8-8794-fd03cf5160db tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:12.524885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed271f4e-931b-44c8-8794-fd03cf5160db tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:12.525991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed271f4e-931b-44c8-8794-fd03cf5160db tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:12.724159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ed271f4e-931b-44c8-8794-fd03cf5160db tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:12.732709 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ed271f4e-931b-44c8-8794-fd03cf5160db tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1315 microversion: 2.1 time: 0.228806 May 28 21:25:12.733359 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2411/4761] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:12 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:13.512749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8cbb6e5b-409f-4023-9e8d-20dfbc79233c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:13.514392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8cbb6e5b-409f-4023-9e8d-20dfbc79233c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:13.522132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cbb6e5b-409f-4023-9e8d-20dfbc79233c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:13.522681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cbb6e5b-409f-4023-9e8d-20dfbc79233c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:13.523464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cbb6e5b-409f-4023-9e8d-20dfbc79233c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:13.531594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cbb6e5b-409f-4023-9e8d-20dfbc79233c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:13.699269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8cbb6e5b-409f-4023-9e8d-20dfbc79233c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:13.733132 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8cbb6e5b-409f-4023-9e8d-20dfbc79233c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1511 microversion: 2.1 time: 0.224996 May 28 21:25:13.734549 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2351/4762] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:13 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1511 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:13.751887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fcb544f9-b8dc-4fb8-a52f-5f6f0909fa09 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:13.752517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fcb544f9-b8dc-4fb8-a52f-5f6f0909fa09 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:13.762996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:13.764830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcb544f9-b8dc-4fb8-a52f-5f6f0909fa09 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:13.765464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcb544f9-b8dc-4fb8-a52f-5f6f0909fa09 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:13.766588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcb544f9-b8dc-4fb8-a52f-5f6f0909fa09 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:13.767195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcb544f9-b8dc-4fb8-a52f-5f6f0909fa09 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:14.057331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fcb544f9-b8dc-4fb8-a52f-5f6f0909fa09 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:14.066734 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fcb544f9-b8dc-4fb8-a52f-5f6f0909fa09 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1502 microversion: 2.1 time: 0.318882 May 28 21:25:14.067936 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2412/4763] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:13 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1502 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:14.086946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-169b85ad-3d96-4834-9f18-ca549232b800 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:14.096324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-169b85ad-3d96-4834-9f18-ca549232b800 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:14.097627 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-169b85ad-3d96-4834-9f18-ca549232b800 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:14.128096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:14.138742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-169b85ad-3d96-4834-9f18-ca549232b800 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Going to try to stop instance {{(pid=143128) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 21:25:14.416478 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-169b85ad-3d96-4834-9f18-ca549232b800 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d/action" status: 202 len: 0 microversion: 2.1 time: 0.333455 May 28 21:25:14.421586 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2352/4764] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:14 2022] POST /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:25:14.426851 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-487a3e62-ff6a-447b-9f22-c72f038d7dd3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:14.427869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-487a3e62-ff6a-447b-9f22-c72f038d7dd3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:14.453639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-487a3e62-ff6a-447b-9f22-c72f038d7dd3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:14.453639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-487a3e62-ff6a-447b-9f22-c72f038d7dd3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:14.453639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-487a3e62-ff6a-447b-9f22-c72f038d7dd3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:14.453639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-487a3e62-ff6a-447b-9f22-c72f038d7dd3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:14.727885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-7adb8eda-349f-4f11-a790-5647d1eb4f2b req-17aeb98e-0b69-4bfc-8e9e-9b44b59c248b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa085b6-1742-4a91-a55f-aeb8b73824e7", "name": "network-vif-deleted", "tag": "ecc2ca19-9082-4880-b151-fca5b4f499cb"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:14.753276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7adb8eda-349f-4f11-a790-5647d1eb4f2b req-17aeb98e-0b69-4bfc-8e9e-9b44b59c248b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:14.754118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7adb8eda-349f-4f11-a790-5647d1eb4f2b req-17aeb98e-0b69-4bfc-8e9e-9b44b59c248b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:14.778625 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-7adb8eda-349f-4f11-a790-5647d1eb4f2b req-17aeb98e-0b69-4bfc-8e9e-9b44b59c248b service nova] Creating event network-vif-deleted:ecc2ca19-9082-4880-b151-fca5b4f499cb for instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 on nch2-master-1 May 28 21:25:14.783990 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-7adb8eda-349f-4f11-a790-5647d1eb4f2b req-17aeb98e-0b69-4bfc-8e9e-9b44b59c248b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061658 May 28 21:25:14.785256 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2353/4765] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:25:14.812447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fe5971b5-a8fc-45ef-9eb6-403a95cf1831 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:14.823099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fe5971b5-a8fc-45ef-9eb6-403a95cf1831 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:14.832894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fe5971b5-a8fc-45ef-9eb6-403a95cf1831 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:14.833358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fe5971b5-a8fc-45ef-9eb6-403a95cf1831 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:14.834179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fe5971b5-a8fc-45ef-9eb6-403a95cf1831 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:14.834623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fe5971b5-a8fc-45ef-9eb6-403a95cf1831 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:14.926085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-487a3e62-ff6a-447b-9f22-c72f038d7dd3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:14.946620 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-487a3e62-ff6a-447b-9f22-c72f038d7dd3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.511176 May 28 21:25:14.947859 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2413/4766] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:14 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:14.985210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fe5971b5-a8fc-45ef-9eb6-403a95cf1831 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:14.993454 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fe5971b5-a8fc-45ef-9eb6-403a95cf1831 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 200 len: 1469 microversion: 2.1 time: 0.206011 May 28 21:25:15.002421 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2354/4767] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:14 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 1469 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:15.964672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e051d64a-b487-49ef-bef8-36a7e78369c7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:15.967417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e051d64a-b487-49ef-bef8-36a7e78369c7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:15.983071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e051d64a-b487-49ef-bef8-36a7e78369c7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:15.984510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e051d64a-b487-49ef-bef8-36a7e78369c7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:16.003640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e051d64a-b487-49ef-bef8-36a7e78369c7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:16.004593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e051d64a-b487-49ef-bef8-36a7e78369c7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:16.011831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c71e8be2-9f43-4e41-be7f-afbbd56608a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:16.012457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c71e8be2-9f43-4e41-be7f-afbbd56608a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:16.024832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c71e8be2-9f43-4e41-be7f-afbbd56608a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:16.029329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c71e8be2-9f43-4e41-be7f-afbbd56608a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:16.031558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c71e8be2-9f43-4e41-be7f-afbbd56608a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:16.032964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c71e8be2-9f43-4e41-be7f-afbbd56608a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:16.079802 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-c71e8be2-9f43-4e41-be7f-afbbd56608a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c71e8be2-9f43-4e41-be7f-afbbd56608a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 HTTP/1.1 May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '3fa085b6-1742-4a91-a55f-aeb8b73824e7'} May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:16.082681 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:16.088935 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:16.088935 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:16.088935 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:16.088935 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:16.088935 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:16.088935 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:25:16.088935 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:16.088935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c71e8be2-9f43-4e41-be7f-afbbd56608a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:16.088935 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c71e8be2-9f43-4e41-be7f-afbbd56608a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 404 len: 111 microversion: 2.1 time: 0.078773 May 28 21:25:16.091638 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2355/4768] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:16 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:25:16.109115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dd6f53fb-b115-4aff-951d-f603070af243 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:16.109809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dd6f53fb-b115-4aff-951d-f603070af243 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:16.119990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd6f53fb-b115-4aff-951d-f603070af243 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:16.120449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd6f53fb-b115-4aff-951d-f603070af243 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:16.121356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd6f53fb-b115-4aff-951d-f603070af243 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:16.121875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd6f53fb-b115-4aff-951d-f603070af243 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:16.343125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e051d64a-b487-49ef-bef8-36a7e78369c7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:16.354606 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e051d64a-b487-49ef-bef8-36a7e78369c7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.393856 May 28 21:25:16.355215 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2414/4769] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:15 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:16.471028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dd6f53fb-b115-4aff-951d-f603070af243 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:16.481040 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dd6f53fb-b115-4aff-951d-f603070af243 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.387381 May 28 21:25:16.494413 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2356/4770] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:16 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:16.621513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ede8e593-86e2-49f4-affc-2721b0b0b669 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ede8e593-86e2-49f4-affc-2721b0b0b669 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 163 May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": 12345, "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'networks': [{'uuid': '3a3043e0-048b-4e2b-ab77-16b78a2870c5'}]}}} May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 12345 May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:25:16.631379 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:25:16.635945 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:25:16.635945 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 28 21:25:16.635945 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:16.635945 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:16.635945 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:16.635945 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:16.635945 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:16.635945 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:16.635945 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:25:16.635945 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:25:16.635945 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' May 28 21:25:16.635945 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:16.635945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ede8e593-86e2-49f4-affc-2721b0b0b669 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:16.635945 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ede8e593-86e2-49f4-affc-2721b0b0b669 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.015690 May 28 21:25:16.636995 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2415/4771] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:25:16 2022] POST /compute/v2.1/servers => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:25:16.641725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aa3aa74a-55ac-49fa-b763-36b9f36c2dd0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:16.642380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aa3aa74a-55ac-49fa-b763-36b9f36c2dd0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:16.648483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa3aa74a-55ac-49fa-b763-36b9f36c2dd0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:16.648941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa3aa74a-55ac-49fa-b763-36b9f36c2dd0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:16.650307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa3aa74a-55ac-49fa-b763-36b9f36c2dd0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:16.650747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa3aa74a-55ac-49fa-b763-36b9f36c2dd0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:16.935825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aa3aa74a-55ac-49fa-b763-36b9f36c2dd0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:16.940880 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aa3aa74a-55ac-49fa-b763-36b9f36c2dd0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.302905 May 28 21:25:16.943826 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2357/4772] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:16 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:16.964406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4ae9d995-1dd8-4831-8de9-6a91f7840957 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:16.965027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4ae9d995-1dd8-4831-8de9-6a91f7840957 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:16.984466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ae9d995-1dd8-4831-8de9-6a91f7840957 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:16.988909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ae9d995-1dd8-4831-8de9-6a91f7840957 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:16.990819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ae9d995-1dd8-4831-8de9-6a91f7840957 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:16.993445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ae9d995-1dd8-4831-8de9-6a91f7840957 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:17.348112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4ae9d995-1dd8-4831-8de9-6a91f7840957 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:17.356348 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4ae9d995-1dd8-4831-8de9-6a91f7840957 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.396316 May 28 21:25:17.360192 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2416/4773] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:16 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:17.378329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-08aefe65-f289-43c3-aceb-ffb36083a199 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:17.378966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-08aefe65-f289-43c3-aceb-ffb36083a199 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:17.391446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08aefe65-f289-43c3-aceb-ffb36083a199 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:17.392898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08aefe65-f289-43c3-aceb-ffb36083a199 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:17.394321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08aefe65-f289-43c3-aceb-ffb36083a199 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:17.394786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08aefe65-f289-43c3-aceb-ffb36083a199 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:17.865040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-08aefe65-f289-43c3-aceb-ffb36083a199 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:17.874248 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-08aefe65-f289-43c3-aceb-ffb36083a199 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.499954 May 28 21:25:17.874849 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2358/4774] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:17 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:18.902190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-04925aec-5a92-4413-8860-980b790f0328 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:18.903380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-04925aec-5a92-4413-8860-980b790f0328 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:18.922630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04925aec-5a92-4413-8860-980b790f0328 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:18.924171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04925aec-5a92-4413-8860-980b790f0328 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:18.924972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04925aec-5a92-4413-8860-980b790f0328 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:18.925398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04925aec-5a92-4413-8860-980b790f0328 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:19.389798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-04925aec-5a92-4413-8860-980b790f0328 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:19.394302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:19.413195 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-04925aec-5a92-4413-8860-980b790f0328 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.515094 May 28 21:25:19.418274 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2417/4775] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:18 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:19.479721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a01879c5-4b89-47fa-a577-0f5bdf6c058a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '.version_select at 0x7f4d66f95ee0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:19.596506 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a01879c5-4b89-47fa-a577-0f5bdf6c058a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2029188104" status: 202 len: 0 microversion: 2.1 time: 0.126377 May 28 21:25:19.597384 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2359/4776] 10.222.0.33 () {58 vars in 1283 bytes} [Sat May 28 21:25:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2029188104 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:25:19.631608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b54a9846-c6bc-407b-b9c0-6ac12620be25 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'create', calling method: .version_select at 0x7f4d571698b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-464335192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZ9giUJNZL4YSmTVOOSQBYBCxQ/PT1xuO6Ic33sgu67sTIu73oNc/FnNzYkRru/5IaqUchxEc8/DASpnZg6OOO7L0b4naYGFCUN5L79tHblzaCuSDOZNkDXGkPWpSUk/w=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:19.653813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-b54a9846-c6bc-407b-b9c0-6ac12620be25 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for project c3588eab36044e439158f876836ea514. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:25:19.659643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-b54a9846-c6bc-407b-b9c0-6ac12620be25 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for user f3468a0b2d324603ab6c3080993bc0c8 and project c3588eab36044e439158f876836ea514. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:25:19.755660 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b54a9846-c6bc-407b-b9c0-6ac12620be25 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.130761 May 28 21:25:19.756924 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2418/4777] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:25:19 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:25:20.433265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-140ff671-09bc-455c-974c-51985bac4988 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:20.436978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-140ff671-09bc-455c-974c-51985bac4988 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:20.449403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-140ff671-09bc-455c-974c-51985bac4988 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:20.452669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-140ff671-09bc-455c-974c-51985bac4988 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:20.455288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-140ff671-09bc-455c-974c-51985bac4988 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:20.455756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-140ff671-09bc-455c-974c-51985bac4988 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:20.812101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-140ff671-09bc-455c-974c-51985bac4988 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:20.822002 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-140ff671-09bc-455c-974c-51985bac4988 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.394486 May 28 21:25:20.826829 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2360/4778] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:20 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:20.942585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40cd55dc-3def-472f-9563-f1c459df331f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-551047414", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "4ce735b7-0e4f-41cb-917f-48baf2562f1c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:21.088146 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-40cd55dc-3def-472f-9563-f1c459df331f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Block Device 4ce735b7-0e4f-41cb-917f-48baf2562f1c is not bootable. May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40cd55dc-3def-472f-9563-f1c459df331f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 357 May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-551047414", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "4ce735b7-0e4f-41cb-917f-48baf2562f1c", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: exception: Block Device 4ce735b7-0e4f-41cb-917f-48baf2562f1c is not bootable. May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-551047414', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '4ce735b7-0e4f-41cb-917f-48baf2562f1c'}], 'networks': [{'uuid': '3a3043e0-048b-4e2b-ab77-16b78a2870c5'}]}}} May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 4ce735b7-0e4f-41cb-917f-48baf2562f1c is not bootable. May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:21.099178 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 4ce735b7-0e4f-41cb-917f-48baf2562f1c is not bootable. May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 4ce735b7-0e4f-41cb-917f-48baf2562f1c is not bootable. May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40cd55dc-3def-472f-9563-f1c459df331f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 400 to user: Block Device 4ce735b7-0e4f-41cb-917f-48baf2562f1c is not bootable. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-40cd55dc-3def-472f-9563-f1c459df331f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.162641 May 28 21:25:21.103432 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2419/4779] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:25:20 2022] POST /compute/v2.1/servers => generated 110 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:25:21.112683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f1c18bcd-0973-4a65-ab13-b6490d806207 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:21.113411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f1c18bcd-0973-4a65-ab13-b6490d806207 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:21.122505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1c18bcd-0973-4a65-ab13-b6490d806207 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:21.123556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1c18bcd-0973-4a65-ab13-b6490d806207 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:21.123925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1c18bcd-0973-4a65-ab13-b6490d806207 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:21.124374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1c18bcd-0973-4a65-ab13-b6490d806207 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:21.341646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f1c18bcd-0973-4a65-ab13-b6490d806207 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:21.350623 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f1c18bcd-0973-4a65-ab13-b6490d806207 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.242793 May 28 21:25:21.352044 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2361/4780] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:21 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:21.368964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc40da25-58ec-46f0-bc08-99dbc1405dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:21.369588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc40da25-58ec-46f0-bc08-99dbc1405dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:21.375874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc40da25-58ec-46f0-bc08-99dbc1405dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:21.376329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc40da25-58ec-46f0-bc08-99dbc1405dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:21.377102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc40da25-58ec-46f0-bc08-99dbc1405dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:21.377545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc40da25-58ec-46f0-bc08-99dbc1405dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:21.601402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc40da25-58ec-46f0-bc08-99dbc1405dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:21.610232 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc40da25-58ec-46f0-bc08-99dbc1405dde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.245610 May 28 21:25:21.610804 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2420/4781] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:21 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:21.842883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-615d12b2-6b7c-43ec-826b-0038e5b84e37 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:21.844020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-615d12b2-6b7c-43ec-826b-0038e5b84e37 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:21.853091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-615d12b2-6b7c-43ec-826b-0038e5b84e37 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:21.857929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-615d12b2-6b7c-43ec-826b-0038e5b84e37 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:21.859012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-615d12b2-6b7c-43ec-826b-0038e5b84e37 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:21.859787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-615d12b2-6b7c-43ec-826b-0038e5b84e37 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:22.044645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-615d12b2-6b7c-43ec-826b-0038e5b84e37 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:22.052378 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-615d12b2-6b7c-43ec-826b-0038e5b84e37 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.213351 May 28 21:25:22.053452 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2362/4782] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:21 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:23.070598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9c64f847-9561-47cb-84b4-8e40240d31a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:23.072020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9c64f847-9561-47cb-84b4-8e40240d31a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:23.081067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c64f847-9561-47cb-84b4-8e40240d31a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:23.088771 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c64f847-9561-47cb-84b4-8e40240d31a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:23.096831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c64f847-9561-47cb-84b4-8e40240d31a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:23.096831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c64f847-9561-47cb-84b4-8e40240d31a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:23.288624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9c64f847-9561-47cb-84b4-8e40240d31a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:23.297215 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9c64f847-9561-47cb-84b4-8e40240d31a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.230994 May 28 21:25:23.298584 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2421/4783] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:23 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:24.316474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6ab3cdef-d0d4-4a7c-81de-1ae60662eb42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:24.334856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6ab3cdef-d0d4-4a7c-81de-1ae60662eb42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:24.342954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ab3cdef-d0d4-4a7c-81de-1ae60662eb42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:24.343898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ab3cdef-d0d4-4a7c-81de-1ae60662eb42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:24.344862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ab3cdef-d0d4-4a7c-81de-1ae60662eb42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:24.345498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ab3cdef-d0d4-4a7c-81de-1ae60662eb42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:24.608476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d66d30e2-bca2-47a5-b60b-9812ac82137d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-565120831", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "9586d0d3-c540-4636-bb36-06bb4b16c195", "destination_type": "local"}, {"source_type": "volume", "uuid": "cf449889-2f06-41b0-9ec1-bd5ef48126ce", "destination_type": "invalid"}], "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d66d30e2-bca2-47a5-b60b-9812ac82137d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 494 May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-565120831", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "9586d0d3-c540-4636-bb36-06bb4b16c195", "destination_type": "local"}, {"source_type": "volume", "uuid": "cf449889-2f06-41b0-9ec1-bd5ef48126ce", "destination_type": "invalid"}], "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-565120831', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'cf449889-2f06-41b0-9ec1-bd5ef48126ce', 'destination_type': 'invalid'}], 'networks': [{'uuid': '3a3043e0-048b-4e2b-ab77-16b78a2870c5'}]}}} May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'invalid' May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:24.611231 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:24.614927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d66d30e2-bca2-47a5-b60b-9812ac82137d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:24.616962 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d66d30e2-bca2-47a5-b60b-9812ac82137d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.009641 May 28 21:25:24.619453 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2422/4784] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:25:24 2022] POST /compute/v2.1/servers => generated 155 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:25:24.628596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aaaf89b4-e083-4be4-aacb-101e06fdcd9a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:24.638349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aaaf89b4-e083-4be4-aacb-101e06fdcd9a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:24.651994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aaaf89b4-e083-4be4-aacb-101e06fdcd9a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:24.652457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aaaf89b4-e083-4be4-aacb-101e06fdcd9a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:24.653239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aaaf89b4-e083-4be4-aacb-101e06fdcd9a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:24.653685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aaaf89b4-e083-4be4-aacb-101e06fdcd9a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:24.694656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6ab3cdef-d0d4-4a7c-81de-1ae60662eb42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:24.706115 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6ab3cdef-d0d4-4a7c-81de-1ae60662eb42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.393487 May 28 21:25:24.721186 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2363/4785] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:24 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:25.032400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aaaf89b4-e083-4be4-aacb-101e06fdcd9a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:25.041635 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aaaf89b4-e083-4be4-aacb-101e06fdcd9a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.418044 May 28 21:25:25.042250 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2423/4786] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:24 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:25.063980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-72c6a6b7-02db-4ba6-8e20-5d914ae8bce5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:25.065373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-72c6a6b7-02db-4ba6-8e20-5d914ae8bce5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:25.076995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72c6a6b7-02db-4ba6-8e20-5d914ae8bce5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:25.077694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72c6a6b7-02db-4ba6-8e20-5d914ae8bce5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:25.079005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72c6a6b7-02db-4ba6-8e20-5d914ae8bce5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:25.079605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72c6a6b7-02db-4ba6-8e20-5d914ae8bce5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:25.474001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-72c6a6b7-02db-4ba6-8e20-5d914ae8bce5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:25.481992 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-72c6a6b7-02db-4ba6-8e20-5d914ae8bce5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.423490 May 28 21:25:25.482587 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2364/4787] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:25 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-636bca6d-bde8-4cf9-82f0-7ef716fb05d1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-347512798", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-636bca6d-bde8-4cf9-82f0-7ef716fb05d1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 491 May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-347512798", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-347512798', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '3a3043e0-048b-4e2b-ab77-16b78a2870c5'}]}}} May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:25:25.595082 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:25.598220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-636bca6d-bde8-4cf9-82f0-7ef716fb05d1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:25.600472 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-636bca6d-bde8-4cf9-82f0-7ef716fb05d1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.008946 May 28 21:25:25.600472 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2424/4788] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:25:25 2022] POST /compute/v2.1/servers => generated 624 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:25:25.605698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0858017c-3df7-45d8-b960-d379562eb2e3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:25.606431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0858017c-3df7-45d8-b960-d379562eb2e3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:25.613708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0858017c-3df7-45d8-b960-d379562eb2e3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:25.618305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0858017c-3df7-45d8-b960-d379562eb2e3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:25.618305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0858017c-3df7-45d8-b960-d379562eb2e3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:25.618305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0858017c-3df7-45d8-b960-d379562eb2e3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:25.723915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ca2ba9ae-1727-4679-98b0-ba8d308bcef8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:25.724682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ca2ba9ae-1727-4679-98b0-ba8d308bcef8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:25.738321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca2ba9ae-1727-4679-98b0-ba8d308bcef8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:25.738321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca2ba9ae-1727-4679-98b0-ba8d308bcef8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:25.739182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca2ba9ae-1727-4679-98b0-ba8d308bcef8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:25.739629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca2ba9ae-1727-4679-98b0-ba8d308bcef8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:25.918317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0858017c-3df7-45d8-b960-d379562eb2e3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:25.928248 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0858017c-3df7-45d8-b960-d379562eb2e3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.326200 May 28 21:25:25.930015 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2365/4789] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:25 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:25.949478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6763de52-d3d6-4bce-8cbe-0e05866c0c18 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:25.950142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6763de52-d3d6-4bce-8cbe-0e05866c0c18 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:25.967232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6763de52-d3d6-4bce-8cbe-0e05866c0c18 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:25.967232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6763de52-d3d6-4bce-8cbe-0e05866c0c18 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:25.967232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6763de52-d3d6-4bce-8cbe-0e05866c0c18 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:25.967232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6763de52-d3d6-4bce-8cbe-0e05866c0c18 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:26.003662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ca2ba9ae-1727-4679-98b0-ba8d308bcef8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:26.025036 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ca2ba9ae-1727-4679-98b0-ba8d308bcef8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.305770 May 28 21:25:26.032667 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2425/4790] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:25 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:26.236358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6763de52-d3d6-4bce-8cbe-0e05866c0c18 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:26.245394 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6763de52-d3d6-4bce-8cbe-0e05866c0c18 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.301488 May 28 21:25:26.246030 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2366/4791] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:25 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:26.416624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c29ace46-470b-457b-80c1-9cb5ff3c20d1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c29ace46-470b-457b-80c1-9cb5ff3c20d1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 416 May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'networks': [{'uuid': '3a3043e0-048b-4e2b-ab77-16b78a2870c5'}]}}} May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:26.419076 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c29ace46-470b-457b-80c1-9cb5ff3c20d1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c29ace46-470b-457b-80c1-9cb5ff3c20d1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.008440 May 28 21:25:26.423396 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2426/4792] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:25:26 2022] POST /compute/v2.1/servers => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:25:26.429026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-efbaf1d9-f33c-4918-ad2a-bf9141950bfa tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:26.429648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-efbaf1d9-f33c-4918-ad2a-bf9141950bfa tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:26.437308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efbaf1d9-f33c-4918-ad2a-bf9141950bfa tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:26.437896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efbaf1d9-f33c-4918-ad2a-bf9141950bfa tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:26.438805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efbaf1d9-f33c-4918-ad2a-bf9141950bfa tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:26.439323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efbaf1d9-f33c-4918-ad2a-bf9141950bfa tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:27.061214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-60172642-bb14-49a7-8f13-84d71155784c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:27.062035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-60172642-bb14-49a7-8f13-84d71155784c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:27.078509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-60172642-bb14-49a7-8f13-84d71155784c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:27.079221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-60172642-bb14-49a7-8f13-84d71155784c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:27.080179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-60172642-bb14-49a7-8f13-84d71155784c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:27.083050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-60172642-bb14-49a7-8f13-84d71155784c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:27.257289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-efbaf1d9-f33c-4918-ad2a-bf9141950bfa tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:27.266784 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-efbaf1d9-f33c-4918-ad2a-bf9141950bfa tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.841503 May 28 21:25:27.279368 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2367/4793] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:26 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:27.284881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-22382fea-2c54-4ee1-9191-1051112e6816 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:27.285716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-22382fea-2c54-4ee1-9191-1051112e6816 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:27.292670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22382fea-2c54-4ee1-9191-1051112e6816 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:27.293911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22382fea-2c54-4ee1-9191-1051112e6816 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:27.294525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22382fea-2c54-4ee1-9191-1051112e6816 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:27.295132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22382fea-2c54-4ee1-9191-1051112e6816 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:27.486887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-60172642-bb14-49a7-8f13-84d71155784c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:27.501315 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-60172642-bb14-49a7-8f13-84d71155784c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.451204 May 28 21:25:27.503240 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2427/4794] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:27 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:27.542000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-22382fea-2c54-4ee1-9191-1051112e6816 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:27.550383 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-22382fea-2c54-4ee1-9191-1051112e6816 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.269747 May 28 21:25:27.555274 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2368/4795] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:27 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:27.896266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a442afc-ad61-4e58-8aa4-ce393fb565ed tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1087676386", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": -1, "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:27.927432 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-6a442afc-ad61-4e58-8aa4-ce393fb565ed tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Flavor -1 could not be found. May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a442afc-ad61-4e58-8aa4-ce393fb565ed tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 206 May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1087676386", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": -1, "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: exception: Flavor -1 could not be found. May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1087676386', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': -1, 'networks': [{'uuid': '3a3043e0-048b-4e2b-ab77-16b78a2870c5'}]}}} May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:27.950802 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a442afc-ad61-4e58-8aa4-ce393fb565ed tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6a442afc-ad61-4e58-8aa4-ce393fb565ed tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.054224 May 28 21:25:27.956614 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2428/4796] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:25:27 2022] POST /compute/v2.1/servers => generated 73 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) May 28 21:25:27.964325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c4413acf-1575-4973-b69a-e6cd03157a0a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:27.965104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c4413acf-1575-4973-b69a-e6cd03157a0a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:27.979931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4413acf-1575-4973-b69a-e6cd03157a0a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:27.979931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4413acf-1575-4973-b69a-e6cd03157a0a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:27.979931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4413acf-1575-4973-b69a-e6cd03157a0a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:27.979931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4413acf-1575-4973-b69a-e6cd03157a0a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:28.284309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c4413acf-1575-4973-b69a-e6cd03157a0a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:28.296260 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c4413acf-1575-4973-b69a-e6cd03157a0a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.336082 May 28 21:25:28.298497 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2369/4797] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:27 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:28.317411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3e933184-5d1d-41b6-9e60-aea555e6fb6e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:28.318763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3e933184-5d1d-41b6-9e60-aea555e6fb6e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:28.330135 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e933184-5d1d-41b6-9e60-aea555e6fb6e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:28.330882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e933184-5d1d-41b6-9e60-aea555e6fb6e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:28.331880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e933184-5d1d-41b6-9e60-aea555e6fb6e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:28.332869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e933184-5d1d-41b6-9e60-aea555e6fb6e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:28.521871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e3541dde-609e-4bf4-b492-e3f2a2d9b9b9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:28.523531 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e3541dde-609e-4bf4-b492-e3f2a2d9b9b9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:28.532272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3e933184-5d1d-41b6-9e60-aea555e6fb6e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:28.541141 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3e933184-5d1d-41b6-9e60-aea555e6fb6e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.230260 May 28 21:25:28.546246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3541dde-609e-4bf4-b492-e3f2a2d9b9b9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:28.546769 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2429/4798] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:28 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:28.547464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3541dde-609e-4bf4-b492-e3f2a2d9b9b9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:28.548517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3541dde-609e-4bf4-b492-e3f2a2d9b9b9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:28.549181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e3541dde-609e-4bf4-b492-e3f2a2d9b9b9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:28.581615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:28.736468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e19992ad-8e63-4fe1-b93c-99f791298272 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1313307813", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e19992ad-8e63-4fe1-b93c-99f791298272 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 173 May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1313307813", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1313307813', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '3a3043e0-048b-4e2b-ab77-16b78a2870c5'}]}}} May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi -1 May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:25:28.741787 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:25:28.746304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:25:28.746304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:25:28.746304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 28 21:25:28.746304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:28.746304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:28.746304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:28.746304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:28.746304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:28.746304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:28.746304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:25:28.746304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:25:28.746304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas May 28 21:25:28.746304 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:28.748668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e19992ad-8e63-4fe1-b93c-99f791298272 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:28.750922 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e19992ad-8e63-4fe1-b93c-99f791298272 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.019115 May 28 21:25:28.760753 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2430/4799] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:25:28 2022] POST /compute/v2.1/servers => generated 145 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 21:25:28.771789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2a293d1e-a581-4496-bacd-6939fca99065 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:28.772662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2a293d1e-a581-4496-bacd-6939fca99065 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:28.789443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a293d1e-a581-4496-bacd-6939fca99065 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:28.789443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a293d1e-a581-4496-bacd-6939fca99065 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:28.790564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a293d1e-a581-4496-bacd-6939fca99065 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:28.791181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a293d1e-a581-4496-bacd-6939fca99065 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:28.813489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e3541dde-609e-4bf4-b492-e3f2a2d9b9b9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:28.828184 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e3541dde-609e-4bf4-b492-e3f2a2d9b9b9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.311800 May 28 21:25:28.829583 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2370/4800] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:28 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:28.963324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2a293d1e-a581-4496-bacd-6939fca99065 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:28.973354 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2a293d1e-a581-4496-bacd-6939fca99065 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.208104 May 28 21:25:28.975083 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2431/4801] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:28 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:28.992245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6bd4e522-5cd7-4e5c-980a-20d5e93cd0b7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:28.997082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6bd4e522-5cd7-4e5c-980a-20d5e93cd0b7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:29.000922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6bd4e522-5cd7-4e5c-980a-20d5e93cd0b7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:29.001575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6bd4e522-5cd7-4e5c-980a-20d5e93cd0b7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:29.002628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6bd4e522-5cd7-4e5c-980a-20d5e93cd0b7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:29.003284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6bd4e522-5cd7-4e5c-980a-20d5e93cd0b7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:29.198097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6bd4e522-5cd7-4e5c-980a-20d5e93cd0b7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:29.206929 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6bd4e522-5cd7-4e5c-980a-20d5e93cd0b7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.218714 May 28 21:25:29.207573 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2371/4802] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:28 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:29.372479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-af241161-b846-4659-bb9d-e5a3c2d7bdb3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-372240279", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:29.377046 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-af241161-b846-4659-bb9d-e5a3c2d7bdb3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-af241161-b846-4659-bb9d-e5a3c2d7bdb3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 215 May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-372240279", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-372240279', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._validate_network_id( May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:29.381749 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:29.396597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:29.396597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:29.396597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:29.396597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:29.396597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:29.396597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) May 28 21:25:29.396597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:29.396597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-af241161-b846-4659-bb9d-e5a3c2d7bdb3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:29.396597 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-af241161-b846-4659-bb9d-e5a3c2d7bdb3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.018954 May 28 21:25:29.396597 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2432/4803] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:25:29 2022] POST /compute/v2.1/servers => generated 123 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:25:29.397351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9733b856-e559-4a19-8858-3563437c47f5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:29.397351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9733b856-e559-4a19-8858-3563437c47f5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:29.405620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9733b856-e559-4a19-8858-3563437c47f5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:29.406119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9733b856-e559-4a19-8858-3563437c47f5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:29.406926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9733b856-e559-4a19-8858-3563437c47f5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:29.407382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9733b856-e559-4a19-8858-3563437c47f5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:29.582301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9733b856-e559-4a19-8858-3563437c47f5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:29.601050 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9733b856-e559-4a19-8858-3563437c47f5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.211304 May 28 21:25:29.608599 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2372/4804] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:29 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:29.640749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ecb0d779-ae7a-48bb-993b-5a126fbdaa8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:29.640749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ecb0d779-ae7a-48bb-993b-5a126fbdaa8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:29.654480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecb0d779-ae7a-48bb-993b-5a126fbdaa8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:29.654935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecb0d779-ae7a-48bb-993b-5a126fbdaa8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:29.655722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecb0d779-ae7a-48bb-993b-5a126fbdaa8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:29.657034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecb0d779-ae7a-48bb-993b-5a126fbdaa8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:29.697149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:29.849084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-92918e6e-9806-4540-95a0-77a94d27061e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:29.850461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-92918e6e-9806-4540-95a0-77a94d27061e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:29.865101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92918e6e-9806-4540-95a0-77a94d27061e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:29.865573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92918e6e-9806-4540-95a0-77a94d27061e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:29.869120 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92918e6e-9806-4540-95a0-77a94d27061e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:29.869856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92918e6e-9806-4540-95a0-77a94d27061e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:30.031810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ecb0d779-ae7a-48bb-993b-5a126fbdaa8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:30.040370 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ecb0d779-ae7a-48bb-993b-5a126fbdaa8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.418135 May 28 21:25:30.040971 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2433/4805] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:29 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:30.192879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2f8457a9-a4ad-4d62-9230-5296f00c7447 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1875467747", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "key_name": "tempest-key-2113834164", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:30.255003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-2f8457a9-a4ad-4d62-9230-5296f00c7447 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] validate_networks() for [('3a3043e0-048b-4e2b-ab77-16b78a2870c5', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:25:30.388877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-92918e6e-9806-4540-95a0-77a94d27061e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:30.398136 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-92918e6e-9806-4540-95a0-77a94d27061e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.555964 May 28 21:25:30.402705 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2373/4806] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:29 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:30.680143 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-2f8457a9-a4ad-4d62-9230-5296f00c7447 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Invalid key_name provided. May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2f8457a9-a4ad-4d62-9230-5296f00c7447 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 247 May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1875467747", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "key_name": "tempest-key-2113834164", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid key_name provided. May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1875467747', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'key_name': 'tempest-key-2113834164', 'networks': [{'uuid': '3a3043e0-048b-4e2b-ab77-16b78a2870c5'}]}}} May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-2113834164 not found for user ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:30.684640 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. May 28 21:25:30.690008 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:30.725021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2f8457a9-a4ad-4d62-9230-5296f00c7447 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 400 to user: Invalid key_name provided. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:30.729553 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2f8457a9-a4ad-4d62-9230-5296f00c7447 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.539538 May 28 21:25:30.733419 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2434/4807] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:25:30 2022] POST /compute/v2.1/servers => generated 70 bytes in 542 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) May 28 21:25:30.739201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-88f63561-0014-45f2-9b92-f96541c2cf88 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:30.739844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-88f63561-0014-45f2-9b92-f96541c2cf88 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:30.761438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88f63561-0014-45f2-9b92-f96541c2cf88 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:30.762051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88f63561-0014-45f2-9b92-f96541c2cf88 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:30.762893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88f63561-0014-45f2-9b92-f96541c2cf88 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:30.767250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88f63561-0014-45f2-9b92-f96541c2cf88 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:31.222858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-88f63561-0014-45f2-9b92-f96541c2cf88 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:31.233387 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-88f63561-0014-45f2-9b92-f96541c2cf88 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.498492 May 28 21:25:31.247750 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2374/4808] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:30 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:31.259962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-de974477-63c3-4898-a1f9-b2584579227c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:31.260947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-de974477-63c3-4898-a1f9-b2584579227c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:31.272436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de974477-63c3-4898-a1f9-b2584579227c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:31.272436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de974477-63c3-4898-a1f9-b2584579227c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:31.275007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de974477-63c3-4898-a1f9-b2584579227c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:31.275615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de974477-63c3-4898-a1f9-b2584579227c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:31.425192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d999806d-6e5a-4f6c-9e5a-6965b8f8fdd2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:31.432253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d999806d-6e5a-4f6c-9e5a-6965b8f8fdd2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:31.444536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d999806d-6e5a-4f6c-9e5a-6965b8f8fdd2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:31.454607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d999806d-6e5a-4f6c-9e5a-6965b8f8fdd2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:31.459023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d999806d-6e5a-4f6c-9e5a-6965b8f8fdd2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:31.459023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d999806d-6e5a-4f6c-9e5a-6965b8f8fdd2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:31.854651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-de974477-63c3-4898-a1f9-b2584579227c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:31.867071 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-de974477-63c3-4898-a1f9-b2584579227c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.610938 May 28 21:25:31.868000 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2435/4809] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:31 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:31.931399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d999806d-6e5a-4f6c-9e5a-6965b8f8fdd2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:31.940034 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d999806d-6e5a-4f6c-9e5a-6965b8f8fdd2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.519897 May 28 21:25:31.941052 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2375/4810] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:31 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:32.113347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d4ea012a-f269-4f67-a8ee-ca7376c11025 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-927803886", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:32.419180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.security_group_api [None req-d4ea012a-f269-4f67-a8ee-ca7376c11025 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Neutron security group does_not_exist not found {{(pid=143129) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} May 28 21:25:32.422151 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-d4ea012a-f269-4f67-a8ee-ca7376c11025 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d4ea012a-f269-4f67-a8ee-ca7376c11025 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 257 May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-927803886", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: exception: Unable to find security_group with name or id 'does_not_exist' May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-927803886', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '3a3043e0-048b-4e2b-ab77-16b78a2870c5'}]}}} May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name May 28 21:25:32.461496 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._create_instance( May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:32.468628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d4ea012a-f269-4f67-a8ee-ca7376c11025 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:32.482128 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d4ea012a-f269-4f67-a8ee-ca7376c11025 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.352129 May 28 21:25:32.482128 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2436/4811] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:25:32 2022] POST /compute/v2.1/servers => generated 106 bytes in 357 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:25:32.482323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9f11b815-69eb-439a-85be-5a2a9dece687 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:32.482323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9f11b815-69eb-439a-85be-5a2a9dece687 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:32.490736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f11b815-69eb-439a-85be-5a2a9dece687 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:32.503785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f11b815-69eb-439a-85be-5a2a9dece687 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:32.509742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f11b815-69eb-439a-85be-5a2a9dece687 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:32.512065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f11b815-69eb-439a-85be-5a2a9dece687 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:32.950305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9f11b815-69eb-439a-85be-5a2a9dece687 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:32.958225 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9f11b815-69eb-439a-85be-5a2a9dece687 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.491093 May 28 21:25:32.964014 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2376/4812] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:32 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:32.964161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-57111e36-055c-4293-948f-a9a7b9d26acf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:32.964161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-57111e36-055c-4293-948f-a9a7b9d26acf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:32.970243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57111e36-055c-4293-948f-a9a7b9d26acf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:32.971313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57111e36-055c-4293-948f-a9a7b9d26acf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:32.972849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57111e36-055c-4293-948f-a9a7b9d26acf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:32.973473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57111e36-055c-4293-948f-a9a7b9d26acf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:32.977609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dd898316-82e9-4ac0-88cc-04f8f64e9951 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:32.979156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dd898316-82e9-4ac0-88cc-04f8f64e9951 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:32.990364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:32.993934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd898316-82e9-4ac0-88cc-04f8f64e9951 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:32.994404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd898316-82e9-4ac0-88cc-04f8f64e9951 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:32.995319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd898316-82e9-4ac0-88cc-04f8f64e9951 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:32.995767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd898316-82e9-4ac0-88cc-04f8f64e9951 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:33.422561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-57111e36-055c-4293-948f-a9a7b9d26acf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:33.433549 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-57111e36-055c-4293-948f-a9a7b9d26acf tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.476537 May 28 21:25:33.442287 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2437/4813] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:32 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:33.531664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dd898316-82e9-4ac0-88cc-04f8f64e9951 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:33.540485 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dd898316-82e9-4ac0-88cc-04f8f64e9951 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.568158 May 28 21:25:33.541085 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2377/4814] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:32 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:33.556922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c37a0c45-9f40-484a-99ad-f75dd064a199 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:33.557434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c37a0c45-9f40-484a-99ad-f75dd064a199 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: cf342fdf-51ba-49da-aad9-8a13a463e246] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:33.564109 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-c37a0c45-9f40-484a-99ad-f75dd064a199 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance cf342fdf-51ba-49da-aad9-8a13a463e246 could not be found. May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c37a0c45-9f40-484a-99ad-f75dd064a199 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/cf342fdf-51ba-49da-aad9-8a13a463e246 HTTP/1.1 May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance cf342fdf-51ba-49da-aad9-8a13a463e246 could not be found. May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'cf342fdf-51ba-49da-aad9-8a13a463e246'} May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf342fdf-51ba-49da-aad9-8a13a463e246 could not be found. May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf342fdf-51ba-49da-aad9-8a13a463e246 could not be found. May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:33.566265 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:33.575874 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:33.575874 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:33.575874 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:33.575874 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:33.575874 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:33.575874 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf342fdf-51ba-49da-aad9-8a13a463e246 could not be found. May 28 21:25:33.575874 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:33.575874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c37a0c45-9f40-484a-99ad-f75dd064a199 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance cf342fdf-51ba-49da-aad9-8a13a463e246 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:33.575874 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c37a0c45-9f40-484a-99ad-f75dd064a199 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cf342fdf-51ba-49da-aad9-8a13a463e246" status: 404 len: 111 microversion: 2.1 time: 0.014785 May 28 21:25:33.575874 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2438/4815] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:25:33 2022] DELETE /compute/v2.1/servers/cf342fdf-51ba-49da-aad9-8a13a463e246 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:25:33.582661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fca4bc5c-f112-47c0-8f6e-239b2aee36b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:33.583682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fca4bc5c-f112-47c0-8f6e-239b2aee36b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:33.591920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fca4bc5c-f112-47c0-8f6e-239b2aee36b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:33.592373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fca4bc5c-f112-47c0-8f6e-239b2aee36b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:33.593479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fca4bc5c-f112-47c0-8f6e-239b2aee36b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:33.594281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fca4bc5c-f112-47c0-8f6e-239b2aee36b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:33.839819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fca4bc5c-f112-47c0-8f6e-239b2aee36b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:33.851544 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fca4bc5c-f112-47c0-8f6e-239b2aee36b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.272855 May 28 21:25:33.852187 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2378/4816] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:33 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:33.870644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e380ece5-2455-44be-87ac-9d24d33708fd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:33.871281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e380ece5-2455-44be-87ac-9d24d33708fd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:33.887544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e380ece5-2455-44be-87ac-9d24d33708fd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:33.887917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e380ece5-2455-44be-87ac-9d24d33708fd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:33.888710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e380ece5-2455-44be-87ac-9d24d33708fd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:33.889154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e380ece5-2455-44be-87ac-9d24d33708fd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:34.450803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5804fbe1-7baf-4fed-8666-c1f55fbe9b61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:34.451438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5804fbe1-7baf-4fed-8666-c1f55fbe9b61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:34.467811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5804fbe1-7baf-4fed-8666-c1f55fbe9b61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:34.468259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5804fbe1-7baf-4fed-8666-c1f55fbe9b61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:34.469144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5804fbe1-7baf-4fed-8666-c1f55fbe9b61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:34.469477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5804fbe1-7baf-4fed-8666-c1f55fbe9b61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:34.915562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e380ece5-2455-44be-87ac-9d24d33708fd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:34.934765 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e380ece5-2455-44be-87ac-9d24d33708fd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 1.064361 May 28 21:25:34.934765 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2439/4817] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:33 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:34.948551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-de47eb39-5030-4bd2-a15a-9dce918eff37 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:34.949311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-de47eb39-5030-4bd2-a15a-9dce918eff37 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Failed to fetch instance by id 9223372036854775808 {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2926}} May 28 21:25:34.949548 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-de47eb39-5030-4bd2-a15a-9dce918eff37 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-de47eb39-5030-4bd2-a15a-9dce918eff37 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 9223372036854775808 could not be found. May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '9223372036854775808'} May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:34.952143 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:34.960421 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:34.960421 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:34.960421 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:34.960421 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. May 28 21:25:34.960421 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:34.960421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-de47eb39-5030-4bd2-a15a-9dce918eff37 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:34.960421 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-de47eb39-5030-4bd2-a15a-9dce918eff37 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.009121 May 28 21:25:34.960421 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2440/4818] 10.222.0.33 () {58 vars in 1187 bytes} [Sat May 28 21:25:34 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 28 21:25:34.962476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-94d65dd9-17c5-4e83-968f-f30de25c6ade tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:34.963102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-94d65dd9-17c5-4e83-968f-f30de25c6ade tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:34.970634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94d65dd9-17c5-4e83-968f-f30de25c6ade tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:34.971102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94d65dd9-17c5-4e83-968f-f30de25c6ade tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:34.971894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94d65dd9-17c5-4e83-968f-f30de25c6ade tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:34.972601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94d65dd9-17c5-4e83-968f-f30de25c6ade tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:35.056395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5804fbe1-7baf-4fed-8666-c1f55fbe9b61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:35.064609 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5804fbe1-7baf-4fed-8666-c1f55fbe9b61 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.617631 May 28 21:25:35.085982 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2379/4819] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:34 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:35.675150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-94d65dd9-17c5-4e83-968f-f30de25c6ade tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:35.689698 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-94d65dd9-17c5-4e83-968f-f30de25c6ade tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.731834 May 28 21:25:35.693751 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2441/4820] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:34 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:35.709821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c744788f-cc90-48b2-9e32-10f37cfef466 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:35.710482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c744788f-cc90-48b2-9e32-10f37cfef466 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:35.732687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c744788f-cc90-48b2-9e32-10f37cfef466 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:35.733151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c744788f-cc90-48b2-9e32-10f37cfef466 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:35.734595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c744788f-cc90-48b2-9e32-10f37cfef466 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:35.735060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c744788f-cc90-48b2-9e32-10f37cfef466 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:35.985411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1708274248", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "dd4175a9-292b-46d3-8584-8570d2379ed3"}], "key_name": "tempest-TestNetworkAdvancedServerOps-464335192", "security_groups": [{"name": "tempest-secgroup-smoke-530734629"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:36.165680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c744788f-cc90-48b2-9e32-10f37cfef466 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:36.178766 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c744788f-cc90-48b2-9e32-10f37cfef466 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.470598 May 28 21:25:36.180491 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2380/4821] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:35 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:36.197724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-337d14be-7fe8-4d31-918b-4a9fbe040811 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:36.198445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-337d14be-7fe8-4d31-918b-4a9fbe040811 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:36.217632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-337d14be-7fe8-4d31-918b-4a9fbe040811 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:36.218127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-337d14be-7fe8-4d31-918b-4a9fbe040811 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:36.218938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-337d14be-7fe8-4d31-918b-4a9fbe040811 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:36.219387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-337d14be-7fe8-4d31-918b-4a9fbe040811 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:36.326263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] validate_networks() for [('dd4175a9-292b-46d3-8584-8570d2379ed3', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:25:37.032686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-337d14be-7fe8-4d31-918b-4a9fbe040811 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:37.046654 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-337d14be-7fe8-4d31-918b-4a9fbe040811 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.864568 May 28 21:25:37.050790 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2381/4822] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:36 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:37.061324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-13b03529-fd8b-4dfb-8ebf-d4e8468b8188 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:37.062064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-13b03529-fd8b-4dfb-8ebf-d4e8468b8188 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Failed to fetch instance by id -1 {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2926}} May 28 21:25:37.062918 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-13b03529-fd8b-4dfb-8ebf-d4e8468b8188 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance -1 could not be found. May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-13b03529-fd8b-4dfb-8ebf-d4e8468b8188 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance -1 could not be found. May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '-1'} May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:37.068346 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:37.073456 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:37.073456 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:37.073456 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. May 28 21:25:37.073456 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:37.075244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-13b03529-fd8b-4dfb-8ebf-d4e8468b8188 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance -1 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:37.076448 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-13b03529-fd8b-4dfb-8ebf-d4e8468b8188 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.024516 May 28 21:25:37.077623 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2382/4823] 10.222.0.33 () {58 vars in 1136 bytes} [Sat May 28 21:25:37 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:25:37.090109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-698601c3-33fa-40e2-bd69-d9a8a5c2c4e8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:37.090742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-698601c3-33fa-40e2-bd69-d9a8a5c2c4e8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:37.105927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-698601c3-33fa-40e2-bd69-d9a8a5c2c4e8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:37.110947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-698601c3-33fa-40e2-bd69-d9a8a5c2c4e8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:37.110947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-698601c3-33fa-40e2-bd69-d9a8a5c2c4e8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:37.110947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-698601c3-33fa-40e2-bd69-d9a8a5c2c4e8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:37.379203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:25:37.379691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:25:37.380141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:25:37.380568 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:25:37.381007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:25:37.390497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:37.391067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:37.391897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:37.392488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:37.410238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for project c3588eab36044e439158f876836ea514. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:25:37.417572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for user f3468a0b2d324603ab6c3080993bc0c8 and project c3588eab36044e439158f876836ea514. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:25:37.422350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-698601c3-33fa-40e2-bd69-d9a8a5c2c4e8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:37.433968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:25:37.435600 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-698601c3-33fa-40e2-bd69-d9a8a5c2c4e8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.349891 May 28 21:25:37.436210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:25:37.436574 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2383/4824] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:37 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:37.453336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6cfb57be-3b91-4aa9-a42c-e0af645985ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:37.454009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6cfb57be-3b91-4aa9-a42c-e0af645985ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:37.460294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cfb57be-3b91-4aa9-a42c-e0af645985ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:37.461159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cfb57be-3b91-4aa9-a42c-e0af645985ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:37.462180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cfb57be-3b91-4aa9-a42c-e0af645985ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:37.462833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cfb57be-3b91-4aa9-a42c-e0af645985ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:37.627914 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7f4a839a-2cf9-4b0e-97e2-fb407951db13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.648568 May 28 21:25:37.637058 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2442/4825] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:25:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:25:37.642973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e4761901-cb13-42e8-a93d-a15cba2a957f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:37.647689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e4761901-cb13-42e8-a93d-a15cba2a957f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:37.776360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6cfb57be-3b91-4aa9-a42c-e0af645985ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:37.779944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e4761901-cb13-42e8-a93d-a15cba2a957f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:37.790749 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6cfb57be-3b91-4aa9-a42c-e0af645985ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.340929 May 28 21:25:37.796791 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2384/4826] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:37 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:37.799960 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e4761901-cb13-42e8-a93d-a15cba2a957f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1266 microversion: 2.1 time: 0.156889 May 28 21:25:37.805869 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2443/4827] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:37 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:37.810080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d1298e0d-d167-4bc2-8414-e28298120978 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:37.810701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d1298e0d-d167-4bc2-8414-e28298120978 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 08d44e20-a338-4fcd-9fd3-0b60012f31cc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:37.820790 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-d1298e0d-d167-4bc2-8414-e28298120978 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance 08d44e20-a338-4fcd-9fd3-0b60012f31cc could not be found. May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d1298e0d-d167-4bc2-8414-e28298120978 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/08d44e20-a338-4fcd-9fd3-0b60012f31cc/action HTTP/1.1 May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 19 May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: {"forceDelete": {}} May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 08d44e20-a338-4fcd-9fd3-0b60012f31cc could not be found. May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '08d44e20-a338-4fcd-9fd3-0b60012f31cc', 'body': {'forceDelete': {}}} May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08d44e20-a338-4fcd-9fd3-0b60012f31cc could not be found. May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08d44e20-a338-4fcd-9fd3-0b60012f31cc could not be found. May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:37.825746 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:37.831126 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:37.831126 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:37.831126 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08d44e20-a338-4fcd-9fd3-0b60012f31cc could not be found. May 28 21:25:37.831126 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:37.831126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d1298e0d-d167-4bc2-8414-e28298120978 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance 08d44e20-a338-4fcd-9fd3-0b60012f31cc could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:37.835239 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d1298e0d-d167-4bc2-8414-e28298120978 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/08d44e20-a338-4fcd-9fd3-0b60012f31cc/action" status: 404 len: 111 microversion: 2.1 time: 0.027962 May 28 21:25:37.835239 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2385/4828] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:37 2022] POST /compute/v2.1/servers/08d44e20-a338-4fcd-9fd3-0b60012f31cc/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:25:37.850292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-488f2484-43ed-4aea-b34e-d8c9403f1301 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:37.851105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-488f2484-43ed-4aea-b34e-d8c9403f1301 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:37.873298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-488f2484-43ed-4aea-b34e-d8c9403f1301 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:37.873776 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-488f2484-43ed-4aea-b34e-d8c9403f1301 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:37.874620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-488f2484-43ed-4aea-b34e-d8c9403f1301 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:37.875059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-488f2484-43ed-4aea-b34e-d8c9403f1301 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:38.065678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dc96b480-ce0f-4e1c-9053-33eec0a5692d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:38.067107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dc96b480-ce0f-4e1c-9053-33eec0a5692d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:38.089248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc96b480-ce0f-4e1c-9053-33eec0a5692d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:38.092511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc96b480-ce0f-4e1c-9053-33eec0a5692d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:38.092511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc96b480-ce0f-4e1c-9053-33eec0a5692d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:38.092511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc96b480-ce0f-4e1c-9053-33eec0a5692d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:38.492254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dc96b480-ce0f-4e1c-9053-33eec0a5692d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:38.505669 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dc96b480-ce0f-4e1c-9053-33eec0a5692d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.442559 May 28 21:25:38.515673 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2386/4829] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:38 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:38.795964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-488f2484-43ed-4aea-b34e-d8c9403f1301 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:38.805800 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-488f2484-43ed-4aea-b34e-d8c9403f1301 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.965809 May 28 21:25:38.806747 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2444/4830] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:37 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:38.822525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-31d7d255-bea4-44db-a70e-fe1ddb6b158e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:38.827545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-31d7d255-bea4-44db-a70e-fe1ddb6b158e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:38.828186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d19e85d3-f812-47de-b8d9-f326ff4c8701 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:38.828186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d19e85d3-f812-47de-b8d9-f326ff4c8701 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:38.845034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d19e85d3-f812-47de-b8d9-f326ff4c8701 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:38.851526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d19e85d3-f812-47de-b8d9-f326ff4c8701 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:38.860145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d19e85d3-f812-47de-b8d9-f326ff4c8701 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:38.862482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d19e85d3-f812-47de-b8d9-f326ff4c8701 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:39.051359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-31d7d255-bea4-44db-a70e-fe1ddb6b158e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:39.067273 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-31d7d255-bea4-44db-a70e-fe1ddb6b158e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1266 microversion: 2.1 time: 0.245117 May 28 21:25:39.069206 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2387/4831] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:38 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:39.132687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d19e85d3-f812-47de-b8d9-f326ff4c8701 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:39.159097 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d19e85d3-f812-47de-b8d9-f326ff4c8701 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.320097 May 28 21:25:39.162038 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2445/4832] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:38 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:39.179311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-305c146e-99cb-441e-9b82-8644a1464a42 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:39.180374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-305c146e-99cb-441e-9b82-8644a1464a42 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: eb6d54c2-101a-49d0-b565-130c9634de1c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:39.188144 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-305c146e-99cb-441e-9b82-8644a1464a42 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance eb6d54c2-101a-49d0-b565-130c9634de1c could not be found. May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-305c146e-99cb-441e-9b82-8644a1464a42 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/eb6d54c2-101a-49d0-b565-130c9634de1c/action HTTP/1.1 May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 39 May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: {"os-getConsoleOutput": {"length": 10}} May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance eb6d54c2-101a-49d0-b565-130c9634de1c could not be found. May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'eb6d54c2-101a-49d0-b565-130c9634de1c', 'body': {'os-getConsoleOutput': {'length': 10}}} May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6d54c2-101a-49d0-b565-130c9634de1c could not be found. May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6d54c2-101a-49d0-b565-130c9634de1c could not be found. May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:39.203887 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:39.210061 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:39.210061 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:39.210061 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:39.210061 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:39.210061 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6d54c2-101a-49d0-b565-130c9634de1c could not be found. May 28 21:25:39.210061 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:39.214208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-305c146e-99cb-441e-9b82-8644a1464a42 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance eb6d54c2-101a-49d0-b565-130c9634de1c could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:39.215468 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-305c146e-99cb-441e-9b82-8644a1464a42 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/eb6d54c2-101a-49d0-b565-130c9634de1c/action" status: 404 len: 111 microversion: 2.1 time: 0.041420 May 28 21:25:39.216237 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2388/4833] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:39 2022] POST /compute/v2.1/servers/eb6d54c2-101a-49d0-b565-130c9634de1c/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:25:39.234387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8e03e313-3c97-4acd-bc9d-77fc9f583dba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:39.234762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8e03e313-3c97-4acd-bc9d-77fc9f583dba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:39.249674 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e03e313-3c97-4acd-bc9d-77fc9f583dba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:39.251258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e03e313-3c97-4acd-bc9d-77fc9f583dba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:39.252517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e03e313-3c97-4acd-bc9d-77fc9f583dba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:39.253211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e03e313-3c97-4acd-bc9d-77fc9f583dba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:39.432297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8e03e313-3c97-4acd-bc9d-77fc9f583dba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:39.442856 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8e03e313-3c97-4acd-bc9d-77fc9f583dba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.219832 May 28 21:25:39.455830 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2446/4834] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:39 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:39.462102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bb00c8c1-c2ba-4c89-8e42-a0fdd668c6ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:39.463043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bb00c8c1-c2ba-4c89-8e42-a0fdd668c6ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:39.470141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb00c8c1-c2ba-4c89-8e42-a0fdd668c6ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:39.470743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb00c8c1-c2ba-4c89-8e42-a0fdd668c6ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:39.471687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb00c8c1-c2ba-4c89-8e42-a0fdd668c6ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:39.472525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb00c8c1-c2ba-4c89-8e42-a0fdd668c6ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:39.526794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-77e0409c-13e3-4780-a356-fa0b7e2d9a3b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:39.527677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-77e0409c-13e3-4780-a356-fa0b7e2d9a3b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:39.543948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77e0409c-13e3-4780-a356-fa0b7e2d9a3b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:39.545518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77e0409c-13e3-4780-a356-fa0b7e2d9a3b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:39.546668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77e0409c-13e3-4780-a356-fa0b7e2d9a3b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:39.547307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77e0409c-13e3-4780-a356-fa0b7e2d9a3b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:39.721658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bb00c8c1-c2ba-4c89-8e42-a0fdd668c6ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:39.730898 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bb00c8c1-c2ba-4c89-8e42-a0fdd668c6ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.273264 May 28 21:25:39.733214 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2389/4835] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:39 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:39.752810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-489aa2e8-e7dc-4223-906c-f5db1c54d278 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:39.753446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-489aa2e8-e7dc-4223-906c-f5db1c54d278 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: de2bfb2a-fbb5-4861-937a-fef1df1cbc2b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:39.765775 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-489aa2e8-e7dc-4223-906c-f5db1c54d278 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance de2bfb2a-fbb5-4861-937a-fef1df1cbc2b could not be found. May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-489aa2e8-e7dc-4223-906c-f5db1c54d278 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/de2bfb2a-fbb5-4861-937a-fef1df1cbc2b HTTP/1.1 May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance de2bfb2a-fbb5-4861-937a-fef1df1cbc2b could not be found. May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'de2bfb2a-fbb5-4861-937a-fef1df1cbc2b'} May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de2bfb2a-fbb5-4861-937a-fef1df1cbc2b could not be found. May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de2bfb2a-fbb5-4861-937a-fef1df1cbc2b could not be found. May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:39.767749 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:39.773138 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:39.773138 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:39.773138 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:39.773138 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de2bfb2a-fbb5-4861-937a-fef1df1cbc2b could not be found. May 28 21:25:39.773138 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:39.779986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-489aa2e8-e7dc-4223-906c-f5db1c54d278 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance de2bfb2a-fbb5-4861-937a-fef1df1cbc2b could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:39.779986 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-489aa2e8-e7dc-4223-906c-f5db1c54d278 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/de2bfb2a-fbb5-4861-937a-fef1df1cbc2b" status: 404 len: 111 microversion: 2.1 time: 0.026887 May 28 21:25:39.780577 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2390/4836] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:39 2022] GET /compute/v2.1/servers/de2bfb2a-fbb5-4861-937a-fef1df1cbc2b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:25:39.787009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-25eded25-1852-4425-b68a-b3112ddb65df tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:39.788206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-25eded25-1852-4425-b68a-b3112ddb65df tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:39.796078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25eded25-1852-4425-b68a-b3112ddb65df tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:39.796879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25eded25-1852-4425-b68a-b3112ddb65df tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:39.798019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25eded25-1852-4425-b68a-b3112ddb65df tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:39.798642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25eded25-1852-4425-b68a-b3112ddb65df tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:39.837772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-77e0409c-13e3-4780-a356-fa0b7e2d9a3b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:39.848349 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-77e0409c-13e3-4780-a356-fa0b7e2d9a3b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1512 microversion: 2.1 time: 0.330533 May 28 21:25:39.849187 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2447/4837] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:39 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1512 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:40.055930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-25eded25-1852-4425-b68a-b3112ddb65df tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:40.068165 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-25eded25-1852-4425-b68a-b3112ddb65df tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.284669 May 28 21:25:40.068165 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2391/4838] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:39 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:40.086301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8d4a55c0-5c88-49c3-af26-24bc5e2f7b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:40.087078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8d4a55c0-5c88-49c3-af26-24bc5e2f7b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:40.094697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89e75358-872a-43a1-92db-99f82ae6740f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:40.094697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-89e75358-872a-43a1-92db-99f82ae6740f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:40.095885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89e75358-872a-43a1-92db-99f82ae6740f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:40.096348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89e75358-872a-43a1-92db-99f82ae6740f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:40.097609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89e75358-872a-43a1-92db-99f82ae6740f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:40.098851 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89e75358-872a-43a1-92db-99f82ae6740f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:40.099049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d4a55c0-5c88-49c3-af26-24bc5e2f7b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:40.103331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:40.105157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d4a55c0-5c88-49c3-af26-24bc5e2f7b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:40.106179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d4a55c0-5c88-49c3-af26-24bc5e2f7b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:40.108432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d4a55c0-5c88-49c3-af26-24bc5e2f7b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:40.115458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:40.229832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8d4a55c0-5c88-49c3-af26-24bc5e2f7b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:40.240806 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8d4a55c0-5c88-49c3-af26-24bc5e2f7b6c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1318 microversion: 2.1 time: 0.158326 May 28 21:25:40.241585 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2392/4839] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:40 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:40.299508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-89e75358-872a-43a1-92db-99f82ae6740f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:40.310770 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-89e75358-872a-43a1-92db-99f82ae6740f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.228249 May 28 21:25:40.324895 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2448/4840] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:40 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:40.542249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5baac9db-f9b1-41b8-abaf-be87f065a14f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1059167544", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5baac9db-f9b1-41b8-abaf-be87f065a14f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 238 May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1059167544", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1059167544', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '3a3043e0-048b-4e2b-ab77-16b78a2870c5'}]}}} May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise error May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:25:40.546551 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:25:40.551814 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:25:40.551814 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:25:40.551814 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 28 21:25:40.551814 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:40.551814 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:40.551814 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:40.551814 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:40.551814 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:40.551814 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:40.551814 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:25:40.551814 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:25:40.551814 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' May 28 21:25:40.551814 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:40.551814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5baac9db-f9b1-41b8-abaf-be87f065a14f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:40.570134 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5baac9db-f9b1-41b8-abaf-be87f065a14f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.016586 May 28 21:25:40.574677 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2393/4841] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:25:40 2022] POST /compute/v2.1/servers => generated 139 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:25:40.582219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-34ff8bea-22e8-4431-87ec-4ad9d72f73a5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:40.583728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-34ff8bea-22e8-4431-87ec-4ad9d72f73a5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:40.612263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34ff8bea-22e8-4431-87ec-4ad9d72f73a5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:40.615693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34ff8bea-22e8-4431-87ec-4ad9d72f73a5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:40.616718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34ff8bea-22e8-4431-87ec-4ad9d72f73a5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:40.616953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34ff8bea-22e8-4431-87ec-4ad9d72f73a5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:40.860306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-34ff8bea-22e8-4431-87ec-4ad9d72f73a5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:40.866597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-26e89fbc-76d7-47df-8ce8-4fbb4f36f84b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:40.869005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-26e89fbc-76d7-47df-8ce8-4fbb4f36f84b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:40.874476 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-34ff8bea-22e8-4431-87ec-4ad9d72f73a5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.297614 May 28 21:25:40.874997 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2449/4842] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:40 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:40.890447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26e89fbc-76d7-47df-8ce8-4fbb4f36f84b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:40.890447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26e89fbc-76d7-47df-8ce8-4fbb4f36f84b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:40.890447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26e89fbc-76d7-47df-8ce8-4fbb4f36f84b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:40.890447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26e89fbc-76d7-47df-8ce8-4fbb4f36f84b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:40.899028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c7f9ab86-2a80-4fe3-8c66-7b67c7d6122e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:40.899685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c7f9ab86-2a80-4fe3-8c66-7b67c7d6122e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:40.906602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7f9ab86-2a80-4fe3-8c66-7b67c7d6122e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:40.907507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7f9ab86-2a80-4fe3-8c66-7b67c7d6122e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:40.908516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7f9ab86-2a80-4fe3-8c66-7b67c7d6122e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:40.909211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c7f9ab86-2a80-4fe3-8c66-7b67c7d6122e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:41.193141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c7f9ab86-2a80-4fe3-8c66-7b67c7d6122e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:41.202604 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c7f9ab86-2a80-4fe3-8c66-7b67c7d6122e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.310225 May 28 21:25:41.203190 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2450/4843] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:40 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:41.214080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-26e89fbc-76d7-47df-8ce8-4fbb4f36f84b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:41.217876 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-26e89fbc-76d7-47df-8ce8-4fbb4f36f84b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1489 microversion: 2.1 time: 0.354174 May 28 21:25:41.217876 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2394/4844] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:40 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1489 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:41.237920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e090034c-1c88-4eb7-b007-ee5ce3aeaf90 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:41.241605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e090034c-1c88-4eb7-b007-ee5ce3aeaf90 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:41.248606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e090034c-1c88-4eb7-b007-ee5ce3aeaf90 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:41.251479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e090034c-1c88-4eb7-b007-ee5ce3aeaf90 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:41.251479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e090034c-1c88-4eb7-b007-ee5ce3aeaf90 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:41.251479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e090034c-1c88-4eb7-b007-ee5ce3aeaf90 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:41.262982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ccd4b788-7877-4755-8a80-9241511892f3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:41.263620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ccd4b788-7877-4755-8a80-9241511892f3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:41.277337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccd4b788-7877-4755-8a80-9241511892f3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:41.277810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccd4b788-7877-4755-8a80-9241511892f3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:41.278703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccd4b788-7877-4755-8a80-9241511892f3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:41.279156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccd4b788-7877-4755-8a80-9241511892f3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:41.339701 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e090034c-1c88-4eb7-b007-ee5ce3aeaf90 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 200 len: 113 microversion: 2.1 time: 0.107814 May 28 21:25:41.340425 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2451/4845] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:41 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 113 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:25:41.362454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e56d7ecf-bec3-40f3-8cf9-0b6e0ba25411 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:41.363478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e56d7ecf-bec3-40f3-8cf9-0b6e0ba25411 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:41.371940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e56d7ecf-bec3-40f3-8cf9-0b6e0ba25411 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:41.372602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e56d7ecf-bec3-40f3-8cf9-0b6e0ba25411 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:41.373689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e56d7ecf-bec3-40f3-8cf9-0b6e0ba25411 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:41.374344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e56d7ecf-bec3-40f3-8cf9-0b6e0ba25411 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:41.809466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ccd4b788-7877-4755-8a80-9241511892f3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:41.818223 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ccd4b788-7877-4755-8a80-9241511892f3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1324 microversion: 2.1 time: 0.560316 May 28 21:25:41.819790 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2395/4846] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:41 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1324 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:41.838749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6a3ec67b-f416-4ffb-be5d-66bbe7c18dcc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-766342384", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6a3ec67b-f416-4ffb-be5d-66bbe7c18dcc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 234 May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-766342384", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-766342384', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '3a3043e0-048b-4e2b-ab77-16b78a2870c5'}]}}} May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = func(instance) May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise error May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi 'notvalid' May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:41.850011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6a3ec67b-f416-4ffb-be5d-66bbe7c18dcc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6a3ec67b-f416-4ffb-be5d-66bbe7c18dcc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.034262 May 28 21:25:41.860646 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2396/4847] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:25:41 2022] POST /compute/v2.1/servers => generated 133 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:25:41.868451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-128de680-8a01-422a-8ecb-acf7a3a235e1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:41.869107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-128de680-8a01-422a-8ecb-acf7a3a235e1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:41.887407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-128de680-8a01-422a-8ecb-acf7a3a235e1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:41.887881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-128de680-8a01-422a-8ecb-acf7a3a235e1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:41.888664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-128de680-8a01-422a-8ecb-acf7a3a235e1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:41.889109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-128de680-8a01-422a-8ecb-acf7a3a235e1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:41.986302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e56d7ecf-bec3-40f3-8cf9-0b6e0ba25411 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:41.997048 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e56d7ecf-bec3-40f3-8cf9-0b6e0ba25411 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.638628 May 28 21:25:41.997737 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2452/4848] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:41 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:42.020113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1d1c2e0d-eb28-4836-8c21-9c024efbef90 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:42.021137 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1d1c2e0d-eb28-4836-8c21-9c024efbef90 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:42.030625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d1c2e0d-eb28-4836-8c21-9c024efbef90 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:42.031405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d1c2e0d-eb28-4836-8c21-9c024efbef90 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:42.032434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d1c2e0d-eb28-4836-8c21-9c024efbef90 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:42.033209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d1c2e0d-eb28-4836-8c21-9c024efbef90 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:42.284304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-128de680-8a01-422a-8ecb-acf7a3a235e1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:42.300714 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-128de680-8a01-422a-8ecb-acf7a3a235e1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.436596 May 28 21:25:42.327847 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2397/4849] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:41 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:42.336633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-367cc90d-2e29-4977-befe-1f469aaec2fc tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:42.344372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-367cc90d-2e29-4977-befe-1f469aaec2fc tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:42.355867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-367cc90d-2e29-4977-befe-1f469aaec2fc tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:42.356620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-367cc90d-2e29-4977-befe-1f469aaec2fc tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:42.358205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-367cc90d-2e29-4977-befe-1f469aaec2fc tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:42.359892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-367cc90d-2e29-4977-befe-1f469aaec2fc tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:42.404686 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-367cc90d-2e29-4977-befe-1f469aaec2fc tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.075601 May 28 21:25:42.405398 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2398/4850] 10.222.0.33 () {60 vars in 1342 bytes} [Sat May 28 21:25:42 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:42.414073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b3cdd299-b574-482c-8fa4-7149fb6ec13f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:42.414711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b3cdd299-b574-482c-8fa4-7149fb6ec13f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:42.424098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1d1c2e0d-eb28-4836-8c21-9c024efbef90 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:42.433927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3cdd299-b574-482c-8fa4-7149fb6ec13f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:42.435028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3cdd299-b574-482c-8fa4-7149fb6ec13f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:42.437451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3cdd299-b574-482c-8fa4-7149fb6ec13f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:42.438881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3cdd299-b574-482c-8fa4-7149fb6ec13f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:42.445969 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1d1c2e0d-eb28-4836-8c21-9c024efbef90 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.430724 May 28 21:25:42.450685 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2453/4851] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:42 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:42.467268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-307c2c61-f7ac-4675-b1e1-5c37780633ca tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:42.468181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-307c2c61-f7ac-4675-b1e1-5c37780633ca tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:42.474987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:42.477119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-307c2c61-f7ac-4675-b1e1-5c37780633ca tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:42.477919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-307c2c61-f7ac-4675-b1e1-5c37780633ca tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:42.479439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-307c2c61-f7ac-4675-b1e1-5c37780633ca tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:42.480409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-307c2c61-f7ac-4675-b1e1-5c37780633ca tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:42.826704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b3cdd299-b574-482c-8fa4-7149fb6ec13f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:42.829012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-307c2c61-f7ac-4675-b1e1-5c37780633ca tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:42.836479 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b3cdd299-b574-482c-8fa4-7149fb6ec13f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.429787 May 28 21:25:42.841976 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2399/4852] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:42 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:42.841976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a1cae253-caca-484a-a557-54be2c94160c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:42.845796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a1cae253-caca-484a-a557-54be2c94160c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:42.853612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1cae253-caca-484a-a557-54be2c94160c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:42.854376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1cae253-caca-484a-a557-54be2c94160c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:42.855339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1cae253-caca-484a-a557-54be2c94160c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:42.855945 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1cae253-caca-484a-a557-54be2c94160c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:42.870703 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-307c2c61-f7ac-4675-b1e1-5c37780633ca tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.406260 May 28 21:25:42.884737 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2454/4853] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:42 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:42.900379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a1cae253-caca-484a-a557-54be2c94160c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:25:42.901005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-539ef6c9-d475-4483-883c-c4ebcd540297 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:42.901005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-539ef6c9-d475-4483-883c-c4ebcd540297 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:42.910583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-539ef6c9-d475-4483-883c-c4ebcd540297 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:42.911067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-539ef6c9-d475-4483-883c-c4ebcd540297 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:42.911863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-539ef6c9-d475-4483-883c-c4ebcd540297 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:42.912316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-539ef6c9-d475-4483-883c-c4ebcd540297 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:43.239834 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-539ef6c9-d475-4483-883c-c4ebcd540297 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:43.250819 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-539ef6c9-d475-4483-883c-c4ebcd540297 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1391 microversion: 2.1 time: 0.364484 May 28 21:25:43.251774 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2455/4854] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:42 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1391 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:43.256626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40a41d1a-bc98-49cb-a06e-9dc2f2af42bb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:43.257239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-40a41d1a-bc98-49cb-a06e-9dc2f2af42bb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 5abf15d2-fa8f-47a3-ab94-e25470a4b210] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:43.261145 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a1cae253-caca-484a-a557-54be2c94160c tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 204 len: 0 microversion: 2.20 time: 0.422778 May 28 21:25:43.262543 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2400/4855] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:25:42 2022] DELETE /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:25:43.271992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-44bdcfc0-5476-4017-b1db-a0e65da2d387 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:43.273130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-44bdcfc0-5476-4017-b1db-a0e65da2d387 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:43.278005 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-40a41d1a-bc98-49cb-a06e-9dc2f2af42bb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance 5abf15d2-fa8f-47a3-ab94-e25470a4b210 could not be found. May 28 21:25:43.283816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-44bdcfc0-5476-4017-b1db-a0e65da2d387 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:43.284516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-44bdcfc0-5476-4017-b1db-a0e65da2d387 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:43.285614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-44bdcfc0-5476-4017-b1db-a0e65da2d387 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:43.286098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-44bdcfc0-5476-4017-b1db-a0e65da2d387 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40a41d1a-bc98-49cb-a06e-9dc2f2af42bb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/5abf15d2-fa8f-47a3-ab94-e25470a4b210/action HTTP/1.1 May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 13 May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: {"pause": {}} May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 5abf15d2-fa8f-47a3-ab94-e25470a4b210 could not be found. May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '5abf15d2-fa8f-47a3-ab94-e25470a4b210', 'body': {'pause': {}}} May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5abf15d2-fa8f-47a3-ab94-e25470a4b210 could not be found. May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5abf15d2-fa8f-47a3-ab94-e25470a4b210 could not be found. May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:43.292673 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:43.300677 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:43.300677 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:43.300677 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5abf15d2-fa8f-47a3-ab94-e25470a4b210 could not be found. May 28 21:25:43.300677 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:43.300677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40a41d1a-bc98-49cb-a06e-9dc2f2af42bb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance 5abf15d2-fa8f-47a3-ab94-e25470a4b210 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:43.300677 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-40a41d1a-bc98-49cb-a06e-9dc2f2af42bb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/5abf15d2-fa8f-47a3-ab94-e25470a4b210/action" status: 404 len: 111 microversion: 2.1 time: 0.042063 May 28 21:25:43.300677 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2456/4856] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:43 2022] POST /compute/v2.1/servers/5abf15d2-fa8f-47a3-ab94-e25470a4b210/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:25:43.308687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2aa7a38a-78eb-4b86-9c0c-9da1bd2e12af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:43.309457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2aa7a38a-78eb-4b86-9c0c-9da1bd2e12af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:43.326364 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2aa7a38a-78eb-4b86-9c0c-9da1bd2e12af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:43.328395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2aa7a38a-78eb-4b86-9c0c-9da1bd2e12af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:43.331178 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2aa7a38a-78eb-4b86-9c0c-9da1bd2e12af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:43.331178 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2aa7a38a-78eb-4b86-9c0c-9da1bd2e12af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:43.607533 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-44bdcfc0-5476-4017-b1db-a0e65da2d387 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:43.610609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2aa7a38a-78eb-4b86-9c0c-9da1bd2e12af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:43.618138 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-44bdcfc0-5476-4017-b1db-a0e65da2d387 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.352558 May 28 21:25:43.619380 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2401/4857] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:43 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:43.621211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2aa7a38a-78eb-4b86-9c0c-9da1bd2e12af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:43.622783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2aa7a38a-78eb-4b86-9c0c-9da1bd2e12af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:43.625277 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2aa7a38a-78eb-4b86-9c0c-9da1bd2e12af tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1724 microversion: 2.20 time: 0.327449 May 28 21:25:43.627225 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2457/4858] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:25:43 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1724 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:25:43.627443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1f60f5f2-5497-4ee5-965c-da86069ed898 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:43.628378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1f60f5f2-5497-4ee5-965c-da86069ed898 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:43.640910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f60f5f2-5497-4ee5-965c-da86069ed898 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:43.641619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f60f5f2-5497-4ee5-965c-da86069ed898 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:43.642481 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f60f5f2-5497-4ee5-965c-da86069ed898 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:43.642930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f60f5f2-5497-4ee5-965c-da86069ed898 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:43.834903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1178083324", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "d304eff3-8e4f-4892-8a6c-ef6717920bb8"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:43.956231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] validate_networks() for [('d304eff3-8e4f-4892-8a6c-ef6717920bb8', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:25:44.052268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1f60f5f2-5497-4ee5-965c-da86069ed898 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:44.062662 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1f60f5f2-5497-4ee5-965c-da86069ed898 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.441222 May 28 21:25:44.066402 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2402/4859] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:43 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:44.082878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b1ab2484-5877-4140-993c-0913feb6f9f2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:44.091650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b1ab2484-5877-4140-993c-0913feb6f9f2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:44.111046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b1ab2484-5877-4140-993c-0913feb6f9f2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:44.112967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b1ab2484-5877-4140-993c-0913feb6f9f2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:44.116395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b1ab2484-5877-4140-993c-0913feb6f9f2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:44.119074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b1ab2484-5877-4140-993c-0913feb6f9f2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:44.400363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b1ab2484-5877-4140-993c-0913feb6f9f2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:44.411357 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b1ab2484-5877-4140-993c-0913feb6f9f2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.332350 May 28 21:25:44.412233 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2403/4860] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:44 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:44.419711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5b3dfbe9-d5d2-434c-b62f-6abc4f90280a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:44.420583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5b3dfbe9-d5d2-434c-b62f-6abc4f90280a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:44.428604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b3dfbe9-d5d2-434c-b62f-6abc4f90280a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:44.429072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b3dfbe9-d5d2-434c-b62f-6abc4f90280a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:44.429977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b3dfbe9-d5d2-434c-b62f-6abc4f90280a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:44.430427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b3dfbe9-d5d2-434c-b62f-6abc4f90280a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:44.850792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5b3dfbe9-d5d2-434c-b62f-6abc4f90280a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:44.860406 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5b3dfbe9-d5d2-434c-b62f-6abc4f90280a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1391 microversion: 2.1 time: 0.446745 May 28 21:25:44.861542 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2404/4861] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:44 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1391 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:44.868290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a29730eb-8637-453f-94c4-7267210cb0a2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:44.869062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a29730eb-8637-453f-94c4-7267210cb0a2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:44.877803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a29730eb-8637-453f-94c4-7267210cb0a2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:44.878546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a29730eb-8637-453f-94c4-7267210cb0a2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:44.879560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a29730eb-8637-453f-94c4-7267210cb0a2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:44.887507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a29730eb-8637-453f-94c4-7267210cb0a2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:45.038005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:25:45.038005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:25:45.038005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:25:45.038005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:25:45.038005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:25:45.052592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:45.053063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:45.053902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:45.054777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:45.092960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Getting quotas for project 54447ea481574a128f06c24315f34e46. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:25:45.100114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Getting quotas for user 02d5fbb072814fd7923ecf12c7ecad7b and project 54447ea481574a128f06c24315f34e46. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:25:45.114250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:25:45.116568 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:25:45.241533 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a29730eb-8637-453f-94c4-7267210cb0a2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action" status: 202 len: 0 microversion: 2.1 time: 0.378239 May 28 21:25:45.256464 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2405/4862] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:44 2022] POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:25:45.264449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7841bc98-e44f-488e-9ab3-083a162324c5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:45.265173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7841bc98-e44f-488e-9ab3-083a162324c5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:45.271664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7841bc98-e44f-488e-9ab3-083a162324c5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:45.272117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7841bc98-e44f-488e-9ab3-083a162324c5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:45.273154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7841bc98-e44f-488e-9ab3-083a162324c5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:45.274341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7841bc98-e44f-488e-9ab3-083a162324c5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:45.318620 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-06a6c02b-83b9-43d9-81a2-a860eec39d24 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.510869 May 28 21:25:45.319306 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2458/4863] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:25:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:25:45.330241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-2fbd4fb6-fd40-4a18-b03f-cb8191dc2592 req-fb4448a9-facb-4ac4-a15c-d2158d7a9e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d38a270e-eebf-4adc-93a3-e4a5bac81ee2", "tag": "b5a42f07-fe9d-45f6-9f24-d15afa18b370"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:45.356600 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2fbd4fb6-fd40-4a18-b03f-cb8191dc2592 req-fb4448a9-facb-4ac4-a15c-d2158d7a9e7c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:45.359353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2fbd4fb6-fd40-4a18-b03f-cb8191dc2592 req-fb4448a9-facb-4ac4-a15c-d2158d7a9e7c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:45.382085 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-2fbd4fb6-fd40-4a18-b03f-cb8191dc2592 req-fb4448a9-facb-4ac4-a15c-d2158d7a9e7c service nova] Creating event network-changed:b5a42f07-fe9d-45f6-9f24-d15afa18b370 for instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 on nch2-master-1 May 28 21:25:45.388053 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-2fbd4fb6-fd40-4a18-b03f-cb8191dc2592 req-fb4448a9-facb-4ac4-a15c-d2158d7a9e7c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067497 May 28 21:25:45.389344 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2459/4864] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:25:45.395570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8cf0eb51-7295-4cd1-9150-a65253e5b486 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:45.396601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8cf0eb51-7295-4cd1-9150-a65253e5b486 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:45.406552 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8cf0eb51-7295-4cd1-9150-a65253e5b486 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:45.407667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8cf0eb51-7295-4cd1-9150-a65253e5b486 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:45.408823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8cf0eb51-7295-4cd1-9150-a65253e5b486 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:45.409465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8cf0eb51-7295-4cd1-9150-a65253e5b486 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:46.180862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7841bc98-e44f-488e-9ab3-083a162324c5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:46.180862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7841bc98-e44f-488e-9ab3-083a162324c5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:46.180862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7841bc98-e44f-488e-9ab3-083a162324c5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:46.181210 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7841bc98-e44f-488e-9ab3-083a162324c5 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1724 microversion: 2.20 time: 0.923250 May 28 21:25:46.181552 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2406/4865] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:25:45 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1724 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:25:46.198620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b6e68c10-c115-4f7b-b105-9f33086c75ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:46.199445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b6e68c10-c115-4f7b-b105-9f33086c75ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:46.224510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8cf0eb51-7295-4cd1-9150-a65253e5b486 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:46.236028 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8cf0eb51-7295-4cd1-9150-a65253e5b486 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1508 microversion: 2.1 time: 0.845256 May 28 21:25:46.242469 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2460/4866] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:45 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1508 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:46.248787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a9702567-5bb6-47e0-83d8-89ea0bb94c63 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:46.249430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a9702567-5bb6-47e0-83d8-89ea0bb94c63 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:46.255873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9702567-5bb6-47e0-83d8-89ea0bb94c63 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:46.256548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9702567-5bb6-47e0-83d8-89ea0bb94c63 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:46.257504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9702567-5bb6-47e0-83d8-89ea0bb94c63 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:46.258683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9702567-5bb6-47e0-83d8-89ea0bb94c63 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:46.268749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b6e68c10-c115-4f7b-b105-9f33086c75ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:46.281637 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b6e68c10-c115-4f7b-b105-9f33086c75ee tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 200 len: 1215 microversion: 2.1 time: 0.088387 May 28 21:25:46.282603 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2407/4867] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:46 2022] GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:46.450462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a9702567-5bb6-47e0-83d8-89ea0bb94c63 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:46.458510 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a9702567-5bb6-47e0-83d8-89ea0bb94c63 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1391 microversion: 2.1 time: 0.214596 May 28 21:25:46.459317 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2461/4868] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:46 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1391 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:47.200072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7cf79f93-2612-46aa-9c82-82fb4474eb8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:47.200721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7cf79f93-2612-46aa-9c82-82fb4474eb8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:47.219764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7cf79f93-2612-46aa-9c82-82fb4474eb8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:47.219764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7cf79f93-2612-46aa-9c82-82fb4474eb8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:47.227367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7cf79f93-2612-46aa-9c82-82fb4474eb8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:47.227897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7cf79f93-2612-46aa-9c82-82fb4474eb8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:47.254038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c5ac133f-5a05-4395-8581-a822695460ac tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:47.254784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c5ac133f-5a05-4395-8581-a822695460ac tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:47.267161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5ac133f-5a05-4395-8581-a822695460ac tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:47.268172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5ac133f-5a05-4395-8581-a822695460ac tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:47.270238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5ac133f-5a05-4395-8581-a822695460ac tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:47.273126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5ac133f-5a05-4395-8581-a822695460ac tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:47.375190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7cf79f93-2612-46aa-9c82-82fb4474eb8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:47.392030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7cf79f93-2612-46aa-9c82-82fb4474eb8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:47.394669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7cf79f93-2612-46aa-9c82-82fb4474eb8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '857a887b6c7c41588afb2845eed6f309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8841fa441d413a92a15510a9d082c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:47.397142 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7cf79f93-2612-46aa-9c82-82fb4474eb8b tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 200 len: 1656 microversion: 2.20 time: 0.201711 May 28 21:25:47.399484 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2408/4869] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:25:47 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 1656 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:25:47.406888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3fdf1199-da92-44e8-9066-c68d14d6ad30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:47.407899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3fdf1199-da92-44e8-9066-c68d14d6ad30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:47.431929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fdf1199-da92-44e8-9066-c68d14d6ad30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:47.435552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fdf1199-da92-44e8-9066-c68d14d6ad30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:47.439083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fdf1199-da92-44e8-9066-c68d14d6ad30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:47.439083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fdf1199-da92-44e8-9066-c68d14d6ad30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:47.448932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:47.592163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3fdf1199-da92-44e8-9066-c68d14d6ad30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:47.612111 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3fdf1199-da92-44e8-9066-c68d14d6ad30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 200 len: 1267 microversion: 2.1 time: 0.211238 May 28 21:25:47.615450 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2409/4870] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:47 2022] GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:47.627965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-81acfb6b-c6d8-4489-b4b1-fc04c69cd516 req-6a807a03-5b12-4e83-9a64-08ae290be8cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd20dd19-f26b-4e32-9114-715558d5aa3b", "name": "network-vif-deleted", "tag": "4c95deb6-3882-40f5-af0e-fd2149216c59"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:47.642159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-81acfb6b-c6d8-4489-b4b1-fc04c69cd516 req-6a807a03-5b12-4e83-9a64-08ae290be8cd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:47.642664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-81acfb6b-c6d8-4489-b4b1-fc04c69cd516 req-6a807a03-5b12-4e83-9a64-08ae290be8cd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:47.656743 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-81acfb6b-c6d8-4489-b4b1-fc04c69cd516 req-6a807a03-5b12-4e83-9a64-08ae290be8cd service nova] Creating event network-vif-deleted:4c95deb6-3882-40f5-af0e-fd2149216c59 for instance cd20dd19-f26b-4e32-9114-715558d5aa3b on nch2-master-1 May 28 21:25:47.661095 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c5ac133f-5a05-4395-8581-a822695460ac tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:47.676910 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c5ac133f-5a05-4395-8581-a822695460ac tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1488 microversion: 2.1 time: 0.422391 May 28 21:25:47.677027 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-81acfb6b-c6d8-4489-b4b1-fc04c69cd516 req-6a807a03-5b12-4e83-9a64-08ae290be8cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055652 May 28 21:25:47.677124 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2462/4871] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:47 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1488 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:47.677447 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2410/4872] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:25:47.680256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-688a287b-e170-40da-9200-ad93e94897de tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:47.681043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-688a287b-e170-40da-9200-ad93e94897de tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:47.690418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8d1950ab-d0dd-4ec0-a4f0-74cccf0184d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:47.691303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8d1950ab-d0dd-4ec0-a4f0-74cccf0184d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:47.714142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-688a287b-e170-40da-9200-ad93e94897de tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:47.714850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-688a287b-e170-40da-9200-ad93e94897de tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:47.715543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-688a287b-e170-40da-9200-ad93e94897de tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:47.715991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-688a287b-e170-40da-9200-ad93e94897de tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:47.728052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d1950ab-d0dd-4ec0-a4f0-74cccf0184d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:47.728512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d1950ab-d0dd-4ec0-a4f0-74cccf0184d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:47.729296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d1950ab-d0dd-4ec0-a4f0-74cccf0184d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:47.729738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d1950ab-d0dd-4ec0-a4f0-74cccf0184d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:47.766714 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-8d1950ab-d0dd-4ec0-a4f0-74cccf0184d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Cannot 'pause' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state paused May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8d1950ab-d0dd-4ec0-a4f0-74cccf0184d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action HTTP/1.1 May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 13 May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: {"pause": {}} May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: exception: Cannot 'pause' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state paused May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'a798306b-2df0-4ef0-b523-13a226b16120', 'body': {'pause': {}}} May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a798306b-2df0-4ef0-b523-13a226b16120 in vm_state paused. Cannot pause while the instance is in this state. May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state paused May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:47.769198 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:47.782375 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:47.782375 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:47.782375 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:47.782375 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state paused May 28 21:25:47.782375 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:47.782375 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8d1950ab-d0dd-4ec0-a4f0-74cccf0184d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 409 to user: Cannot 'pause' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state paused {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:47.782375 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8d1950ab-d0dd-4ec0-a4f0-74cccf0184d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action" status: 409 len: 143 microversion: 2.1 time: 0.090843 May 28 21:25:47.782375 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2411/4873] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:47 2022] POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action => generated 143 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:25:47.802190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b4dab68a-10bf-4871-a960-01ce372a9b60 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:47.803605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b4dab68a-10bf-4871-a960-01ce372a9b60 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:47.816426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b4dab68a-10bf-4871-a960-01ce372a9b60 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:47.816897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b4dab68a-10bf-4871-a960-01ce372a9b60 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:47.817697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b4dab68a-10bf-4871-a960-01ce372a9b60 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:47.818228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b4dab68a-10bf-4871-a960-01ce372a9b60 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:48.066104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-688a287b-e170-40da-9200-ad93e94897de tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:48.080445 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-688a287b-e170-40da-9200-ad93e94897de tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1391 microversion: 2.1 time: 0.404966 May 28 21:25:48.081149 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2463/4874] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:47 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1391 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:48.145539 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b4dab68a-10bf-4871-a960-01ce372a9b60 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action" status: 202 len: 0 microversion: 2.1 time: 0.348167 May 28 21:25:48.147056 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2412/4875] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:47 2022] POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:25:48.154929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-959ad46f-d316-4d97-a0ad-c26fb685cef3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:48.155564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-959ad46f-d316-4d97-a0ad-c26fb685cef3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:48.168710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-959ad46f-d316-4d97-a0ad-c26fb685cef3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:48.169162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-959ad46f-d316-4d97-a0ad-c26fb685cef3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:48.169992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-959ad46f-d316-4d97-a0ad-c26fb685cef3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:48.170443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-959ad46f-d316-4d97-a0ad-c26fb685cef3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:48.419751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1838a5c0-55b2-4f66-8752-c28e40c44793 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:48.419751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1838a5c0-55b2-4f66-8752-c28e40c44793 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:48.432436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1838a5c0-55b2-4f66-8752-c28e40c44793 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:48.432754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1838a5c0-55b2-4f66-8752-c28e40c44793 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:48.433762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1838a5c0-55b2-4f66-8752-c28e40c44793 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:48.434377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1838a5c0-55b2-4f66-8752-c28e40c44793 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:48.475820 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-1838a5c0-55b2-4f66-8752-c28e40c44793 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] HTTP exception thrown: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1838a5c0-55b2-4f66-8752-c28e40c44793 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Request method failure captured: May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b HTTP/1.1 May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpHgQsHrY8-tq6Lwhk_kgt3Xn4L_MidLfd6t6e1kt_vBLOS7gz_CdRphRZe8jlNCfAjP4WEQVlYKxEr43W08fmlIXyzbk2DCiVB54W72qgC2txvk8K6J5cHEGo02tw5b8QBHyCk2dla8Zm2cYLbHUihbqsiMTPUFEU0q9nplGTe2zlo May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Openstack-Nova-Api-Version: 2.20 May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5a8841fa441d413a92a15510a9d082c6 May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a8841fa441d413a92a15510a9d082c6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5a8841fa441d413a92a15510a9d082c6 May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AttachVolumeShelveTestJSON-1592071011-project May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 857a887b6c7c41588afb2845eed6f309 May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1592071011-project May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'cd20dd19-f26b-4e32-9114-715558d5aa3b'} May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:48.479895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:48.484423 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:48.484423 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:48.484423 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:48.484423 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:48.484423 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:48.484423 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:48.484423 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. May 28 21:25:48.484423 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:48.484928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-959ad46f-d316-4d97-a0ad-c26fb685cef3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:48.485360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1838a5c0-55b2-4f66-8752-c28e40c44793 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Returning 404 to user: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:48.485360 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1838a5c0-55b2-4f66-8752-c28e40c44793 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 404 len: 111 microversion: 2.20 time: 0.071760 May 28 21:25:48.485360 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2413/4876] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:25:48 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 28 21:25:48.497427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2d4917a9-226f-4007-ab50-c68d6fab8342 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '.version_select at 0x7f4d640f2550>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:48.501529 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-959ad46f-d316-4d97-a0ad-c26fb685cef3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1495 microversion: 2.1 time: 0.348200 May 28 21:25:48.501529 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2464/4877] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:48 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1495 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:48.610178 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2d4917a9-226f-4007-ab50-c68d6fab8342 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507761769" status: 204 len: 0 microversion: 2.20 time: 0.118591 May 28 21:25:48.612541 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2414/4878] 10.222.0.33 () {60 vars in 1261 bytes} [Sat May 28 21:25:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1507761769 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:25:48.628982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-88be55bf-2613-44df-b0e3-b2483fdd0b5d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:48.629659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-88be55bf-2613-44df-b0e3-b2483fdd0b5d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:48.636762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88be55bf-2613-44df-b0e3-b2483fdd0b5d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:48.637492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88be55bf-2613-44df-b0e3-b2483fdd0b5d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:48.638487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88be55bf-2613-44df-b0e3-b2483fdd0b5d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:48.639131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88be55bf-2613-44df-b0e3-b2483fdd0b5d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:48.717775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-88be55bf-2613-44df-b0e3-b2483fdd0b5d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:48.727555 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-88be55bf-2613-44df-b0e3-b2483fdd0b5d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 200 len: 1273 microversion: 2.1 time: 0.102370 May 28 21:25:48.729503 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2465/4879] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:48 2022] GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 1273 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:49.096261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8663c0a7-2994-45d7-ac2c-d545e3a9f93b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:49.096886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8663c0a7-2994-45d7-ac2c-d545e3a9f93b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:49.104890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8663c0a7-2994-45d7-ac2c-d545e3a9f93b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:49.105344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8663c0a7-2994-45d7-ac2c-d545e3a9f93b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:49.106153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8663c0a7-2994-45d7-ac2c-d545e3a9f93b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:49.106596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8663c0a7-2994-45d7-ac2c-d545e3a9f93b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:49.489304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8663c0a7-2994-45d7-ac2c-d545e3a9f93b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:49.498266 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8663c0a7-2994-45d7-ac2c-d545e3a9f93b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1391 microversion: 2.1 time: 0.405696 May 28 21:25:49.510891 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2415/4880] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:49 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1391 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:49.520082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a77033b8-9589-474a-b8e7-828676a52988 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:49.520702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a77033b8-9589-474a-b8e7-828676a52988 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:49.531922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a77033b8-9589-474a-b8e7-828676a52988 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:49.532922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a77033b8-9589-474a-b8e7-828676a52988 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:49.534535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a77033b8-9589-474a-b8e7-828676a52988 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:49.535168 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a77033b8-9589-474a-b8e7-828676a52988 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:49.746938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5ec71618-c81d-4b51-b878-8fc1c785559d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:49.747931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5ec71618-c81d-4b51-b878-8fc1c785559d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:49.754440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ec71618-c81d-4b51-b878-8fc1c785559d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:49.755191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ec71618-c81d-4b51-b878-8fc1c785559d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:49.756195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ec71618-c81d-4b51-b878-8fc1c785559d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:49.756874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ec71618-c81d-4b51-b878-8fc1c785559d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:49.791596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a77033b8-9589-474a-b8e7-828676a52988 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:49.802092 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a77033b8-9589-474a-b8e7-828676a52988 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.288309 May 28 21:25:49.821989 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2466/4881] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:49 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:49.828687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a88bfdd9-f8b9-4012-a9b0-5667e26c17e2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:49.829323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a88bfdd9-f8b9-4012-a9b0-5667e26c17e2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:49.841343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a88bfdd9-f8b9-4012-a9b0-5667e26c17e2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:49.847922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a88bfdd9-f8b9-4012-a9b0-5667e26c17e2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:49.849319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a88bfdd9-f8b9-4012-a9b0-5667e26c17e2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:49.849319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a88bfdd9-f8b9-4012-a9b0-5667e26c17e2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:49.887828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:50.036769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5ec71618-c81d-4b51-b878-8fc1c785559d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:50.050711 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5ec71618-c81d-4b51-b878-8fc1c785559d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 200 len: 1315 microversion: 2.1 time: 0.307933 May 28 21:25:50.061383 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2416/4882] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:49 2022] GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:50.205009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a88bfdd9-f8b9-4012-a9b0-5667e26c17e2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:50.218322 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a88bfdd9-f8b9-4012-a9b0-5667e26c17e2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.395094 May 28 21:25:50.223944 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2467/4883] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:49 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:50.243088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-68ee62ea-66d9-40d1-b9c9-1c610a7db51d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:50.244631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-68ee62ea-66d9-40d1-b9c9-1c610a7db51d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:50.252431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-68ee62ea-66d9-40d1-b9c9-1c610a7db51d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:50.253978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-68ee62ea-66d9-40d1-b9c9-1c610a7db51d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:50.257085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-68ee62ea-66d9-40d1-b9c9-1c610a7db51d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:50.259104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-68ee62ea-66d9-40d1-b9c9-1c610a7db51d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:50.304093 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-68ee62ea-66d9-40d1-b9c9-1c610a7db51d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-68ee62ea-66d9-40d1-b9c9-1c610a7db51d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7/action HTTP/1.1 May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 28 May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: {"reboot": {"type": "SOFT"}} May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '3fa085b6-1742-4a91-a55f-aeb8b73824e7', 'body': {'reboot': {'type': 'SOFT'}}} May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:50.308606 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:50.318614 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:25:50.318614 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:50.318614 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:50.318614 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:50.318614 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:50.318614 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:50.318614 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:50.318614 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:50.318614 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:50.318614 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:25:50.318614 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:50.318614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-68ee62ea-66d9-40d1-b9c9-1c610a7db51d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:50.323031 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-68ee62ea-66d9-40d1-b9c9-1c610a7db51d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7/action" status: 404 len: 111 microversion: 2.1 time: 0.084513 May 28 21:25:50.324593 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2417/4884] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:50 2022] POST /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7/action => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:25:50.333075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-581428e9-d47a-40a1-89f9-f03c9f9f63a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:50.335044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-581428e9-d47a-40a1-89f9-f03c9f9f63a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:50.355863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-581428e9-d47a-40a1-89f9-f03c9f9f63a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:50.358270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-581428e9-d47a-40a1-89f9-f03c9f9f63a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:50.359373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-581428e9-d47a-40a1-89f9-f03c9f9f63a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:50.360941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-581428e9-d47a-40a1-89f9-f03c9f9f63a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:50.522805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b3afa8c5-e251-466b-b3cf-7f466c226e9e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:50.523628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b3afa8c5-e251-466b-b3cf-7f466c226e9e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:50.535974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3afa8c5-e251-466b-b3cf-7f466c226e9e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:50.536434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3afa8c5-e251-466b-b3cf-7f466c226e9e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:50.553863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3afa8c5-e251-466b-b3cf-7f466c226e9e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:50.554366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3afa8c5-e251-466b-b3cf-7f466c226e9e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:50.664285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-581428e9-d47a-40a1-89f9-f03c9f9f63a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:50.690031 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-581428e9-d47a-40a1-89f9-f03c9f9f63a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.360794 May 28 21:25:50.695110 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2468/4885] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:50 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:50.720655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-81064ea6-3903-430d-934c-5d02c32deb8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:50.721832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-81064ea6-3903-430d-934c-5d02c32deb8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:50.730699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81064ea6-3903-430d-934c-5d02c32deb8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:50.731449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81064ea6-3903-430d-934c-5d02c32deb8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:50.734527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81064ea6-3903-430d-934c-5d02c32deb8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:50.735434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-81064ea6-3903-430d-934c-5d02c32deb8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:51.051041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b3afa8c5-e251-466b-b3cf-7f466c226e9e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:51.061250 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b3afa8c5-e251-466b-b3cf-7f466c226e9e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1391 microversion: 2.1 time: 0.548418 May 28 21:25:51.062519 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2418/4886] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:50 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1391 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:51.067966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a7a1e40b-6792-40f0-b4be-592aea4e13a5 req-0103d03d-0496-48db-89ac-cac796eb995c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81204693-bc12-463e-8061-230ebcdc0fbe", "tag": "68f3980c-6620-4c6d-bb97-8053a73c38ff"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:51.109755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a7a1e40b-6792-40f0-b4be-592aea4e13a5 req-0103d03d-0496-48db-89ac-cac796eb995c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:51.110230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a7a1e40b-6792-40f0-b4be-592aea4e13a5 req-0103d03d-0496-48db-89ac-cac796eb995c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:51.131702 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a7a1e40b-6792-40f0-b4be-592aea4e13a5 req-0103d03d-0496-48db-89ac-cac796eb995c service nova] Creating event network-changed:68f3980c-6620-4c6d-bb97-8053a73c38ff for instance 81204693-bc12-463e-8061-230ebcdc0fbe on nch1-master-1 May 28 21:25:51.142839 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a7a1e40b-6792-40f0-b4be-592aea4e13a5 req-0103d03d-0496-48db-89ac-cac796eb995c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078859 May 28 21:25:51.143464 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2419/4887] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:25:51.149223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6fc38808-1c56-4b31-b81f-2b3b5440508c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:51.149445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-81064ea6-3903-430d-934c-5d02c32deb8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:51.150464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6fc38808-1c56-4b31-b81f-2b3b5440508c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:51.159713 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-81064ea6-3903-430d-934c-5d02c32deb8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.449337 May 28 21:25:51.161943 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2469/4888] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:50 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:51.180395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-77aecdf3-fd81-4422-9e2d-7f081ec2d091 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:51.181760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-77aecdf3-fd81-4422-9e2d-7f081ec2d091 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: b7214819-e513-4c8f-8c17-db5036bf8655] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:51.183293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fc38808-1c56-4b31-b81f-2b3b5440508c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:51.183767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fc38808-1c56-4b31-b81f-2b3b5440508c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:51.184563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fc38808-1c56-4b31-b81f-2b3b5440508c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:51.185004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fc38808-1c56-4b31-b81f-2b3b5440508c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:51.197045 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-77aecdf3-fd81-4422-9e2d-7f081ec2d091 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance b7214819-e513-4c8f-8c17-db5036bf8655 could not be found. May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-77aecdf3-fd81-4422-9e2d-7f081ec2d091 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/b7214819-e513-4c8f-8c17-db5036bf8655/action HTTP/1.1 May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 28 May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: {"reboot": {"type": "SOFT"}} May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance b7214819-e513-4c8f-8c17-db5036bf8655 could not be found. May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'b7214819-e513-4c8f-8c17-db5036bf8655', 'body': {'reboot': {'type': 'SOFT'}}} May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7214819-e513-4c8f-8c17-db5036bf8655 could not be found. May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7214819-e513-4c8f-8c17-db5036bf8655 could not be found. May 28 21:25:51.201593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:51.205645 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:51.205645 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:51.205645 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:51.205645 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:51.205645 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:51.205645 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:51.205645 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:51.205645 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7214819-e513-4c8f-8c17-db5036bf8655 could not be found. May 28 21:25:51.205645 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:51.208174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-77aecdf3-fd81-4422-9e2d-7f081ec2d091 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance b7214819-e513-4c8f-8c17-db5036bf8655 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:51.210255 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-77aecdf3-fd81-4422-9e2d-7f081ec2d091 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/b7214819-e513-4c8f-8c17-db5036bf8655/action" status: 404 len: 111 microversion: 2.1 time: 0.034224 May 28 21:25:51.214027 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2470/4889] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:51 2022] POST /compute/v2.1/servers/b7214819-e513-4c8f-8c17-db5036bf8655/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:25:51.228633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c95ef7e6-4a8a-425a-b536-62b2116190a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:51.231547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c95ef7e6-4a8a-425a-b536-62b2116190a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:51.246725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c95ef7e6-4a8a-425a-b536-62b2116190a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:51.250724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c95ef7e6-4a8a-425a-b536-62b2116190a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:51.255553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c95ef7e6-4a8a-425a-b536-62b2116190a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:51.256325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c95ef7e6-4a8a-425a-b536-62b2116190a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:51.562713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6fc38808-1c56-4b31-b81f-2b3b5440508c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:51.571900 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6fc38808-1c56-4b31-b81f-2b3b5440508c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 200 len: 1315 microversion: 2.1 time: 0.427068 May 28 21:25:51.573333 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2420/4890] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:51 2022] GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:51.656461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c95ef7e6-4a8a-425a-b536-62b2116190a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:51.679271 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c95ef7e6-4a8a-425a-b536-62b2116190a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.456831 May 28 21:25:51.699470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-13ddfdfb-40fe-482c-9e08-b1a4bc30c038 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:51.700251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-13ddfdfb-40fe-482c-9e08-b1a4bc30c038 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:51.703453 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2471/4891] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:51 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:51.708458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13ddfdfb-40fe-482c-9e08-b1a4bc30c038 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:51.711458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13ddfdfb-40fe-482c-9e08-b1a4bc30c038 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:51.713026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13ddfdfb-40fe-482c-9e08-b1a4bc30c038 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:51.719144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13ddfdfb-40fe-482c-9e08-b1a4bc30c038 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:51.917767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-13ddfdfb-40fe-482c-9e08-b1a4bc30c038 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:51.929321 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-13ddfdfb-40fe-482c-9e08-b1a4bc30c038 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.234229 May 28 21:25:51.931255 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2421/4892] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:51 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:51.948628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-92a75048-e418-41b6-a973-6d03ff20dbd9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:51.950200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-92a75048-e418-41b6-a973-6d03ff20dbd9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:51.960405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92a75048-e418-41b6-a973-6d03ff20dbd9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:51.962938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92a75048-e418-41b6-a973-6d03ff20dbd9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:51.963815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92a75048-e418-41b6-a973-6d03ff20dbd9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:51.964274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92a75048-e418-41b6-a973-6d03ff20dbd9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:51.981940 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-92a75048-e418-41b6-a973-6d03ff20dbd9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-92a75048-e418-41b6-a973-6d03ff20dbd9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7/action HTTP/1.1 May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 65 May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: {"rebuild": {"imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195"}} May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '3fa085b6-1742-4a91-a55f-aeb8b73824e7', 'body': {'rebuild': {'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195'}}} May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 28 21:25:51.983654 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-92a75048-e418-41b6-a973-6d03ff20dbd9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-92a75048-e418-41b6-a973-6d03ff20dbd9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7/action" status: 404 len: 111 microversion: 2.1 time: 0.041795 May 28 21:25:51.987897 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2472/4893] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:51 2022] POST /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:25:52.000326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-08f79861-a5ab-44d3-ae17-5b6058e688cc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:52.001454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-08f79861-a5ab-44d3-ae17-5b6058e688cc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:52.011108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08f79861-a5ab-44d3-ae17-5b6058e688cc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:52.011887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08f79861-a5ab-44d3-ae17-5b6058e688cc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:52.013405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08f79861-a5ab-44d3-ae17-5b6058e688cc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:52.014410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-08f79861-a5ab-44d3-ae17-5b6058e688cc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:52.084287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-519f1e31-8b1f-4e17-95cc-63011b2fb9c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:52.085171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-519f1e31-8b1f-4e17-95cc-63011b2fb9c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:52.094173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-519f1e31-8b1f-4e17-95cc-63011b2fb9c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:52.094900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-519f1e31-8b1f-4e17-95cc-63011b2fb9c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:52.095889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-519f1e31-8b1f-4e17-95cc-63011b2fb9c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:52.096633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-519f1e31-8b1f-4e17-95cc-63011b2fb9c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:52.251380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-08f79861-a5ab-44d3-ae17-5b6058e688cc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:52.260953 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-08f79861-a5ab-44d3-ae17-5b6058e688cc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.265814 May 28 21:25:52.261794 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2422/4894] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:51 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:52.279574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1163f7bf-e004-4114-abef-ae47aa91376a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:52.280193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1163f7bf-e004-4114-abef-ae47aa91376a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:52.286390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1163f7bf-e004-4114-abef-ae47aa91376a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:52.290319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1163f7bf-e004-4114-abef-ae47aa91376a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:52.290319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1163f7bf-e004-4114-abef-ae47aa91376a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:52.290319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1163f7bf-e004-4114-abef-ae47aa91376a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:52.326670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-519f1e31-8b1f-4e17-95cc-63011b2fb9c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:52.345414 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-519f1e31-8b1f-4e17-95cc-63011b2fb9c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1391 microversion: 2.1 time: 0.257729 May 28 21:25:52.345414 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2473/4895] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:52 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1391 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:52.454736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-0c228ae5-dbb7-4b9e-8e1a-a0cb3b1ad8be req-23ae4ffa-3a66-4cea-ab78-515a803a3d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38a270e-eebf-4adc-93a3-e4a5bac81ee2", "name": "network-vif-plugged", "status": "completed", "tag": "b5a42f07-fe9d-45f6-9f24-d15afa18b370"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:52.476507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1163f7bf-e004-4114-abef-ae47aa91376a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:52.479302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0c228ae5-dbb7-4b9e-8e1a-a0cb3b1ad8be req-23ae4ffa-3a66-4cea-ab78-515a803a3d3d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:52.480189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0c228ae5-dbb7-4b9e-8e1a-a0cb3b1ad8be req-23ae4ffa-3a66-4cea-ab78-515a803a3d3d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:52.484676 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1163f7bf-e004-4114-abef-ae47aa91376a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.209231 May 28 21:25:52.496308 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2423/4896] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:52 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:52.496831 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-0c228ae5-dbb7-4b9e-8e1a-a0cb3b1ad8be req-23ae4ffa-3a66-4cea-ab78-515a803a3d3d service nova] Creating event network-vif-plugged:b5a42f07-fe9d-45f6-9f24-d15afa18b370 for instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 on nch2-master-1 May 28 21:25:52.503613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1074faab-d70e-478f-9e05-f77b4f93b2cf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:52.507013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1074faab-d70e-478f-9e05-f77b4f93b2cf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: b5cb28a1-5cfe-4de6-82b8-2d0f7373da9c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:52.511046 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-0c228ae5-dbb7-4b9e-8e1a-a0cb3b1ad8be req-23ae4ffa-3a66-4cea-ab78-515a803a3d3d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061697 May 28 21:25:52.512039 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2474/4897] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:25:52.518553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:52.522062 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-1074faab-d70e-478f-9e05-f77b4f93b2cf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance b5cb28a1-5cfe-4de6-82b8-2d0f7373da9c could not be found. May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1074faab-d70e-478f-9e05-f77b4f93b2cf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/b5cb28a1-5cfe-4de6-82b8-2d0f7373da9c/action HTTP/1.1 May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 65 May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: {"rebuild": {"imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195"}} May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance b5cb28a1-5cfe-4de6-82b8-2d0f7373da9c could not be found. May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'b5cb28a1-5cfe-4de6-82b8-2d0f7373da9c', 'body': {'rebuild': {'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195'}}} May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5cb28a1-5cfe-4de6-82b8-2d0f7373da9c could not be found. May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) May 28 21:25:52.524566 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:25:52.529345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:25:52.529345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:52.529345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:52.529345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5cb28a1-5cfe-4de6-82b8-2d0f7373da9c could not be found. May 28 21:25:52.529345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:52.529345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:52.529345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:52.529345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:52.529345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:52.529345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:52.529345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:52.529345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:52.529345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5cb28a1-5cfe-4de6-82b8-2d0f7373da9c could not be found. May 28 21:25:52.529345 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:52.531800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1074faab-d70e-478f-9e05-f77b4f93b2cf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance b5cb28a1-5cfe-4de6-82b8-2d0f7373da9c could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:52.533356 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1074faab-d70e-478f-9e05-f77b4f93b2cf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/b5cb28a1-5cfe-4de6-82b8-2d0f7373da9c/action" status: 404 len: 111 microversion: 2.1 time: 0.034207 May 28 21:25:52.534177 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2424/4898] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:52 2022] POST /compute/v2.1/servers/b5cb28a1-5cfe-4de6-82b8-2d0f7373da9c/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:25:52.545378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-65ec4ae0-179e-4107-8c05-b9cff6fb4b11 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:52.546435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-65ec4ae0-179e-4107-8c05-b9cff6fb4b11 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:52.553635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65ec4ae0-179e-4107-8c05-b9cff6fb4b11 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:52.554274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65ec4ae0-179e-4107-8c05-b9cff6fb4b11 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:52.555600 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65ec4ae0-179e-4107-8c05-b9cff6fb4b11 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:52.556267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65ec4ae0-179e-4107-8c05-b9cff6fb4b11 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:52.590181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-abd4b559-cc4f-4f38-9eee-01201752b41a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:52.591495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-abd4b559-cc4f-4f38-9eee-01201752b41a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:52.601396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abd4b559-cc4f-4f38-9eee-01201752b41a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:52.601792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abd4b559-cc4f-4f38-9eee-01201752b41a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:52.602613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abd4b559-cc4f-4f38-9eee-01201752b41a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:52.603055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abd4b559-cc4f-4f38-9eee-01201752b41a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:52.881947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-65ec4ae0-179e-4107-8c05-b9cff6fb4b11 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:52.907394 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-abd4b559-cc4f-4f38-9eee-01201752b41a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:52.907598 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-65ec4ae0-179e-4107-8c05-b9cff6fb4b11 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.357269 May 28 21:25:52.907693 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-abd4b559-cc4f-4f38-9eee-01201752b41a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 200 len: 1315 microversion: 2.1 time: 0.315877 May 28 21:25:52.907775 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2475/4899] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:52 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:52.917757 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2425/4900] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:52 2022] GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:52.917969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3157baeb-0041-4646-b8eb-809b639ea656 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:52.919316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3157baeb-0041-4646-b8eb-809b639ea656 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:52.927735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3157baeb-0041-4646-b8eb-809b639ea656 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:52.933212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3157baeb-0041-4646-b8eb-809b639ea656 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:52.933212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3157baeb-0041-4646-b8eb-809b639ea656 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:52.933212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3157baeb-0041-4646-b8eb-809b639ea656 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:53.131135 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3157baeb-0041-4646-b8eb-809b639ea656 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:53.139095 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3157baeb-0041-4646-b8eb-809b639ea656 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.226289 May 28 21:25:53.139906 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2476/4901] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:52 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:53.156287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1d6773cc-552e-468e-9eeb-78c1e70e3873 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:53.156935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1d6773cc-552e-468e-9eeb-78c1e70e3873 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 0b166933-68b6-4fb8-a8f2-cf53f51ab325] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:53.162743 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-1d6773cc-552e-468e-9eeb-78c1e70e3873 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance 0b166933-68b6-4fb8-a8f2-cf53f51ab325 could not be found. May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1d6773cc-552e-468e-9eeb-78c1e70e3873 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/0b166933-68b6-4fb8-a8f2-cf53f51ab325/action HTTP/1.1 May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 15 May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: {"restore": {}} May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 0b166933-68b6-4fb8-a8f2-cf53f51ab325 could not be found. May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '0b166933-68b6-4fb8-a8f2-cf53f51ab325', 'body': {'restore': {}}} May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b166933-68b6-4fb8-a8f2-cf53f51ab325 could not be found. May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b166933-68b6-4fb8-a8f2-cf53f51ab325 could not be found. May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:53.167737 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:53.172636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:53.172636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:53.172636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b166933-68b6-4fb8-a8f2-cf53f51ab325 could not be found. May 28 21:25:53.172636 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:53.172636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1d6773cc-552e-468e-9eeb-78c1e70e3873 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance 0b166933-68b6-4fb8-a8f2-cf53f51ab325 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:53.172636 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1d6773cc-552e-468e-9eeb-78c1e70e3873 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/0b166933-68b6-4fb8-a8f2-cf53f51ab325/action" status: 404 len: 111 microversion: 2.1 time: 0.014551 May 28 21:25:53.172636 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2426/4902] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:53 2022] POST /compute/v2.1/servers/0b166933-68b6-4fb8-a8f2-cf53f51ab325/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:25:53.175085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7d7101cc-d1ae-45c8-92d5-885695fc8ab1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:53.175717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7d7101cc-d1ae-45c8-92d5-885695fc8ab1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:53.182597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d7101cc-d1ae-45c8-92d5-885695fc8ab1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:53.183084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d7101cc-d1ae-45c8-92d5-885695fc8ab1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:53.183872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d7101cc-d1ae-45c8-92d5-885695fc8ab1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:53.184314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d7101cc-d1ae-45c8-92d5-885695fc8ab1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:53.328871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7d7101cc-d1ae-45c8-92d5-885695fc8ab1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:53.343981 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7d7101cc-d1ae-45c8-92d5-885695fc8ab1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.168693 May 28 21:25:53.343981 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2477/4903] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:53 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:53.353583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d20e032b-d92c-48ce-8445-9aa6694e9381 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:53.354346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d20e032b-d92c-48ce-8445-9aa6694e9381 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:53.364434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d20e032b-d92c-48ce-8445-9aa6694e9381 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:53.364948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d20e032b-d92c-48ce-8445-9aa6694e9381 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:53.365739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d20e032b-d92c-48ce-8445-9aa6694e9381 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:53.366235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d20e032b-d92c-48ce-8445-9aa6694e9381 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:53.367518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ac3b56fe-a7ca-4657-b973-ded221ca11fe tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:53.377040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ac3b56fe-a7ca-4657-b973-ded221ca11fe tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:53.377190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac3b56fe-a7ca-4657-b973-ded221ca11fe tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:53.377899 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac3b56fe-a7ca-4657-b973-ded221ca11fe tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:53.379145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac3b56fe-a7ca-4657-b973-ded221ca11fe tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:53.379669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac3b56fe-a7ca-4657-b973-ded221ca11fe tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:53.578950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d20e032b-d92c-48ce-8445-9aa6694e9381 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:53.582612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ac3b56fe-a7ca-4657-b973-ded221ca11fe tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:53.587360 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d20e032b-d92c-48ce-8445-9aa6694e9381 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1391 microversion: 2.1 time: 0.238511 May 28 21:25:53.587942 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2427/4904] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:53 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1391 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:53.591709 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ac3b56fe-a7ca-4657-b973-ded221ca11fe tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.230821 May 28 21:25:53.602792 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2478/4905] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:53 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:53.609861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9f685c75-664c-4aad-895d-619c23dffb34 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:53.610473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9f685c75-664c-4aad-895d-619c23dffb34 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:53.617019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f685c75-664c-4aad-895d-619c23dffb34 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:53.617483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f685c75-664c-4aad-895d-619c23dffb34 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:53.618511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f685c75-664c-4aad-895d-619c23dffb34 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:53.618927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f685c75-664c-4aad-895d-619c23dffb34 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:53.642738 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-9f685c75-664c-4aad-895d-619c23dffb34 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Cannot 'restore' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9f685c75-664c-4aad-895d-619c23dffb34 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action HTTP/1.1 May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 15 May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: {"restore": {}} May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: exception: Cannot 'restore' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'a798306b-2df0-4ef0-b523-13a226b16120', 'body': {'restore': {}}} May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a798306b-2df0-4ef0-b523-13a226b16120 in vm_state active. Cannot restore while the instance is in this state. May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:53.644203 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:53.649596 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:53.649596 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:53.649596 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:53.649596 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:25:53.649596 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:53.649596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9f685c75-664c-4aad-895d-619c23dffb34 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 409 to user: Cannot 'restore' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:53.649596 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9f685c75-664c-4aad-895d-619c23dffb34 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action" status: 409 len: 145 microversion: 2.1 time: 0.039978 May 28 21:25:53.649596 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2428/4906] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:53 2022] POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action => generated 145 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:25:53.655784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-85965a3b-ac4e-46e4-baf4-3bf75dc568a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:53.659419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-85965a3b-ac4e-46e4-baf4-3bf75dc568a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:53.662905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85965a3b-ac4e-46e4-baf4-3bf75dc568a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:53.663547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85965a3b-ac4e-46e4-baf4-3bf75dc568a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:53.664492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85965a3b-ac4e-46e4-baf4-3bf75dc568a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:53.665019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85965a3b-ac4e-46e4-baf4-3bf75dc568a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:53.822030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-85965a3b-ac4e-46e4-baf4-3bf75dc568a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:53.830729 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-85965a3b-ac4e-46e4-baf4-3bf75dc568a9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.179284 May 28 21:25:53.831538 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2479/4907] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:53 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:53.848943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b29a5a43-8139-4d50-9bb1-92ffa309da1c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:53.849577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b29a5a43-8139-4d50-9bb1-92ffa309da1c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:53.871668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b29a5a43-8139-4d50-9bb1-92ffa309da1c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:53.872143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b29a5a43-8139-4d50-9bb1-92ffa309da1c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:53.873012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b29a5a43-8139-4d50-9bb1-92ffa309da1c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:53.873464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b29a5a43-8139-4d50-9bb1-92ffa309da1c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:53.926171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6f3e5a83-ea68-4fd6-a4f5-c4d1f6ccc3ce tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:53.927472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6f3e5a83-ea68-4fd6-a4f5-c4d1f6ccc3ce tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:53.944024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f3e5a83-ea68-4fd6-a4f5-c4d1f6ccc3ce tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:53.944753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f3e5a83-ea68-4fd6-a4f5-c4d1f6ccc3ce tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:53.946273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f3e5a83-ea68-4fd6-a4f5-c4d1f6ccc3ce tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:53.946876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f3e5a83-ea68-4fd6-a4f5-c4d1f6ccc3ce tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:54.077158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b29a5a43-8139-4d50-9bb1-92ffa309da1c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:54.086048 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b29a5a43-8139-4d50-9bb1-92ffa309da1c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.241102 May 28 21:25:54.086637 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2429/4908] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:53 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:54.106109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-57fd0f24-2e05-423b-9553-ec6e8e8a8c60 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:54.106669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-57fd0f24-2e05-423b-9553-ec6e8e8a8c60 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 96db68be-8f8d-4ef6-a152-9d5fb3aad258] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:54.115599 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-57fd0f24-2e05-423b-9553-ec6e8e8a8c60 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance 96db68be-8f8d-4ef6-a152-9d5fb3aad258 could not be found. May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-57fd0f24-2e05-423b-9553-ec6e8e8a8c60 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/96db68be-8f8d-4ef6-a152-9d5fb3aad258/action HTTP/1.1 May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 14 May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: {"resume": {}} May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 96db68be-8f8d-4ef6-a152-9d5fb3aad258 could not be found. May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '96db68be-8f8d-4ef6-a152-9d5fb3aad258', 'body': {'resume': {}}} May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96db68be-8f8d-4ef6-a152-9d5fb3aad258 could not be found. May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96db68be-8f8d-4ef6-a152-9d5fb3aad258 could not be found. May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:54.118180 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:54.123054 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:54.123054 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:54.123054 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96db68be-8f8d-4ef6-a152-9d5fb3aad258 could not be found. May 28 21:25:54.123054 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:54.126525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-57fd0f24-2e05-423b-9553-ec6e8e8a8c60 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance 96db68be-8f8d-4ef6-a152-9d5fb3aad258 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:54.127456 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-57fd0f24-2e05-423b-9553-ec6e8e8a8c60 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/96db68be-8f8d-4ef6-a152-9d5fb3aad258/action" status: 404 len: 111 microversion: 2.1 time: 0.025382 May 28 21:25:54.128287 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2430/4909] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:54 2022] POST /compute/v2.1/servers/96db68be-8f8d-4ef6-a152-9d5fb3aad258/action => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:25:54.138645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1114f323-03c3-4d6a-9e46-43fd284ad292 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:54.138857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1114f323-03c3-4d6a-9e46-43fd284ad292 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:54.147158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1114f323-03c3-4d6a-9e46-43fd284ad292 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:54.147567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1114f323-03c3-4d6a-9e46-43fd284ad292 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:54.148276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6f3e5a83-ea68-4fd6-a4f5-c4d1f6ccc3ce tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:54.148592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1114f323-03c3-4d6a-9e46-43fd284ad292 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:54.149172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1114f323-03c3-4d6a-9e46-43fd284ad292 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:54.166097 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6f3e5a83-ea68-4fd6-a4f5-c4d1f6ccc3ce tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 200 len: 1315 microversion: 2.1 time: 0.245368 May 28 21:25:54.176291 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2480/4910] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:53 2022] GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:54.308130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1114f323-03c3-4d6a-9e46-43fd284ad292 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:54.317597 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1114f323-03c3-4d6a-9e46-43fd284ad292 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.183715 May 28 21:25:54.318449 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2431/4911] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:54 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:54.335285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2aa6d507-e093-4e0b-9450-024ea738af8f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:54.336034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2aa6d507-e093-4e0b-9450-024ea738af8f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:54.342498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2aa6d507-e093-4e0b-9450-024ea738af8f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:54.343045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2aa6d507-e093-4e0b-9450-024ea738af8f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:54.347961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2aa6d507-e093-4e0b-9450-024ea738af8f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:54.353611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2aa6d507-e093-4e0b-9450-024ea738af8f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:54.529151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2aa6d507-e093-4e0b-9450-024ea738af8f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:54.537065 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2aa6d507-e093-4e0b-9450-024ea738af8f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.205703 May 28 21:25:54.537645 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2481/4912] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:54 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:54.566239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3bd5c3ab-6de9-42b1-abd3-e5cec5abdc1b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:54.566239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3bd5c3ab-6de9-42b1-abd3-e5cec5abdc1b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:54.582437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3bd5c3ab-6de9-42b1-abd3-e5cec5abdc1b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:54.582912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3bd5c3ab-6de9-42b1-abd3-e5cec5abdc1b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:54.583793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3bd5c3ab-6de9-42b1-abd3-e5cec5abdc1b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:54.584670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3bd5c3ab-6de9-42b1-abd3-e5cec5abdc1b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:54.589793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:54.604856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d22f3d2f-69f2-4ce2-9ee1-10e95fc9aea5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:54.605658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d22f3d2f-69f2-4ce2-9ee1-10e95fc9aea5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:54.618323 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-3bd5c3ab-6de9-42b1-abd3-e5cec5abdc1b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Cannot 'resume' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:25:54.618826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d22f3d2f-69f2-4ce2-9ee1-10e95fc9aea5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:54.619136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d22f3d2f-69f2-4ce2-9ee1-10e95fc9aea5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:54.620213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d22f3d2f-69f2-4ce2-9ee1-10e95fc9aea5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3bd5c3ab-6de9-42b1-abd3-e5cec5abdc1b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action HTTP/1.1 May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 14 May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: {"resume": {}} May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: exception: Cannot 'resume' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'a798306b-2df0-4ef0-b523-13a226b16120', 'body': {'resume': {}}} May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a798306b-2df0-4ef0-b523-13a226b16120 in vm_state active. Cannot resume while the instance is in this state. May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:54.620952 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:54.625047 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:54.625047 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:54.625047 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:54.625047 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:25:54.625047 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:54.625406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d22f3d2f-69f2-4ce2-9ee1-10e95fc9aea5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:54.625530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3bd5c3ab-6de9-42b1-abd3-e5cec5abdc1b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 409 to user: Cannot 'resume' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:54.625530 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3bd5c3ab-6de9-42b1-abd3-e5cec5abdc1b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action" status: 409 len: 144 microversion: 2.1 time: 0.066444 May 28 21:25:54.625530 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2432/4913] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:54 2022] POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action => generated 144 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 28 21:25:54.633638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-781ccc0f-0e23-470c-92a1-78d8f42fc503 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:54.634300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-781ccc0f-0e23-470c-92a1-78d8f42fc503 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:54.641768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-781ccc0f-0e23-470c-92a1-78d8f42fc503 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:54.642270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-781ccc0f-0e23-470c-92a1-78d8f42fc503 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:54.643052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-781ccc0f-0e23-470c-92a1-78d8f42fc503 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:54.643505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-781ccc0f-0e23-470c-92a1-78d8f42fc503 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:54.833584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d22f3d2f-69f2-4ce2-9ee1-10e95fc9aea5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:54.844823 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d22f3d2f-69f2-4ce2-9ee1-10e95fc9aea5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1563 microversion: 2.1 time: 0.244177 May 28 21:25:54.845438 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2482/4914] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:54 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1563 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:54.870426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-781ccc0f-0e23-470c-92a1-78d8f42fc503 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:54.875954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aee135f1-e413-46b0-981c-d23618945db9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:54.893828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aee135f1-e413-46b0-981c-d23618945db9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:54.895056 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-781ccc0f-0e23-470c-92a1-78d8f42fc503 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.252316 May 28 21:25:54.895056 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2433/4915] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:54 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:54.905048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aee135f1-e413-46b0-981c-d23618945db9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:54.905770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aee135f1-e413-46b0-981c-d23618945db9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:54.906996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aee135f1-e413-46b0-981c-d23618945db9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:54.907760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aee135f1-e413-46b0-981c-d23618945db9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:54.917373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-20eb1e5c-190f-435b-b136-c0b21b5168ea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:54.918796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-20eb1e5c-190f-435b-b136-c0b21b5168ea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:54.934771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20eb1e5c-190f-435b-b136-c0b21b5168ea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:54.935459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20eb1e5c-190f-435b-b136-c0b21b5168ea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:54.938251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20eb1e5c-190f-435b-b136-c0b21b5168ea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:54.939079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20eb1e5c-190f-435b-b136-c0b21b5168ea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:55.085068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:55.109141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=14 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:55.541872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aee135f1-e413-46b0-981c-d23618945db9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:55.552990 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aee135f1-e413-46b0-981c-d23618945db9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1563 microversion: 2.1 time: 0.690184 May 28 21:25:55.553594 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2483/4916] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:54 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1563 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:55.564767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-20eb1e5c-190f-435b-b136-c0b21b5168ea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:55.570425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6d00d532-4f0a-46c3-b811-a37922c9af04 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:55.586212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6d00d532-4f0a-46c3-b811-a37922c9af04 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:55.586515 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-20eb1e5c-190f-435b-b136-c0b21b5168ea tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.671242 May 28 21:25:55.586515 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2434/4917] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:54 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:55.586694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d00d532-4f0a-46c3-b811-a37922c9af04 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:55.587075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d00d532-4f0a-46c3-b811-a37922c9af04 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:55.588335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d00d532-4f0a-46c3-b811-a37922c9af04 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:55.589023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d00d532-4f0a-46c3-b811-a37922c9af04 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:55.705786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-71dcb0b1-88e8-4a61-950a-c6ad126e3308 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-71dcb0b1-88e8-4a61-950a-c6ad126e3308 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers HTTP/1.1 May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 160 May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: {"server": {"name": "", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "3a3043e0-048b-4e2b-ab77-16b78a2870c5"}]}} May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid input for field/attribute name. Value: . '' is too short May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'body': {'server': {'name': '', 'imageRef': '9586d0d3-c540-4636-bb36-06bb4b16c195', 'flavorRef': '452', 'networks': [{'uuid': '3a3043e0-048b-4e2b-ab77-16b78a2870c5'}]}}} May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise error May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi '' May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:25:55.708880 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:25:55.714212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:25:55.714212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 28 21:25:55.714212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:55.714212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:55.714212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:55.714212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:55.714212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:55.714212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:55.714212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:25:55.714212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:25:55.714212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 28 21:25:55.714212 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:55.723940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-71dcb0b1-88e8-4a61-950a-c6ad126e3308 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:55.724707 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-71dcb0b1-88e8-4a61-950a-c6ad126e3308 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.023447 May 28 21:25:55.725330 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2435/4918] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:25:55 2022] POST /compute/v2.1/servers => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 21:25:55.735842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-325ef612-2bed-4d68-9003-5d00358305a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:55.736910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-325ef612-2bed-4d68-9003-5d00358305a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:55.749291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6d00d532-4f0a-46c3-b811-a37922c9af04 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:55.749512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-325ef612-2bed-4d68-9003-5d00358305a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:55.749512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-325ef612-2bed-4d68-9003-5d00358305a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:55.749512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-325ef612-2bed-4d68-9003-5d00358305a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:55.749512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-325ef612-2bed-4d68-9003-5d00358305a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:55.754278 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6d00d532-4f0a-46c3-b811-a37922c9af04 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 200 len: 1315 microversion: 2.1 time: 0.187731 May 28 21:25:55.755119 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2484/4919] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:55 2022] GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:55.902721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-325ef612-2bed-4d68-9003-5d00358305a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:55.910935 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-325ef612-2bed-4d68-9003-5d00358305a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.180455 May 28 21:25:55.912507 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2436/4920] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:55 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:55.929486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-24d5717b-1aaa-40d9-b75c-8319a38551c8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:55.930224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-24d5717b-1aaa-40d9-b75c-8319a38551c8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:55.938507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24d5717b-1aaa-40d9-b75c-8319a38551c8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:55.938977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24d5717b-1aaa-40d9-b75c-8319a38551c8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:55.939825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24d5717b-1aaa-40d9-b75c-8319a38551c8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:55.940467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-24d5717b-1aaa-40d9-b75c-8319a38551c8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:56.016969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a55f6aa6-cc84-4b68-be1d-6ee7fa909c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:56.017893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a55f6aa6-cc84-4b68-be1d-6ee7fa909c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:56.036561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a55f6aa6-cc84-4b68-be1d-6ee7fa909c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:56.042942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a55f6aa6-cc84-4b68-be1d-6ee7fa909c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:56.042942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a55f6aa6-cc84-4b68-be1d-6ee7fa909c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:56.042942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a55f6aa6-cc84-4b68-be1d-6ee7fa909c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-a55f6aa6-cc84-4b68-be1d-6ee7fa909c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] HTTP exception thrown: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a55f6aa6-cc84-4b68-be1d-6ee7fa909c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Request method failure captured: May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b HTTP/1.1 May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpHgQsHrY8-tq6Lwhk_kgt3Xn4L_MidLfd6t6e1kt_vBLOS7gz_CdRphRZe8jlNCfAjP4WEQVlYKxEr43W08fmlIXyzbk2DCiVB54W72qgC2txvk8K6J5cHEGo02tw5b8QBHyCk2dla8Zm2cYLbHUihbqsiMTPUFEU0q9nplGTe2zlo May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Openstack-Nova-Api-Version: 2.20 May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5a8841fa441d413a92a15510a9d082c6 May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a8841fa441d413a92a15510a9d082c6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5a8841fa441d413a92a15510a9d082c6 May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AttachVolumeShelveTestJSON-1592071011-project May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 857a887b6c7c41588afb2845eed6f309 May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1592071011-project May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'cd20dd19-f26b-4e32-9114-715558d5aa3b'} May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:25:56.073657 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a55f6aa6-cc84-4b68-be1d-6ee7fa909c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Returning 404 to user: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a55f6aa6-cc84-4b68-be1d-6ee7fa909c18 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "DELETE /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 404 len: 111 microversion: 2.20 time: 0.056148 May 28 21:25:56.077921 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2437/4921] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:25:56 2022] DELETE /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:25:56.080265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f2bc6cea-4411-4681-8e93-b010a0b6a12a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:56.083608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f2bc6cea-4411-4681-8e93-b010a0b6a12a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: cd20dd19-f26b-4e32-9114-715558d5aa3b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:56.091865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2bc6cea-4411-4681-8e93-b010a0b6a12a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:56.093895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2bc6cea-4411-4681-8e93-b010a0b6a12a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:56.097618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2bc6cea-4411-4681-8e93-b010a0b6a12a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:56.097618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2bc6cea-4411-4681-8e93-b010a0b6a12a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:56.114605 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-f2bc6cea-4411-4681-8e93-b010a0b6a12a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] HTTP exception thrown: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f2bc6cea-4411-4681-8e93-b010a0b6a12a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Request method failure captured: May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b HTTP/1.1 May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpHgQsHrY8-tq6Lwhk_kgt3Xn4L_MidLfd6t6e1kt_vBLOS7gz_CdRphRZe8jlNCfAjP4WEQVlYKxEr43W08fmlIXyzbk2DCiVB54W72qgC2txvk8K6J5cHEGo02tw5b8QBHyCk2dla8Zm2cYLbHUihbqsiMTPUFEU0q9nplGTe2zlo May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Openstack-Nova-Api-Version: 2.20 May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5a8841fa441d413a92a15510a9d082c6 May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a8841fa441d413a92a15510a9d082c6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5a8841fa441d413a92a15510a9d082c6 May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AttachVolumeShelveTestJSON-1592071011-project May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 857a887b6c7c41588afb2845eed6f309 May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1592071011-project May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'cd20dd19-f26b-4e32-9114-715558d5aa3b'} May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:56.118141 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:56.129613 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:56.129613 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:56.129613 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:56.129613 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:56.129613 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:56.129613 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:56.129613 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. May 28 21:25:56.129613 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:56.129613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f2bc6cea-4411-4681-8e93-b010a0b6a12a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Returning 404 to user: Instance cd20dd19-f26b-4e32-9114-715558d5aa3b could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:56.129613 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f2bc6cea-4411-4681-8e93-b010a0b6a12a tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b" status: 404 len: 111 microversion: 2.20 time: 0.044385 May 28 21:25:56.129613 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2438/4922] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:25:56 2022] GET /compute/v2.1/servers/cd20dd19-f26b-4e32-9114-715558d5aa3b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:25:56.132115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-24d5717b-1aaa-40d9-b75c-8319a38551c8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:56.146985 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-24d5717b-1aaa-40d9-b75c-8319a38551c8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.221922 May 28 21:25:56.151314 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2485/4923] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:55 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:56.167239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-78fed8ea-e1da-4bf3-84b0-43affc1557ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:56.167779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-78fed8ea-e1da-4bf3-84b0-43affc1557ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: ac0b2f3d-06b6-4bfd-a8e2-92a2fb88b8cb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:56.183432 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-78fed8ea-e1da-4bf3-84b0-43affc1557ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance ac0b2f3d-06b6-4bfd-a8e2-92a2fb88b8cb could not be found. May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-78fed8ea-e1da-4bf3-84b0-43affc1557ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/ac0b2f3d-06b6-4bfd-a8e2-92a2fb88b8cb/action HTTP/1.1 May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 14 May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: {"shelve": {}} May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance ac0b2f3d-06b6-4bfd-a8e2-92a2fb88b8cb could not be found. May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ac0b2f3d-06b6-4bfd-a8e2-92a2fb88b8cb', 'body': {'shelve': {}}} May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac0b2f3d-06b6-4bfd-a8e2-92a2fb88b8cb could not be found. May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac0b2f3d-06b6-4bfd-a8e2-92a2fb88b8cb could not be found. May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:25:56.186003 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:25:56.190873 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:25:56.190873 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:25:56.190873 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac0b2f3d-06b6-4bfd-a8e2-92a2fb88b8cb could not be found. May 28 21:25:56.190873 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:25:56.190873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-78fed8ea-e1da-4bf3-84b0-43affc1557ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance ac0b2f3d-06b6-4bfd-a8e2-92a2fb88b8cb could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:25:56.191688 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-78fed8ea-e1da-4bf3-84b0-43affc1557ba tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/ac0b2f3d-06b6-4bfd-a8e2-92a2fb88b8cb/action" status: 404 len: 111 microversion: 2.1 time: 0.028359 May 28 21:25:56.194196 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2439/4924] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:56 2022] POST /compute/v2.1/servers/ac0b2f3d-06b6-4bfd-a8e2-92a2fb88b8cb/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:25:56.201720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-54781d81-397f-41cb-af93-dfd96ada6f1e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:56.202527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-54781d81-397f-41cb-af93-dfd96ada6f1e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:56.220635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54781d81-397f-41cb-af93-dfd96ada6f1e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:56.221224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54781d81-397f-41cb-af93-dfd96ada6f1e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:56.223286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54781d81-397f-41cb-af93-dfd96ada6f1e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:56.223991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54781d81-397f-41cb-af93-dfd96ada6f1e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:56.267626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:56.450134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-54781d81-397f-41cb-af93-dfd96ada6f1e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:56.461616 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-54781d81-397f-41cb-af93-dfd96ada6f1e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.263962 May 28 21:25:56.464258 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2486/4925] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:56 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:56.478712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:25:56.486452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-77e617e1-c8a0-4764-a966-cb301b10dad1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:56.487412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-77e617e1-c8a0-4764-a966-cb301b10dad1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:56.501419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77e617e1-c8a0-4764-a966-cb301b10dad1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:56.501419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77e617e1-c8a0-4764-a966-cb301b10dad1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:56.501419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77e617e1-c8a0-4764-a966-cb301b10dad1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:56.501419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77e617e1-c8a0-4764-a966-cb301b10dad1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:56.664260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-77e617e1-c8a0-4764-a966-cb301b10dad1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:56.671985 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-77e617e1-c8a0-4764-a966-cb301b10dad1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.196630 May 28 21:25:56.672590 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2440/4926] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:56 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:56.689294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-93baa84b-7ca6-4907-a6fd-601b2925ffa8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:56.689865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-93baa84b-7ca6-4907-a6fd-601b2925ffa8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:56.697081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93baa84b-7ca6-4907-a6fd-601b2925ffa8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:56.697551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93baa84b-7ca6-4907-a6fd-601b2925ffa8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:56.698377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93baa84b-7ca6-4907-a6fd-601b2925ffa8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:56.698833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93baa84b-7ca6-4907-a6fd-601b2925ffa8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:56.723477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-93baa84b-7ca6-4907-a6fd-601b2925ffa8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lazy-loading 'flavor' on Instance uuid a798306b-2df0-4ef0-b523-13a226b16120 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:25:56.775186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f2290797-c433-4140-8135-6bd3ee6f3911 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:56.775186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f2290797-c433-4140-8135-6bd3ee6f3911 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:56.778378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2290797-c433-4140-8135-6bd3ee6f3911 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:56.779004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2290797-c433-4140-8135-6bd3ee6f3911 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:56.780396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2290797-c433-4140-8135-6bd3ee6f3911 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:56.780851 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f2290797-c433-4140-8135-6bd3ee6f3911 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:56.952036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f2290797-c433-4140-8135-6bd3ee6f3911 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:56.961666 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f2290797-c433-4140-8135-6bd3ee6f3911 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 200 len: 1315 microversion: 2.1 time: 0.194572 May 28 21:25:56.962749 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2441/4927] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:56 2022] GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:57.033263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-23d25ac4-7e07-4241-99bf-834e363d17bc req-2a2afa25-fc83-4bda-b19e-b1875353ce72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81204693-bc12-463e-8061-230ebcdc0fbe", "name": "network-vif-plugged", "status": "completed", "tag": "68f3980c-6620-4c6d-bb97-8053a73c38ff"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:57.042513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-23d25ac4-7e07-4241-99bf-834e363d17bc req-2a2afa25-fc83-4bda-b19e-b1875353ce72 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:57.042973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-23d25ac4-7e07-4241-99bf-834e363d17bc req-2a2afa25-fc83-4bda-b19e-b1875353ce72 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:57.056110 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-23d25ac4-7e07-4241-99bf-834e363d17bc req-2a2afa25-fc83-4bda-b19e-b1875353ce72 service nova] Creating event network-vif-plugged:68f3980c-6620-4c6d-bb97-8053a73c38ff for instance 81204693-bc12-463e-8061-230ebcdc0fbe on nch1-master-1 May 28 21:25:57.060968 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-23d25ac4-7e07-4241-99bf-834e363d17bc req-2a2afa25-fc83-4bda-b19e-b1875353ce72 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031612 May 28 21:25:57.061575 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2442/4928] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:25:57.463191 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-93baa84b-7ca6-4907-a6fd-601b2925ffa8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action" status: 202 len: 0 microversion: 2.1 time: 0.774455 May 28 21:25:57.463191 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2487/4929] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:56 2022] POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action => generated 0 bytes in 777 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:25:57.470768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f54173a0-4d71-44ef-b815-334efb30d42d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:57.471491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f54173a0-4d71-44ef-b815-334efb30d42d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:57.485499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f54173a0-4d71-44ef-b815-334efb30d42d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:57.485499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f54173a0-4d71-44ef-b815-334efb30d42d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:57.485499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f54173a0-4d71-44ef-b815-334efb30d42d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:57.485499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f54173a0-4d71-44ef-b815-334efb30d42d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:57.654633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f54173a0-4d71-44ef-b815-334efb30d42d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:57.667712 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f54173a0-4d71-44ef-b815-334efb30d42d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.201203 May 28 21:25:57.668303 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2443/4930] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:57 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:57.979889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2076da9a-7fa1-4128-abae-9cbf5b250f39 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:57.981161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2076da9a-7fa1-4128-abae-9cbf5b250f39 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:57.989000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2076da9a-7fa1-4128-abae-9cbf5b250f39 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:57.989459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2076da9a-7fa1-4128-abae-9cbf5b250f39 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:57.990278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2076da9a-7fa1-4128-abae-9cbf5b250f39 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:57.991031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2076da9a-7fa1-4128-abae-9cbf5b250f39 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:58.175880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2076da9a-7fa1-4128-abae-9cbf5b250f39 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:58.184702 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2076da9a-7fa1-4128-abae-9cbf5b250f39 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 200 len: 1315 microversion: 2.1 time: 0.209129 May 28 21:25:58.185279 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2488/4931] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:57 2022] GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:58.465636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9a613c8b-b034-4f3c-8b77-44397e26c2b0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:58.466296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9a613c8b-b034-4f3c-8b77-44397e26c2b0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:58.470786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-49110e1b-6614-4efd-b925-68bea5c3eda0 req-80238f81-c418-47a6-b5bc-5189ec468c86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d38a270e-eebf-4adc-93a3-e4a5bac81ee2", "tag": "b5a42f07-fe9d-45f6-9f24-d15afa18b370"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:58.481903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a613c8b-b034-4f3c-8b77-44397e26c2b0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:58.486898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a613c8b-b034-4f3c-8b77-44397e26c2b0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:58.486898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a613c8b-b034-4f3c-8b77-44397e26c2b0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:58.486898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9a613c8b-b034-4f3c-8b77-44397e26c2b0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:58.493820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-49110e1b-6614-4efd-b925-68bea5c3eda0 req-80238f81-c418-47a6-b5bc-5189ec468c86 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:58.494327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-49110e1b-6614-4efd-b925-68bea5c3eda0 req-80238f81-c418-47a6-b5bc-5189ec468c86 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:58.526529 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-49110e1b-6614-4efd-b925-68bea5c3eda0 req-80238f81-c418-47a6-b5bc-5189ec468c86 service nova] Creating event network-changed:b5a42f07-fe9d-45f6-9f24-d15afa18b370 for instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 on nch2-master-1 May 28 21:25:58.538655 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-49110e1b-6614-4efd-b925-68bea5c3eda0 req-80238f81-c418-47a6-b5bc-5189ec468c86 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071643 May 28 21:25:58.560048 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2489/4932] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:25:58.691335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-da117be0-a57b-4ad6-812c-68f18d724b17 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:58.692174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-da117be0-a57b-4ad6-812c-68f18d724b17 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:58.701156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da117be0-a57b-4ad6-812c-68f18d724b17 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:58.701710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da117be0-a57b-4ad6-812c-68f18d724b17 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:58.702598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da117be0-a57b-4ad6-812c-68f18d724b17 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:58.703305 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da117be0-a57b-4ad6-812c-68f18d724b17 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:58.933601 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9a613c8b-b034-4f3c-8b77-44397e26c2b0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:58.945882 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9a613c8b-b034-4f3c-8b77-44397e26c2b0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1563 microversion: 2.1 time: 0.483638 May 28 21:25:58.946446 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2444/4933] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:58 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1563 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:25:59.061530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-da117be0-a57b-4ad6-812c-68f18d724b17 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:59.079410 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-da117be0-a57b-4ad6-812c-68f18d724b17 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.396195 May 28 21:25:59.079997 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2490/4934] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:58 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:59.203119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5f0e2b17-5d25-48a2-b6c3-dbf08a4b4c87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:25:59.204011 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5f0e2b17-5d25-48a2-b6c3-dbf08a4b4c87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:59.212974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f0e2b17-5d25-48a2-b6c3-dbf08a4b4c87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:59.213945 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f0e2b17-5d25-48a2-b6c3-dbf08a4b4c87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:59.215198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f0e2b17-5d25-48a2-b6c3-dbf08a4b4c87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:59.215919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f0e2b17-5d25-48a2-b6c3-dbf08a4b4c87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:59.562524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5f0e2b17-5d25-48a2-b6c3-dbf08a4b4c87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:25:59.578621 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5f0e2b17-5d25-48a2-b6c3-dbf08a4b4c87 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 200 len: 1503 microversion: 2.1 time: 0.380154 May 28 21:25:59.579216 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2445/4935] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:25:59 2022] GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 1503 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:25:59.599682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3d9e76ae-47ba-4695-8c90-c8c755002627 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:25:59.603292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3d9e76ae-47ba-4695-8c90-c8c755002627 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:25:59.620010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d9e76ae-47ba-4695-8c90-c8c755002627 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:59.621521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d9e76ae-47ba-4695-8c90-c8c755002627 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:59.622543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d9e76ae-47ba-4695-8c90-c8c755002627 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:25:59.623279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d9e76ae-47ba-4695-8c90-c8c755002627 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:25:59.712820 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3d9e76ae-47ba-4695-8c90-c8c755002627 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action" status: 200 len: 14 microversion: 2.1 time: 0.121040 May 28 21:25:59.715517 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2491/4936] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:25:59 2022] POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:26:00.098951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-01a5a4fa-56f8-41b4-b874-b285a9e629d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:00.099695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-01a5a4fa-56f8-41b4-b874-b285a9e629d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:00.107066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01a5a4fa-56f8-41b4-b874-b285a9e629d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:00.107521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01a5a4fa-56f8-41b4-b874-b285a9e629d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:00.108386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01a5a4fa-56f8-41b4-b874-b285a9e629d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:00.108730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01a5a4fa-56f8-41b4-b874-b285a9e629d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:00.325361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-01a5a4fa-56f8-41b4-b874-b285a9e629d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:00.333142 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-01a5a4fa-56f8-41b4-b874-b285a9e629d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.239646 May 28 21:26:00.333722 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2446/4937] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:00 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:00.705474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0a89c4c2-3c33-46a1-9640-fcaf4f2ac015 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:00.706107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0a89c4c2-3c33-46a1-9640-fcaf4f2ac015 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:00.714852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a89c4c2-3c33-46a1-9640-fcaf4f2ac015 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:00.715320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a89c4c2-3c33-46a1-9640-fcaf4f2ac015 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:00.716284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a89c4c2-3c33-46a1-9640-fcaf4f2ac015 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:00.717223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a89c4c2-3c33-46a1-9640-fcaf4f2ac015 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:00.726390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-902722f5-5aeb-4b34-a469-f50e9ce3875c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:00.727552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-902722f5-5aeb-4b34-a469-f50e9ce3875c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:00.733070 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-0a89c4c2-3c33-46a1-9640-fcaf4f2ac015 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] HTTP exception thrown: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. May 28 21:26:00.734853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-902722f5-5aeb-4b34-a469-f50e9ce3875c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0a89c4c2-3c33-46a1-9640-fcaf4f2ac015 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Request method failure captured: May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 HTTP/1.1 May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpHgQsHrY8-tq6Lwhk_kgt3Xn4L_MidLfd6t6e1kt_vBLOS7gz_CdRphRZe8jlNCfAjP4WEQVlYKxEr43W08fmlIXyzbk2DCiVB54W72qgC2txvk8K6J5cHEGo02tw5b8QBHyCk2dla8Zm2cYLbHUihbqsiMTPUFEU0q9nplGTe2zlo May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Openstack-Nova-Api-Version: 2.20 May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5a8841fa441d413a92a15510a9d082c6 May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a8841fa441d413a92a15510a9d082c6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5a8841fa441d413a92a15510a9d082c6 May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AttachVolumeShelveTestJSON-1592071011-project May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 857a887b6c7c41588afb2845eed6f309 May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1592071011-project May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '6232e7b0-68db-43d6-a836-fb2f96c54658'} May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:26:00.734981 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:26:00.741290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. May 28 21:26:00.741290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:26:00.741290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:26:00.741290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:26:00.741290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:26:00.741290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:26:00.741290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:26:00.741290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:26:00.741290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:26:00.741290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. May 28 21:26:00.741290 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:26:00.743312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-902722f5-5aeb-4b34-a469-f50e9ce3875c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:00.743473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0a89c4c2-3c33-46a1-9640-fcaf4f2ac015 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Returning 404 to user: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:26:00.743621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-902722f5-5aeb-4b34-a469-f50e9ce3875c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:00.743760 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0a89c4c2-3c33-46a1-9640-fcaf4f2ac015 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 404 len: 111 microversion: 2.20 time: 0.035478 May 28 21:26:00.743979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-902722f5-5aeb-4b34-a469-f50e9ce3875c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:00.744156 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2492/4938] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:26:00 2022] DELETE /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 28 21:26:00.750100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8a85cfc3-7def-45c0-acbb-4f1b883fa441 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:00.750725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8a85cfc3-7def-45c0-acbb-4f1b883fa441 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] [instance: 6232e7b0-68db-43d6-a836-fb2f96c54658] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:00.768568 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8a85cfc3-7def-45c0-acbb-4f1b883fa441 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:00.770191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8a85cfc3-7def-45c0-acbb-4f1b883fa441 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:00.771675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8a85cfc3-7def-45c0-acbb-4f1b883fa441 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:00.775412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8a85cfc3-7def-45c0-acbb-4f1b883fa441 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:00.787858 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-902722f5-5aeb-4b34-a469-f50e9ce3875c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action" status: 200 len: 14 microversion: 2.1 time: 0.066539 May 28 21:26:00.789877 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2447/4939] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:00 2022] POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 21:26:00.799294 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-8a85cfc3-7def-45c0-acbb-4f1b883fa441 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] HTTP exception thrown: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8a85cfc3-7def-45c0-acbb-4f1b883fa441 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Request method failure captured: May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 HTTP/1.1 May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpHgQsHrY8-tq6Lwhk_kgt3Xn4L_MidLfd6t6e1kt_vBLOS7gz_CdRphRZe8jlNCfAjP4WEQVlYKxEr43W08fmlIXyzbk2DCiVB54W72qgC2txvk8K6J5cHEGo02tw5b8QBHyCk2dla8Zm2cYLbHUihbqsiMTPUFEU0q9nplGTe2zlo May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Openstack-Nova-Api-Version: 2.20 May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5a8841fa441d413a92a15510a9d082c6 May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a8841fa441d413a92a15510a9d082c6", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a8841fa441d413a92a15510a9d082c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5a8841fa441d413a92a15510a9d082c6 May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1592071011 May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AttachVolumeShelveTestJSON-1592071011-project May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 857a887b6c7c41588afb2845eed6f309 May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1592071011-project May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '6232e7b0-68db-43d6-a836-fb2f96c54658'} May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:26:00.801232 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:26:00.811120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:26:00.811120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:26:00.811120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:26:00.811120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:26:00.811120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:26:00.811120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:26:00.811120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. May 28 21:26:00.811120 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:26:00.811120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8a85cfc3-7def-45c0-acbb-4f1b883fa441 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] Returning 404 to user: Instance 6232e7b0-68db-43d6-a836-fb2f96c54658 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:26:00.811120 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8a85cfc3-7def-45c0-acbb-4f1b883fa441 tempest-AttachVolumeShelveTestJSON-1592071011 tempest-AttachVolumeShelveTestJSON-1592071011-project] 10.222.0.33 "GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658" status: 404 len: 111 microversion: 2.20 time: 0.056768 May 28 21:26:00.811120 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2493/4940] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:26:00 2022] GET /compute/v2.1/servers/6232e7b0-68db-43d6-a836-fb2f96c54658 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 28 21:26:01.354816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0e53d5f5-14de-4fb3-a024-0389c37ed882 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:01.355838 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0e53d5f5-14de-4fb3-a024-0389c37ed882 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:01.365593 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0e53d5f5-14de-4fb3-a024-0389c37ed882 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:01.369322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0e53d5f5-14de-4fb3-a024-0389c37ed882 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:01.371233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0e53d5f5-14de-4fb3-a024-0389c37ed882 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:01.372201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0e53d5f5-14de-4fb3-a024-0389c37ed882 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:01.559299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0e53d5f5-14de-4fb3-a024-0389c37ed882 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:01.567548 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0e53d5f5-14de-4fb3-a024-0389c37ed882 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.220328 May 28 21:26:01.568666 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2448/4941] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:01 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:01.802288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2af79f65-8b87-4aed-baa1-6963e464f04e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:01.806700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2af79f65-8b87-4aed-baa1-6963e464f04e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:01.815595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2af79f65-8b87-4aed-baa1-6963e464f04e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:01.816070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2af79f65-8b87-4aed-baa1-6963e464f04e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:01.816857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2af79f65-8b87-4aed-baa1-6963e464f04e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:01.817307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2af79f65-8b87-4aed-baa1-6963e464f04e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:01.868517 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2af79f65-8b87-4aed-baa1-6963e464f04e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action" status: 200 len: 14 microversion: 2.1 time: 0.073946 May 28 21:26:01.871915 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2494/4942] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:01 2022] POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:26:02.586662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d9115b96-7e83-4189-a227-9b49ae42e010 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:02.586662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d9115b96-7e83-4189-a227-9b49ae42e010 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:02.597409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9115b96-7e83-4189-a227-9b49ae42e010 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:02.603393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9115b96-7e83-4189-a227-9b49ae42e010 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:02.604690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9115b96-7e83-4189-a227-9b49ae42e010 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:02.605323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9115b96-7e83-4189-a227-9b49ae42e010 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:02.880292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ec9c6209-595c-49b2-bfa4-30e59e3ca005 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:02.881563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ec9c6209-595c-49b2-bfa4-30e59e3ca005 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:02.888706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d9115b96-7e83-4189-a227-9b49ae42e010 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:02.892329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec9c6209-595c-49b2-bfa4-30e59e3ca005 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:02.892801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec9c6209-595c-49b2-bfa4-30e59e3ca005 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:02.893594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec9c6209-595c-49b2-bfa4-30e59e3ca005 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:02.894077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec9c6209-595c-49b2-bfa4-30e59e3ca005 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:02.898920 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d9115b96-7e83-4189-a227-9b49ae42e010 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.318174 May 28 21:26:02.901389 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2449/4943] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:02 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:02.937256 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ec9c6209-595c-49b2-bfa4-30e59e3ca005 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action" status: 200 len: 14 microversion: 2.1 time: 0.061127 May 28 21:26:02.938688 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2495/4944] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:02 2022] POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:26:03.917437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1b6e3db0-b2d2-4d61-8633-715070e2d68a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:03.917437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1b6e3db0-b2d2-4d61-8633-715070e2d68a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:03.927563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b6e3db0-b2d2-4d61-8633-715070e2d68a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:03.930458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b6e3db0-b2d2-4d61-8633-715070e2d68a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:03.932228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b6e3db0-b2d2-4d61-8633-715070e2d68a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:03.933449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b6e3db0-b2d2-4d61-8633-715070e2d68a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:03.951007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c8e0920d-397c-44c2-8033-51a1812aca72 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:03.952031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c8e0920d-397c-44c2-8033-51a1812aca72 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:03.960119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8e0920d-397c-44c2-8033-51a1812aca72 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:03.961069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8e0920d-397c-44c2-8033-51a1812aca72 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:03.962055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8e0920d-397c-44c2-8033-51a1812aca72 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:03.962668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8e0920d-397c-44c2-8033-51a1812aca72 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:04.004053 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c8e0920d-397c-44c2-8033-51a1812aca72 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action" status: 200 len: 14 microversion: 2.1 time: 0.058574 May 28 21:26:04.005000 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2496/4945] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:03 2022] POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:26:04.139738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1b6e3db0-b2d2-4d61-8633-715070e2d68a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:04.158662 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1b6e3db0-b2d2-4d61-8633-715070e2d68a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.246466 May 28 21:26:04.159277 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2450/4946] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:03 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:05.016533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d63add90-08fc-43d9-92b6-33726754f39d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:05.018699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d63add90-08fc-43d9-92b6-33726754f39d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:05.021610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:26:05.027396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d63add90-08fc-43d9-92b6-33726754f39d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:05.027866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d63add90-08fc-43d9-92b6-33726754f39d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:05.028974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d63add90-08fc-43d9-92b6-33726754f39d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:05.029435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d63add90-08fc-43d9-92b6-33726754f39d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:05.074908 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d63add90-08fc-43d9-92b6-33726754f39d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action" status: 200 len: 14 microversion: 2.1 time: 0.062353 May 28 21:26:05.076943 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2497/4947] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:05 2022] POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:26:05.178398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4f6086bb-6aaa-4dc5-aaba-ed07c4ea4047 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:05.182624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4f6086bb-6aaa-4dc5-aaba-ed07c4ea4047 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:05.193934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f6086bb-6aaa-4dc5-aaba-ed07c4ea4047 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:05.194399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f6086bb-6aaa-4dc5-aaba-ed07c4ea4047 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:05.195255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f6086bb-6aaa-4dc5-aaba-ed07c4ea4047 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:05.195685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f6086bb-6aaa-4dc5-aaba-ed07c4ea4047 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:05.406834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4f6086bb-6aaa-4dc5-aaba-ed07c4ea4047 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:05.415237 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4f6086bb-6aaa-4dc5-aaba-ed07c4ea4047 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.242770 May 28 21:26:05.432103 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2451/4948] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:05 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:06.086636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-64ef2871-25cf-49a7-b854-9ba3016bb3bb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:06.087662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-64ef2871-25cf-49a7-b854-9ba3016bb3bb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:06.095880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64ef2871-25cf-49a7-b854-9ba3016bb3bb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:06.096344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64ef2871-25cf-49a7-b854-9ba3016bb3bb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:06.097391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64ef2871-25cf-49a7-b854-9ba3016bb3bb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:06.097861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64ef2871-25cf-49a7-b854-9ba3016bb3bb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:06.135588 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-64ef2871-25cf-49a7-b854-9ba3016bb3bb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action" status: 200 len: 14 microversion: 2.1 time: 0.053500 May 28 21:26:06.136835 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2498/4949] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:06 2022] POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:26:06.433073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-565de4a9-ccb3-4572-be95-30590c1b1849 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:06.433716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-565de4a9-ccb3-4572-be95-30590c1b1849 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:06.443871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-565de4a9-ccb3-4572-be95-30590c1b1849 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:06.444539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-565de4a9-ccb3-4572-be95-30590c1b1849 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:06.449013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-565de4a9-ccb3-4572-be95-30590c1b1849 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:06.449013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-565de4a9-ccb3-4572-be95-30590c1b1849 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:06.625428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-565de4a9-ccb3-4572-be95-30590c1b1849 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:06.633095 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-565de4a9-ccb3-4572-be95-30590c1b1849 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.204515 May 28 21:26:06.633585 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2452/4950] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:06 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:07.147407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-816ecadb-2ad9-490e-a984-42699f2c7335 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:07.149068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-816ecadb-2ad9-490e-a984-42699f2c7335 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:07.157045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-816ecadb-2ad9-490e-a984-42699f2c7335 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:07.157501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-816ecadb-2ad9-490e-a984-42699f2c7335 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:07.158299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-816ecadb-2ad9-490e-a984-42699f2c7335 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:07.158775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-816ecadb-2ad9-490e-a984-42699f2c7335 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:07.206359 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-816ecadb-2ad9-490e-a984-42699f2c7335 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action" status: 200 len: 14 microversion: 2.1 time: 0.063736 May 28 21:26:07.207131 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2499/4951] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:07 2022] POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:26:07.657465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-22e60b77-75e9-46f7-9968-02c40aa5b89b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:07.657465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-22e60b77-75e9-46f7-9968-02c40aa5b89b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:07.662033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22e60b77-75e9-46f7-9968-02c40aa5b89b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:07.662527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22e60b77-75e9-46f7-9968-02c40aa5b89b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:07.663305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22e60b77-75e9-46f7-9968-02c40aa5b89b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:07.663813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22e60b77-75e9-46f7-9968-02c40aa5b89b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:07.684146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:26:07.812683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-22e60b77-75e9-46f7-9968-02c40aa5b89b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:07.820317 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-22e60b77-75e9-46f7-9968-02c40aa5b89b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.170830 May 28 21:26:07.820905 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2453/4952] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:07 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:08.221388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8058530b-ef1b-423d-b254-44ce789c7f71 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:08.222709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8058530b-ef1b-423d-b254-44ce789c7f71 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:08.241054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8058530b-ef1b-423d-b254-44ce789c7f71 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:08.242140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8058530b-ef1b-423d-b254-44ce789c7f71 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:08.243172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8058530b-ef1b-423d-b254-44ce789c7f71 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:08.243836 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8058530b-ef1b-423d-b254-44ce789c7f71 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:08.290553 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8058530b-ef1b-423d-b254-44ce789c7f71 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action" status: 200 len: 14 microversion: 2.1 time: 0.073185 May 28 21:26:08.292686 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2500/4953] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:08 2022] POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:26:08.863858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2d854895-47f4-4cb1-a502-6dfde9a3f768 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:08.863858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2d854895-47f4-4cb1-a502-6dfde9a3f768 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:08.863858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d854895-47f4-4cb1-a502-6dfde9a3f768 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:08.863858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d854895-47f4-4cb1-a502-6dfde9a3f768 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:08.863858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d854895-47f4-4cb1-a502-6dfde9a3f768 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:08.863858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d854895-47f4-4cb1-a502-6dfde9a3f768 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:09.016378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2d854895-47f4-4cb1-a502-6dfde9a3f768 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:09.026405 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2d854895-47f4-4cb1-a502-6dfde9a3f768 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.193021 May 28 21:26:09.027874 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2454/4954] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:08 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:09.308990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7057878-ea75-45d5-a59f-b7d4e87d82c2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:09.317632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d7057878-ea75-45d5-a59f-b7d4e87d82c2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:09.329389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7057878-ea75-45d5-a59f-b7d4e87d82c2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:09.333033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7057878-ea75-45d5-a59f-b7d4e87d82c2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:09.333866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7057878-ea75-45d5-a59f-b7d4e87d82c2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:09.334331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7057878-ea75-45d5-a59f-b7d4e87d82c2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:09.374627 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d7057878-ea75-45d5-a59f-b7d4e87d82c2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action" status: 200 len: 14 microversion: 2.1 time: 0.069742 May 28 21:26:09.378629 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2501/4955] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:09 2022] POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:26:10.043584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-af3576e9-b094-4e41-8f89-4558033fb7b3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:10.044137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-af3576e9-b094-4e41-8f89-4558033fb7b3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:10.051566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af3576e9-b094-4e41-8f89-4558033fb7b3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:10.052025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af3576e9-b094-4e41-8f89-4558033fb7b3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:10.052862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af3576e9-b094-4e41-8f89-4558033fb7b3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:10.053241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af3576e9-b094-4e41-8f89-4558033fb7b3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:10.210271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-af3576e9-b094-4e41-8f89-4558033fb7b3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:10.218454 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-af3576e9-b094-4e41-8f89-4558033fb7b3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.178886 May 28 21:26:10.219212 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2455/4956] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:10 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:10.387563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f2378d72-3d69-4912-9eaa-718793b87b18 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:10.388769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f2378d72-3d69-4912-9eaa-718793b87b18 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:10.397212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2378d72-3d69-4912-9eaa-718793b87b18 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:10.397745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2378d72-3d69-4912-9eaa-718793b87b18 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:10.398909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2378d72-3d69-4912-9eaa-718793b87b18 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:10.399447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2378d72-3d69-4912-9eaa-718793b87b18 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:10.451821 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f2378d72-3d69-4912-9eaa-718793b87b18 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action" status: 200 len: 8195 microversion: 2.1 time: 0.069371 May 28 21:26:10.453138 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2502/4957] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:10 2022] POST /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe/action => generated 8195 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:10.462068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c17dee7b-c6e2-4af7-a486-0c968d56929d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:10.462751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c17dee7b-c6e2-4af7-a486-0c968d56929d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:10.468919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c17dee7b-c6e2-4af7-a486-0c968d56929d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:10.469381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c17dee7b-c6e2-4af7-a486-0c968d56929d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:10.470210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c17dee7b-c6e2-4af7-a486-0c968d56929d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:10.470656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c17dee7b-c6e2-4af7-a486-0c968d56929d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:10.618751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c17dee7b-c6e2-4af7-a486-0c968d56929d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:10.626766 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c17dee7b-c6e2-4af7-a486-0c968d56929d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.168703 May 28 21:26:10.627550 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2456/4958] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:10 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:10.649708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f97b2b6f-0ec4-4f82-9e4e-d0bc1f7c825d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:10.652392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f97b2b6f-0ec4-4f82-9e4e-d0bc1f7c825d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:10.658101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f97b2b6f-0ec4-4f82-9e4e-d0bc1f7c825d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:10.658570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f97b2b6f-0ec4-4f82-9e4e-d0bc1f7c825d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:10.659364 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f97b2b6f-0ec4-4f82-9e4e-d0bc1f7c825d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:10.659819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f97b2b6f-0ec4-4f82-9e4e-d0bc1f7c825d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:10.806157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f97b2b6f-0ec4-4f82-9e4e-d0bc1f7c825d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:10.809219 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f97b2b6f-0ec4-4f82-9e4e-d0bc1f7c825d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.164619 May 28 21:26:10.809793 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2503/4959] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:10 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:10.825565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a72cb7da-b409-40a8-8129-e8dec60e0603 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:10.826219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a72cb7da-b409-40a8-8129-e8dec60e0603 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:10.832537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a72cb7da-b409-40a8-8129-e8dec60e0603 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:10.840659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a72cb7da-b409-40a8-8129-e8dec60e0603 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:10.840659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a72cb7da-b409-40a8-8129-e8dec60e0603 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:10.840659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a72cb7da-b409-40a8-8129-e8dec60e0603 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:10.975388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a72cb7da-b409-40a8-8129-e8dec60e0603 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:10.983697 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a72cb7da-b409-40a8-8129-e8dec60e0603 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.162206 May 28 21:26:10.984292 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2457/4960] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:10 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:11.000521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a74fbe31-c5fc-46c1-8d0d-4644c12c1b41 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:11.001146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a74fbe31-c5fc-46c1-8d0d-4644c12c1b41 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:11.008802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a74fbe31-c5fc-46c1-8d0d-4644c12c1b41 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:11.009599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a74fbe31-c5fc-46c1-8d0d-4644c12c1b41 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:11.010501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a74fbe31-c5fc-46c1-8d0d-4644c12c1b41 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:11.011128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a74fbe31-c5fc-46c1-8d0d-4644c12c1b41 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:11.166385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a74fbe31-c5fc-46c1-8d0d-4644c12c1b41 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:11.174064 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a74fbe31-c5fc-46c1-8d0d-4644c12c1b41 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.177708 May 28 21:26:11.174634 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2504/4961] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:10 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:11.190584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b0dacaa9-b5f3-4291-a135-484f34970659 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:11.191275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b0dacaa9-b5f3-4291-a135-484f34970659 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:11.198904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0dacaa9-b5f3-4291-a135-484f34970659 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:11.199364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0dacaa9-b5f3-4291-a135-484f34970659 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:11.200204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0dacaa9-b5f3-4291-a135-484f34970659 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:11.200652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0dacaa9-b5f3-4291-a135-484f34970659 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:11.235854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a96f1f4e-e894-42f4-89e6-ea2ad470b2d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:11.236502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a96f1f4e-e894-42f4-89e6-ea2ad470b2d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:11.243225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a96f1f4e-e894-42f4-89e6-ea2ad470b2d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:11.243689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a96f1f4e-e894-42f4-89e6-ea2ad470b2d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:11.244462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a96f1f4e-e894-42f4-89e6-ea2ad470b2d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:11.244909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a96f1f4e-e894-42f4-89e6-ea2ad470b2d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:11.396748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a96f1f4e-e894-42f4-89e6-ea2ad470b2d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:11.406832 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a96f1f4e-e894-42f4-89e6-ea2ad470b2d2 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.174771 May 28 21:26:11.408329 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2505/4962] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:11 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:11.505141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b0dacaa9-b5f3-4291-a135-484f34970659 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Locking {{(pid=143128) lock /opt/stack/nova/nova/compute/api.py:4700}} May 28 21:26:11.775143 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b0dacaa9-b5f3-4291-a135-484f34970659 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.587533 May 28 21:26:11.775865 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2458/4963] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:11 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:26:11.790885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3928428e-19a4-4325-93f7-b1cbd2828317 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:11.790885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3928428e-19a4-4325-93f7-b1cbd2828317 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:11.800279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3928428e-19a4-4325-93f7-b1cbd2828317 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:11.801189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3928428e-19a4-4325-93f7-b1cbd2828317 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:11.802872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3928428e-19a4-4325-93f7-b1cbd2828317 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:11.803665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3928428e-19a4-4325-93f7-b1cbd2828317 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:11.828843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:26:11.999312 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3928428e-19a4-4325-93f7-b1cbd2828317 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:12.007000 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3928428e-19a4-4325-93f7-b1cbd2828317 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.226872 May 28 21:26:12.010269 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2506/4964] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:11 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:12.023934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c09a7b9-0686-4ccf-b3b5-d144ffb9a8f0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:12.033191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c09a7b9-0686-4ccf-b3b5-d144ffb9a8f0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:12.033191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c09a7b9-0686-4ccf-b3b5-d144ffb9a8f0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:12.056150 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-3c09a7b9-0686-4ccf-b3b5-d144ffb9a8f0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] HTTP exception thrown: Instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 is locked May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c09a7b9-0686-4ccf-b3b5-d144ffb9a8f0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Request method failure captured: May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action HTTP/1.1 May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 15 May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpKIk2OUil0QsMGGU0iOO3mmhI8Jd7LtRGcnyhnlDDx4kYkNF5-ymhcXN7hllklCNhr1_lZt3ykjiY5Y0a-24J_DqF4BPVH5qPEZ4vCdPizqGadcaWtjxsjwyPO4ar3aAOGmADovrf4x3XhColp7kRYAiPONaPNMu2yATNBTY4OR6P4 May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 54447ea481574a128f06c24315f34e46 May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerActionsTestJSON-2133353695 May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54447ea481574a128f06c24315f34e46", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54447ea481574a128f06c24315f34e46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54447ea481574a128f06c24315f34e46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54447ea481574a128f06c24315f34e46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerActionsTestJSON-2133353695 May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 54447ea481574a128f06c24315f34e46 May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerActionsTestJSON-2133353695 May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerActionsTestJSON-2133353695-project May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 02d5fbb072814fd7923ecf12c7ecad7b May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerActionsTestJSON-2133353695-project May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: {"os-stop": {}} May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 is locked May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '226cec1f-9523-4d1f-95cf-e2d994bd1f88', 'body': {'os-stop': {}}} May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 is locked May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 is locked May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 is locked May 28 21:26:12.056533 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:26:12.062917 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c09a7b9-0686-4ccf-b3b5-d144ffb9a8f0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Returning 409 to user: Instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 is locked {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:26:12.062917 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3c09a7b9-0686-4ccf-b3b5-d144ffb9a8f0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 409 len: 107 microversion: 2.1 time: 0.038602 May 28 21:26:12.062917 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2459/4965] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:12 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 107 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:26:12.067902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-38423a9a-a085-40e5-a284-1796681c48ec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:12.068529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-38423a9a-a085-40e5-a284-1796681c48ec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:12.074899 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38423a9a-a085-40e5-a284-1796681c48ec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:12.075418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38423a9a-a085-40e5-a284-1796681c48ec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:12.076196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38423a9a-a085-40e5-a284-1796681c48ec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:12.076641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38423a9a-a085-40e5-a284-1796681c48ec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:12.293653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-38423a9a-a085-40e5-a284-1796681c48ec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Unlocking {{(pid=143129) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 28 21:26:12.424344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fee090bf-7b05-4b3c-b413-fa857760229e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:12.424965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fee090bf-7b05-4b3c-b413-fa857760229e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:12.432025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fee090bf-7b05-4b3c-b413-fa857760229e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:12.432482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fee090bf-7b05-4b3c-b413-fa857760229e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:12.433250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fee090bf-7b05-4b3c-b413-fa857760229e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:12.433691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fee090bf-7b05-4b3c-b413-fa857760229e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:12.540058 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-38423a9a-a085-40e5-a284-1796681c48ec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.476433 May 28 21:26:12.541089 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2507/4966] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:12 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:26:12.554518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d55c1652-5b51-44ba-8576-a1ae41956e03 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:12.564801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d55c1652-5b51-44ba-8576-a1ae41956e03 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:12.573784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d55c1652-5b51-44ba-8576-a1ae41956e03 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:12.574413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fee090bf-7b05-4b3c-b413-fa857760229e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:12.585944 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fee090bf-7b05-4b3c-b413-fa857760229e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.164032 May 28 21:26:12.589793 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2460/4967] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:12 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:12.595796 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d55c1652-5b51-44ba-8576-a1ae41956e03 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Going to try to stop instance {{(pid=143129) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 21:26:12.862900 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d55c1652-5b51-44ba-8576-a1ae41956e03 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.316530 May 28 21:26:12.863560 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2508/4968] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:12 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:26:12.877576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2acbe6b4-5027-4898-be30-6aabcc99c52b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:12.878247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2acbe6b4-5027-4898-be30-6aabcc99c52b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:12.885305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2acbe6b4-5027-4898-be30-6aabcc99c52b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:12.885950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2acbe6b4-5027-4898-be30-6aabcc99c52b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:12.886772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2acbe6b4-5027-4898-be30-6aabcc99c52b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:12.887202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2acbe6b4-5027-4898-be30-6aabcc99c52b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:13.040859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2acbe6b4-5027-4898-be30-6aabcc99c52b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:13.048882 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2acbe6b4-5027-4898-be30-6aabcc99c52b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.175016 May 28 21:26:13.049435 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2461/4969] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:12 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:13.608628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b0581dac-3ae3-437c-a463-76dc6e17ea50 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:13.609273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b0581dac-3ae3-437c-a463-76dc6e17ea50 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:13.615937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0581dac-3ae3-437c-a463-76dc6e17ea50 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:13.616434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0581dac-3ae3-437c-a463-76dc6e17ea50 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:13.617200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0581dac-3ae3-437c-a463-76dc6e17ea50 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:13.617648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0581dac-3ae3-437c-a463-76dc6e17ea50 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:13.782909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b0581dac-3ae3-437c-a463-76dc6e17ea50 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:13.791697 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b0581dac-3ae3-437c-a463-76dc6e17ea50 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.188243 May 28 21:26:13.792669 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2509/4970] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:13 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:14.067627 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1e12da16-5e00-46d2-aaf3-7cdd432f59fc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:14.068848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1e12da16-5e00-46d2-aaf3-7cdd432f59fc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:14.083671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e12da16-5e00-46d2-aaf3-7cdd432f59fc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:14.084141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e12da16-5e00-46d2-aaf3-7cdd432f59fc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:14.084935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e12da16-5e00-46d2-aaf3-7cdd432f59fc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:14.086256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e12da16-5e00-46d2-aaf3-7cdd432f59fc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:14.243669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1e12da16-5e00-46d2-aaf3-7cdd432f59fc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:14.253106 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1e12da16-5e00-46d2-aaf3-7cdd432f59fc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.191032 May 28 21:26:14.263351 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2462/4971] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:14 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:14.809524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e8fc25c3-6208-4a90-bc33-7708f225dc6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:14.812585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e8fc25c3-6208-4a90-bc33-7708f225dc6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:14.817650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8fc25c3-6208-4a90-bc33-7708f225dc6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:14.818144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8fc25c3-6208-4a90-bc33-7708f225dc6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:14.818942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8fc25c3-6208-4a90-bc33-7708f225dc6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:14.819373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e8fc25c3-6208-4a90-bc33-7708f225dc6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:14.955018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e8fc25c3-6208-4a90-bc33-7708f225dc6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:14.964346 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e8fc25c3-6208-4a90-bc33-7708f225dc6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.159147 May 28 21:26:14.964939 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2510/4972] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:14 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:15.271547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-991425a8-3bb5-46b5-b310-80c9ff1d8490 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:15.272286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-991425a8-3bb5-46b5-b310-80c9ff1d8490 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:15.279919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-991425a8-3bb5-46b5-b310-80c9ff1d8490 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:15.280377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-991425a8-3bb5-46b5-b310-80c9ff1d8490 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:15.281148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-991425a8-3bb5-46b5-b310-80c9ff1d8490 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:15.281590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-991425a8-3bb5-46b5-b310-80c9ff1d8490 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:15.420659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-991425a8-3bb5-46b5-b310-80c9ff1d8490 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:15.430313 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-991425a8-3bb5-46b5-b310-80c9ff1d8490 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.162591 May 28 21:26:15.431238 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2463/4973] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:15 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:15.982513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c379717e-3024-4057-8b45-32d6466c5620 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:15.983324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c379717e-3024-4057-8b45-32d6466c5620 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:15.990912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c379717e-3024-4057-8b45-32d6466c5620 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:15.991893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c379717e-3024-4057-8b45-32d6466c5620 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:15.992669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c379717e-3024-4057-8b45-32d6466c5620 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:15.993122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c379717e-3024-4057-8b45-32d6466c5620 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:16.153896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c379717e-3024-4057-8b45-32d6466c5620 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:16.169132 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c379717e-3024-4057-8b45-32d6466c5620 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.188082 May 28 21:26:16.169946 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2511/4974] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:15 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:16.451811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aeae6e60-15bc-402d-ab84-a704e03caa25 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:16.452970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aeae6e60-15bc-402d-ab84-a704e03caa25 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:16.460243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aeae6e60-15bc-402d-ab84-a704e03caa25 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:16.460722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aeae6e60-15bc-402d-ab84-a704e03caa25 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:16.461495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aeae6e60-15bc-402d-ab84-a704e03caa25 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:16.461969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aeae6e60-15bc-402d-ab84-a704e03caa25 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:16.610714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aeae6e60-15bc-402d-ab84-a704e03caa25 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:16.621770 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aeae6e60-15bc-402d-ab84-a704e03caa25 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.174010 May 28 21:26:16.626294 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2464/4975] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:16 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:17.186797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c9644ad0-7ebd-4c18-90aa-b04a5ecd4934 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:17.187355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c9644ad0-7ebd-4c18-90aa-b04a5ecd4934 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:17.194104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c9644ad0-7ebd-4c18-90aa-b04a5ecd4934 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:17.194567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c9644ad0-7ebd-4c18-90aa-b04a5ecd4934 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:17.195345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c9644ad0-7ebd-4c18-90aa-b04a5ecd4934 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:17.195792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c9644ad0-7ebd-4c18-90aa-b04a5ecd4934 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:17.410033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c9644ad0-7ebd-4c18-90aa-b04a5ecd4934 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:17.420587 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c9644ad0-7ebd-4c18-90aa-b04a5ecd4934 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.237235 May 28 21:26:17.421563 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2512/4976] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:17 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:17.640615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c2837210-aae9-4be8-9f34-b993638ebdae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:17.641189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c2837210-aae9-4be8-9f34-b993638ebdae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:17.648842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2837210-aae9-4be8-9f34-b993638ebdae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:17.649308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2837210-aae9-4be8-9f34-b993638ebdae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:17.650116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2837210-aae9-4be8-9f34-b993638ebdae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:17.650571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c2837210-aae9-4be8-9f34-b993638ebdae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:17.796367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c2837210-aae9-4be8-9f34-b993638ebdae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:17.796367 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c2837210-aae9-4be8-9f34-b993638ebdae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.156052 May 28 21:26:17.796367 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2465/4977] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:17 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:18.283493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fa85e637-3f8c-4143-9d01-1ee8bfcf924a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:18.284694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fa85e637-3f8c-4143-9d01-1ee8bfcf924a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:18.292010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa85e637-3f8c-4143-9d01-1ee8bfcf924a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:18.292733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa85e637-3f8c-4143-9d01-1ee8bfcf924a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:18.293671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa85e637-3f8c-4143-9d01-1ee8bfcf924a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:18.294320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa85e637-3f8c-4143-9d01-1ee8bfcf924a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:18.347092 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fa85e637-3f8c-4143-9d01-1ee8bfcf924a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2/action" status: 200 len: 24572 microversion: 2.1 time: 0.067660 May 28 21:26:18.347686 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2513/4978] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:18 2022] POST /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2/action => generated 24572 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:26:18.438435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-32e46e4e-4ef8-4a5a-9647-bb264c4c60dd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:18.439108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-32e46e4e-4ef8-4a5a-9647-bb264c4c60dd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:18.446315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32e46e4e-4ef8-4a5a-9647-bb264c4c60dd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:18.446666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32e46e4e-4ef8-4a5a-9647-bb264c4c60dd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:18.447342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32e46e4e-4ef8-4a5a-9647-bb264c4c60dd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:18.447781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32e46e4e-4ef8-4a5a-9647-bb264c4c60dd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:18.629024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-32e46e4e-4ef8-4a5a-9647-bb264c4c60dd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:18.636609 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-32e46e4e-4ef8-4a5a-9647-bb264c4c60dd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.202551 May 28 21:26:18.637185 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2466/4979] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:18 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:18.812649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d5b76f9d-b7d1-4aa2-a421-dbb4b07463a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:18.813591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d5b76f9d-b7d1-4aa2-a421-dbb4b07463a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:18.821108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5b76f9d-b7d1-4aa2-a421-dbb4b07463a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:18.821683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5b76f9d-b7d1-4aa2-a421-dbb4b07463a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:18.822702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5b76f9d-b7d1-4aa2-a421-dbb4b07463a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:18.823141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d5b76f9d-b7d1-4aa2-a421-dbb4b07463a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:18.963219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d5b76f9d-b7d1-4aa2-a421-dbb4b07463a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:18.972249 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d5b76f9d-b7d1-4aa2-a421-dbb4b07463a4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.162738 May 28 21:26:18.982149 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2514/4980] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:18 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:19.662131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e354dc00-0d49-4b55-8ccb-7658f019bd8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:19.662778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e354dc00-0d49-4b55-8ccb-7658f019bd8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:19.670025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e354dc00-0d49-4b55-8ccb-7658f019bd8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:19.670523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e354dc00-0d49-4b55-8ccb-7658f019bd8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:19.671306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e354dc00-0d49-4b55-8ccb-7658f019bd8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:19.671754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e354dc00-0d49-4b55-8ccb-7658f019bd8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:19.833475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e354dc00-0d49-4b55-8ccb-7658f019bd8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:19.841374 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e354dc00-0d49-4b55-8ccb-7658f019bd8c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.191428 May 28 21:26:19.841966 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2467/4981] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:19 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:19.989468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3fa7a433-7c4f-4964-bc4f-4a6606ac76a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:19.990691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3fa7a433-7c4f-4964-bc4f-4a6606ac76a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:19.998616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fa7a433-7c4f-4964-bc4f-4a6606ac76a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:19.999083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fa7a433-7c4f-4964-bc4f-4a6606ac76a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:20.000029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fa7a433-7c4f-4964-bc4f-4a6606ac76a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:20.000586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fa7a433-7c4f-4964-bc4f-4a6606ac76a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:20.151302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3fa7a433-7c4f-4964-bc4f-4a6606ac76a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:20.159351 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3fa7a433-7c4f-4964-bc4f-4a6606ac76a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.174117 May 28 21:26:20.160029 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2515/4982] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:19 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:20.860294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5d35a031-5802-4e03-a112-edfc331ab06c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:20.860990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5d35a031-5802-4e03-a112-edfc331ab06c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:20.907912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d35a031-5802-4e03-a112-edfc331ab06c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:20.908628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d35a031-5802-4e03-a112-edfc331ab06c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:20.909775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d35a031-5802-4e03-a112-edfc331ab06c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:20.924712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d35a031-5802-4e03-a112-edfc331ab06c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:20.936257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:26:21.110331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5d35a031-5802-4e03-a112-edfc331ab06c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:21.119469 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5d35a031-5802-4e03-a112-edfc331ab06c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.264833 May 28 21:26:21.120399 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2468/4983] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:20 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:21.176812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a9cde1b9-2cc1-424e-aab3-443e240d46e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:21.177344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a9cde1b9-2cc1-424e-aab3-443e240d46e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:21.185296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9cde1b9-2cc1-424e-aab3-443e240d46e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:21.186013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9cde1b9-2cc1-424e-aab3-443e240d46e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:21.186967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9cde1b9-2cc1-424e-aab3-443e240d46e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:21.187588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9cde1b9-2cc1-424e-aab3-443e240d46e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:21.440272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a9cde1b9-2cc1-424e-aab3-443e240d46e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:21.448003 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a9cde1b9-2cc1-424e-aab3-443e240d46e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.275265 May 28 21:26:21.449913 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2516/4984] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:21 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:22.146123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c55681b-659f-49d2-b839-f45e2a65e932 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:22.147144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3c55681b-659f-49d2-b839-f45e2a65e932 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:22.156393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c55681b-659f-49d2-b839-f45e2a65e932 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:22.156773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c55681b-659f-49d2-b839-f45e2a65e932 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:22.157633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c55681b-659f-49d2-b839-f45e2a65e932 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:22.158287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c55681b-659f-49d2-b839-f45e2a65e932 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:22.294383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3c55681b-659f-49d2-b839-f45e2a65e932 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:22.302175 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3c55681b-659f-49d2-b839-f45e2a65e932 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.160341 May 28 21:26:22.302831 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2469/4985] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:22 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:22.465157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e150d9b2-ed78-4510-804f-f423ec90f066 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:22.465770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e150d9b2-ed78-4510-804f-f423ec90f066 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:22.473038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e150d9b2-ed78-4510-804f-f423ec90f066 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:22.473503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e150d9b2-ed78-4510-804f-f423ec90f066 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:22.474309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e150d9b2-ed78-4510-804f-f423ec90f066 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:22.479281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e150d9b2-ed78-4510-804f-f423ec90f066 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:22.992314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e150d9b2-ed78-4510-804f-f423ec90f066 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:23.000087 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e150d9b2-ed78-4510-804f-f423ec90f066 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.538797 May 28 21:26:23.001513 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2517/4986] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:22 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:23.319317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ed89e6ab-d319-4000-8d71-6393705b4e0c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:23.319936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ed89e6ab-d319-4000-8d71-6393705b4e0c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:23.327558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed89e6ab-d319-4000-8d71-6393705b4e0c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:23.328007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed89e6ab-d319-4000-8d71-6393705b4e0c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:23.328775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed89e6ab-d319-4000-8d71-6393705b4e0c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:23.329214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed89e6ab-d319-4000-8d71-6393705b4e0c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:23.554745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ed89e6ab-d319-4000-8d71-6393705b4e0c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:23.563276 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ed89e6ab-d319-4000-8d71-6393705b4e0c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.247822 May 28 21:26:23.566451 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2470/4987] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:23 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:24.016487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bcd18878-3fe3-496d-b1ee-2549b5fa4783 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:24.017693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bcd18878-3fe3-496d-b1ee-2549b5fa4783 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:24.024777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bcd18878-3fe3-496d-b1ee-2549b5fa4783 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:24.025233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bcd18878-3fe3-496d-b1ee-2549b5fa4783 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:24.026055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bcd18878-3fe3-496d-b1ee-2549b5fa4783 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:24.027179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bcd18878-3fe3-496d-b1ee-2549b5fa4783 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:24.181493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bcd18878-3fe3-496d-b1ee-2549b5fa4783 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:24.189403 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bcd18878-3fe3-496d-b1ee-2549b5fa4783 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1658 microversion: 2.1 time: 0.176808 May 28 21:26:24.190006 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2518/4988] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:24 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1658 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:24.207228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-010b3fba-b232-4364-ac9a-b2fc45df27e8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:24.213716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-010b3fba-b232-4364-ac9a-b2fc45df27e8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:24.214205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-010b3fba-b232-4364-ac9a-b2fc45df27e8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:24.237732 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-010b3fba-b232-4364-ac9a-b2fc45df27e8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Going to try to start instance {{(pid=143128) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 21:26:24.517074 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-010b3fba-b232-4364-ac9a-b2fc45df27e8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.313850 May 28 21:26:24.519004 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2471/4989] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:24 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:26:24.529314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fcad4151-cdf5-4b05-a46e-d3bddd2316fa tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:24.530088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fcad4151-cdf5-4b05-a46e-d3bddd2316fa tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:24.544373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcad4151-cdf5-4b05-a46e-d3bddd2316fa tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:24.545069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcad4151-cdf5-4b05-a46e-d3bddd2316fa tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:24.546242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcad4151-cdf5-4b05-a46e-d3bddd2316fa tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:24.546877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fcad4151-cdf5-4b05-a46e-d3bddd2316fa tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:24.581198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-45938299-c508-40fd-b41d-4ecc9e758445 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:24.581947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-45938299-c508-40fd-b41d-4ecc9e758445 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:24.587829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=94 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:26:24.589951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45938299-c508-40fd-b41d-4ecc9e758445 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:24.590429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45938299-c508-40fd-b41d-4ecc9e758445 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:24.591163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45938299-c508-40fd-b41d-4ecc9e758445 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:24.591602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45938299-c508-40fd-b41d-4ecc9e758445 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:24.796809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fcad4151-cdf5-4b05-a46e-d3bddd2316fa tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:24.814124 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fcad4151-cdf5-4b05-a46e-d3bddd2316fa tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1667 microversion: 2.1 time: 0.290728 May 28 21:26:24.817656 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2519/4990] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:24 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1667 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:24.915105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-45938299-c508-40fd-b41d-4ecc9e758445 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:24.924018 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-45938299-c508-40fd-b41d-4ecc9e758445 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.347169 May 28 21:26:24.924621 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2472/4991] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:24 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:25.841159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-36f5eb1d-8020-458f-8423-c54782ef61da tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:25.841902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-36f5eb1d-8020-458f-8423-c54782ef61da tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:25.849557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36f5eb1d-8020-458f-8423-c54782ef61da tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:25.850325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36f5eb1d-8020-458f-8423-c54782ef61da tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:25.851476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36f5eb1d-8020-458f-8423-c54782ef61da tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:25.851920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36f5eb1d-8020-458f-8423-c54782ef61da tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:25.906805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:26:25.949190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2821c466-d76e-4f92-8336-00ea394bcab4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:25.951037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2821c466-d76e-4f92-8336-00ea394bcab4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:25.965733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2821c466-d76e-4f92-8336-00ea394bcab4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:25.966941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2821c466-d76e-4f92-8336-00ea394bcab4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:25.969478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2821c466-d76e-4f92-8336-00ea394bcab4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:25.970279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2821c466-d76e-4f92-8336-00ea394bcab4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:26.190472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2821c466-d76e-4f92-8336-00ea394bcab4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:26.200020 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2821c466-d76e-4f92-8336-00ea394bcab4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.262002 May 28 21:26:26.208154 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2473/4992] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:25 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:26.211591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-36f5eb1d-8020-458f-8423-c54782ef61da tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:26.228814 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-36f5eb1d-8020-458f-8423-c54782ef61da tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1667 microversion: 2.1 time: 0.397616 May 28 21:26:26.238130 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2520/4993] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:25 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1667 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:27.220700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5ba1c5e2-b6d6-4cda-8005-501b494f9edb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:27.230057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5ba1c5e2-b6d6-4cda-8005-501b494f9edb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:27.237412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ba1c5e2-b6d6-4cda-8005-501b494f9edb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:27.239511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ba1c5e2-b6d6-4cda-8005-501b494f9edb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:27.239511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ba1c5e2-b6d6-4cda-8005-501b494f9edb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:27.239511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ba1c5e2-b6d6-4cda-8005-501b494f9edb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:27.244428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e7b85e62-3599-4e34-a4d2-1b2f02861a9a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:27.245684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e7b85e62-3599-4e34-a4d2-1b2f02861a9a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:27.256338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7b85e62-3599-4e34-a4d2-1b2f02861a9a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:27.256338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7b85e62-3599-4e34-a4d2-1b2f02861a9a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:27.257193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7b85e62-3599-4e34-a4d2-1b2f02861a9a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:27.258073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7b85e62-3599-4e34-a4d2-1b2f02861a9a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:27.473442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5ba1c5e2-b6d6-4cda-8005-501b494f9edb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:27.481009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e7b85e62-3599-4e34-a4d2-1b2f02861a9a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:27.488131 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5ba1c5e2-b6d6-4cda-8005-501b494f9edb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.270905 May 28 21:26:27.489284 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2474/4994] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:27 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:27.502592 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e7b85e62-3599-4e34-a4d2-1b2f02861a9a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.249543 May 28 21:26:27.502592 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2521/4995] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:27 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:27.509542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ea78a4e8-c570-4c5f-9adc-e1cb60585e4f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:27.510214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ea78a4e8-c570-4c5f-9adc-e1cb60585e4f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:27.516372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea78a4e8-c570-4c5f-9adc-e1cb60585e4f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:27.516839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea78a4e8-c570-4c5f-9adc-e1cb60585e4f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:27.517617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea78a4e8-c570-4c5f-9adc-e1cb60585e4f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:27.518092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea78a4e8-c570-4c5f-9adc-e1cb60585e4f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:27.664231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ea78a4e8-c570-4c5f-9adc-e1cb60585e4f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:27.672010 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ea78a4e8-c570-4c5f-9adc-e1cb60585e4f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.166861 May 28 21:26:27.672623 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2522/4996] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:27 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:27.688483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-52075d9a-2e5b-48c3-9620-9628fc02e2f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:27.690784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-52075d9a-2e5b-48c3-9620-9628fc02e2f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:27.695644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52075d9a-2e5b-48c3-9620-9628fc02e2f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:27.696100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52075d9a-2e5b-48c3-9620-9628fc02e2f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:27.696860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52075d9a-2e5b-48c3-9620-9628fc02e2f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:27.697300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52075d9a-2e5b-48c3-9620-9628fc02e2f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:27.904825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-52075d9a-2e5b-48c3-9620-9628fc02e2f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Unlocking {{(pid=143128) unlock /opt/stack/nova/nova/compute/api.py:4729}} May 28 21:26:28.088556 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-52075d9a-2e5b-48c3-9620-9628fc02e2f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.404000 May 28 21:26:28.094260 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2475/4997] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:27 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:26:28.100079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7aa0adb4-9cfb-4a9d-a179-be56e4c68c44 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:28.101167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7aa0adb4-9cfb-4a9d-a179-be56e4c68c44 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:28.111059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7aa0adb4-9cfb-4a9d-a179-be56e4c68c44 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:28.111528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7aa0adb4-9cfb-4a9d-a179-be56e4c68c44 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:28.112548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7aa0adb4-9cfb-4a9d-a179-be56e4c68c44 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:28.113007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7aa0adb4-9cfb-4a9d-a179-be56e4c68c44 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:28.268487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7aa0adb4-9cfb-4a9d-a179-be56e4c68c44 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:28.276865 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7aa0adb4-9cfb-4a9d-a179-be56e4c68c44 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.181204 May 28 21:26:28.277546 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2523/4998] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:28 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:28.295243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-46902695-e9a5-444a-9dc5-5a59b36fe21b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:28.296431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-46902695-e9a5-444a-9dc5-5a59b36fe21b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:28.303563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46902695-e9a5-444a-9dc5-5a59b36fe21b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:28.304091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46902695-e9a5-444a-9dc5-5a59b36fe21b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:28.304796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46902695-e9a5-444a-9dc5-5a59b36fe21b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:28.305241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46902695-e9a5-444a-9dc5-5a59b36fe21b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:28.456274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-46902695-e9a5-444a-9dc5-5a59b36fe21b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:28.464666 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-46902695-e9a5-444a-9dc5-5a59b36fe21b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.174389 May 28 21:26:28.465252 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2476/4999] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:28 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:28.482106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5bb65662-5301-4686-98f4-d430641dd978 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:28.482739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5bb65662-5301-4686-98f4-d430641dd978 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:28.489096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bb65662-5301-4686-98f4-d430641dd978 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:28.489564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bb65662-5301-4686-98f4-d430641dd978 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:28.490377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bb65662-5301-4686-98f4-d430641dd978 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:28.490887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5bb65662-5301-4686-98f4-d430641dd978 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:28.506031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a04ecf45-3d55-465f-a9f4-1d328ab9f4b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:28.506670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a04ecf45-3d55-465f-a9f4-1d328ab9f4b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:28.513143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a04ecf45-3d55-465f-a9f4-1d328ab9f4b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:28.513595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a04ecf45-3d55-465f-a9f4-1d328ab9f4b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:28.514558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a04ecf45-3d55-465f-a9f4-1d328ab9f4b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:28.515183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a04ecf45-3d55-465f-a9f4-1d328ab9f4b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:28.697879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5bb65662-5301-4686-98f4-d430641dd978 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:28.707052 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5bb65662-5301-4686-98f4-d430641dd978 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.229125 May 28 21:26:28.708167 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2524/5000] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:28 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:28.719413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a04ecf45-3d55-465f-a9f4-1d328ab9f4b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:28.722020 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a04ecf45-3d55-465f-a9f4-1d328ab9f4b1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1530 microversion: 2.1 time: 0.219437 May 28 21:26:28.725108 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2477/5001] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:28 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1530 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:28.728494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e0fb045b-e6cf-41c1-bab1-2865d7994063 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:28.729041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e0fb045b-e6cf-41c1-bab1-2865d7994063 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:28.737225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0fb045b-e6cf-41c1-bab1-2865d7994063 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:28.737692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0fb045b-e6cf-41c1-bab1-2865d7994063 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:28.738768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0fb045b-e6cf-41c1-bab1-2865d7994063 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:28.739221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0fb045b-e6cf-41c1-bab1-2865d7994063 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:29.006439 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e0fb045b-e6cf-41c1-bab1-2865d7994063 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.282706 May 28 21:26:29.007330 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2525/5002] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:28 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:26:29.021745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4e356e90-c6fc-4610-8e15-3473f5b8ce57 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:29.022807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4e356e90-c6fc-4610-8e15-3473f5b8ce57 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:29.031580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e356e90-c6fc-4610-8e15-3473f5b8ce57 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:29.032048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e356e90-c6fc-4610-8e15-3473f5b8ce57 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:29.041273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e356e90-c6fc-4610-8e15-3473f5b8ce57 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:29.041273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e356e90-c6fc-4610-8e15-3473f5b8ce57 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:29.229882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4e356e90-c6fc-4610-8e15-3473f5b8ce57 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:29.239052 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4e356e90-c6fc-4610-8e15-3473f5b8ce57 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1676 microversion: 2.1 time: 0.225908 May 28 21:26:29.239681 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2478/5003] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:29 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1676 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:29.407701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0de3f0c5-db1f-4f3f-b7f8-5a9a4e3652a6 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:29.408337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0de3f0c5-db1f-4f3f-b7f8-5a9a4e3652a6 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:29.430908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0de3f0c5-db1f-4f3f-b7f8-5a9a4e3652a6 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:29.431384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0de3f0c5-db1f-4f3f-b7f8-5a9a4e3652a6 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:29.433502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0de3f0c5-db1f-4f3f-b7f8-5a9a4e3652a6 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:29.445590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0de3f0c5-db1f-4f3f-b7f8-5a9a4e3652a6 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:29.662565 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0de3f0c5-db1f-4f3f-b7f8-5a9a4e3652a6 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1832 microversion: 2.1 time: 0.258796 May 28 21:26:29.663973 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2526/5004] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:29 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1832 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:29.680931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3cd35659-2c9a-4529-b789-2834785f1b12 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:29.682378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3cd35659-2c9a-4529-b789-2834785f1b12 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:29.689808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cd35659-2c9a-4529-b789-2834785f1b12 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:29.690306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cd35659-2c9a-4529-b789-2834785f1b12 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:29.691130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cd35659-2c9a-4529-b789-2834785f1b12 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:29.691870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cd35659-2c9a-4529-b789-2834785f1b12 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:29.740566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-44496c7e-b1dd-4dd9-aeef-540714dd7b40 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:29.741242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-44496c7e-b1dd-4dd9-aeef-540714dd7b40 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:29.749017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44496c7e-b1dd-4dd9-aeef-540714dd7b40 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:29.749479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44496c7e-b1dd-4dd9-aeef-540714dd7b40 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:29.750303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44496c7e-b1dd-4dd9-aeef-540714dd7b40 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:29.750751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44496c7e-b1dd-4dd9-aeef-540714dd7b40 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:29.942528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3cd35659-2c9a-4529-b789-2834785f1b12 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:29.953100 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3cd35659-2c9a-4529-b789-2834785f1b12 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1681 microversion: 2.1 time: 0.277598 May 28 21:26:29.953883 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2479/5005] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:29 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1681 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:29.984201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-44496c7e-b1dd-4dd9-aeef-540714dd7b40 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:29.992577 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-44496c7e-b1dd-4dd9-aeef-540714dd7b40 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1530 microversion: 2.1 time: 0.256142 May 28 21:26:29.993152 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2527/5006] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:29 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1530 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:30.055059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dd2a5110-2454-4e2e-84e3-de36bdfdb000 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:30.056229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dd2a5110-2454-4e2e-84e3-de36bdfdb000 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:30.063342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd2a5110-2454-4e2e-84e3-de36bdfdb000 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:30.063933 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd2a5110-2454-4e2e-84e3-de36bdfdb000 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:30.064723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd2a5110-2454-4e2e-84e3-de36bdfdb000 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:30.065172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd2a5110-2454-4e2e-84e3-de36bdfdb000 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:30.115367 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dd2a5110-2454-4e2e-84e3-de36bdfdb000 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2/action" status: 200 len: 32639 microversion: 2.1 time: 0.065855 May 28 21:26:30.116569 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2480/5007] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:30 2022] POST /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2/action => generated 32639 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:26:30.262313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b50d4fc1-1dd0-4290-8537-5578b865aa4e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:30.263366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b50d4fc1-1dd0-4290-8537-5578b865aa4e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:30.269780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b50d4fc1-1dd0-4290-8537-5578b865aa4e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:30.270274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b50d4fc1-1dd0-4290-8537-5578b865aa4e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:30.271057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b50d4fc1-1dd0-4290-8537-5578b865aa4e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:30.271506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b50d4fc1-1dd0-4290-8537-5578b865aa4e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:30.308705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6b9e306e-559a-4cf3-903b-288b714486ea tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:30.309518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6b9e306e-559a-4cf3-903b-288b714486ea tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:30.317330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b9e306e-559a-4cf3-903b-288b714486ea tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:30.317925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b9e306e-559a-4cf3-903b-288b714486ea tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:30.318809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b9e306e-559a-4cf3-903b-288b714486ea tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:30.320032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b9e306e-559a-4cf3-903b-288b714486ea tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:30.342073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:26:30.352971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6b9e306e-559a-4cf3-903b-288b714486ea tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e2da25bb9fdc42fbbc3665d6618ecd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dae9dd6b0b54bf2954f3d8427e092ee', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:30.353561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6b9e306e-559a-4cf3-903b-288b714486ea tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] flavor_id is None. Assuming migration. {{(pid=143128) resize /opt/stack/nova/nova/compute/api.py:4142}} May 28 21:26:30.354522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6b9e306e-559a-4cf3-903b-288b714486ea tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=143128) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 21:26:30.455017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b50d4fc1-1dd0-4290-8537-5578b865aa4e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:30.463654 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b50d4fc1-1dd0-4290-8537-5578b865aa4e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1656 microversion: 2.1 time: 0.205403 May 28 21:26:30.466645 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2528/5008] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:30 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1656 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:30.495677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e09c4cbb-61fd-48da-b85d-051ffc065cba tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:30.496489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e09c4cbb-61fd-48da-b85d-051ffc065cba tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:30.505990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e09c4cbb-61fd-48da-b85d-051ffc065cba tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:30.506567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e09c4cbb-61fd-48da-b85d-051ffc065cba tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:30.507485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e09c4cbb-61fd-48da-b85d-051ffc065cba tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:30.508113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e09c4cbb-61fd-48da-b85d-051ffc065cba tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:30.690055 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6b9e306e-559a-4cf3-903b-288b714486ea tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2/action" status: 202 len: 0 microversion: 2.1 time: 0.386947 May 28 21:26:30.690971 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2481/5009] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:30 2022] POST /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:26:30.700752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-01d1206f-17d6-4b0e-9f75-0249be456602 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:30.702668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-01d1206f-17d6-4b0e-9f75-0249be456602 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:30.707878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01d1206f-17d6-4b0e-9f75-0249be456602 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:30.708344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01d1206f-17d6-4b0e-9f75-0249be456602 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:30.709186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01d1206f-17d6-4b0e-9f75-0249be456602 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:30.709641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01d1206f-17d6-4b0e-9f75-0249be456602 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:30.772955 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e09c4cbb-61fd-48da-b85d-051ffc065cba tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.284731 May 28 21:26:30.773803 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2529/5010] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:30 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:26:30.784785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-982bf0e6-b90c-4516-a3bc-d320c2d3adf2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:30.785515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-982bf0e6-b90c-4516-a3bc-d320c2d3adf2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:30.801432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-982bf0e6-b90c-4516-a3bc-d320c2d3adf2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:30.801971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-982bf0e6-b90c-4516-a3bc-d320c2d3adf2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:30.808366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-982bf0e6-b90c-4516-a3bc-d320c2d3adf2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:30.809422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-982bf0e6-b90c-4516-a3bc-d320c2d3adf2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:31.013254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-01d1206f-17d6-4b0e-9f75-0249be456602 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:31.045592 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-01d1206f-17d6-4b0e-9f75-0249be456602 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1690 microversion: 2.1 time: 0.345643 May 28 21:26:31.049404 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2482/5011] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:30 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1690 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:31.068462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3fc8bc5f-aaae-4a4a-938a-7bd2ce04583b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:31.071495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3fc8bc5f-aaae-4a4a-938a-7bd2ce04583b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:31.093672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fc8bc5f-aaae-4a4a-938a-7bd2ce04583b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:31.100281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fc8bc5f-aaae-4a4a-938a-7bd2ce04583b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:31.105124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fc8bc5f-aaae-4a4a-938a-7bd2ce04583b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:31.105956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3fc8bc5f-aaae-4a4a-938a-7bd2ce04583b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:31.157537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-982bf0e6-b90c-4516-a3bc-d320c2d3adf2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:31.174778 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-982bf0e6-b90c-4516-a3bc-d320c2d3adf2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1663 microversion: 2.1 time: 0.396014 May 28 21:26:31.177495 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2530/5012] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:30 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1663 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:31.186426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-67589252-18fe-4aaa-a3c1-c8a56e1125ca req-b1588588-4081-4cc6-96de-b38e5fc5bb55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a798306b-2df0-4ef0-b523-13a226b16120", "name": "network-vif-plugged", "status": "completed", "tag": "04aa786c-dc09-4f75-981b-7d1b73608c2b"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:31.202467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-67589252-18fe-4aaa-a3c1-c8a56e1125ca req-b1588588-4081-4cc6-96de-b38e5fc5bb55 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:31.202920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-67589252-18fe-4aaa-a3c1-c8a56e1125ca req-b1588588-4081-4cc6-96de-b38e5fc5bb55 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:31.217146 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-67589252-18fe-4aaa-a3c1-c8a56e1125ca req-b1588588-4081-4cc6-96de-b38e5fc5bb55 service nova] Creating event network-vif-plugged:04aa786c-dc09-4f75-981b-7d1b73608c2b for instance a798306b-2df0-4ef0-b523-13a226b16120 on nch1-master-1 May 28 21:26:31.223553 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-67589252-18fe-4aaa-a3c1-c8a56e1125ca req-b1588588-4081-4cc6-96de-b38e5fc5bb55 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043194 May 28 21:26:31.224695 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2531/5013] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:26:31.379635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3fc8bc5f-aaae-4a4a-938a-7bd2ce04583b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:31.398097 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3fc8bc5f-aaae-4a4a-938a-7bd2ce04583b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1525 microversion: 2.1 time: 0.341077 May 28 21:26:31.398938 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2483/5014] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:31 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1525 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:32.069874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c645b8c4-e0cd-48aa-a651-b1fd1c479c70 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:32.071117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c645b8c4-e0cd-48aa-a651-b1fd1c479c70 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:32.087770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c645b8c4-e0cd-48aa-a651-b1fd1c479c70 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:32.092208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c645b8c4-e0cd-48aa-a651-b1fd1c479c70 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:32.096656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c645b8c4-e0cd-48aa-a651-b1fd1c479c70 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:32.097434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c645b8c4-e0cd-48aa-a651-b1fd1c479c70 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:32.199552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-11475c91-ea3c-4bad-951c-9795493c01fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:32.200195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-11475c91-ea3c-4bad-951c-9795493c01fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:32.224716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11475c91-ea3c-4bad-951c-9795493c01fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:32.228631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11475c91-ea3c-4bad-951c-9795493c01fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:32.229989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11475c91-ea3c-4bad-951c-9795493c01fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:32.232114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11475c91-ea3c-4bad-951c-9795493c01fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:32.501419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c645b8c4-e0cd-48aa-a651-b1fd1c479c70 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:32.531937 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c645b8c4-e0cd-48aa-a651-b1fd1c479c70 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1690 microversion: 2.1 time: 0.459046 May 28 21:26:32.531937 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2532/5015] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:32 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1690 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:32.540546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-887ecc66-c419-43c4-a2eb-956212570eb8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:32.541628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-887ecc66-c419-43c4-a2eb-956212570eb8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:32.550483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-887ecc66-c419-43c4-a2eb-956212570eb8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:32.551170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-887ecc66-c419-43c4-a2eb-956212570eb8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:32.552398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-887ecc66-c419-43c4-a2eb-956212570eb8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:32.553336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-887ecc66-c419-43c4-a2eb-956212570eb8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:32.660699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-11475c91-ea3c-4bad-951c-9795493c01fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:32.675276 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-11475c91-ea3c-4bad-951c-9795493c01fb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.483809 May 28 21:26:32.677056 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2484/5016] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:32 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:32.701424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2f7f3f63-ce9a-4aaf-bf99-ba625b7ba3ae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:32.704410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2f7f3f63-ce9a-4aaf-bf99-ba625b7ba3ae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:32.728834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f7f3f63-ce9a-4aaf-bf99-ba625b7ba3ae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:32.731816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f7f3f63-ce9a-4aaf-bf99-ba625b7ba3ae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:32.734545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f7f3f63-ce9a-4aaf-bf99-ba625b7ba3ae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:32.736233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f7f3f63-ce9a-4aaf-bf99-ba625b7ba3ae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:32.870605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-887ecc66-c419-43c4-a2eb-956212570eb8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:32.891129 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-887ecc66-c419-43c4-a2eb-956212570eb8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1525 microversion: 2.1 time: 0.354025 May 28 21:26:32.892858 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2533/5017] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:32 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1525 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:33.047276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2f7f3f63-ce9a-4aaf-bf99-ba625b7ba3ae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:33.061252 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2f7f3f63-ce9a-4aaf-bf99-ba625b7ba3ae tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.369551 May 28 21:26:33.063927 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2485/5018] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:32 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:33.079898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-340620fe-3b36-4542-b600-07e9814d4200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:33.082133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-340620fe-3b36-4542-b600-07e9814d4200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:33.094287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-340620fe-3b36-4542-b600-07e9814d4200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:33.094960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-340620fe-3b36-4542-b600-07e9814d4200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:33.096362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-340620fe-3b36-4542-b600-07e9814d4200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:33.106660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-340620fe-3b36-4542-b600-07e9814d4200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:33.327098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-340620fe-3b36-4542-b600-07e9814d4200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:33.346991 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-340620fe-3b36-4542-b600-07e9814d4200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.264729 May 28 21:26:33.346991 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2534/5019] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:33 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:33.359855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dcb9e6c0-9c61-49dc-b698-fca6d27e5395 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:33.360494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dcb9e6c0-9c61-49dc-b698-fca6d27e5395 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:33.403935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcb9e6c0-9c61-49dc-b698-fca6d27e5395 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:33.404402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcb9e6c0-9c61-49dc-b698-fca6d27e5395 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:33.405208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcb9e6c0-9c61-49dc-b698-fca6d27e5395 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:33.410379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dcb9e6c0-9c61-49dc-b698-fca6d27e5395 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:33.538667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2730d373-8ecb-4638-baf9-d78b235c991f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:33.543707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2730d373-8ecb-4638-baf9-d78b235c991f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:33.552019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2730d373-8ecb-4638-baf9-d78b235c991f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:33.552508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2730d373-8ecb-4638-baf9-d78b235c991f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:33.553334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2730d373-8ecb-4638-baf9-d78b235c991f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:33.553819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2730d373-8ecb-4638-baf9-d78b235c991f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:33.597336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:26:33.627666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dcb9e6c0-9c61-49dc-b698-fca6d27e5395 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:33.644605 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dcb9e6c0-9c61-49dc-b698-fca6d27e5395 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.285912 May 28 21:26:33.646244 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2486/5020] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:33 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:33.664199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cf920da8-6469-4db8-b854-640be37d9689 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:33.665090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cf920da8-6469-4db8-b854-640be37d9689 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:33.674352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf920da8-6469-4db8-b854-640be37d9689 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:33.675140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf920da8-6469-4db8-b854-640be37d9689 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:33.676285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf920da8-6469-4db8-b854-640be37d9689 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:33.676936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf920da8-6469-4db8-b854-640be37d9689 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:33.826242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2730d373-8ecb-4638-baf9-d78b235c991f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:33.838342 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2730d373-8ecb-4638-baf9-d78b235c991f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1690 microversion: 2.1 time: 0.304004 May 28 21:26:33.838944 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2535/5021] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:33 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1690 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:33.909188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bf879f71-3202-485c-beb3-7d9deb9b016c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:33.910996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bf879f71-3202-485c-beb3-7d9deb9b016c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:33.923539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf879f71-3202-485c-beb3-7d9deb9b016c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:33.924011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf879f71-3202-485c-beb3-7d9deb9b016c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:33.926740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf879f71-3202-485c-beb3-7d9deb9b016c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:33.928343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf879f71-3202-485c-beb3-7d9deb9b016c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:33.934053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cf920da8-6469-4db8-b854-640be37d9689 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:33.945703 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cf920da8-6469-4db8-b854-640be37d9689 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.287236 May 28 21:26:33.946708 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2487/5022] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:33 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:33.967293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-de78ba79-58af-4fb9-9ce8-169a6912cdbb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:33.968018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-de78ba79-58af-4fb9-9ce8-169a6912cdbb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:33.977739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de78ba79-58af-4fb9-9ce8-169a6912cdbb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:33.978370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de78ba79-58af-4fb9-9ce8-169a6912cdbb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:33.979661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de78ba79-58af-4fb9-9ce8-169a6912cdbb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:33.980341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de78ba79-58af-4fb9-9ce8-169a6912cdbb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:34.273203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bf879f71-3202-485c-beb3-7d9deb9b016c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:34.286597 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bf879f71-3202-485c-beb3-7d9deb9b016c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1525 microversion: 2.1 time: 0.381915 May 28 21:26:34.290119 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2536/5023] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:33 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1525 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:34.377003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-de78ba79-58af-4fb9-9ce8-169a6912cdbb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:34.394893 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-de78ba79-58af-4fb9-9ce8-169a6912cdbb tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.429622 May 28 21:26:34.396699 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2488/5024] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:33 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:34.858194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8d156000-60b2-4830-b5a9-4bceab5ab55a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:34.859381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8d156000-60b2-4830-b5a9-4bceab5ab55a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:34.875293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d156000-60b2-4830-b5a9-4bceab5ab55a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:34.876878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d156000-60b2-4830-b5a9-4bceab5ab55a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:34.878907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d156000-60b2-4830-b5a9-4bceab5ab55a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:34.879793 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d156000-60b2-4830-b5a9-4bceab5ab55a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:35.293088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8d156000-60b2-4830-b5a9-4bceab5ab55a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:35.308194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b3fa15a2-2684-4526-8d9a-e117f272333a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:35.309430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b3fa15a2-2684-4526-8d9a-e117f272333a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:35.311207 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8d156000-60b2-4830-b5a9-4bceab5ab55a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1690 microversion: 2.1 time: 0.456944 May 28 21:26:35.311587 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2537/5025] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:34 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1690 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:35.359658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3fa15a2-2684-4526-8d9a-e117f272333a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:35.362111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3fa15a2-2684-4526-8d9a-e117f272333a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:35.367019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3fa15a2-2684-4526-8d9a-e117f272333a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:35.368047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3fa15a2-2684-4526-8d9a-e117f272333a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:35.643681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b3fa15a2-2684-4526-8d9a-e117f272333a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:35.666233 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b3fa15a2-2684-4526-8d9a-e117f272333a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1525 microversion: 2.1 time: 0.363857 May 28 21:26:35.670997 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2489/5026] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:35 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1525 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:36.340220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-12b34e00-9485-4a9a-8357-e73303e61aec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:36.340220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-12b34e00-9485-4a9a-8357-e73303e61aec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:36.340220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12b34e00-9485-4a9a-8357-e73303e61aec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:36.340220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12b34e00-9485-4a9a-8357-e73303e61aec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:36.342131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12b34e00-9485-4a9a-8357-e73303e61aec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:36.342912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12b34e00-9485-4a9a-8357-e73303e61aec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:36.551644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-12b34e00-9485-4a9a-8357-e73303e61aec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:36.559694 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-12b34e00-9485-4a9a-8357-e73303e61aec tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1695 microversion: 2.1 time: 0.234422 May 28 21:26:36.573334 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2538/5027] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:36 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1695 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:36.687168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d3f55ea5-149e-45b4-9c78-1a34c57be3bb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:36.687785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d3f55ea5-149e-45b4-9c78-1a34c57be3bb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:36.695862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3f55ea5-149e-45b4-9c78-1a34c57be3bb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:36.696314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3f55ea5-149e-45b4-9c78-1a34c57be3bb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:36.697288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3f55ea5-149e-45b4-9c78-1a34c57be3bb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:36.697936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3f55ea5-149e-45b4-9c78-1a34c57be3bb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:36.833329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d3f55ea5-149e-45b4-9c78-1a34c57be3bb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:36.841044 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d3f55ea5-149e-45b4-9c78-1a34c57be3bb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1525 microversion: 2.1 time: 0.157789 May 28 21:26:36.841617 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2490/5028] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:36 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:37.580445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c6922ce3-863e-4478-a3f2-22e8fca4e687 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:37.582103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c6922ce3-863e-4478-a3f2-22e8fca4e687 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:37.594766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=84 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:26:37.597623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6922ce3-863e-4478-a3f2-22e8fca4e687 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:37.598372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6922ce3-863e-4478-a3f2-22e8fca4e687 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:37.599464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6922ce3-863e-4478-a3f2-22e8fca4e687 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:37.600239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c6922ce3-863e-4478-a3f2-22e8fca4e687 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:37.872511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-56159a30-be02-46be-94c7-96434eaecdbd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:37.873794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-56159a30-be02-46be-94c7-96434eaecdbd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:37.883434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56159a30-be02-46be-94c7-96434eaecdbd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:37.884186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56159a30-be02-46be-94c7-96434eaecdbd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:37.885235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56159a30-be02-46be-94c7-96434eaecdbd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:37.885770 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56159a30-be02-46be-94c7-96434eaecdbd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:37.892055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c6922ce3-863e-4478-a3f2-22e8fca4e687 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:37.903123 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c6922ce3-863e-4478-a3f2-22e8fca4e687 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1695 microversion: 2.1 time: 0.329892 May 28 21:26:37.904334 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2539/5029] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:37 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1695 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:38.142647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-56159a30-be02-46be-94c7-96434eaecdbd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:38.152701 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-56159a30-be02-46be-94c7-96434eaecdbd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1525 microversion: 2.1 time: 0.298108 May 28 21:26:38.153406 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2491/5030] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:37 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1525 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:38.922140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a46db4d-16c9-4749-b8ce-7233c984eff4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:38.923336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6a46db4d-16c9-4749-b8ce-7233c984eff4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:38.943435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a46db4d-16c9-4749-b8ce-7233c984eff4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:38.944187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a46db4d-16c9-4749-b8ce-7233c984eff4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:38.945166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a46db4d-16c9-4749-b8ce-7233c984eff4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:38.946038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a46db4d-16c9-4749-b8ce-7233c984eff4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:39.169570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a46db4d-16c9-4749-b8ce-7233c984eff4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:39.171459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c690c885-be34-49ea-9d9f-640cac233429 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:39.172088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c690c885-be34-49ea-9d9f-640cac233429 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:39.179111 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6a46db4d-16c9-4749-b8ce-7233c984eff4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1695 microversion: 2.1 time: 0.261536 May 28 21:26:39.183517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c690c885-be34-49ea-9d9f-640cac233429 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:39.184257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c690c885-be34-49ea-9d9f-640cac233429 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:39.186579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c690c885-be34-49ea-9d9f-640cac233429 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:39.187315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c690c885-be34-49ea-9d9f-640cac233429 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:39.196311 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2540/5031] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:38 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1695 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:39.360592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c690c885-be34-49ea-9d9f-640cac233429 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:39.369364 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c690c885-be34-49ea-9d9f-640cac233429 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1525 microversion: 2.1 time: 0.202810 May 28 21:26:39.370312 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2492/5032] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:39 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1525 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:40.200848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8e264cf8-2822-446c-82ce-7c03383c0b32 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:40.201414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8e264cf8-2822-446c-82ce-7c03383c0b32 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:40.209225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e264cf8-2822-446c-82ce-7c03383c0b32 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:40.209692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e264cf8-2822-446c-82ce-7c03383c0b32 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:40.210578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e264cf8-2822-446c-82ce-7c03383c0b32 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:40.211030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e264cf8-2822-446c-82ce-7c03383c0b32 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:40.364852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8e264cf8-2822-446c-82ce-7c03383c0b32 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:40.376710 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8e264cf8-2822-446c-82ce-7c03383c0b32 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1695 microversion: 2.1 time: 0.179667 May 28 21:26:40.387578 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2541/5033] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:40 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1695 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:40.388749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dce6af29-0f72-4c79-852d-c8d23cbdf676 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:40.389387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dce6af29-0f72-4c79-852d-c8d23cbdf676 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:40.398395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dce6af29-0f72-4c79-852d-c8d23cbdf676 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:40.398847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dce6af29-0f72-4c79-852d-c8d23cbdf676 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:40.399789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dce6af29-0f72-4c79-852d-c8d23cbdf676 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:40.400235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dce6af29-0f72-4c79-852d-c8d23cbdf676 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:40.622711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dce6af29-0f72-4c79-852d-c8d23cbdf676 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:40.638318 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dce6af29-0f72-4c79-852d-c8d23cbdf676 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1525 microversion: 2.1 time: 0.255114 May 28 21:26:40.639995 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2493/5034] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:40 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1525 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:41.395542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-305da892-4584-4b45-91c6-53685a5c108c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:41.397014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-305da892-4584-4b45-91c6-53685a5c108c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:41.414880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-305da892-4584-4b45-91c6-53685a5c108c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:41.415455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-305da892-4584-4b45-91c6-53685a5c108c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:41.416488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-305da892-4584-4b45-91c6-53685a5c108c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:41.417006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-305da892-4584-4b45-91c6-53685a5c108c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:41.657912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0eeeaf5f-dcfe-4de5-96df-cec29ed4f15f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:41.662090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0eeeaf5f-dcfe-4de5-96df-cec29ed4f15f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:41.705221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0eeeaf5f-dcfe-4de5-96df-cec29ed4f15f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:41.707491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0eeeaf5f-dcfe-4de5-96df-cec29ed4f15f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:41.709894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0eeeaf5f-dcfe-4de5-96df-cec29ed4f15f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:41.710594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0eeeaf5f-dcfe-4de5-96df-cec29ed4f15f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:41.723619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-305da892-4584-4b45-91c6-53685a5c108c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:41.735583 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-305da892-4584-4b45-91c6-53685a5c108c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1695 microversion: 2.1 time: 0.344264 May 28 21:26:41.736511 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2542/5035] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:41 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1695 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:42.081169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0eeeaf5f-dcfe-4de5-96df-cec29ed4f15f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:42.090957 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0eeeaf5f-dcfe-4de5-96df-cec29ed4f15f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1525 microversion: 2.1 time: 0.438506 May 28 21:26:42.102183 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2494/5036] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:41 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1525 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:42.754139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-be41fdf8-4556-462b-addd-b7eb0d9d7d34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:42.754750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-be41fdf8-4556-462b-addd-b7eb0d9d7d34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:42.763893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be41fdf8-4556-462b-addd-b7eb0d9d7d34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:42.765157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be41fdf8-4556-462b-addd-b7eb0d9d7d34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:42.765819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be41fdf8-4556-462b-addd-b7eb0d9d7d34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:42.766450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be41fdf8-4556-462b-addd-b7eb0d9d7d34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:43.110004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-92c165f5-4019-4d05-8d92-8f25073e7877 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:43.110619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-92c165f5-4019-4d05-8d92-8f25073e7877 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:43.120283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92c165f5-4019-4d05-8d92-8f25073e7877 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:43.121001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92c165f5-4019-4d05-8d92-8f25073e7877 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:43.122040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92c165f5-4019-4d05-8d92-8f25073e7877 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:43.122650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92c165f5-4019-4d05-8d92-8f25073e7877 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:43.138089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-be41fdf8-4556-462b-addd-b7eb0d9d7d34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:43.149776 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-be41fdf8-4556-462b-addd-b7eb0d9d7d34 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1695 microversion: 2.1 time: 0.397830 May 28 21:26:43.160970 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2543/5037] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:42 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1695 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:43.333648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-92c165f5-4019-4d05-8d92-8f25073e7877 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:43.353028 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-92c165f5-4019-4d05-8d92-8f25073e7877 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1525 microversion: 2.1 time: 0.248264 May 28 21:26:43.362410 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2495/5038] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:43 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1525 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:44.169527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0e527615-829a-4058-a74e-8f152a6f6270 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:44.170330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0e527615-829a-4058-a74e-8f152a6f6270 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:44.177802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0e527615-829a-4058-a74e-8f152a6f6270 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:44.178429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0e527615-829a-4058-a74e-8f152a6f6270 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:44.179299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0e527615-829a-4058-a74e-8f152a6f6270 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:44.179966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0e527615-829a-4058-a74e-8f152a6f6270 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:44.371531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0e527615-829a-4058-a74e-8f152a6f6270 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:44.372524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9117a477-7ebd-4153-a5f4-fdc7f5e3b586 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:44.373748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9117a477-7ebd-4153-a5f4-fdc7f5e3b586 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:44.380289 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0e527615-829a-4058-a74e-8f152a6f6270 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1695 microversion: 2.1 time: 0.216208 May 28 21:26:44.380895 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2544/5039] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:44 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1695 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:44.381207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9117a477-7ebd-4153-a5f4-fdc7f5e3b586 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:44.382656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9117a477-7ebd-4153-a5f4-fdc7f5e3b586 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:44.383773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9117a477-7ebd-4153-a5f4-fdc7f5e3b586 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:44.384297 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9117a477-7ebd-4153-a5f4-fdc7f5e3b586 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:44.406919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:26:44.546372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9117a477-7ebd-4153-a5f4-fdc7f5e3b586 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:44.554405 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9117a477-7ebd-4153-a5f4-fdc7f5e3b586 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1525 microversion: 2.1 time: 0.187109 May 28 21:26:44.554986 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2496/5040] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:44 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1525 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:45.403765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6d509614-f66e-41c9-8510-ab69ebaa3c13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:45.404383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6d509614-f66e-41c9-8510-ab69ebaa3c13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:45.414799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d509614-f66e-41c9-8510-ab69ebaa3c13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:45.415268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d509614-f66e-41c9-8510-ab69ebaa3c13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:45.416386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d509614-f66e-41c9-8510-ab69ebaa3c13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:45.416836 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d509614-f66e-41c9-8510-ab69ebaa3c13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:45.572131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-287c7520-c466-4d15-a571-9f36b5410fb9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:45.572758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-287c7520-c466-4d15-a571-9f36b5410fb9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:45.595057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-287c7520-c466-4d15-a571-9f36b5410fb9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:45.595648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-287c7520-c466-4d15-a571-9f36b5410fb9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:45.596762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-287c7520-c466-4d15-a571-9f36b5410fb9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:45.601282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-287c7520-c466-4d15-a571-9f36b5410fb9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:45.782323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6d509614-f66e-41c9-8510-ab69ebaa3c13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:45.794529 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6d509614-f66e-41c9-8510-ab69ebaa3c13 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1695 microversion: 2.1 time: 0.398631 May 28 21:26:45.795167 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2545/5041] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:45 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1695 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:45.945027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-287c7520-c466-4d15-a571-9f36b5410fb9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:45.953927 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-287c7520-c466-4d15-a571-9f36b5410fb9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1525 microversion: 2.1 time: 0.386127 May 28 21:26:45.954516 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2497/5042] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:45 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1525 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:46.812689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d0cab2f0-e18b-42c8-b154-7b51569780e5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:46.814246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d0cab2f0-e18b-42c8-b154-7b51569780e5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:46.826538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d0cab2f0-e18b-42c8-b154-7b51569780e5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:46.828894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d0cab2f0-e18b-42c8-b154-7b51569780e5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:46.833709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d0cab2f0-e18b-42c8-b154-7b51569780e5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:46.833709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d0cab2f0-e18b-42c8-b154-7b51569780e5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:46.971875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-62bf42dd-9ddf-47e8-aa92-c3fc246b91ed tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:46.972588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-62bf42dd-9ddf-47e8-aa92-c3fc246b91ed tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:46.982784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62bf42dd-9ddf-47e8-aa92-c3fc246b91ed tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:46.983612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62bf42dd-9ddf-47e8-aa92-c3fc246b91ed tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:46.984575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62bf42dd-9ddf-47e8-aa92-c3fc246b91ed tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:46.985188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62bf42dd-9ddf-47e8-aa92-c3fc246b91ed tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:47.246345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d0cab2f0-e18b-42c8-b154-7b51569780e5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:47.263127 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d0cab2f0-e18b-42c8-b154-7b51569780e5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1695 microversion: 2.1 time: 0.454415 May 28 21:26:47.273887 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2546/5043] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:46 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1695 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:47.296750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-62bf42dd-9ddf-47e8-aa92-c3fc246b91ed tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:47.306281 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-62bf42dd-9ddf-47e8-aa92-c3fc246b91ed tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1507 microversion: 2.1 time: 0.339113 May 28 21:26:47.306877 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2498/5044] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:46 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:48.280804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f8891aac-8f03-4e5c-9670-a5e8face1800 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:48.282221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f8891aac-8f03-4e5c-9670-a5e8face1800 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:48.291451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8891aac-8f03-4e5c-9670-a5e8face1800 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:48.292060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8891aac-8f03-4e5c-9670-a5e8face1800 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:48.293101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8891aac-8f03-4e5c-9670-a5e8face1800 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:48.293898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8891aac-8f03-4e5c-9670-a5e8face1800 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:48.325862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fdd9ff48-6d86-4a97-9e5a-3e125fb8f32a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:48.326497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fdd9ff48-6d86-4a97-9e5a-3e125fb8f32a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:48.339837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdd9ff48-6d86-4a97-9e5a-3e125fb8f32a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:48.343991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdd9ff48-6d86-4a97-9e5a-3e125fb8f32a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:48.343991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdd9ff48-6d86-4a97-9e5a-3e125fb8f32a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:48.343991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fdd9ff48-6d86-4a97-9e5a-3e125fb8f32a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:48.719935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f8891aac-8f03-4e5c-9670-a5e8face1800 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:48.729613 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f8891aac-8f03-4e5c-9670-a5e8face1800 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1694 microversion: 2.1 time: 0.452856 May 28 21:26:48.746437 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2547/5045] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:48 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1694 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:48.749163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fdd9ff48-6d86-4a97-9e5a-3e125fb8f32a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:48.761722 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fdd9ff48-6d86-4a97-9e5a-3e125fb8f32a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1507 microversion: 2.1 time: 0.439404 May 28 21:26:48.772733 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2499/5046] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:48 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1507 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:49.751642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e3d18b2a-6ec8-4e8f-b0c2-2cca503e2e61 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:49.752297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e3d18b2a-6ec8-4e8f-b0c2-2cca503e2e61 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:49.760014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3d18b2a-6ec8-4e8f-b0c2-2cca503e2e61 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:49.760478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3d18b2a-6ec8-4e8f-b0c2-2cca503e2e61 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:49.761258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3d18b2a-6ec8-4e8f-b0c2-2cca503e2e61 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:49.761920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3d18b2a-6ec8-4e8f-b0c2-2cca503e2e61 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:49.779842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-11295d4b-4040-4998-b05b-ebae52a15bdd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:49.782354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-11295d4b-4040-4998-b05b-ebae52a15bdd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:49.791179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11295d4b-4040-4998-b05b-ebae52a15bdd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:49.791722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11295d4b-4040-4998-b05b-ebae52a15bdd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:49.792768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11295d4b-4040-4998-b05b-ebae52a15bdd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:49.794316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11295d4b-4040-4998-b05b-ebae52a15bdd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:50.018190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-11295d4b-4040-4998-b05b-ebae52a15bdd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:50.025160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e3d18b2a-6ec8-4e8f-b0c2-2cca503e2e61 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:50.030888 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-11295d4b-4040-4998-b05b-ebae52a15bdd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1507 microversion: 2.1 time: 0.255219 May 28 21:26:50.031905 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2500/5047] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:49 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:50.050900 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e3d18b2a-6ec8-4e8f-b0c2-2cca503e2e61 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1694 microversion: 2.1 time: 0.306622 May 28 21:26:50.057759 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2548/5048] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:49 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1694 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:50.602822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-34f68830-56dc-473c-9ecb-384f4fe79b16 req-d86d3bb3-a83a-4632-9099-186013980027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38a270e-eebf-4adc-93a3-e4a5bac81ee2", "name": "network-vif-unplugged", "status": "completed", "tag": "b5a42f07-fe9d-45f6-9f24-d15afa18b370"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:50.611644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-34f68830-56dc-473c-9ecb-384f4fe79b16 req-d86d3bb3-a83a-4632-9099-186013980027 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:50.612349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-34f68830-56dc-473c-9ecb-384f4fe79b16 req-d86d3bb3-a83a-4632-9099-186013980027 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:50.629768 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-34f68830-56dc-473c-9ecb-384f4fe79b16 req-d86d3bb3-a83a-4632-9099-186013980027 service nova] Creating event network-vif-unplugged:b5a42f07-fe9d-45f6-9f24-d15afa18b370 for instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 on nch1-master-1 May 28 21:26:50.636349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-34f68830-56dc-473c-9ecb-384f4fe79b16 req-d86d3bb3-a83a-4632-9099-186013980027 service nova] Instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:26:50.648111 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-34f68830-56dc-473c-9ecb-384f4fe79b16 req-d86d3bb3-a83a-4632-9099-186013980027 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049220 May 28 21:26:50.649093 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2501/5049] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:26:51.047555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c80fdd0f-df50-4590-91a1-cf8964b75dbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:51.048125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c80fdd0f-df50-4590-91a1-cf8964b75dbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:51.070130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c80fdd0f-df50-4590-91a1-cf8964b75dbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:51.072432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c80fdd0f-df50-4590-91a1-cf8964b75dbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:51.073275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c80fdd0f-df50-4590-91a1-cf8964b75dbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:51.073741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c80fdd0f-df50-4590-91a1-cf8964b75dbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:51.076017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7f394999-332a-4cc2-b321-c17e1662b4db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:51.076912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7f394999-332a-4cc2-b321-c17e1662b4db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:51.090712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f394999-332a-4cc2-b321-c17e1662b4db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:51.091178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f394999-332a-4cc2-b321-c17e1662b4db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:51.091976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f394999-332a-4cc2-b321-c17e1662b4db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:51.092424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f394999-332a-4cc2-b321-c17e1662b4db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:51.477053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c80fdd0f-df50-4590-91a1-cf8964b75dbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:51.483429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7f394999-332a-4cc2-b321-c17e1662b4db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:51.493371 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7f394999-332a-4cc2-b321-c17e1662b4db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1694 microversion: 2.1 time: 0.422023 May 28 21:26:51.495675 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c80fdd0f-df50-4590-91a1-cf8964b75dbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1450 microversion: 2.1 time: 0.452300 May 28 21:26:51.496877 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2502/5050] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:51 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1694 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:51.506286 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2549/5051] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:51 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1450 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:51.516089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1569a5aa-9f50-4673-8b2b-ed1fe4ab6d98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:51.517315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1569a5aa-9f50-4673-8b2b-ed1fe4ab6d98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:51.519843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-72e38c87-0034-4c2e-b678-c27c3de1d5c1 req-73ae7d8f-aefe-4991-9496-b5b7488ce685 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a798306b-2df0-4ef0-b523-13a226b16120", "name": "network-vif-unplugged", "status": "completed", "tag": "04aa786c-dc09-4f75-981b-7d1b73608c2b"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:51.537354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-72e38c87-0034-4c2e-b678-c27c3de1d5c1 req-73ae7d8f-aefe-4991-9496-b5b7488ce685 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:51.537354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-72e38c87-0034-4c2e-b678-c27c3de1d5c1 req-73ae7d8f-aefe-4991-9496-b5b7488ce685 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:51.539587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1569a5aa-9f50-4673-8b2b-ed1fe4ab6d98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:51.540283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1569a5aa-9f50-4673-8b2b-ed1fe4ab6d98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:51.543670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1569a5aa-9f50-4673-8b2b-ed1fe4ab6d98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:51.544357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1569a5aa-9f50-4673-8b2b-ed1fe4ab6d98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:51.559688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.compute.server_external_events [req-72e38c87-0034-4c2e-b678-c27c3de1d5c1 req-73ae7d8f-aefe-4991-9496-b5b7488ce685 service nova] Unable to find a host for instance a798306b-2df0-4ef0-b523-13a226b16120. Dropping event network-vif-unplugged {{(pid=143128) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 28 21:26:51.560697 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-72e38c87-0034-4c2e-b678-c27c3de1d5c1 req-73ae7d8f-aefe-4991-9496-b5b7488ce685 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.062521 May 28 21:26:51.561482 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2503/5052] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 64 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 28 21:26:51.839330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1569a5aa-9f50-4673-8b2b-ed1fe4ab6d98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:51.839330 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1569a5aa-9f50-4673-8b2b-ed1fe4ab6d98 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1450 microversion: 2.1 time: 0.325287 May 28 21:26:51.839330 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2550/5053] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:51 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1450 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:51.910165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8cef4153-4cd1-4545-9c77-67334ed1b08d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:51.913455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8cef4153-4cd1-4545-9c77-67334ed1b08d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:51.921989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cef4153-4cd1-4545-9c77-67334ed1b08d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:51.922859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cef4153-4cd1-4545-9c77-67334ed1b08d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:51.925070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cef4153-4cd1-4545-9c77-67334ed1b08d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:51.930714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cef4153-4cd1-4545-9c77-67334ed1b08d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:51.956129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-8cef4153-4cd1-4545-9c77-67334ed1b08d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lazy-loading 'flavor' on Instance uuid a798306b-2df0-4ef0-b523-13a226b16120 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:26:51.971041 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-8cef4153-4cd1-4545-9c77-67334ed1b08d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Cannot 'shelve' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state shelved_offloaded May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8cef4153-4cd1-4545-9c77-67334ed1b08d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action HTTP/1.1 May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 14 May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: {"shelve": {}} May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: exception: Cannot 'shelve' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state shelved_offloaded May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'a798306b-2df0-4ef0-b523-13a226b16120', 'body': {'shelve': {}}} May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a798306b-2df0-4ef0-b523-13a226b16120 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve May 28 21:26:51.973205 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state shelved_offloaded May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state shelved_offloaded May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8cef4153-4cd1-4545-9c77-67334ed1b08d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 409 to user: Cannot 'shelve' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state shelved_offloaded {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8cef4153-4cd1-4545-9c77-67334ed1b08d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action" status: 409 len: 155 microversion: 2.1 time: 0.074616 May 28 21:26:51.985077 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2504/5054] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:51 2022] POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action => generated 155 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:26:51.990467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-73847863-f718-4a3e-bc29-c0ae10730c74 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:51.991100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-73847863-f718-4a3e-bc29-c0ae10730c74 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:51.997327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73847863-f718-4a3e-bc29-c0ae10730c74 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:51.997792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73847863-f718-4a3e-bc29-c0ae10730c74 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:51.998637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73847863-f718-4a3e-bc29-c0ae10730c74 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:51.999280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73847863-f718-4a3e-bc29-c0ae10730c74 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:52.081077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:26:52.262073 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-73847863-f718-4a3e-bc29-c0ae10730c74 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action" status: 202 len: 0 microversion: 2.1 time: 0.275476 May 28 21:26:52.264784 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2551/5055] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:51 2022] POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:26:52.274891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2f7b140e-3a1e-4f31-a95a-7b9ed62f04e7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:52.283213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2f7b140e-3a1e-4f31-a95a-7b9ed62f04e7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:52.296428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f7b140e-3a1e-4f31-a95a-7b9ed62f04e7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:52.297097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f7b140e-3a1e-4f31-a95a-7b9ed62f04e7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:52.298175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f7b140e-3a1e-4f31-a95a-7b9ed62f04e7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:52.298955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f7b140e-3a1e-4f31-a95a-7b9ed62f04e7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:52.517859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc9af06d-7f7c-4c19-a94c-baf5eecddd92 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:52.518384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc9af06d-7f7c-4c19-a94c-baf5eecddd92 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:52.543249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc9af06d-7f7c-4c19-a94c-baf5eecddd92 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:52.549579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc9af06d-7f7c-4c19-a94c-baf5eecddd92 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:52.549579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc9af06d-7f7c-4c19-a94c-baf5eecddd92 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:52.549579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc9af06d-7f7c-4c19-a94c-baf5eecddd92 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:52.655815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2f7b140e-3a1e-4f31-a95a-7b9ed62f04e7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:52.667369 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2f7b140e-3a1e-4f31-a95a-7b9ed62f04e7 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1458 microversion: 2.1 time: 0.399433 May 28 21:26:52.671891 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2505/5056] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:52 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1458 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:52.677665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-433f2081-8fdf-407d-b264-c0f30e6c5d16 req-f7d05eca-8ae0-463b-b294-ea1acac3b605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d38a270e-eebf-4adc-93a3-e4a5bac81ee2", "tag": "b5a42f07-fe9d-45f6-9f24-d15afa18b370"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:52.689900 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-433f2081-8fdf-407d-b264-c0f30e6c5d16 req-f7d05eca-8ae0-463b-b294-ea1acac3b605 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:52.691124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-433f2081-8fdf-407d-b264-c0f30e6c5d16 req-f7d05eca-8ae0-463b-b294-ea1acac3b605 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:52.704909 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-433f2081-8fdf-407d-b264-c0f30e6c5d16 req-f7d05eca-8ae0-463b-b294-ea1acac3b605 service nova] Creating event network-changed:b5a42f07-fe9d-45f6-9f24-d15afa18b370 for instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 on nch1-master-1 May 28 21:26:52.711235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-433f2081-8fdf-407d-b264-c0f30e6c5d16 req-f7d05eca-8ae0-463b-b294-ea1acac3b605 service nova] Instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:26:52.724097 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-433f2081-8fdf-407d-b264-c0f30e6c5d16 req-f7d05eca-8ae0-463b-b294-ea1acac3b605 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049601 May 28 21:26:52.724620 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2506/5057] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:26:52.726474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc9af06d-7f7c-4c19-a94c-baf5eecddd92 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:52.734298 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc9af06d-7f7c-4c19-a94c-baf5eecddd92 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1694 microversion: 2.1 time: 0.226413 May 28 21:26:52.735279 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2552/5058] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:52 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1694 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:53.692738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4e98e1d3-b908-49e9-be82-49091332a037 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:53.694955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4e98e1d3-b908-49e9-be82-49091332a037 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:53.706494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e98e1d3-b908-49e9-be82-49091332a037 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:53.706494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e98e1d3-b908-49e9-be82-49091332a037 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:53.706494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e98e1d3-b908-49e9-be82-49091332a037 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:53.706972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e98e1d3-b908-49e9-be82-49091332a037 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:53.754378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fd5b1ddd-a67a-4d2d-94b9-407c109e9eef tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:53.755140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fd5b1ddd-a67a-4d2d-94b9-407c109e9eef tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:53.768032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd5b1ddd-a67a-4d2d-94b9-407c109e9eef tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:53.768259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd5b1ddd-a67a-4d2d-94b9-407c109e9eef tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:53.768905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd5b1ddd-a67a-4d2d-94b9-407c109e9eef tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:53.769366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd5b1ddd-a67a-4d2d-94b9-407c109e9eef tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:54.047071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4e98e1d3-b908-49e9-be82-49091332a037 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:54.058863 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4e98e1d3-b908-49e9-be82-49091332a037 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1458 microversion: 2.1 time: 0.374035 May 28 21:26:54.060482 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2507/5059] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:53 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1458 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:54.073831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fd5b1ddd-a67a-4d2d-94b9-407c109e9eef tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:54.093087 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fd5b1ddd-a67a-4d2d-94b9-407c109e9eef tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1692 microversion: 2.1 time: 0.344900 May 28 21:26:54.104616 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2553/5060] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:53 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1692 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:55.080191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6cd4b610-3559-40b2-9eec-71a911480b97 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:55.085908 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6cd4b610-3559-40b2-9eec-71a911480b97 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:55.096146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cd4b610-3559-40b2-9eec-71a911480b97 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:55.096911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cd4b610-3559-40b2-9eec-71a911480b97 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:55.097814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cd4b610-3559-40b2-9eec-71a911480b97 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:55.112679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f7c3479d-cd51-4146-ad7e-c4e5a308f730 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:55.114456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f7c3479d-cd51-4146-ad7e-c4e5a308f730 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:55.124250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6cd4b610-3559-40b2-9eec-71a911480b97 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:55.144655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7c3479d-cd51-4146-ad7e-c4e5a308f730 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:55.144655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7c3479d-cd51-4146-ad7e-c4e5a308f730 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:55.144655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7c3479d-cd51-4146-ad7e-c4e5a308f730 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:55.144655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7c3479d-cd51-4146-ad7e-c4e5a308f730 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:55.508308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6cd4b610-3559-40b2-9eec-71a911480b97 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:55.522267 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6cd4b610-3559-40b2-9eec-71a911480b97 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.447612 May 28 21:26:55.523777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f7c3479d-cd51-4146-ad7e-c4e5a308f730 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:55.533223 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2508/5061] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:55 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:55.535015 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f7c3479d-cd51-4146-ad7e-c4e5a308f730 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1689 microversion: 2.1 time: 0.426798 May 28 21:26:55.535673 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2554/5062] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:55 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1689 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:55.554151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ac7d3bab-69cd-4f82-8ad2-2048767bce82 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:55.554981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ac7d3bab-69cd-4f82-8ad2-2048767bce82 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:55.562663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac7d3bab-69cd-4f82-8ad2-2048767bce82 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:55.563455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac7d3bab-69cd-4f82-8ad2-2048767bce82 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:55.564476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac7d3bab-69cd-4f82-8ad2-2048767bce82 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:55.565176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac7d3bab-69cd-4f82-8ad2-2048767bce82 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:55.956923 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ac7d3bab-69cd-4f82-8ad2-2048767bce82 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2/action" status: 202 len: 0 microversion: 2.1 time: 0.407370 May 28 21:26:55.968402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e5914a44-54ee-45e3-b638-bfb9aa16a037 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:55.969545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e5914a44-54ee-45e3-b638-bfb9aa16a037 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:55.975755 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2509/5063] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:26:55 2022] POST /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:26:55.979189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5914a44-54ee-45e3-b638-bfb9aa16a037 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:55.980249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5914a44-54ee-45e3-b638-bfb9aa16a037 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:55.981558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5914a44-54ee-45e3-b638-bfb9aa16a037 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:55.983112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5914a44-54ee-45e3-b638-bfb9aa16a037 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:56.304189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e5914a44-54ee-45e3-b638-bfb9aa16a037 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:56.311348 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e5914a44-54ee-45e3-b638-bfb9aa16a037 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1688 microversion: 2.1 time: 0.348745 May 28 21:26:56.314573 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2555/5064] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:55 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1688 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:56.507690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a03b9a09-c6ce-414e-8498-278c57078bae req-0fc88f1a-7bc8-4a1e-9565-acee6a903d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a798306b-2df0-4ef0-b523-13a226b16120", "tag": "04aa786c-dc09-4f75-981b-7d1b73608c2b"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:56.515759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=82 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:26:56.531605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a03b9a09-c6ce-414e-8498-278c57078bae req-0fc88f1a-7bc8-4a1e-9565-acee6a903d72 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:56.540772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a03b9a09-c6ce-414e-8498-278c57078bae req-0fc88f1a-7bc8-4a1e-9565-acee6a903d72 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:56.540897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f02941c7-dec9-4822-83c7-d7673e02fa6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:56.541231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f02941c7-dec9-4822-83c7-d7673e02fa6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:56.549261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f02941c7-dec9-4822-83c7-d7673e02fa6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:56.549742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f02941c7-dec9-4822-83c7-d7673e02fa6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:56.550544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f02941c7-dec9-4822-83c7-d7673e02fa6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:56.559895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f02941c7-dec9-4822-83c7-d7673e02fa6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:56.567287 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a03b9a09-c6ce-414e-8498-278c57078bae req-0fc88f1a-7bc8-4a1e-9565-acee6a903d72 service nova] Creating event network-changed:04aa786c-dc09-4f75-981b-7d1b73608c2b for instance a798306b-2df0-4ef0-b523-13a226b16120 on nch2-master-1 May 28 21:26:56.578428 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a03b9a09-c6ce-414e-8498-278c57078bae req-0fc88f1a-7bc8-4a1e-9565-acee6a903d72 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075020 May 28 21:26:56.580081 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2510/5065] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:26:56.817872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f02941c7-dec9-4822-83c7-d7673e02fa6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:56.831805 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f02941c7-dec9-4822-83c7-d7673e02fa6a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.295615 May 28 21:26:56.833806 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2556/5066] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:56 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:57.334641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cf1dc904-c980-4167-bf0e-31fc604ad438 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:57.336830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cf1dc904-c980-4167-bf0e-31fc604ad438 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:57.359772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf1dc904-c980-4167-bf0e-31fc604ad438 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:57.359772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf1dc904-c980-4167-bf0e-31fc604ad438 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:57.359978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf1dc904-c980-4167-bf0e-31fc604ad438 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:57.360422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf1dc904-c980-4167-bf0e-31fc604ad438 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:57.482034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-0b3628c4-2ff7-4eae-912d-1b58ef4a6e49 req-2eec6bac-08be-4e31-99ea-9995d2cc30b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38a270e-eebf-4adc-93a3-e4a5bac81ee2", "name": "network-vif-plugged", "status": "completed", "tag": "b5a42f07-fe9d-45f6-9f24-d15afa18b370"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:26:57.499721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0b3628c4-2ff7-4eae-912d-1b58ef4a6e49 req-2eec6bac-08be-4e31-99ea-9995d2cc30b4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:57.502483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0b3628c4-2ff7-4eae-912d-1b58ef4a6e49 req-2eec6bac-08be-4e31-99ea-9995d2cc30b4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:57.515873 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-0b3628c4-2ff7-4eae-912d-1b58ef4a6e49 req-2eec6bac-08be-4e31-99ea-9995d2cc30b4 service nova] Creating event network-vif-plugged:b5a42f07-fe9d-45f6-9f24-d15afa18b370 for instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 on nch1-master-1 May 28 21:26:57.522540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-0b3628c4-2ff7-4eae-912d-1b58ef4a6e49 req-2eec6bac-08be-4e31-99ea-9995d2cc30b4 service nova] Instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:26:57.535739 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-0b3628c4-2ff7-4eae-912d-1b58ef4a6e49 req-2eec6bac-08be-4e31-99ea-9995d2cc30b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058288 May 28 21:26:57.547122 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2557/5067] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:26:57.765044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cf1dc904-c980-4167-bf0e-31fc604ad438 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:57.777608 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cf1dc904-c980-4167-bf0e-31fc604ad438 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1688 microversion: 2.1 time: 0.449706 May 28 21:26:57.778395 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2511/5068] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:57 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1688 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:57.856700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e697110f-16e1-4e34-9a56-9554508671d4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:57.857418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e697110f-16e1-4e34-9a56-9554508671d4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:57.864994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e697110f-16e1-4e34-9a56-9554508671d4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:57.865980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e697110f-16e1-4e34-9a56-9554508671d4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:57.873599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e697110f-16e1-4e34-9a56-9554508671d4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:57.874122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e697110f-16e1-4e34-9a56-9554508671d4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:58.324875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e697110f-16e1-4e34-9a56-9554508671d4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:58.339962 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e697110f-16e1-4e34-9a56-9554508671d4 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.487390 May 28 21:26:58.352596 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2558/5069] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:57 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:26:58.796688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-64d49175-7b2a-49bc-9ec4-97f8b0a85d40 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:58.797750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-64d49175-7b2a-49bc-9ec4-97f8b0a85d40 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:58.805027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64d49175-7b2a-49bc-9ec4-97f8b0a85d40 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:58.805764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64d49175-7b2a-49bc-9ec4-97f8b0a85d40 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:58.806792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64d49175-7b2a-49bc-9ec4-97f8b0a85d40 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:58.807404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64d49175-7b2a-49bc-9ec4-97f8b0a85d40 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:59.082506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-64d49175-7b2a-49bc-9ec4-97f8b0a85d40 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:59.092055 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-64d49175-7b2a-49bc-9ec4-97f8b0a85d40 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1688 microversion: 2.1 time: 0.300187 May 28 21:26:59.102411 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2512/5070] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:58 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1688 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:26:59.367955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-54460826-09c8-476b-a615-1811914f88a1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:26:59.367955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-54460826-09c8-476b-a615-1811914f88a1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:26:59.370724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54460826-09c8-476b-a615-1811914f88a1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:59.371319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54460826-09c8-476b-a615-1811914f88a1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:59.372234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54460826-09c8-476b-a615-1811914f88a1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:26:59.372787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-54460826-09c8-476b-a615-1811914f88a1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:26:59.599207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-54460826-09c8-476b-a615-1811914f88a1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:26:59.607637 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-54460826-09c8-476b-a615-1811914f88a1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.250886 May 28 21:26:59.608511 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2559/5071] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:26:59 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:00.113215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-70d5e05b-650a-415c-8865-2415865033ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:00.114824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-70d5e05b-650a-415c-8865-2415865033ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:00.150674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70d5e05b-650a-415c-8865-2415865033ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:00.154102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70d5e05b-650a-415c-8865-2415865033ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:00.154102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70d5e05b-650a-415c-8865-2415865033ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:00.154102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70d5e05b-650a-415c-8865-2415865033ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:00.191339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:00.620782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-5c77ad2f-e311-444e-9770-8931eb4e7b03 req-f90cf475-7aba-4f3e-9848-e359ef4b0607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38a270e-eebf-4adc-93a3-e4a5bac81ee2", "name": "network-vif-unplugged", "status": "completed", "tag": "b5a42f07-fe9d-45f6-9f24-d15afa18b370"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:00.639850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5c77ad2f-e311-444e-9770-8931eb4e7b03 req-f90cf475-7aba-4f3e-9848-e359ef4b0607 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:00.642337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5c77ad2f-e311-444e-9770-8931eb4e7b03 req-f90cf475-7aba-4f3e-9848-e359ef4b0607 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:00.673095 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-5c77ad2f-e311-444e-9770-8931eb4e7b03 req-f90cf475-7aba-4f3e-9848-e359ef4b0607 service nova] Creating event network-vif-unplugged:b5a42f07-fe9d-45f6-9f24-d15afa18b370 for instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 on nch2-master-1 May 28 21:27:00.688152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-5c77ad2f-e311-444e-9770-8931eb4e7b03 req-f90cf475-7aba-4f3e-9848-e359ef4b0607 service nova] Instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:27:00.703255 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-5c77ad2f-e311-444e-9770-8931eb4e7b03 req-f90cf475-7aba-4f3e-9848-e359ef4b0607 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087669 May 28 21:27:00.705288 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2560/5072] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:27:00.711452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-70d5e05b-650a-415c-8865-2415865033ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:00.712515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9dd3ade8-533c-4ebf-be9b-813d12792e92 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:00.713954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9dd3ade8-533c-4ebf-be9b-813d12792e92 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:00.722212 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-70d5e05b-650a-415c-8865-2415865033ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1688 microversion: 2.1 time: 0.615573 May 28 21:27:00.725177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9dd3ade8-533c-4ebf-be9b-813d12792e92 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:00.725919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9dd3ade8-533c-4ebf-be9b-813d12792e92 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:00.727317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9dd3ade8-533c-4ebf-be9b-813d12792e92 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:00.727936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9dd3ade8-533c-4ebf-be9b-813d12792e92 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:00.736160 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2513/5073] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:00 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1688 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:00.758022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84b85d79-161c-490a-918e-56924e145ab3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:00.759306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-84b85d79-161c-490a-918e-56924e145ab3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:00.772040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84b85d79-161c-490a-918e-56924e145ab3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:00.772040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84b85d79-161c-490a-918e-56924e145ab3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:00.772787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84b85d79-161c-490a-918e-56924e145ab3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:00.775250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84b85d79-161c-490a-918e-56924e145ab3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:01.139740 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-84b85d79-161c-490a-918e-56924e145ab3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.399738 May 28 21:27:01.149884 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2514/5074] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:27:00 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:27:01.180286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6217b09f-5294-422f-9480-1977cd99c882 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:01.188919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6217b09f-5294-422f-9480-1977cd99c882 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:01.210777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6217b09f-5294-422f-9480-1977cd99c882 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:01.215545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6217b09f-5294-422f-9480-1977cd99c882 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:01.218041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6217b09f-5294-422f-9480-1977cd99c882 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:01.219457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6217b09f-5294-422f-9480-1977cd99c882 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:02.246313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9dd3ade8-533c-4ebf-be9b-813d12792e92 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:02.262431 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9dd3ade8-533c-4ebf-be9b-813d12792e92 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 1.555521 May 28 21:27:02.267772 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2561/5075] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:00 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:02.277822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2054b9e5-88a8-45e3-8ae4-d6d77d1701c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:02.278750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2054b9e5-88a8-45e3-8ae4-d6d77d1701c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:02.285435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2054b9e5-88a8-45e3-8ae4-d6d77d1701c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:02.290856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2054b9e5-88a8-45e3-8ae4-d6d77d1701c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:02.290856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2054b9e5-88a8-45e3-8ae4-d6d77d1701c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:02.290856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2054b9e5-88a8-45e3-8ae4-d6d77d1701c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:02.336297 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6217b09f-5294-422f-9480-1977cd99c882 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:02.344204 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6217b09f-5294-422f-9480-1977cd99c882 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1673 microversion: 2.1 time: 1.180959 May 28 21:27:02.359611 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2515/5076] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:01 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1673 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:27:02.659368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-229241768", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:02.732674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:27:02.902952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2054b9e5-88a8-45e3-8ae4-d6d77d1701c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:02.918492 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2054b9e5-88a8-45e3-8ae4-d6d77d1701c7 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1688 microversion: 2.1 time: 0.644359 May 28 21:27:02.919137 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2562/5077] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:02 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1688 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:03.281750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8adc5c89-1318-4ef1-9b6f-f68336b89619 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:03.282588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8adc5c89-1318-4ef1-9b6f-f68336b89619 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:03.290270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8adc5c89-1318-4ef1-9b6f-f68336b89619 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:03.292930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8adc5c89-1318-4ef1-9b6f-f68336b89619 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:03.292930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8adc5c89-1318-4ef1-9b6f-f68336b89619 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:03.292930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8adc5c89-1318-4ef1-9b6f-f68336b89619 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:03.646816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:27:03.647378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:27:03.647732 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:27:03.648156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:27:03.648579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:27:03.668286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:03.669540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:03.670987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:03.672460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:03.704905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Getting quotas for project 760e1d0cdcff4948bc9f8849ecc56e1c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:27:03.724517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Getting quotas for user d470c6d9a88d4b758d9df497c450cffb and project 760e1d0cdcff4948bc9f8849ecc56e1c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:27:03.731164 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8adc5c89-1318-4ef1-9b6f-f68336b89619 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:03.742469 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8adc5c89-1318-4ef1-9b6f-f68336b89619 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.465742 May 28 21:27:03.753882 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2563/5078] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:03 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:03.760008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-088c175b-200e-4dee-8084-feae8e356f2f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:03.761088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-088c175b-200e-4dee-8084-feae8e356f2f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:03.770654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:27:03.777676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-088c175b-200e-4dee-8084-feae8e356f2f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:03.778661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-088c175b-200e-4dee-8084-feae8e356f2f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:03.783709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-088c175b-200e-4dee-8084-feae8e356f2f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:03.785500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-088c175b-200e-4dee-8084-feae8e356f2f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:03.794104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:27:04.018846 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e696e9cc-d599-4cc8-afae-c83f78c52a27 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.364289 May 28 21:27:04.026125 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2516/5079] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:27:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1372 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:27:04.045169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-bf57a8f1-2423-412b-a86d-b1fba5bcc1bf req-807e2b8c-dae9-4491-bc66-d3f9e14de779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d38a270e-eebf-4adc-93a3-e4a5bac81ee2", "tag": "b5a42f07-fe9d-45f6-9f24-d15afa18b370"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:04.059305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-bf57a8f1-2423-412b-a86d-b1fba5bcc1bf req-807e2b8c-dae9-4491-bc66-d3f9e14de779 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:04.060134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-bf57a8f1-2423-412b-a86d-b1fba5bcc1bf req-807e2b8c-dae9-4491-bc66-d3f9e14de779 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:04.099242 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-bf57a8f1-2423-412b-a86d-b1fba5bcc1bf req-807e2b8c-dae9-4491-bc66-d3f9e14de779 service nova] Creating event network-changed:b5a42f07-fe9d-45f6-9f24-d15afa18b370 for instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 on nch2-master-1 May 28 21:27:04.122088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-bf57a8f1-2423-412b-a86d-b1fba5bcc1bf req-807e2b8c-dae9-4491-bc66-d3f9e14de779 service nova] Instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:27:04.151871 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-bf57a8f1-2423-412b-a86d-b1fba5bcc1bf req-807e2b8c-dae9-4491-bc66-d3f9e14de779 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123955 May 28 21:27:04.158972 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2517/5080] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:27:04.189370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5b024d77-fe9b-45fe-8a50-0d2cbb628412 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:04.192254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5b024d77-fe9b-45fe-8a50-0d2cbb628412 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:04.229335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b024d77-fe9b-45fe-8a50-0d2cbb628412 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:04.229728 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b024d77-fe9b-45fe-8a50-0d2cbb628412 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:04.236484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b024d77-fe9b-45fe-8a50-0d2cbb628412 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:04.239506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b024d77-fe9b-45fe-8a50-0d2cbb628412 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:04.485673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-088c175b-200e-4dee-8084-feae8e356f2f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:04.489157 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-088c175b-200e-4dee-8084-feae8e356f2f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1673 microversion: 2.1 time: 0.733860 May 28 21:27:04.492025 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2564/5081] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:03 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1673 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:04.506790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-510ba146-0960-4dbd-82ce-02f9945f4181 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:04.506790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-510ba146-0960-4dbd-82ce-02f9945f4181 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:04.632830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5b024d77-fe9b-45fe-8a50-0d2cbb628412 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:04.653162 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5b024d77-fe9b-45fe-8a50-0d2cbb628412 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1688 microversion: 2.1 time: 0.494917 May 28 21:27:04.654247 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2518/5082] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:04 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1688 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:04.666758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-510ba146-0960-4dbd-82ce-02f9945f4181 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:04.683238 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-510ba146-0960-4dbd-82ce-02f9945f4181 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1214 microversion: 2.1 time: 0.189235 May 28 21:27:04.685795 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2565/5083] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:04 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1214 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:04.762778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-efc74379-eb7b-4abf-a9b7-b210c7cbb830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:04.764694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-efc74379-eb7b-4abf-a9b7-b210c7cbb830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:04.784735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efc74379-eb7b-4abf-a9b7-b210c7cbb830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:04.786039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efc74379-eb7b-4abf-a9b7-b210c7cbb830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:04.794903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efc74379-eb7b-4abf-a9b7-b210c7cbb830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:04.795370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efc74379-eb7b-4abf-a9b7-b210c7cbb830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:05.278865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-efc74379-eb7b-4abf-a9b7-b210c7cbb830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:05.306702 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-efc74379-eb7b-4abf-a9b7-b210c7cbb830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.549314 May 28 21:27:05.320067 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2519/5084] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:04 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:05.509237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-97814632-2177-42b2-ab13-10f0222f3a77 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:05.510778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-97814632-2177-42b2-ab13-10f0222f3a77 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:05.523645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97814632-2177-42b2-ab13-10f0222f3a77 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:05.538418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97814632-2177-42b2-ab13-10f0222f3a77 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:05.539752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97814632-2177-42b2-ab13-10f0222f3a77 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:05.542586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-97814632-2177-42b2-ab13-10f0222f3a77 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:05.690635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3cbe6974-287b-4ff7-bf95-426b248d84ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:05.693035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3cbe6974-287b-4ff7-bf95-426b248d84ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:05.741511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cbe6974-287b-4ff7-bf95-426b248d84ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:05.744434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cbe6974-287b-4ff7-bf95-426b248d84ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:05.748018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cbe6974-287b-4ff7-bf95-426b248d84ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:05.753338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3cbe6974-287b-4ff7-bf95-426b248d84ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:05.838740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-97814632-2177-42b2-ab13-10f0222f3a77 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:05.849029 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-97814632-2177-42b2-ab13-10f0222f3a77 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.344114 May 28 21:27:05.849670 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2566/5085] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:05 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:05.859466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-774001b2-653b-4222-9db3-7938e16ef80d tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:05.878025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-774001b2-653b-4222-9db3-7938e16ef80d tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:05.878810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-774001b2-653b-4222-9db3-7938e16ef80d tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:05.879508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-774001b2-653b-4222-9db3-7938e16ef80d tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:05.880734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-774001b2-653b-4222-9db3-7938e16ef80d tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:05.882377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-774001b2-653b-4222-9db3-7938e16ef80d tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:05.998215 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-774001b2-653b-4222-9db3-7938e16ef80d tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:06.021288 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-774001b2-653b-4222-9db3-7938e16ef80d tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1218 microversion: 2.1 time: 0.170459 May 28 21:27:06.022431 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2567/5086] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:05 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1218 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:06.091771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3cbe6974-287b-4ff7-bf95-426b248d84ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:06.102677 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3cbe6974-287b-4ff7-bf95-426b248d84ab tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1688 microversion: 2.1 time: 0.424653 May 28 21:27:06.104307 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2520/5087] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:05 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1688 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:27:06.328018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9b6c13d7-6326-44e3-98a9-faeb95ba1830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:06.328828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9b6c13d7-6326-44e3-98a9-faeb95ba1830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:06.335170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b6c13d7-6326-44e3-98a9-faeb95ba1830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:06.335854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b6c13d7-6326-44e3-98a9-faeb95ba1830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:06.336640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b6c13d7-6326-44e3-98a9-faeb95ba1830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:06.337084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b6c13d7-6326-44e3-98a9-faeb95ba1830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:06.506607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9b6c13d7-6326-44e3-98a9-faeb95ba1830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:06.515115 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9b6c13d7-6326-44e3-98a9-faeb95ba1830 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.191015 May 28 21:27:06.515940 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2568/5088] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:06 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:27:07.047143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ed0d39e6-4323-4519-ae5b-0f4c4cea9a41 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:07.047143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ed0d39e6-4323-4519-ae5b-0f4c4cea9a41 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:07.060711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed0d39e6-4323-4519-ae5b-0f4c4cea9a41 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:07.061182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed0d39e6-4323-4519-ae5b-0f4c4cea9a41 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:07.064208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed0d39e6-4323-4519-ae5b-0f4c4cea9a41 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:07.064969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed0d39e6-4323-4519-ae5b-0f4c4cea9a41 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:07.121358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-59a9596f-01af-45bf-a87d-e90428d813f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:07.122508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-59a9596f-01af-45bf-a87d-e90428d813f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:07.154219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-59a9596f-01af-45bf-a87d-e90428d813f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:07.157859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-59a9596f-01af-45bf-a87d-e90428d813f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:07.159234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-59a9596f-01af-45bf-a87d-e90428d813f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:07.159984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-59a9596f-01af-45bf-a87d-e90428d813f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:07.204025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:07.213673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ed0d39e6-4323-4519-ae5b-0f4c4cea9a41 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:07.225276 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ed0d39e6-4323-4519-ae5b-0f4c4cea9a41 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1274 microversion: 2.1 time: 0.190205 May 28 21:27:07.226598 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2521/5089] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:07 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1274 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:07.531861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-65181436-d0da-459d-9d42-8b2bdfffd220 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:07.532500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-65181436-d0da-459d-9d42-8b2bdfffd220 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:07.545415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65181436-d0da-459d-9d42-8b2bdfffd220 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:07.553936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65181436-d0da-459d-9d42-8b2bdfffd220 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:07.555195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65181436-d0da-459d-9d42-8b2bdfffd220 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:07.555841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65181436-d0da-459d-9d42-8b2bdfffd220 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:07.610617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-59a9596f-01af-45bf-a87d-e90428d813f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:07.619020 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-59a9596f-01af-45bf-a87d-e90428d813f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1688 microversion: 2.1 time: 0.502168 May 28 21:27:07.622859 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2569/5090] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:07 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1688 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:07.811738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-65181436-d0da-459d-9d42-8b2bdfffd220 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:07.820607 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-65181436-d0da-459d-9d42-8b2bdfffd220 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.292641 May 28 21:27:07.821864 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2522/5091] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:07 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:08.243889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c88ea3e8-14eb-43a3-9ce0-567069a3e698 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:08.244901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c88ea3e8-14eb-43a3-9ce0-567069a3e698 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:08.261510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c88ea3e8-14eb-43a3-9ce0-567069a3e698 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:08.265087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c88ea3e8-14eb-43a3-9ce0-567069a3e698 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:08.266204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c88ea3e8-14eb-43a3-9ce0-567069a3e698 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:08.266833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c88ea3e8-14eb-43a3-9ce0-567069a3e698 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:08.415040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c88ea3e8-14eb-43a3-9ce0-567069a3e698 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:08.423674 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c88ea3e8-14eb-43a3-9ce0-567069a3e698 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1272 microversion: 2.1 time: 0.184436 May 28 21:27:08.424874 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2570/5092] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:08 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:08.640676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-246d8f97-46fc-428b-918a-0faad033706e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:08.641394 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-246d8f97-46fc-428b-918a-0faad033706e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:08.648766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-246d8f97-46fc-428b-918a-0faad033706e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:08.649478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-246d8f97-46fc-428b-918a-0faad033706e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:08.650498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-246d8f97-46fc-428b-918a-0faad033706e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:08.651116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-246d8f97-46fc-428b-918a-0faad033706e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:08.838990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ecdae8e7-4d2f-46d9-b449-6afefba81fde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:08.843404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ecdae8e7-4d2f-46d9-b449-6afefba81fde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:08.850452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecdae8e7-4d2f-46d9-b449-6afefba81fde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:08.853392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecdae8e7-4d2f-46d9-b449-6afefba81fde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:08.855299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecdae8e7-4d2f-46d9-b449-6afefba81fde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:08.857535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ecdae8e7-4d2f-46d9-b449-6afefba81fde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:09.048179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-246d8f97-46fc-428b-918a-0faad033706e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:09.060656 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-246d8f97-46fc-428b-918a-0faad033706e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1681 microversion: 2.1 time: 0.423675 May 28 21:27:09.065751 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2523/5093] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:08 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1681 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:09.447508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-323fa3e5-6ebb-49c5-a0f6-53929fba49d6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:09.448969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-323fa3e5-6ebb-49c5-a0f6-53929fba49d6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:09.457205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-323fa3e5-6ebb-49c5-a0f6-53929fba49d6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:09.458100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-323fa3e5-6ebb-49c5-a0f6-53929fba49d6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:09.459174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-323fa3e5-6ebb-49c5-a0f6-53929fba49d6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:09.459846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-323fa3e5-6ebb-49c5-a0f6-53929fba49d6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:09.554340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ecdae8e7-4d2f-46d9-b449-6afefba81fde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:09.556173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-323fa3e5-6ebb-49c5-a0f6-53929fba49d6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:09.566968 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ecdae8e7-4d2f-46d9-b449-6afefba81fde tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.732186 May 28 21:27:09.567658 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2571/5094] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:08 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:09.568054 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-323fa3e5-6ebb-49c5-a0f6-53929fba49d6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1272 microversion: 2.1 time: 0.122463 May 28 21:27:09.577406 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2524/5095] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:09 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:27:10.584503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b54cb5f0-ff80-4022-8729-4b0c5384411e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:10.586542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b54cb5f0-ff80-4022-8729-4b0c5384411e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:10.587196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cbf4b551-e834-4bce-8bcc-942ef6b4ffbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:10.588817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cbf4b551-e834-4bce-8bcc-942ef6b4ffbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:10.594204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=70 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:10.596066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b54cb5f0-ff80-4022-8729-4b0c5384411e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:10.596571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b54cb5f0-ff80-4022-8729-4b0c5384411e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:10.597291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b54cb5f0-ff80-4022-8729-4b0c5384411e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:10.598039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b54cb5f0-ff80-4022-8729-4b0c5384411e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:10.599113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cbf4b551-e834-4bce-8bcc-942ef6b4ffbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:10.599716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cbf4b551-e834-4bce-8bcc-942ef6b4ffbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:10.600760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cbf4b551-e834-4bce-8bcc-942ef6b4ffbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:10.601320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cbf4b551-e834-4bce-8bcc-942ef6b4ffbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:10.860070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b54cb5f0-ff80-4022-8729-4b0c5384411e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:10.863086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cbf4b551-e834-4bce-8bcc-942ef6b4ffbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:10.868843 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b54cb5f0-ff80-4022-8729-4b0c5384411e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1314 microversion: 2.1 time: 0.288229 May 28 21:27:10.872542 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2572/5096] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:10 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:10.872668 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cbf4b551-e834-4bce-8bcc-942ef6b4ffbf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.290710 May 28 21:27:10.872668 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2525/5097] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:10 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:10.967609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-fd1d2e9e-386f-4d96-9e4e-875c8ff45f0e req-cd2ea500-ad9f-403b-90c1-732c08549d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38a270e-eebf-4adc-93a3-e4a5bac81ee2", "name": "network-vif-plugged", "status": "completed", "tag": "b5a42f07-fe9d-45f6-9f24-d15afa18b370"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:10.983647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-fd1d2e9e-386f-4d96-9e4e-875c8ff45f0e req-cd2ea500-ad9f-403b-90c1-732c08549d9e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:10.984111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-fd1d2e9e-386f-4d96-9e4e-875c8ff45f0e req-cd2ea500-ad9f-403b-90c1-732c08549d9e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:11.010511 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-fd1d2e9e-386f-4d96-9e4e-875c8ff45f0e req-cd2ea500-ad9f-403b-90c1-732c08549d9e service nova] Creating event network-vif-plugged:b5a42f07-fe9d-45f6-9f24-d15afa18b370 for instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 on nch2-master-1 May 28 21:27:11.016472 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-fd1d2e9e-386f-4d96-9e4e-875c8ff45f0e req-cd2ea500-ad9f-403b-90c1-732c08549d9e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052629 May 28 21:27:11.017924 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2573/5098] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:27:11.337041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-dfca5744-b353-43b0-9914-8d27873fbd2d req-47a0edfc-6123-4cd5-bd89-8f7a0efce467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de31255-d63b-4656-8a1b-bc9eb3a31e10", "tag": "18fbc0bb-2a21-4202-b425-f643fa1c94c1"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:11.353375 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-dfca5744-b353-43b0-9914-8d27873fbd2d req-47a0edfc-6123-4cd5-bd89-8f7a0efce467 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:11.354468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-dfca5744-b353-43b0-9914-8d27873fbd2d req-47a0edfc-6123-4cd5-bd89-8f7a0efce467 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:11.367192 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-dfca5744-b353-43b0-9914-8d27873fbd2d req-47a0edfc-6123-4cd5-bd89-8f7a0efce467 service nova] Creating event network-changed:18fbc0bb-2a21-4202-b425-f643fa1c94c1 for instance 8de31255-d63b-4656-8a1b-bc9eb3a31e10 on nch1-master-1 May 28 21:27:11.372909 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-dfca5744-b353-43b0-9914-8d27873fbd2d req-47a0edfc-6123-4cd5-bd89-8f7a0efce467 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040556 May 28 21:27:11.374193 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2526/5099] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:27:11.888761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4285200b-ccb1-483e-84ee-9961209472da tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:11.889719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-36f79cb2-00fb-4dcc-a51b-a8f947e9e5d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:11.891078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-36f79cb2-00fb-4dcc-a51b-a8f947e9e5d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:11.891397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4285200b-ccb1-483e-84ee-9961209472da tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:11.901774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36f79cb2-00fb-4dcc-a51b-a8f947e9e5d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:11.902916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36f79cb2-00fb-4dcc-a51b-a8f947e9e5d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:11.904938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36f79cb2-00fb-4dcc-a51b-a8f947e9e5d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:11.905115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4285200b-ccb1-483e-84ee-9961209472da tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:11.905628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36f79cb2-00fb-4dcc-a51b-a8f947e9e5d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:11.906429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4285200b-ccb1-483e-84ee-9961209472da tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:11.908055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4285200b-ccb1-483e-84ee-9961209472da tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:11.908055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4285200b-ccb1-483e-84ee-9961209472da tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:12.195841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4285200b-ccb1-483e-84ee-9961209472da tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:12.206542 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4285200b-ccb1-483e-84ee-9961209472da tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1314 microversion: 2.1 time: 0.322615 May 28 21:27:12.207141 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2574/5100] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:11 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:12.211461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-36f79cb2-00fb-4dcc-a51b-a8f947e9e5d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:12.219434 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-36f79cb2-00fb-4dcc-a51b-a8f947e9e5d5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.334488 May 28 21:27:12.220014 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2527/5101] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:11 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:13.223803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b0951f52-c3cc-41dd-927a-22f249f359e5 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:13.225052 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b0951f52-c3cc-41dd-927a-22f249f359e5 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:13.232534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0951f52-c3cc-41dd-927a-22f249f359e5 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:13.233534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0951f52-c3cc-41dd-927a-22f249f359e5 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:13.234420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0951f52-c3cc-41dd-927a-22f249f359e5 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:13.234954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b0951f52-c3cc-41dd-927a-22f249f359e5 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:13.239955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ac43ef7-9936-4203-856b-8fd66316761e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:13.241179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8ac43ef7-9936-4203-856b-8fd66316761e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:13.258140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ac43ef7-9936-4203-856b-8fd66316761e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:13.258592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ac43ef7-9936-4203-856b-8fd66316761e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:13.259388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ac43ef7-9936-4203-856b-8fd66316761e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:13.259830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ac43ef7-9936-4203-856b-8fd66316761e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:13.536053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b0951f52-c3cc-41dd-927a-22f249f359e5 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:13.543723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8ac43ef7-9936-4203-856b-8fd66316761e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:13.552069 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b0951f52-c3cc-41dd-927a-22f249f359e5 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1314 microversion: 2.1 time: 0.332429 May 28 21:27:13.553181 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2575/5102] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:13 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:13.563292 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8ac43ef7-9936-4203-856b-8fd66316761e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.326562 May 28 21:27:13.564056 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2528/5103] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:13 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:27:14.570917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-13a0914b-1b69-431a-aa3f-cde514b45e35 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:14.572661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-13a0914b-1b69-431a-aa3f-cde514b45e35 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:14.579800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13a0914b-1b69-431a-aa3f-cde514b45e35 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:14.581603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13a0914b-1b69-431a-aa3f-cde514b45e35 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:14.581603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13a0914b-1b69-431a-aa3f-cde514b45e35 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:14.581972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13a0914b-1b69-431a-aa3f-cde514b45e35 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:14.583241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-092ce31e-a35d-4537-bd86-ff1db9f310e5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:14.584862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-092ce31e-a35d-4537-bd86-ff1db9f310e5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:14.588665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:14.589770 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:14.594837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-092ce31e-a35d-4537-bd86-ff1db9f310e5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:14.623580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-092ce31e-a35d-4537-bd86-ff1db9f310e5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:14.623580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-092ce31e-a35d-4537-bd86-ff1db9f310e5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:14.623580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-092ce31e-a35d-4537-bd86-ff1db9f310e5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:14.676188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:14.874585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-13a0914b-1b69-431a-aa3f-cde514b45e35 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:14.882914 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-13a0914b-1b69-431a-aa3f-cde514b45e35 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1314 microversion: 2.1 time: 0.318038 May 28 21:27:14.883520 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2576/5104] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:14 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:14.921769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-092ce31e-a35d-4537-bd86-ff1db9f310e5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:14.933106 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-092ce31e-a35d-4537-bd86-ff1db9f310e5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.355859 May 28 21:27:14.933724 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2529/5105] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:14 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:15.900275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-38840bd5-0ab0-4032-a421-00c14b758b0e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:15.900986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-38840bd5-0ab0-4032-a421-00c14b758b0e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:15.908332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38840bd5-0ab0-4032-a421-00c14b758b0e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:15.908798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38840bd5-0ab0-4032-a421-00c14b758b0e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:15.909609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38840bd5-0ab0-4032-a421-00c14b758b0e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:15.910167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-38840bd5-0ab0-4032-a421-00c14b758b0e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:15.951919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ca62a89d-0846-477b-883e-940a13228e6d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:15.953291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ca62a89d-0846-477b-883e-940a13228e6d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:15.972347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca62a89d-0846-477b-883e-940a13228e6d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:15.975800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca62a89d-0846-477b-883e-940a13228e6d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:15.984572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca62a89d-0846-477b-883e-940a13228e6d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:15.985169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca62a89d-0846-477b-883e-940a13228e6d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:16.126954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-38840bd5-0ab0-4032-a421-00c14b758b0e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:16.144776 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-38840bd5-0ab0-4032-a421-00c14b758b0e tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1314 microversion: 2.1 time: 0.248319 May 28 21:27:16.145363 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2577/5106] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:15 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:16.193935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ca62a89d-0846-477b-883e-940a13228e6d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:16.196426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:16.202629 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ca62a89d-0846-477b-883e-940a13228e6d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.256062 May 28 21:27:16.203219 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2530/5107] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:15 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:27:16.931047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-26bf4975-a740-4b15-bef1-ff4fc5dcb2e9 req-eb015eae-d0cf-460e-913e-f7b8fd2f4052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a798306b-2df0-4ef0-b523-13a226b16120", "name": "network-vif-plugged", "status": "completed", "tag": "04aa786c-dc09-4f75-981b-7d1b73608c2b"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:16.945001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-26bf4975-a740-4b15-bef1-ff4fc5dcb2e9 req-eb015eae-d0cf-460e-913e-f7b8fd2f4052 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:16.946007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-26bf4975-a740-4b15-bef1-ff4fc5dcb2e9 req-eb015eae-d0cf-460e-913e-f7b8fd2f4052 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:16.961935 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-26bf4975-a740-4b15-bef1-ff4fc5dcb2e9 req-eb015eae-d0cf-460e-913e-f7b8fd2f4052 service nova] Creating event network-vif-plugged:04aa786c-dc09-4f75-981b-7d1b73608c2b for instance a798306b-2df0-4ef0-b523-13a226b16120 on nch2-master-1 May 28 21:27:16.967245 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-26bf4975-a740-4b15-bef1-ff4fc5dcb2e9 req-eb015eae-d0cf-460e-913e-f7b8fd2f4052 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039795 May 28 21:27:16.968169 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2578/5108] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:27:17.161737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9f699570-06db-4431-8e3f-8fb0fa3e5728 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:17.162378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9f699570-06db-4431-8e3f-8fb0fa3e5728 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:17.169740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f699570-06db-4431-8e3f-8fb0fa3e5728 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:17.170505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f699570-06db-4431-8e3f-8fb0fa3e5728 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:17.171511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f699570-06db-4431-8e3f-8fb0fa3e5728 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:17.172191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f699570-06db-4431-8e3f-8fb0fa3e5728 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:17.222023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-297ac83b-b8d7-4df5-8138-f78d9216ea4a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:17.223037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-297ac83b-b8d7-4df5-8138-f78d9216ea4a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:17.236196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-297ac83b-b8d7-4df5-8138-f78d9216ea4a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:17.236930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-297ac83b-b8d7-4df5-8138-f78d9216ea4a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:17.237926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-297ac83b-b8d7-4df5-8138-f78d9216ea4a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:17.239140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-297ac83b-b8d7-4df5-8138-f78d9216ea4a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:17.498673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9f699570-06db-4431-8e3f-8fb0fa3e5728 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:17.511847 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9f699570-06db-4431-8e3f-8fb0fa3e5728 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1314 microversion: 2.1 time: 0.353909 May 28 21:27:17.512497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-297ac83b-b8d7-4df5-8138-f78d9216ea4a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:17.522402 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2531/5109] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:17 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:17.523022 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-297ac83b-b8d7-4df5-8138-f78d9216ea4a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.305570 May 28 21:27:17.523622 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2579/5110] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:17 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:18.532853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ac3564dc-f3be-4ce7-b581-aa84b7e4fbc0 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:18.533506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ac3564dc-f3be-4ce7-b581-aa84b7e4fbc0 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:18.545264 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-afc4a322-edad-476c-91d9-67e184661e08 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:18.546192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-afc4a322-edad-476c-91d9-67e184661e08 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:18.549175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac3564dc-f3be-4ce7-b581-aa84b7e4fbc0 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:18.550161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac3564dc-f3be-4ce7-b581-aa84b7e4fbc0 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:18.557728 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac3564dc-f3be-4ce7-b581-aa84b7e4fbc0 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:18.557728 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac3564dc-f3be-4ce7-b581-aa84b7e4fbc0 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:18.558553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afc4a322-edad-476c-91d9-67e184661e08 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:18.558553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afc4a322-edad-476c-91d9-67e184661e08 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:18.558553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afc4a322-edad-476c-91d9-67e184661e08 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:18.558553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afc4a322-edad-476c-91d9-67e184661e08 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:18.768351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ac3564dc-f3be-4ce7-b581-aa84b7e4fbc0 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:18.774768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-afc4a322-edad-476c-91d9-67e184661e08 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:18.780513 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ac3564dc-f3be-4ce7-b581-aa84b7e4fbc0 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1314 microversion: 2.1 time: 0.255347 May 28 21:27:18.781149 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2532/5111] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:18 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:18.785243 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-afc4a322-edad-476c-91d9-67e184661e08 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.246301 May 28 21:27:18.787815 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2580/5112] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:18 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:27:18.982921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-c508e9b7-014d-4be0-95ca-ad012c597cca req-5b622eba-aa37-4a3e-a106-d9c0d47274bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de31255-d63b-4656-8a1b-bc9eb3a31e10", "name": "network-vif-plugged", "status": "completed", "tag": "18fbc0bb-2a21-4202-b425-f643fa1c94c1"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:18.994696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c508e9b7-014d-4be0-95ca-ad012c597cca req-5b622eba-aa37-4a3e-a106-d9c0d47274bd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:18.995157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c508e9b7-014d-4be0-95ca-ad012c597cca req-5b622eba-aa37-4a3e-a106-d9c0d47274bd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:19.007542 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-c508e9b7-014d-4be0-95ca-ad012c597cca req-5b622eba-aa37-4a3e-a106-d9c0d47274bd service nova] Creating event network-vif-plugged:18fbc0bb-2a21-4202-b425-f643fa1c94c1 for instance 8de31255-d63b-4656-8a1b-bc9eb3a31e10 on nch1-master-1 May 28 21:27:19.013307 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-c508e9b7-014d-4be0-95ca-ad012c597cca req-5b622eba-aa37-4a3e-a106-d9c0d47274bd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034393 May 28 21:27:19.014269 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2533/5113] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:27:19.798071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-980d4982-3ceb-466c-a716-4a68ff7781c4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:19.798710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-980d4982-3ceb-466c-a716-4a68ff7781c4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:19.802538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6f1a73eb-f749-4ca0-8b24-b8de926de18b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:19.803257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6f1a73eb-f749-4ca0-8b24-b8de926de18b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:19.805639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-980d4982-3ceb-466c-a716-4a68ff7781c4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:19.806145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-980d4982-3ceb-466c-a716-4a68ff7781c4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:19.806942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-980d4982-3ceb-466c-a716-4a68ff7781c4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:19.814838 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-980d4982-3ceb-466c-a716-4a68ff7781c4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:19.814961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f1a73eb-f749-4ca0-8b24-b8de926de18b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:19.814961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f1a73eb-f749-4ca0-8b24-b8de926de18b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:19.814961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f1a73eb-f749-4ca0-8b24-b8de926de18b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:19.814961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f1a73eb-f749-4ca0-8b24-b8de926de18b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:20.003454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-980d4982-3ceb-466c-a716-4a68ff7781c4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:20.012501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6f1a73eb-f749-4ca0-8b24-b8de926de18b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:20.012673 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-980d4982-3ceb-466c-a716-4a68ff7781c4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1314 microversion: 2.1 time: 0.218800 May 28 21:27:20.013448 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2581/5114] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:19 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:20.020846 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6f1a73eb-f749-4ca0-8b24-b8de926de18b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1516 microversion: 2.1 time: 0.222294 May 28 21:27:20.026423 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2534/5115] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:19 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1516 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:27:21.030175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e97aabfc-3ecd-4cfc-9300-d5d4202423b4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:21.030837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e97aabfc-3ecd-4cfc-9300-d5d4202423b4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:21.038500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a96d8d33-f3f2-47c8-9795-3abecf08f626 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:21.043064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e97aabfc-3ecd-4cfc-9300-d5d4202423b4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:21.043196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a96d8d33-f3f2-47c8-9795-3abecf08f626 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:21.043299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e97aabfc-3ecd-4cfc-9300-d5d4202423b4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:21.043299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e97aabfc-3ecd-4cfc-9300-d5d4202423b4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:21.043299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e97aabfc-3ecd-4cfc-9300-d5d4202423b4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:21.047704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a96d8d33-f3f2-47c8-9795-3abecf08f626 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:21.048297 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a96d8d33-f3f2-47c8-9795-3abecf08f626 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:21.049198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a96d8d33-f3f2-47c8-9795-3abecf08f626 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:21.049877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a96d8d33-f3f2-47c8-9795-3abecf08f626 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:21.271745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e97aabfc-3ecd-4cfc-9300-d5d4202423b4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:21.283924 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e97aabfc-3ecd-4cfc-9300-d5d4202423b4 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1463 microversion: 2.1 time: 0.257707 May 28 21:27:21.290606 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2582/5116] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:21 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1463 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:21.314190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a96d8d33-f3f2-47c8-9795-3abecf08f626 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:21.323899 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a96d8d33-f3f2-47c8-9795-3abecf08f626 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.290355 May 28 21:27:21.327257 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2535/5117] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:21 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:21.338256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-30793c4f-ac14-4ae0-9778-bcb355ac5313 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:21.339024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-30793c4f-ac14-4ae0-9778-bcb355ac5313 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:21.341423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c7ffb0a-2663-4485-9bca-4dbc2faffebf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:21.342117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8c7ffb0a-2663-4485-9bca-4dbc2faffebf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:21.347098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30793c4f-ac14-4ae0-9778-bcb355ac5313 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:21.347751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30793c4f-ac14-4ae0-9778-bcb355ac5313 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:21.348682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30793c4f-ac14-4ae0-9778-bcb355ac5313 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:21.349353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-30793c4f-ac14-4ae0-9778-bcb355ac5313 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:21.349746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c7ffb0a-2663-4485-9bca-4dbc2faffebf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:21.350272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c7ffb0a-2663-4485-9bca-4dbc2faffebf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:21.351223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c7ffb0a-2663-4485-9bca-4dbc2faffebf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:21.351766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c7ffb0a-2663-4485-9bca-4dbc2faffebf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:21.407747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-30793c4f-ac14-4ae0-9778-bcb355ac5313 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:27:21.502922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8c7ffb0a-2663-4485-9bca-4dbc2faffebf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:21.511631 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8c7ffb0a-2663-4485-9bca-4dbc2faffebf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.174103 May 28 21:27:21.523286 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2536/5118] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:21 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:27:21.537809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2c8d50a1-58a2-4883-be9a-550d397b772d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:21.538577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2c8d50a1-58a2-4883-be9a-550d397b772d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:21.544935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c8d50a1-58a2-4883-be9a-550d397b772d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:21.545458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c8d50a1-58a2-4883-be9a-550d397b772d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:21.546571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c8d50a1-58a2-4883-be9a-550d397b772d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:21.547240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c8d50a1-58a2-4883-be9a-550d397b772d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:21.693132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2c8d50a1-58a2-4883-be9a-550d397b772d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:21.701291 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2c8d50a1-58a2-4883-be9a-550d397b772d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.168346 May 28 21:27:21.701887 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2537/5119] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:21 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:21.718154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9a9527e6-0b80-438f-aae4-349c2504edfb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:21.725224 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-9a9527e6-0b80-438f-aae4-349c2504edfb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance 41557f01-8794-4c96-aae2-6dfe8f4bbc4a has no mapping to a cell. May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9a9527e6-0b80-438f-aae4-349c2504edfb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/41557f01-8794-4c96-aae2-6dfe8f4bbc4a/action HTTP/1.1 May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 15 May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: {"os-stop": {}} May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 41557f01-8794-4c96-aae2-6dfe8f4bbc4a has no mapping to a cell. May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '41557f01-8794-4c96-aae2-6dfe8f4bbc4a', 'body': {'os-stop': {}}} May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 41557f01-8794-4c96-aae2-6dfe8f4bbc4a has no mapping to a cell. May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 28 21:27:21.733344 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41557f01-8794-4c96-aae2-6dfe8f4bbc4a has no mapping to a cell. May 28 21:27:21.739263 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:21.739263 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:21.739263 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:21.739263 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:21.739263 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:21.739263 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:21.739263 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:27:21.739263 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:27:21.739263 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41557f01-8794-4c96-aae2-6dfe8f4bbc4a has no mapping to a cell. May 28 21:27:21.739263 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:21.739263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9a9527e6-0b80-438f-aae4-349c2504edfb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance 41557f01-8794-4c96-aae2-6dfe8f4bbc4a has no mapping to a cell. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:27:21.739263 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9a9527e6-0b80-438f-aae4-349c2504edfb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/41557f01-8794-4c96-aae2-6dfe8f4bbc4a/action" status: 404 len: 117 microversion: 2.1 time: 0.021728 May 28 21:27:21.739263 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2538/5120] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:27:21 2022] POST /compute/v2.1/servers/41557f01-8794-4c96-aae2-6dfe8f4bbc4a/action => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:27:21.746538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0c853431-a087-4868-a6a4-235f95c43420 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:21.747249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0c853431-a087-4868-a6a4-235f95c43420 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:21.761177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c853431-a087-4868-a6a4-235f95c43420 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:21.762946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c853431-a087-4868-a6a4-235f95c43420 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:21.762946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c853431-a087-4868-a6a4-235f95c43420 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:21.762946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c853431-a087-4868-a6a4-235f95c43420 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:21.825543 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-30793c4f-ac14-4ae0-9778-bcb355ac5313 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 204 len: 0 microversion: 2.1 time: 0.493838 May 28 21:27:21.829891 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2583/5121] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:27:21 2022] DELETE /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:27:21.836398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-394eaa14-9dec-4b3a-a800-2c2027daf9a3 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:21.837118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-394eaa14-9dec-4b3a-a800-2c2027daf9a3 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:21.845585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-394eaa14-9dec-4b3a-a800-2c2027daf9a3 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:21.846289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-394eaa14-9dec-4b3a-a800-2c2027daf9a3 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:21.847093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-394eaa14-9dec-4b3a-a800-2c2027daf9a3 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:21.847551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-394eaa14-9dec-4b3a-a800-2c2027daf9a3 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:21.995140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c853431-a087-4868-a6a4-235f95c43420 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:22.020640 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0c853431-a087-4868-a6a4-235f95c43420 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.278486 May 28 21:27:22.033906 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2539/5122] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:21 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:27:22.038880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-618f97ef-4828-47d3-9258-707bd68ac725 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:22.040249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-618f97ef-4828-47d3-9258-707bd68ac725 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:22.047350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-618f97ef-4828-47d3-9258-707bd68ac725 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:22.048062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-618f97ef-4828-47d3-9258-707bd68ac725 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:22.049251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-618f97ef-4828-47d3-9258-707bd68ac725 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:22.049701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-618f97ef-4828-47d3-9258-707bd68ac725 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:22.053560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-394eaa14-9dec-4b3a-a800-2c2027daf9a3 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:22.070270 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-394eaa14-9dec-4b3a-a800-2c2027daf9a3 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1469 microversion: 2.1 time: 0.238404 May 28 21:27:22.071569 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2584/5123] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:21 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1469 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:22.207896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-618f97ef-4828-47d3-9258-707bd68ac725 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:22.217558 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-618f97ef-4828-47d3-9258-707bd68ac725 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.182766 May 28 21:27:22.217558 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2540/5124] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:22 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:22.234169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-75752a58-616e-4c44-9d67-867980d8bbac tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:22.234812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-75752a58-616e-4c44-9d67-867980d8bbac tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 105926d4-79b1-4736-8e4f-46d186ce5767] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:22.240960 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-75752a58-616e-4c44-9d67-867980d8bbac tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance 105926d4-79b1-4736-8e4f-46d186ce5767 could not be found. May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-75752a58-616e-4c44-9d67-867980d8bbac tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/105926d4-79b1-4736-8e4f-46d186ce5767/action HTTP/1.1 May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 15 May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: {"suspend": {}} May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 105926d4-79b1-4736-8e4f-46d186ce5767 could not be found. May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '105926d4-79b1-4736-8e4f-46d186ce5767', 'body': {'suspend': {}}} May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 105926d4-79b1-4736-8e4f-46d186ce5767 could not be found. May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 105926d4-79b1-4736-8e4f-46d186ce5767 could not be found. May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:22.242830 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:22.247776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:27:22.247776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:27:22.247776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 105926d4-79b1-4736-8e4f-46d186ce5767 could not be found. May 28 21:27:22.247776 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:22.247776 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-75752a58-616e-4c44-9d67-867980d8bbac tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance 105926d4-79b1-4736-8e4f-46d186ce5767 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:27:22.247776 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-75752a58-616e-4c44-9d67-867980d8bbac tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/105926d4-79b1-4736-8e4f-46d186ce5767/action" status: 404 len: 111 microversion: 2.1 time: 0.014250 May 28 21:27:22.247776 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2585/5125] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:27:22 2022] POST /compute/v2.1/servers/105926d4-79b1-4736-8e4f-46d186ce5767/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:27:22.254249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aedc777a-89cd-4bbb-b5f4-ab11e6b6eb69 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:22.254962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aedc777a-89cd-4bbb-b5f4-ab11e6b6eb69 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:22.261214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aedc777a-89cd-4bbb-b5f4-ab11e6b6eb69 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:22.261756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aedc777a-89cd-4bbb-b5f4-ab11e6b6eb69 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:22.262643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aedc777a-89cd-4bbb-b5f4-ab11e6b6eb69 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:22.263180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aedc777a-89cd-4bbb-b5f4-ab11e6b6eb69 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:22.408316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aedc777a-89cd-4bbb-b5f4-ab11e6b6eb69 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:22.421151 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aedc777a-89cd-4bbb-b5f4-ab11e6b6eb69 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.171015 May 28 21:27:22.422034 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2541/5126] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:22 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:22.441114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1748ed0d-b179-4015-a035-ba7c1058937f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:22.441828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1748ed0d-b179-4015-a035-ba7c1058937f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:22.451116 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1748ed0d-b179-4015-a035-ba7c1058937f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:22.451933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1748ed0d-b179-4015-a035-ba7c1058937f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:22.453275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1748ed0d-b179-4015-a035-ba7c1058937f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:22.454270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1748ed0d-b179-4015-a035-ba7c1058937f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:22.602937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1748ed0d-b179-4015-a035-ba7c1058937f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:22.605346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:22.611436 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1748ed0d-b179-4015-a035-ba7c1058937f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.174184 May 28 21:27:22.616798 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2586/5127] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:22 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:22.628086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f89386ea-76e8-48af-a209-3dc7370593e0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:22.628701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f89386ea-76e8-48af-a209-3dc7370593e0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:22.634907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f89386ea-76e8-48af-a209-3dc7370593e0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:22.635368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f89386ea-76e8-48af-a209-3dc7370593e0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:22.636149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f89386ea-76e8-48af-a209-3dc7370593e0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:22.636778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f89386ea-76e8-48af-a209-3dc7370593e0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:22.663059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-f89386ea-76e8-48af-a209-3dc7370593e0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lazy-loading 'flavor' on Instance uuid a798306b-2df0-4ef0-b523-13a226b16120 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:27:23.088665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-efa345bf-4a7f-4bce-a1a3-9d56a325b65c tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:23.091517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-efa345bf-4a7f-4bce-a1a3-9d56a325b65c tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:23.092309 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f89386ea-76e8-48af-a209-3dc7370593e0 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action" status: 202 len: 0 microversion: 2.1 time: 0.468346 May 28 21:27:23.096399 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2542/5128] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:27:22 2022] POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:27:23.099016 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-efa345bf-4a7f-4bce-a1a3-9d56a325b65c tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:23.099547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-efa345bf-4a7f-4bce-a1a3-9d56a325b65c tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:23.100397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-efa345bf-4a7f-4bce-a1a3-9d56a325b65c tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:23.100912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-efa345bf-4a7f-4bce-a1a3-9d56a325b65c tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:23.101691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9818bcfd-47f7-4d75-be1b-f5831ddf8d56 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:23.102427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9818bcfd-47f7-4d75-be1b-f5831ddf8d56 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:23.124105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9818bcfd-47f7-4d75-be1b-f5831ddf8d56 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:23.124748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9818bcfd-47f7-4d75-be1b-f5831ddf8d56 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:23.125735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9818bcfd-47f7-4d75-be1b-f5831ddf8d56 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:23.126695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9818bcfd-47f7-4d75-be1b-f5831ddf8d56 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:23.319437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-efa345bf-4a7f-4bce-a1a3-9d56a325b65c tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:23.327155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9818bcfd-47f7-4d75-be1b-f5831ddf8d56 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:23.335090 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-efa345bf-4a7f-4bce-a1a3-9d56a325b65c tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1469 microversion: 2.1 time: 0.251096 May 28 21:27:23.337613 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9818bcfd-47f7-4d75-be1b-f5831ddf8d56 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1511 microversion: 2.1 time: 0.239929 May 28 21:27:23.338722 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2543/5129] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:23 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1511 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:23.353796 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2587/5130] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:23 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1469 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:27:23.912164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-e72142e8-c89d-434b-a76f-8e40368b208e req-3cb868ef-3321-479b-9df4-67b7e510d64e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de31255-d63b-4656-8a1b-bc9eb3a31e10", "name": "network-vif-deleted", "tag": "18fbc0bb-2a21-4202-b425-f643fa1c94c1"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:23.921291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e72142e8-c89d-434b-a76f-8e40368b208e req-3cb868ef-3321-479b-9df4-67b7e510d64e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:23.921742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e72142e8-c89d-434b-a76f-8e40368b208e req-3cb868ef-3321-479b-9df4-67b7e510d64e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:23.934483 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e72142e8-c89d-434b-a76f-8e40368b208e req-3cb868ef-3321-479b-9df4-67b7e510d64e service nova] Creating event network-vif-deleted:18fbc0bb-2a21-4202-b425-f643fa1c94c1 for instance 8de31255-d63b-4656-8a1b-bc9eb3a31e10 on nch1-master-1 May 28 21:27:23.940320 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-e72142e8-c89d-434b-a76f-8e40368b208e req-3cb868ef-3321-479b-9df4-67b7e510d64e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032011 May 28 21:27:23.941810 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2544/5131] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:27:24.353155 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-585ba9ac-586d-4b6b-98d3-5f219b35bd76 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:24.353789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-585ba9ac-586d-4b6b-98d3-5f219b35bd76 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:24.361715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-585ba9ac-586d-4b6b-98d3-5f219b35bd76 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:24.362235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-585ba9ac-586d-4b6b-98d3-5f219b35bd76 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:24.363028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-585ba9ac-586d-4b6b-98d3-5f219b35bd76 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:24.363479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-585ba9ac-586d-4b6b-98d3-5f219b35bd76 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:24.370377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-173953c2-cdae-46ac-8924-9359272acddf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:24.371293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-173953c2-cdae-46ac-8924-9359272acddf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:24.378714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-173953c2-cdae-46ac-8924-9359272acddf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:24.379647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-173953c2-cdae-46ac-8924-9359272acddf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:24.381031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-173953c2-cdae-46ac-8924-9359272acddf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:24.381725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-173953c2-cdae-46ac-8924-9359272acddf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:24.400312 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-585ba9ac-586d-4b6b-98d3-5f219b35bd76 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:24.401082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-585ba9ac-586d-4b6b-98d3-5f219b35bd76 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:24.401728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-585ba9ac-586d-4b6b-98d3-5f219b35bd76 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lazy-loading 'fault' on Instance uuid 8de31255-d63b-4656-8a1b-bc9eb3a31e10 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:27:24.475348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-585ba9ac-586d-4b6b-98d3-5f219b35bd76 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd470c6d9a88d4b758d9df497c450cffb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '760e1d0cdcff4948bc9f8849ecc56e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:24.483761 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-585ba9ac-586d-4b6b-98d3-5f219b35bd76 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 200 len: 1304 microversion: 2.1 time: 0.134993 May 28 21:27:24.485149 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2588/5132] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:24 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:24.632852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-173953c2-cdae-46ac-8924-9359272acddf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:24.644364 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-173953c2-cdae-46ac-8924-9359272acddf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1494 microversion: 2.1 time: 0.280421 May 28 21:27:24.645280 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2545/5133] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:24 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1494 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:24.664609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-039e2f24-2cad-4003-abaf-2829c467ff7b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:24.665919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-039e2f24-2cad-4003-abaf-2829c467ff7b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:24.672701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-039e2f24-2cad-4003-abaf-2829c467ff7b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:24.673374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-039e2f24-2cad-4003-abaf-2829c467ff7b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:24.674402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-039e2f24-2cad-4003-abaf-2829c467ff7b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:24.674850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-039e2f24-2cad-4003-abaf-2829c467ff7b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:24.700253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-039e2f24-2cad-4003-abaf-2829c467ff7b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lazy-loading 'flavor' on Instance uuid a798306b-2df0-4ef0-b523-13a226b16120 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:27:24.713293 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-039e2f24-2cad-4003-abaf-2829c467ff7b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Cannot 'suspend' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state suspended May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-039e2f24-2cad-4003-abaf-2829c467ff7b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action HTTP/1.1 May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 15 May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: {"suspend": {}} May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: exception: Cannot 'suspend' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state suspended May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'a798306b-2df0-4ef0-b523-13a226b16120', 'body': {'suspend': {}}} May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a798306b-2df0-4ef0-b523-13a226b16120 in vm_state suspended. Cannot suspend while the instance is in this state. May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend May 28 21:27:24.715089 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state suspended May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state suspended May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-039e2f24-2cad-4003-abaf-2829c467ff7b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 409 to user: Cannot 'suspend' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state suspended {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-039e2f24-2cad-4003-abaf-2829c467ff7b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action" status: 409 len: 148 microversion: 2.1 time: 0.059162 May 28 21:27:24.719664 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2589/5134] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:27:24 2022] POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action => generated 148 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:27:24.727055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bb244590-4a5d-4314-9a4a-6f6d3ca3abbb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:24.727606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bb244590-4a5d-4314-9a4a-6f6d3ca3abbb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:24.733696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb244590-4a5d-4314-9a4a-6f6d3ca3abbb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:24.734271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb244590-4a5d-4314-9a4a-6f6d3ca3abbb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:24.735050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb244590-4a5d-4314-9a4a-6f6d3ca3abbb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:24.735494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb244590-4a5d-4314-9a4a-6f6d3ca3abbb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:24.999265 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bb244590-4a5d-4314-9a4a-6f6d3ca3abbb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action" status: 202 len: 0 microversion: 2.1 time: 0.275794 May 28 21:27:25.000005 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2546/5135] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:27:24 2022] POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:27:25.008886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3e373da2-05fc-4e79-b730-3a048c2f45ef tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:25.009520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3e373da2-05fc-4e79-b730-3a048c2f45ef tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:25.018542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e373da2-05fc-4e79-b730-3a048c2f45ef tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:25.019009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e373da2-05fc-4e79-b730-3a048c2f45ef tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:25.020382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e373da2-05fc-4e79-b730-3a048c2f45ef tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:25.021222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e373da2-05fc-4e79-b730-3a048c2f45ef tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:25.233123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3e373da2-05fc-4e79-b730-3a048c2f45ef tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:25.243294 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3e373da2-05fc-4e79-b730-3a048c2f45ef tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1500 microversion: 2.1 time: 0.238763 May 28 21:27:25.244313 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2590/5136] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:25 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1500 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:25.503324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-52f3edae-ddd7-486e-b6c3-497f13a9ffe6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:25.504620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-52f3edae-ddd7-486e-b6c3-497f13a9ffe6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] [instance: 8de31255-d63b-4656-8a1b-bc9eb3a31e10] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:25.522974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52f3edae-ddd7-486e-b6c3-497f13a9ffe6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:25.523424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52f3edae-ddd7-486e-b6c3-497f13a9ffe6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:25.524215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52f3edae-ddd7-486e-b6c3-497f13a9ffe6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:25.524658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52f3edae-ddd7-486e-b6c3-497f13a9ffe6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:25.527888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:25.553692 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-52f3edae-ddd7-486e-b6c3-497f13a9ffe6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] HTTP exception thrown: Instance 8de31255-d63b-4656-8a1b-bc9eb3a31e10 could not be found. May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-52f3edae-ddd7-486e-b6c3-497f13a9ffe6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Request method failure captured: May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 HTTP/1.1 May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpOjN5_VhJh6aLhomrK-OZYHQtbmgoJa3TNX7B8Q2KOZ9qZTN2o-AivlGr06faeZvfXGxBRwUykLsbaSOYTqKgGHFxn9J_UAQPlSEZMRYx04NjVGuZfNoRgeDsqfmFpG-AKd_0oiZLxVQ2SCguqt26YFn-eU7jZ1z2ZKmgIUvjoT1Vc May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 760e1d0cdcff4948bc9f8849ecc56e1c May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-VolumesNegativeTest-1222424159 May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_760e1d0cdcff4948bc9f8849ecc56e1c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/760e1d0cdcff4948bc9f8849ecc56e1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/760e1d0cdcff4948bc9f8849ecc56e1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/760e1d0cdcff4948bc9f8849ecc56e1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-VolumesNegativeTest-1222424159 May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 760e1d0cdcff4948bc9f8849ecc56e1c May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-VolumesNegativeTest-1222424159 May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-VolumesNegativeTest-1222424159-project May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: d470c6d9a88d4b758d9df497c450cffb May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-VolumesNegativeTest-1222424159-project May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 8de31255-d63b-4656-8a1b-bc9eb3a31e10 could not be found. May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '8de31255-d63b-4656-8a1b-bc9eb3a31e10'} May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8de31255-d63b-4656-8a1b-bc9eb3a31e10 could not be found. May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8de31255-d63b-4656-8a1b-bc9eb3a31e10 could not be found. May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:25.555781 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:25.560960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:25.560960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:25.560960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:25.560960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:27:25.560960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:27:25.560960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8de31255-d63b-4656-8a1b-bc9eb3a31e10 could not be found. May 28 21:27:25.560960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:25.562524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-52f3edae-ddd7-486e-b6c3-497f13a9ffe6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] Returning 404 to user: Instance 8de31255-d63b-4656-8a1b-bc9eb3a31e10 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:27:25.563740 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-52f3edae-ddd7-486e-b6c3-497f13a9ffe6 tempest-VolumesNegativeTest-1222424159 tempest-VolumesNegativeTest-1222424159-project] 10.222.0.33 "GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10" status: 404 len: 111 microversion: 2.1 time: 0.065759 May 28 21:27:25.569988 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2547/5137] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:25 2022] GET /compute/v2.1/servers/8de31255-d63b-4656-8a1b-bc9eb3a31e10 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:27:26.262130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0604ac93-19e9-4f8a-a35b-bda0da009733 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:26.262869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0604ac93-19e9-4f8a-a35b-bda0da009733 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:26.269947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0604ac93-19e9-4f8a-a35b-bda0da009733 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:26.270418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0604ac93-19e9-4f8a-a35b-bda0da009733 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:26.271752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0604ac93-19e9-4f8a-a35b-bda0da009733 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:26.272207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0604ac93-19e9-4f8a-a35b-bda0da009733 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:26.420420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0604ac93-19e9-4f8a-a35b-bda0da009733 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:26.428088 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0604ac93-19e9-4f8a-a35b-bda0da009733 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1500 microversion: 2.1 time: 0.170098 May 28 21:27:26.428666 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2591/5138] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:26 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1500 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:27.444708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5b01d14c-62c9-4bfd-bdc6-9ccab54099dc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:27.445333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5b01d14c-62c9-4bfd-bdc6-9ccab54099dc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:27.448571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:27.456218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b01d14c-62c9-4bfd-bdc6-9ccab54099dc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:27.456971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b01d14c-62c9-4bfd-bdc6-9ccab54099dc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:27.457974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b01d14c-62c9-4bfd-bdc6-9ccab54099dc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:27.458585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b01d14c-62c9-4bfd-bdc6-9ccab54099dc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:27.611303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5b01d14c-62c9-4bfd-bdc6-9ccab54099dc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:27.619865 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5b01d14c-62c9-4bfd-bdc6-9ccab54099dc tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.179099 May 28 21:27:27.620442 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2548/5139] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:27 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:27.638249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0b95f7a8-f79c-49c3-a717-9dd812a35b87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:27.638952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0b95f7a8-f79c-49c3-a717-9dd812a35b87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:27.646120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b95f7a8-f79c-49c3-a717-9dd812a35b87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:27.646576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b95f7a8-f79c-49c3-a717-9dd812a35b87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:27.647338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b95f7a8-f79c-49c3-a717-9dd812a35b87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:27.647780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b95f7a8-f79c-49c3-a717-9dd812a35b87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:27.779123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0b95f7a8-f79c-49c3-a717-9dd812a35b87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:27.787519 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0b95f7a8-f79c-49c3-a717-9dd812a35b87 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.152570 May 28 21:27:27.792320 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2592/5140] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:27 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:27.803590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3f19c819-4e34-4e70-927a-06f063de77a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:27.804286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3f19c819-4e34-4e70-927a-06f063de77a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: dc8b4b09-77cf-4d57-98fd-0196ae6c966a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-3f19c819-4e34-4e70-927a-06f063de77a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance dc8b4b09-77cf-4d57-98fd-0196ae6c966a could not be found. May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3f19c819-4e34-4e70-927a-06f063de77a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/dc8b4b09-77cf-4d57-98fd-0196ae6c966a/action HTTP/1.1 May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 15 May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: {"unpause": {}} May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance dc8b4b09-77cf-4d57-98fd-0196ae6c966a could not be found. May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'dc8b4b09-77cf-4d57-98fd-0196ae6c966a', 'body': {'unpause': {}}} May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc8b4b09-77cf-4d57-98fd-0196ae6c966a could not be found. May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc8b4b09-77cf-4d57-98fd-0196ae6c966a could not be found. May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:27.815393 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:27.821674 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:27.821674 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:27.821674 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:27.821674 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:27:27.821674 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:27:27.821674 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc8b4b09-77cf-4d57-98fd-0196ae6c966a could not be found. May 28 21:27:27.821674 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:27.821674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3f19c819-4e34-4e70-927a-06f063de77a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance dc8b4b09-77cf-4d57-98fd-0196ae6c966a could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:27:27.821674 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3f19c819-4e34-4e70-927a-06f063de77a8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/dc8b4b09-77cf-4d57-98fd-0196ae6c966a/action" status: 404 len: 111 microversion: 2.1 time: 0.015643 May 28 21:27:27.821674 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2549/5141] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:27:27 2022] POST /compute/v2.1/servers/dc8b4b09-77cf-4d57-98fd-0196ae6c966a/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:27:27.828400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-166076a9-87d7-4091-baab-5a84a450079c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:27.829025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-166076a9-87d7-4091-baab-5a84a450079c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:27.835745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-166076a9-87d7-4091-baab-5a84a450079c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:27.836516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-166076a9-87d7-4091-baab-5a84a450079c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:27.838554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-166076a9-87d7-4091-baab-5a84a450079c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:27.839017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-166076a9-87d7-4091-baab-5a84a450079c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:27.978733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-166076a9-87d7-4091-baab-5a84a450079c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:27.986876 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-166076a9-87d7-4091-baab-5a84a450079c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.163649 May 28 21:27:27.998801 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2593/5142] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:27 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:28.004303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-32c53337-0eca-47df-b03d-956900a2f75d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:28.004974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-32c53337-0eca-47df-b03d-956900a2f75d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:28.012263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32c53337-0eca-47df-b03d-956900a2f75d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:28.012721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32c53337-0eca-47df-b03d-956900a2f75d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:28.019196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32c53337-0eca-47df-b03d-956900a2f75d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:28.019196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32c53337-0eca-47df-b03d-956900a2f75d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:28.245802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-32c53337-0eca-47df-b03d-956900a2f75d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:28.257291 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-32c53337-0eca-47df-b03d-956900a2f75d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.256932 May 28 21:27:28.258460 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2550/5143] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:27 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:27:28.277469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2e669624-a6a3-4d27-a4f7-d2a2b64d6fe9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:28.278620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2e669624-a6a3-4d27-a4f7-d2a2b64d6fe9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:28.290201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e669624-a6a3-4d27-a4f7-d2a2b64d6fe9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:28.295005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e669624-a6a3-4d27-a4f7-d2a2b64d6fe9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:28.295005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e669624-a6a3-4d27-a4f7-d2a2b64d6fe9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:28.295005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e669624-a6a3-4d27-a4f7-d2a2b64d6fe9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:28.326052 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-2e669624-a6a3-4d27-a4f7-d2a2b64d6fe9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Cannot 'unpause' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2e669624-a6a3-4d27-a4f7-d2a2b64d6fe9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action HTTP/1.1 May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 15 May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: {"unpause": {}} May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: exception: Cannot 'unpause' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'a798306b-2df0-4ef0-b523-13a226b16120', 'body': {'unpause': {}}} May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a798306b-2df0-4ef0-b523-13a226b16120 in vm_state active. Cannot unpause while the instance is in this state. May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:28.327561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:28.332678 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:28.332678 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:27:28.332678 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:27:28.332678 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:27:28.332678 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:28.332678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2e669624-a6a3-4d27-a4f7-d2a2b64d6fe9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 409 to user: Cannot 'unpause' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:27:28.332678 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2e669624-a6a3-4d27-a4f7-d2a2b64d6fe9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action" status: 409 len: 145 microversion: 2.1 time: 0.059322 May 28 21:27:28.332678 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2594/5144] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:27:28 2022] POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action => generated 145 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:27:28.339416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a44f612d-8fe4-4d1d-93b8-201913a38baf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:28.340147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a44f612d-8fe4-4d1d-93b8-201913a38baf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:28.347886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a44f612d-8fe4-4d1d-93b8-201913a38baf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:28.348429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a44f612d-8fe4-4d1d-93b8-201913a38baf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:28.349321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a44f612d-8fe4-4d1d-93b8-201913a38baf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:28.349854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a44f612d-8fe4-4d1d-93b8-201913a38baf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:28.496749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a44f612d-8fe4-4d1d-93b8-201913a38baf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:28.511149 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a44f612d-8fe4-4d1d-93b8-201913a38baf tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.170511 May 28 21:27:28.511149 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2551/5145] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:28 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:28.525649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-382cd23b-2a19-456d-ae7d-9008d558163b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:28.526311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-382cd23b-2a19-456d-ae7d-9008d558163b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:28.533418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-382cd23b-2a19-456d-ae7d-9008d558163b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:28.533934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-382cd23b-2a19-456d-ae7d-9008d558163b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:28.534759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-382cd23b-2a19-456d-ae7d-9008d558163b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:28.535215 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-382cd23b-2a19-456d-ae7d-9008d558163b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:28.670878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-382cd23b-2a19-456d-ae7d-9008d558163b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:28.691829 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-382cd23b-2a19-456d-ae7d-9008d558163b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.170739 May 28 21:27:28.694983 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2595/5146] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:28 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:28.711277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2d5ec015-eb11-4c60-aa6a-dd4be7861d6f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:28.711871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2d5ec015-eb11-4c60-aa6a-dd4be7861d6f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a92283f0-f742-4bfa-8ae1-cb563d50c79b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:28.717739 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-2d5ec015-eb11-4c60-aa6a-dd4be7861d6f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance a92283f0-f742-4bfa-8ae1-cb563d50c79b could not be found. May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2d5ec015-eb11-4c60-aa6a-dd4be7861d6f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/a92283f0-f742-4bfa-8ae1-cb563d50c79b/action HTTP/1.1 May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 18 May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: {"unshelve": null} May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance a92283f0-f742-4bfa-8ae1-cb563d50c79b could not be found. May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'a92283f0-f742-4bfa-8ae1-cb563d50c79b', 'body': {'unshelve': None}} May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a92283f0-f742-4bfa-8ae1-cb563d50c79b could not be found. May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a92283f0-f742-4bfa-8ae1-cb563d50c79b could not be found. May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:28.725407 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:28.730597 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:28.730597 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:27:28.730597 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:27:28.730597 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a92283f0-f742-4bfa-8ae1-cb563d50c79b could not be found. May 28 21:27:28.730597 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:28.730597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2d5ec015-eb11-4c60-aa6a-dd4be7861d6f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance a92283f0-f742-4bfa-8ae1-cb563d50c79b could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:27:28.730597 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2d5ec015-eb11-4c60-aa6a-dd4be7861d6f tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/a92283f0-f742-4bfa-8ae1-cb563d50c79b/action" status: 404 len: 111 microversion: 2.1 time: 0.014236 May 28 21:27:28.730597 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2552/5147] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:27:28 2022] POST /compute/v2.1/servers/a92283f0-f742-4bfa-8ae1-cb563d50c79b/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:27:28.731186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2eee1803-55d1-49fc-b3f2-7302aa28b76b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:28.731530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2eee1803-55d1-49fc-b3f2-7302aa28b76b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:28.737876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2eee1803-55d1-49fc-b3f2-7302aa28b76b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:28.738350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2eee1803-55d1-49fc-b3f2-7302aa28b76b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:28.739246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2eee1803-55d1-49fc-b3f2-7302aa28b76b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:28.740223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2eee1803-55d1-49fc-b3f2-7302aa28b76b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:28.918362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2eee1803-55d1-49fc-b3f2-7302aa28b76b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:28.925074 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2eee1803-55d1-49fc-b3f2-7302aa28b76b tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.198632 May 28 21:27:28.929904 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2596/5148] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:28 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:28.945531 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eb524b11-773b-47ca-87ea-bae5b8b90cf8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:28.946239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eb524b11-773b-47ca-87ea-bae5b8b90cf8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:28.954113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb524b11-773b-47ca-87ea-bae5b8b90cf8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:28.954889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb524b11-773b-47ca-87ea-bae5b8b90cf8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:28.955746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb524b11-773b-47ca-87ea-bae5b8b90cf8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:28.956663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb524b11-773b-47ca-87ea-bae5b8b90cf8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:29.141012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eb524b11-773b-47ca-87ea-bae5b8b90cf8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:29.153948 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eb524b11-773b-47ca-87ea-bae5b8b90cf8 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.211676 May 28 21:27:29.169334 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2553/5149] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:28 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:29.175366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8569dfb7-689b-4cc0-9055-ff344f4157ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:29.177270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8569dfb7-689b-4cc0-9055-ff344f4157ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:29.195922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8569dfb7-689b-4cc0-9055-ff344f4157ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:29.196517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8569dfb7-689b-4cc0-9055-ff344f4157ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:29.197308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8569dfb7-689b-4cc0-9055-ff344f4157ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:29.198266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8569dfb7-689b-4cc0-9055-ff344f4157ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:29.248665 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-8569dfb7-689b-4cc0-9055-ff344f4157ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Cannot 'unshelve' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8569dfb7-689b-4cc0-9055-ff344f4157ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action HTTP/1.1 May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 18 May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: {"unshelve": null} May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: exception: Cannot 'unshelve' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'a798306b-2df0-4ef0-b523-13a226b16120', 'body': {'unshelve': None}} May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a798306b-2df0-4ef0-b523-13a226b16120 in vm_state active. Cannot unshelve while the instance is in this state. May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:27:29.250774 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:29.255068 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:29.255068 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:29.255068 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:29.255068 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:29.255068 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:29.255068 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:27:29.255068 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:27:29.255068 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active May 28 21:27:29.255068 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:29.255068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8569dfb7-689b-4cc0-9055-ff344f4157ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 409 to user: Cannot 'unshelve' instance a798306b-2df0-4ef0-b523-13a226b16120 while it is in vm_state active {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:27:29.255068 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8569dfb7-689b-4cc0-9055-ff344f4157ab tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action" status: 409 len: 146 microversion: 2.1 time: 0.082103 May 28 21:27:29.255068 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2597/5150] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:27:29 2022] POST /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120/action => generated 146 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 28 21:27:29.262505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f0c216dc-04ef-45a6-8b89-435ecdecd6cd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:29.267291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f0c216dc-04ef-45a6-8b89-435ecdecd6cd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:29.269823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0c216dc-04ef-45a6-8b89-435ecdecd6cd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:29.270620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0c216dc-04ef-45a6-8b89-435ecdecd6cd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:29.272298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0c216dc-04ef-45a6-8b89-435ecdecd6cd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:29.273506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0c216dc-04ef-45a6-8b89-435ecdecd6cd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:29.469643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f0c216dc-04ef-45a6-8b89-435ecdecd6cd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:29.481906 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f0c216dc-04ef-45a6-8b89-435ecdecd6cd tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.221358 May 28 21:27:29.481906 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2554/5151] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:29 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:29.497547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-15f1e416-d33d-4710-8be5-f4ee622f50f1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:29.498328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-15f1e416-d33d-4710-8be5-f4ee622f50f1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:29.504619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15f1e416-d33d-4710-8be5-f4ee622f50f1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:29.506681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15f1e416-d33d-4710-8be5-f4ee622f50f1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:29.506681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15f1e416-d33d-4710-8be5-f4ee622f50f1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:29.506681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15f1e416-d33d-4710-8be5-f4ee622f50f1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:29.677693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-15f1e416-d33d-4710-8be5-f4ee622f50f1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:29.688263 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-15f1e416-d33d-4710-8be5-f4ee622f50f1 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.194563 May 28 21:27:29.690446 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2598/5152] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:29 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:29.707139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b560d28f-254f-4830-b55d-567bfce99580 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1309993294_updated"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:29.708360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b560d28f-254f-4830-b55d-567bfce99580 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 31b0e4be-7b4b-4972-bc2f-7a9bf85758fa] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:29.715022 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-b560d28f-254f-4830-b55d-567bfce99580 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance 31b0e4be-7b4b-4972-bc2f-7a9bf85758fa could not be found. May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b560d28f-254f-4830-b55d-567bfce99580 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: request: PUT /compute/v2.1/servers/31b0e4be-7b4b-4972-bc2f-7a9bf85758fa HTTP/1.1 May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 81 May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1309993294_updated"}} May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 31b0e4be-7b4b-4972-bc2f-7a9bf85758fa could not be found. May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '31b0e4be-7b4b-4972-bc2f-7a9bf85758fa', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1309993294_updated'}}} May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b0e4be-7b4b-4972-bc2f-7a9bf85758fa could not be found. May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 28 21:27:29.716687 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b0e4be-7b4b-4972-bc2f-7a9bf85758fa could not be found. May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b0e4be-7b4b-4972-bc2f-7a9bf85758fa could not be found. May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b560d28f-254f-4830-b55d-567bfce99580 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance 31b0e4be-7b4b-4972-bc2f-7a9bf85758fa could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b560d28f-254f-4830-b55d-567bfce99580 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "PUT /compute/v2.1/servers/31b0e4be-7b4b-4972-bc2f-7a9bf85758fa" status: 404 len: 111 microversion: 2.1 time: 0.015372 May 28 21:27:29.722151 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2555/5153] 10.222.0.33 () {60 vars in 1255 bytes} [Sat May 28 21:27:29 2022] PUT /compute/v2.1/servers/31b0e4be-7b4b-4972-bc2f-7a9bf85758fa => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:27:29.731536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-202b049a-95a8-42c2-a54c-e1f8e0c91e7d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:29.732356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-202b049a-95a8-42c2-a54c-e1f8e0c91e7d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:29.738927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-202b049a-95a8-42c2-a54c-e1f8e0c91e7d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:29.739459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-202b049a-95a8-42c2-a54c-e1f8e0c91e7d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:29.740395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-202b049a-95a8-42c2-a54c-e1f8e0c91e7d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:29.740915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-202b049a-95a8-42c2-a54c-e1f8e0c91e7d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:29.947024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-202b049a-95a8-42c2-a54c-e1f8e0c91e7d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:29.962901 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-202b049a-95a8-42c2-a54c-e1f8e0c91e7d tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.228731 May 28 21:27:29.962901 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2599/5154] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:29 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:29.978490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-50596515-2478-4bcf-9972-c8ec5532dbe3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:29.979115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-50596515-2478-4bcf-9972-c8ec5532dbe3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:29.988540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50596515-2478-4bcf-9972-c8ec5532dbe3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:29.992450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50596515-2478-4bcf-9972-c8ec5532dbe3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:29.992450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50596515-2478-4bcf-9972-c8ec5532dbe3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:29.992450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50596515-2478-4bcf-9972-c8ec5532dbe3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:30.166086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-50596515-2478-4bcf-9972-c8ec5532dbe3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:30.176401 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-50596515-2478-4bcf-9972-c8ec5532dbe3 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.201752 May 28 21:27:30.178989 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2556/5155] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:29 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:30.204167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c3033b03-93e1-4a48-a11d-1e25c3596633 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c3033b03-93e1-4a48-a11d-1e25c3596633 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: request: PUT /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 HTTP/1.1 May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 280 May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'a798306b-2df0-4ef0-b523-13a226b16120', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:30.205282 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long May 28 21:27:30.209212 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:30.212681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c3033b03-93e1-4a48-a11d-1e25c3596633 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:27:30.213890 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c3033b03-93e1-4a48-a11d-1e25c3596633 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "PUT /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 400 len: 619 microversion: 2.1 time: 0.023018 May 28 21:27:30.215023 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2600/5156] 10.222.0.33 () {60 vars in 1256 bytes} [Sat May 28 21:27:30 2022] PUT /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:27:30.226560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1b5ffe76-f373-4085-98af-0988b4b62a04 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:30.227547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1b5ffe76-f373-4085-98af-0988b4b62a04 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:30.235646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b5ffe76-f373-4085-98af-0988b4b62a04 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:30.236443 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b5ffe76-f373-4085-98af-0988b4b62a04 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:30.237566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b5ffe76-f373-4085-98af-0988b4b62a04 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:30.238495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b5ffe76-f373-4085-98af-0988b4b62a04 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:30.415296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1b5ffe76-f373-4085-98af-0988b4b62a04 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:30.440363 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1b5ffe76-f373-4085-98af-0988b4b62a04 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.219683 May 28 21:27:30.441195 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2557/5157] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:30 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:30.458475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8be35bfd-dc6d-4058-aeb2-1afc846f6ba5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:30.461298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8be35bfd-dc6d-4058-aeb2-1afc846f6ba5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:30.471634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8be35bfd-dc6d-4058-aeb2-1afc846f6ba5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:30.472857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8be35bfd-dc6d-4058-aeb2-1afc846f6ba5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:30.478709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8be35bfd-dc6d-4058-aeb2-1afc846f6ba5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:30.478709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8be35bfd-dc6d-4058-aeb2-1afc846f6ba5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:30.676416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8be35bfd-dc6d-4058-aeb2-1afc846f6ba5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:30.685755 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8be35bfd-dc6d-4058-aeb2-1afc846f6ba5 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.231823 May 28 21:27:30.697362 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2601/5158] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:30 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:30.706449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d7b11620-1c47-48cc-a244-9a074651eac9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d7b11620-1c47-48cc-a244-9a074651eac9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: request: PUT /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 HTTP/1.1 May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 24 May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: {"server": {"name": ""}} May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid input for field/attribute name. Value: . '' is too short May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'a798306b-2df0-4ef0-b523-13a226b16120', 'body': {'server': {'name': ''}}} May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise error May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi On instance['server']: May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi '' May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:27:30.706831 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short May 28 21:27:30.712803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:30.712803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:30.712803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:30.712803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:30.712803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:30.712803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:30.712803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:27:30.712803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:27:30.712803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short May 28 21:27:30.712803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:30.712803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d7b11620-1c47-48cc-a244-9a074651eac9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:27:30.712803 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d7b11620-1c47-48cc-a244-9a074651eac9 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "PUT /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 400 len: 108 microversion: 2.1 time: 0.012265 May 28 21:27:30.713804 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2558/5159] 10.222.0.33 () {60 vars in 1255 bytes} [Sat May 28 21:27:30 2022] PUT /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 28 21:27:30.721787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e10e7d78-8b26-4d9d-bb74-7dc084f19915 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:30.722451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e10e7d78-8b26-4d9d-bb74-7dc084f19915 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:30.738817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e10e7d78-8b26-4d9d-bb74-7dc084f19915 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:30.739304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e10e7d78-8b26-4d9d-bb74-7dc084f19915 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:30.740679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e10e7d78-8b26-4d9d-bb74-7dc084f19915 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:30.741135 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e10e7d78-8b26-4d9d-bb74-7dc084f19915 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:30.981451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e10e7d78-8b26-4d9d-bb74-7dc084f19915 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:30.994399 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e10e7d78-8b26-4d9d-bb74-7dc084f19915 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1503 microversion: 2.1 time: 0.276924 May 28 21:27:30.995633 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2602/5160] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:30 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1503 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:33.930331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4ff63668-d17e-4f81-862d-e6e9cf252f0a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:33.931411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4ff63668-d17e-4f81-862d-e6e9cf252f0a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:33.939276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ff63668-d17e-4f81-862d-e6e9cf252f0a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:33.939746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ff63668-d17e-4f81-862d-e6e9cf252f0a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:33.940531 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ff63668-d17e-4f81-862d-e6e9cf252f0a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:33.940983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ff63668-d17e-4f81-862d-e6e9cf252f0a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:33.998295 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4ff63668-d17e-4f81-862d-e6e9cf252f0a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2/action" status: 200 len: 63202 microversion: 2.1 time: 0.264507 May 28 21:27:33.998986 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2559/5161] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:27:33 2022] POST /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2/action => generated 63202 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:27:40.646373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1d65378a-8a61-4975-ad4e-4ecd4e2f6796 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:40.689059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1d65378a-8a61-4975-ad4e-4ecd4e2f6796 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:40.689059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d65378a-8a61-4975-ad4e-4ecd4e2f6796 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:40.689059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d65378a-8a61-4975-ad4e-4ecd4e2f6796 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:40.689059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d65378a-8a61-4975-ad4e-4ecd4e2f6796 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:40.689059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d65378a-8a61-4975-ad4e-4ecd4e2f6796 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:40.820926 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1d65378a-8a61-4975-ad4e-4ecd4e2f6796 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1832 microversion: 2.1 time: 0.420952 May 28 21:27:40.821553 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2603/5162] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:40 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1832 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:41.092234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f8403e15-a83c-40a9-ae6d-96f8a5c8d91c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:41.093590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f8403e15-a83c-40a9-ae6d-96f8a5c8d91c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:41.100822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8403e15-a83c-40a9-ae6d-96f8a5c8d91c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:41.101284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8403e15-a83c-40a9-ae6d-96f8a5c8d91c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:41.102328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8403e15-a83c-40a9-ae6d-96f8a5c8d91c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:41.102767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8403e15-a83c-40a9-ae6d-96f8a5c8d91c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:41.320720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f8403e15-a83c-40a9-ae6d-96f8a5c8d91c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:41.328858 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f8403e15-a83c-40a9-ae6d-96f8a5c8d91c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.396027 May 28 21:27:41.342921 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2560/5163] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:40 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:41.347826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e25b0d87-4254-4ce2-99e4-9fa9d8c5901a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:41.348720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e25b0d87-4254-4ce2-99e4-9fa9d8c5901a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:41.355847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e25b0d87-4254-4ce2-99e4-9fa9d8c5901a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:41.356674 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e25b0d87-4254-4ce2-99e4-9fa9d8c5901a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:41.357607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e25b0d87-4254-4ce2-99e4-9fa9d8c5901a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:41.358304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e25b0d87-4254-4ce2-99e4-9fa9d8c5901a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:41.509704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e25b0d87-4254-4ce2-99e4-9fa9d8c5901a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:41.517307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:41.518329 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e25b0d87-4254-4ce2-99e4-9fa9d8c5901a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.174888 May 28 21:27:41.518920 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2604/5164] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:41 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:41.535410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5d0f9b58-b305-47fe-b2da-7e093c7a8e7e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:41.535819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5d0f9b58-b305-47fe-b2da-7e093c7a8e7e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:41.543143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d0f9b58-b305-47fe-b2da-7e093c7a8e7e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:41.543606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d0f9b58-b305-47fe-b2da-7e093c7a8e7e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:41.547235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d0f9b58-b305-47fe-b2da-7e093c7a8e7e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:41.547235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5d0f9b58-b305-47fe-b2da-7e093c7a8e7e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:41.837604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5d0f9b58-b305-47fe-b2da-7e093c7a8e7e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:41.847398 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5d0f9b58-b305-47fe-b2da-7e093c7a8e7e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.316262 May 28 21:27:41.850125 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2561/5165] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:41 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:41.869690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e5cdc4b8-b008-4901-bfc8-2a6fd43072f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:41.870647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e5cdc4b8-b008-4901-bfc8-2a6fd43072f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:41.890191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5cdc4b8-b008-4901-bfc8-2a6fd43072f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:41.890948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5cdc4b8-b008-4901-bfc8-2a6fd43072f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:41.894895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5cdc4b8-b008-4901-bfc8-2a6fd43072f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:41.895562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5cdc4b8-b008-4901-bfc8-2a6fd43072f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:42.161226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e5cdc4b8-b008-4901-bfc8-2a6fd43072f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:42.171581 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e5cdc4b8-b008-4901-bfc8-2a6fd43072f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.305804 May 28 21:27:42.182038 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2605/5166] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:41 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:42.236133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1382632114", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "d304eff3-8e4f-4892-8a6c-ef6717920bb8"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:42.299681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] validate_networks() for [('d304eff3-8e4f-4892-8a6c-ef6717920bb8', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:27:42.316988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6c591dff-b363-4960-bf3b-528d4fc1e35e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:42.316988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6c591dff-b363-4960-bf3b-528d4fc1e35e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:42.316988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:42.322657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c591dff-b363-4960-bf3b-528d4fc1e35e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:42.323368 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c591dff-b363-4960-bf3b-528d4fc1e35e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:42.324887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c591dff-b363-4960-bf3b-528d4fc1e35e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:42.325755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6c591dff-b363-4960-bf3b-528d4fc1e35e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:42.346674 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-6c591dff-b363-4960-bf3b-528d4fc1e35e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6c591dff-b363-4960-bf3b-528d4fc1e35e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 HTTP/1.1 May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '3fa085b6-1742-4a91-a55f-aeb8b73824e7'} May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:27:42.348597 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:27:42.354442 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:27:42.354442 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:42.354442 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:42.354442 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:42.354442 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:42.354442 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:42.354442 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:42.354442 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:27:42.354442 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:27:42.354442 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:27:42.354442 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:42.358566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6c591dff-b363-4960-bf3b-528d4fc1e35e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:27:42.359706 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6c591dff-b363-4960-bf3b-528d4fc1e35e tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 404 len: 111 microversion: 2.1 time: 0.052730 May 28 21:27:42.362832 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2606/5167] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:27:42 2022] DELETE /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:27:42.367933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cfd07ce0-8fdf-46b2-a2a1-6d301e65fd09 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:42.368853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cfd07ce0-8fdf-46b2-a2a1-6d301e65fd09 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:42.375989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cfd07ce0-8fdf-46b2-a2a1-6d301e65fd09 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:42.376460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cfd07ce0-8fdf-46b2-a2a1-6d301e65fd09 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:42.378600 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cfd07ce0-8fdf-46b2-a2a1-6d301e65fd09 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:42.379972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cfd07ce0-8fdf-46b2-a2a1-6d301e65fd09 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:42.414834 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cfd07ce0-8fdf-46b2-a2a1-6d301e65fd09 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:27:42.870068 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cfd07ce0-8fdf-46b2-a2a1-6d301e65fd09 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 204 len: 0 microversion: 2.1 time: 0.508100 May 28 21:27:42.871833 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2607/5168] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:27:42 2022] DELETE /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:27:42.878256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-766cc51a-bc80-44ee-b0d0-a61eb96013da tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:42.879235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-766cc51a-bc80-44ee-b0d0-a61eb96013da tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: 3fa085b6-1742-4a91-a55f-aeb8b73824e7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:42.886044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-766cc51a-bc80-44ee-b0d0-a61eb96013da tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:42.890735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-766cc51a-bc80-44ee-b0d0-a61eb96013da tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:42.890735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-766cc51a-bc80-44ee-b0d0-a61eb96013da tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:42.890735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-766cc51a-bc80-44ee-b0d0-a61eb96013da tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:42.904901 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-766cc51a-bc80-44ee-b0d0-a61eb96013da tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-766cc51a-bc80-44ee-b0d0-a61eb96013da tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 HTTP/1.1 May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '3fa085b6-1742-4a91-a55f-aeb8b73824e7'} May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:42.906833 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:42.921001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:42.921001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:42.921001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:42.921001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:27:42.921001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:27:42.921001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. May 28 21:27:42.921001 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:27:42.921001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-766cc51a-bc80-44ee-b0d0-a61eb96013da tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance 3fa085b6-1742-4a91-a55f-aeb8b73824e7 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:27:42.921001 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-766cc51a-bc80-44ee-b0d0-a61eb96013da tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7" status: 404 len: 111 microversion: 2.1 time: 0.035286 May 28 21:27:42.921001 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2608/5169] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:42 2022] GET /compute/v2.1/servers/3fa085b6-1742-4a91-a55f-aeb8b73824e7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:27:42.921001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-a649bd81-60b3-4af1-8a74-f61ed658e966 req-63340292-9bdb-4212-989b-bd36ecae8cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d38a270e-eebf-4adc-93a3-e4a5bac81ee2", "tag": "b5a42f07-fe9d-45f6-9f24-d15afa18b370"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:42.923337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a649bd81-60b3-4af1-8a74-f61ed658e966 req-63340292-9bdb-4212-989b-bd36ecae8cd5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:42.923471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a649bd81-60b3-4af1-8a74-f61ed658e966 req-63340292-9bdb-4212-989b-bd36ecae8cd5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:42.935511 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a649bd81-60b3-4af1-8a74-f61ed658e966 req-63340292-9bdb-4212-989b-bd36ecae8cd5 service nova] Creating event network-changed:b5a42f07-fe9d-45f6-9f24-d15afa18b370 for instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 on nch2-master-1 May 28 21:27:42.940479 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-a649bd81-60b3-4af1-8a74-f61ed658e966 req-63340292-9bdb-4212-989b-bd36ecae8cd5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030037 May 28 21:27:42.941097 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2609/5170] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:27:42.946382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-906d6b5e-bacc-46a1-b513-2937a4e7a85d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:42.947100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-906d6b5e-bacc-46a1-b513-2937a4e7a85d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:42.953548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-906d6b5e-bacc-46a1-b513-2937a4e7a85d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:42.954209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-906d6b5e-bacc-46a1-b513-2937a4e7a85d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:42.955101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-906d6b5e-bacc-46a1-b513-2937a4e7a85d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:42.955550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-906d6b5e-bacc-46a1-b513-2937a4e7a85d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:43.037524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:27:43.038753 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:27:43.039632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:27:43.041564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:27:43.042899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:27:43.065537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:43.069538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:43.073162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:43.075313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:43.142947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Getting quotas for project 54447ea481574a128f06c24315f34e46. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:27:43.161605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-906d6b5e-bacc-46a1-b513-2937a4e7a85d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:43.164553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Getting quotas for user 02d5fbb072814fd7923ecf12c7ecad7b and project 54447ea481574a128f06c24315f34e46. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:27:43.173890 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-906d6b5e-bacc-46a1-b513-2937a4e7a85d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1687 microversion: 2.1 time: 0.230230 May 28 21:27:43.174738 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2610/5171] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:42 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1687 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:43.185156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1b9ba991-eaa9-4c9e-8512-6b2e2d1a7b58 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:43.186009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1b9ba991-eaa9-4c9e-8512-6b2e2d1a7b58 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:43.196391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b9ba991-eaa9-4c9e-8512-6b2e2d1a7b58 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:43.197577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b9ba991-eaa9-4c9e-8512-6b2e2d1a7b58 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:43.198626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b9ba991-eaa9-4c9e-8512-6b2e2d1a7b58 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:43.199652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b9ba991-eaa9-4c9e-8512-6b2e2d1a7b58 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:43.208916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:27:43.216098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:27:43.276982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1b9ba991-eaa9-4c9e-8512-6b2e2d1a7b58 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:27:43.378440 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a4d095c6-1958-43c6-b36e-ba4ba864d9ea tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.146679 May 28 21:27:43.387771 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2562/5172] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:27:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:27:43.405336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d751621a-131d-46cc-bd96-287dd88e3d4e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:43.406082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d751621a-131d-46cc-bd96-287dd88e3d4e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:43.486385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d751621a-131d-46cc-bd96-287dd88e3d4e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:43.496133 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d751621a-131d-46cc-bd96-287dd88e3d4e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 200 len: 1215 microversion: 2.1 time: 0.106470 May 28 21:27:43.500775 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2563/5173] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:43 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 1215 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:43.669001 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1b9ba991-eaa9-4c9e-8512-6b2e2d1a7b58 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 204 len: 0 microversion: 2.1 time: 0.492722 May 28 21:27:43.669602 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2611/5174] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:27:43 2022] DELETE /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:27:43.678462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f006ce36-930d-46bf-8bb9-53fd120b8d6c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:43.679104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f006ce36-930d-46bf-8bb9-53fd120b8d6c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:43.685382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f006ce36-930d-46bf-8bb9-53fd120b8d6c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:43.685876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f006ce36-930d-46bf-8bb9-53fd120b8d6c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:43.686659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f006ce36-930d-46bf-8bb9-53fd120b8d6c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:43.687108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f006ce36-930d-46bf-8bb9-53fd120b8d6c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:43.976313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f006ce36-930d-46bf-8bb9-53fd120b8d6c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:43.984396 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f006ce36-930d-46bf-8bb9-53fd120b8d6c tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.310280 May 28 21:27:43.985250 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2564/5175] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:43 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:44.198425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb4fb53c-8463-404c-a5da-24c6cbb241d6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:44.200440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fb4fb53c-8463-404c-a5da-24c6cbb241d6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:44.220426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb4fb53c-8463-404c-a5da-24c6cbb241d6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:44.221028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb4fb53c-8463-404c-a5da-24c6cbb241d6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:44.222065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb4fb53c-8463-404c-a5da-24c6cbb241d6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:44.222521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb4fb53c-8463-404c-a5da-24c6cbb241d6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:44.418936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fb4fb53c-8463-404c-a5da-24c6cbb241d6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:44.429521 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb4fb53c-8463-404c-a5da-24c6cbb241d6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1687 microversion: 2.1 time: 0.240911 May 28 21:27:44.433883 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2612/5176] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:44 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1687 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:44.518354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eb6f62a2-bcb4-4197-bb89-81435b5eac9a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:44.519661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eb6f62a2-bcb4-4197-bb89-81435b5eac9a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:44.621614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eb6f62a2-bcb4-4197-bb89-81435b5eac9a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:44.628833 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eb6f62a2-bcb4-4197-bb89-81435b5eac9a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 200 len: 1215 microversion: 2.1 time: 0.114625 May 28 21:27:44.631175 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2565/5177] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:44 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:45.007033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-448c7d0e-ccee-43a0-b820-5db67922ed5a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:45.007676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-448c7d0e-ccee-43a0-b820-5db67922ed5a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:45.014483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-448c7d0e-ccee-43a0-b820-5db67922ed5a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:45.014943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-448c7d0e-ccee-43a0-b820-5db67922ed5a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:45.015725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-448c7d0e-ccee-43a0-b820-5db67922ed5a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:45.016171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-448c7d0e-ccee-43a0-b820-5db67922ed5a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:45.199520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-448c7d0e-ccee-43a0-b820-5db67922ed5a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:45.204669 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-448c7d0e-ccee-43a0-b820-5db67922ed5a tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.202237 May 28 21:27:45.205488 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2613/5178] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:45 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:45.448030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-03744449-3148-451e-9825-86f9bb87318b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:45.448695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-03744449-3148-451e-9825-86f9bb87318b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:45.461290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03744449-3148-451e-9825-86f9bb87318b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:45.461812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03744449-3148-451e-9825-86f9bb87318b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:45.462831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03744449-3148-451e-9825-86f9bb87318b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:45.463937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03744449-3148-451e-9825-86f9bb87318b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:45.648286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-71922c16-7cad-4023-a46e-7769e367ed89 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:45.649686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-71922c16-7cad-4023-a46e-7769e367ed89 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:45.670996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71922c16-7cad-4023-a46e-7769e367ed89 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:45.670996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71922c16-7cad-4023-a46e-7769e367ed89 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:45.672671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71922c16-7cad-4023-a46e-7769e367ed89 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:45.673455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-71922c16-7cad-4023-a46e-7769e367ed89 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:45.849395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-71922c16-7cad-4023-a46e-7769e367ed89 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:45.858089 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-71922c16-7cad-4023-a46e-7769e367ed89 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 200 len: 1267 microversion: 2.1 time: 0.215477 May 28 21:27:45.858912 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2614/5179] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:45 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:27:45.938747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-03744449-3148-451e-9825-86f9bb87318b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:45.954930 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-03744449-3148-451e-9825-86f9bb87318b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1687 microversion: 2.1 time: 0.511365 May 28 21:27:45.963266 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2566/5180] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:45 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1687 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:46.222803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8db2851c-d174-44e1-999d-3aa9936476eb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:46.223419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8db2851c-d174-44e1-999d-3aa9936476eb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:46.233809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8db2851c-d174-44e1-999d-3aa9936476eb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:46.235410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8db2851c-d174-44e1-999d-3aa9936476eb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:46.239348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8db2851c-d174-44e1-999d-3aa9936476eb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:46.239814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8db2851c-d174-44e1-999d-3aa9936476eb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:46.639230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8db2851c-d174-44e1-999d-3aa9936476eb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:46.661238 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8db2851c-d174-44e1-999d-3aa9936476eb tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1509 microversion: 2.1 time: 0.442646 May 28 21:27:46.662318 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2615/5181] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:46 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1509 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:46.771113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-d9fc24b4-89f5-4f35-834f-db45417525e4 req-86f3f732-5103-4c18-9d2f-ec41653a217e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a798306b-2df0-4ef0-b523-13a226b16120", "name": "network-vif-deleted", "tag": "04aa786c-dc09-4f75-981b-7d1b73608c2b"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:46.780788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d9fc24b4-89f5-4f35-834f-db45417525e4 req-86f3f732-5103-4c18-9d2f-ec41653a217e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:46.783160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d9fc24b4-89f5-4f35-834f-db45417525e4 req-86f3f732-5103-4c18-9d2f-ec41653a217e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:46.793928 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-d9fc24b4-89f5-4f35-834f-db45417525e4 req-86f3f732-5103-4c18-9d2f-ec41653a217e service nova] Creating event network-vif-deleted:04aa786c-dc09-4f75-981b-7d1b73608c2b for instance a798306b-2df0-4ef0-b523-13a226b16120 on nch2-master-1 May 28 21:27:46.799663 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-d9fc24b4-89f5-4f35-834f-db45417525e4 req-86f3f732-5103-4c18-9d2f-ec41653a217e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032021 May 28 21:27:46.800544 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2567/5182] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:27:46.875896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40780a32-5a99-4c08-90bd-66c4508e134c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:46.876871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-40780a32-5a99-4c08-90bd-66c4508e134c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:46.885713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40780a32-5a99-4c08-90bd-66c4508e134c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:46.886213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40780a32-5a99-4c08-90bd-66c4508e134c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:46.893104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40780a32-5a99-4c08-90bd-66c4508e134c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:46.893885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40780a32-5a99-4c08-90bd-66c4508e134c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:46.975621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-40780a32-5a99-4c08-90bd-66c4508e134c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:46.976811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d3d1b446-e63c-4020-be28-e60a3cda889b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:46.977975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d3d1b446-e63c-4020-be28-e60a3cda889b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:46.986552 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-40780a32-5a99-4c08-90bd-66c4508e134c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 200 len: 1273 microversion: 2.1 time: 0.114906 May 28 21:27:46.988666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3d1b446-e63c-4020-be28-e60a3cda889b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:46.988980 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2616/5183] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:46 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:46.989097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3d1b446-e63c-4020-be28-e60a3cda889b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:46.995661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3d1b446-e63c-4020-be28-e60a3cda889b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:46.995661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3d1b446-e63c-4020-be28-e60a3cda889b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:47.120285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d3d1b446-e63c-4020-be28-e60a3cda889b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:47.137116 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d3d1b446-e63c-4020-be28-e60a3cda889b tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 200 len: 1502 microversion: 2.1 time: 0.167070 May 28 21:27:47.138323 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2568/5184] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:46 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:27:47.164102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-8ac1cb70-4e29-46ba-b155-86bb8609674e req-bfd27ce4-6a49-4658-94f0-2d22a3ec8dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d38a270e-eebf-4adc-93a3-e4a5bac81ee2", "name": "network-vif-deleted", "tag": "b5a42f07-fe9d-45f6-9f24-d15afa18b370"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:47.174612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8ac1cb70-4e29-46ba-b155-86bb8609674e req-bfd27ce4-6a49-4658-94f0-2d22a3ec8dc8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:47.175588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8ac1cb70-4e29-46ba-b155-86bb8609674e req-bfd27ce4-6a49-4658-94f0-2d22a3ec8dc8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:47.190625 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-8ac1cb70-4e29-46ba-b155-86bb8609674e req-bfd27ce4-6a49-4658-94f0-2d22a3ec8dc8 service nova] Creating event network-vif-deleted:b5a42f07-fe9d-45f6-9f24-d15afa18b370 for instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 on nch2-master-1 May 28 21:27:47.196949 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-8ac1cb70-4e29-46ba-b155-86bb8609674e req-bfd27ce4-6a49-4658-94f0-2d22a3ec8dc8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036874 May 28 21:27:47.197649 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2617/5185] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:27:47.690265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f208969c-9f3f-497e-8604-adda8253ed65 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:47.691390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f208969c-9f3f-497e-8604-adda8253ed65 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:47.700799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f208969c-9f3f-497e-8604-adda8253ed65 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:47.701557 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f208969c-9f3f-497e-8604-adda8253ed65 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:47.702609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f208969c-9f3f-497e-8604-adda8253ed65 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:47.703264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f208969c-9f3f-497e-8604-adda8253ed65 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:47.753801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f208969c-9f3f-497e-8604-adda8253ed65 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:47.754525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f208969c-9f3f-497e-8604-adda8253ed65 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:47.755193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-f208969c-9f3f-497e-8604-adda8253ed65 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lazy-loading 'fault' on Instance uuid a798306b-2df0-4ef0-b523-13a226b16120 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:27:47.938485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f208969c-9f3f-497e-8604-adda8253ed65 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebc8e00965334bd1bb811a0eefd64b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01fa7893b58741ce84a316632efe7882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:47.952033 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f208969c-9f3f-497e-8604-adda8253ed65 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 200 len: 1305 microversion: 2.1 time: 0.275435 May 28 21:27:47.961782 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2569/5186] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:47 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 1305 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:48.012348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5e6696b7-6338-4bd9-bdea-add65fdc6e56 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:48.013064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5e6696b7-6338-4bd9-bdea-add65fdc6e56 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:48.022529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5e6696b7-6338-4bd9-bdea-add65fdc6e56 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:48.023009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5e6696b7-6338-4bd9-bdea-add65fdc6e56 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:48.023817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5e6696b7-6338-4bd9-bdea-add65fdc6e56 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:48.024268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5e6696b7-6338-4bd9-bdea-add65fdc6e56 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:48.155958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-afe477dd-2fc4-4cf2-92e0-1554d5a8b690 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:48.157634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-afe477dd-2fc4-4cf2-92e0-1554d5a8b690 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: d38a270e-eebf-4adc-93a3-e4a5bac81ee2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:48.170926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afe477dd-2fc4-4cf2-92e0-1554d5a8b690 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:48.171597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afe477dd-2fc4-4cf2-92e0-1554d5a8b690 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:48.173788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afe477dd-2fc4-4cf2-92e0-1554d5a8b690 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:48.175786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afe477dd-2fc4-4cf2-92e0-1554d5a8b690 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:48.208858 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-afe477dd-2fc4-4cf2-92e0-1554d5a8b690 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] HTTP exception thrown: Instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 could not be found. May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-afe477dd-2fc4-4cf2-92e0-1554d5a8b690 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Request method failure captured: May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 HTTP/1.1 May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpKKy1DVesaj_dysVbGqpWcHx4cpHNtNqkxvMKKXBNqPepistzKKj5agiD8mz188E2_RFwo_f1as_TQInxyhgm3IcOuVM4c5upLUW3nrJ4MRI1Ng4P0UpvRwuZdeq2foyGDCzH24UQIOA6NcxtlTNzFgs85sIrFiF6Be00fINdCNhb0 May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: c3588eab36044e439158f876836ea514 May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-174864934 May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3588eab36044e439158f876836ea514", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3588eab36044e439158f876836ea514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3588eab36044e439158f876836ea514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3588eab36044e439158f876836ea514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestNetworkAdvancedServerOps-174864934 May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: c3588eab36044e439158f876836ea514 May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-174864934 May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestNetworkAdvancedServerOps-174864934-project May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f3468a0b2d324603ab6c3080993bc0c8 May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestNetworkAdvancedServerOps-174864934-project May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 could not be found. May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'd38a270e-eebf-4adc-93a3-e4a5bac81ee2'} May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 could not be found. May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 could not be found. May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:48.212784 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:48.218151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:48.218151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:48.218151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:48.218151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:27:48.218151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:27:48.218151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 could not be found. May 28 21:27:48.218151 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:48.218151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-afe477dd-2fc4-4cf2-92e0-1554d5a8b690 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Returning 404 to user: Instance d38a270e-eebf-4adc-93a3-e4a5bac81ee2 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:27:48.218151 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-afe477dd-2fc4-4cf2-92e0-1554d5a8b690 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2" status: 404 len: 111 microversion: 2.1 time: 0.063905 May 28 21:27:48.222372 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2570/5187] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:48 2022] GET /compute/v2.1/servers/d38a270e-eebf-4adc-93a3-e4a5bac81ee2 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:27:48.268774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5e6696b7-6338-4bd9-bdea-add65fdc6e56 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:48.280085 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5e6696b7-6338-4bd9-bdea-add65fdc6e56 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 200 len: 1315 microversion: 2.1 time: 0.271930 May 28 21:27:48.280788 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2618/5188] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:48 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:48.968464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-db2777cc-c2c8-4cdd-b2eb-e6755eb1bd71 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:48.971613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-db2777cc-c2c8-4cdd-b2eb-e6755eb1bd71 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] [instance: a798306b-2df0-4ef0-b523-13a226b16120] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:48.989959 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db2777cc-c2c8-4cdd-b2eb-e6755eb1bd71 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:48.995883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db2777cc-c2c8-4cdd-b2eb-e6755eb1bd71 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:48.995883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db2777cc-c2c8-4cdd-b2eb-e6755eb1bd71 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:48.995883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db2777cc-c2c8-4cdd-b2eb-e6755eb1bd71 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:49.011327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-1073d913-eeaf-460e-be09-5d006987f841 req-8b410c1d-fa7d-4901-9592-c3bcaa072711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b35b6fe-546d-42e1-a38b-8f32ce3078bc", "tag": "ca40ef3b-811a-4af2-975d-a424b3e6d7f1"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:49.026406 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-db2777cc-c2c8-4cdd-b2eb-e6755eb1bd71 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] HTTP exception thrown: Instance a798306b-2df0-4ef0-b523-13a226b16120 could not be found. May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-db2777cc-c2c8-4cdd-b2eb-e6755eb1bd71 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Request method failure captured: May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 HTTP/1.1 May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpMOrW9VDpKyQ0YvYtAFhJmEf_m0tkMJv1er3DnlPB6v1wXfFLoVKWLEzEsnTUvlCg9O_CUEg5z6P6guMr0ilWACa838kqHrJTS5KIRW_1asLOy7fOIz8pNpqSCcKP2TBW7GCqSyR0UuotClNtQmZjDwZSyodM0Zy-l9HqGcdI5a7Pg May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_01fa7893b58741ce84a316632efe7882", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/01fa7893b58741ce84a316632efe7882"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/01fa7893b58741ce84a316632efe7882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 01fa7893b58741ce84a316632efe7882 May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-498936791 May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ebc8e00965334bd1bb811a0eefd64b84 May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-498936791-project May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance a798306b-2df0-4ef0-b523-13a226b16120 could not be found. May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'a798306b-2df0-4ef0-b523-13a226b16120'} May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a798306b-2df0-4ef0-b523-13a226b16120 could not be found. May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a798306b-2df0-4ef0-b523-13a226b16120 could not be found. May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:27:49.030113 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:49.035235 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:27:49.035235 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:27:49.035235 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:27:49.035235 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:27:49.035235 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:27:49.035235 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a798306b-2df0-4ef0-b523-13a226b16120 could not be found. May 28 21:27:49.035235 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:27:49.035235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-db2777cc-c2c8-4cdd-b2eb-e6755eb1bd71 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] Returning 404 to user: Instance a798306b-2df0-4ef0-b523-13a226b16120 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:27:49.035235 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-db2777cc-c2c8-4cdd-b2eb-e6755eb1bd71 tempest-ServersNegativeTestJSON-498936791 tempest-ServersNegativeTestJSON-498936791-project] 10.222.0.33 "GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120" status: 404 len: 111 microversion: 2.1 time: 0.066979 May 28 21:27:49.036185 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2571/5189] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:48 2022] GET /compute/v2.1/servers/a798306b-2df0-4ef0-b523-13a226b16120 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:27:49.050103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1073d913-eeaf-460e-be09-5d006987f841 req-8b410c1d-fa7d-4901-9592-c3bcaa072711 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:49.052024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1073d913-eeaf-460e-be09-5d006987f841 req-8b410c1d-fa7d-4901-9592-c3bcaa072711 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:49.066662 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-1073d913-eeaf-460e-be09-5d006987f841 req-8b410c1d-fa7d-4901-9592-c3bcaa072711 service nova] Creating event network-changed:ca40ef3b-811a-4af2-975d-a424b3e6d7f1 for instance 3b35b6fe-546d-42e1-a38b-8f32ce3078bc on nch1-master-1 May 28 21:27:49.087110 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-1073d913-eeaf-460e-be09-5d006987f841 req-8b410c1d-fa7d-4901-9592-c3bcaa072711 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071236 May 28 21:27:49.090989 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2619/5190] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:27:49.297668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c9aa8da4-5c92-4384-9868-dc67b55d05a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:49.298493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c9aa8da4-5c92-4384-9868-dc67b55d05a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:49.310682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9aa8da4-5c92-4384-9868-dc67b55d05a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:49.315305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9aa8da4-5c92-4384-9868-dc67b55d05a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:49.315305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9aa8da4-5c92-4384-9868-dc67b55d05a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:49.315305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c9aa8da4-5c92-4384-9868-dc67b55d05a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:49.549899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c9aa8da4-5c92-4384-9868-dc67b55d05a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:49.564326 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c9aa8da4-5c92-4384-9868-dc67b55d05a7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 200 len: 1315 microversion: 2.1 time: 0.271414 May 28 21:27:49.570539 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2572/5191] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:49 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:50.583501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1ab5965a-91eb-4a75-9b0e-07f57e71bc4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:50.584957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1ab5965a-91eb-4a75-9b0e-07f57e71bc4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:50.598319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ab5965a-91eb-4a75-9b0e-07f57e71bc4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:50.598796 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ab5965a-91eb-4a75-9b0e-07f57e71bc4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:50.602928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ab5965a-91eb-4a75-9b0e-07f57e71bc4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:50.604867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ab5965a-91eb-4a75-9b0e-07f57e71bc4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:50.855682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1ab5965a-91eb-4a75-9b0e-07f57e71bc4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:50.864565 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1ab5965a-91eb-4a75-9b0e-07f57e71bc4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 200 len: 1315 microversion: 2.1 time: 0.285954 May 28 21:27:50.865345 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2620/5192] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:50 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:51.883254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-feeca568-dba0-4ba3-98ed-8cd49d24fb1c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:51.884324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-feeca568-dba0-4ba3-98ed-8cd49d24fb1c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:51.908593 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-feeca568-dba0-4ba3-98ed-8cd49d24fb1c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:51.908878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-feeca568-dba0-4ba3-98ed-8cd49d24fb1c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:51.926699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-feeca568-dba0-4ba3-98ed-8cd49d24fb1c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:51.927162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-feeca568-dba0-4ba3-98ed-8cd49d24fb1c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:51.935417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:52.368211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-feeca568-dba0-4ba3-98ed-8cd49d24fb1c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:52.378729 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-feeca568-dba0-4ba3-98ed-8cd49d24fb1c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 200 len: 1315 microversion: 2.1 time: 0.499895 May 28 21:27:52.393012 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2573/5193] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:51 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:53.402522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fe68eb19-94c1-4319-b109-fefc5b2f45dc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:53.415459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fe68eb19-94c1-4319-b109-fefc5b2f45dc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:53.425171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe68eb19-94c1-4319-b109-fefc5b2f45dc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:53.425171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe68eb19-94c1-4319-b109-fefc5b2f45dc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:53.430265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe68eb19-94c1-4319-b109-fefc5b2f45dc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:53.430561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe68eb19-94c1-4319-b109-fefc5b2f45dc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:53.462941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:53.511828 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 21:27:53.512485 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 21:27:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc (ip 10.222.0.33) !!! May 28 21:27:54.156526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fe68eb19-94c1-4319-b109-fefc5b2f45dc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:54.172772 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fe68eb19-94c1-4319-b109-fefc5b2f45dc tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 200 len: 1315 microversion: 2.1 time: 0.775126 May 28 21:27:54.173735 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2621/5194] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:53 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 1315 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:55.189216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:55.191735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=10 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:27:55.195400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-51ecae74-c7bd-445a-9784-a4fe3120dc30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:55.196031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-51ecae74-c7bd-445a-9784-a4fe3120dc30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:55.203169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51ecae74-c7bd-445a-9784-a4fe3120dc30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:55.203787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51ecae74-c7bd-445a-9784-a4fe3120dc30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:55.204760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51ecae74-c7bd-445a-9784-a4fe3120dc30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:55.205266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51ecae74-c7bd-445a-9784-a4fe3120dc30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:55.337599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5fe94de6-92d1-4041-80ca-0218eebcb8bf tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '.version_select at 0x7f4d6474cee0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:55.455360 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5fe94de6-92d1-4041-80ca-0218eebcb8bf tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-464335192" status: 202 len: 0 microversion: 2.1 time: 0.124032 May 28 21:27:55.457414 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2622/5195] 10.222.0.33 () {58 vars in 1280 bytes} [Sat May 28 21:27:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-464335192 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:27:55.506366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eff32eba-2ed2-4d4d-bb12-6938c20438fe tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'create', calling method: .version_select at 0x7f4d64293430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-187899813", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeEN2mGbgcdjt+FxR2BQ8Zg3AXAu4JN9mxyA6tFIT2X1SYkxxCSGIUEzmrT8LS0zQMJbkoVrCLxUua6BZm5CxHNAiLbudrhhri3ayZLEToNBdL86p2PSmDP45x/HDW0iQ=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:55.573654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-eff32eba-2ed2-4d4d-bb12-6938c20438fe tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for project c3588eab36044e439158f876836ea514. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:27:55.590326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-eff32eba-2ed2-4d4d-bb12-6938c20438fe tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for user f3468a0b2d324603ab6c3080993bc0c8 and project c3588eab36044e439158f876836ea514. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:27:55.746054 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eff32eba-2ed2-4d4d-bb12-6938c20438fe tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.247046 May 28 21:27:55.750427 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2623/5196] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:27:55 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:27:55.759039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-92fbdd55-5148-4d9c-bd69-9cd4d63dc5d4 req-c7c52b55-4dc3-47d5-8d09-121efdcf9b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b35b6fe-546d-42e1-a38b-8f32ce3078bc", "name": "network-vif-plugged", "status": "completed", "tag": "ca40ef3b-811a-4af2-975d-a424b3e6d7f1"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:55.772042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-92fbdd55-5148-4d9c-bd69-9cd4d63dc5d4 req-c7c52b55-4dc3-47d5-8d09-121efdcf9b31 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:55.773140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-92fbdd55-5148-4d9c-bd69-9cd4d63dc5d4 req-c7c52b55-4dc3-47d5-8d09-121efdcf9b31 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:55.795152 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-92fbdd55-5148-4d9c-bd69-9cd4d63dc5d4 req-c7c52b55-4dc3-47d5-8d09-121efdcf9b31 service nova] Creating event network-vif-plugged:ca40ef3b-811a-4af2-975d-a424b3e6d7f1 for instance 3b35b6fe-546d-42e1-a38b-8f32ce3078bc on nch1-master-1 May 28 21:27:55.803306 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-92fbdd55-5148-4d9c-bd69-9cd4d63dc5d4 req-c7c52b55-4dc3-47d5-8d09-121efdcf9b31 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049748 May 28 21:27:55.804143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-51ecae74-c7bd-445a-9784-a4fe3120dc30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:55.809043 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2624/5197] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:27:55.827116 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-51ecae74-c7bd-445a-9784-a4fe3120dc30 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 200 len: 1315 microversion: 2.1 time: 0.640408 May 28 21:27:55.841793 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2574/5198] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:55 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 1315 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:56.846664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e1e1a27e-bd04-46cb-826e-2019ae6a36d5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:56.847909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e1e1a27e-bd04-46cb-826e-2019ae6a36d5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:56.856841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1e1a27e-bd04-46cb-826e-2019ae6a36d5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:56.857309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1e1a27e-bd04-46cb-826e-2019ae6a36d5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:56.858272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1e1a27e-bd04-46cb-826e-2019ae6a36d5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:56.858892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e1e1a27e-bd04-46cb-826e-2019ae6a36d5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:57.354906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e1e1a27e-bd04-46cb-826e-2019ae6a36d5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:57.383308 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e1e1a27e-bd04-46cb-826e-2019ae6a36d5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 200 len: 1315 microversion: 2.1 time: 0.540448 May 28 21:27:57.383308 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2625/5199] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:56 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:58.400725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1bac1410-798a-400e-a6f1-cbe87d5f3f8e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:27:58.401695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1bac1410-798a-400e-a6f1-cbe87d5f3f8e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:58.420566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1bac1410-798a-400e-a6f1-cbe87d5f3f8e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:58.423812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1bac1410-798a-400e-a6f1-cbe87d5f3f8e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:58.425403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1bac1410-798a-400e-a6f1-cbe87d5f3f8e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:58.426792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1bac1410-798a-400e-a6f1-cbe87d5f3f8e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:59.030712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1bac1410-798a-400e-a6f1-cbe87d5f3f8e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:27:59.040483 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1bac1410-798a-400e-a6f1-cbe87d5f3f8e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 200 len: 1503 microversion: 2.1 time: 0.644721 May 28 21:27:59.053826 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2575/5200] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:27:58 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 1503 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:27:59.058766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1baae77c-7af9-4947-8538-bc0086650c0d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:27:59.059313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1baae77c-7af9-4947-8538-bc0086650c0d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:27:59.082828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1baae77c-7af9-4947-8538-bc0086650c0d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:59.087501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1baae77c-7af9-4947-8538-bc0086650c0d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:59.088378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1baae77c-7af9-4947-8538-bc0086650c0d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:27:59.089224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1baae77c-7af9-4947-8538-bc0086650c0d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:27:59.413445 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.network.security_group_api [None req-1baae77c-7af9-4947-8538-bc0086650c0d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Removing security group 83b104d2-4b0f-4c68-8ad2-ba269d367279 from port ca40ef3b-811a-4af2-975d-a424b3e6d7f1 May 28 21:28:00.460867 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1baae77c-7af9-4947-8538-bc0086650c0d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc/action" status: 202 len: 0 microversion: 2.1 time: 1.406309 May 28 21:28:00.462992 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2626/5201] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:27:59 2022] POST /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc/action => generated 0 bytes in 1409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:28:00.472664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a08b582f-37cc-4e61-85ce-b6af2b1e98e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:00.475617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a08b582f-37cc-4e61-85ce-b6af2b1e98e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:00.491882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:28:00.497382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a08b582f-37cc-4e61-85ce-b6af2b1e98e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:00.499614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a08b582f-37cc-4e61-85ce-b6af2b1e98e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:00.500361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-502d6022-4c78-4561-a96a-ad8a8e31bb70 req-2e57b11b-d0d9-470b-b635-b76616501904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b35b6fe-546d-42e1-a38b-8f32ce3078bc", "tag": "ca40ef3b-811a-4af2-975d-a424b3e6d7f1"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:00.503202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a08b582f-37cc-4e61-85ce-b6af2b1e98e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:00.504064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a08b582f-37cc-4e61-85ce-b6af2b1e98e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:00.523203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-502d6022-4c78-4561-a96a-ad8a8e31bb70 req-2e57b11b-d0d9-470b-b635-b76616501904 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:00.524302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-502d6022-4c78-4561-a96a-ad8a8e31bb70 req-2e57b11b-d0d9-470b-b635-b76616501904 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:00.563533 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-502d6022-4c78-4561-a96a-ad8a8e31bb70 req-2e57b11b-d0d9-470b-b635-b76616501904 service nova] Creating event network-changed:ca40ef3b-811a-4af2-975d-a424b3e6d7f1 for instance 3b35b6fe-546d-42e1-a38b-8f32ce3078bc on nch1-master-1 May 28 21:28:00.578552 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-502d6022-4c78-4561-a96a-ad8a8e31bb70 req-2e57b11b-d0d9-470b-b635-b76616501904 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080478 May 28 21:28:00.584055 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2627/5202] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:28:00.940951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a08b582f-37cc-4e61-85ce-b6af2b1e98e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:00.956806 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a08b582f-37cc-4e61-85ce-b6af2b1e98e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 200 len: 1461 microversion: 2.1 time: 0.487126 May 28 21:28:00.959043 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2576/5203] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:00 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 1461 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:00.977203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4afe1779-5cbc-48c8-b643-97fc339a1ff8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:00.978027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4afe1779-5cbc-48c8-b643-97fc339a1ff8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:00.986273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4afe1779-5cbc-48c8-b643-97fc339a1ff8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:00.986740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4afe1779-5cbc-48c8-b643-97fc339a1ff8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:00.987544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4afe1779-5cbc-48c8-b643-97fc339a1ff8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:00.988015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4afe1779-5cbc-48c8-b643-97fc339a1ff8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:01.809470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4afe1779-5cbc-48c8-b643-97fc339a1ff8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:01.818700 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4afe1779-5cbc-48c8-b643-97fc339a1ff8 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.845427 May 28 21:28:01.836142 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2628/5204] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:00 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:01.844869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c7225573-8f32-4928-b4b2-aa76189edb78 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:01.845500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c7225573-8f32-4928-b4b2-aa76189edb78 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:01.891591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7225573-8f32-4928-b4b2-aa76189edb78 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:01.901600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7225573-8f32-4928-b4b2-aa76189edb78 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:01.901600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7225573-8f32-4928-b4b2-aa76189edb78 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:01.901600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7225573-8f32-4928-b4b2-aa76189edb78 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:02.340077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c7225573-8f32-4928-b4b2-aa76189edb78 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:02.345890 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c7225573-8f32-4928-b4b2-aa76189edb78 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.505725 May 28 21:28:02.346720 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2577/5205] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:01 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:02.368410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9d2e7511-b216-4de1-ac6d-2dfec499349e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:02.369292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9d2e7511-b216-4de1-ac6d-2dfec499349e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:02.383573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d2e7511-b216-4de1-ac6d-2dfec499349e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:02.387187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d2e7511-b216-4de1-ac6d-2dfec499349e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:02.388202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d2e7511-b216-4de1-ac6d-2dfec499349e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:02.388825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d2e7511-b216-4de1-ac6d-2dfec499349e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:02.784012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9d2e7511-b216-4de1-ac6d-2dfec499349e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:02.798278 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9d2e7511-b216-4de1-ac6d-2dfec499349e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.437163 May 28 21:28:02.801207 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2629/5206] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:02 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:02.820729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6c94ec9d-7d16-4503-8164-579614ff24bd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:02.821576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6c94ec9d-7d16-4503-8164-579614ff24bd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:02.828717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c94ec9d-7d16-4503-8164-579614ff24bd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:02.829513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c94ec9d-7d16-4503-8164-579614ff24bd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:02.830725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c94ec9d-7d16-4503-8164-579614ff24bd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:02.832112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c94ec9d-7d16-4503-8164-579614ff24bd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:03.118223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6c94ec9d-7d16-4503-8164-579614ff24bd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:03.132584 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6c94ec9d-7d16-4503-8164-579614ff24bd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.317253 May 28 21:28:03.133500 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2578/5207] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:02 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:03.320972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1845183729", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "d304eff3-8e4f-4892-8a6c-ef6717920bb8"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:03.459344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] validate_networks() for [('d304eff3-8e4f-4892-8a6c-ef6717920bb8', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:28:04.006812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:28:04.007529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:28:04.008018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:28:04.008470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:28:04.011030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:28:04.025996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:04.026466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:04.027507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:04.028159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:04.050578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Getting quotas for project 54447ea481574a128f06c24315f34e46. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:28:04.058614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Getting quotas for user 02d5fbb072814fd7923ecf12c7ecad7b and project 54447ea481574a128f06c24315f34e46. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:28:04.089938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:28:04.090656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:28:04.240942 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4ff74b52-343f-4e7c-a644-c9e4b4293d21 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.924809 May 28 21:28:04.257633 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2630/5208] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:28:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:28:04.257746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e6f388c5-99fa-4ba9-8b1c-4ff097f7a2c7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:04.257746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e6f388c5-99fa-4ba9-8b1c-4ff097f7a2c7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:05.117063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e6f388c5-99fa-4ba9-8b1c-4ff097f7a2c7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:05.126238 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e6f388c5-99fa-4ba9-8b1c-4ff097f7a2c7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1215 microversion: 2.1 time: 0.877794 May 28 21:28:05.132166 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2579/5209] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:04 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1215 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:28:05.602729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1c890812-2cbd-4ed7-8627-8267e4589c89 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Action: 'create', calling method: .version_select at 0x7f4d57ed6af0>, body: {"keypair": {"name": "tempest-keypair-1450742268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgnciFNezLbvx+dZ35zs0xRhPJoib+c7rb1YZhPDbUM6S/47deR2I1hujz/Xz0sKiGiqWMqqCrts3uK8SlC9JLH9L1efsM1ZjacPn9lY/LsAxOn8DnXuitN5dyr1ZSTkQ=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:05.652487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-1c890812-2cbd-4ed7-8627-8267e4589c89 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Getting quotas for project e3cc8c5f2fe44b87bf5c05eadb62936c. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:28:05.661505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-1c890812-2cbd-4ed7-8627-8267e4589c89 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Getting quotas for user 93f78df0f96c47ac97a200a4442db6da and project e3cc8c5f2fe44b87bf5c05eadb62936c. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:28:05.803845 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1c890812-2cbd-4ed7-8627-8267e4589c89 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.439518 May 28 21:28:05.816173 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2631/5210] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:28:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:28:06.158774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bb4a2a47-3383-41af-95e6-f718aafad18f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:06.158774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bb4a2a47-3383-41af-95e6-f718aafad18f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:06.169478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb4a2a47-3383-41af-95e6-f718aafad18f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:06.175269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb4a2a47-3383-41af-95e6-f718aafad18f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:06.176511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb4a2a47-3383-41af-95e6-f718aafad18f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:06.178424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bb4a2a47-3383-41af-95e6-f718aafad18f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:06.324066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bb4a2a47-3383-41af-95e6-f718aafad18f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:06.346419 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bb4a2a47-3383-41af-95e6-f718aafad18f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1211 microversion: 2.1 time: 0.201767 May 28 21:28:06.347509 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2580/5211] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:06 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1211 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:07.377339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9f0025d9-3e9b-4533-8588-20bb0bdfba83 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:07.378025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9f0025d9-3e9b-4533-8588-20bb0bdfba83 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:07.386601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:28:07.400066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f0025d9-3e9b-4533-8588-20bb0bdfba83 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:07.406641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f0025d9-3e9b-4533-8588-20bb0bdfba83 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:07.411459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f0025d9-3e9b-4533-8588-20bb0bdfba83 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:07.411975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f0025d9-3e9b-4533-8588-20bb0bdfba83 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:07.696935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9f0025d9-3e9b-4533-8588-20bb0bdfba83 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:07.704999 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9f0025d9-3e9b-4533-8588-20bb0bdfba83 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1275 microversion: 2.1 time: 0.333151 May 28 21:28:07.708701 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2632/5212] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:07 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1275 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:08.728484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a7083876-5bfa-405c-a46f-b4e327c208c9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:08.729244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a7083876-5bfa-405c-a46f-b4e327c208c9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:08.742566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7083876-5bfa-405c-a46f-b4e327c208c9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:08.743029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7083876-5bfa-405c-a46f-b4e327c208c9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:08.743831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7083876-5bfa-405c-a46f-b4e327c208c9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:08.744282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7083876-5bfa-405c-a46f-b4e327c208c9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:09.496373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a7083876-5bfa-405c-a46f-b4e327c208c9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:09.504351 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a7083876-5bfa-405c-a46f-b4e327c208c9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1273 microversion: 2.1 time: 0.781029 May 28 21:28:09.510364 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2581/5213] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:08 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1273 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:10.530800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1b2e9a81-d19d-4895-9a6c-6e456f1776d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:10.532172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1b2e9a81-d19d-4895-9a6c-6e456f1776d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:10.543738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b2e9a81-d19d-4895-9a6c-6e456f1776d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:10.544514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b2e9a81-d19d-4895-9a6c-6e456f1776d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:10.558884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b2e9a81-d19d-4895-9a6c-6e456f1776d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:10.562735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b2e9a81-d19d-4895-9a6c-6e456f1776d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:11.499773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1b2e9a81-d19d-4895-9a6c-6e456f1776d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:11.512585 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1b2e9a81-d19d-4895-9a6c-6e456f1776d2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1315 microversion: 2.1 time: 0.989231 May 28 21:28:11.513488 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2633/5214] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:10 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1315 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:12.258618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-40454df7-1d17-4a41-bd6e-eb1b660ed82f req-2a59d97a-79ae-489a-8276-20e5b001558e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eae0a7a9-fc43-4223-8ab8-087913d81116", "tag": "56fc1fb3-b822-43eb-8a4f-8a45b044dda9"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:12.269872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-40454df7-1d17-4a41-bd6e-eb1b660ed82f req-2a59d97a-79ae-489a-8276-20e5b001558e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:12.270347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-40454df7-1d17-4a41-bd6e-eb1b660ed82f req-2a59d97a-79ae-489a-8276-20e5b001558e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:12.292286 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-40454df7-1d17-4a41-bd6e-eb1b660ed82f req-2a59d97a-79ae-489a-8276-20e5b001558e service nova] Creating event network-changed:56fc1fb3-b822-43eb-8a4f-8a45b044dda9 for instance eae0a7a9-fc43-4223-8ab8-087913d81116 on nch2-master-1 May 28 21:28:12.306939 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-40454df7-1d17-4a41-bd6e-eb1b660ed82f req-2a59d97a-79ae-489a-8276-20e5b001558e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045009 May 28 21:28:12.308019 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2582/5215] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:28:12.546881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-526a5fc9-9bbc-4cd6-af53-38bf70fcc221 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:12.548465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-526a5fc9-9bbc-4cd6-af53-38bf70fcc221 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:12.591319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-526a5fc9-9bbc-4cd6-af53-38bf70fcc221 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:12.591319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-526a5fc9-9bbc-4cd6-af53-38bf70fcc221 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:12.592063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-526a5fc9-9bbc-4cd6-af53-38bf70fcc221 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:12.592516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-526a5fc9-9bbc-4cd6-af53-38bf70fcc221 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:12.915259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1769351568", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cdaf932-9554-41b6-9356-44a95a22c252"}], "security_groups": [{"name": "tempest-securitygroup--1710998428"}], "key_name": "tempest-keypair-1450742268", "user_data": "}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:13.290424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] validate_networks() for [('4cdaf932-9554-41b6-9356-44a95a22c252', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:28:13.299653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-526a5fc9-9bbc-4cd6-af53-38bf70fcc221 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:13.314580 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-526a5fc9-9bbc-4cd6-af53-38bf70fcc221 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1315 microversion: 2.1 time: 0.784308 May 28 21:28:13.327901 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2634/5216] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:12 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1315 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:14.333738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7a85bbe0-5e15-410d-bd6b-bc32162cd677 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:14.335092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7a85bbe0-5e15-410d-bd6b-bc32162cd677 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:14.338521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:28:14.344518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a85bbe0-5e15-410d-bd6b-bc32162cd677 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:14.348515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a85bbe0-5e15-410d-bd6b-bc32162cd677 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:14.348515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a85bbe0-5e15-410d-bd6b-bc32162cd677 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:14.348515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a85bbe0-5e15-410d-bd6b-bc32162cd677 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:14.788224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7a85bbe0-5e15-410d-bd6b-bc32162cd677 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:14.797505 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7a85bbe0-5e15-410d-bd6b-bc32162cd677 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1315 microversion: 2.1 time: 0.469261 May 28 21:28:14.800754 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2635/5217] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:14 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1315 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:14.802979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:28:14.803461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:28:14.804410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:28:14.804840 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:28:14.805521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:28:14.815586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-308941365", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "56b90745-a7e4-4951-ac94-fad335e2d110"}], "key_name": "tempest-TestNetworkAdvancedServerOps-187899813", "security_groups": [{"name": "tempest-secgroup-smoke-324502257"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:14.837082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:14.837561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:14.838425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:14.846127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:14.898176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Getting quotas for project e3cc8c5f2fe44b87bf5c05eadb62936c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:28:14.905596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Getting quotas for user 93f78df0f96c47ac97a200a4442db6da and project e3cc8c5f2fe44b87bf5c05eadb62936c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:28:14.925402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:28:14.928511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:28:14.956562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] validate_networks() for [('56b90745-a7e4-4951-ac94-fad335e2d110', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:28:15.100340 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-930eba68-8a39-4dd6-8c19-25537662f4fb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.187878 May 28 21:28:15.102544 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2583/5218] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:28:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 2193 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:28:15.116939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f013dc01-ff49-4428-b1c0-7bd27cc06f90 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:15.118021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f013dc01-ff49-4428-b1c0-7bd27cc06f90 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:15.216579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f013dc01-ff49-4428-b1c0-7bd27cc06f90 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:15.243005 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f013dc01-ff49-4428-b1c0-7bd27cc06f90 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1238 microversion: 2.1 time: 0.131045 May 28 21:28:15.243873 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2584/5219] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:15 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1238 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:15.484789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:28:15.485406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:28:15.486161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:28:15.486750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:28:15.487263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:28:15.507959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:15.507959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:15.507959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:15.507959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:15.532634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for project c3588eab36044e439158f876836ea514. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:28:15.539034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for user f3468a0b2d324603ab6c3080993bc0c8 and project c3588eab36044e439158f876836ea514. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:28:15.555572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:28:15.559253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:28:15.695471 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bd6d93a0-6136-4ff7-834d-0935d76ddda5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.893333 May 28 21:28:15.696674 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2636/5220] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:28:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:28:15.708501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-37cf02a4-ba83-40dc-a22a-370d7d856a4a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:15.709171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-37cf02a4-ba83-40dc-a22a-370d7d856a4a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:15.813024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-37cf02a4-ba83-40dc-a22a-370d7d856a4a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:15.819940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1ec7a440-284d-4538-8e94-96826f259159 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:15.820963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1ec7a440-284d-4538-8e94-96826f259159 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:15.830683 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-37cf02a4-ba83-40dc-a22a-370d7d856a4a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1265 microversion: 2.1 time: 0.127910 May 28 21:28:15.831300 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2585/5221] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:15 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:15.839389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ec7a440-284d-4538-8e94-96826f259159 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:15.841894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ec7a440-284d-4538-8e94-96826f259159 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:15.844024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ec7a440-284d-4538-8e94-96826f259159 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:15.851012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ec7a440-284d-4538-8e94-96826f259159 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:16.193247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1ec7a440-284d-4538-8e94-96826f259159 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:16.205358 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1ec7a440-284d-4538-8e94-96826f259159 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1315 microversion: 2.1 time: 0.392366 May 28 21:28:16.206802 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2637/5222] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:15 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:28:16.261809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-633f9fa2-f451-434d-97ab-877663e5eee4 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:16.263234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-633f9fa2-f451-434d-97ab-877663e5eee4 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:16.347039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-633f9fa2-f451-434d-97ab-877663e5eee4 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:16.356556 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-633f9fa2-f451-434d-97ab-877663e5eee4 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1238 microversion: 2.1 time: 0.099385 May 28 21:28:16.375547 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2586/5223] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:16 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1238 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:16.851218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-439b9823-69d7-44aa-8a2a-32b1c50d0b6a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:16.851858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-439b9823-69d7-44aa-8a2a-32b1c50d0b6a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:17.226767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f5c55930-ebcd-417f-b411-ddb8e403b625 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:17.230125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f5c55930-ebcd-417f-b411-ddb8e403b625 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:17.250583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5c55930-ebcd-417f-b411-ddb8e403b625 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:17.251558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5c55930-ebcd-417f-b411-ddb8e403b625 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:17.252649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5c55930-ebcd-417f-b411-ddb8e403b625 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:17.253530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5c55930-ebcd-417f-b411-ddb8e403b625 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:17.490120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-439b9823-69d7-44aa-8a2a-32b1c50d0b6a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:17.498711 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-439b9823-69d7-44aa-8a2a-32b1c50d0b6a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1265 microversion: 2.1 time: 0.653479 May 28 21:28:17.499383 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2638/5224] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:16 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1265 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:17.524489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4c1b653f-0307-4a57-95ef-4273178399ae tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:17.531251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4c1b653f-0307-4a57-95ef-4273178399ae tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:17.548585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c1b653f-0307-4a57-95ef-4273178399ae tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:17.552466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c1b653f-0307-4a57-95ef-4273178399ae tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:17.560810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c1b653f-0307-4a57-95ef-4273178399ae tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:17.561429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4c1b653f-0307-4a57-95ef-4273178399ae tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:17.644819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4c1b653f-0307-4a57-95ef-4273178399ae tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:17.657447 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4c1b653f-0307-4a57-95ef-4273178399ae tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1234 microversion: 2.1 time: 0.155747 May 28 21:28:17.659296 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2639/5225] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:17 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1234 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:17.689218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f5c55930-ebcd-417f-b411-ddb8e403b625 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:17.701125 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f5c55930-ebcd-417f-b411-ddb8e403b625 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1315 microversion: 2.1 time: 0.479362 May 28 21:28:17.702594 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2587/5226] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:17 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:28:18.517300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c652b07a-d10d-4e3e-aad3-f8957854b5ff tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:18.517955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c652b07a-d10d-4e3e-aad3-f8957854b5ff tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:18.539201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c652b07a-d10d-4e3e-aad3-f8957854b5ff tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:18.540254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c652b07a-d10d-4e3e-aad3-f8957854b5ff tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:18.542655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c652b07a-d10d-4e3e-aad3-f8957854b5ff tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:18.543327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c652b07a-d10d-4e3e-aad3-f8957854b5ff tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:18.676316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-96d8aa0a-c215-445c-a298-ee56ef0531da tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:18.694577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-96d8aa0a-c215-445c-a298-ee56ef0531da tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:18.694577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96d8aa0a-c215-445c-a298-ee56ef0531da tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:18.694577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96d8aa0a-c215-445c-a298-ee56ef0531da tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:18.694577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96d8aa0a-c215-445c-a298-ee56ef0531da tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:18.694577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96d8aa0a-c215-445c-a298-ee56ef0531da tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:18.722464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c652b07a-d10d-4e3e-aad3-f8957854b5ff tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:18.731848 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c652b07a-d10d-4e3e-aad3-f8957854b5ff tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1317 microversion: 2.1 time: 0.218539 May 28 21:28:18.736694 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2640/5227] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:18 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:18.744760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0a479a71-e76e-4f08-ab93-66d13f8b82dd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:18.747797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0a479a71-e76e-4f08-ab93-66d13f8b82dd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:18.761174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a479a71-e76e-4f08-ab93-66d13f8b82dd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:18.764286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a479a71-e76e-4f08-ab93-66d13f8b82dd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:18.770617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a479a71-e76e-4f08-ab93-66d13f8b82dd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:18.771409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a479a71-e76e-4f08-ab93-66d13f8b82dd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:18.856301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-96d8aa0a-c215-445c-a298-ee56ef0531da tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:18.865720 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-96d8aa0a-c215-445c-a298-ee56ef0531da tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1298 microversion: 2.1 time: 0.193583 May 28 21:28:18.867269 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2588/5228] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:18 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1298 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:28:19.102514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0a479a71-e76e-4f08-ab93-66d13f8b82dd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:19.116989 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0a479a71-e76e-4f08-ab93-66d13f8b82dd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1315 microversion: 2.1 time: 0.375184 May 28 21:28:19.118947 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2641/5229] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:18 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:19.521986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-1620cf95-04d4-4586-a9b1-589003c6ab3f req-2fa63761-0bb2-45fb-934f-b52ed82f577e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae0a7a9-fc43-4223-8ab8-087913d81116", "name": "network-vif-plugged", "status": "completed", "tag": "56fc1fb3-b822-43eb-8a4f-8a45b044dda9"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:19.532908 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1620cf95-04d4-4586-a9b1-589003c6ab3f req-2fa63761-0bb2-45fb-934f-b52ed82f577e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:19.533586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1620cf95-04d4-4586-a9b1-589003c6ab3f req-2fa63761-0bb2-45fb-934f-b52ed82f577e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:19.548888 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-1620cf95-04d4-4586-a9b1-589003c6ab3f req-2fa63761-0bb2-45fb-934f-b52ed82f577e service nova] Creating event network-vif-plugged:56fc1fb3-b822-43eb-8a4f-8a45b044dda9 for instance eae0a7a9-fc43-4223-8ab8-087913d81116 on nch2-master-1 May 28 21:28:19.555178 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-1620cf95-04d4-4586-a9b1-589003c6ab3f req-2fa63761-0bb2-45fb-934f-b52ed82f577e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037186 May 28 21:28:19.556110 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2589/5230] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:28:19.754509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bd154e15-ba7a-4923-a6a8-497f13a8ce1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:19.755535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bd154e15-ba7a-4923-a6a8-497f13a8ce1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:19.767238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd154e15-ba7a-4923-a6a8-497f13a8ce1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:19.769425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd154e15-ba7a-4923-a6a8-497f13a8ce1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:19.771293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd154e15-ba7a-4923-a6a8-497f13a8ce1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:19.771752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd154e15-ba7a-4923-a6a8-497f13a8ce1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:19.889128 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d5d5fb47-d3a2-47d2-8366-273a8f7ea0ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:19.892030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d5d5fb47-d3a2-47d2-8366-273a8f7ea0ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:19.925166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bd154e15-ba7a-4923-a6a8-497f13a8ce1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:19.931830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d5d5fb47-d3a2-47d2-8366-273a8f7ea0ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:19.935196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d5d5fb47-d3a2-47d2-8366-273a8f7ea0ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:19.938630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d5d5fb47-d3a2-47d2-8366-273a8f7ea0ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:19.954302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d5d5fb47-d3a2-47d2-8366-273a8f7ea0ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:19.957023 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bd154e15-ba7a-4923-a6a8-497f13a8ce1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1323 microversion: 2.1 time: 0.206792 May 28 21:28:19.973989 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2642/5231] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:19 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1323 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:20.134570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7f4996f7-3b7d-46b2-9d24-43f80fee75f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:20.135213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7f4996f7-3b7d-46b2-9d24-43f80fee75f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:20.147249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f4996f7-3b7d-46b2-9d24-43f80fee75f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:20.147955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f4996f7-3b7d-46b2-9d24-43f80fee75f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:20.148960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f4996f7-3b7d-46b2-9d24-43f80fee75f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:20.149570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f4996f7-3b7d-46b2-9d24-43f80fee75f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:20.304350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d5d5fb47-d3a2-47d2-8366-273a8f7ea0ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:20.323831 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d5d5fb47-d3a2-47d2-8366-273a8f7ea0ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1364 microversion: 2.1 time: 0.439330 May 28 21:28:20.329161 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2590/5232] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:19 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1364 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:20.528154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7f4996f7-3b7d-46b2-9d24-43f80fee75f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:20.539294 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7f4996f7-3b7d-46b2-9d24-43f80fee75f6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1315 microversion: 2.1 time: 0.408452 May 28 21:28:20.541063 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2643/5233] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:20 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:20.985269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dbf447a3-a2d7-44fb-b859-1add127dbb89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:20.986723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dbf447a3-a2d7-44fb-b859-1add127dbb89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:21.009333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dbf447a3-a2d7-44fb-b859-1add127dbb89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:21.022065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dbf447a3-a2d7-44fb-b859-1add127dbb89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:21.023304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dbf447a3-a2d7-44fb-b859-1add127dbb89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:21.026906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dbf447a3-a2d7-44fb-b859-1add127dbb89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:21.341681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7ff89c7c-9739-4fe9-a151-5ecb1369f8aa tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:21.343074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7ff89c7c-9739-4fe9-a151-5ecb1369f8aa tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:21.370310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ff89c7c-9739-4fe9-a151-5ecb1369f8aa tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:21.371058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ff89c7c-9739-4fe9-a151-5ecb1369f8aa tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:21.372043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ff89c7c-9739-4fe9-a151-5ecb1369f8aa tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:21.373701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ff89c7c-9739-4fe9-a151-5ecb1369f8aa tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:21.388098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dbf447a3-a2d7-44fb-b859-1add127dbb89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:21.403025 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dbf447a3-a2d7-44fb-b859-1add127dbb89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1390 microversion: 2.1 time: 0.421994 May 28 21:28:21.403932 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2591/5234] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:20 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1390 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:21.558495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e86c8f88-7a75-4736-a25d-913de95e392b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:21.559133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e86c8f88-7a75-4736-a25d-913de95e392b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:21.582245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e86c8f88-7a75-4736-a25d-913de95e392b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:21.583016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e86c8f88-7a75-4736-a25d-913de95e392b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:21.584374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e86c8f88-7a75-4736-a25d-913de95e392b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:21.585007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e86c8f88-7a75-4736-a25d-913de95e392b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:21.799714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7ff89c7c-9739-4fe9-a151-5ecb1369f8aa tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:21.824476 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7ff89c7c-9739-4fe9-a151-5ecb1369f8aa tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1364 microversion: 2.1 time: 0.487163 May 28 21:28:21.826868 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2644/5235] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:21 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1364 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:21.890382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e86c8f88-7a75-4736-a25d-913de95e392b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:21.902271 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e86c8f88-7a75-4736-a25d-913de95e392b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1503 microversion: 2.1 time: 0.348545 May 28 21:28:21.909647 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2592/5236] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:21 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1503 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:21.923672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4003e95b-2070-49d1-b327-6412f4f38ed7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:21.928828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4003e95b-2070-49d1-b327-6412f4f38ed7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:21.941497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4003e95b-2070-49d1-b327-6412f4f38ed7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:21.942041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4003e95b-2070-49d1-b327-6412f4f38ed7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:21.944518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4003e95b-2070-49d1-b327-6412f4f38ed7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:21.945226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4003e95b-2070-49d1-b327-6412f4f38ed7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:21.962546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:28:21.971257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-5514d36f-226b-44bc-8ec3-6fb882d181d6 req-6059d701-874a-421f-8eac-3e559f7d3a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3733dc91-2f81-4efc-a391-73a96ee6ee44", "tag": "783b2061-7d11-4de9-a5c2-51f878cf481e"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:21.992500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5514d36f-226b-44bc-8ec3-6fb882d181d6 req-6059d701-874a-421f-8eac-3e559f7d3a97 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:21.993708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5514d36f-226b-44bc-8ec3-6fb882d181d6 req-6059d701-874a-421f-8eac-3e559f7d3a97 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:22.026813 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-5514d36f-226b-44bc-8ec3-6fb882d181d6 req-6059d701-874a-421f-8eac-3e559f7d3a97 service nova] Creating event network-changed:783b2061-7d11-4de9-a5c2-51f878cf481e for instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 on nch2-master-1 May 28 21:28:22.047658 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-5514d36f-226b-44bc-8ec3-6fb882d181d6 req-6059d701-874a-421f-8eac-3e559f7d3a97 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071305 May 28 21:28:22.057086 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2593/5237] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:28:22.352475 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4003e95b-2070-49d1-b327-6412f4f38ed7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116/action" status: 202 len: 0 microversion: 2.1 time: 0.432476 May 28 21:28:22.354623 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2645/5238] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:28:21 2022] POST /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:28:22.368093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ded008df-fc5b-4744-bf14-a6458f5b8ef5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:22.369232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ded008df-fc5b-4744-bf14-a6458f5b8ef5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:22.376806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ded008df-fc5b-4744-bf14-a6458f5b8ef5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:22.377269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ded008df-fc5b-4744-bf14-a6458f5b8ef5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:22.379259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ded008df-fc5b-4744-bf14-a6458f5b8ef5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:22.379259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ded008df-fc5b-4744-bf14-a6458f5b8ef5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:22.430896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fa3dcad5-421f-4b77-93b1-1f002b7c6681 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:22.433932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fa3dcad5-421f-4b77-93b1-1f002b7c6681 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:22.482915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa3dcad5-421f-4b77-93b1-1f002b7c6681 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:22.487451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa3dcad5-421f-4b77-93b1-1f002b7c6681 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:22.488293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa3dcad5-421f-4b77-93b1-1f002b7c6681 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:22.491194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa3dcad5-421f-4b77-93b1-1f002b7c6681 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:22.873178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ded008df-fc5b-4744-bf14-a6458f5b8ef5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:22.890139 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ded008df-fc5b-4744-bf14-a6458f5b8ef5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1508 microversion: 2.1 time: 0.531760 May 28 21:28:22.891239 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2594/5239] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:22 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1508 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:22.902679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cc6e51b3-88bb-4a2f-87e1-38fd6464832e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:22.917152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cc6e51b3-88bb-4a2f-87e1-38fd6464832e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:22.930534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc6e51b3-88bb-4a2f-87e1-38fd6464832e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:22.935119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc6e51b3-88bb-4a2f-87e1-38fd6464832e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:22.935727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc6e51b3-88bb-4a2f-87e1-38fd6464832e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:22.936115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc6e51b3-88bb-4a2f-87e1-38fd6464832e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:22.941071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fa3dcad5-421f-4b77-93b1-1f002b7c6681 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:22.950104 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fa3dcad5-421f-4b77-93b1-1f002b7c6681 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1390 microversion: 2.1 time: 0.532512 May 28 21:28:22.964401 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2646/5240] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:22 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1390 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:23.273586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cc6e51b3-88bb-4a2f-87e1-38fd6464832e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:23.284269 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cc6e51b3-88bb-4a2f-87e1-38fd6464832e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1364 microversion: 2.1 time: 0.391599 May 28 21:28:23.284872 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2595/5241] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:22 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1364 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:23.693699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-bccc5eaf-4495-4448-8c78-e1bf0b3c0bd3 req-fd481580-4532-416f-b66a-930116d5da59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d24eed1-f65c-4cbe-a113-9e6c6165a0c7", "tag": "ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:23.705428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-bccc5eaf-4495-4448-8c78-e1bf0b3c0bd3 req-fd481580-4532-416f-b66a-930116d5da59 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:23.706187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-bccc5eaf-4495-4448-8c78-e1bf0b3c0bd3 req-fd481580-4532-416f-b66a-930116d5da59 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:23.722836 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-bccc5eaf-4495-4448-8c78-e1bf0b3c0bd3 req-fd481580-4532-416f-b66a-930116d5da59 service nova] Creating event network-changed:ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249 for instance 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 on nch2-master-1 May 28 21:28:23.728545 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-bccc5eaf-4495-4448-8c78-e1bf0b3c0bd3 req-fd481580-4532-416f-b66a-930116d5da59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039795 May 28 21:28:23.729881 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2647/5242] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:28:23.908188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4f7d5205-79d0-4579-87f6-d99c5ad4c171 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:23.909352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4f7d5205-79d0-4579-87f6-d99c5ad4c171 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:23.918696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f7d5205-79d0-4579-87f6-d99c5ad4c171 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:23.919396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f7d5205-79d0-4579-87f6-d99c5ad4c171 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:23.920368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f7d5205-79d0-4579-87f6-d99c5ad4c171 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:23.921514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f7d5205-79d0-4579-87f6-d99c5ad4c171 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:23.950578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:28:23.971898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-47bbb536-ec4f-4482-9ca1-dd14a8091344 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:23.972618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-47bbb536-ec4f-4482-9ca1-dd14a8091344 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:23.983025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-47bbb536-ec4f-4482-9ca1-dd14a8091344 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:23.983499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-47bbb536-ec4f-4482-9ca1-dd14a8091344 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:23.984294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-47bbb536-ec4f-4482-9ca1-dd14a8091344 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:23.984746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-47bbb536-ec4f-4482-9ca1-dd14a8091344 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:24.205210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4f7d5205-79d0-4579-87f6-d99c5ad4c171 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:24.213855 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4f7d5205-79d0-4579-87f6-d99c5ad4c171 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1488 microversion: 2.1 time: 0.310217 May 28 21:28:24.221020 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2596/5243] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:23 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1488 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:24.225076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-47bbb536-ec4f-4482-9ca1-dd14a8091344 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:24.233456 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-47bbb536-ec4f-4482-9ca1-dd14a8091344 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1390 microversion: 2.1 time: 0.266024 May 28 21:28:24.233692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-82b49a4a-1d75-4e58-b12a-c58bf904cd43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:24.234029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-82b49a4a-1d75-4e58-b12a-c58bf904cd43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:24.234551 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2648/5244] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:23 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1390 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:28:24.241670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82b49a4a-1d75-4e58-b12a-c58bf904cd43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:24.242170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82b49a4a-1d75-4e58-b12a-c58bf904cd43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:24.243146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82b49a4a-1d75-4e58-b12a-c58bf904cd43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:24.243593 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82b49a4a-1d75-4e58-b12a-c58bf904cd43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:24.269542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-82b49a4a-1d75-4e58-b12a-c58bf904cd43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lazy-loading 'flavor' on Instance uuid eae0a7a9-fc43-4223-8ab8-087913d81116 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:28:24.303872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-70b73451-0ff8-450b-97e3-fa92f6fbe123 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:24.304501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-70b73451-0ff8-450b-97e3-fa92f6fbe123 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:24.313499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70b73451-0ff8-450b-97e3-fa92f6fbe123 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:24.314389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70b73451-0ff8-450b-97e3-fa92f6fbe123 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:24.315382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70b73451-0ff8-450b-97e3-fa92f6fbe123 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:24.319191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70b73451-0ff8-450b-97e3-fa92f6fbe123 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:24.503957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-70b73451-0ff8-450b-97e3-fa92f6fbe123 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:24.512461 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-70b73451-0ff8-450b-97e3-fa92f6fbe123 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1364 microversion: 2.1 time: 0.213636 May 28 21:28:24.513415 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2649/5245] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:24 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:24.880206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:28:24.970011 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-82b49a4a-1d75-4e58-b12a-c58bf904cd43 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116/action" status: 202 len: 0 microversion: 2.1 time: 0.739809 May 28 21:28:24.971014 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2597/5246] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:28:24 2022] POST /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116/action => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:28:24.984465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-167d5e51-0b02-42bc-8e68-414be9240228 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:24.984465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-167d5e51-0b02-42bc-8e68-414be9240228 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:24.992457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-167d5e51-0b02-42bc-8e68-414be9240228 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:24.992927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-167d5e51-0b02-42bc-8e68-414be9240228 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:24.993709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-167d5e51-0b02-42bc-8e68-414be9240228 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:24.994184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-167d5e51-0b02-42bc-8e68-414be9240228 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:25.167030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-167d5e51-0b02-42bc-8e68-414be9240228 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:25.175152 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-167d5e51-0b02-42bc-8e68-414be9240228 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1494 microversion: 2.1 time: 0.199672 May 28 21:28:25.176287 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2650/5247] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:24 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1494 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:25.253038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a918d605-d005-4a6b-b97d-eed3141c56f8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:25.253670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a918d605-d005-4a6b-b97d-eed3141c56f8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:25.260098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a918d605-d005-4a6b-b97d-eed3141c56f8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:25.260661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a918d605-d005-4a6b-b97d-eed3141c56f8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:25.261700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a918d605-d005-4a6b-b97d-eed3141c56f8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:25.262194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a918d605-d005-4a6b-b97d-eed3141c56f8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:25.412638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a918d605-d005-4a6b-b97d-eed3141c56f8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:25.420472 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a918d605-d005-4a6b-b97d-eed3141c56f8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1390 microversion: 2.1 time: 0.173076 May 28 21:28:25.421224 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2598/5248] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:25 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1390 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:28:25.529317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c34fa6e0-5219-48f2-888e-d5da170b2f85 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:25.530179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c34fa6e0-5219-48f2-888e-d5da170b2f85 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:25.543308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:28:25.550424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c34fa6e0-5219-48f2-888e-d5da170b2f85 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:25.553756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c34fa6e0-5219-48f2-888e-d5da170b2f85 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:25.554978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c34fa6e0-5219-48f2-888e-d5da170b2f85 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:25.562413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c34fa6e0-5219-48f2-888e-d5da170b2f85 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:25.716661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c34fa6e0-5219-48f2-888e-d5da170b2f85 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:25.725936 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c34fa6e0-5219-48f2-888e-d5da170b2f85 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1364 microversion: 2.1 time: 0.200600 May 28 21:28:25.734181 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2651/5249] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:25 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:26.194467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-97aac2b6-e81a-41fb-8676-1baad2e85479 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:26.195107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-97aac2b6-e81a-41fb-8676-1baad2e85479 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:26.202301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-97aac2b6-e81a-41fb-8676-1baad2e85479 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:26.202774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-97aac2b6-e81a-41fb-8676-1baad2e85479 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:26.203559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-97aac2b6-e81a-41fb-8676-1baad2e85479 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:26.204008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-97aac2b6-e81a-41fb-8676-1baad2e85479 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:26.351489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=14 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:28:26.367774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-97aac2b6-e81a-41fb-8676-1baad2e85479 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:26.375697 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-97aac2b6-e81a-41fb-8676-1baad2e85479 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1515 microversion: 2.1 time: 0.185314 May 28 21:28:26.377259 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2599/5250] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:26 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:26.439638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9bf51259-5b6a-4021-b097-d3adaed75ffb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:26.440336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9bf51259-5b6a-4021-b097-d3adaed75ffb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:26.448940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bf51259-5b6a-4021-b097-d3adaed75ffb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:26.449438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bf51259-5b6a-4021-b097-d3adaed75ffb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:26.450250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bf51259-5b6a-4021-b097-d3adaed75ffb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:26.450886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9bf51259-5b6a-4021-b097-d3adaed75ffb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:26.595219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9bf51259-5b6a-4021-b097-d3adaed75ffb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:26.632924 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9bf51259-5b6a-4021-b097-d3adaed75ffb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1390 microversion: 2.1 time: 0.198733 May 28 21:28:26.636021 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2652/5251] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:26 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1390 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:26.743582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d554fbd1-17f1-41ca-aabe-e1f16d227535 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:26.744467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d554fbd1-17f1-41ca-aabe-e1f16d227535 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:26.750845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d554fbd1-17f1-41ca-aabe-e1f16d227535 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:26.757315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d554fbd1-17f1-41ca-aabe-e1f16d227535 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:26.757315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d554fbd1-17f1-41ca-aabe-e1f16d227535 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:26.757315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d554fbd1-17f1-41ca-aabe-e1f16d227535 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:26.897017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d554fbd1-17f1-41ca-aabe-e1f16d227535 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:26.905238 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d554fbd1-17f1-41ca-aabe-e1f16d227535 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1364 microversion: 2.1 time: 0.166144 May 28 21:28:26.906211 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2600/5252] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:26 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:27.395885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-134d0277-9dee-4123-bec8-dd6e51a02ae7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:27.400526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-134d0277-9dee-4123-bec8-dd6e51a02ae7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:27.409423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-134d0277-9dee-4123-bec8-dd6e51a02ae7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:27.411047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-134d0277-9dee-4123-bec8-dd6e51a02ae7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:27.412820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-134d0277-9dee-4123-bec8-dd6e51a02ae7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:27.413447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-134d0277-9dee-4123-bec8-dd6e51a02ae7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:27.497268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=22 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:28:27.591551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-134d0277-9dee-4123-bec8-dd6e51a02ae7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:27.600338 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-134d0277-9dee-4123-bec8-dd6e51a02ae7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1515 microversion: 2.1 time: 0.210559 May 28 21:28:27.600933 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2653/5253] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:27 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:27.652229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b9f639c3-b726-4e94-8b99-44460595ccdc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:27.653074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b9f639c3-b726-4e94-8b99-44460595ccdc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:27.661955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9f639c3-b726-4e94-8b99-44460595ccdc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:27.663787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9f639c3-b726-4e94-8b99-44460595ccdc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:27.664711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9f639c3-b726-4e94-8b99-44460595ccdc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:27.665427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9f639c3-b726-4e94-8b99-44460595ccdc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:27.825295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b9f639c3-b726-4e94-8b99-44460595ccdc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:27.833262 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b9f639c3-b726-4e94-8b99-44460595ccdc tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1390 microversion: 2.1 time: 0.185160 May 28 21:28:27.834191 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2601/5254] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:27 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1390 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:27.932674 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a0470a27-31b2-42ad-90b5-3e5c2497045e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:27.934211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a0470a27-31b2-42ad-90b5-3e5c2497045e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:27.950919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0470a27-31b2-42ad-90b5-3e5c2497045e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:27.950919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0470a27-31b2-42ad-90b5-3e5c2497045e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:27.952816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0470a27-31b2-42ad-90b5-3e5c2497045e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:27.953614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0470a27-31b2-42ad-90b5-3e5c2497045e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:28.270324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a0470a27-31b2-42ad-90b5-3e5c2497045e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:28.282413 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a0470a27-31b2-42ad-90b5-3e5c2497045e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1364 microversion: 2.1 time: 0.363150 May 28 21:28:28.283599 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2654/5255] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:27 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1364 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:28.617901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-11aef968-568f-4d1e-935a-37b2d5a776d3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:28.618834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-11aef968-568f-4d1e-935a-37b2d5a776d3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:28.625605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11aef968-568f-4d1e-935a-37b2d5a776d3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:28.626154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11aef968-568f-4d1e-935a-37b2d5a776d3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:28.626961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11aef968-568f-4d1e-935a-37b2d5a776d3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:28.627518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11aef968-568f-4d1e-935a-37b2d5a776d3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:28.786925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-11aef968-568f-4d1e-935a-37b2d5a776d3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:28.800196 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-11aef968-568f-4d1e-935a-37b2d5a776d3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1510 microversion: 2.1 time: 0.185233 May 28 21:28:28.802673 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2602/5256] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:28 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1510 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:28.854039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d0f81628-6966-4ab7-8000-ae7f943a9c6a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:28.854761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d0f81628-6966-4ab7-8000-ae7f943a9c6a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:28.867298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d0f81628-6966-4ab7-8000-ae7f943a9c6a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:28.868737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d0f81628-6966-4ab7-8000-ae7f943a9c6a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:28.872200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d0f81628-6966-4ab7-8000-ae7f943a9c6a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:28.872923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d0f81628-6966-4ab7-8000-ae7f943a9c6a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:29.087464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d0f81628-6966-4ab7-8000-ae7f943a9c6a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:29.098483 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d0f81628-6966-4ab7-8000-ae7f943a9c6a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1390 microversion: 2.1 time: 0.250035 May 28 21:28:29.109280 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2655/5257] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:28 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1390 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:29.299874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7c38f80d-f31b-4f6a-803d-0db616d4af31 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:29.300914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7c38f80d-f31b-4f6a-803d-0db616d4af31 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:29.318894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c38f80d-f31b-4f6a-803d-0db616d4af31 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:29.319385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c38f80d-f31b-4f6a-803d-0db616d4af31 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:29.320207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c38f80d-f31b-4f6a-803d-0db616d4af31 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:29.320633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c38f80d-f31b-4f6a-803d-0db616d4af31 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:29.480215 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-125e0a0b-888d-4205-9014-6fc81dd38cbf req-1ed12405-f049-4f3b-86fa-afb4d34b8c33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae0a7a9-fc43-4223-8ab8-087913d81116", "name": "network-vif-plugged", "status": "completed", "tag": "56fc1fb3-b822-43eb-8a4f-8a45b044dda9"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:29.500595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-125e0a0b-888d-4205-9014-6fc81dd38cbf req-1ed12405-f049-4f3b-86fa-afb4d34b8c33 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:29.501266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-125e0a0b-888d-4205-9014-6fc81dd38cbf req-1ed12405-f049-4f3b-86fa-afb4d34b8c33 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:29.527993 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-125e0a0b-888d-4205-9014-6fc81dd38cbf req-1ed12405-f049-4f3b-86fa-afb4d34b8c33 service nova] Creating event network-vif-plugged:56fc1fb3-b822-43eb-8a4f-8a45b044dda9 for instance eae0a7a9-fc43-4223-8ab8-087913d81116 on nch2-master-1 May 28 21:28:29.544427 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-125e0a0b-888d-4205-9014-6fc81dd38cbf req-1ed12405-f049-4f3b-86fa-afb4d34b8c33 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069321 May 28 21:28:29.547322 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2656/5258] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:28:29.571123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7c38f80d-f31b-4f6a-803d-0db616d4af31 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:29.606691 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7c38f80d-f31b-4f6a-803d-0db616d4af31 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1364 microversion: 2.1 time: 0.304916 May 28 21:28:29.607321 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2603/5259] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:29 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1364 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:29.822948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a903649-1fc7-4116-b177-efdd1a4eb49d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:29.824088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6a903649-1fc7-4116-b177-efdd1a4eb49d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:29.833313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a903649-1fc7-4116-b177-efdd1a4eb49d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:29.833778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a903649-1fc7-4116-b177-efdd1a4eb49d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:29.834608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a903649-1fc7-4116-b177-efdd1a4eb49d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:29.835029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a903649-1fc7-4116-b177-efdd1a4eb49d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:30.061684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a903649-1fc7-4116-b177-efdd1a4eb49d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:30.083946 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6a903649-1fc7-4116-b177-efdd1a4eb49d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1510 microversion: 2.1 time: 0.266558 May 28 21:28:30.087511 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2657/5260] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:29 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1510 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:30.117885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a2f7a986-0d4d-4564-b8c8-84f1759a69a1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:30.121213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a2f7a986-0d4d-4564-b8c8-84f1759a69a1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:30.134847 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2f7a986-0d4d-4564-b8c8-84f1759a69a1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:30.135670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2f7a986-0d4d-4564-b8c8-84f1759a69a1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:30.136689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2f7a986-0d4d-4564-b8c8-84f1759a69a1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:30.137361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2f7a986-0d4d-4564-b8c8-84f1759a69a1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:30.352812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a2f7a986-0d4d-4564-b8c8-84f1759a69a1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:30.381680 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a2f7a986-0d4d-4564-b8c8-84f1759a69a1 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1390 microversion: 2.1 time: 0.269024 May 28 21:28:30.394139 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2604/5261] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:30 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1390 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:30.626334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a0950800-799e-4268-8ad9-4f6441653b04 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:30.626980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a0950800-799e-4268-8ad9-4f6441653b04 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:30.641194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0950800-799e-4268-8ad9-4f6441653b04 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:30.642124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0950800-799e-4268-8ad9-4f6441653b04 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:30.643129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0950800-799e-4268-8ad9-4f6441653b04 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:30.643764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0950800-799e-4268-8ad9-4f6441653b04 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:30.789736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a0950800-799e-4268-8ad9-4f6441653b04 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:30.799402 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a0950800-799e-4268-8ad9-4f6441653b04 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1364 microversion: 2.1 time: 0.177147 May 28 21:28:30.800304 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2658/5262] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:30 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:28:31.118281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-386f2b2d-6973-4f5e-8429-a346c8e4a160 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:31.119435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-386f2b2d-6973-4f5e-8429-a346c8e4a160 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:31.127068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-386f2b2d-6973-4f5e-8429-a346c8e4a160 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:31.134391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-386f2b2d-6973-4f5e-8429-a346c8e4a160 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:31.135984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-386f2b2d-6973-4f5e-8429-a346c8e4a160 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:31.136508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-386f2b2d-6973-4f5e-8429-a346c8e4a160 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:31.400458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8e9551b2-c112-409d-9572-57900acbbb75 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:31.401239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8e9551b2-c112-409d-9572-57900acbbb75 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:31.414021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e9551b2-c112-409d-9572-57900acbbb75 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:31.414994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e9551b2-c112-409d-9572-57900acbbb75 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:31.421081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e9551b2-c112-409d-9572-57900acbbb75 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:31.421081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e9551b2-c112-409d-9572-57900acbbb75 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:31.543758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-386f2b2d-6973-4f5e-8429-a346c8e4a160 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:31.579683 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-386f2b2d-6973-4f5e-8429-a346c8e4a160 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1510 microversion: 2.1 time: 0.464178 May 28 21:28:31.580256 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2605/5263] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:31 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:31.592744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-46df453b-68c7-4053-aaab-b7329c15e09c req-fbc4e418-42eb-493d-b2f0-56ad67da9f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3733dc91-2f81-4efc-a391-73a96ee6ee44", "name": "network-vif-plugged", "status": "completed", "tag": "783b2061-7d11-4de9-a5c2-51f878cf481e"}, {"server_uuid": "8d24eed1-f65c-4cbe-a113-9e6c6165a0c7", "name": "network-vif-plugged", "status": "completed", "tag": "ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:31.612123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-46df453b-68c7-4053-aaab-b7329c15e09c req-fbc4e418-42eb-493d-b2f0-56ad67da9f0e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:31.612794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-46df453b-68c7-4053-aaab-b7329c15e09c req-fbc4e418-42eb-493d-b2f0-56ad67da9f0e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:31.628525 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-46df453b-68c7-4053-aaab-b7329c15e09c req-fbc4e418-42eb-493d-b2f0-56ad67da9f0e service nova] Creating event network-vif-plugged:783b2061-7d11-4de9-a5c2-51f878cf481e for instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 on nch2-master-1 May 28 21:28:31.629385 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-46df453b-68c7-4053-aaab-b7329c15e09c req-fbc4e418-42eb-493d-b2f0-56ad67da9f0e service nova] Creating event network-vif-plugged:ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249 for instance 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 on nch2-master-1 May 28 21:28:31.637220 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-46df453b-68c7-4053-aaab-b7329c15e09c req-fbc4e418-42eb-493d-b2f0-56ad67da9f0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055691 May 28 21:28:31.639990 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2606/5264] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:28:31.800910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8e9551b2-c112-409d-9572-57900acbbb75 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:31.814369 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8e9551b2-c112-409d-9572-57900acbbb75 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1390 microversion: 2.1 time: 0.416727 May 28 21:28:31.815946 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2659/5265] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:31 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1390 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:31.820020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-70aa381a-3c89-4b04-be56-f936c2bba686 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:31.821679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-70aa381a-3c89-4b04-be56-f936c2bba686 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:31.838510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70aa381a-3c89-4b04-be56-f936c2bba686 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:31.840746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70aa381a-3c89-4b04-be56-f936c2bba686 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:31.842434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70aa381a-3c89-4b04-be56-f936c2bba686 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:31.845249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70aa381a-3c89-4b04-be56-f936c2bba686 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:32.147318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-70aa381a-3c89-4b04-be56-f936c2bba686 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:32.156932 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-70aa381a-3c89-4b04-be56-f936c2bba686 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1364 microversion: 2.1 time: 0.343446 May 28 21:28:32.172874 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2607/5266] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:31 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1364 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:28:32.598727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a77eb5a7-fb58-431c-bf7d-ee97c37ae59c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:32.600042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a77eb5a7-fb58-431c-bf7d-ee97c37ae59c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:32.626769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a77eb5a7-fb58-431c-bf7d-ee97c37ae59c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:32.627424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a77eb5a7-fb58-431c-bf7d-ee97c37ae59c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:32.628741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a77eb5a7-fb58-431c-bf7d-ee97c37ae59c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:32.629455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a77eb5a7-fb58-431c-bf7d-ee97c37ae59c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:32.836544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ba82da05-761e-4072-a7af-104206d1b3e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:32.838359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ba82da05-761e-4072-a7af-104206d1b3e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:32.853060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba82da05-761e-4072-a7af-104206d1b3e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:32.854218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba82da05-761e-4072-a7af-104206d1b3e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:32.856807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba82da05-761e-4072-a7af-104206d1b3e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:32.858346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba82da05-761e-4072-a7af-104206d1b3e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:33.092610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a77eb5a7-fb58-431c-bf7d-ee97c37ae59c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:33.106923 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a77eb5a7-fb58-431c-bf7d-ee97c37ae59c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1510 microversion: 2.1 time: 0.512838 May 28 21:28:33.113832 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2660/5267] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:32 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1510 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:28:33.145500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ba82da05-761e-4072-a7af-104206d1b3e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:33.154956 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ba82da05-761e-4072-a7af-104206d1b3e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1390 microversion: 2.1 time: 0.326142 May 28 21:28:33.161569 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2608/5268] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:32 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1390 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:28:33.176986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b2738b8f-dae9-49dd-92f6-a3e25c3742a9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:33.177602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b2738b8f-dae9-49dd-92f6-a3e25c3742a9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:33.185056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2738b8f-dae9-49dd-92f6-a3e25c3742a9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:33.185572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2738b8f-dae9-49dd-92f6-a3e25c3742a9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:33.186424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2738b8f-dae9-49dd-92f6-a3e25c3742a9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:33.186871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2738b8f-dae9-49dd-92f6-a3e25c3742a9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:33.335654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b2738b8f-dae9-49dd-92f6-a3e25c3742a9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:33.343417 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b2738b8f-dae9-49dd-92f6-a3e25c3742a9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1364 microversion: 2.1 time: 0.170971 May 28 21:28:33.344283 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2661/5269] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:33 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:34.127699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-88268c7e-c35b-4eab-98fb-d7ab4f43332b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:34.128340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-88268c7e-c35b-4eab-98fb-d7ab4f43332b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:34.132038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:28:34.142520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88268c7e-c35b-4eab-98fb-d7ab4f43332b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:34.143041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88268c7e-c35b-4eab-98fb-d7ab4f43332b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:34.155194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88268c7e-c35b-4eab-98fb-d7ab4f43332b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:34.155194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88268c7e-c35b-4eab-98fb-d7ab4f43332b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:34.174541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc72b24a-49b4-48b5-8860-63194cd09fa6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:34.175819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc72b24a-49b4-48b5-8860-63194cd09fa6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:34.185870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc72b24a-49b4-48b5-8860-63194cd09fa6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:34.189381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc72b24a-49b4-48b5-8860-63194cd09fa6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:34.189381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc72b24a-49b4-48b5-8860-63194cd09fa6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:34.189381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc72b24a-49b4-48b5-8860-63194cd09fa6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:34.192981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:28:34.553539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-88268c7e-c35b-4eab-98fb-d7ab4f43332b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:34.564196 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-88268c7e-c35b-4eab-98fb-d7ab4f43332b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1510 microversion: 2.1 time: 0.440299 May 28 21:28:34.566132 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2609/5270] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:34 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1510 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:34.571783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0b9ac1be-d726-4019-baa4-9f77d3e169c4 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:34.572640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0b9ac1be-d726-4019-baa4-9f77d3e169c4 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:34.585157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc72b24a-49b4-48b5-8860-63194cd09fa6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:34.594054 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc72b24a-49b4-48b5-8860-63194cd09fa6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1562 microversion: 2.1 time: 0.423087 May 28 21:28:34.610015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b9ac1be-d726-4019-baa4-9f77d3e169c4 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:34.610015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b9ac1be-d726-4019-baa4-9f77d3e169c4 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:34.610015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b9ac1be-d726-4019-baa4-9f77d3e169c4 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:34.610015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0b9ac1be-d726-4019-baa4-9f77d3e169c4 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:34.611493 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2662/5271] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:34 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1562 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:28:34.626913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f010c0e7-2f2d-4c0e-82ff-095ad70ee7bd tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:34.628842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f010c0e7-2f2d-4c0e-82ff-095ad70ee7bd tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:34.636364 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f010c0e7-2f2d-4c0e-82ff-095ad70ee7bd tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:34.642425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f010c0e7-2f2d-4c0e-82ff-095ad70ee7bd tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:34.642425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f010c0e7-2f2d-4c0e-82ff-095ad70ee7bd tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:34.642425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f010c0e7-2f2d-4c0e-82ff-095ad70ee7bd tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:34.905754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0b9ac1be-d726-4019-baa4-9f77d3e169c4 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:34.917183 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0b9ac1be-d726-4019-baa4-9f77d3e169c4 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1550 microversion: 2.1 time: 0.349646 May 28 21:28:34.917792 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2610/5272] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:34 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1550 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:34.930664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f010c0e7-2f2d-4c0e-82ff-095ad70ee7bd tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:34.939484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-65783acb-003f-4084-98e3-021c613025bc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:34.940328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-65783acb-003f-4084-98e3-021c613025bc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:34.943358 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f010c0e7-2f2d-4c0e-82ff-095ad70ee7bd tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1562 microversion: 2.1 time: 0.328906 May 28 21:28:34.946852 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2663/5273] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:34 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1562 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:28:34.948518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65783acb-003f-4084-98e3-021c613025bc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:34.949223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65783acb-003f-4084-98e3-021c613025bc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:34.951427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65783acb-003f-4084-98e3-021c613025bc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:34.952218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-65783acb-003f-4084-98e3-021c613025bc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:35.079103 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-65783acb-003f-4084-98e3-021c613025bc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144026 May 28 21:28:35.080917 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2611/5274] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:28:34 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:28:35.597540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d28b4ad6-d3fa-4f6e-8e37-b2d978f75de0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:35.600821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d28b4ad6-d3fa-4f6e-8e37-b2d978f75de0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:35.623051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d28b4ad6-d3fa-4f6e-8e37-b2d978f75de0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:35.625184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d28b4ad6-d3fa-4f6e-8e37-b2d978f75de0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:35.626026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d28b4ad6-d3fa-4f6e-8e37-b2d978f75de0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:35.626863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d28b4ad6-d3fa-4f6e-8e37-b2d978f75de0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:36.246767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d28b4ad6-d3fa-4f6e-8e37-b2d978f75de0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:36.256923 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d28b4ad6-d3fa-4f6e-8e37-b2d978f75de0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1510 microversion: 2.1 time: 0.675074 May 28 21:28:36.262330 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2664/5275] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:35 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1510 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:37.145476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-e529f8d9-6e00-48c7-b8c4-357f36475f7d req-a1840667-eca5-49d0-a5de-a2f9c89e6fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3733dc91-2f81-4efc-a391-73a96ee6ee44", "tag": "783b2061-7d11-4de9-a5c2-51f878cf481e"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:37.156827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e529f8d9-6e00-48c7-b8c4-357f36475f7d req-a1840667-eca5-49d0-a5de-a2f9c89e6fd6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:37.157742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e529f8d9-6e00-48c7-b8c4-357f36475f7d req-a1840667-eca5-49d0-a5de-a2f9c89e6fd6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:37.167763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:28:37.182497 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e529f8d9-6e00-48c7-b8c4-357f36475f7d req-a1840667-eca5-49d0-a5de-a2f9c89e6fd6 service nova] Creating event network-changed:783b2061-7d11-4de9-a5c2-51f878cf481e for instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 on nch2-master-1 May 28 21:28:37.190871 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-e529f8d9-6e00-48c7-b8c4-357f36475f7d req-a1840667-eca5-49d0-a5de-a2f9c89e6fd6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049906 May 28 21:28:37.196935 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2612/5276] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:28:37.275889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-27ed1582-0ee3-4c31-9949-154ae9051ee9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:37.277611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-27ed1582-0ee3-4c31-9949-154ae9051ee9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:37.311597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27ed1582-0ee3-4c31-9949-154ae9051ee9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:37.312315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27ed1582-0ee3-4c31-9949-154ae9051ee9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:37.319216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27ed1582-0ee3-4c31-9949-154ae9051ee9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:37.319787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-27ed1582-0ee3-4c31-9949-154ae9051ee9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:37.809281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-27ed1582-0ee3-4c31-9949-154ae9051ee9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:37.822162 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-27ed1582-0ee3-4c31-9949-154ae9051ee9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1510 microversion: 2.1 time: 0.548728 May 28 21:28:37.828704 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2665/5277] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:37 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1510 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:38.842068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-efcdc76c-b39f-416c-906f-6deef6cf410f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:38.843105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-efcdc76c-b39f-416c-906f-6deef6cf410f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:38.858237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efcdc76c-b39f-416c-906f-6deef6cf410f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:38.858988 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efcdc76c-b39f-416c-906f-6deef6cf410f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:38.860039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efcdc76c-b39f-416c-906f-6deef6cf410f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:38.860968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-efcdc76c-b39f-416c-906f-6deef6cf410f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:39.161235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-efcdc76c-b39f-416c-906f-6deef6cf410f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:39.170989 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-efcdc76c-b39f-416c-906f-6deef6cf410f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1510 microversion: 2.1 time: 0.333747 May 28 21:28:39.171903 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2613/5278] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:38 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1510 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:39.448092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-77c862d9-d801-4480-be71-fcda79a32e24 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:39.448882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-77c862d9-d801-4480-be71-fcda79a32e24 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:39.469189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-07410e52-112b-4de6-b3a5-df3ea29a446b req-e146bc19-a135-4628-a43f-dba1464cd4d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d24eed1-f65c-4cbe-a113-9e6c6165a0c7", "tag": "ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:39.476340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77c862d9-d801-4480-be71-fcda79a32e24 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:39.485158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77c862d9-d801-4480-be71-fcda79a32e24 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:39.485158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77c862d9-d801-4480-be71-fcda79a32e24 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:39.485158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77c862d9-d801-4480-be71-fcda79a32e24 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:39.486369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-07410e52-112b-4de6-b3a5-df3ea29a446b req-e146bc19-a135-4628-a43f-dba1464cd4d2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:39.487823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-07410e52-112b-4de6-b3a5-df3ea29a446b req-e146bc19-a135-4628-a43f-dba1464cd4d2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:39.514973 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-07410e52-112b-4de6-b3a5-df3ea29a446b req-e146bc19-a135-4628-a43f-dba1464cd4d2 service nova] Creating event network-changed:ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249 for instance 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 on nch2-master-1 May 28 21:28:39.532182 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-07410e52-112b-4de6-b3a5-df3ea29a446b req-e146bc19-a135-4628-a43f-dba1464cd4d2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068707 May 28 21:28:39.541216 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2614/5279] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:28:39.896116 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-77c862d9-d801-4480-be71-fcda79a32e24 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:39.906321 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-77c862d9-d801-4480-be71-fcda79a32e24 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1562 microversion: 2.1 time: 0.464419 May 28 21:28:39.906918 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2666/5280] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:39 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1562 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:40.191864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c5eea2a3-513e-4cf2-8565-beed0747e4e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:40.193195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c5eea2a3-513e-4cf2-8565-beed0747e4e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:40.208462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5eea2a3-513e-4cf2-8565-beed0747e4e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:40.211010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5eea2a3-513e-4cf2-8565-beed0747e4e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:40.212468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5eea2a3-513e-4cf2-8565-beed0747e4e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:40.216206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5eea2a3-513e-4cf2-8565-beed0747e4e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:40.586453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c5eea2a3-513e-4cf2-8565-beed0747e4e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:40.602902 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c5eea2a3-513e-4cf2-8565-beed0747e4e6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1510 microversion: 2.1 time: 0.417172 May 28 21:28:40.603803 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2615/5281] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:40 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1510 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:41.627724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aca58e0c-5d42-46b9-9700-3a6078124448 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:41.628393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aca58e0c-5d42-46b9-9700-3a6078124448 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:41.643565 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aca58e0c-5d42-46b9-9700-3a6078124448 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:41.651836 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aca58e0c-5d42-46b9-9700-3a6078124448 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:41.654172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aca58e0c-5d42-46b9-9700-3a6078124448 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:41.654635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aca58e0c-5d42-46b9-9700-3a6078124448 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:41.871981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aca58e0c-5d42-46b9-9700-3a6078124448 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:41.887624 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aca58e0c-5d42-46b9-9700-3a6078124448 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1510 microversion: 2.1 time: 0.270360 May 28 21:28:41.888371 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2667/5282] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:41 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1510 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:42.908247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-43da3fe3-c3f4-4313-947d-a33d636e9c94 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:42.908882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-43da3fe3-c3f4-4313-947d-a33d636e9c94 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:42.917175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43da3fe3-c3f4-4313-947d-a33d636e9c94 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:42.917660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43da3fe3-c3f4-4313-947d-a33d636e9c94 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:42.918597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43da3fe3-c3f4-4313-947d-a33d636e9c94 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:42.919071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43da3fe3-c3f4-4313-947d-a33d636e9c94 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:43.064268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-43da3fe3-c3f4-4313-947d-a33d636e9c94 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:43.072832 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-43da3fe3-c3f4-4313-947d-a33d636e9c94 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1510 microversion: 2.1 time: 0.168589 May 28 21:28:43.073417 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2616/5283] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:42 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:44.092089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-91cad06f-c486-4d5b-90fa-7f8834d2da9e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:44.092959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-91cad06f-c486-4d5b-90fa-7f8834d2da9e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:44.101285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:28:44.103203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91cad06f-c486-4d5b-90fa-7f8834d2da9e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:44.108006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91cad06f-c486-4d5b-90fa-7f8834d2da9e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:44.108006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91cad06f-c486-4d5b-90fa-7f8834d2da9e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:44.108006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91cad06f-c486-4d5b-90fa-7f8834d2da9e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:44.277353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-91cad06f-c486-4d5b-90fa-7f8834d2da9e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:44.287154 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-91cad06f-c486-4d5b-90fa-7f8834d2da9e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1510 microversion: 2.1 time: 0.200292 May 28 21:28:44.287963 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2668/5284] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:44 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:45.308185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d4f3f325-28ae-4fd6-b71e-3ef78e8e7400 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:45.315387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d4f3f325-28ae-4fd6-b71e-3ef78e8e7400 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:45.322763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4f3f325-28ae-4fd6-b71e-3ef78e8e7400 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:45.323355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4f3f325-28ae-4fd6-b71e-3ef78e8e7400 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:45.330231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4f3f325-28ae-4fd6-b71e-3ef78e8e7400 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:45.330231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d4f3f325-28ae-4fd6-b71e-3ef78e8e7400 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:45.583336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d4f3f325-28ae-4fd6-b71e-3ef78e8e7400 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:45.592134 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d4f3f325-28ae-4fd6-b71e-3ef78e8e7400 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1507 microversion: 2.1 time: 0.290439 May 28 21:28:45.599055 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2617/5285] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:45 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:46.630031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0d5f1d4a-977f-4fa8-bf84-d23c8603bec5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:46.630817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0d5f1d4a-977f-4fa8-bf84-d23c8603bec5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:46.640057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d5f1d4a-977f-4fa8-bf84-d23c8603bec5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:46.648795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d5f1d4a-977f-4fa8-bf84-d23c8603bec5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:46.648795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d5f1d4a-977f-4fa8-bf84-d23c8603bec5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:46.648795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d5f1d4a-977f-4fa8-bf84-d23c8603bec5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:46.834652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0d5f1d4a-977f-4fa8-bf84-d23c8603bec5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:46.846342 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0d5f1d4a-977f-4fa8-bf84-d23c8603bec5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1507 microversion: 2.1 time: 0.238678 May 28 21:28:46.847010 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2669/5286] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:46 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:47.864562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4fbd139c-e68f-4cb3-b4be-ffeef020c044 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:47.865326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4fbd139c-e68f-4cb3-b4be-ffeef020c044 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:47.873186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fbd139c-e68f-4cb3-b4be-ffeef020c044 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:47.873657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fbd139c-e68f-4cb3-b4be-ffeef020c044 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:47.874491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fbd139c-e68f-4cb3-b4be-ffeef020c044 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:47.874944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fbd139c-e68f-4cb3-b4be-ffeef020c044 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:48.060244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4fbd139c-e68f-4cb3-b4be-ffeef020c044 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:48.068541 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4fbd139c-e68f-4cb3-b4be-ffeef020c044 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1507 microversion: 2.1 time: 0.208129 May 28 21:28:48.069560 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2618/5287] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:47 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:28:49.089878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-acf13530-5d93-4296-8baf-94d2a4e49cc5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:49.090485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-acf13530-5d93-4296-8baf-94d2a4e49cc5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:49.098262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-acf13530-5d93-4296-8baf-94d2a4e49cc5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:49.100162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-acf13530-5d93-4296-8baf-94d2a4e49cc5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:49.100635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-acf13530-5d93-4296-8baf-94d2a4e49cc5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:49.101090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-acf13530-5d93-4296-8baf-94d2a4e49cc5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:49.264812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-acf13530-5d93-4296-8baf-94d2a4e49cc5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:49.275262 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-acf13530-5d93-4296-8baf-94d2a4e49cc5 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 200 len: 1510 microversion: 2.1 time: 0.190497 May 28 21:28:49.286706 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2670/5288] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:49 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:49.294199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-239cfd38-977c-4be0-8d8c-4c3a7a019af0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:49.294839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-239cfd38-977c-4be0-8d8c-4c3a7a019af0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:49.309734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-239cfd38-977c-4be0-8d8c-4c3a7a019af0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:49.310890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-239cfd38-977c-4be0-8d8c-4c3a7a019af0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:49.311861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-239cfd38-977c-4be0-8d8c-4c3a7a019af0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:49.312523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-239cfd38-977c-4be0-8d8c-4c3a7a019af0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:49.344444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d8adc86d-35a6-4b9f-9b53-0fb75167b16d req-59de94c8-0dea-4cea-9b39-e25f97f3f935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae0a7a9-fc43-4223-8ab8-087913d81116", "name": "network-vif-unplugged", "status": "completed", "tag": "56fc1fb3-b822-43eb-8a4f-8a45b044dda9"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:49.370780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d8adc86d-35a6-4b9f-9b53-0fb75167b16d req-59de94c8-0dea-4cea-9b39-e25f97f3f935 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:49.371272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d8adc86d-35a6-4b9f-9b53-0fb75167b16d req-59de94c8-0dea-4cea-9b39-e25f97f3f935 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:49.400176 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d8adc86d-35a6-4b9f-9b53-0fb75167b16d req-59de94c8-0dea-4cea-9b39-e25f97f3f935 service nova] Creating event network-vif-unplugged:56fc1fb3-b822-43eb-8a4f-8a45b044dda9 for instance eae0a7a9-fc43-4223-8ab8-087913d81116 on nch2-master-1 May 28 21:28:49.406534 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d8adc86d-35a6-4b9f-9b53-0fb75167b16d req-59de94c8-0dea-4cea-9b39-e25f97f3f935 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066406 May 28 21:28:49.407587 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2671/5289] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:28:49.468771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-239cfd38-977c-4be0-8d8c-4c3a7a019af0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:49.477099 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-239cfd38-977c-4be0-8d8c-4c3a7a019af0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.187088 May 28 21:28:49.488109 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2619/5290] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:49 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:49.499340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-90312ca8-d12e-440c-b0d3-710d2b067dcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:49.500662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-90312ca8-d12e-440c-b0d3-710d2b067dcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:49.508004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90312ca8-d12e-440c-b0d3-710d2b067dcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:49.508451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90312ca8-d12e-440c-b0d3-710d2b067dcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:49.509230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90312ca8-d12e-440c-b0d3-710d2b067dcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:49.509676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90312ca8-d12e-440c-b0d3-710d2b067dcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:49.668962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-90312ca8-d12e-440c-b0d3-710d2b067dcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:49.677614 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-90312ca8-d12e-440c-b0d3-710d2b067dcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.182776 May 28 21:28:49.678260 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2672/5291] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:49 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:49.695863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-91ca0713-b651-4c4a-8e4f-0b21452ede06 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:49.695863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-91ca0713-b651-4c4a-8e4f-0b21452ede06 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:49.701109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91ca0713-b651-4c4a-8e4f-0b21452ede06 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:49.701565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91ca0713-b651-4c4a-8e4f-0b21452ede06 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:49.702373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91ca0713-b651-4c4a-8e4f-0b21452ede06 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:49.702821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91ca0713-b651-4c4a-8e4f-0b21452ede06 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:49.833710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-91ca0713-b651-4c4a-8e4f-0b21452ede06 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:49.841726 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-91ca0713-b651-4c4a-8e4f-0b21452ede06 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.152172 May 28 21:28:49.844016 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2620/5292] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:49 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:49.860091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f6b183ef-8bbb-43e4-8825-1a86b26e4ea4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:49.864141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f6b183ef-8bbb-43e4-8825-1a86b26e4ea4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:49.867860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6b183ef-8bbb-43e4-8825-1a86b26e4ea4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:49.868322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6b183ef-8bbb-43e4-8825-1a86b26e4ea4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:49.869109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6b183ef-8bbb-43e4-8825-1a86b26e4ea4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:49.869563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f6b183ef-8bbb-43e4-8825-1a86b26e4ea4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:50.013902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f6b183ef-8bbb-43e4-8825-1a86b26e4ea4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:50.022768 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f6b183ef-8bbb-43e4-8825-1a86b26e4ea4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.166509 May 28 21:28:50.023370 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2673/5293] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:49 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:50.040685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b1b95da0-c164-4d80-b4e5-f5f099c5d2ec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:50.047829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b1b95da0-c164-4d80-b4e5-f5f099c5d2ec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:50.048525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b1b95da0-c164-4d80-b4e5-f5f099c5d2ec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:50.075069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b1b95da0-c164-4d80-b4e5-f5f099c5d2ec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Going to try to stop instance {{(pid=143128) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 21:28:50.267404 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b1b95da0-c164-4d80-b4e5-f5f099c5d2ec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.230536 May 28 21:28:50.267961 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2621/5294] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:28:50 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:28:50.277800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4f687341-c107-4ff9-87c5-3e99a3607e9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:50.279595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4f687341-c107-4ff9-87c5-3e99a3607e9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:50.289751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f687341-c107-4ff9-87c5-3e99a3607e9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:50.290871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f687341-c107-4ff9-87c5-3e99a3607e9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:50.292024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f687341-c107-4ff9-87c5-3e99a3607e9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:50.293034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f687341-c107-4ff9-87c5-3e99a3607e9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:50.461283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4f687341-c107-4ff9-87c5-3e99a3607e9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:50.471029 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4f687341-c107-4ff9-87c5-3e99a3607e9b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.198197 May 28 21:28:50.471630 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2674/5295] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:50 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:51.491357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0d3d5b57-0a29-4515-8d7e-d9a8d8c82dec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:51.492335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0d3d5b57-0a29-4515-8d7e-d9a8d8c82dec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:51.499013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d3d5b57-0a29-4515-8d7e-d9a8d8c82dec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:51.501524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d3d5b57-0a29-4515-8d7e-d9a8d8c82dec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:51.501524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d3d5b57-0a29-4515-8d7e-d9a8d8c82dec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:51.501524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d3d5b57-0a29-4515-8d7e-d9a8d8c82dec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:51.651076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0d3d5b57-0a29-4515-8d7e-d9a8d8c82dec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:51.660320 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0d3d5b57-0a29-4515-8d7e-d9a8d8c82dec tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.175115 May 28 21:28:51.671071 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2622/5296] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:51 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:52.679022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8f7b2de0-a95c-4912-8d39-7558a6a27731 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:52.680155 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8f7b2de0-a95c-4912-8d39-7558a6a27731 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:52.687448 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8f7b2de0-a95c-4912-8d39-7558a6a27731 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:52.688129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8f7b2de0-a95c-4912-8d39-7558a6a27731 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:52.691369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8f7b2de0-a95c-4912-8d39-7558a6a27731 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:52.691369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8f7b2de0-a95c-4912-8d39-7558a6a27731 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:52.836185 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8f7b2de0-a95c-4912-8d39-7558a6a27731 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:52.845325 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8f7b2de0-a95c-4912-8d39-7558a6a27731 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.171445 May 28 21:28:52.862694 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2675/5297] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:52 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:53.862910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c449620d-646a-4a7a-9607-ca7b5e734a3e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:53.868687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c449620d-646a-4a7a-9607-ca7b5e734a3e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:53.871153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c449620d-646a-4a7a-9607-ca7b5e734a3e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:53.871864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c449620d-646a-4a7a-9607-ca7b5e734a3e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:53.872717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c449620d-646a-4a7a-9607-ca7b5e734a3e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:53.873232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c449620d-646a-4a7a-9607-ca7b5e734a3e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:54.171985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c449620d-646a-4a7a-9607-ca7b5e734a3e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:54.180280 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c449620d-646a-4a7a-9607-ca7b5e734a3e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.321469 May 28 21:28:54.180892 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2623/5298] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:53 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:55.197828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0a00c8ef-465f-491a-a723-4476112353ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:55.198476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0a00c8ef-465f-491a-a723-4476112353ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:55.205811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a00c8ef-465f-491a-a723-4476112353ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:55.207192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a00c8ef-465f-491a-a723-4476112353ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:55.210683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a00c8ef-465f-491a-a723-4476112353ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:55.210683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a00c8ef-465f-491a-a723-4476112353ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:55.493920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0a00c8ef-465f-491a-a723-4476112353ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:55.510009 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0a00c8ef-465f-491a-a723-4476112353ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.314420 May 28 21:28:55.520481 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2676/5299] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:55 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:56.527977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-940d6cdc-2926-4cb3-8cb9-9d611c407fe0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:56.528597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-940d6cdc-2926-4cb3-8cb9-9d611c407fe0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:56.536425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-940d6cdc-2926-4cb3-8cb9-9d611c407fe0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:56.537385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-940d6cdc-2926-4cb3-8cb9-9d611c407fe0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:56.538203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-940d6cdc-2926-4cb3-8cb9-9d611c407fe0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:56.538649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-940d6cdc-2926-4cb3-8cb9-9d611c407fe0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:56.715820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-940d6cdc-2926-4cb3-8cb9-9d611c407fe0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:56.725065 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-940d6cdc-2926-4cb3-8cb9-9d611c407fe0 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.200952 May 28 21:28:56.725598 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2624/5300] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:56 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:57.751860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ca93ba27-5d35-4bf2-bfc2-03d69a040fcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:57.754861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ca93ba27-5d35-4bf2-bfc2-03d69a040fcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:57.765587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca93ba27-5d35-4bf2-bfc2-03d69a040fcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:57.766080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca93ba27-5d35-4bf2-bfc2-03d69a040fcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:57.767144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca93ba27-5d35-4bf2-bfc2-03d69a040fcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:57.767951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca93ba27-5d35-4bf2-bfc2-03d69a040fcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:58.019869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ca93ba27-5d35-4bf2-bfc2-03d69a040fcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:58.037679 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ca93ba27-5d35-4bf2-bfc2-03d69a040fcd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.299302 May 28 21:28:58.038326 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2677/5301] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:57 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:58.977719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-220631617", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:28:59.029532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] validate_networks() for None {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:28:59.058340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40e73dc6-049d-4685-91f4-7592b9594f0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:59.059690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-40e73dc6-049d-4685-91f4-7592b9594f0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:59.067805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40e73dc6-049d-4685-91f4-7592b9594f0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:59.068594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40e73dc6-049d-4685-91f4-7592b9594f0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:59.069610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40e73dc6-049d-4685-91f4-7592b9594f0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:59.070346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40e73dc6-049d-4685-91f4-7592b9594f0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:59.376049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-40e73dc6-049d-4685-91f4-7592b9594f0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:59.384999 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-40e73dc6-049d-4685-91f4-7592b9594f0c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.332738 May 28 21:28:59.386084 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2678/5302] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:59 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:28:59.408997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:28:59.409434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:28:59.410490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:28:59.410966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:28:59.411390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:28:59.421549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:59.422286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:59.423184 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:28:59.423711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:28:59.451986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Getting quotas for project 071f3ee8ccba4f4a891cac48aaa54d0a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:28:59.458607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Getting quotas for user 38d2c184e2ad446cb0481b1421439771 and project 071f3ee8ccba4f4a891cac48aaa54d0a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:28:59.481292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:28:59.487121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:28:59.603074 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-67a3422f-c8ab-408c-9bb5-88ce7c05d7ab tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629116 May 28 21:28:59.608333 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2625/5303] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:28:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:28:59.620090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-839905ed-7bee-4459-a340-7f01f790d742 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:28:59.620792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-839905ed-7bee-4459-a340-7f01f790d742 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:28:59.741325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-839905ed-7bee-4459-a340-7f01f790d742 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d2c184e2ad446cb0481b1421439771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f3ee8ccba4f4a891cac48aaa54d0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:28:59.747804 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-839905ed-7bee-4459-a340-7f01f790d742 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 200 len: 1213 microversion: 2.1 time: 0.132660 May 28 21:28:59.748408 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2679/5304] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:28:59 2022] GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 1213 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:00.404681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4d22d72b-928b-4a0c-bc2a-ae08a593bedd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:00.406086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4d22d72b-928b-4a0c-bc2a-ae08a593bedd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:00.416287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d22d72b-928b-4a0c-bc2a-ae08a593bedd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:00.416754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d22d72b-928b-4a0c-bc2a-ae08a593bedd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:00.417546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d22d72b-928b-4a0c-bc2a-ae08a593bedd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:00.418083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d22d72b-928b-4a0c-bc2a-ae08a593bedd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:00.445138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ee010164-7f37-4449-ad8b-8e709b8a9917 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:00.446390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ee010164-7f37-4449-ad8b-8e709b8a9917 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:00.458322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee010164-7f37-4449-ad8b-8e709b8a9917 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:00.458893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee010164-7f37-4449-ad8b-8e709b8a9917 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:00.459837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee010164-7f37-4449-ad8b-8e709b8a9917 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:00.460432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ee010164-7f37-4449-ad8b-8e709b8a9917 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:00.487401 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:00.526633 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ee010164-7f37-4449-ad8b-8e709b8a9917 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7/action" status: 200 len: 24565 microversion: 2.1 time: 0.087433 May 28 21:29:00.527964 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2680/5305] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:29:00 2022] POST /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7/action => generated 24565 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:29:00.673212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4d22d72b-928b-4a0c-bc2a-ae08a593bedd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:00.691822 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4d22d72b-928b-4a0c-bc2a-ae08a593bedd tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1681 microversion: 2.1 time: 0.291668 May 28 21:29:00.693751 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2626/5306] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:00 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1681 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:00.765002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d9e4f120-a237-45f1-9dba-0d836c39001a tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:00.765727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d9e4f120-a237-45f1-9dba-0d836c39001a tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:00.828777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d9e4f120-a237-45f1-9dba-0d836c39001a tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d2c184e2ad446cb0481b1421439771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f3ee8ccba4f4a891cac48aaa54d0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:00.838689 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d9e4f120-a237-45f1-9dba-0d836c39001a tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 200 len: 1213 microversion: 2.1 time: 0.077821 May 28 21:29:00.849099 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2681/5307] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:00 2022] GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:01.710397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-23972eb3-1030-4378-8332-2b010d90c00f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:01.710960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-23972eb3-1030-4378-8332-2b010d90c00f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:01.720712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-23972eb3-1030-4378-8332-2b010d90c00f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:01.721165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-23972eb3-1030-4378-8332-2b010d90c00f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:01.721970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-23972eb3-1030-4378-8332-2b010d90c00f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:01.722438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-23972eb3-1030-4378-8332-2b010d90c00f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:01.856464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0ed78c60-8828-43b6-911e-ac8eaced2d26 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:01.857091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0ed78c60-8828-43b6-911e-ac8eaced2d26 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:01.865475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ed78c60-8828-43b6-911e-ac8eaced2d26 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:01.866207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ed78c60-8828-43b6-911e-ac8eaced2d26 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:01.867176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ed78c60-8828-43b6-911e-ac8eaced2d26 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:01.867631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ed78c60-8828-43b6-911e-ac8eaced2d26 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:01.954074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0ed78c60-8828-43b6-911e-ac8eaced2d26 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d2c184e2ad446cb0481b1421439771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f3ee8ccba4f4a891cac48aaa54d0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:01.962476 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0ed78c60-8828-43b6-911e-ac8eaced2d26 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 200 len: 1209 microversion: 2.1 time: 0.109710 May 28 21:29:01.962990 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2682/5308] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:01 2022] GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:02.002105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-23972eb3-1030-4378-8332-2b010d90c00f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:02.015440 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-23972eb3-1030-4378-8332-2b010d90c00f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1658 microversion: 2.1 time: 0.305029 May 28 21:29:02.022077 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2627/5309] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:01 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1658 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:02.028233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8a93e1d8-2146-4034-8532-4537de9495ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:02.035579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8a93e1d8-2146-4034-8532-4537de9495ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:02.036256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8a93e1d8-2146-4034-8532-4537de9495ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:02.061230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8a93e1d8-2146-4034-8532-4537de9495ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Going to try to start instance {{(pid=143129) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 21:29:02.281667 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8a93e1d8-2146-4034-8532-4537de9495ab tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.257361 May 28 21:29:02.282528 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2683/5310] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:29:02 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:29:02.295755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f67400e3-479c-4b32-9b3b-52d6903eb2e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:02.296398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f67400e3-479c-4b32-9b3b-52d6903eb2e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:02.305047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f67400e3-479c-4b32-9b3b-52d6903eb2e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:02.305703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f67400e3-479c-4b32-9b3b-52d6903eb2e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:02.306756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f67400e3-479c-4b32-9b3b-52d6903eb2e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:02.307373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f67400e3-479c-4b32-9b3b-52d6903eb2e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:02.522014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f67400e3-479c-4b32-9b3b-52d6903eb2e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:02.530638 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f67400e3-479c-4b32-9b3b-52d6903eb2e2 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1667 microversion: 2.1 time: 0.238714 May 28 21:29:02.531829 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2628/5311] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:02 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1667 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:02.982267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c8a8beba-2714-45a4-b052-51ce24fd4b2d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:02.983302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c8a8beba-2714-45a4-b052-51ce24fd4b2d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:02.991237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8a8beba-2714-45a4-b052-51ce24fd4b2d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:02.992057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8a8beba-2714-45a4-b052-51ce24fd4b2d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:02.993002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8a8beba-2714-45a4-b052-51ce24fd4b2d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:02.993550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8a8beba-2714-45a4-b052-51ce24fd4b2d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:03.123368 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c8a8beba-2714-45a4-b052-51ce24fd4b2d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d2c184e2ad446cb0481b1421439771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f3ee8ccba4f4a891cac48aaa54d0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:03.135363 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c8a8beba-2714-45a4-b052-51ce24fd4b2d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 200 len: 1271 microversion: 2.1 time: 0.158270 May 28 21:29:03.137458 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2684/5312] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:02 2022] GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:03.549066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f0899adc-710e-4236-bed3-c99775abe86d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:03.550174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f0899adc-710e-4236-bed3-c99775abe86d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:03.559524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0899adc-710e-4236-bed3-c99775abe86d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:03.560081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0899adc-710e-4236-bed3-c99775abe86d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:03.560942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0899adc-710e-4236-bed3-c99775abe86d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:03.561540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0899adc-710e-4236-bed3-c99775abe86d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:04.157819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fa26d56d-cc47-4047-96b8-1abdca1c1e82 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:04.160433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fa26d56d-cc47-4047-96b8-1abdca1c1e82 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:04.170194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa26d56d-cc47-4047-96b8-1abdca1c1e82 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:04.170918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa26d56d-cc47-4047-96b8-1abdca1c1e82 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:04.172997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa26d56d-cc47-4047-96b8-1abdca1c1e82 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:04.172997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa26d56d-cc47-4047-96b8-1abdca1c1e82 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:04.206757 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f0899adc-710e-4236-bed3-c99775abe86d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:04.211734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:04.223731 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f0899adc-710e-4236-bed3-c99775abe86d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1667 microversion: 2.1 time: 0.678814 May 28 21:29:04.226273 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2629/5313] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:03 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1667 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:04.367725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fa26d56d-cc47-4047-96b8-1abdca1c1e82 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d2c184e2ad446cb0481b1421439771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f3ee8ccba4f4a891cac48aaa54d0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:04.375512 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fa26d56d-cc47-4047-96b8-1abdca1c1e82 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 200 len: 1313 microversion: 2.1 time: 0.224255 May 28 21:29:04.376094 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2685/5314] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:04 2022] GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:05.186997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ef0b57c8-b475-4815-84c7-fe0bed5ad8a7 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Action: 'create', calling method: .version_select at 0x7f4d579f54c0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1282774370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFpKg02Z7LeGMQJBgcQJgVHNZtHnvP6gkXPK4NxkDS1c/sgz1tFL3TkEeU1EUZBIiGqqjrghIZ9DMSXqg1LMnUgDOPTJvhb2KLv3tcAL9UCPvGju3gV9w0PD8MXdurHqKg=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:05.205655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-ef0b57c8-b475-4815-84c7-fe0bed5ad8a7 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Getting quotas for project 97cf01c13fa745a3bd04e35a0ce27088. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:29:05.214355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-ef0b57c8-b475-4815-84c7-fe0bed5ad8a7 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Getting quotas for user 642d08e104394dd28e6b4b502f5bc8cf and project 97cf01c13fa745a3bd04e35a0ce27088. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:29:05.242202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cf24abf8-af68-4e52-89e1-7a1639862a10 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:05.243553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cf24abf8-af68-4e52-89e1-7a1639862a10 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:05.255104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf24abf8-af68-4e52-89e1-7a1639862a10 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:05.255869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf24abf8-af68-4e52-89e1-7a1639862a10 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:05.256668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf24abf8-af68-4e52-89e1-7a1639862a10 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:05.257134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cf24abf8-af68-4e52-89e1-7a1639862a10 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:05.326602 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ef0b57c8-b475-4815-84c7-fe0bed5ad8a7 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.398870 May 28 21:29:05.327785 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2630/5315] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:29:04 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:29:05.440058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-0b521863-ff0a-4316-a5aa-ed9e727ff0fd req-755c2d61-5d0f-485c-a358-125f0f4f3d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "264103c5-0b85-46e8-bf9c-41b21fc70596", "tag": "1080aa54-438b-4d5a-98b6-508ec021bb9a"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:05.451457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0b521863-ff0a-4316-a5aa-ed9e727ff0fd req-755c2d61-5d0f-485c-a358-125f0f4f3d02 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:05.452242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0b521863-ff0a-4316-a5aa-ed9e727ff0fd req-755c2d61-5d0f-485c-a358-125f0f4f3d02 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:05.469968 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-0b521863-ff0a-4316-a5aa-ed9e727ff0fd req-755c2d61-5d0f-485c-a358-125f0f4f3d02 service nova] Creating event network-changed:1080aa54-438b-4d5a-98b6-508ec021bb9a for instance 264103c5-0b85-46e8-bf9c-41b21fc70596 on nch1-master-1 May 28 21:29:05.477137 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-0b521863-ff0a-4316-a5aa-ed9e727ff0fd req-755c2d61-5d0f-485c-a358-125f0f4f3d02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147518 May 28 21:29:05.478204 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2631/5316] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:05.494083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3870cf37-6c51-42f7-be84-07d7616c7659 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:05.494083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3870cf37-6c51-42f7-be84-07d7616c7659 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:05.501392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3870cf37-6c51-42f7-be84-07d7616c7659 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:05.502207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3870cf37-6c51-42f7-be84-07d7616c7659 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:05.503234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3870cf37-6c51-42f7-be84-07d7616c7659 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:05.504424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3870cf37-6c51-42f7-be84-07d7616c7659 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:05.697533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cf24abf8-af68-4e52-89e1-7a1639862a10 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:05.705578 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cf24abf8-af68-4e52-89e1-7a1639862a10 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.468279 May 28 21:29:05.706562 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2686/5317] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:05 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:05.724915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fddee744-facf-49a4-ac7e-7c3691048536 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:05.728542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fddee744-facf-49a4-ac7e-7c3691048536 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:05.731944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fddee744-facf-49a4-ac7e-7c3691048536 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:05.732395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fddee744-facf-49a4-ac7e-7c3691048536 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:05.733432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fddee744-facf-49a4-ac7e-7c3691048536 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:05.733906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fddee744-facf-49a4-ac7e-7c3691048536 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:05.822836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3870cf37-6c51-42f7-be84-07d7616c7659 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d2c184e2ad446cb0481b1421439771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f3ee8ccba4f4a891cac48aaa54d0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:05.830773 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3870cf37-6c51-42f7-be84-07d7616c7659 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 200 len: 1313 microversion: 2.1 time: 0.351123 May 28 21:29:05.840261 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2632/5318] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:05 2022] GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:05.965885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fddee744-facf-49a4-ac7e-7c3691048536 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:05.974515 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fddee744-facf-49a4-ac7e-7c3691048536 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.254334 May 28 21:29:05.975089 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2687/5319] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:05 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:05.991918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c128a131-e6fb-41d1-8509-aa3b3f432c5e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:05.992534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c128a131-e6fb-41d1-8509-aa3b3f432c5e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:05.999987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c128a131-e6fb-41d1-8509-aa3b3f432c5e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:06.000441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c128a131-e6fb-41d1-8509-aa3b3f432c5e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:06.001202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c128a131-e6fb-41d1-8509-aa3b3f432c5e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:06.001642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c128a131-e6fb-41d1-8509-aa3b3f432c5e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:06.153604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c128a131-e6fb-41d1-8509-aa3b3f432c5e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:06.162185 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c128a131-e6fb-41d1-8509-aa3b3f432c5e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.173979 May 28 21:29:06.162708 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2633/5320] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:05 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:06.178223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eb75a900-753d-43dc-9f8b-079bbe08a2b1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:06.178853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eb75a900-753d-43dc-9f8b-079bbe08a2b1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:06.185032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb75a900-753d-43dc-9f8b-079bbe08a2b1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:06.185496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb75a900-753d-43dc-9f8b-079bbe08a2b1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:06.186340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb75a900-753d-43dc-9f8b-079bbe08a2b1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:06.186792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb75a900-753d-43dc-9f8b-079bbe08a2b1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:06.318926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eb75a900-753d-43dc-9f8b-079bbe08a2b1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:06.326813 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eb75a900-753d-43dc-9f8b-079bbe08a2b1 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.152647 May 28 21:29:06.327471 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2688/5321] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:06 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:06.349163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b604527c-06be-423d-b281-8ff040e8d6d7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:06.350133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b604527c-06be-423d-b281-8ff040e8d6d7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:06.356431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b604527c-06be-423d-b281-8ff040e8d6d7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:06.356897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b604527c-06be-423d-b281-8ff040e8d6d7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:06.357699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b604527c-06be-423d-b281-8ff040e8d6d7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:06.358173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b604527c-06be-423d-b281-8ff040e8d6d7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:06.496748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b604527c-06be-423d-b281-8ff040e8d6d7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:06.505230 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b604527c-06be-423d-b281-8ff040e8d6d7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.165694 May 28 21:29:06.505815 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2634/5322] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:06 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:06.523092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d9910248-b6c1-4ca0-aff9-7a9aa62a3a7b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:06.523895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d9910248-b6c1-4ca0-aff9-7a9aa62a3a7b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:06.531294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9910248-b6c1-4ca0-aff9-7a9aa62a3a7b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:06.531964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9910248-b6c1-4ca0-aff9-7a9aa62a3a7b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:06.533200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9910248-b6c1-4ca0-aff9-7a9aa62a3a7b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:06.533621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9910248-b6c1-4ca0-aff9-7a9aa62a3a7b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:06.560038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-d9910248-b6c1-4ca0-aff9-7a9aa62a3a7b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lazy-loading 'flavor' on Instance uuid 226cec1f-9523-4d1f-95cf-e2d994bd1f88 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:29:06.847901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6d9636da-8f28-4000-8819-736b78463351 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:06.848671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6d9636da-8f28-4000-8819-736b78463351 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:06.855414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d9636da-8f28-4000-8819-736b78463351 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:06.856005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d9636da-8f28-4000-8819-736b78463351 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:06.856720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d9636da-8f28-4000-8819-736b78463351 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:06.857311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6d9636da-8f28-4000-8819-736b78463351 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:06.924645 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d9910248-b6c1-4ca0-aff9-7a9aa62a3a7b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.406337 May 28 21:29:06.927060 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2689/5323] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:29:06 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:29:06.937292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-41439094-b0e7-4234-9f19-30d94ef58b81 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:06.938467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-41439094-b0e7-4234-9f19-30d94ef58b81 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:06.959040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41439094-b0e7-4234-9f19-30d94ef58b81 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:06.959777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41439094-b0e7-4234-9f19-30d94ef58b81 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:06.960879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41439094-b0e7-4234-9f19-30d94ef58b81 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:06.961601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41439094-b0e7-4234-9f19-30d94ef58b81 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:07.010988 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6d9636da-8f28-4000-8819-736b78463351 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d2c184e2ad446cb0481b1421439771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f3ee8ccba4f4a891cac48aaa54d0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:07.021658 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6d9636da-8f28-4000-8819-736b78463351 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 200 len: 1313 microversion: 2.1 time: 0.177511 May 28 21:29:07.022300 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2635/5324] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:06 2022] GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:07.125011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-41439094-b0e7-4234-9f19-30d94ef58b81 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:07.133159 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-41439094-b0e7-4234-9f19-30d94ef58b81 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1679 microversion: 2.1 time: 0.200989 May 28 21:29:07.133736 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2690/5325] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:06 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:08.038904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7372d4ad-4aa2-4331-91e6-fd3b9dcf26b1 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:08.040303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7372d4ad-4aa2-4331-91e6-fd3b9dcf26b1 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:08.043527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:08.048650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7372d4ad-4aa2-4331-91e6-fd3b9dcf26b1 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:08.049117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7372d4ad-4aa2-4331-91e6-fd3b9dcf26b1 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:08.049941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7372d4ad-4aa2-4331-91e6-fd3b9dcf26b1 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:08.050392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7372d4ad-4aa2-4331-91e6-fd3b9dcf26b1 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:08.153001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c4991200-d23f-42c5-9b37-53360da4798b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:08.154226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c4991200-d23f-42c5-9b37-53360da4798b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:08.161712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4991200-d23f-42c5-9b37-53360da4798b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:08.162349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4991200-d23f-42c5-9b37-53360da4798b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:08.163152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4991200-d23f-42c5-9b37-53360da4798b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:08.163596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4991200-d23f-42c5-9b37-53360da4798b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:08.230582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7372d4ad-4aa2-4331-91e6-fd3b9dcf26b1 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d2c184e2ad446cb0481b1421439771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f3ee8ccba4f4a891cac48aaa54d0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:08.240850 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7372d4ad-4aa2-4331-91e6-fd3b9dcf26b1 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 200 len: 1313 microversion: 2.1 time: 0.205774 May 28 21:29:08.255108 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2636/5326] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:08 2022] GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:08.335145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c4991200-d23f-42c5-9b37-53360da4798b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:08.344096 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c4991200-d23f-42c5-9b37-53360da4798b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1662 microversion: 2.1 time: 0.196548 May 28 21:29:08.344673 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2691/5327] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:08 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1662 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:08.362551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2dd0f9f2-091d-4767-bc42-8c21bc4159fe tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:08.363021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2dd0f9f2-091d-4767-bc42-8c21bc4159fe tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:08.369094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2dd0f9f2-091d-4767-bc42-8c21bc4159fe tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:08.369549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2dd0f9f2-091d-4767-bc42-8c21bc4159fe tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:08.370378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2dd0f9f2-091d-4767-bc42-8c21bc4159fe tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:08.370828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2dd0f9f2-091d-4767-bc42-8c21bc4159fe tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:08.670777 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2dd0f9f2-091d-4767-bc42-8c21bc4159fe tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action" status: 202 len: 0 microversion: 2.1 time: 0.312370 May 28 21:29:08.675813 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2637/5328] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:29:08 2022] POST /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:29:08.682477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2a907e44-b68a-4c5d-8493-bf4e02659173 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:08.685077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2a907e44-b68a-4c5d-8493-bf4e02659173 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:08.692696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a907e44-b68a-4c5d-8493-bf4e02659173 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:08.693445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a907e44-b68a-4c5d-8493-bf4e02659173 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:08.694264 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a907e44-b68a-4c5d-8493-bf4e02659173 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:08.694717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a907e44-b68a-4c5d-8493-bf4e02659173 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:08.857082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2a907e44-b68a-4c5d-8493-bf4e02659173 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:08.867049 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2a907e44-b68a-4c5d-8493-bf4e02659173 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1668 microversion: 2.1 time: 0.189828 May 28 21:29:08.867667 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2692/5329] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:08 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1668 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:09.264098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f730f224-3d58-453c-bbe4-f16e2467f5b0 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:09.264827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f730f224-3d58-453c-bbe4-f16e2467f5b0 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:09.272223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f730f224-3d58-453c-bbe4-f16e2467f5b0 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:09.275936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f730f224-3d58-453c-bbe4-f16e2467f5b0 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:09.275936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f730f224-3d58-453c-bbe4-f16e2467f5b0 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:09.275936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f730f224-3d58-453c-bbe4-f16e2467f5b0 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:09.443233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:09.509570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f730f224-3d58-453c-bbe4-f16e2467f5b0 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d2c184e2ad446cb0481b1421439771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f3ee8ccba4f4a891cac48aaa54d0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:09.518659 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f730f224-3d58-453c-bbe4-f16e2467f5b0 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 200 len: 1313 microversion: 2.1 time: 0.262273 May 28 21:29:09.519983 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2638/5330] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:09 2022] GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:09.889820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40eb241f-b5b2-44ea-b064-9c24913dc200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:09.891986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-40eb241f-b5b2-44ea-b064-9c24913dc200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:09.912971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40eb241f-b5b2-44ea-b064-9c24913dc200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:09.913767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40eb241f-b5b2-44ea-b064-9c24913dc200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:09.915826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40eb241f-b5b2-44ea-b064-9c24913dc200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:09.916574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40eb241f-b5b2-44ea-b064-9c24913dc200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:10.114735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-d8f6dd2a-e422-412b-9312-dc7aa50c7163 req-4ae44a44-c0e6-4b57-ac4b-232ef060fe5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264103c5-0b85-46e8-bf9c-41b21fc70596", "name": "network-vif-plugged", "status": "completed", "tag": "1080aa54-438b-4d5a-98b6-508ec021bb9a"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:10.124876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d8f6dd2a-e422-412b-9312-dc7aa50c7163 req-4ae44a44-c0e6-4b57-ac4b-232ef060fe5a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:10.125668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d8f6dd2a-e422-412b-9312-dc7aa50c7163 req-4ae44a44-c0e6-4b57-ac4b-232ef060fe5a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:10.142501 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-d8f6dd2a-e422-412b-9312-dc7aa50c7163 req-4ae44a44-c0e6-4b57-ac4b-232ef060fe5a service nova] Creating event network-vif-plugged:1080aa54-438b-4d5a-98b6-508ec021bb9a for instance 264103c5-0b85-46e8-bf9c-41b21fc70596 on nch1-master-1 May 28 21:29:10.148536 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-d8f6dd2a-e422-412b-9312-dc7aa50c7163 req-4ae44a44-c0e6-4b57-ac4b-232ef060fe5a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164794 May 28 21:29:10.149369 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2639/5331] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:10.227038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-40eb241f-b5b2-44ea-b064-9c24913dc200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:10.235536 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-40eb241f-b5b2-44ea-b064-9c24913dc200 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1668 microversion: 2.1 time: 0.353205 May 28 21:29:10.236622 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2693/5332] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:09 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1668 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:10.538296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84ef599e-b07d-48fe-bf7b-05461523691d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:10.539821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-84ef599e-b07d-48fe-bf7b-05461523691d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:10.547669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84ef599e-b07d-48fe-bf7b-05461523691d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:10.548634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84ef599e-b07d-48fe-bf7b-05461523691d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:10.549771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84ef599e-b07d-48fe-bf7b-05461523691d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:10.550500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84ef599e-b07d-48fe-bf7b-05461523691d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:11.012332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-84ef599e-b07d-48fe-bf7b-05461523691d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d2c184e2ad446cb0481b1421439771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f3ee8ccba4f4a891cac48aaa54d0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:11.023653 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-84ef599e-b07d-48fe-bf7b-05461523691d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 200 len: 1313 microversion: 2.1 time: 0.491281 May 28 21:29:11.024674 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2640/5333] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:10 2022] GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 1313 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:11.254825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f7516067-5bce-488b-9615-9441434e7b05 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:11.255455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f7516067-5bce-488b-9615-9441434e7b05 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:11.257500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:11.265194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7516067-5bce-488b-9615-9441434e7b05 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:11.266277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7516067-5bce-488b-9615-9441434e7b05 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:11.273142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7516067-5bce-488b-9615-9441434e7b05 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:11.274075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7516067-5bce-488b-9615-9441434e7b05 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:11.429095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3faf5b6c-59f6-418d-9ba4-863c9bdda255 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:11.429724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3faf5b6c-59f6-418d-9ba4-863c9bdda255 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:11.436396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3faf5b6c-59f6-418d-9ba4-863c9bdda255 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:11.437151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3faf5b6c-59f6-418d-9ba4-863c9bdda255 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:11.438157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3faf5b6c-59f6-418d-9ba4-863c9bdda255 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:11.438778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3faf5b6c-59f6-418d-9ba4-863c9bdda255 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:11.555695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f7516067-5bce-488b-9615-9441434e7b05 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:11.564104 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f7516067-5bce-488b-9615-9441434e7b05 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.313828 May 28 21:29:11.574984 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2694/5334] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:11 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:11.591749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b57d649f-ec12-4adc-8dac-3b4b3609bec4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:11.593578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b57d649f-ec12-4adc-8dac-3b4b3609bec4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:11.599379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b57d649f-ec12-4adc-8dac-3b4b3609bec4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:11.599838 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b57d649f-ec12-4adc-8dac-3b4b3609bec4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:11.600815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b57d649f-ec12-4adc-8dac-3b4b3609bec4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:11.601438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b57d649f-ec12-4adc-8dac-3b4b3609bec4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:11.995829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3faf5b6c-59f6-418d-9ba4-863c9bdda255 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:12.006011 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3faf5b6c-59f6-418d-9ba4-863c9bdda255 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1681 microversion: 2.1 time: 0.581214 May 28 21:29:12.006983 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2641/5335] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:11 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1681 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:12.042007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0af3c5a8-e62e-4bb2-95ef-43399286b6ed tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:12.043076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0af3c5a8-e62e-4bb2-95ef-43399286b6ed tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:12.049562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0af3c5a8-e62e-4bb2-95ef-43399286b6ed tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:12.054019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0af3c5a8-e62e-4bb2-95ef-43399286b6ed tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:12.054019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0af3c5a8-e62e-4bb2-95ef-43399286b6ed tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:12.054019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0af3c5a8-e62e-4bb2-95ef-43399286b6ed tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:12.060428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b57d649f-ec12-4adc-8dac-3b4b3609bec4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:12.064454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:12.080072 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b57d649f-ec12-4adc-8dac-3b4b3609bec4 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1671 microversion: 2.1 time: 0.491482 May 28 21:29:12.083868 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2695/5336] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:11 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1671 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:12.107033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b87f025b-5e52-4d0d-bc44-e5ec93220f42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:12.107033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b87f025b-5e52-4d0d-bc44-e5ec93220f42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:12.114987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b87f025b-5e52-4d0d-bc44-e5ec93220f42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:12.115953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b87f025b-5e52-4d0d-bc44-e5ec93220f42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:12.117492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b87f025b-5e52-4d0d-bc44-e5ec93220f42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:12.119133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b87f025b-5e52-4d0d-bc44-e5ec93220f42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:12.153814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b87f025b-5e52-4d0d-bc44-e5ec93220f42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:29:12.163506 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.compute.api [None req-b87f025b-5e52-4d0d-bc44-e5ec93220f42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Working on deleting snapshot fdddcb1b-6eab-4ea3-96af-eb5422ba0597 from shelved instance... May 28 21:29:12.395306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0af3c5a8-e62e-4bb2-95ef-43399286b6ed tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d2c184e2ad446cb0481b1421439771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f3ee8ccba4f4a891cac48aaa54d0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:12.408865 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0af3c5a8-e62e-4bb2-95ef-43399286b6ed tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 200 len: 1462 microversion: 2.1 time: 0.370694 May 28 21:29:12.410731 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2642/5337] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:12 2022] GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 1462 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:12.416828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-94e9ca0f-1371-4317-a535-f0098e78a1e5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:12.418516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-94e9ca0f-1371-4317-a535-f0098e78a1e5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:12.429699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94e9ca0f-1371-4317-a535-f0098e78a1e5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:12.431075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94e9ca0f-1371-4317-a535-f0098e78a1e5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:12.432075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94e9ca0f-1371-4317-a535-f0098e78a1e5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:12.434099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94e9ca0f-1371-4317-a535-f0098e78a1e5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:12.531546 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-94e9ca0f-1371-4317-a535-f0098e78a1e5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7/action" status: 200 len: 32636 microversion: 2.1 time: 0.118789 May 28 21:29:12.532878 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2643/5338] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:29:12 2022] POST /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7/action => generated 32636 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:29:12.539084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-88393c47-045d-4a29-816a-f34580c4bc63 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f64c199d-aafe-4b81-8b40-af7ac5fa31b5", "device": "/dev/sdb"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:12.541502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-88393c47-045d-4a29-816a-f34580c4bc63 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:12.550143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88393c47-045d-4a29-816a-f34580c4bc63 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:12.550811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88393c47-045d-4a29-816a-f34580c4bc63 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:12.551602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88393c47-045d-4a29-816a-f34580c4bc63 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:12.552043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-88393c47-045d-4a29-816a-f34580c4bc63 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:13.648556 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-88393c47-045d-4a29-816a-f34580c4bc63 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "POST /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.114032 May 28 21:29:13.655798 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2644/5339] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:29:12 2022] POST /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596/os-volume_attachments => generated 194 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:13.655798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1770b62f-422d-4beb-b69f-965eb30294d9 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:13.661261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1770b62f-422d-4beb-b69f-965eb30294d9 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:13.674096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1770b62f-422d-4beb-b69f-965eb30294d9 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:13.677396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1770b62f-422d-4beb-b69f-965eb30294d9 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:13.678476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1770b62f-422d-4beb-b69f-965eb30294d9 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:13.680545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1770b62f-422d-4beb-b69f-965eb30294d9 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:14.024028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b87f025b-5e52-4d0d-bc44-e5ec93220f42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Doing local delete in cell fc53a60a-e345-4363-abb1-87c4d33bcbf6(cell1) {{(pid=143129) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 28 21:29:14.024995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b87f025b-5e52-4d0d-bc44-e5ec93220f42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:14.025647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b87f025b-5e52-4d0d-bc44-e5ec93220f42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:14.028529 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.compute.api [None req-b87f025b-5e52-4d0d-bc44-e5ec93220f42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 28 21:29:14.039079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-b87f025b-5e52-4d0d-bc44-e5ec93220f42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] deallocate_for_instance() {{(pid=143129) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} May 28 21:29:14.424695 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1770b62f-422d-4beb-b69f-965eb30294d9 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1832 microversion: 2.1 time: 0.773405 May 28 21:29:14.426186 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2645/5340] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:13 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1832 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:14.435688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5c8a995b-55c7-4dfe-b06b-27949bb44aee tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:14.436209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5c8a995b-55c7-4dfe-b06b-27949bb44aee tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:14.457974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c8a995b-55c7-4dfe-b06b-27949bb44aee tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:14.458302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c8a995b-55c7-4dfe-b06b-27949bb44aee tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:14.459308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c8a995b-55c7-4dfe-b06b-27949bb44aee tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:14.462467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c8a995b-55c7-4dfe-b06b-27949bb44aee tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:14.518270 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5c8a995b-55c7-4dfe-b06b-27949bb44aee tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/ips" status: 200 len: 145 microversion: 2.1 time: 0.090950 May 28 21:29:14.520660 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2646/5341] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 21:29:14 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/ips => generated 145 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:14.527954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-04abf63c-c041-498c-8e3f-5a981f9fe3d2 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:14.529811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-04abf63c-c041-498c-8e3f-5a981f9fe3d2 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:14.537880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04abf63c-c041-498c-8e3f-5a981f9fe3d2 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:14.538629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04abf63c-c041-498c-8e3f-5a981f9fe3d2 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:14.539613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04abf63c-c041-498c-8e3f-5a981f9fe3d2 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:14.540236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04abf63c-c041-498c-8e3f-5a981f9fe3d2 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:14.547846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:14.597453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-04abf63c-c041-498c-8e3f-5a981f9fe3d2 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lazy-loading 'flavor' on Instance uuid 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:29:14.618022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-04abf63c-c041-498c-8e3f-5a981f9fe3d2 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Going to try to live migrate instance to another host {{(pid=143128) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} May 28 21:29:15.226146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=10 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:15.936077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-b87f025b-5e52-4d0d-bc44-e5ec93220f42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Updating instance_info_cache with network_info: [] {{(pid=143129) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 28 21:29:16.918048 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b87f025b-5e52-4d0d-bc44-e5ec93220f42 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "DELETE /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 204 len: 0 microversion: 2.1 time: 4.818725 May 28 21:29:16.919138 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2696/5342] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:29:12 2022] DELETE /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 0 bytes in 4821 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:29:17.042105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-6e0a1d98-62d0-4d48-857b-b0b98f6577d4 req-8b193770-9a7a-4780-b100-2329756c7206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eae0a7a9-fc43-4223-8ab8-087913d81116", "name": "network-vif-deleted", "tag": "56fc1fb3-b822-43eb-8a4f-8a45b044dda9"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:17.058439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6e0a1d98-62d0-4d48-857b-b0b98f6577d4 req-8b193770-9a7a-4780-b100-2329756c7206 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:17.061246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6e0a1d98-62d0-4d48-857b-b0b98f6577d4 req-8b193770-9a7a-4780-b100-2329756c7206 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:17.084614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.compute.server_external_events [req-6e0a1d98-62d0-4d48-857b-b0b98f6577d4 req-8b193770-9a7a-4780-b100-2329756c7206 service nova] Unable to find a host for instance eae0a7a9-fc43-4223-8ab8-087913d81116. Dropping event network-vif-deleted {{(pid=143129) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 28 21:29:17.085543 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-6e0a1d98-62d0-4d48-857b-b0b98f6577d4 req-8b193770-9a7a-4780-b100-2329756c7206 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.165320 May 28 21:29:17.086243 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2697/5343] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 166 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 28 21:29:17.091393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-385fff86-522f-4489-b0c6-44070574975b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:17.092162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-385fff86-522f-4489-b0c6-44070574975b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: eae0a7a9-fc43-4223-8ab8-087913d81116] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:17.108005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-385fff86-522f-4489-b0c6-44070574975b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:17.108527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-385fff86-522f-4489-b0c6-44070574975b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:17.109334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-385fff86-522f-4489-b0c6-44070574975b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:17.109781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-385fff86-522f-4489-b0c6-44070574975b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:17.127498 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-385fff86-522f-4489-b0c6-44070574975b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] HTTP exception thrown: Instance eae0a7a9-fc43-4223-8ab8-087913d81116 could not be found. May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-385fff86-522f-4489-b0c6-44070574975b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Request method failure captured: May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 HTTP/1.1 May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpKIk2OUil0QsMGGU0iOO3mmhI8Jd7LtRGcnyhnlDDx4kYkNF5-ymhcXN7hllklCNhr1_lZt3ykjiY5Y0a-24J_DqF4BPVH5qPEZ4vCdPizqGadcaWtjxsjwyPO4ar3aAOGmADovrf4x3XhColp7kRYAiPONaPNMu2yATNBTY4OR6P4 May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 54447ea481574a128f06c24315f34e46 May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerActionsTestJSON-2133353695 May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54447ea481574a128f06c24315f34e46", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54447ea481574a128f06c24315f34e46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54447ea481574a128f06c24315f34e46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54447ea481574a128f06c24315f34e46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerActionsTestJSON-2133353695 May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 54447ea481574a128f06c24315f34e46 May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerActionsTestJSON-2133353695 May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerActionsTestJSON-2133353695-project May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 02d5fbb072814fd7923ecf12c7ecad7b May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerActionsTestJSON-2133353695-project May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance eae0a7a9-fc43-4223-8ab8-087913d81116 could not be found. May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'eae0a7a9-fc43-4223-8ab8-087913d81116'} May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eae0a7a9-fc43-4223-8ab8-087913d81116 could not be found. May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eae0a7a9-fc43-4223-8ab8-087913d81116 could not be found. May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:29:17.130135 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:17.134998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:17.134998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:29:17.134998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:29:17.134998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:29:17.134998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:29:17.134998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eae0a7a9-fc43-4223-8ab8-087913d81116 could not be found. May 28 21:29:17.134998 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:17.136889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-385fff86-522f-4489-b0c6-44070574975b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Returning 404 to user: Instance eae0a7a9-fc43-4223-8ab8-087913d81116 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:29:17.138588 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-385fff86-522f-4489-b0c6-44070574975b tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116" status: 404 len: 111 microversion: 2.1 time: 0.050421 May 28 21:29:17.139671 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2698/5344] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:17 2022] GET /compute/v2.1/servers/eae0a7a9-fc43-4223-8ab8-087913d81116 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:29:17.151001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7dd20d84-06a1-4ac8-9874-b6fd9cc07509 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:17.151803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7dd20d84-06a1-4ac8-9874-b6fd9cc07509 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:17.162060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7dd20d84-06a1-4ac8-9874-b6fd9cc07509 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:17.162976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7dd20d84-06a1-4ac8-9874-b6fd9cc07509 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:17.164759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7dd20d84-06a1-4ac8-9874-b6fd9cc07509 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:17.165427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7dd20d84-06a1-4ac8-9874-b6fd9cc07509 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:17.205285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7dd20d84-06a1-4ac8-9874-b6fd9cc07509 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:29:17.588825 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7dd20d84-06a1-4ac8-9874-b6fd9cc07509 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 204 len: 0 microversion: 2.1 time: 0.444819 May 28 21:29:17.589497 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2699/5345] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:29:17 2022] DELETE /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:29:17.602298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-70bafa4a-63e3-44c2-998e-9a4d03917933 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:17.603106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-70bafa4a-63e3-44c2-998e-9a4d03917933 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:17.615294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70bafa4a-63e3-44c2-998e-9a4d03917933 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:17.616047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70bafa4a-63e3-44c2-998e-9a4d03917933 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:17.617120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70bafa4a-63e3-44c2-998e-9a4d03917933 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:17.617744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70bafa4a-63e3-44c2-998e-9a4d03917933 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:17.812702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-70bafa4a-63e3-44c2-998e-9a4d03917933 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:17.831047 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-70bafa4a-63e3-44c2-998e-9a4d03917933 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 200 len: 1467 microversion: 2.1 time: 0.233016 May 28 21:29:17.833772 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2700/5346] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:17 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 1467 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:18.143851 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1648775569-access_point-78266137", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "18f202fb-f11d-44f7-a6cc-cfa3234b5c9b"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1282774370", "security_groups": [{"name": "tempest-secgroup_access--1445282248"}, {"name": "tempest-secgroup_general--503177038"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:18.402403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] validate_networks() for [('18f202fb-f11d-44f7-a6cc-cfa3234b5c9b', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:29:19.252972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:29:19.257489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:29:19.257489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:29:19.257489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:29:19.257489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:29:19.260304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:19.277324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:19.282097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:19.286152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:19.286152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:19.333345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Getting quotas for project 97cf01c13fa745a3bd04e35a0ce27088. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:29:19.349359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Getting quotas for user 642d08e104394dd28e6b4b502f5bc8cf and project 97cf01c13fa745a3bd04e35a0ce27088. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:29:19.370268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:29:19.381359 ncdv-master-1 devstack@n-api.service[143129]: WARNING nova.utils [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1648775569-access_point-78266137 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1648775569-ac May 28 21:29:19.382675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:29:19.511543 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0af974c4-a7ea-4018-be9f-f26019986b79 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.374691 May 28 21:29:19.512578 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2701/5347] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:29:18 2022] POST /compute/v2.1/servers => generated 457 bytes in 1377 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:29:19.518205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-90c46067-7d56-498d-a519-b1ed091bb0d0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed95b6dd-f6d9-4cde-a354-d6ae7327ae42"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:19.520431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-90c46067-7d56-498d-a519-b1ed091bb0d0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:19.529383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90c46067-7d56-498d-a519-b1ed091bb0d0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:19.531330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90c46067-7d56-498d-a519-b1ed091bb0d0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:19.532496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90c46067-7d56-498d-a519-b1ed091bb0d0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:19.533271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90c46067-7d56-498d-a519-b1ed091bb0d0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:20.285918 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-04abf63c-c041-498c-8e3f-5a981f9fe3d2 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7/action" status: 202 len: 0 microversion: 2.1 time: 5.763860 May 28 21:29:20.289879 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2647/5348] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:29:14 2022] POST /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7/action => generated 0 bytes in 5768 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:29:20.295207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aa51aa64-b696-4f90-bcd5-bd64b07cbf88 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:20.295844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aa51aa64-b696-4f90-bcd5-bd64b07cbf88 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:20.304074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa51aa64-b696-4f90-bcd5-bd64b07cbf88 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:20.304999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa51aa64-b696-4f90-bcd5-bd64b07cbf88 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:20.305814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa51aa64-b696-4f90-bcd5-bd64b07cbf88 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:20.306289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa51aa64-b696-4f90-bcd5-bd64b07cbf88 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:20.718958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aa51aa64-b696-4f90-bcd5-bd64b07cbf88 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:20.727842 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aa51aa64-b696-4f90-bcd5-bd64b07cbf88 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 200 len: 1300 microversion: 2.1 time: 0.436861 May 28 21:29:20.737403 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2648/5349] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:20 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 1300 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:20.737403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5915ab6e-940c-427f-87be-6bff7d367fc1 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:20.737403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5915ab6e-940c-427f-87be-6bff7d367fc1 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:20.811027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5915ab6e-940c-427f-87be-6bff7d367fc1 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:20.818965 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5915ab6e-940c-427f-87be-6bff7d367fc1 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1293 microversion: 2.1 time: 0.089536 May 28 21:29:20.824039 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2649/5350] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:20 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:20.824039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-4e288b3c-90f5-422c-8c78-7c4a2be00119 req-26324dc8-6baa-4a0c-9d6c-6febb65eddef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b35b6fe-546d-42e1-a38b-8f32ce3078bc", "name": "network-vif-deleted", "tag": "ca40ef3b-811a-4af2-975d-a424b3e6d7f1"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:20.833944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-4e288b3c-90f5-422c-8c78-7c4a2be00119 req-26324dc8-6baa-4a0c-9d6c-6febb65eddef service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:20.834828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-4e288b3c-90f5-422c-8c78-7c4a2be00119 req-26324dc8-6baa-4a0c-9d6c-6febb65eddef service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:20.851740 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-4e288b3c-90f5-422c-8c78-7c4a2be00119 req-26324dc8-6baa-4a0c-9d6c-6febb65eddef service nova] Creating event network-vif-deleted:ca40ef3b-811a-4af2-975d-a424b3e6d7f1 for instance 3b35b6fe-546d-42e1-a38b-8f32ce3078bc on nch1-master-1 May 28 21:29:20.855177 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-4e288b3c-90f5-422c-8c78-7c4a2be00119 req-26324dc8-6baa-4a0c-9d6c-6febb65eddef service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034337 May 28 21:29:20.856019 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2650/5351] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:20.861503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c1115621-5bfe-4b8c-a3b6-f5581382f5f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:20.862254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c1115621-5bfe-4b8c-a3b6-f5581382f5f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:20.869194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1115621-5bfe-4b8c-a3b6-f5581382f5f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:20.869810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1115621-5bfe-4b8c-a3b6-f5581382f5f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:20.870607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1115621-5bfe-4b8c-a3b6-f5581382f5f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:20.871045 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c1115621-5bfe-4b8c-a3b6-f5581382f5f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:20.896248 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-90c46067-7d56-498d-a519-b1ed091bb0d0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "POST /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.381074 May 28 21:29:20.911899 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2702/5352] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:29:19 2022] POST /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/os-volume_attachments => generated 194 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:21.176163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c1115621-5bfe-4b8c-a3b6-f5581382f5f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:21.186538 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c1115621-5bfe-4b8c-a3b6-f5581382f5f5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1691 microversion: 2.1 time: 0.328736 May 28 21:29:21.187359 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2651/5353] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:20 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1691 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:21.746135 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eccf31e0-b6b0-476c-9aa9-55ab22d4aac9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:21.746844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eccf31e0-b6b0-476c-9aa9-55ab22d4aac9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 3b35b6fe-546d-42e1-a38b-8f32ce3078bc] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:21.764966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eccf31e0-b6b0-476c-9aa9-55ab22d4aac9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:21.765823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eccf31e0-b6b0-476c-9aa9-55ab22d4aac9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:21.767043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eccf31e0-b6b0-476c-9aa9-55ab22d4aac9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:21.767873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eccf31e0-b6b0-476c-9aa9-55ab22d4aac9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:21.795366 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-eccf31e0-b6b0-476c-9aa9-55ab22d4aac9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] HTTP exception thrown: Instance 3b35b6fe-546d-42e1-a38b-8f32ce3078bc could not be found. May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eccf31e0-b6b0-476c-9aa9-55ab22d4aac9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Request method failure captured: May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc HTTP/1.1 May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpKIk2OUil0QsMGGU0iOO3mmhI8Jd7LtRGcnyhnlDDx4kYkNF5-ymhcXN7hllklCNhr1_lZt3ykjiY5Y0a-24J_DqF4BPVH5qPEZ4vCdPizqGadcaWtjxsjwyPO4ar3aAOGmADovrf4x3XhColp7kRYAiPONaPNMu2yATNBTY4OR6P4 May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 54447ea481574a128f06c24315f34e46 May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerActionsTestJSON-2133353695 May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54447ea481574a128f06c24315f34e46", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54447ea481574a128f06c24315f34e46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54447ea481574a128f06c24315f34e46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54447ea481574a128f06c24315f34e46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerActionsTestJSON-2133353695 May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 54447ea481574a128f06c24315f34e46 May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerActionsTestJSON-2133353695 May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerActionsTestJSON-2133353695-project May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 02d5fbb072814fd7923ecf12c7ecad7b May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerActionsTestJSON-2133353695-project May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 3b35b6fe-546d-42e1-a38b-8f32ce3078bc could not be found. May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '3b35b6fe-546d-42e1-a38b-8f32ce3078bc'} May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b35b6fe-546d-42e1-a38b-8f32ce3078bc could not be found. May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b35b6fe-546d-42e1-a38b-8f32ce3078bc could not be found. May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:29:21.797542 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:21.804603 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:21.804603 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:29:21.804603 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:29:21.804603 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:29:21.804603 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:29:21.804603 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b35b6fe-546d-42e1-a38b-8f32ce3078bc could not be found. May 28 21:29:21.804603 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:21.806263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eccf31e0-b6b0-476c-9aa9-55ab22d4aac9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Returning 404 to user: Instance 3b35b6fe-546d-42e1-a38b-8f32ce3078bc could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:29:21.807353 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eccf31e0-b6b0-476c-9aa9-55ab22d4aac9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc" status: 404 len: 111 microversion: 2.1 time: 0.066486 May 28 21:29:21.808087 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2703/5354] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:21 2022] GET /compute/v2.1/servers/3b35b6fe-546d-42e1-a38b-8f32ce3078bc => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:29:21.825281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-59c50c22-0e1c-495e-9a89-8070f15eb247 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:21.826024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-59c50c22-0e1c-495e-9a89-8070f15eb247 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:21.833619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59c50c22-0e1c-495e-9a89-8070f15eb247 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:21.834576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59c50c22-0e1c-495e-9a89-8070f15eb247 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:21.836044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59c50c22-0e1c-495e-9a89-8070f15eb247 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:21.836790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59c50c22-0e1c-495e-9a89-8070f15eb247 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:21.840931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f368457e-cd90-428f-b085-86e9d2a658ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:21.841560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f368457e-cd90-428f-b085-86e9d2a658ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:21.870830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f368457e-cd90-428f-b085-86e9d2a658ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:21.871358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f368457e-cd90-428f-b085-86e9d2a658ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:21.872031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-59c50c22-0e1c-495e-9a89-8070f15eb247 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:29:21.872188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f368457e-cd90-428f-b085-86e9d2a658ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:21.872613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f368457e-cd90-428f-b085-86e9d2a658ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:21.977916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f368457e-cd90-428f-b085-86e9d2a658ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:22.007692 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f368457e-cd90-428f-b085-86e9d2a658ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1297 microversion: 2.1 time: 0.175019 May 28 21:29:22.008675 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2704/5355] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:21 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1297 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:22.210428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3534256f-ab50-4e4b-aa26-f413983bfa2c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:22.211728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3534256f-ab50-4e4b-aa26-f413983bfa2c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:22.234596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3534256f-ab50-4e4b-aa26-f413983bfa2c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:22.235162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3534256f-ab50-4e4b-aa26-f413983bfa2c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:22.236392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3534256f-ab50-4e4b-aa26-f413983bfa2c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:22.236917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3534256f-ab50-4e4b-aa26-f413983bfa2c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:22.354601 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-59c50c22-0e1c-495e-9a89-8070f15eb247 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "DELETE /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 204 len: 0 microversion: 2.1 time: 0.541865 May 28 21:29:22.356293 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2652/5356] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:29:21 2022] DELETE /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:29:22.375775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-295c1e9f-88e8-4942-bd22-56cf4bcb69e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:22.376706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-295c1e9f-88e8-4942-bd22-56cf4bcb69e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:22.392288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-295c1e9f-88e8-4942-bd22-56cf4bcb69e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:22.393220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-295c1e9f-88e8-4942-bd22-56cf4bcb69e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:22.395122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-295c1e9f-88e8-4942-bd22-56cf4bcb69e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:22.396552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-295c1e9f-88e8-4942-bd22-56cf4bcb69e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:22.441559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3534256f-ab50-4e4b-aa26-f413983bfa2c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:22.444223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=19,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:22.453147 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3534256f-ab50-4e4b-aa26-f413983bfa2c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1691 microversion: 2.1 time: 0.252306 May 28 21:29:22.458138 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2705/5357] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:22 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1691 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:22.629672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-295c1e9f-88e8-4942-bd22-56cf4bcb69e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:22.639786 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-295c1e9f-88e8-4942-bd22-56cf4bcb69e7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 200 len: 1509 microversion: 2.1 time: 0.276371 May 28 21:29:22.640402 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2653/5358] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:22 2022] GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 1509 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:22.919433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-6310377b-de1d-49d3-8cda-c17aba01a830 req-56054cb6-6f9d-44e4-abca-8d46a332bce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d24eed1-f65c-4cbe-a113-9e6c6165a0c7", "name": "network-vif-unplugged", "status": "completed", "tag": "ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:22.929335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6310377b-de1d-49d3-8cda-c17aba01a830 req-56054cb6-6f9d-44e4-abca-8d46a332bce9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:22.930227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6310377b-de1d-49d3-8cda-c17aba01a830 req-56054cb6-6f9d-44e4-abca-8d46a332bce9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:22.946636 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-6310377b-de1d-49d3-8cda-c17aba01a830 req-56054cb6-6f9d-44e4-abca-8d46a332bce9 service nova] Creating event network-vif-unplugged:ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249 for instance 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 on nch2-master-1 May 28 21:29:22.953006 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-6310377b-de1d-49d3-8cda-c17aba01a830 req-56054cb6-6f9d-44e4-abca-8d46a332bce9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036986 May 28 21:29:22.954653 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2706/5359] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:23.033722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a7676678-8a66-4ab6-9746-ba91456ddff5 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:23.034908 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a7676678-8a66-4ab6-9746-ba91456ddff5 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:23.044262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7676678-8a66-4ab6-9746-ba91456ddff5 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:23.045005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7676678-8a66-4ab6-9746-ba91456ddff5 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:23.046015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7676678-8a66-4ab6-9746-ba91456ddff5 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:23.046693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a7676678-8a66-4ab6-9746-ba91456ddff5 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:23.194039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a7676678-8a66-4ab6-9746-ba91456ddff5 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:23.202960 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a7676678-8a66-4ab6-9746-ba91456ddff5 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1353 microversion: 2.1 time: 0.175402 May 28 21:29:23.203810 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2654/5360] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:23 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:23.475626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-29797784-df2f-4f40-96dd-d7331d6570db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:23.478059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-29797784-df2f-4f40-96dd-d7331d6570db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:23.486423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29797784-df2f-4f40-96dd-d7331d6570db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:23.486908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29797784-df2f-4f40-96dd-d7331d6570db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:23.487730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29797784-df2f-4f40-96dd-d7331d6570db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:23.488174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29797784-df2f-4f40-96dd-d7331d6570db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:23.657638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0142b85e-601f-41d4-98b6-6d565759fef6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:23.658889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0142b85e-601f-41d4-98b6-6d565759fef6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:23.670070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0142b85e-601f-41d4-98b6-6d565759fef6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:23.670453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0142b85e-601f-41d4-98b6-6d565759fef6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:23.672693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0142b85e-601f-41d4-98b6-6d565759fef6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:23.673457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0142b85e-601f-41d4-98b6-6d565759fef6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:23.716940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-29797784-df2f-4f40-96dd-d7331d6570db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:23.728187 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-29797784-df2f-4f40-96dd-d7331d6570db tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1691 microversion: 2.1 time: 0.257472 May 28 21:29:23.728911 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2707/5361] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:23 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1691 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:23.921864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0142b85e-601f-41d4-98b6-6d565759fef6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:23.929929 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0142b85e-601f-41d4-98b6-6d565759fef6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 200 len: 1509 microversion: 2.1 time: 0.276601 May 28 21:29:23.937400 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2655/5362] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:23 2022] GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 1509 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:24.225624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-10771eed-0a6d-4c05-bcd6-88529330b5c2 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:24.226340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-10771eed-0a6d-4c05-bcd6-88529330b5c2 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:24.244239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10771eed-0a6d-4c05-bcd6-88529330b5c2 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:24.246063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10771eed-0a6d-4c05-bcd6-88529330b5c2 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:24.248358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10771eed-0a6d-4c05-bcd6-88529330b5c2 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:24.249411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10771eed-0a6d-4c05-bcd6-88529330b5c2 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:24.379173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-10771eed-0a6d-4c05-bcd6-88529330b5c2 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:24.411430 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-10771eed-0a6d-4c05-bcd6-88529330b5c2 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1351 microversion: 2.1 time: 0.194521 May 28 21:29:24.412979 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2708/5363] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:24 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1351 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:24.746781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-535120f8-8565-4915-96b4-7243fdef6810 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:24.747547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-535120f8-8565-4915-96b4-7243fdef6810 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:24.773171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-535120f8-8565-4915-96b4-7243fdef6810 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:24.773704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-535120f8-8565-4915-96b4-7243fdef6810 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:24.779822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-535120f8-8565-4915-96b4-7243fdef6810 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:24.780326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-535120f8-8565-4915-96b4-7243fdef6810 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:24.948333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5cb9f2ef-91ed-4067-bbb8-12f15a8e8820 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:24.948958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5cb9f2ef-91ed-4067-bbb8-12f15a8e8820 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:24.955768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cb9f2ef-91ed-4067-bbb8-12f15a8e8820 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:24.956251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cb9f2ef-91ed-4067-bbb8-12f15a8e8820 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:24.957017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cb9f2ef-91ed-4067-bbb8-12f15a8e8820 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:24.957495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5cb9f2ef-91ed-4067-bbb8-12f15a8e8820 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:25.061986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5cb9f2ef-91ed-4067-bbb8-12f15a8e8820 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:25.070662 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5cb9f2ef-91ed-4067-bbb8-12f15a8e8820 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 200 len: 1467 microversion: 2.1 time: 0.126863 May 28 21:29:25.091308 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2709/5364] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:24 2022] GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 1467 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:25.094015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-535120f8-8565-4915-96b4-7243fdef6810 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:25.114947 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-535120f8-8565-4915-96b4-7243fdef6810 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1691 microversion: 2.1 time: 0.361895 May 28 21:29:25.114947 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2656/5365] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:24 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1691 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:25.121967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-739355f4-d856-4b9d-bf4d-ffa9fa8bb467 req-873f9572-d9a6-47f0-9bc5-7ddc978161fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d24eed1-f65c-4cbe-a113-9e6c6165a0c7", "tag": "ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249"}, {"server_uuid": "81204693-bc12-463e-8061-230ebcdc0fbe", "name": "network-vif-deleted", "tag": "68f3980c-6620-4c6d-bb97-8053a73c38ff"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:25.140955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-739355f4-d856-4b9d-bf4d-ffa9fa8bb467 req-873f9572-d9a6-47f0-9bc5-7ddc978161fb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:25.144009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-739355f4-d856-4b9d-bf4d-ffa9fa8bb467 req-873f9572-d9a6-47f0-9bc5-7ddc978161fb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:25.164838 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-739355f4-d856-4b9d-bf4d-ffa9fa8bb467 req-873f9572-d9a6-47f0-9bc5-7ddc978161fb service nova] Creating event network-changed:ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249 for instance 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 on nch2-master-1 May 28 21:29:25.165272 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-739355f4-d856-4b9d-bf4d-ffa9fa8bb467 req-873f9572-d9a6-47f0-9bc5-7ddc978161fb service nova] Creating event network-vif-deleted:68f3980c-6620-4c6d-bb97-8053a73c38ff for instance 81204693-bc12-463e-8061-230ebcdc0fbe on nch1-master-1 May 28 21:29:25.182702 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-739355f4-d856-4b9d-bf4d-ffa9fa8bb467 req-873f9572-d9a6-47f0-9bc5-7ddc978161fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.066013 May 28 21:29:25.183745 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2710/5366] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:25.430760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fe2dac28-bb3e-496e-83eb-9502cf219eee tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:25.431384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fe2dac28-bb3e-496e-83eb-9502cf219eee tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:25.439991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fe2dac28-bb3e-496e-83eb-9502cf219eee tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:25.443541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fe2dac28-bb3e-496e-83eb-9502cf219eee tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:25.444505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fe2dac28-bb3e-496e-83eb-9502cf219eee tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:25.447053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fe2dac28-bb3e-496e-83eb-9502cf219eee tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:25.694808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-722956de-6705-4922-8b8c-a012213a6f2b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:25.711161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-722956de-6705-4922-8b8c-a012213a6f2b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:25.711710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-722956de-6705-4922-8b8c-a012213a6f2b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:25.742408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-722956de-6705-4922-8b8c-a012213a6f2b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Going to try to stop instance {{(pid=143129) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 21:29:25.843044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fe2dac28-bb3e-496e-83eb-9502cf219eee tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:25.855595 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fe2dac28-bb3e-496e-83eb-9502cf219eee tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1470 microversion: 2.1 time: 0.428693 May 28 21:29:25.856194 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2657/5367] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:25 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1470 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:26.041779 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-722956de-6705-4922-8b8c-a012213a6f2b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "POST /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/action" status: 202 len: 0 microversion: 2.1 time: 0.353100 May 28 21:29:26.045401 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2711/5368] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:29:25 2022] POST /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:29:26.051664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-92f6b413-6a56-4968-929a-ecb748662532 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:26.053220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-92f6b413-6a56-4968-929a-ecb748662532 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:26.060241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92f6b413-6a56-4968-929a-ecb748662532 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:26.060701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92f6b413-6a56-4968-929a-ecb748662532 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:26.061547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92f6b413-6a56-4968-929a-ecb748662532 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:26.062211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92f6b413-6a56-4968-929a-ecb748662532 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:26.089430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-708a24dc-9307-4796-b7c3-1c6b3b36f891 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:26.090166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-708a24dc-9307-4796-b7c3-1c6b3b36f891 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 81204693-bc12-463e-8061-230ebcdc0fbe] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:26.099585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-708a24dc-9307-4796-b7c3-1c6b3b36f891 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:26.099585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-708a24dc-9307-4796-b7c3-1c6b3b36f891 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:26.099585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-708a24dc-9307-4796-b7c3-1c6b3b36f891 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:26.099910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-708a24dc-9307-4796-b7c3-1c6b3b36f891 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:26.118807 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-708a24dc-9307-4796-b7c3-1c6b3b36f891 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] HTTP exception thrown: Instance 81204693-bc12-463e-8061-230ebcdc0fbe could not be found. May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-708a24dc-9307-4796-b7c3-1c6b3b36f891 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Request method failure captured: May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe HTTP/1.1 May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpKIk2OUil0QsMGGU0iOO3mmhI8Jd7LtRGcnyhnlDDx4kYkNF5-ymhcXN7hllklCNhr1_lZt3ykjiY5Y0a-24J_DqF4BPVH5qPEZ4vCdPizqGadcaWtjxsjwyPO4ar3aAOGmADovrf4x3XhColp7kRYAiPONaPNMu2yATNBTY4OR6P4 May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 54447ea481574a128f06c24315f34e46 May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerActionsTestJSON-2133353695 May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54447ea481574a128f06c24315f34e46", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54447ea481574a128f06c24315f34e46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54447ea481574a128f06c24315f34e46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54447ea481574a128f06c24315f34e46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerActionsTestJSON-2133353695 May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 54447ea481574a128f06c24315f34e46 May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerActionsTestJSON-2133353695 May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerActionsTestJSON-2133353695-project May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 02d5fbb072814fd7923ecf12c7ecad7b May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerActionsTestJSON-2133353695-project May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 81204693-bc12-463e-8061-230ebcdc0fbe could not be found. May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '81204693-bc12-463e-8061-230ebcdc0fbe'} May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81204693-bc12-463e-8061-230ebcdc0fbe could not be found. May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81204693-bc12-463e-8061-230ebcdc0fbe could not be found. May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:29:26.120593 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:26.126893 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:26.126893 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:29:26.126893 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:29:26.126893 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:29:26.126893 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:29:26.126893 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81204693-bc12-463e-8061-230ebcdc0fbe could not be found. May 28 21:29:26.126893 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:26.126893 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-708a24dc-9307-4796-b7c3-1c6b3b36f891 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Returning 404 to user: Instance 81204693-bc12-463e-8061-230ebcdc0fbe could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:29:26.126893 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-708a24dc-9307-4796-b7c3-1c6b3b36f891 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe" status: 404 len: 111 microversion: 2.1 time: 0.037564 May 28 21:29:26.126893 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2712/5369] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:26 2022] GET /compute/v2.1/servers/81204693-bc12-463e-8061-230ebcdc0fbe => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:29:26.130976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-78f4596c-c672-419f-a4ee-6b9015e9c433 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:26.131691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-78f4596c-c672-419f-a4ee-6b9015e9c433 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:26.138483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78f4596c-c672-419f-a4ee-6b9015e9c433 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:26.141727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78f4596c-c672-419f-a4ee-6b9015e9c433 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:26.143090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78f4596c-c672-419f-a4ee-6b9015e9c433 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:26.144257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78f4596c-c672-419f-a4ee-6b9015e9c433 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:26.384101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-78f4596c-c672-419f-a4ee-6b9015e9c433 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:26.400436 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-78f4596c-c672-419f-a4ee-6b9015e9c433 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1691 microversion: 2.1 time: 0.273795 May 28 21:29:26.401655 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2713/5370] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:26 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1691 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:26.406985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ade0fdfe-c0bd-4e7e-8d9a-be48bd24f91d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:26.410850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ade0fdfe-c0bd-4e7e-8d9a-be48bd24f91d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:26.417911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ade0fdfe-c0bd-4e7e-8d9a-be48bd24f91d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:26.418762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ade0fdfe-c0bd-4e7e-8d9a-be48bd24f91d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:26.419826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ade0fdfe-c0bd-4e7e-8d9a-be48bd24f91d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:26.420388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ade0fdfe-c0bd-4e7e-8d9a-be48bd24f91d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:26.450020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-92f6b413-6a56-4968-929a-ecb748662532 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:26.456819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ade0fdfe-c0bd-4e7e-8d9a-be48bd24f91d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:29:26.462762 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-92f6b413-6a56-4968-929a-ecb748662532 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1724 microversion: 2.1 time: 0.415882 May 28 21:29:26.478055 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2658/5371] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:26 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1724 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:26.491817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-6f33f874-94c6-494e-9e2f-bc7be2b227d6 req-43e1fa30-154a-40d8-afb2-0e407bea65de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cc276a6-db4e-4a03-b637-5c84e10a589f", "tag": "4c140de1-06ca-4846-ac17-c169fb67a422"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:26.501343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6f33f874-94c6-494e-9e2f-bc7be2b227d6 req-43e1fa30-154a-40d8-afb2-0e407bea65de service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:26.502018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6f33f874-94c6-494e-9e2f-bc7be2b227d6 req-43e1fa30-154a-40d8-afb2-0e407bea65de service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:26.513942 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-6f33f874-94c6-494e-9e2f-bc7be2b227d6 req-43e1fa30-154a-40d8-afb2-0e407bea65de service nova] Creating event network-changed:4c140de1-06ca-4846-ac17-c169fb67a422 for instance 5cc276a6-db4e-4a03-b637-5c84e10a589f on nch2-master-1 May 28 21:29:26.519920 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-6f33f874-94c6-494e-9e2f-bc7be2b227d6 req-43e1fa30-154a-40d8-afb2-0e407bea65de service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031682 May 28 21:29:26.520768 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2659/5372] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:26.875356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-df1d90f3-f1ca-463a-bfbb-054d6603699f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:26.881561 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ade0fdfe-c0bd-4e7e-8d9a-be48bd24f91d tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 204 len: 0 microversion: 2.1 time: 0.477095 May 28 21:29:26.883698 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2714/5373] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:29:26 2022] DELETE /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:29:26.883861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-df1d90f3-f1ca-463a-bfbb-054d6603699f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:26.893230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df1d90f3-f1ca-463a-bfbb-054d6603699f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:26.895048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df1d90f3-f1ca-463a-bfbb-054d6603699f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:26.895931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df1d90f3-f1ca-463a-bfbb-054d6603699f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:26.897241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df1d90f3-f1ca-463a-bfbb-054d6603699f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:26.899417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-910bce89-1004-4415-b406-741ca195f68f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:26.900793 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-910bce89-1004-4415-b406-741ca195f68f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:26.913469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-910bce89-1004-4415-b406-741ca195f68f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:26.915101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-910bce89-1004-4415-b406-741ca195f68f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:26.916285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-910bce89-1004-4415-b406-741ca195f68f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:26.918341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-910bce89-1004-4415-b406-741ca195f68f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:27.282648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-910bce89-1004-4415-b406-741ca195f68f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:27.288735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-df1d90f3-f1ca-463a-bfbb-054d6603699f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:27.298571 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-910bce89-1004-4415-b406-741ca195f68f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1495 microversion: 2.1 time: 0.407027 May 28 21:29:27.300450 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-df1d90f3-f1ca-463a-bfbb-054d6603699f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1470 microversion: 2.1 time: 0.430708 May 28 21:29:27.301711 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2660/5374] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:26 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1470 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:27.310133 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2715/5375] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:26 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1495 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:27.419026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fd9f961b-3805-44a7-8d3d-8993b07e9946 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:27.419661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fd9f961b-3805-44a7-8d3d-8993b07e9946 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:27.426535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fd9f961b-3805-44a7-8d3d-8993b07e9946 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:27.427001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fd9f961b-3805-44a7-8d3d-8993b07e9946 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:27.427784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fd9f961b-3805-44a7-8d3d-8993b07e9946 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:27.428235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fd9f961b-3805-44a7-8d3d-8993b07e9946 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:27.501593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-225a2eab-9d28-4131-8188-4ffe0415c508 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:27.501593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-225a2eab-9d28-4131-8188-4ffe0415c508 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:27.520641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-225a2eab-9d28-4131-8188-4ffe0415c508 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:27.521508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-225a2eab-9d28-4131-8188-4ffe0415c508 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:27.522522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-225a2eab-9d28-4131-8188-4ffe0415c508 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:27.523913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-225a2eab-9d28-4131-8188-4ffe0415c508 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:27.639718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fd9f961b-3805-44a7-8d3d-8993b07e9946 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:27.651686 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fd9f961b-3805-44a7-8d3d-8993b07e9946 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1691 microversion: 2.1 time: 0.236260 May 28 21:29:27.658552 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2661/5376] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:27 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1691 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:27.730470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-225a2eab-9d28-4131-8188-4ffe0415c508 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:27.739399 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-225a2eab-9d28-4131-8188-4ffe0415c508 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1724 microversion: 2.1 time: 0.247084 May 28 21:29:27.740282 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2716/5377] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:27 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:28.329874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f7202be6-2cb6-4a65-9643-6e790f81b82f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:28.330720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eb2f8014-7abc-4bd8-9247-a9e4475405f7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:28.332680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eb2f8014-7abc-4bd8-9247-a9e4475405f7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:28.336229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f7202be6-2cb6-4a65-9643-6e790f81b82f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:28.343866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb2f8014-7abc-4bd8-9247-a9e4475405f7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:28.344346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb2f8014-7abc-4bd8-9247-a9e4475405f7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:28.345145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb2f8014-7abc-4bd8-9247-a9e4475405f7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:28.345601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb2f8014-7abc-4bd8-9247-a9e4475405f7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:28.355496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7202be6-2cb6-4a65-9643-6e790f81b82f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:28.355951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7202be6-2cb6-4a65-9643-6e790f81b82f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:28.358792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7202be6-2cb6-4a65-9643-6e790f81b82f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:28.361055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7202be6-2cb6-4a65-9643-6e790f81b82f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:28.604551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eb2f8014-7abc-4bd8-9247-a9e4475405f7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:28.614673 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eb2f8014-7abc-4bd8-9247-a9e4475405f7 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1495 microversion: 2.1 time: 0.292409 May 28 21:29:28.625190 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2717/5378] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:28 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1495 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:28.670262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c34fe6f5-488c-40c9-aa52-d52c0ef3c96c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:28.679492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c34fe6f5-488c-40c9-aa52-d52c0ef3c96c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:28.695236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c34fe6f5-488c-40c9-aa52-d52c0ef3c96c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:28.696035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c34fe6f5-488c-40c9-aa52-d52c0ef3c96c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:28.699483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c34fe6f5-488c-40c9-aa52-d52c0ef3c96c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:28.700281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c34fe6f5-488c-40c9-aa52-d52c0ef3c96c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:28.932082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f7202be6-2cb6-4a65-9643-6e790f81b82f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:28.933696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:28.947238 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f7202be6-2cb6-4a65-9643-6e790f81b82f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1470 microversion: 2.1 time: 0.626268 May 28 21:29:28.948090 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2662/5379] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:28 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1470 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:28.953596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0faba104-4da6-489b-9165-3b29dc4a85c6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:28.954305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0faba104-4da6-489b-9165-3b29dc4a85c6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:28.962541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0faba104-4da6-489b-9165-3b29dc4a85c6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:28.962989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0faba104-4da6-489b-9165-3b29dc4a85c6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:28.963949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0faba104-4da6-489b-9165-3b29dc4a85c6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:28.964428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0faba104-4da6-489b-9165-3b29dc4a85c6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:29.212619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c34fe6f5-488c-40c9-aa52-d52c0ef3c96c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:29.221555 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c34fe6f5-488c-40c9-aa52-d52c0ef3c96c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1691 microversion: 2.1 time: 0.555700 May 28 21:29:29.230747 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2718/5380] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:28 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1691 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:29.353419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-1448d63c-1e06-4aa0-a410-abaa95e018f4 req-01efbaab-2b34-4466-a680-78b670f3f6cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fdc441-5fd2-4945-8749-ad17d0140a5d", "name": "network-vif-deleted", "tag": "d2d5eed9-fe81-4c87-8dc3-8afcae96de04"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:29.355329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0faba104-4da6-489b-9165-3b29dc4a85c6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:29.364695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:29.366764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:29.367834 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0faba104-4da6-489b-9165-3b29dc4a85c6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1724 microversion: 2.1 time: 0.417629 May 28 21:29:29.369013 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2663/5381] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:28 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1724 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:29.379536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1448d63c-1e06-4aa0-a410-abaa95e018f4 req-01efbaab-2b34-4466-a680-78b670f3f6cf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:29.382505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1448d63c-1e06-4aa0-a410-abaa95e018f4 req-01efbaab-2b34-4466-a680-78b670f3f6cf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:29.412890 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-1448d63c-1e06-4aa0-a410-abaa95e018f4 req-01efbaab-2b34-4466-a680-78b670f3f6cf service nova] Creating event network-vif-deleted:d2d5eed9-fe81-4c87-8dc3-8afcae96de04 for instance d7fdc441-5fd2-4945-8749-ad17d0140a5d on nch1-master-1 May 28 21:29:29.418437 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-1448d63c-1e06-4aa0-a410-abaa95e018f4 req-01efbaab-2b34-4466-a680-78b670f3f6cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068578 May 28 21:29:29.419066 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2719/5382] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:29.633761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d49f51bf-70a6-479b-8af9-76e2d4346f8a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:29.634951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d49f51bf-70a6-479b-8af9-76e2d4346f8a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:29.642132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d49f51bf-70a6-479b-8af9-76e2d4346f8a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:29.642934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d49f51bf-70a6-479b-8af9-76e2d4346f8a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:29.644486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d49f51bf-70a6-479b-8af9-76e2d4346f8a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:29.644986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d49f51bf-70a6-479b-8af9-76e2d4346f8a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:29.763519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d49f51bf-70a6-479b-8af9-76e2d4346f8a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:29.780448 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d49f51bf-70a6-479b-8af9-76e2d4346f8a tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 200 len: 1287 microversion: 2.1 time: 0.150192 May 28 21:29:29.790473 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2664/5383] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:29 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 1287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:29.968529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e68b7eaf-18a4-4ecf-9771-648f20e112b3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:29.969665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e68b7eaf-18a4-4ecf-9771-648f20e112b3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:29.977168 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e68b7eaf-18a4-4ecf-9771-648f20e112b3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:29.978067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e68b7eaf-18a4-4ecf-9771-648f20e112b3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:29.979433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e68b7eaf-18a4-4ecf-9771-648f20e112b3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:29.980125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e68b7eaf-18a4-4ecf-9771-648f20e112b3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:30.248514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9b527a93-c5d8-40eb-9602-1d3cca78f10c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:30.249491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9b527a93-c5d8-40eb-9602-1d3cca78f10c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:30.256944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b527a93-c5d8-40eb-9602-1d3cca78f10c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:30.257400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b527a93-c5d8-40eb-9602-1d3cca78f10c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:30.258256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b527a93-c5d8-40eb-9602-1d3cca78f10c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:30.258701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b527a93-c5d8-40eb-9602-1d3cca78f10c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:30.260901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e68b7eaf-18a4-4ecf-9771-648f20e112b3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:30.269461 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e68b7eaf-18a4-4ecf-9771-648f20e112b3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1470 microversion: 2.1 time: 0.308526 May 28 21:29:30.270188 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2720/5384] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:29 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1470 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:30.386251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e6567b82-484b-4d25-9385-e9efa3f1e00f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:30.387100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e6567b82-484b-4d25-9385-e9efa3f1e00f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:30.393974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6567b82-484b-4d25-9385-e9efa3f1e00f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:30.394767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6567b82-484b-4d25-9385-e9efa3f1e00f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:30.395637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6567b82-484b-4d25-9385-e9efa3f1e00f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:30.396259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6567b82-484b-4d25-9385-e9efa3f1e00f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:30.645512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9b527a93-c5d8-40eb-9602-1d3cca78f10c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:30.656057 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9b527a93-c5d8-40eb-9602-1d3cca78f10c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1691 microversion: 2.1 time: 0.411864 May 28 21:29:30.661977 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2665/5385] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:30 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1691 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:30.692262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e6567b82-484b-4d25-9385-e9efa3f1e00f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:30.701087 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e6567b82-484b-4d25-9385-e9efa3f1e00f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1724 microversion: 2.1 time: 0.319336 May 28 21:29:30.701883 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2721/5386] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:30 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:30.798332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-19652842-d48a-4352-b5c2-d8eff8af2b8f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:30.802065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-19652842-d48a-4352-b5c2-d8eff8af2b8f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: d7fdc441-5fd2-4945-8749-ad17d0140a5d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:30.806331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19652842-d48a-4352-b5c2-d8eff8af2b8f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:30.806793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19652842-d48a-4352-b5c2-d8eff8af2b8f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:30.807585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19652842-d48a-4352-b5c2-d8eff8af2b8f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:30.808016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19652842-d48a-4352-b5c2-d8eff8af2b8f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:30.821998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:30.823784 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-19652842-d48a-4352-b5c2-d8eff8af2b8f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] HTTP exception thrown: Instance d7fdc441-5fd2-4945-8749-ad17d0140a5d could not be found. May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-19652842-d48a-4352-b5c2-d8eff8af2b8f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Request method failure captured: May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d HTTP/1.1 May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpKIk2OUil0QsMGGU0iOO3mmhI8Jd7LtRGcnyhnlDDx4kYkNF5-ymhcXN7hllklCNhr1_lZt3ykjiY5Y0a-24J_DqF4BPVH5qPEZ4vCdPizqGadcaWtjxsjwyPO4ar3aAOGmADovrf4x3XhColp7kRYAiPONaPNMu2yATNBTY4OR6P4 May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 54447ea481574a128f06c24315f34e46 May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerActionsTestJSON-2133353695 May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54447ea481574a128f06c24315f34e46", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54447ea481574a128f06c24315f34e46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54447ea481574a128f06c24315f34e46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54447ea481574a128f06c24315f34e46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerActionsTestJSON-2133353695 May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 54447ea481574a128f06c24315f34e46 May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerActionsTestJSON-2133353695 May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerActionsTestJSON-2133353695-project May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 02d5fbb072814fd7923ecf12c7ecad7b May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerActionsTestJSON-2133353695-project May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance d7fdc441-5fd2-4945-8749-ad17d0140a5d could not be found. May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'd7fdc441-5fd2-4945-8749-ad17d0140a5d'} May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7fdc441-5fd2-4945-8749-ad17d0140a5d could not be found. May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7fdc441-5fd2-4945-8749-ad17d0140a5d could not be found. May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:29:30.827348 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:29:30.832758 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:30.832758 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:29:30.832758 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:29:30.832758 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:29:30.832758 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:29:30.832758 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7fdc441-5fd2-4945-8749-ad17d0140a5d could not be found. May 28 21:29:30.832758 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:29:30.832758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-19652842-d48a-4352-b5c2-d8eff8af2b8f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Returning 404 to user: Instance d7fdc441-5fd2-4945-8749-ad17d0140a5d could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:29:30.832758 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-19652842-d48a-4352-b5c2-d8eff8af2b8f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d" status: 404 len: 111 microversion: 2.1 time: 0.033078 May 28 21:29:30.832758 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2666/5387] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:30 2022] GET /compute/v2.1/servers/d7fdc441-5fd2-4945-8749-ad17d0140a5d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:29:30.836085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0ec5e258-6f3c-4f01-914c-6244e148b257 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:30.836603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0ec5e258-6f3c-4f01-914c-6244e148b257 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:30.843188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ec5e258-6f3c-4f01-914c-6244e148b257 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:30.843651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ec5e258-6f3c-4f01-914c-6244e148b257 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:30.844632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ec5e258-6f3c-4f01-914c-6244e148b257 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:30.845328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ec5e258-6f3c-4f01-914c-6244e148b257 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:30.863498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:30.874711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0ec5e258-6f3c-4f01-914c-6244e148b257 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:29:31.208591 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0ec5e258-6f3c-4f01-914c-6244e148b257 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "DELETE /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 204 len: 0 microversion: 2.1 time: 0.375992 May 28 21:29:31.209305 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2722/5388] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:29:30 2022] DELETE /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:29:31.223658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-df3fb76b-f5d9-4bfb-b265-9d837da0a07e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:31.224292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-df3fb76b-f5d9-4bfb-b265-9d837da0a07e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:31.232801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df3fb76b-f5d9-4bfb-b265-9d837da0a07e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:31.233293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df3fb76b-f5d9-4bfb-b265-9d837da0a07e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:31.234102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df3fb76b-f5d9-4bfb-b265-9d837da0a07e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:31.234615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df3fb76b-f5d9-4bfb-b265-9d837da0a07e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:31.287853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-33f4d4b9-e3bc-49b2-a547-5a5afa694c45 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:31.288572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-33f4d4b9-e3bc-49b2-a547-5a5afa694c45 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:31.296131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33f4d4b9-e3bc-49b2-a547-5a5afa694c45 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:31.296614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33f4d4b9-e3bc-49b2-a547-5a5afa694c45 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:31.297384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33f4d4b9-e3bc-49b2-a547-5a5afa694c45 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:31.298387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33f4d4b9-e3bc-49b2-a547-5a5afa694c45 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:31.484177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-df3fb76b-f5d9-4bfb-b265-9d837da0a07e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:31.492238 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-df3fb76b-f5d9-4bfb-b265-9d837da0a07e tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1677 microversion: 2.1 time: 0.272927 May 28 21:29:31.493418 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2667/5389] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:31 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1677 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:31.499429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-81378f6a-8ae4-4d8e-ab13-8d614cd22e9b req-9ff50976-bd70-44a4-840d-4505982cffd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d24eed1-f65c-4cbe-a113-9e6c6165a0c7", "name": "network-vif-unplugged", "status": "completed", "tag": "ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:31.510912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-81378f6a-8ae4-4d8e-ab13-8d614cd22e9b req-9ff50976-bd70-44a4-840d-4505982cffd0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:31.511659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-81378f6a-8ae4-4d8e-ab13-8d614cd22e9b req-9ff50976-bd70-44a4-840d-4505982cffd0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:31.524768 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-81378f6a-8ae4-4d8e-ab13-8d614cd22e9b req-9ff50976-bd70-44a4-840d-4505982cffd0 service nova] Creating event network-vif-unplugged:ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249 for instance 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 on nch1-master-1 May 28 21:29:31.530302 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-81378f6a-8ae4-4d8e-ab13-8d614cd22e9b req-9ff50976-bd70-44a4-840d-4505982cffd0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035342 May 28 21:29:31.531480 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2668/5390] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:31.566025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-33f4d4b9-e3bc-49b2-a547-5a5afa694c45 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:31.590139 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-33f4d4b9-e3bc-49b2-a547-5a5afa694c45 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1470 microversion: 2.1 time: 0.307043 May 28 21:29:31.590750 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2723/5391] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:31 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1470 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:31.678633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2d0efd94-1d1f-4dfd-af1b-5a37dfe7df1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:31.679263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2d0efd94-1d1f-4dfd-af1b-5a37dfe7df1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:31.680577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a0ab7c13-019a-4fd1-8e86-a2f21464972d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:31.681199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a0ab7c13-019a-4fd1-8e86-a2f21464972d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:31.691155 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d0efd94-1d1f-4dfd-af1b-5a37dfe7df1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:31.691636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d0efd94-1d1f-4dfd-af1b-5a37dfe7df1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:31.692450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d0efd94-1d1f-4dfd-af1b-5a37dfe7df1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:31.697487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a0ab7c13-019a-4fd1-8e86-a2f21464972d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:31.697974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a0ab7c13-019a-4fd1-8e86-a2f21464972d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:31.698766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a0ab7c13-019a-4fd1-8e86-a2f21464972d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:31.699209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a0ab7c13-019a-4fd1-8e86-a2f21464972d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:31.702787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d0efd94-1d1f-4dfd-af1b-5a37dfe7df1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:31.841090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-a0ab7c13-019a-4fd1-8e86-a2f21464972d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lazy-loading 'services' on Instance uuid 264103c5-0b85-46e8-bf9c-41b21fc70596 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:29:32.082668 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a0ab7c13-019a-4fd1-8e86-a2f21464972d tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "DELETE /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596/os-volume_attachments/f64c199d-aafe-4b81-8b40-af7ac5fa31b5" status: 202 len: 0 microversion: 2.1 time: 0.413651 May 28 21:29:32.083664 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2669/5392] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:29:31 2022] DELETE /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596/os-volume_attachments/f64c199d-aafe-4b81-8b40-af7ac5fa31b5 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:29:32.102645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1be44042-b115-4cad-9f4d-b1ca93695d0e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:32.103263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1be44042-b115-4cad-9f4d-b1ca93695d0e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:32.117377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1be44042-b115-4cad-9f4d-b1ca93695d0e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:32.117377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1be44042-b115-4cad-9f4d-b1ca93695d0e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:32.117377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1be44042-b115-4cad-9f4d-b1ca93695d0e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:32.117377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1be44042-b115-4cad-9f4d-b1ca93695d0e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:32.348611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2d0efd94-1d1f-4dfd-af1b-5a37dfe7df1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:32.357028 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2d0efd94-1d1f-4dfd-af1b-5a37dfe7df1c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1681 microversion: 2.1 time: 0.685506 May 28 21:29:32.362917 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2724/5393] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:31 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1681 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:32.373812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-04ac0ced-ab72-46aa-a53f-43bc7aabaec4 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:32.374498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-04ac0ced-ab72-46aa-a53f-43bc7aabaec4 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:32.381459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04ac0ced-ab72-46aa-a53f-43bc7aabaec4 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:32.382034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04ac0ced-ab72-46aa-a53f-43bc7aabaec4 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:32.385547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04ac0ced-ab72-46aa-a53f-43bc7aabaec4 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:32.385547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04ac0ced-ab72-46aa-a53f-43bc7aabaec4 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:32.396647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1be44042-b115-4cad-9f4d-b1ca93695d0e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:32.405130 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1be44042-b115-4cad-9f4d-b1ca93695d0e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1724 microversion: 2.1 time: 0.320247 May 28 21:29:32.405723 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2670/5394] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:32 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1724 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:32.509989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-24eb4618-49ad-438e-a38d-7cb8436adbd9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:32.511091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-24eb4618-49ad-438e-a38d-7cb8436adbd9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:32.517794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24eb4618-49ad-438e-a38d-7cb8436adbd9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:32.518579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24eb4618-49ad-438e-a38d-7cb8436adbd9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:32.520003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24eb4618-49ad-438e-a38d-7cb8436adbd9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:32.520003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24eb4618-49ad-438e-a38d-7cb8436adbd9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:32.588444 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-04ac0ced-ab72-46aa-a53f-43bc7aabaec4 tempest-TestNetworkAdvancedServerOps-1846680351 tempest-TestNetworkAdvancedServerOps-1846680351-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1832 microversion: 2.1 time: 0.218229 May 28 21:29:32.590128 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2725/5395] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:32 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1832 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:32.609261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-74bd2a4c-b401-4181-9472-785ace9e185a tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:32.610888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-74bd2a4c-b401-4181-9472-785ace9e185a tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:32.625198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74bd2a4c-b401-4181-9472-785ace9e185a tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:32.625675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74bd2a4c-b401-4181-9472-785ace9e185a tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:32.626509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74bd2a4c-b401-4181-9472-785ace9e185a tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:32.627003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74bd2a4c-b401-4181-9472-785ace9e185a tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:32.710819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-24eb4618-49ad-438e-a38d-7cb8436adbd9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:32.718947 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-24eb4618-49ad-438e-a38d-7cb8436adbd9 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1677 microversion: 2.1 time: 0.213279 May 28 21:29:32.719603 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2671/5396] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:32 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1677 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:32.724811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-666e3b97-302d-4b43-9ba7-5e21e8f8b2b4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:32.727708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-666e3b97-302d-4b43-9ba7-5e21e8f8b2b4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:32.734135 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-666e3b97-302d-4b43-9ba7-5e21e8f8b2b4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:32.734676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-666e3b97-302d-4b43-9ba7-5e21e8f8b2b4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:32.735696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-666e3b97-302d-4b43-9ba7-5e21e8f8b2b4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:32.736149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-666e3b97-302d-4b43-9ba7-5e21e8f8b2b4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:32.830553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-74bd2a4c-b401-4181-9472-785ace9e185a tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:32.840721 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-74bd2a4c-b401-4181-9472-785ace9e185a tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1470 microversion: 2.1 time: 0.236842 May 28 21:29:32.842555 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2726/5397] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:32 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1470 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:32.899544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-666e3b97-302d-4b43-9ba7-5e21e8f8b2b4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:32.907692 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-666e3b97-302d-4b43-9ba7-5e21e8f8b2b4 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1681 microversion: 2.1 time: 0.187107 May 28 21:29:32.908286 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2672/5398] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:32 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:33.225751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a69b26b5-e4e4-4418-b4b9-0db5cc586c99 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:33.226772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a69b26b5-e4e4-4418-b4b9-0db5cc586c99 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:33.234978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a69b26b5-e4e4-4418-b4b9-0db5cc586c99 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:33.235441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a69b26b5-e4e4-4418-b4b9-0db5cc586c99 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:33.236339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a69b26b5-e4e4-4418-b4b9-0db5cc586c99 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:33.236691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a69b26b5-e4e4-4418-b4b9-0db5cc586c99 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:33.267675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a69b26b5-e4e4-4418-b4b9-0db5cc586c99 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:29:33.422561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dc59910a-92a4-49cd-bc93-5db74d11a52d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:33.423196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dc59910a-92a4-49cd-bc93-5db74d11a52d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:33.433011 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc59910a-92a4-49cd-bc93-5db74d11a52d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:33.433469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc59910a-92a4-49cd-bc93-5db74d11a52d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:33.438910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc59910a-92a4-49cd-bc93-5db74d11a52d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:33.439740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc59910a-92a4-49cd-bc93-5db74d11a52d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:33.644312 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a69b26b5-e4e4-4418-b4b9-0db5cc586c99 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "DELETE /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 204 len: 0 microversion: 2.1 time: 0.422716 May 28 21:29:33.645735 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2727/5399] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:29:33 2022] DELETE /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:29:33.657103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6040f9d4-9b77-404e-b6b8-e3d0758a6f1b tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:33.657725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6040f9d4-9b77-404e-b6b8-e3d0758a6f1b tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:33.671642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6040f9d4-9b77-404e-b6b8-e3d0758a6f1b tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:33.672413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6040f9d4-9b77-404e-b6b8-e3d0758a6f1b tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:33.673272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6040f9d4-9b77-404e-b6b8-e3d0758a6f1b tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:33.673814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6040f9d4-9b77-404e-b6b8-e3d0758a6f1b tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:33.681516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dc59910a-92a4-49cd-bc93-5db74d11a52d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:33.695780 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dc59910a-92a4-49cd-bc93-5db74d11a52d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1724 microversion: 2.1 time: 0.276916 May 28 21:29:33.699162 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2673/5400] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:33 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:33.738080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bf64260f-292e-4be8-9d30-b3c741feb6d6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:33.739731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bf64260f-292e-4be8-9d30-b3c741feb6d6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:33.747006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf64260f-292e-4be8-9d30-b3c741feb6d6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:33.748060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf64260f-292e-4be8-9d30-b3c741feb6d6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:33.749106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf64260f-292e-4be8-9d30-b3c741feb6d6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:33.754268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf64260f-292e-4be8-9d30-b3c741feb6d6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:34.022487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6040f9d4-9b77-404e-b6b8-e3d0758a6f1b tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d2c184e2ad446cb0481b1421439771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f3ee8ccba4f4a891cac48aaa54d0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:34.024379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bf64260f-292e-4be8-9d30-b3c741feb6d6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:34.032104 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6040f9d4-9b77-404e-b6b8-e3d0758a6f1b tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 200 len: 1468 microversion: 2.1 time: 0.380117 May 28 21:29:34.033901 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2728/5401] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:33 2022] GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 1468 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:34.039047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-78028966-12c2-4931-9a75-27e2a8048268 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:34.039702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-78028966-12c2-4931-9a75-27e2a8048268 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:34.047167 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bf64260f-292e-4be8-9d30-b3c741feb6d6 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1677 microversion: 2.1 time: 0.314342 May 28 21:29:34.047362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78028966-12c2-4931-9a75-27e2a8048268 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:34.047630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78028966-12c2-4931-9a75-27e2a8048268 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:34.048425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78028966-12c2-4931-9a75-27e2a8048268 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:34.048880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78028966-12c2-4931-9a75-27e2a8048268 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:34.058756 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2674/5402] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:33 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1677 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:34.058756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-25a78d83-2dc7-42f8-9702-2e997cc59a7e req-f271a460-e151-4697-b799-6d3527a7d880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cc276a6-db4e-4a03-b637-5c84e10a589f", "name": "network-vif-plugged", "status": "completed", "tag": "4c140de1-06ca-4846-ac17-c169fb67a422"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:34.075521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-25a78d83-2dc7-42f8-9702-2e997cc59a7e req-f271a460-e151-4697-b799-6d3527a7d880 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:34.076334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-25a78d83-2dc7-42f8-9702-2e997cc59a7e req-f271a460-e151-4697-b799-6d3527a7d880 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:34.090447 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-25a78d83-2dc7-42f8-9702-2e997cc59a7e req-f271a460-e151-4697-b799-6d3527a7d880 service nova] Creating event network-vif-plugged:4c140de1-06ca-4846-ac17-c169fb67a422 for instance 5cc276a6-db4e-4a03-b637-5c84e10a589f on nch2-master-1 May 28 21:29:34.096251 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-25a78d83-2dc7-42f8-9702-2e997cc59a7e req-f271a460-e151-4697-b799-6d3527a7d880 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044430 May 28 21:29:34.098016 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2675/5403] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:34.394238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-78028966-12c2-4931-9a75-27e2a8048268 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:34.410427 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-78028966-12c2-4931-9a75-27e2a8048268 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1470 microversion: 2.1 time: 0.374320 May 28 21:29:34.411611 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2729/5404] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:34 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1470 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:34.619251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-610174bd-5679-4c13-9edc-5571bbf07974 req-871e7b19-4d5b-4063-bb16-a82f387ef3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226cec1f-9523-4d1f-95cf-e2d994bd1f88", "name": "network-vif-deleted", "tag": "b98532fb-0692-4c80-9ec0-a5445175d125"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:34.627724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-610174bd-5679-4c13-9edc-5571bbf07974 req-871e7b19-4d5b-4063-bb16-a82f387ef3e1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:34.628118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-610174bd-5679-4c13-9edc-5571bbf07974 req-871e7b19-4d5b-4063-bb16-a82f387ef3e1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:34.644139 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-610174bd-5679-4c13-9edc-5571bbf07974 req-871e7b19-4d5b-4063-bb16-a82f387ef3e1 service nova] Creating event network-vif-deleted:b98532fb-0692-4c80-9ec0-a5445175d125 for instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 on nch2-master-1 May 28 21:29:34.649254 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-610174bd-5679-4c13-9edc-5571bbf07974 req-871e7b19-4d5b-4063-bb16-a82f387ef3e1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034942 May 28 21:29:34.649906 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2676/5405] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:34.713172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e70ac2e6-205b-45f1-9cd6-8da3c2974951 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:34.716921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e70ac2e6-205b-45f1-9cd6-8da3c2974951 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:34.720342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e70ac2e6-205b-45f1-9cd6-8da3c2974951 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:34.720820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e70ac2e6-205b-45f1-9cd6-8da3c2974951 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:34.722214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e70ac2e6-205b-45f1-9cd6-8da3c2974951 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:34.722675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e70ac2e6-205b-45f1-9cd6-8da3c2974951 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:34.928056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e70ac2e6-205b-45f1-9cd6-8da3c2974951 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:34.936602 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e70ac2e6-205b-45f1-9cd6-8da3c2974951 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1724 microversion: 2.1 time: 0.227283 May 28 21:29:34.937187 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2730/5406] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:34 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:35.022871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4943d562-0d67-4192-9c06-8519920d75f0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:35.024189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4943d562-0d67-4192-9c06-8519920d75f0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:35.031217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4943d562-0d67-4192-9c06-8519920d75f0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:35.031757 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4943d562-0d67-4192-9c06-8519920d75f0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:35.032629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4943d562-0d67-4192-9c06-8519920d75f0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:35.033064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4943d562-0d67-4192-9c06-8519920d75f0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:35.052026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6d049840-b5a6-45f6-8dc4-078bcb824f34 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:35.053030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6d049840-b5a6-45f6-8dc4-078bcb824f34 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:35.062226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d049840-b5a6-45f6-8dc4-078bcb824f34 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:35.063054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d049840-b5a6-45f6-8dc4-078bcb824f34 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:35.066991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d049840-b5a6-45f6-8dc4-078bcb824f34 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:35.067731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d049840-b5a6-45f6-8dc4-078bcb824f34 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:35.116330 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4943d562-0d67-4192-9c06-8519920d75f0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7/action" status: 200 len: 38687 microversion: 2.1 time: 0.097598 May 28 21:29:35.117403 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2677/5407] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:29:35 2022] POST /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7/action => generated 38687 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:29:35.123140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-62b41fc8-05c3-475f-bc23-2776be0c25b3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:35.123867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-62b41fc8-05c3-475f-bc23-2776be0c25b3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:35.132563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62b41fc8-05c3-475f-bc23-2776be0c25b3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:35.133025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62b41fc8-05c3-475f-bc23-2776be0c25b3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:35.133827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62b41fc8-05c3-475f-bc23-2776be0c25b3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:35.134307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62b41fc8-05c3-475f-bc23-2776be0c25b3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:35.180889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62b41fc8-05c3-475f-bc23-2776be0c25b3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:35.181751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62b41fc8-05c3-475f-bc23-2776be0c25b3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:35.182434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-62b41fc8-05c3-475f-bc23-2776be0c25b3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lazy-loading 'fault' on Instance uuid 226cec1f-9523-4d1f-95cf-e2d994bd1f88 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:29:35.240055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-62b41fc8-05c3-475f-bc23-2776be0c25b3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02d5fbb072814fd7923ecf12c7ecad7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54447ea481574a128f06c24315f34e46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:35.260305 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-62b41fc8-05c3-475f-bc23-2776be0c25b3 tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 200 len: 1329 microversion: 2.1 time: 0.139770 May 28 21:29:35.260305 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2678/5408] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:35 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 1329 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:35.267732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6d049840-b5a6-45f6-8dc4-078bcb824f34 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d2c184e2ad446cb0481b1421439771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f3ee8ccba4f4a891cac48aaa54d0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:35.280038 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6d049840-b5a6-45f6-8dc4-078bcb824f34 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 200 len: 1468 microversion: 2.1 time: 0.234535 May 28 21:29:35.280741 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2731/5409] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:35 2022] GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 1468 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:35.428195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ca7a0d9a-9910-4abb-9da7-1c412ad2106f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:35.428977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ca7a0d9a-9910-4abb-9da7-1c412ad2106f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:35.435720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca7a0d9a-9910-4abb-9da7-1c412ad2106f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:35.436179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca7a0d9a-9910-4abb-9da7-1c412ad2106f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:35.436973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca7a0d9a-9910-4abb-9da7-1c412ad2106f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:35.437423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca7a0d9a-9910-4abb-9da7-1c412ad2106f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:35.637130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ca7a0d9a-9910-4abb-9da7-1c412ad2106f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:35.645749 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ca7a0d9a-9910-4abb-9da7-1c412ad2106f tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1470 microversion: 2.1 time: 0.221697 May 28 21:29:35.646685 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2679/5410] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:35 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1470 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:35.954704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dde8f975-40ba-4fcc-b177-08d1ac9bfa66 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:35.955251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dde8f975-40ba-4fcc-b177-08d1ac9bfa66 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:35.962999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dde8f975-40ba-4fcc-b177-08d1ac9bfa66 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:35.963502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dde8f975-40ba-4fcc-b177-08d1ac9bfa66 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:35.964312 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dde8f975-40ba-4fcc-b177-08d1ac9bfa66 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:35.964757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dde8f975-40ba-4fcc-b177-08d1ac9bfa66 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:36.103648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dde8f975-40ba-4fcc-b177-08d1ac9bfa66 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:36.112585 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dde8f975-40ba-4fcc-b177-08d1ac9bfa66 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1724 microversion: 2.1 time: 0.161506 May 28 21:29:36.113267 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2732/5411] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:35 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:36.277017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fb549bc3-9e8d-427e-bf05-cb62bedd3e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:36.277673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fb549bc3-9e8d-427e-bf05-cb62bedd3e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] [instance: 226cec1f-9523-4d1f-95cf-e2d994bd1f88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:36.280252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:36.285108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb549bc3-9e8d-427e-bf05-cb62bedd3e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:36.285567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb549bc3-9e8d-427e-bf05-cb62bedd3e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:36.286373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb549bc3-9e8d-427e-bf05-cb62bedd3e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:36.286822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb549bc3-9e8d-427e-bf05-cb62bedd3e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:36.299110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7bf1cbf1-3e93-489f-83c6-fd7cc16c5dac tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:36.301243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7bf1cbf1-3e93-489f-83c6-fd7cc16c5dac tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:36.303413 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-fb549bc3-9e8d-427e-bf05-cb62bedd3e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] HTTP exception thrown: Instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 could not be found. May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fb549bc3-9e8d-427e-bf05-cb62bedd3e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Request method failure captured: May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 HTTP/1.1 May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpKIk2OUil0QsMGGU0iOO3mmhI8Jd7LtRGcnyhnlDDx4kYkNF5-ymhcXN7hllklCNhr1_lZt3ykjiY5Y0a-24J_DqF4BPVH5qPEZ4vCdPizqGadcaWtjxsjwyPO4ar3aAOGmADovrf4x3XhColp7kRYAiPONaPNMu2yATNBTY4OR6P4 May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 54447ea481574a128f06c24315f34e46 May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerActionsTestJSON-2133353695 May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_54447ea481574a128f06c24315f34e46", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54447ea481574a128f06c24315f34e46"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/54447ea481574a128f06c24315f34e46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/54447ea481574a128f06c24315f34e46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerActionsTestJSON-2133353695 May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 54447ea481574a128f06c24315f34e46 May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerActionsTestJSON-2133353695 May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerActionsTestJSON-2133353695-project May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 02d5fbb072814fd7923ecf12c7ecad7b May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerActionsTestJSON-2133353695-project May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 could not be found. May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '226cec1f-9523-4d1f-95cf-e2d994bd1f88'} May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 could not be found. May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 could not be found. May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:29:36.305371 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:29:36.314529 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:36.314529 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:29:36.314529 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:29:36.314529 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:29:36.314529 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:29:36.314529 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 could not be found. May 28 21:29:36.314529 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:29:36.314529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fb549bc3-9e8d-427e-bf05-cb62bedd3e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Returning 404 to user: Instance 226cec1f-9523-4d1f-95cf-e2d994bd1f88 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:29:36.314529 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fb549bc3-9e8d-427e-bf05-cb62bedd3e4c tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88" status: 404 len: 111 microversion: 2.1 time: 0.035920 May 28 21:29:36.314529 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2680/5412] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:36 2022] GET /compute/v2.1/servers/226cec1f-9523-4d1f-95cf-e2d994bd1f88 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:29:36.319916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-73979ecd-7db0-4c0e-971e-83d78b2ff39f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] Calling method '.version_select at 0x7f4d57871310>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:36.320747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bf1cbf1-3e93-489f-83c6-fd7cc16c5dac tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:36.321279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bf1cbf1-3e93-489f-83c6-fd7cc16c5dac tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:36.322184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bf1cbf1-3e93-489f-83c6-fd7cc16c5dac tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:36.322890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bf1cbf1-3e93-489f-83c6-fd7cc16c5dac tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:36.399800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7bf1cbf1-3e93-489f-83c6-fd7cc16c5dac tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38d2c184e2ad446cb0481b1421439771', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '071f3ee8ccba4f4a891cac48aaa54d0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:36.411198 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7bf1cbf1-3e93-489f-83c6-fd7cc16c5dac tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 200 len: 1426 microversion: 2.1 time: 0.117202 May 28 21:29:36.412011 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2733/5413] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:36 2022] GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 1426 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:29:36.416561 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-73979ecd-7db0-4c0e-971e-83d78b2ff39f tempest-ServerActionsTestJSON-2133353695 tempest-ServerActionsTestJSON-2133353695-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574782717" status: 202 len: 0 microversion: 2.1 time: 0.102829 May 28 21:29:36.417164 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2681/5414] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 21:29:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1574782717 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:29:36.665570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-893775d9-5a2d-4330-8f22-b1ae121e1411 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:36.666530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-893775d9-5a2d-4330-8f22-b1ae121e1411 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:36.677535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-893775d9-5a2d-4330-8f22-b1ae121e1411 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:36.678459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-893775d9-5a2d-4330-8f22-b1ae121e1411 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:36.679949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-893775d9-5a2d-4330-8f22-b1ae121e1411 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:36.680404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-893775d9-5a2d-4330-8f22-b1ae121e1411 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:36.694607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-5d963635-8716-4621-a0c3-e6a40e1851a3 req-b6f21037-fee3-4b60-bd33-f145749f4551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264103c5-0b85-46e8-bf9c-41b21fc70596", "name": "network-vif-deleted", "tag": "1080aa54-438b-4d5a-98b6-508ec021bb9a"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:36.733155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5d963635-8716-4621-a0c3-e6a40e1851a3 req-b6f21037-fee3-4b60-bd33-f145749f4551 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:36.733410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5d963635-8716-4621-a0c3-e6a40e1851a3 req-b6f21037-fee3-4b60-bd33-f145749f4551 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:36.770099 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-5d963635-8716-4621-a0c3-e6a40e1851a3 req-b6f21037-fee3-4b60-bd33-f145749f4551 service nova] Creating event network-vif-deleted:1080aa54-438b-4d5a-98b6-508ec021bb9a for instance 264103c5-0b85-46e8-bf9c-41b21fc70596 on nch1-master-1 May 28 21:29:36.788890 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-5d963635-8716-4621-a0c3-e6a40e1851a3 req-b6f21037-fee3-4b60-bd33-f145749f4551 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115187 May 28 21:29:36.789777 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2682/5415] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:36.999210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-893775d9-5a2d-4330-8f22-b1ae121e1411 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:37.015128 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-893775d9-5a2d-4330-8f22-b1ae121e1411 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1642 microversion: 2.1 time: 0.350280 May 28 21:29:37.018890 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2734/5416] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:36 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1642 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:37.033634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9cf6e265-726f-47ed-84e8-c16a12c75ac0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:37.041869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9cf6e265-726f-47ed-84e8-c16a12c75ac0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:37.043731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cf6e265-726f-47ed-84e8-c16a12c75ac0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:37.044449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cf6e265-726f-47ed-84e8-c16a12c75ac0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:37.051376 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-950a459f-9527-4dda-a88b-aa1e0a0f343f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:37.052008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-950a459f-9527-4dda-a88b-aa1e0a0f343f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:37.060473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cf6e265-726f-47ed-84e8-c16a12c75ac0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:37.060473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9cf6e265-726f-47ed-84e8-c16a12c75ac0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:37.063438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-950a459f-9527-4dda-a88b-aa1e0a0f343f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:37.066459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-950a459f-9527-4dda-a88b-aa1e0a0f343f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:37.067661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-950a459f-9527-4dda-a88b-aa1e0a0f343f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:37.068122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-950a459f-9527-4dda-a88b-aa1e0a0f343f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:37.112786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-950a459f-9527-4dda-a88b-aa1e0a0f343f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:29:37.121125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:37.311750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9cf6e265-726f-47ed-84e8-c16a12c75ac0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:37.317157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:37.325567 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9cf6e265-726f-47ed-84e8-c16a12c75ac0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1642 microversion: 2.1 time: 0.296181 May 28 21:29:37.327184 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2683/5417] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:37 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1642 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:37.334191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6da9c1d5-4122-4881-8c99-92bb9210bd68 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:37.335341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6da9c1d5-4122-4881-8c99-92bb9210bd68 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:37.345904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6da9c1d5-4122-4881-8c99-92bb9210bd68 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:37.346877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6da9c1d5-4122-4881-8c99-92bb9210bd68 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:37.347584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6da9c1d5-4122-4881-8c99-92bb9210bd68 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:37.348421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6da9c1d5-4122-4881-8c99-92bb9210bd68 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:37.500037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:37.600104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6da9c1d5-4122-4881-8c99-92bb9210bd68 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:37.612744 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6da9c1d5-4122-4881-8c99-92bb9210bd68 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1724 microversion: 2.1 time: 0.283700 May 28 21:29:37.616766 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2684/5418] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:37 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1724 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:37.626359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d62585b6-4b67-4b2a-ba03-a9e3dfac490e tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:37.630219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d62585b6-4b67-4b2a-ba03-a9e3dfac490e tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:37.631365 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-950a459f-9527-4dda-a88b-aa1e0a0f343f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 204 len: 0 microversion: 2.1 time: 0.583721 May 28 21:29:37.632310 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2735/5419] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:29:37 2022] DELETE /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:29:37.645158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-19ddbb5d-3662-40c1-8383-6ea805a6c678 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:37.645905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-19ddbb5d-3662-40c1-8383-6ea805a6c678 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] [instance: 264103c5-0b85-46e8-bf9c-41b21fc70596] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:37.647046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d62585b6-4b67-4b2a-ba03-a9e3dfac490e tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:37.647655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d62585b6-4b67-4b2a-ba03-a9e3dfac490e tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:37.648466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d62585b6-4b67-4b2a-ba03-a9e3dfac490e tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:37.649748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d62585b6-4b67-4b2a-ba03-a9e3dfac490e tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:37.655133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19ddbb5d-3662-40c1-8383-6ea805a6c678 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:37.655133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19ddbb5d-3662-40c1-8383-6ea805a6c678 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:37.655133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19ddbb5d-3662-40c1-8383-6ea805a6c678 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:37.656986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19ddbb5d-3662-40c1-8383-6ea805a6c678 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:37.673413 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-19ddbb5d-3662-40c1-8383-6ea805a6c678 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] HTTP exception thrown: Instance 264103c5-0b85-46e8-bf9c-41b21fc70596 could not be found. May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-19ddbb5d-3662-40c1-8383-6ea805a6c678 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Request method failure captured: May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 HTTP/1.1 May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpQXg3DpfCLJiQ81oox6VuiqJ7nRcs2pznukKD_8abFHQrv3-A_fIjVTteNml9tnaNrFHpdeftYR9WAp4myVpmIgvd-rBMXQZ1cXMqFB1hFvEkInXsSs_22CsMkvDMe3MpdQR19AzTnxfoWDNkteQ5V52KWPcyB_tAaQaIiSR6Qmc1U May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 071f3ee8ccba4f4a891cac48aaa54d0a May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-VolumesBackupsTest-1716294911 May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_071f3ee8ccba4f4a891cac48aaa54d0a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/071f3ee8ccba4f4a891cac48aaa54d0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/071f3ee8ccba4f4a891cac48aaa54d0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/071f3ee8ccba4f4a891cac48aaa54d0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-VolumesBackupsTest-1716294911 May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 071f3ee8ccba4f4a891cac48aaa54d0a May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-VolumesBackupsTest-1716294911 May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-VolumesBackupsTest-1716294911-project May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 38d2c184e2ad446cb0481b1421439771 May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-VolumesBackupsTest-1716294911-project May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 264103c5-0b85-46e8-bf9c-41b21fc70596 could not be found. May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '264103c5-0b85-46e8-bf9c-41b21fc70596'} May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 264103c5-0b85-46e8-bf9c-41b21fc70596 could not be found. May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 264103c5-0b85-46e8-bf9c-41b21fc70596 could not be found. May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:29:37.676767 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:37.683345 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:37.683345 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:29:37.683345 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:29:37.683345 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:29:37.683345 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:29:37.683345 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 264103c5-0b85-46e8-bf9c-41b21fc70596 could not be found. May 28 21:29:37.683345 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:29:37.683345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-19ddbb5d-3662-40c1-8383-6ea805a6c678 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] Returning 404 to user: Instance 264103c5-0b85-46e8-bf9c-41b21fc70596 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:29:37.683345 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-19ddbb5d-3662-40c1-8383-6ea805a6c678 tempest-VolumesBackupsTest-1716294911 tempest-VolumesBackupsTest-1716294911-project] 10.222.0.33 "GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596" status: 404 len: 111 microversion: 2.1 time: 0.046487 May 28 21:29:37.683345 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2736/5420] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:37 2022] GET /compute/v2.1/servers/264103c5-0b85-46e8-bf9c-41b21fc70596 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:29:37.689935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f77e6911-77a9-43b4-aa9a-bd81c597cac8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:37.691219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f77e6911-77a9-43b4-aa9a-bd81c597cac8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:37.700426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f77e6911-77a9-43b4-aa9a-bd81c597cac8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:37.701042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f77e6911-77a9-43b4-aa9a-bd81c597cac8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:37.702965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f77e6911-77a9-43b4-aa9a-bd81c597cac8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:37.705517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f77e6911-77a9-43b4-aa9a-bd81c597cac8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:38.115200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f77e6911-77a9-43b4-aa9a-bd81c597cac8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:38.130955 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f77e6911-77a9-43b4-aa9a-bd81c597cac8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1687 microversion: 2.1 time: 0.445805 May 28 21:29:38.141758 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2737/5421] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:37 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1687 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:38.583066 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d62585b6-4b67-4b2a-ba03-a9e3dfac490e tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1793 microversion: 2.1 time: 0.964933 May 28 21:29:38.584779 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2685/5422] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:37 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1793 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:38.632722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-00ed8641-a4d5-4c9c-a5bd-3ee58259009a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:38.633358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-00ed8641-a4d5-4c9c-a5bd-3ee58259009a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:38.647191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00ed8641-a4d5-4c9c-a5bd-3ee58259009a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:38.647191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00ed8641-a4d5-4c9c-a5bd-3ee58259009a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:38.647191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00ed8641-a4d5-4c9c-a5bd-3ee58259009a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:38.647191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00ed8641-a4d5-4c9c-a5bd-3ee58259009a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:38.825455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-8bb39a95-4254-409b-9ecf-9dc317ba3b4f req-f31e028d-f487-43e8-92a6-1e5f8a1aa0ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d24eed1-f65c-4cbe-a113-9e6c6165a0c7", "tag": "ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:38.839831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8bb39a95-4254-409b-9ecf-9dc317ba3b4f req-f31e028d-f487-43e8-92a6-1e5f8a1aa0ee service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:38.840266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8bb39a95-4254-409b-9ecf-9dc317ba3b4f req-f31e028d-f487-43e8-92a6-1e5f8a1aa0ee service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:38.880704 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-8bb39a95-4254-409b-9ecf-9dc317ba3b4f req-f31e028d-f487-43e8-92a6-1e5f8a1aa0ee service nova] Creating event network-changed:ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249 for instance 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 on nch1-master-1 May 28 21:29:38.899553 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-8bb39a95-4254-409b-9ecf-9dc317ba3b4f req-f31e028d-f487-43e8-92a6-1e5f8a1aa0ee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079594 May 28 21:29:38.918470 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2686/5423] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:39.092207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-00ed8641-a4d5-4c9c-a5bd-3ee58259009a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:39.101818 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-00ed8641-a4d5-4c9c-a5bd-3ee58259009a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1724 microversion: 2.1 time: 0.474027 May 28 21:29:39.115723 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2738/5424] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:38 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1724 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:39.152784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a84f6b2a-dc90-4b43-bd11-512a09fcc308 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:39.152784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a84f6b2a-dc90-4b43-bd11-512a09fcc308 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:39.161092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a84f6b2a-dc90-4b43-bd11-512a09fcc308 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:39.161926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a84f6b2a-dc90-4b43-bd11-512a09fcc308 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:39.163034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a84f6b2a-dc90-4b43-bd11-512a09fcc308 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:39.163905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a84f6b2a-dc90-4b43-bd11-512a09fcc308 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:39.302793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a84f6b2a-dc90-4b43-bd11-512a09fcc308 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:39.315798 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a84f6b2a-dc90-4b43-bd11-512a09fcc308 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 200 len: 1620 microversion: 2.1 time: 0.169347 May 28 21:29:39.316771 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2687/5425] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:39 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 1620 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:40.126412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c75b6b95-c853-4a3e-b2aa-36940b42e012 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:40.126412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c75b6b95-c853-4a3e-b2aa-36940b42e012 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:40.137323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c75b6b95-c853-4a3e-b2aa-36940b42e012 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:40.137791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c75b6b95-c853-4a3e-b2aa-36940b42e012 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:40.140089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c75b6b95-c853-4a3e-b2aa-36940b42e012 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:40.140563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c75b6b95-c853-4a3e-b2aa-36940b42e012 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:40.337438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-59a55db5-8001-4b20-98c8-68568606fe73 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:40.338130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-59a55db5-8001-4b20-98c8-68568606fe73 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:40.355980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59a55db5-8001-4b20-98c8-68568606fe73 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:40.356735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59a55db5-8001-4b20-98c8-68568606fe73 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:40.357575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59a55db5-8001-4b20-98c8-68568606fe73 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:40.367271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59a55db5-8001-4b20-98c8-68568606fe73 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:40.392941 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-59a55db5-8001-4b20-98c8-68568606fe73 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] HTTP exception thrown: Instance 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 could not be found. May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-59a55db5-8001-4b20-98c8-68568606fe73 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Request method failure captured: May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 HTTP/1.1 May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpKKy1DVesaj_dysVbGqpWcHx4cpHNtNqkxvMKKXBNqPepistzKKj5agiD8mz188E2_RFwo_f1as_TQInxyhgm3IcOuVM4c5upLUW3nrJ4MRI1Ng4P0UpvRwuZdeq2foyGDCzH24UQIOA6NcxtlTNzFgs85sIrFiF6Be00fINdCNhb0 May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: c3588eab36044e439158f876836ea514 May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-174864934 May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3588eab36044e439158f876836ea514", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3588eab36044e439158f876836ea514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3588eab36044e439158f876836ea514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3588eab36044e439158f876836ea514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestNetworkAdvancedServerOps-174864934 May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: c3588eab36044e439158f876836ea514 May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-174864934 May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestNetworkAdvancedServerOps-174864934-project May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f3468a0b2d324603ab6c3080993bc0c8 May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestNetworkAdvancedServerOps-174864934-project May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 could not be found. May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '8d24eed1-f65c-4cbe-a113-9e6c6165a0c7'} May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 could not be found. May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 could not be found. May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:29:40.398085 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:29:40.404050 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:29:40.404050 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:29:40.404050 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:29:40.404050 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:29:40.404050 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:29:40.404050 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 could not be found. May 28 21:29:40.404050 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:29:40.405911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-59a55db5-8001-4b20-98c8-68568606fe73 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Returning 404 to user: Instance 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:29:40.407635 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-59a55db5-8001-4b20-98c8-68568606fe73 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7" status: 404 len: 111 microversion: 2.1 time: 0.074017 May 28 21:29:40.412523 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2688/5426] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:40 2022] GET /compute/v2.1/servers/8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:29:40.689361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c75b6b95-c853-4a3e-b2aa-36940b42e012 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:40.714930 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c75b6b95-c853-4a3e-b2aa-36940b42e012 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1724 microversion: 2.1 time: 0.595398 May 28 21:29:40.720439 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2739/5427] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:40 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1724 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:40.928234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2ffa852c-53c2-4ae3-974f-b75b5c124f6e req-07d2ff8b-b35b-43a8-b76a-f24c3078d394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d24eed1-f65c-4cbe-a113-9e6c6165a0c7", "name": "network-vif-deleted", "tag": "ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:40.946858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2ffa852c-53c2-4ae3-974f-b75b5c124f6e req-07d2ff8b-b35b-43a8-b76a-f24c3078d394 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:40.949098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2ffa852c-53c2-4ae3-974f-b75b5c124f6e req-07d2ff8b-b35b-43a8-b76a-f24c3078d394 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:40.991787 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2ffa852c-53c2-4ae3-974f-b75b5c124f6e req-07d2ff8b-b35b-43a8-b76a-f24c3078d394 service nova] Creating event network-vif-deleted:ec6d2f1e-c01b-4d5a-b0d2-6026b9bde249 for instance 8d24eed1-f65c-4cbe-a113-9e6c6165a0c7 on nch1-master-1 May 28 21:29:41.007253 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2ffa852c-53c2-4ae3-974f-b75b5c124f6e req-07d2ff8b-b35b-43a8-b76a-f24c3078d394 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080399 May 28 21:29:41.009810 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2689/5428] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:41.738905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89b14fc9-6a23-4928-8130-296a9a93c035 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:41.740738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-89b14fc9-6a23-4928-8130-296a9a93c035 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:41.754056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89b14fc9-6a23-4928-8130-296a9a93c035 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:41.756971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89b14fc9-6a23-4928-8130-296a9a93c035 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:41.756971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89b14fc9-6a23-4928-8130-296a9a93c035 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:41.756971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89b14fc9-6a23-4928-8130-296a9a93c035 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:42.123089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-89b14fc9-6a23-4928-8130-296a9a93c035 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:42.137148 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-89b14fc9-6a23-4928-8130-296a9a93c035 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1701 microversion: 2.1 time: 0.403142 May 28 21:29:42.138512 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2740/5429] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:41 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1701 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:42.156179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-78261321-2079-4b7b-acdc-2efaa93d86f7 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:42.173780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78261321-2079-4b7b-acdc-2efaa93d86f7 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:42.175133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78261321-2079-4b7b-acdc-2efaa93d86f7 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:42.218019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-78261321-2079-4b7b-acdc-2efaa93d86f7 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Going to try to start instance {{(pid=143128) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 21:29:42.481144 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-78261321-2079-4b7b-acdc-2efaa93d86f7 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "POST /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/action" status: 202 len: 0 microversion: 2.1 time: 0.329978 May 28 21:29:42.484787 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2690/5430] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:29:42 2022] POST /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:29:42.492970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6b674f01-0596-47f5-8a60-9258306810e0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:42.494315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6b674f01-0596-47f5-8a60-9258306810e0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:42.510360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b674f01-0596-47f5-8a60-9258306810e0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:42.510360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b674f01-0596-47f5-8a60-9258306810e0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:42.510360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b674f01-0596-47f5-8a60-9258306810e0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:42.511219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6b674f01-0596-47f5-8a60-9258306810e0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:43.067790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6b674f01-0596-47f5-8a60-9258306810e0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:43.084512 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6b674f01-0596-47f5-8a60-9258306810e0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1710 microversion: 2.1 time: 0.598046 May 28 21:29:43.085150 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2741/5431] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:42 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1710 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:44.107497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-789dbe3e-f07e-4626-88f8-6ba6a9ff918d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:44.117693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-789dbe3e-f07e-4626-88f8-6ba6a9ff918d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:44.127724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-789dbe3e-f07e-4626-88f8-6ba6a9ff918d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:44.128448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-789dbe3e-f07e-4626-88f8-6ba6a9ff918d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:44.129570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-789dbe3e-f07e-4626-88f8-6ba6a9ff918d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:44.130376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-789dbe3e-f07e-4626-88f8-6ba6a9ff918d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:44.143269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-7e728481-7459-45ba-8bf9-a369292e1807 req-6b8ac9f4-8494-4083-be35-4fb09f54149d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cc276a6-db4e-4a03-b637-5c84e10a589f", "tag": "4c140de1-06ca-4846-ac17-c169fb67a422"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:44.169017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7e728481-7459-45ba-8bf9-a369292e1807 req-6b8ac9f4-8494-4083-be35-4fb09f54149d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:44.173681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7e728481-7459-45ba-8bf9-a369292e1807 req-6b8ac9f4-8494-4083-be35-4fb09f54149d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:44.201265 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-7e728481-7459-45ba-8bf9-a369292e1807 req-6b8ac9f4-8494-4083-be35-4fb09f54149d service nova] Creating event network-changed:4c140de1-06ca-4846-ac17-c169fb67a422 for instance 5cc276a6-db4e-4a03-b637-5c84e10a589f on nch2-master-1 May 28 21:29:44.212673 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-7e728481-7459-45ba-8bf9-a369292e1807 req-6b8ac9f4-8494-4083-be35-4fb09f54149d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074893 May 28 21:29:44.214307 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2742/5432] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:44.531502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-789dbe3e-f07e-4626-88f8-6ba6a9ff918d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:44.565402 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-789dbe3e-f07e-4626-88f8-6ba6a9ff918d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1710 microversion: 2.1 time: 0.462191 May 28 21:29:44.570843 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2691/5433] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:44 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1710 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:45.598688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cd431309-11a8-4fcb-abe7-df142e771d22 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:45.610561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cd431309-11a8-4fcb-abe7-df142e771d22 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:45.640261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd431309-11a8-4fcb-abe7-df142e771d22 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:45.643847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd431309-11a8-4fcb-abe7-df142e771d22 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:45.643847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd431309-11a8-4fcb-abe7-df142e771d22 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:45.643847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd431309-11a8-4fcb-abe7-df142e771d22 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:46.243967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cd431309-11a8-4fcb-abe7-df142e771d22 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:46.279795 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cd431309-11a8-4fcb-abe7-df142e771d22 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1714 microversion: 2.1 time: 0.693188 May 28 21:29:46.285225 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2743/5434] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:45 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1714 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:50.306551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2071f6c7-c629-4849-abe0-8332e4a2b03f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '.version_select at 0x7f4d56c19dc0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:50.495603 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2071f6c7-c629-4849-abe0-8332e4a2b03f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-187899813" status: 202 len: 0 microversion: 2.1 time: 0.195262 May 28 21:29:50.496121 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2692/5435] 10.222.0.33 () {58 vars in 1280 bytes} [Sat May 28 21:29:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-187899813 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:29:50.531342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-365907fc-0102-49e3-a027-9bea0a019a7d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'create', calling method: .version_select at 0x7f4d69cb1820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-218233991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOZ0OIUGP5mwndx0bzqVjQr1lhdLa2BIzhbP6NSviTlBt2rPW6cdsoKU7pbYGMU7hh6RNWzwScJM11d3QAwkQJJR5sbfY6SYGRRKDIqjqcOaXJTMG6w3zX1hBkRTHhQJwA=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:50.565462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-365907fc-0102-49e3-a027-9bea0a019a7d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for project c3588eab36044e439158f876836ea514. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:29:50.573661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-365907fc-0102-49e3-a027-9bea0a019a7d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for user f3468a0b2d324603ab6c3080993bc0c8 and project c3588eab36044e439158f876836ea514. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:29:50.722160 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-365907fc-0102-49e3-a027-9bea0a019a7d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.195381 May 28 21:29:50.727279 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2744/5436] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:29:50 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:29:54.093383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1492313442", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "6d23314a-36af-449b-b8a7-527d8ef2e13e"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:29:54.154790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] validate_networks() for [('6d23314a-36af-449b-b8a7-527d8ef2e13e', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:29:54.556968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:54.770256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:29:54.771376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:29:54.772240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:29:54.773103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:29:54.773750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:29:54.788841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:54.789493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:54.790342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:54.790790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:54.815823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Getting quotas for project 2ba32c313b5d4d728ceb5ebadab52c9c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:29:54.822725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Getting quotas for user 4c36e5d440be496693c66e5bbc1ef060 and project 2ba32c313b5d4d728ceb5ebadab52c9c. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:29:54.839159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:29:54.843059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:29:55.025066 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9e0c10a5-7f7c-4861-b268-8428dcc165cd tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160355 May 28 21:29:55.026297 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2693/5437] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:29:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:29:55.037622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-423ffddb-0923-4f17-a3a5-f6303a04dc93 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:55.038859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-423ffddb-0923-4f17-a3a5-f6303a04dc93 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:55.118205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-423ffddb-0923-4f17-a3a5-f6303a04dc93 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:55.132446 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-423ffddb-0923-4f17-a3a5-f6303a04dc93 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1217 microversion: 2.1 time: 0.099009 May 28 21:29:55.141572 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2745/5438] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:55 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:56.153219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e1a27f4a-ca76-440a-b791-cd2b65fd5c7c tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:56.154484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e1a27f4a-ca76-440a-b791-cd2b65fd5c7c tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:56.220100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e1a27f4a-ca76-440a-b791-cd2b65fd5c7c tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:56.230868 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e1a27f4a-ca76-440a-b791-cd2b65fd5c7c tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1217 microversion: 2.1 time: 0.082275 May 28 21:29:56.241128 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2694/5439] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:56 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:57.267624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ac7acff1-3157-4ce7-baa1-7dc5d18f07a2 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:57.269027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ac7acff1-3157-4ce7-baa1-7dc5d18f07a2 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:57.278006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:29:57.280468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac7acff1-3157-4ce7-baa1-7dc5d18f07a2 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:57.281239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac7acff1-3157-4ce7-baa1-7dc5d18f07a2 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:57.282397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac7acff1-3157-4ce7-baa1-7dc5d18f07a2 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:57.283141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac7acff1-3157-4ce7-baa1-7dc5d18f07a2 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:57.511754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ac7acff1-3157-4ce7-baa1-7dc5d18f07a2 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:57.528312 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ac7acff1-3157-4ce7-baa1-7dc5d18f07a2 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1213 microversion: 2.1 time: 0.281787 May 28 21:29:57.531305 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2746/5440] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:57 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1213 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:58.547774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-07596494-76fa-4a67-a363-9ec7b500a5f1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:58.549858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-07596494-76fa-4a67-a363-9ec7b500a5f1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:58.559715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07596494-76fa-4a67-a363-9ec7b500a5f1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:58.560422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07596494-76fa-4a67-a363-9ec7b500a5f1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:58.561314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07596494-76fa-4a67-a363-9ec7b500a5f1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:58.561848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07596494-76fa-4a67-a363-9ec7b500a5f1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:58.643814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-07596494-76fa-4a67-a363-9ec7b500a5f1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:58.651905 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-07596494-76fa-4a67-a363-9ec7b500a5f1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1275 microversion: 2.1 time: 0.108822 May 28 21:29:58.656388 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2695/5441] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:58 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1275 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:29:59.671741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d572e0db-c314-4e3a-94b6-c51b9f6e3815 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:29:59.672907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d572e0db-c314-4e3a-94b6-c51b9f6e3815 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:29:59.683712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d572e0db-c314-4e3a-94b6-c51b9f6e3815 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:59.684177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d572e0db-c314-4e3a-94b6-c51b9f6e3815 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:59.684977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d572e0db-c314-4e3a-94b6-c51b9f6e3815 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:29:59.685429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d572e0db-c314-4e3a-94b6-c51b9f6e3815 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:29:59.791873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d572e0db-c314-4e3a-94b6-c51b9f6e3815 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:29:59.812293 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d572e0db-c314-4e3a-94b6-c51b9f6e3815 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1275 microversion: 2.1 time: 0.146190 May 28 21:29:59.815790 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2747/5442] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:29:59 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1275 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:00.832746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f0d919a8-aa1b-438a-b032-27a3b99fc32f tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:00.833672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f0d919a8-aa1b-438a-b032-27a3b99fc32f tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:00.851356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0d919a8-aa1b-438a-b032-27a3b99fc32f tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:00.852434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0d919a8-aa1b-438a-b032-27a3b99fc32f tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:00.855850 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0d919a8-aa1b-438a-b032-27a3b99fc32f tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:00.855850 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0d919a8-aa1b-438a-b032-27a3b99fc32f tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:01.384988 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f0d919a8-aa1b-438a-b032-27a3b99fc32f tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:01.403628 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f0d919a8-aa1b-438a-b032-27a3b99fc32f tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1317 microversion: 2.1 time: 0.575262 May 28 21:30:01.413951 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2696/5443] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:00 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:02.425291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-95cf2dfb-7fc5-4e28-ae04-7d3eb7a3373e tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:02.426623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-95cf2dfb-7fc5-4e28-ae04-7d3eb7a3373e tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:02.447636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95cf2dfb-7fc5-4e28-ae04-7d3eb7a3373e tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:02.448425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95cf2dfb-7fc5-4e28-ae04-7d3eb7a3373e tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:02.451245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95cf2dfb-7fc5-4e28-ae04-7d3eb7a3373e tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:02.470235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95cf2dfb-7fc5-4e28-ae04-7d3eb7a3373e tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:02.857939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-95cf2dfb-7fc5-4e28-ae04-7d3eb7a3373e tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:02.877923 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-95cf2dfb-7fc5-4e28-ae04-7d3eb7a3373e tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1317 microversion: 2.1 time: 0.450296 May 28 21:30:02.879305 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2748/5444] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:02 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:02.965681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-92792204-29ef-450c-bbc9-71fc69c58474 req-901cbfc3-915b-45d9-900f-79d09b8f1f1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31f37915-7049-4d5d-9acf-d2fdaeb996ff", "tag": "a1a5ae95-8e29-4b9e-8330-57b23bee2a78"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:02.990108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-92792204-29ef-450c-bbc9-71fc69c58474 req-901cbfc3-915b-45d9-900f-79d09b8f1f1d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:02.991230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-92792204-29ef-450c-bbc9-71fc69c58474 req-901cbfc3-915b-45d9-900f-79d09b8f1f1d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:03.077664 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-92792204-29ef-450c-bbc9-71fc69c58474 req-901cbfc3-915b-45d9-900f-79d09b8f1f1d service nova] Creating event network-changed:a1a5ae95-8e29-4b9e-8330-57b23bee2a78 for instance 31f37915-7049-4d5d-9acf-d2fdaeb996ff on nch1-master-1 May 28 21:30:03.092904 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-92792204-29ef-450c-bbc9-71fc69c58474 req-901cbfc3-915b-45d9-900f-79d09b8f1f1d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137047 May 28 21:30:03.094697 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2697/5445] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:30:03.896774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f659b5c1-8a08-4efa-bb18-42a40749131d tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:03.898635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f659b5c1-8a08-4efa-bb18-42a40749131d tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:03.919480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f659b5c1-8a08-4efa-bb18-42a40749131d tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:03.924233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f659b5c1-8a08-4efa-bb18-42a40749131d tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:03.930221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f659b5c1-8a08-4efa-bb18-42a40749131d tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:03.930997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f659b5c1-8a08-4efa-bb18-42a40749131d tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:04.448136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f659b5c1-8a08-4efa-bb18-42a40749131d tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:04.465706 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f659b5c1-8a08-4efa-bb18-42a40749131d tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1317 microversion: 2.1 time: 0.574148 May 28 21:30:04.468916 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2749/5446] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:03 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:05.282804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-988802010", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "46804eff-203e-443e-9a96-978a8b49a93a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-218233991", "security_groups": [{"name": "tempest-secgroup-smoke-287547440"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:05.297877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:05.419085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] validate_networks() for [('46804eff-203e-443e-9a96-978a8b49a93a', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:30:05.484232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4f49bc06-0ec3-4aca-8863-7f69616bef65 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:05.484929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4f49bc06-0ec3-4aca-8863-7f69616bef65 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:05.488623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:05.495936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f49bc06-0ec3-4aca-8863-7f69616bef65 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:05.496588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f49bc06-0ec3-4aca-8863-7f69616bef65 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:05.498348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f49bc06-0ec3-4aca-8863-7f69616bef65 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:05.498984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f49bc06-0ec3-4aca-8863-7f69616bef65 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:05.894488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4f49bc06-0ec3-4aca-8863-7f69616bef65 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:05.909228 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4f49bc06-0ec3-4aca-8863-7f69616bef65 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1317 microversion: 2.1 time: 0.428018 May 28 21:30:05.910524 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2750/5447] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:05 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:06.229986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:06.398527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:30:06.399861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:30:06.400544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:30:06.401157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:30:06.401768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:30:06.412934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:06.413649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:06.414855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:06.415524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:06.437324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for project c3588eab36044e439158f876836ea514. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:30:06.444324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Getting quotas for user f3468a0b2d324603ab6c3080993bc0c8 and project c3588eab36044e439158f876836ea514. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:30:06.463737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:30:06.467156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:30:06.622934 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-14754c19-7fc8-4916-ba58-e14e3cd6ef89 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.344434 May 28 21:30:06.624319 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2698/5448] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:30:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:30:06.640909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dcbaca08-a5fa-4686-b481-b095ab26e191 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:06.640909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dcbaca08-a5fa-4686-b481-b095ab26e191 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:06.783398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dcbaca08-a5fa-4686-b481-b095ab26e191 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:06.792302 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dcbaca08-a5fa-4686-b481-b095ab26e191 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1265 microversion: 2.1 time: 0.161313 May 28 21:30:06.792911 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2751/5449] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:06 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:06.928916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f7e67bc0-8882-4e88-8283-6013251c54a1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:06.929549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f7e67bc0-8882-4e88-8283-6013251c54a1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:06.945062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7e67bc0-8882-4e88-8283-6013251c54a1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:06.946531 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7e67bc0-8882-4e88-8283-6013251c54a1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:06.947348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7e67bc0-8882-4e88-8283-6013251c54a1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:06.947943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7e67bc0-8882-4e88-8283-6013251c54a1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:07.129990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f7e67bc0-8882-4e88-8283-6013251c54a1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:07.139430 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f7e67bc0-8882-4e88-8283-6013251c54a1 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1317 microversion: 2.1 time: 0.216564 May 28 21:30:07.149925 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2699/5450] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:06 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:07.810230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8cde7e76-65ed-43ce-8940-2eb114ebdc01 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:07.813867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8cde7e76-65ed-43ce-8940-2eb114ebdc01 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:07.942156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8cde7e76-65ed-43ce-8940-2eb114ebdc01 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:07.973602 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8cde7e76-65ed-43ce-8940-2eb114ebdc01 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1265 microversion: 2.1 time: 0.167125 May 28 21:30:07.974493 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2752/5451] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:07 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:08.156102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd22586b-8598-4a38-9f01-d742a5b97ba5 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:08.156829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bd22586b-8598-4a38-9f01-d742a5b97ba5 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:08.163001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:08.169032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd22586b-8598-4a38-9f01-d742a5b97ba5 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:08.170042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd22586b-8598-4a38-9f01-d742a5b97ba5 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:08.184119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd22586b-8598-4a38-9f01-d742a5b97ba5 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:08.184868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd22586b-8598-4a38-9f01-d742a5b97ba5 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:08.468715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bd22586b-8598-4a38-9f01-d742a5b97ba5 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:08.481128 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bd22586b-8598-4a38-9f01-d742a5b97ba5 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1317 microversion: 2.1 time: 0.327353 May 28 21:30:08.492730 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2700/5452] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:08 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1317 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:08.998370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-911bf5df-d9ed-452d-8ae6-ca6353fad70f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:09.003394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-911bf5df-d9ed-452d-8ae6-ca6353fad70f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:09.015193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-911bf5df-d9ed-452d-8ae6-ca6353fad70f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:09.016979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-911bf5df-d9ed-452d-8ae6-ca6353fad70f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:09.018635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-911bf5df-d9ed-452d-8ae6-ca6353fad70f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:09.019390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-911bf5df-d9ed-452d-8ae6-ca6353fad70f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:09.038233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-b51ee559-f724-4fc7-bf90-5e30f278eaac req-45f228d7-eccd-4e0a-8d03-d707879c3498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f37915-7049-4d5d-9acf-d2fdaeb996ff", "name": "network-vif-plugged", "status": "completed", "tag": "a1a5ae95-8e29-4b9e-8330-57b23bee2a78"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:09.073270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b51ee559-f724-4fc7-bf90-5e30f278eaac req-45f228d7-eccd-4e0a-8d03-d707879c3498 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:09.073775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b51ee559-f724-4fc7-bf90-5e30f278eaac req-45f228d7-eccd-4e0a-8d03-d707879c3498 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:09.115706 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-b51ee559-f724-4fc7-bf90-5e30f278eaac req-45f228d7-eccd-4e0a-8d03-d707879c3498 service nova] Creating event network-vif-plugged:a1a5ae95-8e29-4b9e-8330-57b23bee2a78 for instance 31f37915-7049-4d5d-9acf-d2fdaeb996ff on nch1-master-1 May 28 21:30:09.123794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-911bf5df-d9ed-452d-8ae6-ca6353fad70f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:09.144016 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-b51ee559-f724-4fc7-bf90-5e30f278eaac req-45f228d7-eccd-4e0a-8d03-d707879c3498 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100927 May 28 21:30:09.144855 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-911bf5df-d9ed-452d-8ae6-ca6353fad70f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1317 microversion: 2.1 time: 0.157090 May 28 21:30:09.147472 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2753/5453] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:08 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:09.147769 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2701/5454] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:30:09.500351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-de2f623d-7abd-491e-bf9f-1f9b1449f787 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:09.500979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-de2f623d-7abd-491e-bf9f-1f9b1449f787 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:09.512892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de2f623d-7abd-491e-bf9f-1f9b1449f787 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:09.518187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de2f623d-7abd-491e-bf9f-1f9b1449f787 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:09.519505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de2f623d-7abd-491e-bf9f-1f9b1449f787 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:09.524896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de2f623d-7abd-491e-bf9f-1f9b1449f787 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:10.127539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-de2f623d-7abd-491e-bf9f-1f9b1449f787 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:10.140174 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-de2f623d-7abd-491e-bf9f-1f9b1449f787 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1317 microversion: 2.1 time: 0.644575 May 28 21:30:10.141033 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2754/5455] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:09 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1317 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:10.182436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-63cf7b5c-b610-445a-87f7-5015ee67e88c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:10.182436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-63cf7b5c-b610-445a-87f7-5015ee67e88c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:10.182436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63cf7b5c-b610-445a-87f7-5015ee67e88c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:10.182436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63cf7b5c-b610-445a-87f7-5015ee67e88c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:10.182436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63cf7b5c-b610-445a-87f7-5015ee67e88c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:10.182436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63cf7b5c-b610-445a-87f7-5015ee67e88c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:10.250894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-63cf7b5c-b610-445a-87f7-5015ee67e88c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:10.258743 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-63cf7b5c-b610-445a-87f7-5015ee67e88c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1323 microversion: 2.1 time: 0.098109 May 28 21:30:10.259503 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2702/5456] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:10 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1323 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:11.159458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9ec43ca2-5386-4136-81c9-d0e8030e8daa tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:11.160179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9ec43ca2-5386-4136-81c9-d0e8030e8daa tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:11.164040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:11.168032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ec43ca2-5386-4136-81c9-d0e8030e8daa tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:11.168560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ec43ca2-5386-4136-81c9-d0e8030e8daa tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:11.169415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ec43ca2-5386-4136-81c9-d0e8030e8daa tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:11.169954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ec43ca2-5386-4136-81c9-d0e8030e8daa tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:11.276175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-15c9e22f-4826-4d03-8109-6ba996f8584c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:11.276797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-15c9e22f-4826-4d03-8109-6ba996f8584c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:11.290800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15c9e22f-4826-4d03-8109-6ba996f8584c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:11.291275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15c9e22f-4826-4d03-8109-6ba996f8584c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:11.292076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15c9e22f-4826-4d03-8109-6ba996f8584c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:11.292619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15c9e22f-4826-4d03-8109-6ba996f8584c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:11.506921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9ec43ca2-5386-4136-81c9-d0e8030e8daa tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:11.535278 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9ec43ca2-5386-4136-81c9-d0e8030e8daa tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1505 microversion: 2.1 time: 0.379885 May 28 21:30:11.536605 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2755/5457] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:11 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:11.586719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3ece47b1-004e-4338-b983-be669a3abe1c tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:11.593978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3ece47b1-004e-4338-b983-be669a3abe1c tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:11.614317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ece47b1-004e-4338-b983-be669a3abe1c tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:11.617253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ece47b1-004e-4338-b983-be669a3abe1c tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:11.620682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ece47b1-004e-4338-b983-be669a3abe1c tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:11.621306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ece47b1-004e-4338-b983-be669a3abe1c tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:11.634277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-15c9e22f-4826-4d03-8109-6ba996f8584c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:11.654234 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-15c9e22f-4826-4d03-8109-6ba996f8584c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1390 microversion: 2.1 time: 0.379420 May 28 21:30:11.675918 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2703/5458] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:11 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1390 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:30:11.688196 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3ece47b1-004e-4338-b983-be669a3abe1c tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff/ips" status: 200 len: 108 microversion: 2.1 time: 0.115340 May 28 21:30:11.689493 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2756/5459] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 21:30:11 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff/ips => generated 108 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:30:11.703421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-89f9b9b5-ead7-4b1d-8c76-22917508dc5b tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:11.704272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-89f9b9b5-ead7-4b1d-8c76-22917508dc5b tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:11.711357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89f9b9b5-ead7-4b1d-8c76-22917508dc5b tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:11.712418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89f9b9b5-ead7-4b1d-8c76-22917508dc5b tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:11.713425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89f9b9b5-ead7-4b1d-8c76-22917508dc5b tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:11.714111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-89f9b9b5-ead7-4b1d-8c76-22917508dc5b tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:11.750314 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-89f9b9b5-ead7-4b1d-8c76-22917508dc5b tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff/ips" status: 200 len: 108 microversion: 2.1 time: 0.053137 May 28 21:30:11.756441 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2704/5460] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 21:30:11 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff/ips => generated 108 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:30:11.766492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-93fc9b9e-ebc6-42d2-bae9-26854ecadddf tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:11.767393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-93fc9b9e-ebc6-42d2-bae9-26854ecadddf tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:11.776569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93fc9b9e-ebc6-42d2-bae9-26854ecadddf tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:11.777866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93fc9b9e-ebc6-42d2-bae9-26854ecadddf tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:11.778924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93fc9b9e-ebc6-42d2-bae9-26854ecadddf tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:11.779716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93fc9b9e-ebc6-42d2-bae9-26854ecadddf tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:11.828398 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-93fc9b9e-ebc6-42d2-bae9-26854ecadddf tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff/ips/tempest-ServerAddressesTestJSON-968631584-network" status: 200 len: 93 microversion: 2.1 time: 0.065677 May 28 21:30:11.829506 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2757/5461] 10.222.0.33 () {58 vars in 1397 bytes} [Sat May 28 21:30:11 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff/ips/tempest-ServerAddressesTestJSON-968631584-network => generated 93 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:30:11.841140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-01a8caa8-3c34-47de-bcdf-d3d0b8f09c00 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:11.842246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-01a8caa8-3c34-47de-bcdf-d3d0b8f09c00 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:11.851818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01a8caa8-3c34-47de-bcdf-d3d0b8f09c00 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:11.853551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01a8caa8-3c34-47de-bcdf-d3d0b8f09c00 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:11.854584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01a8caa8-3c34-47de-bcdf-d3d0b8f09c00 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:11.855219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-01a8caa8-3c34-47de-bcdf-d3d0b8f09c00 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:11.894247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-01a8caa8-3c34-47de-bcdf-d3d0b8f09c00 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:30:12.425587 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-01a8caa8-3c34-47de-bcdf-d3d0b8f09c00 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "DELETE /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 204 len: 0 microversion: 2.1 time: 0.587864 May 28 21:30:12.426930 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2705/5462] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:30:11 2022] DELETE /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:30:12.436077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-10a2e4f7-8cb6-4ec2-9018-f39db0e7fb94 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:12.439022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-10a2e4f7-8cb6-4ec2-9018-f39db0e7fb94 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:12.448967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10a2e4f7-8cb6-4ec2-9018-f39db0e7fb94 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:12.452313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10a2e4f7-8cb6-4ec2-9018-f39db0e7fb94 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:12.453511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10a2e4f7-8cb6-4ec2-9018-f39db0e7fb94 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:12.454055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10a2e4f7-8cb6-4ec2-9018-f39db0e7fb94 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:12.552926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-ac063d5f-b5ef-4a31-a0fe-17cef74528fd req-2d476eeb-e3e5-4553-8396-f509b917b615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a04681-51df-4f74-af55-3f8f4e1b8a71", "tag": "88ddc193-6f03-4717-b54b-d87010254589"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:12.563085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ac063d5f-b5ef-4a31-a0fe-17cef74528fd req-2d476eeb-e3e5-4553-8396-f509b917b615 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:12.563539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ac063d5f-b5ef-4a31-a0fe-17cef74528fd req-2d476eeb-e3e5-4553-8396-f509b917b615 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:12.585210 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-ac063d5f-b5ef-4a31-a0fe-17cef74528fd req-2d476eeb-e3e5-4553-8396-f509b917b615 service nova] Creating event network-changed:88ddc193-6f03-4717-b54b-d87010254589 for instance 37a04681-51df-4f74-af55-3f8f4e1b8a71 on nch2-master-1 May 28 21:30:12.595687 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-ac063d5f-b5ef-4a31-a0fe-17cef74528fd req-2d476eeb-e3e5-4553-8396-f509b917b615 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047057 May 28 21:30:12.601652 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2706/5463] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:30:12.675106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9ece3d4d-2fd5-409a-8563-a5e6a8bd9e4f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:12.675874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9ece3d4d-2fd5-409a-8563-a5e6a8bd9e4f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:12.682749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ece3d4d-2fd5-409a-8563-a5e6a8bd9e4f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:12.683464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ece3d4d-2fd5-409a-8563-a5e6a8bd9e4f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:12.684576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ece3d4d-2fd5-409a-8563-a5e6a8bd9e4f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:12.685172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ece3d4d-2fd5-409a-8563-a5e6a8bd9e4f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:13.068515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-10a2e4f7-8cb6-4ec2-9018-f39db0e7fb94 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:13.077458 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-10a2e4f7-8cb6-4ec2-9018-f39db0e7fb94 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1511 microversion: 2.1 time: 0.646355 May 28 21:30:13.079791 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2758/5464] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:12 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1511 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:13.204641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9ece3d4d-2fd5-409a-8563-a5e6a8bd9e4f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:13.215538 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9ece3d4d-2fd5-409a-8563-a5e6a8bd9e4f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1390 microversion: 2.1 time: 0.544503 May 28 21:30:13.237707 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2707/5465] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:12 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1390 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:30:14.096779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-61a539cb-43ad-4ab3-a425-a4ad2170085a tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:14.098090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-61a539cb-43ad-4ab3-a425-a4ad2170085a tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:14.105897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61a539cb-43ad-4ab3-a425-a4ad2170085a tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:14.106753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61a539cb-43ad-4ab3-a425-a4ad2170085a tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:14.107715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61a539cb-43ad-4ab3-a425-a4ad2170085a tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:14.108530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61a539cb-43ad-4ab3-a425-a4ad2170085a tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:14.233337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d65c8ecf-69f1-46b7-8193-7cc0bd68769a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:14.235068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d65c8ecf-69f1-46b7-8193-7cc0bd68769a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:14.244490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d65c8ecf-69f1-46b7-8193-7cc0bd68769a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:14.244957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d65c8ecf-69f1-46b7-8193-7cc0bd68769a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:14.245994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d65c8ecf-69f1-46b7-8193-7cc0bd68769a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:14.246459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d65c8ecf-69f1-46b7-8193-7cc0bd68769a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:14.469911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-61a539cb-43ad-4ab3-a425-a4ad2170085a tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:14.477551 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-61a539cb-43ad-4ab3-a425-a4ad2170085a tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1511 microversion: 2.1 time: 0.385724 May 28 21:30:14.478427 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2759/5466] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:14 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1511 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:14.616402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d65c8ecf-69f1-46b7-8193-7cc0bd68769a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:14.625544 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d65c8ecf-69f1-46b7-8193-7cc0bd68769a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1390 microversion: 2.1 time: 0.396585 May 28 21:30:14.636502 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2708/5467] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:14 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1390 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:14.917147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-8a7b65e6-03c5-4531-a435-7c83d38c2860 req-2e04e0b3-1ceb-4a25-8358-0dcf5919393d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31f37915-7049-4d5d-9acf-d2fdaeb996ff", "name": "network-vif-deleted", "tag": "a1a5ae95-8e29-4b9e-8330-57b23bee2a78"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:14.926791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8a7b65e6-03c5-4531-a435-7c83d38c2860 req-2e04e0b3-1ceb-4a25-8358-0dcf5919393d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:14.927747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-8a7b65e6-03c5-4531-a435-7c83d38c2860 req-2e04e0b3-1ceb-4a25-8358-0dcf5919393d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:14.946893 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-8a7b65e6-03c5-4531-a435-7c83d38c2860 req-2e04e0b3-1ceb-4a25-8358-0dcf5919393d service nova] Creating event network-vif-deleted:a1a5ae95-8e29-4b9e-8330-57b23bee2a78 for instance 31f37915-7049-4d5d-9acf-d2fdaeb996ff on nch1-master-1 May 28 21:30:14.952974 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-8a7b65e6-03c5-4531-a435-7c83d38c2860 req-2e04e0b3-1ceb-4a25-8358-0dcf5919393d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039935 May 28 21:30:14.953977 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2760/5468] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:30:15.495539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-36200977-e949-40d9-b261-5ffb6a02f7af tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:15.496177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-36200977-e949-40d9-b261-5ffb6a02f7af tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:15.503506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36200977-e949-40d9-b261-5ffb6a02f7af tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:15.504313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36200977-e949-40d9-b261-5ffb6a02f7af tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:15.505256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36200977-e949-40d9-b261-5ffb6a02f7af tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:15.505704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36200977-e949-40d9-b261-5ffb6a02f7af tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:15.546978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36200977-e949-40d9-b261-5ffb6a02f7af tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:15.547679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36200977-e949-40d9-b261-5ffb6a02f7af tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:15.548361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-36200977-e949-40d9-b261-5ffb6a02f7af tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lazy-loading 'fault' on Instance uuid 31f37915-7049-4d5d-9acf-d2fdaeb996ff {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:30:15.628178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-36200977-e949-40d9-b261-5ffb6a02f7af tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c36e5d440be496693c66e5bbc1ef060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ba32c313b5d4d728ceb5ebadab52c9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:15.636299 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-36200977-e949-40d9-b261-5ffb6a02f7af tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 200 len: 1307 microversion: 2.1 time: 0.144588 May 28 21:30:15.647020 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2709/5469] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:15 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 1307 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:15.653716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f18a28e2-6f3f-44fc-a66a-1b60b1445f6e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:15.655357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f18a28e2-6f3f-44fc-a66a-1b60b1445f6e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:15.662620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f18a28e2-6f3f-44fc-a66a-1b60b1445f6e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:15.663423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f18a28e2-6f3f-44fc-a66a-1b60b1445f6e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:15.664350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f18a28e2-6f3f-44fc-a66a-1b60b1445f6e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:15.665078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f18a28e2-6f3f-44fc-a66a-1b60b1445f6e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:15.853095 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f18a28e2-6f3f-44fc-a66a-1b60b1445f6e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:15.863109 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f18a28e2-6f3f-44fc-a66a-1b60b1445f6e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1390 microversion: 2.1 time: 0.223817 May 28 21:30:15.864252 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2761/5470] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:15 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1390 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:16.657481 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f4a55141-e821-4942-b072-0a292b447a63 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:16.659437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f4a55141-e821-4942-b072-0a292b447a63 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] [instance: 31f37915-7049-4d5d-9acf-d2fdaeb996ff] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:16.661747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:16.663685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:16.674495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f4a55141-e821-4942-b072-0a292b447a63 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:16.675219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f4a55141-e821-4942-b072-0a292b447a63 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:16.676655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f4a55141-e821-4942-b072-0a292b447a63 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:16.677305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f4a55141-e821-4942-b072-0a292b447a63 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:16.697094 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-f4a55141-e821-4942-b072-0a292b447a63 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] HTTP exception thrown: Instance 31f37915-7049-4d5d-9acf-d2fdaeb996ff could not be found. May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f4a55141-e821-4942-b072-0a292b447a63 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Request method failure captured: May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff HTTP/1.1 May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpRR03VJpCbTmYfmVjVC6KqW-CfDLNLWRjeVWwVuYmFRY3SjW8nUlrDpbipK9c6a0vqhQTg3w5iUYPohdf_Vk419p8sEjUP_CZmDtxNccCGL8NTZXs3mslbCfGF82m2i9ufQWFnzDOw86U-GT5w1df-ccX3J8wdhOKUM47NifU1NMoA May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 2ba32c313b5d4d728ceb5ebadab52c9c May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerAddressesTestJSON-1683630589 May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_2ba32c313b5d4d728ceb5ebadab52c9c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ba32c313b5d4d728ceb5ebadab52c9c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/2ba32c313b5d4d728ceb5ebadab52c9c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/2ba32c313b5d4d728ceb5ebadab52c9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerAddressesTestJSON-1683630589 May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 2ba32c313b5d4d728ceb5ebadab52c9c May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1683630589 May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerAddressesTestJSON-1683630589-project May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 4c36e5d440be496693c66e5bbc1ef060 May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerAddressesTestJSON-1683630589-project May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 31f37915-7049-4d5d-9acf-d2fdaeb996ff could not be found. May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '31f37915-7049-4d5d-9acf-d2fdaeb996ff'} May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31f37915-7049-4d5d-9acf-d2fdaeb996ff could not be found. May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31f37915-7049-4d5d-9acf-d2fdaeb996ff could not be found. May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:30:16.699400 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:16.702790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:16.702790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:30:16.702790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:30:16.702790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:30:16.702790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:30:16.702790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31f37915-7049-4d5d-9acf-d2fdaeb996ff could not be found. May 28 21:30:16.702790 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:16.705252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f4a55141-e821-4942-b072-0a292b447a63 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] Returning 404 to user: Instance 31f37915-7049-4d5d-9acf-d2fdaeb996ff could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:30:16.706394 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f4a55141-e821-4942-b072-0a292b447a63 tempest-ServerAddressesTestJSON-1683630589 tempest-ServerAddressesTestJSON-1683630589-project] 10.222.0.33 "GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff" status: 404 len: 111 microversion: 2.1 time: 0.053534 May 28 21:30:16.716081 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2710/5471] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:16 2022] GET /compute/v2.1/servers/31f37915-7049-4d5d-9acf-d2fdaeb996ff => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:30:16.882755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6ca1466e-5f43-4588-9575-1cc282c0c44e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:16.883376 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6ca1466e-5f43-4588-9575-1cc282c0c44e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:16.890708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ca1466e-5f43-4588-9575-1cc282c0c44e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:16.891434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ca1466e-5f43-4588-9575-1cc282c0c44e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:16.892272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ca1466e-5f43-4588-9575-1cc282c0c44e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:16.892733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6ca1466e-5f43-4588-9575-1cc282c0c44e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:17.280166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6ca1466e-5f43-4588-9575-1cc282c0c44e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:17.290213 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6ca1466e-5f43-4588-9575-1cc282c0c44e tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1390 microversion: 2.1 time: 0.413640 May 28 21:30:17.300087 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2762/5472] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:16 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1390 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:18.310600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9f0530a6-811e-4a50-8a86-9a360225dca5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:18.311208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9f0530a6-811e-4a50-8a86-9a360225dca5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:18.327002 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f0530a6-811e-4a50-8a86-9a360225dca5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:18.334640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f0530a6-811e-4a50-8a86-9a360225dca5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:18.335650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f0530a6-811e-4a50-8a86-9a360225dca5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:18.336246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f0530a6-811e-4a50-8a86-9a360225dca5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:18.768760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9f0530a6-811e-4a50-8a86-9a360225dca5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:18.776898 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9f0530a6-811e-4a50-8a86-9a360225dca5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1390 microversion: 2.1 time: 0.470130 May 28 21:30:18.777463 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2711/5473] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:18 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1390 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:19.081299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9ba7c57b-3c78-4114-afdb-a3c424e8f5dc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:19.082726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9ba7c57b-3c78-4114-afdb-a3c424e8f5dc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:19.102593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:19.105505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ba7c57b-3c78-4114-afdb-a3c424e8f5dc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:19.106233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ba7c57b-3c78-4114-afdb-a3c424e8f5dc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:19.107538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ba7c57b-3c78-4114-afdb-a3c424e8f5dc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:19.108353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9ba7c57b-3c78-4114-afdb-a3c424e8f5dc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:19.261021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-9ba7c57b-3c78-4114-afdb-a3c424e8f5dc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lazy-loading 'services' on Instance uuid 3733dc91-2f81-4efc-a391-73a96ee6ee44 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:30:19.746219 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9ba7c57b-3c78-4114-afdb-a3c424e8f5dc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/os-volume_attachments/ed95b6dd-f6d9-4cde-a354-d6ae7327ae42" status: 202 len: 0 microversion: 2.1 time: 0.668186 May 28 21:30:19.747475 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2763/5474] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:30:19 2022] DELETE /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/os-volume_attachments/ed95b6dd-f6d9-4cde-a354-d6ae7327ae42 => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:30:19.797131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-46f04962-dc64-460d-aab9-414689ba563f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:19.797953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-46f04962-dc64-460d-aab9-414689ba563f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:19.817816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46f04962-dc64-460d-aab9-414689ba563f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:19.820153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46f04962-dc64-460d-aab9-414689ba563f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:19.821169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46f04962-dc64-460d-aab9-414689ba563f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:19.821829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46f04962-dc64-460d-aab9-414689ba563f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:20.195046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-46f04962-dc64-460d-aab9-414689ba563f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:20.209669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:20.256380 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-46f04962-dc64-460d-aab9-414689ba563f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1390 microversion: 2.1 time: 0.465006 May 28 21:30:20.257828 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2712/5475] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:19 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1390 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:20.876166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-5ae81e2c-69e9-4dd2-9e44-68d57c11db50 req-bd912aaf-3e1b-44dc-a6a4-a460129e1ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a04681-51df-4f74-af55-3f8f4e1b8a71", "name": "network-vif-plugged", "status": "completed", "tag": "88ddc193-6f03-4717-b54b-d87010254589"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:20.912147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5ae81e2c-69e9-4dd2-9e44-68d57c11db50 req-bd912aaf-3e1b-44dc-a6a4-a460129e1ffe service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:20.913446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5ae81e2c-69e9-4dd2-9e44-68d57c11db50 req-bd912aaf-3e1b-44dc-a6a4-a460129e1ffe service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:20.969196 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-5ae81e2c-69e9-4dd2-9e44-68d57c11db50 req-bd912aaf-3e1b-44dc-a6a4-a460129e1ffe service nova] Creating event network-vif-plugged:88ddc193-6f03-4717-b54b-d87010254589 for instance 37a04681-51df-4f74-af55-3f8f4e1b8a71 on nch2-master-1 May 28 21:30:20.975380 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-5ae81e2c-69e9-4dd2-9e44-68d57c11db50 req-bd912aaf-3e1b-44dc-a6a4-a460129e1ffe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105251 May 28 21:30:20.976862 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2764/5476] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:30:21.002133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bbe5df57-2db9-4530-9978-d5b718a40894 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:21.015955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbe5df57-2db9-4530-9978-d5b718a40894 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:21.019804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbe5df57-2db9-4530-9978-d5b718a40894 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:21.087508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bbe5df57-2db9-4530-9978-d5b718a40894 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Going to try to stop instance {{(pid=143128) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 21:30:21.279877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-95fc3dea-c1e0-4255-898e-bca32b82a2bb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:21.283547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-95fc3dea-c1e0-4255-898e-bca32b82a2bb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:21.292173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95fc3dea-c1e0-4255-898e-bca32b82a2bb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:21.292634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95fc3dea-c1e0-4255-898e-bca32b82a2bb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:21.293418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95fc3dea-c1e0-4255-898e-bca32b82a2bb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:21.293919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95fc3dea-c1e0-4255-898e-bca32b82a2bb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:21.414266 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bbe5df57-2db9-4530-9978-d5b718a40894 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "POST /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/action" status: 202 len: 0 microversion: 2.1 time: 0.418959 May 28 21:30:21.415133 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2713/5477] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:30:20 2022] POST /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:30:21.425113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-415129ae-d5bf-49e7-a7b1-8f5d4b5b628d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:21.426201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-415129ae-d5bf-49e7-a7b1-8f5d4b5b628d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:21.440936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-415129ae-d5bf-49e7-a7b1-8f5d4b5b628d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:21.441754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-415129ae-d5bf-49e7-a7b1-8f5d4b5b628d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:21.443318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-415129ae-d5bf-49e7-a7b1-8f5d4b5b628d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:21.443915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-415129ae-d5bf-49e7-a7b1-8f5d4b5b628d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:21.839641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-95fc3dea-c1e0-4255-898e-bca32b82a2bb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:21.846130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:21.851946 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-95fc3dea-c1e0-4255-898e-bca32b82a2bb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1390 microversion: 2.1 time: 0.576333 May 28 21:30:21.852543 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2765/5478] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:21 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1390 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:21.891790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-415129ae-d5bf-49e7-a7b1-8f5d4b5b628d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:21.903267 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-415129ae-d5bf-49e7-a7b1-8f5d4b5b628d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1678 microversion: 2.1 time: 0.483119 May 28 21:30:21.904536 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2714/5479] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:21 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1678 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:30:22.882763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6269fe1a-ae4f-4bcb-83e2-bec129c51afb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:22.882763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6269fe1a-ae4f-4bcb-83e2-bec129c51afb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:22.892752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6269fe1a-ae4f-4bcb-83e2-bec129c51afb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:22.893515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6269fe1a-ae4f-4bcb-83e2-bec129c51afb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:22.894435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6269fe1a-ae4f-4bcb-83e2-bec129c51afb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:22.894989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6269fe1a-ae4f-4bcb-83e2-bec129c51afb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:22.921891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-37e50555-b74d-4640-87b6-6cf0747ff1ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:22.928401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-37e50555-b74d-4640-87b6-6cf0747ff1ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:22.942241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37e50555-b74d-4640-87b6-6cf0747ff1ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:22.949109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37e50555-b74d-4640-87b6-6cf0747ff1ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:22.961381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37e50555-b74d-4640-87b6-6cf0747ff1ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:22.962819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-37e50555-b74d-4640-87b6-6cf0747ff1ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:23.539172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6269fe1a-ae4f-4bcb-83e2-bec129c51afb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:23.549275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-37e50555-b74d-4640-87b6-6cf0747ff1ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:23.550360 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6269fe1a-ae4f-4bcb-83e2-bec129c51afb tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1390 microversion: 2.1 time: 0.684494 May 28 21:30:23.557628 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-37e50555-b74d-4640-87b6-6cf0747ff1ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1678 microversion: 2.1 time: 0.639699 May 28 21:30:23.558449 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2715/5480] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:22 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1678 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:30:23.563263 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2766/5481] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:22 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1390 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:23.993215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1159610389", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "65dc20c6-ee0c-418b-acb9-71e837ee80fc"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1282774370", "security_groups": []}, "os:scheduler_hints": {"different_host": ["5cc276a6-db4e-4a03-b637-5c84e10a589f"]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:24.068004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] validate_networks() for [('65dc20c6-ee0c-418b-acb9-71e837ee80fc', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:30:24.570251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-41642c9b-a9a3-4782-bb07-2d892aa38af2 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:24.571147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-41642c9b-a9a3-4782-bb07-2d892aa38af2 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:24.587422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41642c9b-a9a3-4782-bb07-2d892aa38af2 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:24.591365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41642c9b-a9a3-4782-bb07-2d892aa38af2 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:24.594428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41642c9b-a9a3-4782-bb07-2d892aa38af2 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:24.597274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41642c9b-a9a3-4782-bb07-2d892aa38af2 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:24.674227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:30:24.676219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:30:24.676961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:30:24.677540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:30:24.678191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:30:24.701482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:24.709817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:24.711501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:24.711979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:24.789642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Getting quotas for project 97cf01c13fa745a3bd04e35a0ce27088. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:30:24.809998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Getting quotas for user 642d08e104394dd28e6b4b502f5bc8cf and project 97cf01c13fa745a3bd04e35a0ce27088. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:30:24.843346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:30:24.845814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:30:24.850980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-41642c9b-a9a3-4782-bb07-2d892aa38af2 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:24.862603 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-41642c9b-a9a3-4782-bb07-2d892aa38af2 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1563 microversion: 2.1 time: 0.296917 May 28 21:30:24.874223 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2767/5482] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:24 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1563 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:24.874223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-af549563-1b99-43d9-8de0-8b6aaee3c8ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:24.874223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-af549563-1b99-43d9-8de0-8b6aaee3c8ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:24.887458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af549563-1b99-43d9-8de0-8b6aaee3c8ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:24.888178 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af549563-1b99-43d9-8de0-8b6aaee3c8ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:24.889172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af549563-1b99-43d9-8de0-8b6aaee3c8ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:24.889868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af549563-1b99-43d9-8de0-8b6aaee3c8ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:25.026453 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8ce3273c-0f5d-47d0-8f05-903df9dc8832 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.039749 May 28 21:30:25.029005 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2716/5483] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:30:23 2022] POST /compute/v2.1/servers => generated 361 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:30:25.037956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a5a717f6-d01e-4491-9a49-71ea2825f6b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:25.038889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a5a717f6-d01e-4491-9a49-71ea2825f6b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:25.054634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5a717f6-d01e-4491-9a49-71ea2825f6b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:25.055781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5a717f6-d01e-4491-9a49-71ea2825f6b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:25.074904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5a717f6-d01e-4491-9a49-71ea2825f6b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:25.079280 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5a717f6-d01e-4491-9a49-71ea2825f6b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:25.182019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-af549563-1b99-43d9-8de0-8b6aaee3c8ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:25.201912 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-af549563-1b99-43d9-8de0-8b6aaee3c8ea tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1678 microversion: 2.1 time: 0.335799 May 28 21:30:25.202757 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2768/5484] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:24 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1678 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:25.209219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-afb8111c-27bd-4af4-b3bc-b0825a74a856 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:25.210120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-afb8111c-27bd-4af4-b3bc-b0825a74a856 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:25.334055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-afb8111c-27bd-4af4-b3bc-b0825a74a856 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:25.357397 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-afb8111c-27bd-4af4-b3bc-b0825a74a856 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1242 microversion: 2.1 time: 0.146630 May 28 21:30:25.358646 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2769/5485] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:25 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1242 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:25.430077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a5a717f6-d01e-4491-9a49-71ea2825f6b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:25.443372 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a5a717f6-d01e-4491-9a49-71ea2825f6b8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1563 microversion: 2.1 time: 0.411570 May 28 21:30:25.444086 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2717/5486] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:25 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1563 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:25.666842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-954482055", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "9d9cbcf0-5554-4bcb-81c4-ca52a60c3a70"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:25.670200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] validate_networks() for [('9d9cbcf0-5554-4bcb-81c4-ca52a60c3a70', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:30:26.220522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4d1a68ec-5351-4cea-a863-85cd87fa8097 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:26.224276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4d1a68ec-5351-4cea-a863-85cd87fa8097 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:26.234622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d1a68ec-5351-4cea-a863-85cd87fa8097 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:26.235092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d1a68ec-5351-4cea-a863-85cd87fa8097 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:26.235930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d1a68ec-5351-4cea-a863-85cd87fa8097 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:26.236463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4d1a68ec-5351-4cea-a863-85cd87fa8097 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:26.683290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4d1a68ec-5351-4cea-a863-85cd87fa8097 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:26.703819 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4d1a68ec-5351-4cea-a863-85cd87fa8097 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1678 microversion: 2.1 time: 0.487039 May 28 21:30:26.705773 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2718/5487] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:26 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1678 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:26.712472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2214ad6e-2d93-449b-9b1a-f0a32c41793b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:26.714237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2214ad6e-2d93-449b-9b1a-f0a32c41793b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:26.723874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2214ad6e-2d93-449b-9b1a-f0a32c41793b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:26.724584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2214ad6e-2d93-449b-9b1a-f0a32c41793b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:26.725876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2214ad6e-2d93-449b-9b1a-f0a32c41793b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:26.726569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2214ad6e-2d93-449b-9b1a-f0a32c41793b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:26.759510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:30:26.764435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:30:26.764435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:30:26.764435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:30:26.764435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:30:26.775249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:26.775891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:26.777093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:26.777557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:26.799196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Getting quotas for project 239c9c3debdd456ab6e9c0545ab47fe2. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:30:26.811590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Getting quotas for user 5b4a37f2a8ec4160bc4db12c0d3e7de5 and project 239c9c3debdd456ab6e9c0545ab47fe2. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:30:26.835173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2214ad6e-2d93-449b-9b1a-f0a32c41793b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:26.851894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:30:26.852656 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2214ad6e-2d93-449b-9b1a-f0a32c41793b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1246 microversion: 2.1 time: 0.145150 May 28 21:30:26.854862 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2719/5488] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:26 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1246 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:26.856905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:30:27.049283 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-366141ef-f097-4d0c-8042-af7e8ca3e7f6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.686159 May 28 21:30:27.051929 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2770/5489] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:30:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:30:27.077502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0b35b47b-0e45-49bc-a7be-d0be2c1e28dc tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:27.078394 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0b35b47b-0e45-49bc-a7be-d0be2c1e28dc tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:27.383919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0b35b47b-0e45-49bc-a7be-d0be2c1e28dc tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:27.390510 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0b35b47b-0e45-49bc-a7be-d0be2c1e28dc tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1224 microversion: 2.1 time: 0.324534 May 28 21:30:27.400720 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2720/5490] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:27 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1224 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:27.723569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1a70271b-cd8b-4f4a-bbef-05b14d20a8d7 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:27.724260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1a70271b-cd8b-4f4a-bbef-05b14d20a8d7 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:27.731727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a70271b-cd8b-4f4a-bbef-05b14d20a8d7 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:27.732148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a70271b-cd8b-4f4a-bbef-05b14d20a8d7 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:27.732942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a70271b-cd8b-4f4a-bbef-05b14d20a8d7 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:27.733387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a70271b-cd8b-4f4a-bbef-05b14d20a8d7 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:27.880906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-be35cde9-91c8-4812-a46b-8ebed53ec32c tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:27.881665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-be35cde9-91c8-4812-a46b-8ebed53ec32c tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:27.915161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-be35cde9-91c8-4812-a46b-8ebed53ec32c tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:27.917326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-be35cde9-91c8-4812-a46b-8ebed53ec32c tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:27.917515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-be35cde9-91c8-4812-a46b-8ebed53ec32c tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:27.919870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-be35cde9-91c8-4812-a46b-8ebed53ec32c tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:27.986126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1a70271b-cd8b-4f4a-bbef-05b14d20a8d7 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:27.998718 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1a70271b-cd8b-4f4a-bbef-05b14d20a8d7 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1678 microversion: 2.1 time: 0.280582 May 28 21:30:28.000821 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2771/5491] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:27 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1678 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:30:28.105824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-be35cde9-91c8-4812-a46b-8ebed53ec32c tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:28.119101 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-be35cde9-91c8-4812-a46b-8ebed53ec32c tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1294 microversion: 2.1 time: 0.252401 May 28 21:30:28.124150 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2721/5492] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:27 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1294 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:30:28.409447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2798fc2c-b390-49c7-a888-32951824c964 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:28.413152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2798fc2c-b390-49c7-a888-32951824c964 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:28.556608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2798fc2c-b390-49c7-a888-32951824c964 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:28.565186 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2798fc2c-b390-49c7-a888-32951824c964 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1224 microversion: 2.1 time: 0.159738 May 28 21:30:28.566349 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2772/5493] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:28 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1224 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:29.017655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-73af4a23-fde1-4ea1-89ee-ddb7739f78a0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:29.020053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-73af4a23-fde1-4ea1-89ee-ddb7739f78a0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:29.030926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-73af4a23-fde1-4ea1-89ee-ddb7739f78a0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:29.032949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-73af4a23-fde1-4ea1-89ee-ddb7739f78a0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:29.033203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-73af4a23-fde1-4ea1-89ee-ddb7739f78a0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:29.035378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-73af4a23-fde1-4ea1-89ee-ddb7739f78a0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:29.145086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cd671d7c-409d-4b78-87e4-f88edfc0b0d7 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:29.148969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cd671d7c-409d-4b78-87e4-f88edfc0b0d7 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:29.161564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd671d7c-409d-4b78-87e4-f88edfc0b0d7 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:29.162372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd671d7c-409d-4b78-87e4-f88edfc0b0d7 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:29.163569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd671d7c-409d-4b78-87e4-f88edfc0b0d7 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:29.164237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd671d7c-409d-4b78-87e4-f88edfc0b0d7 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:29.360382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cd671d7c-409d-4b78-87e4-f88edfc0b0d7 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:29.369624 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cd671d7c-409d-4b78-87e4-f88edfc0b0d7 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1300 microversion: 2.1 time: 0.232841 May 28 21:30:29.370196 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2773/5494] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:29 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1300 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:29.459194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-73af4a23-fde1-4ea1-89ee-ddb7739f78a0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:29.470772 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-73af4a23-fde1-4ea1-89ee-ddb7739f78a0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1678 microversion: 2.1 time: 0.458748 May 28 21:30:29.471899 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2722/5495] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:29 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1678 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:29.586875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-19205a79-57b1-4fc7-be46-de30e54fbb12 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:29.588100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-19205a79-57b1-4fc7-be46-de30e54fbb12 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:29.601270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19205a79-57b1-4fc7-be46-de30e54fbb12 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:29.603015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19205a79-57b1-4fc7-be46-de30e54fbb12 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:29.616231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19205a79-57b1-4fc7-be46-de30e54fbb12 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:29.620085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19205a79-57b1-4fc7-be46-de30e54fbb12 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:29.638172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4b82cb36-40a5-44e6-bb78-4d80b7686a72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:29.638780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4b82cb36-40a5-44e6-bb78-4d80b7686a72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:29.649365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b82cb36-40a5-44e6-bb78-4d80b7686a72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:29.655127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b82cb36-40a5-44e6-bb78-4d80b7686a72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:29.655127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b82cb36-40a5-44e6-bb78-4d80b7686a72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:29.655127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4b82cb36-40a5-44e6-bb78-4d80b7686a72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:29.713266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-19205a79-57b1-4fc7-be46-de30e54fbb12 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:29.726755 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-19205a79-57b1-4fc7-be46-de30e54fbb12 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1276 microversion: 2.1 time: 0.145913 May 28 21:30:29.728784 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2774/5496] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:29 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:29.734327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-a229b792-16e6-4245-916a-432544474763 req-f94e82bb-bb80-4e69-9d85-84a7a6a42322 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a04681-51df-4f74-af55-3f8f4e1b8a71", "tag": "88ddc193-6f03-4717-b54b-d87010254589"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:29.754180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a229b792-16e6-4245-916a-432544474763 req-f94e82bb-bb80-4e69-9d85-84a7a6a42322 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:29.754180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a229b792-16e6-4245-916a-432544474763 req-f94e82bb-bb80-4e69-9d85-84a7a6a42322 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:29.761008 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a229b792-16e6-4245-916a-432544474763 req-f94e82bb-bb80-4e69-9d85-84a7a6a42322 service nova] Creating event network-changed:88ddc193-6f03-4717-b54b-d87010254589 for instance 37a04681-51df-4f74-af55-3f8f4e1b8a71 on nch2-master-1 May 28 21:30:29.772896 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-a229b792-16e6-4245-916a-432544474763 req-f94e82bb-bb80-4e69-9d85-84a7a6a42322 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042395 May 28 21:30:29.773525 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2775/5497] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:30:29.899459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4b82cb36-40a5-44e6-bb78-4d80b7686a72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:29.911408 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4b82cb36-40a5-44e6-bb78-4d80b7686a72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1563 microversion: 2.1 time: 0.277016 May 28 21:30:29.912264 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2723/5498] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:29 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1563 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:30:30.389120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8de5e2cd-7878-47fd-9031-7f96ce27945b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:30.390578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8de5e2cd-7878-47fd-9031-7f96ce27945b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:30.403773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8de5e2cd-7878-47fd-9031-7f96ce27945b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:30.404367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8de5e2cd-7878-47fd-9031-7f96ce27945b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:30.405372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8de5e2cd-7878-47fd-9031-7f96ce27945b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:30.406086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8de5e2cd-7878-47fd-9031-7f96ce27945b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:30.487895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-75815dde-e522-4a8f-8862-40e78d3c9a3c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:30.489217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-75815dde-e522-4a8f-8862-40e78d3c9a3c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:30.496413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75815dde-e522-4a8f-8862-40e78d3c9a3c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:30.496868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75815dde-e522-4a8f-8862-40e78d3c9a3c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:30.497644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75815dde-e522-4a8f-8862-40e78d3c9a3c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:30.498106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-75815dde-e522-4a8f-8862-40e78d3c9a3c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:30.697563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8de5e2cd-7878-47fd-9031-7f96ce27945b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:30.717079 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8de5e2cd-7878-47fd-9031-7f96ce27945b tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1300 microversion: 2.1 time: 0.332643 May 28 21:30:30.718378 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2776/5499] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:30 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1300 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:30.745622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-61bc586a-c87a-4d3d-808f-65286bd3d0c6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:30.746737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-61bc586a-c87a-4d3d-808f-65286bd3d0c6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:30.755835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61bc586a-c87a-4d3d-808f-65286bd3d0c6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:30.756572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61bc586a-c87a-4d3d-808f-65286bd3d0c6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:30.757670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61bc586a-c87a-4d3d-808f-65286bd3d0c6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:30.758353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61bc586a-c87a-4d3d-808f-65286bd3d0c6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:30.886984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-61bc586a-c87a-4d3d-808f-65286bd3d0c6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:30.897591 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-61bc586a-c87a-4d3d-808f-65286bd3d0c6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1294 microversion: 2.1 time: 0.156512 May 28 21:30:30.899289 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2777/5500] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:30 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1294 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:30:30.964975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-75815dde-e522-4a8f-8862-40e78d3c9a3c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:30.975056 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-75815dde-e522-4a8f-8862-40e78d3c9a3c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1678 microversion: 2.1 time: 0.491300 May 28 21:30:30.975925 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2724/5501] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:30 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1678 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:30:31.191743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-1c46a502-b32c-4122-9aa8-82541804b8e1 req-3528f2be-7df4-4ae7-9db3-0d082b5153c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a50f0bb-6ffb-4f35-944a-df60190c6d3f", "tag": "04dce3f3-a646-4093-813a-3c444e90c0bf"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:31.207826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1c46a502-b32c-4122-9aa8-82541804b8e1 req-3528f2be-7df4-4ae7-9db3-0d082b5153c8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:31.208340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1c46a502-b32c-4122-9aa8-82541804b8e1 req-3528f2be-7df4-4ae7-9db3-0d082b5153c8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:31.225906 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-1c46a502-b32c-4122-9aa8-82541804b8e1 req-3528f2be-7df4-4ae7-9db3-0d082b5153c8 service nova] Creating event network-changed:04dce3f3-a646-4093-813a-3c444e90c0bf for instance 2a50f0bb-6ffb-4f35-944a-df60190c6d3f on nch1-master-1 May 28 21:30:31.230945 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-1c46a502-b32c-4122-9aa8-82541804b8e1 req-3528f2be-7df4-4ae7-9db3-0d082b5153c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044665 May 28 21:30:31.232361 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2778/5502] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:30:31.738034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-40b15ebd-39f3-4b5d-b170-cbf3c47c6389 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:31.738773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-40b15ebd-39f3-4b5d-b170-cbf3c47c6389 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:31.768889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40b15ebd-39f3-4b5d-b170-cbf3c47c6389 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:31.769353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40b15ebd-39f3-4b5d-b170-cbf3c47c6389 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:31.770175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40b15ebd-39f3-4b5d-b170-cbf3c47c6389 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:31.770621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40b15ebd-39f3-4b5d-b170-cbf3c47c6389 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:31.886247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-40b15ebd-39f3-4b5d-b170-cbf3c47c6389 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:31.900767 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-40b15ebd-39f3-4b5d-b170-cbf3c47c6389 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1300 microversion: 2.1 time: 0.169173 May 28 21:30:31.903007 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2725/5503] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:31 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1300 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:31.920195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-29dcfbc5-8d5f-418b-8b38-feabf96a58b0 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:31.921417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-29dcfbc5-8d5f-418b-8b38-feabf96a58b0 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:31.929641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29dcfbc5-8d5f-418b-8b38-feabf96a58b0 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:31.935299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29dcfbc5-8d5f-418b-8b38-feabf96a58b0 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:31.935299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29dcfbc5-8d5f-418b-8b38-feabf96a58b0 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:31.935299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29dcfbc5-8d5f-418b-8b38-feabf96a58b0 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:31.993095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c99eaa3b-7729-4cbc-a54c-d8a28afb6cc9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:31.993806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c99eaa3b-7729-4cbc-a54c-d8a28afb6cc9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:32.002082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c99eaa3b-7729-4cbc-a54c-d8a28afb6cc9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:32.002547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c99eaa3b-7729-4cbc-a54c-d8a28afb6cc9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:32.003348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c99eaa3b-7729-4cbc-a54c-d8a28afb6cc9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:32.003957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c99eaa3b-7729-4cbc-a54c-d8a28afb6cc9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:32.265409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-29dcfbc5-8d5f-418b-8b38-feabf96a58b0 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:32.274395 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-29dcfbc5-8d5f-418b-8b38-feabf96a58b0 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1324 microversion: 2.1 time: 0.361579 May 28 21:30:32.275205 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2779/5504] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:31 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1324 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:32.289950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c99eaa3b-7729-4cbc-a54c-d8a28afb6cc9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:32.299474 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c99eaa3b-7729-4cbc-a54c-d8a28afb6cc9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1655 microversion: 2.1 time: 0.310262 May 28 21:30:32.301387 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2726/5505] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:31 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1655 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:30:32.320982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-14a5461f-01fc-4e3f-a21c-414e66784359 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:32.335608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-14a5461f-01fc-4e3f-a21c-414e66784359 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:32.335608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-14a5461f-01fc-4e3f-a21c-414e66784359 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:32.360743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-14a5461f-01fc-4e3f-a21c-414e66784359 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Going to try to start instance {{(pid=143129) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 21:30:32.580997 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-14a5461f-01fc-4e3f-a21c-414e66784359 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "POST /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/action" status: 202 len: 0 microversion: 2.1 time: 0.268309 May 28 21:30:32.581722 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2780/5506] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:30:32 2022] POST /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:30:32.590441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ba652045-4e2b-49ed-a231-8bafdd310ae9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:32.591242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ba652045-4e2b-49ed-a231-8bafdd310ae9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:32.599297 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba652045-4e2b-49ed-a231-8bafdd310ae9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:32.599754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba652045-4e2b-49ed-a231-8bafdd310ae9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:32.600547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba652045-4e2b-49ed-a231-8bafdd310ae9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:32.600990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba652045-4e2b-49ed-a231-8bafdd310ae9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:32.744177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ba652045-4e2b-49ed-a231-8bafdd310ae9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:32.754312 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ba652045-4e2b-49ed-a231-8bafdd310ae9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1664 microversion: 2.1 time: 0.167698 May 28 21:30:32.761581 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2727/5507] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:32 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:32.921380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cbeb115f-a583-49b3-bfba-fa6c6a6d8165 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:32.922124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cbeb115f-a583-49b3-bfba-fa6c6a6d8165 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:32.930080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cbeb115f-a583-49b3-bfba-fa6c6a6d8165 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:32.930542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cbeb115f-a583-49b3-bfba-fa6c6a6d8165 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:32.931359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cbeb115f-a583-49b3-bfba-fa6c6a6d8165 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:32.931815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cbeb115f-a583-49b3-bfba-fa6c6a6d8165 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:33.117522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cbeb115f-a583-49b3-bfba-fa6c6a6d8165 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:33.125547 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cbeb115f-a583-49b3-bfba-fa6c6a6d8165 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1300 microversion: 2.1 time: 0.208593 May 28 21:30:33.126374 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2781/5508] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:32 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1300 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:33.293697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5b0229b8-4764-44cb-aa22-d497cc698d0f tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:33.294374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5b0229b8-4764-44cb-aa22-d497cc698d0f tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:33.303258 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b0229b8-4764-44cb-aa22-d497cc698d0f tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:33.303414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b0229b8-4764-44cb-aa22-d497cc698d0f tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:33.304265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b0229b8-4764-44cb-aa22-d497cc698d0f tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:33.304911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b0229b8-4764-44cb-aa22-d497cc698d0f tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:33.482881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-a58efcd4-d5dd-47f3-b3d7-6c5021f21fb6 req-71d5d711-2e4c-413a-99ea-08b34aef3b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba6556ed-1498-4ed8-b88c-2304dde93e41", "tag": "44b30383-a358-4d04-98f6-0ab9284b8c8b"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:33.492321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a58efcd4-d5dd-47f3-b3d7-6c5021f21fb6 req-71d5d711-2e4c-413a-99ea-08b34aef3b06 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:33.492780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a58efcd4-d5dd-47f3-b3d7-6c5021f21fb6 req-71d5d711-2e4c-413a-99ea-08b34aef3b06 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:33.508641 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a58efcd4-d5dd-47f3-b3d7-6c5021f21fb6 req-71d5d711-2e4c-413a-99ea-08b34aef3b06 service nova] Creating event network-changed:44b30383-a358-4d04-98f6-0ab9284b8c8b for instance ba6556ed-1498-4ed8-b88c-2304dde93e41 on nch1-master-1 May 28 21:30:33.513774 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-a58efcd4-d5dd-47f3-b3d7-6c5021f21fb6 req-71d5d711-2e4c-413a-99ea-08b34aef3b06 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035336 May 28 21:30:33.514756 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2782/5509] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:30:33.684288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5b0229b8-4764-44cb-aa22-d497cc698d0f tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:33.693891 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5b0229b8-4764-44cb-aa22-d497cc698d0f tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1324 microversion: 2.1 time: 0.405128 May 28 21:30:33.694772 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2728/5510] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:33 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:33.772584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8865bf58-7d8e-4cd6-8bcb-254c4a35e6dd tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:33.773295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8865bf58-7d8e-4cd6-8bcb-254c4a35e6dd tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:33.779812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8865bf58-7d8e-4cd6-8bcb-254c4a35e6dd tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:33.780282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8865bf58-7d8e-4cd6-8bcb-254c4a35e6dd tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:33.783200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8865bf58-7d8e-4cd6-8bcb-254c4a35e6dd tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:33.783200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8865bf58-7d8e-4cd6-8bcb-254c4a35e6dd tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:34.039511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8865bf58-7d8e-4cd6-8bcb-254c4a35e6dd tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:34.041014 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8865bf58-7d8e-4cd6-8bcb-254c4a35e6dd tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1664 microversion: 2.1 time: 0.272813 May 28 21:30:34.041605 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2783/5511] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:33 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1664 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:34.145608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-50ddd64a-1221-447f-9ada-482dae2ab8bd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:34.147189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-50ddd64a-1221-447f-9ada-482dae2ab8bd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:34.155685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50ddd64a-1221-447f-9ada-482dae2ab8bd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:34.156399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50ddd64a-1221-447f-9ada-482dae2ab8bd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:34.157426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50ddd64a-1221-447f-9ada-482dae2ab8bd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:34.158425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50ddd64a-1221-447f-9ada-482dae2ab8bd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:34.569129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-50ddd64a-1221-447f-9ada-482dae2ab8bd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:34.577438 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-50ddd64a-1221-447f-9ada-482dae2ab8bd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1300 microversion: 2.1 time: 0.438494 May 28 21:30:34.578059 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2729/5512] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:34 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1300 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:34.711850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6d622453-8f58-4604-9e02-bb3f9521fc5a tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:34.712694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6d622453-8f58-4604-9e02-bb3f9521fc5a tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:34.720081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d622453-8f58-4604-9e02-bb3f9521fc5a tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:34.720788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d622453-8f58-4604-9e02-bb3f9521fc5a tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:34.721577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d622453-8f58-4604-9e02-bb3f9521fc5a tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:34.722065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6d622453-8f58-4604-9e02-bb3f9521fc5a tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:34.886256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6d622453-8f58-4604-9e02-bb3f9521fc5a tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:34.894056 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6d622453-8f58-4604-9e02-bb3f9521fc5a tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1324 microversion: 2.1 time: 0.186730 May 28 21:30:34.894760 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2784/5513] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:34 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1324 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:35.058225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-21a12012-287e-4627-90e5-cc93e4756474 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:35.058893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-21a12012-287e-4627-90e5-cc93e4756474 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:35.060898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:35.066102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21a12012-287e-4627-90e5-cc93e4756474 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:35.066572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21a12012-287e-4627-90e5-cc93e4756474 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:35.067361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21a12012-287e-4627-90e5-cc93e4756474 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:35.067820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21a12012-287e-4627-90e5-cc93e4756474 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:35.072133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:35.221373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-21a12012-287e-4627-90e5-cc93e4756474 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:35.229186 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-21a12012-287e-4627-90e5-cc93e4756474 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1668 microversion: 2.1 time: 0.175031 May 28 21:30:35.229832 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2730/5514] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:35 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1668 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:35.596243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-79ec9679-5954-4567-9f50-4502a8740377 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:35.597041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-79ec9679-5954-4567-9f50-4502a8740377 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:35.604339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79ec9679-5954-4567-9f50-4502a8740377 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:35.604796 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79ec9679-5954-4567-9f50-4502a8740377 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:35.605562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79ec9679-5954-4567-9f50-4502a8740377 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:35.606034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79ec9679-5954-4567-9f50-4502a8740377 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:35.688937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-79ec9679-5954-4567-9f50-4502a8740377 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:35.697726 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-79ec9679-5954-4567-9f50-4502a8740377 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1300 microversion: 2.1 time: 0.105866 May 28 21:30:35.698607 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2785/5515] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:35 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:35.911915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c86c4a36-11da-43ed-8d97-8b0dd05cb198 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:35.912439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c86c4a36-11da-43ed-8d97-8b0dd05cb198 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:35.919607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c86c4a36-11da-43ed-8d97-8b0dd05cb198 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:35.920067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c86c4a36-11da-43ed-8d97-8b0dd05cb198 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:35.920846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c86c4a36-11da-43ed-8d97-8b0dd05cb198 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:35.921292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c86c4a36-11da-43ed-8d97-8b0dd05cb198 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:36.083785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c86c4a36-11da-43ed-8d97-8b0dd05cb198 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:36.094401 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c86c4a36-11da-43ed-8d97-8b0dd05cb198 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1324 microversion: 2.1 time: 0.186800 May 28 21:30:36.095239 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2731/5516] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:35 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1324 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:36.372555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d3d39444-ed7b-4e49-9dff-a58771705a01 req-a90536b0-0ad6-4b9e-a7f4-d56e7e39a1cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a50f0bb-6ffb-4f35-944a-df60190c6d3f", "name": "network-vif-plugged", "status": "completed", "tag": "04dce3f3-a646-4093-813a-3c444e90c0bf"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:36.381140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d3d39444-ed7b-4e49-9dff-a58771705a01 req-a90536b0-0ad6-4b9e-a7f4-d56e7e39a1cc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:36.381755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d3d39444-ed7b-4e49-9dff-a58771705a01 req-a90536b0-0ad6-4b9e-a7f4-d56e7e39a1cc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:36.385880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:36.393327 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d3d39444-ed7b-4e49-9dff-a58771705a01 req-a90536b0-0ad6-4b9e-a7f4-d56e7e39a1cc service nova] Creating event network-vif-plugged:04dce3f3-a646-4093-813a-3c444e90c0bf for instance 2a50f0bb-6ffb-4f35-944a-df60190c6d3f on nch1-master-1 May 28 21:30:36.398422 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d3d39444-ed7b-4e49-9dff-a58771705a01 req-a90536b0-0ad6-4b9e-a7f4-d56e7e39a1cc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029476 May 28 21:30:36.399553 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2786/5517] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:30:36.716118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f163788f-b855-4d99-8fcb-dbdf5792a7c0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:36.717013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f163788f-b855-4d99-8fcb-dbdf5792a7c0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:36.731692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f163788f-b855-4d99-8fcb-dbdf5792a7c0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:36.734041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f163788f-b855-4d99-8fcb-dbdf5792a7c0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:36.734041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f163788f-b855-4d99-8fcb-dbdf5792a7c0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:36.734041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f163788f-b855-4d99-8fcb-dbdf5792a7c0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:36.828277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f163788f-b855-4d99-8fcb-dbdf5792a7c0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:36.836776 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f163788f-b855-4d99-8fcb-dbdf5792a7c0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1300 microversion: 2.1 time: 0.125542 May 28 21:30:36.838082 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2732/5518] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:36 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1300 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:37.112482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c0613cc6-d97a-4fa7-8668-829f917c14ac tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:37.113324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c0613cc6-d97a-4fa7-8668-829f917c14ac tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:37.116377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:37.121979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0613cc6-d97a-4fa7-8668-829f917c14ac tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:37.122435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0613cc6-d97a-4fa7-8668-829f917c14ac tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:37.123200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0613cc6-d97a-4fa7-8668-829f917c14ac tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:37.123641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0613cc6-d97a-4fa7-8668-829f917c14ac tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:37.270864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c0613cc6-d97a-4fa7-8668-829f917c14ac tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:37.278132 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c0613cc6-d97a-4fa7-8668-829f917c14ac tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1324 microversion: 2.1 time: 0.170306 May 28 21:30:37.278807 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2787/5519] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:37 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:37.860157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ae2375d-68d1-47bf-a817-e0e2948509f8 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:37.860790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8ae2375d-68d1-47bf-a817-e0e2948509f8 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:37.863249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:37.869286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ae2375d-68d1-47bf-a817-e0e2948509f8 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:37.869750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ae2375d-68d1-47bf-a817-e0e2948509f8 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:37.870629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ae2375d-68d1-47bf-a817-e0e2948509f8 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:37.871078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ae2375d-68d1-47bf-a817-e0e2948509f8 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:37.972162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8ae2375d-68d1-47bf-a817-e0e2948509f8 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:37.981361 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8ae2375d-68d1-47bf-a817-e0e2948509f8 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1472 microversion: 2.1 time: 0.125592 May 28 21:30:37.981982 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2733/5520] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:37 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1472 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:38.004204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f00eddb5-1ed5-4d60-91f0-400c15786ea3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:38.004839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f00eddb5-1ed5-4d60-91f0-400c15786ea3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:38.012119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f00eddb5-1ed5-4d60-91f0-400c15786ea3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:38.012598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f00eddb5-1ed5-4d60-91f0-400c15786ea3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:38.013390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f00eddb5-1ed5-4d60-91f0-400c15786ea3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:38.013875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f00eddb5-1ed5-4d60-91f0-400c15786ea3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:38.102207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f00eddb5-1ed5-4d60-91f0-400c15786ea3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:38.111552 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f00eddb5-1ed5-4d60-91f0-400c15786ea3 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1472 microversion: 2.1 time: 0.111029 May 28 21:30:38.112525 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2788/5521] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:37 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1472 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:38.132774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c19a1e37-d765-4547-ab5c-199b4662fe49 tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:38.132774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c19a1e37-d765-4547-ab5c-199b4662fe49 tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:38.135399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c19a1e37-d765-4547-ab5c-199b4662fe49 tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:38.135860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c19a1e37-d765-4547-ab5c-199b4662fe49 tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:38.136648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c19a1e37-d765-4547-ab5c-199b4662fe49 tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:38.137099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c19a1e37-d765-4547-ab5c-199b4662fe49 tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:38.217553 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c19a1e37-d765-4547-ab5c-199b4662fe49 tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1623 microversion: 2.1 time: 0.093721 May 28 21:30:38.218188 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2734/5522] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:38 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1623 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:38.234109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c43cd637-b92f-4c14-acba-7e92ae9617f9 tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:38.244586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c43cd637-b92f-4c14-acba-7e92ae9617f9 tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:38.244586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c43cd637-b92f-4c14-acba-7e92ae9617f9 tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:38.244586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c43cd637-b92f-4c14-acba-7e92ae9617f9 tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:38.244586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c43cd637-b92f-4c14-acba-7e92ae9617f9 tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:38.244963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c43cd637-b92f-4c14-acba-7e92ae9617f9 tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:38.296092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1a2f10a5-3f06-4421-ac83-1700a1107bd5 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:38.297342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1a2f10a5-3f06-4421-ac83-1700a1107bd5 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:38.304648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a2f10a5-3f06-4421-ac83-1700a1107bd5 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:38.305528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a2f10a5-3f06-4421-ac83-1700a1107bd5 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:38.306795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a2f10a5-3f06-4421-ac83-1700a1107bd5 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:38.307400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a2f10a5-3f06-4421-ac83-1700a1107bd5 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:38.500351 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c43cd637-b92f-4c14-acba-7e92ae9617f9 tempest-TestSecurityGroupsBasicOps-1433298426 tempest-TestSecurityGroupsBasicOps-1433298426-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1912 microversion: 2.1 time: 0.269528 May 28 21:30:38.501353 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2789/5523] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:38 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1912 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:38.507172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ffa4d72c-af7e-4f16-9f6c-7d0d29bc270b req-484b384c-b6a0-420b-886f-89a7e7b0ac0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6556ed-1498-4ed8-b88c-2304dde93e41", "name": "network-vif-plugged", "status": "completed", "tag": "44b30383-a358-4d04-98f6-0ab9284b8c8b"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:38.515145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1a2f10a5-3f06-4421-ac83-1700a1107bd5 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:38.517725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ffa4d72c-af7e-4f16-9f6c-7d0d29bc270b req-484b384c-b6a0-420b-886f-89a7e7b0ac0f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:38.518291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ffa4d72c-af7e-4f16-9f6c-7d0d29bc270b req-484b384c-b6a0-420b-886f-89a7e7b0ac0f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:38.525547 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1a2f10a5-3f06-4421-ac83-1700a1107bd5 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1324 microversion: 2.1 time: 0.234734 May 28 21:30:38.526179 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2735/5524] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:38 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1324 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:38.532769 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ffa4d72c-af7e-4f16-9f6c-7d0d29bc270b req-484b384c-b6a0-420b-886f-89a7e7b0ac0f service nova] Creating event network-vif-plugged:44b30383-a358-4d04-98f6-0ab9284b8c8b for instance ba6556ed-1498-4ed8-b88c-2304dde93e41 on nch1-master-1 May 28 21:30:38.538740 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ffa4d72c-af7e-4f16-9f6c-7d0d29bc270b req-484b384c-b6a0-420b-886f-89a7e7b0ac0f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035576 May 28 21:30:38.539780 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2790/5525] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:30:38.568626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9338a09c-5338-417c-a1e4-f208d41138ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:38.569183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9338a09c-5338-417c-a1e4-f208d41138ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:38.577101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9338a09c-5338-417c-a1e4-f208d41138ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:38.577780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9338a09c-5338-417c-a1e4-f208d41138ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:38.578834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9338a09c-5338-417c-a1e4-f208d41138ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:38.579424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9338a09c-5338-417c-a1e4-f208d41138ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:38.624175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9338a09c-5338-417c-a1e4-f208d41138ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:30:38.853952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:38.968073 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9338a09c-5338-417c-a1e4-f208d41138ca tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 204 len: 0 microversion: 2.1 time: 0.403681 May 28 21:30:38.969735 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2736/5526] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:30:38 2022] DELETE /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:30:38.980961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=10 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:38.985440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5c48b451-19a4-4512-94c4-ff63c684ebdd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:38.986723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5c48b451-19a4-4512-94c4-ff63c684ebdd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:38.993267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c48b451-19a4-4512-94c4-ff63c684ebdd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:38.993932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c48b451-19a4-4512-94c4-ff63c684ebdd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:38.994927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c48b451-19a4-4512-94c4-ff63c684ebdd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:38.995382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5c48b451-19a4-4512-94c4-ff63c684ebdd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:39.079258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5c48b451-19a4-4512-94c4-ff63c684ebdd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:39.087064 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5c48b451-19a4-4512-94c4-ff63c684ebdd tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1478 microversion: 2.1 time: 0.107031 May 28 21:30:39.087643 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2791/5527] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:38 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1478 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:39.545006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e83c457d-d430-4a5d-aac1-8469ec947e76 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:39.545727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e83c457d-d430-4a5d-aac1-8469ec947e76 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:39.552435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e83c457d-d430-4a5d-aac1-8469ec947e76 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:39.552919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e83c457d-d430-4a5d-aac1-8469ec947e76 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:39.553737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e83c457d-d430-4a5d-aac1-8469ec947e76 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:39.554212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e83c457d-d430-4a5d-aac1-8469ec947e76 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:39.704821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e83c457d-d430-4a5d-aac1-8469ec947e76 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:39.713205 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e83c457d-d430-4a5d-aac1-8469ec947e76 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1324 microversion: 2.1 time: 0.172283 May 28 21:30:39.713792 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2737/5528] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:39 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1324 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:40.105148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d16c1420-1ad7-4160-b1b8-fbc7594ba666 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:40.105763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d16c1420-1ad7-4160-b1b8-fbc7594ba666 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:40.112964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d16c1420-1ad7-4160-b1b8-fbc7594ba666 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:40.113531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d16c1420-1ad7-4160-b1b8-fbc7594ba666 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:40.114192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d16c1420-1ad7-4160-b1b8-fbc7594ba666 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:40.114637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d16c1420-1ad7-4160-b1b8-fbc7594ba666 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:40.225437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d16c1420-1ad7-4160-b1b8-fbc7594ba666 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:40.233551 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d16c1420-1ad7-4160-b1b8-fbc7594ba666 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1478 microversion: 2.1 time: 0.132841 May 28 21:30:40.238171 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2792/5529] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:40 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1478 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:40.731632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7b26074f-4e39-4f69-adbd-fcaf25b6d89c tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:40.732836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7b26074f-4e39-4f69-adbd-fcaf25b6d89c tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:40.741341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b26074f-4e39-4f69-adbd-fcaf25b6d89c tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:40.742704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b26074f-4e39-4f69-adbd-fcaf25b6d89c tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:40.743668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b26074f-4e39-4f69-adbd-fcaf25b6d89c tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:40.744274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7b26074f-4e39-4f69-adbd-fcaf25b6d89c tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:40.936383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7b26074f-4e39-4f69-adbd-fcaf25b6d89c tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:40.944230 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7b26074f-4e39-4f69-adbd-fcaf25b6d89c tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1324 microversion: 2.1 time: 0.216870 May 28 21:30:40.944816 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2738/5530] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:40 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1324 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:30:41.252808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-70e35177-b6ce-444d-aa77-8cdfdab2ee41 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:41.254326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-70e35177-b6ce-444d-aa77-8cdfdab2ee41 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:41.264131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70e35177-b6ce-444d-aa77-8cdfdab2ee41 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:41.265238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70e35177-b6ce-444d-aa77-8cdfdab2ee41 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:41.266276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70e35177-b6ce-444d-aa77-8cdfdab2ee41 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:41.267151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-c1490a62-9561-4715-96d2-d71cefd22617 req-7925d999-a18b-490c-aec4-2dbdd162d773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a50f0bb-6ffb-4f35-944a-df60190c6d3f", "name": "network-vif-deleted", "tag": "04dce3f3-a646-4093-813a-3c444e90c0bf"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:41.267396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70e35177-b6ce-444d-aa77-8cdfdab2ee41 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:41.277642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c1490a62-9561-4715-96d2-d71cefd22617 req-7925d999-a18b-490c-aec4-2dbdd162d773 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:41.278333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c1490a62-9561-4715-96d2-d71cefd22617 req-7925d999-a18b-490c-aec4-2dbdd162d773 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:41.297071 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-c1490a62-9561-4715-96d2-d71cefd22617 req-7925d999-a18b-490c-aec4-2dbdd162d773 service nova] Creating event network-vif-deleted:04dce3f3-a646-4093-813a-3c444e90c0bf for instance 2a50f0bb-6ffb-4f35-944a-df60190c6d3f on nch1-master-1 May 28 21:30:41.302827 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-c1490a62-9561-4715-96d2-d71cefd22617 req-7925d999-a18b-490c-aec4-2dbdd162d773 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041065 May 28 21:30:41.306842 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2739/5531] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:30:41.341538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-70e35177-b6ce-444d-aa77-8cdfdab2ee41 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:41.350566 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-70e35177-b6ce-444d-aa77-8cdfdab2ee41 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 200 len: 1478 microversion: 2.1 time: 0.102808 May 28 21:30:41.351255 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2793/5532] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:41 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 1478 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:41.961389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-61e6a5da-9bcd-4a6c-955f-f9d5d12e8cab tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:41.962143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-61e6a5da-9bcd-4a6c-955f-f9d5d12e8cab tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:41.969646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61e6a5da-9bcd-4a6c-955f-f9d5d12e8cab tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:41.970135 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61e6a5da-9bcd-4a6c-955f-f9d5d12e8cab tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:41.970958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61e6a5da-9bcd-4a6c-955f-f9d5d12e8cab tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:41.971517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61e6a5da-9bcd-4a6c-955f-f9d5d12e8cab tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:42.123509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-61e6a5da-9bcd-4a6c-955f-f9d5d12e8cab tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:42.132042 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-61e6a5da-9bcd-4a6c-955f-f9d5d12e8cab tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1521 microversion: 2.1 time: 0.175193 May 28 21:30:42.132467 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2740/5533] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:41 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:42.163111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6f60e06d-73a4-4b17-b557-922b44f8d125 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:42.163683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6f60e06d-73a4-4b17-b557-922b44f8d125 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:42.178858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f60e06d-73a4-4b17-b557-922b44f8d125 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:42.179253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f60e06d-73a4-4b17-b557-922b44f8d125 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:42.180040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f60e06d-73a4-4b17-b557-922b44f8d125 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:42.180486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f60e06d-73a4-4b17-b557-922b44f8d125 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:42.210481 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-6f60e06d-73a4-4b17-b557-922b44f8d125 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] HTTP exception thrown: Instance is not a member of specified network May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6f60e06d-73a4-4b17-b557-922b44f8d125 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Request method failure captured: May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41/ips/invalid HTTP/1.1 May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpRwiGiptcIIgVEqEri88q81s3SM8F__uPpPxjkeF60NPvMlFZbS-E2ecgxm-kog_xyV8ti-djkiPcjcK8I4xEEN0uMOoEXaaIcyZQVqVMFr9AP1rrZ8_kzd-FajAruekWrrZG4YtfefthMVLjNEI1AbMo8OyO2L96XgZ68Z06jsTVE May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 239c9c3debdd456ab6e9c0545ab47fe2 May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1256405105 May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_239c9c3debdd456ab6e9c0545ab47fe2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/239c9c3debdd456ab6e9c0545ab47fe2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/239c9c3debdd456ab6e9c0545ab47fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/239c9c3debdd456ab6e9c0545ab47fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1256405105 May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 239c9c3debdd456ab6e9c0545ab47fe2 May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1256405105 May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerAddressesNegativeTestJSON-1256405105-project May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 5b4a37f2a8ec4160bc4db12c0d3e7de5 May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1256405105-project May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance is not a member of specified network May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'server_id': 'ba6556ed-1498-4ed8-b88c-2304dde93e41', 'id': 'invalid'} May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network May 28 21:30:42.216510 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:30:42.219478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6f60e06d-73a4-4b17-b557-922b44f8d125 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Returning 404 to user: Instance is not a member of specified network {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:30:42.219478 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6f60e06d-73a4-4b17-b557-922b44f8d125 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.059683 May 28 21:30:42.219478 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2794/5534] 10.222.0.33 () {58 vars in 1271 bytes} [Sat May 28 21:30:42 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41/ips/invalid => generated 91 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:30:42.228413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6d0555e7-3cf0-4195-92e7-127e94605cf6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:42.228941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6d0555e7-3cf0-4195-92e7-127e94605cf6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Failed to fetch instance by id 999 {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2926}} May 28 21:30:42.229468 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-6d0555e7-3cf0-4195-92e7-127e94605cf6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] HTTP exception thrown: Instance 999 could not be found. May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6d0555e7-3cf0-4195-92e7-127e94605cf6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Request method failure captured: May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpRwiGiptcIIgVEqEri88q81s3SM8F__uPpPxjkeF60NPvMlFZbS-E2ecgxm-kog_xyV8ti-djkiPcjcK8I4xEEN0uMOoEXaaIcyZQVqVMFr9AP1rrZ8_kzd-FajAruekWrrZG4YtfefthMVLjNEI1AbMo8OyO2L96XgZ68Z06jsTVE May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 239c9c3debdd456ab6e9c0545ab47fe2 May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1256405105 May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_239c9c3debdd456ab6e9c0545ab47fe2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/239c9c3debdd456ab6e9c0545ab47fe2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/239c9c3debdd456ab6e9c0545ab47fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/239c9c3debdd456ab6e9c0545ab47fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1256405105 May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 239c9c3debdd456ab6e9c0545ab47fe2 May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1256405105 May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerAddressesNegativeTestJSON-1256405105-project May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 5b4a37f2a8ec4160bc4db12c0d3e7de5 May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1256405105-project May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 999 could not be found. May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'server_id': '999'} May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. May 28 21:30:42.231294 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:42.234979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6d0555e7-3cf0-4195-92e7-127e94605cf6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Returning 404 to user: Instance 999 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:30:42.234979 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6d0555e7-3cf0-4195-92e7-127e94605cf6 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008729 May 28 21:30:42.234979 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2741/5535] 10.222.0.33 () {58 vars in 1148 bytes} [Sat May 28 21:30:42 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 28 21:30:42.243297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b82fa0c2-3c2d-46bf-82af-530a076054b8 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:42.243799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b82fa0c2-3c2d-46bf-82af-530a076054b8 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:42.252606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b82fa0c2-3c2d-46bf-82af-530a076054b8 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:42.252606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b82fa0c2-3c2d-46bf-82af-530a076054b8 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:42.252606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b82fa0c2-3c2d-46bf-82af-530a076054b8 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:42.252606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b82fa0c2-3c2d-46bf-82af-530a076054b8 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:42.281488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b82fa0c2-3c2d-46bf-82af-530a076054b8 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:30:42.368388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ec350786-2e47-4109-aadf-409247abd584 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:42.369005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ec350786-2e47-4109-aadf-409247abd584 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 2a50f0bb-6ffb-4f35-944a-df60190c6d3f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:42.375138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec350786-2e47-4109-aadf-409247abd584 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:42.375585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec350786-2e47-4109-aadf-409247abd584 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:42.376426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec350786-2e47-4109-aadf-409247abd584 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:42.376867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec350786-2e47-4109-aadf-409247abd584 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:42.405091 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-ec350786-2e47-4109-aadf-409247abd584 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] HTTP exception thrown: Instance 2a50f0bb-6ffb-4f35-944a-df60190c6d3f could not be found. May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ec350786-2e47-4109-aadf-409247abd584 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Request method failure captured: May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f HTTP/1.1 May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpQfluKM8NQwQWzA6uAjrOrJBcypsGbo28GSfrYH8gGuCTVVRJ8lb3tvegJQYJ_i6xYdHTmDjBQC1euWDcplJgWTc15f02RMBRYBc512NqlTXlSvukuek3h5xQ_xLJGd4-Doi50Za6jJ5VnB6N4eadY52R4hDeR4mjv8AXDeH2iX2TQ May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 97cf01c13fa745a3bd04e35a0ce27088 May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1648775569 May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_97cf01c13fa745a3bd04e35a0ce27088", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/97cf01c13fa745a3bd04e35a0ce27088"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/97cf01c13fa745a3bd04e35a0ce27088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/97cf01c13fa745a3bd04e35a0ce27088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1648775569 May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 97cf01c13fa745a3bd04e35a0ce27088 May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1648775569 May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestSecurityGroupsBasicOps-1648775569-project May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 642d08e104394dd28e6b4b502f5bc8cf May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1648775569-project May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 2a50f0bb-6ffb-4f35-944a-df60190c6d3f could not be found. May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '2a50f0bb-6ffb-4f35-944a-df60190c6d3f'} May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a50f0bb-6ffb-4f35-944a-df60190c6d3f could not be found. May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a50f0bb-6ffb-4f35-944a-df60190c6d3f could not be found. May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:30:42.410770 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:42.415149 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:42.415149 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:30:42.415149 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:30:42.415149 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:30:42.415149 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:30:42.415149 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a50f0bb-6ffb-4f35-944a-df60190c6d3f could not be found. May 28 21:30:42.415149 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:42.415149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ec350786-2e47-4109-aadf-409247abd584 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Returning 404 to user: Instance 2a50f0bb-6ffb-4f35-944a-df60190c6d3f could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:30:42.415149 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ec350786-2e47-4109-aadf-409247abd584 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f" status: 404 len: 111 microversion: 2.1 time: 0.047842 May 28 21:30:42.415149 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2742/5536] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:42 2022] GET /compute/v2.1/servers/2a50f0bb-6ffb-4f35-944a-df60190c6d3f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:30:42.448128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:42.556038 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b82fa0c2-3c2d-46bf-82af-530a076054b8 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 204 len: 0 microversion: 2.1 time: 0.316226 May 28 21:30:42.556817 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2795/5537] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:30:42 2022] DELETE /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:30:42.566974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9c287452-3e62-40d6-9cd1-106946705b65 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:42.569731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9c287452-3e62-40d6-9cd1-106946705b65 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:42.574371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c287452-3e62-40d6-9cd1-106946705b65 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:42.574821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c287452-3e62-40d6-9cd1-106946705b65 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:42.575594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c287452-3e62-40d6-9cd1-106946705b65 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:42.576036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c287452-3e62-40d6-9cd1-106946705b65 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:42.716534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9c287452-3e62-40d6-9cd1-106946705b65 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:42.724879 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9c287452-3e62-40d6-9cd1-106946705b65 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1527 microversion: 2.1 time: 0.163743 May 28 21:30:42.725653 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2743/5538] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:42 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1527 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:30:43.745233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cc5867a0-e65a-4581-8895-6c0f776d0529 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:43.746999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cc5867a0-e65a-4581-8895-6c0f776d0529 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:43.755931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc5867a0-e65a-4581-8895-6c0f776d0529 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:43.756537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc5867a0-e65a-4581-8895-6c0f776d0529 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:43.757467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc5867a0-e65a-4581-8895-6c0f776d0529 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:43.758025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc5867a0-e65a-4581-8895-6c0f776d0529 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:44.028442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cc5867a0-e65a-4581-8895-6c0f776d0529 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:44.050304 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cc5867a0-e65a-4581-8895-6c0f776d0529 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1527 microversion: 2.1 time: 0.310019 May 28 21:30:44.051919 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2796/5539] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:43 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1527 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:44.504549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-cb25a419-ad3e-46b0-bd3b-578a3a461631 req-ec0708d2-6606-42b6-a8a7-ea91cad3a294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba6556ed-1498-4ed8-b88c-2304dde93e41", "name": "network-vif-deleted", "tag": "44b30383-a358-4d04-98f6-0ab9284b8c8b"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:44.514251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cb25a419-ad3e-46b0-bd3b-578a3a461631 req-ec0708d2-6606-42b6-a8a7-ea91cad3a294 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:44.514820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cb25a419-ad3e-46b0-bd3b-578a3a461631 req-ec0708d2-6606-42b6-a8a7-ea91cad3a294 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:44.528404 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-cb25a419-ad3e-46b0-bd3b-578a3a461631 req-ec0708d2-6606-42b6-a8a7-ea91cad3a294 service nova] Creating event network-vif-deleted:44b30383-a358-4d04-98f6-0ab9284b8c8b for instance ba6556ed-1498-4ed8-b88c-2304dde93e41 on nch1-master-1 May 28 21:30:44.536125 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-cb25a419-ad3e-46b0-bd3b-578a3a461631 req-ec0708d2-6606-42b6-a8a7-ea91cad3a294 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032970 May 28 21:30:44.538154 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2744/5540] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:30:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:30:45.070563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1a69738b-82de-4ed0-8454-1e22c9547638 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:45.071320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1a69738b-82de-4ed0-8454-1e22c9547638 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:45.078852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a69738b-82de-4ed0-8454-1e22c9547638 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:45.079583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a69738b-82de-4ed0-8454-1e22c9547638 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:45.081786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a69738b-82de-4ed0-8454-1e22c9547638 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:45.082470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a69738b-82de-4ed0-8454-1e22c9547638 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:45.127791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a69738b-82de-4ed0-8454-1e22c9547638 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:45.128625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a69738b-82de-4ed0-8454-1e22c9547638 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:45.129162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-1a69738b-82de-4ed0-8454-1e22c9547638 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lazy-loading 'fault' on Instance uuid ba6556ed-1498-4ed8-b88c-2304dde93e41 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:30:45.179479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1a69738b-82de-4ed0-8454-1e22c9547638 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b4a37f2a8ec4160bc4db12c0d3e7de5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '239c9c3debdd456ab6e9c0545ab47fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:45.188292 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1a69738b-82de-4ed0-8454-1e22c9547638 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 200 len: 1314 microversion: 2.1 time: 0.123518 May 28 21:30:45.189284 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2797/5541] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:45 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 1314 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:46.208195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5a14e3cf-8712-4015-8032-a9f05061bf98 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:46.211054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5a14e3cf-8712-4015-8032-a9f05061bf98 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] [instance: ba6556ed-1498-4ed8-b88c-2304dde93e41] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:46.224516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5a14e3cf-8712-4015-8032-a9f05061bf98 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:46.226461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5a14e3cf-8712-4015-8032-a9f05061bf98 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:46.227639 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5a14e3cf-8712-4015-8032-a9f05061bf98 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:46.228324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5a14e3cf-8712-4015-8032-a9f05061bf98 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:46.244841 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-5a14e3cf-8712-4015-8032-a9f05061bf98 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] HTTP exception thrown: Instance ba6556ed-1498-4ed8-b88c-2304dde93e41 could not be found. May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5a14e3cf-8712-4015-8032-a9f05061bf98 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Request method failure captured: May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 HTTP/1.1 May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpRwiGiptcIIgVEqEri88q81s3SM8F__uPpPxjkeF60NPvMlFZbS-E2ecgxm-kog_xyV8ti-djkiPcjcK8I4xEEN0uMOoEXaaIcyZQVqVMFr9AP1rrZ8_kzd-FajAruekWrrZG4YtfefthMVLjNEI1AbMo8OyO2L96XgZ68Z06jsTVE May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 239c9c3debdd456ab6e9c0545ab47fe2 May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1256405105 May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_239c9c3debdd456ab6e9c0545ab47fe2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/239c9c3debdd456ab6e9c0545ab47fe2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/239c9c3debdd456ab6e9c0545ab47fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/239c9c3debdd456ab6e9c0545ab47fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1256405105 May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 239c9c3debdd456ab6e9c0545ab47fe2 May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1256405105 May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerAddressesNegativeTestJSON-1256405105-project May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 5b4a37f2a8ec4160bc4db12c0d3e7de5 May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1256405105-project May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance ba6556ed-1498-4ed8-b88c-2304dde93e41 could not be found. May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ba6556ed-1498-4ed8-b88c-2304dde93e41'} May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba6556ed-1498-4ed8-b88c-2304dde93e41 could not be found. May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba6556ed-1498-4ed8-b88c-2304dde93e41 could not be found. May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:46.246731 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:30:46.250020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:46.250020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:46.250020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:30:46.250020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:30:46.250020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:30:46.250020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:30:46.250020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba6556ed-1498-4ed8-b88c-2304dde93e41 could not be found. May 28 21:30:46.250020 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:46.250020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5a14e3cf-8712-4015-8032-a9f05061bf98 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] Returning 404 to user: Instance ba6556ed-1498-4ed8-b88c-2304dde93e41 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:30:46.250020 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5a14e3cf-8712-4015-8032-a9f05061bf98 tempest-ServerAddressesNegativeTestJSON-1256405105 tempest-ServerAddressesNegativeTestJSON-1256405105-project] 10.222.0.33 "GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41" status: 404 len: 111 microversion: 2.1 time: 0.045735 May 28 21:30:46.252577 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2745/5542] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:46 2022] GET /compute/v2.1/servers/ba6556ed-1498-4ed8-b88c-2304dde93e41 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:30:47.614765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3b6d1b7f-9fd1-4a70-8f26-9fccac335b45 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:47.616576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3b6d1b7f-9fd1-4a70-8f26-9fccac335b45 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:47.631296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b6d1b7f-9fd1-4a70-8f26-9fccac335b45 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:47.631765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b6d1b7f-9fd1-4a70-8f26-9fccac335b45 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:47.632565 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b6d1b7f-9fd1-4a70-8f26-9fccac335b45 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:47.635442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b6d1b7f-9fd1-4a70-8f26-9fccac335b45 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:47.710644 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3b6d1b7f-9fd1-4a70-8f26-9fccac335b45 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71/action" status: 200 len: 24575 microversion: 2.1 time: 0.099332 May 28 21:30:47.711582 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2798/5543] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:30:47 2022] POST /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71/action => generated 24575 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:30:48.135324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a1be2697-4580-4d53-bca2-e334128857d0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:48.135831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a1be2697-4580-4d53-bca2-e334128857d0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:48.137827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-1d6d36db-7b1d-48db-8901-58b314d7d971 req-477f9a46-7d69-4ead-a711-3c76a03f0b43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cc276a6-db4e-4a03-b637-5c84e10a589f", "tag": "4c140de1-06ca-4846-ac17-c169fb67a422"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:48.147742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1d6d36db-7b1d-48db-8901-58b314d7d971 req-477f9a46-7d69-4ead-a711-3c76a03f0b43 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:48.148423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1d6d36db-7b1d-48db-8901-58b314d7d971 req-477f9a46-7d69-4ead-a711-3c76a03f0b43 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:48.151125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1be2697-4580-4d53-bca2-e334128857d0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:48.151955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1be2697-4580-4d53-bca2-e334128857d0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:48.155183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1be2697-4580-4d53-bca2-e334128857d0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:48.156653 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a1be2697-4580-4d53-bca2-e334128857d0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:48.161337 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-1d6d36db-7b1d-48db-8901-58b314d7d971 req-477f9a46-7d69-4ead-a711-3c76a03f0b43 service nova] Creating event network-changed:4c140de1-06ca-4846-ac17-c169fb67a422 for instance 5cc276a6-db4e-4a03-b637-5c84e10a589f on nch2-master-1 May 28 21:30:48.167810 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-1d6d36db-7b1d-48db-8901-58b314d7d971 req-477f9a46-7d69-4ead-a711-3c76a03f0b43 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033992 May 28 21:30:48.169000 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2799/5544] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:30:48.197082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a1be2697-4580-4d53-bca2-e334128857d0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:30:48.592236 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a1be2697-4580-4d53-bca2-e334128857d0 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 204 len: 0 microversion: 2.1 time: 0.460120 May 28 21:30:48.593361 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2746/5545] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:30:48 2022] DELETE /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:30:48.615609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-606095e9-0a89-47b2-acd4-7985e1fbd2e6 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:48.617976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-606095e9-0a89-47b2-acd4-7985e1fbd2e6 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:48.630384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-606095e9-0a89-47b2-acd4-7985e1fbd2e6 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:48.633747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-606095e9-0a89-47b2-acd4-7985e1fbd2e6 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:48.633747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-606095e9-0a89-47b2-acd4-7985e1fbd2e6 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:48.633747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-606095e9-0a89-47b2-acd4-7985e1fbd2e6 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:48.836976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-606095e9-0a89-47b2-acd4-7985e1fbd2e6 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:48.845794 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-606095e9-0a89-47b2-acd4-7985e1fbd2e6 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1767 microversion: 2.1 time: 0.241586 May 28 21:30:48.847502 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2800/5546] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:48 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1767 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:49.864928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-07e0d20d-2973-42ef-a63a-3e3055def721 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:49.865640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-07e0d20d-2973-42ef-a63a-3e3055def721 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:49.872223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07e0d20d-2973-42ef-a63a-3e3055def721 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:49.872729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07e0d20d-2973-42ef-a63a-3e3055def721 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:49.874218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07e0d20d-2973-42ef-a63a-3e3055def721 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:49.874915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-07e0d20d-2973-42ef-a63a-3e3055def721 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:49.880232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:50.125857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-07e0d20d-2973-42ef-a63a-3e3055def721 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:50.134539 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-07e0d20d-2973-42ef-a63a-3e3055def721 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1767 microversion: 2.1 time: 0.274030 May 28 21:30:50.135093 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2747/5547] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:49 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1767 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:50.685207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-953d5b2b-9525-41f1-b419-06a4162175af req-c3e025f7-63e9-4853-b939-75b4e36bcedf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cc276a6-db4e-4a03-b637-5c84e10a589f", "name": "network-vif-deleted", "tag": "4c140de1-06ca-4846-ac17-c169fb67a422"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:50.694769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-953d5b2b-9525-41f1-b419-06a4162175af req-c3e025f7-63e9-4853-b939-75b4e36bcedf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:50.695224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-953d5b2b-9525-41f1-b419-06a4162175af req-c3e025f7-63e9-4853-b939-75b4e36bcedf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:50.706732 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-953d5b2b-9525-41f1-b419-06a4162175af req-c3e025f7-63e9-4853-b939-75b4e36bcedf service nova] Creating event network-vif-deleted:4c140de1-06ca-4846-ac17-c169fb67a422 for instance 5cc276a6-db4e-4a03-b637-5c84e10a589f on nch2-master-1 May 28 21:30:50.711689 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-953d5b2b-9525-41f1-b419-06a4162175af req-c3e025f7-63e9-4853-b939-75b4e36bcedf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030930 May 28 21:30:50.712279 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2801/5548] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:30:51.152975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84563f0e-f9f6-4ad2-9a37-fc951ab57f3e tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:51.153470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-84563f0e-f9f6-4ad2-9a37-fc951ab57f3e tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:51.162569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84563f0e-f9f6-4ad2-9a37-fc951ab57f3e tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:51.163034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84563f0e-f9f6-4ad2-9a37-fc951ab57f3e tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:51.163822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84563f0e-f9f6-4ad2-9a37-fc951ab57f3e tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:51.164373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84563f0e-f9f6-4ad2-9a37-fc951ab57f3e tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:51.199306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84563f0e-f9f6-4ad2-9a37-fc951ab57f3e tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:51.199756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84563f0e-f9f6-4ad2-9a37-fc951ab57f3e tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:51.200319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-84563f0e-f9f6-4ad2-9a37-fc951ab57f3e tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lazy-loading 'fault' on Instance uuid 5cc276a6-db4e-4a03-b637-5c84e10a589f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:30:51.243833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-84563f0e-f9f6-4ad2-9a37-fc951ab57f3e tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '642d08e104394dd28e6b4b502f5bc8cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97cf01c13fa745a3bd04e35a0ce27088', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:51.251883 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-84563f0e-f9f6-4ad2-9a37-fc951ab57f3e tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 200 len: 1383 microversion: 2.1 time: 0.103207 May 28 21:30:51.252506 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2748/5549] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:51 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 1383 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:30:51.676388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-870232025", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "5f1ba372-d2e3-4574-b418-cafd8223027d"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:51.735308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] validate_networks() for [('5f1ba372-d2e3-4574-b418-cafd8223027d', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:30:52.243067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:30:52.243526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:30:52.244015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:30:52.244650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:30:52.245080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:30:52.254897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:52.255357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:52.256160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:52.256597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:52.268640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bbf0dcd1-f58c-4aef-bc2a-961876633533 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:52.269266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bbf0dcd1-f58c-4aef-bc2a-961876633533 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] [instance: 5cc276a6-db4e-4a03-b637-5c84e10a589f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:52.275212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Getting quotas for project b98e2ebc3d3b4e7083b9c429628ce69f. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:30:52.276419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbf0dcd1-f58c-4aef-bc2a-961876633533 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:52.277133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbf0dcd1-f58c-4aef-bc2a-961876633533 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:52.278159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbf0dcd1-f58c-4aef-bc2a-961876633533 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:52.278877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbf0dcd1-f58c-4aef-bc2a-961876633533 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:52.281274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Getting quotas for user c08e8a164d3248188ce965d1a9e04f03 and project b98e2ebc3d3b4e7083b9c429628ce69f. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:30:52.294190 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-bbf0dcd1-f58c-4aef-bc2a-961876633533 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] HTTP exception thrown: Instance 5cc276a6-db4e-4a03-b637-5c84e10a589f could not be found. May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bbf0dcd1-f58c-4aef-bc2a-961876633533 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Request method failure captured: May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f HTTP/1.1 May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpQfluKM8NQwQWzA6uAjrOrJBcypsGbo28GSfrYH8gGuCTVVRJ8lb3tvegJQYJ_i6xYdHTmDjBQC1euWDcplJgWTc15f02RMBRYBc512NqlTXlSvukuek3h5xQ_xLJGd4-Doi50Za6jJ5VnB6N4eadY52R4hDeR4mjv8AXDeH2iX2TQ May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 97cf01c13fa745a3bd04e35a0ce27088 May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1648775569 May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_97cf01c13fa745a3bd04e35a0ce27088", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/97cf01c13fa745a3bd04e35a0ce27088"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/97cf01c13fa745a3bd04e35a0ce27088"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/97cf01c13fa745a3bd04e35a0ce27088"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1648775569 May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 97cf01c13fa745a3bd04e35a0ce27088 May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1648775569 May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestSecurityGroupsBasicOps-1648775569-project May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 642d08e104394dd28e6b4b502f5bc8cf May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1648775569-project May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 5cc276a6-db4e-4a03-b637-5c84e10a589f could not be found. May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '5cc276a6-db4e-4a03-b637-5c84e10a589f'} May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cc276a6-db4e-4a03-b637-5c84e10a589f could not be found. May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cc276a6-db4e-4a03-b637-5c84e10a589f could not be found. May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:30:52.296309 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:52.301626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:30:52.301626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:30:52.301626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:30:52.301626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:30:52.301626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:30:52.301626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cc276a6-db4e-4a03-b637-5c84e10a589f could not be found. May 28 21:30:52.301626 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:30:52.302121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:30:52.302203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bbf0dcd1-f58c-4aef-bc2a-961876633533 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Returning 404 to user: Instance 5cc276a6-db4e-4a03-b637-5c84e10a589f could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:30:52.302203 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bbf0dcd1-f58c-4aef-bc2a-961876633533 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f" status: 404 len: 111 microversion: 2.1 time: 0.033116 May 28 21:30:52.302203 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2749/5550] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:52 2022] GET /compute/v2.1/servers/5cc276a6-db4e-4a03-b637-5c84e10a589f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:30:52.302380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:30:52.617172 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0027102b-8127-4e11-8c56-241af7f69500 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.186407 May 28 21:30:52.617858 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2802/5551] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:30:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1188 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 21:30:52.634999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d8d49505-e529-4fc8-99c0-3a24db2d7d4a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:52.635686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d8d49505-e529-4fc8-99c0-3a24db2d7d4a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:52.710561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d8d49505-e529-4fc8-99c0-3a24db2d7d4a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:52.719073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d8d49505-e529-4fc8-99c0-3a24db2d7d4a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:52.720848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d8d49505-e529-4fc8-99c0-3a24db2d7d4a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:52.722085 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d8d49505-e529-4fc8-99c0-3a24db2d7d4a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 200 len: 1261 microversion: 2.26 time: 0.091003 May 28 21:30:52.722644 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2750/5552] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:30:52 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 1261 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:30:53.750803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bcf3acc9-1532-4581-861e-fc788f86a0d7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:53.752422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bcf3acc9-1532-4581-861e-fc788f86a0d7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:53.856170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bcf3acc9-1532-4581-861e-fc788f86a0d7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:53.864498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bcf3acc9-1532-4581-861e-fc788f86a0d7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:53.866866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bcf3acc9-1532-4581-861e-fc788f86a0d7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:53.867651 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bcf3acc9-1532-4581-861e-fc788f86a0d7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 200 len: 1261 microversion: 2.26 time: 0.130556 May 28 21:30:53.869100 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2803/5553] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:30:53 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 1261 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:30:54.889928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3ae9a29d-5230-4186-a63f-0e5870a80916 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:54.894040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3ae9a29d-5230-4186-a63f-0e5870a80916 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:54.918429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ae9a29d-5230-4186-a63f-0e5870a80916 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:54.918429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ae9a29d-5230-4186-a63f-0e5870a80916 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:54.918429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ae9a29d-5230-4186-a63f-0e5870a80916 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:54.918429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ae9a29d-5230-4186-a63f-0e5870a80916 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:54.988970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3ae9a29d-5230-4186-a63f-0e5870a80916 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:54.999845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3ae9a29d-5230-4186-a63f-0e5870a80916 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:55.002368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3ae9a29d-5230-4186-a63f-0e5870a80916 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:55.005066 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3ae9a29d-5230-4186-a63f-0e5870a80916 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 200 len: 1257 microversion: 2.26 time: 0.120564 May 28 21:30:55.038987 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2751/5554] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:30:54 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 1257 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:30:56.050499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-05561be6-0680-4ce5-bfbf-00dc22bfb94d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:56.051961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-05561be6-0680-4ce5-bfbf-00dc22bfb94d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:56.074844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05561be6-0680-4ce5-bfbf-00dc22bfb94d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:56.075581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05561be6-0680-4ce5-bfbf-00dc22bfb94d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:56.076644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05561be6-0680-4ce5-bfbf-00dc22bfb94d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:56.077251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05561be6-0680-4ce5-bfbf-00dc22bfb94d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:56.303483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-05561be6-0680-4ce5-bfbf-00dc22bfb94d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:56.317317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-05561be6-0680-4ce5-bfbf-00dc22bfb94d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:56.320945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-05561be6-0680-4ce5-bfbf-00dc22bfb94d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:56.322192 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-05561be6-0680-4ce5-bfbf-00dc22bfb94d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 200 len: 1321 microversion: 2.26 time: 0.278963 May 28 21:30:56.335743 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2804/5555] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:30:56 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:30:57.346680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5b1f0b54-edd1-4c94-aa32-32177ed7cdf5 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:57.348175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5b1f0b54-edd1-4c94-aa32-32177ed7cdf5 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:57.356412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b1f0b54-edd1-4c94-aa32-32177ed7cdf5 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:57.356946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b1f0b54-edd1-4c94-aa32-32177ed7cdf5 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:57.357819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b1f0b54-edd1-4c94-aa32-32177ed7cdf5 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:57.358515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b1f0b54-edd1-4c94-aa32-32177ed7cdf5 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:57.582167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5b1f0b54-edd1-4c94-aa32-32177ed7cdf5 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:57.591290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5b1f0b54-edd1-4c94-aa32-32177ed7cdf5 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:57.594907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5b1f0b54-edd1-4c94-aa32-32177ed7cdf5 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:57.594907 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5b1f0b54-edd1-4c94-aa32-32177ed7cdf5 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 200 len: 1361 microversion: 2.26 time: 0.252230 May 28 21:30:57.610936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c03d0ba1-469b-4a06-aa5d-e9508a88d5f9 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] Calling method '.version_select at 0x7f4d64116ee0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:57.617515 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2752/5556] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:30:57 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:30:57.744043 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c03d0ba1-469b-4a06-aa5d-e9508a88d5f9 tempest-TestSecurityGroupsBasicOps-1648775569 tempest-TestSecurityGroupsBasicOps-1648775569-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1282774370" status: 202 len: 0 microversion: 2.1 time: 0.138224 May 28 21:30:57.746038 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2805/5557] 10.222.0.33 () {58 vars in 1277 bytes} [Sat May 28 21:30:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1282774370 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:30:58.369572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-b4bf9596-ee75-4e42-8a7a-e03f1267d09f req-ff962230-615c-4d2c-b099-47885dcdcf85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e51bb11-1862-4204-815f-b523cf2fc9c3", "tag": "7d9ac367-7c8b-48e8-9f2d-3b0c33c4a2d0"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:58.379415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b4bf9596-ee75-4e42-8a7a-e03f1267d09f req-ff962230-615c-4d2c-b099-47885dcdcf85 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:58.379874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b4bf9596-ee75-4e42-8a7a-e03f1267d09f req-ff962230-615c-4d2c-b099-47885dcdcf85 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:58.396496 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-b4bf9596-ee75-4e42-8a7a-e03f1267d09f req-ff962230-615c-4d2c-b099-47885dcdcf85 service nova] Creating event network-changed:7d9ac367-7c8b-48e8-9f2d-3b0c33c4a2d0 for instance 1e51bb11-1862-4204-815f-b523cf2fc9c3 on nch1-master-1 May 28 21:30:58.401632 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-b4bf9596-ee75-4e42-8a7a-e03f1267d09f req-ff962230-615c-4d2c-b099-47885dcdcf85 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035877 May 28 21:30:58.403051 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2753/5558] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:30:58.461400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:30:58.462852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:58.470009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:58.470476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:58.471292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:58.471746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:58.540774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:30:58.550870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:30:58.551310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:30:58.551802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:30:58.552236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:30:58.552657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:30:58.616262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3f0fe130-44cc-468b-89a4-ef3dda53c31b tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:58.617231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3f0fe130-44cc-468b-89a4-ef3dda53c31b tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:58.625961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f0fe130-44cc-468b-89a4-ef3dda53c31b tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:58.626419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f0fe130-44cc-468b-89a4-ef3dda53c31b tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:58.630151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f0fe130-44cc-468b-89a4-ef3dda53c31b tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:58.630636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f0fe130-44cc-468b-89a4-ef3dda53c31b tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:58.827377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:58.834939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:58.835495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:58.836457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:58.836976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:58.867127 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-516a8c14-a0cf-4fb5-9a06-1311b84cf7d5 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71/action" status: 202 len: 1138 microversion: 2.1 time: 0.409638 May 28 21:30:58.868142 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2806/5559] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:30:58 2022] POST /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71/action => generated 1138 bytes in 411 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) May 28 21:30:58.889608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7d501f25-29bf-4388-af77-bca6524846e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:30:58.890370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7d501f25-29bf-4388-af77-bca6524846e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:30:58.910379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d501f25-29bf-4388-af77-bca6524846e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:58.910379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d501f25-29bf-4388-af77-bca6524846e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:58.910804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d501f25-29bf-4388-af77-bca6524846e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:30:58.911238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d501f25-29bf-4388-af77-bca6524846e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:30:59.324872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3f0fe130-44cc-468b-89a4-ef3dda53c31b tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:59.330965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7d501f25-29bf-4388-af77-bca6524846e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:59.335148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3f0fe130-44cc-468b-89a4-ef3dda53c31b tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:59.337556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3f0fe130-44cc-468b-89a4-ef3dda53c31b tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:30:59.339299 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3f0fe130-44cc-468b-89a4-ef3dda53c31b tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 200 len: 1361 microversion: 2.26 time: 0.727828 May 28 21:30:59.340204 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2754/5560] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:30:58 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 1361 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:30:59.350788 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7d501f25-29bf-4388-af77-bca6524846e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1691 microversion: 2.1 time: 0.466825 May 28 21:30:59.350788 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2807/5561] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:30:58 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1691 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:31:00.361201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-50890432-7476-4b6d-8131-9cd2300013b7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:00.362935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-50890432-7476-4b6d-8131-9cd2300013b7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:00.365151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3a1f5648-ffce-445f-b340-3a131a83497f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:00.366021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3a1f5648-ffce-445f-b340-3a131a83497f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:00.378244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a1f5648-ffce-445f-b340-3a131a83497f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:00.378244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a1f5648-ffce-445f-b340-3a131a83497f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:00.379251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a1f5648-ffce-445f-b340-3a131a83497f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:00.379884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a1f5648-ffce-445f-b340-3a131a83497f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:00.388527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50890432-7476-4b6d-8131-9cd2300013b7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:00.389005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50890432-7476-4b6d-8131-9cd2300013b7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:00.389819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50890432-7476-4b6d-8131-9cd2300013b7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:00.390295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-50890432-7476-4b6d-8131-9cd2300013b7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:00.590625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3a1f5648-ffce-445f-b340-3a131a83497f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:00.599139 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3a1f5648-ffce-445f-b340-3a131a83497f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1691 microversion: 2.1 time: 0.238343 May 28 21:31:00.599721 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2808/5562] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:00 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1691 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:00.605750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-50890432-7476-4b6d-8131-9cd2300013b7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:00.614455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-50890432-7476-4b6d-8131-9cd2300013b7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:00.616044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-50890432-7476-4b6d-8131-9cd2300013b7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:00.617199 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-50890432-7476-4b6d-8131-9cd2300013b7 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 200 len: 1361 microversion: 2.26 time: 0.261944 May 28 21:31:00.617770 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2755/5563] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:00 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 1361 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:01.617402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a6127473-04af-4300-aefe-46188009f371 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:01.618163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a6127473-04af-4300-aefe-46188009f371 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:01.625566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6127473-04af-4300-aefe-46188009f371 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:01.626134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6127473-04af-4300-aefe-46188009f371 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:01.627028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6127473-04af-4300-aefe-46188009f371 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:01.628269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6127473-04af-4300-aefe-46188009f371 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:01.637948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-26dbb80d-9419-4579-8282-45cc24b12d71 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:01.638648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-26dbb80d-9419-4579-8282-45cc24b12d71 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:01.645051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26dbb80d-9419-4579-8282-45cc24b12d71 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:01.645679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26dbb80d-9419-4579-8282-45cc24b12d71 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:01.646515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26dbb80d-9419-4579-8282-45cc24b12d71 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:01.646964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26dbb80d-9419-4579-8282-45cc24b12d71 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:01.869971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a6127473-04af-4300-aefe-46188009f371 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:01.872166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-26dbb80d-9419-4579-8282-45cc24b12d71 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:01.881381 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a6127473-04af-4300-aefe-46188009f371 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1691 microversion: 2.1 time: 0.268109 May 28 21:31:01.886593 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2809/5564] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:01 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1691 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:01.888779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-26dbb80d-9419-4579-8282-45cc24b12d71 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:01.891481 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-26dbb80d-9419-4579-8282-45cc24b12d71 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:01.894113 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-26dbb80d-9419-4579-8282-45cc24b12d71 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 200 len: 1361 microversion: 2.26 time: 0.261167 May 28 21:31:01.899891 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2756/5565] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:01 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:31:02.902450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bb723775-01cf-4c2a-815d-ca0b514efeea tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:02.903104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bb723775-01cf-4c2a-815d-ca0b514efeea tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:02.914932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2057d682-6a74-44df-8531-1d5848654e64 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:02.915743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2057d682-6a74-44df-8531-1d5848654e64 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:02.921734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:02.927696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2057d682-6a74-44df-8531-1d5848654e64 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:02.928160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2057d682-6a74-44df-8531-1d5848654e64 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:02.928940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2057d682-6a74-44df-8531-1d5848654e64 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:02.929404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2057d682-6a74-44df-8531-1d5848654e64 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:02.931268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:02.933882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb723775-01cf-4c2a-815d-ca0b514efeea tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:02.934347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb723775-01cf-4c2a-815d-ca0b514efeea tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:02.935128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb723775-01cf-4c2a-815d-ca0b514efeea tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:02.935573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb723775-01cf-4c2a-815d-ca0b514efeea tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:03.163747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2057d682-6a74-44df-8531-1d5848654e64 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:03.164778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bb723775-01cf-4c2a-815d-ca0b514efeea tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:03.174104 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bb723775-01cf-4c2a-815d-ca0b514efeea tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1691 microversion: 2.1 time: 0.277885 May 28 21:31:03.183907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2057d682-6a74-44df-8531-1d5848654e64 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:03.183907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2057d682-6a74-44df-8531-1d5848654e64 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:03.183907 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2057d682-6a74-44df-8531-1d5848654e64 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 200 len: 1361 microversion: 2.26 time: 0.270966 May 28 21:31:03.183907 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2757/5566] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:02 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:31:03.194364 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2810/5567] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:02 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1691 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:04.192529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-31e9b114-a0f9-4fc3-ab21-9b8a3062c0a8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:04.193148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-31e9b114-a0f9-4fc3-ab21-9b8a3062c0a8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:04.202411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31e9b114-a0f9-4fc3-ab21-9b8a3062c0a8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:04.202874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31e9b114-a0f9-4fc3-ab21-9b8a3062c0a8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:04.204188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31e9b114-a0f9-4fc3-ab21-9b8a3062c0a8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:04.204795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-31e9b114-a0f9-4fc3-ab21-9b8a3062c0a8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:04.210557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-da348717-de5a-44e3-9f84-8c1243a341b1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:04.213988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-da348717-de5a-44e3-9f84-8c1243a341b1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:04.216945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=8 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:04.229335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da348717-de5a-44e3-9f84-8c1243a341b1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:04.231028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da348717-de5a-44e3-9f84-8c1243a341b1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:04.231930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da348717-de5a-44e3-9f84-8c1243a341b1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:04.234823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da348717-de5a-44e3-9f84-8c1243a341b1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:04.430869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-31e9b114-a0f9-4fc3-ab21-9b8a3062c0a8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:04.442062 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-31e9b114-a0f9-4fc3-ab21-9b8a3062c0a8 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1691 microversion: 2.1 time: 0.254153 May 28 21:31:04.442671 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2758/5568] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:04 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1691 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:04.475285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-da348717-de5a-44e3-9f84-8c1243a341b1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:04.495455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-da348717-de5a-44e3-9f84-8c1243a341b1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:04.495455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-da348717-de5a-44e3-9f84-8c1243a341b1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:04.495455 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-da348717-de5a-44e3-9f84-8c1243a341b1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 200 len: 1361 microversion: 2.26 time: 0.285512 May 28 21:31:04.495455 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2811/5569] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:04 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 1361 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:04.794442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a718dfb4-28d6-4617-bea0-3418bba2d17c req-23307525-3eb1-4ad7-b695-b3bf2c6110c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e51bb11-1862-4204-815f-b523cf2fc9c3", "name": "network-vif-plugged", "status": "completed", "tag": "7d9ac367-7c8b-48e8-9f2d-3b0c33c4a2d0"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:31:04.812245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a718dfb4-28d6-4617-bea0-3418bba2d17c req-23307525-3eb1-4ad7-b695-b3bf2c6110c2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:04.812963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a718dfb4-28d6-4617-bea0-3418bba2d17c req-23307525-3eb1-4ad7-b695-b3bf2c6110c2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:04.827314 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a718dfb4-28d6-4617-bea0-3418bba2d17c req-23307525-3eb1-4ad7-b695-b3bf2c6110c2 service nova] Creating event network-vif-plugged:7d9ac367-7c8b-48e8-9f2d-3b0c33c4a2d0 for instance 1e51bb11-1862-4204-815f-b523cf2fc9c3 on nch1-master-1 May 28 21:31:04.834497 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a718dfb4-28d6-4617-bea0-3418bba2d17c req-23307525-3eb1-4ad7-b695-b3bf2c6110c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046176 May 28 21:31:04.835178 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2759/5570] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:31:05.459184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1bce8f31-8940-4f74-946e-6bd5d3da76e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:05.460501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1bce8f31-8940-4f74-946e-6bd5d3da76e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:05.468951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1bce8f31-8940-4f74-946e-6bd5d3da76e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:05.469411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1bce8f31-8940-4f74-946e-6bd5d3da76e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:05.470284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1bce8f31-8940-4f74-946e-6bd5d3da76e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:05.470730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1bce8f31-8940-4f74-946e-6bd5d3da76e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:05.515937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cedd5f38-cfb8-4cd4-844b-5e0824e69ce4 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:05.519795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cedd5f38-cfb8-4cd4-844b-5e0824e69ce4 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:05.546668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cedd5f38-cfb8-4cd4-844b-5e0824e69ce4 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:05.550145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cedd5f38-cfb8-4cd4-844b-5e0824e69ce4 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:05.551052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cedd5f38-cfb8-4cd4-844b-5e0824e69ce4 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:05.551514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cedd5f38-cfb8-4cd4-844b-5e0824e69ce4 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:05.695169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1bce8f31-8940-4f74-946e-6bd5d3da76e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:05.709339 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1bce8f31-8940-4f74-946e-6bd5d3da76e0 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1691 microversion: 2.1 time: 0.253163 May 28 21:31:05.710574 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2812/5571] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:05 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1691 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:05.800033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cedd5f38-cfb8-4cd4-844b-5e0824e69ce4 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:05.817810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cedd5f38-cfb8-4cd4-844b-5e0824e69ce4 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:05.819477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cedd5f38-cfb8-4cd4-844b-5e0824e69ce4 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:05.832340 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cedd5f38-cfb8-4cd4-844b-5e0824e69ce4 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 200 len: 1361 microversion: 2.26 time: 0.309772 May 28 21:31:05.832340 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2760/5572] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:05 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 1361 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:06.728901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-258e2930-96c1-405f-b186-4897e647c451 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:06.729544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-258e2930-96c1-405f-b186-4897e647c451 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:06.738288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-258e2930-96c1-405f-b186-4897e647c451 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:06.738716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-258e2930-96c1-405f-b186-4897e647c451 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:06.739503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-258e2930-96c1-405f-b186-4897e647c451 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:06.739964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-258e2930-96c1-405f-b186-4897e647c451 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:06.846996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3815d54d-8f96-40b1-bd5c-37da7c923cca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:06.849520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3815d54d-8f96-40b1-bd5c-37da7c923cca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:06.863877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3815d54d-8f96-40b1-bd5c-37da7c923cca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:06.864691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3815d54d-8f96-40b1-bd5c-37da7c923cca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:06.865705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3815d54d-8f96-40b1-bd5c-37da7c923cca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:06.870222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3815d54d-8f96-40b1-bd5c-37da7c923cca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.024602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-258e2930-96c1-405f-b186-4897e647c451 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:07.044009 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-258e2930-96c1-405f-b186-4897e647c451 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1691 microversion: 2.1 time: 0.314253 May 28 21:31:07.045109 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2813/5573] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:06 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1691 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:07.097673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3815d54d-8f96-40b1-bd5c-37da7c923cca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:07.113165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3815d54d-8f96-40b1-bd5c-37da7c923cca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:07.114489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3815d54d-8f96-40b1-bd5c-37da7c923cca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:07.115967 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3815d54d-8f96-40b1-bd5c-37da7c923cca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 200 len: 1545 microversion: 2.26 time: 0.279791 May 28 21:31:07.116542 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2761/5574] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:06 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 1545 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:07.136621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-196fb855-180c-499b-8391-2436616d1308 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d56dbd5e0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:07.145608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-196fb855-180c-499b-8391-2436616d1308 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.146236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-196fb855-180c-499b-8391-2436616d1308 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.146989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-196fb855-180c-499b-8391-2436616d1308 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:07.154097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-196fb855-180c-499b-8391-2436616d1308 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.155326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-196fb855-180c-499b-8391-2436616d1308 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.156338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-196fb855-180c-499b-8391-2436616d1308 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.160966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-196fb855-180c-499b-8391-2436616d1308 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.204136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-196fb855-180c-499b-8391-2436616d1308 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.204767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-196fb855-180c-499b-8391-2436616d1308 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.224611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-196fb855-180c-499b-8391-2436616d1308 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.225408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-196fb855-180c-499b-8391-2436616d1308 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.366728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-196fb855-180c-499b-8391-2436616d1308 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lazy-loading 'flavor' on Instance uuid 1e51bb11-1862-4204-815f-b523cf2fc9c3 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:31:07.394764 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-196fb855-180c-499b-8391-2436616d1308 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "PUT /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-1536691066" status: 201 len: 0 microversion: 2.26 time: 0.263768 May 28 21:31:07.395447 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2814/5575] 10.222.0.33 () {62 vars in 1379 bytes} [Sat May 28 21:31:07 2022] PUT /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-1536691066 => generated 0 bytes in 265 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) May 28 21:31:07.406080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0f6c653e-2038-4018-8a39-2c80c5e43952 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d56bc8ca0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:07.418532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f6c653e-2038-4018-8a39-2c80c5e43952 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.423073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f6c653e-2038-4018-8a39-2c80c5e43952 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.445561 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0f6c653e-2038-4018-8a39-2c80c5e43952 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-1536691066" status: 204 len: 0 microversion: 2.26 time: 0.044636 May 28 21:31:07.446939 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2762/5576] 10.222.0.33 () {60 vars in 1360 bytes} [Sat May 28 21:31:07 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-1536691066 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:31:07.455380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aea529cc-10e8-4bc5-8a7f-e99c2c1c9f9c tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d56ce6430>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:07.464748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea529cc-10e8-4bc5-8a7f-e99c2c1c9f9c tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.465467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea529cc-10e8-4bc5-8a7f-e99c2c1c9f9c tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.469292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aea529cc-10e8-4bc5-8a7f-e99c2c1c9f9c tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:07.476639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea529cc-10e8-4bc5-8a7f-e99c2c1c9f9c tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.477473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea529cc-10e8-4bc5-8a7f-e99c2c1c9f9c tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.478993 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea529cc-10e8-4bc5-8a7f-e99c2c1c9f9c tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.479731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea529cc-10e8-4bc5-8a7f-e99c2c1c9f9c tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.508973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea529cc-10e8-4bc5-8a7f-e99c2c1c9f9c tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.509700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aea529cc-10e8-4bc5-8a7f-e99c2c1c9f9c tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.573165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2c4c2da4-2f69-4623-ba39-eed86a17b66c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:07.574066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2c4c2da4-2f69-4623-ba39-eed86a17b66c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:07.582580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c4c2da4-2f69-4623-ba39-eed86a17b66c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.583313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c4c2da4-2f69-4623-ba39-eed86a17b66c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.584308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c4c2da4-2f69-4623-ba39-eed86a17b66c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.584940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c4c2da4-2f69-4623-ba39-eed86a17b66c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.616850 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2c4c2da4-2f69-4623-ba39-eed86a17b66c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047864 May 28 21:31:07.617427 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2763/5577] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:31:07 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 28 21:31:07.653360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-aea529cc-10e8-4bc5-8a7f-e99c2c1c9f9c tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lazy-loading 'flavor' on Instance uuid 1e51bb11-1862-4204-815f-b523cf2fc9c3 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:31:07.684738 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aea529cc-10e8-4bc5-8a7f-e99c2c1c9f9c tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags" status: 204 len: 0 microversion: 2.26 time: 0.233390 May 28 21:31:07.690929 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2815/5578] 10.222.0.33 () {60 vars in 1294 bytes} [Sat May 28 21:31:07 2022] DELETE /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:31:07.695763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5ac12c36-c84d-42db-aa39-2521df64940f tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d56ddf550>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:07.704217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ac12c36-c84d-42db-aa39-2521df64940f tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.705333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ac12c36-c84d-42db-aa39-2521df64940f tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.718825 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5ac12c36-c84d-42db-aa39-2521df64940f tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags" status: 200 len: 12 microversion: 2.26 time: 0.027612 May 28 21:31:07.719918 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2764/5579] 10.222.0.33 () {60 vars in 1291 bytes} [Sat May 28 21:31:07 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags => generated 12 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:07.731097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c4df02de-8c59-4210-9265-e2ead81e6b66 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d56dbd8b0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:07.745760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7303bcae-301f-44bc-a83c-ee73bd2b0a52 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:07.746351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7303bcae-301f-44bc-a83c-ee73bd2b0a52 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:07.748259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4df02de-8c59-4210-9265-e2ead81e6b66 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.748752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4df02de-8c59-4210-9265-e2ead81e6b66 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.749252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c4df02de-8c59-4210-9265-e2ead81e6b66 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:07.758751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7303bcae-301f-44bc-a83c-ee73bd2b0a52 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.759420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7303bcae-301f-44bc-a83c-ee73bd2b0a52 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.764195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7303bcae-301f-44bc-a83c-ee73bd2b0a52 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.764195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7303bcae-301f-44bc-a83c-ee73bd2b0a52 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.765184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4df02de-8c59-4210-9265-e2ead81e6b66 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.766906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4df02de-8c59-4210-9265-e2ead81e6b66 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.766906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4df02de-8c59-4210-9265-e2ead81e6b66 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.766906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4df02de-8c59-4210-9265-e2ead81e6b66 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.795039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7303bcae-301f-44bc-a83c-ee73bd2b0a52 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:31:07.795788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4df02de-8c59-4210-9265-e2ead81e6b66 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.796258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4df02de-8c59-4210-9265-e2ead81e6b66 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.806878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4df02de-8c59-4210-9265-e2ead81e6b66 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:07.807387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4df02de-8c59-4210-9265-e2ead81e6b66 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:07.961584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-c4df02de-8c59-4210-9265-e2ead81e6b66 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lazy-loading 'flavor' on Instance uuid 1e51bb11-1862-4204-815f-b523cf2fc9c3 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:31:07.976290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:07.992477 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c4df02de-8c59-4210-9265-e2ead81e6b66 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "PUT /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-1076035938" status: 201 len: 0 microversion: 2.26 time: 0.264055 May 28 21:31:07.994175 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2816/5580] 10.222.0.33 () {62 vars in 1379 bytes} [Sat May 28 21:31:07 2022] PUT /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-1076035938 => generated 0 bytes in 269 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 28 21:31:08.008257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8407bf34-ba0f-4266-b40d-0aacfae268be tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d56dbdee0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:08.020301 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8407bf34-ba0f-4266-b40d-0aacfae268be tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.021389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8407bf34-ba0f-4266-b40d-0aacfae268be tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.052604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:08.066412 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8407bf34-ba0f-4266-b40d-0aacfae268be tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags" status: 200 len: 36 microversion: 2.26 time: 0.064611 May 28 21:31:08.068868 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2817/5581] 10.222.0.33 () {60 vars in 1291 bytes} [Sat May 28 21:31:07 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags => generated 36 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:08.083718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-37d98367-1f34-4bdb-8313-b2b016b3aee6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:08.089814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-37d98367-1f34-4bdb-8313-b2b016b3aee6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:08.115633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37d98367-1f34-4bdb-8313-b2b016b3aee6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.116369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37d98367-1f34-4bdb-8313-b2b016b3aee6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.117358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37d98367-1f34-4bdb-8313-b2b016b3aee6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.118584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-37d98367-1f34-4bdb-8313-b2b016b3aee6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.218479 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7303bcae-301f-44bc-a83c-ee73bd2b0a52 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 204 len: 0 microversion: 2.1 time: 0.480051 May 28 21:31:08.222424 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2765/5582] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:31:07 2022] DELETE /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:31:08.229134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9962f023-a30d-47c8-a87a-986adecc5c61 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d56bc8280>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:08.246693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9962f023-a30d-47c8-a87a-986adecc5c61 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.247160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9962f023-a30d-47c8-a87a-986adecc5c61 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.247767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9962f023-a30d-47c8-a87a-986adecc5c61 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:08.269803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9962f023-a30d-47c8-a87a-986adecc5c61 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.270554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9962f023-a30d-47c8-a87a-986adecc5c61 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.271405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9962f023-a30d-47c8-a87a-986adecc5c61 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.274324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9962f023-a30d-47c8-a87a-986adecc5c61 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.319442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9962f023-a30d-47c8-a87a-986adecc5c61 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.319894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9962f023-a30d-47c8-a87a-986adecc5c61 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.420503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-37d98367-1f34-4bdb-8313-b2b016b3aee6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:08.428545 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-37d98367-1f34-4bdb-8313-b2b016b3aee6 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1691 microversion: 2.1 time: 0.358388 May 28 21:31:08.432047 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2818/5583] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:08 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1691 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:08.441426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ba3d7e14-9ef5-4230-ba24-30f4113216a6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:08.442966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ba3d7e14-9ef5-4230-ba24-30f4113216a6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:08.456325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba3d7e14-9ef5-4230-ba24-30f4113216a6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.456650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba3d7e14-9ef5-4230-ba24-30f4113216a6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.467937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba3d7e14-9ef5-4230-ba24-30f4113216a6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.468509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba3d7e14-9ef5-4230-ba24-30f4113216a6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.468752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-9962f023-a30d-47c8-a87a-986adecc5c61 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lazy-loading 'flavor' on Instance uuid 1e51bb11-1862-4204-815f-b523cf2fc9c3 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:31:08.499705 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9962f023-a30d-47c8-a87a-986adecc5c61 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-1076035938" status: 204 len: 0 microversion: 2.26 time: 0.278040 May 28 21:31:08.503980 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2766/5584] 10.222.0.33 () {60 vars in 1363 bytes} [Sat May 28 21:31:08 2022] DELETE /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-1076035938 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:31:08.522857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-17ecc321-160a-4f96-9f49-57a2fcab68c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d56ddf280>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:08.564719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-17ecc321-160a-4f96-9f49-57a2fcab68c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.564719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-17ecc321-160a-4f96-9f49-57a2fcab68c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.571646 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-17ecc321-160a-4f96-9f49-57a2fcab68c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags" status: 200 len: 12 microversion: 2.26 time: 0.063270 May 28 21:31:08.574958 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2767/5585] 10.222.0.33 () {60 vars in 1291 bytes} [Sat May 28 21:31:08 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags => generated 12 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:08.583160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-43071b4e-8c8b-405c-b396-0496a2022416 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d56bbf310>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:08.603005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43071b4e-8c8b-405c-b396-0496a2022416 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.610805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43071b4e-8c8b-405c-b396-0496a2022416 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.611607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-43071b4e-8c8b-405c-b396-0496a2022416 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:08.620977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43071b4e-8c8b-405c-b396-0496a2022416 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.621748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43071b4e-8c8b-405c-b396-0496a2022416 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.622756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43071b4e-8c8b-405c-b396-0496a2022416 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.623373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43071b4e-8c8b-405c-b396-0496a2022416 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.654140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43071b4e-8c8b-405c-b396-0496a2022416 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.655133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-43071b4e-8c8b-405c-b396-0496a2022416 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.679446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-43071b4e-8c8b-405c-b396-0496a2022416 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lazy-loading 'flavor' on Instance uuid 1e51bb11-1862-4204-815f-b523cf2fc9c3 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:31:08.697910 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-43071b4e-8c8b-405c-b396-0496a2022416 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags" status: 204 len: 0 microversion: 2.26 time: 0.118964 May 28 21:31:08.699092 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2768/5586] 10.222.0.33 () {60 vars in 1294 bytes} [Sat May 28 21:31:08 2022] DELETE /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:31:08.709402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c7297d85-fb2e-41bc-8495-98f3f6466d5d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d56dafb80>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:08.719901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7297d85-fb2e-41bc-8495-98f3f6466d5d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.720856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7297d85-fb2e-41bc-8495-98f3f6466d5d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.722053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c7297d85-fb2e-41bc-8495-98f3f6466d5d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:08.730511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7297d85-fb2e-41bc-8495-98f3f6466d5d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.731205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7297d85-fb2e-41bc-8495-98f3f6466d5d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.732139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7297d85-fb2e-41bc-8495-98f3f6466d5d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.732726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7297d85-fb2e-41bc-8495-98f3f6466d5d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.773886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7297d85-fb2e-41bc-8495-98f3f6466d5d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.775740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7297d85-fb2e-41bc-8495-98f3f6466d5d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.787300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7297d85-fb2e-41bc-8495-98f3f6466d5d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.787680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7297d85-fb2e-41bc-8495-98f3f6466d5d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.797604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ba3d7e14-9ef5-4230-ba24-30f4113216a6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:08.807516 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ba3d7e14-9ef5-4230-ba24-30f4113216a6 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1674 microversion: 2.1 time: 0.374450 May 28 21:31:08.808121 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2819/5587] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:08 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1674 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:08.926349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-c7297d85-fb2e-41bc-8495-98f3f6466d5d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lazy-loading 'flavor' on Instance uuid 1e51bb11-1862-4204-815f-b523cf2fc9c3 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:31:08.945376 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c7297d85-fb2e-41bc-8495-98f3f6466d5d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "PUT /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-2070738575" status: 201 len: 0 microversion: 2.26 time: 0.240992 May 28 21:31:08.946133 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2769/5588] 10.222.0.33 () {62 vars in 1379 bytes} [Sat May 28 21:31:08 2022] PUT /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-2070738575 => generated 0 bytes in 243 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) May 28 21:31:08.957338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c634b859-69e4-4907-9a46-d8bee06a3273 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d56cc4a60>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:08.968995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c634b859-69e4-4907-9a46-d8bee06a3273 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.969668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c634b859-69e4-4907-9a46-d8bee06a3273 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.970680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c634b859-69e4-4907-9a46-d8bee06a3273 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:08.977964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c634b859-69e4-4907-9a46-d8bee06a3273 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.978631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c634b859-69e4-4907-9a46-d8bee06a3273 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:08.979420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c634b859-69e4-4907-9a46-d8bee06a3273 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:08.980086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c634b859-69e4-4907-9a46-d8bee06a3273 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.006828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c634b859-69e4-4907-9a46-d8bee06a3273 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.007527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c634b859-69e4-4907-9a46-d8bee06a3273 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.022489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c634b859-69e4-4907-9a46-d8bee06a3273 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.023245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c634b859-69e4-4907-9a46-d8bee06a3273 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.123866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-c634b859-69e4-4907-9a46-d8bee06a3273 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lazy-loading 'flavor' on Instance uuid 1e51bb11-1862-4204-815f-b523cf2fc9c3 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:31:09.141858 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c634b859-69e4-4907-9a46-d8bee06a3273 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "PUT /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-1168058598" status: 201 len: 0 microversion: 2.26 time: 0.190286 May 28 21:31:09.142777 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2820/5589] 10.222.0.33 () {62 vars in 1379 bytes} [Sat May 28 21:31:08 2022] PUT /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-1168058598 => generated 0 bytes in 192 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) May 28 21:31:09.159279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-57fdc0a6-724d-41e7-be5e-c97c57de604e tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d56d54af0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:09.165223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57fdc0a6-724d-41e7-be5e-c97c57de604e tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.165678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57fdc0a6-724d-41e7-be5e-c97c57de604e tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.166211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-57fdc0a6-724d-41e7-be5e-c97c57de604e tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:09.172892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57fdc0a6-724d-41e7-be5e-c97c57de604e tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.173347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57fdc0a6-724d-41e7-be5e-c97c57de604e tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.174147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57fdc0a6-724d-41e7-be5e-c97c57de604e tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.174649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57fdc0a6-724d-41e7-be5e-c97c57de604e tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.203327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57fdc0a6-724d-41e7-be5e-c97c57de604e tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.203898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-57fdc0a6-724d-41e7-be5e-c97c57de604e tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.294487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-57fdc0a6-724d-41e7-be5e-c97c57de604e tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lazy-loading 'flavor' on Instance uuid 1e51bb11-1862-4204-815f-b523cf2fc9c3 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:31:09.313051 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-57fdc0a6-724d-41e7-be5e-c97c57de604e tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags" status: 204 len: 0 microversion: 2.26 time: 0.162552 May 28 21:31:09.313887 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2770/5590] 10.222.0.33 () {60 vars in 1294 bytes} [Sat May 28 21:31:09 2022] DELETE /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:31:09.343579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0d878cc3-2d4f-41bd-83f5-eb88999b8715 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d57800f70>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:09.354674 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d878cc3-2d4f-41bd-83f5-eb88999b8715 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.355165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0d878cc3-2d4f-41bd-83f5-eb88999b8715 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.364872 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0d878cc3-2d4f-41bd-83f5-eb88999b8715 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags" status: 200 len: 12 microversion: 2.26 time: 0.044938 May 28 21:31:09.365884 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2821/5591] 10.222.0.33 () {60 vars in 1291 bytes} [Sat May 28 21:31:09 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags => generated 12 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:09.376289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-933a4966-ce66-4a3d-a2a5-34b2b2ab61c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d56d839d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:09.386043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-933a4966-ce66-4a3d-a2a5-34b2b2ab61c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.387013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-933a4966-ce66-4a3d-a2a5-34b2b2ab61c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.388225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-933a4966-ce66-4a3d-a2a5-34b2b2ab61c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:09.396414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-933a4966-ce66-4a3d-a2a5-34b2b2ab61c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.396903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-933a4966-ce66-4a3d-a2a5-34b2b2ab61c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.397697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-933a4966-ce66-4a3d-a2a5-34b2b2ab61c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.398233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-933a4966-ce66-4a3d-a2a5-34b2b2ab61c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.434230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-933a4966-ce66-4a3d-a2a5-34b2b2ab61c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.435054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-933a4966-ce66-4a3d-a2a5-34b2b2ab61c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.448462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4cf40107-0aa7-497f-97c9-c2cd03041d0d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:09.449083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4cf40107-0aa7-497f-97c9-c2cd03041d0d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:09.458535 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4cf40107-0aa7-497f-97c9-c2cd03041d0d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.458995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4cf40107-0aa7-497f-97c9-c2cd03041d0d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.459645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-933a4966-ce66-4a3d-a2a5-34b2b2ab61c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lazy-loading 'flavor' on Instance uuid 1e51bb11-1862-4204-815f-b523cf2fc9c3 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:31:09.466843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4cf40107-0aa7-497f-97c9-c2cd03041d0d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.467321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4cf40107-0aa7-497f-97c9-c2cd03041d0d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.483576 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-933a4966-ce66-4a3d-a2a5-34b2b2ab61c1 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags" status: 204 len: 0 microversion: 2.26 time: 0.110913 May 28 21:31:09.485477 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2771/5592] 10.222.0.33 () {60 vars in 1294 bytes} [Sat May 28 21:31:09 2022] DELETE /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:31:09.495500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f8d84e07-0d49-4676-95f3-a312a1ec5a2d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d573dc4c0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:09.498131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:09.509991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8d84e07-0d49-4676-95f3-a312a1ec5a2d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.514225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8d84e07-0d49-4676-95f3-a312a1ec5a2d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.514833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f8d84e07-0d49-4676-95f3-a312a1ec5a2d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:09.525641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8d84e07-0d49-4676-95f3-a312a1ec5a2d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.529209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8d84e07-0d49-4676-95f3-a312a1ec5a2d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.530100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8d84e07-0d49-4676-95f3-a312a1ec5a2d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.530562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8d84e07-0d49-4676-95f3-a312a1ec5a2d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.587364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8d84e07-0d49-4676-95f3-a312a1ec5a2d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.587933 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8d84e07-0d49-4676-95f3-a312a1ec5a2d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.603041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8d84e07-0d49-4676-95f3-a312a1ec5a2d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.603576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8d84e07-0d49-4676-95f3-a312a1ec5a2d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.685405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4cf40107-0aa7-497f-97c9-c2cd03041d0d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:09.699133 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4cf40107-0aa7-497f-97c9-c2cd03041d0d tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1691 microversion: 2.1 time: 0.254453 May 28 21:31:09.710282 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2822/5593] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:09 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1691 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:31:09.763436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-f8d84e07-0d49-4676-95f3-a312a1ec5a2d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lazy-loading 'flavor' on Instance uuid 1e51bb11-1862-4204-815f-b523cf2fc9c3 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:31:09.780543 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f8d84e07-0d49-4676-95f3-a312a1ec5a2d tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "PUT /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-597938244" status: 201 len: 0 microversion: 2.26 time: 0.289143 May 28 21:31:09.791014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c2a126a0-826a-48c0-bf53-9e6d4a390757 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d572d1a60>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:09.800178 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2772/5594] 10.222.0.33 () {62 vars in 1376 bytes} [Sat May 28 21:31:09 2022] PUT /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-597938244 => generated 0 bytes in 310 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) May 28 21:31:09.808839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2a126a0-826a-48c0-bf53-9e6d4a390757 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.808839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2a126a0-826a-48c0-bf53-9e6d4a390757 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.808839 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c2a126a0-826a-48c0-bf53-9e6d4a390757 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:09.815458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2a126a0-826a-48c0-bf53-9e6d4a390757 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.816572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2a126a0-826a-48c0-bf53-9e6d4a390757 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.817436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2a126a0-826a-48c0-bf53-9e6d4a390757 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.819418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2a126a0-826a-48c0-bf53-9e6d4a390757 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.824724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-caa341e4-a88a-4f9a-9a68-7f84869ffc18 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:09.825347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-caa341e4-a88a-4f9a-9a68-7f84869ffc18 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:09.836758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-caa341e4-a88a-4f9a-9a68-7f84869ffc18 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.837223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-caa341e4-a88a-4f9a-9a68-7f84869ffc18 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.841966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-caa341e4-a88a-4f9a-9a68-7f84869ffc18 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.842700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-caa341e4-a88a-4f9a-9a68-7f84869ffc18 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.862919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2a126a0-826a-48c0-bf53-9e6d4a390757 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.863385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2a126a0-826a-48c0-bf53-9e6d4a390757 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:09.874923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2a126a0-826a-48c0-bf53-9e6d4a390757 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:09.875850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c2a126a0-826a-48c0-bf53-9e6d4a390757 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:10.002116 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-c2a126a0-826a-48c0-bf53-9e6d4a390757 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lazy-loading 'flavor' on Instance uuid 1e51bb11-1862-4204-815f-b523cf2fc9c3 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:31:10.042479 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c2a126a0-826a-48c0-bf53-9e6d4a390757 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "PUT /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-1449268550" status: 201 len: 0 microversion: 2.26 time: 0.252090 May 28 21:31:10.043672 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2823/5595] 10.222.0.33 () {62 vars in 1379 bytes} [Sat May 28 21:31:09 2022] PUT /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags/tempest-tag-1449268550 => generated 0 bytes in 257 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) May 28 21:31:10.047611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-caa341e4-a88a-4f9a-9a68-7f84869ffc18 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:10.060031 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-caa341e4-a88a-4f9a-9a68-7f84869ffc18 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1674 microversion: 2.1 time: 0.238704 May 28 21:31:10.060830 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2773/5596] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:09 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1674 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:31:10.061368 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f0893627-bc6c-4b68-ab6f-370d6ffedd19 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Action: 'update_all', calling method: .version_select at 0x7f4d572d11f0>, body: {"tags": ["tempest-tag-1677270725", "tempest-tag-1738816112"]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:31:10.081967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0893627-bc6c-4b68-ab6f-370d6ffedd19 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:10.082434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0893627-bc6c-4b68-ab6f-370d6ffedd19 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:10.082925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f0893627-bc6c-4b68-ab6f-370d6ffedd19 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:10.105095 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0893627-bc6c-4b68-ab6f-370d6ffedd19 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:10.105568 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0893627-bc6c-4b68-ab6f-370d6ffedd19 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:10.106410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0893627-bc6c-4b68-ab6f-370d6ffedd19 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:10.107201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0893627-bc6c-4b68-ab6f-370d6ffedd19 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:10.131545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0893627-bc6c-4b68-ab6f-370d6ffedd19 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:10.132188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f0893627-bc6c-4b68-ab6f-370d6ffedd19 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:10.276660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-f0893627-bc6c-4b68-ab6f-370d6ffedd19 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lazy-loading 'flavor' on Instance uuid 1e51bb11-1862-4204-815f-b523cf2fc9c3 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:31:10.303623 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f0893627-bc6c-4b68-ab6f-370d6ffedd19 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "PUT /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags" status: 200 len: 62 microversion: 2.26 time: 0.248291 May 28 21:31:10.308692 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2824/5597] 10.222.0.33 () {62 vars in 1311 bytes} [Sat May 28 21:31:10 2022] PUT /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags => generated 62 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:10.314954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6094988c-9ca8-44d1-9ad6-f90e89391a2a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d56bc7820>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:10.323641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6094988c-9ca8-44d1-9ad6-f90e89391a2a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:10.324096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6094988c-9ca8-44d1-9ad6-f90e89391a2a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:10.333814 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6094988c-9ca8-44d1-9ad6-f90e89391a2a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags" status: 200 len: 62 microversion: 2.26 time: 0.023644 May 28 21:31:10.334699 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2774/5598] 10.222.0.33 () {60 vars in 1291 bytes} [Sat May 28 21:31:10 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags => generated 62 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:10.344874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8c902eb8-3cb9-4be9-bc5e-c27450ee692a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '.version_select at 0x7f4d570bb4c0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:10.347461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:10.354764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c902eb8-3cb9-4be9-bc5e-c27450ee692a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:10.358686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c902eb8-3cb9-4be9-bc5e-c27450ee692a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:10.358686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8c902eb8-3cb9-4be9-bc5e-c27450ee692a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:10.361504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c902eb8-3cb9-4be9-bc5e-c27450ee692a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:10.362672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c902eb8-3cb9-4be9-bc5e-c27450ee692a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:10.363568 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c902eb8-3cb9-4be9-bc5e-c27450ee692a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:10.364023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c902eb8-3cb9-4be9-bc5e-c27450ee692a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:10.393701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c902eb8-3cb9-4be9-bc5e-c27450ee692a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:10.394447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c902eb8-3cb9-4be9-bc5e-c27450ee692a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:10.482956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-8c902eb8-3cb9-4be9-bc5e-c27450ee692a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lazy-loading 'flavor' on Instance uuid 1e51bb11-1862-4204-815f-b523cf2fc9c3 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:31:10.502564 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8c902eb8-3cb9-4be9-bc5e-c27450ee692a tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags" status: 204 len: 0 microversion: 2.26 time: 0.159237 May 28 21:31:10.502564 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2825/5599] 10.222.0.33 () {60 vars in 1294 bytes} [Sat May 28 21:31:10 2022] DELETE /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3/tags => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:31:10.510620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8641d867-b449-41f1-84ed-09c558436804 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:10.511135 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8641d867-b449-41f1-84ed-09c558436804 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:10.524035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8641d867-b449-41f1-84ed-09c558436804 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:10.524693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8641d867-b449-41f1-84ed-09c558436804 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:10.525598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8641d867-b449-41f1-84ed-09c558436804 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:10.526191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8641d867-b449-41f1-84ed-09c558436804 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:10.567413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8641d867-b449-41f1-84ed-09c558436804 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:31:10.717246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-261f708c-53b4-4f64-a8db-2702d98f9629 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:10.717907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-261f708c-53b4-4f64-a8db-2702d98f9629 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:10.725590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-261f708c-53b4-4f64-a8db-2702d98f9629 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:10.726099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-261f708c-53b4-4f64-a8db-2702d98f9629 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:10.726890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-261f708c-53b4-4f64-a8db-2702d98f9629 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:10.727339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-261f708c-53b4-4f64-a8db-2702d98f9629 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:10.896628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-261f708c-53b4-4f64-a8db-2702d98f9629 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:10.905616 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-261f708c-53b4-4f64-a8db-2702d98f9629 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1691 microversion: 2.1 time: 0.192912 May 28 21:31:10.905777 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8641d867-b449-41f1-84ed-09c558436804 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 204 len: 0 microversion: 2.26 time: 0.396677 May 28 21:31:10.906754 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2826/5600] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:10 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1691 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:31:10.907818 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2775/5601] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:31:10 2022] DELETE /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:31:10.918991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3f618c45-c480-4959-8f6e-3738d4d741f9 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:10.919611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3f618c45-c480-4959-8f6e-3738d4d741f9 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:10.928061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f618c45-c480-4959-8f6e-3738d4d741f9 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:10.928788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f618c45-c480-4959-8f6e-3738d4d741f9 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:10.929583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f618c45-c480-4959-8f6e-3738d4d741f9 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:10.930207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f618c45-c480-4959-8f6e-3738d4d741f9 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:11.080829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-25efc545-1b34-4101-a888-2ba8780f3a1f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:11.081549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-25efc545-1b34-4101-a888-2ba8780f3a1f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:11.089822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25efc545-1b34-4101-a888-2ba8780f3a1f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:11.090306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25efc545-1b34-4101-a888-2ba8780f3a1f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:11.091369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25efc545-1b34-4101-a888-2ba8780f3a1f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:11.092516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-25efc545-1b34-4101-a888-2ba8780f3a1f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:11.127971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3f618c45-c480-4959-8f6e-3738d4d741f9 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:11.138173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3f618c45-c480-4959-8f6e-3738d4d741f9 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:11.139954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3f618c45-c480-4959-8f6e-3738d4d741f9 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:11.141623 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3f618c45-c480-4959-8f6e-3738d4d741f9 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 200 len: 1551 microversion: 2.26 time: 0.227212 May 28 21:31:11.153340 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2827/5602] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:10 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 1551 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:11.333055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-25efc545-1b34-4101-a888-2ba8780f3a1f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:11.345714 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-25efc545-1b34-4101-a888-2ba8780f3a1f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1674 microversion: 2.1 time: 0.271014 May 28 21:31:11.348412 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2776/5603] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:11 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1674 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:11.926352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b443ba9b-1760-4dee-b51d-02815316936f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:11.926982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b443ba9b-1760-4dee-b51d-02815316936f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:11.943504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b443ba9b-1760-4dee-b51d-02815316936f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:11.947396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b443ba9b-1760-4dee-b51d-02815316936f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:11.950136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b443ba9b-1760-4dee-b51d-02815316936f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:11.951983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b443ba9b-1760-4dee-b51d-02815316936f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:12.161752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-766b14d6-44dc-4aa6-85bf-d6e25702f949 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:12.162655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-766b14d6-44dc-4aa6-85bf-d6e25702f949 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:12.166846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=89,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:12.171458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b443ba9b-1760-4dee-b51d-02815316936f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:12.180690 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b443ba9b-1760-4dee-b51d-02815316936f tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1697 microversion: 2.1 time: 0.260149 May 28 21:31:12.182883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-766b14d6-44dc-4aa6-85bf-d6e25702f949 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:12.183554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-766b14d6-44dc-4aa6-85bf-d6e25702f949 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:12.184532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-766b14d6-44dc-4aa6-85bf-d6e25702f949 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:12.186363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-766b14d6-44dc-4aa6-85bf-d6e25702f949 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:12.194489 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2828/5604] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:11 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1697 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:12.295649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-7e5f0587-cb7d-4a75-8ee3-45b3994b4d3b req-52a8f76e-8c79-4f6c-98d1-c524f540e8f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3733dc91-2f81-4efc-a391-73a96ee6ee44", "name": "network-vif-deleted", "tag": "783b2061-7d11-4de9-a5c2-51f878cf481e"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:31:12.317789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7e5f0587-cb7d-4a75-8ee3-45b3994b4d3b req-52a8f76e-8c79-4f6c-98d1-c524f540e8f3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:12.321770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7e5f0587-cb7d-4a75-8ee3-45b3994b4d3b req-52a8f76e-8c79-4f6c-98d1-c524f540e8f3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:12.357393 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-7e5f0587-cb7d-4a75-8ee3-45b3994b4d3b req-52a8f76e-8c79-4f6c-98d1-c524f540e8f3 service nova] Creating event network-vif-deleted:783b2061-7d11-4de9-a5c2-51f878cf481e for instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 on nch2-master-1 May 28 21:31:12.399579 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-7e5f0587-cb7d-4a75-8ee3-45b3994b4d3b req-52a8f76e-8c79-4f6c-98d1-c524f540e8f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100736 May 28 21:31:12.400282 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2829/5605] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:31:12.433521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-111a9b7e-5e36-4161-bcd9-c0d127c354ee tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:12.436651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-111a9b7e-5e36-4161-bcd9-c0d127c354ee tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:12.453768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-111a9b7e-5e36-4161-bcd9-c0d127c354ee tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:12.454518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-111a9b7e-5e36-4161-bcd9-c0d127c354ee tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:12.460571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-111a9b7e-5e36-4161-bcd9-c0d127c354ee tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:12.461226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-111a9b7e-5e36-4161-bcd9-c0d127c354ee tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:12.733298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-111a9b7e-5e36-4161-bcd9-c0d127c354ee tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:12.741748 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-111a9b7e-5e36-4161-bcd9-c0d127c354ee tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1606 microversion: 2.1 time: 0.336160 May 28 21:31:12.743803 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2830/5606] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:12 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1606 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:12.974450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-766b14d6-44dc-4aa6-85bf-d6e25702f949 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:12.990900 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-766b14d6-44dc-4aa6-85bf-d6e25702f949 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:12.995522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-766b14d6-44dc-4aa6-85bf-d6e25702f949 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:12.996833 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-766b14d6-44dc-4aa6-85bf-d6e25702f949 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 200 len: 1551 microversion: 2.26 time: 0.840139 May 28 21:31:13.003757 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2777/5607] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:12 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 1551 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:31:13.202053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7565fc05-2420-40f5-8032-653345813b85 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:13.203407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7565fc05-2420-40f5-8032-653345813b85 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:13.216509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7565fc05-2420-40f5-8032-653345813b85 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:13.218692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7565fc05-2420-40f5-8032-653345813b85 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:13.222859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7565fc05-2420-40f5-8032-653345813b85 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:13.226206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7565fc05-2420-40f5-8032-653345813b85 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:13.670775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a58cfabc-db49-4fd5-9524-a80713f6222b req-15ecaf8b-b85f-49bb-afec-138831c46054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e51bb11-1862-4204-815f-b523cf2fc9c3", "name": "network-vif-deleted", "tag": "7d9ac367-7c8b-48e8-9f2d-3b0c33c4a2d0"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:31:13.697190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a58cfabc-db49-4fd5-9524-a80713f6222b req-15ecaf8b-b85f-49bb-afec-138831c46054 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:13.699675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a58cfabc-db49-4fd5-9524-a80713f6222b req-15ecaf8b-b85f-49bb-afec-138831c46054 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:13.711086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7565fc05-2420-40f5-8032-653345813b85 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:13.718704 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a58cfabc-db49-4fd5-9524-a80713f6222b req-15ecaf8b-b85f-49bb-afec-138831c46054 service nova] Creating event network-vif-deleted:7d9ac367-7c8b-48e8-9f2d-3b0c33c4a2d0 for instance 1e51bb11-1862-4204-815f-b523cf2fc9c3 on nch1-master-1 May 28 21:31:13.722385 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7565fc05-2420-40f5-8032-653345813b85 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1697 microversion: 2.1 time: 0.524388 May 28 21:31:13.727754 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a58cfabc-db49-4fd5-9524-a80713f6222b req-15ecaf8b-b85f-49bb-afec-138831c46054 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070607 May 28 21:31:13.731120 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2778/5608] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:31:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:31:13.738512 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2831/5609] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:13 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1697 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:13.764346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-91051e64-110d-4d70-8169-06e5c0e4753e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:13.765055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-91051e64-110d-4d70-8169-06e5c0e4753e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:13.801885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91051e64-110d-4d70-8169-06e5c0e4753e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:13.802754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91051e64-110d-4d70-8169-06e5c0e4753e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:13.803588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91051e64-110d-4d70-8169-06e5c0e4753e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:13.804793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91051e64-110d-4d70-8169-06e5c0e4753e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:13.873020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91051e64-110d-4d70-8169-06e5c0e4753e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:13.873487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91051e64-110d-4d70-8169-06e5c0e4753e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:13.873980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-91051e64-110d-4d70-8169-06e5c0e4753e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lazy-loading 'fault' on Instance uuid 3733dc91-2f81-4efc-a391-73a96ee6ee44 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:31:13.939883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-91051e64-110d-4d70-8169-06e5c0e4753e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:13.953757 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-91051e64-110d-4d70-8169-06e5c0e4753e tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 200 len: 1328 microversion: 2.1 time: 0.194475 May 28 21:31:13.956638 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2779/5610] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:13 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 1328 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:14.026939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-880096e7-f04e-4177-8cf7-25538669d1ca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:14.028963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-880096e7-f04e-4177-8cf7-25538669d1ca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:14.062539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-880096e7-f04e-4177-8cf7-25538669d1ca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:14.062998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-880096e7-f04e-4177-8cf7-25538669d1ca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:14.066578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-880096e7-f04e-4177-8cf7-25538669d1ca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:14.068315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-880096e7-f04e-4177-8cf7-25538669d1ca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:14.240877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-880096e7-f04e-4177-8cf7-25538669d1ca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:14.263347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-880096e7-f04e-4177-8cf7-25538669d1ca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:14.275975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-880096e7-f04e-4177-8cf7-25538669d1ca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c08e8a164d3248188ce965d1a9e04f03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b98e2ebc3d3b4e7083b9c429628ce69f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:14.280568 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-880096e7-f04e-4177-8cf7-25538669d1ca tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 200 len: 1346 microversion: 2.26 time: 0.263631 May 28 21:31:14.306721 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2832/5611] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:14 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 1346 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:14.741809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a668afdf-6210-453c-bd60-0c7be801b7b9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:14.743327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a668afdf-6210-453c-bd60-0c7be801b7b9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:14.751786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a668afdf-6210-453c-bd60-0c7be801b7b9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:14.758468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a668afdf-6210-453c-bd60-0c7be801b7b9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:14.759538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a668afdf-6210-453c-bd60-0c7be801b7b9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:14.760396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a668afdf-6210-453c-bd60-0c7be801b7b9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:14.972282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-375e81d6-048b-4b38-b439-3730d5d2f166 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:14.973494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-375e81d6-048b-4b38-b439-3730d5d2f166 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:14.991098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-375e81d6-048b-4b38-b439-3730d5d2f166 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:14.991571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-375e81d6-048b-4b38-b439-3730d5d2f166 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:14.992380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-375e81d6-048b-4b38-b439-3730d5d2f166 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:14.993228 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-375e81d6-048b-4b38-b439-3730d5d2f166 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:15.009655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a668afdf-6210-453c-bd60-0c7be801b7b9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:15.021627 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a668afdf-6210-453c-bd60-0c7be801b7b9 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1682 microversion: 2.1 time: 0.284962 May 28 21:31:15.031970 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2780/5612] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:14 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1682 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:15.040895 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-375e81d6-048b-4b38-b439-3730d5d2f166 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] HTTP exception thrown: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-375e81d6-048b-4b38-b439-3730d5d2f166 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Request method failure captured: May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 HTTP/1.1 May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpPlhU68Y7j3b7llP_SiIbEUcCX8UhcT_jXm1aREvNsb5stwi92gong_XhY_hCutfnb_a0ixsP-MzktA3LXP48mG6k5sBU1dTg_B9w-83ShPqGHFoj2WPJna2Y6YciUmAUmq8SvZIXLY3idOrn3VZ7O9BLlteEgvaHU5OTKx9a_KZtA May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e3cc8c5f2fe44b87bf5c05eadb62936c May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AttachVolumeTestJSON-1447462214 May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3cc8c5f2fe44b87bf5c05eadb62936c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AttachVolumeTestJSON-1447462214 May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e3cc8c5f2fe44b87bf5c05eadb62936c May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1447462214 May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AttachVolumeTestJSON-1447462214-project May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 93f78df0f96c47ac97a200a4442db6da May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AttachVolumeTestJSON-1447462214-project May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '3733dc91-2f81-4efc-a391-73a96ee6ee44'} May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:31:15.043018 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:31:15.046751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:31:15.046751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:31:15.046751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:31:15.046751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:31:15.046751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:31:15.046751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. May 28 21:31:15.046751 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:31:15.048767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-375e81d6-048b-4b38-b439-3730d5d2f166 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Returning 404 to user: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:31:15.050364 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-375e81d6-048b-4b38-b439-3730d5d2f166 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 404 len: 111 microversion: 2.1 time: 0.082726 May 28 21:31:15.053237 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2833/5613] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:14 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:31:15.064131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e9c45bfe-23b2-446b-9364-32d1aac0daa8 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '.version_select at 0x7f4d56c29ca0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:15.303705 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e9c45bfe-23b2-446b-9364-32d1aac0daa8 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450742268" status: 202 len: 0 microversion: 2.1 time: 0.243390 May 28 21:31:15.307699 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2781/5614] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 21:31:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450742268 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:31:15.324681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-33fba15c-bb7e-4089-ac47-cb5c1c02e248 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:15.325405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-33fba15c-bb7e-4089-ac47-cb5c1c02e248 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] [instance: 1e51bb11-1862-4204-815f-b523cf2fc9c3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:15.354425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33fba15c-bb7e-4089-ac47-cb5c1c02e248 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:15.355283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33fba15c-bb7e-4089-ac47-cb5c1c02e248 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:15.356762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33fba15c-bb7e-4089-ac47-cb5c1c02e248 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:15.360277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-33fba15c-bb7e-4089-ac47-cb5c1c02e248 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:15.387555 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-33fba15c-bb7e-4089-ac47-cb5c1c02e248 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] HTTP exception thrown: Instance 1e51bb11-1862-4204-815f-b523cf2fc9c3 could not be found. May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-33fba15c-bb7e-4089-ac47-cb5c1c02e248 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Request method failure captured: May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 HTTP/1.1 May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpSLDWlZ6wTETxBAtPTRSdvAb0OVOPZ6V-8K-zqblf40OguerOj85L_WthmEUAsXFTAFAdmWe2NeF8CTTzd2BB4YgOLxICPOWob19mJW2rgMG10lr3zR3fXYOO1jlmXWyzDNuMYjDGV5X-kSnzlyY_G4hSA1zvcOuV3Quc1YlN8LcXk May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Openstack-Nova-Api-Version: 2.26 May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: b98e2ebc3d3b4e7083b9c429628ce69f May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerTagsTestJSON-637860934 May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b98e2ebc3d3b4e7083b9c429628ce69f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98e2ebc3d3b4e7083b9c429628ce69f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b98e2ebc3d3b4e7083b9c429628ce69f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b98e2ebc3d3b4e7083b9c429628ce69f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerTagsTestJSON-637860934 May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: b98e2ebc3d3b4e7083b9c429628ce69f May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerTagsTestJSON-637860934 May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerTagsTestJSON-637860934-project May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: c08e8a164d3248188ce965d1a9e04f03 May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerTagsTestJSON-637860934-project May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 1e51bb11-1862-4204-815f-b523cf2fc9c3 could not be found. May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '1e51bb11-1862-4204-815f-b523cf2fc9c3'} May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e51bb11-1862-4204-815f-b523cf2fc9c3 could not be found. May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e51bb11-1862-4204-815f-b523cf2fc9c3 could not be found. May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:31:15.389384 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:31:15.393949 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:31:15.393949 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:31:15.393949 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:31:15.393949 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:31:15.393949 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:31:15.393949 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e51bb11-1862-4204-815f-b523cf2fc9c3 could not be found. May 28 21:31:15.393949 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:31:15.396273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-33fba15c-bb7e-4089-ac47-cb5c1c02e248 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] Returning 404 to user: Instance 1e51bb11-1862-4204-815f-b523cf2fc9c3 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:31:15.421089 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-33fba15c-bb7e-4089-ac47-cb5c1c02e248 tempest-ServerTagsTestJSON-637860934 tempest-ServerTagsTestJSON-637860934-project] 10.222.0.33 "GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3" status: 404 len: 111 microversion: 2.26 time: 0.077542 May 28 21:31:15.422612 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2834/5615] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:15 2022] GET /compute/v2.1/servers/1e51bb11-1862-4204-815f-b523cf2fc9c3 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:31:16.298079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-c90af736-0d8b-4925-b3a4-71edce0b8e90 req-3ff0b9b0-bd10-4e02-b4af-14f67f659696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a04681-51df-4f74-af55-3f8f4e1b8a71", "name": "network-vif-plugged", "status": "completed", "tag": "88ddc193-6f03-4717-b54b-d87010254589"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:31:16.313596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c90af736-0d8b-4925-b3a4-71edce0b8e90 req-3ff0b9b0-bd10-4e02-b4af-14f67f659696 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:16.314459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c90af736-0d8b-4925-b3a4-71edce0b8e90 req-3ff0b9b0-bd10-4e02-b4af-14f67f659696 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:16.327985 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-c90af736-0d8b-4925-b3a4-71edce0b8e90 req-3ff0b9b0-bd10-4e02-b4af-14f67f659696 service nova] Creating event network-vif-plugged:88ddc193-6f03-4717-b54b-d87010254589 for instance 37a04681-51df-4f74-af55-3f8f4e1b8a71 on nch2-master-1 May 28 21:31:16.334797 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-c90af736-0d8b-4925-b3a4-71edce0b8e90 req-3ff0b9b0-bd10-4e02-b4af-14f67f659696 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041518 May 28 21:31:16.336104 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2782/5616] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:31:16.726629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8c46b6f4-c02c-4d28-9236-f583349b408b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Action: 'create', calling method: .version_select at 0x7f4d576ab1f0>, body: {"keypair": {"name": "tempest-keypair-497834363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMd+aOSvUjAfgBi8B5MGmx9NSoN8b35pL/9a6MXQvci1N9/JSKFpb0oEKYohy42xBOWbyHMuTZC3KmlhLUSboV2mcp2LJ6XkIvUxzTuA5uQVWzqyektyJ4SLEPRled7NYw=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:31:16.736316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:16.746129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-8c46b6f4-c02c-4d28-9236-f583349b408b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Getting quotas for project e3cc8c5f2fe44b87bf5c05eadb62936c. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:31:16.751663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-8c46b6f4-c02c-4d28-9236-f583349b408b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Getting quotas for user 93f78df0f96c47ac97a200a4442db6da and project e3cc8c5f2fe44b87bf5c05eadb62936c. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:31:16.910439 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8c46b6f4-c02c-4d28-9236-f583349b408b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181431 May 28 21:31:16.910439 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2835/5617] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:31:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:31:19.725766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f67909b9-8155-4ab0-b206-cb25b3def8cd tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-935349989", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": "none"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:31:19.826936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-f67909b9-8155-4ab0-b206-cb25b3def8cd tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:31:19.827706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-f67909b9-8155-4ab0-b206-cb25b3def8cd tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:31:19.828630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-f67909b9-8155-4ab0-b206-cb25b3def8cd tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:31:19.829490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-f67909b9-8155-4ab0-b206-cb25b3def8cd tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:31:19.830175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-f67909b9-8155-4ab0-b206-cb25b3def8cd tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:31:19.840382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f67909b9-8155-4ab0-b206-cb25b3def8cd tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:19.841323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f67909b9-8155-4ab0-b206-cb25b3def8cd tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:19.842414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f67909b9-8155-4ab0-b206-cb25b3def8cd tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:19.843403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f67909b9-8155-4ab0-b206-cb25b3def8cd tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:19.865518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-f67909b9-8155-4ab0-b206-cb25b3def8cd tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Getting quotas for project 8c9a59b25d3d479caeafce7ad25cf423. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:31:19.871107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-f67909b9-8155-4ab0-b206-cb25b3def8cd tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Getting quotas for user d15d14a609054950959cb446223dad78 and project 8c9a59b25d3d479caeafce7ad25cf423. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:31:19.884502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f67909b9-8155-4ab0-b206-cb25b3def8cd tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:31:19.898419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f67909b9-8155-4ab0-b206-cb25b3def8cd tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:31:20.022355 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f67909b9-8155-4ab0-b206-cb25b3def8cd tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.537407 May 28 21:31:20.041820 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2783/5618] 10.222.0.33 () {62 vars in 1187 bytes} [Sat May 28 21:31:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 28 21:31:20.086842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a1fb39e4-e642-49b5-84f9-d618c7ae206f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:20.088163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a1fb39e4-e642-49b5-84f9-d618c7ae206f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:20.177558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a1fb39e4-e642-49b5-84f9-d618c7ae206f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:20.182749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a1fb39e4-e642-49b5-84f9-d618c7ae206f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:20.184540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a1fb39e4-e642-49b5-84f9-d618c7ae206f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:20.186157 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a1fb39e4-e642-49b5-84f9-d618c7ae206f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1277 microversion: 2.57 time: 0.113708 May 28 21:31:20.186977 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2836/5619] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:20 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:21.209277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-285c3ee8-157c-46c6-bb0c-e33ad83e90d1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:21.210493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-285c3ee8-157c-46c6-bb0c-e33ad83e90d1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:21.305650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-285c3ee8-157c-46c6-bb0c-e33ad83e90d1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:21.313974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-285c3ee8-157c-46c6-bb0c-e33ad83e90d1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:21.316040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-285c3ee8-157c-46c6-bb0c-e33ad83e90d1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:21.317306 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-285c3ee8-157c-46c6-bb0c-e33ad83e90d1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1277 microversion: 2.57 time: 0.115985 May 28 21:31:21.317888 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2784/5620] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:21 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:21.711683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2032848152", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cdaf932-9554-41b6-9356-44a95a22c252"}], "security_groups": [{"name": "tempest-securitygroup--1182080208"}], "key_name": "tempest-keypair-497834363", "user_data": "}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:31:21.840024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] validate_networks() for [('4cdaf932-9554-41b6-9356-44a95a22c252', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:31:22.336879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1f53b826-812c-4c48-b4bb-f7d32168b628 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:22.337375 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1f53b826-812c-4c48-b4bb-f7d32168b628 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:22.349515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f53b826-812c-4c48-b4bb-f7d32168b628 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:22.352690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f53b826-812c-4c48-b4bb-f7d32168b628 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:22.356858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f53b826-812c-4c48-b4bb-f7d32168b628 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:22.357700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f53b826-812c-4c48-b4bb-f7d32168b628 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:22.360256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:31:22.360904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:31:22.362211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:31:22.362646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:31:22.363879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:31:22.379126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:22.379589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:22.380409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:22.381235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:22.401902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Getting quotas for project e3cc8c5f2fe44b87bf5c05eadb62936c. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:31:22.407358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Getting quotas for user 93f78df0f96c47ac97a200a4442db6da and project e3cc8c5f2fe44b87bf5c05eadb62936c. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:31:22.422886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:31:22.426529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:31:22.473045 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1f53b826-812c-4c48-b4bb-f7d32168b628 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:22.481261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1f53b826-812c-4c48-b4bb-f7d32168b628 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:22.482936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1f53b826-812c-4c48-b4bb-f7d32168b628 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:22.484170 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1f53b826-812c-4c48-b4bb-f7d32168b628 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1273 microversion: 2.57 time: 0.152080 May 28 21:31:22.484819 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2785/5621] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:22 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:31:22.633086 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-457c4cd4-6b02-4954-b204-034c36876153 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.925277 May 28 21:31:22.634085 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2837/5622] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:31:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:31:22.644507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-000ca913-622d-47c4-9171-04da4d903e6f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:22.645386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-000ca913-622d-47c4-9171-04da4d903e6f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:22.713710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-000ca913-622d-47c4-9171-04da4d903e6f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:22.722695 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-000ca913-622d-47c4-9171-04da4d903e6f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1237 microversion: 2.1 time: 0.082382 May 28 21:31:22.732940 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2786/5623] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:22 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:23.506241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-61bdb2c7-2431-4ae6-b45f-3b424fa9db7c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:23.507150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-61bdb2c7-2431-4ae6-b45f-3b424fa9db7c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:23.518582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61bdb2c7-2431-4ae6-b45f-3b424fa9db7c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:23.518582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61bdb2c7-2431-4ae6-b45f-3b424fa9db7c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:23.519284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61bdb2c7-2431-4ae6-b45f-3b424fa9db7c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:23.519955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61bdb2c7-2431-4ae6-b45f-3b424fa9db7c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:23.668191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-61bdb2c7-2431-4ae6-b45f-3b424fa9db7c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:23.678967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-61bdb2c7-2431-4ae6-b45f-3b424fa9db7c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:23.680767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-61bdb2c7-2431-4ae6-b45f-3b424fa9db7c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:23.682150 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-61bdb2c7-2431-4ae6-b45f-3b424fa9db7c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1337 microversion: 2.57 time: 0.183075 May 28 21:31:23.683214 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2838/5624] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:23 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1337 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:23.740810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-99732edd-869a-4793-8744-a99a5c7c9d35 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:23.741439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-99732edd-869a-4793-8744-a99a5c7c9d35 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:23.811541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-99732edd-869a-4793-8744-a99a5c7c9d35 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:23.819200 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-99732edd-869a-4793-8744-a99a5c7c9d35 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1237 microversion: 2.1 time: 0.082289 May 28 21:31:23.820040 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2787/5625] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:23 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:24.704317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-712c6b44-fcf7-40c8-a6fe-d37961dc1bf0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:24.706574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-712c6b44-fcf7-40c8-a6fe-d37961dc1bf0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:24.714757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-712c6b44-fcf7-40c8-a6fe-d37961dc1bf0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:24.715226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-712c6b44-fcf7-40c8-a6fe-d37961dc1bf0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:24.716297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-712c6b44-fcf7-40c8-a6fe-d37961dc1bf0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:24.716751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-712c6b44-fcf7-40c8-a6fe-d37961dc1bf0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:24.787377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-712c6b44-fcf7-40c8-a6fe-d37961dc1bf0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:24.798437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-712c6b44-fcf7-40c8-a6fe-d37961dc1bf0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:24.800129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-712c6b44-fcf7-40c8-a6fe-d37961dc1bf0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:24.801465 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-712c6b44-fcf7-40c8-a6fe-d37961dc1bf0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1335 microversion: 2.57 time: 0.101217 May 28 21:31:24.802132 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2839/5626] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:24 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1335 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:24.837449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-26cf2a0b-bc25-4d3e-b293-c5472782c269 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:24.838906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-26cf2a0b-bc25-4d3e-b293-c5472782c269 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:24.847205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26cf2a0b-bc25-4d3e-b293-c5472782c269 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:24.847671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26cf2a0b-bc25-4d3e-b293-c5472782c269 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:24.848458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26cf2a0b-bc25-4d3e-b293-c5472782c269 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:24.848896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26cf2a0b-bc25-4d3e-b293-c5472782c269 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:24.918476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-26cf2a0b-bc25-4d3e-b293-c5472782c269 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:24.927486 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-26cf2a0b-bc25-4d3e-b293-c5472782c269 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1289 microversion: 2.1 time: 0.094447 May 28 21:31:24.928086 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2788/5627] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:24 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:25.821056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3f920c37-4b66-4753-a670-32f6e3c5282e tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:25.821775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3f920c37-4b66-4753-a670-32f6e3c5282e tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:25.829165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f920c37-4b66-4753-a670-32f6e3c5282e tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:25.829622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f920c37-4b66-4753-a670-32f6e3c5282e tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:25.830462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f920c37-4b66-4753-a670-32f6e3c5282e tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:25.830900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f920c37-4b66-4753-a670-32f6e3c5282e tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:25.899524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3f920c37-4b66-4753-a670-32f6e3c5282e tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:25.910289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3f920c37-4b66-4753-a670-32f6e3c5282e tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:25.911843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3f920c37-4b66-4753-a670-32f6e3c5282e tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:25.913043 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3f920c37-4b66-4753-a670-32f6e3c5282e tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1335 microversion: 2.57 time: 0.096455 May 28 21:31:25.917376 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2840/5628] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:25 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1335 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:25.957460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6bbf8076-3902-4279-9cf8-e56b9b576fba tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:25.958156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6bbf8076-3902-4279-9cf8-e56b9b576fba tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:25.971899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6bbf8076-3902-4279-9cf8-e56b9b576fba tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:25.972729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6bbf8076-3902-4279-9cf8-e56b9b576fba tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:25.977128 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6bbf8076-3902-4279-9cf8-e56b9b576fba tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:25.977589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6bbf8076-3902-4279-9cf8-e56b9b576fba tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:26.045030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6bbf8076-3902-4279-9cf8-e56b9b576fba tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:26.053307 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6bbf8076-3902-4279-9cf8-e56b9b576fba tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1295 microversion: 2.1 time: 0.102417 May 28 21:31:26.053911 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2789/5629] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:25 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1295 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:26.931595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-12be3cfa-4b87-42cc-b9bc-4107d32817d2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:26.932192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-12be3cfa-4b87-42cc-b9bc-4107d32817d2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:26.940140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12be3cfa-4b87-42cc-b9bc-4107d32817d2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:26.940607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12be3cfa-4b87-42cc-b9bc-4107d32817d2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:26.941394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12be3cfa-4b87-42cc-b9bc-4107d32817d2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:26.941873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12be3cfa-4b87-42cc-b9bc-4107d32817d2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:27.026523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-12be3cfa-4b87-42cc-b9bc-4107d32817d2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:27.036156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-12be3cfa-4b87-42cc-b9bc-4107d32817d2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:27.037692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-12be3cfa-4b87-42cc-b9bc-4107d32817d2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:27.039889 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-12be3cfa-4b87-42cc-b9bc-4107d32817d2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1356 microversion: 2.57 time: 0.111911 May 28 21:31:27.040476 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2841/5630] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:26 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1356 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:27.058778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:31:27.060342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:27.073816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:27.074987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:27.076035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:27.076721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:27.080785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-70048067-49ff-444d-ba16-e77049433a84 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:27.081513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-70048067-49ff-444d-ba16-e77049433a84 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:27.088779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70048067-49ff-444d-ba16-e77049433a84 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:27.089571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70048067-49ff-444d-ba16-e77049433a84 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:27.090672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70048067-49ff-444d-ba16-e77049433a84 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:27.091124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-70048067-49ff-444d-ba16-e77049433a84 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:27.193042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:31:27.204332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:31:27.204332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:31:27.204332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:31:27.204332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:31:27.256860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-70048067-49ff-444d-ba16-e77049433a84 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:27.264540 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-70048067-49ff-444d-ba16-e77049433a84 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1363 microversion: 2.1 time: 0.187828 May 28 21:31:27.265124 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2842/5631] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:27 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:27.428897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-a36890e4-2006-46ba-a013-9c5ce9729e3c req-dadf82fa-5ab3-476e-9fd7-d420852737a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6401e526-a5f4-434e-baea-2f9d952e875f", "tag": "e0110c6f-1f82-42ec-a116-dd5556f40987"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:31:27.457089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a36890e4-2006-46ba-a013-9c5ce9729e3c req-dadf82fa-5ab3-476e-9fd7-d420852737a1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:27.457089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a36890e4-2006-46ba-a013-9c5ce9729e3c req-dadf82fa-5ab3-476e-9fd7-d420852737a1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:27.466648 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a36890e4-2006-46ba-a013-9c5ce9729e3c req-dadf82fa-5ab3-476e-9fd7-d420852737a1 service nova] Creating event network-changed:e0110c6f-1f82-42ec-a116-dd5556f40987 for instance 6401e526-a5f4-434e-baea-2f9d952e875f on nch2-master-1 May 28 21:31:27.472857 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-a36890e4-2006-46ba-a013-9c5ce9729e3c req-dadf82fa-5ab3-476e-9fd7-d420852737a1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048753 May 28 21:31:27.474085 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2843/5632] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:31:27.512265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:27.519725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:27.520186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:27.520986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:27.523548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:27.569053 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a30f3536-a869-428d-91f2-b3daa3589b0b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "POST /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8/action" status: 202 len: 1137 microversion: 2.57 time: 0.514001 May 28 21:31:27.569694 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2790/5633] 10.222.0.33 () {62 vars in 1319 bytes} [Sat May 28 21:31:27 2022] POST /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8/action => generated 1137 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) May 28 21:31:27.586928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40ad081c-8310-47e2-9c22-744865cebaa8 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:27.587899 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-40ad081c-8310-47e2-9c22-744865cebaa8 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:27.594986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40ad081c-8310-47e2-9c22-744865cebaa8 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:27.595534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40ad081c-8310-47e2-9c22-744865cebaa8 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:27.596530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40ad081c-8310-47e2-9c22-744865cebaa8 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:27.596990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40ad081c-8310-47e2-9c22-744865cebaa8 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:27.687817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-40ad081c-8310-47e2-9c22-744865cebaa8 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:27.697195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-40ad081c-8310-47e2-9c22-744865cebaa8 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:27.698764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-40ad081c-8310-47e2-9c22-744865cebaa8 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:27.699963 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-40ad081c-8310-47e2-9c22-744865cebaa8 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.117888 May 28 21:31:27.700772 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2844/5634] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:27 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:28.282107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2bf69b8f-593a-4789-8315-649e9b78af60 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:28.283587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2bf69b8f-593a-4789-8315-649e9b78af60 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:28.290518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bf69b8f-593a-4789-8315-649e9b78af60 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:28.291008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bf69b8f-593a-4789-8315-649e9b78af60 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:28.291783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bf69b8f-593a-4789-8315-649e9b78af60 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:28.292237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bf69b8f-593a-4789-8315-649e9b78af60 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:28.425590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2bf69b8f-593a-4789-8315-649e9b78af60 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:28.433172 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2bf69b8f-593a-4789-8315-649e9b78af60 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1363 microversion: 2.1 time: 0.154982 May 28 21:31:28.436589 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2791/5635] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:28 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:28.718434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6f2a4e5b-12e3-4ae3-96f3-ec0fdaa9330b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:28.719055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6f2a4e5b-12e3-4ae3-96f3-ec0fdaa9330b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:28.727795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f2a4e5b-12e3-4ae3-96f3-ec0fdaa9330b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:28.728308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f2a4e5b-12e3-4ae3-96f3-ec0fdaa9330b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:28.729107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f2a4e5b-12e3-4ae3-96f3-ec0fdaa9330b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:28.729635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f2a4e5b-12e3-4ae3-96f3-ec0fdaa9330b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:28.800948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6f2a4e5b-12e3-4ae3-96f3-ec0fdaa9330b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:28.809358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6f2a4e5b-12e3-4ae3-96f3-ec0fdaa9330b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:28.810958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6f2a4e5b-12e3-4ae3-96f3-ec0fdaa9330b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:28.812118 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6f2a4e5b-12e3-4ae3-96f3-ec0fdaa9330b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.097910 May 28 21:31:28.812715 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2845/5636] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:28 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:29.451667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-587c96a7-1208-47b5-a710-abb49c2cb416 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:29.452808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-587c96a7-1208-47b5-a710-abb49c2cb416 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:29.460775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-587c96a7-1208-47b5-a710-abb49c2cb416 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:29.461239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-587c96a7-1208-47b5-a710-abb49c2cb416 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:29.462110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-587c96a7-1208-47b5-a710-abb49c2cb416 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:29.462555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-587c96a7-1208-47b5-a710-abb49c2cb416 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:29.634406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-587c96a7-1208-47b5-a710-abb49c2cb416 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:29.642191 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-587c96a7-1208-47b5-a710-abb49c2cb416 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1363 microversion: 2.1 time: 0.196103 May 28 21:31:29.643883 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2792/5637] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:29 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:29.829744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a2e55cbe-5e19-4d21-bc85-cb92024923f0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:29.830450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a2e55cbe-5e19-4d21-bc85-cb92024923f0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:29.837858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2e55cbe-5e19-4d21-bc85-cb92024923f0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:29.838353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2e55cbe-5e19-4d21-bc85-cb92024923f0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:29.839130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2e55cbe-5e19-4d21-bc85-cb92024923f0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:29.839583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2e55cbe-5e19-4d21-bc85-cb92024923f0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:29.904663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a2e55cbe-5e19-4d21-bc85-cb92024923f0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:29.913351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a2e55cbe-5e19-4d21-bc85-cb92024923f0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:29.916716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a2e55cbe-5e19-4d21-bc85-cb92024923f0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:29.916716 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a2e55cbe-5e19-4d21-bc85-cb92024923f0 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.090229 May 28 21:31:29.916716 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2846/5638] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:29 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:30.658498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-24d83e61-9cda-4459-a139-5bbc41da67fc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:30.659201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-24d83e61-9cda-4459-a139-5bbc41da67fc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:30.661125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:30.667004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24d83e61-9cda-4459-a139-5bbc41da67fc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:30.667483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24d83e61-9cda-4459-a139-5bbc41da67fc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:30.668323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24d83e61-9cda-4459-a139-5bbc41da67fc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:30.668745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24d83e61-9cda-4459-a139-5bbc41da67fc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:30.806455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-24d83e61-9cda-4459-a139-5bbc41da67fc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:30.813991 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-24d83e61-9cda-4459-a139-5bbc41da67fc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1363 microversion: 2.1 time: 0.159382 May 28 21:31:30.814565 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2793/5639] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:30 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:30.935035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-96e13d63-8d9d-47ce-a04f-46be8692b57d tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:30.935662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-96e13d63-8d9d-47ce-a04f-46be8692b57d tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:30.943311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-96e13d63-8d9d-47ce-a04f-46be8692b57d tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:30.943772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-96e13d63-8d9d-47ce-a04f-46be8692b57d tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:30.944544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-96e13d63-8d9d-47ce-a04f-46be8692b57d tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:30.944993 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-96e13d63-8d9d-47ce-a04f-46be8692b57d tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:31.008782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-96e13d63-8d9d-47ce-a04f-46be8692b57d tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:31.017336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-96e13d63-8d9d-47ce-a04f-46be8692b57d tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:31.018889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-96e13d63-8d9d-47ce-a04f-46be8692b57d tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:31.020074 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-96e13d63-8d9d-47ce-a04f-46be8692b57d tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.088982 May 28 21:31:31.020675 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2847/5640] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:30 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:31.832473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5695d398-30d4-4e49-b475-591eb764c350 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:31.833112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5695d398-30d4-4e49-b475-591eb764c350 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:31.841412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5695d398-30d4-4e49-b475-591eb764c350 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:31.841905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5695d398-30d4-4e49-b475-591eb764c350 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:31.842685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5695d398-30d4-4e49-b475-591eb764c350 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:31.843131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5695d398-30d4-4e49-b475-591eb764c350 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:31.980419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5695d398-30d4-4e49-b475-591eb764c350 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:31.988415 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5695d398-30d4-4e49-b475-591eb764c350 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1363 microversion: 2.1 time: 0.160232 May 28 21:31:31.989007 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2794/5641] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:31 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:32.039304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a7014bd-028b-4649-9883-8002f5687284 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:32.039953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6a7014bd-028b-4649-9883-8002f5687284 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:32.047048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a7014bd-028b-4649-9883-8002f5687284 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:32.047507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a7014bd-028b-4649-9883-8002f5687284 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:32.048324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a7014bd-028b-4649-9883-8002f5687284 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:32.048781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a7014bd-028b-4649-9883-8002f5687284 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:32.141338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a7014bd-028b-4649-9883-8002f5687284 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:32.149624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a7014bd-028b-4649-9883-8002f5687284 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:32.151193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a7014bd-028b-4649-9883-8002f5687284 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:32.152402 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6a7014bd-028b-4649-9883-8002f5687284 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.117150 May 28 21:31:32.152980 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2848/5642] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:32 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:33.008991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eda2fc23-741c-4cad-afd5-6e08cb486cbb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:33.009511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eda2fc23-741c-4cad-afd5-6e08cb486cbb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:33.016488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eda2fc23-741c-4cad-afd5-6e08cb486cbb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:33.016946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eda2fc23-741c-4cad-afd5-6e08cb486cbb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:33.017719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eda2fc23-741c-4cad-afd5-6e08cb486cbb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:33.018194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eda2fc23-741c-4cad-afd5-6e08cb486cbb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:33.151591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eda2fc23-741c-4cad-afd5-6e08cb486cbb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:33.159390 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eda2fc23-741c-4cad-afd5-6e08cb486cbb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1363 microversion: 2.1 time: 0.154662 May 28 21:31:33.159978 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2795/5643] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:33 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:33.174393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b89089f5-5431-49ed-8c68-d77ed4be2249 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:33.181892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b89089f5-5431-49ed-8c68-d77ed4be2249 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:33.181892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:33.181892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=12 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:33.184117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b89089f5-5431-49ed-8c68-d77ed4be2249 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:33.184617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b89089f5-5431-49ed-8c68-d77ed4be2249 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:33.185484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b89089f5-5431-49ed-8c68-d77ed4be2249 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:33.185984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b89089f5-5431-49ed-8c68-d77ed4be2249 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:33.252341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b89089f5-5431-49ed-8c68-d77ed4be2249 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:33.261562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b89089f5-5431-49ed-8c68-d77ed4be2249 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:33.263180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b89089f5-5431-49ed-8c68-d77ed4be2249 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:33.264442 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b89089f5-5431-49ed-8c68-d77ed4be2249 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.093983 May 28 21:31:33.265109 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2849/5644] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:33 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:34.180364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aaf2a48d-ca8c-46aa-859d-a10af219f376 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:34.180364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aaf2a48d-ca8c-46aa-859d-a10af219f376 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:34.180364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=12 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:34.185756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aaf2a48d-ca8c-46aa-859d-a10af219f376 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:34.186263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aaf2a48d-ca8c-46aa-859d-a10af219f376 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:34.187055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aaf2a48d-ca8c-46aa-859d-a10af219f376 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:34.187508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aaf2a48d-ca8c-46aa-859d-a10af219f376 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:34.191788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:34.284399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-53961701-cb6b-4042-badf-7c664419a011 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:34.285024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-53961701-cb6b-4042-badf-7c664419a011 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:34.295697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-53961701-cb6b-4042-badf-7c664419a011 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:34.296229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-53961701-cb6b-4042-badf-7c664419a011 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:34.297029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-53961701-cb6b-4042-badf-7c664419a011 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:34.297481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-53961701-cb6b-4042-badf-7c664419a011 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:34.339637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aaf2a48d-ca8c-46aa-859d-a10af219f376 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:34.350311 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aaf2a48d-ca8c-46aa-859d-a10af219f376 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1363 microversion: 2.1 time: 0.177007 May 28 21:31:34.350912 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2796/5645] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:34 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:34.367813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-66b2f2a2-add2-408b-9adc-3132c8940451 req-90b840da-c54f-4444-b2c7-909612d784d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6401e526-a5f4-434e-baea-2f9d952e875f", "name": "network-vif-plugged", "status": "completed", "tag": "e0110c6f-1f82-42ec-a116-dd5556f40987"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:31:34.378775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-66b2f2a2-add2-408b-9adc-3132c8940451 req-90b840da-c54f-4444-b2c7-909612d784d1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:34.379148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-66b2f2a2-add2-408b-9adc-3132c8940451 req-90b840da-c54f-4444-b2c7-909612d784d1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:34.390938 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-66b2f2a2-add2-408b-9adc-3132c8940451 req-90b840da-c54f-4444-b2c7-909612d784d1 service nova] Creating event network-vif-plugged:e0110c6f-1f82-42ec-a116-dd5556f40987 for instance 6401e526-a5f4-434e-baea-2f9d952e875f on nch2-master-1 May 28 21:31:34.396184 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-66b2f2a2-add2-408b-9adc-3132c8940451 req-90b840da-c54f-4444-b2c7-909612d784d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034653 May 28 21:31:34.397324 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2797/5646] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:31:34.404013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-53961701-cb6b-4042-badf-7c664419a011 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:34.415166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-53961701-cb6b-4042-badf-7c664419a011 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:34.416905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-53961701-cb6b-4042-badf-7c664419a011 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:34.419158 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-53961701-cb6b-4042-badf-7c664419a011 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.137686 May 28 21:31:34.430156 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2850/5647] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:34 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:31:35.369110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f42a32ef-febc-4f25-bf91-d41ed1859471 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:35.369874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f42a32ef-febc-4f25-bf91-d41ed1859471 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:35.376954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f42a32ef-febc-4f25-bf91-d41ed1859471 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:35.377449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f42a32ef-febc-4f25-bf91-d41ed1859471 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:35.378244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f42a32ef-febc-4f25-bf91-d41ed1859471 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:35.378690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f42a32ef-febc-4f25-bf91-d41ed1859471 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:35.437100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f405f3f3-1c84-4ec7-ba20-de3ce1af0e30 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:35.437723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f405f3f3-1c84-4ec7-ba20-de3ce1af0e30 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:35.445354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f405f3f3-1c84-4ec7-ba20-de3ce1af0e30 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:35.445812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f405f3f3-1c84-4ec7-ba20-de3ce1af0e30 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:35.446608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f405f3f3-1c84-4ec7-ba20-de3ce1af0e30 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:35.447059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f405f3f3-1c84-4ec7-ba20-de3ce1af0e30 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:35.517307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f405f3f3-1c84-4ec7-ba20-de3ce1af0e30 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:35.520938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:35.525738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f405f3f3-1c84-4ec7-ba20-de3ce1af0e30 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:35.527335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f405f3f3-1c84-4ec7-ba20-de3ce1af0e30 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:35.528552 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f405f3f3-1c84-4ec7-ba20-de3ce1af0e30 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.095397 May 28 21:31:35.529119 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2851/5648] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:35 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:31:35.539729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f42a32ef-febc-4f25-bf91-d41ed1859471 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:35.547317 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f42a32ef-febc-4f25-bf91-d41ed1859471 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1363 microversion: 2.1 time: 0.183840 May 28 21:31:35.548694 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2798/5649] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:35 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:36.547780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bd5316e4-56a9-48ff-84b0-f448905f4b7f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:36.548437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bd5316e4-56a9-48ff-84b0-f448905f4b7f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:36.556328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd5316e4-56a9-48ff-84b0-f448905f4b7f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:36.556779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd5316e4-56a9-48ff-84b0-f448905f4b7f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:36.557577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd5316e4-56a9-48ff-84b0-f448905f4b7f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:36.558057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd5316e4-56a9-48ff-84b0-f448905f4b7f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:36.564833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1281e653-a1a1-4d7e-854c-3dafa7dede78 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:36.565455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1281e653-a1a1-4d7e-854c-3dafa7dede78 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:36.573712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1281e653-a1a1-4d7e-854c-3dafa7dede78 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:36.574264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1281e653-a1a1-4d7e-854c-3dafa7dede78 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:36.577016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1281e653-a1a1-4d7e-854c-3dafa7dede78 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:36.577016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1281e653-a1a1-4d7e-854c-3dafa7dede78 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:36.626400 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bd5316e4-56a9-48ff-84b0-f448905f4b7f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:36.637664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bd5316e4-56a9-48ff-84b0-f448905f4b7f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:36.639456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bd5316e4-56a9-48ff-84b0-f448905f4b7f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:36.640751 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bd5316e4-56a9-48ff-84b0-f448905f4b7f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.096876 May 28 21:31:36.641428 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2852/5650] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:36 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:36.720252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1281e653-a1a1-4d7e-854c-3dafa7dede78 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:36.728065 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1281e653-a1a1-4d7e-854c-3dafa7dede78 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1549 microversion: 2.1 time: 0.167435 May 28 21:31:36.728646 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2799/5651] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:36 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:36.745596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4dce5485-aa2c-46eb-af11-7a17c71c9f0a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:36.746130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4dce5485-aa2c-46eb-af11-7a17c71c9f0a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:36.752250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4dce5485-aa2c-46eb-af11-7a17c71c9f0a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:36.752714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4dce5485-aa2c-46eb-af11-7a17c71c9f0a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:36.753485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4dce5485-aa2c-46eb-af11-7a17c71c9f0a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:36.753961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4dce5485-aa2c-46eb-af11-7a17c71c9f0a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:36.832639 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4dce5485-aa2c-46eb-af11-7a17c71c9f0a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091367 May 28 21:31:36.833250 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2853/5652] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:31:36 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:31:37.660027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-258e9ddc-3d02-4adc-b989-c8fe1e93af7b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:37.660720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-258e9ddc-3d02-4adc-b989-c8fe1e93af7b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:37.668915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-258e9ddc-3d02-4adc-b989-c8fe1e93af7b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:37.669383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-258e9ddc-3d02-4adc-b989-c8fe1e93af7b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:37.670219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-258e9ddc-3d02-4adc-b989-c8fe1e93af7b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:37.670672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-258e9ddc-3d02-4adc-b989-c8fe1e93af7b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:38.015118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-258e9ddc-3d02-4adc-b989-c8fe1e93af7b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:38.025777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-258e9ddc-3d02-4adc-b989-c8fe1e93af7b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:38.027722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-258e9ddc-3d02-4adc-b989-c8fe1e93af7b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:38.029245 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-258e9ddc-3d02-4adc-b989-c8fe1e93af7b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.373239 May 28 21:31:38.034718 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2800/5653] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:37 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:31:38.231272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-abecc20d-5f68-4aac-836e-d7332c339ff4 req-f1c037dc-77bf-48c2-8c59-4841244d4c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6401e526-a5f4-434e-baea-2f9d952e875f", "tag": "e0110c6f-1f82-42ec-a116-dd5556f40987"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:31:38.243489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-abecc20d-5f68-4aac-836e-d7332c339ff4 req-f1c037dc-77bf-48c2-8c59-4841244d4c21 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:38.244476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-abecc20d-5f68-4aac-836e-d7332c339ff4 req-f1c037dc-77bf-48c2-8c59-4841244d4c21 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:38.269814 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-abecc20d-5f68-4aac-836e-d7332c339ff4 req-f1c037dc-77bf-48c2-8c59-4841244d4c21 service nova] Creating event network-changed:e0110c6f-1f82-42ec-a116-dd5556f40987 for instance 6401e526-a5f4-434e-baea-2f9d952e875f on nch2-master-1 May 28 21:31:38.276951 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-abecc20d-5f68-4aac-836e-d7332c339ff4 req-f1c037dc-77bf-48c2-8c59-4841244d4c21 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051081 May 28 21:31:38.277577 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2854/5654] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:31:39.049205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-16057548-2566-480b-bef4-e890efcac65c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:39.050323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-16057548-2566-480b-bef4-e890efcac65c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:39.062513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16057548-2566-480b-bef4-e890efcac65c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:39.062513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16057548-2566-480b-bef4-e890efcac65c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:39.063397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16057548-2566-480b-bef4-e890efcac65c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:39.063835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16057548-2566-480b-bef4-e890efcac65c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:39.141209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-16057548-2566-480b-bef4-e890efcac65c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:39.149707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-16057548-2566-480b-bef4-e890efcac65c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:39.151539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-16057548-2566-480b-bef4-e890efcac65c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:39.152541 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-16057548-2566-480b-bef4-e890efcac65c tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.108426 May 28 21:31:39.153151 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2801/5655] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:39 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:39.279457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-592edb7b-3243-47f7-8a28-cef5b36e94ae tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:31:39.281146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-592edb7b-3243-47f7-8a28-cef5b36e94ae tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:39.289897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-592edb7b-3243-47f7-8a28-cef5b36e94ae tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:39.290370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-592edb7b-3243-47f7-8a28-cef5b36e94ae tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:39.291240 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-592edb7b-3243-47f7-8a28-cef5b36e94ae tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:39.291678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-592edb7b-3243-47f7-8a28-cef5b36e94ae tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:39.348783 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-592edb7b-3243-47f7-8a28-cef5b36e94ae tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "POST /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71/action" status: 200 len: 24560 microversion: 2.1 time: 0.073507 May 28 21:31:39.349774 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2855/5656] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:31:39 2022] POST /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71/action => generated 24560 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:31:40.172020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b3c17fe3-9700-4d60-9aa5-b0ac3b3c9a34 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:40.172660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b3c17fe3-9700-4d60-9aa5-b0ac3b3c9a34 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:40.179959 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3c17fe3-9700-4d60-9aa5-b0ac3b3c9a34 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:40.180394 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3c17fe3-9700-4d60-9aa5-b0ac3b3c9a34 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:40.181173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3c17fe3-9700-4d60-9aa5-b0ac3b3c9a34 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:40.181641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b3c17fe3-9700-4d60-9aa5-b0ac3b3c9a34 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:40.249823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b3c17fe3-9700-4d60-9aa5-b0ac3b3c9a34 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:40.259572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b3c17fe3-9700-4d60-9aa5-b0ac3b3c9a34 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:40.261091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b3c17fe3-9700-4d60-9aa5-b0ac3b3c9a34 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:40.262324 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b3c17fe3-9700-4d60-9aa5-b0ac3b3c9a34 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.094299 May 28 21:31:40.262914 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2802/5657] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:40 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:41.282112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f9c2805a-1134-48c0-9b1d-482a8f74aa8f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:41.282810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f9c2805a-1134-48c0-9b1d-482a8f74aa8f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:41.297362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9c2805a-1134-48c0-9b1d-482a8f74aa8f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:41.298349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9c2805a-1134-48c0-9b1d-482a8f74aa8f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:41.299161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9c2805a-1134-48c0-9b1d-482a8f74aa8f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:41.299613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9c2805a-1134-48c0-9b1d-482a8f74aa8f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:41.365796 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f9c2805a-1134-48c0-9b1d-482a8f74aa8f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:41.374282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f9c2805a-1134-48c0-9b1d-482a8f74aa8f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:41.375829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f9c2805a-1134-48c0-9b1d-482a8f74aa8f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:41.376983 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f9c2805a-1134-48c0-9b1d-482a8f74aa8f tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.099174 May 28 21:31:41.377552 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2856/5658] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:41 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:42.396608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5decff59-051d-4e4e-a3a6-e8d211d506d4 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:42.397361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5decff59-051d-4e4e-a3a6-e8d211d506d4 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:42.413698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5decff59-051d-4e4e-a3a6-e8d211d506d4 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:42.413698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5decff59-051d-4e4e-a3a6-e8d211d506d4 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:42.413698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5decff59-051d-4e4e-a3a6-e8d211d506d4 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:42.413698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5decff59-051d-4e4e-a3a6-e8d211d506d4 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:42.473156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5decff59-051d-4e4e-a3a6-e8d211d506d4 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:42.481935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5decff59-051d-4e4e-a3a6-e8d211d506d4 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:42.483466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5decff59-051d-4e4e-a3a6-e8d211d506d4 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:42.484631 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5decff59-051d-4e4e-a3a6-e8d211d506d4 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.092635 May 28 21:31:42.485197 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2803/5659] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:42 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:43.504250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-92baa05a-3d0c-451c-b56e-d990ee345e86 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:43.504911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-92baa05a-3d0c-451c-b56e-d990ee345e86 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:43.512179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92baa05a-3d0c-451c-b56e-d990ee345e86 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:43.517268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92baa05a-3d0c-451c-b56e-d990ee345e86 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:43.517268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92baa05a-3d0c-451c-b56e-d990ee345e86 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:43.517268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-92baa05a-3d0c-451c-b56e-d990ee345e86 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:43.583324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-92baa05a-3d0c-451c-b56e-d990ee345e86 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:43.592132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-92baa05a-3d0c-451c-b56e-d990ee345e86 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:43.593645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-92baa05a-3d0c-451c-b56e-d990ee345e86 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:43.594846 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-92baa05a-3d0c-451c-b56e-d990ee345e86 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.095117 May 28 21:31:43.595404 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2857/5660] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:43 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:44.613195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-609e3d5f-9f4c-460b-8776-5d0ba00723e2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:44.613813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-609e3d5f-9f4c-460b-8776-5d0ba00723e2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:44.620475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:44.626433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-609e3d5f-9f4c-460b-8776-5d0ba00723e2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:44.626433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-609e3d5f-9f4c-460b-8776-5d0ba00723e2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:44.626927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-609e3d5f-9f4c-460b-8776-5d0ba00723e2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:44.627376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-609e3d5f-9f4c-460b-8776-5d0ba00723e2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:44.694485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-609e3d5f-9f4c-460b-8776-5d0ba00723e2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:44.703279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-609e3d5f-9f4c-460b-8776-5d0ba00723e2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:44.704789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-609e3d5f-9f4c-460b-8776-5d0ba00723e2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:44.706095 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-609e3d5f-9f4c-460b-8776-5d0ba00723e2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.096714 May 28 21:31:44.706682 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2804/5661] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:44 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:45.725010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5245a781-afc7-45d0-86bd-b79ab9f4c614 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:45.725659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5245a781-afc7-45d0-86bd-b79ab9f4c614 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:45.733114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5245a781-afc7-45d0-86bd-b79ab9f4c614 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:45.733569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5245a781-afc7-45d0-86bd-b79ab9f4c614 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:45.734372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5245a781-afc7-45d0-86bd-b79ab9f4c614 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:45.734820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5245a781-afc7-45d0-86bd-b79ab9f4c614 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:45.800004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5245a781-afc7-45d0-86bd-b79ab9f4c614 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:45.808401 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5245a781-afc7-45d0-86bd-b79ab9f4c614 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:45.810075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5245a781-afc7-45d0-86bd-b79ab9f4c614 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:45.811327 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5245a781-afc7-45d0-86bd-b79ab9f4c614 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.090289 May 28 21:31:45.811901 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2858/5662] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:45 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:46.829792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-234b6c6f-513c-4165-a706-9e7b68fb9328 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:46.830432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-234b6c6f-513c-4165-a706-9e7b68fb9328 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:46.838598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-234b6c6f-513c-4165-a706-9e7b68fb9328 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:46.839049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-234b6c6f-513c-4165-a706-9e7b68fb9328 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:46.840242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-234b6c6f-513c-4165-a706-9e7b68fb9328 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:46.840682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-234b6c6f-513c-4165-a706-9e7b68fb9328 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:46.908383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-234b6c6f-513c-4165-a706-9e7b68fb9328 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:46.916468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-234b6c6f-513c-4165-a706-9e7b68fb9328 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:46.917997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-234b6c6f-513c-4165-a706-9e7b68fb9328 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:46.919154 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-234b6c6f-513c-4165-a706-9e7b68fb9328 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.093372 May 28 21:31:46.919727 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2805/5663] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:46 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:47.937952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-82047aa6-9229-48b8-ba86-0e7586f4b79b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:47.938580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-82047aa6-9229-48b8-ba86-0e7586f4b79b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:47.941435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:47.946333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82047aa6-9229-48b8-ba86-0e7586f4b79b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:47.946789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82047aa6-9229-48b8-ba86-0e7586f4b79b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:47.947564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82047aa6-9229-48b8-ba86-0e7586f4b79b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:47.948010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-82047aa6-9229-48b8-ba86-0e7586f4b79b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:48.014259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-82047aa6-9229-48b8-ba86-0e7586f4b79b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:48.022518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-82047aa6-9229-48b8-ba86-0e7586f4b79b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:48.024660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-82047aa6-9229-48b8-ba86-0e7586f4b79b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:48.025790 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-82047aa6-9229-48b8-ba86-0e7586f4b79b tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.091781 May 28 21:31:48.026389 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2859/5664] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:47 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:49.045803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8d5ce0a5-a275-48ac-b87c-54d5e1cf30ae tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:49.046448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8d5ce0a5-a275-48ac-b87c-54d5e1cf30ae tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:49.053056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d5ce0a5-a275-48ac-b87c-54d5e1cf30ae tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:49.053515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d5ce0a5-a275-48ac-b87c-54d5e1cf30ae tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:49.054306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d5ce0a5-a275-48ac-b87c-54d5e1cf30ae tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:49.055360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d5ce0a5-a275-48ac-b87c-54d5e1cf30ae tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:49.120232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8d5ce0a5-a275-48ac-b87c-54d5e1cf30ae tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:49.128215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8d5ce0a5-a275-48ac-b87c-54d5e1cf30ae tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:49.129716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8d5ce0a5-a275-48ac-b87c-54d5e1cf30ae tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:49.130913 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8d5ce0a5-a275-48ac-b87c-54d5e1cf30ae tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.089271 May 28 21:31:49.131478 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2806/5665] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:49 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:50.150384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2b306e78-8ce3-4d3f-8287-31412826baf9 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:50.150998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2b306e78-8ce3-4d3f-8287-31412826baf9 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:50.157971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b306e78-8ce3-4d3f-8287-31412826baf9 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:50.158362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b306e78-8ce3-4d3f-8287-31412826baf9 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:50.159163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b306e78-8ce3-4d3f-8287-31412826baf9 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:50.159607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b306e78-8ce3-4d3f-8287-31412826baf9 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:50.223920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2b306e78-8ce3-4d3f-8287-31412826baf9 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:50.233073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2b306e78-8ce3-4d3f-8287-31412826baf9 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:50.234661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2b306e78-8ce3-4d3f-8287-31412826baf9 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:50.235826 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2b306e78-8ce3-4d3f-8287-31412826baf9 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.090303 May 28 21:31:50.236397 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2860/5666] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:50 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:51.183830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-64cadcf7-b0d5-4d36-b42c-fff536eaec98 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:51.184664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-64cadcf7-b0d5-4d36-b42c-fff536eaec98 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:51.185972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-11e100f4-6841-41b2-ac1b-44fa68b23aca req-45499c02-4524-4a39-8a50-cf9852f2b15b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37a04681-51df-4f74-af55-3f8f4e1b8a71", "tag": "88ddc193-6f03-4717-b54b-d87010254589"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:31:51.192173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64cadcf7-b0d5-4d36-b42c-fff536eaec98 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:51.192765 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64cadcf7-b0d5-4d36-b42c-fff536eaec98 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:51.193646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64cadcf7-b0d5-4d36-b42c-fff536eaec98 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:51.194379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-64cadcf7-b0d5-4d36-b42c-fff536eaec98 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:51.196275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-11e100f4-6841-41b2-ac1b-44fa68b23aca req-45499c02-4524-4a39-8a50-cf9852f2b15b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:51.196735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-11e100f4-6841-41b2-ac1b-44fa68b23aca req-45499c02-4524-4a39-8a50-cf9852f2b15b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:51.208562 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-11e100f4-6841-41b2-ac1b-44fa68b23aca req-45499c02-4524-4a39-8a50-cf9852f2b15b service nova] Creating event network-changed:88ddc193-6f03-4717-b54b-d87010254589 for instance 37a04681-51df-4f74-af55-3f8f4e1b8a71 on nch2-master-1 May 28 21:31:51.214084 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-11e100f4-6841-41b2-ac1b-44fa68b23aca req-45499c02-4524-4a39-8a50-cf9852f2b15b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031791 May 28 21:31:51.215322 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2861/5667] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:31:51.225864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-64cadcf7-b0d5-4d36-b42c-fff536eaec98 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:31:51.255196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-909b5ffc-6240-48dc-b1d0-ec4aaedfc1cf tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:51.256162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-909b5ffc-6240-48dc-b1d0-ec4aaedfc1cf tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:51.263172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-909b5ffc-6240-48dc-b1d0-ec4aaedfc1cf tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:51.263630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-909b5ffc-6240-48dc-b1d0-ec4aaedfc1cf tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:51.267548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-909b5ffc-6240-48dc-b1d0-ec4aaedfc1cf tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:51.275124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-909b5ffc-6240-48dc-b1d0-ec4aaedfc1cf tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:51.348316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-909b5ffc-6240-48dc-b1d0-ec4aaedfc1cf tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:51.358193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-909b5ffc-6240-48dc-b1d0-ec4aaedfc1cf tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:51.359938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-909b5ffc-6240-48dc-b1d0-ec4aaedfc1cf tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:51.361290 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-909b5ffc-6240-48dc-b1d0-ec4aaedfc1cf tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.110474 May 28 21:31:51.362033 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2862/5668] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:51 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:31:51.700220 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-64cadcf7-b0d5-4d36-b42c-fff536eaec98 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "DELETE /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 204 len: 0 microversion: 2.1 time: 0.520794 May 28 21:31:51.701255 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2807/5669] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:31:51 2022] DELETE /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:31:51.709543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1a6af1ec-4ff6-4512-9385-16d8ea616789 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:51.710557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1a6af1ec-4ff6-4512-9385-16d8ea616789 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:51.718377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a6af1ec-4ff6-4512-9385-16d8ea616789 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:51.719147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a6af1ec-4ff6-4512-9385-16d8ea616789 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:51.720338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a6af1ec-4ff6-4512-9385-16d8ea616789 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:51.721101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a6af1ec-4ff6-4512-9385-16d8ea616789 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:51.880752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1a6af1ec-4ff6-4512-9385-16d8ea616789 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:51.898582 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1a6af1ec-4ff6-4512-9385-16d8ea616789 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1688 microversion: 2.1 time: 0.191215 May 28 21:31:51.898582 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2863/5670] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:51 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1688 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:52.384373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ee92274e-4108-4690-b4e5-5ee3fc65f674 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:52.385013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ee92274e-4108-4690-b4e5-5ee3fc65f674 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:52.392310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ee92274e-4108-4690-b4e5-5ee3fc65f674 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:52.392779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ee92274e-4108-4690-b4e5-5ee3fc65f674 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:52.393558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ee92274e-4108-4690-b4e5-5ee3fc65f674 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:52.394065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ee92274e-4108-4690-b4e5-5ee3fc65f674 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:52.460184 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ee92274e-4108-4690-b4e5-5ee3fc65f674 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:52.469366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ee92274e-4108-4690-b4e5-5ee3fc65f674 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:52.470910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ee92274e-4108-4690-b4e5-5ee3fc65f674 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:52.472085 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ee92274e-4108-4690-b4e5-5ee3fc65f674 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.092265 May 28 21:31:52.472658 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2808/5671] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:52 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:52.920597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f3bca576-8964-4bcb-852e-b79e77f7f3c3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:52.921987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f3bca576-8964-4bcb-852e-b79e77f7f3c3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:52.929340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3bca576-8964-4bcb-852e-b79e77f7f3c3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:52.929796 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3bca576-8964-4bcb-852e-b79e77f7f3c3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:52.930625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3bca576-8964-4bcb-852e-b79e77f7f3c3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:52.931045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3bca576-8964-4bcb-852e-b79e77f7f3c3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:53.065429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f3bca576-8964-4bcb-852e-b79e77f7f3c3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:53.078342 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f3bca576-8964-4bcb-852e-b79e77f7f3c3 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1569 microversion: 2.1 time: 0.161338 May 28 21:31:53.079153 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2864/5672] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:52 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:53.491353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d50090ca-8672-4986-b095-9d0741e84559 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:53.495755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d50090ca-8672-4986-b095-9d0741e84559 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:53.498726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d50090ca-8672-4986-b095-9d0741e84559 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:53.499176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d50090ca-8672-4986-b095-9d0741e84559 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:53.499987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d50090ca-8672-4986-b095-9d0741e84559 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:53.500427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d50090ca-8672-4986-b095-9d0741e84559 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:53.580714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d50090ca-8672-4986-b095-9d0741e84559 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:53.590586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d50090ca-8672-4986-b095-9d0741e84559 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:53.592110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d50090ca-8672-4986-b095-9d0741e84559 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:53.593302 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d50090ca-8672-4986-b095-9d0741e84559 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.106097 May 28 21:31:53.593879 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2809/5673] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:53 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:53.621342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d0c381fc-ac7e-4ecd-872c-695f4b4b6c1a req-4ab3891f-49fd-4b5d-9e07-7ad439a00bcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37a04681-51df-4f74-af55-3f8f4e1b8a71", "name": "network-vif-deleted", "tag": "88ddc193-6f03-4717-b54b-d87010254589"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:31:53.629527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d0c381fc-ac7e-4ecd-872c-695f4b4b6c1a req-4ab3891f-49fd-4b5d-9e07-7ad439a00bcd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:53.630024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d0c381fc-ac7e-4ecd-872c-695f4b4b6c1a req-4ab3891f-49fd-4b5d-9e07-7ad439a00bcd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:53.641557 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d0c381fc-ac7e-4ecd-872c-695f4b4b6c1a req-4ab3891f-49fd-4b5d-9e07-7ad439a00bcd service nova] Creating event network-vif-deleted:88ddc193-6f03-4717-b54b-d87010254589 for instance 37a04681-51df-4f74-af55-3f8f4e1b8a71 on nch2-master-1 May 28 21:31:53.646345 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d0c381fc-ac7e-4ecd-872c-695f4b4b6c1a req-4ab3891f-49fd-4b5d-9e07-7ad439a00bcd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028713 May 28 21:31:53.646947 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2865/5674] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:31:54.096023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d406b0cd-333a-460c-8b37-9013f8af1c72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:54.096641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d406b0cd-333a-460c-8b37-9013f8af1c72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:54.103478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d406b0cd-333a-460c-8b37-9013f8af1c72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:54.103949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d406b0cd-333a-460c-8b37-9013f8af1c72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:54.104690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d406b0cd-333a-460c-8b37-9013f8af1c72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:54.105130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d406b0cd-333a-460c-8b37-9013f8af1c72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:54.136419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d406b0cd-333a-460c-8b37-9013f8af1c72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:54.136811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d406b0cd-333a-460c-8b37-9013f8af1c72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:54.137265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-d406b0cd-333a-460c-8b37-9013f8af1c72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lazy-loading 'fault' on Instance uuid 37a04681-51df-4f74-af55-3f8f4e1b8a71 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:31:54.179801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d406b0cd-333a-460c-8b37-9013f8af1c72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3468a0b2d324603ab6c3080993bc0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3588eab36044e439158f876836ea514', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:54.188144 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d406b0cd-333a-460c-8b37-9013f8af1c72 tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 200 len: 1355 microversion: 2.1 time: 0.096154 May 28 21:31:54.188730 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2810/5675] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:54 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 1355 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:31:54.613160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f67b4efd-bd39-4bce-b2f1-f96f20338af1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:54.613894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f67b4efd-bd39-4bce-b2f1-f96f20338af1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:54.620383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f67b4efd-bd39-4bce-b2f1-f96f20338af1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:54.620845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f67b4efd-bd39-4bce-b2f1-f96f20338af1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:54.621675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f67b4efd-bd39-4bce-b2f1-f96f20338af1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:54.622187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f67b4efd-bd39-4bce-b2f1-f96f20338af1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:54.691184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f67b4efd-bd39-4bce-b2f1-f96f20338af1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:54.699472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f67b4efd-bd39-4bce-b2f1-f96f20338af1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:54.700950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f67b4efd-bd39-4bce-b2f1-f96f20338af1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:54.702150 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f67b4efd-bd39-4bce-b2f1-f96f20338af1 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1365 microversion: 2.57 time: 0.094301 May 28 21:31:54.702721 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2866/5676] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:54 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1365 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:31:55.204639 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-815b8b92-39a4-4f9e-904b-cde0caeab87c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:55.205193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-815b8b92-39a4-4f9e-904b-cde0caeab87c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] [instance: 37a04681-51df-4f74-af55-3f8f4e1b8a71] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:55.212857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-815b8b92-39a4-4f9e-904b-cde0caeab87c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:55.213323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-815b8b92-39a4-4f9e-904b-cde0caeab87c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:55.214148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-815b8b92-39a4-4f9e-904b-cde0caeab87c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:55.214591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-815b8b92-39a4-4f9e-904b-cde0caeab87c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:55.228563 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-815b8b92-39a4-4f9e-904b-cde0caeab87c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] HTTP exception thrown: Instance 37a04681-51df-4f74-af55-3f8f4e1b8a71 could not be found. May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-815b8b92-39a4-4f9e-904b-cde0caeab87c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Request method failure captured: May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 HTTP/1.1 May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpKKy1DVesaj_dysVbGqpWcHx4cpHNtNqkxvMKKXBNqPepistzKKj5agiD8mz188E2_RFwo_f1as_TQInxyhgm3IcOuVM4c5upLUW3nrJ4MRI1Ng4P0UpvRwuZdeq2foyGDCzH24UQIOA6NcxtlTNzFgs85sIrFiF6Be00fINdCNhb0 May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: c3588eab36044e439158f876836ea514 May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-174864934 May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c3588eab36044e439158f876836ea514", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3588eab36044e439158f876836ea514"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c3588eab36044e439158f876836ea514"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c3588eab36044e439158f876836ea514"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestNetworkAdvancedServerOps-174864934 May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: c3588eab36044e439158f876836ea514 May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-174864934 May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestNetworkAdvancedServerOps-174864934-project May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: f3468a0b2d324603ab6c3080993bc0c8 May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestNetworkAdvancedServerOps-174864934-project May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 37a04681-51df-4f74-af55-3f8f4e1b8a71 could not be found. May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '37a04681-51df-4f74-af55-3f8f4e1b8a71'} May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37a04681-51df-4f74-af55-3f8f4e1b8a71 could not be found. May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37a04681-51df-4f74-af55-3f8f4e1b8a71 could not be found. May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:31:55.230382 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:31:55.240759 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:31:55.240759 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:31:55.240759 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:31:55.240759 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:31:55.240759 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:31:55.240759 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37a04681-51df-4f74-af55-3f8f4e1b8a71 could not be found. May 28 21:31:55.240759 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:31:55.240759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-815b8b92-39a4-4f9e-904b-cde0caeab87c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Returning 404 to user: Instance 37a04681-51df-4f74-af55-3f8f4e1b8a71 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:31:55.240759 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-815b8b92-39a4-4f9e-904b-cde0caeab87c tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71" status: 404 len: 111 microversion: 2.1 time: 0.031202 May 28 21:31:55.240759 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2811/5677] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:31:55 2022] GET /compute/v2.1/servers/37a04681-51df-4f74-af55-3f8f4e1b8a71 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:31:55.721310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fb1ffd97-5073-40bf-af7b-d7655981b509 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:55.721974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fb1ffd97-5073-40bf-af7b-d7655981b509 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:55.730248 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb1ffd97-5073-40bf-af7b-d7655981b509 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:55.730712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb1ffd97-5073-40bf-af7b-d7655981b509 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:55.731495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb1ffd97-5073-40bf-af7b-d7655981b509 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:55.731942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fb1ffd97-5073-40bf-af7b-d7655981b509 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:55.796992 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fb1ffd97-5073-40bf-af7b-d7655981b509 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:55.805357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fb1ffd97-5073-40bf-af7b-d7655981b509 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:55.807500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fb1ffd97-5073-40bf-af7b-d7655981b509 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:55.808682 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fb1ffd97-5073-40bf-af7b-d7655981b509 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1371 microversion: 2.57 time: 0.091212 May 28 21:31:55.809246 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2867/5678] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:55 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 28 21:31:56.827970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5202d33b-2e57-4504-b467-4058ab74ad43 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:56.828635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5202d33b-2e57-4504-b467-4058ab74ad43 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:56.838709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5202d33b-2e57-4504-b467-4058ab74ad43 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:56.839212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5202d33b-2e57-4504-b467-4058ab74ad43 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:56.840269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5202d33b-2e57-4504-b467-4058ab74ad43 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:56.840719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5202d33b-2e57-4504-b467-4058ab74ad43 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:56.846006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:31:56.909673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5202d33b-2e57-4504-b467-4058ab74ad43 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:56.918479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5202d33b-2e57-4504-b467-4058ab74ad43 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:56.920050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5202d33b-2e57-4504-b467-4058ab74ad43 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:56.921280 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5202d33b-2e57-4504-b467-4058ab74ad43 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1371 microversion: 2.57 time: 0.097498 May 28 21:31:56.921861 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2812/5679] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:56 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1371 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:57.944497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1b5b3bb6-1b01-41cf-b153-03a89d7dd8aa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:57.945085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1b5b3bb6-1b01-41cf-b153-03a89d7dd8aa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:57.955661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b5b3bb6-1b01-41cf-b153-03a89d7dd8aa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:57.956272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b5b3bb6-1b01-41cf-b153-03a89d7dd8aa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:57.957462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b5b3bb6-1b01-41cf-b153-03a89d7dd8aa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:57.958160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b5b3bb6-1b01-41cf-b153-03a89d7dd8aa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:58.043638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1b5b3bb6-1b01-41cf-b153-03a89d7dd8aa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:58.052802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1b5b3bb6-1b01-41cf-b153-03a89d7dd8aa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:58.054353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1b5b3bb6-1b01-41cf-b153-03a89d7dd8aa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:58.055888 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1b5b3bb6-1b01-41cf-b153-03a89d7dd8aa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1356 microversion: 2.57 time: 0.117603 May 28 21:31:58.056971 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2868/5680] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:57 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1356 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:58.109882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6197ec1a-7463-4383-824b-bb855563fd55 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:58.111315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6197ec1a-7463-4383-824b-bb855563fd55 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:58.128429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6197ec1a-7463-4383-824b-bb855563fd55 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:58.128889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6197ec1a-7463-4383-824b-bb855563fd55 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:58.129682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6197ec1a-7463-4383-824b-bb855563fd55 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:58.133155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6197ec1a-7463-4383-824b-bb855563fd55 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:58.202590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6197ec1a-7463-4383-824b-bb855563fd55 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:31:58.588515 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6197ec1a-7463-4383-824b-bb855563fd55 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 204 len: 0 microversion: 2.57 time: 0.506863 May 28 21:31:58.589125 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2813/5681] 10.222.0.33 () {60 vars in 1279 bytes} [Sat May 28 21:31:58 2022] DELETE /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 28 21:31:58.599832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e2285a74-6487-45fe-94c2-c27bf813d077 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:58.600464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e2285a74-6487-45fe-94c2-c27bf813d077 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:58.619844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e2285a74-6487-45fe-94c2-c27bf813d077 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:58.619844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e2285a74-6487-45fe-94c2-c27bf813d077 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:58.619844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e2285a74-6487-45fe-94c2-c27bf813d077 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:58.619844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e2285a74-6487-45fe-94c2-c27bf813d077 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:58.770849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e2285a74-6487-45fe-94c2-c27bf813d077 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:58.772289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e2285a74-6487-45fe-94c2-c27bf813d077 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:58.775326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e2285a74-6487-45fe-94c2-c27bf813d077 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:58.776992 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e2285a74-6487-45fe-94c2-c27bf813d077 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1362 microversion: 2.57 time: 0.181130 May 28 21:31:58.779308 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2869/5682] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:58 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:31:59.610780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-356a4ad8-9ad0-4f09-b64a-e79943dca47a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] Calling method '.version_select at 0x7f4d56c298b0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:59.692371 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-356a4ad8-9ad0-4f09-b64a-e79943dca47a tempest-TestNetworkAdvancedServerOps-174864934 tempest-TestNetworkAdvancedServerOps-174864934-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-218233991" status: 202 len: 0 microversion: 2.1 time: 0.085974 May 28 21:31:59.692961 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2814/5683] 10.222.0.33 () {58 vars in 1280 bytes} [Sat May 28 21:31:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-218233991 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:31:59.796065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1dec6391-5f5c-4a06-b9a5-5423d2bb0fe3 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:31:59.796711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1dec6391-5f5c-4a06-b9a5-5423d2bb0fe3 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:31:59.803699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1dec6391-5f5c-4a06-b9a5-5423d2bb0fe3 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:59.804158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1dec6391-5f5c-4a06-b9a5-5423d2bb0fe3 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:59.804924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1dec6391-5f5c-4a06-b9a5-5423d2bb0fe3 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:31:59.805366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1dec6391-5f5c-4a06-b9a5-5423d2bb0fe3 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:31:59.874700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1dec6391-5f5c-4a06-b9a5-5423d2bb0fe3 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:59.882772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1dec6391-5f5c-4a06-b9a5-5423d2bb0fe3 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:59.884290 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1dec6391-5f5c-4a06-b9a5-5423d2bb0fe3 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:31:59.885462 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1dec6391-5f5c-4a06-b9a5-5423d2bb0fe3 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1362 microversion: 2.57 time: 0.093363 May 28 21:31:59.886063 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2870/5684] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:31:59 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1362 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:32:00.904804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-254d380c-c5ca-448f-a50d-31fec8533ed2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:00.906447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-254d380c-c5ca-448f-a50d-31fec8533ed2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:00.912741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-254d380c-c5ca-448f-a50d-31fec8533ed2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:00.913199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-254d380c-c5ca-448f-a50d-31fec8533ed2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:00.914013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-254d380c-c5ca-448f-a50d-31fec8533ed2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:00.914460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-254d380c-c5ca-448f-a50d-31fec8533ed2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:00.948454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-254d380c-c5ca-448f-a50d-31fec8533ed2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:00.949453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-254d380c-c5ca-448f-a50d-31fec8533ed2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:00.949453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-254d380c-c5ca-448f-a50d-31fec8533ed2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lazy-loading 'fault' on Instance uuid 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:32:01.013864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-254d380c-c5ca-448f-a50d-31fec8533ed2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:01.023559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-254d380c-c5ca-448f-a50d-31fec8533ed2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:01.025704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-254d380c-c5ca-448f-a50d-31fec8533ed2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd15d14a609054950959cb446223dad78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c9a59b25d3d479caeafce7ad25cf423', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:01.027617 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-254d380c-c5ca-448f-a50d-31fec8533ed2 tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 200 len: 1367 microversion: 2.57 time: 0.127568 May 28 21:32:01.028354 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2815/5685] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:32:00 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 1367 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 28 21:32:02.047417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ba7170a7-92a0-47b1-acaf-0ded602bf4fa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:02.048044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ba7170a7-92a0-47b1-acaf-0ded602bf4fa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] [instance: 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:02.056987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba7170a7-92a0-47b1-acaf-0ded602bf4fa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:02.064189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba7170a7-92a0-47b1-acaf-0ded602bf4fa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:02.064189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba7170a7-92a0-47b1-acaf-0ded602bf4fa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:02.064189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba7170a7-92a0-47b1-acaf-0ded602bf4fa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:02.064189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:32:02.074324 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-ba7170a7-92a0-47b1-acaf-0ded602bf4fa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] HTTP exception thrown: Instance 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 could not be found. May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ba7170a7-92a0-47b1-acaf-0ded602bf4fa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Request method failure captured: May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 HTTP/1.1 May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpSnd6uNF8ZYET4bSTRUvtxtgC9XXabYt_8FVeRwMuYNJCaFOEOBK-8_5RFqQ3nzsnO8ZbWCljR12y_K7Yw5XN5vBfd5CcGcxwru_pArjTVNExYHBfgr3YaxnsqiUKqBZHMuWPtFay29qdZQToMK9Cor8IxT2jrmWB6WfOy5UmiBmjE May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Openstack-Nova-Api-Version: 2.57 May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 8c9a59b25d3d479caeafce7ad25cf423 May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerShowV257Test-199485726 May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8c9a59b25d3d479caeafce7ad25cf423", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c9a59b25d3d479caeafce7ad25cf423"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8c9a59b25d3d479caeafce7ad25cf423"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8c9a59b25d3d479caeafce7ad25cf423"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerShowV257Test-199485726 May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 8c9a59b25d3d479caeafce7ad25cf423 May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerShowV257Test-199485726 May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerShowV257Test-199485726-project May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: d15d14a609054950959cb446223dad78 May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerShowV257Test-199485726-project May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 could not be found. May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '0fd8cfad-3e73-4c98-96ef-50b58b26eaa8'} May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 could not be found. May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 could not be found. May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:32:02.076031 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:32:02.083562 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:32:02.083562 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:32:02.083562 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:32:02.083562 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:32:02.083562 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:32:02.083562 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 could not be found. May 28 21:32:02.083562 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:32:02.083562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ba7170a7-92a0-47b1-acaf-0ded602bf4fa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] Returning 404 to user: Instance 0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:32:02.083562 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ba7170a7-92a0-47b1-acaf-0ded602bf4fa tempest-ServerShowV257Test-199485726 tempest-ServerShowV257Test-199485726-project] 10.222.0.33 "GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8" status: 404 len: 111 microversion: 2.57 time: 0.033926 May 28 21:32:02.083562 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2871/5686] 10.222.0.33 () {60 vars in 1276 bytes} [Sat May 28 21:32:02 2022] GET /compute/v2.1/servers/0fd8cfad-3e73-4c98-96ef-50b58b26eaa8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 28 21:32:07.914323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1385698390", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "98cbbe0d-742a-49e2-b86e-a5499d0b4313"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:32:07.967880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] validate_networks() for [('98cbbe0d-742a-49e2-b86e-a5499d0b4313', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:32:08.322246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:32:08.322675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:32:08.323235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:32:08.323651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:32:08.324068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:32:08.333227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:08.333678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:08.334523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:08.334962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:08.351866 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Getting quotas for project 8a50a2e9cce04058b89adb71008e6397. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:32:08.357719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Getting quotas for user 1d2aebad2d24440fb9cfdb279afc9290 and project 8a50a2e9cce04058b89adb71008e6397. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:32:08.371244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:32:08.373679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:32:08.506489 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f24c8ac8-8adc-42c2-8ec0-10d1742758e1 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714548 May 28 21:32:08.514249 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2816/5687] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:32:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:32:08.519815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1db36d3b-6c60-4d4d-b6d8-b24dae4abbec tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:08.520590 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1db36d3b-6c60-4d4d-b6d8-b24dae4abbec tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:08.583001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1db36d3b-6c60-4d4d-b6d8-b24dae4abbec tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:08.590823 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1db36d3b-6c60-4d4d-b6d8-b24dae4abbec tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1228 microversion: 2.1 time: 0.075125 May 28 21:32:08.597665 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2872/5688] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:08 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1228 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:09.609047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b9ef59fe-b5e1-439c-bee8-dcd6276c9f72 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:09.609641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b9ef59fe-b5e1-439c-bee8-dcd6276c9f72 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:09.617551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9ef59fe-b5e1-439c-bee8-dcd6276c9f72 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:09.618052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9ef59fe-b5e1-439c-bee8-dcd6276c9f72 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:09.619341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9ef59fe-b5e1-439c-bee8-dcd6276c9f72 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:09.619816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9ef59fe-b5e1-439c-bee8-dcd6276c9f72 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:09.687398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b9ef59fe-b5e1-439c-bee8-dcd6276c9f72 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:09.695511 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b9ef59fe-b5e1-439c-bee8-dcd6276c9f72 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1232 microversion: 2.1 time: 0.091650 May 28 21:32:09.696072 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2817/5689] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:09 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1232 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:10.717917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-22894896-a29e-4c2e-b7eb-863a2a288b03 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:10.718540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-22894896-a29e-4c2e-b7eb-863a2a288b03 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:10.726608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22894896-a29e-4c2e-b7eb-863a2a288b03 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:10.727067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22894896-a29e-4c2e-b7eb-863a2a288b03 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:10.728319 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22894896-a29e-4c2e-b7eb-863a2a288b03 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:10.728762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22894896-a29e-4c2e-b7eb-863a2a288b03 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:10.832347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-22894896-a29e-4c2e-b7eb-863a2a288b03 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:10.842298 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-22894896-a29e-4c2e-b7eb-863a2a288b03 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1280 microversion: 2.1 time: 0.128433 May 28 21:32:10.842916 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2873/5690] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:10 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1280 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:11.859485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6e310be6-efd9-4fa1-a842-b30bfca14c84 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:11.860807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6e310be6-efd9-4fa1-a842-b30bfca14c84 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:11.868751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e310be6-efd9-4fa1-a842-b30bfca14c84 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:11.869206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e310be6-efd9-4fa1-a842-b30bfca14c84 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:11.870079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e310be6-efd9-4fa1-a842-b30bfca14c84 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:11.870522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6e310be6-efd9-4fa1-a842-b30bfca14c84 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:12.146670 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6e310be6-efd9-4fa1-a842-b30bfca14c84 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:12.156609 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6e310be6-efd9-4fa1-a842-b30bfca14c84 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1328 microversion: 2.1 time: 0.301557 May 28 21:32:12.157518 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2818/5691] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:11 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1328 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:12.688895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-14577e2d-7414-4456-b8e9-3dc50456e9a5 req-5f264973-ba63-4db5-ab4d-20ae73ef1540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e270095-55e5-473b-acaa-66c465df3b86", "tag": "b7090f2e-3ba6-4707-a52d-8db7d5c0d69f"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:32:12.698448 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-14577e2d-7414-4456-b8e9-3dc50456e9a5 req-5f264973-ba63-4db5-ab4d-20ae73ef1540 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:12.698921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-14577e2d-7414-4456-b8e9-3dc50456e9a5 req-5f264973-ba63-4db5-ab4d-20ae73ef1540 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:12.707845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3ff75d76-7750-45ff-a947-d6d64c9afbbb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:12.708431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3ff75d76-7750-45ff-a947-d6d64c9afbbb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:12.711712 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-14577e2d-7414-4456-b8e9-3dc50456e9a5 req-5f264973-ba63-4db5-ab4d-20ae73ef1540 service nova] Creating event network-changed:b7090f2e-3ba6-4707-a52d-8db7d5c0d69f for instance 3e270095-55e5-473b-acaa-66c465df3b86 on nch1-master-1 May 28 21:32:12.716497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ff75d76-7750-45ff-a947-d6d64c9afbbb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:12.717015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ff75d76-7750-45ff-a947-d6d64c9afbbb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:12.717920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ff75d76-7750-45ff-a947-d6d64c9afbbb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:12.718461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ff75d76-7750-45ff-a947-d6d64c9afbbb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:12.718693 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-14577e2d-7414-4456-b8e9-3dc50456e9a5 req-5f264973-ba63-4db5-ab4d-20ae73ef1540 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034131 May 28 21:32:12.719303 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2874/5692] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:12.756363 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3ff75d76-7750-45ff-a947-d6d64c9afbbb tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/ips" status: 200 len: 146 microversion: 2.1 time: 0.052421 May 28 21:32:12.756986 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2819/5693] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 21:32:12 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/ips => generated 146 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:13.176740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0f7c785a-f384-4e5f-a450-5c2bf975d81e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:13.177549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0f7c785a-f384-4e5f-a450-5c2bf975d81e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:13.184976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f7c785a-f384-4e5f-a450-5c2bf975d81e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:13.185868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f7c785a-f384-4e5f-a450-5c2bf975d81e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:13.186671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f7c785a-f384-4e5f-a450-5c2bf975d81e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:13.187121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f7c785a-f384-4e5f-a450-5c2bf975d81e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:13.414147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0f7c785a-f384-4e5f-a450-5c2bf975d81e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:13.422330 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0f7c785a-f384-4e5f-a450-5c2bf975d81e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1328 microversion: 2.1 time: 0.250067 May 28 21:32:13.423108 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2875/5694] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:13 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1328 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:14.439431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-93bc6a82-7dea-46f0-9c87-5745a7e619be tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:14.440166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-93bc6a82-7dea-46f0-9c87-5745a7e619be tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:14.447789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93bc6a82-7dea-46f0-9c87-5745a7e619be tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:14.448248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93bc6a82-7dea-46f0-9c87-5745a7e619be tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:14.449006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93bc6a82-7dea-46f0-9c87-5745a7e619be tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:14.449444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93bc6a82-7dea-46f0-9c87-5745a7e619be tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:14.583862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-93bc6a82-7dea-46f0-9c87-5745a7e619be tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:14.591673 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-93bc6a82-7dea-46f0-9c87-5745a7e619be tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1328 microversion: 2.1 time: 0.156491 May 28 21:32:14.592243 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2820/5695] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:14 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1328 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:15.609121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-887ce4b3-077f-4cf1-bb71-4adf29d04a75 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:15.609778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-887ce4b3-077f-4cf1-bb71-4adf29d04a75 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:15.616389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-887ce4b3-077f-4cf1-bb71-4adf29d04a75 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:15.616854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-887ce4b3-077f-4cf1-bb71-4adf29d04a75 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:15.617623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-887ce4b3-077f-4cf1-bb71-4adf29d04a75 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:15.618896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-887ce4b3-077f-4cf1-bb71-4adf29d04a75 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:15.637022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-21f332c3-c426-482d-b02a-48e9fd499e6f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60d078cc-0a8b-44c0-924e-2d287ff7f3bd"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:32:15.638213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-21f332c3-c426-482d-b02a-48e9fd499e6f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:15.645745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21f332c3-c426-482d-b02a-48e9fd499e6f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:15.646590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21f332c3-c426-482d-b02a-48e9fd499e6f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:15.647024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21f332c3-c426-482d-b02a-48e9fd499e6f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:15.647471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21f332c3-c426-482d-b02a-48e9fd499e6f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:15.763530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-887ce4b3-077f-4cf1-bb71-4adf29d04a75 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:15.771141 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-887ce4b3-077f-4cf1-bb71-4adf29d04a75 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1328 microversion: 2.1 time: 0.166055 May 28 21:32:15.771715 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2876/5696] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:15 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1328 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:16.569538 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-21f332c3-c426-482d-b02a-48e9fd499e6f tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "POST /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.936753 May 28 21:32:16.570136 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2821/5697] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:32:15 2022] POST /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments => generated 194 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:32:16.788376 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f39eaf58-65df-4221-912a-705931e22998 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:16.789689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f39eaf58-65df-4221-912a-705931e22998 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:16.797648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f39eaf58-65df-4221-912a-705931e22998 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:16.798394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f39eaf58-65df-4221-912a-705931e22998 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:16.799299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f39eaf58-65df-4221-912a-705931e22998 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:16.799868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f39eaf58-65df-4221-912a-705931e22998 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:16.971575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f39eaf58-65df-4221-912a-705931e22998 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:16.982309 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f39eaf58-65df-4221-912a-705931e22998 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1328 microversion: 2.1 time: 0.197947 May 28 21:32:16.983084 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2877/5698] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:16 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1328 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:18.000347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9d2b8402-3afd-49c1-bee5-11b83fbdd075 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:18.001069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9d2b8402-3afd-49c1-bee5-11b83fbdd075 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:18.003079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:32:18.008125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d2b8402-3afd-49c1-bee5-11b83fbdd075 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:18.008584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d2b8402-3afd-49c1-bee5-11b83fbdd075 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:18.010249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d2b8402-3afd-49c1-bee5-11b83fbdd075 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:18.010869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d2b8402-3afd-49c1-bee5-11b83fbdd075 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:18.150062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9d2b8402-3afd-49c1-bee5-11b83fbdd075 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:18.158393 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9d2b8402-3afd-49c1-bee5-11b83fbdd075 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1328 microversion: 2.1 time: 0.163154 May 28 21:32:18.158967 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2822/5699] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:17 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1328 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:19.094559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-9e4446b3-62f5-411c-ba66-e88f6239590a req-c9e13a8e-909a-4438-bbd8-7667de129843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e270095-55e5-473b-acaa-66c465df3b86", "name": "network-vif-plugged", "status": "completed", "tag": "b7090f2e-3ba6-4707-a52d-8db7d5c0d69f"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:32:19.098616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:32:19.103996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9e4446b3-62f5-411c-ba66-e88f6239590a req-c9e13a8e-909a-4438-bbd8-7667de129843 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:19.104442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9e4446b3-62f5-411c-ba66-e88f6239590a req-c9e13a8e-909a-4438-bbd8-7667de129843 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:19.117061 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-9e4446b3-62f5-411c-ba66-e88f6239590a req-c9e13a8e-909a-4438-bbd8-7667de129843 service nova] Creating event network-vif-plugged:b7090f2e-3ba6-4707-a52d-8db7d5c0d69f for instance 3e270095-55e5-473b-acaa-66c465df3b86 on nch1-master-1 May 28 21:32:19.122322 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-9e4446b3-62f5-411c-ba66-e88f6239590a req-c9e13a8e-909a-4438-bbd8-7667de129843 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031737 May 28 21:32:19.122941 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2878/5700] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:19.175794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-53f92fdb-fb85-4fe9-85d9-da17e52a84cb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:19.176423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-53f92fdb-fb85-4fe9-85d9-da17e52a84cb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:19.178957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:32:19.179649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:32:19.186874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53f92fdb-fb85-4fe9-85d9-da17e52a84cb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:19.187421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53f92fdb-fb85-4fe9-85d9-da17e52a84cb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:19.188261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53f92fdb-fb85-4fe9-85d9-da17e52a84cb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:19.188707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53f92fdb-fb85-4fe9-85d9-da17e52a84cb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:19.359382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-53f92fdb-fb85-4fe9-85d9-da17e52a84cb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:19.367222 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-53f92fdb-fb85-4fe9-85d9-da17e52a84cb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1328 microversion: 2.1 time: 0.195491 May 28 21:32:19.368612 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2823/5701] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:19 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1328 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:20.386926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f5a07506-1c3b-473e-ab02-24dcd1413c0d tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:20.387636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f5a07506-1c3b-473e-ab02-24dcd1413c0d tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:20.389706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=42 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:32:20.394812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5a07506-1c3b-473e-ab02-24dcd1413c0d tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:20.395278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5a07506-1c3b-473e-ab02-24dcd1413c0d tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:20.396061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5a07506-1c3b-473e-ab02-24dcd1413c0d tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:20.396504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5a07506-1c3b-473e-ab02-24dcd1413c0d tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:20.856669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f5a07506-1c3b-473e-ab02-24dcd1413c0d tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:20.864192 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f5a07506-1c3b-473e-ab02-24dcd1413c0d tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1328 microversion: 2.1 time: 0.483306 May 28 21:32:20.864777 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2879/5702] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:20 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1328 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:20.907752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-77a01bf1-4831-4127-8287-7f8007fb623d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:20.908965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-77a01bf1-4831-4127-8287-7f8007fb623d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:20.916762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77a01bf1-4831-4127-8287-7f8007fb623d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:20.917295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77a01bf1-4831-4127-8287-7f8007fb623d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:20.918126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77a01bf1-4831-4127-8287-7f8007fb623d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:20.918563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77a01bf1-4831-4127-8287-7f8007fb623d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:20.949517 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-77a01bf1-4831-4127-8287-7f8007fb623d tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046144 May 28 21:32:20.950111 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2824/5703] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:32:20 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:20.960365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-19992083-38c4-4687-af2a-8daf01f9eb1b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:20.960871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-19992083-38c4-4687-af2a-8daf01f9eb1b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:20.969696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19992083-38c4-4687-af2a-8daf01f9eb1b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:20.969696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19992083-38c4-4687-af2a-8daf01f9eb1b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:20.969696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19992083-38c4-4687-af2a-8daf01f9eb1b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:20.969696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-19992083-38c4-4687-af2a-8daf01f9eb1b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:20.998206 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-19992083-38c4-4687-af2a-8daf01f9eb1b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments/60d078cc-0a8b-44c0-924e-2d287ff7f3bd" status: 200 len: 194 microversion: 2.1 time: 0.041794 May 28 21:32:20.998797 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2880/5704] 10.222.0.33 () {58 vars in 1412 bytes} [Sat May 28 21:32:20 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments/60d078cc-0a8b-44c0-924e-2d287ff7f3bd => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:21.881631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-457db4f4-4966-44b5-9cb8-f383ff0d0a23 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:21.882297 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-457db4f4-4966-44b5-9cb8-f383ff0d0a23 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:21.898582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-457db4f4-4966-44b5-9cb8-f383ff0d0a23 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:21.898582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-457db4f4-4966-44b5-9cb8-f383ff0d0a23 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:21.898582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-457db4f4-4966-44b5-9cb8-f383ff0d0a23 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:21.898582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-457db4f4-4966-44b5-9cb8-f383ff0d0a23 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:22.023197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-457db4f4-4966-44b5-9cb8-f383ff0d0a23 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:22.031132 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-457db4f4-4966-44b5-9cb8-f383ff0d0a23 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1529 microversion: 2.1 time: 0.153208 May 28 21:32:22.031953 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2825/5705] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:21 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1529 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:22.048785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-34b081ed-11b3-42c6-81af-b59127c921e8 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:22.049434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-34b081ed-11b3-42c6-81af-b59127c921e8 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:22.057734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34b081ed-11b3-42c6-81af-b59127c921e8 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:22.058249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34b081ed-11b3-42c6-81af-b59127c921e8 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:22.059025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34b081ed-11b3-42c6-81af-b59127c921e8 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:22.059499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34b081ed-11b3-42c6-81af-b59127c921e8 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:22.213354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-34b081ed-11b3-42c6-81af-b59127c921e8 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:22.224167 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-34b081ed-11b3-42c6-81af-b59127c921e8 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1529 microversion: 2.1 time: 0.179278 May 28 21:32:22.224949 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2881/5706] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:22 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1529 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:22.291566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dc510cf0-c33d-4576-bafa-40f8ee839621 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:22.292104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dc510cf0-c33d-4576-bafa-40f8ee839621 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:22.298293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc510cf0-c33d-4576-bafa-40f8ee839621 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:22.298758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc510cf0-c33d-4576-bafa-40f8ee839621 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:22.299529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc510cf0-c33d-4576-bafa-40f8ee839621 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:22.299976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc510cf0-c33d-4576-bafa-40f8ee839621 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:22.314281 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-dc510cf0-c33d-4576-bafa-40f8ee839621 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] HTTP exception thrown: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dc510cf0-c33d-4576-bafa-40f8ee839621 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] Request method failure captured: May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 HTTP/1.1 May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpTX6H8ThrZ9mRdgGA6_YEbEVCLTrMIdKC-yfNmAgjAFQvDT35Qs1tDIQyiy2IG7lk0chi0Km0szYFjjXLbYXyjImVmrgyxOD0RbcRajEbSWsH1einGwOtKXaBcpbr5biK8eFIqgWKQtumEu3DalES2JOyE_mZp8mGMT5t0Ozx_gQN4 May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: a63778cceaba4431b706a6de830ced40 May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-250780266 May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a63778cceaba4431b706a6de830ced40", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a63778cceaba4431b706a6de830ced40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a63778cceaba4431b706a6de830ced40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a63778cceaba4431b706a6de830ced40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-250780266 May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: a63778cceaba4431b706a6de830ced40 May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-250780266 May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestMultiTenantJSON-250780266-project May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: cb35028198084d9c9eeb72b28e0e9117 May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-250780266-project May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '3e270095-55e5-473b-acaa-66c465df3b86'} May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:32:22.315941 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:32:22.324394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. May 28 21:32:22.324394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:22.324394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:32:22.324394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:22.324394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:32:22.324394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:32:22.324394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:32:22.324394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:32:22.324394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:32:22.324394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. May 28 21:32:22.324394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:22.324394 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dc510cf0-c33d-4576-bafa-40f8ee839621 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] Returning 404 to user: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:32:22.324394 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dc510cf0-c33d-4576-bafa-40f8ee839621 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 404 len: 111 microversion: 2.1 time: 0.080631 May 28 21:32:22.324394 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2826/5707] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:32:22 2022] DELETE /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:32:22.327762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7b2dffad-22b4-4f2b-a098-ece4ffe53d8a tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:22.328382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7b2dffad-22b4-4f2b-a098-ece4ffe53d8a tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:22.335106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b2dffad-22b4-4f2b-a098-ece4ffe53d8a tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:22.335647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b2dffad-22b4-4f2b-a098-ece4ffe53d8a tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:22.336357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b2dffad-22b4-4f2b-a098-ece4ffe53d8a tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:22.336797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7b2dffad-22b4-4f2b-a098-ece4ffe53d8a tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:22.466507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7b2dffad-22b4-4f2b-a098-ece4ffe53d8a tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:22.474280 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7b2dffad-22b4-4f2b-a098-ece4ffe53d8a tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1529 microversion: 2.1 time: 0.150421 May 28 21:32:22.474858 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2882/5708] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:22 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1529 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:22.490662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d0d44325-c1d2-4fa5-a524-421d9a230dd3 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] Action: 'update', calling method: >, body: {"server": {"name": "3e270095-55e5-473b-acaa-66c465df3b86_new"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:32:22.493362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d0d44325-c1d2-4fa5-a524-421d9a230dd3 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:22.498136 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0d44325-c1d2-4fa5-a524-421d9a230dd3 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:22.498593 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0d44325-c1d2-4fa5-a524-421d9a230dd3 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:22.499455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0d44325-c1d2-4fa5-a524-421d9a230dd3 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:22.499899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0d44325-c1d2-4fa5-a524-421d9a230dd3 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:22.513505 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-d0d44325-c1d2-4fa5-a524-421d9a230dd3 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] HTTP exception thrown: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d0d44325-c1d2-4fa5-a524-421d9a230dd3 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] Request method failure captured: May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: request: PUT /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 HTTP/1.1 May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 64 May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpTX6H8ThrZ9mRdgGA6_YEbEVCLTrMIdKC-yfNmAgjAFQvDT35Qs1tDIQyiy2IG7lk0chi0Km0szYFjjXLbYXyjImVmrgyxOD0RbcRajEbSWsH1einGwOtKXaBcpbr5biK8eFIqgWKQtumEu3DalES2JOyE_mZp8mGMT5t0Ozx_gQN4 May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: a63778cceaba4431b706a6de830ced40 May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-250780266 May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a63778cceaba4431b706a6de830ced40", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a63778cceaba4431b706a6de830ced40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a63778cceaba4431b706a6de830ced40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a63778cceaba4431b706a6de830ced40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-250780266 May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: a63778cceaba4431b706a6de830ced40 May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-250780266 May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestMultiTenantJSON-250780266-project May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: cb35028198084d9c9eeb72b28e0e9117 May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-250780266-project May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: {"server": {"name": "3e270095-55e5-473b-acaa-66c465df3b86_new"}} May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '3e270095-55e5-473b-acaa-66c465df3b86', 'body': {'server': {'name': '3e270095-55e5-473b-acaa-66c465df3b86_new'}}} May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] May 28 21:32:22.515177 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d0d44325-c1d2-4fa5-a524-421d9a230dd3 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] Returning 404 to user: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d0d44325-c1d2-4fa5-a524-421d9a230dd3 tempest-ServersNegativeTestMultiTenantJSON-250780266 tempest-ServersNegativeTestMultiTenantJSON-250780266-project] 10.222.0.33 "PUT /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 404 len: 111 microversion: 2.1 time: 0.029812 May 28 21:32:22.519688 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2827/5709] 10.222.0.33 () {60 vars in 1255 bytes} [Sat May 28 21:32:22 2022] PUT /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:32:22.532704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2157bc87-3abd-4e4c-889f-3fe3d795447e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:22.533212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2157bc87-3abd-4e4c-889f-3fe3d795447e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:22.539541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2157bc87-3abd-4e4c-889f-3fe3d795447e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:22.539997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2157bc87-3abd-4e4c-889f-3fe3d795447e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:22.541638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2157bc87-3abd-4e4c-889f-3fe3d795447e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:22.542172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2157bc87-3abd-4e4c-889f-3fe3d795447e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:22.568493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2157bc87-3abd-4e4c-889f-3fe3d795447e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:32:22.839169 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2157bc87-3abd-4e4c-889f-3fe3d795447e tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 204 len: 0 microversion: 2.1 time: 0.309976 May 28 21:32:22.840039 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2883/5710] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:32:22 2022] DELETE /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:32:22.848410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8980c32c-ef6a-4b2f-b427-07a4f7b00aeb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:22.849101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8980c32c-ef6a-4b2f-b427-07a4f7b00aeb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:22.857502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8980c32c-ef6a-4b2f-b427-07a4f7b00aeb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:22.857903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8980c32c-ef6a-4b2f-b427-07a4f7b00aeb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:22.858686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8980c32c-ef6a-4b2f-b427-07a4f7b00aeb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:22.859177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8980c32c-ef6a-4b2f-b427-07a4f7b00aeb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:23.007708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8980c32c-ef6a-4b2f-b427-07a4f7b00aeb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:23.009233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:32:23.015359 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8980c32c-ef6a-4b2f-b427-07a4f7b00aeb tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1535 microversion: 2.1 time: 0.171011 May 28 21:32:23.015946 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2828/5711] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:22 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1535 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:23.792466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fafc9251-a378-4cc7-8cdc-38fe2e884e36 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be8b4c83-8b39-4532-a3ec-dc28247b1e69"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:32:23.793627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fafc9251-a378-4cc7-8cdc-38fe2e884e36 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:23.800603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fafc9251-a378-4cc7-8cdc-38fe2e884e36 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:23.801055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fafc9251-a378-4cc7-8cdc-38fe2e884e36 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:23.801822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fafc9251-a378-4cc7-8cdc-38fe2e884e36 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:23.802287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fafc9251-a378-4cc7-8cdc-38fe2e884e36 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:24.032966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a658ae8d-c9f2-45eb-9825-5d0af88f001f tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:24.033652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a658ae8d-c9f2-45eb-9825-5d0af88f001f tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:24.041999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a658ae8d-c9f2-45eb-9825-5d0af88f001f tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:24.042463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a658ae8d-c9f2-45eb-9825-5d0af88f001f tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:24.043223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a658ae8d-c9f2-45eb-9825-5d0af88f001f tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:24.043657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a658ae8d-c9f2-45eb-9825-5d0af88f001f tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:24.257669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a658ae8d-c9f2-45eb-9825-5d0af88f001f tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:24.266011 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a658ae8d-c9f2-45eb-9825-5d0af88f001f tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1535 microversion: 2.1 time: 0.236858 May 28 21:32:24.266753 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2829/5712] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:24 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1535 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:24.695282 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fafc9251-a378-4cc7-8cdc-38fe2e884e36 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "POST /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.907495 May 28 21:32:24.696003 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2884/5713] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:32:23 2022] POST /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments => generated 194 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:24.718865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-9548004e-c686-48e6-a149-5276f3d1a688 req-e865b244-9b78-44ab-8f18-582e2a0562a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e270095-55e5-473b-acaa-66c465df3b86", "name": "network-vif-deleted", "tag": "b7090f2e-3ba6-4707-a52d-8db7d5c0d69f"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:32:24.728405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9548004e-c686-48e6-a149-5276f3d1a688 req-e865b244-9b78-44ab-8f18-582e2a0562a3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:24.728861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9548004e-c686-48e6-a149-5276f3d1a688 req-e865b244-9b78-44ab-8f18-582e2a0562a3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:24.741483 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-9548004e-c686-48e6-a149-5276f3d1a688 req-e865b244-9b78-44ab-8f18-582e2a0562a3 service nova] Creating event network-vif-deleted:b7090f2e-3ba6-4707-a52d-8db7d5c0d69f for instance 3e270095-55e5-473b-acaa-66c465df3b86 on nch1-master-1 May 28 21:32:24.747185 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-9548004e-c686-48e6-a149-5276f3d1a688 req-e865b244-9b78-44ab-8f18-582e2a0562a3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033796 May 28 21:32:24.747801 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2830/5714] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:25.284042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d923d707-3560-4b1f-af23-bf4446b90365 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:25.284843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d923d707-3560-4b1f-af23-bf4446b90365 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:25.292944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d923d707-3560-4b1f-af23-bf4446b90365 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:25.293429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d923d707-3560-4b1f-af23-bf4446b90365 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:25.294323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d923d707-3560-4b1f-af23-bf4446b90365 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:25.294770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d923d707-3560-4b1f-af23-bf4446b90365 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:25.331429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d923d707-3560-4b1f-af23-bf4446b90365 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:25.331894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d923d707-3560-4b1f-af23-bf4446b90365 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:25.332357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-d923d707-3560-4b1f-af23-bf4446b90365 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lazy-loading 'fault' on Instance uuid 3e270095-55e5-473b-acaa-66c465df3b86 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:32:25.374821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d923d707-3560-4b1f-af23-bf4446b90365 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d2aebad2d24440fb9cfdb279afc9290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50a2e9cce04058b89adb71008e6397', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:25.382533 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d923d707-3560-4b1f-af23-bf4446b90365 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 200 len: 1318 microversion: 2.1 time: 0.102862 May 28 21:32:25.383245 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2885/5715] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:25 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 1318 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:26.400907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fc4b42b2-6282-4bc4-9d3b-492a642efc32 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:26.401614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fc4b42b2-6282-4bc4-9d3b-492a642efc32 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] [instance: 3e270095-55e5-473b-acaa-66c465df3b86] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:26.408585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc4b42b2-6282-4bc4-9d3b-492a642efc32 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:26.411529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc4b42b2-6282-4bc4-9d3b-492a642efc32 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:26.411529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc4b42b2-6282-4bc4-9d3b-492a642efc32 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:26.411529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc4b42b2-6282-4bc4-9d3b-492a642efc32 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:26.423422 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-fc4b42b2-6282-4bc4-9d3b-492a642efc32 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] HTTP exception thrown: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fc4b42b2-6282-4bc4-9d3b-492a642efc32 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Request method failure captured: May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 HTTP/1.1 May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpTVSq5X7bPz6eRhnNyqWXiKkCkAvfOnQNXMc3YHet6VBv5Ixi_gHQ4i4TwD6IXHv3afhBlLNVIVtOZ37bZMgVcfmOHXdNTBsvpHQp5Nyf2hD4fAWkNOp9f6EHqQhXWKE-27LI_2T0o14p__a2xMhffqqyWK4ZyLL0b-s5AvwUeoymM May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 8a50a2e9cce04058b89adb71008e6397 May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2003393570 May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_8a50a2e9cce04058b89adb71008e6397", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a50a2e9cce04058b89adb71008e6397"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/8a50a2e9cce04058b89adb71008e6397"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/8a50a2e9cce04058b89adb71008e6397"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2003393570 May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 8a50a2e9cce04058b89adb71008e6397 May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2003393570 May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2003393570-project May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 1d2aebad2d24440fb9cfdb279afc9290 May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2003393570-project May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '3e270095-55e5-473b-acaa-66c465df3b86'} May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. May 28 21:32:26.425040 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:26.429291 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:32:26.429291 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:26.429291 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:32:26.429291 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:32:26.429291 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:32:26.429291 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:32:26.429291 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:32:26.429291 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. May 28 21:32:26.429291 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:26.429291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fc4b42b2-6282-4bc4-9d3b-492a642efc32 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] Returning 404 to user: Instance 3e270095-55e5-473b-acaa-66c465df3b86 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:32:26.429291 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fc4b42b2-6282-4bc4-9d3b-492a642efc32 tempest-ServersNegativeTestMultiTenantJSON-2003393570 tempest-ServersNegativeTestMultiTenantJSON-2003393570-project] 10.222.0.33 "GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86" status: 404 len: 111 microversion: 2.1 time: 0.030761 May 28 21:32:26.429291 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2831/5716] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:26 2022] GET /compute/v2.1/servers/3e270095-55e5-473b-acaa-66c465df3b86 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:32:30.460126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7fb0ef68-b133-42b0-9502-14674c832134 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:30.461827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7fb0ef68-b133-42b0-9502-14674c832134 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:30.471080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fb0ef68-b133-42b0-9502-14674c832134 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:30.486073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fb0ef68-b133-42b0-9502-14674c832134 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:30.486073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fb0ef68-b133-42b0-9502-14674c832134 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:30.486073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fb0ef68-b133-42b0-9502-14674c832134 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:30.505681 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7fb0ef68-b133-42b0-9502-14674c832134 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049881 May 28 21:32:30.506624 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2886/5717] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:32:30 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:30.658083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2d58d8e5-c402-4b7d-8a49-b0bd7aac16ca tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:30.658700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2d58d8e5-c402-4b7d-8a49-b0bd7aac16ca tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:30.667099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d58d8e5-c402-4b7d-8a49-b0bd7aac16ca tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:30.667611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d58d8e5-c402-4b7d-8a49-b0bd7aac16ca tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:30.669148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d58d8e5-c402-4b7d-8a49-b0bd7aac16ca tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:30.669609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d58d8e5-c402-4b7d-8a49-b0bd7aac16ca tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:30.707433 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2d58d8e5-c402-4b7d-8a49-b0bd7aac16ca tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments/60d078cc-0a8b-44c0-924e-2d287ff7f3bd" status: 200 len: 194 microversion: 2.1 time: 0.057431 May 28 21:32:30.710029 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2832/5718] 10.222.0.33 () {58 vars in 1412 bytes} [Sat May 28 21:32:30 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments/60d078cc-0a8b-44c0-924e-2d287ff7f3bd => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:30.724402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e0561019-1157-44dd-863f-a418ba710aca tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:30.725447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e0561019-1157-44dd-863f-a418ba710aca tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:30.734238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0561019-1157-44dd-863f-a418ba710aca tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:30.737598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0561019-1157-44dd-863f-a418ba710aca tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:30.737598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0561019-1157-44dd-863f-a418ba710aca tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:30.737598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0561019-1157-44dd-863f-a418ba710aca tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:30.770980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:32:30.866756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-e0561019-1157-44dd-863f-a418ba710aca tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lazy-loading 'services' on Instance uuid 6401e526-a5f4-434e-baea-2f9d952e875f {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:32:31.118626 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e0561019-1157-44dd-863f-a418ba710aca tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments/60d078cc-0a8b-44c0-924e-2d287ff7f3bd" status: 202 len: 0 microversion: 2.1 time: 0.403935 May 28 21:32:31.119427 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2887/5719] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:32:30 2022] DELETE /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments/60d078cc-0a8b-44c0-924e-2d287ff7f3bd => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:32:31.221730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-709eb976-f776-4d79-b55a-df7a4d0b6c47 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Action: 'create', calling method: .version_select at 0x7f4d56bfa670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2118771571", "metadata": {"Type": "work"}}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:32:31.916836 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-709eb976-f776-4d79-b55a-df7a4d0b6c47 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 0.832850 May 28 21:32:31.917467 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2833/5720] 10.222.0.33 () {60 vars in 1155 bytes} [Sat May 28 21:32:31 2022] POST /compute/v2.1/os-volumes => generated 346 bytes in 834 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 28 21:32:31.932555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c6b5175b-dad4-471a-acf2-3af7d295992f tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c464c0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:31.984689 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c6b5175b-dad4-471a-acf2-3af7d295992f tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.058244 May 28 21:32:31.988028 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2888/5721] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:31 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:32.256683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c8a7377a-fa14-4d55-a8f3-1e8fa298587b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:32.257191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c8a7377a-fa14-4d55-a8f3-1e8fa298587b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:32.264897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8a7377a-fa14-4d55-a8f3-1e8fa298587b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:32.265357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8a7377a-fa14-4d55-a8f3-1e8fa298587b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:32.266790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8a7377a-fa14-4d55-a8f3-1e8fa298587b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:32.266790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c8a7377a-fa14-4d55-a8f3-1e8fa298587b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:32.301261 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c8a7377a-fa14-4d55-a8f3-1e8fa298587b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments/be8b4c83-8b39-4532-a3ec-dc28247b1e69" status: 200 len: 194 microversion: 2.1 time: 0.045610 May 28 21:32:32.301261 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2834/5722] 10.222.0.33 () {58 vars in 1412 bytes} [Sat May 28 21:32:32 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments/be8b4c83-8b39-4532-a3ec-dc28247b1e69 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:32.309045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e43f6edb-9f18-4187-af96-f8fd13678057 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:32.310117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e43f6edb-9f18-4187-af96-f8fd13678057 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:32.318059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e43f6edb-9f18-4187-af96-f8fd13678057 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:32.318598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e43f6edb-9f18-4187-af96-f8fd13678057 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:32.319505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e43f6edb-9f18-4187-af96-f8fd13678057 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:32.320154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e43f6edb-9f18-4187-af96-f8fd13678057 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:32.400407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-e43f6edb-9f18-4187-af96-f8fd13678057 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lazy-loading 'services' on Instance uuid 6401e526-a5f4-434e-baea-2f9d952e875f {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:32:32.588517 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e43f6edb-9f18-4187-af96-f8fd13678057 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments/be8b4c83-8b39-4532-a3ec-dc28247b1e69" status: 202 len: 0 microversion: 2.1 time: 0.283394 May 28 21:32:32.589423 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2889/5723] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:32:32 2022] DELETE /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments/be8b4c83-8b39-4532-a3ec-dc28247b1e69 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:32:32.999104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5e823b2a-316a-41b7-a958-cb1493200329 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56bc1af0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:33.048469 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5e823b2a-316a-41b7-a958-cb1493200329 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.053777 May 28 21:32:33.049220 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2835/5724] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:32 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:34.062341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0f6f859a-6b87-4de9-b3a7-10d3fea4eb7e tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c10700>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:34.116219 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0f6f859a-6b87-4de9-b3a7-10d3fea4eb7e tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.054801 May 28 21:32:34.116219 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2890/5725] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:34 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:35.126751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3023251f-c7f7-4904-a81b-cc7f680a8e4c tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56b88b80>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:35.174657 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3023251f-c7f7-4904-a81b-cc7f680a8e4c tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.053142 May 28 21:32:35.180072 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2836/5726] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:35 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:36.192076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e35f1ed4-e0c8-4a51-8a04-46b387d31299 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c0f940>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:36.240288 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e35f1ed4-e0c8-4a51-8a04-46b387d31299 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.053018 May 28 21:32:36.240886 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2891/5727] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:36 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:37.254516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-563ab3d2-0153-439a-bda1-563e9bc7e68f tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56bc1c10>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:37.303152 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-563ab3d2-0153-439a-bda1-563e9bc7e68f tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.053355 May 28 21:32:37.303749 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2837/5728] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:37 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:38.316644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b10e0b7c-d118-4838-88dd-19f86afa2b08 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c61ee0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:38.364363 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b10e0b7c-d118-4838-88dd-19f86afa2b08 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.052362 May 28 21:32:38.368763 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2892/5729] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:38 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:39.380415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-07ea2374-ac96-4c4c-8395-efb17e4237a5 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56d544c0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:39.429801 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-07ea2374-ac96-4c4c-8395-efb17e4237a5 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.054027 May 28 21:32:39.430406 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2838/5730] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:39 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:40.443046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-edc4e51f-1bd7-4848-bd20-2c6d6863090f tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d572d1b80>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:40.491959 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-edc4e51f-1bd7-4848-bd20-2c6d6863090f tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.053606 May 28 21:32:40.492534 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2893/5731] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:40 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:41.506169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1d21bd4d-9af6-4a65-97ea-fc47bd2e3262 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56bbd160>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:41.553569 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1d21bd4d-9af6-4a65-97ea-fc47bd2e3262 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.052284 May 28 21:32:41.554191 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2839/5732] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:41 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:42.564116 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:32:42.565123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:32:42.569099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bd2f7520-20d4-4fff-a585-0a6eccffac19 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c10790>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:42.622281 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bd2f7520-20d4-4fff-a585-0a6eccffac19 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.059828 May 28 21:32:42.623418 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2894/5733] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:42 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:43.230589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=23 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:32:43.234192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=23 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:32:43.236234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3870164b-4bc7-4830-96de-55918c95e74a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:43.237860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3870164b-4bc7-4830-96de-55918c95e74a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:43.244261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3870164b-4bc7-4830-96de-55918c95e74a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:43.244716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3870164b-4bc7-4830-96de-55918c95e74a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:43.245478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3870164b-4bc7-4830-96de-55918c95e74a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:43.245983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3870164b-4bc7-4830-96de-55918c95e74a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:43.274099 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3870164b-4bc7-4830-96de-55918c95e74a tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044254 May 28 21:32:43.274685 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2840/5734] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:32:43 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:32:43.380756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1b344e1d-10fc-4059-ae83-e9ff557c7020 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:43.381879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1b344e1d-10fc-4059-ae83-e9ff557c7020 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:43.390076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b344e1d-10fc-4059-ae83-e9ff557c7020 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:43.391572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b344e1d-10fc-4059-ae83-e9ff557c7020 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:43.391930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b344e1d-10fc-4059-ae83-e9ff557c7020 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:43.392446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b344e1d-10fc-4059-ae83-e9ff557c7020 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:43.423017 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1b344e1d-10fc-4059-ae83-e9ff557c7020 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046165 May 28 21:32:43.423639 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2895/5735] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:32:43 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:32:43.486252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-557e1d01-7746-4c94-bd4c-3ac4d225d2bc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:43.486776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-557e1d01-7746-4c94-bd4c-3ac4d225d2bc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:43.494350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-557e1d01-7746-4c94-bd4c-3ac4d225d2bc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:43.495291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-557e1d01-7746-4c94-bd4c-3ac4d225d2bc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:43.495620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-557e1d01-7746-4c94-bd4c-3ac4d225d2bc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:43.496061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-557e1d01-7746-4c94-bd4c-3ac4d225d2bc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:43.521649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-557e1d01-7746-4c94-bd4c-3ac4d225d2bc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:32:43.639573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e9ec37df-3f55-4cd5-ac78-c473b9f8b073 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c10dc0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:43.688998 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e9ec37df-3f55-4cd5-ac78-c473b9f8b073 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 347 microversion: 2.1 time: 0.053936 May 28 21:32:43.689587 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2896/5736] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:43 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 347 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:32:43.705391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e99663c8-1f32-40b1-93d6-5336f4905b6b tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c19430>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:43.767987 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e99663c8-1f32-40b1-93d6-5336f4905b6b tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 347 microversion: 2.1 time: 0.066635 May 28 21:32:43.779602 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2897/5737] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:43 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 347 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:32:43.785444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3ae95691-f8a0-4823-bfc3-4569a1d91179 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c7a700>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:43.917293 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-557e1d01-7746-4c94-bd4c-3ac4d225d2bc tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 204 len: 0 microversion: 2.1 time: 0.436888 May 28 21:32:43.917826 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2841/5738] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:32:43 2022] DELETE /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:32:43.926867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a50d7f24-781e-4f68-9f46-c044c08834f1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:43.927581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a50d7f24-781e-4f68-9f46-c044c08834f1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:43.933694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a50d7f24-781e-4f68-9f46-c044c08834f1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:43.934199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a50d7f24-781e-4f68-9f46-c044c08834f1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:43.934979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a50d7f24-781e-4f68-9f46-c044c08834f1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:43.935431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a50d7f24-781e-4f68-9f46-c044c08834f1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:44.093986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a50d7f24-781e-4f68-9f46-c044c08834f1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:44.103100 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a50d7f24-781e-4f68-9f46-c044c08834f1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1674 microversion: 2.1 time: 0.180776 May 28 21:32:44.103818 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2842/5739] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:43 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1674 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:32:44.120817 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3ae95691-f8a0-4823-bfc3-4569a1d91179 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 202 len: 0 microversion: 2.1 time: 0.337369 May 28 21:32:44.120817 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2898/5740] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 21:32:43 2022] DELETE /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:32:44.129773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2c38c062-13cf-4cc5-be85-db5fe83a4b06 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c29dc0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:44.176992 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2c38c062-13cf-4cc5-be85-db5fe83a4b06 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.053442 May 28 21:32:44.177588 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2843/5741] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:44 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:45.122910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6e8a1c69-1d26-41a3-9dc1-e637e9ce72e9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:45.123537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6e8a1c69-1d26-41a3-9dc1-e637e9ce72e9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:45.133454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e8a1c69-1d26-41a3-9dc1-e637e9ce72e9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:45.133454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e8a1c69-1d26-41a3-9dc1-e637e9ce72e9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:45.133688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e8a1c69-1d26-41a3-9dc1-e637e9ce72e9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:45.134344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e8a1c69-1d26-41a3-9dc1-e637e9ce72e9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:45.191268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9f1234d9-dc0d-440c-8a4b-ac0e500d76a1 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56b883a0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:45.250603 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9f1234d9-dc0d-440c-8a4b-ac0e500d76a1 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.064745 May 28 21:32:45.257027 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2844/5742] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:45 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:32:45.284704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6e8a1c69-1d26-41a3-9dc1-e637e9ce72e9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:45.292584 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6e8a1c69-1d26-41a3-9dc1-e637e9ce72e9 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1674 microversion: 2.1 time: 0.175154 May 28 21:32:45.293379 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2899/5743] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:45 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:46.265658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cdde3b84-e282-4c71-ad60-22f1ef4d2846 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56bee1f0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:46.311287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-422c5806-d7e7-4178-9aca-f56183059876 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:46.312061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-422c5806-d7e7-4178-9aca-f56183059876 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:46.321647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-422c5806-d7e7-4178-9aca-f56183059876 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:46.322085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-422c5806-d7e7-4178-9aca-f56183059876 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:46.323060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-422c5806-d7e7-4178-9aca-f56183059876 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:46.323705 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-422c5806-d7e7-4178-9aca-f56183059876 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:46.335940 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cdde3b84-e282-4c71-ad60-22f1ef4d2846 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.075956 May 28 21:32:46.336791 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2845/5744] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:46 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:46.391320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-422c5806-d7e7-4178-9aca-f56183059876 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:46.400724 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-422c5806-d7e7-4178-9aca-f56183059876 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1606 microversion: 2.1 time: 0.094529 May 28 21:32:46.401369 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2900/5745] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:46 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1606 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:32:46.552825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-3549cd57-4970-4959-a2d0-1b4fc3240a7f req-33b53c60-42d2-48f5-8072-7bd44678109f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6401e526-a5f4-434e-baea-2f9d952e875f", "name": "network-vif-deleted", "tag": "e0110c6f-1f82-42ec-a116-dd5556f40987"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:32:46.562440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3549cd57-4970-4959-a2d0-1b4fc3240a7f req-33b53c60-42d2-48f5-8072-7bd44678109f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:46.572313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3549cd57-4970-4959-a2d0-1b4fc3240a7f req-33b53c60-42d2-48f5-8072-7bd44678109f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:46.574740 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-3549cd57-4970-4959-a2d0-1b4fc3240a7f req-33b53c60-42d2-48f5-8072-7bd44678109f service nova] Creating event network-vif-deleted:e0110c6f-1f82-42ec-a116-dd5556f40987 for instance 6401e526-a5f4-434e-baea-2f9d952e875f on nch2-master-1 May 28 21:32:46.580372 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-3549cd57-4970-4959-a2d0-1b4fc3240a7f req-33b53c60-42d2-48f5-8072-7bd44678109f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031377 May 28 21:32:46.581503 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2846/5746] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:47.348647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-14e3c2c4-b4e0-4420-9e3e-daf87f121ce6 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c10b80>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:47.403255 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-14e3c2c4-b4e0-4420-9e3e-daf87f121ce6 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.058557 May 28 21:32:47.403843 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2901/5747] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:47 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:47.419582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-461ee623-3fc6-4036-aff4-965372a7016c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:47.420305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-461ee623-3fc6-4036-aff4-965372a7016c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:47.428411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-461ee623-3fc6-4036-aff4-965372a7016c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:47.429993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-461ee623-3fc6-4036-aff4-965372a7016c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:47.429993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-461ee623-3fc6-4036-aff4-965372a7016c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:47.430188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-461ee623-3fc6-4036-aff4-965372a7016c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:47.465224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-461ee623-3fc6-4036-aff4-965372a7016c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:47.465689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-461ee623-3fc6-4036-aff4-965372a7016c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:47.466187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-461ee623-3fc6-4036-aff4-965372a7016c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lazy-loading 'fault' on Instance uuid 6401e526-a5f4-434e-baea-2f9d952e875f {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:32:47.515075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-461ee623-3fc6-4036-aff4-965372a7016c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f78df0f96c47ac97a200a4442db6da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3cc8c5f2fe44b87bf5c05eadb62936c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:32:47.523621 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-461ee623-3fc6-4036-aff4-965372a7016c tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 200 len: 1327 microversion: 2.1 time: 0.108161 May 28 21:32:47.524624 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2847/5748] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:47 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:32:48.417717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c4cf9dc8-44aa-40c8-b36a-5f437274132b tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c5ec10>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:48.465664 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c4cf9dc8-44aa-40c8-b36a-5f437274132b tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.052841 May 28 21:32:48.466266 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2902/5749] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:48 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:48.540691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d058eaed-198e-47ec-9a98-8be0267b61be tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:48.541320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d058eaed-198e-47ec-9a98-8be0267b61be tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:32:48.548464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d058eaed-198e-47ec-9a98-8be0267b61be tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:48.550499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d058eaed-198e-47ec-9a98-8be0267b61be tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:48.550499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d058eaed-198e-47ec-9a98-8be0267b61be tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:32:48.550499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d058eaed-198e-47ec-9a98-8be0267b61be tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:32:48.563917 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-d058eaed-198e-47ec-9a98-8be0267b61be tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] HTTP exception thrown: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d058eaed-198e-47ec-9a98-8be0267b61be tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Request method failure captured: May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f HTTP/1.1 May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpPlhU68Y7j3b7llP_SiIbEUcCX8UhcT_jXm1aREvNsb5stwi92gong_XhY_hCutfnb_a0ixsP-MzktA3LXP48mG6k5sBU1dTg_B9w-83ShPqGHFoj2WPJna2Y6YciUmAUmq8SvZIXLY3idOrn3VZ7O9BLlteEgvaHU5OTKx9a_KZtA May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e3cc8c5f2fe44b87bf5c05eadb62936c May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AttachVolumeTestJSON-1447462214 May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3cc8c5f2fe44b87bf5c05eadb62936c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AttachVolumeTestJSON-1447462214 May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e3cc8c5f2fe44b87bf5c05eadb62936c May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1447462214 May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AttachVolumeTestJSON-1447462214-project May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 93f78df0f96c47ac97a200a4442db6da May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AttachVolumeTestJSON-1447462214-project May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '6401e526-a5f4-434e-baea-2f9d952e875f'} May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:32:48.566157 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:48.571094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:32:48.571094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:32:48.571094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:32:48.571094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:32:48.571094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:32:48.571094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. May 28 21:32:48.571094 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:32:48.571094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d058eaed-198e-47ec-9a98-8be0267b61be tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Returning 404 to user: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:32:48.571094 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d058eaed-198e-47ec-9a98-8be0267b61be tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 404 len: 111 microversion: 2.1 time: 0.030992 May 28 21:32:48.571094 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2848/5750] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:32:48 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:32:48.581861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0830639b-ea11-4d1b-866e-aa4ace2b0be0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '.version_select at 0x7f4d56c0f670>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:48.679609 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0830639b-ea11-4d1b-866e-aa4ace2b0be0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-497834363" status: 202 len: 0 microversion: 2.1 time: 0.102223 May 28 21:32:48.680147 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2903/5751] 10.222.0.33 () {58 vars in 1217 bytes} [Sat May 28 21:32:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-497834363 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:32:49.479184 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-74690288-97d7-4be4-91a6-2d38055fbe6f tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d571b5940>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:49.537072 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-74690288-97d7-4be4-91a6-2d38055fbe6f tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.062233 May 28 21:32:49.537656 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2849/5752] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:49 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:50.548700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7c8f72da-b0e2-4b22-a7ea-f48b7d5a9612 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d572d1040>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:50.598587 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7c8f72da-b0e2-4b22-a7ea-f48b7d5a9612 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.053752 May 28 21:32:50.599166 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2904/5753] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:50 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:51.612993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ec4b3241-0e38-46a7-b6d0-4fc921bc4242 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56b7f040>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:51.661615 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ec4b3241-0e38-46a7-b6d0-4fc921bc4242 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.054024 May 28 21:32:51.662238 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2850/5754] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:51 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:52.675547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e34b6eff-3f40-4514-90bf-edcb33d4fe4c tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d57800430>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:52.723341 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e34b6eff-3f40-4514-90bf-edcb33d4fe4c tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.053029 May 28 21:32:52.723917 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2905/5755] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:52 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:53.736747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fb08e505-a087-4d48-ae81-33e0662feaab tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56d54040>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:53.783904 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fb08e505-a087-4d48-ae81-33e0662feaab tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.051713 May 28 21:32:53.784512 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2851/5756] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:53 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:54.801586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-02fd698c-ca3d-473a-8a6c-0a5fefbe0dce tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c7a5e0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:54.849749 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-02fd698c-ca3d-473a-8a6c-0a5fefbe0dce tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.052860 May 28 21:32:54.850393 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2906/5757] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:54 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:55.863706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d56ce47f-1f02-463a-9612-3248ae2cd77b tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56bfadc0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:55.911017 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d56ce47f-1f02-463a-9612-3248ae2cd77b tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.052674 May 28 21:32:55.911595 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2852/5758] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:55 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:56.926945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=18 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:32:56.930905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bc22541b-a3b1-4c3a-b9c5-623e1e20899f tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c31820>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:56.980657 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bc22541b-a3b1-4c3a-b9c5-623e1e20899f tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.055251 May 28 21:32:56.981263 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2907/5759] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:56 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:57.993406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2e10e456-08a7-436a-ac39-eb5d78f71154 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56ba5a60>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:58.040101 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2e10e456-08a7-436a-ac39-eb5d78f71154 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.051367 May 28 21:32:58.040682 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2853/5760] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:57 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:32:59.050768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:32:59.054773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cbf90357-ed2e-4b49-8bf9-7e160cac0c45 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56cbd280>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:32:59.103179 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cbf90357-ed2e-4b49-8bf9-7e160cac0c45 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.054519 May 28 21:32:59.104413 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2908/5761] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:32:59 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:33:00.118901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:33:00.119681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:33:00.124377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0ccbf115-000c-406a-8973-51fcbef8e067 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56b4a700>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:33:00.172796 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0ccbf115-000c-406a-8973-51fcbef8e067 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.054737 May 28 21:33:00.173497 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2854/5762] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:33:00 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:33:01.191235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-800b6617-5669-4aeb-98fa-83944a89b77d tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c31c10>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:33:01.241221 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-800b6617-5669-4aeb-98fa-83944a89b77d tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.054602 May 28 21:33:01.241221 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2909/5763] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:33:01 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:33:02.255515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7994c326-41b2-4e9a-b94a-7189bcda9949 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d57180820>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:33:02.307714 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7994c326-41b2-4e9a-b94a-7189bcda9949 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.058880 May 28 21:33:02.308303 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2855/5764] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:33:02 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:33:03.321641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5582890d-45ee-42b0-80c9-9e85c5bf7169 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c10700>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:33:03.546215 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5582890d-45ee-42b0-80c9-9e85c5bf7169 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.229309 May 28 21:33:03.546794 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2910/5765] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:33:03 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:33:04.559422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2a622349-876f-4dae-afbf-404b1b1f6d73 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56b4d4c0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:33:04.678066 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2a622349-876f-4dae-afbf-404b1b1f6d73 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.123539 May 28 21:33:04.678678 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2856/5766] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:33:04 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:33:05.692035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dd88abe0-c4c4-4ec9-8a0e-d51ce51f90ea tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56c329d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:33:05.750362 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dd88abe0-c4c4-4ec9-8a0e-d51ce51f90ea tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 200 len: 346 microversion: 2.1 time: 0.063550 May 28 21:33:05.750975 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2911/5767] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:33:05 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:33:06.763586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-534b80a7-bcd6-4257-bf49-e6d6d06b29e5 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Calling method '.version_select at 0x7f4d56dafb80>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:33:06.792026 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-534b80a7-bcd6-4257-bf49-e6d6d06b29e5 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] HTTP exception thrown: Volume 719cf254-e14a-4776-876d-e0177461f78b could not be found. May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-534b80a7-bcd6-4257-bf49-e6d6d06b29e5 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Request method failure captured: May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b HTTP/1.1 May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpTvXcSHzbPXhEqT1rC0bG1I-_j4r4_BMLgMZWgdQRZu2lYYV4fkuxsxIfKXum7_jatM6YW_KCdNVGK5XYh2Mmn8cPsCWR2VpQUEBn8ttjiqRzxX3i9IYXYlOgK6OTVj6FwFreqRByFlDug4du3yXAgQGlav36H9cjPhsUhg243rYvY May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 0ce4c7a9c74d441581a634afac6b8f8d May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-VolumesGetTestJSON-675753615 May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_0ce4c7a9c74d441581a634afac6b8f8d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ce4c7a9c74d441581a634afac6b8f8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/0ce4c7a9c74d441581a634afac6b8f8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/0ce4c7a9c74d441581a634afac6b8f8d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-VolumesGetTestJSON-675753615 May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 0ce4c7a9c74d441581a634afac6b8f8d May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-VolumesGetTestJSON-675753615 May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-VolumesGetTestJSON-675753615-project May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 7882449f34df41708755bf3f902cf043 May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-VolumesGetTestJSON-675753615-project May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: method: May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: exception: Volume 719cf254-e14a-4776-876d-e0177461f78b could not be found. May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '719cf254-e14a-4776-876d-e0177461f78b'} May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 719cf254-e14a-4776-876d-e0177461f78b could not be found. (HTTP 404) (Request-ID: req-bbb1a608-f8e8-4c8c-be05-597e52fd9054) May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 28 21:33:06.794071 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi item = cinderclient( May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 719cf254-e14a-4776-876d-e0177461f78b could not be found. May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 719cf254-e14a-4776-876d-e0177461f78b could not be found. May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 719cf254-e14a-4776-876d-e0177461f78b could not be found. May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-534b80a7-bcd6-4257-bf49-e6d6d06b29e5 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] Returning 404 to user: Volume 719cf254-e14a-4776-876d-e0177461f78b could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-534b80a7-bcd6-4257-bf49-e6d6d06b29e5 tempest-VolumesGetTestJSON-675753615 tempest-VolumesGetTestJSON-675753615-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b" status: 404 len: 109 microversion: 2.1 time: 0.036827 May 28 21:33:06.798254 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2857/5768] 10.222.0.33 () {58 vars in 1244 bytes} [Sat May 28 21:33:06 2022] GET /compute/v2.1/os-volumes/719cf254-e14a-4776-876d-e0177461f78b => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:33:45.910188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3735ed6f-3881-42aa-b9e0-0171486064f2 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:33:45.910760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3735ed6f-3881-42aa-b9e0-0171486064f2 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:33:45.916865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3735ed6f-3881-42aa-b9e0-0171486064f2 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:33:45.917978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3735ed6f-3881-42aa-b9e0-0171486064f2 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:33:45.918752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3735ed6f-3881-42aa-b9e0-0171486064f2 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:33:45.919200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3735ed6f-3881-42aa-b9e0-0171486064f2 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:33:45.932341 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-3735ed6f-3881-42aa-b9e0-0171486064f2 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] HTTP exception thrown: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3735ed6f-3881-42aa-b9e0-0171486064f2 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Request method failure captured: May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f HTTP/1.1 May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpPlhU68Y7j3b7llP_SiIbEUcCX8UhcT_jXm1aREvNsb5stwi92gong_XhY_hCutfnb_a0ixsP-MzktA3LXP48mG6k5sBU1dTg_B9w-83ShPqGHFoj2WPJna2Y6YciUmAUmq8SvZIXLY3idOrn3VZ7O9BLlteEgvaHU5OTKx9a_KZtA May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e3cc8c5f2fe44b87bf5c05eadb62936c May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AttachVolumeTestJSON-1447462214 May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3cc8c5f2fe44b87bf5c05eadb62936c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AttachVolumeTestJSON-1447462214 May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e3cc8c5f2fe44b87bf5c05eadb62936c May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1447462214 May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AttachVolumeTestJSON-1447462214-project May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 93f78df0f96c47ac97a200a4442db6da May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AttachVolumeTestJSON-1447462214-project May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '6401e526-a5f4-434e-baea-2f9d952e875f'} May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:33:45.934070 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:33:45.938715 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. May 28 21:33:45.938715 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:33:45.938715 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:33:45.938715 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:33:45.938715 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:45.938715 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:33:45.938715 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:33:45.938715 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:33:45.938715 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:33:45.938715 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. May 28 21:33:45.938715 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:33:45.938715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3735ed6f-3881-42aa-b9e0-0171486064f2 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Returning 404 to user: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:33:45.938715 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3735ed6f-3881-42aa-b9e0-0171486064f2 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 404 len: 111 microversion: 2.1 time: 0.030679 May 28 21:33:45.938715 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2912/5769] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:33:45 2022] DELETE /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:33:45.948224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3ff6b15c-e65c-422b-93f7-cbc4763acfa0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:33:45.948895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3ff6b15c-e65c-422b-93f7-cbc4763acfa0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 6401e526-a5f4-434e-baea-2f9d952e875f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:33:45.955281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ff6b15c-e65c-422b-93f7-cbc4763acfa0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:33:45.955743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ff6b15c-e65c-422b-93f7-cbc4763acfa0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:33:45.956528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ff6b15c-e65c-422b-93f7-cbc4763acfa0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:33:45.956976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ff6b15c-e65c-422b-93f7-cbc4763acfa0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:33:45.971062 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-3ff6b15c-e65c-422b-93f7-cbc4763acfa0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] HTTP exception thrown: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3ff6b15c-e65c-422b-93f7-cbc4763acfa0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Request method failure captured: May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f HTTP/1.1 May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpPlhU68Y7j3b7llP_SiIbEUcCX8UhcT_jXm1aREvNsb5stwi92gong_XhY_hCutfnb_a0ixsP-MzktA3LXP48mG6k5sBU1dTg_B9w-83ShPqGHFoj2WPJna2Y6YciUmAUmq8SvZIXLY3idOrn3VZ7O9BLlteEgvaHU5OTKx9a_KZtA May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e3cc8c5f2fe44b87bf5c05eadb62936c May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AttachVolumeTestJSON-1447462214 May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3cc8c5f2fe44b87bf5c05eadb62936c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AttachVolumeTestJSON-1447462214 May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e3cc8c5f2fe44b87bf5c05eadb62936c May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1447462214 May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AttachVolumeTestJSON-1447462214-project May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 93f78df0f96c47ac97a200a4442db6da May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AttachVolumeTestJSON-1447462214-project May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '6401e526-a5f4-434e-baea-2f9d952e875f'} May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:33:45.972603 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:45.988015 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:45.988015 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:33:45.988015 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:33:45.988015 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:33:45.988015 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:33:45.988015 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. May 28 21:33:45.988015 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:45.988015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3ff6b15c-e65c-422b-93f7-cbc4763acfa0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Returning 404 to user: Instance 6401e526-a5f4-434e-baea-2f9d952e875f could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:33:45.988015 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3ff6b15c-e65c-422b-93f7-cbc4763acfa0 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f" status: 404 len: 111 microversion: 2.1 time: 0.034040 May 28 21:33:45.988015 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2858/5770] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:33:45 2022] GET /compute/v2.1/servers/6401e526-a5f4-434e-baea-2f9d952e875f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:33:54.805933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bc6775df-7c66-4865-9892-b46548fe3013 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Action: 'create', calling method: .version_select at 0x7f4d56c32940>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-128443152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZDjtX8JPjKCuiar6hAqoqkveiiZv9e0EdbJbvmj6rQzA4Utqn5SpICiKh+yACxNFVCuBgPgTUbBhzUBO142mplasoGFpaQMeTCF5JrNnv/pJ3E+Ivsffe42l+CTLz1vQ=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:33:54.821999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-bc6775df-7c66-4865-9892-b46548fe3013 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Getting quotas for project 5241f87816134389b836a8eae1d53bd3. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:33:54.830781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-bc6775df-7c66-4865-9892-b46548fe3013 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Getting quotas for user c93401a279c9403ca62627e829082968 and project 5241f87816134389b836a8eae1d53bd3. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:33:54.912980 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bc6775df-7c66-4865-9892-b46548fe3013 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.111060 May 28 21:33:54.913588 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2913/5771] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:33:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:33:55.706730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0cf6f4f8-951c-41b9-be1c-ab381e04ea9b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:33:55.707277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0cf6f4f8-951c-41b9-be1c-ab381e04ea9b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:33:55.716855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0cf6f4f8-951c-41b9-be1c-ab381e04ea9b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:33:55.716855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0cf6f4f8-951c-41b9-be1c-ab381e04ea9b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:33:55.716855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0cf6f4f8-951c-41b9-be1c-ab381e04ea9b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:33:55.716855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0cf6f4f8-951c-41b9-be1c-ab381e04ea9b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:33:55.730051 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-0cf6f4f8-951c-41b9-be1c-ab381e04ea9b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] HTTP exception thrown: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0cf6f4f8-951c-41b9-be1c-ab381e04ea9b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Request method failure captured: May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 HTTP/1.1 May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpPlhU68Y7j3b7llP_SiIbEUcCX8UhcT_jXm1aREvNsb5stwi92gong_XhY_hCutfnb_a0ixsP-MzktA3LXP48mG6k5sBU1dTg_B9w-83ShPqGHFoj2WPJna2Y6YciUmAUmq8SvZIXLY3idOrn3VZ7O9BLlteEgvaHU5OTKx9a_KZtA May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: e3cc8c5f2fe44b87bf5c05eadb62936c May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AttachVolumeTestJSON-1447462214 May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3cc8c5f2fe44b87bf5c05eadb62936c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AttachVolumeTestJSON-1447462214 May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: e3cc8c5f2fe44b87bf5c05eadb62936c May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1447462214 May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AttachVolumeTestJSON-1447462214-project May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 93f78df0f96c47ac97a200a4442db6da May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AttachVolumeTestJSON-1447462214-project May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '3733dc91-2f81-4efc-a391-73a96ee6ee44'} May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:33:55.732173 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:33:55.737176 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. May 28 21:33:55.737176 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:55.737176 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:33:55.737176 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:55.737176 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:55.737176 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:33:55.737176 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:33:55.737176 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:33:55.737176 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:33:55.737176 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. May 28 21:33:55.737176 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:33:55.737176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0cf6f4f8-951c-41b9-be1c-ab381e04ea9b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Returning 404 to user: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:33:55.737176 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0cf6f4f8-951c-41b9-be1c-ab381e04ea9b tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "DELETE /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 404 len: 111 microversion: 2.1 time: 0.031872 May 28 21:33:55.737176 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2859/5772] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:33:55 2022] DELETE /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:33:55.743300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-978de007-b2bc-4a1f-a54a-dd90343228b1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:33:55.744138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-978de007-b2bc-4a1f-a54a-dd90343228b1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] [instance: 3733dc91-2f81-4efc-a391-73a96ee6ee44] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:33:55.751519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-978de007-b2bc-4a1f-a54a-dd90343228b1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:33:55.752574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-978de007-b2bc-4a1f-a54a-dd90343228b1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:33:55.753386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-978de007-b2bc-4a1f-a54a-dd90343228b1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:33:55.753864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-978de007-b2bc-4a1f-a54a-dd90343228b1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:33:55.770905 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-978de007-b2bc-4a1f-a54a-dd90343228b1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] HTTP exception thrown: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-978de007-b2bc-4a1f-a54a-dd90343228b1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Request method failure captured: May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 HTTP/1.1 May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpPlhU68Y7j3b7llP_SiIbEUcCX8UhcT_jXm1aREvNsb5stwi92gong_XhY_hCutfnb_a0ixsP-MzktA3LXP48mG6k5sBU1dTg_B9w-83ShPqGHFoj2WPJna2Y6YciUmAUmq8SvZIXLY3idOrn3VZ7O9BLlteEgvaHU5OTKx9a_KZtA May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: e3cc8c5f2fe44b87bf5c05eadb62936c May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AttachVolumeTestJSON-1447462214 May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_e3cc8c5f2fe44b87bf5c05eadb62936c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/e3cc8c5f2fe44b87bf5c05eadb62936c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AttachVolumeTestJSON-1447462214 May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: e3cc8c5f2fe44b87bf5c05eadb62936c May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1447462214 May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AttachVolumeTestJSON-1447462214-project May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 93f78df0f96c47ac97a200a4442db6da May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AttachVolumeTestJSON-1447462214-project May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '3733dc91-2f81-4efc-a391-73a96ee6ee44'} May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:33:55.772498 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:33:55.783192 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:33:55.783192 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:33:55.783192 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:33:55.783192 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:33:55.783192 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:33:55.783192 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. May 28 21:33:55.783192 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:33:55.783192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-978de007-b2bc-4a1f-a54a-dd90343228b1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] Returning 404 to user: Instance 3733dc91-2f81-4efc-a391-73a96ee6ee44 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:33:55.783192 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-978de007-b2bc-4a1f-a54a-dd90343228b1 tempest-AttachVolumeTestJSON-1447462214 tempest-AttachVolumeTestJSON-1447462214-project] 10.222.0.33 "GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44" status: 404 len: 111 microversion: 2.1 time: 0.034735 May 28 21:33:55.783192 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2914/5773] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:33:55 2022] GET /compute/v2.1/servers/3733dc91-2f81-4efc-a391-73a96ee6ee44 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:33:58.293620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-696499087", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "66ff15ab-0cf7-464f-a399-0ea2ae0a2aa0", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-128443152", "security_groups": [{"name": "tempest-secgroup-smoke-1209600346"}], "networks": [{"uuid": "09045f64-b1c6-4a33-b482-1bc94dd960f1"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:33:58.410971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] validate_networks() for [('09045f64-b1c6-4a33-b482-1bc94dd960f1', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:33:59.595265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:33:59.595870 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:33:59.596917 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:33:59.597400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:33:59.597866 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:33:59.608371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:33:59.608963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:33:59.609867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:33:59.610602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:33:59.628748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Getting quotas for project 5241f87816134389b836a8eae1d53bd3. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:33:59.634560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Getting quotas for user c93401a279c9403ca62627e829082968 and project 5241f87816134389b836a8eae1d53bd3. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:33:59.698292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:33:59.700404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66ff15ab-0cf7-464f-a399-0ea2ae0a2aa0',volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:34:00.681204 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b2d650b5-8c84-4abe-9a17-b3d4a071b0d0 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.392589 May 28 21:34:00.686957 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2860/5774] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:33:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 2394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:34:00.693889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89e00b11-c52c-4d37-9ed7-d21c6fb7d773 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:00.694520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-89e00b11-c52c-4d37-9ed7-d21c6fb7d773 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:00.756436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-89e00b11-c52c-4d37-9ed7-d21c6fb7d773 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:00.763456 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-89e00b11-c52c-4d37-9ed7-d21c6fb7d773 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1097 microversion: 2.1 time: 0.074422 May 28 21:34:00.764283 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2915/5775] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:00 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1097 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:01.781309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f9e25cc7-5b84-47a3-9b81-fd37acc2c788 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:01.781967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f9e25cc7-5b84-47a3-9b81-fd37acc2c788 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:01.841494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f9e25cc7-5b84-47a3-9b81-fd37acc2c788 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:01.849267 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f9e25cc7-5b84-47a3-9b81-fd37acc2c788 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1097 microversion: 2.1 time: 0.072688 May 28 21:34:01.849855 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2861/5776] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:01 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1097 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:02.873783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4edcdfa2-e82a-46fb-b565-8378f680f650 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:02.875212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4edcdfa2-e82a-46fb-b565-8378f680f650 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:02.886364 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4edcdfa2-e82a-46fb-b565-8378f680f650 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:02.887012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4edcdfa2-e82a-46fb-b565-8378f680f650 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:02.888009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4edcdfa2-e82a-46fb-b565-8378f680f650 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:02.888792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4edcdfa2-e82a-46fb-b565-8378f680f650 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:02.954598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4edcdfa2-e82a-46fb-b565-8378f680f650 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:02.962242 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4edcdfa2-e82a-46fb-b565-8378f680f650 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1139 microversion: 2.1 time: 0.098617 May 28 21:34:02.962807 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2916/5777] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:02 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1139 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:03.985215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-acda7eea-b644-46b3-bc48-0de0b8a1b481 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:03.988712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-acda7eea-b644-46b3-bc48-0de0b8a1b481 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:03.997149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-acda7eea-b644-46b3-bc48-0de0b8a1b481 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:03.998612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-acda7eea-b644-46b3-bc48-0de0b8a1b481 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:03.999637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-acda7eea-b644-46b3-bc48-0de0b8a1b481 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:04.000580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-acda7eea-b644-46b3-bc48-0de0b8a1b481 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:04.070658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-acda7eea-b644-46b3-bc48-0de0b8a1b481 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:04.079537 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-acda7eea-b644-46b3-bc48-0de0b8a1b481 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1203 microversion: 2.1 time: 0.102668 May 28 21:34:04.080038 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2862/5778] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:03 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1203 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:05.099242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4d42346c-58d5-4236-a017-103430b44f7b tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:05.103389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4d42346c-58d5-4236-a017-103430b44f7b tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:05.110753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d42346c-58d5-4236-a017-103430b44f7b tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:05.114474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d42346c-58d5-4236-a017-103430b44f7b tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:05.116197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d42346c-58d5-4236-a017-103430b44f7b tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:05.118984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d42346c-58d5-4236-a017-103430b44f7b tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:05.407750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4d42346c-58d5-4236-a017-103430b44f7b tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:05.419972 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4d42346c-58d5-4236-a017-103430b44f7b tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1281 microversion: 2.1 time: 0.326576 May 28 21:34:05.422432 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2917/5779] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:05 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1281 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:06.439024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7f12febb-961c-4189-9faf-2764ad79a691 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:06.440176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7f12febb-961c-4189-9faf-2764ad79a691 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:06.455494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f12febb-961c-4189-9faf-2764ad79a691 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:06.456848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f12febb-961c-4189-9faf-2764ad79a691 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:06.460008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f12febb-961c-4189-9faf-2764ad79a691 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:06.463141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7f12febb-961c-4189-9faf-2764ad79a691 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:06.681177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-0a802338-5efc-4635-bbb4-ba3ba05a5c34 req-d0bd7b98-9a1e-47ee-ba54-1498df91342e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d962501-978a-43fc-bc68-2bf2ac890247", "tag": "73a64a63-4871-4fa5-8209-ef8eae8d5d74"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:34:06.693183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0a802338-5efc-4635-bbb4-ba3ba05a5c34 req-d0bd7b98-9a1e-47ee-ba54-1498df91342e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:06.694018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0a802338-5efc-4635-bbb4-ba3ba05a5c34 req-d0bd7b98-9a1e-47ee-ba54-1498df91342e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:06.733202 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-0a802338-5efc-4635-bbb4-ba3ba05a5c34 req-d0bd7b98-9a1e-47ee-ba54-1498df91342e service nova] Creating event network-changed:73a64a63-4871-4fa5-8209-ef8eae8d5d74 for instance 0d962501-978a-43fc-bc68-2bf2ac890247 on nch1-master-1 May 28 21:34:06.749636 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-0a802338-5efc-4635-bbb4-ba3ba05a5c34 req-d0bd7b98-9a1e-47ee-ba54-1498df91342e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069464 May 28 21:34:06.750661 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2918/5780] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:34:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:34:06.781868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7f12febb-961c-4189-9faf-2764ad79a691 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:06.792392 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7f12febb-961c-4189-9faf-2764ad79a691 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1281 microversion: 2.1 time: 0.358346 May 28 21:34:06.793926 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2863/5781] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:06 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1281 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:07.810686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-faabab0a-b3e4-4bcb-850f-b20675ddc339 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:07.811621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-faabab0a-b3e4-4bcb-850f-b20675ddc339 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:07.820227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-faabab0a-b3e4-4bcb-850f-b20675ddc339 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:07.825108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-faabab0a-b3e4-4bcb-850f-b20675ddc339 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:07.825108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-faabab0a-b3e4-4bcb-850f-b20675ddc339 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:07.825108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-faabab0a-b3e4-4bcb-850f-b20675ddc339 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:07.977509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-faabab0a-b3e4-4bcb-850f-b20675ddc339 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:07.995633 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-faabab0a-b3e4-4bcb-850f-b20675ddc339 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1269 microversion: 2.1 time: 0.182397 May 28 21:34:07.995633 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2919/5782] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:07 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1269 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:09.011314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f1b4c293-8faf-491e-a289-d5d49bf6af61 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:09.013156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f1b4c293-8faf-491e-a289-d5d49bf6af61 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:09.021056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1b4c293-8faf-491e-a289-d5d49bf6af61 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:09.021420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1b4c293-8faf-491e-a289-d5d49bf6af61 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:09.022492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1642199414", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "265ad580-d40e-4f6f-b270-22c5a86698fc"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:34:09.022979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1b4c293-8faf-491e-a289-d5d49bf6af61 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:09.023167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1b4c293-8faf-491e-a289-d5d49bf6af61 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:09.110773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] validate_networks() for [('265ad580-d40e-4f6f-b270-22c5a86698fc', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:34:09.382672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f1b4c293-8faf-491e-a289-d5d49bf6af61 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:09.392658 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f1b4c293-8faf-491e-a289-d5d49bf6af61 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1269 microversion: 2.1 time: 0.389851 May 28 21:34:09.393950 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2864/5783] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:09 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1269 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:09.618516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:34:09.646228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2476c8e1-ec0e-4d2c-bcc5-51c185122d01 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Action: 'create', calling method: .version_select at 0x7f4d56b88790>, body: {"keypair": {"name": "tempest-keypair-316541066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcSaX1xdcBv/olnVQAm6FoRK2nmWeFJGlThjJejNyNBqSkJcnZZCEnspWa9pDnPEhBI5Fu/g5PSCqmNeSJmkbKRKYVTo2bZsesAp8MXdJBqLIFNAB8RfjTjU5hWNkeyiQ=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:34:09.663340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-2476c8e1-ec0e-4d2c-bcc5-51c185122d01 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for project f9c9caba58394e1480acb632405111c5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:34:09.668989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-2476c8e1-ec0e-4d2c-bcc5-51c185122d01 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for user b16d0e791edd4f119e646e7ced74bf74 and project f9c9caba58394e1480acb632405111c5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:34:09.704216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:34:09.705072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:34:09.705245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:34:09.705873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:34:09.706296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:34:09.716948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:09.717418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:09.718432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:09.718867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:09.737702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Getting quotas for project 6ed82f578e214948a9311cbdbb55a027. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:34:09.743441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Getting quotas for user 8d033e99f9294e348b01c59a970931d5 and project 6ed82f578e214948a9311cbdbb55a027. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:34:09.771741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:34:09.774177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:34:09.841603 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2476c8e1-ec0e-4d2c-bcc5-51c185122d01 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.327532 May 28 21:34:09.842239 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2865/5784] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:34:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:34:09.896486 ncdv-master-1 devstack@n-api.service[143129]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [1fdd8e4e-3f9f-4e68-8d64-0a7335600a5c] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 21:34:10.411259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0d3be638-71e7-4bf4-92d6-0eb650b1995f tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:10.411800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0d3be638-71e7-4bf4-92d6-0eb650b1995f tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:10.419977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d3be638-71e7-4bf4-92d6-0eb650b1995f tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:10.420441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d3be638-71e7-4bf4-92d6-0eb650b1995f tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:10.421244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d3be638-71e7-4bf4-92d6-0eb650b1995f tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:10.421687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d3be638-71e7-4bf4-92d6-0eb650b1995f tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:10.579051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0d3be638-71e7-4bf4-92d6-0eb650b1995f tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:10.597177 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0d3be638-71e7-4bf4-92d6-0eb650b1995f tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1269 microversion: 2.1 time: 0.190638 May 28 21:34:10.598237 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2866/5785] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:10 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1269 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:34:10.904070 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [1fdd8e4e-3f9f-4e68-8d64-0a7335600a5c] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 40038. May 28 21:34:10.908210 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7139eaaf-7570-4d6d-b113-d312e5824442 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.890360 May 28 21:34:10.910039 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2920/5786] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:34:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 28 21:34:10.920136 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-77871fba-3df0-4213-a4ba-b646350ce89e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:10.920812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-77871fba-3df0-4213-a4ba-b646350ce89e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:10.997454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-77871fba-3df0-4213-a4ba-b646350ce89e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:11.004436 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-77871fba-3df0-4213-a4ba-b646350ce89e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 200 len: 1219 microversion: 2.1 time: 0.088726 May 28 21:34:11.005030 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2867/5787] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:10 2022] GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:11.616445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ac99e84b-80f2-4a6d-8712-9d86d1f7606c tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:11.617151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ac99e84b-80f2-4a6d-8712-9d86d1f7606c tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:11.624493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac99e84b-80f2-4a6d-8712-9d86d1f7606c tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:11.624968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac99e84b-80f2-4a6d-8712-9d86d1f7606c tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:11.625825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac99e84b-80f2-4a6d-8712-9d86d1f7606c tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:11.626386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac99e84b-80f2-4a6d-8712-9d86d1f7606c tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:11.863244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ac99e84b-80f2-4a6d-8712-9d86d1f7606c tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:11.873762 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ac99e84b-80f2-4a6d-8712-9d86d1f7606c tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1269 microversion: 2.1 time: 0.262136 May 28 21:34:11.877265 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2921/5788] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:11 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1269 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:12.022558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a2f3e3dc-a0ff-4295-ae14-2276603d8cee tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:12.023806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a2f3e3dc-a0ff-4295-ae14-2276603d8cee tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:12.108782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a2f3e3dc-a0ff-4295-ae14-2276603d8cee tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:12.118575 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a2f3e3dc-a0ff-4295-ae14-2276603d8cee tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 200 len: 1219 microversion: 2.1 time: 0.099933 May 28 21:34:12.119178 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2868/5789] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:12 2022] GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:12.625253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-730561254", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31de5272-0585-4c63-8300-cd5a798dd14e"}], "security_groups": [{"name": "tempest-securitygroup--1980456944"}], "key_name": "tempest-keypair-316541066", "user_data": "}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:34:12.783652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] validate_networks() for [('31de5272-0585-4c63-8300-cd5a798dd14e', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:34:12.891056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6b4a5339-e1bd-4962-820e-64ffb22dffa1 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:12.891690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6b4a5339-e1bd-4962-820e-64ffb22dffa1 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:12.905113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b4a5339-e1bd-4962-820e-64ffb22dffa1 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:12.905577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b4a5339-e1bd-4962-820e-64ffb22dffa1 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:12.907454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b4a5339-e1bd-4962-820e-64ffb22dffa1 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:12.907911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b4a5339-e1bd-4962-820e-64ffb22dffa1 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:13.142294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6b4a5339-e1bd-4962-820e-64ffb22dffa1 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:13.151947 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6b4a5339-e1bd-4962-820e-64ffb22dffa1 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1269 microversion: 2.1 time: 0.263840 May 28 21:34:13.153118 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2869/5790] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:12 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1269 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:13.162968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-95b5c365-8b0f-404f-9111-844b8b83f868 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:13.163893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-95b5c365-8b0f-404f-9111-844b8b83f868 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:13.173064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95b5c365-8b0f-404f-9111-844b8b83f868 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:13.173692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95b5c365-8b0f-404f-9111-844b8b83f868 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:13.174925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95b5c365-8b0f-404f-9111-844b8b83f868 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:13.175743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95b5c365-8b0f-404f-9111-844b8b83f868 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:13.295119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-95b5c365-8b0f-404f-9111-844b8b83f868 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:13.320337 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-95b5c365-8b0f-404f-9111-844b8b83f868 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 200 len: 1271 microversion: 2.1 time: 0.165725 May 28 21:34:13.327553 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2870/5791] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:13 2022] GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:13.350942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:34:13.351578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:34:13.352059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:34:13.352480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:34:13.352916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:34:13.363877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:13.363877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:13.364507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:13.364952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:13.383669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for project f9c9caba58394e1480acb632405111c5. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:34:13.389114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for user b16d0e791edd4f119e646e7ced74bf74 and project f9c9caba58394e1480acb632405111c5. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:34:13.403176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:34:13.405764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:34:13.520819 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-78c01004-56e7-46fd-94cb-f61a3c64ce31 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.899109 May 28 21:34:13.521988 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2922/5792] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:34:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:34:13.537973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4a2b127a-7b04-4b26-bb8e-1760fddad8e6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:13.539293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4a2b127a-7b04-4b26-bb8e-1760fddad8e6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:13.608311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-9e5723cc-218c-4611-a141-ea1b969b3ca6 req-b765a7d0-240d-456a-bf54-93c28b2063e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d962501-978a-43fc-bc68-2bf2ac890247", "name": "network-vif-plugged", "status": "completed", "tag": "73a64a63-4871-4fa5-8209-ef8eae8d5d74"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:34:13.617325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9e5723cc-218c-4611-a141-ea1b969b3ca6 req-b765a7d0-240d-456a-bf54-93c28b2063e3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:13.618132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9e5723cc-218c-4611-a141-ea1b969b3ca6 req-b765a7d0-240d-456a-bf54-93c28b2063e3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:13.632927 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-9e5723cc-218c-4611-a141-ea1b969b3ca6 req-b765a7d0-240d-456a-bf54-93c28b2063e3 service nova] Creating event network-vif-plugged:73a64a63-4871-4fa5-8209-ef8eae8d5d74 for instance 0d962501-978a-43fc-bc68-2bf2ac890247 on nch1-master-1 May 28 21:34:13.639352 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-9e5723cc-218c-4611-a141-ea1b969b3ca6 req-b765a7d0-240d-456a-bf54-93c28b2063e3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157495 May 28 21:34:13.639966 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2871/5793] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:34:13.650247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4a2b127a-7b04-4b26-bb8e-1760fddad8e6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:13.659009 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4a2b127a-7b04-4b26-bb8e-1760fddad8e6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1240 microversion: 2.1 time: 0.125796 May 28 21:34:13.659604 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2923/5794] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:13 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1240 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:34:14.169617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a13d98ae-70ea-4985-816c-7012bec4c6b9 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:14.170906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a13d98ae-70ea-4985-816c-7012bec4c6b9 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:14.183242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a13d98ae-70ea-4985-816c-7012bec4c6b9 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:14.188949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a13d98ae-70ea-4985-816c-7012bec4c6b9 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:14.192505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a13d98ae-70ea-4985-816c-7012bec4c6b9 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:14.193058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a13d98ae-70ea-4985-816c-7012bec4c6b9 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:14.338285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-01235fac-2a3c-4c93-8725-82db080da865 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:14.339819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-01235fac-2a3c-4c93-8725-82db080da865 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:14.349038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01235fac-2a3c-4c93-8725-82db080da865 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:14.352726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a13d98ae-70ea-4985-816c-7012bec4c6b9 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:14.354602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01235fac-2a3c-4c93-8725-82db080da865 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:14.355607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01235fac-2a3c-4c93-8725-82db080da865 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:14.356261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01235fac-2a3c-4c93-8725-82db080da865 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:14.362687 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a13d98ae-70ea-4985-816c-7012bec4c6b9 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1269 microversion: 2.1 time: 0.197082 May 28 21:34:14.363625 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2872/5795] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:14 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1269 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:14.426792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-01235fac-2a3c-4c93-8725-82db080da865 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:14.436159 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-01235fac-2a3c-4c93-8725-82db080da865 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 200 len: 1277 microversion: 2.1 time: 0.101692 May 28 21:34:14.445940 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2924/5796] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:14 2022] GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:34:14.675483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-66ba8d3d-acd4-4ef3-9121-d55d93fa231f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:14.676109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-66ba8d3d-acd4-4ef3-9121-d55d93fa231f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:14.733350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-66ba8d3d-acd4-4ef3-9121-d55d93fa231f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:14.740395 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-66ba8d3d-acd4-4ef3-9121-d55d93fa231f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1240 microversion: 2.1 time: 0.068795 May 28 21:34:14.740974 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2873/5797] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:14 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:15.381139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6cdd0e8c-13f2-4dd2-91cb-d391d5d50c87 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:15.381822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6cdd0e8c-13f2-4dd2-91cb-d391d5d50c87 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:15.389404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cdd0e8c-13f2-4dd2-91cb-d391d5d50c87 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:15.389880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cdd0e8c-13f2-4dd2-91cb-d391d5d50c87 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:15.390880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cdd0e8c-13f2-4dd2-91cb-d391d5d50c87 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:15.391348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cdd0e8c-13f2-4dd2-91cb-d391d5d50c87 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:15.453712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f9b2e89d-c615-43e2-9b45-3a7e32570220 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:15.454370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f9b2e89d-c615-43e2-9b45-3a7e32570220 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:15.462388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9b2e89d-c615-43e2-9b45-3a7e32570220 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:15.462868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9b2e89d-c615-43e2-9b45-3a7e32570220 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:15.463672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9b2e89d-c615-43e2-9b45-3a7e32570220 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:15.464122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f9b2e89d-c615-43e2-9b45-3a7e32570220 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:15.935348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6cdd0e8c-13f2-4dd2-91cb-d391d5d50c87 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:15.937802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=45 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:34:15.945455 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6cdd0e8c-13f2-4dd2-91cb-d391d5d50c87 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1269 microversion: 2.1 time: 0.568383 May 28 21:34:15.949200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f9b2e89d-c615-43e2-9b45-3a7e32570220 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:15.951708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=55 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:34:15.953724 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2925/5798] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:15 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1269 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:15.967417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-504fe067-5865-4cbe-88af-5f8130d8669c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:15.970275 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f9b2e89d-c615-43e2-9b45-3a7e32570220 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 200 len: 1319 microversion: 2.1 time: 0.518240 May 28 21:34:15.970393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-504fe067-5865-4cbe-88af-5f8130d8669c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:15.970492 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2874/5799] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:15 2022] GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 1319 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:34:15.970584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=7 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:34:15.975054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-504fe067-5865-4cbe-88af-5f8130d8669c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:15.975516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-504fe067-5865-4cbe-88af-5f8130d8669c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:15.976283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-504fe067-5865-4cbe-88af-5f8130d8669c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:15.976739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-504fe067-5865-4cbe-88af-5f8130d8669c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:16.039471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-504fe067-5865-4cbe-88af-5f8130d8669c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:16.050465 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-504fe067-5865-4cbe-88af-5f8130d8669c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1292 microversion: 2.1 time: 0.087650 May 28 21:34:16.054033 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2926/5800] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:15 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:16.153545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-3c46c319-1a69-44be-a3fa-de953f85bff4 req-1f2201c6-6f10-4530-9f3e-376f2e6b601a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fd905ae-de46-41cb-8d04-722111b5ddf3", "tag": "71837f42-77ea-4049-8317-cdf49187be43"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:34:16.167359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:34:16.170276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3c46c319-1a69-44be-a3fa-de953f85bff4 req-1f2201c6-6f10-4530-9f3e-376f2e6b601a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:16.170927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3c46c319-1a69-44be-a3fa-de953f85bff4 req-1f2201c6-6f10-4530-9f3e-376f2e6b601a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:16.182544 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-3c46c319-1a69-44be-a3fa-de953f85bff4 req-1f2201c6-6f10-4530-9f3e-376f2e6b601a service nova] Creating event network-changed:71837f42-77ea-4049-8317-cdf49187be43 for instance 5fd905ae-de46-41cb-8d04-722111b5ddf3 on nch2-master-1 May 28 21:34:16.187378 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-3c46c319-1a69-44be-a3fa-de953f85bff4 req-1f2201c6-6f10-4530-9f3e-376f2e6b601a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124264 May 28 21:34:16.187982 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2875/5801] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:34:16.972358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f467378b-e149-4430-9731-e76ac307f346 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:16.972980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f467378b-e149-4430-9731-e76ac307f346 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:16.981744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f467378b-e149-4430-9731-e76ac307f346 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:16.982238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f467378b-e149-4430-9731-e76ac307f346 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:16.983018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f467378b-e149-4430-9731-e76ac307f346 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:16.983454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f467378b-e149-4430-9731-e76ac307f346 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:16.986654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-34308c6e-3d33-4aa2-a459-44e2dd505a8a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:16.987364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-34308c6e-3d33-4aa2-a459-44e2dd505a8a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:16.997799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-34308c6e-3d33-4aa2-a459-44e2dd505a8a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:17.000230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-34308c6e-3d33-4aa2-a459-44e2dd505a8a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:17.000230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-34308c6e-3d33-4aa2-a459-44e2dd505a8a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:17.000230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-34308c6e-3d33-4aa2-a459-44e2dd505a8a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:17.269718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f467378b-e149-4430-9731-e76ac307f346 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:17.288477 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f467378b-e149-4430-9731-e76ac307f346 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1458 microversion: 2.1 time: 0.321932 May 28 21:34:17.289754 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2927/5802] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:16 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1458 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:17.296771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-34308c6e-3d33-4aa2-a459-44e2dd505a8a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:17.307615 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-34308c6e-3d33-4aa2-a459-44e2dd505a8a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 200 len: 1319 microversion: 2.1 time: 0.326071 May 28 21:34:17.308218 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2876/5803] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:16 2022] GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:34:17.312456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ec3d944a-9b05-497f-bb4d-1a083484d769 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:17.321802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ec3d944a-9b05-497f-bb4d-1a083484d769 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:17.322017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7e69b73d-ea72-4463-9706-13f56098565e tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:17.322017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7e69b73d-ea72-4463-9706-13f56098565e tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:17.325222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec3d944a-9b05-497f-bb4d-1a083484d769 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:17.325563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec3d944a-9b05-497f-bb4d-1a083484d769 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:17.326395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec3d944a-9b05-497f-bb4d-1a083484d769 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:17.326844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec3d944a-9b05-497f-bb4d-1a083484d769 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:17.326981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e69b73d-ea72-4463-9706-13f56098565e tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:17.327849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e69b73d-ea72-4463-9706-13f56098565e tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:17.328642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e69b73d-ea72-4463-9706-13f56098565e tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:17.329242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e69b73d-ea72-4463-9706-13f56098565e tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:17.617815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7e69b73d-ea72-4463-9706-13f56098565e tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:17.625615 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7e69b73d-ea72-4463-9706-13f56098565e tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1458 microversion: 2.1 time: 0.314251 May 28 21:34:17.626128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ec3d944a-9b05-497f-bb4d-1a083484d769 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:17.626297 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2877/5804] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:17 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1458 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:17.635290 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ec3d944a-9b05-497f-bb4d-1a083484d769 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1366 microversion: 2.1 time: 0.344270 May 28 21:34:17.636349 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2928/5805] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:17 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:18.325817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b51a7107-e7c8-49c8-9267-002c5f069565 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:18.326637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b51a7107-e7c8-49c8-9267-002c5f069565 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:18.334092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b51a7107-e7c8-49c8-9267-002c5f069565 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:18.335444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b51a7107-e7c8-49c8-9267-002c5f069565 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:18.336586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b51a7107-e7c8-49c8-9267-002c5f069565 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:18.337126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b51a7107-e7c8-49c8-9267-002c5f069565 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:18.534553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b51a7107-e7c8-49c8-9267-002c5f069565 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:18.543274 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b51a7107-e7c8-49c8-9267-002c5f069565 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 200 len: 1319 microversion: 2.1 time: 0.221956 May 28 21:34:18.548318 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2878/5806] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:18 2022] GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:18.657636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7e248686-2513-4927-bbc2-c3de088fb000 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:18.659090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7e248686-2513-4927-bbc2-c3de088fb000 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:18.668823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e248686-2513-4927-bbc2-c3de088fb000 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:18.669491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e248686-2513-4927-bbc2-c3de088fb000 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:18.670559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e248686-2513-4927-bbc2-c3de088fb000 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:18.672463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e248686-2513-4927-bbc2-c3de088fb000 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:18.722556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-b79fbd19-bd9d-4337-8658-d2eb712b3642 req-6bc5ae3d-b3be-466c-a949-5b8972d901b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "496c4c91-33f1-4301-ba55-0e99f84223da", "tag": "d9d0f754-692c-4fa8-809f-632b9373cf5c"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:34:18.743352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b79fbd19-bd9d-4337-8658-d2eb712b3642 req-6bc5ae3d-b3be-466c-a949-5b8972d901b3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:18.744085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b79fbd19-bd9d-4337-8658-d2eb712b3642 req-6bc5ae3d-b3be-466c-a949-5b8972d901b3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:18.773564 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b79fbd19-bd9d-4337-8658-d2eb712b3642 req-6bc5ae3d-b3be-466c-a949-5b8972d901b3 service nova] Creating event network-changed:d9d0f754-692c-4fa8-809f-632b9373cf5c for instance 496c4c91-33f1-4301-ba55-0e99f84223da on nch1-master-1 May 28 21:34:18.781188 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-b79fbd19-bd9d-4337-8658-d2eb712b3642 req-6bc5ae3d-b3be-466c-a949-5b8972d901b3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168971 May 28 21:34:18.782141 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2929/5807] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:34:18.924763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7e248686-2513-4927-bbc2-c3de088fb000 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:18.933060 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7e248686-2513-4927-bbc2-c3de088fb000 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1366 microversion: 2.1 time: 0.283485 May 28 21:34:18.934072 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2879/5808] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:18 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:34:19.562009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-222035bf-45e0-43f6-b2f8-7ccadc875ad0 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:19.563046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-222035bf-45e0-43f6-b2f8-7ccadc875ad0 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:19.569603 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-222035bf-45e0-43f6-b2f8-7ccadc875ad0 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:19.570107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-222035bf-45e0-43f6-b2f8-7ccadc875ad0 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:19.570883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-222035bf-45e0-43f6-b2f8-7ccadc875ad0 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:19.571326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-222035bf-45e0-43f6-b2f8-7ccadc875ad0 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:19.710823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-222035bf-45e0-43f6-b2f8-7ccadc875ad0 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:19.718952 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-222035bf-45e0-43f6-b2f8-7ccadc875ad0 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 200 len: 1319 microversion: 2.1 time: 0.162106 May 28 21:34:19.719532 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2930/5809] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:19 2022] GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:19.861088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-998de077-3f32-4d42-8ef1-63e493dc3285 req-84209b21-abe1-4a72-b8b4-1e93589cc626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d962501-978a-43fc-bc68-2bf2ac890247", "tag": "73a64a63-4871-4fa5-8209-ef8eae8d5d74"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:34:19.873019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-998de077-3f32-4d42-8ef1-63e493dc3285 req-84209b21-abe1-4a72-b8b4-1e93589cc626 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:19.873473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-998de077-3f32-4d42-8ef1-63e493dc3285 req-84209b21-abe1-4a72-b8b4-1e93589cc626 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:19.885339 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-998de077-3f32-4d42-8ef1-63e493dc3285 req-84209b21-abe1-4a72-b8b4-1e93589cc626 service nova] Creating event network-changed:73a64a63-4871-4fa5-8209-ef8eae8d5d74 for instance 0d962501-978a-43fc-bc68-2bf2ac890247 on nch1-master-1 May 28 21:34:19.890860 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-998de077-3f32-4d42-8ef1-63e493dc3285 req-84209b21-abe1-4a72-b8b4-1e93589cc626 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034907 May 28 21:34:19.891471 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2880/5810] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:34:19.950242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-11ffc425-a168-41a6-9f0f-c5503c952fe4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:19.951559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-11ffc425-a168-41a6-9f0f-c5503c952fe4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:19.958654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11ffc425-a168-41a6-9f0f-c5503c952fe4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:19.959256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11ffc425-a168-41a6-9f0f-c5503c952fe4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:19.960184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11ffc425-a168-41a6-9f0f-c5503c952fe4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:19.960735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11ffc425-a168-41a6-9f0f-c5503c952fe4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:20.335092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-11ffc425-a168-41a6-9f0f-c5503c952fe4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:20.350248 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-11ffc425-a168-41a6-9f0f-c5503c952fe4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1366 microversion: 2.1 time: 0.404067 May 28 21:34:20.351521 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2931/5811] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:19 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:20.736529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-87578141-6872-4c92-b4a7-50f197cfa985 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:20.737271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-87578141-6872-4c92-b4a7-50f197cfa985 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:20.744112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87578141-6872-4c92-b4a7-50f197cfa985 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:20.744921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87578141-6872-4c92-b4a7-50f197cfa985 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:20.745417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87578141-6872-4c92-b4a7-50f197cfa985 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:20.745745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87578141-6872-4c92-b4a7-50f197cfa985 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:21.047237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-87578141-6872-4c92-b4a7-50f197cfa985 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:21.054932 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-87578141-6872-4c92-b4a7-50f197cfa985 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 200 len: 1319 microversion: 2.1 time: 0.322800 May 28 21:34:21.055745 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2881/5812] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:20 2022] GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:21.206531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-5ff3d762-1b32-425d-a2e4-dec19a3dbbaa req-631af897-4079-4ab1-aa94-e6cc30508943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd905ae-de46-41cb-8d04-722111b5ddf3", "name": "network-vif-plugged", "status": "completed", "tag": "71837f42-77ea-4049-8317-cdf49187be43"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:34:21.217562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5ff3d762-1b32-425d-a2e4-dec19a3dbbaa req-631af897-4079-4ab1-aa94-e6cc30508943 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:21.218123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5ff3d762-1b32-425d-a2e4-dec19a3dbbaa req-631af897-4079-4ab1-aa94-e6cc30508943 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:21.230909 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-5ff3d762-1b32-425d-a2e4-dec19a3dbbaa req-631af897-4079-4ab1-aa94-e6cc30508943 service nova] Creating event network-vif-plugged:71837f42-77ea-4049-8317-cdf49187be43 for instance 5fd905ae-de46-41cb-8d04-722111b5ddf3 on nch2-master-1 May 28 21:34:21.235902 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-5ff3d762-1b32-425d-a2e4-dec19a3dbbaa req-631af897-4079-4ab1-aa94-e6cc30508943 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033216 May 28 21:34:21.236613 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2932/5813] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:34:21.367941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c56c546e-d5e5-4b33-b24d-0afe7eba836a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:21.374009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c56c546e-d5e5-4b33-b24d-0afe7eba836a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:21.376867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c56c546e-d5e5-4b33-b24d-0afe7eba836a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:21.377327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c56c546e-d5e5-4b33-b24d-0afe7eba836a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:21.378140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c56c546e-d5e5-4b33-b24d-0afe7eba836a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:21.378773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c56c546e-d5e5-4b33-b24d-0afe7eba836a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:21.694411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c56c546e-d5e5-4b33-b24d-0afe7eba836a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:21.702529 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c56c546e-d5e5-4b33-b24d-0afe7eba836a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1366 microversion: 2.1 time: 0.339108 May 28 21:34:21.703121 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2882/5814] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:21 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:21.850300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-862d839a-01ea-4a0b-8412-f7a5859d176d req-3c283c9f-9def-4db5-94cc-cc6e237eb88a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d962501-978a-43fc-bc68-2bf2ac890247", "tag": "73a64a63-4871-4fa5-8209-ef8eae8d5d74"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:34:21.862093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-862d839a-01ea-4a0b-8412-f7a5859d176d req-3c283c9f-9def-4db5-94cc-cc6e237eb88a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:21.862546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-862d839a-01ea-4a0b-8412-f7a5859d176d req-3c283c9f-9def-4db5-94cc-cc6e237eb88a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:21.875940 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-862d839a-01ea-4a0b-8412-f7a5859d176d req-3c283c9f-9def-4db5-94cc-cc6e237eb88a service nova] Creating event network-changed:73a64a63-4871-4fa5-8209-ef8eae8d5d74 for instance 0d962501-978a-43fc-bc68-2bf2ac890247 on nch1-master-1 May 28 21:34:21.880919 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-862d839a-01ea-4a0b-8412-f7a5859d176d req-3c283c9f-9def-4db5-94cc-cc6e237eb88a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040182 May 28 21:34:21.881495 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2933/5815] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:34:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:34:22.072752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ce6f9ad9-ea24-482c-82b1-5f2b16b18fbb tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:22.073923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ce6f9ad9-ea24-482c-82b1-5f2b16b18fbb tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:22.081008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce6f9ad9-ea24-482c-82b1-5f2b16b18fbb tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:22.081460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce6f9ad9-ea24-482c-82b1-5f2b16b18fbb tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:22.082466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce6f9ad9-ea24-482c-82b1-5f2b16b18fbb tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:22.082909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce6f9ad9-ea24-482c-82b1-5f2b16b18fbb tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:22.279573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ce6f9ad9-ea24-482c-82b1-5f2b16b18fbb tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:22.293270 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ce6f9ad9-ea24-482c-82b1-5f2b16b18fbb tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 200 len: 1319 microversion: 2.1 time: 0.224510 May 28 21:34:22.294199 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2883/5816] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:22 2022] GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:22.722307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b525be49-754d-4248-96f2-a170c45d3dfa tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:22.723030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b525be49-754d-4248-96f2-a170c45d3dfa tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:22.732491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b525be49-754d-4248-96f2-a170c45d3dfa tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:22.732960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b525be49-754d-4248-96f2-a170c45d3dfa tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:22.733802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b525be49-754d-4248-96f2-a170c45d3dfa tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:22.734600 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b525be49-754d-4248-96f2-a170c45d3dfa tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:22.879111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b525be49-754d-4248-96f2-a170c45d3dfa tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:22.887683 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b525be49-754d-4248-96f2-a170c45d3dfa tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1366 microversion: 2.1 time: 0.171201 May 28 21:34:22.888260 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2934/5817] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:22 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:23.310281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-40df565b-1ef1-4a1d-b59f-5299c06f70e2 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:23.310902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-40df565b-1ef1-4a1d-b59f-5299c06f70e2 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:23.318223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40df565b-1ef1-4a1d-b59f-5299c06f70e2 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:23.318892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40df565b-1ef1-4a1d-b59f-5299c06f70e2 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:23.319667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40df565b-1ef1-4a1d-b59f-5299c06f70e2 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:23.320296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40df565b-1ef1-4a1d-b59f-5299c06f70e2 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:23.471460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-40df565b-1ef1-4a1d-b59f-5299c06f70e2 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:23.481254 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-40df565b-1ef1-4a1d-b59f-5299c06f70e2 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 200 len: 1508 microversion: 2.1 time: 0.174318 May 28 21:34:23.492833 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2884/5818] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:23 2022] GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:23.895759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-1e511863-897b-4be9-a672-721a9d489a01 req-b9829b74-634f-4c40-9f7b-13dee58e396b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d962501-978a-43fc-bc68-2bf2ac890247", "tag": "73a64a63-4871-4fa5-8209-ef8eae8d5d74"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:34:23.904939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-011cc142-6979-4731-9e27-6c48725728f1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:23.905678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-011cc142-6979-4731-9e27-6c48725728f1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:23.905902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:34:23.906724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=20 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:34:23.910188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1e511863-897b-4be9-a672-721a9d489a01 req-b9829b74-634f-4c40-9f7b-13dee58e396b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:23.910733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1e511863-897b-4be9-a672-721a9d489a01 req-b9829b74-634f-4c40-9f7b-13dee58e396b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:23.912917 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-011cc142-6979-4731-9e27-6c48725728f1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:23.914090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-011cc142-6979-4731-9e27-6c48725728f1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:23.915095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-011cc142-6979-4731-9e27-6c48725728f1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:23.916935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-011cc142-6979-4731-9e27-6c48725728f1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:23.928257 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-1e511863-897b-4be9-a672-721a9d489a01 req-b9829b74-634f-4c40-9f7b-13dee58e396b service nova] Creating event network-changed:73a64a63-4871-4fa5-8209-ef8eae8d5d74 for instance 0d962501-978a-43fc-bc68-2bf2ac890247 on nch1-master-1 May 28 21:34:23.935114 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-1e511863-897b-4be9-a672-721a9d489a01 req-b9829b74-634f-4c40-9f7b-13dee58e396b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041775 May 28 21:34:23.935775 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2935/5819] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:34:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:34:24.141149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-011cc142-6979-4731-9e27-6c48725728f1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:24.149153 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-011cc142-6979-4731-9e27-6c48725728f1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1366 microversion: 2.1 time: 0.248446 May 28 21:34:24.149765 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2885/5820] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:23 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:25.168412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-403dca29-1c7a-4655-aafe-93670b62724b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:25.169172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-403dca29-1c7a-4655-aafe-93670b62724b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:25.177900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-403dca29-1c7a-4655-aafe-93670b62724b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:25.178358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-403dca29-1c7a-4655-aafe-93670b62724b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:25.179220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-403dca29-1c7a-4655-aafe-93670b62724b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:25.179659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-403dca29-1c7a-4655-aafe-93670b62724b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:25.312620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-403dca29-1c7a-4655-aafe-93670b62724b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:25.320953 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-403dca29-1c7a-4655-aafe-93670b62724b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1366 microversion: 2.1 time: 0.157923 May 28 21:34:25.322489 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2936/5821] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:25 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:25.564614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-385260f8-93a1-4330-bb9f-256c008036e0 req-c5ed3b9f-ffad-4017-aa64-e65fa11199db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "496c4c91-33f1-4301-ba55-0e99f84223da", "name": "network-vif-plugged", "status": "completed", "tag": "d9d0f754-692c-4fa8-809f-632b9373cf5c"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:34:25.570409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=18 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:34:25.575337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-385260f8-93a1-4330-bb9f-256c008036e0 req-c5ed3b9f-ffad-4017-aa64-e65fa11199db service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:25.577021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-385260f8-93a1-4330-bb9f-256c008036e0 req-c5ed3b9f-ffad-4017-aa64-e65fa11199db service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:25.587244 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-385260f8-93a1-4330-bb9f-256c008036e0 req-c5ed3b9f-ffad-4017-aa64-e65fa11199db service nova] Creating event network-vif-plugged:d9d0f754-692c-4fa8-809f-632b9373cf5c for instance 496c4c91-33f1-4301-ba55-0e99f84223da on nch1-master-1 May 28 21:34:25.592869 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-385260f8-93a1-4330-bb9f-256c008036e0 req-c5ed3b9f-ffad-4017-aa64-e65fa11199db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032457 May 28 21:34:25.593453 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2886/5822] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:34:26.339408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-231fc0f0-4f44-41d4-a473-7a5d9072cd89 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:26.340546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-231fc0f0-4f44-41d4-a473-7a5d9072cd89 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:26.348062 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-231fc0f0-4f44-41d4-a473-7a5d9072cd89 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:26.348521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-231fc0f0-4f44-41d4-a473-7a5d9072cd89 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:26.349300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-231fc0f0-4f44-41d4-a473-7a5d9072cd89 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:26.349744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-231fc0f0-4f44-41d4-a473-7a5d9072cd89 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:26.487089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-231fc0f0-4f44-41d4-a473-7a5d9072cd89 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:26.495505 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-231fc0f0-4f44-41d4-a473-7a5d9072cd89 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1366 microversion: 2.1 time: 0.160297 May 28 21:34:26.496097 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2937/5823] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:26 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:27.513677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8cb28f89-5951-44c9-94e0-25f06e0d8d81 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:27.514515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8cb28f89-5951-44c9-94e0-25f06e0d8d81 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:27.521514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cb28f89-5951-44c9-94e0-25f06e0d8d81 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:27.522026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cb28f89-5951-44c9-94e0-25f06e0d8d81 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:27.522811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cb28f89-5951-44c9-94e0-25f06e0d8d81 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:27.523362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8cb28f89-5951-44c9-94e0-25f06e0d8d81 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:27.658267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8cb28f89-5951-44c9-94e0-25f06e0d8d81 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:34:27.666126 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8cb28f89-5951-44c9-94e0-25f06e0d8d81 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1556 microversion: 2.1 time: 0.157640 May 28 21:34:27.666709 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2887/5824] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:34:27 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:34:27.683602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-22beef8e-0460-4cd0-b3b8-3de8c7606e11 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:34:27.684859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-22beef8e-0460-4cd0-b3b8-3de8c7606e11 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:27.692478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22beef8e-0460-4cd0-b3b8-3de8c7606e11 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:27.692970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22beef8e-0460-4cd0-b3b8-3de8c7606e11 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:27.693865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22beef8e-0460-4cd0-b3b8-3de8c7606e11 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:27.696457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22beef8e-0460-4cd0-b3b8-3de8c7606e11 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:27.773097 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-22beef8e-0460-4cd0-b3b8-3de8c7606e11 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093409 May 28 21:34:27.774057 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2938/5825] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:34:27 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:34:29.144188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2a041b79-52e1-4954-9af7-36109bb79d64 req-b95c295c-b232-46d9-96a7-cea236ff6d92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "496c4c91-33f1-4301-ba55-0e99f84223da", "tag": "d9d0f754-692c-4fa8-809f-632b9373cf5c"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:34:29.153946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2a041b79-52e1-4954-9af7-36109bb79d64 req-b95c295c-b232-46d9-96a7-cea236ff6d92 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:29.154124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2a041b79-52e1-4954-9af7-36109bb79d64 req-b95c295c-b232-46d9-96a7-cea236ff6d92 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:29.166412 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2a041b79-52e1-4954-9af7-36109bb79d64 req-b95c295c-b232-46d9-96a7-cea236ff6d92 service nova] Creating event network-changed:d9d0f754-692c-4fa8-809f-632b9373cf5c for instance 496c4c91-33f1-4301-ba55-0e99f84223da on nch1-master-1 May 28 21:34:29.185121 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2a041b79-52e1-4954-9af7-36109bb79d64 req-b95c295c-b232-46d9-96a7-cea236ff6d92 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032530 May 28 21:34:29.187637 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2888/5826] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:34:30.640210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-095fe1e7-4db6-46a0-b58b-2fef32469503 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a420983a-b71a-4ca0-935a-b83c5153223d", "device": "/dev/sdb"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:34:30.641307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-095fe1e7-4db6-46a0-b58b-2fef32469503 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:34:30.648147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-095fe1e7-4db6-46a0-b58b-2fef32469503 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:30.651342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-095fe1e7-4db6-46a0-b58b-2fef32469503 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:30.652206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-095fe1e7-4db6-46a0-b58b-2fef32469503 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:34:30.652662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-095fe1e7-4db6-46a0-b58b-2fef32469503 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:34:31.433037 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-095fe1e7-4db6-46a0-b58b-2fef32469503 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "POST /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.797514 May 28 21:34:31.433654 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2939/5827] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:34:30 2022] POST /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3/os-volume_attachments => generated 194 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:35:04.126791 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=27 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:35:04.127558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=69 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:35:04.131963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-083ab273-0847-4420-972c-edd537c919b4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:04.132558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-083ab273-0847-4420-972c-edd537c919b4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:04.138953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-083ab273-0847-4420-972c-edd537c919b4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:04.139504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-083ab273-0847-4420-972c-edd537c919b4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:04.140315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-083ab273-0847-4420-972c-edd537c919b4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:04.140760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-083ab273-0847-4420-972c-edd537c919b4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:04.168326 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-083ab273-0847-4420-972c-edd537c919b4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da/ips" status: 200 len: 149 microversion: 2.1 time: 0.044064 May 28 21:35:04.168983 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2889/5828] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 21:35:04 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:35:07.198724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d77fc369-1c41-48f8-b600-a0882af34fe1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ae207c8-8c87-4201-942c-781ab5b960e5"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:35:07.201564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d77fc369-1c41-48f8-b600-a0882af34fe1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:07.208806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=27 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:35:07.209918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:35:07.212635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d77fc369-1c41-48f8-b600-a0882af34fe1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:07.213372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d77fc369-1c41-48f8-b600-a0882af34fe1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:07.214662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d77fc369-1c41-48f8-b600-a0882af34fe1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:07.215700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d77fc369-1c41-48f8-b600-a0882af34fe1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:08.043423 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d77fc369-1c41-48f8-b600-a0882af34fe1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "POST /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.848845 May 28 21:35:08.056886 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2940/5829] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:35:07 2022] POST /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da/os-volume_attachments => generated 194 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:35:12.490689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b7bbe168-d196-46fc-930a-ecf1bf783320 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Action: 'create', calling method: .version_select at 0x7f4d56bee280>, body: {"keypair": {"name": "tempest-keypair-1066318971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMz4K10SFeqD6O6h9Q9Z5pLmFih+UNDD5b+GNkLRcmT7Gbhk6ZRdviNZ9DS2KL+foHaQ324Utpv1niN2rI8ycQ7zBDdT7BLztOqEBPMIielQegnfnrWX/2mLGoGSiwf+4w=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:35:12.512696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b7bbe168-d196-46fc-930a-ecf1bf783320 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for project f9c9caba58394e1480acb632405111c5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:35:12.518833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-b7bbe168-d196-46fc-930a-ecf1bf783320 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for user b16d0e791edd4f119e646e7ced74bf74 and project f9c9caba58394e1480acb632405111c5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:35:12.674222 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b7bbe168-d196-46fc-930a-ecf1bf783320 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.187485 May 28 21:35:12.675055 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2890/5830] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:35:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:35:16.816911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-9558199", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31de5272-0585-4c63-8300-cd5a798dd14e"}], "security_groups": [{"name": "tempest-securitygroup--362950782"}], "key_name": "tempest-keypair-1066318971", "user_data": "}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:35:17.012028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] validate_networks() for [('31de5272-0585-4c63-8300-cd5a798dd14e', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:35:17.511109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:35:17.511707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:35:17.512330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:35:17.512879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:35:17.513495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:35:17.526827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:17.527643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:17.529321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:17.532624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:17.574825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for project f9c9caba58394e1480acb632405111c5. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:35:17.575267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for user b16d0e791edd4f119e646e7ced74bf74 and project f9c9caba58394e1480acb632405111c5. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:35:17.589437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:35:17.593904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:35:17.747298 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-75ba94b3-5b01-4e83-b411-95763c367db9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.935249 May 28 21:35:17.747997 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2941/5831] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:35:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:35:17.760455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-647153f6-2cdd-424d-92b1-9ad83e5a2d97 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:17.761770 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-647153f6-2cdd-424d-92b1-9ad83e5a2d97 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:17.833411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-647153f6-2cdd-424d-92b1-9ad83e5a2d97 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:17.845811 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-647153f6-2cdd-424d-92b1-9ad83e5a2d97 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 200 len: 1239 microversion: 2.1 time: 0.089411 May 28 21:35:17.846439 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2891/5832] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:17 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 1239 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:18.863589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ec9911c3-4933-48f5-a12b-7c9cb5b1655d tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:18.874295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ec9911c3-4933-48f5-a12b-7c9cb5b1655d tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:18.981486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ec9911c3-4933-48f5-a12b-7c9cb5b1655d tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:18.998208 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ec9911c3-4933-48f5-a12b-7c9cb5b1655d tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 200 len: 1239 microversion: 2.1 time: 0.138189 May 28 21:35:18.998566 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2942/5833] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:18 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 1239 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:19.237183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4b6c4df2-816e-4cc3-8a9e-1d4c9deed98d tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Action: 'create', calling method: .version_select at 0x7f4d56b51280>, body: {"keypair": {"name": "tempest-TestServerBasicOps-2141702049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9/MdDKq8zC9bajc524wecOTAjbrgES/aBWUx2KvaGFHbJJflFraytHBRPGSpvNdEqnWktgu2j9CgtomqiU0qGCLJ/dQPnkU9tkFHkdyQ5uV/PI5zgRkeeR+9XlTkrTOw=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:35:19.252423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-4b6c4df2-816e-4cc3-8a9e-1d4c9deed98d tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Getting quotas for project 4b4e0b07528040a3aa0194c06fb942cb. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:35:19.258010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-4b6c4df2-816e-4cc3-8a9e-1d4c9deed98d tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Getting quotas for user 13249a1c05fa43bd917b36aafb9db0d9 and project 4b4e0b07528040a3aa0194c06fb942cb. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:35:19.385392 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4b6c4df2-816e-4cc3-8a9e-1d4c9deed98d tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.381152 May 28 21:35:19.387012 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2892/5834] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:35:19 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:35:20.014904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4d2d7d67-1436-4638-9613-2fe2d74c172a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:20.015528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4d2d7d67-1436-4638-9613-2fe2d74c172a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:20.023605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d2d7d67-1436-4638-9613-2fe2d74c172a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:20.024977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d2d7d67-1436-4638-9613-2fe2d74c172a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:20.026524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d2d7d67-1436-4638-9613-2fe2d74c172a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:20.027498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d2d7d67-1436-4638-9613-2fe2d74c172a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:20.178826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4d2d7d67-1436-4638-9613-2fe2d74c172a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:20.215503 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4d2d7d67-1436-4638-9613-2fe2d74c172a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 200 len: 1299 microversion: 2.1 time: 0.203192 May 28 21:35:20.222010 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2943/5835] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:20 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 1299 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:21.251354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bca57f3b-2a0a-4e54-8dcc-06bb80f65a0b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:21.257452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bca57f3b-2a0a-4e54-8dcc-06bb80f65a0b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:21.272492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bca57f3b-2a0a-4e54-8dcc-06bb80f65a0b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:21.273229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bca57f3b-2a0a-4e54-8dcc-06bb80f65a0b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:21.275829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bca57f3b-2a0a-4e54-8dcc-06bb80f65a0b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:21.275829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bca57f3b-2a0a-4e54-8dcc-06bb80f65a0b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:21.665444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bca57f3b-2a0a-4e54-8dcc-06bb80f65a0b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:21.680973 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bca57f3b-2a0a-4e54-8dcc-06bb80f65a0b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 200 len: 1364 microversion: 2.1 time: 0.448116 May 28 21:35:21.687860 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2893/5836] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:21 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 1364 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:22.702961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-05f84575-7563-491c-aa79-048ce97081bf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:22.703589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-05f84575-7563-491c-aa79-048ce97081bf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:22.732884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05f84575-7563-491c-aa79-048ce97081bf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:22.736359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05f84575-7563-491c-aa79-048ce97081bf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:22.740131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05f84575-7563-491c-aa79-048ce97081bf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:22.741812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-05f84575-7563-491c-aa79-048ce97081bf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:23.171048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-b73a46f7-825c-4af2-a18d-ced105cfa66e req-e96547b3-73aa-4614-b6db-7adb31e48af2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2bfb879-a670-4828-a3f1-d46c30d49549", "tag": "01a4688a-0915-4b20-ad10-2f933662cdf2"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:35:23.187124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b73a46f7-825c-4af2-a18d-ced105cfa66e req-e96547b3-73aa-4614-b6db-7adb31e48af2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:23.191307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b73a46f7-825c-4af2-a18d-ced105cfa66e req-e96547b3-73aa-4614-b6db-7adb31e48af2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:23.231127 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-b73a46f7-825c-4af2-a18d-ced105cfa66e req-e96547b3-73aa-4614-b6db-7adb31e48af2 service nova] Creating event network-changed:01a4688a-0915-4b20-ad10-2f933662cdf2 for instance b2bfb879-a670-4828-a3f1-d46c30d49549 on nch2-master-1 May 28 21:35:23.236706 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-b73a46f7-825c-4af2-a18d-ced105cfa66e req-e96547b3-73aa-4614-b6db-7adb31e48af2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073370 May 28 21:35:23.237371 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2894/5837] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:35:23.597694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-05f84575-7563-491c-aa79-048ce97081bf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:23.614655 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-05f84575-7563-491c-aa79-048ce97081bf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 200 len: 1364 microversion: 2.1 time: 0.916502 May 28 21:35:23.615636 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2944/5838] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:22 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 1364 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:24.609759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1978302014", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-2141702049", "security_groups": [{"name": "tempest-secgroup-smoke-1283676424"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "84185306-0fe7-4164-b8b1-4427d8ec6084"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:35:24.632075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a9f829aa-aa3a-48b7-a53e-7a18d376c25f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:24.635631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a9f829aa-aa3a-48b7-a53e-7a18d376c25f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:24.651803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9f829aa-aa3a-48b7-a53e-7a18d376c25f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:24.652266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9f829aa-aa3a-48b7-a53e-7a18d376c25f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:24.653200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9f829aa-aa3a-48b7-a53e-7a18d376c25f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:24.653670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9f829aa-aa3a-48b7-a53e-7a18d376c25f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:25.004577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] validate_networks() for [('84185306-0fe7-4164-b8b1-4427d8ec6084', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:35:25.045663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a9f829aa-aa3a-48b7-a53e-7a18d376c25f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:25.059953 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a9f829aa-aa3a-48b7-a53e-7a18d376c25f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 200 len: 1364 microversion: 2.1 time: 0.431381 May 28 21:35:25.061388 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2945/5839] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:24 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 1364 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:25.927084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Getting quotas for project 4b4e0b07528040a3aa0194c06fb942cb. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:35:25.939615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Getting quotas for user 13249a1c05fa43bd917b36aafb9db0d9 and project 4b4e0b07528040a3aa0194c06fb942cb. Resources: dict_keys(['metadata_items']) {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:35:25.956493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:35:25.956493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:35:25.956493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:35:25.956898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:35:25.957371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:35:25.967073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:25.967724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:25.968767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:25.969378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:25.990964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Getting quotas for project 4b4e0b07528040a3aa0194c06fb942cb. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:35:25.999149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Getting quotas for user 13249a1c05fa43bd917b36aafb9db0d9 and project 4b4e0b07528040a3aa0194c06fb942cb. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:35:26.014635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:35:26.017133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:35:26.077060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-87c0356f-7636-4ca6-9297-b622a4f18bb0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:26.078407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-87c0356f-7636-4ca6-9297-b622a4f18bb0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:26.085946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87c0356f-7636-4ca6-9297-b622a4f18bb0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:26.086628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87c0356f-7636-4ca6-9297-b622a4f18bb0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:26.087423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87c0356f-7636-4ca6-9297-b622a4f18bb0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:26.087960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87c0356f-7636-4ca6-9297-b622a4f18bb0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:26.158372 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c952a021-d784-4ef8-937a-3f3619236e6a tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.554138 May 28 21:35:26.159364 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2895/5840] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:35:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:35:26.173767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-daf1ccc4-ad81-415a-aa27-e944b9617d96 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:26.174645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-daf1ccc4-ad81-415a-aa27-e944b9617d96 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:26.275705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-daf1ccc4-ad81-415a-aa27-e944b9617d96 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:26.305193 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-daf1ccc4-ad81-415a-aa27-e944b9617d96 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1303 microversion: 2.1 time: 0.135590 May 28 21:35:26.315281 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2896/5841] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:26 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1303 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:35:26.322794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-87c0356f-7636-4ca6-9297-b622a4f18bb0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:26.335096 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-87c0356f-7636-4ca6-9297-b622a4f18bb0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 200 len: 1364 microversion: 2.1 time: 0.261992 May 28 21:35:26.336630 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2946/5842] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:26 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:35:27.323657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0860d9b4-258a-4189-8a7c-3a77cfd046f1 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:27.324476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0860d9b4-258a-4189-8a7c-3a77cfd046f1 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:27.354070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-35abdc5e-5167-446e-ae06-8cc9e38e81a9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:27.354696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-35abdc5e-5167-446e-ae06-8cc9e38e81a9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:27.362593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35abdc5e-5167-446e-ae06-8cc9e38e81a9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:27.363277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35abdc5e-5167-446e-ae06-8cc9e38e81a9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:27.364730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35abdc5e-5167-446e-ae06-8cc9e38e81a9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:27.365172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35abdc5e-5167-446e-ae06-8cc9e38e81a9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:27.381811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0860d9b4-258a-4189-8a7c-3a77cfd046f1 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:27.389964 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0860d9b4-258a-4189-8a7c-3a77cfd046f1 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1303 microversion: 2.1 time: 0.070140 May 28 21:35:27.391032 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2897/5843] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:27 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1303 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:27.538567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:35:27.597752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-35abdc5e-5167-446e-ae06-8cc9e38e81a9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:27.617571 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-35abdc5e-5167-446e-ae06-8cc9e38e81a9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 200 len: 1364 microversion: 2.1 time: 0.268990 May 28 21:35:27.628631 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2947/5844] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:27 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:35:27.672889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-20dc7b9b-f56a-48c4-a1aa-9713904204ac req-e9bf9ad2-7663-4767-909f-77c02071cbce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bfb879-a670-4828-a3f1-d46c30d49549", "name": "network-vif-plugged", "status": "completed", "tag": "01a4688a-0915-4b20-ad10-2f933662cdf2"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:35:27.683364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-20dc7b9b-f56a-48c4-a1aa-9713904204ac req-e9bf9ad2-7663-4767-909f-77c02071cbce service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:27.683909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-20dc7b9b-f56a-48c4-a1aa-9713904204ac req-e9bf9ad2-7663-4767-909f-77c02071cbce service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:27.695731 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-20dc7b9b-f56a-48c4-a1aa-9713904204ac req-e9bf9ad2-7663-4767-909f-77c02071cbce service nova] Creating event network-vif-plugged:01a4688a-0915-4b20-ad10-2f933662cdf2 for instance b2bfb879-a670-4828-a3f1-d46c30d49549 on nch2-master-1 May 28 21:35:27.701738 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-20dc7b9b-f56a-48c4-a1aa-9713904204ac req-e9bf9ad2-7663-4767-909f-77c02071cbce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037414 May 28 21:35:27.702418 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2898/5845] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:35:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:35:28.408272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89a5366c-9c46-4f63-aa5e-9977797fb494 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:28.409050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-89a5366c-9c46-4f63-aa5e-9977797fb494 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:28.418542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89a5366c-9c46-4f63-aa5e-9977797fb494 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:28.419044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89a5366c-9c46-4f63-aa5e-9977797fb494 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:28.420822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89a5366c-9c46-4f63-aa5e-9977797fb494 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:28.421270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89a5366c-9c46-4f63-aa5e-9977797fb494 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:28.527661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-89a5366c-9c46-4f63-aa5e-9977797fb494 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:28.535385 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-89a5366c-9c46-4f63-aa5e-9977797fb494 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1355 microversion: 2.1 time: 0.132537 May 28 21:35:28.536014 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2948/5846] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:28 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1355 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:28.636326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-539261d9-7878-4898-8dff-f4b501057d40 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:28.637046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-539261d9-7878-4898-8dff-f4b501057d40 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:28.644286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-539261d9-7878-4898-8dff-f4b501057d40 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:28.644749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-539261d9-7878-4898-8dff-f4b501057d40 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:28.646152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-539261d9-7878-4898-8dff-f4b501057d40 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:28.646992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-539261d9-7878-4898-8dff-f4b501057d40 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:28.984077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-539261d9-7878-4898-8dff-f4b501057d40 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:28.994780 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-539261d9-7878-4898-8dff-f4b501057d40 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 200 len: 1364 microversion: 2.1 time: 0.362678 May 28 21:35:28.995843 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2899/5847] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:28 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 1364 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:29.556925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0cbc1790-b688-4e06-9209-076fcb0dd719 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:29.558339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0cbc1790-b688-4e06-9209-076fcb0dd719 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:29.561300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=8 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:35:29.567718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cbc1790-b688-4e06-9209-076fcb0dd719 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:29.568192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cbc1790-b688-4e06-9209-076fcb0dd719 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:29.569026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cbc1790-b688-4e06-9209-076fcb0dd719 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:29.569690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cbc1790-b688-4e06-9209-076fcb0dd719 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:29.650965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0cbc1790-b688-4e06-9209-076fcb0dd719 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:29.663924 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0cbc1790-b688-4e06-9209-076fcb0dd719 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1361 microversion: 2.1 time: 0.110955 May 28 21:35:29.664650 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2949/5848] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:29 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1361 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:30.014616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-307046ed-dc4c-4be9-bdb6-be5a943ce7a2 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:30.015604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-307046ed-dc4c-4be9-bdb6-be5a943ce7a2 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:30.024374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-307046ed-dc4c-4be9-bdb6-be5a943ce7a2 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:30.025520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-307046ed-dc4c-4be9-bdb6-be5a943ce7a2 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:30.026706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-307046ed-dc4c-4be9-bdb6-be5a943ce7a2 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:30.027326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-307046ed-dc4c-4be9-bdb6-be5a943ce7a2 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:30.184125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-307046ed-dc4c-4be9-bdb6-be5a943ce7a2 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:30.196360 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-307046ed-dc4c-4be9-bdb6-be5a943ce7a2 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 200 len: 1553 microversion: 2.1 time: 0.185744 May 28 21:35:30.197060 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2900/5849] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:30 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 1553 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:30.213632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ed2078ad-fb66-401b-b2ba-dd0cdbe8558a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:30.214181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ed2078ad-fb66-401b-b2ba-dd0cdbe8558a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:30.228587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed2078ad-fb66-401b-b2ba-dd0cdbe8558a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:30.230462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed2078ad-fb66-401b-b2ba-dd0cdbe8558a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:30.232113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed2078ad-fb66-401b-b2ba-dd0cdbe8558a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:30.233198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed2078ad-fb66-401b-b2ba-dd0cdbe8558a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:30.360348 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ed2078ad-fb66-401b-b2ba-dd0cdbe8558a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151371 May 28 21:35:30.360957 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2950/5850] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:35:30 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:35:30.682382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7a7d9bbf-b2cf-4ddc-bbe6-558200feb9e8 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:30.683278 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7a7d9bbf-b2cf-4ddc-bbe6-558200feb9e8 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:30.691585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a7d9bbf-b2cf-4ddc-bbe6-558200feb9e8 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:30.692524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a7d9bbf-b2cf-4ddc-bbe6-558200feb9e8 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:30.694130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a7d9bbf-b2cf-4ddc-bbe6-558200feb9e8 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:30.694790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a7d9bbf-b2cf-4ddc-bbe6-558200feb9e8 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:31.011878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7a7d9bbf-b2cf-4ddc-bbe6-558200feb9e8 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:31.023299 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7a7d9bbf-b2cf-4ddc-bbe6-558200feb9e8 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1429 microversion: 2.1 time: 0.345619 May 28 21:35:31.024974 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2901/5851] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:30 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1429 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:31.572693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-a64592a7-11af-4d0b-9bf2-5b8083501625 req-2789d49a-12bf-419e-ab7a-f40178914480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be4e698e-48f4-4ffd-82f7-9f9497b6dc30", "tag": "36e6204f-ff1b-4d12-a280-9411350bd0f6"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:35:31.595065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a64592a7-11af-4d0b-9bf2-5b8083501625 req-2789d49a-12bf-419e-ab7a-f40178914480 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:31.596254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a64592a7-11af-4d0b-9bf2-5b8083501625 req-2789d49a-12bf-419e-ab7a-f40178914480 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:31.627592 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a64592a7-11af-4d0b-9bf2-5b8083501625 req-2789d49a-12bf-419e-ab7a-f40178914480 service nova] Creating event network-changed:36e6204f-ff1b-4d12-a280-9411350bd0f6 for instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 on nch1-master-1 May 28 21:35:31.641931 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-a64592a7-11af-4d0b-9bf2-5b8083501625 req-2789d49a-12bf-419e-ab7a-f40178914480 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079840 May 28 21:35:31.642728 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2951/5852] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:35:32.042165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0eaaee6c-e300-4641-840f-84141c30289f tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:32.043051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0eaaee6c-e300-4641-840f-84141c30289f tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:32.050360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0eaaee6c-e300-4641-840f-84141c30289f tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:32.050924 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0eaaee6c-e300-4641-840f-84141c30289f tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:32.052301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0eaaee6c-e300-4641-840f-84141c30289f tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:32.053199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0eaaee6c-e300-4641-840f-84141c30289f tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:32.733156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0eaaee6c-e300-4641-840f-84141c30289f tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:32.767724 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0eaaee6c-e300-4641-840f-84141c30289f tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1429 microversion: 2.1 time: 0.727649 May 28 21:35:32.769347 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2902/5853] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:32 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1429 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:33.692449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-cec84ba2-5f82-4d39-b546-f7b12df0a363 req-17cb815c-49d7-4bea-94b7-ef5e06a78a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2bfb879-a670-4828-a3f1-d46c30d49549", "tag": "01a4688a-0915-4b20-ad10-2f933662cdf2"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:35:33.701676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cec84ba2-5f82-4d39-b546-f7b12df0a363 req-17cb815c-49d7-4bea-94b7-ef5e06a78a33 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:33.702167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cec84ba2-5f82-4d39-b546-f7b12df0a363 req-17cb815c-49d7-4bea-94b7-ef5e06a78a33 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:33.714216 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-cec84ba2-5f82-4d39-b546-f7b12df0a363 req-17cb815c-49d7-4bea-94b7-ef5e06a78a33 service nova] Creating event network-changed:01a4688a-0915-4b20-ad10-2f933662cdf2 for instance b2bfb879-a670-4828-a3f1-d46c30d49549 on nch2-master-1 May 28 21:35:33.720109 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-cec84ba2-5f82-4d39-b546-f7b12df0a363 req-17cb815c-49d7-4bea-94b7-ef5e06a78a33 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033314 May 28 21:35:33.720946 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2952/5854] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:35:33.787494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3112fb48-23e3-4461-a125-320e661dafe0 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:33.788117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3112fb48-23e3-4461-a125-320e661dafe0 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:33.796548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3112fb48-23e3-4461-a125-320e661dafe0 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:33.797272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3112fb48-23e3-4461-a125-320e661dafe0 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:33.798468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3112fb48-23e3-4461-a125-320e661dafe0 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:33.799091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3112fb48-23e3-4461-a125-320e661dafe0 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:34.322002 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3112fb48-23e3-4461-a125-320e661dafe0 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:34.332196 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3112fb48-23e3-4461-a125-320e661dafe0 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1429 microversion: 2.1 time: 0.549179 May 28 21:35:34.334500 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2903/5855] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:33 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1429 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:35.352250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a10853ca-7a08-434e-b821-ac9da62f453d tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:35.352959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a10853ca-7a08-434e-b821-ac9da62f453d tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:35.359968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a10853ca-7a08-434e-b821-ac9da62f453d tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:35.360418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a10853ca-7a08-434e-b821-ac9da62f453d tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:35.361180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a10853ca-7a08-434e-b821-ac9da62f453d tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:35.361618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a10853ca-7a08-434e-b821-ac9da62f453d tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:35.497108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a10853ca-7a08-434e-b821-ac9da62f453d tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:35.505257 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a10853ca-7a08-434e-b821-ac9da62f453d tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1429 microversion: 2.1 time: 0.157530 May 28 21:35:35.505831 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2953/5856] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:35 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1429 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:35:36.523202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2b3642b6-cd68-4608-96f7-139069b71dc1 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:36.523863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2b3642b6-cd68-4608-96f7-139069b71dc1 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:36.527846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:35:36.528526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=5 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:35:36.532245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b3642b6-cd68-4608-96f7-139069b71dc1 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:36.532706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b3642b6-cd68-4608-96f7-139069b71dc1 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:36.533486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b3642b6-cd68-4608-96f7-139069b71dc1 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:36.533955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b3642b6-cd68-4608-96f7-139069b71dc1 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:36.674685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2b3642b6-cd68-4608-96f7-139069b71dc1 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:36.682522 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2b3642b6-cd68-4608-96f7-139069b71dc1 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1429 microversion: 2.1 time: 0.164290 May 28 21:35:36.683085 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2904/5857] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:36 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1429 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:37.701858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7ba75d99-ee61-4505-9893-fc0ddce6a2ca tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:37.702498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7ba75d99-ee61-4505-9893-fc0ddce6a2ca tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:37.705341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:35:37.710779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ba75d99-ee61-4505-9893-fc0ddce6a2ca tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:37.712173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ba75d99-ee61-4505-9893-fc0ddce6a2ca tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:37.712173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ba75d99-ee61-4505-9893-fc0ddce6a2ca tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:37.712469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ba75d99-ee61-4505-9893-fc0ddce6a2ca tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:37.715405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:35:37.839615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-30b99983-408b-477c-aa7c-c3f3a2eef6e3 req-ce25eb05-6c99-4af7-a8ee-d677428ce012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4e698e-48f4-4ffd-82f7-9f9497b6dc30", "name": "network-vif-plugged", "status": "completed", "tag": "36e6204f-ff1b-4d12-a280-9411350bd0f6"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:35:37.856497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=24 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:35:37.871582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-30b99983-408b-477c-aa7c-c3f3a2eef6e3 req-ce25eb05-6c99-4af7-a8ee-d677428ce012 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:37.871582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-30b99983-408b-477c-aa7c-c3f3a2eef6e3 req-ce25eb05-6c99-4af7-a8ee-d677428ce012 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:37.878989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7ba75d99-ee61-4505-9893-fc0ddce6a2ca tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:37.884826 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-30b99983-408b-477c-aa7c-c3f3a2eef6e3 req-ce25eb05-6c99-4af7-a8ee-d677428ce012 service nova] Creating event network-vif-plugged:36e6204f-ff1b-4d12-a280-9411350bd0f6 for instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 on nch1-master-1 May 28 21:35:37.891908 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-30b99983-408b-477c-aa7c-c3f3a2eef6e3 req-ce25eb05-6c99-4af7-a8ee-d677428ce012 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055912 May 28 21:35:37.892729 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2905/5858] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:35:37.900971 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7ba75d99-ee61-4505-9893-fc0ddce6a2ca tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1429 microversion: 2.1 time: 0.201446 May 28 21:35:37.900971 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2954/5859] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:37 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1429 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:38.918490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4ab10443-d36d-4022-859e-f665fcbdcbb9 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:38.919325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4ab10443-d36d-4022-859e-f665fcbdcbb9 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:38.928774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ab10443-d36d-4022-859e-f665fcbdcbb9 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:38.931164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ab10443-d36d-4022-859e-f665fcbdcbb9 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:38.931164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ab10443-d36d-4022-859e-f665fcbdcbb9 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:38.931164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ab10443-d36d-4022-859e-f665fcbdcbb9 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:39.071025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4ab10443-d36d-4022-859e-f665fcbdcbb9 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:39.078981 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4ab10443-d36d-4022-859e-f665fcbdcbb9 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1429 microversion: 2.1 time: 0.165582 May 28 21:35:39.079560 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2906/5860] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:38 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1429 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:40.097322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-10d41e0f-66a7-47f1-8299-be5f29aeb212 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:40.098851 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-10d41e0f-66a7-47f1-8299-be5f29aeb212 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:40.109018 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10d41e0f-66a7-47f1-8299-be5f29aeb212 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:40.109488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10d41e0f-66a7-47f1-8299-be5f29aeb212 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:40.110320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10d41e0f-66a7-47f1-8299-be5f29aeb212 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:40.110980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10d41e0f-66a7-47f1-8299-be5f29aeb212 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:40.305035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-10d41e0f-66a7-47f1-8299-be5f29aeb212 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:40.312973 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-10d41e0f-66a7-47f1-8299-be5f29aeb212 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1608 microversion: 2.1 time: 0.219967 May 28 21:35:40.313567 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2955/5861] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:40 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1608 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:40.331981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4c321b71-5f01-44ac-9df8-d6bccebc34b5 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:40.332893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4c321b71-5f01-44ac-9df8-d6bccebc34b5 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:40.340831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c321b71-5f01-44ac-9df8-d6bccebc34b5 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:40.341371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c321b71-5f01-44ac-9df8-d6bccebc34b5 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:40.342250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c321b71-5f01-44ac-9df8-d6bccebc34b5 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:40.342844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c321b71-5f01-44ac-9df8-d6bccebc34b5 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:40.513965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4c321b71-5f01-44ac-9df8-d6bccebc34b5 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:40.521745 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4c321b71-5f01-44ac-9df8-d6bccebc34b5 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1608 microversion: 2.1 time: 0.194036 May 28 21:35:40.522457 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2907/5862] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:40 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1608 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:40.538938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d097c1bb-0fca-4c46-af5c-df0270221f58 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:40.539600 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d097c1bb-0fca-4c46-af5c-df0270221f58 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:40.545773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d097c1bb-0fca-4c46-af5c-df0270221f58 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:40.546278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d097c1bb-0fca-4c46-af5c-df0270221f58 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:40.547067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d097c1bb-0fca-4c46-af5c-df0270221f58 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:40.547520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d097c1bb-0fca-4c46-af5c-df0270221f58 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:40.694168 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d097c1bb-0fca-4c46-af5c-df0270221f58 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:40.701796 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d097c1bb-0fca-4c46-af5c-df0270221f58 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1608 microversion: 2.1 time: 0.167788 May 28 21:35:40.702406 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2956/5863] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:40 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1608 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:41.264874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1431798716", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "84e3b5ad-ffd4-43ba-8646-84cbecb1c3fa"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:35:41.320092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] validate_networks() for [('84e3b5ad-ffd4-43ba-8646-84cbecb1c3fa', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:35:41.902182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:35:41.906468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:35:41.906468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:35:41.906468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:35:41.906468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:35:41.913943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:41.914395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:41.915192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:41.915657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:41.936380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Getting quotas for project 28f8fcc4afe8471c94db58bef7526459. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:35:41.942001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Getting quotas for user b8372df2880a483e8f1b2b1b667ddf04 and project 28f8fcc4afe8471c94db58bef7526459. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:35:41.957979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:35:41.959405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:35:42.056874 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f8669c55-8274-4f1f-95d5-6a5fe7776823 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920276 May 28 21:35:42.057994 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2908/5864] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:35:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:35:42.075318 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e9dc2e8d-759d-447d-8605-100c424c0093 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:42.076834 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e9dc2e8d-759d-447d-8605-100c424c0093 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:42.150014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e9dc2e8d-759d-447d-8605-100c424c0093 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8372df2880a483e8f1b2b1b667ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f8fcc4afe8471c94db58bef7526459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:42.157413 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e9dc2e8d-759d-447d-8605-100c424c0093 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 200 len: 1214 microversion: 2.1 time: 0.088515 May 28 21:35:42.158243 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2957/5865] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:42 2022] GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:35:43.175510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a79bb12a-67ba-4486-85d7-fa94f6b5f6b6 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:43.176955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a79bb12a-67ba-4486-85d7-fa94f6b5f6b6 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:43.580445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a79bb12a-67ba-4486-85d7-fa94f6b5f6b6 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8372df2880a483e8f1b2b1b667ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f8fcc4afe8471c94db58bef7526459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:43.583634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-5b3b2076-3dad-408a-9de8-0f04965219a5 req-6d968312-b8ff-45e1-971d-db95bfc126a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be4e698e-48f4-4ffd-82f7-9f9497b6dc30", "tag": "36e6204f-ff1b-4d12-a280-9411350bd0f6"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:35:43.589304 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a79bb12a-67ba-4486-85d7-fa94f6b5f6b6 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 200 len: 1214 microversion: 2.1 time: 0.418072 May 28 21:35:43.590224 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2909/5866] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:43 2022] GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 1214 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:43.596479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5b3b2076-3dad-408a-9de8-0f04965219a5 req-6d968312-b8ff-45e1-971d-db95bfc126a8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:43.597078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5b3b2076-3dad-408a-9de8-0f04965219a5 req-6d968312-b8ff-45e1-971d-db95bfc126a8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:43.608715 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-5b3b2076-3dad-408a-9de8-0f04965219a5 req-6d968312-b8ff-45e1-971d-db95bfc126a8 service nova] Creating event network-changed:36e6204f-ff1b-4d12-a280-9411350bd0f6 for instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 on nch1-master-1 May 28 21:35:43.615356 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-5b3b2076-3dad-408a-9de8-0f04965219a5 req-6d968312-b8ff-45e1-971d-db95bfc126a8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036029 May 28 21:35:43.616132 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2958/5867] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:35:44.611342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3ddb67b4-7b92-4688-9f08-c4a1c905d94d tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:44.611969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3ddb67b4-7b92-4688-9f08-c4a1c905d94d tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:44.619665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ddb67b4-7b92-4688-9f08-c4a1c905d94d tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:44.620125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ddb67b4-7b92-4688-9f08-c4a1c905d94d tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:44.620938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ddb67b4-7b92-4688-9f08-c4a1c905d94d tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:44.621408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ddb67b4-7b92-4688-9f08-c4a1c905d94d tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:44.626749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=69 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:35:44.688076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3ddb67b4-7b92-4688-9f08-c4a1c905d94d tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8372df2880a483e8f1b2b1b667ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f8fcc4afe8471c94db58bef7526459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:44.696256 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3ddb67b4-7b92-4688-9f08-c4a1c905d94d tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 200 len: 1274 microversion: 2.1 time: 0.089023 May 28 21:35:44.696848 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2910/5868] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:44 2022] GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 1274 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:45.718510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a282fbf0-3e2a-4072-a524-e8e8ba091dd7 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:45.719246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a282fbf0-3e2a-4072-a524-e8e8ba091dd7 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:45.725557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a282fbf0-3e2a-4072-a524-e8e8ba091dd7 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:45.726119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a282fbf0-3e2a-4072-a524-e8e8ba091dd7 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:45.726931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a282fbf0-3e2a-4072-a524-e8e8ba091dd7 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:45.727373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a282fbf0-3e2a-4072-a524-e8e8ba091dd7 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:45.861378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a282fbf0-3e2a-4072-a524-e8e8ba091dd7 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8372df2880a483e8f1b2b1b667ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f8fcc4afe8471c94db58bef7526459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:45.872653 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a282fbf0-3e2a-4072-a524-e8e8ba091dd7 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 200 len: 1314 microversion: 2.1 time: 0.159629 May 28 21:35:45.875964 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2959/5869] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:45 2022] GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:46.154676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-ffc2f11d-345e-4dfd-a821-5234c91467e0 req-a8ccfc79-41d3-4bb8-b246-628065c26b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "374901ee-a9de-43dc-94a5-5752fb696b5e", "tag": "0a8f780a-7f66-4fc7-9924-891c82b8972f"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:35:46.164192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ffc2f11d-345e-4dfd-a821-5234c91467e0 req-a8ccfc79-41d3-4bb8-b246-628065c26b21 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:46.164637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ffc2f11d-345e-4dfd-a821-5234c91467e0 req-a8ccfc79-41d3-4bb8-b246-628065c26b21 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:46.177653 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-ffc2f11d-345e-4dfd-a821-5234c91467e0 req-a8ccfc79-41d3-4bb8-b246-628065c26b21 service nova] Creating event network-changed:0a8f780a-7f66-4fc7-9924-891c82b8972f for instance 374901ee-a9de-43dc-94a5-5752fb696b5e on nch2-master-1 May 28 21:35:46.182699 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-ffc2f11d-345e-4dfd-a821-5234c91467e0 req-a8ccfc79-41d3-4bb8-b246-628065c26b21 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032477 May 28 21:35:46.183590 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2911/5870] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:35:46.889781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-78f29638-9818-4f96-89e9-d828a7e51e9e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:46.890482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-78f29638-9818-4f96-89e9-d828a7e51e9e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:46.898194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78f29638-9818-4f96-89e9-d828a7e51e9e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:46.898667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78f29638-9818-4f96-89e9-d828a7e51e9e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:46.899454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78f29638-9818-4f96-89e9-d828a7e51e9e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:46.899888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-78f29638-9818-4f96-89e9-d828a7e51e9e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:47.031655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-78f29638-9818-4f96-89e9-d828a7e51e9e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8372df2880a483e8f1b2b1b667ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f8fcc4afe8471c94db58bef7526459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:47.039921 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-78f29638-9818-4f96-89e9-d828a7e51e9e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 200 len: 1314 microversion: 2.1 time: 0.154084 May 28 21:35:47.040503 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2960/5871] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:46 2022] GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:48.058110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f10f1079-fc2a-461d-ab28-db16a359b22c tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:48.058822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f10f1079-fc2a-461d-ab28-db16a359b22c tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:48.066459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f10f1079-fc2a-461d-ab28-db16a359b22c tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:48.066925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f10f1079-fc2a-461d-ab28-db16a359b22c tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:48.067719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f10f1079-fc2a-461d-ab28-db16a359b22c tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:48.068165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f10f1079-fc2a-461d-ab28-db16a359b22c tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:48.199380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f10f1079-fc2a-461d-ab28-db16a359b22c tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8372df2880a483e8f1b2b1b667ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f8fcc4afe8471c94db58bef7526459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:48.206901 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f10f1079-fc2a-461d-ab28-db16a359b22c tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 200 len: 1314 microversion: 2.1 time: 0.153504 May 28 21:35:48.207487 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2912/5872] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:48 2022] GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:49.224637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1a59ad92-f45a-4ae8-850c-b93c6c72f83e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:49.225269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1a59ad92-f45a-4ae8-850c-b93c6c72f83e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:49.232223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a59ad92-f45a-4ae8-850c-b93c6c72f83e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:49.232683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a59ad92-f45a-4ae8-850c-b93c6c72f83e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:49.233457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a59ad92-f45a-4ae8-850c-b93c6c72f83e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:49.233941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a59ad92-f45a-4ae8-850c-b93c6c72f83e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:49.372509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1a59ad92-f45a-4ae8-850c-b93c6c72f83e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8372df2880a483e8f1b2b1b667ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f8fcc4afe8471c94db58bef7526459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:49.380144 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1a59ad92-f45a-4ae8-850c-b93c6c72f83e tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 200 len: 1314 microversion: 2.1 time: 0.159385 May 28 21:35:49.380724 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2961/5873] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:49 2022] GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:50.396331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f93a8a86-4925-41f4-8be6-3b5b4de5226f tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:50.397564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f93a8a86-4925-41f4-8be6-3b5b4de5226f tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:50.404414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f93a8a86-4925-41f4-8be6-3b5b4de5226f tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:50.404868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f93a8a86-4925-41f4-8be6-3b5b4de5226f tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:50.405638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f93a8a86-4925-41f4-8be6-3b5b4de5226f tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:50.406110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f93a8a86-4925-41f4-8be6-3b5b4de5226f tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:50.536612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f93a8a86-4925-41f4-8be6-3b5b4de5226f tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8372df2880a483e8f1b2b1b667ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f8fcc4afe8471c94db58bef7526459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:50.544175 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f93a8a86-4925-41f4-8be6-3b5b4de5226f tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 200 len: 1314 microversion: 2.1 time: 0.151738 May 28 21:35:50.544768 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2913/5874] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:50 2022] GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:51.563986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-86a406d2-bfa7-43a4-a3e5-88f8422bd71a tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:51.564728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-86a406d2-bfa7-43a4-a3e5-88f8422bd71a tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:51.572403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-86a406d2-bfa7-43a4-a3e5-88f8422bd71a tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:51.572855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-86a406d2-bfa7-43a4-a3e5-88f8422bd71a tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:51.573617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-86a406d2-bfa7-43a4-a3e5-88f8422bd71a tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:51.574130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-86a406d2-bfa7-43a4-a3e5-88f8422bd71a tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:51.714491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-86a406d2-bfa7-43a4-a3e5-88f8422bd71a tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8372df2880a483e8f1b2b1b667ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f8fcc4afe8471c94db58bef7526459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:51.720467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-8b11f736-4bb3-4766-a6b6-894ee99b9ee0 req-9ef86366-078f-40a9-9b45-cdb440e82e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374901ee-a9de-43dc-94a5-5752fb696b5e", "name": "network-vif-plugged", "status": "completed", "tag": "0a8f780a-7f66-4fc7-9924-891c82b8972f"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:35:51.722989 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-86a406d2-bfa7-43a4-a3e5-88f8422bd71a tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 200 len: 1314 microversion: 2.1 time: 0.162994 May 28 21:35:51.726052 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2962/5875] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:51 2022] GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:51.730266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8b11f736-4bb3-4766-a6b6-894ee99b9ee0 req-9ef86366-078f-40a9-9b45-cdb440e82e63 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:51.730718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8b11f736-4bb3-4766-a6b6-894ee99b9ee0 req-9ef86366-078f-40a9-9b45-cdb440e82e63 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:51.742571 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-8b11f736-4bb3-4766-a6b6-894ee99b9ee0 req-9ef86366-078f-40a9-9b45-cdb440e82e63 service nova] Creating event network-vif-plugged:0a8f780a-7f66-4fc7-9924-891c82b8972f for instance 374901ee-a9de-43dc-94a5-5752fb696b5e on nch2-master-1 May 28 21:35:51.747640 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-8b11f736-4bb3-4766-a6b6-894ee99b9ee0 req-9ef86366-078f-40a9-9b45-cdb440e82e63 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035651 May 28 21:35:51.748531 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2914/5876] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:35:52.740204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e0588d65-dcbe-4ab7-b9a3-d93c76e8cde1 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:52.740854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e0588d65-dcbe-4ab7-b9a3-d93c76e8cde1 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:52.742869 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:35:52.750534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0588d65-dcbe-4ab7-b9a3-d93c76e8cde1 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:52.751000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0588d65-dcbe-4ab7-b9a3-d93c76e8cde1 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:52.751786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0588d65-dcbe-4ab7-b9a3-d93c76e8cde1 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:52.752241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0588d65-dcbe-4ab7-b9a3-d93c76e8cde1 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:52.880755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e0588d65-dcbe-4ab7-b9a3-d93c76e8cde1 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8372df2880a483e8f1b2b1b667ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f8fcc4afe8471c94db58bef7526459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:52.888339 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e0588d65-dcbe-4ab7-b9a3-d93c76e8cde1 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 200 len: 1314 microversion: 2.1 time: 0.152098 May 28 21:35:52.888906 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2963/5877] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:52 2022] GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:53.906142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7843c08b-37d7-457f-9dc9-f6eb03c34a96 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:53.909871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7843c08b-37d7-457f-9dc9-f6eb03c34a96 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:53.909871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:35:53.910448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:35:53.915618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7843c08b-37d7-457f-9dc9-f6eb03c34a96 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:53.916055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7843c08b-37d7-457f-9dc9-f6eb03c34a96 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:53.916863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7843c08b-37d7-457f-9dc9-f6eb03c34a96 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:53.917308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7843c08b-37d7-457f-9dc9-f6eb03c34a96 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:54.085159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7843c08b-37d7-457f-9dc9-f6eb03c34a96 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8372df2880a483e8f1b2b1b667ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f8fcc4afe8471c94db58bef7526459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:54.093960 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7843c08b-37d7-457f-9dc9-f6eb03c34a96 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 200 len: 1499 microversion: 2.1 time: 0.192018 May 28 21:35:54.094557 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2915/5878] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:53 2022] GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 1499 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:58.348429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-90cc0e5c-e6da-41af-95f6-b23b2ff42da4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:58.349218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-90cc0e5c-e6da-41af-95f6-b23b2ff42da4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:58.356925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90cc0e5c-e6da-41af-95f6-b23b2ff42da4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:58.357388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90cc0e5c-e6da-41af-95f6-b23b2ff42da4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:58.358241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90cc0e5c-e6da-41af-95f6-b23b2ff42da4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:58.358691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90cc0e5c-e6da-41af-95f6-b23b2ff42da4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:58.384558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-90cc0e5c-e6da-41af-95f6-b23b2ff42da4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:35:58.642674 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-90cc0e5c-e6da-41af-95f6-b23b2ff42da4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "DELETE /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 204 len: 0 microversion: 2.1 time: 0.297862 May 28 21:35:58.643305 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2964/5879] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:35:58 2022] DELETE /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:35:58.652722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-81f69526-8ae7-4bf0-ad3b-57983e43c350 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:58.657574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-81f69526-8ae7-4bf0-ad3b-57983e43c350 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:58.660117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-81f69526-8ae7-4bf0-ad3b-57983e43c350 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:58.660584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-81f69526-8ae7-4bf0-ad3b-57983e43c350 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:58.661362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-81f69526-8ae7-4bf0-ad3b-57983e43c350 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:58.661813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-81f69526-8ae7-4bf0-ad3b-57983e43c350 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:58.799068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-81f69526-8ae7-4bf0-ad3b-57983e43c350 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8372df2880a483e8f1b2b1b667ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f8fcc4afe8471c94db58bef7526459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:58.806729 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-81f69526-8ae7-4bf0-ad3b-57983e43c350 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 200 len: 1505 microversion: 2.1 time: 0.159086 May 28 21:35:58.807304 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2916/5880] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:58 2022] GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:35:59.824610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-52dcb8ec-17f0-48ec-a662-7af7581f344b tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:35:59.825307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-52dcb8ec-17f0-48ec-a662-7af7581f344b tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:35:59.834195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52dcb8ec-17f0-48ec-a662-7af7581f344b tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:59.834645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52dcb8ec-17f0-48ec-a662-7af7581f344b tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:59.835413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52dcb8ec-17f0-48ec-a662-7af7581f344b tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:35:59.835856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52dcb8ec-17f0-48ec-a662-7af7581f344b tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:35:59.973779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-52dcb8ec-17f0-48ec-a662-7af7581f344b tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8372df2880a483e8f1b2b1b667ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f8fcc4afe8471c94db58bef7526459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:35:59.981922 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-52dcb8ec-17f0-48ec-a662-7af7581f344b tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 200 len: 1505 microversion: 2.1 time: 0.161534 May 28 21:35:59.982501 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2965/5881] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:35:59 2022] GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:00.804111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-f07aee79-de52-4acd-a86f-3debf3d0e53c req-326b8842-b8f9-4a00-af7d-a505fa42cfbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "374901ee-a9de-43dc-94a5-5752fb696b5e", "name": "network-vif-deleted", "tag": "0a8f780a-7f66-4fc7-9924-891c82b8972f"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:36:00.813423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f07aee79-de52-4acd-a86f-3debf3d0e53c req-326b8842-b8f9-4a00-af7d-a505fa42cfbf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:00.813899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f07aee79-de52-4acd-a86f-3debf3d0e53c req-326b8842-b8f9-4a00-af7d-a505fa42cfbf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:00.825791 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-f07aee79-de52-4acd-a86f-3debf3d0e53c req-326b8842-b8f9-4a00-af7d-a505fa42cfbf service nova] Creating event network-vif-deleted:0a8f780a-7f66-4fc7-9924-891c82b8972f for instance 374901ee-a9de-43dc-94a5-5752fb696b5e on nch2-master-1 May 28 21:36:00.830765 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-f07aee79-de52-4acd-a86f-3debf3d0e53c req-326b8842-b8f9-4a00-af7d-a505fa42cfbf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030655 May 28 21:36:00.831347 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2917/5882] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:36:00.999352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ff65bafb-f9d6-4cfd-9286-b54f71627df4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:00.999916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ff65bafb-f9d6-4cfd-9286-b54f71627df4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:01.006882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff65bafb-f9d6-4cfd-9286-b54f71627df4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:01.007348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff65bafb-f9d6-4cfd-9286-b54f71627df4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:01.008127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff65bafb-f9d6-4cfd-9286-b54f71627df4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:01.008577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff65bafb-f9d6-4cfd-9286-b54f71627df4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:01.072142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ff65bafb-f9d6-4cfd-9286-b54f71627df4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8372df2880a483e8f1b2b1b667ddf04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28f8fcc4afe8471c94db58bef7526459', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:01.080025 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ff65bafb-f9d6-4cfd-9286-b54f71627df4 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 200 len: 1299 microversion: 2.1 time: 0.084669 May 28 21:36:01.080609 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2966/5883] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:00 2022] GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:02.097343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6001b4c6-2517-4a5d-b061-57aeb7607e55 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:02.098159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6001b4c6-2517-4a5d-b061-57aeb7607e55 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] [instance: 374901ee-a9de-43dc-94a5-5752fb696b5e] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:02.105610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6001b4c6-2517-4a5d-b061-57aeb7607e55 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:02.106095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6001b4c6-2517-4a5d-b061-57aeb7607e55 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:02.106858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6001b4c6-2517-4a5d-b061-57aeb7607e55 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:02.107298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6001b4c6-2517-4a5d-b061-57aeb7607e55 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:02.123533 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-6001b4c6-2517-4a5d-b061-57aeb7607e55 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] HTTP exception thrown: Instance 374901ee-a9de-43dc-94a5-5752fb696b5e could not be found. May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6001b4c6-2517-4a5d-b061-57aeb7607e55 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Request method failure captured: May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e HTTP/1.1 May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpWqRo0dzFhxDeiw8xT-XqapcsEQNalh_tNBDo7-xi3dWyGF-fmKE3Kycn2geuU3rNMgpSG8Uaq2_BtYVRaRwLA5RoMNzbBitEhR2YEbh1Z5PdbylftkZPNJeb7WXL-iG95u-AjbtP1hqFXJb8BDUew27u0nD3S2CpYELAdKsZRPKBI May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 28f8fcc4afe8471c94db58bef7526459 May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-VolumesActionsTest-1083035635 May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_28f8fcc4afe8471c94db58bef7526459", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/28f8fcc4afe8471c94db58bef7526459"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/28f8fcc4afe8471c94db58bef7526459"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/28f8fcc4afe8471c94db58bef7526459"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-VolumesActionsTest-1083035635 May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 28f8fcc4afe8471c94db58bef7526459 May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-VolumesActionsTest-1083035635 May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-VolumesActionsTest-1083035635-project May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: b8372df2880a483e8f1b2b1b667ddf04 May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-VolumesActionsTest-1083035635-project May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 374901ee-a9de-43dc-94a5-5752fb696b5e could not be found. May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '374901ee-a9de-43dc-94a5-5752fb696b5e'} May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 374901ee-a9de-43dc-94a5-5752fb696b5e could not be found. May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 374901ee-a9de-43dc-94a5-5752fb696b5e could not be found. May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:36:02.125186 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:02.131011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:02.131011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:36:02.131011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:36:02.131011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:36:02.131011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:36:02.131011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 374901ee-a9de-43dc-94a5-5752fb696b5e could not be found. May 28 21:36:02.131011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:02.131011 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6001b4c6-2517-4a5d-b061-57aeb7607e55 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] Returning 404 to user: Instance 374901ee-a9de-43dc-94a5-5752fb696b5e could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:36:02.131011 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6001b4c6-2517-4a5d-b061-57aeb7607e55 tempest-VolumesActionsTest-1083035635 tempest-VolumesActionsTest-1083035635-project] 10.222.0.33 "GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e" status: 404 len: 111 microversion: 2.1 time: 0.033566 May 28 21:36:02.131011 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2918/5884] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:02 2022] GET /compute/v2.1/servers/374901ee-a9de-43dc-94a5-5752fb696b5e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:36:07.088604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-67c7f766-3dd7-47e7-beca-df06d4ba0864 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:07.089151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-67c7f766-3dd7-47e7-beca-df06d4ba0864 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:07.096712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67c7f766-3dd7-47e7-beca-df06d4ba0864 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:07.097170 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67c7f766-3dd7-47e7-beca-df06d4ba0864 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:07.097960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67c7f766-3dd7-47e7-beca-df06d4ba0864 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:07.098403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67c7f766-3dd7-47e7-beca-df06d4ba0864 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:07.125029 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-67c7f766-3dd7-47e7-beca-df06d4ba0864 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549/ips" status: 200 len: 148 microversion: 2.1 time: 0.040383 May 28 21:36:07.125652 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2967/5885] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 21:36:07 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:36:07.137266 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0a263ab1-b9df-4cc7-84ca-93e7a1eb394b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ae207c8-8c87-4201-942c-781ab5b960e5"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:36:07.138390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0a263ab1-b9df-4cc7-84ca-93e7a1eb394b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:07.145759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a263ab1-b9df-4cc7-84ca-93e7a1eb394b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:07.146254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a263ab1-b9df-4cc7-84ca-93e7a1eb394b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:07.147033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a263ab1-b9df-4cc7-84ca-93e7a1eb394b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:07.147480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a263ab1-b9df-4cc7-84ca-93e7a1eb394b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:07.227629 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-0a263ab1-b9df-4cc7-84ca-93e7a1eb394b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] HTTP exception thrown: Invalid volume: volume 9ae207c8-8c87-4201-942c-781ab5b960e5 is already attached to instances: 496c4c91-33f1-4301-ba55-0e99f84223da May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0a263ab1-b9df-4cc7-84ca-93e7a1eb394b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Request method failure captured: May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549/os-volume_attachments HTTP/1.1 May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 74 May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpVRO-mAxq6p3GCM6f9DBOuC6gM1jLrQkTcIGTva2AkLnRSMUBqa-v9eVXfkm2PMd8NeLYhF-4I6HJDUZ-KSNTa0czoN9va3UpuGRFgQJU4y4HLnhbLb00NIsPyXWHr82FwRNk4pOcjox7d1rlRD_kjkv5QsGlOaJ5XjMoC8y-HfNC4 May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: f9c9caba58394e1480acb632405111c5 May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f9c9caba58394e1480acb632405111c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f9c9caba58394e1480acb632405111c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AttachVolumeNegativeTest-679324601 May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: f9c9caba58394e1480acb632405111c5 May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: b16d0e791edd4f119e646e7ced74bf74 May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: {"volumeAttachment": {"volumeId": "9ae207c8-8c87-4201-942c-781ab5b960e5"}} May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid volume: volume 9ae207c8-8c87-4201-942c-781ab5b960e5 is already attached to instances: 496c4c91-33f1-4301-ba55-0e99f84223da May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'server_id': 'b2bfb879-a670-4828-a3f1-d46c30d49549', 'body': {'volumeAttachment': {'volumeId': '9ae207c8-8c87-4201-942c-781ab5b960e5'}}} May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9ae207c8-8c87-4201-942c-781ab5b960e5 is already attached to instances: 496c4c91-33f1-4301-ba55-0e99f84223da May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:36:07.229984 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9ae207c8-8c87-4201-942c-781ab5b960e5 is already attached to instances: 496c4c91-33f1-4301-ba55-0e99f84223da May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9ae207c8-8c87-4201-942c-781ab5b960e5 is already attached to instances: 496c4c91-33f1-4301-ba55-0e99f84223da May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0a263ab1-b9df-4cc7-84ca-93e7a1eb394b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Returning 400 to user: Invalid volume: volume 9ae207c8-8c87-4201-942c-781ab5b960e5 is already attached to instances: 496c4c91-33f1-4301-ba55-0e99f84223da {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0a263ab1-b9df-4cc7-84ca-93e7a1eb394b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "POST /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099428 May 28 21:36:07.235072 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2919/5886] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:36:07 2022] POST /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:36:07.240322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-69c8ddb7-e706-41e0-b237-38ac0b0d4c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:07.240938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-69c8ddb7-e706-41e0-b237-38ac0b0d4c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:07.251632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69c8ddb7-e706-41e0-b237-38ac0b0d4c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:07.251632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69c8ddb7-e706-41e0-b237-38ac0b0d4c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:07.251632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69c8ddb7-e706-41e0-b237-38ac0b0d4c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:07.251632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69c8ddb7-e706-41e0-b237-38ac0b0d4c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:07.541905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-69c8ddb7-e706-41e0-b237-38ac0b0d4c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:36:07.889610 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-69c8ddb7-e706-41e0-b237-38ac0b0d4c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 204 len: 0 microversion: 2.1 time: 0.652787 May 28 21:36:07.932824 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2968/5887] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:36:07 2022] DELETE /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:36:07.932987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1284d04c-74c6-422b-a260-c4e009531c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:07.932987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1284d04c-74c6-422b-a260-c4e009531c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:07.932987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:36:07.932987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1284d04c-74c6-422b-a260-c4e009531c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:07.932987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1284d04c-74c6-422b-a260-c4e009531c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:07.932987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1284d04c-74c6-422b-a260-c4e009531c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:07.932987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1284d04c-74c6-422b-a260-c4e009531c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:08.042578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1284d04c-74c6-422b-a260-c4e009531c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:08.050182 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1284d04c-74c6-422b-a260-c4e009531c95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 200 len: 1677 microversion: 2.1 time: 0.155407 May 28 21:36:08.050766 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2920/5888] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:07 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:09.068485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-098d1a9b-4013-4cc8-b92a-455d5dffa156 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:09.073780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-098d1a9b-4013-4cc8-b92a-455d5dffa156 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:09.076947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-098d1a9b-4013-4cc8-b92a-455d5dffa156 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:09.077406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-098d1a9b-4013-4cc8-b92a-455d5dffa156 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:09.078208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-098d1a9b-4013-4cc8-b92a-455d5dffa156 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:09.078659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-098d1a9b-4013-4cc8-b92a-455d5dffa156 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:09.094599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:36:09.211262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-098d1a9b-4013-4cc8-b92a-455d5dffa156 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:09.219613 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-098d1a9b-4013-4cc8-b92a-455d5dffa156 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 200 len: 1677 microversion: 2.1 time: 0.155492 May 28 21:36:09.220185 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2969/5889] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:09 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:10.241632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0cc85926-6d19-4d93-a14d-bc41abd42852 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:10.241632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0cc85926-6d19-4d93-a14d-bc41abd42852 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:10.245157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0cc85926-6d19-4d93-a14d-bc41abd42852 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:10.245645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0cc85926-6d19-4d93-a14d-bc41abd42852 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:10.246602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0cc85926-6d19-4d93-a14d-bc41abd42852 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:10.247397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0cc85926-6d19-4d93-a14d-bc41abd42852 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:10.311156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0cc85926-6d19-4d93-a14d-bc41abd42852 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:10.319045 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0cc85926-6d19-4d93-a14d-bc41abd42852 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 200 len: 1610 microversion: 2.1 time: 0.086153 May 28 21:36:10.319637 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2921/5890] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:10 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 1610 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:10.457718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-3590f4b8-46eb-444b-b358-695208bcb81e req-dd7d0185-8178-45fd-9569-1704a474389a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2bfb879-a670-4828-a3f1-d46c30d49549", "name": "network-vif-deleted", "tag": "01a4688a-0915-4b20-ad10-2f933662cdf2"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:36:10.462032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:36:10.469045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3590f4b8-46eb-444b-b358-695208bcb81e req-dd7d0185-8178-45fd-9569-1704a474389a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:10.469563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3590f4b8-46eb-444b-b358-695208bcb81e req-dd7d0185-8178-45fd-9569-1704a474389a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:10.481034 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-3590f4b8-46eb-444b-b358-695208bcb81e req-dd7d0185-8178-45fd-9569-1704a474389a service nova] Creating event network-vif-deleted:01a4688a-0915-4b20-ad10-2f933662cdf2 for instance b2bfb879-a670-4828-a3f1-d46c30d49549 on nch2-master-1 May 28 21:36:10.485984 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-3590f4b8-46eb-444b-b358-695208bcb81e req-dd7d0185-8178-45fd-9569-1704a474389a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032385 May 28 21:36:10.486562 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2970/5891] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:36:11.337510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2a0f0fa4-4c4f-436e-ac0f-f2c60be04e28 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:11.342642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2a0f0fa4-4c4f-436e-ac0f-f2c60be04e28 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:11.346113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a0f0fa4-4c4f-436e-ac0f-f2c60be04e28 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:11.346578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a0f0fa4-4c4f-436e-ac0f-f2c60be04e28 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:11.347391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a0f0fa4-4c4f-436e-ac0f-f2c60be04e28 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:11.347843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a0f0fa4-4c4f-436e-ac0f-f2c60be04e28 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:11.381708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a0f0fa4-4c4f-436e-ac0f-f2c60be04e28 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:11.382271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a0f0fa4-4c4f-436e-ac0f-f2c60be04e28 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:11.382740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-2a0f0fa4-4c4f-436e-ac0f-f2c60be04e28 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lazy-loading 'fault' on Instance uuid b2bfb879-a670-4828-a3f1-d46c30d49549 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:36:11.436939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2a0f0fa4-4c4f-436e-ac0f-f2c60be04e28 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:11.444227 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2a0f0fa4-4c4f-436e-ac0f-f2c60be04e28 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 200 len: 1329 microversion: 2.1 time: 0.110970 May 28 21:36:11.445277 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2922/5892] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:11 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 1329 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:12.466871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b29fe201-b3a2-4479-a8f0-7501abdfe57e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:12.467585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b29fe201-b3a2-4479-a8f0-7501abdfe57e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:12.475218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b29fe201-b3a2-4479-a8f0-7501abdfe57e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:12.475218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b29fe201-b3a2-4479-a8f0-7501abdfe57e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:12.476006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b29fe201-b3a2-4479-a8f0-7501abdfe57e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:12.476456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b29fe201-b3a2-4479-a8f0-7501abdfe57e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:12.490601 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-b29fe201-b3a2-4479-a8f0-7501abdfe57e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] HTTP exception thrown: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b29fe201-b3a2-4479-a8f0-7501abdfe57e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Request method failure captured: May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 HTTP/1.1 May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpVRO-mAxq6p3GCM6f9DBOuC6gM1jLrQkTcIGTva2AkLnRSMUBqa-v9eVXfkm2PMd8NeLYhF-4I6HJDUZ-KSNTa0czoN9va3UpuGRFgQJU4y4HLnhbLb00NIsPyXWHr82FwRNk4pOcjox7d1rlRD_kjkv5QsGlOaJ5XjMoC8y-HfNC4 May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f9c9caba58394e1480acb632405111c5 May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f9c9caba58394e1480acb632405111c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f9c9caba58394e1480acb632405111c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AttachVolumeNegativeTest-679324601 May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f9c9caba58394e1480acb632405111c5 May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: b16d0e791edd4f119e646e7ced74bf74 May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'b2bfb879-a670-4828-a3f1-d46c30d49549'} May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:36:12.492266 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:36:12.507374 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:12.507374 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:36:12.507374 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:36:12.507374 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:36:12.507374 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:36:12.507374 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. May 28 21:36:12.507374 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:36:12.507374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b29fe201-b3a2-4479-a8f0-7501abdfe57e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Returning 404 to user: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:36:12.507374 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b29fe201-b3a2-4479-a8f0-7501abdfe57e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 404 len: 111 microversion: 2.1 time: 0.033163 May 28 21:36:12.507374 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2971/5893] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:12 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:36:12.511041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1e2d8770-59e6-4cab-a3be-b45f18fc379b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '.version_select at 0x7f4d56b7fee0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:12.626471 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1e2d8770-59e6-4cab-a3be-b45f18fc379b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1066318971" status: 202 len: 0 microversion: 2.1 time: 0.119273 May 28 21:36:12.627071 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2923/5894] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 21:36:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1066318971 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:36:13.434441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b1db5f50-dee7-439c-a15e-8e9ff123720f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:13.434950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b1db5f50-dee7-439c-a15e-8e9ff123720f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:13.441149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1db5f50-dee7-439c-a15e-8e9ff123720f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:13.441608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1db5f50-dee7-439c-a15e-8e9ff123720f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:13.442418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1db5f50-dee7-439c-a15e-8e9ff123720f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:13.442865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1db5f50-dee7-439c-a15e-8e9ff123720f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:13.525954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-b1db5f50-dee7-439c-a15e-8e9ff123720f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lazy-loading 'services' on Instance uuid 496c4c91-33f1-4301-ba55-0e99f84223da {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:36:13.773430 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b1db5f50-dee7-439c-a15e-8e9ff123720f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "DELETE /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da/os-volume_attachments/9ae207c8-8c87-4201-942c-781ab5b960e5" status: 202 len: 0 microversion: 2.1 time: 0.343195 May 28 21:36:13.774105 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2972/5895] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:36:13 2022] DELETE /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da/os-volume_attachments/9ae207c8-8c87-4201-942c-781ab5b960e5 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:36:13.782456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1976b9bc-b94a-469d-a05a-1f1ff7e3c948 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:13.783489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1976b9bc-b94a-469d-a05a-1f1ff7e3c948 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:13.791149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1976b9bc-b94a-469d-a05a-1f1ff7e3c948 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:13.791615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1976b9bc-b94a-469d-a05a-1f1ff7e3c948 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:13.792401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1976b9bc-b94a-469d-a05a-1f1ff7e3c948 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:13.792900 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1976b9bc-b94a-469d-a05a-1f1ff7e3c948 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:13.823272 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1976b9bc-b94a-469d-a05a-1f1ff7e3c948 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 May 28 21:36:13.823838 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2924/5896] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:36:13 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:36:14.838962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f2af5f30-ab7f-44c1-8590-9593f1ed6c65 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:14.838962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f2af5f30-ab7f-44c1-8590-9593f1ed6c65 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:14.843981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2af5f30-ab7f-44c1-8590-9593f1ed6c65 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:14.844447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2af5f30-ab7f-44c1-8590-9593f1ed6c65 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:14.845222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2af5f30-ab7f-44c1-8590-9593f1ed6c65 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:14.845670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2af5f30-ab7f-44c1-8590-9593f1ed6c65 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:14.876052 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f2af5f30-ab7f-44c1-8590-9593f1ed6c65 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045011 May 28 21:36:14.876608 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2973/5897] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:36:14 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:36:15.888335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a29cad12-eaae-4ff6-8a27-8d8ccf8eeaa8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:15.889190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a29cad12-eaae-4ff6-8a27-8d8ccf8eeaa8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:15.896253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a29cad12-eaae-4ff6-8a27-8d8ccf8eeaa8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:15.896715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a29cad12-eaae-4ff6-8a27-8d8ccf8eeaa8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:15.897485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a29cad12-eaae-4ff6-8a27-8d8ccf8eeaa8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:15.897959 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a29cad12-eaae-4ff6-8a27-8d8ccf8eeaa8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:15.926602 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a29cad12-eaae-4ff6-8a27-8d8ccf8eeaa8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043007 May 28 21:36:15.927635 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2925/5898] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:36:15 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:36:15.987366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-04ccbbca-a4f5-4786-ab67-b466315c323e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:15.987896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-04ccbbca-a4f5-4786-ab67-b466315c323e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:15.994837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04ccbbca-a4f5-4786-ab67-b466315c323e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:15.995301 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04ccbbca-a4f5-4786-ab67-b466315c323e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:15.996629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04ccbbca-a4f5-4786-ab67-b466315c323e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:15.997082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04ccbbca-a4f5-4786-ab67-b466315c323e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:16.026090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-04ccbbca-a4f5-4786-ab67-b466315c323e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:36:16.363958 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-04ccbbca-a4f5-4786-ab67-b466315c323e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "DELETE /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 204 len: 0 microversion: 2.1 time: 0.380273 May 28 21:36:16.364554 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2974/5899] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:36:15 2022] DELETE /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:36:16.373625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-53ed8575-2ff8-4f65-93b2-6be31944ce6b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:16.374286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-53ed8575-2ff8-4f65-93b2-6be31944ce6b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:16.380597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53ed8575-2ff8-4f65-93b2-6be31944ce6b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:16.381057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53ed8575-2ff8-4f65-93b2-6be31944ce6b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:16.381875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53ed8575-2ff8-4f65-93b2-6be31944ce6b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:16.382329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-53ed8575-2ff8-4f65-93b2-6be31944ce6b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:16.385199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=76 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:36:16.519836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-53ed8575-2ff8-4f65-93b2-6be31944ce6b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:16.528157 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-53ed8575-2ff8-4f65-93b2-6be31944ce6b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1680 microversion: 2.1 time: 0.158685 May 28 21:36:16.528734 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2926/5900] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:16 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:17.546952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f03cf697-64c6-4ad9-8956-12ecd1896b5d tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:17.547686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f03cf697-64c6-4ad9-8956-12ecd1896b5d tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:17.555222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f03cf697-64c6-4ad9-8956-12ecd1896b5d tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:17.555606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f03cf697-64c6-4ad9-8956-12ecd1896b5d tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:17.556363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f03cf697-64c6-4ad9-8956-12ecd1896b5d tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:17.556808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f03cf697-64c6-4ad9-8956-12ecd1896b5d tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:17.699756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f03cf697-64c6-4ad9-8956-12ecd1896b5d tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:17.711515 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f03cf697-64c6-4ad9-8956-12ecd1896b5d tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1680 microversion: 2.1 time: 0.169461 May 28 21:36:17.718000 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2975/5901] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:17 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:18.733953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e0158e13-0c1e-495c-9984-7b772c3316d4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:18.734582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e0158e13-0c1e-495c-9984-7b772c3316d4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:18.743937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0158e13-0c1e-495c-9984-7b772c3316d4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:18.746895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0158e13-0c1e-495c-9984-7b772c3316d4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:18.747873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0158e13-0c1e-495c-9984-7b772c3316d4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:18.748985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0158e13-0c1e-495c-9984-7b772c3316d4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:18.838986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e0158e13-0c1e-495c-9984-7b772c3316d4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:18.848651 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e0158e13-0c1e-495c-9984-7b772c3316d4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1612 microversion: 2.1 time: 0.119255 May 28 21:36:18.849350 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2927/5902] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:18 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1612 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:18.920109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-24b3700f-56f2-44d6-9bdc-9f1cac6088bd req-2fec19b9-d54f-45a8-9071-b635e2c61e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "496c4c91-33f1-4301-ba55-0e99f84223da", "name": "network-vif-deleted", "tag": "d9d0f754-692c-4fa8-809f-632b9373cf5c"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:36:18.935105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-24b3700f-56f2-44d6-9bdc-9f1cac6088bd req-2fec19b9-d54f-45a8-9071-b635e2c61e33 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:18.935840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-24b3700f-56f2-44d6-9bdc-9f1cac6088bd req-2fec19b9-d54f-45a8-9071-b635e2c61e33 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:18.947484 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-24b3700f-56f2-44d6-9bdc-9f1cac6088bd req-2fec19b9-d54f-45a8-9071-b635e2c61e33 service nova] Creating event network-vif-deleted:d9d0f754-692c-4fa8-809f-632b9373cf5c for instance 496c4c91-33f1-4301-ba55-0e99f84223da on nch1-master-1 May 28 21:36:18.953911 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-24b3700f-56f2-44d6-9bdc-9f1cac6088bd req-2fec19b9-d54f-45a8-9071-b635e2c61e33 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037911 May 28 21:36:18.954825 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2976/5903] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:36:19.108249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ab6b41f-c0ce-46c7-90b9-533051f6e877 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:19.108674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8ab6b41f-c0ce-46c7-90b9-533051f6e877 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:19.116098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ab6b41f-c0ce-46c7-90b9-533051f6e877 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:19.125397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ab6b41f-c0ce-46c7-90b9-533051f6e877 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:19.125397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ab6b41f-c0ce-46c7-90b9-533051f6e877 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:19.125397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ab6b41f-c0ce-46c7-90b9-533051f6e877 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:19.147268 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8ab6b41f-c0ce-46c7-90b9-533051f6e877 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.044063 May 28 21:36:19.148241 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2928/5904] 10.222.0.33 () {58 vars in 1292 bytes} [Sat May 28 21:36:19 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30/os-server-password => generated 116 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:36:19.867629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5a5b4f4c-3ed4-445c-adf6-27fc116411f7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:19.868437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5a5b4f4c-3ed4-445c-adf6-27fc116411f7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:19.876373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a5b4f4c-3ed4-445c-adf6-27fc116411f7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:19.877099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a5b4f4c-3ed4-445c-adf6-27fc116411f7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:19.877909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a5b4f4c-3ed4-445c-adf6-27fc116411f7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:19.878405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a5b4f4c-3ed4-445c-adf6-27fc116411f7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:19.914762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a5b4f4c-3ed4-445c-adf6-27fc116411f7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:19.915225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a5b4f4c-3ed4-445c-adf6-27fc116411f7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:19.915692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-5a5b4f4c-3ed4-445c-adf6-27fc116411f7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lazy-loading 'fault' on Instance uuid 496c4c91-33f1-4301-ba55-0e99f84223da {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:36:19.958762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5a5b4f4c-3ed4-445c-adf6-27fc116411f7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:19.967471 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5a5b4f4c-3ed4-445c-adf6-27fc116411f7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 200 len: 1330 microversion: 2.1 time: 0.104465 May 28 21:36:19.968102 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2977/5905] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:19 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:20.985126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a5cbe31b-f2f4-4b66-921a-1730bf7ea801 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:20.985857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a5cbe31b-f2f4-4b66-921a-1730bf7ea801 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:20.993011 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5cbe31b-f2f4-4b66-921a-1730bf7ea801 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:20.994093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5cbe31b-f2f4-4b66-921a-1730bf7ea801 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:20.994399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5cbe31b-f2f4-4b66-921a-1730bf7ea801 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:20.994853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5cbe31b-f2f4-4b66-921a-1730bf7ea801 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:21.008947 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-a5cbe31b-f2f4-4b66-921a-1730bf7ea801 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] HTTP exception thrown: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a5cbe31b-f2f4-4b66-921a-1730bf7ea801 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Request method failure captured: May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da HTTP/1.1 May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpVRO-mAxq6p3GCM6f9DBOuC6gM1jLrQkTcIGTva2AkLnRSMUBqa-v9eVXfkm2PMd8NeLYhF-4I6HJDUZ-KSNTa0czoN9va3UpuGRFgQJU4y4HLnhbLb00NIsPyXWHr82FwRNk4pOcjox7d1rlRD_kjkv5QsGlOaJ5XjMoC8y-HfNC4 May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: f9c9caba58394e1480acb632405111c5 May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f9c9caba58394e1480acb632405111c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f9c9caba58394e1480acb632405111c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AttachVolumeNegativeTest-679324601 May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: f9c9caba58394e1480acb632405111c5 May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: b16d0e791edd4f119e646e7ced74bf74 May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '496c4c91-33f1-4301-ba55-0e99f84223da'} May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:36:21.010564 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:21.020005 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:21.020005 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:36:21.020005 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:36:21.020005 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:36:21.020005 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:36:21.020005 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. May 28 21:36:21.020005 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:21.020005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a5cbe31b-f2f4-4b66-921a-1730bf7ea801 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Returning 404 to user: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:36:21.020005 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a5cbe31b-f2f4-4b66-921a-1730bf7ea801 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 404 len: 111 microversion: 2.1 time: 0.031316 May 28 21:36:21.020005 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2929/5906] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:20 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:36:21.021167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c74c447a-54c0-4465-8aba-1b96b3a3a948 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '.version_select at 0x7f4d572c4c10>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:21.124836 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c74c447a-54c0-4465-8aba-1b96b3a3a948 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-316541066" status: 202 len: 0 microversion: 2.1 time: 0.107572 May 28 21:36:21.125422 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2978/5907] 10.222.0.33 () {58 vars in 1217 bytes} [Sat May 28 21:36:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-316541066 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:36:21.935623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9d1c2f4c-0ffd-499e-af6c-039b7641cd5b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Action: 'create', calling method: .version_select at 0x7f4d56bc15e0>, body: {"keypair": {"name": "tempest-keypair-916673926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHu7A5qZ8h7LtNYP2wRCDWu4B/gtlYHOttLywpHtQSaBHZXpksEdU+6kbQAG1HMJ7KASURRZ9T/cAv8PcJ80vjVvruxxz9z6ANR4JJGQKk3t9pa634h8IbBjoaURuZuzQ=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:36:21.950059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-9d1c2f4c-0ffd-499e-af6c-039b7641cd5b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for project f9c9caba58394e1480acb632405111c5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:36:21.955205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-9d1c2f4c-0ffd-499e-af6c-039b7641cd5b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for user b16d0e791edd4f119e646e7ced74bf74 and project f9c9caba58394e1480acb632405111c5. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:36:22.085609 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9d1c2f4c-0ffd-499e-af6c-039b7641cd5b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.153833 May 28 21:36:22.086339 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2930/5908] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:36:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:36:23.557444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0ecce648-3798-4c5f-9d35-6c463a370ccf tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:23.558503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0ecce648-3798-4c5f-9d35-6c463a370ccf tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:23.562287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-ab9d8be0-c894-40f1-b443-b1cd7b0d719d req-da59b61d-6cfc-4a10-99a1-a6b24478fb0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d962501-978a-43fc-bc68-2bf2ac890247", "tag": "73a64a63-4871-4fa5-8209-ef8eae8d5d74"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:36:23.571639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ecce648-3798-4c5f-9d35-6c463a370ccf tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:23.575416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ab9d8be0-c894-40f1-b443-b1cd7b0d719d req-da59b61d-6cfc-4a10-99a1-a6b24478fb0e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:23.575416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ab9d8be0-c894-40f1-b443-b1cd7b0d719d req-da59b61d-6cfc-4a10-99a1-a6b24478fb0e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:23.576271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ecce648-3798-4c5f-9d35-6c463a370ccf tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:23.577262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ecce648-3798-4c5f-9d35-6c463a370ccf tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:23.577885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ecce648-3798-4c5f-9d35-6c463a370ccf tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:23.583568 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-ab9d8be0-c894-40f1-b443-b1cd7b0d719d req-da59b61d-6cfc-4a10-99a1-a6b24478fb0e service nova] Creating event network-changed:73a64a63-4871-4fa5-8209-ef8eae8d5d74 for instance 0d962501-978a-43fc-bc68-2bf2ac890247 on nch1-master-1 May 28 21:36:23.588870 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-ab9d8be0-c894-40f1-b443-b1cd7b0d719d req-da59b61d-6cfc-4a10-99a1-a6b24478fb0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030169 May 28 21:36:23.589481 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2931/5909] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:36:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:36:23.619846 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0ecce648-3798-4c5f-9d35-6c463a370ccf tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:36:24.197791 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0ecce648-3798-4c5f-9d35-6c463a370ccf tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 204 len: 0 microversion: 2.1 time: 0.643749 May 28 21:36:24.199631 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2979/5910] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:36:23 2022] DELETE /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:36:24.209815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-18e8864d-efac-4543-98db-b0a2bfa58e50 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:24.210751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-18e8864d-efac-4543-98db-b0a2bfa58e50 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:24.217498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18e8864d-efac-4543-98db-b0a2bfa58e50 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:24.221556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18e8864d-efac-4543-98db-b0a2bfa58e50 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:24.221556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18e8864d-efac-4543-98db-b0a2bfa58e50 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:24.221556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18e8864d-efac-4543-98db-b0a2bfa58e50 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:24.399734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-18e8864d-efac-4543-98db-b0a2bfa58e50 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:24.407820 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-18e8864d-efac-4543-98db-b0a2bfa58e50 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1583 microversion: 2.1 time: 0.202887 May 28 21:36:24.408392 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2932/5911] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:24 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1583 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:24.909136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-82335525", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31de5272-0585-4c63-8300-cd5a798dd14e"}], "security_groups": [{"name": "tempest-securitygroup--1793032633"}], "key_name": "tempest-keypair-916673926", "user_data": "}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:36:25.016011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] validate_networks() for [('31de5272-0585-4c63-8300-cd5a798dd14e', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:36:25.428309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3ac1bf4f-45ad-405a-bb4e-7bb968a641b5 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:25.429451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3ac1bf4f-45ad-405a-bb4e-7bb968a641b5 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:25.437506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ac1bf4f-45ad-405a-bb4e-7bb968a641b5 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:25.438121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ac1bf4f-45ad-405a-bb4e-7bb968a641b5 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:25.438915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ac1bf4f-45ad-405a-bb4e-7bb968a641b5 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:25.439358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ac1bf4f-45ad-405a-bb4e-7bb968a641b5 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:25.612982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3ac1bf4f-45ad-405a-bb4e-7bb968a641b5 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:25.621891 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3ac1bf4f-45ad-405a-bb4e-7bb968a641b5 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1464 microversion: 2.1 time: 0.197301 May 28 21:36:25.632182 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2933/5912] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:25 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1464 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:36:25.990671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:36:25.991184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:36:25.991574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:36:25.991991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:36:25.992412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:36:26.002408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:26.002872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:26.003688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:26.004138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:26.025458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for project f9c9caba58394e1480acb632405111c5. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:36:26.030929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for user b16d0e791edd4f119e646e7ced74bf74 and project f9c9caba58394e1480acb632405111c5. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:36:26.044769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:36:26.047232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:36:26.188776 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9fefc25a-362e-4b45-b21e-77201685ec3f tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.284817 May 28 21:36:26.189451 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2980/5913] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:36:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:36:26.199598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-805cf17a-776e-4dab-ada4-2eda894eac23 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:26.200457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-805cf17a-776e-4dab-ada4-2eda894eac23 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:26.290529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-805cf17a-776e-4dab-ada4-2eda894eac23 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:26.302140 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-805cf17a-776e-4dab-ada4-2eda894eac23 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 200 len: 1239 microversion: 2.1 time: 0.106179 May 28 21:36:26.303323 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2934/5914] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:26 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 1239 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:26.352384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-b4c4603f-6328-460c-a188-a059ef24b65b req-6c0df947-1c73-42e2-a395-5b198ecaad54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d962501-978a-43fc-bc68-2bf2ac890247", "name": "network-vif-deleted", "tag": "73a64a63-4871-4fa5-8209-ef8eae8d5d74"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:36:26.363993 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b4c4603f-6328-460c-a188-a059ef24b65b req-6c0df947-1c73-42e2-a395-5b198ecaad54 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:26.366559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b4c4603f-6328-460c-a188-a059ef24b65b req-6c0df947-1c73-42e2-a395-5b198ecaad54 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:26.377353 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b4c4603f-6328-460c-a188-a059ef24b65b req-6c0df947-1c73-42e2-a395-5b198ecaad54 service nova] Creating event network-vif-deleted:73a64a63-4871-4fa5-8209-ef8eae8d5d74 for instance 0d962501-978a-43fc-bc68-2bf2ac890247 on nch1-master-1 May 28 21:36:26.382366 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-b4c4603f-6328-460c-a188-a059ef24b65b req-6c0df947-1c73-42e2-a395-5b198ecaad54 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034416 May 28 21:36:26.382974 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2981/5915] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:36:26.640613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-59e17dff-7f8f-4732-8987-da55a85d7368 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:26.641312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-59e17dff-7f8f-4732-8987-da55a85d7368 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:26.649676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59e17dff-7f8f-4732-8987-da55a85d7368 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:26.650156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59e17dff-7f8f-4732-8987-da55a85d7368 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:26.651003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59e17dff-7f8f-4732-8987-da55a85d7368 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:26.651539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59e17dff-7f8f-4732-8987-da55a85d7368 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:26.715504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-59e17dff-7f8f-4732-8987-da55a85d7368 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c93401a279c9403ca62627e829082968', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5241f87816134389b836a8eae1d53bd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:26.723991 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-59e17dff-7f8f-4732-8987-da55a85d7368 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 200 len: 1228 microversion: 2.1 time: 0.088273 May 28 21:36:26.724567 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2935/5916] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:26 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 1228 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:27.320972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e0ee71ee-2700-41b4-b9c6-af650e888dd8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:27.321630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e0ee71ee-2700-41b4-b9c6-af650e888dd8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:27.328642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0ee71ee-2700-41b4-b9c6-af650e888dd8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:27.329096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0ee71ee-2700-41b4-b9c6-af650e888dd8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:27.329884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0ee71ee-2700-41b4-b9c6-af650e888dd8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:27.330330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0ee71ee-2700-41b4-b9c6-af650e888dd8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:27.404530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e0ee71ee-2700-41b4-b9c6-af650e888dd8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:27.412166 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e0ee71ee-2700-41b4-b9c6-af650e888dd8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 200 len: 1243 microversion: 2.1 time: 0.096461 May 28 21:36:27.413251 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2982/5917] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:27 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 1243 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:27.741519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6b67204a-bb02-4f4f-a421-e90d993d9e1d tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:27.742426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6b67204a-bb02-4f4f-a421-e90d993d9e1d tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] [instance: 0d962501-978a-43fc-bc68-2bf2ac890247] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:27.749730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b67204a-bb02-4f4f-a421-e90d993d9e1d tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:27.750268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b67204a-bb02-4f4f-a421-e90d993d9e1d tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:27.751055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b67204a-bb02-4f4f-a421-e90d993d9e1d tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:27.751499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6b67204a-bb02-4f4f-a421-e90d993d9e1d tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:27.765743 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-6b67204a-bb02-4f4f-a421-e90d993d9e1d tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] HTTP exception thrown: Instance 0d962501-978a-43fc-bc68-2bf2ac890247 could not be found. May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6b67204a-bb02-4f4f-a421-e90d993d9e1d tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Request method failure captured: May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 HTTP/1.1 May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpSdEDmgcYwK08r-fbPmo9M6xQLOA2N-IRKJfyD4_JVtXaPmrVqeQb_-OxTT_nugvcAca5bY4QzMxCtQAys-GUzFriALskzZtMUiGnRrcvYqR-OmUjxDmqO9ooHXdEgumk7bQo7ogfXmyCmqlxQulc8G-2cHhokxWw1cmdb5AXQnfVI May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5241f87816134389b836a8eae1d53bd3 May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestVolumeBackupRestore-1923413318 May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5241f87816134389b836a8eae1d53bd3", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5241f87816134389b836a8eae1d53bd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5241f87816134389b836a8eae1d53bd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5241f87816134389b836a8eae1d53bd3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestVolumeBackupRestore-1923413318 May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5241f87816134389b836a8eae1d53bd3 May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1923413318 May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestVolumeBackupRestore-1923413318-project May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: c93401a279c9403ca62627e829082968 May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestVolumeBackupRestore-1923413318-project May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 0d962501-978a-43fc-bc68-2bf2ac890247 could not be found. May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '0d962501-978a-43fc-bc68-2bf2ac890247'} May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d962501-978a-43fc-bc68-2bf2ac890247 could not be found. May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d962501-978a-43fc-bc68-2bf2ac890247 could not be found. May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:36:27.767510 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:27.772329 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:27.772329 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:36:27.772329 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:36:27.772329 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:36:27.772329 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:36:27.772329 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d962501-978a-43fc-bc68-2bf2ac890247 could not be found. May 28 21:36:27.772329 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:36:27.772329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6b67204a-bb02-4f4f-a421-e90d993d9e1d tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Returning 404 to user: Instance 0d962501-978a-43fc-bc68-2bf2ac890247 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:36:27.772329 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6b67204a-bb02-4f4f-a421-e90d993d9e1d tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247" status: 404 len: 111 microversion: 2.1 time: 0.032263 May 28 21:36:27.772992 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2936/5918] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:27 2022] GET /compute/v2.1/servers/0d962501-978a-43fc-bc68-2bf2ac890247 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:36:28.030254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9d22a1aa-cf81-4663-a357-19e8ae1091b5 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] Calling method '.version_select at 0x7f4d56c869d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:28.119299 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9d22a1aa-cf81-4663-a357-19e8ae1091b5 tempest-TestVolumeBackupRestore-1923413318 tempest-TestVolumeBackupRestore-1923413318-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-128443152" status: 202 len: 0 microversion: 2.1 time: 0.093659 May 28 21:36:28.119894 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2983/5919] 10.222.0.33 () {58 vars in 1265 bytes} [Sat May 28 21:36:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-128443152 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:36:28.430477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f0786814-b747-42ea-83b8-504a12f8c92a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:28.431106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f0786814-b747-42ea-83b8-504a12f8c92a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:28.439107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0786814-b747-42ea-83b8-504a12f8c92a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:28.439580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0786814-b747-42ea-83b8-504a12f8c92a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:28.440451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0786814-b747-42ea-83b8-504a12f8c92a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:28.440902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f0786814-b747-42ea-83b8-504a12f8c92a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:28.526799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f0786814-b747-42ea-83b8-504a12f8c92a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:28.534498 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f0786814-b747-42ea-83b8-504a12f8c92a tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 200 len: 1299 microversion: 2.1 time: 0.109118 May 28 21:36:28.535086 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2937/5920] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:28 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:29.554529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-41509037-b0a3-4d4e-9169-e56c9206d16e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:29.555154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-41509037-b0a3-4d4e-9169-e56c9206d16e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:29.562048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41509037-b0a3-4d4e-9169-e56c9206d16e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:29.562639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41509037-b0a3-4d4e-9169-e56c9206d16e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:29.563427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41509037-b0a3-4d4e-9169-e56c9206d16e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:29.563870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-41509037-b0a3-4d4e-9169-e56c9206d16e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:29.711828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-41509037-b0a3-4d4e-9169-e56c9206d16e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:29.720419 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-41509037-b0a3-4d4e-9169-e56c9206d16e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 200 len: 1365 microversion: 2.1 time: 0.170933 May 28 21:36:29.721093 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2984/5921] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:29 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:30.347605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-03cda770-ee45-4622-9f3f-eb83708c438c req-744f4550-7842-4bcf-8c73-7381b9a2514b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d3a945-5fc1-4084-82da-73e2bc0604d5", "tag": "c9b88b36-b24a-47e4-b9dd-cff768b8bfdc"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:36:30.359288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-03cda770-ee45-4622-9f3f-eb83708c438c req-744f4550-7842-4bcf-8c73-7381b9a2514b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:30.359805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-03cda770-ee45-4622-9f3f-eb83708c438c req-744f4550-7842-4bcf-8c73-7381b9a2514b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:30.373707 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-03cda770-ee45-4622-9f3f-eb83708c438c req-744f4550-7842-4bcf-8c73-7381b9a2514b service nova] Creating event network-changed:c9b88b36-b24a-47e4-b9dd-cff768b8bfdc for instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 on nch2-master-1 May 28 21:36:30.379071 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-03cda770-ee45-4622-9f3f-eb83708c438c req-744f4550-7842-4bcf-8c73-7381b9a2514b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035589 May 28 21:36:30.379790 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2938/5922] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:36:30.739262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fbf0b6f0-4173-43c1-bb81-5164e7ac5242 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:30.739898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fbf0b6f0-4173-43c1-bb81-5164e7ac5242 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:30.748096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fbf0b6f0-4173-43c1-bb81-5164e7ac5242 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:30.748559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fbf0b6f0-4173-43c1-bb81-5164e7ac5242 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:30.749370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fbf0b6f0-4173-43c1-bb81-5164e7ac5242 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:30.749803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fbf0b6f0-4173-43c1-bb81-5164e7ac5242 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:30.893108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fbf0b6f0-4173-43c1-bb81-5164e7ac5242 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:30.900948 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fbf0b6f0-4173-43c1-bb81-5164e7ac5242 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 200 len: 1365 microversion: 2.1 time: 0.165757 May 28 21:36:30.901530 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2985/5923] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:30 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:31.919650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-937b61ce-ed29-407a-804d-c7f2aea31f8b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:31.920398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-937b61ce-ed29-407a-804d-c7f2aea31f8b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:31.926784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-937b61ce-ed29-407a-804d-c7f2aea31f8b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:31.927238 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-937b61ce-ed29-407a-804d-c7f2aea31f8b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:31.928001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-937b61ce-ed29-407a-804d-c7f2aea31f8b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:31.928440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-937b61ce-ed29-407a-804d-c7f2aea31f8b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:32.065790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-937b61ce-ed29-407a-804d-c7f2aea31f8b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:32.075130 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-937b61ce-ed29-407a-804d-c7f2aea31f8b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 200 len: 1365 microversion: 2.1 time: 0.161385 May 28 21:36:32.075754 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2939/5924] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:31 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:33.092050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3f9d85dd-b795-42a7-856c-fe646db24661 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:33.092724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3f9d85dd-b795-42a7-856c-fe646db24661 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:33.099854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f9d85dd-b795-42a7-856c-fe646db24661 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:33.100315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f9d85dd-b795-42a7-856c-fe646db24661 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:33.101086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f9d85dd-b795-42a7-856c-fe646db24661 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:33.101533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f9d85dd-b795-42a7-856c-fe646db24661 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:33.230485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3f9d85dd-b795-42a7-856c-fe646db24661 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:33.238793 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3f9d85dd-b795-42a7-856c-fe646db24661 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 200 len: 1365 microversion: 2.1 time: 0.151579 May 28 21:36:33.239370 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2986/5925] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:33 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:34.255886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cd924756-9285-419f-8cef-8beaf31f75a0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:34.256499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cd924756-9285-419f-8cef-8beaf31f75a0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:34.263606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd924756-9285-419f-8cef-8beaf31f75a0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:34.264538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd924756-9285-419f-8cef-8beaf31f75a0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:34.265327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd924756-9285-419f-8cef-8beaf31f75a0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:34.265776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd924756-9285-419f-8cef-8beaf31f75a0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:34.401141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cd924756-9285-419f-8cef-8beaf31f75a0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:34.409102 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cd924756-9285-419f-8cef-8beaf31f75a0 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 200 len: 1365 microversion: 2.1 time: 0.157283 May 28 21:36:34.409683 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2940/5926] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:34 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:35.110039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-66c83d98-1794-444c-bc12-a09f10f59649 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:35.110039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-66c83d98-1794-444c-bc12-a09f10f59649 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:35.116585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66c83d98-1794-444c-bc12-a09f10f59649 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:35.117069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66c83d98-1794-444c-bc12-a09f10f59649 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:35.117854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66c83d98-1794-444c-bc12-a09f10f59649 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:35.118311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66c83d98-1794-444c-bc12-a09f10f59649 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:35.120894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:36:35.202308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-66c83d98-1794-444c-bc12-a09f10f59649 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lazy-loading 'services' on Instance uuid 5fd905ae-de46-41cb-8d04-722111b5ddf3 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:36:35.426176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a5d84a0c-ef51-4782-8ecd-208c7bd452d6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:35.426740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a5d84a0c-ef51-4782-8ecd-208c7bd452d6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:35.433632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5d84a0c-ef51-4782-8ecd-208c7bd452d6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:35.434130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5d84a0c-ef51-4782-8ecd-208c7bd452d6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:35.434939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5d84a0c-ef51-4782-8ecd-208c7bd452d6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:35.435369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5d84a0c-ef51-4782-8ecd-208c7bd452d6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:35.453706 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-66c83d98-1794-444c-bc12-a09f10f59649 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3/os-volume_attachments/a420983a-b71a-4ca0-935a-b83c5153223d" status: 202 len: 0 microversion: 2.1 time: 0.348580 May 28 21:36:35.454175 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2987/5927] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:36:35 2022] DELETE /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3/os-volume_attachments/a420983a-b71a-4ca0-935a-b83c5153223d => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:36:35.580372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a5d84a0c-ef51-4782-8ecd-208c7bd452d6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:35.588251 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a5d84a0c-ef51-4782-8ecd-208c7bd452d6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 200 len: 1365 microversion: 2.1 time: 0.166121 May 28 21:36:35.588823 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2941/5928] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:35 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:36:35.914897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-f9ec336c-9c7c-4089-bbcd-48394b32e265 req-1e51e271-7ff7-4c16-ab9a-0f793fd02eec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d3a945-5fc1-4084-82da-73e2bc0604d5", "name": "network-vif-plugged", "status": "completed", "tag": "c9b88b36-b24a-47e4-b9dd-cff768b8bfdc"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:36:35.924186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f9ec336c-9c7c-4089-bbcd-48394b32e265 req-1e51e271-7ff7-4c16-ab9a-0f793fd02eec service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:35.924743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-f9ec336c-9c7c-4089-bbcd-48394b32e265 req-1e51e271-7ff7-4c16-ab9a-0f793fd02eec service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:35.937977 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-f9ec336c-9c7c-4089-bbcd-48394b32e265 req-1e51e271-7ff7-4c16-ab9a-0f793fd02eec service nova] Creating event network-vif-plugged:c9b88b36-b24a-47e4-b9dd-cff768b8bfdc for instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 on nch2-master-1 May 28 21:36:35.940697 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-f9ec336c-9c7c-4089-bbcd-48394b32e265 req-1e51e271-7ff7-4c16-ab9a-0f793fd02eec service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030564 May 28 21:36:35.941277 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2988/5929] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:36:36.573444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b54685d5-ec59-4f42-b8f7-bf1640b4548f tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:36.578027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b54685d5-ec59-4f42-b8f7-bf1640b4548f tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:36.578027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:36:36.581730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b54685d5-ec59-4f42-b8f7-bf1640b4548f tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:36.582226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b54685d5-ec59-4f42-b8f7-bf1640b4548f tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:36.583021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b54685d5-ec59-4f42-b8f7-bf1640b4548f tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:36.583449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b54685d5-ec59-4f42-b8f7-bf1640b4548f tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:36.608823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:36:36.609629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:36:36.611210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b54685d5-ec59-4f42-b8f7-bf1640b4548f tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:36:36.614921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aa152470-f9eb-4fb6-a564-90e74a594ae7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:36.615631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aa152470-f9eb-4fb6-a564-90e74a594ae7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:36.621808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa152470-f9eb-4fb6-a564-90e74a594ae7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:36.622321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa152470-f9eb-4fb6-a564-90e74a594ae7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:36.623961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa152470-f9eb-4fb6-a564-90e74a594ae7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:36.628474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa152470-f9eb-4fb6-a564-90e74a594ae7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:36.766085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aa152470-f9eb-4fb6-a564-90e74a594ae7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:36.776486 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aa152470-f9eb-4fb6-a564-90e74a594ae7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 200 len: 1365 microversion: 2.1 time: 0.168528 May 28 21:36:36.777236 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2989/5930] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:36 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:36:37.067051 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b54685d5-ec59-4f42-b8f7-bf1640b4548f tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 204 len: 0 microversion: 2.1 time: 0.497301 May 28 21:36:37.067651 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2942/5931] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:36:36 2022] DELETE /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:36:37.083021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4aad36c2-4f45-40e6-867d-68e0a784f832 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:37.083822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4aad36c2-4f45-40e6-867d-68e0a784f832 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:37.090541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4aad36c2-4f45-40e6-867d-68e0a784f832 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:37.090996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4aad36c2-4f45-40e6-867d-68e0a784f832 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:37.092326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4aad36c2-4f45-40e6-867d-68e0a784f832 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:37.092735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4aad36c2-4f45-40e6-867d-68e0a784f832 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:37.229966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4aad36c2-4f45-40e6-867d-68e0a784f832 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:37.237980 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4aad36c2-4f45-40e6-867d-68e0a784f832 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 200 len: 1514 microversion: 2.1 time: 0.159182 May 28 21:36:37.242085 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2990/5932] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:37 2022] GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:37.799803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aeb02e8f-8fd4-4fd5-b58a-5489f40566df tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:37.800513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aeb02e8f-8fd4-4fd5-b58a-5489f40566df tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:37.807674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aeb02e8f-8fd4-4fd5-b58a-5489f40566df tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:37.808133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aeb02e8f-8fd4-4fd5-b58a-5489f40566df tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:37.808909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aeb02e8f-8fd4-4fd5-b58a-5489f40566df tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:37.809357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aeb02e8f-8fd4-4fd5-b58a-5489f40566df tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:37.945172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aeb02e8f-8fd4-4fd5-b58a-5489f40566df tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:37.952977 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aeb02e8f-8fd4-4fd5-b58a-5489f40566df tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 200 len: 1555 microversion: 2.1 time: 0.157511 May 28 21:36:37.953556 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2943/5933] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:37 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:37.969250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89668dd0-aee1-49f9-8054-bad2a24ca9f6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:37.969748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-89668dd0-aee1-49f9-8054-bad2a24ca9f6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:37.976910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89668dd0-aee1-49f9-8054-bad2a24ca9f6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:37.977370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89668dd0-aee1-49f9-8054-bad2a24ca9f6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:37.978160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89668dd0-aee1-49f9-8054-bad2a24ca9f6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:37.978606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89668dd0-aee1-49f9-8054-bad2a24ca9f6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:38.056486 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-89668dd0-aee1-49f9-8054-bad2a24ca9f6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091415 May 28 21:36:38.057958 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2991/5934] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:36:37 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:36:38.256120 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-48d819bf-66e3-4718-be8c-0a9875806ec5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:38.256656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-48d819bf-66e3-4718-be8c-0a9875806ec5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:38.258820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:36:38.264831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-48d819bf-66e3-4718-be8c-0a9875806ec5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:38.265294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-48d819bf-66e3-4718-be8c-0a9875806ec5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:38.267158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-48d819bf-66e3-4718-be8c-0a9875806ec5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:38.267623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-48d819bf-66e3-4718-be8c-0a9875806ec5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:38.414132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-48d819bf-66e3-4718-be8c-0a9875806ec5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:38.422569 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-48d819bf-66e3-4718-be8c-0a9875806ec5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 200 len: 1514 microversion: 2.1 time: 0.170731 May 28 21:36:38.423156 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2944/5935] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:38 2022] GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:39.336258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-404fa4b1-2c54-463d-a111-5dde4cfe83b8 req-90992cec-fd42-441b-8b4b-a6b92869d9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85d3a945-5fc1-4084-82da-73e2bc0604d5", "tag": "c9b88b36-b24a-47e4-b9dd-cff768b8bfdc"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:36:39.348994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-404fa4b1-2c54-463d-a111-5dde4cfe83b8 req-90992cec-fd42-441b-8b4b-a6b92869d9d6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:39.349794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-404fa4b1-2c54-463d-a111-5dde4cfe83b8 req-90992cec-fd42-441b-8b4b-a6b92869d9d6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:39.364383 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-404fa4b1-2c54-463d-a111-5dde4cfe83b8 req-90992cec-fd42-441b-8b4b-a6b92869d9d6 service nova] Creating event network-changed:c9b88b36-b24a-47e4-b9dd-cff768b8bfdc for instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 on nch2-master-1 May 28 21:36:39.371151 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-404fa4b1-2c54-463d-a111-5dde4cfe83b8 req-90992cec-fd42-441b-8b4b-a6b92869d9d6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038720 May 28 21:36:39.373192 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2992/5936] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:36:39.441046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-290c855e-3c2f-4160-abad-59a63708ea65 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:39.441691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-290c855e-3c2f-4160-abad-59a63708ea65 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:39.449743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-290c855e-3c2f-4160-abad-59a63708ea65 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:39.450243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-290c855e-3c2f-4160-abad-59a63708ea65 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:39.451104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-290c855e-3c2f-4160-abad-59a63708ea65 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:39.451559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-290c855e-3c2f-4160-abad-59a63708ea65 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:39.698034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-290c855e-3c2f-4160-abad-59a63708ea65 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:39.708190 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-290c855e-3c2f-4160-abad-59a63708ea65 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 200 len: 1514 microversion: 2.1 time: 0.271054 May 28 21:36:39.718705 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2945/5937] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:39 2022] GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:40.727790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2503d2fd-7f3c-4629-9496-b53255ea5ca1 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:40.728496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2503d2fd-7f3c-4629-9496-b53255ea5ca1 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: 5fd905ae-de46-41cb-8d04-722111b5ddf3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:40.734792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2503d2fd-7f3c-4629-9496-b53255ea5ca1 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:40.735253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2503d2fd-7f3c-4629-9496-b53255ea5ca1 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:40.736022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2503d2fd-7f3c-4629-9496-b53255ea5ca1 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:40.736472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2503d2fd-7f3c-4629-9496-b53255ea5ca1 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:40.753909 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-2503d2fd-7f3c-4629-9496-b53255ea5ca1 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] HTTP exception thrown: Instance 5fd905ae-de46-41cb-8d04-722111b5ddf3 could not be found. May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2503d2fd-7f3c-4629-9496-b53255ea5ca1 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Request method failure captured: May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 HTTP/1.1 May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpS_ypa5UNFNBLjvVoACWmulZGE45wG9ph1wcihi0Hn_hm24GeYhaH3pHz4UbMKo2WiBCVxm6wJq1Wf2Fdi1ik-iztyIeivPQ_sgmXaZvWpvaM83Nofu4dqmWBUYEOf-47dmGRomtc3ZI6K7wRHPrHtXJAx2YxGDoFHLfF3c9jWYoWk May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 6ed82f578e214948a9311cbdbb55a027 May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-VolumesSnapshotTestJSON-961770574 May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6ed82f578e214948a9311cbdbb55a027", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed82f578e214948a9311cbdbb55a027"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6ed82f578e214948a9311cbdbb55a027"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed82f578e214948a9311cbdbb55a027"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-VolumesSnapshotTestJSON-961770574 May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 6ed82f578e214948a9311cbdbb55a027 May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-961770574 May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-VolumesSnapshotTestJSON-961770574-project May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 8d033e99f9294e348b01c59a970931d5 May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-VolumesSnapshotTestJSON-961770574-project May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 5fd905ae-de46-41cb-8d04-722111b5ddf3 could not be found. May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '5fd905ae-de46-41cb-8d04-722111b5ddf3'} May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fd905ae-de46-41cb-8d04-722111b5ddf3 could not be found. May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fd905ae-de46-41cb-8d04-722111b5ddf3 could not be found. May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:36:40.755573 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:36:40.760450 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:36:40.760450 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:36:40.760450 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:36:40.760450 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:36:40.760450 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:36:40.760450 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fd905ae-de46-41cb-8d04-722111b5ddf3 could not be found. May 28 21:36:40.760450 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:36:40.760450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2503d2fd-7f3c-4629-9496-b53255ea5ca1 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Returning 404 to user: Instance 5fd905ae-de46-41cb-8d04-722111b5ddf3 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:36:40.760450 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2503d2fd-7f3c-4629-9496-b53255ea5ca1 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3" status: 404 len: 111 microversion: 2.1 time: 0.034439 May 28 21:36:40.760450 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2993/5938] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:40 2022] GET /compute/v2.1/servers/5fd905ae-de46-41cb-8d04-722111b5ddf3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:36:41.390564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-0c324e54-97cb-4d3a-85c6-7b1ffa59281a req-b1cdfda6-7fcf-45d0-9bd7-95b35af51874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fd905ae-de46-41cb-8d04-722111b5ddf3", "name": "network-vif-deleted", "tag": "71837f42-77ea-4049-8317-cdf49187be43"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:36:41.399829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0c324e54-97cb-4d3a-85c6-7b1ffa59281a req-b1cdfda6-7fcf-45d0-9bd7-95b35af51874 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:41.400407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0c324e54-97cb-4d3a-85c6-7b1ffa59281a req-b1cdfda6-7fcf-45d0-9bd7-95b35af51874 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:41.403060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:36:41.412635 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-0c324e54-97cb-4d3a-85c6-7b1ffa59281a req-b1cdfda6-7fcf-45d0-9bd7-95b35af51874 service nova] Creating event network-vif-deleted:71837f42-77ea-4049-8317-cdf49187be43 for instance 5fd905ae-de46-41cb-8d04-722111b5ddf3 on nch2-master-1 May 28 21:36:41.417349 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-0c324e54-97cb-4d3a-85c6-7b1ffa59281a req-b1cdfda6-7fcf-45d0-9bd7-95b35af51874 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030519 May 28 21:36:41.417947 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2946/5939] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:36:51.363253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1070426673", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "265ad580-d40e-4f6f-b270-22c5a86698fc"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:36:51.371898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:36:51.372548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:36:51.416435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] validate_networks() for [('265ad580-d40e-4f6f-b270-22c5a86698fc', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:36:51.776975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:36:51.777356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:36:51.777848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:36:51.782783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:36:51.782783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:36:51.795133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:51.796122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:51.796996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:51.797555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:51.822440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Getting quotas for project 6ed82f578e214948a9311cbdbb55a027. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:36:51.827817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Getting quotas for user 8d033e99f9294e348b01c59a970931d5 and project 6ed82f578e214948a9311cbdbb55a027. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:36:51.841092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:36:51.843421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:36:52.008500 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-93567c8d-de57-4c36-b198-f30eb3f7ce5e tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649628 May 28 21:36:52.009305 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2994/5940] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:36:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:36:52.021548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-22a8b632-0f96-4b92-8152-c5a6215e3f91 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:52.022979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-22a8b632-0f96-4b92-8152-c5a6215e3f91 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:52.028829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=5 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:36:52.087400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-22a8b632-0f96-4b92-8152-c5a6215e3f91 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:52.095344 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-22a8b632-0f96-4b92-8152-c5a6215e3f91 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 200 len: 1219 microversion: 2.1 time: 0.079475 May 28 21:36:52.096045 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2947/5941] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:52 2022] GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:53.113482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-13fee32f-10d3-4dac-996b-f7139c6cbbc3 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:53.114294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-13fee32f-10d3-4dac-996b-f7139c6cbbc3 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:53.121503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13fee32f-10d3-4dac-996b-f7139c6cbbc3 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:53.121937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13fee32f-10d3-4dac-996b-f7139c6cbbc3 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:53.122731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13fee32f-10d3-4dac-996b-f7139c6cbbc3 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:53.123190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13fee32f-10d3-4dac-996b-f7139c6cbbc3 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:53.185026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-13fee32f-10d3-4dac-996b-f7139c6cbbc3 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:53.193241 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-13fee32f-10d3-4dac-996b-f7139c6cbbc3 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 200 len: 1223 microversion: 2.1 time: 0.084594 May 28 21:36:53.194008 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2995/5942] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:53 2022] GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:54.211578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-610d0f0d-b2b9-49f7-be52-23c9a81584be tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:54.212435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-610d0f0d-b2b9-49f7-be52-23c9a81584be tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:54.221735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-610d0f0d-b2b9-49f7-be52-23c9a81584be tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:54.222231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-610d0f0d-b2b9-49f7-be52-23c9a81584be tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:54.223024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-610d0f0d-b2b9-49f7-be52-23c9a81584be tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:54.223583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-610d0f0d-b2b9-49f7-be52-23c9a81584be tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:54.302222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-610d0f0d-b2b9-49f7-be52-23c9a81584be tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:54.310450 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-610d0f0d-b2b9-49f7-be52-23c9a81584be tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 200 len: 1289 microversion: 2.1 time: 0.103083 May 28 21:36:54.311031 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2948/5943] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:54 2022] GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 1289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:55.331511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-efbdd94c-e6f6-440a-a9c5-e3430cb6a93d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:55.332311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-efbdd94c-e6f6-440a-a9c5-e3430cb6a93d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:55.339430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-efbdd94c-e6f6-440a-a9c5-e3430cb6a93d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:55.340161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-efbdd94c-e6f6-440a-a9c5-e3430cb6a93d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:55.341003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-efbdd94c-e6f6-440a-a9c5-e3430cb6a93d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:55.341460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-efbdd94c-e6f6-440a-a9c5-e3430cb6a93d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:55.555385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-efbdd94c-e6f6-440a-a9c5-e3430cb6a93d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:55.563205 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-efbdd94c-e6f6-440a-a9c5-e3430cb6a93d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 200 len: 1319 microversion: 2.1 time: 0.236179 May 28 21:36:55.563795 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2996/5944] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:55 2022] GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:55.752587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-885c5976-1ce4-420a-8d7c-0e50a9731c39 req-740d1c2f-220f-4ef7-986c-2f23e5197008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c102e74a-53d8-49a3-b95c-11662e61a985", "tag": "9385ed55-01a4-4312-9e23-8609250a9f81"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:36:55.761819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-885c5976-1ce4-420a-8d7c-0e50a9731c39 req-740d1c2f-220f-4ef7-986c-2f23e5197008 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:55.762366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-885c5976-1ce4-420a-8d7c-0e50a9731c39 req-740d1c2f-220f-4ef7-986c-2f23e5197008 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:55.776875 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-885c5976-1ce4-420a-8d7c-0e50a9731c39 req-740d1c2f-220f-4ef7-986c-2f23e5197008 service nova] Creating event network-changed:9385ed55-01a4-4312-9e23-8609250a9f81 for instance c102e74a-53d8-49a3-b95c-11662e61a985 on nch1-master-1 May 28 21:36:55.781778 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-885c5976-1ce4-420a-8d7c-0e50a9731c39 req-740d1c2f-220f-4ef7-986c-2f23e5197008 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033723 May 28 21:36:55.782428 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2949/5945] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:36:56.583382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cb37b6b9-cc46-4b67-a260-a2419807c43d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:56.584034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cb37b6b9-cc46-4b67-a260-a2419807c43d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:56.591445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cb37b6b9-cc46-4b67-a260-a2419807c43d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:56.592334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cb37b6b9-cc46-4b67-a260-a2419807c43d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:56.593124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cb37b6b9-cc46-4b67-a260-a2419807c43d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:56.593577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cb37b6b9-cc46-4b67-a260-a2419807c43d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:56.763760 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cb37b6b9-cc46-4b67-a260-a2419807c43d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:56.771931 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cb37b6b9-cc46-4b67-a260-a2419807c43d tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 200 len: 1319 microversion: 2.1 time: 0.192983 May 28 21:36:56.772585 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2997/5946] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:56 2022] GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:57.791018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3ac40f6c-ef07-4f7d-a257-8a0c0136f09a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:57.791735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3ac40f6c-ef07-4f7d-a257-8a0c0136f09a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:57.798044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ac40f6c-ef07-4f7d-a257-8a0c0136f09a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:57.798500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ac40f6c-ef07-4f7d-a257-8a0c0136f09a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:57.799929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ac40f6c-ef07-4f7d-a257-8a0c0136f09a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:57.800374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ac40f6c-ef07-4f7d-a257-8a0c0136f09a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:57.941065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3ac40f6c-ef07-4f7d-a257-8a0c0136f09a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:57.951495 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3ac40f6c-ef07-4f7d-a257-8a0c0136f09a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 200 len: 1319 microversion: 2.1 time: 0.165686 May 28 21:36:57.952841 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2950/5947] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:57 2022] GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:36:58.969314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-88b5e0b1-3e14-436e-8f87-16e4b32b51c5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:36:58.970003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-88b5e0b1-3e14-436e-8f87-16e4b32b51c5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:36:58.977726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88b5e0b1-3e14-436e-8f87-16e4b32b51c5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:58.978225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88b5e0b1-3e14-436e-8f87-16e4b32b51c5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:58.979002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88b5e0b1-3e14-436e-8f87-16e4b32b51c5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:36:58.979453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88b5e0b1-3e14-436e-8f87-16e4b32b51c5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:36:59.110103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-88b5e0b1-3e14-436e-8f87-16e4b32b51c5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:36:59.117970 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-88b5e0b1-3e14-436e-8f87-16e4b32b51c5 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 200 len: 1319 microversion: 2.1 time: 0.152855 May 28 21:36:59.118534 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2998/5948] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:36:58 2022] GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:00.137457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-120426ca-9787-4c86-8be3-c24da824b1a7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:00.139596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-120426ca-9787-4c86-8be3-c24da824b1a7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:00.146969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-120426ca-9787-4c86-8be3-c24da824b1a7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:00.147457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-120426ca-9787-4c86-8be3-c24da824b1a7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:00.148239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-120426ca-9787-4c86-8be3-c24da824b1a7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:00.148710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-120426ca-9787-4c86-8be3-c24da824b1a7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:00.290054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-120426ca-9787-4c86-8be3-c24da824b1a7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:00.297712 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-120426ca-9787-4c86-8be3-c24da824b1a7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 200 len: 1319 microversion: 2.1 time: 0.166786 May 28 21:37:00.298381 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2951/5949] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:00 2022] GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:01.315274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c4f61338-5823-4982-951e-ea40e7070db7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:01.315895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c4f61338-5823-4982-951e-ea40e7070db7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:01.322958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4f61338-5823-4982-951e-ea40e7070db7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:01.323420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4f61338-5823-4982-951e-ea40e7070db7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:01.324201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4f61338-5823-4982-951e-ea40e7070db7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:01.324651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c4f61338-5823-4982-951e-ea40e7070db7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:01.483750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c4f61338-5823-4982-951e-ea40e7070db7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:01.491665 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c4f61338-5823-4982-951e-ea40e7070db7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 200 len: 1319 microversion: 2.1 time: 0.180344 May 28 21:37:01.492233 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 2999/5950] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:01 2022] GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:02.304619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a426faab-5117-44d6-90e3-41e204084a88 req-c6fb00e2-cf3c-4e64-868a-19788f7e04b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c102e74a-53d8-49a3-b95c-11662e61a985", "name": "network-vif-plugged", "status": "completed", "tag": "9385ed55-01a4-4312-9e23-8609250a9f81"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:37:02.311140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:37:02.315817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a426faab-5117-44d6-90e3-41e204084a88 req-c6fb00e2-cf3c-4e64-868a-19788f7e04b0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:02.315817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a426faab-5117-44d6-90e3-41e204084a88 req-c6fb00e2-cf3c-4e64-868a-19788f7e04b0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:02.326882 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a426faab-5117-44d6-90e3-41e204084a88 req-c6fb00e2-cf3c-4e64-868a-19788f7e04b0 service nova] Creating event network-vif-plugged:9385ed55-01a4-4312-9e23-8609250a9f81 for instance c102e74a-53d8-49a3-b95c-11662e61a985 on nch1-master-1 May 28 21:37:02.331816 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a426faab-5117-44d6-90e3-41e204084a88 req-c6fb00e2-cf3c-4e64-868a-19788f7e04b0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031564 May 28 21:37:02.332414 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2952/5951] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:37:02.513103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d765e0af-c594-4bed-b675-d5ec0fe07cf7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:02.513758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d765e0af-c594-4bed-b675-d5ec0fe07cf7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:02.516034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:37:02.516712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:37:02.523787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d765e0af-c594-4bed-b675-d5ec0fe07cf7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:02.524243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d765e0af-c594-4bed-b675-d5ec0fe07cf7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:02.525017 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d765e0af-c594-4bed-b675-d5ec0fe07cf7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:02.525464 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d765e0af-c594-4bed-b675-d5ec0fe07cf7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:02.656823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d765e0af-c594-4bed-b675-d5ec0fe07cf7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:02.665037 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d765e0af-c594-4bed-b675-d5ec0fe07cf7 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 200 len: 1319 microversion: 2.1 time: 0.156210 May 28 21:37:02.665605 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3000/5952] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:02 2022] GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:03.683725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-22686ea4-bbe2-49fb-a490-8b7f904e6031 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:03.684439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-22686ea4-bbe2-49fb-a490-8b7f904e6031 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:03.691631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22686ea4-bbe2-49fb-a490-8b7f904e6031 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:03.692091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22686ea4-bbe2-49fb-a490-8b7f904e6031 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:03.692862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22686ea4-bbe2-49fb-a490-8b7f904e6031 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:03.693308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22686ea4-bbe2-49fb-a490-8b7f904e6031 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:03.830818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-22686ea4-bbe2-49fb-a490-8b7f904e6031 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:03.839398 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-22686ea4-bbe2-49fb-a490-8b7f904e6031 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 200 len: 1507 microversion: 2.1 time: 0.161268 May 28 21:37:03.840247 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2953/5953] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:03 2022] GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:03.856430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a7511edd-d36b-4d99-b670-85a3bab7594f tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b31650fd-bab6-499a-bca7-af6b551f165e", "device": "/dev/sdb"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:37:03.857599 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a7511edd-d36b-4d99-b670-85a3bab7594f tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:03.864769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a7511edd-d36b-4d99-b670-85a3bab7594f tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:03.865234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a7511edd-d36b-4d99-b670-85a3bab7594f tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:03.866048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a7511edd-d36b-4d99-b670-85a3bab7594f tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:03.866499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a7511edd-d36b-4d99-b670-85a3bab7594f tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:04.681808 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a7511edd-d36b-4d99-b670-85a3bab7594f tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "POST /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.829370 May 28 21:37:04.682588 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3001/5954] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:37:03 2022] POST /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985/os-volume_attachments => generated 194 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:37:13.271143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5619e656-ee9e-4ed4-82cb-d6df7cde3ec6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:13.271707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5619e656-ee9e-4ed4-82cb-d6df7cde3ec6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:13.279631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5619e656-ee9e-4ed4-82cb-d6df7cde3ec6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:13.280087 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5619e656-ee9e-4ed4-82cb-d6df7cde3ec6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:13.280926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5619e656-ee9e-4ed4-82cb-d6df7cde3ec6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:13.281365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5619e656-ee9e-4ed4-82cb-d6df7cde3ec6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:13.305694 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5619e656-ee9e-4ed4-82cb-d6df7cde3ec6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5/ips" status: 200 len: 150 microversion: 2.1 time: 0.038493 May 28 21:37:13.306552 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2954/5955] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 21:37:13 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:37:16.015646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:37:16.016467 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:37:16.020881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5b18aac4-593a-46fe-991c-3487e2384356 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "288fd4fc-4ae9-43dc-9f8e-7c3076f69091"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:37:16.022113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5b18aac4-593a-46fe-991c-3487e2384356 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:16.032193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b18aac4-593a-46fe-991c-3487e2384356 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:16.032658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b18aac4-593a-46fe-991c-3487e2384356 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:16.033758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b18aac4-593a-46fe-991c-3487e2384356 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:16.033937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b18aac4-593a-46fe-991c-3487e2384356 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:16.835717 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5b18aac4-593a-46fe-991c-3487e2384356 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "POST /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.821795 May 28 21:37:16.836926 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3002/5956] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:37:16 2022] POST /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5/os-volume_attachments => generated 194 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:37:20.134616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-448487da-abf6-411b-b365-0ca7c6f4faa9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "288fd4fc-4ae9-43dc-9f8e-7c3076f69091"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:37:20.135754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-448487da-abf6-411b-b365-0ca7c6f4faa9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:20.144723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-448487da-abf6-411b-b365-0ca7c6f4faa9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:20.145181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-448487da-abf6-411b-b365-0ca7c6f4faa9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:20.146075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-448487da-abf6-411b-b365-0ca7c6f4faa9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:20.146734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-448487da-abf6-411b-b365-0ca7c6f4faa9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:20.241487 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-448487da-abf6-411b-b365-0ca7c6f4faa9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] HTTP exception thrown: Invalid volume: volume 288fd4fc-4ae9-43dc-9f8e-7c3076f69091 is already attached to instances: 85d3a945-5fc1-4084-82da-73e2bc0604d5 May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-448487da-abf6-411b-b365-0ca7c6f4faa9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Request method failure captured: May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5/os-volume_attachments HTTP/1.1 May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 74 May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpVRO-mAxq6p3GCM6f9DBOuC6gM1jLrQkTcIGTva2AkLnRSMUBqa-v9eVXfkm2PMd8NeLYhF-4I6HJDUZ-KSNTa0czoN9va3UpuGRFgQJU4y4HLnhbLb00NIsPyXWHr82FwRNk4pOcjox7d1rlRD_kjkv5QsGlOaJ5XjMoC8y-HfNC4 May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: f9c9caba58394e1480acb632405111c5 May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f9c9caba58394e1480acb632405111c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f9c9caba58394e1480acb632405111c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AttachVolumeNegativeTest-679324601 May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: f9c9caba58394e1480acb632405111c5 May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: b16d0e791edd4f119e646e7ced74bf74 May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: {"volumeAttachment": {"volumeId": "288fd4fc-4ae9-43dc-9f8e-7c3076f69091"}} May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: exception: Invalid volume: volume 288fd4fc-4ae9-43dc-9f8e-7c3076f69091 is already attached to instances: 85d3a945-5fc1-4084-82da-73e2bc0604d5 May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'server_id': '85d3a945-5fc1-4084-82da-73e2bc0604d5', 'body': {'volumeAttachment': {'volumeId': '288fd4fc-4ae9-43dc-9f8e-7c3076f69091'}}} May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 288fd4fc-4ae9-43dc-9f8e-7c3076f69091 is already attached to instances: 85d3a945-5fc1-4084-82da-73e2bc0604d5 May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:37:20.243333 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 288fd4fc-4ae9-43dc-9f8e-7c3076f69091 is already attached to instances: 85d3a945-5fc1-4084-82da-73e2bc0604d5 May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 288fd4fc-4ae9-43dc-9f8e-7c3076f69091 is already attached to instances: 85d3a945-5fc1-4084-82da-73e2bc0604d5 May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-448487da-abf6-411b-b365-0ca7c6f4faa9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Returning 400 to user: Invalid volume: volume 288fd4fc-4ae9-43dc-9f8e-7c3076f69091 is already attached to instances: 85d3a945-5fc1-4084-82da-73e2bc0604d5 {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-448487da-abf6-411b-b365-0ca7c6f4faa9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "POST /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114969 May 28 21:37:20.247797 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2955/5957] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:37:20 2022] POST /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:37:20.314398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-91990afa-8ed1-4cc6-845e-6e75e5df2b14 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:20.315000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-91990afa-8ed1-4cc6-845e-6e75e5df2b14 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:20.322030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91990afa-8ed1-4cc6-845e-6e75e5df2b14 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:20.322495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91990afa-8ed1-4cc6-845e-6e75e5df2b14 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:20.324909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91990afa-8ed1-4cc6-845e-6e75e5df2b14 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:20.324909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91990afa-8ed1-4cc6-845e-6e75e5df2b14 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:20.406277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-91990afa-8ed1-4cc6-845e-6e75e5df2b14 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lazy-loading 'services' on Instance uuid 85d3a945-5fc1-4084-82da-73e2bc0604d5 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:37:20.626361 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-91990afa-8ed1-4cc6-845e-6e75e5df2b14 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "DELETE /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5/os-volume_attachments/288fd4fc-4ae9-43dc-9f8e-7c3076f69091" status: 202 len: 0 microversion: 2.1 time: 0.316804 May 28 21:37:20.626956 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3003/5958] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:37:20 2022] DELETE /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5/os-volume_attachments/288fd4fc-4ae9-43dc-9f8e-7c3076f69091 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:37:20.636627 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d6478610-d253-4d75-8470-229d8a564685 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:20.637569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d6478610-d253-4d75-8470-229d8a564685 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:20.643811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6478610-d253-4d75-8470-229d8a564685 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:20.644288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6478610-d253-4d75-8470-229d8a564685 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:20.645038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6478610-d253-4d75-8470-229d8a564685 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:20.645518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6478610-d253-4d75-8470-229d8a564685 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:20.676219 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d6478610-d253-4d75-8470-229d8a564685 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044691 May 28 21:37:20.676765 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2956/5959] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:37:20 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:37:21.688275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-02556404-9678-4a79-9675-0c22b4559bd7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:21.689358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-02556404-9678-4a79-9675-0c22b4559bd7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:21.697123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02556404-9678-4a79-9675-0c22b4559bd7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:21.697587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02556404-9678-4a79-9675-0c22b4559bd7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:21.698417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02556404-9678-4a79-9675-0c22b4559bd7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:21.703283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02556404-9678-4a79-9675-0c22b4559bd7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:21.734613 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-02556404-9678-4a79-9675-0c22b4559bd7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046127 May 28 21:37:21.734613 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3004/5960] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:37:21 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:37:21.787448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1e93b58b-8964-4a4a-8697-dcdae428278c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:21.787938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1e93b58b-8964-4a4a-8697-dcdae428278c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:21.795390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e93b58b-8964-4a4a-8697-dcdae428278c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:21.795845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e93b58b-8964-4a4a-8697-dcdae428278c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:21.796649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e93b58b-8964-4a4a-8697-dcdae428278c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:21.797094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e93b58b-8964-4a4a-8697-dcdae428278c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:21.823067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1e93b58b-8964-4a4a-8697-dcdae428278c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:37:22.127983 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1e93b58b-8964-4a4a-8697-dcdae428278c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "DELETE /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 204 len: 0 microversion: 2.1 time: 0.344032 May 28 21:37:22.128596 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2957/5961] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:37:21 2022] DELETE /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:37:22.136762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7d4d08d4-b8bf-4596-a0ff-0a9202f4c5c8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:22.137409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7d4d08d4-b8bf-4596-a0ff-0a9202f4c5c8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:22.143593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d4d08d4-b8bf-4596-a0ff-0a9202f4c5c8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:22.144049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d4d08d4-b8bf-4596-a0ff-0a9202f4c5c8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:22.144840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d4d08d4-b8bf-4596-a0ff-0a9202f4c5c8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:22.145285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d4d08d4-b8bf-4596-a0ff-0a9202f4c5c8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:22.279682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7d4d08d4-b8bf-4596-a0ff-0a9202f4c5c8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:22.287444 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7d4d08d4-b8bf-4596-a0ff-0a9202f4c5c8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 200 len: 1680 microversion: 2.1 time: 0.154617 May 28 21:37:22.288017 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3005/5962] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:22 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:23.305995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1174cb2a-4948-408a-b7d9-0b9d34e0b04e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:23.306716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1174cb2a-4948-408a-b7d9-0b9d34e0b04e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:23.309783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:37:23.317874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1174cb2a-4948-408a-b7d9-0b9d34e0b04e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:23.318315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1174cb2a-4948-408a-b7d9-0b9d34e0b04e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:23.319147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1174cb2a-4948-408a-b7d9-0b9d34e0b04e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:23.319587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1174cb2a-4948-408a-b7d9-0b9d34e0b04e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:23.453047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1174cb2a-4948-408a-b7d9-0b9d34e0b04e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:23.460884 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1174cb2a-4948-408a-b7d9-0b9d34e0b04e tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 200 len: 1680 microversion: 2.1 time: 0.160197 May 28 21:37:23.462015 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2958/5963] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:23 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:24.473866 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-75286670-a65f-4d5f-9cf0-300e0cb88c92 req-db9b16dd-e837-4522-81d8-da6075958eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85d3a945-5fc1-4084-82da-73e2bc0604d5", "name": "network-vif-deleted", "tag": "c9b88b36-b24a-47e4-b9dd-cff768b8bfdc"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:37:24.481254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8980a27d-c884-420f-8d56-8d074c0e1073 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:24.482105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8980a27d-c884-420f-8d56-8d074c0e1073 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:24.483033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-75286670-a65f-4d5f-9cf0-300e0cb88c92 req-db9b16dd-e837-4522-81d8-da6075958eae service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:24.483490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-75286670-a65f-4d5f-9cf0-300e0cb88c92 req-db9b16dd-e837-4522-81d8-da6075958eae service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:24.493764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8980a27d-c884-420f-8d56-8d074c0e1073 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:24.495895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8980a27d-c884-420f-8d56-8d074c0e1073 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:24.496181 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-75286670-a65f-4d5f-9cf0-300e0cb88c92 req-db9b16dd-e837-4522-81d8-da6075958eae service nova] Creating event network-vif-deleted:c9b88b36-b24a-47e4-b9dd-cff768b8bfdc for instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 on nch2-master-1 May 28 21:37:24.497290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8980a27d-c884-420f-8d56-8d074c0e1073 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:24.498000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8980a27d-c884-420f-8d56-8d074c0e1073 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:24.501524 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-75286670-a65f-4d5f-9cf0-300e0cb88c92 req-db9b16dd-e837-4522-81d8-da6075958eae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032239 May 28 21:37:24.503055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:37:24.506620 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3006/5964] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:37:24.580110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8980a27d-c884-420f-8d56-8d074c0e1073 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:24.588464 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8980a27d-c884-420f-8d56-8d074c0e1073 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 200 len: 1612 microversion: 2.1 time: 0.113286 May 28 21:37:24.589068 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2959/5965] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:24 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 1612 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:37:25.607715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8234aeb5-90b6-4406-86fa-9e029a4ffca1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:25.608326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8234aeb5-90b6-4406-86fa-9e029a4ffca1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:25.614795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8234aeb5-90b6-4406-86fa-9e029a4ffca1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:25.615250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8234aeb5-90b6-4406-86fa-9e029a4ffca1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:25.616013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8234aeb5-90b6-4406-86fa-9e029a4ffca1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:25.616454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8234aeb5-90b6-4406-86fa-9e029a4ffca1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:25.630283 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-8234aeb5-90b6-4406-86fa-9e029a4ffca1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] HTTP exception thrown: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8234aeb5-90b6-4406-86fa-9e029a4ffca1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Request method failure captured: May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 HTTP/1.1 May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpVRO-mAxq6p3GCM6f9DBOuC6gM1jLrQkTcIGTva2AkLnRSMUBqa-v9eVXfkm2PMd8NeLYhF-4I6HJDUZ-KSNTa0czoN9va3UpuGRFgQJU4y4HLnhbLb00NIsPyXWHr82FwRNk4pOcjox7d1rlRD_kjkv5QsGlOaJ5XjMoC8y-HfNC4 May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f9c9caba58394e1480acb632405111c5 May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f9c9caba58394e1480acb632405111c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f9c9caba58394e1480acb632405111c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AttachVolumeNegativeTest-679324601 May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f9c9caba58394e1480acb632405111c5 May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: b16d0e791edd4f119e646e7ced74bf74 May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '85d3a945-5fc1-4084-82da-73e2bc0604d5'} May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:37:25.631926 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:37:25.641499 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:37:25.641499 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:37:25.641499 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:37:25.641499 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:37:25.641499 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:37:25.641499 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. May 28 21:37:25.641499 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:37:25.641499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8234aeb5-90b6-4406-86fa-9e029a4ffca1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Returning 404 to user: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:37:25.641499 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8234aeb5-90b6-4406-86fa-9e029a4ffca1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 404 len: 111 microversion: 2.1 time: 0.031161 May 28 21:37:25.641499 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3007/5966] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:25 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:37:25.643314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0d5758e6-697b-4d3d-b5df-25f91da40e95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '.version_select at 0x7f4d56bc8af0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:25.741592 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0d5758e6-697b-4d3d-b5df-25f91da40e95 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-916673926" status: 202 len: 0 microversion: 2.1 time: 0.102536 May 28 21:37:25.742222 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2960/5967] 10.222.0.33 () {58 vars in 1217 bytes} [Sat May 28 21:37:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-916673926 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:37:26.482293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7fb00916-66ed-45cb-946e-56c0862e6f69 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Action: 'create', calling method: .version_select at 0x7f4d56bb0ee0>, body: {"keypair": {"name": "tempest-keypair-1490929733", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIwPu67O9pQMvpslLCbhKXzJBN4fhOGBvq+wqZjOTrK6j6jUDAcKEdn6aPri/n5K9mBYKVBH/KDZD5/Lb31YEfGJJ+9qWWAdhwud/yqIv0+z9hQ7vyQxfRNj7sqUWRvyg=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:37:26.496680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-7fb00916-66ed-45cb-946e-56c0862e6f69 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for project f9c9caba58394e1480acb632405111c5. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:37:26.502179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-7fb00916-66ed-45cb-946e-56c0862e6f69 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for user b16d0e791edd4f119e646e7ced74bf74 and project f9c9caba58394e1480acb632405111c5. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:37:26.598869 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7fb00916-66ed-45cb-946e-56c0862e6f69 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121386 May 28 21:37:26.599404 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3008/5968] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:37:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:37:29.051682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-987872032", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31de5272-0585-4c63-8300-cd5a798dd14e"}], "security_groups": [{"name": "tempest-securitygroup--992902529"}], "key_name": "tempest-keypair-1490929733", "user_data": "}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:37:29.158656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] validate_networks() for [('31de5272-0585-4c63-8300-cd5a798dd14e', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:37:29.533794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:37:29.534267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:37:29.534772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:37:29.535188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:37:29.535604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:37:29.545153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:29.545603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:29.546440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:29.546880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:29.563464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for project f9c9caba58394e1480acb632405111c5. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:37:29.568790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Getting quotas for user b16d0e791edd4f119e646e7ced74bf74 and project f9c9caba58394e1480acb632405111c5. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:37:29.580993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:37:29.583313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:37:29.691310 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c6359b19-a114-416d-aeb3-a0d78914035c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.644881 May 28 21:37:29.691888 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2961/5969] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:37:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:37:29.702637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3068558b-314c-41a5-b8dc-4b23678d2e6b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:29.703325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3068558b-314c-41a5-b8dc-4b23678d2e6b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:30.107315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3068558b-314c-41a5-b8dc-4b23678d2e6b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:30.114768 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3068558b-314c-41a5-b8dc-4b23678d2e6b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 200 len: 1241 microversion: 2.1 time: 0.416187 May 28 21:37:30.115424 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3009/5970] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:29 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 1241 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:31.134995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f54bc2b8-bcef-42bd-a1bf-9af99f86ef70 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:31.135745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f54bc2b8-bcef-42bd-a1bf-9af99f86ef70 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:31.142496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f54bc2b8-bcef-42bd-a1bf-9af99f86ef70 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:31.142950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f54bc2b8-bcef-42bd-a1bf-9af99f86ef70 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:31.143720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f54bc2b8-bcef-42bd-a1bf-9af99f86ef70 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:31.144157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f54bc2b8-bcef-42bd-a1bf-9af99f86ef70 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:31.208559 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f54bc2b8-bcef-42bd-a1bf-9af99f86ef70 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:31.217740 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f54bc2b8-bcef-42bd-a1bf-9af99f86ef70 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 200 len: 1237 microversion: 2.1 time: 0.087611 May 28 21:37:31.218382 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2962/5971] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:31 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:32.237050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-324390be-4a5d-402e-b121-ead487cb7caf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:32.237700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-324390be-4a5d-402e-b121-ead487cb7caf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:32.245459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-324390be-4a5d-402e-b121-ead487cb7caf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:32.245945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-324390be-4a5d-402e-b121-ead487cb7caf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:32.246717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-324390be-4a5d-402e-b121-ead487cb7caf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:32.247165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-324390be-4a5d-402e-b121-ead487cb7caf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:32.328386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-324390be-4a5d-402e-b121-ead487cb7caf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:32.336200 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-324390be-4a5d-402e-b121-ead487cb7caf tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 200 len: 1311 microversion: 2.1 time: 0.103447 May 28 21:37:32.336849 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3010/5972] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:32 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:33.353198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-afc91bd0-5f31-47d2-9597-4b7a020c3bee tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:33.354426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-afc91bd0-5f31-47d2-9597-4b7a020c3bee tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:33.361402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afc91bd0-5f31-47d2-9597-4b7a020c3bee tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:33.361881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afc91bd0-5f31-47d2-9597-4b7a020c3bee tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:33.362652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afc91bd0-5f31-47d2-9597-4b7a020c3bee tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:33.363118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afc91bd0-5f31-47d2-9597-4b7a020c3bee tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:33.595433 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-afc91bd0-5f31-47d2-9597-4b7a020c3bee tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:33.602543 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-afc91bd0-5f31-47d2-9597-4b7a020c3bee tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 200 len: 1366 microversion: 2.1 time: 0.253230 May 28 21:37:33.603112 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2963/5973] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:33 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:33.863239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-0dad1c52-ae29-4fa1-9928-bea435823912 req-e074875e-14bb-4432-b719-bcb1c70abb14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20afe6e9-95dd-459a-b79d-28211a95df88", "tag": "d5404c04-ff1d-452e-b436-4e2d59b13e28"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:37:33.873521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0dad1c52-ae29-4fa1-9928-bea435823912 req-e074875e-14bb-4432-b719-bcb1c70abb14 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:33.874007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0dad1c52-ae29-4fa1-9928-bea435823912 req-e074875e-14bb-4432-b719-bcb1c70abb14 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:33.888828 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-0dad1c52-ae29-4fa1-9928-bea435823912 req-e074875e-14bb-4432-b719-bcb1c70abb14 service nova] Creating event network-changed:d5404c04-ff1d-452e-b436-4e2d59b13e28 for instance 20afe6e9-95dd-459a-b79d-28211a95df88 on nch2-master-1 May 28 21:37:33.893911 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-0dad1c52-ae29-4fa1-9928-bea435823912 req-e074875e-14bb-4432-b719-bcb1c70abb14 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034291 May 28 21:37:33.894534 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3011/5974] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:37:34.619791 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-03fafa3c-f24d-4810-a254-bf9240d0d488 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:34.620437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-03fafa3c-f24d-4810-a254-bf9240d0d488 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:34.627667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03fafa3c-f24d-4810-a254-bf9240d0d488 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:34.628127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03fafa3c-f24d-4810-a254-bf9240d0d488 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:34.628905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03fafa3c-f24d-4810-a254-bf9240d0d488 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:34.629357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-03fafa3c-f24d-4810-a254-bf9240d0d488 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:34.763535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-03fafa3c-f24d-4810-a254-bf9240d0d488 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:34.771289 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-03fafa3c-f24d-4810-a254-bf9240d0d488 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 200 len: 1366 microversion: 2.1 time: 0.155477 May 28 21:37:34.771906 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2964/5975] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:34 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:35.789023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-56c58966-11a8-4cab-9db6-75f6f991f555 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:35.790575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-56c58966-11a8-4cab-9db6-75f6f991f555 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:35.798706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56c58966-11a8-4cab-9db6-75f6f991f555 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:35.799164 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56c58966-11a8-4cab-9db6-75f6f991f555 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:35.799930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56c58966-11a8-4cab-9db6-75f6f991f555 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:35.800409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-56c58966-11a8-4cab-9db6-75f6f991f555 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:35.932867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-56c58966-11a8-4cab-9db6-75f6f991f555 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:35.940684 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-56c58966-11a8-4cab-9db6-75f6f991f555 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 200 len: 1366 microversion: 2.1 time: 0.155986 May 28 21:37:35.943300 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3012/5976] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:35 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:36.958291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7047398e-3e5c-4c80-9876-3ab66c656b05 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:36.958925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7047398e-3e5c-4c80-9876-3ab66c656b05 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:36.966452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7047398e-3e5c-4c80-9876-3ab66c656b05 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:36.966913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7047398e-3e5c-4c80-9876-3ab66c656b05 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:36.967697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7047398e-3e5c-4c80-9876-3ab66c656b05 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:36.968209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7047398e-3e5c-4c80-9876-3ab66c656b05 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:37.104994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7047398e-3e5c-4c80-9876-3ab66c656b05 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:37.112615 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7047398e-3e5c-4c80-9876-3ab66c656b05 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 200 len: 1366 microversion: 2.1 time: 0.158306 May 28 21:37:37.113206 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2965/5977] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:36 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:37:38.130325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ae18d062-2446-408c-890f-78ef396e4a06 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:38.130960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ae18d062-2446-408c-890f-78ef396e4a06 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:38.139329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae18d062-2446-408c-890f-78ef396e4a06 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:38.140092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae18d062-2446-408c-890f-78ef396e4a06 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:38.140878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae18d062-2446-408c-890f-78ef396e4a06 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:38.141490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ae18d062-2446-408c-890f-78ef396e4a06 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:38.301334 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ae18d062-2446-408c-890f-78ef396e4a06 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:38.310804 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ae18d062-2446-408c-890f-78ef396e4a06 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 200 len: 1366 microversion: 2.1 time: 0.184661 May 28 21:37:38.311595 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3013/5978] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:38 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:39.327504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d6d8d008-034f-4d3d-942f-7ff69ad684ae tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:39.328135 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d6d8d008-034f-4d3d-942f-7ff69ad684ae tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:39.335102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6d8d008-034f-4d3d-942f-7ff69ad684ae tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:39.338009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6d8d008-034f-4d3d-942f-7ff69ad684ae tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:39.338009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6d8d008-034f-4d3d-942f-7ff69ad684ae tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:39.338009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6d8d008-034f-4d3d-942f-7ff69ad684ae tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:39.475925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d6d8d008-034f-4d3d-942f-7ff69ad684ae tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:39.480930 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d6d8d008-034f-4d3d-942f-7ff69ad684ae tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 200 len: 1366 microversion: 2.1 time: 0.157434 May 28 21:37:39.481520 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2966/5979] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:39 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:40.247227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-cd61cd49-40b5-4545-9e21-c3f1f4bbaf2b req-1fa0f2ed-be88-413f-9658-054968c0d7ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20afe6e9-95dd-459a-b79d-28211a95df88", "name": "network-vif-plugged", "status": "completed", "tag": "d5404c04-ff1d-452e-b436-4e2d59b13e28"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:37:40.255309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:37:40.257450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cd61cd49-40b5-4545-9e21-c3f1f4bbaf2b req-1fa0f2ed-be88-413f-9658-054968c0d7ee service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:40.258031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cd61cd49-40b5-4545-9e21-c3f1f4bbaf2b req-1fa0f2ed-be88-413f-9658-054968c0d7ee service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:40.269307 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-cd61cd49-40b5-4545-9e21-c3f1f4bbaf2b req-1fa0f2ed-be88-413f-9658-054968c0d7ee service nova] Creating event network-vif-plugged:d5404c04-ff1d-452e-b436-4e2d59b13e28 for instance 20afe6e9-95dd-459a-b79d-28211a95df88 on nch2-master-1 May 28 21:37:40.274440 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-cd61cd49-40b5-4545-9e21-c3f1f4bbaf2b req-1fa0f2ed-be88-413f-9658-054968c0d7ee service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031812 May 28 21:37:40.275349 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3014/5980] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:37:40.497322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aef63e69-b68b-40d1-bcde-8de571f72f79 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:40.497889 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aef63e69-b68b-40d1-bcde-8de571f72f79 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:40.499816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:37:40.500509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:37:40.506291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aef63e69-b68b-40d1-bcde-8de571f72f79 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:40.506756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aef63e69-b68b-40d1-bcde-8de571f72f79 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:40.507535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aef63e69-b68b-40d1-bcde-8de571f72f79 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:40.508175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aef63e69-b68b-40d1-bcde-8de571f72f79 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:40.643941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aef63e69-b68b-40d1-bcde-8de571f72f79 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:40.652568 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aef63e69-b68b-40d1-bcde-8de571f72f79 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 200 len: 1366 microversion: 2.1 time: 0.159902 May 28 21:37:40.656297 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2967/5981] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:40 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:41.675036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-77ad4e31-07ec-4039-88bf-03062c32e5a5 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:41.675730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-77ad4e31-07ec-4039-88bf-03062c32e5a5 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:41.684265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77ad4e31-07ec-4039-88bf-03062c32e5a5 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:41.684725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77ad4e31-07ec-4039-88bf-03062c32e5a5 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:41.685646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77ad4e31-07ec-4039-88bf-03062c32e5a5 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:41.686433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-77ad4e31-07ec-4039-88bf-03062c32e5a5 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:41.867676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-77ad4e31-07ec-4039-88bf-03062c32e5a5 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:37:41.876144 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-77ad4e31-07ec-4039-88bf-03062c32e5a5 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 200 len: 1556 microversion: 2.1 time: 0.211232 May 28 21:37:41.876744 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3015/5982] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:41 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 1556 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:41.893916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eeaf306f-ced6-4615-bd8d-00ab438e5546 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:41.895080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eeaf306f-ced6-4615-bd8d-00ab438e5546 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:41.902894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eeaf306f-ced6-4615-bd8d-00ab438e5546 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:41.903294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eeaf306f-ced6-4615-bd8d-00ab438e5546 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:41.904084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eeaf306f-ced6-4615-bd8d-00ab438e5546 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:41.904537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eeaf306f-ced6-4615-bd8d-00ab438e5546 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:41.983433 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eeaf306f-ced6-4615-bd8d-00ab438e5546 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094728 May 28 21:37:41.984210 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2968/5983] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:37:41 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:37:43.113935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ff62dc24-90db-445b-82ca-53fb07561e1c req-3c1a3357-4997-48e2-bdbc-e17d26ef0384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20afe6e9-95dd-459a-b79d-28211a95df88", "tag": "d5404c04-ff1d-452e-b436-4e2d59b13e28"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:37:43.125780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ff62dc24-90db-445b-82ca-53fb07561e1c req-3c1a3357-4997-48e2-bdbc-e17d26ef0384 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:43.126525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ff62dc24-90db-445b-82ca-53fb07561e1c req-3c1a3357-4997-48e2-bdbc-e17d26ef0384 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:43.139403 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ff62dc24-90db-445b-82ca-53fb07561e1c req-3c1a3357-4997-48e2-bdbc-e17d26ef0384 service nova] Creating event network-changed:d5404c04-ff1d-452e-b436-4e2d59b13e28 for instance 20afe6e9-95dd-459a-b79d-28211a95df88 on nch2-master-1 May 28 21:37:43.144918 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ff62dc24-90db-445b-82ca-53fb07561e1c req-3c1a3357-4997-48e2-bdbc-e17d26ef0384 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034891 May 28 21:37:43.145920 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3016/5984] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:37:52.127566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:37:52.128680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=47 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:37:52.256157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2a71e371-2fd3-4016-a310-33e5fab3f479 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:52.257041 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:37:52.257041 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:37:52.258244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a71e371-2fd3-4016-a310-33e5fab3f479 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:52.258721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a71e371-2fd3-4016-a310-33e5fab3f479 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:52.259579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a71e371-2fd3-4016-a310-33e5fab3f479 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:52.260013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2a71e371-2fd3-4016-a310-33e5fab3f479 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:52.284953 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2a71e371-2fd3-4016-a310-33e5fab3f479 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.159107 May 28 21:37:52.285544 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2969/5985] 10.222.0.33 () {58 vars in 1184 bytes} [Sat May 28 21:37:52 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:37:52.392196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-784471612", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "919d5938-0107-44fe-b73b-06e60ddbe1f0"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:37:52.397857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:37:52.458291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] validate_networks() for [('919d5938-0107-44fe-b73b-06e60ddbe1f0', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:37:52.842417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:37:52.842863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:37:52.843357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:37:52.843785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:37:52.844213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:37:52.853446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:52.853940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:52.856544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:52.857032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:52.872933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:37:52.883801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Getting quotas for project 548e808b546044df903a929dfb8a6900. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:37:52.889969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Getting quotas for user fd831e5fee154f41aeacb1cf9196939e and project 548e808b546044df903a929dfb8a6900. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:37:52.905360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:37:52.907813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:37:53.032943 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cc0788fd-48bf-4ec8-9067-36aca79028a5 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645932 May 28 21:37:53.034254 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3017/5986] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:37:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:37:53.044003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bf096fb4-9d9e-4de5-8e9a-c6d65d38912c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:53.045142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bf096fb4-9d9e-4de5-8e9a-c6d65d38912c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:53.108174 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bf096fb4-9d9e-4de5-8e9a-c6d65d38912c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1328 microversion: 2.1 time: 0.068262 May 28 21:37:53.108926 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2970/5987] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:53 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1328 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:54.125665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-863015c9-acdd-4019-a54f-c7381c0c0196 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:54.126426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-863015c9-acdd-4019-a54f-c7381c0c0196 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:54.133116 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-863015c9-acdd-4019-a54f-c7381c0c0196 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:54.133676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-863015c9-acdd-4019-a54f-c7381c0c0196 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:54.135484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-863015c9-acdd-4019-a54f-c7381c0c0196 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:54.135484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-863015c9-acdd-4019-a54f-c7381c0c0196 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:54.234566 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-863015c9-acdd-4019-a54f-c7381c0c0196 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1345 microversion: 2.1 time: 0.113712 May 28 21:37:54.235442 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3018/5988] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:54 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:55.252368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1b8c6d9e-0cb6-48e6-bf23-248f5c56b138 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:55.253599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1b8c6d9e-0cb6-48e6-bf23-248f5c56b138 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:55.279028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b8c6d9e-0cb6-48e6-bf23-248f5c56b138 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:55.279717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b8c6d9e-0cb6-48e6-bf23-248f5c56b138 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:55.280668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b8c6d9e-0cb6-48e6-bf23-248f5c56b138 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:55.281190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1b8c6d9e-0cb6-48e6-bf23-248f5c56b138 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:55.386072 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1b8c6d9e-0cb6-48e6-bf23-248f5c56b138 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1423 microversion: 2.1 time: 0.137852 May 28 21:37:55.398031 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2971/5989] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:55 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1423 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:56.405081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c5479da3-f41d-4354-be17-800126a37c6b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:56.405806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c5479da3-f41d-4354-be17-800126a37c6b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:56.413121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5479da3-f41d-4354-be17-800126a37c6b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:56.413669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5479da3-f41d-4354-be17-800126a37c6b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:56.414651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5479da3-f41d-4354-be17-800126a37c6b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:56.415169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c5479da3-f41d-4354-be17-800126a37c6b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:56.544380 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c5479da3-f41d-4354-be17-800126a37c6b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1463 microversion: 2.1 time: 0.140780 May 28 21:37:56.544380 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3019/5990] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:56 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1463 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:56.829815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-b24cf71e-7f6e-48e8-8ba3-2e4a163ca46a req-70b0f351-93f8-4c8d-9559-6ad3cd95c9f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a2eb78-9ddc-4bed-bd0f-ddd30a175be4", "tag": "560f74a3-26ec-4cf0-b93b-bd8920e3dd9e"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:37:56.839429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b24cf71e-7f6e-48e8-8ba3-2e4a163ca46a req-70b0f351-93f8-4c8d-9559-6ad3cd95c9f9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:56.841864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b24cf71e-7f6e-48e8-8ba3-2e4a163ca46a req-70b0f351-93f8-4c8d-9559-6ad3cd95c9f9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:56.852948 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-b24cf71e-7f6e-48e8-8ba3-2e4a163ca46a req-70b0f351-93f8-4c8d-9559-6ad3cd95c9f9 service nova] Creating event network-changed:560f74a3-26ec-4cf0-b93b-bd8920e3dd9e for instance 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 on nch1-master-1 May 28 21:37:56.860698 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-b24cf71e-7f6e-48e8-8ba3-2e4a163ca46a req-70b0f351-93f8-4c8d-9559-6ad3cd95c9f9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034508 May 28 21:37:56.866008 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2972/5991] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:37:57.559110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7e5f0a1a-a8d5-4750-8975-1914ef2ad830 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:57.559736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7e5f0a1a-a8d5-4750-8975-1914ef2ad830 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:57.566837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e5f0a1a-a8d5-4750-8975-1914ef2ad830 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:57.567301 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e5f0a1a-a8d5-4750-8975-1914ef2ad830 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:57.568080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e5f0a1a-a8d5-4750-8975-1914ef2ad830 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:57.568529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7e5f0a1a-a8d5-4750-8975-1914ef2ad830 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:57.695839 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7e5f0a1a-a8d5-4750-8975-1914ef2ad830 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1463 microversion: 2.1 time: 0.140561 May 28 21:37:57.696416 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3020/5992] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:57 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1463 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:58.715419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-70795bd0-0e73-45c9-80d1-d167b2e977d8 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:58.723221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-70795bd0-0e73-45c9-80d1-d167b2e977d8 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:58.723221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70795bd0-0e73-45c9-80d1-d167b2e977d8 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:58.723221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70795bd0-0e73-45c9-80d1-d167b2e977d8 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:58.723743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70795bd0-0e73-45c9-80d1-d167b2e977d8 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:58.724188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70795bd0-0e73-45c9-80d1-d167b2e977d8 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:58.851922 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-70795bd0-0e73-45c9-80d1-d167b2e977d8 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1463 microversion: 2.1 time: 0.142260 May 28 21:37:58.852504 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2973/5993] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:58 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1463 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:37:59.869028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7ce1a87a-eced-4980-b869-7acd2502cd74 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:37:59.869655 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7ce1a87a-eced-4980-b869-7acd2502cd74 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:37:59.876699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ce1a87a-eced-4980-b869-7acd2502cd74 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:59.877162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ce1a87a-eced-4980-b869-7acd2502cd74 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:37:59.877959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ce1a87a-eced-4980-b869-7acd2502cd74 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:37:59.878410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7ce1a87a-eced-4980-b869-7acd2502cd74 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:00.001768 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7ce1a87a-eced-4980-b869-7acd2502cd74 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1463 microversion: 2.1 time: 0.136444 May 28 21:38:00.002374 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3021/5994] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:37:59 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1463 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:01.019319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5c286f01-ee13-4a95-8502-b7f0f23749da tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:01.019842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5c286f01-ee13-4a95-8502-b7f0f23749da tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:01.027325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c286f01-ee13-4a95-8502-b7f0f23749da tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:01.027783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c286f01-ee13-4a95-8502-b7f0f23749da tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:01.028552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c286f01-ee13-4a95-8502-b7f0f23749da tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:01.029003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5c286f01-ee13-4a95-8502-b7f0f23749da tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:01.162233 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5c286f01-ee13-4a95-8502-b7f0f23749da tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1463 microversion: 2.1 time: 0.146726 May 28 21:38:01.162811 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2974/5995] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:01 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1463 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:02.180787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-67ae5c57-27c2-455a-bb14-d254542fead1 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:02.181447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-67ae5c57-27c2-455a-bb14-d254542fead1 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:02.189069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67ae5c57-27c2-455a-bb14-d254542fead1 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:02.189533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67ae5c57-27c2-455a-bb14-d254542fead1 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:02.190340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67ae5c57-27c2-455a-bb14-d254542fead1 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:02.190791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67ae5c57-27c2-455a-bb14-d254542fead1 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:02.315655 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-67ae5c57-27c2-455a-bb14-d254542fead1 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1463 microversion: 2.1 time: 0.138601 May 28 21:38:02.316167 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3022/5996] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:02 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1463 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:38:02.580142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-7b6c68a0-a5f2-4528-b50a-78d03292cc41 req-e7c07269-3ec5-474f-91f9-afd83a6de1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a2eb78-9ddc-4bed-bd0f-ddd30a175be4", "name": "network-vif-plugged", "status": "completed", "tag": "560f74a3-26ec-4cf0-b93b-bd8920e3dd9e"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:38:02.586626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:38:02.593886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7b6c68a0-a5f2-4528-b50a-78d03292cc41 req-e7c07269-3ec5-474f-91f9-afd83a6de1ab service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:02.594330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7b6c68a0-a5f2-4528-b50a-78d03292cc41 req-e7c07269-3ec5-474f-91f9-afd83a6de1ab service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:02.609709 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-7b6c68a0-a5f2-4528-b50a-78d03292cc41 req-e7c07269-3ec5-474f-91f9-afd83a6de1ab service nova] Creating event network-vif-plugged:560f74a3-26ec-4cf0-b93b-bd8920e3dd9e for instance 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 on nch1-master-1 May 28 21:38:02.612739 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-7b6c68a0-a5f2-4528-b50a-78d03292cc41 req-e7c07269-3ec5-474f-91f9-afd83a6de1ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039050 May 28 21:38:02.613363 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2975/5997] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:38:03.331679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1408029d-6306-4680-831c-19c385849221 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:03.332303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1408029d-6306-4680-831c-19c385849221 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:03.334225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:38:03.334931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:38:03.340972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1408029d-6306-4680-831c-19c385849221 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:03.341537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1408029d-6306-4680-831c-19c385849221 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:03.342282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1408029d-6306-4680-831c-19c385849221 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:03.342728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1408029d-6306-4680-831c-19c385849221 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:03.583570 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1408029d-6306-4680-831c-19c385849221 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1463 microversion: 2.1 time: 0.255559 May 28 21:38:03.584256 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3023/5998] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:03 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1463 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:04.597790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:38:04.602709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bac7e960-b353-4188-83ad-d38f5d248689 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:04.603493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bac7e960-b353-4188-83ad-d38f5d248689 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:04.610298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bac7e960-b353-4188-83ad-d38f5d248689 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:04.610762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bac7e960-b353-4188-83ad-d38f5d248689 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:04.611534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bac7e960-b353-4188-83ad-d38f5d248689 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:04.611981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bac7e960-b353-4188-83ad-d38f5d248689 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:04.740365 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bac7e960-b353-4188-83ad-d38f5d248689 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1648 microversion: 2.1 time: 0.143498 May 28 21:38:04.740945 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2976/5999] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:04 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1648 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:04.756656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a197e4dd-e652-4726-a849-244415a2bfef tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:04.757289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a197e4dd-e652-4726-a849-244415a2bfef tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:04.764885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a197e4dd-e652-4726-a849-244415a2bfef tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:04.765351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a197e4dd-e652-4726-a849-244415a2bfef tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:04.766175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a197e4dd-e652-4726-a849-244415a2bfef tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:04.766631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a197e4dd-e652-4726-a849-244415a2bfef tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:04.889016 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a197e4dd-e652-4726-a849-244415a2bfef tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1648 microversion: 2.1 time: 0.136090 May 28 21:38:04.889595 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3024/6000] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:04 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1648 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:04.904650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-26766b6e-ba5d-4571-b3b2-e04e1b6a3d3a tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:04.905275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-26766b6e-ba5d-4571-b3b2-e04e1b6a3d3a tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:04.911349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26766b6e-ba5d-4571-b3b2-e04e1b6a3d3a tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:04.911809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26766b6e-ba5d-4571-b3b2-e04e1b6a3d3a tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:04.912582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26766b6e-ba5d-4571-b3b2-e04e1b6a3d3a tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:04.913027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26766b6e-ba5d-4571-b3b2-e04e1b6a3d3a tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:05.096929 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-26766b6e-ba5d-4571-b3b2-e04e1b6a3d3a tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1648 microversion: 2.1 time: 0.195959 May 28 21:38:05.097510 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2977/6001] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:04 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1648 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:05.150763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-129771900", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "919d5938-0107-44fe-b73b-06e60ddbe1f0"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:38:05.204491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] validate_networks() for [('919d5938-0107-44fe-b73b-06e60ddbe1f0', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:38:05.550376 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:38:05.550811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:38:05.551296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:38:05.551717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:38:05.552166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:38:05.561577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:05.562092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:05.562895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:05.563338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:05.580408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Getting quotas for project 548e808b546044df903a929dfb8a6900. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:38:05.585686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Getting quotas for user fd831e5fee154f41aeacb1cf9196939e and project 548e808b546044df903a929dfb8a6900. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:38:05.599026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:38:05.601196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:38:05.719284 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8c2e9964-df34-47ed-9b5e-743fe87c8fab tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572342 May 28 21:38:05.719867 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3025/6002] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:38:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:38:05.729764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b9bf0385-9399-4553-b380-90a8049cfa2e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:05.730458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b9bf0385-9399-4553-b380-90a8049cfa2e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:05.789901 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b9bf0385-9399-4553-b380-90a8049cfa2e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1328 microversion: 2.1 time: 0.063814 May 28 21:38:05.790532 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2978/6003] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:05 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1328 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:06.807628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2570d102-5141-48af-bde4-785beb38502e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:06.808257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2570d102-5141-48af-bde4-785beb38502e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:06.814538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2570d102-5141-48af-bde4-785beb38502e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:06.814997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2570d102-5141-48af-bde4-785beb38502e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:06.815773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2570d102-5141-48af-bde4-785beb38502e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:06.816220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2570d102-5141-48af-bde4-785beb38502e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:06.885374 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2570d102-5141-48af-bde4-785beb38502e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1337 microversion: 2.1 time: 0.082360 May 28 21:38:06.885990 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3026/6004] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:06 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1337 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:07.908126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3f824a9d-eb9e-4114-a811-35f2767cb78c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:07.908696 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3f824a9d-eb9e-4114-a811-35f2767cb78c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:07.916728 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f824a9d-eb9e-4114-a811-35f2767cb78c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:07.917703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f824a9d-eb9e-4114-a811-35f2767cb78c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:07.918612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f824a9d-eb9e-4114-a811-35f2767cb78c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:07.919061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3f824a9d-eb9e-4114-a811-35f2767cb78c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:07.986194 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3f824a9d-eb9e-4114-a811-35f2767cb78c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1421 microversion: 2.1 time: 0.081924 May 28 21:38:07.986766 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2979/6005] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:07 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1421 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:09.011389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2fc56900-6877-40c6-b8e1-a7b2ca7fe25d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:09.012795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2fc56900-6877-40c6-b8e1-a7b2ca7fe25d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:09.020129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fc56900-6877-40c6-b8e1-a7b2ca7fe25d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:09.021131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fc56900-6877-40c6-b8e1-a7b2ca7fe25d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:09.022004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fc56900-6877-40c6-b8e1-a7b2ca7fe25d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:09.022675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2fc56900-6877-40c6-b8e1-a7b2ca7fe25d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:09.035718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-6e2ddc61-fc2b-403f-985b-75605bfd9fc5 req-0a322401-5f35-454a-bc31-e6f4a44c22be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712", "tag": "7783699b-2420-40b7-a38b-5e1c55f6a0df"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:38:09.047095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6e2ddc61-fc2b-403f-985b-75605bfd9fc5 req-0a322401-5f35-454a-bc31-e6f4a44c22be service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:09.047843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-6e2ddc61-fc2b-403f-985b-75605bfd9fc5 req-0a322401-5f35-454a-bc31-e6f4a44c22be service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:09.070071 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-6e2ddc61-fc2b-403f-985b-75605bfd9fc5 req-0a322401-5f35-454a-bc31-e6f4a44c22be service nova] Creating event network-changed:7783699b-2420-40b7-a38b-5e1c55f6a0df for instance 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 on nch2-master-1 May 28 21:38:09.082716 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-6e2ddc61-fc2b-403f-985b-75605bfd9fc5 req-0a322401-5f35-454a-bc31-e6f4a44c22be service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050848 May 28 21:38:09.083680 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2980/6006] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:38:09.268521 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2fc56900-6877-40c6-b8e1-a7b2ca7fe25d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1463 microversion: 2.1 time: 0.261279 May 28 21:38:09.269351 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3027/6007] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:09 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1463 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:38:10.287421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-98dabb7f-e14e-43ea-832b-b83d2e9f7efe tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:10.288137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-98dabb7f-e14e-43ea-832b-b83d2e9f7efe tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:10.295069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98dabb7f-e14e-43ea-832b-b83d2e9f7efe tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:10.295529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98dabb7f-e14e-43ea-832b-b83d2e9f7efe tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:10.296300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98dabb7f-e14e-43ea-832b-b83d2e9f7efe tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:10.296745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98dabb7f-e14e-43ea-832b-b83d2e9f7efe tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:10.421496 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-98dabb7f-e14e-43ea-832b-b83d2e9f7efe tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1463 microversion: 2.1 time: 0.138986 May 28 21:38:10.422118 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2981/6008] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:10 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1463 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:11.442557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-074e1080-fa19-4341-a562-a27d0df64b7e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:11.443151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-074e1080-fa19-4341-a562-a27d0df64b7e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:11.450297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-074e1080-fa19-4341-a562-a27d0df64b7e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:11.450758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-074e1080-fa19-4341-a562-a27d0df64b7e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:11.451584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-074e1080-fa19-4341-a562-a27d0df64b7e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:11.452060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-074e1080-fa19-4341-a562-a27d0df64b7e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:11.581674 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-074e1080-fa19-4341-a562-a27d0df64b7e tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1463 microversion: 2.1 time: 0.142960 May 28 21:38:11.582339 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3028/6009] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:11 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1463 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:12.599525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6fdc528f-3947-4727-8902-4ac886f67ce3 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:12.606376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6fdc528f-3947-4727-8902-4ac886f67ce3 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:12.607652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fdc528f-3947-4727-8902-4ac886f67ce3 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:12.608107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fdc528f-3947-4727-8902-4ac886f67ce3 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:12.608871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fdc528f-3947-4727-8902-4ac886f67ce3 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:12.609310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6fdc528f-3947-4727-8902-4ac886f67ce3 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:12.736225 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6fdc528f-3947-4727-8902-4ac886f67ce3 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1463 microversion: 2.1 time: 0.140424 May 28 21:38:12.736815 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2982/6010] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:12 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1463 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:13.753822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0bfa8701-233a-48fb-b7ac-c2518aeabbfc tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:13.754484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0bfa8701-233a-48fb-b7ac-c2518aeabbfc tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:13.761734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0bfa8701-233a-48fb-b7ac-c2518aeabbfc tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:13.762222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0bfa8701-233a-48fb-b7ac-c2518aeabbfc tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:13.763000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0bfa8701-233a-48fb-b7ac-c2518aeabbfc tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:13.763448 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0bfa8701-233a-48fb-b7ac-c2518aeabbfc tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:13.891733 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0bfa8701-233a-48fb-b7ac-c2518aeabbfc tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1463 microversion: 2.1 time: 0.141940 May 28 21:38:13.892314 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3029/6011] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:13 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1463 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:14.908437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-15c91925-5669-4c11-8352-a74bf4c81f94 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:14.909009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-15c91925-5669-4c11-8352-a74bf4c81f94 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:14.916112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15c91925-5669-4c11-8352-a74bf4c81f94 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:14.916569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15c91925-5669-4c11-8352-a74bf4c81f94 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:14.917900 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15c91925-5669-4c11-8352-a74bf4c81f94 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:14.918346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-15c91925-5669-4c11-8352-a74bf4c81f94 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:15.043201 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-15c91925-5669-4c11-8352-a74bf4c81f94 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1463 microversion: 2.1 time: 0.138558 May 28 21:38:15.043787 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2983/6012] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:14 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1463 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:15.342494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f8bfa56e-e5a1-4328-8e79-bcfa05882532 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:15.343021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f8bfa56e-e5a1-4328-8e79-bcfa05882532 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:15.350038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8bfa56e-e5a1-4328-8e79-bcfa05882532 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:15.350500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8bfa56e-e5a1-4328-8e79-bcfa05882532 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:15.351266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8bfa56e-e5a1-4328-8e79-bcfa05882532 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:15.351707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f8bfa56e-e5a1-4328-8e79-bcfa05882532 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:15.377689 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f8bfa56e-e5a1-4328-8e79-bcfa05882532 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88/ips" status: 200 len: 149 microversion: 2.1 time: 0.039908 May 28 21:38:15.378343 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3030/6013] 10.222.0.33 () {58 vars in 1247 bytes} [Sat May 28 21:38:15 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:38:16.060415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-496009c8-0a30-467b-a23c-702defa03ee0 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:16.061076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-496009c8-0a30-467b-a23c-702defa03ee0 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:16.063127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:38:16.069059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-496009c8-0a30-467b-a23c-702defa03ee0 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:16.069450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-496009c8-0a30-467b-a23c-702defa03ee0 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:16.070257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-496009c8-0a30-467b-a23c-702defa03ee0 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:16.070704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-496009c8-0a30-467b-a23c-702defa03ee0 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:16.222003 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-496009c8-0a30-467b-a23c-702defa03ee0 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1463 microversion: 2.1 time: 0.165743 May 28 21:38:16.222594 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2984/6014] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:16 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1463 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:16.376039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-4ce44c63-dfdd-451b-bead-cd9099c859b5 req-09b91468-58c3-4c97-8c55-d5cb911fa788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712", "name": "network-vif-plugged", "status": "completed", "tag": "7783699b-2420-40b7-a38b-5e1c55f6a0df"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:38:16.379768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:38:16.382852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:38:16.387067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4ce44c63-dfdd-451b-bead-cd9099c859b5 req-09b91468-58c3-4c97-8c55-d5cb911fa788 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:16.387524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4ce44c63-dfdd-451b-bead-cd9099c859b5 req-09b91468-58c3-4c97-8c55-d5cb911fa788 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:16.398775 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-4ce44c63-dfdd-451b-bead-cd9099c859b5 req-09b91468-58c3-4c97-8c55-d5cb911fa788 service nova] Creating event network-vif-plugged:7783699b-2420-40b7-a38b-5e1c55f6a0df for instance 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 on nch2-master-1 May 28 21:38:16.405912 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-4ce44c63-dfdd-451b-bead-cd9099c859b5 req-09b91468-58c3-4c97-8c55-d5cb911fa788 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031752 May 28 21:38:16.405912 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3031/6015] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:38:17.239531 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-136c8268-1fdc-4ac0-8dd3-986bbf6f2272 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:17.240238 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-136c8268-1fdc-4ac0-8dd3-986bbf6f2272 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:17.247820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-136c8268-1fdc-4ac0-8dd3-986bbf6f2272 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:17.248281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-136c8268-1fdc-4ac0-8dd3-986bbf6f2272 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:17.249050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-136c8268-1fdc-4ac0-8dd3-986bbf6f2272 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:17.249497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-136c8268-1fdc-4ac0-8dd3-986bbf6f2272 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:17.374418 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-136c8268-1fdc-4ac0-8dd3-986bbf6f2272 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1463 microversion: 2.1 time: 0.138716 May 28 21:38:17.375007 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2985/6016] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:17 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1463 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:18.169257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0a95faa9-043a-4f32-a726-2e56514e106b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8424c958-02ac-4e4c-9145-b75c712c7d07"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:38:18.170451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0a95faa9-043a-4f32-a726-2e56514e106b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:18.177622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a95faa9-043a-4f32-a726-2e56514e106b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:18.178122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a95faa9-043a-4f32-a726-2e56514e106b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:18.178907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a95faa9-043a-4f32-a726-2e56514e106b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:18.179355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a95faa9-043a-4f32-a726-2e56514e106b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:18.394575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3e7306da-d55f-4f4f-8e3d-87a134120391 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:18.395276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3e7306da-d55f-4f4f-8e3d-87a134120391 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:18.405002 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e7306da-d55f-4f4f-8e3d-87a134120391 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:18.405536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e7306da-d55f-4f4f-8e3d-87a134120391 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:18.406541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e7306da-d55f-4f4f-8e3d-87a134120391 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:18.407041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e7306da-d55f-4f4f-8e3d-87a134120391 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:18.539914 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3e7306da-d55f-4f4f-8e3d-87a134120391 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1649 microversion: 2.1 time: 0.150465 May 28 21:38:18.540495 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2986/6017] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:18 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1649 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:18.557750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b9180c03-d8d2-45eb-a634-83a91be17f7d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:18.558484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b9180c03-d8d2-45eb-a634-83a91be17f7d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:18.564511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9180c03-d8d2-45eb-a634-83a91be17f7d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:18.565080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9180c03-d8d2-45eb-a634-83a91be17f7d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:18.565745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9180c03-d8d2-45eb-a634-83a91be17f7d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:18.566212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b9180c03-d8d2-45eb-a634-83a91be17f7d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:18.692849 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b9180c03-d8d2-45eb-a634-83a91be17f7d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1649 microversion: 2.1 time: 0.138639 May 28 21:38:18.693430 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2987/6018] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:18 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1649 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:38:18.708633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2e9086d6-45da-435f-bcb0-553486035c90 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:18.712357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2e9086d6-45da-435f-bcb0-553486035c90 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:18.716088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e9086d6-45da-435f-bcb0-553486035c90 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:18.716546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e9086d6-45da-435f-bcb0-553486035c90 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:18.717327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e9086d6-45da-435f-bcb0-553486035c90 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:18.717773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e9086d6-45da-435f-bcb0-553486035c90 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:18.847677 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2e9086d6-45da-435f-bcb0-553486035c90 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1649 microversion: 2.1 time: 0.142445 May 28 21:38:18.848261 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2988/6019] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:18 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1649 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:38:18.863709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1f2f2567-b4e4-4b9e-82dc-70547491c164 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:18.864208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1f2f2567-b4e4-4b9e-82dc-70547491c164 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:18.870534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f2f2567-b4e4-4b9e-82dc-70547491c164 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:18.870992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f2f2567-b4e4-4b9e-82dc-70547491c164 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:18.871761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f2f2567-b4e4-4b9e-82dc-70547491c164 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:18.872205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f2f2567-b4e4-4b9e-82dc-70547491c164 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:18.897316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1f2f2567-b4e4-4b9e-82dc-70547491c164 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:38:18.910427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=100 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:38:18.995845 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0a95faa9-043a-4f32-a726-2e56514e106b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "POST /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.832080 May 28 21:38:18.996798 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3032/6020] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:38:18 2022] POST /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88/os-volume_attachments => generated 194 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:38:19.173087 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1f2f2567-b4e4-4b9e-82dc-70547491c164 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 204 len: 0 microversion: 2.1 time: 0.312570 May 28 21:38:19.173692 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2989/6021] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:38:18 2022] DELETE /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:38:19.183224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-29a8e7c8-fc1c-4030-9ab7-c25675b049ce tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:19.184022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-29a8e7c8-fc1c-4030-9ab7-c25675b049ce tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:19.192131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29a8e7c8-fc1c-4030-9ab7-c25675b049ce tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:19.192591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29a8e7c8-fc1c-4030-9ab7-c25675b049ce tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:19.193587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29a8e7c8-fc1c-4030-9ab7-c25675b049ce tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:19.194171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29a8e7c8-fc1c-4030-9ab7-c25675b049ce tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:19.335733 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-29a8e7c8-fc1c-4030-9ab7-c25675b049ce tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1655 microversion: 2.1 time: 0.157295 May 28 21:38:19.336325 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3033/6022] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:19 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:20.353693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-63c06926-7ab6-44f9-bb14-e889346c80ef tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:20.354397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-63c06926-7ab6-44f9-bb14-e889346c80ef tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:20.361287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63c06926-7ab6-44f9-bb14-e889346c80ef tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:20.361746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63c06926-7ab6-44f9-bb14-e889346c80ef tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:20.362590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63c06926-7ab6-44f9-bb14-e889346c80ef tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:20.363058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63c06926-7ab6-44f9-bb14-e889346c80ef tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:20.489917 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-63c06926-7ab6-44f9-bb14-e889346c80ef tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1655 microversion: 2.1 time: 0.140336 May 28 21:38:20.490544 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2990/6023] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:20 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1655 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:21.006852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-54229821-7603-47e0-83e2-d6265c67e602 req-8d774c92-d2bc-4130-8fc8-228788b02d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712", "name": "network-vif-deleted", "tag": "7783699b-2420-40b7-a38b-5e1c55f6a0df"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:38:21.021663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-54229821-7603-47e0-83e2-d6265c67e602 req-8d774c92-d2bc-4130-8fc8-228788b02d2f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:21.022182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-54229821-7603-47e0-83e2-d6265c67e602 req-8d774c92-d2bc-4130-8fc8-228788b02d2f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:21.038428 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-54229821-7603-47e0-83e2-d6265c67e602 req-8d774c92-d2bc-4130-8fc8-228788b02d2f service nova] Creating event network-vif-deleted:7783699b-2420-40b7-a38b-5e1c55f6a0df for instance 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 on nch2-master-1 May 28 21:38:21.044003 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-54229821-7603-47e0-83e2-d6265c67e602 req-8d774c92-d2bc-4130-8fc8-228788b02d2f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042365 May 28 21:38:21.044712 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3034/6024] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:38:21.507668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ded94c91-e5d5-4bb2-b2a2-4ef103372448 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:21.508192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ded94c91-e5d5-4bb2-b2a2-4ef103372448 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:21.515637 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ded94c91-e5d5-4bb2-b2a2-4ef103372448 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:21.516090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ded94c91-e5d5-4bb2-b2a2-4ef103372448 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:21.516858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ded94c91-e5d5-4bb2-b2a2-4ef103372448 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:21.517295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ded94c91-e5d5-4bb2-b2a2-4ef103372448 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:21.547644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ded94c91-e5d5-4bb2-b2a2-4ef103372448 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:21.548092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ded94c91-e5d5-4bb2-b2a2-4ef103372448 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:21.548545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-ded94c91-e5d5-4bb2-b2a2-4ef103372448 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lazy-loading 'fault' on Instance uuid 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:38:21.596074 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ded94c91-e5d5-4bb2-b2a2-4ef103372448 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 200 len: 1453 microversion: 2.1 time: 0.092253 May 28 21:38:21.596651 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2991/6025] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:21 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:22.614633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-98290df4-9046-4932-8bac-196c277ea13c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:22.615372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-98290df4-9046-4932-8bac-196c277ea13c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:22.617392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:38:22.622484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98290df4-9046-4932-8bac-196c277ea13c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:22.622971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98290df4-9046-4932-8bac-196c277ea13c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:22.623704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98290df4-9046-4932-8bac-196c277ea13c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:22.624148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98290df4-9046-4932-8bac-196c277ea13c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:22.637242 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-98290df4-9046-4932-8bac-196c277ea13c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] HTTP exception thrown: Instance 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 could not be found. May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-98290df4-9046-4932-8bac-196c277ea13c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Request method failure captured: May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 HTTP/1.1 May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpYwTEraghOF634tpE3S0iNPa52w10thtHFl0edqX5AqFlNX7r7ATHf2JcVODnsodM7LJ_3GxWupRZgaZI24DiuFAiB9E3WsUKtuQuuvLFLqWT56SyoN32D2XCIbb1dUV0VQERDS-yYVfTzAfdl9aFFMVoaTzI2ye0BVWALSOABpEJE May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 548e808b546044df903a929dfb8a6900 May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestServerMultinode-1384046119 May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_548e808b546044df903a929dfb8a6900", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/548e808b546044df903a929dfb8a6900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/548e808b546044df903a929dfb8a6900"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/548e808b546044df903a929dfb8a6900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestServerMultinode-1384046119 May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 548e808b546044df903a929dfb8a6900 May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestServerMultinode-1384046119 May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestServerMultinode-1384046119-project-admin May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: fd831e5fee154f41aeacb1cf9196939e May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestServerMultinode-1384046119-project-admin May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 could not be found. May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712'} May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 could not be found. May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 could not be found. May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:22.638928 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:22.644040 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:22.644040 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:22.644040 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:22.644040 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:38:22.644040 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:38:22.644040 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 could not be found. May 28 21:38:22.644040 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:22.644040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-98290df4-9046-4932-8bac-196c277ea13c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Returning 404 to user: Instance 8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:38:22.644040 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-98290df4-9046-4932-8bac-196c277ea13c tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712" status: 404 len: 111 microversion: 2.1 time: 0.030960 May 28 21:38:22.644040 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3035/6026] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:22 2022] GET /compute/v2.1/servers/8b9bf1d7-8e74-481b-9c1f-c7e66b3ba712 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:38:22.649183 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f3952576-fc95-47ad-9ce5-78e275fea8f9 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:22.649711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f3952576-fc95-47ad-9ce5-78e275fea8f9 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:22.653450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:38:22.658545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3952576-fc95-47ad-9ce5-78e275fea8f9 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:22.659014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3952576-fc95-47ad-9ce5-78e275fea8f9 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:22.659797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3952576-fc95-47ad-9ce5-78e275fea8f9 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:22.660249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3952576-fc95-47ad-9ce5-78e275fea8f9 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:22.685684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f3952576-fc95-47ad-9ce5-78e275fea8f9 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:38:22.932469 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f3952576-fc95-47ad-9ce5-78e275fea8f9 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "DELETE /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 204 len: 0 microversion: 2.1 time: 0.286833 May 28 21:38:22.932969 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2992/6027] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:38:22 2022] DELETE /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:38:22.941469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4f853d6f-9a0d-4ba2-b0e9-b496bffd4d54 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:22.942137 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4f853d6f-9a0d-4ba2-b0e9-b496bffd4d54 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:22.949380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f853d6f-9a0d-4ba2-b0e9-b496bffd4d54 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:22.949856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f853d6f-9a0d-4ba2-b0e9-b496bffd4d54 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:22.950632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f853d6f-9a0d-4ba2-b0e9-b496bffd4d54 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:22.951081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4f853d6f-9a0d-4ba2-b0e9-b496bffd4d54 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:22.954953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:38:23.079430 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4f853d6f-9a0d-4ba2-b0e9-b496bffd4d54 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1654 microversion: 2.1 time: 0.142047 May 28 21:38:23.080011 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3036/6028] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:22 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1654 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:23.428058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2085482f-c36d-4555-9e83-279016d86610 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:23.428652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2085482f-c36d-4555-9e83-279016d86610 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:23.435274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2085482f-c36d-4555-9e83-279016d86610 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:23.435723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2085482f-c36d-4555-9e83-279016d86610 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:23.436642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2085482f-c36d-4555-9e83-279016d86610 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:23.437090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2085482f-c36d-4555-9e83-279016d86610 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:23.518811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-2085482f-c36d-4555-9e83-279016d86610 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lazy-loading 'services' on Instance uuid 20afe6e9-95dd-459a-b79d-28211a95df88 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:38:23.760906 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2085482f-c36d-4555-9e83-279016d86610 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "DELETE /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88/os-volume_attachments/8424c958-02ac-4e4c-9145-b75c712c7d07" status: 202 len: 0 microversion: 2.1 time: 0.336971 May 28 21:38:23.761737 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2993/6029] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:38:23 2022] DELETE /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88/os-volume_attachments/8424c958-02ac-4e4c-9145-b75c712c7d07 => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:38:23.773688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bdbc7ac0-ed6f-4f7f-91f7-c79376d442d9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:23.774718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bdbc7ac0-ed6f-4f7f-91f7-c79376d442d9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:23.782549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bdbc7ac0-ed6f-4f7f-91f7-c79376d442d9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:23.783005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bdbc7ac0-ed6f-4f7f-91f7-c79376d442d9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:23.783773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bdbc7ac0-ed6f-4f7f-91f7-c79376d442d9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:23.784216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bdbc7ac0-ed6f-4f7f-91f7-c79376d442d9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:23.814494 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bdbc7ac0-ed6f-4f7f-91f7-c79376d442d9 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044749 May 28 21:38:23.814982 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3037/6030] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:38:23 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:38:24.097615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dd1af323-80cb-4e56-aa48-5cdebbb37395 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:24.098436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dd1af323-80cb-4e56-aa48-5cdebbb37395 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:24.105349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd1af323-80cb-4e56-aa48-5cdebbb37395 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:24.105803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd1af323-80cb-4e56-aa48-5cdebbb37395 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:24.106596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd1af323-80cb-4e56-aa48-5cdebbb37395 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:24.107036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dd1af323-80cb-4e56-aa48-5cdebbb37395 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:24.234615 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dd1af323-80cb-4e56-aa48-5cdebbb37395 tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1654 microversion: 2.1 time: 0.141155 May 28 21:38:24.235199 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2994/6031] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:24 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1654 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:24.772762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-7dc9d305-1461-4671-9eaa-8fdebddec035 req-ed650aef-f0e6-44f5-8113-c5079964d418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a2eb78-9ddc-4bed-bd0f-ddd30a175be4", "name": "network-vif-deleted", "tag": "560f74a3-26ec-4cf0-b93b-bd8920e3dd9e"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:38:24.783465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7dc9d305-1461-4671-9eaa-8fdebddec035 req-ed650aef-f0e6-44f5-8113-c5079964d418 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:24.784090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-7dc9d305-1461-4671-9eaa-8fdebddec035 req-ed650aef-f0e6-44f5-8113-c5079964d418 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:24.796003 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-7dc9d305-1461-4671-9eaa-8fdebddec035 req-ed650aef-f0e6-44f5-8113-c5079964d418 service nova] Creating event network-vif-deleted:560f74a3-26ec-4cf0-b93b-bd8920e3dd9e for instance 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 on nch1-master-1 May 28 21:38:24.801706 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-7dc9d305-1461-4671-9eaa-8fdebddec035 req-ed650aef-f0e6-44f5-8113-c5079964d418 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032645 May 28 21:38:24.802492 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3038/6032] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:38:24.826754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-48db6f6e-f5ef-43f3-9d03-1dd04de09cf8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:24.827766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-48db6f6e-f5ef-43f3-9d03-1dd04de09cf8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:24.835062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-48db6f6e-f5ef-43f3-9d03-1dd04de09cf8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:24.841042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-48db6f6e-f5ef-43f3-9d03-1dd04de09cf8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:24.841042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-48db6f6e-f5ef-43f3-9d03-1dd04de09cf8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:24.841042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-48db6f6e-f5ef-43f3-9d03-1dd04de09cf8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:24.869659 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-48db6f6e-f5ef-43f3-9d03-1dd04de09cf8 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047417 May 28 21:38:24.872784 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2995/6033] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:38:24 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:38:24.934489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8371a096-3fe1-446f-b969-b46d8eb70985 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:24.935031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8371a096-3fe1-446f-b969-b46d8eb70985 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:24.941488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8371a096-3fe1-446f-b969-b46d8eb70985 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:24.941985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8371a096-3fe1-446f-b969-b46d8eb70985 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:24.942761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8371a096-3fe1-446f-b969-b46d8eb70985 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:24.943202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8371a096-3fe1-446f-b969-b46d8eb70985 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:24.971834 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8371a096-3fe1-446f-b969-b46d8eb70985 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:38:25.255310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d571972b-d9f9-48e9-9537-1577bc2efb4b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:25.255881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d571972b-d9f9-48e9-9537-1577bc2efb4b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:25.262087 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d571972b-d9f9-48e9-9537-1577bc2efb4b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:25.262548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d571972b-d9f9-48e9-9537-1577bc2efb4b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:25.263324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d571972b-d9f9-48e9-9537-1577bc2efb4b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:25.263770 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d571972b-d9f9-48e9-9537-1577bc2efb4b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:25.293926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d571972b-d9f9-48e9-9537-1577bc2efb4b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:25.294387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d571972b-d9f9-48e9-9537-1577bc2efb4b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:25.294845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-d571972b-d9f9-48e9-9537-1577bc2efb4b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lazy-loading 'fault' on Instance uuid 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:38:25.298101 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8371a096-3fe1-446f-b969-b46d8eb70985 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "DELETE /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 204 len: 0 microversion: 2.1 time: 0.368209 May 28 21:38:25.298725 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3039/6034] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:38:24 2022] DELETE /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:38:25.308501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-efc57f7d-aeb6-4f65-8f0a-0aea206e46e7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:25.314542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-efc57f7d-aeb6-4f65-8f0a-0aea206e46e7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:25.320801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-efc57f7d-aeb6-4f65-8f0a-0aea206e46e7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:25.321256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-efc57f7d-aeb6-4f65-8f0a-0aea206e46e7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:25.322153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-efc57f7d-aeb6-4f65-8f0a-0aea206e46e7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:25.322596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-efc57f7d-aeb6-4f65-8f0a-0aea206e46e7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:25.345138 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d571972b-d9f9-48e9-9537-1577bc2efb4b tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 200 len: 1453 microversion: 2.1 time: 0.093724 May 28 21:38:25.346326 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2996/6035] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:25 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:38:25.458106 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-efc57f7d-aeb6-4f65-8f0a-0aea206e46e7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:38:25.466150 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-efc57f7d-aeb6-4f65-8f0a-0aea206e46e7 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 200 len: 1680 microversion: 2.1 time: 0.162981 May 28 21:38:25.466730 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3040/6036] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:25 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:38:26.361948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f662294a-343a-471e-9b75-3bc1f117312d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:26.362506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f662294a-343a-471e-9b75-3bc1f117312d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] [instance: 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:26.369549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f662294a-343a-471e-9b75-3bc1f117312d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:26.370040 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f662294a-343a-471e-9b75-3bc1f117312d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:26.371837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f662294a-343a-471e-9b75-3bc1f117312d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:26.372214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f662294a-343a-471e-9b75-3bc1f117312d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:26.385250 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-f662294a-343a-471e-9b75-3bc1f117312d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] HTTP exception thrown: Instance 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 could not be found. May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f662294a-343a-471e-9b75-3bc1f117312d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Request method failure captured: May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 HTTP/1.1 May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpYwTEraghOF634tpE3S0iNPa52w10thtHFl0edqX5AqFlNX7r7ATHf2JcVODnsodM7LJ_3GxWupRZgaZI24DiuFAiB9E3WsUKtuQuuvLFLqWT56SyoN32D2XCIbb1dUV0VQERDS-yYVfTzAfdl9aFFMVoaTzI2ye0BVWALSOABpEJE May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 548e808b546044df903a929dfb8a6900 May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestServerMultinode-1384046119 May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_548e808b546044df903a929dfb8a6900", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/548e808b546044df903a929dfb8a6900"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/548e808b546044df903a929dfb8a6900"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/548e808b546044df903a929dfb8a6900"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestServerMultinode-1384046119 May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 548e808b546044df903a929dfb8a6900 May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestServerMultinode-1384046119 May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestServerMultinode-1384046119-project-admin May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: fd831e5fee154f41aeacb1cf9196939e May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestServerMultinode-1384046119-project-admin May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 could not be found. May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '34a2eb78-9ddc-4bed-bd0f-ddd30a175be4'} May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 could not be found. May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 could not be found. May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:26.387565 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:26.393058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:26.393058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:26.393058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:26.393058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:38:26.393058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:38:26.393058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 could not be found. May 28 21:38:26.393058 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:26.393058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f662294a-343a-471e-9b75-3bc1f117312d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] Returning 404 to user: Instance 34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:38:26.393058 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f662294a-343a-471e-9b75-3bc1f117312d tempest-TestServerMultinode-1384046119 tempest-TestServerMultinode-1384046119-project-admin] 10.222.0.33 "GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4" status: 404 len: 111 microversion: 2.1 time: 0.030879 May 28 21:38:26.393058 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2997/6037] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:26 2022] GET /compute/v2.1/servers/34a2eb78-9ddc-4bed-bd0f-ddd30a175be4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:38:26.483666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e7cfd671-01ff-43ee-a7e3-6d4866d5a655 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:26.484251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e7cfd671-01ff-43ee-a7e3-6d4866d5a655 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:26.491325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7cfd671-01ff-43ee-a7e3-6d4866d5a655 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:26.500150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7cfd671-01ff-43ee-a7e3-6d4866d5a655 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:26.500150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7cfd671-01ff-43ee-a7e3-6d4866d5a655 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:26.500150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e7cfd671-01ff-43ee-a7e3-6d4866d5a655 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:26.704753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e7cfd671-01ff-43ee-a7e3-6d4866d5a655 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:38:26.712631 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e7cfd671-01ff-43ee-a7e3-6d4866d5a655 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 200 len: 1680 microversion: 2.1 time: 0.232924 May 28 21:38:26.713217 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3041/6038] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:26 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 1680 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:27.730321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-87c2bdac-20df-4a46-a09a-35eada1db70b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:27.730948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-87c2bdac-20df-4a46-a09a-35eada1db70b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:27.738025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87c2bdac-20df-4a46-a09a-35eada1db70b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:27.738485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87c2bdac-20df-4a46-a09a-35eada1db70b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:27.739390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87c2bdac-20df-4a46-a09a-35eada1db70b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:27.739832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87c2bdac-20df-4a46-a09a-35eada1db70b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:28.022267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-87c2bdac-20df-4a46-a09a-35eada1db70b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:38:28.030016 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-87c2bdac-20df-4a46-a09a-35eada1db70b tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 200 len: 1680 microversion: 2.1 time: 0.303735 May 28 21:38:28.030626 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2998/6039] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:27 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 1680 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:28.695652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-1da86394-e87e-4938-a88c-8d388f06f70f req-a956d58a-399a-4298-b6f4-32525a772012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20afe6e9-95dd-459a-b79d-28211a95df88", "name": "network-vif-deleted", "tag": "d5404c04-ff1d-452e-b436-4e2d59b13e28"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:38:28.705087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1da86394-e87e-4938-a88c-8d388f06f70f req-a956d58a-399a-4298-b6f4-32525a772012 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:28.707636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1da86394-e87e-4938-a88c-8d388f06f70f req-a956d58a-399a-4298-b6f4-32525a772012 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:28.719031 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-1da86394-e87e-4938-a88c-8d388f06f70f req-a956d58a-399a-4298-b6f4-32525a772012 service nova] Creating event network-vif-deleted:d5404c04-ff1d-452e-b436-4e2d59b13e28 for instance 20afe6e9-95dd-459a-b79d-28211a95df88 on nch2-master-1 May 28 21:38:28.723968 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-1da86394-e87e-4938-a88c-8d388f06f70f req-a956d58a-399a-4298-b6f4-32525a772012 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032017 May 28 21:38:28.724957 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3042/6040] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:38:29.049702 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ed24cac2-326e-48ed-9e15-72ea9c7afb32 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:29.050993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ed24cac2-326e-48ed-9e15-72ea9c7afb32 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:29.069292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed24cac2-326e-48ed-9e15-72ea9c7afb32 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:29.070063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed24cac2-326e-48ed-9e15-72ea9c7afb32 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:29.070869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed24cac2-326e-48ed-9e15-72ea9c7afb32 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:29.071478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed24cac2-326e-48ed-9e15-72ea9c7afb32 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:29.114912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed24cac2-326e-48ed-9e15-72ea9c7afb32 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:29.115877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed24cac2-326e-48ed-9e15-72ea9c7afb32 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:29.116346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-ed24cac2-326e-48ed-9e15-72ea9c7afb32 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lazy-loading 'fault' on Instance uuid 20afe6e9-95dd-459a-b79d-28211a95df88 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:38:29.199633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ed24cac2-326e-48ed-9e15-72ea9c7afb32 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16d0e791edd4f119e646e7ced74bf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9c9caba58394e1480acb632405111c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:38:29.209781 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ed24cac2-326e-48ed-9e15-72ea9c7afb32 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 200 len: 1331 microversion: 2.1 time: 0.166394 May 28 21:38:29.211208 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 2999/6041] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:29 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 1331 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:30.229769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1f6fddf2-5f68-4b0d-bb60-9110357b8cf4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:30.231123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1f6fddf2-5f68-4b0d-bb60-9110357b8cf4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:30.237491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f6fddf2-5f68-4b0d-bb60-9110357b8cf4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:30.237984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f6fddf2-5f68-4b0d-bb60-9110357b8cf4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:30.238756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f6fddf2-5f68-4b0d-bb60-9110357b8cf4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:30.239197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1f6fddf2-5f68-4b0d-bb60-9110357b8cf4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:30.253529 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-1f6fddf2-5f68-4b0d-bb60-9110357b8cf4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] HTTP exception thrown: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1f6fddf2-5f68-4b0d-bb60-9110357b8cf4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Request method failure captured: May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 HTTP/1.1 May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpVRO-mAxq6p3GCM6f9DBOuC6gM1jLrQkTcIGTva2AkLnRSMUBqa-v9eVXfkm2PMd8NeLYhF-4I6HJDUZ-KSNTa0czoN9va3UpuGRFgQJU4y4HLnhbLb00NIsPyXWHr82FwRNk4pOcjox7d1rlRD_kjkv5QsGlOaJ5XjMoC8y-HfNC4 May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f9c9caba58394e1480acb632405111c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f9c9caba58394e1480acb632405111c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: b16d0e791edd4f119e646e7ced74bf74 May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '20afe6e9-95dd-459a-b79d-28211a95df88'} May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:30.254694 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:30.259118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:30.259118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:30.259118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:30.259118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:38:30.259118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:38:30.259118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. May 28 21:38:30.259118 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:30.259118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1f6fddf2-5f68-4b0d-bb60-9110357b8cf4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Returning 404 to user: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:38:30.259118 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1f6fddf2-5f68-4b0d-bb60-9110357b8cf4 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 404 len: 111 microversion: 2.1 time: 0.031795 May 28 21:38:30.259118 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3043/6042] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:30 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:38:30.265389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d78fda7e-29c3-4bdd-a0c7-0439953f68bb tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '.version_select at 0x7f4d5757e280>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:30.359344 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d78fda7e-29c3-4bdd-a0c7-0439953f68bb tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1490929733" status: 202 len: 0 microversion: 2.1 time: 0.097868 May 28 21:38:30.363880 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3000/6043] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 21:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1490929733 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:38:35.125641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4e644908-7d64-44a4-a9f5-edce7b6a3199 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:35.126340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4e644908-7d64-44a4-a9f5-edce7b6a3199 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:35.134167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e644908-7d64-44a4-a9f5-edce7b6a3199 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:35.134641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e644908-7d64-44a4-a9f5-edce7b6a3199 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:35.136712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e644908-7d64-44a4-a9f5-edce7b6a3199 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:35.137176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e644908-7d64-44a4-a9f5-edce7b6a3199 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:35.151448 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-4e644908-7d64-44a4-a9f5-edce7b6a3199 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] HTTP exception thrown: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4e644908-7d64-44a4-a9f5-edce7b6a3199 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Request method failure captured: May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 HTTP/1.1 May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpVRO-mAxq6p3GCM6f9DBOuC6gM1jLrQkTcIGTva2AkLnRSMUBqa-v9eVXfkm2PMd8NeLYhF-4I6HJDUZ-KSNTa0czoN9va3UpuGRFgQJU4y4HLnhbLb00NIsPyXWHr82FwRNk4pOcjox7d1rlRD_kjkv5QsGlOaJ5XjMoC8y-HfNC4 May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f9c9caba58394e1480acb632405111c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f9c9caba58394e1480acb632405111c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: b16d0e791edd4f119e646e7ced74bf74 May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '20afe6e9-95dd-459a-b79d-28211a95df88'} May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:38:35.153647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:38:35.157984 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. May 28 21:38:35.157984 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:35.157984 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:35.157984 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:35.157984 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:35.157984 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:35.157984 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:35.157984 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:38:35.157984 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:38:35.157984 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. May 28 21:38:35.157984 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:35.157984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4e644908-7d64-44a4-a9f5-edce7b6a3199 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Returning 404 to user: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:38:35.157984 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4e644908-7d64-44a4-a9f5-edce7b6a3199 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "DELETE /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 404 len: 111 microversion: 2.1 time: 0.033544 May 28 21:38:35.157984 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3044/6044] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:38:35 2022] DELETE /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:38:35.165057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-db984d99-75f1-49e7-8976-27780c87fc64 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:35.165717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-db984d99-75f1-49e7-8976-27780c87fc64 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 20afe6e9-95dd-459a-b79d-28211a95df88] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:35.172675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db984d99-75f1-49e7-8976-27780c87fc64 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:35.173141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db984d99-75f1-49e7-8976-27780c87fc64 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:35.173951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db984d99-75f1-49e7-8976-27780c87fc64 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:35.174397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db984d99-75f1-49e7-8976-27780c87fc64 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:35.187886 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-db984d99-75f1-49e7-8976-27780c87fc64 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] HTTP exception thrown: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-db984d99-75f1-49e7-8976-27780c87fc64 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Request method failure captured: May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 HTTP/1.1 May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpVRO-mAxq6p3GCM6f9DBOuC6gM1jLrQkTcIGTva2AkLnRSMUBqa-v9eVXfkm2PMd8NeLYhF-4I6HJDUZ-KSNTa0czoN9va3UpuGRFgQJU4y4HLnhbLb00NIsPyXWHr82FwRNk4pOcjox7d1rlRD_kjkv5QsGlOaJ5XjMoC8y-HfNC4 May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f9c9caba58394e1480acb632405111c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f9c9caba58394e1480acb632405111c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: b16d0e791edd4f119e646e7ced74bf74 May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '20afe6e9-95dd-459a-b79d-28211a95df88'} May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:35.192541 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:35.197247 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:35.197247 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:35.197247 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:35.197247 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:38:35.197247 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:38:35.197247 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. May 28 21:38:35.197247 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:35.197247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-db984d99-75f1-49e7-8976-27780c87fc64 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Returning 404 to user: Instance 20afe6e9-95dd-459a-b79d-28211a95df88 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:38:35.197247 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-db984d99-75f1-49e7-8976-27780c87fc64 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88" status: 404 len: 111 microversion: 2.1 time: 0.030854 May 28 21:38:35.197247 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3001/6045] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:35 2022] GET /compute/v2.1/servers/20afe6e9-95dd-459a-b79d-28211a95df88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:38:39.628797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e70da695-3e69-4f90-adcb-2a55a1be221c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:39.629396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e70da695-3e69-4f90-adcb-2a55a1be221c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:39.636997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e70da695-3e69-4f90-adcb-2a55a1be221c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:39.637460 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e70da695-3e69-4f90-adcb-2a55a1be221c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:39.638561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e70da695-3e69-4f90-adcb-2a55a1be221c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:39.639029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e70da695-3e69-4f90-adcb-2a55a1be221c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:39.653388 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-e70da695-3e69-4f90-adcb-2a55a1be221c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] HTTP exception thrown: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e70da695-3e69-4f90-adcb-2a55a1be221c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Request method failure captured: May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 HTTP/1.1 May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpVRO-mAxq6p3GCM6f9DBOuC6gM1jLrQkTcIGTva2AkLnRSMUBqa-v9eVXfkm2PMd8NeLYhF-4I6HJDUZ-KSNTa0czoN9va3UpuGRFgQJU4y4HLnhbLb00NIsPyXWHr82FwRNk4pOcjox7d1rlRD_kjkv5QsGlOaJ5XjMoC8y-HfNC4 May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f9c9caba58394e1480acb632405111c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f9c9caba58394e1480acb632405111c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: b16d0e791edd4f119e646e7ced74bf74 May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '85d3a945-5fc1-4084-82da-73e2bc0604d5'} May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:38:39.655026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:38:39.659899 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. May 28 21:38:39.659899 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:39.659899 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:39.659899 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:39.659899 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:39.659899 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:39.659899 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:39.659899 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:38:39.659899 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:38:39.659899 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. May 28 21:38:39.659899 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:39.659899 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e70da695-3e69-4f90-adcb-2a55a1be221c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Returning 404 to user: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:38:39.659899 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e70da695-3e69-4f90-adcb-2a55a1be221c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "DELETE /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 404 len: 111 microversion: 2.1 time: 0.032821 May 28 21:38:39.659899 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3045/6046] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:38:39 2022] DELETE /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:38:39.664914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-517717a1-d581-4946-887a-04774b7bf648 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:39.665566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-517717a1-d581-4946-887a-04774b7bf648 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 85d3a945-5fc1-4084-82da-73e2bc0604d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:39.673208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-517717a1-d581-4946-887a-04774b7bf648 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:39.673657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-517717a1-d581-4946-887a-04774b7bf648 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:39.674459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-517717a1-d581-4946-887a-04774b7bf648 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:39.674902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-517717a1-d581-4946-887a-04774b7bf648 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:39.690870 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-517717a1-d581-4946-887a-04774b7bf648 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] HTTP exception thrown: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-517717a1-d581-4946-887a-04774b7bf648 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Request method failure captured: May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 HTTP/1.1 May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpVRO-mAxq6p3GCM6f9DBOuC6gM1jLrQkTcIGTva2AkLnRSMUBqa-v9eVXfkm2PMd8NeLYhF-4I6HJDUZ-KSNTa0czoN9va3UpuGRFgQJU4y4HLnhbLb00NIsPyXWHr82FwRNk4pOcjox7d1rlRD_kjkv5QsGlOaJ5XjMoC8y-HfNC4 May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f9c9caba58394e1480acb632405111c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f9c9caba58394e1480acb632405111c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: b16d0e791edd4f119e646e7ced74bf74 May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '85d3a945-5fc1-4084-82da-73e2bc0604d5'} May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:39.692402 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:39.697554 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:39.697554 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:39.697554 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:39.697554 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:38:39.697554 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:38:39.697554 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. May 28 21:38:39.697554 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:39.697554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-517717a1-d581-4946-887a-04774b7bf648 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Returning 404 to user: Instance 85d3a945-5fc1-4084-82da-73e2bc0604d5 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:38:39.697554 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-517717a1-d581-4946-887a-04774b7bf648 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5" status: 404 len: 111 microversion: 2.1 time: 0.032741 May 28 21:38:39.697554 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3002/6047] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:39 2022] GET /compute/v2.1/servers/85d3a945-5fc1-4084-82da-73e2bc0604d5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:38:39.702208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d33b6b1b-c008-4e0a-a85f-241d6efcbea6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:39.702717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d33b6b1b-c008-4e0a-a85f-241d6efcbea6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:39.708829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d33b6b1b-c008-4e0a-a85f-241d6efcbea6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:39.709285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d33b6b1b-c008-4e0a-a85f-241d6efcbea6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:39.710088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d33b6b1b-c008-4e0a-a85f-241d6efcbea6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:39.710534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d33b6b1b-c008-4e0a-a85f-241d6efcbea6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:39.724717 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-d33b6b1b-c008-4e0a-a85f-241d6efcbea6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] HTTP exception thrown: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d33b6b1b-c008-4e0a-a85f-241d6efcbea6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Request method failure captured: May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 HTTP/1.1 May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpVRO-mAxq6p3GCM6f9DBOuC6gM1jLrQkTcIGTva2AkLnRSMUBqa-v9eVXfkm2PMd8NeLYhF-4I6HJDUZ-KSNTa0czoN9va3UpuGRFgQJU4y4HLnhbLb00NIsPyXWHr82FwRNk4pOcjox7d1rlRD_kjkv5QsGlOaJ5XjMoC8y-HfNC4 May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f9c9caba58394e1480acb632405111c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f9c9caba58394e1480acb632405111c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: b16d0e791edd4f119e646e7ced74bf74 May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'b2bfb879-a670-4828-a3f1-d46c30d49549'} May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:38:39.726301 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:38:39.730335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. May 28 21:38:39.730335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:39.730335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:39.730335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:39.730335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:39.730335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:39.730335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:39.730335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:38:39.730335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:38:39.730335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. May 28 21:38:39.730335 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:39.730335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d33b6b1b-c008-4e0a-a85f-241d6efcbea6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Returning 404 to user: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:38:39.730335 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d33b6b1b-c008-4e0a-a85f-241d6efcbea6 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 404 len: 111 microversion: 2.1 time: 0.029364 May 28 21:38:39.730335 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3046/6048] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:38:39 2022] DELETE /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:38:39.737223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2ff55553-d1d9-4736-95a9-2d1b36c6012c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:39.738095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2ff55553-d1d9-4736-95a9-2d1b36c6012c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: b2bfb879-a670-4828-a3f1-d46c30d49549] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:39.744803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ff55553-d1d9-4736-95a9-2d1b36c6012c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:39.745363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ff55553-d1d9-4736-95a9-2d1b36c6012c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:39.746185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ff55553-d1d9-4736-95a9-2d1b36c6012c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:39.746633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ff55553-d1d9-4736-95a9-2d1b36c6012c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:39.761442 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-2ff55553-d1d9-4736-95a9-2d1b36c6012c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] HTTP exception thrown: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2ff55553-d1d9-4736-95a9-2d1b36c6012c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Request method failure captured: May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 HTTP/1.1 May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpVRO-mAxq6p3GCM6f9DBOuC6gM1jLrQkTcIGTva2AkLnRSMUBqa-v9eVXfkm2PMd8NeLYhF-4I6HJDUZ-KSNTa0czoN9va3UpuGRFgQJU4y4HLnhbLb00NIsPyXWHr82FwRNk4pOcjox7d1rlRD_kjkv5QsGlOaJ5XjMoC8y-HfNC4 May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f9c9caba58394e1480acb632405111c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f9c9caba58394e1480acb632405111c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: b16d0e791edd4f119e646e7ced74bf74 May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'b2bfb879-a670-4828-a3f1-d46c30d49549'} May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:39.763067 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:39.767960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:39.767960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:39.767960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:39.767960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:38:39.767960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:38:39.767960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. May 28 21:38:39.767960 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:39.767960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2ff55553-d1d9-4736-95a9-2d1b36c6012c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Returning 404 to user: Instance b2bfb879-a670-4828-a3f1-d46c30d49549 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:38:39.767960 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2ff55553-d1d9-4736-95a9-2d1b36c6012c tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549" status: 404 len: 111 microversion: 2.1 time: 0.031270 May 28 21:38:39.768652 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3003/6049] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:39 2022] GET /compute/v2.1/servers/b2bfb879-a670-4828-a3f1-d46c30d49549 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:38:44.236072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8c3c71a9-8549-49ac-a8d3-084dcf7d54b1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:44.236574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8c3c71a9-8549-49ac-a8d3-084dcf7d54b1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:44.243788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c3c71a9-8549-49ac-a8d3-084dcf7d54b1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:44.245062 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c3c71a9-8549-49ac-a8d3-084dcf7d54b1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:44.245062 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c3c71a9-8549-49ac-a8d3-084dcf7d54b1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:44.245478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8c3c71a9-8549-49ac-a8d3-084dcf7d54b1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:44.259975 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-8c3c71a9-8549-49ac-a8d3-084dcf7d54b1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] HTTP exception thrown: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8c3c71a9-8549-49ac-a8d3-084dcf7d54b1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Request method failure captured: May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da HTTP/1.1 May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpVRO-mAxq6p3GCM6f9DBOuC6gM1jLrQkTcIGTva2AkLnRSMUBqa-v9eVXfkm2PMd8NeLYhF-4I6HJDUZ-KSNTa0czoN9va3UpuGRFgQJU4y4HLnhbLb00NIsPyXWHr82FwRNk4pOcjox7d1rlRD_kjkv5QsGlOaJ5XjMoC8y-HfNC4 May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f9c9caba58394e1480acb632405111c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f9c9caba58394e1480acb632405111c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: b16d0e791edd4f119e646e7ced74bf74 May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '496c4c91-33f1-4301-ba55-0e99f84223da'} May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:38:44.261569 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:38:44.268764 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. May 28 21:38:44.268764 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:44.268764 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:44.268764 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:44.268764 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:44.268764 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:44.268764 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:44.268764 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:38:44.268764 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:38:44.268764 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. May 28 21:38:44.268764 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:38:44.268764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8c3c71a9-8549-49ac-a8d3-084dcf7d54b1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Returning 404 to user: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:38:44.268764 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8c3c71a9-8549-49ac-a8d3-084dcf7d54b1 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "DELETE /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 404 len: 111 microversion: 2.1 time: 0.031534 May 28 21:38:44.268764 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3047/6050] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:38:44 2022] DELETE /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:38:44.277815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d665ea9b-8cf2-4015-9deb-b4db0bad2401 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:44.279734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d665ea9b-8cf2-4015-9deb-b4db0bad2401 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] [instance: 496c4c91-33f1-4301-ba55-0e99f84223da] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:44.287174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d665ea9b-8cf2-4015-9deb-b4db0bad2401 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:44.287936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d665ea9b-8cf2-4015-9deb-b4db0bad2401 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:44.288726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d665ea9b-8cf2-4015-9deb-b4db0bad2401 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:44.289165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d665ea9b-8cf2-4015-9deb-b4db0bad2401 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:44.315989 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-d665ea9b-8cf2-4015-9deb-b4db0bad2401 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] HTTP exception thrown: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d665ea9b-8cf2-4015-9deb-b4db0bad2401 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Request method failure captured: May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da HTTP/1.1 May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpVRO-mAxq6p3GCM6f9DBOuC6gM1jLrQkTcIGTva2AkLnRSMUBqa-v9eVXfkm2PMd8NeLYhF-4I6HJDUZ-KSNTa0czoN9va3UpuGRFgQJU4y4HLnhbLb00NIsPyXWHr82FwRNk4pOcjox7d1rlRD_kjkv5QsGlOaJ5XjMoC8y-HfNC4 May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f9c9caba58394e1480acb632405111c5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f9c9caba58394e1480acb632405111c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f9c9caba58394e1480acb632405111c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: f9c9caba58394e1480acb632405111c5 May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-679324601 May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: b16d0e791edd4f119e646e7ced74bf74 May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-AttachVolumeNegativeTest-679324601-project May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '496c4c91-33f1-4301-ba55-0e99f84223da'} May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:44.317727 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:44.322708 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:44.322708 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:44.322708 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:44.322708 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:38:44.322708 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:38:44.322708 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. May 28 21:38:44.322708 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:44.324176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d665ea9b-8cf2-4015-9deb-b4db0bad2401 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] Returning 404 to user: Instance 496c4c91-33f1-4301-ba55-0e99f84223da could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:38:44.325240 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d665ea9b-8cf2-4015-9deb-b4db0bad2401 tempest-AttachVolumeNegativeTest-679324601 tempest-AttachVolumeNegativeTest-679324601-project] 10.222.0.33 "GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da" status: 404 len: 111 microversion: 2.1 time: 0.057489 May 28 21:38:44.329324 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3004/6051] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:44 2022] GET /compute/v2.1/servers/496c4c91-33f1-4301-ba55-0e99f84223da => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:38:47.119181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-49eb8ba8-013a-4123-b333-d30d16c3a6ac tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:47.119718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-49eb8ba8-013a-4123-b333-d30d16c3a6ac tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:47.130136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49eb8ba8-013a-4123-b333-d30d16c3a6ac tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:47.130607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49eb8ba8-013a-4123-b333-d30d16c3a6ac tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:47.135713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49eb8ba8-013a-4123-b333-d30d16c3a6ac tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:47.136183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49eb8ba8-013a-4123-b333-d30d16c3a6ac tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:47.284677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-49eb8ba8-013a-4123-b333-d30d16c3a6ac tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lazy-loading 'services' on Instance uuid c102e74a-53d8-49a3-b95c-11662e61a985 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:38:47.520756 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-49eb8ba8-013a-4123-b333-d30d16c3a6ac tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985/os-volume_attachments/b31650fd-bab6-499a-bca7-af6b551f165e" status: 202 len: 0 microversion: 2.1 time: 0.405577 May 28 21:38:47.521950 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3048/6052] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:38:47 2022] DELETE /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985/os-volume_attachments/b31650fd-bab6-499a-bca7-af6b551f165e => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:38:48.801581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4a778b38-b884-4444-b931-c5be1baf4804 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:48.802781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4a778b38-b884-4444-b931-c5be1baf4804 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:48.820582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a778b38-b884-4444-b931-c5be1baf4804 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:48.823983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a778b38-b884-4444-b931-c5be1baf4804 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:48.824903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a778b38-b884-4444-b931-c5be1baf4804 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:48.825990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4a778b38-b884-4444-b931-c5be1baf4804 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:48.916261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4a778b38-b884-4444-b931-c5be1baf4804 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:38:48.946227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:38:49.340289 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4a778b38-b884-4444-b931-c5be1baf4804 tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 204 len: 0 microversion: 2.1 time: 0.542722 May 28 21:38:49.344761 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3005/6053] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:38:48 2022] DELETE /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:38:49.354591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-de0f6782-864b-4c3f-9b50-87c8ce01789a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:49.354591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-de0f6782-864b-4c3f-9b50-87c8ce01789a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:49.366960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de0f6782-864b-4c3f-9b50-87c8ce01789a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:49.367430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de0f6782-864b-4c3f-9b50-87c8ce01789a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:49.368233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de0f6782-864b-4c3f-9b50-87c8ce01789a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:49.368689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-de0f6782-864b-4c3f-9b50-87c8ce01789a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:49.653979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-de0f6782-864b-4c3f-9b50-87c8ce01789a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:38:49.670135 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-de0f6782-864b-4c3f-9b50-87c8ce01789a tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 200 len: 1513 microversion: 2.1 time: 0.323111 May 28 21:38:49.673759 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3049/6054] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:49 2022] GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 1513 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:50.691478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-62b2e635-f35d-4540-a36d-aa7ee0690ade tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:50.691478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-62b2e635-f35d-4540-a36d-aa7ee0690ade tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:50.709546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62b2e635-f35d-4540-a36d-aa7ee0690ade tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:50.714268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62b2e635-f35d-4540-a36d-aa7ee0690ade tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:50.714268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62b2e635-f35d-4540-a36d-aa7ee0690ade tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:50.714268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-62b2e635-f35d-4540-a36d-aa7ee0690ade tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:50.955856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-62b2e635-f35d-4540-a36d-aa7ee0690ade tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:38:50.964441 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-62b2e635-f35d-4540-a36d-aa7ee0690ade tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 200 len: 1513 microversion: 2.1 time: 0.280263 May 28 21:38:50.975902 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3006/6055] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:50 2022] GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 1513 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:51.985667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1cb25d2b-f363-4f8e-9c28-e1399c088c8b tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:51.986254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1cb25d2b-f363-4f8e-9c28-e1399c088c8b tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:51.995907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-80a7ac59-53f9-4c5d-9eb8-82eae68c43d4 req-95fb6cc6-e035-433f-b5b5-4f5b2b90c3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c102e74a-53d8-49a3-b95c-11662e61a985", "name": "network-vif-deleted", "tag": "9385ed55-01a4-4312-9e23-8609250a9f81"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:38:52.003681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1cb25d2b-f363-4f8e-9c28-e1399c088c8b tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:52.005356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1cb25d2b-f363-4f8e-9c28-e1399c088c8b tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:52.006500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1cb25d2b-f363-4f8e-9c28-e1399c088c8b tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:52.008445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1cb25d2b-f363-4f8e-9c28-e1399c088c8b tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:52.011786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-80a7ac59-53f9-4c5d-9eb8-82eae68c43d4 req-95fb6cc6-e035-433f-b5b5-4f5b2b90c3d7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:52.016328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-80a7ac59-53f9-4c5d-9eb8-82eae68c43d4 req-95fb6cc6-e035-433f-b5b5-4f5b2b90c3d7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:52.039208 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-80a7ac59-53f9-4c5d-9eb8-82eae68c43d4 req-95fb6cc6-e035-433f-b5b5-4f5b2b90c3d7 service nova] Creating event network-vif-deleted:9385ed55-01a4-4312-9e23-8609250a9f81 for instance c102e74a-53d8-49a3-b95c-11662e61a985 on nch1-master-1 May 28 21:38:52.051379 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-80a7ac59-53f9-4c5d-9eb8-82eae68c43d4 req-95fb6cc6-e035-433f-b5b5-4f5b2b90c3d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060313 May 28 21:38:52.053519 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3007/6056] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:38:52.113880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1cb25d2b-f363-4f8e-9c28-e1399c088c8b tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d033e99f9294e348b01c59a970931d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ed82f578e214948a9311cbdbb55a027', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:38:52.131853 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1cb25d2b-f363-4f8e-9c28-e1399c088c8b tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 200 len: 1471 microversion: 2.1 time: 0.151768 May 28 21:38:52.133221 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3050/6057] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:51 2022] GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:38:53.149868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-45a466de-36ec-4409-af69-ba08783cd9dd tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:38:53.150664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-45a466de-36ec-4409-af69-ba08783cd9dd tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] [instance: c102e74a-53d8-49a3-b95c-11662e61a985] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:38:53.157913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:38:53.159955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45a466de-36ec-4409-af69-ba08783cd9dd tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:53.160485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45a466de-36ec-4409-af69-ba08783cd9dd tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:53.161341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45a466de-36ec-4409-af69-ba08783cd9dd tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:38:53.161896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-45a466de-36ec-4409-af69-ba08783cd9dd tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:38:53.176292 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-45a466de-36ec-4409-af69-ba08783cd9dd tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] HTTP exception thrown: Instance c102e74a-53d8-49a3-b95c-11662e61a985 could not be found. May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-45a466de-36ec-4409-af69-ba08783cd9dd tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Request method failure captured: May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 HTTP/1.1 May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpS_ypa5UNFNBLjvVoACWmulZGE45wG9ph1wcihi0Hn_hm24GeYhaH3pHz4UbMKo2WiBCVxm6wJq1Wf2Fdi1ik-iztyIeivPQ_sgmXaZvWpvaM83Nofu4dqmWBUYEOf-47dmGRomtc3ZI6K7wRHPrHtXJAx2YxGDoFHLfF3c9jWYoWk May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 6ed82f578e214948a9311cbdbb55a027 May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-VolumesSnapshotTestJSON-961770574 May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6ed82f578e214948a9311cbdbb55a027", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed82f578e214948a9311cbdbb55a027"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6ed82f578e214948a9311cbdbb55a027"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6ed82f578e214948a9311cbdbb55a027"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-VolumesSnapshotTestJSON-961770574 May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 6ed82f578e214948a9311cbdbb55a027 May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-961770574 May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-VolumesSnapshotTestJSON-961770574-project May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 8d033e99f9294e348b01c59a970931d5 May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-VolumesSnapshotTestJSON-961770574-project May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance c102e74a-53d8-49a3-b95c-11662e61a985 could not be found. May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'c102e74a-53d8-49a3-b95c-11662e61a985'} May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c102e74a-53d8-49a3-b95c-11662e61a985 could not be found. May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c102e74a-53d8-49a3-b95c-11662e61a985 could not be found. May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:38:53.178249 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:53.188990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:38:53.188990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:38:53.188990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:38:53.188990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:38:53.188990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:38:53.188990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c102e74a-53d8-49a3-b95c-11662e61a985 could not be found. May 28 21:38:53.188990 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:38:53.188990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-45a466de-36ec-4409-af69-ba08783cd9dd tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] Returning 404 to user: Instance c102e74a-53d8-49a3-b95c-11662e61a985 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:38:53.188990 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-45a466de-36ec-4409-af69-ba08783cd9dd tempest-VolumesSnapshotTestJSON-961770574 tempest-VolumesSnapshotTestJSON-961770574-project] 10.222.0.33 "GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985" status: 404 len: 111 microversion: 2.1 time: 0.034368 May 28 21:38:53.188990 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3008/6058] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:38:53 2022] GET /compute/v2.1/servers/c102e74a-53d8-49a3-b95c-11662e61a985 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:39:01.947938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-355461628", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "5c75e3f3-953a-49e7-95ef-9ce38c375765", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "66a65b2a-c99c-44c5-8c4a-ebd7f0012d23"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:39:01.958160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:39:02.040712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] validate_networks() for [('66a65b2a-c99c-44c5-8c4a-ebd7f0012d23', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:39:02.118066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:39:02.421730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:39:02.422499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:39:02.423083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:39:02.423577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:39:02.424041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:39:02.433595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:02.434093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:02.434910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:02.435390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:02.457154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Getting quotas for project 5833e78f486c4a118608290040b31cfc. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:39:02.463114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Getting quotas for user 388458a7b3504bd08f3789f53cf9ea35 and project 5833e78f486c4a118608290040b31cfc. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:39:02.477871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:39:02.479982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5c75e3f3-953a-49e7-95ef-9ce38c375765',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:39:02.649944 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2d46df74-8075-4723-872d-b53957349f37 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705835 May 28 21:39:02.650614 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3051/6059] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:39:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:39:02.663891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-44cc215b-7771-48ab-8141-34832d9d2384 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:02.663891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-44cc215b-7771-48ab-8141-34832d9d2384 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:02.721815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-44cc215b-7771-48ab-8141-34832d9d2384 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:02.742472 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-44cc215b-7771-48ab-8141-34832d9d2384 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1056 microversion: 2.1 time: 0.085490 May 28 21:39:02.743486 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3009/6060] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:02 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1056 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:03.762175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2015cb76-ede6-4e6d-aa26-25861ccf567b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:03.762804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2015cb76-ede6-4e6d-aa26-25861ccf567b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:03.818171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2015cb76-ede6-4e6d-aa26-25861ccf567b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:03.825011 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2015cb76-ede6-4e6d-aa26-25861ccf567b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1056 microversion: 2.1 time: 0.067895 May 28 21:39:03.825583 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3052/6061] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:03 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1056 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:04.843493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4e700d9d-895a-497b-81d2-55979d5d842d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:04.844206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4e700d9d-895a-497b-81d2-55979d5d842d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:04.846192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:39:04.858527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e700d9d-895a-497b-81d2-55979d5d842d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:04.861344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e700d9d-895a-497b-81d2-55979d5d842d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:04.861344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e700d9d-895a-497b-81d2-55979d5d842d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:04.861344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e700d9d-895a-497b-81d2-55979d5d842d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:04.932722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4e700d9d-895a-497b-81d2-55979d5d842d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:04.937373 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4e700d9d-895a-497b-81d2-55979d5d842d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1108 microversion: 2.1 time: 0.099344 May 28 21:39:04.937996 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3010/6062] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:04 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1108 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:05.954524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-16edeec7-4042-434f-aa94-e3892a01c345 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:05.959184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-16edeec7-4042-434f-aa94-e3892a01c345 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:05.964257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-16edeec7-4042-434f-aa94-e3892a01c345 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:05.965070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-16edeec7-4042-434f-aa94-e3892a01c345 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:05.966013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-16edeec7-4042-434f-aa94-e3892a01c345 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:05.966528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-16edeec7-4042-434f-aa94-e3892a01c345 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:06.173043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-16edeec7-4042-434f-aa94-e3892a01c345 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:06.181427 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-16edeec7-4042-434f-aa94-e3892a01c345 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1168 microversion: 2.1 time: 0.230978 May 28 21:39:06.181973 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3053/6063] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:05 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1168 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:07.206360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-26ba4124-7de9-4328-805f-443573ec9a4c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:07.213892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-26ba4124-7de9-4328-805f-443573ec9a4c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:07.237224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26ba4124-7de9-4328-805f-443573ec9a4c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:07.238544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26ba4124-7de9-4328-805f-443573ec9a4c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:07.239479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26ba4124-7de9-4328-805f-443573ec9a4c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:07.240009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26ba4124-7de9-4328-805f-443573ec9a4c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:07.410492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-a89ce9ae-a35f-420d-9b6c-6ddac5863350 req-9344abd4-d15c-4348-9f12-4fee3104dd56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9da2e5da-8e7d-4a2f-8122-107438f11587", "tag": "dcf554dc-e07f-4a0c-a55e-10ce2adb19cf"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:39:07.419818 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a89ce9ae-a35f-420d-9b6c-6ddac5863350 req-9344abd4-d15c-4348-9f12-4fee3104dd56 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:07.420569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a89ce9ae-a35f-420d-9b6c-6ddac5863350 req-9344abd4-d15c-4348-9f12-4fee3104dd56 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:07.433073 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a89ce9ae-a35f-420d-9b6c-6ddac5863350 req-9344abd4-d15c-4348-9f12-4fee3104dd56 service nova] Creating event network-changed:dcf554dc-e07f-4a0c-a55e-10ce2adb19cf for instance 9da2e5da-8e7d-4a2f-8122-107438f11587 on nch2-master-1 May 28 21:39:07.443603 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-a89ce9ae-a35f-420d-9b6c-6ddac5863350 req-9344abd4-d15c-4348-9f12-4fee3104dd56 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036749 May 28 21:39:07.444425 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3054/6064] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:39:07.477797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-26ba4124-7de9-4328-805f-443573ec9a4c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:07.487739 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-26ba4124-7de9-4328-805f-443573ec9a4c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1168 microversion: 2.1 time: 0.290817 May 28 21:39:07.488736 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3011/6065] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:07 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1168 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:08.506053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3e0f44c7-548b-4854-a8d9-76eb114ba802 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:08.506775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3e0f44c7-548b-4854-a8d9-76eb114ba802 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:08.513313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e0f44c7-548b-4854-a8d9-76eb114ba802 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:08.513832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e0f44c7-548b-4854-a8d9-76eb114ba802 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:08.514670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e0f44c7-548b-4854-a8d9-76eb114ba802 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:08.515122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e0f44c7-548b-4854-a8d9-76eb114ba802 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:08.661378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3e0f44c7-548b-4854-a8d9-76eb114ba802 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:08.669787 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3e0f44c7-548b-4854-a8d9-76eb114ba802 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1168 microversion: 2.1 time: 0.168895 May 28 21:39:08.670457 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3055/6066] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:08 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1168 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:09.686385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-47faaa85-ae08-478e-b35a-c8118de3d990 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:09.687033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-47faaa85-ae08-478e-b35a-c8118de3d990 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:09.693721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47faaa85-ae08-478e-b35a-c8118de3d990 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:09.694250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47faaa85-ae08-478e-b35a-c8118de3d990 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:09.695032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47faaa85-ae08-478e-b35a-c8118de3d990 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:09.695482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47faaa85-ae08-478e-b35a-c8118de3d990 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:09.839921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-47faaa85-ae08-478e-b35a-c8118de3d990 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:09.848490 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-47faaa85-ae08-478e-b35a-c8118de3d990 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1168 microversion: 2.1 time: 0.165983 May 28 21:39:09.849151 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3012/6067] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:09 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1168 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:10.866472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-20fc5dd8-74e1-411f-99fe-f7816934fffc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:10.867083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-20fc5dd8-74e1-411f-99fe-f7816934fffc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:10.874087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20fc5dd8-74e1-411f-99fe-f7816934fffc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:10.874543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20fc5dd8-74e1-411f-99fe-f7816934fffc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:10.875306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20fc5dd8-74e1-411f-99fe-f7816934fffc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:10.875748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20fc5dd8-74e1-411f-99fe-f7816934fffc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:11.025823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-20fc5dd8-74e1-411f-99fe-f7816934fffc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:11.034864 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-20fc5dd8-74e1-411f-99fe-f7816934fffc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1168 microversion: 2.1 time: 0.172410 May 28 21:39:11.035746 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3056/6068] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:10 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1168 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:12.051563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-19f1f905-b6d7-4016-8394-70c0e43cef17 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:12.052188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-19f1f905-b6d7-4016-8394-70c0e43cef17 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:12.059220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19f1f905-b6d7-4016-8394-70c0e43cef17 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:12.059679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19f1f905-b6d7-4016-8394-70c0e43cef17 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:12.060457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19f1f905-b6d7-4016-8394-70c0e43cef17 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:12.060898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19f1f905-b6d7-4016-8394-70c0e43cef17 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:12.191479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-19f1f905-b6d7-4016-8394-70c0e43cef17 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:12.199160 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-19f1f905-b6d7-4016-8394-70c0e43cef17 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1202 microversion: 2.1 time: 0.151431 May 28 21:39:12.200159 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3013/6069] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:12 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:13.223658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-84d54885-34e7-4ad8-9b1c-1e57ac566c3e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:13.224368 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-84d54885-34e7-4ad8-9b1c-1e57ac566c3e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:13.232136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:39:13.234339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84d54885-34e7-4ad8-9b1c-1e57ac566c3e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:13.234796 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84d54885-34e7-4ad8-9b1c-1e57ac566c3e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:13.236080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84d54885-34e7-4ad8-9b1c-1e57ac566c3e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:13.236560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84d54885-34e7-4ad8-9b1c-1e57ac566c3e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:13.372544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-84d54885-34e7-4ad8-9b1c-1e57ac566c3e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:13.380230 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-84d54885-34e7-4ad8-9b1c-1e57ac566c3e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1202 microversion: 2.1 time: 0.160625 May 28 21:39:13.382779 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3057/6070] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:13 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:14.397476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c831ed2f-094e-4f9d-9281-be5646f78ae8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:14.398575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c831ed2f-094e-4f9d-9281-be5646f78ae8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:14.400359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:39:14.411312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c831ed2f-094e-4f9d-9281-be5646f78ae8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:14.411778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c831ed2f-094e-4f9d-9281-be5646f78ae8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:14.412572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c831ed2f-094e-4f9d-9281-be5646f78ae8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:14.413012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c831ed2f-094e-4f9d-9281-be5646f78ae8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:14.558330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c831ed2f-094e-4f9d-9281-be5646f78ae8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:14.567077 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c831ed2f-094e-4f9d-9281-be5646f78ae8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1202 microversion: 2.1 time: 0.173572 May 28 21:39:14.567747 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3014/6071] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:14 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1202 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:15.585091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-36dbb880-a879-4923-93ea-bf9fd963c967 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:15.585629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-36dbb880-a879-4923-93ea-bf9fd963c967 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:15.587543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=8 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:39:15.593218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36dbb880-a879-4923-93ea-bf9fd963c967 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:15.597642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36dbb880-a879-4923-93ea-bf9fd963c967 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:15.597642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36dbb880-a879-4923-93ea-bf9fd963c967 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:15.597642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-36dbb880-a879-4923-93ea-bf9fd963c967 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:15.740495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-36dbb880-a879-4923-93ea-bf9fd963c967 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:15.748177 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-36dbb880-a879-4923-93ea-bf9fd963c967 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1202 microversion: 2.1 time: 0.167352 May 28 21:39:15.748778 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3058/6072] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:15 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1202 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:16.765108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9275f01e-2ea0-4bb3-9ab5-d686d55a3134 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:16.770856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9275f01e-2ea0-4bb3-9ab5-d686d55a3134 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:16.773994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9275f01e-2ea0-4bb3-9ab5-d686d55a3134 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:16.774453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9275f01e-2ea0-4bb3-9ab5-d686d55a3134 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:16.775223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9275f01e-2ea0-4bb3-9ab5-d686d55a3134 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:16.775687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9275f01e-2ea0-4bb3-9ab5-d686d55a3134 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:16.940281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9275f01e-2ea0-4bb3-9ab5-d686d55a3134 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:16.950403 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9275f01e-2ea0-4bb3-9ab5-d686d55a3134 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1202 microversion: 2.1 time: 0.189146 May 28 21:39:16.961990 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3015/6073] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:16 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1202 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:17.971909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0f481f8b-9a8d-42a6-a2ac-5ed5e44e113b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:17.972604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0f481f8b-9a8d-42a6-a2ac-5ed5e44e113b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:17.979641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f481f8b-9a8d-42a6-a2ac-5ed5e44e113b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:17.980096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f481f8b-9a8d-42a6-a2ac-5ed5e44e113b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:17.980937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f481f8b-9a8d-42a6-a2ac-5ed5e44e113b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:17.981384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f481f8b-9a8d-42a6-a2ac-5ed5e44e113b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:18.112372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0f481f8b-9a8d-42a6-a2ac-5ed5e44e113b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:18.120006 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0f481f8b-9a8d-42a6-a2ac-5ed5e44e113b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1202 microversion: 2.1 time: 0.152556 May 28 21:39:18.120592 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3059/6074] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:17 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:18.645255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-9fed8209-876c-4b1c-8a37-33c9433f400c req-05deadeb-1ba3-424f-b9fd-17f7cba009d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da2e5da-8e7d-4a2f-8122-107438f11587", "name": "network-vif-plugged", "status": "completed", "tag": "dcf554dc-e07f-4a0c-a55e-10ce2adb19cf"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:39:18.654163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9fed8209-876c-4b1c-8a37-33c9433f400c req-05deadeb-1ba3-424f-b9fd-17f7cba009d7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:18.654618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9fed8209-876c-4b1c-8a37-33c9433f400c req-05deadeb-1ba3-424f-b9fd-17f7cba009d7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:18.666065 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-9fed8209-876c-4b1c-8a37-33c9433f400c req-05deadeb-1ba3-424f-b9fd-17f7cba009d7 service nova] Creating event network-vif-plugged:dcf554dc-e07f-4a0c-a55e-10ce2adb19cf for instance 9da2e5da-8e7d-4a2f-8122-107438f11587 on nch2-master-1 May 28 21:39:18.671092 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-9fed8209-876c-4b1c-8a37-33c9433f400c req-05deadeb-1ba3-424f-b9fd-17f7cba009d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165095 May 28 21:39:18.671686 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3016/6075] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:39:19.138414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3b7ee9eb-c394-4b16-9c02-5dd281934929 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:19.142690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3b7ee9eb-c394-4b16-9c02-5dd281934929 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:19.146005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b7ee9eb-c394-4b16-9c02-5dd281934929 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:19.146476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b7ee9eb-c394-4b16-9c02-5dd281934929 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:19.147297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b7ee9eb-c394-4b16-9c02-5dd281934929 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:19.147751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b7ee9eb-c394-4b16-9c02-5dd281934929 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:19.286807 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3b7ee9eb-c394-4b16-9c02-5dd281934929 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:19.297512 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3b7ee9eb-c394-4b16-9c02-5dd281934929 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1202 microversion: 2.1 time: 0.163199 May 28 21:39:19.298330 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3060/6076] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:19 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:20.316862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e21f4bc9-3d61-4313-9dbf-3c2dbefaf69f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:20.317616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e21f4bc9-3d61-4313-9dbf-3c2dbefaf69f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:20.324233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e21f4bc9-3d61-4313-9dbf-3c2dbefaf69f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:20.326201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e21f4bc9-3d61-4313-9dbf-3c2dbefaf69f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:20.326201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e21f4bc9-3d61-4313-9dbf-3c2dbefaf69f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:20.326201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e21f4bc9-3d61-4313-9dbf-3c2dbefaf69f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:20.488598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e21f4bc9-3d61-4313-9dbf-3c2dbefaf69f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:20.499233 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e21f4bc9-3d61-4313-9dbf-3c2dbefaf69f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1202 microversion: 2.1 time: 0.188133 May 28 21:39:20.499921 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3017/6077] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:20 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1202 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:21.523452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0cec9c09-85ca-444d-b513-1fcd2aa8f908 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:21.523452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0cec9c09-85ca-444d-b513-1fcd2aa8f908 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:21.531944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cec9c09-85ca-444d-b513-1fcd2aa8f908 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:21.532482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cec9c09-85ca-444d-b513-1fcd2aa8f908 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:21.533480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cec9c09-85ca-444d-b513-1fcd2aa8f908 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:21.533970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0cec9c09-85ca-444d-b513-1fcd2aa8f908 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:21.673159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0cec9c09-85ca-444d-b513-1fcd2aa8f908 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:21.682108 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0cec9c09-85ca-444d-b513-1fcd2aa8f908 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1389 microversion: 2.1 time: 0.167022 May 28 21:39:21.682717 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3061/6078] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:21 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:21.703609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7d280ae0-5c6e-45fa-b02a-4e72faf9b4bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:21.704339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7d280ae0-5c6e-45fa-b02a-4e72faf9b4bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:21.711404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d280ae0-5c6e-45fa-b02a-4e72faf9b4bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:21.711974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d280ae0-5c6e-45fa-b02a-4e72faf9b4bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:21.712876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d280ae0-5c6e-45fa-b02a-4e72faf9b4bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:21.713412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d280ae0-5c6e-45fa-b02a-4e72faf9b4bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:21.859233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7d280ae0-5c6e-45fa-b02a-4e72faf9b4bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:21.868138 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7d280ae0-5c6e-45fa-b02a-4e72faf9b4bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1389 microversion: 2.1 time: 0.168715 May 28 21:39:21.868722 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3018/6079] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:21 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1389 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:21.883958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c3e3ddbe-229a-41a9-8431-826c1c4720b8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:21.884694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c3e3ddbe-229a-41a9-8431-826c1c4720b8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:21.891099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3e3ddbe-229a-41a9-8431-826c1c4720b8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:21.891746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3e3ddbe-229a-41a9-8431-826c1c4720b8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:21.892515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3e3ddbe-229a-41a9-8431-826c1c4720b8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:21.893019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c3e3ddbe-229a-41a9-8431-826c1c4720b8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:22.023514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c3e3ddbe-229a-41a9-8431-826c1c4720b8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:22.034770 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c3e3ddbe-229a-41a9-8431-826c1c4720b8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1389 microversion: 2.1 time: 0.151312 May 28 21:39:22.034770 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3062/6080] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:21 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:22.104062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cce325c5-6b2d-4e6a-8f4f-914078a7dfab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:22.104578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cce325c5-6b2d-4e6a-8f4f-914078a7dfab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:22.110822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cce325c5-6b2d-4e6a-8f4f-914078a7dfab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:22.115067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cce325c5-6b2d-4e6a-8f4f-914078a7dfab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:22.115067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cce325c5-6b2d-4e6a-8f4f-914078a7dfab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:22.115067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cce325c5-6b2d-4e6a-8f4f-914078a7dfab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:22.137815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cce325c5-6b2d-4e6a-8f4f-914078a7dfab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:39:22.505220 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cce325c5-6b2d-4e6a-8f4f-914078a7dfab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 204 len: 0 microversion: 2.1 time: 0.404630 May 28 21:39:22.505792 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3019/6081] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:39:22 2022] DELETE /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:39:22.514077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-af90c40f-8ce0-4b5e-92bd-cf2304e1b5fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:22.521072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-af90c40f-8ce0-4b5e-92bd-cf2304e1b5fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:22.521072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af90c40f-8ce0-4b5e-92bd-cf2304e1b5fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:22.521543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af90c40f-8ce0-4b5e-92bd-cf2304e1b5fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:22.522350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af90c40f-8ce0-4b5e-92bd-cf2304e1b5fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:22.522803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af90c40f-8ce0-4b5e-92bd-cf2304e1b5fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:22.661499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-af90c40f-8ce0-4b5e-92bd-cf2304e1b5fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:22.669328 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-af90c40f-8ce0-4b5e-92bd-cf2304e1b5fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1395 microversion: 2.1 time: 0.159271 May 28 21:39:22.669919 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3063/6082] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:22 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1395 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:23.688024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-83ce9726-2d40-4927-9097-d0307ae55177 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:23.688667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-83ce9726-2d40-4927-9097-d0307ae55177 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:23.697452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-83ce9726-2d40-4927-9097-d0307ae55177 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:23.697947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-83ce9726-2d40-4927-9097-d0307ae55177 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:23.698715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-83ce9726-2d40-4927-9097-d0307ae55177 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:23.699153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-83ce9726-2d40-4927-9097-d0307ae55177 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:23.854306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-83ce9726-2d40-4927-9097-d0307ae55177 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:23.861159 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-83ce9726-2d40-4927-9097-d0307ae55177 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1395 microversion: 2.1 time: 0.177968 May 28 21:39:23.861810 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3020/6083] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:23 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1395 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:24.666565 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-678d4b6b-4816-40ce-8af8-0ef6cf013406 req-27810cdc-2d40-4339-a9d1-6b31bc8b9cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9da2e5da-8e7d-4a2f-8122-107438f11587", "name": "network-vif-deleted", "tag": "dcf554dc-e07f-4a0c-a55e-10ce2adb19cf"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:39:24.682606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-678d4b6b-4816-40ce-8af8-0ef6cf013406 req-27810cdc-2d40-4339-a9d1-6b31bc8b9cab service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:24.682606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-678d4b6b-4816-40ce-8af8-0ef6cf013406 req-27810cdc-2d40-4339-a9d1-6b31bc8b9cab service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:24.698064 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-678d4b6b-4816-40ce-8af8-0ef6cf013406 req-27810cdc-2d40-4339-a9d1-6b31bc8b9cab service nova] Creating event network-vif-deleted:dcf554dc-e07f-4a0c-a55e-10ce2adb19cf for instance 9da2e5da-8e7d-4a2f-8122-107438f11587 on nch2-master-1 May 28 21:39:24.704749 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-678d4b6b-4816-40ce-8af8-0ef6cf013406 req-27810cdc-2d40-4339-a9d1-6b31bc8b9cab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193984 May 28 21:39:24.706107 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3064/6084] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:39:24.880122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6419a82f-b699-41bf-b93e-34589df01d23 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:24.881125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6419a82f-b699-41bf-b93e-34589df01d23 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:24.890249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6419a82f-b699-41bf-b93e-34589df01d23 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:24.893801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6419a82f-b699-41bf-b93e-34589df01d23 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:24.893801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6419a82f-b699-41bf-b93e-34589df01d23 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:24.893801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6419a82f-b699-41bf-b93e-34589df01d23 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:24.962675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6419a82f-b699-41bf-b93e-34589df01d23 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:24.970803 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6419a82f-b699-41bf-b93e-34589df01d23 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 200 len: 1187 microversion: 2.1 time: 0.095526 May 28 21:39:24.971499 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3021/6085] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:24 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:25.989486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4afe53e4-6aa9-43d2-ac1c-0de58cffdc24 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:25.990231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4afe53e4-6aa9-43d2-ac1c-0de58cffdc24 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:25.996601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4afe53e4-6aa9-43d2-ac1c-0de58cffdc24 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:25.997287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4afe53e4-6aa9-43d2-ac1c-0de58cffdc24 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:25.998274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4afe53e4-6aa9-43d2-ac1c-0de58cffdc24 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:25.998724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4afe53e4-6aa9-43d2-ac1c-0de58cffdc24 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:26.013933 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-4afe53e4-6aa9-43d2-ac1c-0de58cffdc24 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] HTTP exception thrown: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4afe53e4-6aa9-43d2-ac1c-0de58cffdc24 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Request method failure captured: May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 HTTP/1.1 May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpZj6T8fAUPV0L9vvdx7FjM-mPDbeMcny2vaFgqFap_hhOicDv_aSrneSkPKTuy8G7aOJ8u-6aN6vtjm8OAlWN3Sh2BNpOvEzUNMkpGCfAsXWUG9AhKKLTChCVZAHzz9iHirDXgMjQoShyXSLMnsx_u72mL9Gv37fsMmCKprrAlJHzI May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5833e78f486c4a118608290040b31cfc May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5833e78f486c4a118608290040b31cfc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5833e78f486c4a118608290040b31cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestVolumeBootPattern-1994669512 May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5833e78f486c4a118608290040b31cfc May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestVolumeBootPattern-1994669512-project May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 388458a7b3504bd08f3789f53cf9ea35 May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestVolumeBootPattern-1994669512-project May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '9da2e5da-8e7d-4a2f-8122-107438f11587'} May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:39:26.015572 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:39:26.022561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:39:26.022561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:39:26.022561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:39:26.022561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:39:26.022561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:39:26.022561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. May 28 21:39:26.022561 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:39:26.022561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4afe53e4-6aa9-43d2-ac1c-0de58cffdc24 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Returning 404 to user: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:39:26.022561 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4afe53e4-6aa9-43d2-ac1c-0de58cffdc24 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 404 len: 111 microversion: 2.1 time: 0.033230 May 28 21:39:26.022561 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3065/6086] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:25 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:39:31.327135 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6ae441d9-283a-44d0-b49c-e22bf188de5d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:31.327719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6ae441d9-283a-44d0-b49c-e22bf188de5d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:31.335619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ae441d9-283a-44d0-b49c-e22bf188de5d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:31.336152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ae441d9-283a-44d0-b49c-e22bf188de5d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:31.336994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ae441d9-283a-44d0-b49c-e22bf188de5d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:31.337514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6ae441d9-283a-44d0-b49c-e22bf188de5d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:31.351514 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-6ae441d9-283a-44d0-b49c-e22bf188de5d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] HTTP exception thrown: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6ae441d9-283a-44d0-b49c-e22bf188de5d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Request method failure captured: May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 HTTP/1.1 May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpZj6T8fAUPV0L9vvdx7FjM-mPDbeMcny2vaFgqFap_hhOicDv_aSrneSkPKTuy8G7aOJ8u-6aN6vtjm8OAlWN3Sh2BNpOvEzUNMkpGCfAsXWUG9AhKKLTChCVZAHzz9iHirDXgMjQoShyXSLMnsx_u72mL9Gv37fsMmCKprrAlJHzI May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5833e78f486c4a118608290040b31cfc May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5833e78f486c4a118608290040b31cfc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5833e78f486c4a118608290040b31cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestVolumeBootPattern-1994669512 May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5833e78f486c4a118608290040b31cfc May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestVolumeBootPattern-1994669512-project May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 388458a7b3504bd08f3789f53cf9ea35 May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestVolumeBootPattern-1994669512-project May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '9da2e5da-8e7d-4a2f-8122-107438f11587'} May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:39:31.353184 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:39:31.357968 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. May 28 21:39:31.357968 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:39:31.357968 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:39:31.357968 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:39:31.357968 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:39:31.357968 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:39:31.357968 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:39:31.357968 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:39:31.357968 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:39:31.357968 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. May 28 21:39:31.357968 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:39:31.357968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6ae441d9-283a-44d0-b49c-e22bf188de5d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Returning 404 to user: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:39:31.357968 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6ae441d9-283a-44d0-b49c-e22bf188de5d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 404 len: 111 microversion: 2.1 time: 0.031862 May 28 21:39:31.357968 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3022/6087] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:39:31 2022] DELETE /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:39:31.363986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7fbe049d-7fdf-4fb3-a43c-cd103ee94ce6 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:31.364465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7fbe049d-7fdf-4fb3-a43c-cd103ee94ce6 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 9da2e5da-8e7d-4a2f-8122-107438f11587] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:31.380892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fbe049d-7fdf-4fb3-a43c-cd103ee94ce6 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:31.380892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fbe049d-7fdf-4fb3-a43c-cd103ee94ce6 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:31.381332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fbe049d-7fdf-4fb3-a43c-cd103ee94ce6 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:31.382107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fbe049d-7fdf-4fb3-a43c-cd103ee94ce6 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:31.398488 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-7fbe049d-7fdf-4fb3-a43c-cd103ee94ce6 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] HTTP exception thrown: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7fbe049d-7fdf-4fb3-a43c-cd103ee94ce6 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Request method failure captured: May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 HTTP/1.1 May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpZj6T8fAUPV0L9vvdx7FjM-mPDbeMcny2vaFgqFap_hhOicDv_aSrneSkPKTuy8G7aOJ8u-6aN6vtjm8OAlWN3Sh2BNpOvEzUNMkpGCfAsXWUG9AhKKLTChCVZAHzz9iHirDXgMjQoShyXSLMnsx_u72mL9Gv37fsMmCKprrAlJHzI May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5833e78f486c4a118608290040b31cfc May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5833e78f486c4a118608290040b31cfc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5833e78f486c4a118608290040b31cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestVolumeBootPattern-1994669512 May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5833e78f486c4a118608290040b31cfc May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestVolumeBootPattern-1994669512-project May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 388458a7b3504bd08f3789f53cf9ea35 May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestVolumeBootPattern-1994669512-project May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '9da2e5da-8e7d-4a2f-8122-107438f11587'} May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:39:31.400668 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:39:31.409982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:39:31.409982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:39:31.409982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:39:31.409982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:39:31.409982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:39:31.409982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. May 28 21:39:31.409982 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:39:31.409982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7fbe049d-7fdf-4fb3-a43c-cd103ee94ce6 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Returning 404 to user: Instance 9da2e5da-8e7d-4a2f-8122-107438f11587 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:39:31.409982 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7fbe049d-7fdf-4fb3-a43c-cd103ee94ce6 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587" status: 404 len: 111 microversion: 2.1 time: 0.044645 May 28 21:39:31.409982 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3066/6088] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:31 2022] GET /compute/v2.1/servers/9da2e5da-8e7d-4a2f-8122-107438f11587 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:39:51.423787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1243897856", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2869ef6c-a254-4e8c-adc3-29d4f49c8803", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "66a65b2a-c99c-44c5-8c4a-ebd7f0012d23"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:39:51.433452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:39:51.434227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:39:51.487770 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] validate_networks() for [('66a65b2a-c99c-44c5-8c4a-ebd7f0012d23', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:39:52.468464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:39:52.471556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:39:52.471556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:39:52.471556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:39:52.471556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:39:52.479613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:52.480084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:52.480904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:52.481355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:52.500442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Getting quotas for project 5833e78f486c4a118608290040b31cfc. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:39:52.506041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Getting quotas for user 388458a7b3504bd08f3789f53cf9ea35 and project 5833e78f486c4a118608290040b31cfc. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:39:52.571695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:39:52.574239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2869ef6c-a254-4e8c-adc3-29d4f49c8803',volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:39:53.139401 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e2809d68-68d2-499b-837e-186fd53f90ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.719780 May 28 21:39:53.140065 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3023/6089] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:39:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:39:53.152538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-88ff8e4e-3490-4832-93c4-4bb26cd90c7f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:53.153695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-88ff8e4e-3490-4832-93c4-4bb26cd90c7f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:53.162499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:39:53.163852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=70 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:39:53.225059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-88ff8e4e-3490-4832-93c4-4bb26cd90c7f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:53.233602 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-88ff8e4e-3490-4832-93c4-4bb26cd90c7f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1071 microversion: 2.1 time: 0.086736 May 28 21:39:53.234598 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3067/6090] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:53 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1071 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:54.252249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-caa7fe62-dcd3-4967-9513-2eb46e657ca0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:54.253001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-caa7fe62-dcd3-4967-9513-2eb46e657ca0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:54.263253 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-caa7fe62-dcd3-4967-9513-2eb46e657ca0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:54.263707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-caa7fe62-dcd3-4967-9513-2eb46e657ca0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:54.264479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-caa7fe62-dcd3-4967-9513-2eb46e657ca0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:54.264922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-caa7fe62-dcd3-4967-9513-2eb46e657ca0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:54.327755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-caa7fe62-dcd3-4967-9513-2eb46e657ca0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:54.335602 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-caa7fe62-dcd3-4967-9513-2eb46e657ca0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1121 microversion: 2.1 time: 0.088619 May 28 21:39:54.336271 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3024/6091] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:54 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1121 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:55.352920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-84fd37c8-6a33-4ecf-8208-2acabe00a1bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:55.355606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-84fd37c8-6a33-4ecf-8208-2acabe00a1bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:55.365694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84fd37c8-6a33-4ecf-8208-2acabe00a1bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:55.367456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84fd37c8-6a33-4ecf-8208-2acabe00a1bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:55.368257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84fd37c8-6a33-4ecf-8208-2acabe00a1bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:55.370010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84fd37c8-6a33-4ecf-8208-2acabe00a1bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:55.455962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-84fd37c8-6a33-4ecf-8208-2acabe00a1bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:55.469570 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-84fd37c8-6a33-4ecf-8208-2acabe00a1bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1177 microversion: 2.1 time: 0.120677 May 28 21:39:55.486450 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3068/6092] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:55 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1177 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:56.505031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e08620b4-653e-4b05-8641-088dbf4541ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:56.505713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e08620b4-653e-4b05-8641-088dbf4541ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:56.514409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e08620b4-653e-4b05-8641-088dbf4541ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:56.514865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e08620b4-653e-4b05-8641-088dbf4541ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:56.515792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e08620b4-653e-4b05-8641-088dbf4541ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:56.516422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e08620b4-653e-4b05-8641-088dbf4541ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:56.770054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e08620b4-653e-4b05-8641-088dbf4541ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:56.784657 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e08620b4-653e-4b05-8641-088dbf4541ab tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1229 microversion: 2.1 time: 0.285014 May 28 21:39:56.789989 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3025/6093] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:56 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1229 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:57.332567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-35310987-e8d2-4b91-a5c0-aa5c7ae29b88 req-3f641e7b-3b2f-4ffd-955f-2ded418daada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4527e2a9-d628-4542-9e0b-299945d3b75d", "tag": "1ef33897-2a16-4447-9b31-15473a71684a"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:39:57.356815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-35310987-e8d2-4b91-a5c0-aa5c7ae29b88 req-3f641e7b-3b2f-4ffd-955f-2ded418daada service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:57.357365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-35310987-e8d2-4b91-a5c0-aa5c7ae29b88 req-3f641e7b-3b2f-4ffd-955f-2ded418daada service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:57.373410 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-35310987-e8d2-4b91-a5c0-aa5c7ae29b88 req-3f641e7b-3b2f-4ffd-955f-2ded418daada service nova] Creating event network-changed:1ef33897-2a16-4447-9b31-15473a71684a for instance 4527e2a9-d628-4542-9e0b-299945d3b75d on nch2-master-1 May 28 21:39:57.379329 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-35310987-e8d2-4b91-a5c0-aa5c7ae29b88 req-3f641e7b-3b2f-4ffd-955f-2ded418daada service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057221 May 28 21:39:57.380299 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3069/6094] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:39:57.802693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-877da9c9-2131-4022-9217-00b9dc9d49c9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:57.803707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-877da9c9-2131-4022-9217-00b9dc9d49c9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:57.813760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-877da9c9-2131-4022-9217-00b9dc9d49c9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:57.814607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-877da9c9-2131-4022-9217-00b9dc9d49c9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:57.816137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-877da9c9-2131-4022-9217-00b9dc9d49c9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:57.816994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-877da9c9-2131-4022-9217-00b9dc9d49c9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:58.061856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-877da9c9-2131-4022-9217-00b9dc9d49c9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:58.065912 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-877da9c9-2131-4022-9217-00b9dc9d49c9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1217 microversion: 2.1 time: 0.267202 May 28 21:39:58.066849 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3026/6095] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:57 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1217 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:39:59.082725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a0e88cc8-7703-4407-823c-d4fee27691a9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:39:59.083455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a0e88cc8-7703-4407-823c-d4fee27691a9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:39:59.091710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0e88cc8-7703-4407-823c-d4fee27691a9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:59.092177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0e88cc8-7703-4407-823c-d4fee27691a9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:59.092964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0e88cc8-7703-4407-823c-d4fee27691a9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:39:59.093419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0e88cc8-7703-4407-823c-d4fee27691a9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:39:59.424710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a0e88cc8-7703-4407-823c-d4fee27691a9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:39:59.432804 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a0e88cc8-7703-4407-823c-d4fee27691a9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1217 microversion: 2.1 time: 0.354388 May 28 21:39:59.433392 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3070/6096] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:39:59 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1217 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:00.449925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-24fc11c5-1821-49e8-81c3-a4ec1d3a2d72 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:00.450558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-24fc11c5-1821-49e8-81c3-a4ec1d3a2d72 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:00.458008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24fc11c5-1821-49e8-81c3-a4ec1d3a2d72 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:00.460456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24fc11c5-1821-49e8-81c3-a4ec1d3a2d72 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:00.460456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24fc11c5-1821-49e8-81c3-a4ec1d3a2d72 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:00.460456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-24fc11c5-1821-49e8-81c3-a4ec1d3a2d72 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:00.636716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-24fc11c5-1821-49e8-81c3-a4ec1d3a2d72 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:00.645124 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-24fc11c5-1821-49e8-81c3-a4ec1d3a2d72 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1217 microversion: 2.1 time: 0.199447 May 28 21:40:00.645960 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3027/6097] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:00 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1217 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:01.663039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-93265c09-c4e0-4b30-b02e-f956438ac591 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:01.663597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-93265c09-c4e0-4b30-b02e-f956438ac591 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:01.672389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93265c09-c4e0-4b30-b02e-f956438ac591 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:01.672851 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93265c09-c4e0-4b30-b02e-f956438ac591 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:01.673694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93265c09-c4e0-4b30-b02e-f956438ac591 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:01.674168 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-93265c09-c4e0-4b30-b02e-f956438ac591 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:01.924015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-93265c09-c4e0-4b30-b02e-f956438ac591 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:01.932019 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-93265c09-c4e0-4b30-b02e-f956438ac591 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1217 microversion: 2.1 time: 0.273018 May 28 21:40:01.932892 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3071/6098] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:01 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1217 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:02.957079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-83ddb65e-cf34-4498-8390-a0aef54986e3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:02.957733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-83ddb65e-cf34-4498-8390-a0aef54986e3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:02.961482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:40:02.962427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:40:02.967508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-83ddb65e-cf34-4498-8390-a0aef54986e3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:02.968313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-83ddb65e-cf34-4498-8390-a0aef54986e3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:02.969270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-83ddb65e-cf34-4498-8390-a0aef54986e3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:02.970241 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-83ddb65e-cf34-4498-8390-a0aef54986e3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:03.132001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-83ddb65e-cf34-4498-8390-a0aef54986e3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:03.143366 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-83ddb65e-cf34-4498-8390-a0aef54986e3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1217 microversion: 2.1 time: 0.198342 May 28 21:40:03.144464 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3028/6099] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:02 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1217 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:04.160843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ba7d3a18-23ed-4f87-bfdd-2cb6e41f60fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:04.161469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ba7d3a18-23ed-4f87-bfdd-2cb6e41f60fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:04.164389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:40:04.169306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba7d3a18-23ed-4f87-bfdd-2cb6e41f60fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:04.169805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba7d3a18-23ed-4f87-bfdd-2cb6e41f60fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:04.170625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba7d3a18-23ed-4f87-bfdd-2cb6e41f60fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:04.171075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ba7d3a18-23ed-4f87-bfdd-2cb6e41f60fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:04.429058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ba7d3a18-23ed-4f87-bfdd-2cb6e41f60fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:04.437740 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ba7d3a18-23ed-4f87-bfdd-2cb6e41f60fe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1217 microversion: 2.1 time: 0.281008 May 28 21:40:04.438357 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3072/6100] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:04 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1217 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:04.858397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2fe3deae-000a-4611-acd0-f1992c728a8c req-d0b1e71e-b38e-4b18-bb60-13befcce18b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4527e2a9-d628-4542-9e0b-299945d3b75d", "name": "network-vif-plugged", "status": "completed", "tag": "1ef33897-2a16-4447-9b31-15473a71684a"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:40:04.869694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2fe3deae-000a-4611-acd0-f1992c728a8c req-d0b1e71e-b38e-4b18-bb60-13befcce18b2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:04.869694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2fe3deae-000a-4611-acd0-f1992c728a8c req-d0b1e71e-b38e-4b18-bb60-13befcce18b2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:04.881212 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2fe3deae-000a-4611-acd0-f1992c728a8c req-d0b1e71e-b38e-4b18-bb60-13befcce18b2 service nova] Creating event network-vif-plugged:1ef33897-2a16-4447-9b31-15473a71684a for instance 4527e2a9-d628-4542-9e0b-299945d3b75d on nch2-master-1 May 28 21:40:04.886404 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2fe3deae-000a-4611-acd0-f1992c728a8c req-d0b1e71e-b38e-4b18-bb60-13befcce18b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031666 May 28 21:40:04.887301 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3029/6101] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:40:05.454183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-497a7b4f-346e-410b-bd11-5283f064a701 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:05.454809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-497a7b4f-346e-410b-bd11-5283f064a701 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:05.462262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-497a7b4f-346e-410b-bd11-5283f064a701 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:05.463289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-497a7b4f-346e-410b-bd11-5283f064a701 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:05.464476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-497a7b4f-346e-410b-bd11-5283f064a701 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:05.464785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-497a7b4f-346e-410b-bd11-5283f064a701 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:05.671870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-497a7b4f-346e-410b-bd11-5283f064a701 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:05.680004 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-497a7b4f-346e-410b-bd11-5283f064a701 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1217 microversion: 2.1 time: 0.229854 May 28 21:40:05.680598 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3073/6102] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:05 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:06.698305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-14d01892-f5bb-4489-97e7-d7d944e6dcbb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:06.699965 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-14d01892-f5bb-4489-97e7-d7d944e6dcbb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:06.706464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14d01892-f5bb-4489-97e7-d7d944e6dcbb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:06.706867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14d01892-f5bb-4489-97e7-d7d944e6dcbb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:06.707644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14d01892-f5bb-4489-97e7-d7d944e6dcbb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:06.708096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-14d01892-f5bb-4489-97e7-d7d944e6dcbb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:06.939722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-14d01892-f5bb-4489-97e7-d7d944e6dcbb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:06.948352 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-14d01892-f5bb-4489-97e7-d7d944e6dcbb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1403 microversion: 2.1 time: 0.255235 May 28 21:40:06.948950 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3030/6103] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:06 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1403 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:06.965857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fd97e93c-5957-403b-af25-9855313fff6e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:06.967214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fd97e93c-5957-403b-af25-9855313fff6e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:06.974833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd97e93c-5957-403b-af25-9855313fff6e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:06.979044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd97e93c-5957-403b-af25-9855313fff6e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:06.979044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd97e93c-5957-403b-af25-9855313fff6e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:06.979044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd97e93c-5957-403b-af25-9855313fff6e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:07.117947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fd97e93c-5957-403b-af25-9855313fff6e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:07.125866 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fd97e93c-5957-403b-af25-9855313fff6e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1403 microversion: 2.1 time: 0.164597 May 28 21:40:07.126451 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3074/6104] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:06 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1403 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:07.142817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-00adc55c-1175-4596-80c7-7166ccd2b94e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-67910199"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:40:07.143915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-00adc55c-1175-4596-80c7-7166ccd2b94e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:07.150076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00adc55c-1175-4596-80c7-7166ccd2b94e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:07.151106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00adc55c-1175-4596-80c7-7166ccd2b94e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:07.151964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00adc55c-1175-4596-80c7-7166ccd2b94e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:07.152540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00adc55c-1175-4596-80c7-7166ccd2b94e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:07.245011 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.compute.api [None req-00adc55c-1175-4596-80c7-7166ccd2b94e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Attempting to quiesce instance before volume snapshot. May 28 21:40:07.304949 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.compute.api [None req-00adc55c-1175-4596-80c7-7166ccd2b94e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Skipping quiescing instance because the operation is not supported by the underlying compute driver. May 28 21:40:07.529259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-00adc55c-1175-4596-80c7-7166ccd2b94e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Creating snapshot from volume 2869ef6c-a254-4e8c-adc3-29d4f49c8803. {{(pid=143128) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} May 28 21:40:09.289315 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-00adc55c-1175-4596-80c7-7166ccd2b94e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "POST /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d/action" status: 202 len: 0 microversion: 2.1 time: 2.150470 May 28 21:40:09.290156 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3031/6105] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:40:07 2022] POST /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d/action => generated 0 bytes in 2152 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 21:40:11.535391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1371513757", "imageRef": "1dc069a0-0959-42ec-a716-246cdf44f91a", "flavorRef": "452", "networks": [{"uuid": "66a65b2a-c99c-44c5-8c4a-ebd7f0012d23"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:40:11.590327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] validate_networks() for [('66a65b2a-c99c-44c5-8c4a-ebd7f0012d23', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:40:11.960847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:40:11.961305 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:40:11.961787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:40:11.962236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:40:11.962686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:40:11.972050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:11.972508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:11.973308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:11.973749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:11.991222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Getting quotas for project 5833e78f486c4a118608290040b31cfc. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:40:11.997133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Getting quotas for user 388458a7b3504bd08f3789f53cf9ea35 and project 5833e78f486c4a118608290040b31cfc. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:40:12.009451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:40:12.011985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2ca018f7-a0df-4767-af4d-8f3d3a002686',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:40:12.158505 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9657b22c-8514-42d8-8816-c33f6cdadb26 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.626964 May 28 21:40:12.163875 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3075/6106] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:40:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:40:12.171079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a2ccffbc-770a-4ef3-9b9a-136e714faa53 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:12.171919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a2ccffbc-770a-4ef3-9b9a-136e714faa53 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:12.244131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a2ccffbc-770a-4ef3-9b9a-136e714faa53 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:12.257874 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a2ccffbc-770a-4ef3-9b9a-136e714faa53 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1230 microversion: 2.1 time: 0.091826 May 28 21:40:12.258498 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3032/6107] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:12 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1230 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:13.276424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dd7e1a56-1395-4735-a927-d64569bd8e1f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:13.277085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dd7e1a56-1395-4735-a927-d64569bd8e1f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:13.283559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd7e1a56-1395-4735-a927-d64569bd8e1f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:13.284020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd7e1a56-1395-4735-a927-d64569bd8e1f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:13.284913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd7e1a56-1395-4735-a927-d64569bd8e1f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:13.285366 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd7e1a56-1395-4735-a927-d64569bd8e1f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:13.347444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dd7e1a56-1395-4735-a927-d64569bd8e1f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:13.355353 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dd7e1a56-1395-4735-a927-d64569bd8e1f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1234 microversion: 2.1 time: 0.084330 May 28 21:40:13.356119 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3076/6108] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:13 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1234 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:14.374257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7c5b2c6a-2ec9-4986-809b-2e3b4cb0dd06 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:14.375595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7c5b2c6a-2ec9-4986-809b-2e3b4cb0dd06 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:14.384367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c5b2c6a-2ec9-4986-809b-2e3b4cb0dd06 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:14.385724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c5b2c6a-2ec9-4986-809b-2e3b4cb0dd06 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:14.386838 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c5b2c6a-2ec9-4986-809b-2e3b4cb0dd06 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:14.387459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7c5b2c6a-2ec9-4986-809b-2e3b4cb0dd06 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:14.458791 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7c5b2c6a-2ec9-4986-809b-2e3b4cb0dd06 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:14.467932 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7c5b2c6a-2ec9-4986-809b-2e3b4cb0dd06 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1290 microversion: 2.1 time: 0.099069 May 28 21:40:14.468615 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3033/6109] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:14 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1290 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:15.485995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bd813edb-80ee-4eef-b605-f9d2f019dbb7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:15.487970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bd813edb-80ee-4eef-b605-f9d2f019dbb7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:15.495998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd813edb-80ee-4eef-b605-f9d2f019dbb7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:15.496508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd813edb-80ee-4eef-b605-f9d2f019dbb7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:15.497254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd813edb-80ee-4eef-b605-f9d2f019dbb7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:15.497922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bd813edb-80ee-4eef-b605-f9d2f019dbb7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:15.577627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bd813edb-80ee-4eef-b605-f9d2f019dbb7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:15.588741 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bd813edb-80ee-4eef-b605-f9d2f019dbb7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1300 microversion: 2.1 time: 0.106456 May 28 21:40:15.589622 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3077/6110] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:15 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:16.611683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f698373c-8123-4a3a-8ae1-626576a518bd tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:16.612662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f698373c-8123-4a3a-8ae1-626576a518bd tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:16.622624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f698373c-8123-4a3a-8ae1-626576a518bd tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:16.623110 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f698373c-8123-4a3a-8ae1-626576a518bd tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:16.623920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f698373c-8123-4a3a-8ae1-626576a518bd tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:16.624555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f698373c-8123-4a3a-8ae1-626576a518bd tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:16.789328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f698373c-8123-4a3a-8ae1-626576a518bd tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:16.810863 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f698373c-8123-4a3a-8ae1-626576a518bd tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1342 microversion: 2.1 time: 0.207657 May 28 21:40:16.822602 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3034/6111] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:16 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:17.797522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-430cb750-9caf-45d3-9af3-10b580268d06 req-9993c8d1-1b57-4760-a240-48c401bc2755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ac27b04-a334-430a-8861-7ecbd2efa725", "tag": "6afedae5-e7e4-44ad-9610-8ca96aa15dcf"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:40:17.808480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-430cb750-9caf-45d3-9af3-10b580268d06 req-9993c8d1-1b57-4760-a240-48c401bc2755 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:17.808982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-430cb750-9caf-45d3-9af3-10b580268d06 req-9993c8d1-1b57-4760-a240-48c401bc2755 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:17.830596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bbe8ab3e-8e33-403b-a94d-7df824e33a95 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:17.831134 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-430cb750-9caf-45d3-9af3-10b580268d06 req-9993c8d1-1b57-4760-a240-48c401bc2755 service nova] Creating event network-changed:6afedae5-e7e4-44ad-9610-8ca96aa15dcf for instance 1ac27b04-a334-430a-8861-7ecbd2efa725 on nch1-master-1 May 28 21:40:17.832071 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bbe8ab3e-8e33-403b-a94d-7df824e33a95 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:17.837026 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-430cb750-9caf-45d3-9af3-10b580268d06 req-9993c8d1-1b57-4760-a240-48c401bc2755 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211499 May 28 21:40:17.838641 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3078/6112] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:40:17.845537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbe8ab3e-8e33-403b-a94d-7df824e33a95 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:17.846326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbe8ab3e-8e33-403b-a94d-7df824e33a95 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:17.847327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbe8ab3e-8e33-403b-a94d-7df824e33a95 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:17.851197 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bbe8ab3e-8e33-403b-a94d-7df824e33a95 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:18.006580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bbe8ab3e-8e33-403b-a94d-7df824e33a95 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:18.014925 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bbe8ab3e-8e33-403b-a94d-7df824e33a95 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1342 microversion: 2.1 time: 0.188586 May 28 21:40:18.015561 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3035/6113] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:17 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1342 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:40:19.033562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7c47ce51-e586-4994-b645-4e75037a0f73 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:19.034330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7c47ce51-e586-4994-b645-4e75037a0f73 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:19.042633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c47ce51-e586-4994-b645-4e75037a0f73 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:19.043093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c47ce51-e586-4994-b645-4e75037a0f73 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:19.043978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c47ce51-e586-4994-b645-4e75037a0f73 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:19.044414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c47ce51-e586-4994-b645-4e75037a0f73 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:19.205873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7c47ce51-e586-4994-b645-4e75037a0f73 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:19.215209 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7c47ce51-e586-4994-b645-4e75037a0f73 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1342 microversion: 2.1 time: 0.186169 May 28 21:40:19.215802 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3079/6114] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:19 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1342 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:20.233077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-34707673-7647-40ff-afe5-00519246e5bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:20.233723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-34707673-7647-40ff-afe5-00519246e5bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:20.240910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-34707673-7647-40ff-afe5-00519246e5bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:20.241382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-34707673-7647-40ff-afe5-00519246e5bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:20.242199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-34707673-7647-40ff-afe5-00519246e5bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:20.242654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-34707673-7647-40ff-afe5-00519246e5bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:20.390603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-34707673-7647-40ff-afe5-00519246e5bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:20.399557 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-34707673-7647-40ff-afe5-00519246e5bb tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1388 microversion: 2.1 time: 0.170418 May 28 21:40:20.400891 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3036/6115] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:20 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1388 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:21.417744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a39f363-14fc-4469-92a2-77a658a1ead8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:21.421065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6a39f363-14fc-4469-92a2-77a658a1ead8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:21.425867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a39f363-14fc-4469-92a2-77a658a1ead8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:21.426411 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a39f363-14fc-4469-92a2-77a658a1ead8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:21.427138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a39f363-14fc-4469-92a2-77a658a1ead8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:21.427593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a39f363-14fc-4469-92a2-77a658a1ead8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:21.570906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a39f363-14fc-4469-92a2-77a658a1ead8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:21.580020 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6a39f363-14fc-4469-92a2-77a658a1ead8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1376 microversion: 2.1 time: 0.166722 May 28 21:40:21.581044 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3080/6116] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:21 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:40:22.600549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd4ad115-6f94-4f41-a857-dc7b5895c75f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:22.601305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bd4ad115-6f94-4f41-a857-dc7b5895c75f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:22.608015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:40:22.614343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:40:22.614343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd4ad115-6f94-4f41-a857-dc7b5895c75f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:22.614343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd4ad115-6f94-4f41-a857-dc7b5895c75f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:22.614343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd4ad115-6f94-4f41-a857-dc7b5895c75f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:22.614343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd4ad115-6f94-4f41-a857-dc7b5895c75f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:22.617740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:40:22.658355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:40:22.659739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:40:22.766678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bd4ad115-6f94-4f41-a857-dc7b5895c75f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:22.774962 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bd4ad115-6f94-4f41-a857-dc7b5895c75f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1376 microversion: 2.1 time: 0.178750 May 28 21:40:22.775711 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3037/6117] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:22 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1376 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:22.806885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9e217bc1-f3ff-4dd0-ab4f-cd4b169a0268 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:22.807421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9e217bc1-f3ff-4dd0-ab4f-cd4b169a0268 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:22.814149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e217bc1-f3ff-4dd0-ab4f-cd4b169a0268 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:22.814617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e217bc1-f3ff-4dd0-ab4f-cd4b169a0268 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:22.815727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e217bc1-f3ff-4dd0-ab4f-cd4b169a0268 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:22.815895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e217bc1-f3ff-4dd0-ab4f-cd4b169a0268 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:22.844444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9e217bc1-f3ff-4dd0-ab4f-cd4b169a0268 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:40:23.172344 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9e217bc1-f3ff-4dd0-ab4f-cd4b169a0268 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "DELETE /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 204 len: 0 microversion: 2.1 time: 0.518626 May 28 21:40:23.173311 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3081/6118] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:40:22 2022] DELETE /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 28 21:40:23.186471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f752040e-dd88-4aa7-a60c-06e21f1ba415 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:23.187118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f752040e-dd88-4aa7-a60c-06e21f1ba415 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:23.194578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f752040e-dd88-4aa7-a60c-06e21f1ba415 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:23.195052 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f752040e-dd88-4aa7-a60c-06e21f1ba415 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:23.195872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f752040e-dd88-4aa7-a60c-06e21f1ba415 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:23.196520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f752040e-dd88-4aa7-a60c-06e21f1ba415 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:23.342500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f752040e-dd88-4aa7-a60c-06e21f1ba415 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:23.350830 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f752040e-dd88-4aa7-a60c-06e21f1ba415 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1732 microversion: 2.1 time: 0.168215 May 28 21:40:23.351396 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3038/6119] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:23 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:23.795542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1d99bb55-9e73-4985-9187-5caa4c47ffd0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:23.796456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1d99bb55-9e73-4985-9187-5caa4c47ffd0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:23.807907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d99bb55-9e73-4985-9187-5caa4c47ffd0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:23.808450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d99bb55-9e73-4985-9187-5caa4c47ffd0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:23.809321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d99bb55-9e73-4985-9187-5caa4c47ffd0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:23.809870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d99bb55-9e73-4985-9187-5caa4c47ffd0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:23.954852 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1d99bb55-9e73-4985-9187-5caa4c47ffd0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:23.964815 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1d99bb55-9e73-4985-9187-5caa4c47ffd0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1376 microversion: 2.1 time: 0.174903 May 28 21:40:23.974605 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3082/6120] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:23 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1376 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:24.369122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-29188bfe-35f6-4c6b-b517-6f4154fa9597 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:24.369789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-29188bfe-35f6-4c6b-b517-6f4154fa9597 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:24.377434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29188bfe-35f6-4c6b-b517-6f4154fa9597 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:24.377920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29188bfe-35f6-4c6b-b517-6f4154fa9597 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:24.379584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29188bfe-35f6-4c6b-b517-6f4154fa9597 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:24.379584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-29188bfe-35f6-4c6b-b517-6f4154fa9597 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:24.519837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-29188bfe-35f6-4c6b-b517-6f4154fa9597 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:24.527701 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-29188bfe-35f6-4c6b-b517-6f4154fa9597 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1732 microversion: 2.1 time: 0.163010 May 28 21:40:24.528295 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3039/6121] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:24 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:24.985218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2810c7ae-589d-4940-bc1f-b51340ffdb54 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:24.986357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2810c7ae-589d-4940-bc1f-b51340ffdb54 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:24.999302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2810c7ae-589d-4940-bc1f-b51340ffdb54 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:25.000246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2810c7ae-589d-4940-bc1f-b51340ffdb54 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:25.002296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2810c7ae-589d-4940-bc1f-b51340ffdb54 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:25.003387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2810c7ae-589d-4940-bc1f-b51340ffdb54 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:25.179615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2810c7ae-589d-4940-bc1f-b51340ffdb54 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:25.189106 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2810c7ae-589d-4940-bc1f-b51340ffdb54 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1376 microversion: 2.1 time: 0.211207 May 28 21:40:25.190528 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3083/6122] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:24 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1376 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:25.545457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6f7eb9ab-167a-45bb-b0da-53dd3ad0b87b tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:25.546678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6f7eb9ab-167a-45bb-b0da-53dd3ad0b87b tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:25.555392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f7eb9ab-167a-45bb-b0da-53dd3ad0b87b tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:25.558467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f7eb9ab-167a-45bb-b0da-53dd3ad0b87b tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:25.558467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f7eb9ab-167a-45bb-b0da-53dd3ad0b87b tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:25.558467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6f7eb9ab-167a-45bb-b0da-53dd3ad0b87b tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:25.642841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6f7eb9ab-167a-45bb-b0da-53dd3ad0b87b tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:25.651392 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6f7eb9ab-167a-45bb-b0da-53dd3ad0b87b tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1664 microversion: 2.1 time: 0.110646 May 28 21:40:25.652091 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3040/6123] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:25 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1664 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:26.067564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-cf5c04f8-9c18-4507-97cf-4b4a16948b4d req-50f93f31-6ad3-45a3-99fe-10ef17220517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be4e698e-48f4-4ffd-82f7-9f9497b6dc30", "name": "network-vif-deleted", "tag": "36e6204f-ff1b-4d12-a280-9411350bd0f6"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:40:26.077956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:40:26.083090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cf5c04f8-9c18-4507-97cf-4b4a16948b4d req-50f93f31-6ad3-45a3-99fe-10ef17220517 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:26.083802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cf5c04f8-9c18-4507-97cf-4b4a16948b4d req-50f93f31-6ad3-45a3-99fe-10ef17220517 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:26.088462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:40:26.101567 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-cf5c04f8-9c18-4507-97cf-4b4a16948b4d req-50f93f31-6ad3-45a3-99fe-10ef17220517 service nova] Creating event network-vif-deleted:36e6204f-ff1b-4d12-a280-9411350bd0f6 for instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 on nch1-master-1 May 28 21:40:26.113437 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-cf5c04f8-9c18-4507-97cf-4b4a16948b4d req-50f93f31-6ad3-45a3-99fe-10ef17220517 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051084 May 28 21:40:26.114366 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3084/6124] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:40:26.211142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-485c0eaf-7aa1-43f8-ace4-675293f54588 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:26.212148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-485c0eaf-7aa1-43f8-ace4-675293f54588 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:26.220745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-485c0eaf-7aa1-43f8-ace4-675293f54588 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:26.226171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-485c0eaf-7aa1-43f8-ace4-675293f54588 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:26.229483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-485c0eaf-7aa1-43f8-ace4-675293f54588 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:26.230170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-485c0eaf-7aa1-43f8-ace4-675293f54588 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:26.538017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-485c0eaf-7aa1-43f8-ace4-675293f54588 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:26.551669 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-485c0eaf-7aa1-43f8-ace4-675293f54588 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1376 microversion: 2.1 time: 0.348042 May 28 21:40:26.556548 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3041/6125] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:26 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1376 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:26.671434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d6649311-17ae-4f79-b231-83b70321ad14 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:26.672449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d6649311-17ae-4f79-b231-83b70321ad14 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:26.682204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6649311-17ae-4f79-b231-83b70321ad14 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:26.682868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6649311-17ae-4f79-b231-83b70321ad14 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:26.683824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6649311-17ae-4f79-b231-83b70321ad14 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:26.684443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6649311-17ae-4f79-b231-83b70321ad14 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:26.722624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6649311-17ae-4f79-b231-83b70321ad14 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:26.723364 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6649311-17ae-4f79-b231-83b70321ad14 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:26.724080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-d6649311-17ae-4f79-b231-83b70321ad14 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lazy-loading 'fault' on Instance uuid be4e698e-48f4-4ffd-82f7-9f9497b6dc30 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:40:26.803318 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d6649311-17ae-4f79-b231-83b70321ad14 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13249a1c05fa43bd917b36aafb9db0d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b4e0b07528040a3aa0194c06fb942cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:26.811825 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d6649311-17ae-4f79-b231-83b70321ad14 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 200 len: 1389 microversion: 2.1 time: 0.146916 May 28 21:40:26.812431 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3085/6126] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:26 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 1389 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:27.221159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-e47a859b-ad14-4936-8e59-d508ebf3a3fb req-e812228c-7e98-486a-880d-2ba617eb9c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac27b04-a334-430a-8861-7ecbd2efa725", "name": "network-vif-plugged", "status": "completed", "tag": "6afedae5-e7e4-44ad-9610-8ca96aa15dcf"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:40:27.232530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e47a859b-ad14-4936-8e59-d508ebf3a3fb req-e812228c-7e98-486a-880d-2ba617eb9c71 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:27.233125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-e47a859b-ad14-4936-8e59-d508ebf3a3fb req-e812228c-7e98-486a-880d-2ba617eb9c71 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:27.247808 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-e47a859b-ad14-4936-8e59-d508ebf3a3fb req-e812228c-7e98-486a-880d-2ba617eb9c71 service nova] Creating event network-vif-plugged:6afedae5-e7e4-44ad-9610-8ca96aa15dcf for instance 1ac27b04-a334-430a-8861-7ecbd2efa725 on nch1-master-1 May 28 21:40:27.255711 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-e47a859b-ad14-4936-8e59-d508ebf3a3fb req-e812228c-7e98-486a-880d-2ba617eb9c71 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039367 May 28 21:40:27.262125 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3042/6127] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:40:27.580958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1ecb0943-a56d-49e1-8206-db2e047566f8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:27.581531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1ecb0943-a56d-49e1-8206-db2e047566f8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:27.590649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ecb0943-a56d-49e1-8206-db2e047566f8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:27.591014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ecb0943-a56d-49e1-8206-db2e047566f8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:27.591998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ecb0943-a56d-49e1-8206-db2e047566f8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:27.592612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1ecb0943-a56d-49e1-8206-db2e047566f8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:27.837134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1ecb0943-a56d-49e1-8206-db2e047566f8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:27.838141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-591f1ee5-e483-4c0d-bad9-6a8d4e9d1e89 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:27.840480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-591f1ee5-e483-4c0d-bad9-6a8d4e9d1e89 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:27.847341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-591f1ee5-e483-4c0d-bad9-6a8d4e9d1e89 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:27.848104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-591f1ee5-e483-4c0d-bad9-6a8d4e9d1e89 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:27.848234 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1ecb0943-a56d-49e1-8206-db2e047566f8 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1376 microversion: 2.1 time: 0.271389 May 28 21:40:27.849210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-591f1ee5-e483-4c0d-bad9-6a8d4e9d1e89 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:27.850280 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-591f1ee5-e483-4c0d-bad9-6a8d4e9d1e89 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:27.859428 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3086/6128] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:27 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1376 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:27.867522 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-591f1ee5-e483-4c0d-bad9-6a8d4e9d1e89 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] HTTP exception thrown: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-591f1ee5-e483-4c0d-bad9-6a8d4e9d1e89 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Request method failure captured: May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 HTTP/1.1 May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpWNvcpNxQ5IZSh_SJJ8j5oGq6Esz5FUBd4Ia8CsTXS0P7RCKGXIidWly45rL6a6vjuEf9FnNX6TZggNciRIi29K9tbTlLYALPyH3zG5vXgcHBVkJ1ayHOF_x14td4ZIfg-E1KcHOlHC9v7emMe8EAhD9WObt55aM6GkcRL2lxyaGSQ May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 4b4e0b07528040a3aa0194c06fb942cb May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestServerBasicOps-1147498718 May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4b4e0b07528040a3aa0194c06fb942cb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4b4e0b07528040a3aa0194c06fb942cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4b4e0b07528040a3aa0194c06fb942cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4b4e0b07528040a3aa0194c06fb942cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestServerBasicOps-1147498718 May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 4b4e0b07528040a3aa0194c06fb942cb May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestServerBasicOps-1147498718 May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestServerBasicOps-1147498718-project May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 13249a1c05fa43bd917b36aafb9db0d9 May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestServerBasicOps-1147498718-project May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'be4e698e-48f4-4ffd-82f7-9f9497b6dc30'} May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:40:27.869827 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:40:27.875261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:40:27.875261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:40:27.875261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:40:27.875261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:40:27.875261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:40:27.875261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. May 28 21:40:27.875261 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:40:27.877884 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-591f1ee5-e483-4c0d-bad9-6a8d4e9d1e89 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Returning 404 to user: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:40:27.878992 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-591f1ee5-e483-4c0d-bad9-6a8d4e9d1e89 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 404 len: 111 microversion: 2.1 time: 0.049321 May 28 21:40:27.879696 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3043/6129] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:27 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:40:28.468947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-88727d22-37f0-4a60-bfa0-a333c4f1afff tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:28.469601 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-88727d22-37f0-4a60-bfa0-a333c4f1afff tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:28.476419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88727d22-37f0-4a60-bfa0-a333c4f1afff tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:28.476907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88727d22-37f0-4a60-bfa0-a333c4f1afff tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:28.478455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88727d22-37f0-4a60-bfa0-a333c4f1afff tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:28.478922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88727d22-37f0-4a60-bfa0-a333c4f1afff tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:28.503571 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-88727d22-37f0-4a60-bfa0-a333c4f1afff tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] HTTP exception thrown: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-88727d22-37f0-4a60-bfa0-a333c4f1afff tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Request method failure captured: May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 HTTP/1.1 May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpWNvcpNxQ5IZSh_SJJ8j5oGq6Esz5FUBd4Ia8CsTXS0P7RCKGXIidWly45rL6a6vjuEf9FnNX6TZggNciRIi29K9tbTlLYALPyH3zG5vXgcHBVkJ1ayHOF_x14td4ZIfg-E1KcHOlHC9v7emMe8EAhD9WObt55aM6GkcRL2lxyaGSQ May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 4b4e0b07528040a3aa0194c06fb942cb May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestServerBasicOps-1147498718 May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4b4e0b07528040a3aa0194c06fb942cb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4b4e0b07528040a3aa0194c06fb942cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4b4e0b07528040a3aa0194c06fb942cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4b4e0b07528040a3aa0194c06fb942cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestServerBasicOps-1147498718 May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 4b4e0b07528040a3aa0194c06fb942cb May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestServerBasicOps-1147498718 May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestServerBasicOps-1147498718-project May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 13249a1c05fa43bd917b36aafb9db0d9 May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestServerBasicOps-1147498718-project May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'be4e698e-48f4-4ffd-82f7-9f9497b6dc30'} May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:40:28.505607 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. May 28 21:40:28.512042 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:40:28.512042 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:40:28.512042 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:40:28.512042 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:40:28.512042 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:40:28.512042 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:40:28.512042 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:40:28.512042 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:40:28.512042 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. May 28 21:40:28.512042 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:40:28.512042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-88727d22-37f0-4a60-bfa0-a333c4f1afff tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Returning 404 to user: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:40:28.512042 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-88727d22-37f0-4a60-bfa0-a333c4f1afff tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "DELETE /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 404 len: 111 microversion: 2.1 time: 0.042543 May 28 21:40:28.512042 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3087/6130] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:40:28 2022] DELETE /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:40:28.517926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bc2324fd-a80b-460e-ae48-6277bb130030 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:28.518692 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bc2324fd-a80b-460e-ae48-6277bb130030 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] [instance: be4e698e-48f4-4ffd-82f7-9f9497b6dc30] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:28.548715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc2324fd-a80b-460e-ae48-6277bb130030 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:28.549355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc2324fd-a80b-460e-ae48-6277bb130030 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:28.551749 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc2324fd-a80b-460e-ae48-6277bb130030 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:28.553548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc2324fd-a80b-460e-ae48-6277bb130030 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:28.579064 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-bc2324fd-a80b-460e-ae48-6277bb130030 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] HTTP exception thrown: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bc2324fd-a80b-460e-ae48-6277bb130030 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Request method failure captured: May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 HTTP/1.1 May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpWNvcpNxQ5IZSh_SJJ8j5oGq6Esz5FUBd4Ia8CsTXS0P7RCKGXIidWly45rL6a6vjuEf9FnNX6TZggNciRIi29K9tbTlLYALPyH3zG5vXgcHBVkJ1ayHOF_x14td4ZIfg-E1KcHOlHC9v7emMe8EAhD9WObt55aM6GkcRL2lxyaGSQ May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 4b4e0b07528040a3aa0194c06fb942cb May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestServerBasicOps-1147498718 May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4b4e0b07528040a3aa0194c06fb942cb", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4b4e0b07528040a3aa0194c06fb942cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4b4e0b07528040a3aa0194c06fb942cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4b4e0b07528040a3aa0194c06fb942cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestServerBasicOps-1147498718 May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 4b4e0b07528040a3aa0194c06fb942cb May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestServerBasicOps-1147498718 May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestServerBasicOps-1147498718-project May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 13249a1c05fa43bd917b36aafb9db0d9 May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestServerBasicOps-1147498718-project May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'be4e698e-48f4-4ffd-82f7-9f9497b6dc30'} May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:40:28.580888 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:40:28.586107 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:40:28.586107 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:40:28.586107 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:40:28.586107 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:40:28.586107 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:40:28.586107 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. May 28 21:40:28.586107 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:40:28.586107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bc2324fd-a80b-460e-ae48-6277bb130030 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Returning 404 to user: Instance be4e698e-48f4-4ffd-82f7-9f9497b6dc30 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:40:28.588131 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bc2324fd-a80b-460e-ae48-6277bb130030 tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30" status: 404 len: 111 microversion: 2.1 time: 0.074439 May 28 21:40:28.590523 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3044/6131] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:28 2022] GET /compute/v2.1/servers/be4e698e-48f4-4ffd-82f7-9f9497b6dc30 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:40:28.869543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-52a75b4b-1abe-4d80-ac9f-30de16e7dc7c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:28.870499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-52a75b4b-1abe-4d80-ac9f-30de16e7dc7c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:28.882773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52a75b4b-1abe-4d80-ac9f-30de16e7dc7c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:28.883243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52a75b4b-1abe-4d80-ac9f-30de16e7dc7c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:28.884942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52a75b4b-1abe-4d80-ac9f-30de16e7dc7c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:28.886055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-52a75b4b-1abe-4d80-ac9f-30de16e7dc7c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:29.022422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-08091cf4-3590-45d2-92ae-fbb027f9dc4b tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] Calling method '.version_select at 0x7f4d56daf4c0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:29.076770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-52a75b4b-1abe-4d80-ac9f-30de16e7dc7c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:29.091118 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-52a75b4b-1abe-4d80-ac9f-30de16e7dc7c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1376 microversion: 2.1 time: 0.227955 May 28 21:40:29.101653 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3088/6132] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:28 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1376 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:29.140296 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-08091cf4-3590-45d2-92ae-fbb027f9dc4b tempest-TestServerBasicOps-1147498718 tempest-TestServerBasicOps-1147498718-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2141702049" status: 202 len: 0 microversion: 2.1 time: 0.122463 May 28 21:40:29.150616 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3045/6133] 10.222.0.33 () {58 vars in 1253 bytes} [Sat May 28 21:40:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2141702049 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:40:30.114677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9c7349a1-35e0-412c-a4ca-fce27128eade tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:30.116648 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9c7349a1-35e0-412c-a4ca-fce27128eade tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:30.125285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c7349a1-35e0-412c-a4ca-fce27128eade tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:30.125285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c7349a1-35e0-412c-a4ca-fce27128eade tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:30.125285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c7349a1-35e0-412c-a4ca-fce27128eade tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:30.125663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c7349a1-35e0-412c-a4ca-fce27128eade tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:30.379528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9c7349a1-35e0-412c-a4ca-fce27128eade tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:30.388662 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9c7349a1-35e0-412c-a4ca-fce27128eade tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1562 microversion: 2.1 time: 0.282563 May 28 21:40:30.389254 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3089/6134] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:30 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1562 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:40:30.406512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-19180cd4-e55b-443d-8975-baa511bc7ecc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:30.407159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-19180cd4-e55b-443d-8975-baa511bc7ecc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:30.423212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19180cd4-e55b-443d-8975-baa511bc7ecc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:30.423212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19180cd4-e55b-443d-8975-baa511bc7ecc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:30.423212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19180cd4-e55b-443d-8975-baa511bc7ecc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:30.423212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19180cd4-e55b-443d-8975-baa511bc7ecc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:30.651037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-19180cd4-e55b-443d-8975-baa511bc7ecc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:30.667603 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-19180cd4-e55b-443d-8975-baa511bc7ecc tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1562 microversion: 2.1 time: 0.260614 May 28 21:40:30.667603 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3046/6135] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:30 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1562 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:30.738842 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fd7188f2-c063-4a79-adca-44d29327d578 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:30.739363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fd7188f2-c063-4a79-adca-44d29327d578 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:30.746450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd7188f2-c063-4a79-adca-44d29327d578 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:30.746889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd7188f2-c063-4a79-adca-44d29327d578 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:30.751015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd7188f2-c063-4a79-adca-44d29327d578 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:30.751015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fd7188f2-c063-4a79-adca-44d29327d578 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:30.780131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fd7188f2-c063-4a79-adca-44d29327d578 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:40:31.305315 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fd7188f2-c063-4a79-adca-44d29327d578 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 204 len: 0 microversion: 2.1 time: 0.570195 May 28 21:40:31.307246 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3090/6136] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:40:30 2022] DELETE /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:40:31.317185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-27f0e91e-33b7-401c-911d-1de81135e15d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:31.318135 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-27f0e91e-33b7-401c-911d-1de81135e15d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:31.328826 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-27f0e91e-33b7-401c-911d-1de81135e15d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:31.332198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-27f0e91e-33b7-401c-911d-1de81135e15d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:31.332198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-27f0e91e-33b7-401c-911d-1de81135e15d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:31.332198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-27f0e91e-33b7-401c-911d-1de81135e15d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:31.801319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-27f0e91e-33b7-401c-911d-1de81135e15d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:31.816575 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-27f0e91e-33b7-401c-911d-1de81135e15d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1568 microversion: 2.1 time: 0.504321 May 28 21:40:31.827801 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3047/6137] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:31 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1568 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:32.836128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9e17b4c0-748a-431e-bf89-917004cb9853 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:32.839806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9e17b4c0-748a-431e-bf89-917004cb9853 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:32.869805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e17b4c0-748a-431e-bf89-917004cb9853 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:32.870317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e17b4c0-748a-431e-bf89-917004cb9853 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:32.872495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e17b4c0-748a-431e-bf89-917004cb9853 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:32.879859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e17b4c0-748a-431e-bf89-917004cb9853 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:33.380275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9e17b4c0-748a-431e-bf89-917004cb9853 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:33.398957 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9e17b4c0-748a-431e-bf89-917004cb9853 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1568 microversion: 2.1 time: 0.558902 May 28 21:40:33.399587 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3091/6138] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:32 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1568 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:33.920267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-cc7938c1-1337-4304-9135-05d0b21e7bc9 req-b27008e0-8125-4329-b58b-6ce621712031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ac27b04-a334-430a-8861-7ecbd2efa725", "name": "network-vif-deleted", "tag": "6afedae5-e7e4-44ad-9610-8ca96aa15dcf"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:40:33.935505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cc7938c1-1337-4304-9135-05d0b21e7bc9 req-b27008e0-8125-4329-b58b-6ce621712031 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:33.939983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cc7938c1-1337-4304-9135-05d0b21e7bc9 req-b27008e0-8125-4329-b58b-6ce621712031 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:33.963376 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-cc7938c1-1337-4304-9135-05d0b21e7bc9 req-b27008e0-8125-4329-b58b-6ce621712031 service nova] Creating event network-vif-deleted:6afedae5-e7e4-44ad-9610-8ca96aa15dcf for instance 1ac27b04-a334-430a-8861-7ecbd2efa725 on nch1-master-1 May 28 21:40:33.988786 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-cc7938c1-1337-4304-9135-05d0b21e7bc9 req-b27008e0-8125-4329-b58b-6ce621712031 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063124 May 28 21:40:33.989766 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3048/6139] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:40:34.408396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-302cd5ee-5ddd-4a85-b844-5f558902b31f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:34.409092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-302cd5ee-5ddd-4a85-b844-5f558902b31f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:34.423701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-302cd5ee-5ddd-4a85-b844-5f558902b31f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:34.427833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-302cd5ee-5ddd-4a85-b844-5f558902b31f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:34.435361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-302cd5ee-5ddd-4a85-b844-5f558902b31f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:34.436167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-302cd5ee-5ddd-4a85-b844-5f558902b31f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:34.615965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-302cd5ee-5ddd-4a85-b844-5f558902b31f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:40:34.629227 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-302cd5ee-5ddd-4a85-b844-5f558902b31f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 200 len: 1361 microversion: 2.1 time: 0.224788 May 28 21:40:34.641088 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3092/6140] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:34 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:40:35.649827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7bf1cdd2-ee52-428d-8886-ed060b98aa58 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:35.653206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7bf1cdd2-ee52-428d-8886-ed060b98aa58 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:40:35.663223 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bf1cdd2-ee52-428d-8886-ed060b98aa58 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:35.665947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bf1cdd2-ee52-428d-8886-ed060b98aa58 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:35.666942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bf1cdd2-ee52-428d-8886-ed060b98aa58 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:35.667480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bf1cdd2-ee52-428d-8886-ed060b98aa58 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:35.685189 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-7bf1cdd2-ee52-428d-8886-ed060b98aa58 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] HTTP exception thrown: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7bf1cdd2-ee52-428d-8886-ed060b98aa58 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Request method failure captured: May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 HTTP/1.1 May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpZj6T8fAUPV0L9vvdx7FjM-mPDbeMcny2vaFgqFap_hhOicDv_aSrneSkPKTuy8G7aOJ8u-6aN6vtjm8OAlWN3Sh2BNpOvEzUNMkpGCfAsXWUG9AhKKLTChCVZAHzz9iHirDXgMjQoShyXSLMnsx_u72mL9Gv37fsMmCKprrAlJHzI May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5833e78f486c4a118608290040b31cfc May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5833e78f486c4a118608290040b31cfc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5833e78f486c4a118608290040b31cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestVolumeBootPattern-1994669512 May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5833e78f486c4a118608290040b31cfc May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestVolumeBootPattern-1994669512-project May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 388458a7b3504bd08f3789f53cf9ea35 May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestVolumeBootPattern-1994669512-project May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '1ac27b04-a334-430a-8861-7ecbd2efa725'} May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:40:35.687336 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:40:35.691575 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:40:35.691575 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:40:35.691575 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:40:35.691575 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:40:35.691575 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:40:35.691575 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. May 28 21:40:35.691575 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:40:35.691575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7bf1cdd2-ee52-428d-8886-ed060b98aa58 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Returning 404 to user: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:40:35.699203 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7bf1cdd2-ee52-428d-8886-ed060b98aa58 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 404 len: 111 microversion: 2.1 time: 0.045275 May 28 21:40:35.701121 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3049/6141] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:40:35 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:40:46.230299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:40:46.231077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:40:46.543162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8b648ed2-fcce-4995-839a-c5fc49d4c93c tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2128913152", "availability_zone": "foo_zone"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:40:46.546185 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:40:46.546185 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:40:46.547375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.aggregate [None req-8b648ed2-fcce-4995-839a-c5fc49d4c93c tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Generated uuid 5721aae4-7fda-4b72-8efb-e76a6310b501 for aggregate {{(pid=143129) create /opt/stack/nova/nova/objects/aggregate.py:298}} May 28 21:40:46.634577 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8b648ed2-fcce-4995-839a-c5fc49d4c93c tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.410097 May 28 21:40:46.636897 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3093/6142] 10.222.0.33 () {60 vars in 1163 bytes} [Sat May 28 21:40:46 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:40:46.651949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cd8c9103-6d7b-4d94-bc43-7c46193298de tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:40:46.653569 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:40:46.653569 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:40:46.664590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:40:46.665062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=51 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:40:46.753536 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cd8c9103-6d7b-4d94-bc43-7c46193298de tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.106113 May 28 21:40:46.760121 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3050/6143] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:40:46 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:40:46.766690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-74fa4996-530a-405c-ae10-13c06cacb26a tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:46.768035 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:40:46.768035 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:40:46.769356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74fa4996-530a-405c-ae10-13c06cacb26a tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:46.769831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74fa4996-530a-405c-ae10-13c06cacb26a tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:46.771972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74fa4996-530a-405c-ae10-13c06cacb26a tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:46.772495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74fa4996-530a-405c-ae10-13c06cacb26a tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:46.798757 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-74fa4996-530a-405c-ae10-13c06cacb26a tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] 10.222.0.33 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.037079 May 28 21:40:46.804822 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3094/6144] 10.222.0.33 () {58 vars in 1175 bytes} [Sat May 28 21:40:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:40:46.823245 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-acccae67-c476-4331-9a5a-fa1a08890d68 tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:46.824327 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:40:46.824327 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:40:46.847005 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-acccae67-c476-4331-9a5a-fa1a08890d68 tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.038965 May 28 21:40:46.847601 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3051/6145] 10.222.0.33 () {58 vars in 1142 bytes} [Sat May 28 21:40:46 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:40:46.858987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-afc062a9-7713-435c-9879-ae9272a9eff3 tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:40:46.860347 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:40:46.860347 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:40:46.870148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afc062a9-7713-435c-9879-ae9272a9eff3 tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:46.870532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afc062a9-7713-435c-9879-ae9272a9eff3 tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:47.343909 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-afc062a9-7713-435c-9879-ae9272a9eff3 tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.488809 May 28 21:40:47.344875 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3095/6146] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:40:46 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:40:47.355179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3469ad28-c5bd-4927-ae31-0bf739b9ba6c tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:47.356277 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:40:47.356277 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:40:47.364154 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3469ad28-c5bd-4927-ae31-0bf739b9ba6c tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.012915 May 28 21:40:47.365172 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3052/6147] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:40:47 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:40:47.376474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3202e7bb-cf35-4b22-bcff-d340712f799c tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-761255066", "availability_zone": "foo_zone"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:40:47.377987 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:40:47.377987 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:40:47.526136 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3202e7bb-cf35-4b22-bcff-d340712f799c tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] 10.222.0.33 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.147537 May 28 21:40:47.526136 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3096/6148] 10.222.0.33 () {60 vars in 1172 bytes} [Sat May 28 21:40:47 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:40:47.538408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f8c17da8-fac5-48bd-ad8a-6c0fa83d4451 tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:40:47.543356 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:40:47.543356 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:40:47.647728 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f8c17da8-fac5-48bd-ad8a-6c0fa83d4451 tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.118398 May 28 21:40:47.648594 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3053/6149] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:40:47 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:40:47.659457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-10fa64e1-5956-4171-b0ce-75766b45bf0d tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:47.660308 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:40:47.660308 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:40:47.670363 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-10fa64e1-5956-4171-b0ce-75766b45bf0d tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] 10.222.0.33 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.012861 May 28 21:40:47.670363 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3097/6150] 10.222.0.33 () {58 vars in 1151 bytes} [Sat May 28 21:40:47 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:40:47.679385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ceab4137-b135-4b67-a859-e6db8d407156 tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:40:47.680638 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:40:47.680638 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:40:47.692815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ceab4137-b135-4b67-a859-e6db8d407156 tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:40:47.693287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ceab4137-b135-4b67-a859-e6db8d407156 tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:40:48.077085 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ceab4137-b135-4b67-a859-e6db8d407156 tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] 10.222.0.33 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.401540 May 28 21:40:48.077701 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3054/6151] 10.222.0.33 () {60 vars in 1193 bytes} [Sat May 28 21:40:47 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:40:48.089536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4f5eb4b2-8146-434c-9309-e00550807874 tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:40:48.090350 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:40:48.090350 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:40:48.206673 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4f5eb4b2-8146-434c-9309-e00550807874 tempest-TestAggregatesBasicOps-1692501958 tempest-TestAggregatesBasicOps-1692501958-project-admin] 10.222.0.33 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.122416 May 28 21:40:48.213276 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3098/6152] 10.222.0.33 () {58 vars in 1154 bytes} [Sat May 28 21:40:48 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) May 28 21:41:09.048962 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:41:09.169635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1342688164", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "8ddfca51-bc4b-42de-bc64-3ec384148ff5"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:41:09.229008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] validate_networks() for [('8ddfca51-bc4b-42de-bc64-3ec384148ff5', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:41:09.841428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:41:09.841907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:41:09.842570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:41:09.843026 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:41:09.843457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:41:09.852761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:09.853229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:09.854093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:09.854556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:09.871952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Getting quotas for project 338603768c9143128533b10cfc00530e. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:41:09.877215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Getting quotas for user ddfb9c65496f4c28bbfed14bb0a4529d and project 338603768c9143128533b10cfc00530e. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:41:09.890573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:41:09.892887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:41:10.024843 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-099c9767-92d4-4599-ace1-643a647f587e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977330 May 28 21:41:10.025854 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3055/6153] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:41:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:41:10.036527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c2d7f13b-8ec3-41ed-a6da-f3b4e9a429fa tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:10.037089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c2d7f13b-8ec3-41ed-a6da-f3b4e9a429fa tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:10.041761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:41:10.042724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:41:10.113653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c2d7f13b-8ec3-41ed-a6da-f3b4e9a429fa tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:10.128455 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c2d7f13b-8ec3-41ed-a6da-f3b4e9a429fa tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1215 microversion: 2.1 time: 0.095779 May 28 21:41:10.129082 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3099/6154] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:10 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:11.149946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-621a9228-59ff-4992-a09a-e5f7464ce51a tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:11.151276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-621a9228-59ff-4992-a09a-e5f7464ce51a tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:11.225320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-621a9228-59ff-4992-a09a-e5f7464ce51a tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:11.232894 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-621a9228-59ff-4992-a09a-e5f7464ce51a tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1215 microversion: 2.1 time: 0.090955 May 28 21:41:11.234037 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3056/6155] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:11 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:12.254610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-85d52b95-70cf-4b91-9576-fbdb58a1791c tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:12.255582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-85d52b95-70cf-4b91-9576-fbdb58a1791c tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:12.263179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85d52b95-70cf-4b91-9576-fbdb58a1791c tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:12.263650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85d52b95-70cf-4b91-9576-fbdb58a1791c tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:12.264665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85d52b95-70cf-4b91-9576-fbdb58a1791c tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:12.266541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-85d52b95-70cf-4b91-9576-fbdb58a1791c tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:12.373396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-85d52b95-70cf-4b91-9576-fbdb58a1791c tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:12.382157 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-85d52b95-70cf-4b91-9576-fbdb58a1791c tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1267 microversion: 2.1 time: 0.135818 May 28 21:41:12.392715 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3100/6156] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:12 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:13.402502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bdced59a-95b2-46b0-bdc2-cf958b12fab9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:13.404953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bdced59a-95b2-46b0-bdc2-cf958b12fab9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:13.419795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdced59a-95b2-46b0-bdc2-cf958b12fab9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:13.420288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdced59a-95b2-46b0-bdc2-cf958b12fab9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:13.421383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdced59a-95b2-46b0-bdc2-cf958b12fab9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:13.421960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdced59a-95b2-46b0-bdc2-cf958b12fab9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:13.682234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bdced59a-95b2-46b0-bdc2-cf958b12fab9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:13.698156 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bdced59a-95b2-46b0-bdc2-cf958b12fab9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1315 microversion: 2.1 time: 0.300039 May 28 21:41:13.698156 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3057/6157] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:13 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:14.665706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-9f39a313-00b9-4d46-9792-f5213a1f4c7e req-2a556f6c-25c1-4a17-a2a5-8a036e0e1598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ba71f2-8b5e-499e-94c6-d01a965dcfeb", "tag": "0086297a-9b8e-45c2-b7dd-2c0186af3d7f"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:41:14.677032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9f39a313-00b9-4d46-9792-f5213a1f4c7e req-2a556f6c-25c1-4a17-a2a5-8a036e0e1598 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:14.677503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9f39a313-00b9-4d46-9792-f5213a1f4c7e req-2a556f6c-25c1-4a17-a2a5-8a036e0e1598 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:14.712612 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-9f39a313-00b9-4d46-9792-f5213a1f4c7e req-2a556f6c-25c1-4a17-a2a5-8a036e0e1598 service nova] Creating event network-changed:0086297a-9b8e-45c2-b7dd-2c0186af3d7f for instance 40ba71f2-8b5e-499e-94c6-d01a965dcfeb on nch1-master-1 May 28 21:41:14.715016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ed4dc5cc-1e89-4e9c-a104-f906899c10f9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:14.715492 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-9f39a313-00b9-4d46-9792-f5213a1f4c7e req-2a556f6c-25c1-4a17-a2a5-8a036e0e1598 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056919 May 28 21:41:14.715766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ed4dc5cc-1e89-4e9c-a104-f906899c10f9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:14.716560 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3101/6158] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:41:14.728490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed4dc5cc-1e89-4e9c-a104-f906899c10f9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:14.728992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed4dc5cc-1e89-4e9c-a104-f906899c10f9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:14.729987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed4dc5cc-1e89-4e9c-a104-f906899c10f9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:14.731089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed4dc5cc-1e89-4e9c-a104-f906899c10f9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:14.981148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ed4dc5cc-1e89-4e9c-a104-f906899c10f9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:14.996108 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ed4dc5cc-1e89-4e9c-a104-f906899c10f9 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1315 microversion: 2.1 time: 0.285735 May 28 21:41:14.997517 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3058/6159] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:14 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:41:15.715886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f804261a-75b6-470f-a5cb-d5c31e102e2f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:15.716645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f804261a-75b6-470f-a5cb-d5c31e102e2f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:15.723576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f804261a-75b6-470f-a5cb-d5c31e102e2f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:15.724035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f804261a-75b6-470f-a5cb-d5c31e102e2f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:15.724814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f804261a-75b6-470f-a5cb-d5c31e102e2f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:15.725316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f804261a-75b6-470f-a5cb-d5c31e102e2f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:15.757151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f804261a-75b6-470f-a5cb-d5c31e102e2f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:41:16.015238 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8451abfc-30c9-4587-bc92-7bb0182a52f1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:16.016543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8451abfc-30c9-4587-bc92-7bb0182a52f1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:16.023888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8451abfc-30c9-4587-bc92-7bb0182a52f1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:16.024887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8451abfc-30c9-4587-bc92-7bb0182a52f1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:16.025687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8451abfc-30c9-4587-bc92-7bb0182a52f1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:16.026182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8451abfc-30c9-4587-bc92-7bb0182a52f1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:16.126663 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f804261a-75b6-470f-a5cb-d5c31e102e2f tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 204 len: 0 microversion: 2.1 time: 0.417884 May 28 21:41:16.127651 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3102/6160] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:41:15 2022] DELETE /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:41:16.136885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1a28643a-d318-4b67-8bc4-a5183b4e4ba7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:16.137920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1a28643a-d318-4b67-8bc4-a5183b4e4ba7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:16.144487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a28643a-d318-4b67-8bc4-a5183b4e4ba7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:16.144756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a28643a-d318-4b67-8bc4-a5183b4e4ba7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:16.145534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a28643a-d318-4b67-8bc4-a5183b4e4ba7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:16.146080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a28643a-d318-4b67-8bc4-a5183b4e4ba7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:16.184800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8451abfc-30c9-4587-bc92-7bb0182a52f1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:16.194120 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8451abfc-30c9-4587-bc92-7bb0182a52f1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1315 microversion: 2.1 time: 0.182974 May 28 21:41:16.194747 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3059/6161] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:16 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:16.319024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1a28643a-d318-4b67-8bc4-a5183b4e4ba7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:16.328551 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1a28643a-d318-4b67-8bc4-a5183b4e4ba7 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1409 microversion: 2.1 time: 0.195735 May 28 21:41:16.329540 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3103/6162] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:16 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1409 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:17.212006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-93a98a3a-4e75-4058-b60b-f0a36ae0f874 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:17.212850 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-93a98a3a-4e75-4058-b60b-f0a36ae0f874 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:17.220219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93a98a3a-4e75-4058-b60b-f0a36ae0f874 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:17.224303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93a98a3a-4e75-4058-b60b-f0a36ae0f874 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:17.224303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93a98a3a-4e75-4058-b60b-f0a36ae0f874 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:17.224303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-93a98a3a-4e75-4058-b60b-f0a36ae0f874 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:17.347447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dbc63b83-dca0-48dd-8ade-01d9d737d7d0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:17.348229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dbc63b83-dca0-48dd-8ade-01d9d737d7d0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:17.359511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbc63b83-dca0-48dd-8ade-01d9d737d7d0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:17.360238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbc63b83-dca0-48dd-8ade-01d9d737d7d0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:17.361995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbc63b83-dca0-48dd-8ade-01d9d737d7d0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:17.362608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbc63b83-dca0-48dd-8ade-01d9d737d7d0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:17.473523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-93a98a3a-4e75-4058-b60b-f0a36ae0f874 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:17.483852 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-93a98a3a-4e75-4058-b60b-f0a36ae0f874 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1315 microversion: 2.1 time: 0.275435 May 28 21:41:17.494656 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3060/6163] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:17 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:17.551726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dbc63b83-dca0-48dd-8ade-01d9d737d7d0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:17.560568 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dbc63b83-dca0-48dd-8ade-01d9d737d7d0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1409 microversion: 2.1 time: 0.217536 May 28 21:41:17.561369 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3104/6164] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:17 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1409 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:41:18.315305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-5a60e5f8-38f0-40f9-b15f-9a36d8164cb1 req-e2496c7e-f2bf-4b5c-9d1f-d7a37064b04a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4527e2a9-d628-4542-9e0b-299945d3b75d", "name": "network-vif-deleted", "tag": "1ef33897-2a16-4447-9b31-15473a71684a"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:41:18.338871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5a60e5f8-38f0-40f9-b15f-9a36d8164cb1 req-e2496c7e-f2bf-4b5c-9d1f-d7a37064b04a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:18.338871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5a60e5f8-38f0-40f9-b15f-9a36d8164cb1 req-e2496c7e-f2bf-4b5c-9d1f-d7a37064b04a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:18.349785 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-5a60e5f8-38f0-40f9-b15f-9a36d8164cb1 req-e2496c7e-f2bf-4b5c-9d1f-d7a37064b04a service nova] Creating event network-vif-deleted:1ef33897-2a16-4447-9b31-15473a71684a for instance 4527e2a9-d628-4542-9e0b-299945d3b75d on nch2-master-1 May 28 21:41:18.355747 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-5a60e5f8-38f0-40f9-b15f-9a36d8164cb1 req-e2496c7e-f2bf-4b5c-9d1f-d7a37064b04a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045518 May 28 21:41:18.356702 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3061/6165] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:41:18.501698 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-906956c4-4fb8-4142-96f7-555e20fe60d2 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:18.503825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-906956c4-4fb8-4142-96f7-555e20fe60d2 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:18.514828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-906956c4-4fb8-4142-96f7-555e20fe60d2 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:18.515645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-906956c4-4fb8-4142-96f7-555e20fe60d2 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:18.516755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-906956c4-4fb8-4142-96f7-555e20fe60d2 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:18.517303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-906956c4-4fb8-4142-96f7-555e20fe60d2 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:18.578661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a50fc669-87cc-439f-9b8e-3484fe22e08c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:18.579949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a50fc669-87cc-439f-9b8e-3484fe22e08c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:18.589078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a50fc669-87cc-439f-9b8e-3484fe22e08c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:18.595361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a50fc669-87cc-439f-9b8e-3484fe22e08c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:18.595361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a50fc669-87cc-439f-9b8e-3484fe22e08c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:18.595361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a50fc669-87cc-439f-9b8e-3484fe22e08c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:18.671977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a50fc669-87cc-439f-9b8e-3484fe22e08c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:18.680793 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a50fc669-87cc-439f-9b8e-3484fe22e08c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1202 microversion: 2.1 time: 0.106442 May 28 21:41:18.681403 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3062/6166] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:18 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1202 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:18.694172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-906956c4-4fb8-4142-96f7-555e20fe60d2 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:18.703141 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-906956c4-4fb8-4142-96f7-555e20fe60d2 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1315 microversion: 2.1 time: 0.206308 May 28 21:41:18.703979 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3105/6167] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:18 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:41:19.494295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-7e4158bd-d04d-4436-9ecf-01e665965ffa req-e38f30a0-7b54-442a-a458-a237caba9662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ba71f2-8b5e-499e-94c6-d01a965dcfeb", "name": "network-vif-plugged", "status": "completed", "tag": "0086297a-9b8e-45c2-b7dd-2c0186af3d7f"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:41:19.504373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7e4158bd-d04d-4436-9ecf-01e665965ffa req-e38f30a0-7b54-442a-a458-a237caba9662 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:19.505138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7e4158bd-d04d-4436-9ecf-01e665965ffa req-e38f30a0-7b54-442a-a458-a237caba9662 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:19.518463 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-7e4158bd-d04d-4436-9ecf-01e665965ffa req-e38f30a0-7b54-442a-a458-a237caba9662 service nova] Creating event network-vif-plugged:0086297a-9b8e-45c2-b7dd-2c0186af3d7f for instance 40ba71f2-8b5e-499e-94c6-d01a965dcfeb on nch1-master-1 May 28 21:41:19.523686 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-7e4158bd-d04d-4436-9ecf-01e665965ffa req-e38f30a0-7b54-442a-a458-a237caba9662 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033983 May 28 21:41:19.525525 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3063/6168] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:41:19.698085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-890d2fd4-8b15-4b0d-95d1-d0b11ede3c40 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:19.699396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-890d2fd4-8b15-4b0d-95d1-d0b11ede3c40 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:19.707382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-890d2fd4-8b15-4b0d-95d1-d0b11ede3c40 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:19.708095 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-890d2fd4-8b15-4b0d-95d1-d0b11ede3c40 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:19.708996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-890d2fd4-8b15-4b0d-95d1-d0b11ede3c40 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:19.709542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-890d2fd4-8b15-4b0d-95d1-d0b11ede3c40 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:19.723332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cf412eb3-6039-4f9c-8843-3dcc66e0e15a tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:19.724072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cf412eb3-6039-4f9c-8843-3dcc66e0e15a tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:19.737074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf412eb3-6039-4f9c-8843-3dcc66e0e15a tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:19.737543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf412eb3-6039-4f9c-8843-3dcc66e0e15a tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:19.738508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf412eb3-6039-4f9c-8843-3dcc66e0e15a tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:19.738970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf412eb3-6039-4f9c-8843-3dcc66e0e15a tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:19.749916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-890d2fd4-8b15-4b0d-95d1-d0b11ede3c40 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:19.750699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-890d2fd4-8b15-4b0d-95d1-d0b11ede3c40 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:19.753818 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-890d2fd4-8b15-4b0d-95d1-d0b11ede3c40 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lazy-loading 'fault' on Instance uuid 4527e2a9-d628-4542-9e0b-299945d3b75d {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:41:19.862565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:41:20.117566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:41:20.124388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-890d2fd4-8b15-4b0d-95d1-d0b11ede3c40 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:20.132174 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-890d2fd4-8b15-4b0d-95d1-d0b11ede3c40 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 200 len: 1161 microversion: 2.1 time: 0.439130 May 28 21:41:20.132860 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3106/6169] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:19 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 1161 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:20.240475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cf412eb3-6039-4f9c-8843-3dcc66e0e15a tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:20.249340 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cf412eb3-6039-4f9c-8843-3dcc66e0e15a tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1315 microversion: 2.1 time: 0.530526 May 28 21:41:20.250103 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3064/6170] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:19 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:41:21.148605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ca2a0e0d-df51-4061-9abd-dbdc51439a19 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:21.149916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ca2a0e0d-df51-4061-9abd-dbdc51439a19 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:21.157362 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca2a0e0d-df51-4061-9abd-dbdc51439a19 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:21.157816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca2a0e0d-df51-4061-9abd-dbdc51439a19 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:21.158614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca2a0e0d-df51-4061-9abd-dbdc51439a19 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:21.159058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca2a0e0d-df51-4061-9abd-dbdc51439a19 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:21.176150 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-ca2a0e0d-df51-4061-9abd-dbdc51439a19 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] HTTP exception thrown: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ca2a0e0d-df51-4061-9abd-dbdc51439a19 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Request method failure captured: May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d HTTP/1.1 May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpZj6T8fAUPV0L9vvdx7FjM-mPDbeMcny2vaFgqFap_hhOicDv_aSrneSkPKTuy8G7aOJ8u-6aN6vtjm8OAlWN3Sh2BNpOvEzUNMkpGCfAsXWUG9AhKKLTChCVZAHzz9iHirDXgMjQoShyXSLMnsx_u72mL9Gv37fsMmCKprrAlJHzI May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5833e78f486c4a118608290040b31cfc May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5833e78f486c4a118608290040b31cfc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5833e78f486c4a118608290040b31cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestVolumeBootPattern-1994669512 May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5833e78f486c4a118608290040b31cfc May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestVolumeBootPattern-1994669512-project May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 388458a7b3504bd08f3789f53cf9ea35 May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestVolumeBootPattern-1994669512-project May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '4527e2a9-d628-4542-9e0b-299945d3b75d'} May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:41:21.178519 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:21.184641 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:21.184641 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:41:21.184641 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:41:21.184641 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:41:21.184641 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:41:21.184641 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. May 28 21:41:21.184641 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:21.184641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ca2a0e0d-df51-4061-9abd-dbdc51439a19 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Returning 404 to user: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:41:21.184641 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ca2a0e0d-df51-4061-9abd-dbdc51439a19 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 404 len: 111 microversion: 2.1 time: 0.035511 May 28 21:41:21.184641 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3107/6171] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:21 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:41:21.266806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5436dbf1-9f94-41f5-8387-375c2d3598a3 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:21.267447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5436dbf1-9f94-41f5-8387-375c2d3598a3 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:21.272129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:41:21.276411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5436dbf1-9f94-41f5-8387-375c2d3598a3 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:21.276888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5436dbf1-9f94-41f5-8387-375c2d3598a3 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:21.277915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5436dbf1-9f94-41f5-8387-375c2d3598a3 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:21.280750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5436dbf1-9f94-41f5-8387-375c2d3598a3 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:21.481621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5436dbf1-9f94-41f5-8387-375c2d3598a3 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:21.490439 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5436dbf1-9f94-41f5-8387-375c2d3598a3 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1502 microversion: 2.1 time: 0.227412 May 28 21:41:21.491074 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3065/6172] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:21 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:21.508442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a9fa97b9-26fa-4548-93d6-331f92f1e8ba tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:21.509867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a9fa97b9-26fa-4548-93d6-331f92f1e8ba tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:21.516314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9fa97b9-26fa-4548-93d6-331f92f1e8ba tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:21.516968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9fa97b9-26fa-4548-93d6-331f92f1e8ba tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:21.517946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9fa97b9-26fa-4548-93d6-331f92f1e8ba tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:21.518556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9fa97b9-26fa-4548-93d6-331f92f1e8ba tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:21.666320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a9fa97b9-26fa-4548-93d6-331f92f1e8ba tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:21.674557 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a9fa97b9-26fa-4548-93d6-331f92f1e8ba tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1502 microversion: 2.1 time: 0.170054 May 28 21:41:21.675153 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3108/6173] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:21 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:21.692552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-12d3da07-a40f-4b0a-a008-62201e673e80 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:41:21.695060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-12d3da07-a40f-4b0a-a008-62201e673e80 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:21.700543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12d3da07-a40f-4b0a-a008-62201e673e80 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:21.701095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12d3da07-a40f-4b0a-a008-62201e673e80 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:21.702028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12d3da07-a40f-4b0a-a008-62201e673e80 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:21.702487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12d3da07-a40f-4b0a-a008-62201e673e80 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:21.729025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-12d3da07-a40f-4b0a-a008-62201e673e80 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lazy-loading 'flavor' on Instance uuid 40ba71f2-8b5e-499e-94c6-d01a965dcfeb {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:41:22.044947 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-12d3da07-a40f-4b0a-a008-62201e673e80 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "POST /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb/action" status: 202 len: 0 microversion: 2.1 time: 0.356514 May 28 21:41:22.045712 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3066/6174] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:41:21 2022] POST /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:41:22.053984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7cbf969a-b9a1-4f1b-a229-230780553803 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:22.055276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7cbf969a-b9a1-4f1b-a229-230780553803 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:22.061809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cbf969a-b9a1-4f1b-a229-230780553803 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:22.062545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cbf969a-b9a1-4f1b-a229-230780553803 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:22.063515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cbf969a-b9a1-4f1b-a229-230780553803 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:22.064134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7cbf969a-b9a1-4f1b-a229-230780553803 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:22.195494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7cbf969a-b9a1-4f1b-a229-230780553803 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:22.203679 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7cbf969a-b9a1-4f1b-a229-230780553803 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1510 microversion: 2.1 time: 0.153679 May 28 21:41:22.211960 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3109/6175] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:22 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:23.223145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2ddacb15-e74b-484d-80c7-3f68f0212063 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:23.223882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2ddacb15-e74b-484d-80c7-3f68f0212063 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:23.230384 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ddacb15-e74b-484d-80c7-3f68f0212063 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:23.230854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ddacb15-e74b-484d-80c7-3f68f0212063 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:23.231738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ddacb15-e74b-484d-80c7-3f68f0212063 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:23.232108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ddacb15-e74b-484d-80c7-3f68f0212063 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:23.427386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2ddacb15-e74b-484d-80c7-3f68f0212063 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:23.435610 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2ddacb15-e74b-484d-80c7-3f68f0212063 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1493 microversion: 2.1 time: 0.217662 May 28 21:41:23.436193 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3067/6176] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:23 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1493 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:23.453282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5f440894-0f2a-4023-bcd7-2e3e68891978 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:41:23.453811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5f440894-0f2a-4023-bcd7-2e3e68891978 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:23.461121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f440894-0f2a-4023-bcd7-2e3e68891978 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:23.467037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f440894-0f2a-4023-bcd7-2e3e68891978 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:23.467037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f440894-0f2a-4023-bcd7-2e3e68891978 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:23.467037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f440894-0f2a-4023-bcd7-2e3e68891978 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:23.682957 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5f440894-0f2a-4023-bcd7-2e3e68891978 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "POST /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb/action" status: 202 len: 0 microversion: 2.1 time: 0.233462 May 28 21:41:23.688241 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3110/6177] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:41:23 2022] POST /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:41:23.691810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-227c967d-a631-4f45-a55b-2b516714d727 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:23.692564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-227c967d-a631-4f45-a55b-2b516714d727 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:23.699743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-227c967d-a631-4f45-a55b-2b516714d727 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:23.700306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-227c967d-a631-4f45-a55b-2b516714d727 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:23.701395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-227c967d-a631-4f45-a55b-2b516714d727 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:23.701887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-227c967d-a631-4f45-a55b-2b516714d727 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:23.844756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-227c967d-a631-4f45-a55b-2b516714d727 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:23.854498 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-227c967d-a631-4f45-a55b-2b516714d727 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1499 microversion: 2.1 time: 0.166676 May 28 21:41:23.855100 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3068/6178] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:23 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1499 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:24.402431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ce7dcb9d-e090-41e5-84fa-4e7ec34f48d1 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:24.403038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ce7dcb9d-e090-41e5-84fa-4e7ec34f48d1 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:24.409536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce7dcb9d-e090-41e5-84fa-4e7ec34f48d1 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:24.410044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce7dcb9d-e090-41e5-84fa-4e7ec34f48d1 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:24.410829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce7dcb9d-e090-41e5-84fa-4e7ec34f48d1 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:24.411286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce7dcb9d-e090-41e5-84fa-4e7ec34f48d1 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:24.426539 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-ce7dcb9d-e090-41e5-84fa-4e7ec34f48d1 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] HTTP exception thrown: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ce7dcb9d-e090-41e5-84fa-4e7ec34f48d1 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Request method failure captured: May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 HTTP/1.1 May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpZj6T8fAUPV0L9vvdx7FjM-mPDbeMcny2vaFgqFap_hhOicDv_aSrneSkPKTuy8G7aOJ8u-6aN6vtjm8OAlWN3Sh2BNpOvEzUNMkpGCfAsXWUG9AhKKLTChCVZAHzz9iHirDXgMjQoShyXSLMnsx_u72mL9Gv37fsMmCKprrAlJHzI May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5833e78f486c4a118608290040b31cfc May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5833e78f486c4a118608290040b31cfc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5833e78f486c4a118608290040b31cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestVolumeBootPattern-1994669512 May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5833e78f486c4a118608290040b31cfc May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestVolumeBootPattern-1994669512-project May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 388458a7b3504bd08f3789f53cf9ea35 May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestVolumeBootPattern-1994669512-project May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '1ac27b04-a334-430a-8861-7ecbd2efa725'} May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:41:24.427278 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:41:24.432617 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. May 28 21:41:24.432617 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:24.432617 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:41:24.432617 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:24.432617 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:24.432617 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:41:24.432617 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:41:24.432617 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:41:24.432617 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:41:24.432617 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. May 28 21:41:24.432617 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:24.432617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ce7dcb9d-e090-41e5-84fa-4e7ec34f48d1 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Returning 404 to user: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:41:24.432617 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ce7dcb9d-e090-41e5-84fa-4e7ec34f48d1 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 404 len: 111 microversion: 2.1 time: 0.031493 May 28 21:41:24.432617 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3111/6179] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:41:24 2022] DELETE /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:41:24.439079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-691eda89-16f0-4cef-8d28-b344e8d16abe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:24.439777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-691eda89-16f0-4cef-8d28-b344e8d16abe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 1ac27b04-a334-430a-8861-7ecbd2efa725] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:24.447974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-691eda89-16f0-4cef-8d28-b344e8d16abe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:24.455408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-691eda89-16f0-4cef-8d28-b344e8d16abe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:24.455408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-691eda89-16f0-4cef-8d28-b344e8d16abe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:24.455408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-691eda89-16f0-4cef-8d28-b344e8d16abe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:24.469359 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-691eda89-16f0-4cef-8d28-b344e8d16abe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] HTTP exception thrown: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-691eda89-16f0-4cef-8d28-b344e8d16abe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Request method failure captured: May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 HTTP/1.1 May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpZj6T8fAUPV0L9vvdx7FjM-mPDbeMcny2vaFgqFap_hhOicDv_aSrneSkPKTuy8G7aOJ8u-6aN6vtjm8OAlWN3Sh2BNpOvEzUNMkpGCfAsXWUG9AhKKLTChCVZAHzz9iHirDXgMjQoShyXSLMnsx_u72mL9Gv37fsMmCKprrAlJHzI May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5833e78f486c4a118608290040b31cfc May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5833e78f486c4a118608290040b31cfc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5833e78f486c4a118608290040b31cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestVolumeBootPattern-1994669512 May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5833e78f486c4a118608290040b31cfc May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestVolumeBootPattern-1994669512-project May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 388458a7b3504bd08f3789f53cf9ea35 May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestVolumeBootPattern-1994669512-project May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '1ac27b04-a334-430a-8861-7ecbd2efa725'} May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:41:24.471849 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:41:24.477951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:24.477951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:41:24.477951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:41:24.477951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:41:24.477951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:41:24.477951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. May 28 21:41:24.477951 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:41:24.477951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-691eda89-16f0-4cef-8d28-b344e8d16abe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Returning 404 to user: Instance 1ac27b04-a334-430a-8861-7ecbd2efa725 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:41:24.477951 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-691eda89-16f0-4cef-8d28-b344e8d16abe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725" status: 404 len: 111 microversion: 2.1 time: 0.038587 May 28 21:41:24.477951 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3069/6180] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:24 2022] GET /compute/v2.1/servers/1ac27b04-a334-430a-8861-7ecbd2efa725 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:41:24.871563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9c39dea2-5ea6-41cb-bae5-930663b170be tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:24.872972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9c39dea2-5ea6-41cb-bae5-930663b170be tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:24.884679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c39dea2-5ea6-41cb-bae5-930663b170be tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:24.885768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c39dea2-5ea6-41cb-bae5-930663b170be tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:24.886854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c39dea2-5ea6-41cb-bae5-930663b170be tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:24.887518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9c39dea2-5ea6-41cb-bae5-930663b170be tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:25.064625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9c39dea2-5ea6-41cb-bae5-930663b170be tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:25.074130 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9c39dea2-5ea6-41cb-bae5-930663b170be tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1499 microversion: 2.1 time: 0.206595 May 28 21:41:25.075033 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3112/6181] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:24 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1499 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:25.499081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d1e647d6-9a80-4834-8329-7a90fc2f051a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:25.499617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d1e647d6-9a80-4834-8329-7a90fc2f051a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:25.506842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d1e647d6-9a80-4834-8329-7a90fc2f051a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:25.507319 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d1e647d6-9a80-4834-8329-7a90fc2f051a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:25.508113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d1e647d6-9a80-4834-8329-7a90fc2f051a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:25.509150 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d1e647d6-9a80-4834-8329-7a90fc2f051a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:25.523581 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-d1e647d6-9a80-4834-8329-7a90fc2f051a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] HTTP exception thrown: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d1e647d6-9a80-4834-8329-7a90fc2f051a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Request method failure captured: May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d HTTP/1.1 May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpZj6T8fAUPV0L9vvdx7FjM-mPDbeMcny2vaFgqFap_hhOicDv_aSrneSkPKTuy8G7aOJ8u-6aN6vtjm8OAlWN3Sh2BNpOvEzUNMkpGCfAsXWUG9AhKKLTChCVZAHzz9iHirDXgMjQoShyXSLMnsx_u72mL9Gv37fsMmCKprrAlJHzI May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5833e78f486c4a118608290040b31cfc May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5833e78f486c4a118608290040b31cfc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5833e78f486c4a118608290040b31cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestVolumeBootPattern-1994669512 May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5833e78f486c4a118608290040b31cfc May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestVolumeBootPattern-1994669512-project May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 388458a7b3504bd08f3789f53cf9ea35 May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestVolumeBootPattern-1994669512-project May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '4527e2a9-d628-4542-9e0b-299945d3b75d'} May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:41:25.525394 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:41:25.530713 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. May 28 21:41:25.530713 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:41:25.530713 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:41:25.530713 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:41:25.530713 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:25.530713 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:41:25.530713 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:41:25.530713 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:41:25.530713 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:41:25.530713 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. May 28 21:41:25.530713 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:41:25.530713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d1e647d6-9a80-4834-8329-7a90fc2f051a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Returning 404 to user: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:41:25.530713 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d1e647d6-9a80-4834-8329-7a90fc2f051a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 404 len: 111 microversion: 2.1 time: 0.032454 May 28 21:41:25.530713 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3070/6182] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:41:25 2022] DELETE /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:41:25.536925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f5c0bd9a-9b13-4a53-8c31-fd61e36d93d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:25.537859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f5c0bd9a-9b13-4a53-8c31-fd61e36d93d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 4527e2a9-d628-4542-9e0b-299945d3b75d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:25.544174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5c0bd9a-9b13-4a53-8c31-fd61e36d93d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:25.545767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5c0bd9a-9b13-4a53-8c31-fd61e36d93d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:25.545767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5c0bd9a-9b13-4a53-8c31-fd61e36d93d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:25.546239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5c0bd9a-9b13-4a53-8c31-fd61e36d93d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:25.561924 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-f5c0bd9a-9b13-4a53-8c31-fd61e36d93d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] HTTP exception thrown: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f5c0bd9a-9b13-4a53-8c31-fd61e36d93d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Request method failure captured: May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d HTTP/1.1 May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpZj6T8fAUPV0L9vvdx7FjM-mPDbeMcny2vaFgqFap_hhOicDv_aSrneSkPKTuy8G7aOJ8u-6aN6vtjm8OAlWN3Sh2BNpOvEzUNMkpGCfAsXWUG9AhKKLTChCVZAHzz9iHirDXgMjQoShyXSLMnsx_u72mL9Gv37fsMmCKprrAlJHzI May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5833e78f486c4a118608290040b31cfc May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5833e78f486c4a118608290040b31cfc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5833e78f486c4a118608290040b31cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestVolumeBootPattern-1994669512 May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5833e78f486c4a118608290040b31cfc May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestVolumeBootPattern-1994669512-project May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 388458a7b3504bd08f3789f53cf9ea35 May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestVolumeBootPattern-1994669512-project May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '4527e2a9-d628-4542-9e0b-299945d3b75d'} May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:41:25.564014 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:25.569203 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:25.569203 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:41:25.569203 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:41:25.569203 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:41:25.569203 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:41:25.569203 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. May 28 21:41:25.569203 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:25.570752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f5c0bd9a-9b13-4a53-8c31-fd61e36d93d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Returning 404 to user: Instance 4527e2a9-d628-4542-9e0b-299945d3b75d could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:41:25.576240 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f5c0bd9a-9b13-4a53-8c31-fd61e36d93d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d" status: 404 len: 111 microversion: 2.1 time: 0.039532 May 28 21:41:25.576751 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3113/6183] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:25 2022] GET /compute/v2.1/servers/4527e2a9-d628-4542-9e0b-299945d3b75d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:41:25.670969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f252ef1d-17cd-425b-b986-587a0ede2bb0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Action: 'create', calling method: .version_select at 0x7f4d56b7d700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1455929180", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaH/YNTWz9wbqBHBddu3C02v+72bICohOfPmqV0cpZbAd4SPCc5qVlaQD8J/zBoltbVNPJp5YriB2+vCqlMsjinnOt6Y4aKPlY4eI/HinnAJOD963WUfteql8ubCej4JQ=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:41:25.684127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-f252ef1d-17cd-425b-b986-587a0ede2bb0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Getting quotas for project 5833e78f486c4a118608290040b31cfc. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:41:25.689467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-f252ef1d-17cd-425b-b986-587a0ede2bb0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Getting quotas for user 388458a7b3504bd08f3789f53cf9ea35 and project 5833e78f486c4a118608290040b31cfc. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:41:25.810978 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f252ef1d-17cd-425b-b986-587a0ede2bb0 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.146179 May 28 21:41:25.811657 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3071/6184] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:41:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:41:26.091693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-44e7eaa7-dfff-4f90-ac99-45a938b6e951 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:26.092330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-44e7eaa7-dfff-4f90-ac99-45a938b6e951 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:26.099847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44e7eaa7-dfff-4f90-ac99-45a938b6e951 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:26.100015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44e7eaa7-dfff-4f90-ac99-45a938b6e951 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:26.100805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44e7eaa7-dfff-4f90-ac99-45a938b6e951 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:26.101303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44e7eaa7-dfff-4f90-ac99-45a938b6e951 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:26.362915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-44e7eaa7-dfff-4f90-ac99-45a938b6e951 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:26.379077 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-44e7eaa7-dfff-4f90-ac99-45a938b6e951 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1502 microversion: 2.1 time: 0.290231 May 28 21:41:26.398918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-12a5f1c3-1f88-4aa4-95e8-b9d44dd83b0f tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:41:26.399530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-12a5f1c3-1f88-4aa4-95e8-b9d44dd83b0f tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:26.403071 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3114/6185] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:26 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1502 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:26.407330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12a5f1c3-1f88-4aa4-95e8-b9d44dd83b0f tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:26.409145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12a5f1c3-1f88-4aa4-95e8-b9d44dd83b0f tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:26.409145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12a5f1c3-1f88-4aa4-95e8-b9d44dd83b0f tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:26.409145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12a5f1c3-1f88-4aa4-95e8-b9d44dd83b0f tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:26.434550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-12a5f1c3-1f88-4aa4-95e8-b9d44dd83b0f tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lazy-loading 'flavor' on Instance uuid 40ba71f2-8b5e-499e-94c6-d01a965dcfeb {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:41:26.789171 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-12a5f1c3-1f88-4aa4-95e8-b9d44dd83b0f tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "POST /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb/action" status: 202 len: 0 microversion: 2.1 time: 0.393588 May 28 21:41:26.790481 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3072/6186] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:41:26 2022] POST /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:41:26.799103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6da7f94e-b8b3-4b8b-af90-406d6ed6279d tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:26.799988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6da7f94e-b8b3-4b8b-af90-406d6ed6279d tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:26.809959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6da7f94e-b8b3-4b8b-af90-406d6ed6279d tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:26.810617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6da7f94e-b8b3-4b8b-af90-406d6ed6279d tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:26.812087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6da7f94e-b8b3-4b8b-af90-406d6ed6279d tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:26.812087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6da7f94e-b8b3-4b8b-af90-406d6ed6279d tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:26.818837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:41:27.107289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6da7f94e-b8b3-4b8b-af90-406d6ed6279d tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:27.117298 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6da7f94e-b8b3-4b8b-af90-406d6ed6279d tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1510 microversion: 2.1 time: 0.322731 May 28 21:41:27.119723 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3115/6187] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:26 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1510 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:28.138230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3b1f5988-2541-42fb-96ec-1a7317f2abee tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:28.138970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3b1f5988-2541-42fb-96ec-1a7317f2abee tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:28.155280 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b1f5988-2541-42fb-96ec-1a7317f2abee tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:28.161942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b1f5988-2541-42fb-96ec-1a7317f2abee tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:28.162897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b1f5988-2541-42fb-96ec-1a7317f2abee tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:28.163369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b1f5988-2541-42fb-96ec-1a7317f2abee tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:28.202353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:41:28.343474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3b1f5988-2541-42fb-96ec-1a7317f2abee tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:28.351018 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3b1f5988-2541-42fb-96ec-1a7317f2abee tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1493 microversion: 2.1 time: 0.218135 May 28 21:41:28.359552 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3073/6188] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:28 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1493 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:28.368986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-be68fb6b-0e18-42cc-940f-6fda5de21fdc tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:41:28.369539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-be68fb6b-0e18-42cc-940f-6fda5de21fdc tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:28.376698 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be68fb6b-0e18-42cc-940f-6fda5de21fdc tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:28.377165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be68fb6b-0e18-42cc-940f-6fda5de21fdc tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:28.378014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be68fb6b-0e18-42cc-940f-6fda5de21fdc tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:28.378470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-be68fb6b-0e18-42cc-940f-6fda5de21fdc tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:28.672725 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-be68fb6b-0e18-42cc-940f-6fda5de21fdc tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "POST /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb/action" status: 202 len: 0 microversion: 2.1 time: 0.307802 May 28 21:41:28.673747 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3116/6189] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:41:28 2022] POST /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:41:28.682365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cd793508-2f51-40a0-ac65-a113a63c7a1e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:28.683166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cd793508-2f51-40a0-ac65-a113a63c7a1e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:28.702587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd793508-2f51-40a0-ac65-a113a63c7a1e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:28.702587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd793508-2f51-40a0-ac65-a113a63c7a1e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:28.702587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd793508-2f51-40a0-ac65-a113a63c7a1e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:28.702587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cd793508-2f51-40a0-ac65-a113a63c7a1e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:28.878118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cd793508-2f51-40a0-ac65-a113a63c7a1e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:28.890004 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cd793508-2f51-40a0-ac65-a113a63c7a1e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1499 microversion: 2.1 time: 0.212037 May 28 21:41:28.890606 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3074/6190] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:28 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1499 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:29.908616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4e9b2be9-6b1b-4dd1-92e0-d49bf80cd3c6 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:29.909257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4e9b2be9-6b1b-4dd1-92e0-d49bf80cd3c6 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:29.917215 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e9b2be9-6b1b-4dd1-92e0-d49bf80cd3c6 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:29.917670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e9b2be9-6b1b-4dd1-92e0-d49bf80cd3c6 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:29.918466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e9b2be9-6b1b-4dd1-92e0-d49bf80cd3c6 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:29.918918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e9b2be9-6b1b-4dd1-92e0-d49bf80cd3c6 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:30.067628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4e9b2be9-6b1b-4dd1-92e0-d49bf80cd3c6 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:30.076437 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4e9b2be9-6b1b-4dd1-92e0-d49bf80cd3c6 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1499 microversion: 2.1 time: 0.172178 May 28 21:41:30.077204 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3117/6191] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:29 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1499 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:31.094038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d8c6779d-5113-465a-a71a-c50a5b0c02bc tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:31.094785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d8c6779d-5113-465a-a71a-c50a5b0c02bc tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:31.103402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8c6779d-5113-465a-a71a-c50a5b0c02bc tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:31.103871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8c6779d-5113-465a-a71a-c50a5b0c02bc tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:31.104666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8c6779d-5113-465a-a71a-c50a5b0c02bc tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:31.105130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8c6779d-5113-465a-a71a-c50a5b0c02bc tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:31.299699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d8c6779d-5113-465a-a71a-c50a5b0c02bc tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:31.310090 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d8c6779d-5113-465a-a71a-c50a5b0c02bc tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1502 microversion: 2.1 time: 0.219522 May 28 21:41:31.326838 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-80dfbe43-1204-45ca-87cb-7d124bf09206 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:31.327373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-80dfbe43-1204-45ca-87cb-7d124bf09206 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:31.332302 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3075/6192] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:31 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:31.336638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80dfbe43-1204-45ca-87cb-7d124bf09206 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:31.336638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80dfbe43-1204-45ca-87cb-7d124bf09206 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:31.337414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80dfbe43-1204-45ca-87cb-7d124bf09206 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:31.337922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-80dfbe43-1204-45ca-87cb-7d124bf09206 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:31.367553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-80dfbe43-1204-45ca-87cb-7d124bf09206 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:41:31.659215 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-80dfbe43-1204-45ca-87cb-7d124bf09206 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "DELETE /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 204 len: 0 microversion: 2.1 time: 0.333479 May 28 21:41:31.659215 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3118/6193] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:41:31 2022] DELETE /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:41:31.665823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d3e7f1e2-1679-4869-8b55-c016c1284ec1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:31.666487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d3e7f1e2-1679-4869-8b55-c016c1284ec1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:31.673208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3e7f1e2-1679-4869-8b55-c016c1284ec1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:31.676196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3e7f1e2-1679-4869-8b55-c016c1284ec1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:31.676196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3e7f1e2-1679-4869-8b55-c016c1284ec1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:31.676196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d3e7f1e2-1679-4869-8b55-c016c1284ec1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:31.816634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d3e7f1e2-1679-4869-8b55-c016c1284ec1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:31.824497 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d3e7f1e2-1679-4869-8b55-c016c1284ec1 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1508 microversion: 2.1 time: 0.162980 May 28 21:41:31.825092 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3076/6194] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:31 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:32.842902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c037f561-844c-46b4-b541-078557c9539e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:32.843711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c037f561-844c-46b4-b541-078557c9539e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:32.850704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c037f561-844c-46b4-b541-078557c9539e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:32.857107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c037f561-844c-46b4-b541-078557c9539e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:32.857107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c037f561-844c-46b4-b541-078557c9539e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:32.857107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c037f561-844c-46b4-b541-078557c9539e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:33.160639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c037f561-844c-46b4-b541-078557c9539e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:33.169308 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c037f561-844c-46b4-b541-078557c9539e tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1508 microversion: 2.1 time: 0.331115 May 28 21:41:33.170053 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3119/6195] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:32 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1508 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:34.085691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-c471c934-60dc-4edc-8ab6-33bff62f31db req-5f571f2c-ebf5-442f-bf9d-d30fff8f8d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ba71f2-8b5e-499e-94c6-d01a965dcfeb", "name": "network-vif-deleted", "tag": "0086297a-9b8e-45c2-b7dd-2c0186af3d7f"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:41:34.103061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c471c934-60dc-4edc-8ab6-33bff62f31db req-5f571f2c-ebf5-442f-bf9d-d30fff8f8d17 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:34.103888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c471c934-60dc-4edc-8ab6-33bff62f31db req-5f571f2c-ebf5-442f-bf9d-d30fff8f8d17 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:34.117553 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-c471c934-60dc-4edc-8ab6-33bff62f31db req-5f571f2c-ebf5-442f-bf9d-d30fff8f8d17 service nova] Creating event network-vif-deleted:0086297a-9b8e-45c2-b7dd-2c0186af3d7f for instance 40ba71f2-8b5e-499e-94c6-d01a965dcfeb on nch1-master-1 May 28 21:41:34.124166 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-c471c934-60dc-4edc-8ab6-33bff62f31db req-5f571f2c-ebf5-442f-bf9d-d30fff8f8d17 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042434 May 28 21:41:34.129103 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3077/6196] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:41:34.186884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8d258c47-56f4-4886-88b3-1481a25adb70 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:34.191536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8d258c47-56f4-4886-88b3-1481a25adb70 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:34.194469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d258c47-56f4-4886-88b3-1481a25adb70 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:34.194936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d258c47-56f4-4886-88b3-1481a25adb70 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:34.195811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d258c47-56f4-4886-88b3-1481a25adb70 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:34.196926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d258c47-56f4-4886-88b3-1481a25adb70 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:34.275497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8d258c47-56f4-4886-88b3-1481a25adb70 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ddfb9c65496f4c28bbfed14bb0a4529d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338603768c9143128533b10cfc00530e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:34.284818 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8d258c47-56f4-4886-88b3-1481a25adb70 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 200 len: 1466 microversion: 2.1 time: 0.101716 May 28 21:41:34.285958 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3120/6197] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:34 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 1466 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:34.599625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1351491273", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1455929180", "security_groups": [{"name": "tempest-secgroup-smoke-1791485158"}], "block_device_mapping_v2": [{"uuid": "76158cb5-574c-466c-82f8-f0cc50204799", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "66a65b2a-c99c-44c5-8c4a-ebd7f0012d23"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:41:34.781000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] validate_networks() for [('66a65b2a-c99c-44c5-8c4a-ebd7f0012d23', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:41:35.303271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-02945184-7f0e-431a-98f9-64b0121e4c41 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:35.306423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-02945184-7f0e-431a-98f9-64b0121e4c41 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] [instance: 40ba71f2-8b5e-499e-94c6-d01a965dcfeb] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:35.314796 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02945184-7f0e-431a-98f9-64b0121e4c41 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:35.315710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02945184-7f0e-431a-98f9-64b0121e4c41 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:35.316987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02945184-7f0e-431a-98f9-64b0121e4c41 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:35.317613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02945184-7f0e-431a-98f9-64b0121e4c41 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:35.336214 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-02945184-7f0e-431a-98f9-64b0121e4c41 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] HTTP exception thrown: Instance 40ba71f2-8b5e-499e-94c6-d01a965dcfeb could not be found. May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-02945184-7f0e-431a-98f9-64b0121e4c41 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Request method failure captured: May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb HTTP/1.1 May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpbxgBZzjl-YCMHmE74Y5wV7J45YdRovmyIf6B_xJ1dkToXjSvqSuskja5SSXJOwST-jUP9Vqaa7mpsrhrYmdfJY99gKRUZzzyYv4ZAKiqsfyXRRVR7Bu0VTUdDs8Th41Ms1OIYjOnnlcpxBLCO_pMfafcBIYoTRcvdb05KNfcoWI6o May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 338603768c9143128533b10cfc00530e May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestServerAdvancedOps-1423859723 May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_338603768c9143128533b10cfc00530e", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/338603768c9143128533b10cfc00530e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/338603768c9143128533b10cfc00530e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/338603768c9143128533b10cfc00530e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestServerAdvancedOps-1423859723 May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 338603768c9143128533b10cfc00530e May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestServerAdvancedOps-1423859723 May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestServerAdvancedOps-1423859723-project May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: ddfb9c65496f4c28bbfed14bb0a4529d May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestServerAdvancedOps-1423859723-project May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 40ba71f2-8b5e-499e-94c6-d01a965dcfeb could not be found. May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '40ba71f2-8b5e-499e-94c6-d01a965dcfeb'} May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40ba71f2-8b5e-499e-94c6-d01a965dcfeb could not be found. May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40ba71f2-8b5e-499e-94c6-d01a965dcfeb could not be found. May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:41:35.339884 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:35.345249 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:41:35.345249 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:41:35.345249 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:41:35.345249 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:41:35.345249 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:41:35.345249 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40ba71f2-8b5e-499e-94c6-d01a965dcfeb could not be found. May 28 21:41:35.345249 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:41:35.345249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-02945184-7f0e-431a-98f9-64b0121e4c41 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] Returning 404 to user: Instance 40ba71f2-8b5e-499e-94c6-d01a965dcfeb could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:41:35.345249 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-02945184-7f0e-431a-98f9-64b0121e4c41 tempest-TestServerAdvancedOps-1423859723 tempest-TestServerAdvancedOps-1423859723-project] 10.222.0.33 "GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb" status: 404 len: 111 microversion: 2.1 time: 0.042189 May 28 21:41:35.348378 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3121/6198] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:35 2022] GET /compute/v2.1/servers/40ba71f2-8b5e-499e-94c6-d01a965dcfeb => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:41:35.648369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:41:35.649509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:41:35.650089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:41:35.650525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:41:35.650960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:41:35.653140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:41:35.661469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:35.666041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:35.666041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:35.666041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:35.683201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Getting quotas for project 5833e78f486c4a118608290040b31cfc. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:41:35.689693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Getting quotas for user 388458a7b3504bd08f3789f53cf9ea35 and project 5833e78f486c4a118608290040b31cfc. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:41:35.763360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:41:35.768343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='76158cb5-574c-466c-82f8-f0cc50204799',volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:41:36.243698 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-40ab84c1-b9d1-4def-bb61-9c5c7ec00988 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.648805 May 28 21:41:36.244996 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3078/6199] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:41:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:41:36.255125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5831a8cd-7657-4502-904a-013e7297b25c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:36.256163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5831a8cd-7657-4502-904a-013e7297b25c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:36.336895 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5831a8cd-7657-4502-904a-013e7297b25c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:36.349626 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5831a8cd-7657-4502-904a-013e7297b25c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1095 microversion: 2.1 time: 0.098532 May 28 21:41:36.350252 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3122/6200] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:36 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1095 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:37.368603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c412240e-a9db-456c-9e9d-92e00dded602 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:37.369502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c412240e-a9db-456c-9e9d-92e00dded602 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:37.380458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c412240e-a9db-456c-9e9d-92e00dded602 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:37.384772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c412240e-a9db-456c-9e9d-92e00dded602 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:37.384772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c412240e-a9db-456c-9e9d-92e00dded602 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:37.384772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c412240e-a9db-456c-9e9d-92e00dded602 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:37.545305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c412240e-a9db-456c-9e9d-92e00dded602 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:37.553954 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c412240e-a9db-456c-9e9d-92e00dded602 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1145 microversion: 2.1 time: 0.190311 May 28 21:41:37.554839 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3079/6201] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:37 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1145 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:38.572717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8fa071f8-c43b-4deb-bc80-7ce64eab6f4b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:38.573937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8fa071f8-c43b-4deb-bc80-7ce64eab6f4b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:38.583134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fa071f8-c43b-4deb-bc80-7ce64eab6f4b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:38.583857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fa071f8-c43b-4deb-bc80-7ce64eab6f4b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:38.585215 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fa071f8-c43b-4deb-bc80-7ce64eab6f4b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:38.585826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fa071f8-c43b-4deb-bc80-7ce64eab6f4b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:38.698473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8fa071f8-c43b-4deb-bc80-7ce64eab6f4b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:38.710813 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8fa071f8-c43b-4deb-bc80-7ce64eab6f4b tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1211 microversion: 2.1 time: 0.143309 May 28 21:41:38.713259 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3123/6202] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:38 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1211 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:39.730903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-82336343-5e27-4047-ac8d-123eb02f57de tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:39.731633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-82336343-5e27-4047-ac8d-123eb02f57de tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:39.741059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82336343-5e27-4047-ac8d-123eb02f57de tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:39.742218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82336343-5e27-4047-ac8d-123eb02f57de tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:39.743645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82336343-5e27-4047-ac8d-123eb02f57de tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:39.744111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82336343-5e27-4047-ac8d-123eb02f57de tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:39.808786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-82336343-5e27-4047-ac8d-123eb02f57de tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:39.817038 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-82336343-5e27-4047-ac8d-123eb02f57de tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1211 microversion: 2.1 time: 0.091126 May 28 21:41:39.817767 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3080/6203] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:39 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:40.841113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89e5bb1d-0588-4a2d-a747-52e58f95d32c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:40.842229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-89e5bb1d-0588-4a2d-a747-52e58f95d32c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:40.869536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89e5bb1d-0588-4a2d-a747-52e58f95d32c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:40.871700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89e5bb1d-0588-4a2d-a747-52e58f95d32c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:40.876706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89e5bb1d-0588-4a2d-a747-52e58f95d32c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:40.877263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89e5bb1d-0588-4a2d-a747-52e58f95d32c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:41.101496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-89e5bb1d-0588-4a2d-a747-52e58f95d32c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:41.134977 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-89e5bb1d-0588-4a2d-a747-52e58f95d32c tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1267 microversion: 2.1 time: 0.303042 May 28 21:41:41.136328 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3124/6204] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:40 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1267 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:41.162961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2e26a40a-a9e6-479b-867a-185e835b86b7 req-3b1c3075-dc0b-49c1-80d2-f75195a485c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb94843-e803-4c2d-9aed-29fd9c029b08", "tag": "1d6e7e91-497b-4a50-988d-8abdcdbb2014"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:41:41.190885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2e26a40a-a9e6-479b-867a-185e835b86b7 req-3b1c3075-dc0b-49c1-80d2-f75195a485c2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:41.191713 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2e26a40a-a9e6-479b-867a-185e835b86b7 req-3b1c3075-dc0b-49c1-80d2-f75195a485c2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:41.230653 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2e26a40a-a9e6-479b-867a-185e835b86b7 req-3b1c3075-dc0b-49c1-80d2-f75195a485c2 service nova] Creating event network-changed:1d6e7e91-497b-4a50-988d-8abdcdbb2014 for instance 6fb94843-e803-4c2d-9aed-29fd9c029b08 on nch1-master-1 May 28 21:41:41.236787 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2e26a40a-a9e6-479b-867a-185e835b86b7 req-3b1c3075-dc0b-49c1-80d2-f75195a485c2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077886 May 28 21:41:41.237525 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3081/6205] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:41:42.153279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d45010b0-7c93-4df6-8124-0743c04bde2e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:42.154166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d45010b0-7c93-4df6-8124-0743c04bde2e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:42.162304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d45010b0-7c93-4df6-8124-0743c04bde2e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:42.163205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d45010b0-7c93-4df6-8124-0743c04bde2e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:42.165063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d45010b0-7c93-4df6-8124-0743c04bde2e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:42.165782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d45010b0-7c93-4df6-8124-0743c04bde2e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:42.531715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d45010b0-7c93-4df6-8124-0743c04bde2e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:42.540067 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d45010b0-7c93-4df6-8124-0743c04bde2e tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1267 microversion: 2.1 time: 0.390809 May 28 21:41:42.540661 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3125/6206] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:42 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1267 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:43.558946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-55ea466a-9fae-46fe-882b-7ce390e4d2ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:43.559709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-55ea466a-9fae-46fe-882b-7ce390e4d2ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:43.568254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55ea466a-9fae-46fe-882b-7ce390e4d2ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:43.568726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55ea466a-9fae-46fe-882b-7ce390e4d2ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:43.569869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55ea466a-9fae-46fe-882b-7ce390e4d2ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:43.570907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-55ea466a-9fae-46fe-882b-7ce390e4d2ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:43.839856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-55ea466a-9fae-46fe-882b-7ce390e4d2ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:43.848105 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-55ea466a-9fae-46fe-882b-7ce390e4d2ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1267 microversion: 2.1 time: 0.294928 May 28 21:41:43.858338 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3082/6207] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:43 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:44.865513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6e30d7e6-395f-4427-94bf-9690d69ff68d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:44.870134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6e30d7e6-395f-4427-94bf-9690d69ff68d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:44.873137 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e30d7e6-395f-4427-94bf-9690d69ff68d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:44.873646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e30d7e6-395f-4427-94bf-9690d69ff68d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:44.874496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e30d7e6-395f-4427-94bf-9690d69ff68d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:44.874948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6e30d7e6-395f-4427-94bf-9690d69ff68d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:45.110689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6e30d7e6-395f-4427-94bf-9690d69ff68d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:45.120228 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6e30d7e6-395f-4427-94bf-9690d69ff68d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1267 microversion: 2.1 time: 0.258801 May 28 21:41:45.120829 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3126/6208] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:44 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1267 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:46.140796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-af948ea8-9b65-4eb1-b85b-80969165164a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:46.141595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-af948ea8-9b65-4eb1-b85b-80969165164a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:46.148011 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:41:46.154047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=10 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:41:46.154250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af948ea8-9b65-4eb1-b85b-80969165164a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:46.154949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af948ea8-9b65-4eb1-b85b-80969165164a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:46.155850 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af948ea8-9b65-4eb1-b85b-80969165164a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:46.156406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af948ea8-9b65-4eb1-b85b-80969165164a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:46.358371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-af948ea8-9b65-4eb1-b85b-80969165164a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:46.366840 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-af948ea8-9b65-4eb1-b85b-80969165164a tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1267 microversion: 2.1 time: 0.231782 May 28 21:41:46.368654 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3083/6209] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:46 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:47.385557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a9540301-9eac-4164-843e-ce14f754066d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:47.386216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a9540301-9eac-4164-843e-ce14f754066d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:47.389102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:41:47.399697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:41:47.403023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9540301-9eac-4164-843e-ce14f754066d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:47.403495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9540301-9eac-4164-843e-ce14f754066d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:47.406564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9540301-9eac-4164-843e-ce14f754066d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:47.407265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9540301-9eac-4164-843e-ce14f754066d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:47.598043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a9540301-9eac-4164-843e-ce14f754066d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:47.603476 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a9540301-9eac-4164-843e-ce14f754066d tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1267 microversion: 2.1 time: 0.222643 May 28 21:41:47.604255 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3127/6210] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:47 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:47.631336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-9e6c4d66-a7b0-4d6f-8144-7903ef477e63 req-8d4bb994-d2da-480d-b808-566dca794f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb94843-e803-4c2d-9aed-29fd9c029b08", "name": "network-vif-plugged", "status": "completed", "tag": "1d6e7e91-497b-4a50-988d-8abdcdbb2014"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:41:47.641064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9e6c4d66-a7b0-4d6f-8144-7903ef477e63 req-8d4bb994-d2da-480d-b808-566dca794f32 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:47.655375 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9e6c4d66-a7b0-4d6f-8144-7903ef477e63 req-8d4bb994-d2da-480d-b808-566dca794f32 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:47.655375 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-9e6c4d66-a7b0-4d6f-8144-7903ef477e63 req-8d4bb994-d2da-480d-b808-566dca794f32 service nova] Creating event network-vif-plugged:1d6e7e91-497b-4a50-988d-8abdcdbb2014 for instance 6fb94843-e803-4c2d-9aed-29fd9c029b08 on nch1-master-1 May 28 21:41:47.658700 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-9e6c4d66-a7b0-4d6f-8144-7903ef477e63 req-8d4bb994-d2da-480d-b808-566dca794f32 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031521 May 28 21:41:47.659668 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3084/6211] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:41:48.621509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c292e493-70ec-410f-bb11-6bfa540faafe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:48.622289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c292e493-70ec-410f-bb11-6bfa540faafe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:48.630151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c292e493-70ec-410f-bb11-6bfa540faafe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:48.631111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c292e493-70ec-410f-bb11-6bfa540faafe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:48.631953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c292e493-70ec-410f-bb11-6bfa540faafe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:48.632772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c292e493-70ec-410f-bb11-6bfa540faafe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:48.799275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c292e493-70ec-410f-bb11-6bfa540faafe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:48.808548 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c292e493-70ec-410f-bb11-6bfa540faafe tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1267 microversion: 2.1 time: 0.191934 May 28 21:41:48.809146 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3128/6212] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:48 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:49.827612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7d153454-137a-4380-84fe-8f73eb2167ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:49.828341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7d153454-137a-4380-84fe-8f73eb2167ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:49.835122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d153454-137a-4380-84fe-8f73eb2167ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:49.835416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d153454-137a-4380-84fe-8f73eb2167ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:49.836236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d153454-137a-4380-84fe-8f73eb2167ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:49.836698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7d153454-137a-4380-84fe-8f73eb2167ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:49.973574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7d153454-137a-4380-84fe-8f73eb2167ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:49.982035 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7d153454-137a-4380-84fe-8f73eb2167ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1454 microversion: 2.1 time: 0.159605 May 28 21:41:49.982630 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3085/6213] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:49 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:49.999274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-66b98d94-8f2f-41cb-819d-203534f43885 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:41:50.000020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-66b98d94-8f2f-41cb-819d-203534f43885 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:41:50.006651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66b98d94-8f2f-41cb-819d-203534f43885 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:50.007109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66b98d94-8f2f-41cb-819d-203534f43885 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:50.008755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66b98d94-8f2f-41cb-819d-203534f43885 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:50.009205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-66b98d94-8f2f-41cb-819d-203534f43885 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:50.151072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-66b98d94-8f2f-41cb-819d-203534f43885 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:41:50.159205 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-66b98d94-8f2f-41cb-819d-203534f43885 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1454 microversion: 2.1 time: 0.164026 May 28 21:41:50.160043 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3129/6214] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:41:49 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1454 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:41:52.815419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-69ba74cc-4956-46ab-9996-c44c5ca8ce05 req-967f7494-a2e9-4dd9-bda3-d4775e30ccb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb94843-e803-4c2d-9aed-29fd9c029b08", "tag": "1d6e7e91-497b-4a50-988d-8abdcdbb2014"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:41:52.825974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-69ba74cc-4956-46ab-9996-c44c5ca8ce05 req-967f7494-a2e9-4dd9-bda3-d4775e30ccb8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:41:52.826452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-69ba74cc-4956-46ab-9996-c44c5ca8ce05 req-967f7494-a2e9-4dd9-bda3-d4775e30ccb8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:41:52.837961 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-69ba74cc-4956-46ab-9996-c44c5ca8ce05 req-967f7494-a2e9-4dd9-bda3-d4775e30ccb8 service nova] Creating event network-changed:1d6e7e91-497b-4a50-988d-8abdcdbb2014 for instance 6fb94843-e803-4c2d-9aed-29fd9c029b08 on nch1-master-1 May 28 21:41:52.843299 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-69ba74cc-4956-46ab-9996-c44c5ca8ce05 req-967f7494-a2e9-4dd9-bda3-d4775e30ccb8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031776 May 28 21:41:52.843915 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3086/6215] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:42:53.539897 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 21:42:53.540575 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 21:42:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 21:44:20.886058 ncdv-master-1 devstack@n-api.service[143129]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac93fc00-477b-44ec-8099-842dbc0762a6] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 21:44:20.886058 ncdv-master-1 devstack@n-api.service[143129]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0135df6d-06bc-4c7e-99b7-8ac7fe500326] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 21:44:20.886058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-81a22961-62d4-438a-885f-87d6c8ad8d67 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Action: 'create', calling method: .version_select at 0x7f4d6416e040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-100900842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWs7SYv8fkNPgAfs5tZxAmj6E6Fa74/CQeLUFdFJr3unoA0olqTpTbYFQLPpKvyieogzJlXzqwtmvG7pcuWq89AIdKFYd84+pqNcVp90HDnDIICcg8Ur5IHLQJ0QnpgVw=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:44:20.893692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=5 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:44:20.894486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:44:20.908111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-81a22961-62d4-438a-885f-87d6c8ad8d67 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Getting quotas for project d7ae678d8e60475bb9b35abcb027a02d. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:44:20.912152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-81a22961-62d4-438a-885f-87d6c8ad8d67 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Getting quotas for user 854bc76149074ec5a4ba92bd42ae6a32 and project d7ae678d8e60475bb9b35abcb027a02d. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:44:21.040288 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-81a22961-62d4-438a-885f-87d6c8ad8d67 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.164717 May 28 21:44:21.041190 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3130/6216] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:44:20 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:44:24.205387 ncdv-master-1 devstack@n-api.service[143128]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71d375b4-1aec-4c8d-819c-c0bdf546db7b] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 21:44:24.209188 ncdv-master-1 devstack@n-api.service[143128]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c389da86-0e4e-4c71-b4f6-a8fc5e8f642f] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 21:44:24.209188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:44:24.209188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=60 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:44:24.212317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1177724665", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "cfd831a5-f539-47f4-9050-114341abe6bf"}], "key_name": "tempest-TestNetworkBasicOps-100900842", "security_groups": [{"name": "tempest-secgroup-smoke-2038603226"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:44:24.509724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] validate_networks() for [('cfd831a5-f539-47f4-9050-114341abe6bf', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:44:24.873986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:44:24.874468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:44:24.874967 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:44:24.875397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:44:24.876453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:44:24.886309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:24.886776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:24.887599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:24.888081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:24.905099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Getting quotas for project d7ae678d8e60475bb9b35abcb027a02d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:44:24.910578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Getting quotas for user 854bc76149074ec5a4ba92bd42ae6a32 and project d7ae678d8e60475bb9b35abcb027a02d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:44:24.923829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:44:24.926279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:44:25.026003 ncdv-master-1 devstack@n-api.service[143128]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [63d4e346-ce63-4579-a13d-e28abfa098f7] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 21:44:25.214392 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] [71d375b4-1aec-4c8d-819c-c0bdf546db7b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 49316. May 28 21:44:25.215073 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] [c389da86-0e4e-4c71-b4f6-a8fc5e8f642f] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 49318. May 28 21:44:26.033418 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [63d4e346-ce63-4579-a13d-e28abfa098f7] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 49320. May 28 21:44:26.038074 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9d08f3d5-2d8f-4f61-b5ad-237e8625decd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.835648 May 28 21:44:26.038740 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3087/6217] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:44:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:44:26.052357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-926bc6b0-d836-4b03-877b-c14c8edf5a28 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:44:26.052747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-926bc6b0-d836-4b03-877b-c14c8edf5a28 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:44:26.067771 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] [0135df6d-06bc-4c7e-99b7-8ac7fe500326] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 49326. May 28 21:44:26.078924 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac93fc00-477b-44ec-8099-842dbc0762a6] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 49324. May 28 21:44:26.192184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-926bc6b0-d836-4b03-877b-c14c8edf5a28 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:44:26.200108 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-926bc6b0-d836-4b03-877b-c14c8edf5a28 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 200 len: 1248 microversion: 2.1 time: 0.155305 May 28 21:44:26.200666 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3131/6218] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:44:26 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 1248 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:44:27.219156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-26a9d321-3324-4490-b00f-96d16f4ac5c5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:44:27.219902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-26a9d321-3324-4490-b00f-96d16f4ac5c5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:44:27.273980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-26a9d321-3324-4490-b00f-96d16f4ac5c5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:44:27.280850 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-26a9d321-3324-4490-b00f-96d16f4ac5c5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 200 len: 1248 microversion: 2.1 time: 0.066489 May 28 21:44:27.281412 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3088/6219] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:44:27 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 1248 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:44:28.298337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d3e484cd-8d0c-4d23-ad8e-b9743815eba5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:44:28.298954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d3e484cd-8d0c-4d23-ad8e-b9743815eba5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:44:28.306662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3e484cd-8d0c-4d23-ad8e-b9743815eba5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:28.307171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3e484cd-8d0c-4d23-ad8e-b9743815eba5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:28.307947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3e484cd-8d0c-4d23-ad8e-b9743815eba5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:28.308392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3e484cd-8d0c-4d23-ad8e-b9743815eba5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:28.373644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d3e484cd-8d0c-4d23-ad8e-b9743815eba5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:44:28.381960 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d3e484cd-8d0c-4d23-ad8e-b9743815eba5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 200 len: 1300 microversion: 2.1 time: 0.087750 May 28 21:44:28.382617 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3132/6220] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:44:28 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:44:29.402858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2f472196-939e-426f-8daf-b9f04ed5fc81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:44:29.407022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2f472196-939e-426f-8daf-b9f04ed5fc81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:44:29.418237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f472196-939e-426f-8daf-b9f04ed5fc81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:29.418710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f472196-939e-426f-8daf-b9f04ed5fc81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:29.419726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f472196-939e-426f-8daf-b9f04ed5fc81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:29.420185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2f472196-939e-426f-8daf-b9f04ed5fc81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:29.566507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2f472196-939e-426f-8daf-b9f04ed5fc81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:44:29.574841 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2f472196-939e-426f-8daf-b9f04ed5fc81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 200 len: 1374 microversion: 2.1 time: 0.176744 May 28 21:44:29.575559 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3089/6221] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:44:29 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:44:30.529169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-4cb21c23-9b0e-4751-9e78-9c8730cbfe4c req-2cb749f0-c70d-433d-a765-2399bcd3ca3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864d2c73-7076-4086-978a-b103487013b7", "tag": "22ee83fa-1b1b-4e18-b6e6-9c7878e0df14"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:44:30.538397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4cb21c23-9b0e-4751-9e78-9c8730cbfe4c req-2cb749f0-c70d-433d-a765-2399bcd3ca3e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:30.538916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-4cb21c23-9b0e-4751-9e78-9c8730cbfe4c req-2cb749f0-c70d-433d-a765-2399bcd3ca3e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:30.558093 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-4cb21c23-9b0e-4751-9e78-9c8730cbfe4c req-2cb749f0-c70d-433d-a765-2399bcd3ca3e service nova] Creating event network-changed:22ee83fa-1b1b-4e18-b6e6-9c7878e0df14 for instance 864d2c73-7076-4086-978a-b103487013b7 on nch2-master-1 May 28 21:44:30.558093 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-4cb21c23-9b0e-4751-9e78-9c8730cbfe4c req-2cb749f0-c70d-433d-a765-2399bcd3ca3e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106887 May 28 21:44:30.558093 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3133/6222] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:44:30.592177 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7bbb2b9e-a46f-47f7-9fcc-870fc18a29e0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:44:30.592821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7bbb2b9e-a46f-47f7-9fcc-870fc18a29e0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:44:30.603939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bbb2b9e-a46f-47f7-9fcc-870fc18a29e0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:30.604776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bbb2b9e-a46f-47f7-9fcc-870fc18a29e0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:30.605916 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bbb2b9e-a46f-47f7-9fcc-870fc18a29e0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:30.606598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bbb2b9e-a46f-47f7-9fcc-870fc18a29e0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:31.109772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7bbb2b9e-a46f-47f7-9fcc-870fc18a29e0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:44:31.117877 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7bbb2b9e-a46f-47f7-9fcc-870fc18a29e0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 200 len: 1374 microversion: 2.1 time: 0.529686 May 28 21:44:31.118481 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3090/6223] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:44:30 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 1374 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:44:32.136313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ea7c2b85-ff1b-4db9-9430-4818e96c0886 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:44:32.137037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ea7c2b85-ff1b-4db9-9430-4818e96c0886 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:44:32.143581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea7c2b85-ff1b-4db9-9430-4818e96c0886 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:32.144045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea7c2b85-ff1b-4db9-9430-4818e96c0886 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:32.144820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea7c2b85-ff1b-4db9-9430-4818e96c0886 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:32.145268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea7c2b85-ff1b-4db9-9430-4818e96c0886 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:32.364746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ea7c2b85-ff1b-4db9-9430-4818e96c0886 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:44:32.372483 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ea7c2b85-ff1b-4db9-9430-4818e96c0886 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 200 len: 1374 microversion: 2.1 time: 0.241408 May 28 21:44:32.373333 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3134/6224] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:44:32 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 1374 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:44:33.390437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b19b435b-325b-4918-99d9-5959652175de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:44:33.391077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b19b435b-325b-4918-99d9-5959652175de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:44:33.398310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b19b435b-325b-4918-99d9-5959652175de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:33.398791 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b19b435b-325b-4918-99d9-5959652175de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:33.399586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b19b435b-325b-4918-99d9-5959652175de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:33.400050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b19b435b-325b-4918-99d9-5959652175de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:33.541771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b19b435b-325b-4918-99d9-5959652175de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:44:33.549353 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b19b435b-325b-4918-99d9-5959652175de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 200 len: 1374 microversion: 2.1 time: 0.162875 May 28 21:44:33.549949 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3091/6225] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:44:33 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:44:34.570647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-95045940-32fe-46be-bbba-ea05646320f2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:44:34.571404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-95045940-32fe-46be-bbba-ea05646320f2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:44:34.578439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95045940-32fe-46be-bbba-ea05646320f2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:34.580184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95045940-32fe-46be-bbba-ea05646320f2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:34.580184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95045940-32fe-46be-bbba-ea05646320f2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:34.580184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95045940-32fe-46be-bbba-ea05646320f2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:34.712753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-95045940-32fe-46be-bbba-ea05646320f2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:44:34.720445 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-95045940-32fe-46be-bbba-ea05646320f2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 200 len: 1374 microversion: 2.1 time: 0.153785 May 28 21:44:34.721021 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3135/6226] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:44:34 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:44:35.192859 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 21:44:35.193432 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 21:44:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 21:44:35.737128 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-838cb87f-4684-4b4c-9065-90ef4001a668 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:44:35.737795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-838cb87f-4684-4b4c-9065-90ef4001a668 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:44:35.740631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:44:35.745596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-838cb87f-4684-4b4c-9065-90ef4001a668 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:35.746101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-838cb87f-4684-4b4c-9065-90ef4001a668 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:35.746895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-838cb87f-4684-4b4c-9065-90ef4001a668 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:35.747386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-838cb87f-4684-4b4c-9065-90ef4001a668 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:35.880380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-838cb87f-4684-4b4c-9065-90ef4001a668 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:44:35.888124 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-838cb87f-4684-4b4c-9065-90ef4001a668 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 200 len: 1374 microversion: 2.1 time: 0.154977 May 28 21:44:35.892492 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3092/6227] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:44:35 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:44:36.013690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-b89fa8d2-a2ad-466c-9f30-bfd48ba81e97 req-7e813204-35ce-431f-97c8-cdc33abe7ffe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864d2c73-7076-4086-978a-b103487013b7", "name": "network-vif-plugged", "status": "completed", "tag": "22ee83fa-1b1b-4e18-b6e6-9c7878e0df14"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:44:36.021263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b89fa8d2-a2ad-466c-9f30-bfd48ba81e97 req-7e813204-35ce-431f-97c8-cdc33abe7ffe service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:36.021720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b89fa8d2-a2ad-466c-9f30-bfd48ba81e97 req-7e813204-35ce-431f-97c8-cdc33abe7ffe service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:36.032754 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b89fa8d2-a2ad-466c-9f30-bfd48ba81e97 req-7e813204-35ce-431f-97c8-cdc33abe7ffe service nova] Creating event network-vif-plugged:22ee83fa-1b1b-4e18-b6e6-9c7878e0df14 for instance 864d2c73-7076-4086-978a-b103487013b7 on nch2-master-1 May 28 21:44:36.038495 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-b89fa8d2-a2ad-466c-9f30-bfd48ba81e97 req-7e813204-35ce-431f-97c8-cdc33abe7ffe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093584 May 28 21:44:36.039097 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3136/6228] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:44:36.906023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f8b4e350-9e8b-4e33-9d34-b406beb02e5c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:44:36.906575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f8b4e350-9e8b-4e33-9d34-b406beb02e5c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:44:36.914324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8b4e350-9e8b-4e33-9d34-b406beb02e5c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:36.914796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8b4e350-9e8b-4e33-9d34-b406beb02e5c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:36.915633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8b4e350-9e8b-4e33-9d34-b406beb02e5c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:36.916092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8b4e350-9e8b-4e33-9d34-b406beb02e5c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:37.050406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f8b4e350-9e8b-4e33-9d34-b406beb02e5c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:44:37.058818 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f8b4e350-9e8b-4e33-9d34-b406beb02e5c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 200 len: 1374 microversion: 2.1 time: 0.156821 May 28 21:44:37.059410 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3093/6229] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:44:36 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:44:38.073859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:44:38.078997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a6d0b9f5-e866-42a2-a2a0-0908a1099ea1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:44:38.079740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a6d0b9f5-e866-42a2-a2a0-0908a1099ea1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:44:38.086099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6d0b9f5-e866-42a2-a2a0-0908a1099ea1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:38.086589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6d0b9f5-e866-42a2-a2a0-0908a1099ea1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:38.087695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6d0b9f5-e866-42a2-a2a0-0908a1099ea1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:38.088142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a6d0b9f5-e866-42a2-a2a0-0908a1099ea1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:38.222901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a6d0b9f5-e866-42a2-a2a0-0908a1099ea1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:44:38.230603 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a6d0b9f5-e866-42a2-a2a0-0908a1099ea1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 200 len: 1546 microversion: 2.1 time: 0.157669 May 28 21:44:38.231190 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3137/6230] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:44:38 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:44:38.247144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ea32815a-8255-43e6-b9dc-425175646102 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:44:38.247782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ea32815a-8255-43e6-b9dc-425175646102 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:44:38.249663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:44:38.255582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea32815a-8255-43e6-b9dc-425175646102 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:38.256156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea32815a-8255-43e6-b9dc-425175646102 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:38.257571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea32815a-8255-43e6-b9dc-425175646102 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:38.258069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea32815a-8255-43e6-b9dc-425175646102 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:38.389347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ea32815a-8255-43e6-b9dc-425175646102 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:44:38.397188 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ea32815a-8255-43e6-b9dc-425175646102 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 200 len: 1546 microversion: 2.1 time: 0.153952 May 28 21:44:38.397770 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3094/6231] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:44:38 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:44:40.325944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d7eabf4a-2218-43bc-84d9-ef31536c41aa req-25a17c9a-73cc-40bf-9fde-422a3adc4111 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864d2c73-7076-4086-978a-b103487013b7", "tag": "22ee83fa-1b1b-4e18-b6e6-9c7878e0df14"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:44:40.337448 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d7eabf4a-2218-43bc-84d9-ef31536c41aa req-25a17c9a-73cc-40bf-9fde-422a3adc4111 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:44:40.338356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d7eabf4a-2218-43bc-84d9-ef31536c41aa req-25a17c9a-73cc-40bf-9fde-422a3adc4111 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:44:40.354747 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d7eabf4a-2218-43bc-84d9-ef31536c41aa req-25a17c9a-73cc-40bf-9fde-422a3adc4111 service nova] Creating event network-changed:22ee83fa-1b1b-4e18-b6e6-9c7878e0df14 for instance 864d2c73-7076-4086-978a-b103487013b7 on nch2-master-1 May 28 21:44:40.360571 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d7eabf4a-2218-43bc-84d9-ef31536c41aa req-25a17c9a-73cc-40bf-9fde-422a3adc4111 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039209 May 28 21:44:40.361804 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3138/6232] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:44:59.953355 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 21:44:59.954002 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 21:44:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 21:45:01.595989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd619cec-5748-4821-b54a-556de84c808f tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:45:01.596904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bd619cec-5748-4821-b54a-556de84c808f tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:01.599160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:45:01.599951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=38 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:45:01.604750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd619cec-5748-4821-b54a-556de84c808f tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:01.605215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd619cec-5748-4821-b54a-556de84c808f tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:01.606027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd619cec-5748-4821-b54a-556de84c808f tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:01.606512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd619cec-5748-4821-b54a-556de84c808f tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:01.669681 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bd619cec-5748-4821-b54a-556de84c808f tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "POST /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7/action" status: 200 len: 24566 microversion: 2.1 time: 0.077798 May 28 21:45:01.670385 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3095/6233] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:45:01 2022] POST /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7/action => generated 24566 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:45:17.046518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:45:17.047333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=30 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:45:17.051747 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dab94a1b-50a8-4f2c-94f4-eef5ce2bb615 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Action: 'create', calling method: .version_select at 0x7f4d6474c040>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1475186095", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHr5QW/4qkYop8bDz0zDfKmWx8LI4Ymjg68NrHrd2crCp2Cv2Y+j8CibM91F2AuEOMWurPlwzHXfK5H5UeWoeWeGv63prkaAzeatEfKPuoX2Na2OFy1+nEg74ZxTZRIHA=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:45:17.068971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-dab94a1b-50a8-4f2c-94f4-eef5ce2bb615 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Getting quotas for project d7ae678d8e60475bb9b35abcb027a02d. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:45:17.075524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-dab94a1b-50a8-4f2c-94f4-eef5ce2bb615 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Getting quotas for user 854bc76149074ec5a4ba92bd42ae6a32 and project d7ae678d8e60475bb9b35abcb027a02d. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:45:17.186767 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dab94a1b-50a8-4f2c-94f4-eef5ce2bb615 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.142747 May 28 21:45:17.187417 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3139/6234] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:45:17 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:45:19.948267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1842946016", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "c39154e9-3b85-4502-9a36-d80e4be6edb4"}], "key_name": "tempest-TestNetworkBasicOps-1475186095", "security_groups": [{"name": "tempest-secgroup-smoke-800313276"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:45:19.956662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:45:20.055729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] validate_networks() for [('c39154e9-3b85-4502-9a36-d80e4be6edb4', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:45:20.478213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:45:20.478691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:45:20.479190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:45:20.479648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:45:20.480113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:45:20.491392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:20.491891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:20.492711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:20.493171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:20.510284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Getting quotas for project d7ae678d8e60475bb9b35abcb027a02d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:45:20.516142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Getting quotas for user 854bc76149074ec5a4ba92bd42ae6a32 and project d7ae678d8e60475bb9b35abcb027a02d. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:45:20.529421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:45:20.531880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:45:20.648612 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d6d9fc58-d9fa-44f5-b48a-c1b046627228 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.705152 May 28 21:45:20.649302 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3096/6235] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:45:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:45:20.660506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6be50239-0a44-48ad-bd03-6e31db651092 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:20.661371 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6be50239-0a44-48ad-bd03-6e31db651092 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:20.722660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6be50239-0a44-48ad-bd03-6e31db651092 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:20.730187 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6be50239-0a44-48ad-bd03-6e31db651092 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 200 len: 1249 microversion: 2.1 time: 0.073775 May 28 21:45:20.730640 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3140/6236] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:20 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 1249 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:45:21.748796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-06eede6c-9892-463a-921d-52f782ce65f1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:21.749435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-06eede6c-9892-463a-921d-52f782ce65f1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:21.755993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06eede6c-9892-463a-921d-52f782ce65f1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:21.756464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06eede6c-9892-463a-921d-52f782ce65f1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:21.757249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06eede6c-9892-463a-921d-52f782ce65f1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:21.757710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-06eede6c-9892-463a-921d-52f782ce65f1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:21.820147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-06eede6c-9892-463a-921d-52f782ce65f1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:21.828445 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-06eede6c-9892-463a-921d-52f782ce65f1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 200 len: 1253 microversion: 2.1 time: 0.085066 May 28 21:45:21.829019 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3097/6237] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:21 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 1253 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:45:22.846489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f7e06bb3-ed71-4634-9efe-d0cd62edd03a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:22.847738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f7e06bb3-ed71-4634-9efe-d0cd62edd03a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:22.855899 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7e06bb3-ed71-4634-9efe-d0cd62edd03a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:22.856618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7e06bb3-ed71-4634-9efe-d0cd62edd03a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:22.857589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7e06bb3-ed71-4634-9efe-d0cd62edd03a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:22.858072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7e06bb3-ed71-4634-9efe-d0cd62edd03a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:22.921288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f7e06bb3-ed71-4634-9efe-d0cd62edd03a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:22.929211 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f7e06bb3-ed71-4634-9efe-d0cd62edd03a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 200 len: 1309 microversion: 2.1 time: 0.087318 May 28 21:45:22.929796 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3141/6238] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:22 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 1309 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:45:23.946977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-70a40802-3fe1-4619-a056-885f667225fd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:23.947568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-70a40802-3fe1-4619-a056-885f667225fd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:23.954720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70a40802-3fe1-4619-a056-885f667225fd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:23.955195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70a40802-3fe1-4619-a056-885f667225fd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:23.955990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70a40802-3fe1-4619-a056-885f667225fd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:23.956454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70a40802-3fe1-4619-a056-885f667225fd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:24.091343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-70a40802-3fe1-4619-a056-885f667225fd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:24.099242 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-70a40802-3fe1-4619-a056-885f667225fd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 200 len: 1374 microversion: 2.1 time: 0.156433 May 28 21:45:24.102591 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3098/6239] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:23 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:45:24.585656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-5bb9e30f-1710-4ed3-ba5a-1477c11ae088 req-d8f62065-c4b6-4df1-a96f-55043d3c7e4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4265c1-07eb-407e-859b-1e7c3260ada5", "tag": "c471432b-570e-4242-a0aa-7071b92822bd"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:45:24.595002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5bb9e30f-1710-4ed3-ba5a-1477c11ae088 req-d8f62065-c4b6-4df1-a96f-55043d3c7e4a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:24.595457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-5bb9e30f-1710-4ed3-ba5a-1477c11ae088 req-d8f62065-c4b6-4df1-a96f-55043d3c7e4a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:24.607609 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-5bb9e30f-1710-4ed3-ba5a-1477c11ae088 req-d8f62065-c4b6-4df1-a96f-55043d3c7e4a service nova] Creating event network-changed:c471432b-570e-4242-a0aa-7071b92822bd for instance fb4265c1-07eb-407e-859b-1e7c3260ada5 on nch1-master-1 May 28 21:45:24.613788 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-5bb9e30f-1710-4ed3-ba5a-1477c11ae088 req-d8f62065-c4b6-4df1-a96f-55043d3c7e4a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103470 May 28 21:45:24.617012 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3142/6240] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:45:25.116498 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-80843483-b630-41bb-ab77-eba46380ee63 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:25.117248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-80843483-b630-41bb-ab77-eba46380ee63 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:25.124502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80843483-b630-41bb-ab77-eba46380ee63 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:25.125189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80843483-b630-41bb-ab77-eba46380ee63 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:25.126194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80843483-b630-41bb-ab77-eba46380ee63 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:25.126666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80843483-b630-41bb-ab77-eba46380ee63 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:25.267904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-80843483-b630-41bb-ab77-eba46380ee63 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:25.275827 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-80843483-b630-41bb-ab77-eba46380ee63 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 200 len: 1374 microversion: 2.1 time: 0.163316 May 28 21:45:25.276416 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3099/6241] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:25 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:45:26.259962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-68590aa5-481b-4780-82ea-8ae68f3fcdb5 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:45:26.260974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-68590aa5-481b-4780-82ea-8ae68f3fcdb5 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:26.267279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68590aa5-481b-4780-82ea-8ae68f3fcdb5 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:26.267739 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68590aa5-481b-4780-82ea-8ae68f3fcdb5 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:26.268503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68590aa5-481b-4780-82ea-8ae68f3fcdb5 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:26.268945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-68590aa5-481b-4780-82ea-8ae68f3fcdb5 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:26.292485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ef27e9af-670b-47fe-9443-77aa269664ec tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:26.293118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ef27e9af-670b-47fe-9443-77aa269664ec tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:26.302061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef27e9af-670b-47fe-9443-77aa269664ec tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:26.302536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef27e9af-670b-47fe-9443-77aa269664ec tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:26.303382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef27e9af-670b-47fe-9443-77aa269664ec tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:26.303878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef27e9af-670b-47fe-9443-77aa269664ec tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:26.321708 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-68590aa5-481b-4780-82ea-8ae68f3fcdb5 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "POST /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08/action" status: 200 len: 24567 microversion: 2.1 time: 0.170150 May 28 21:45:26.322302 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3143/6242] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:45:26 2022] POST /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08/action => generated 24567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:45:26.437163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ef27e9af-670b-47fe-9443-77aa269664ec tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:26.445189 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ef27e9af-670b-47fe-9443-77aa269664ec tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 200 len: 1374 microversion: 2.1 time: 0.156550 May 28 21:45:26.446112 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3100/6243] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:26 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:45:27.258622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c1e9fc29-415f-4936-9eed-37dca461baa9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:27.258846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-051f50c3-5bdc-4b16-ac34-ab1902577eb8 req-f0a30893-fcf7-42ba-9565-f1a0a44ebcb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fb94843-e803-4c2d-9aed-29fd9c029b08", "tag": "1d6e7e91-497b-4a50-988d-8abdcdbb2014"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:45:27.259386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c1e9fc29-415f-4936-9eed-37dca461baa9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:27.268941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-051f50c3-5bdc-4b16-ac34-ab1902577eb8 req-f0a30893-fcf7-42ba-9565-f1a0a44ebcb5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:27.269344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c1e9fc29-415f-4936-9eed-37dca461baa9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:27.269852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-051f50c3-5bdc-4b16-ac34-ab1902577eb8 req-f0a30893-fcf7-42ba-9565-f1a0a44ebcb5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:27.270031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c1e9fc29-415f-4936-9eed-37dca461baa9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:27.271093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c1e9fc29-415f-4936-9eed-37dca461baa9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:27.271622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c1e9fc29-415f-4936-9eed-37dca461baa9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:27.282265 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-051f50c3-5bdc-4b16-ac34-ab1902577eb8 req-f0a30893-fcf7-42ba-9565-f1a0a44ebcb5 service nova] Creating event network-changed:1d6e7e91-497b-4a50-988d-8abdcdbb2014 for instance 6fb94843-e803-4c2d-9aed-29fd9c029b08 on nch1-master-1 May 28 21:45:27.287601 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-051f50c3-5bdc-4b16-ac34-ab1902577eb8 req-f0a30893-fcf7-42ba-9565-f1a0a44ebcb5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032334 May 28 21:45:27.289487 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3101/6244] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:45:27.307356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c1e9fc29-415f-4936-9eed-37dca461baa9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:45:27.463014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f844b722-fefa-4979-b955-e0afec541a81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:27.464599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f844b722-fefa-4979-b955-e0afec541a81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:27.473215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f844b722-fefa-4979-b955-e0afec541a81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:27.473795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f844b722-fefa-4979-b955-e0afec541a81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:27.474695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f844b722-fefa-4979-b955-e0afec541a81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:27.475487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f844b722-fefa-4979-b955-e0afec541a81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:27.642549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f844b722-fefa-4979-b955-e0afec541a81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:27.650604 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f844b722-fefa-4979-b955-e0afec541a81 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 200 len: 1374 microversion: 2.1 time: 0.192634 May 28 21:45:27.651199 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3102/6245] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:27 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 1374 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:45:27.689306 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c1e9fc29-415f-4936-9eed-37dca461baa9 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 204 len: 0 microversion: 2.1 time: 0.435766 May 28 21:45:27.690279 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3144/6246] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:45:27 2022] DELETE /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:45:27.698693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b5205d63-39cb-4a80-bbef-bf431fffe2d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:27.699336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b5205d63-39cb-4a80-bbef-bf431fffe2d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:27.706627 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5205d63-39cb-4a80-bbef-bf431fffe2d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:27.707100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5205d63-39cb-4a80-bbef-bf431fffe2d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:27.707898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5205d63-39cb-4a80-bbef-bf431fffe2d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:27.708546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5205d63-39cb-4a80-bbef-bf431fffe2d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:27.849230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b5205d63-39cb-4a80-bbef-bf431fffe2d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:27.859082 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b5205d63-39cb-4a80-bbef-bf431fffe2d3 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1578 microversion: 2.1 time: 0.163716 May 28 21:45:27.862314 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3103/6247] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:27 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:45:28.668783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e3c6bf6b-3ccf-4d6a-b910-77c340c086de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:28.670199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e3c6bf6b-3ccf-4d6a-b910-77c340c086de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:28.679507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3c6bf6b-3ccf-4d6a-b910-77c340c086de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:28.680045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3c6bf6b-3ccf-4d6a-b910-77c340c086de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:28.680920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3c6bf6b-3ccf-4d6a-b910-77c340c086de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:28.681431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e3c6bf6b-3ccf-4d6a-b910-77c340c086de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:28.826344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e3c6bf6b-3ccf-4d6a-b910-77c340c086de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:28.834995 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e3c6bf6b-3ccf-4d6a-b910-77c340c086de tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 200 len: 1374 microversion: 2.1 time: 0.170517 May 28 21:45:28.836089 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3145/6248] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:28 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:45:28.876562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c23e0d44-dc41-4fa7-a71c-13977d9361ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:28.877196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c23e0d44-dc41-4fa7-a71c-13977d9361ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:28.884636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c23e0d44-dc41-4fa7-a71c-13977d9361ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:28.885101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c23e0d44-dc41-4fa7-a71c-13977d9361ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:28.885912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c23e0d44-dc41-4fa7-a71c-13977d9361ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:28.886366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c23e0d44-dc41-4fa7-a71c-13977d9361ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:29.025010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c23e0d44-dc41-4fa7-a71c-13977d9361ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:29.032927 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c23e0d44-dc41-4fa7-a71c-13977d9361ce tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1578 microversion: 2.1 time: 0.160346 May 28 21:45:29.033535 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3104/6249] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:28 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:45:29.853079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-90d2ee87-eae7-4063-95b7-43a9eaae1da2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:29.853579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-90d2ee87-eae7-4063-95b7-43a9eaae1da2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:29.861112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90d2ee87-eae7-4063-95b7-43a9eaae1da2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:29.861740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90d2ee87-eae7-4063-95b7-43a9eaae1da2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:29.869450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90d2ee87-eae7-4063-95b7-43a9eaae1da2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:29.869700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2743d889-e7cc-4e0f-b322-78d7dc28d8e7 req-f1f1d78d-caa9-4952-a882-2073ac56f2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fb94843-e803-4c2d-9aed-29fd9c029b08", "name": "network-vif-deleted", "tag": "1d6e7e91-497b-4a50-988d-8abdcdbb2014"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:45:29.876623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-90d2ee87-eae7-4063-95b7-43a9eaae1da2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:29.878543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2743d889-e7cc-4e0f-b322-78d7dc28d8e7 req-f1f1d78d-caa9-4952-a882-2073ac56f2c9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:29.879041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2743d889-e7cc-4e0f-b322-78d7dc28d8e7 req-f1f1d78d-caa9-4952-a882-2073ac56f2c9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:29.891662 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2743d889-e7cc-4e0f-b322-78d7dc28d8e7 req-f1f1d78d-caa9-4952-a882-2073ac56f2c9 service nova] Creating event network-vif-deleted:1d6e7e91-497b-4a50-988d-8abdcdbb2014 for instance 6fb94843-e803-4c2d-9aed-29fd9c029b08 on nch1-master-1 May 28 21:45:29.896749 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2743d889-e7cc-4e0f-b322-78d7dc28d8e7 req-f1f1d78d-caa9-4952-a882-2073ac56f2c9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031061 May 28 21:45:29.897776 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3105/6250] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:45:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:45:30.010675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-90d2ee87-eae7-4063-95b7-43a9eaae1da2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:30.015878 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-90d2ee87-eae7-4063-95b7-43a9eaae1da2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 200 len: 1374 microversion: 2.1 time: 0.167059 May 28 21:45:30.016466 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3146/6251] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:29 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:45:30.050686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1e68f120-78f2-4c27-b19f-b7e744e79fa2 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:30.051373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1e68f120-78f2-4c27-b19f-b7e744e79fa2 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:30.058096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e68f120-78f2-4c27-b19f-b7e744e79fa2 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:30.058565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e68f120-78f2-4c27-b19f-b7e744e79fa2 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:30.059348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e68f120-78f2-4c27-b19f-b7e744e79fa2 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:30.059807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e68f120-78f2-4c27-b19f-b7e744e79fa2 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:30.129865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1e68f120-78f2-4c27-b19f-b7e744e79fa2 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388458a7b3504bd08f3789f53cf9ea35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5833e78f486c4a118608290040b31cfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:30.137907 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1e68f120-78f2-4c27-b19f-b7e744e79fa2 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 200 len: 1226 microversion: 2.1 time: 0.091525 May 28 21:45:30.142692 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3106/6252] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:30 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:45:30.724187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-12bffb47-064a-4ccf-bbc7-c62e23e810ac req-dd52f888-ad44-4f86-8be3-865f5482981f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4265c1-07eb-407e-859b-1e7c3260ada5", "name": "network-vif-plugged", "status": "completed", "tag": "c471432b-570e-4242-a0aa-7071b92822bd"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:45:30.727864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:45:30.733253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-12bffb47-064a-4ccf-bbc7-c62e23e810ac req-dd52f888-ad44-4f86-8be3-865f5482981f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:30.736087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-12bffb47-064a-4ccf-bbc7-c62e23e810ac req-dd52f888-ad44-4f86-8be3-865f5482981f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:30.745338 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-12bffb47-064a-4ccf-bbc7-c62e23e810ac req-dd52f888-ad44-4f86-8be3-865f5482981f service nova] Creating event network-vif-plugged:c471432b-570e-4242-a0aa-7071b92822bd for instance fb4265c1-07eb-407e-859b-1e7c3260ada5 on nch1-master-1 May 28 21:45:30.750394 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-12bffb47-064a-4ccf-bbc7-c62e23e810ac req-dd52f888-ad44-4f86-8be3-865f5482981f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029985 May 28 21:45:30.750967 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3147/6253] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:45:31.033339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-11d462cb-e0a1-4105-93d9-fd7030c773be tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:31.034021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-11d462cb-e0a1-4105-93d9-fd7030c773be tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:31.036054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:45:31.036794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:45:31.042606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11d462cb-e0a1-4105-93d9-fd7030c773be tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:31.043077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11d462cb-e0a1-4105-93d9-fd7030c773be tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:31.043861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11d462cb-e0a1-4105-93d9-fd7030c773be tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:31.044321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-11d462cb-e0a1-4105-93d9-fd7030c773be tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:31.156719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a25f3391-b95f-476b-96f7-99a34d48d510 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:31.157547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a25f3391-b95f-476b-96f7-99a34d48d510 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] [instance: 6fb94843-e803-4c2d-9aed-29fd9c029b08] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:31.165571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a25f3391-b95f-476b-96f7-99a34d48d510 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:31.166144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a25f3391-b95f-476b-96f7-99a34d48d510 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:31.166932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a25f3391-b95f-476b-96f7-99a34d48d510 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:31.167381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a25f3391-b95f-476b-96f7-99a34d48d510 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:31.181456 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-a25f3391-b95f-476b-96f7-99a34d48d510 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] HTTP exception thrown: Instance 6fb94843-e803-4c2d-9aed-29fd9c029b08 could not be found. May 28 21:45:31.184215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-11d462cb-e0a1-4105-93d9-fd7030c773be tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a25f3391-b95f-476b-96f7-99a34d48d510 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Request method failure captured: May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 HTTP/1.1 May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpZj6T8fAUPV0L9vvdx7FjM-mPDbeMcny2vaFgqFap_hhOicDv_aSrneSkPKTuy8G7aOJ8u-6aN6vtjm8OAlWN3Sh2BNpOvEzUNMkpGCfAsXWUG9AhKKLTChCVZAHzz9iHirDXgMjQoShyXSLMnsx_u72mL9Gv37fsMmCKprrAlJHzI May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5833e78f486c4a118608290040b31cfc May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5833e78f486c4a118608290040b31cfc", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5833e78f486c4a118608290040b31cfc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5833e78f486c4a118608290040b31cfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestVolumeBootPattern-1994669512 May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5833e78f486c4a118608290040b31cfc May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestVolumeBootPattern-1994669512 May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestVolumeBootPattern-1994669512-project May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 388458a7b3504bd08f3789f53cf9ea35 May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestVolumeBootPattern-1994669512-project May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 6fb94843-e803-4c2d-9aed-29fd9c029b08 could not be found. May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '6fb94843-e803-4c2d-9aed-29fd9c029b08'} May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fb94843-e803-4c2d-9aed-29fd9c029b08 could not be found. May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fb94843-e803-4c2d-9aed-29fd9c029b08 could not be found. May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:45:31.185037 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:45:31.191755 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:45:31.191755 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:45:31.191755 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:45:31.191755 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:45:31.191755 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:45:31.191755 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fb94843-e803-4c2d-9aed-29fd9c029b08 could not be found. May 28 21:45:31.191755 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:45:31.191755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a25f3391-b95f-476b-96f7-99a34d48d510 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Returning 404 to user: Instance 6fb94843-e803-4c2d-9aed-29fd9c029b08 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:45:31.191755 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a25f3391-b95f-476b-96f7-99a34d48d510 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08" status: 404 len: 111 microversion: 2.1 time: 0.032823 May 28 21:45:31.191755 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3148/6254] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:31 2022] GET /compute/v2.1/servers/6fb94843-e803-4c2d-9aed-29fd9c029b08 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:45:31.193289 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-11d462cb-e0a1-4105-93d9-fd7030c773be tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 200 len: 1374 microversion: 2.1 time: 0.163946 May 28 21:45:31.202294 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3107/6255] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:31 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:45:32.209865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8785b54a-fd54-4130-9cf2-028d2282b092 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:32.210500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8785b54a-fd54-4130-9cf2-028d2282b092 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:32.217716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8785b54a-fd54-4130-9cf2-028d2282b092 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:32.218202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8785b54a-fd54-4130-9cf2-028d2282b092 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:32.218968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8785b54a-fd54-4130-9cf2-028d2282b092 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:32.219912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8785b54a-fd54-4130-9cf2-028d2282b092 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:32.352329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8785b54a-fd54-4130-9cf2-028d2282b092 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:32.360625 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8785b54a-fd54-4130-9cf2-028d2282b092 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 200 len: 1546 microversion: 2.1 time: 0.154169 May 28 21:45:32.361193 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3149/6256] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:32 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:45:32.376502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e5da165b-5a1b-4509-b5bb-4f020fc6cb85 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:32.377159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e5da165b-5a1b-4509-b5bb-4f020fc6cb85 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:32.384294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5da165b-5a1b-4509-b5bb-4f020fc6cb85 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:32.384764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5da165b-5a1b-4509-b5bb-4f020fc6cb85 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:32.385554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5da165b-5a1b-4509-b5bb-4f020fc6cb85 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:32.386056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e5da165b-5a1b-4509-b5bb-4f020fc6cb85 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:32.523079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e5da165b-5a1b-4509-b5bb-4f020fc6cb85 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:32.530811 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e5da165b-5a1b-4509-b5bb-4f020fc6cb85 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 200 len: 1546 microversion: 2.1 time: 0.158195 May 28 21:45:32.531416 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3108/6257] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:32 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:45:36.858714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d2c5e13f-b7b5-4be5-adf9-5b20af609262 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] Calling method '.version_select at 0x7f4d6416e9d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:36.924235 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d2c5e13f-b7b5-4be5-adf9-5b20af609262 tempest-TestVolumeBootPattern-1994669512 tempest-TestVolumeBootPattern-1994669512-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1455929180" status: 202 len: 0 microversion: 2.1 time: 0.069390 May 28 21:45:36.924839 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3150/6258] 10.222.0.33 () {58 vars in 1262 bytes} [Sat May 28 21:45:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1455929180 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:45:58.041798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c62b3302-e452-42fa-8ea2-2953bf3e8316 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:58.042296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c62b3302-e452-42fa-8ea2-2953bf3e8316 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:58.044604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:45:58.045312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=66 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:45:58.050806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c62b3302-e452-42fa-8ea2-2953bf3e8316 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:58.051284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c62b3302-e452-42fa-8ea2-2953bf3e8316 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:58.052080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c62b3302-e452-42fa-8ea2-2953bf3e8316 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:58.052540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c62b3302-e452-42fa-8ea2-2953bf3e8316 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:58.080234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c62b3302-e452-42fa-8ea2-2953bf3e8316 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:45:58.366545 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c62b3302-e452-42fa-8ea2-2953bf3e8316 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 204 len: 0 microversion: 2.1 time: 0.328892 May 28 21:45:58.367149 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3109/6259] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:45:58 2022] DELETE /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:45:58.373664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:45:58.374678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:45:58.378767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3b450a2d-4df5-4257-b349-3d1195a77cfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:58.379389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3b450a2d-4df5-4257-b349-3d1195a77cfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:58.386089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b450a2d-4df5-4257-b349-3d1195a77cfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:58.386545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b450a2d-4df5-4257-b349-3d1195a77cfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:58.387515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b450a2d-4df5-4257-b349-3d1195a77cfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:58.387974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3b450a2d-4df5-4257-b349-3d1195a77cfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:58.521250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3b450a2d-4df5-4257-b349-3d1195a77cfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:58.529072 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3b450a2d-4df5-4257-b349-3d1195a77cfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 200 len: 1552 microversion: 2.1 time: 0.157475 May 28 21:45:58.529772 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3151/6260] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:58 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:45:59.547839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-359afe85-31c4-4111-918a-3f43974b80ed tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:45:59.549062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-359afe85-31c4-4111-918a-3f43974b80ed tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:45:59.556119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-359afe85-31c4-4111-918a-3f43974b80ed tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:59.556649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-359afe85-31c4-4111-918a-3f43974b80ed tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:59.557520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-359afe85-31c4-4111-918a-3f43974b80ed tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:45:59.558060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-359afe85-31c4-4111-918a-3f43974b80ed tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:45:59.693413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-359afe85-31c4-4111-918a-3f43974b80ed tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:45:59.701459 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-359afe85-31c4-4111-918a-3f43974b80ed tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 200 len: 1552 microversion: 2.1 time: 0.157928 May 28 21:45:59.702084 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3110/6261] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:45:59 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:46:00.267681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-2be59170-a763-4581-8b14-8dc1c20edcc7 req-d61fdf22-836a-4cc0-8059-2494f21ae3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4265c1-07eb-407e-859b-1e7c3260ada5", "name": "network-vif-deleted", "tag": "c471432b-570e-4242-a0aa-7071b92822bd"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:46:00.277897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2be59170-a763-4581-8b14-8dc1c20edcc7 req-d61fdf22-836a-4cc0-8059-2494f21ae3e7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:00.278402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2be59170-a763-4581-8b14-8dc1c20edcc7 req-d61fdf22-836a-4cc0-8059-2494f21ae3e7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:00.290458 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-2be59170-a763-4581-8b14-8dc1c20edcc7 req-d61fdf22-836a-4cc0-8059-2494f21ae3e7 service nova] Creating event network-vif-deleted:c471432b-570e-4242-a0aa-7071b92822bd for instance fb4265c1-07eb-407e-859b-1e7c3260ada5 on nch1-master-1 May 28 21:46:00.295475 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-2be59170-a763-4581-8b14-8dc1c20edcc7 req-d61fdf22-836a-4cc0-8059-2494f21ae3e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032054 May 28 21:46:00.297707 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3152/6262] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:46:00.718187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c612b202-f5f3-4190-920f-f9d9b454e0fc tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:00.718823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c612b202-f5f3-4190-920f-f9d9b454e0fc tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:00.725830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c612b202-f5f3-4190-920f-f9d9b454e0fc tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:00.726329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c612b202-f5f3-4190-920f-f9d9b454e0fc tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:00.727107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c612b202-f5f3-4190-920f-f9d9b454e0fc tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:00.727560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c612b202-f5f3-4190-920f-f9d9b454e0fc tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:00.757828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c612b202-f5f3-4190-920f-f9d9b454e0fc tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:00.758320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c612b202-f5f3-4190-920f-f9d9b454e0fc tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:00.758780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-c612b202-f5f3-4190-920f-f9d9b454e0fc tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lazy-loading 'fault' on Instance uuid fb4265c1-07eb-407e-859b-1e7c3260ada5 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:46:00.803508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c612b202-f5f3-4190-920f-f9d9b454e0fc tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:46:00.811010 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c612b202-f5f3-4190-920f-f9d9b454e0fc tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 200 len: 1339 microversion: 2.1 time: 0.096864 May 28 21:46:00.811599 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3111/6263] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:00 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:46:01.830272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d6873ba0-f69a-4c75-9ee0-01ee0a161dc3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:01.830990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d6873ba0-f69a-4c75-9ee0-01ee0a161dc3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: fb4265c1-07eb-407e-859b-1e7c3260ada5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:01.837774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6873ba0-f69a-4c75-9ee0-01ee0a161dc3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:01.838262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6873ba0-f69a-4c75-9ee0-01ee0a161dc3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:01.839034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6873ba0-f69a-4c75-9ee0-01ee0a161dc3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:01.839511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6873ba0-f69a-4c75-9ee0-01ee0a161dc3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:01.853559 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-d6873ba0-f69a-4c75-9ee0-01ee0a161dc3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] HTTP exception thrown: Instance fb4265c1-07eb-407e-859b-1e7c3260ada5 could not be found. May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d6873ba0-f69a-4c75-9ee0-01ee0a161dc3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Request method failure captured: May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 HTTP/1.1 May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpetix5UG8FhnAED17LhFgl2UpkOnIjgG6KP48lkgkV0fOQ9jTnc5cGF1CYKdZJRZ4b5SSRZOlekX0dfr01CbQ3xFk6fDTTj-Vpqo4_MhSrzUPl8rKBU82oF69BogLqakdM7zjV2qnSpVZb98TqIQrc4E0cxTZUxUp8QEd1prspRgBs May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: d7ae678d8e60475bb9b35abcb027a02d May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestNetworkBasicOps-477684878 May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7ae678d8e60475bb9b35abcb027a02d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ae678d8e60475bb9b35abcb027a02d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7ae678d8e60475bb9b35abcb027a02d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ae678d8e60475bb9b35abcb027a02d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestNetworkBasicOps-477684878 May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: d7ae678d8e60475bb9b35abcb027a02d May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestNetworkBasicOps-477684878 May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestNetworkBasicOps-477684878-project May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 854bc76149074ec5a4ba92bd42ae6a32 May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestNetworkBasicOps-477684878-project May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance fb4265c1-07eb-407e-859b-1e7c3260ada5 could not be found. May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'fb4265c1-07eb-407e-859b-1e7c3260ada5'} May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb4265c1-07eb-407e-859b-1e7c3260ada5 could not be found. May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4265c1-07eb-407e-859b-1e7c3260ada5 could not be found. May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:46:01.855321 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:46:01.861108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:46:01.861108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:46:01.861108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:46:01.861108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:46:01.861108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:46:01.861108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4265c1-07eb-407e-859b-1e7c3260ada5 could not be found. May 28 21:46:01.861108 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:46:01.861108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d6873ba0-f69a-4c75-9ee0-01ee0a161dc3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Returning 404 to user: Instance fb4265c1-07eb-407e-859b-1e7c3260ada5 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:46:01.861108 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d6873ba0-f69a-4c75-9ee0-01ee0a161dc3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5" status: 404 len: 111 microversion: 2.1 time: 0.032535 May 28 21:46:01.861108 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3153/6264] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:01 2022] GET /compute/v2.1/servers/fb4265c1-07eb-407e-859b-1e7c3260ada5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:46:02.075745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-17a17f8d-909b-4ee2-9bba-92f14636f042 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '.version_select at 0x7f4d56bbf310>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:02.172570 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-17a17f8d-909b-4ee2-9bba-92f14636f042 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1475186095" status: 202 len: 0 microversion: 2.1 time: 0.100559 May 28 21:46:02.173163 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3112/6265] 10.222.0.33 () {58 vars in 1256 bytes} [Sat May 28 21:46:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1475186095 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:46:04.096552 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3436ba2e-d0b5-4aa9-9c0d-1917c2434dd4 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:04.102041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3436ba2e-d0b5-4aa9-9c0d-1917c2434dd4 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:04.102193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a0e294ed-8a91-41e9-adcc-5e49adebfea3 req-e3d3356e-4be4-4656-b8f7-3b1dd1af9591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "864d2c73-7076-4086-978a-b103487013b7", "tag": "22ee83fa-1b1b-4e18-b6e6-9c7878e0df14"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:46:04.106613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3436ba2e-d0b5-4aa9-9c0d-1917c2434dd4 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:04.106826 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a0e294ed-8a91-41e9-adcc-5e49adebfea3 req-e3d3356e-4be4-4656-b8f7-3b1dd1af9591 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:04.107222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3436ba2e-d0b5-4aa9-9c0d-1917c2434dd4 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:04.107497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a0e294ed-8a91-41e9-adcc-5e49adebfea3 req-e3d3356e-4be4-4656-b8f7-3b1dd1af9591 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:04.108026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3436ba2e-d0b5-4aa9-9c0d-1917c2434dd4 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:04.108473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3436ba2e-d0b5-4aa9-9c0d-1917c2434dd4 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:04.119310 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a0e294ed-8a91-41e9-adcc-5e49adebfea3 req-e3d3356e-4be4-4656-b8f7-3b1dd1af9591 service nova] Creating event network-changed:22ee83fa-1b1b-4e18-b6e6-9c7878e0df14 for instance 864d2c73-7076-4086-978a-b103487013b7 on nch2-master-1 May 28 21:46:04.124449 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a0e294ed-8a91-41e9-adcc-5e49adebfea3 req-e3d3356e-4be4-4656-b8f7-3b1dd1af9591 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031332 May 28 21:46:04.126172 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3113/6266] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:46:04.138271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3436ba2e-d0b5-4aa9-9c0d-1917c2434dd4 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:46:04.414478 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3436ba2e-d0b5-4aa9-9c0d-1917c2434dd4 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "DELETE /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 204 len: 0 microversion: 2.1 time: 0.324012 May 28 21:46:04.415576 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3154/6267] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:46:04 2022] DELETE /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:46:04.426666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9ada0f8c-a88e-4532-86bf-5f8b026fac54 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:04.427418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9ada0f8c-a88e-4532-86bf-5f8b026fac54 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:04.434586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ada0f8c-a88e-4532-86bf-5f8b026fac54 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:04.435061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ada0f8c-a88e-4532-86bf-5f8b026fac54 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:04.436008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ada0f8c-a88e-4532-86bf-5f8b026fac54 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:04.436474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ada0f8c-a88e-4532-86bf-5f8b026fac54 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:04.613623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9ada0f8c-a88e-4532-86bf-5f8b026fac54 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:46:04.621233 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9ada0f8c-a88e-4532-86bf-5f8b026fac54 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 200 len: 1671 microversion: 2.1 time: 0.200602 May 28 21:46:04.621811 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3114/6268] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:04 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 1671 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:46:05.639396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fca66b72-2683-41ae-b927-618769101820 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:05.640114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fca66b72-2683-41ae-b927-618769101820 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:05.647305 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fca66b72-2683-41ae-b927-618769101820 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:05.647802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fca66b72-2683-41ae-b927-618769101820 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:05.648586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fca66b72-2683-41ae-b927-618769101820 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:05.649034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fca66b72-2683-41ae-b927-618769101820 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:05.872614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fca66b72-2683-41ae-b927-618769101820 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:46:05.880316 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fca66b72-2683-41ae-b927-618769101820 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 200 len: 1552 microversion: 2.1 time: 0.245385 May 28 21:46:05.880911 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3155/6269] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:05 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 1552 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:46:06.305401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-0c69fdd7-42a7-4c7b-afe1-aae0a6424513 req-3e2ffd82-3c05-4caf-8535-66c662f9bfdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "864d2c73-7076-4086-978a-b103487013b7", "name": "network-vif-deleted", "tag": "22ee83fa-1b1b-4e18-b6e6-9c7878e0df14"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:46:06.314403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0c69fdd7-42a7-4c7b-afe1-aae0a6424513 req-3e2ffd82-3c05-4caf-8535-66c662f9bfdf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:06.314804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-0c69fdd7-42a7-4c7b-afe1-aae0a6424513 req-3e2ffd82-3c05-4caf-8535-66c662f9bfdf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:06.325666 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-0c69fdd7-42a7-4c7b-afe1-aae0a6424513 req-3e2ffd82-3c05-4caf-8535-66c662f9bfdf service nova] Creating event network-vif-deleted:22ee83fa-1b1b-4e18-b6e6-9c7878e0df14 for instance 864d2c73-7076-4086-978a-b103487013b7 on nch2-master-1 May 28 21:46:06.331286 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-0c69fdd7-42a7-4c7b-afe1-aae0a6424513 req-3e2ffd82-3c05-4caf-8535-66c662f9bfdf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029774 May 28 21:46:06.331871 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3115/6270] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:46:06.897790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-762f2cfb-57c7-43e6-ac1d-e15f8c3111cd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:06.900891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-762f2cfb-57c7-43e6-ac1d-e15f8c3111cd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:06.905538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-762f2cfb-57c7-43e6-ac1d-e15f8c3111cd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:06.906044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-762f2cfb-57c7-43e6-ac1d-e15f8c3111cd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:06.906870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-762f2cfb-57c7-43e6-ac1d-e15f8c3111cd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:06.907320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-762f2cfb-57c7-43e6-ac1d-e15f8c3111cd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:06.939680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-762f2cfb-57c7-43e6-ac1d-e15f8c3111cd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:06.940141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-762f2cfb-57c7-43e6-ac1d-e15f8c3111cd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:06.940634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-762f2cfb-57c7-43e6-ac1d-e15f8c3111cd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lazy-loading 'fault' on Instance uuid 864d2c73-7076-4086-978a-b103487013b7 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:46:06.981132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-762f2cfb-57c7-43e6-ac1d-e15f8c3111cd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:46:06.989685 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-762f2cfb-57c7-43e6-ac1d-e15f8c3111cd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 200 len: 1338 microversion: 2.1 time: 0.095875 May 28 21:46:06.990313 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3156/6271] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:06 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 1338 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:46:08.007528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-686699f8-1538-4eca-9bcc-c6193267750a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-686699f8-1538-4eca-9bcc-c6193267750a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 864d2c73-7076-4086-978a-b103487013b7] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-686699f8-1538-4eca-9bcc-c6193267750a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-686699f8-1538-4eca-9bcc-c6193267750a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-686699f8-1538-4eca-9bcc-c6193267750a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-686699f8-1538-4eca-9bcc-c6193267750a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-686699f8-1538-4eca-9bcc-c6193267750a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] HTTP exception thrown: Instance 864d2c73-7076-4086-978a-b103487013b7 could not be found. May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-686699f8-1538-4eca-9bcc-c6193267750a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Request method failure captured: May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 HTTP/1.1 May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpetix5UG8FhnAED17LhFgl2UpkOnIjgG6KP48lkgkV0fOQ9jTnc5cGF1CYKdZJRZ4b5SSRZOlekX0dfr01CbQ3xFk6fDTTj-Vpqo4_MhSrzUPl8rKBU82oF69BogLqakdM7zjV2qnSpVZb98TqIQrc4E0cxTZUxUp8QEd1prspRgBs May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: d7ae678d8e60475bb9b35abcb027a02d May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestNetworkBasicOps-477684878 May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7ae678d8e60475bb9b35abcb027a02d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ae678d8e60475bb9b35abcb027a02d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7ae678d8e60475bb9b35abcb027a02d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ae678d8e60475bb9b35abcb027a02d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestNetworkBasicOps-477684878 May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: d7ae678d8e60475bb9b35abcb027a02d May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestNetworkBasicOps-477684878 May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestNetworkBasicOps-477684878-project May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 854bc76149074ec5a4ba92bd42ae6a32 May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestNetworkBasicOps-477684878-project May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 864d2c73-7076-4086-978a-b103487013b7 could not be found. May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '864d2c73-7076-4086-978a-b103487013b7'} May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:46:08.140709 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 864d2c73-7076-4086-978a-b103487013b7 could not be found. May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 864d2c73-7076-4086-978a-b103487013b7 could not be found. May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 864d2c73-7076-4086-978a-b103487013b7 could not be found. May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-686699f8-1538-4eca-9bcc-c6193267750a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Returning 404 to user: Instance 864d2c73-7076-4086-978a-b103487013b7 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-686699f8-1538-4eca-9bcc-c6193267750a tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7" status: 404 len: 111 microversion: 2.1 time: 0.037377 May 28 21:46:08.146143 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3116/6272] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:08 2022] GET /compute/v2.1/servers/864d2c73-7076-4086-978a-b103487013b7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:46:08.276102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f5e25b02-e84b-4cdf-8e6a-d4ea6b05721f tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '.version_select at 0x7f4d69cca1f0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:08.351494 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f5e25b02-e84b-4cdf-8e6a-d4ea6b05721f tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-100900842" status: 202 len: 0 microversion: 2.1 time: 0.079350 May 28 21:46:08.352100 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3157/6273] 10.222.0.33 () {58 vars in 1253 bytes} [Sat May 28 21:46:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-100900842 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:46:13.668765 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 21:46:13.668765 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 21:46:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 21:46:18.080463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-343d7774-635f-4f6d-af20-b2f0205431be tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Action: 'create', calling method: .version_select at 0x7f4d573dc940>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-509774037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH7sAgtUNMAXjMGvl7u5M4OJF9fV1xAuGETSHGonkCAAnwhRXcQ7eYJKibREGVloJCgPnjNkKduzJNvgkVEimiLdiunLGzr60kNVwkGNPzuzLE8qka+5jCjwSVnaHq59Ng=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:46:18.088334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:46:18.089252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:46:18.100044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-343d7774-635f-4f6d-af20-b2f0205431be tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Getting quotas for project d7ae678d8e60475bb9b35abcb027a02d. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:46:18.105448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-343d7774-635f-4f6d-af20-b2f0205431be tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Getting quotas for user 854bc76149074ec5a4ba92bd42ae6a32 and project d7ae678d8e60475bb9b35abcb027a02d. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:46:18.195974 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-343d7774-635f-4f6d-af20-b2f0205431be tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.121440 May 28 21:46:18.196589 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3117/6274] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:46:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:46:20.785069 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:46:20.785896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:46:20.790724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-757993220", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "5b4fc601-6d9b-4594-96b4-14162570af1c"}], "key_name": "tempest-TestNetworkBasicOps-509774037", "security_groups": [{"name": "tempest-secgroup-smoke-595649407"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:46:20.902792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] validate_networks() for [('5b4fc601-6d9b-4594-96b4-14162570af1c', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:46:21.704382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:46:21.704843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:46:21.705325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:46:21.705744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:46:21.706200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:46:21.715466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:21.715924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:21.716734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:21.717177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:21.735195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Getting quotas for project d7ae678d8e60475bb9b35abcb027a02d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:46:21.741314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Getting quotas for user 854bc76149074ec5a4ba92bd42ae6a32 and project d7ae678d8e60475bb9b35abcb027a02d. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:46:21.754260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:46:21.756553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:46:21.923589 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-74bcf1ee-7af4-4019-bbb6-ef61f527fbfd tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.140150 May 28 21:46:21.924986 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3158/6275] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:46:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:46:21.935137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5955e2a8-fd77-44bf-abd5-38b3f78c49d1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:21.935773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5955e2a8-fd77-44bf-abd5-38b3f78c49d1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:21.997622 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5955e2a8-fd77-44bf-abd5-38b3f78c49d1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:46:22.003245 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5955e2a8-fd77-44bf-abd5-38b3f78c49d1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 200 len: 1247 microversion: 2.1 time: 0.073021 May 28 21:46:22.004143 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3118/6276] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:21 2022] GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 1247 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:46:23.022109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c668963e-ef16-4538-8413-e7549699226c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:23.022742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c668963e-ef16-4538-8413-e7549699226c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:23.029731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c668963e-ef16-4538-8413-e7549699226c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:23.030218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c668963e-ef16-4538-8413-e7549699226c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:23.030995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c668963e-ef16-4538-8413-e7549699226c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:23.031438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c668963e-ef16-4538-8413-e7549699226c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:23.093242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c668963e-ef16-4538-8413-e7549699226c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:46:23.100899 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c668963e-ef16-4538-8413-e7549699226c tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 200 len: 1251 microversion: 2.1 time: 0.084474 May 28 21:46:23.101466 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3159/6277] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:23 2022] GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 1251 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:46:24.117985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b43e1cd8-3daf-4563-a38f-94018b593f29 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:24.118619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b43e1cd8-3daf-4563-a38f-94018b593f29 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:24.126835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b43e1cd8-3daf-4563-a38f-94018b593f29 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:24.127243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b43e1cd8-3daf-4563-a38f-94018b593f29 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:24.128020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b43e1cd8-3daf-4563-a38f-94018b593f29 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:24.128473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b43e1cd8-3daf-4563-a38f-94018b593f29 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:24.190091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b43e1cd8-3daf-4563-a38f-94018b593f29 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:46:24.197704 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b43e1cd8-3daf-4563-a38f-94018b593f29 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 200 len: 1317 microversion: 2.1 time: 0.084061 May 28 21:46:24.198399 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3119/6278] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:24 2022] GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 1317 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:46:25.216750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5536fe75-6b46-4674-a075-17e27d7c479e tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:25.217385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5536fe75-6b46-4674-a075-17e27d7c479e tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:25.225172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5536fe75-6b46-4674-a075-17e27d7c479e tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:25.225635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5536fe75-6b46-4674-a075-17e27d7c479e tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:25.226434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5536fe75-6b46-4674-a075-17e27d7c479e tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:25.226880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5536fe75-6b46-4674-a075-17e27d7c479e tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:25.363798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5536fe75-6b46-4674-a075-17e27d7c479e tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:46:25.372003 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5536fe75-6b46-4674-a075-17e27d7c479e tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 200 len: 1372 microversion: 2.1 time: 0.159869 May 28 21:46:25.372725 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3160/6279] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:25 2022] GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:46:25.640537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-8ab90055-f313-400f-8a1c-0e6ef29a7c60 req-b284c869-3a9e-4988-b1b2-71e30b0b5058 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7aed71-59d4-4915-98d4-4db9bf26cb4b", "tag": "06b689cf-6b82-4fbf-8073-311da1266e64"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:46:25.653368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8ab90055-f313-400f-8a1c-0e6ef29a7c60 req-b284c869-3a9e-4988-b1b2-71e30b0b5058 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:25.653861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8ab90055-f313-400f-8a1c-0e6ef29a7c60 req-b284c869-3a9e-4988-b1b2-71e30b0b5058 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:25.666360 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-8ab90055-f313-400f-8a1c-0e6ef29a7c60 req-b284c869-3a9e-4988-b1b2-71e30b0b5058 service nova] Creating event network-changed:06b689cf-6b82-4fbf-8073-311da1266e64 for instance 8c7aed71-59d4-4915-98d4-4db9bf26cb4b on nch1-master-1 May 28 21:46:25.674136 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-8ab90055-f313-400f-8a1c-0e6ef29a7c60 req-b284c869-3a9e-4988-b1b2-71e30b0b5058 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037579 May 28 21:46:25.674759 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3120/6280] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:46:26.390261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-29151d32-f0dd-4210-b2b0-c65d6760e741 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:26.390885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-29151d32-f0dd-4210-b2b0-c65d6760e741 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:26.397607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29151d32-f0dd-4210-b2b0-c65d6760e741 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:26.398031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29151d32-f0dd-4210-b2b0-c65d6760e741 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:26.398809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29151d32-f0dd-4210-b2b0-c65d6760e741 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:26.399254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-29151d32-f0dd-4210-b2b0-c65d6760e741 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:26.529766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-29151d32-f0dd-4210-b2b0-c65d6760e741 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:46:26.538145 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-29151d32-f0dd-4210-b2b0-c65d6760e741 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 200 len: 1372 microversion: 2.1 time: 0.152033 May 28 21:46:26.538737 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3161/6281] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:26 2022] GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:46:27.556667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d1aa4a75-f4f7-49f8-959c-28f9f39d03f5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:27.557380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d1aa4a75-f4f7-49f8-959c-28f9f39d03f5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:27.563695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d1aa4a75-f4f7-49f8-959c-28f9f39d03f5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:27.564164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d1aa4a75-f4f7-49f8-959c-28f9f39d03f5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:27.564931 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d1aa4a75-f4f7-49f8-959c-28f9f39d03f5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:27.565383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d1aa4a75-f4f7-49f8-959c-28f9f39d03f5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:27.697144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d1aa4a75-f4f7-49f8-959c-28f9f39d03f5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:46:27.705203 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d1aa4a75-f4f7-49f8-959c-28f9f39d03f5 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 200 len: 1372 microversion: 2.1 time: 0.153697 May 28 21:46:27.705791 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3121/6282] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:27 2022] GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:46:28.723615 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8e66ad61-9601-40c9-9e49-3b5c1b993925 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:28.724247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8e66ad61-9601-40c9-9e49-3b5c1b993925 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:28.731951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e66ad61-9601-40c9-9e49-3b5c1b993925 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:28.732420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e66ad61-9601-40c9-9e49-3b5c1b993925 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:28.733209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e66ad61-9601-40c9-9e49-3b5c1b993925 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:28.733663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e66ad61-9601-40c9-9e49-3b5c1b993925 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:28.875486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8e66ad61-9601-40c9-9e49-3b5c1b993925 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:46:28.884205 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8e66ad61-9601-40c9-9e49-3b5c1b993925 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 200 len: 1372 microversion: 2.1 time: 0.164809 May 28 21:46:28.884786 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3162/6283] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:28 2022] GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:46:29.900612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-765dbbd6-ef2b-4c71-8f5e-5a6473da14f0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:29.901171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-765dbbd6-ef2b-4c71-8f5e-5a6473da14f0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:29.908358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-765dbbd6-ef2b-4c71-8f5e-5a6473da14f0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:29.908828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-765dbbd6-ef2b-4c71-8f5e-5a6473da14f0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:29.909606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-765dbbd6-ef2b-4c71-8f5e-5a6473da14f0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:29.910630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-765dbbd6-ef2b-4c71-8f5e-5a6473da14f0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:30.039956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-765dbbd6-ef2b-4c71-8f5e-5a6473da14f0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:46:30.047670 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-765dbbd6-ef2b-4c71-8f5e-5a6473da14f0 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 200 len: 1372 microversion: 2.1 time: 0.151083 May 28 21:46:30.048244 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3122/6284] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:29 2022] GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:46:30.958218 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-3ea1d2d8-7ad7-4ddb-b366-3bb9f8479755 req-50a55b6b-aadd-46a1-98bc-47ef05c7e80a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7aed71-59d4-4915-98d4-4db9bf26cb4b", "name": "network-vif-plugged", "status": "completed", "tag": "06b689cf-6b82-4fbf-8073-311da1266e64"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:46:30.972501 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3ea1d2d8-7ad7-4ddb-b366-3bb9f8479755 req-50a55b6b-aadd-46a1-98bc-47ef05c7e80a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:30.973036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3ea1d2d8-7ad7-4ddb-b366-3bb9f8479755 req-50a55b6b-aadd-46a1-98bc-47ef05c7e80a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:30.985791 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-3ea1d2d8-7ad7-4ddb-b366-3bb9f8479755 req-50a55b6b-aadd-46a1-98bc-47ef05c7e80a service nova] Creating event network-vif-plugged:06b689cf-6b82-4fbf-8073-311da1266e64 for instance 8c7aed71-59d4-4915-98d4-4db9bf26cb4b on nch1-master-1 May 28 21:46:30.992183 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-3ea1d2d8-7ad7-4ddb-b366-3bb9f8479755 req-50a55b6b-aadd-46a1-98bc-47ef05c7e80a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038004 May 28 21:46:30.992775 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3163/6285] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:46:31.064848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-21002393-9c3e-4885-ae35-a9c893c61fa3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:31.065496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-21002393-9c3e-4885-ae35-a9c893c61fa3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:31.073664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21002393-9c3e-4885-ae35-a9c893c61fa3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:31.074181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21002393-9c3e-4885-ae35-a9c893c61fa3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:31.075250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21002393-9c3e-4885-ae35-a9c893c61fa3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:31.075655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21002393-9c3e-4885-ae35-a9c893c61fa3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:31.217804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-21002393-9c3e-4885-ae35-a9c893c61fa3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:46:31.226028 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-21002393-9c3e-4885-ae35-a9c893c61fa3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 200 len: 1372 microversion: 2.1 time: 0.165337 May 28 21:46:31.228531 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3123/6286] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:31 2022] GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:46:32.243284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-96b14590-fcb4-4016-a813-ba74b3ca0f56 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:32.243995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-96b14590-fcb4-4016-a813-ba74b3ca0f56 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:32.248080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:46:32.248752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:46:32.254711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-96b14590-fcb4-4016-a813-ba74b3ca0f56 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:32.255172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-96b14590-fcb4-4016-a813-ba74b3ca0f56 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:32.255990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-96b14590-fcb4-4016-a813-ba74b3ca0f56 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:32.256433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-96b14590-fcb4-4016-a813-ba74b3ca0f56 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:32.390195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-96b14590-fcb4-4016-a813-ba74b3ca0f56 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:46:32.397954 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-96b14590-fcb4-4016-a813-ba74b3ca0f56 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 200 len: 1542 microversion: 2.1 time: 0.158959 May 28 21:46:32.398551 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3164/6287] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:32 2022] GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 1542 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:46:32.413865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1bb30d73-b3a2-48a9-b49f-d7a076f9c217 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:46:32.414638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1bb30d73-b3a2-48a9-b49f-d7a076f9c217 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:32.416625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:46:32.422564 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1bb30d73-b3a2-48a9-b49f-d7a076f9c217 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:32.423022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1bb30d73-b3a2-48a9-b49f-d7a076f9c217 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:32.423793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1bb30d73-b3a2-48a9-b49f-d7a076f9c217 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:32.424244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1bb30d73-b3a2-48a9-b49f-d7a076f9c217 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:32.559074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1bb30d73-b3a2-48a9-b49f-d7a076f9c217 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:46:32.567443 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1bb30d73-b3a2-48a9-b49f-d7a076f9c217 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 200 len: 1542 microversion: 2.1 time: 0.157511 May 28 21:46:32.571373 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3124/6288] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:46:32 2022] GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 1542 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:46:34.432702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-21bfd368-3796-4a68-8352-784f12cbd625 req-ff19cce0-cd30-40e9-98b5-24c243f1d695 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7aed71-59d4-4915-98d4-4db9bf26cb4b", "tag": "06b689cf-6b82-4fbf-8073-311da1266e64"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:46:34.441981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-21bfd368-3796-4a68-8352-784f12cbd625 req-ff19cce0-cd30-40e9-98b5-24c243f1d695 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:34.442489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-21bfd368-3796-4a68-8352-784f12cbd625 req-ff19cce0-cd30-40e9-98b5-24c243f1d695 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:34.454177 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-21bfd368-3796-4a68-8352-784f12cbd625 req-ff19cce0-cd30-40e9-98b5-24c243f1d695 service nova] Creating event network-changed:06b689cf-6b82-4fbf-8073-311da1266e64 for instance 8c7aed71-59d4-4915-98d4-4db9bf26cb4b on nch1-master-1 May 28 21:46:34.459236 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-21bfd368-3796-4a68-8352-784f12cbd625 req-ff19cce0-cd30-40e9-98b5-24c243f1d695 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030659 May 28 21:46:34.459902 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3165/6289] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:46:56.716041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fea9410e-66a9-4815-9e34-ca8921fa82f2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:46:56.717021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fea9410e-66a9-4815-9e34-ca8921fa82f2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:46:56.719220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:46:56.720463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=32 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:46:56.724723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fea9410e-66a9-4815-9e34-ca8921fa82f2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:56.725185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fea9410e-66a9-4815-9e34-ca8921fa82f2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:56.725988 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fea9410e-66a9-4815-9e34-ca8921fa82f2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:46:56.726441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fea9410e-66a9-4815-9e34-ca8921fa82f2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:46:56.774947 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fea9410e-66a9-4815-9e34-ca8921fa82f2 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "POST /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b/action" status: 200 len: 24570 microversion: 2.1 time: 0.062846 May 28 21:46:56.775591 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3125/6290] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:46:56 2022] POST /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b/action => generated 24570 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:47:07.928325 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:47:07.929078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=36 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:47:07.933324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-11ecf4d8-e8b7-407d-84d7-0e9a62e726b1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:47:07.934384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-11ecf4d8-e8b7-407d-84d7-0e9a62e726b1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:07.941153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11ecf4d8-e8b7-407d-84d7-0e9a62e726b1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:07.941610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11ecf4d8-e8b7-407d-84d7-0e9a62e726b1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:07.942407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11ecf4d8-e8b7-407d-84d7-0e9a62e726b1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:07.942849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-11ecf4d8-e8b7-407d-84d7-0e9a62e726b1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:07.991293 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-11ecf4d8-e8b7-407d-84d7-0e9a62e726b1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "POST /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b/action" status: 200 len: 32649 microversion: 2.1 time: 0.064767 May 28 21:47:07.992030 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3166/6291] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:47:07 2022] POST /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b/action => generated 32649 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 21:47:09.136686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-78b9486a-f7f6-4aa7-ab7c-4590b75faae1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:09.137363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-78b9486a-f7f6-4aa7-ab7c-4590b75faae1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:09.140722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-9241bbc6-da93-424a-9a46-18bc3d20eed7 req-5b9340e8-3bf8-46ba-90e2-6c22a6fed7bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7aed71-59d4-4915-98d4-4db9bf26cb4b", "tag": "06b689cf-6b82-4fbf-8073-311da1266e64"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:47:09.141435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=4 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:47:09.148176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78b9486a-f7f6-4aa7-ab7c-4590b75faae1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:09.148751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78b9486a-f7f6-4aa7-ab7c-4590b75faae1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:09.149645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78b9486a-f7f6-4aa7-ab7c-4590b75faae1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:09.150273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-78b9486a-f7f6-4aa7-ab7c-4590b75faae1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:09.150920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9241bbc6-da93-424a-9a46-18bc3d20eed7 req-5b9340e8-3bf8-46ba-90e2-6c22a6fed7bf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:09.151465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9241bbc6-da93-424a-9a46-18bc3d20eed7 req-5b9340e8-3bf8-46ba-90e2-6c22a6fed7bf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:09.163150 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-9241bbc6-da93-424a-9a46-18bc3d20eed7 req-5b9340e8-3bf8-46ba-90e2-6c22a6fed7bf service nova] Creating event network-changed:06b689cf-6b82-4fbf-8073-311da1266e64 for instance 8c7aed71-59d4-4915-98d4-4db9bf26cb4b on nch1-master-1 May 28 21:47:09.168199 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-9241bbc6-da93-424a-9a46-18bc3d20eed7 req-5b9340e8-3bf8-46ba-90e2-6c22a6fed7bf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033527 May 28 21:47:09.169055 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3167/6292] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:47:09.179899 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-78b9486a-f7f6-4aa7-ab7c-4590b75faae1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:47:09.469068 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-78b9486a-f7f6-4aa7-ab7c-4590b75faae1 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 204 len: 0 microversion: 2.1 time: 0.336980 May 28 21:47:09.470142 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3126/6293] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:47:09 2022] DELETE /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:47:09.484928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e49dcb29-1bf6-4634-9b52-e754f20a658b tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:09.486262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e49dcb29-1bf6-4634-9b52-e754f20a658b tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:09.493335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e49dcb29-1bf6-4634-9b52-e754f20a658b tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:09.494125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e49dcb29-1bf6-4634-9b52-e754f20a658b tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:09.495182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e49dcb29-1bf6-4634-9b52-e754f20a658b tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:09.495905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e49dcb29-1bf6-4634-9b52-e754f20a658b tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:09.638335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e49dcb29-1bf6-4634-9b52-e754f20a658b tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:09.647334 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e49dcb29-1bf6-4634-9b52-e754f20a658b tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 200 len: 1667 microversion: 2.1 time: 0.167231 May 28 21:47:09.647928 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3168/6294] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:09 2022] GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 1667 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:10.665210 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1650bc78-db77-4b3e-b824-0523c78551b6 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:10.665964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1650bc78-db77-4b3e-b824-0523c78551b6 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:10.675051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1650bc78-db77-4b3e-b824-0523c78551b6 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:10.676078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1650bc78-db77-4b3e-b824-0523c78551b6 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:10.676888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1650bc78-db77-4b3e-b824-0523c78551b6 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:10.677391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1650bc78-db77-4b3e-b824-0523c78551b6 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:10.810161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1650bc78-db77-4b3e-b824-0523c78551b6 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:10.818040 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1650bc78-db77-4b3e-b824-0523c78551b6 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 200 len: 1548 microversion: 2.1 time: 0.157066 May 28 21:47:10.818777 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3127/6295] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:10 2022] GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:11.273470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-2779a1f9-477f-4c49-a96f-32cd9c438e11 req-c6311640-75e1-4db9-a144-72ae664ece00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7aed71-59d4-4915-98d4-4db9bf26cb4b", "name": "network-vif-deleted", "tag": "06b689cf-6b82-4fbf-8073-311da1266e64"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:47:11.282462 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2779a1f9-477f-4c49-a96f-32cd9c438e11 req-c6311640-75e1-4db9-a144-72ae664ece00 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:11.282927 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2779a1f9-477f-4c49-a96f-32cd9c438e11 req-c6311640-75e1-4db9-a144-72ae664ece00 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:11.294105 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-2779a1f9-477f-4c49-a96f-32cd9c438e11 req-c6311640-75e1-4db9-a144-72ae664ece00 service nova] Creating event network-vif-deleted:06b689cf-6b82-4fbf-8073-311da1266e64 for instance 8c7aed71-59d4-4915-98d4-4db9bf26cb4b on nch1-master-1 May 28 21:47:11.299095 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-2779a1f9-477f-4c49-a96f-32cd9c438e11 req-c6311640-75e1-4db9-a144-72ae664ece00 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029353 May 28 21:47:11.300025 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3169/6296] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:47:11.835862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0028237d-5b55-4116-a02c-ed806b2f95d3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:11.836514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0028237d-5b55-4116-a02c-ed806b2f95d3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:11.845906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0028237d-5b55-4116-a02c-ed806b2f95d3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:11.846386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0028237d-5b55-4116-a02c-ed806b2f95d3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:11.847187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0028237d-5b55-4116-a02c-ed806b2f95d3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:11.847659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0028237d-5b55-4116-a02c-ed806b2f95d3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:11.879736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0028237d-5b55-4116-a02c-ed806b2f95d3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:11.880208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0028237d-5b55-4116-a02c-ed806b2f95d3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:11.880676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-0028237d-5b55-4116-a02c-ed806b2f95d3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lazy-loading 'fault' on Instance uuid 8c7aed71-59d4-4915-98d4-4db9bf26cb4b {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:47:11.925694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0028237d-5b55-4116-a02c-ed806b2f95d3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854bc76149074ec5a4ba92bd42ae6a32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7ae678d8e60475bb9b35abcb027a02d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:11.933307 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0028237d-5b55-4116-a02c-ed806b2f95d3 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 200 len: 1337 microversion: 2.1 time: 0.101918 May 28 21:47:11.934572 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3128/6297] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:11 2022] GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 1337 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:12.952208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7f539d36-88d2-4164-8f22-4f084fdb8f87 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:12.952919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7f539d36-88d2-4164-8f22-4f084fdb8f87 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] [instance: 8c7aed71-59d4-4915-98d4-4db9bf26cb4b] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:12.960130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f539d36-88d2-4164-8f22-4f084fdb8f87 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:12.960862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f539d36-88d2-4164-8f22-4f084fdb8f87 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:12.961641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f539d36-88d2-4164-8f22-4f084fdb8f87 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:12.962147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f539d36-88d2-4164-8f22-4f084fdb8f87 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:12.978491 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-7f539d36-88d2-4164-8f22-4f084fdb8f87 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] HTTP exception thrown: Instance 8c7aed71-59d4-4915-98d4-4db9bf26cb4b could not be found. May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7f539d36-88d2-4164-8f22-4f084fdb8f87 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Request method failure captured: May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b HTTP/1.1 May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpetix5UG8FhnAED17LhFgl2UpkOnIjgG6KP48lkgkV0fOQ9jTnc5cGF1CYKdZJRZ4b5SSRZOlekX0dfr01CbQ3xFk6fDTTj-Vpqo4_MhSrzUPl8rKBU82oF69BogLqakdM7zjV2qnSpVZb98TqIQrc4E0cxTZUxUp8QEd1prspRgBs May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: d7ae678d8e60475bb9b35abcb027a02d May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestNetworkBasicOps-477684878 May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d7ae678d8e60475bb9b35abcb027a02d", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ae678d8e60475bb9b35abcb027a02d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d7ae678d8e60475bb9b35abcb027a02d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d7ae678d8e60475bb9b35abcb027a02d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestNetworkBasicOps-477684878 May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: d7ae678d8e60475bb9b35abcb027a02d May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestNetworkBasicOps-477684878 May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestNetworkBasicOps-477684878-project May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 854bc76149074ec5a4ba92bd42ae6a32 May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestNetworkBasicOps-477684878-project May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 8c7aed71-59d4-4915-98d4-4db9bf26cb4b could not be found. May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '8c7aed71-59d4-4915-98d4-4db9bf26cb4b'} May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c7aed71-59d4-4915-98d4-4db9bf26cb4b could not be found. May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c7aed71-59d4-4915-98d4-4db9bf26cb4b could not be found. May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:47:12.980141 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:12.986731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:47:12.986731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:47:12.986731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:47:12.986731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:47:12.986731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:47:12.986731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c7aed71-59d4-4915-98d4-4db9bf26cb4b could not be found. May 28 21:47:12.986731 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:12.986731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7f539d36-88d2-4164-8f22-4f084fdb8f87 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Returning 404 to user: Instance 8c7aed71-59d4-4915-98d4-4db9bf26cb4b could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:47:12.986731 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7f539d36-88d2-4164-8f22-4f084fdb8f87 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b" status: 404 len: 111 microversion: 2.1 time: 0.035100 May 28 21:47:12.986731 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3170/6298] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:12 2022] GET /compute/v2.1/servers/8c7aed71-59d4-4915-98d4-4db9bf26cb4b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:47:13.213751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-72500ea9-046b-442c-b3f5-910204ecc785 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] Calling method '.version_select at 0x7f4d57f68c10>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:13.299460 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-72500ea9-046b-442c-b3f5-910204ecc785 tempest-TestNetworkBasicOps-477684878 tempest-TestNetworkBasicOps-477684878-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-509774037" status: 202 len: 0 microversion: 2.1 time: 0.093300 May 28 21:47:13.300131 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3129/6299] 10.222.0.33 () {58 vars in 1253 bytes} [Sat May 28 21:47:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-509774037 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:47:30.450104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=10 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:47:30.451006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=16 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:47:30.563813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-88073170", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:47:30.614128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] validate_networks() for None {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:47:30.878771 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:47:30.879234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:47:30.879763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:47:30.880179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:47:30.880598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:47:30.889574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:30.890064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:30.890864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:30.891307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:30.910103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Getting quotas for project 1d7b02b506014c31ac4e33b324648ec1. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:47:30.915338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Getting quotas for user 50097382ed6e438ba79564a1dcee76c3 and project 1d7b02b506014c31ac4e33b324648ec1. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:47:30.927639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:47:30.929885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:47:31.056800 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-63ea989c-11b9-4573-9fb4-c8c40a90e0b4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611975 May 28 21:47:31.057759 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3171/6300] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:47:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:47:31.066078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:47:31.066886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:47:31.071170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1afcdcf7-01ce-49e9-a366-ef9ce61cf0f4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:31.071812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1afcdcf7-01ce-49e9-a366-ef9ce61cf0f4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:31.125613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1afcdcf7-01ce-49e9-a366-ef9ce61cf0f4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50097382ed6e438ba79564a1dcee76c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7b02b506014c31ac4e33b324648ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:31.132963 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1afcdcf7-01ce-49e9-a366-ef9ce61cf0f4 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3" status: 200 len: 1220 microversion: 2.1 time: 0.069001 May 28 21:47:31.133549 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3130/6301] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:31 2022] GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 => generated 1220 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:32.151046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-20e4f860-3ab0-4b64-9783-214d73f1d7a3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:32.151620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-20e4f860-3ab0-4b64-9783-214d73f1d7a3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:32.159475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20e4f860-3ab0-4b64-9783-214d73f1d7a3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:32.159945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20e4f860-3ab0-4b64-9783-214d73f1d7a3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:32.160730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20e4f860-3ab0-4b64-9783-214d73f1d7a3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:32.161183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20e4f860-3ab0-4b64-9783-214d73f1d7a3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:32.226485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-20e4f860-3ab0-4b64-9783-214d73f1d7a3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50097382ed6e438ba79564a1dcee76c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7b02b506014c31ac4e33b324648ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:32.234050 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-20e4f860-3ab0-4b64-9783-214d73f1d7a3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3" status: 200 len: 1224 microversion: 2.1 time: 0.087095 May 28 21:47:32.234628 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3172/6302] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:32 2022] GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:33.252099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bfcc7aa7-61df-4a49-9b42-db31091bc742 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:33.252724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bfcc7aa7-61df-4a49-9b42-db31091bc742 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:33.260055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bfcc7aa7-61df-4a49-9b42-db31091bc742 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:33.260526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bfcc7aa7-61df-4a49-9b42-db31091bc742 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:33.261350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bfcc7aa7-61df-4a49-9b42-db31091bc742 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:33.261816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bfcc7aa7-61df-4a49-9b42-db31091bc742 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:33.332938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bfcc7aa7-61df-4a49-9b42-db31091bc742 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50097382ed6e438ba79564a1dcee76c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7b02b506014c31ac4e33b324648ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:33.341413 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bfcc7aa7-61df-4a49-9b42-db31091bc742 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3" status: 200 len: 1280 microversion: 2.1 time: 0.094267 May 28 21:47:33.342116 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3131/6303] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:33 2022] GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 => generated 1280 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:34.359192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ac29a757-a439-48ae-af8c-1aa8d8f5c533 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:34.360538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ac29a757-a439-48ae-af8c-1aa8d8f5c533 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:34.368795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac29a757-a439-48ae-af8c-1aa8d8f5c533 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:34.369276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac29a757-a439-48ae-af8c-1aa8d8f5c533 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:34.370233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac29a757-a439-48ae-af8c-1aa8d8f5c533 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:34.370688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac29a757-a439-48ae-af8c-1aa8d8f5c533 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:34.512586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ac29a757-a439-48ae-af8c-1aa8d8f5c533 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50097382ed6e438ba79564a1dcee76c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7b02b506014c31ac4e33b324648ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:34.524355 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ac29a757-a439-48ae-af8c-1aa8d8f5c533 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3" status: 200 len: 1320 microversion: 2.1 time: 0.169104 May 28 21:47:34.524959 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3173/6304] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:34 2022] GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:35.215759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-b5ac9804-da16-4b06-aa69-b2af88b586b1 req-a81a97b4-bbbe-4793-8ae2-72840e9189d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc0afc96-116e-48a0-9ee4-cb9b57fc40b3", "tag": "34b74c1b-f116-4201-b09b-b82f6a0f3687"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:47:35.227540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b5ac9804-da16-4b06-aa69-b2af88b586b1 req-a81a97b4-bbbe-4793-8ae2-72840e9189d1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:35.228440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b5ac9804-da16-4b06-aa69-b2af88b586b1 req-a81a97b4-bbbe-4793-8ae2-72840e9189d1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:35.241038 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-b5ac9804-da16-4b06-aa69-b2af88b586b1 req-a81a97b4-bbbe-4793-8ae2-72840e9189d1 service nova] Creating event network-changed:34b74c1b-f116-4201-b09b-b82f6a0f3687 for instance bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 on nch1-master-1 May 28 21:47:35.246402 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-b5ac9804-da16-4b06-aa69-b2af88b586b1 req-a81a97b4-bbbe-4793-8ae2-72840e9189d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036544 May 28 21:47:35.247024 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3132/6305] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:47:35.548728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-61dc9ac4-7efc-4a99-b1a8-d6e3144dfb4c tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:35.549980 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-61dc9ac4-7efc-4a99-b1a8-d6e3144dfb4c tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:35.558558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61dc9ac4-7efc-4a99-b1a8-d6e3144dfb4c tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:35.558558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61dc9ac4-7efc-4a99-b1a8-d6e3144dfb4c tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:35.558558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61dc9ac4-7efc-4a99-b1a8-d6e3144dfb4c tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:35.558915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61dc9ac4-7efc-4a99-b1a8-d6e3144dfb4c tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:35.691909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-61dc9ac4-7efc-4a99-b1a8-d6e3144dfb4c tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50097382ed6e438ba79564a1dcee76c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7b02b506014c31ac4e33b324648ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:35.700012 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-61dc9ac4-7efc-4a99-b1a8-d6e3144dfb4c tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3" status: 200 len: 1320 microversion: 2.1 time: 0.155241 May 28 21:47:35.702447 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3174/6306] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:35 2022] GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:36.718409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-41996aa0-b639-49a1-9b33-80f143dbbd53 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:36.719168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-41996aa0-b639-49a1-9b33-80f143dbbd53 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:36.725509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41996aa0-b639-49a1-9b33-80f143dbbd53 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:36.726020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41996aa0-b639-49a1-9b33-80f143dbbd53 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:36.726810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41996aa0-b639-49a1-9b33-80f143dbbd53 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:36.727273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41996aa0-b639-49a1-9b33-80f143dbbd53 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:36.854511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-41996aa0-b639-49a1-9b33-80f143dbbd53 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50097382ed6e438ba79564a1dcee76c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7b02b506014c31ac4e33b324648ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:36.862627 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-41996aa0-b639-49a1-9b33-80f143dbbd53 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3" status: 200 len: 1320 microversion: 2.1 time: 0.149417 May 28 21:47:36.863207 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3133/6307] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:36 2022] GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 => generated 1320 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:37.879618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d9822882-84c8-405a-ab66-9f8c1c75258f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:37.880248 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d9822882-84c8-405a-ab66-9f8c1c75258f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:37.887396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9822882-84c8-405a-ab66-9f8c1c75258f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:37.887860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9822882-84c8-405a-ab66-9f8c1c75258f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:37.888645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9822882-84c8-405a-ab66-9f8c1c75258f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:37.889098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9822882-84c8-405a-ab66-9f8c1c75258f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:38.018350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d9822882-84c8-405a-ab66-9f8c1c75258f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50097382ed6e438ba79564a1dcee76c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7b02b506014c31ac4e33b324648ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:38.025883 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d9822882-84c8-405a-ab66-9f8c1c75258f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3" status: 200 len: 1320 microversion: 2.1 time: 0.150496 May 28 21:47:38.026464 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3175/6308] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:37 2022] GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 => generated 1320 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:39.042620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-119085db-c8aa-46c6-bcd0-255c42526a95 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:39.043292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-119085db-c8aa-46c6-bcd0-255c42526a95 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:39.050844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-119085db-c8aa-46c6-bcd0-255c42526a95 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:39.051318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-119085db-c8aa-46c6-bcd0-255c42526a95 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:39.052108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-119085db-c8aa-46c6-bcd0-255c42526a95 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:39.052572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-119085db-c8aa-46c6-bcd0-255c42526a95 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:39.180935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-119085db-c8aa-46c6-bcd0-255c42526a95 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50097382ed6e438ba79564a1dcee76c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7b02b506014c31ac4e33b324648ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:39.188482 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-119085db-c8aa-46c6-bcd0-255c42526a95 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3" status: 200 len: 1320 microversion: 2.1 time: 0.149875 May 28 21:47:39.189059 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3134/6309] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:39 2022] GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 => generated 1320 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:39.304129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-95409a35-0bdb-4d2d-a573-998428bd8725 req-e8b6aa19-5fd6-41b2-87e1-77ebbc4962ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0afc96-116e-48a0-9ee4-cb9b57fc40b3", "name": "network-vif-plugged", "status": "completed", "tag": "34b74c1b-f116-4201-b09b-b82f6a0f3687"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:47:39.313227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-95409a35-0bdb-4d2d-a573-998428bd8725 req-e8b6aa19-5fd6-41b2-87e1-77ebbc4962ea service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:39.313683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-95409a35-0bdb-4d2d-a573-998428bd8725 req-e8b6aa19-5fd6-41b2-87e1-77ebbc4962ea service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:39.325019 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-95409a35-0bdb-4d2d-a573-998428bd8725 req-e8b6aa19-5fd6-41b2-87e1-77ebbc4962ea service nova] Creating event network-vif-plugged:34b74c1b-f116-4201-b09b-b82f6a0f3687 for instance bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 on nch1-master-1 May 28 21:47:39.330896 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-95409a35-0bdb-4d2d-a573-998428bd8725 req-e8b6aa19-5fd6-41b2-87e1-77ebbc4962ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029925 May 28 21:47:39.331482 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3176/6310] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:47:40.205587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-44edf373-8a2f-42f5-9a99-d00ae45515f3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:40.206269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-44edf373-8a2f-42f5-9a99-d00ae45515f3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:40.213727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-44edf373-8a2f-42f5-9a99-d00ae45515f3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:40.214227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-44edf373-8a2f-42f5-9a99-d00ae45515f3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:40.215045 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-44edf373-8a2f-42f5-9a99-d00ae45515f3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:40.215514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-44edf373-8a2f-42f5-9a99-d00ae45515f3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:40.349993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-44edf373-8a2f-42f5-9a99-d00ae45515f3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50097382ed6e438ba79564a1dcee76c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7b02b506014c31ac4e33b324648ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:40.357810 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-44edf373-8a2f-42f5-9a99-d00ae45515f3 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3" status: 200 len: 1320 microversion: 2.1 time: 0.156208 May 28 21:47:40.358405 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3135/6311] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:40 2022] GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:47:41.375502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-47f395c8-2329-4cd3-98eb-bb1fa8da6650 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:41.376247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-47f395c8-2329-4cd3-98eb-bb1fa8da6650 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:41.379878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:47:41.380596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:47:41.385831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-47f395c8-2329-4cd3-98eb-bb1fa8da6650 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:41.386327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-47f395c8-2329-4cd3-98eb-bb1fa8da6650 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:41.387113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-47f395c8-2329-4cd3-98eb-bb1fa8da6650 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:41.387594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-47f395c8-2329-4cd3-98eb-bb1fa8da6650 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:41.519905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-47f395c8-2329-4cd3-98eb-bb1fa8da6650 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50097382ed6e438ba79564a1dcee76c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7b02b506014c31ac4e33b324648ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:41.527592 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-47f395c8-2329-4cd3-98eb-bb1fa8da6650 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3" status: 200 len: 1470 microversion: 2.1 time: 0.156371 May 28 21:47:41.528174 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3177/6312] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:41 2022] GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:41.546746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:47:41.602103 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0ff79ef8-3776-4658-adec-7cf58472eef2 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Calling method '.version_select at 0x7f4d69cc0af0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:41.667097 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0ff79ef8-3776-4658-adec-7cf58472eef2 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/5bd34cd977554e59b9f9974979d7afe5" status: 200 len: 371 microversion: 2.1 time: 0.125129 May 28 21:47:41.667910 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3136/6313] 10.222.0.33 () {58 vars in 1241 bytes} [Sat May 28 21:47:41 2022] GET /compute/v2.1/os-quota-sets/5bd34cd977554e59b9f9974979d7afe5 => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:47:41.678880 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-add1f5e1-9e46-45dd-87c9-94dc5300ce55 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-632106210", "id": 603770134, "os-flavor-access:is_public": "True"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:47:41.680469 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:47:41.680469 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:47:41.792938 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-add1f5e1-9e46-45dd-87c9-94dc5300ce55 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.118584 May 28 21:47:41.793581 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3178/6314] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:47:41 2022] POST /compute/v2.1/flavors => generated 434 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:47:41.805042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "603770134"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:47:41.806068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:41.812449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:41.812926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:41.813725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:41.814232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:41.903979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3bdb15556d29491ab7de9d0724208ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34cd977554e59b9f9974979d7afe5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:41.910982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-632106210 {{(pid=143128) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 21:47:41.917453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:41.917956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:41.918775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:41.919230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:41.939985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Getting quotas for project 1d7b02b506014c31ac4e33b324648ec1. Resources: {'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:47:41.945065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Getting quotas for user 50097382ed6e438ba79564a1dcee76c3 and project 1d7b02b506014c31ac4e33b324648ec1. Resources: {'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:47:41.957147 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.compute.api [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] ram quota exceeded for 5bd34cd977554e59b9f9974979d7afe5, tried to resize instance. May 28 21:47:41.957706 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Request method failure captured: May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3/action HTTP/1.1 May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 38 May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikphyoso2Y_z_qnlPwy4BKvBxXvGhtguJb7HXWcrLViBSxNNgkoVhlVMvQa9Rkai_kDJg1zAQyA2MwYRefM3SN4x-P6f7o9DKNFQEtV2aAyMjacK4c9r-IUUb0kKVAm1YAiiw3sII3AMKDZ-6pU45nkeQqMT1NMCPbwHNfdVEjYYYZAc May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 5bd34cd977554e59b9f9974979d7afe5 May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-498023403 May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader,admin May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader,admin May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5bd34cd977554e59b9f9974979d7afe5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bd34cd977554e59b9f9974979d7afe5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5bd34cd977554e59b9f9974979d7afe5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bd34cd977554e59b9f9974979d7afe5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersAdminNegativeTestJSON-498023403 May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 5bd34cd977554e59b9f9974979d7afe5 May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-498023403 May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersAdminNegativeTestJSON-498023403-project-admin May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 3bdb15556d29491ab7de9d0724208ad0 May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersAdminNegativeTestJSON-498023403-project-admin May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: {"resize": {"flavorRef": "603770134"}} May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'bc0afc96-116e-48a0-9ee4-cb9b57fc40b3', 'body': {'resize': {'flavorRef': '603770134'}}} May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:47:41.959903 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f88cd5bd-4b97-4744-af53-40d2727c3ffa tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3/action" status: 403 len: 118 microversion: 2.1 time: 0.160597 May 28 21:47:41.965284 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3137/6315] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:47:41 2022] POST /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3/action => generated 118 bytes in 162 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:47:41.973410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a07cd143-1de5-49e9-9e2a-6e0cebcdb2ce tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:41.973410 ncdv-master-1 devstack@n-api.service[143129]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:47:41.973410 ncdv-master-1 devstack@n-api.service[143129]: warnings.warn(msg) May 28 21:47:42.040284 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a07cd143-1de5-49e9-9e2a-6e0cebcdb2ce tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/603770134" status: 202 len: 0 microversion: 2.1 time: 0.073316 May 28 21:47:42.040872 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3179/6316] 10.222.0.33 () {58 vars in 1157 bytes} [Sat May 28 21:47:41 2022] DELETE /compute/v2.1/flavors/603770134 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:47:42.048743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-85822dc6-938f-4937-907e-57aa681315c2 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:42.068360 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-85822dc6-938f-4937-907e-57aa681315c2 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023262 May 28 21:47:42.068952 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3138/6317] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:47:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:42.088598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3d563059-9b85-4af7-bc81-583f6125586f tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Calling method '.version_select at 0x7f4d57f7fdc0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:42.158667 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3d563059-9b85-4af7-bc81-583f6125586f tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] 10.222.0.33 "GET /compute/v2.1/os-quota-sets/5bd34cd977554e59b9f9974979d7afe5" status: 200 len: 371 microversion: 2.1 time: 0.071486 May 28 21:47:42.158667 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3180/6318] 10.222.0.33 () {58 vars in 1241 bytes} [Sat May 28 21:47:42 2022] GET /compute/v2.1/os-quota-sets/5bd34cd977554e59b9f9974979d7afe5 => generated 371 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:47:42.167998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9bf4d418-01b7-47d7-834d-6bb0c887d36c tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1151268238", "id": 1691972491, "os-flavor-access:is_public": "True"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:47:42.169635 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:47:42.169635 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:47:42.234493 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9bf4d418-01b7-47d7-834d-6bb0c887d36c tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.070163 May 28 21:47:42.235084 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3139/6319] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:47:42 2022] POST /compute/v2.1/flavors => generated 437 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:47:42.245922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1691972491"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:47:42.246901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:42.253078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:42.253539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:42.254349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:42.254827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:42.341341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '3bdb15556d29491ab7de9d0724208ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bd34cd977554e59b9f9974979d7afe5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:42.348254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1151268238 {{(pid=143129) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 21:47:42.354692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:42.355151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:42.355954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:42.356399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:42.376629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Getting quotas for project 1d7b02b506014c31ac4e33b324648ec1. Resources: {'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:47:42.382566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Getting quotas for user 50097382ed6e438ba79564a1dcee76c3 and project 1d7b02b506014c31ac4e33b324648ec1. Resources: {'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:47:42.395569 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.compute.api [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] cores quota exceeded for 5bd34cd977554e59b9f9974979d7afe5, tried to resize instance. May 28 21:47:42.396201 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Request method failure captured: May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3/action HTTP/1.1 May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 39 May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikphyoso2Y_z_qnlPwy4BKvBxXvGhtguJb7HXWcrLViBSxNNgkoVhlVMvQa9Rkai_kDJg1zAQyA2MwYRefM3SN4x-P6f7o9DKNFQEtV2aAyMjacK4c9r-IUUb0kKVAm1YAiiw3sII3AMKDZ-6pU45nkeQqMT1NMCPbwHNfdVEjYYYZAc May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 5bd34cd977554e59b9f9974979d7afe5 May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-498023403 May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader,admin May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader,admin May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5bd34cd977554e59b9f9974979d7afe5", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bd34cd977554e59b9f9974979d7afe5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5bd34cd977554e59b9f9974979d7afe5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5bd34cd977554e59b9f9974979d7afe5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersAdminNegativeTestJSON-498023403 May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 5bd34cd977554e59b9f9974979d7afe5 May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-498023403 May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersAdminNegativeTestJSON-498023403-project-admin May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 3bdb15556d29491ab7de9d0724208ad0 May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersAdminNegativeTestJSON-498023403-project-admin May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: {"resize": {"flavorRef": "1691972491"}} May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'bc0afc96-116e-48a0-9ee4-cb9b57fc40b3', 'body': {'resize': {'flavorRef': '1691972491'}}} May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:47:42.398310 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9b8f01cf-b8bb-4cd8-9902-012a72601794 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] 10.222.0.33 "POST /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3/action" status: 403 len: 113 microversion: 2.1 time: 0.157782 May 28 21:47:42.404713 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3181/6320] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:47:42 2022] POST /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3/action => generated 113 bytes in 159 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) May 28 21:47:42.418746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-acbcfb52-b0c9-486d-ae7d-9a9e9058de58 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:42.418746 ncdv-master-1 devstack@n-api.service[143128]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 28 21:47:42.418746 ncdv-master-1 devstack@n-api.service[143128]: warnings.warn(msg) May 28 21:47:42.512614 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-acbcfb52-b0c9-486d-ae7d-9a9e9058de58 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] 10.222.0.33 "DELETE /compute/v2.1/flavors/1691972491" status: 202 len: 0 microversion: 2.1 time: 0.107733 May 28 21:47:42.513199 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3140/6321] 10.222.0.33 () {58 vars in 1160 bytes} [Sat May 28 21:47:42 2022] DELETE /compute/v2.1/flavors/1691972491 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 28 21:47:42.521743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d90bd8e4-36ed-48c7-854d-cbf23041df92 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:42.540916 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d90bd8e4-36ed-48c7-854d-cbf23041df92 tempest-ServersAdminNegativeTestJSON-498023403 tempest-ServersAdminNegativeTestJSON-498023403-project-admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023504 May 28 21:47:42.541478 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3182/6322] 10.222.0.33 () {58 vars in 1145 bytes} [Sat May 28 21:47:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:42.557538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-00ef75e5-6878-46be-a956-0cbb164256cb tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:42.558212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-00ef75e5-6878-46be-a956-0cbb164256cb tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:42.566831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00ef75e5-6878-46be-a956-0cbb164256cb tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:42.567351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00ef75e5-6878-46be-a956-0cbb164256cb tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:42.568196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00ef75e5-6878-46be-a956-0cbb164256cb tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:42.568690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-00ef75e5-6878-46be-a956-0cbb164256cb tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:42.594933 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-00ef75e5-6878-46be-a956-0cbb164256cb tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:47:42.805823 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-00ef75e5-6878-46be-a956-0cbb164256cb tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3" status: 204 len: 0 microversion: 2.1 time: 0.251908 May 28 21:47:42.806553 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3141/6323] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:47:42 2022] DELETE /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:47:42.814481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5d12d027-0105-4563-b3f7-7ab753efbeb7 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:42.815498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5d12d027-0105-4563-b3f7-7ab753efbeb7 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:42.821964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d12d027-0105-4563-b3f7-7ab753efbeb7 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:42.822428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d12d027-0105-4563-b3f7-7ab753efbeb7 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:42.823309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d12d027-0105-4563-b3f7-7ab753efbeb7 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:42.823818 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5d12d027-0105-4563-b3f7-7ab753efbeb7 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:42.955359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5d12d027-0105-4563-b3f7-7ab753efbeb7 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50097382ed6e438ba79564a1dcee76c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7b02b506014c31ac4e33b324648ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:42.963253 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5d12d027-0105-4563-b3f7-7ab753efbeb7 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3" status: 200 len: 1476 microversion: 2.1 time: 0.152635 May 28 21:47:42.963837 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3183/6324] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:42 2022] GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 => generated 1476 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:43.980381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-39f4c530-97b8-489e-9256-0778dec58a30 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:43.981019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-39f4c530-97b8-489e-9256-0778dec58a30 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:43.987952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39f4c530-97b8-489e-9256-0778dec58a30 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:43.988428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39f4c530-97b8-489e-9256-0778dec58a30 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:43.989207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39f4c530-97b8-489e-9256-0778dec58a30 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:43.989662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39f4c530-97b8-489e-9256-0778dec58a30 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:44.123685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-39f4c530-97b8-489e-9256-0778dec58a30 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50097382ed6e438ba79564a1dcee76c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7b02b506014c31ac4e33b324648ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:44.132442 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-39f4c530-97b8-489e-9256-0778dec58a30 tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3" status: 200 len: 1476 microversion: 2.1 time: 0.156478 May 28 21:47:44.133037 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3142/6325] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:43 2022] GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 => generated 1476 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:44.585553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-72e9704a-9be1-4721-a9ab-b16985973b81 req-75aec550-f4ac-4378-9f86-fb9468219065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0afc96-116e-48a0-9ee4-cb9b57fc40b3", "name": "network-vif-deleted", "tag": "34b74c1b-f116-4201-b09b-b82f6a0f3687"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:47:44.595435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-72e9704a-9be1-4721-a9ab-b16985973b81 req-75aec550-f4ac-4378-9f86-fb9468219065 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:44.595894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-72e9704a-9be1-4721-a9ab-b16985973b81 req-75aec550-f4ac-4378-9f86-fb9468219065 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:44.608752 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-72e9704a-9be1-4721-a9ab-b16985973b81 req-75aec550-f4ac-4378-9f86-fb9468219065 service nova] Creating event network-vif-deleted:34b74c1b-f116-4201-b09b-b82f6a0f3687 for instance bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 on nch1-master-1 May 28 21:47:44.614456 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-72e9704a-9be1-4721-a9ab-b16985973b81 req-75aec550-f4ac-4378-9f86-fb9468219065 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033010 May 28 21:47:44.615101 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3184/6326] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:47:45.149106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e9cc042c-205b-4b32-afb8-2c1eec2b145f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:45.149824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e9cc042c-205b-4b32-afb8-2c1eec2b145f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:45.156900 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9cc042c-205b-4b32-afb8-2c1eec2b145f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:45.157764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9cc042c-205b-4b32-afb8-2c1eec2b145f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:45.158199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9cc042c-205b-4b32-afb8-2c1eec2b145f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:45.158658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9cc042c-205b-4b32-afb8-2c1eec2b145f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:45.190376 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9cc042c-205b-4b32-afb8-2c1eec2b145f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:45.200493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9cc042c-205b-4b32-afb8-2c1eec2b145f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:45.200493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-e9cc042c-205b-4b32-afb8-2c1eec2b145f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lazy-loading 'fault' on Instance uuid bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:47:45.232353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e9cc042c-205b-4b32-afb8-2c1eec2b145f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50097382ed6e438ba79564a1dcee76c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d7b02b506014c31ac4e33b324648ec1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:45.239947 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e9cc042c-205b-4b32-afb8-2c1eec2b145f tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3" status: 200 len: 1310 microversion: 2.1 time: 0.094778 May 28 21:47:45.243762 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3143/6327] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:45 2022] GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:46.258308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5a68ad71-2dd3-49b3-a29e-480b18b1668b tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:46.259093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5a68ad71-2dd3-49b3-a29e-480b18b1668b tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] [instance: bc0afc96-116e-48a0-9ee4-cb9b57fc40b3] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:46.265458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a68ad71-2dd3-49b3-a29e-480b18b1668b tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:46.265950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a68ad71-2dd3-49b3-a29e-480b18b1668b tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:46.267022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a68ad71-2dd3-49b3-a29e-480b18b1668b tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:46.267472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a68ad71-2dd3-49b3-a29e-480b18b1668b tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:46.280773 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-5a68ad71-2dd3-49b3-a29e-480b18b1668b tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] HTTP exception thrown: Instance bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 could not be found. May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5a68ad71-2dd3-49b3-a29e-480b18b1668b tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Request method failure captured: May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 HTTP/1.1 May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikphx70Yc82Cs6QldFz4-SO5XSybi1lwmNw7Ja-5o6pNhtFpth8eDtxazn-5SaNb54xSkz4Nt_5rBtaA6fy9rxlFrwTFzhOKSk5HZkui0Hbo6ZxPBhuxvmn-W3COORdrgqSlg7AKguRnNCDdvhsRaawXyEdYip4DLLXh3ipGIiIbZf3I May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 1d7b02b506014c31ac4e33b324648ec1 May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1385096980 May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_1d7b02b506014c31ac4e33b324648ec1", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1d7b02b506014c31ac4e33b324648ec1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/1d7b02b506014c31ac4e33b324648ec1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/1d7b02b506014c31ac4e33b324648ec1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1385096980 May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 1d7b02b506014c31ac4e33b324648ec1 May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1385096980 May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersAdminNegativeTestJSON-1385096980-project May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 50097382ed6e438ba79564a1dcee76c3 May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1385096980-project May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 could not be found. May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'bc0afc96-116e-48a0-9ee4-cb9b57fc40b3'} May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 could not be found. May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 could not be found. May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:46.282436 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:47:46.288618 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:46.288618 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:47:46.288618 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:47:46.288618 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:47:46.288618 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:47:46.288618 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:47:46.288618 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 could not be found. May 28 21:47:46.288618 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:47:46.288618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5a68ad71-2dd3-49b3-a29e-480b18b1668b tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] Returning 404 to user: Instance bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:47:46.288618 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5a68ad71-2dd3-49b3-a29e-480b18b1668b tempest-ServersAdminNegativeTestJSON-1385096980 tempest-ServersAdminNegativeTestJSON-1385096980-project] 10.222.0.33 "GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3" status: 404 len: 111 microversion: 2.1 time: 0.030777 May 28 21:47:46.288618 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3185/6328] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:46 2022] GET /compute/v2.1/servers/bc0afc96-116e-48a0-9ee4-cb9b57fc40b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:47:50.700043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-93418079", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "14c4bfac-994a-4d50-a4f0-1b8d094a024c"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:47:50.750935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] validate_networks() for [('14c4bfac-994a-4d50-a4f0-1b8d094a024c', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:47:51.095164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:47:51.095635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:47:51.096127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:47:51.097186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:47:51.097619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:47:51.106894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:51.107302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:51.108113 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:51.108566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:51.125631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Getting quotas for project 6bf011cdf83d49df98c2e932eda352cd. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:47:51.130834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Getting quotas for user 45bef914dfcc4fb49dfc30dc1acdd799 and project 6bf011cdf83d49df98c2e932eda352cd. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:47:51.143216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:47:51.146043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:47:51.285113 ncdv-master-1 devstack@n-api.service[143128]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [63d4e346-ce63-4579-a13d-e28abfa098f7] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 21:47:52.292092 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [63d4e346-ce63-4579-a13d-e28abfa098f7] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 50132. May 28 21:47:52.296007 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5b38686b-972b-4b48-abd4-a26bf0c71b10 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.712806 May 28 21:47:52.296677 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3144/6329] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:47:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:47:52.307588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b05c5c6b-3ed2-4b5b-a1a9-71028c04896e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:52.308212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b05c5c6b-3ed2-4b5b-a1a9-71028c04896e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:52.312145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:47:52.365804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:47:52.369431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b05c5c6b-3ed2-4b5b-a1a9-71028c04896e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:52.387629 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b05c5c6b-3ed2-4b5b-a1a9-71028c04896e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1213 microversion: 2.1 time: 0.073870 May 28 21:47:52.387629 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3186/6330] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:52 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:53.395370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fb17cc74-012b-4e8a-937e-0f496a12c812 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:53.396042 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fb17cc74-012b-4e8a-937e-0f496a12c812 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:53.402311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb17cc74-012b-4e8a-937e-0f496a12c812 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:53.402786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb17cc74-012b-4e8a-937e-0f496a12c812 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:53.403598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb17cc74-012b-4e8a-937e-0f496a12c812 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:53.404043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fb17cc74-012b-4e8a-937e-0f496a12c812 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:53.496517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fb17cc74-012b-4e8a-937e-0f496a12c812 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:53.504843 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fb17cc74-012b-4e8a-937e-0f496a12c812 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1217 microversion: 2.1 time: 0.114476 May 28 21:47:53.505426 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3145/6331] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:53 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1217 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:47:54.522469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0f0547e4-04c8-4b6e-bc74-1cb8400bf579 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:54.523099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0f0547e4-04c8-4b6e-bc74-1cb8400bf579 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:54.530499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f0547e4-04c8-4b6e-bc74-1cb8400bf579 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:54.530959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f0547e4-04c8-4b6e-bc74-1cb8400bf579 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:54.531925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f0547e4-04c8-4b6e-bc74-1cb8400bf579 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:54.532377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f0547e4-04c8-4b6e-bc74-1cb8400bf579 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:54.598023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0f0547e4-04c8-4b6e-bc74-1cb8400bf579 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:54.606347 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0f0547e4-04c8-4b6e-bc74-1cb8400bf579 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1283 microversion: 2.1 time: 0.088436 May 28 21:47:54.606930 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3187/6332] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:54 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1283 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:55.623810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-674a6273-3c19-41f0-ad95-3392ae36bae5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:55.624438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-674a6273-3c19-41f0-ad95-3392ae36bae5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:55.630951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-674a6273-3c19-41f0-ad95-3392ae36bae5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:55.633998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-674a6273-3c19-41f0-ad95-3392ae36bae5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:55.633998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-674a6273-3c19-41f0-ad95-3392ae36bae5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:55.633998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-674a6273-3c19-41f0-ad95-3392ae36bae5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:55.761997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-674a6273-3c19-41f0-ad95-3392ae36bae5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:55.770237 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-674a6273-3c19-41f0-ad95-3392ae36bae5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1313 microversion: 2.1 time: 0.150036 May 28 21:47:55.770827 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3146/6333] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:55 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:56.195455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-90997a00-8ee6-4d81-afe5-59d107162538 req-f4f124bc-2268-4ffa-92db-646ecf997096 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dd2b8c8-65db-470f-8ac9-503ffcd46431", "tag": "48e179a5-b060-4a83-a5d9-558129bd1fb9"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:47:56.204128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-90997a00-8ee6-4d81-afe5-59d107162538 req-f4f124bc-2268-4ffa-92db-646ecf997096 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:56.204578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-90997a00-8ee6-4d81-afe5-59d107162538 req-f4f124bc-2268-4ffa-92db-646ecf997096 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:56.216537 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-90997a00-8ee6-4d81-afe5-59d107162538 req-f4f124bc-2268-4ffa-92db-646ecf997096 service nova] Creating event network-changed:48e179a5-b060-4a83-a5d9-558129bd1fb9 for instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 on nch1-master-1 May 28 21:47:56.221214 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-90997a00-8ee6-4d81-afe5-59d107162538 req-f4f124bc-2268-4ffa-92db-646ecf997096 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030059 May 28 21:47:56.222512 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3188/6334] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:47:56.787885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-675ce28b-484e-4335-8109-f054a1a70de4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:56.788525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-675ce28b-484e-4335-8109-f054a1a70de4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:56.795365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-675ce28b-484e-4335-8109-f054a1a70de4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:56.795835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-675ce28b-484e-4335-8109-f054a1a70de4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:56.796625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-675ce28b-484e-4335-8109-f054a1a70de4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:56.797081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-675ce28b-484e-4335-8109-f054a1a70de4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:56.928714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-675ce28b-484e-4335-8109-f054a1a70de4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:56.936293 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-675ce28b-484e-4335-8109-f054a1a70de4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1313 microversion: 2.1 time: 0.152928 May 28 21:47:56.936902 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3147/6335] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:56 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:57.960406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7c1271f2-3dec-41d9-95a3-d2c30b527e81 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:57.961152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7c1271f2-3dec-41d9-95a3-d2c30b527e81 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:57.967521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c1271f2-3dec-41d9-95a3-d2c30b527e81 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:57.967983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c1271f2-3dec-41d9-95a3-d2c30b527e81 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:57.968757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c1271f2-3dec-41d9-95a3-d2c30b527e81 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:57.969203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7c1271f2-3dec-41d9-95a3-d2c30b527e81 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:58.096862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7c1271f2-3dec-41d9-95a3-d2c30b527e81 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:58.105160 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7c1271f2-3dec-41d9-95a3-d2c30b527e81 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1313 microversion: 2.1 time: 0.150678 May 28 21:47:58.105748 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3189/6336] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:57 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:47:59.121864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4da239b7-e03e-46e9-8acd-af9e7cafd69c tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:47:59.122510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4da239b7-e03e-46e9-8acd-af9e7cafd69c tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:47:59.129497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4da239b7-e03e-46e9-8acd-af9e7cafd69c tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:59.129994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4da239b7-e03e-46e9-8acd-af9e7cafd69c tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:59.130772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4da239b7-e03e-46e9-8acd-af9e7cafd69c tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:47:59.131237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4da239b7-e03e-46e9-8acd-af9e7cafd69c tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:47:59.578745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4da239b7-e03e-46e9-8acd-af9e7cafd69c tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:47:59.587205 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4da239b7-e03e-46e9-8acd-af9e7cafd69c tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1313 microversion: 2.1 time: 0.469256 May 28 21:47:59.587716 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3148/6337] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:47:59 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:00.604363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7fd5d9a1-3282-4381-b1d9-16cff597eb04 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:00.604929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7fd5d9a1-3282-4381-b1d9-16cff597eb04 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:00.607759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:48:00.612668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fd5d9a1-3282-4381-b1d9-16cff597eb04 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:00.613768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fd5d9a1-3282-4381-b1d9-16cff597eb04 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:00.614574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fd5d9a1-3282-4381-b1d9-16cff597eb04 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:00.615075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fd5d9a1-3282-4381-b1d9-16cff597eb04 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:00.619109 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=72 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:48:00.742426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7fd5d9a1-3282-4381-b1d9-16cff597eb04 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:00.750057 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7fd5d9a1-3282-4381-b1d9-16cff597eb04 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1313 microversion: 2.1 time: 0.149785 May 28 21:48:00.750632 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3190/6338] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:00 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:01.423088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-5bde974a-1b71-436f-bb14-11f322a30ebe req-f79e0f2d-1dba-4794-b385-d31ddfb21dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd2b8c8-65db-470f-8ac9-503ffcd46431", "name": "network-vif-plugged", "status": "completed", "tag": "48e179a5-b060-4a83-a5d9-558129bd1fb9"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:48:01.429563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=5 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:48:01.430310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:48:01.434355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5bde974a-1b71-436f-bb14-11f322a30ebe req-f79e0f2d-1dba-4794-b385-d31ddfb21dc6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:01.434816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5bde974a-1b71-436f-bb14-11f322a30ebe req-f79e0f2d-1dba-4794-b385-d31ddfb21dc6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:01.445782 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-5bde974a-1b71-436f-bb14-11f322a30ebe req-f79e0f2d-1dba-4794-b385-d31ddfb21dc6 service nova] Creating event network-vif-plugged:48e179a5-b060-4a83-a5d9-558129bd1fb9 for instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 on nch1-master-1 May 28 21:48:01.451523 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-5bde974a-1b71-436f-bb14-11f322a30ebe req-f79e0f2d-1dba-4794-b385-d31ddfb21dc6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031956 May 28 21:48:01.452135 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3149/6339] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:48:01.767186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0b280007-3cbf-49d1-8100-eed48bce29a5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:01.767877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0b280007-3cbf-49d1-8100-eed48bce29a5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:01.775780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b280007-3cbf-49d1-8100-eed48bce29a5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:01.776239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b280007-3cbf-49d1-8100-eed48bce29a5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:01.777005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b280007-3cbf-49d1-8100-eed48bce29a5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:01.777494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b280007-3cbf-49d1-8100-eed48bce29a5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:01.909613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0b280007-3cbf-49d1-8100-eed48bce29a5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:01.918046 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0b280007-3cbf-49d1-8100-eed48bce29a5 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1313 microversion: 2.1 time: 0.155195 May 28 21:48:01.919631 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3191/6340] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:01 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:02.935365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ca62e743-3686-414e-bba1-11dcc6f7ee9b tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:02.936090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ca62e743-3686-414e-bba1-11dcc6f7ee9b tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:02.944712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca62e743-3686-414e-bba1-11dcc6f7ee9b tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:02.945182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca62e743-3686-414e-bba1-11dcc6f7ee9b tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:02.945996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca62e743-3686-414e-bba1-11dcc6f7ee9b tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:02.946457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ca62e743-3686-414e-bba1-11dcc6f7ee9b tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:02.961488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:48:03.075139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ca62e743-3686-414e-bba1-11dcc6f7ee9b tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:03.083269 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ca62e743-3686-414e-bba1-11dcc6f7ee9b tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1500 microversion: 2.1 time: 0.152837 May 28 21:48:03.083889 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3150/6341] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:02 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1500 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:03.100091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-289c6efd-2ba9-4222-9ad6-5135c407c0ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:48:03.101068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-289c6efd-2ba9-4222-9ad6-5135c407c0ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:03.102977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:48:03.108664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-289c6efd-2ba9-4222-9ad6-5135c407c0ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:03.112295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-289c6efd-2ba9-4222-9ad6-5135c407c0ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:03.112295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-289c6efd-2ba9-4222-9ad6-5135c407c0ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:03.112295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-289c6efd-2ba9-4222-9ad6-5135c407c0ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:03.138474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-289c6efd-2ba9-4222-9ad6-5135c407c0ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:03.144959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-289c6efd-2ba9-4222-9ad6-5135c407c0ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Old instance type m1.heat2, new instance type m1.heat {{(pid=143129) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 21:48:03.151269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-289c6efd-2ba9-4222-9ad6-5135c407c0ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:48:03.151744 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-289c6efd-2ba9-4222-9ad6-5135c407c0ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:48:03.152226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-289c6efd-2ba9-4222-9ad6-5135c407c0ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:48:03.152640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-289c6efd-2ba9-4222-9ad6-5135c407c0ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:48:03.153057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-289c6efd-2ba9-4222-9ad6-5135c407c0ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:48:03.524041 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-289c6efd-2ba9-4222-9ad6-5135c407c0ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "POST /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431/action" status: 202 len: 0 microversion: 2.1 time: 0.428324 May 28 21:48:03.524668 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3192/6342] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:48:03 2022] POST /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:48:03.533293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a95219bb-75e4-42f8-bad3-6910765a9cf2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:03.534029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a95219bb-75e4-42f8-bad3-6910765a9cf2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:03.540533 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a95219bb-75e4-42f8-bad3-6910765a9cf2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:03.541007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a95219bb-75e4-42f8-bad3-6910765a9cf2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:03.541793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a95219bb-75e4-42f8-bad3-6910765a9cf2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:03.542335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a95219bb-75e4-42f8-bad3-6910765a9cf2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:03.674834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a95219bb-75e4-42f8-bad3-6910765a9cf2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:03.682674 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a95219bb-75e4-42f8-bad3-6910765a9cf2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1509 microversion: 2.1 time: 0.153757 May 28 21:48:03.685473 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3151/6343] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:03 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:04.701037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e475b571-a3eb-48bb-9700-bb0b1fe2a177 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:04.701659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e475b571-a3eb-48bb-9700-bb0b1fe2a177 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:04.708541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e475b571-a3eb-48bb-9700-bb0b1fe2a177 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:04.709000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e475b571-a3eb-48bb-9700-bb0b1fe2a177 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:04.710064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e475b571-a3eb-48bb-9700-bb0b1fe2a177 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:04.710512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e475b571-a3eb-48bb-9700-bb0b1fe2a177 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:04.840496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e475b571-a3eb-48bb-9700-bb0b1fe2a177 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:04.848214 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e475b571-a3eb-48bb-9700-bb0b1fe2a177 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1509 microversion: 2.1 time: 0.152195 May 28 21:48:04.848798 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3193/6344] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:04 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:05.864742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-461e1071-cc62-4d63-9b9a-441634eb50b2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:05.865377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-461e1071-cc62-4d63-9b9a-441634eb50b2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:05.868131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:48:05.872968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-461e1071-cc62-4d63-9b9a-441634eb50b2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:05.873429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-461e1071-cc62-4d63-9b9a-441634eb50b2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:05.874283 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-461e1071-cc62-4d63-9b9a-441634eb50b2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:05.874739 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-461e1071-cc62-4d63-9b9a-441634eb50b2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:06.025117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-461e1071-cc62-4d63-9b9a-441634eb50b2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:06.032661 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-461e1071-cc62-4d63-9b9a-441634eb50b2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1509 microversion: 2.1 time: 0.171943 May 28 21:48:06.033257 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3152/6345] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:05 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:07.050092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0f839e55-9ac1-4f91-93ec-5e3ad8623da4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:07.050745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0f839e55-9ac1-4f91-93ec-5e3ad8623da4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:07.057793 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f839e55-9ac1-4f91-93ec-5e3ad8623da4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:07.058290 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f839e55-9ac1-4f91-93ec-5e3ad8623da4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:07.059072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f839e55-9ac1-4f91-93ec-5e3ad8623da4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:07.059526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0f839e55-9ac1-4f91-93ec-5e3ad8623da4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:07.187360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0f839e55-9ac1-4f91-93ec-5e3ad8623da4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:07.195366 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0f839e55-9ac1-4f91-93ec-5e3ad8623da4 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.149290 May 28 21:48:07.195934 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3194/6346] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:07 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:08.212806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c4d6620c-4104-4dd9-ac30-eab3c34999ad tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:08.213437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c4d6620c-4104-4dd9-ac30-eab3c34999ad tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:08.220528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4d6620c-4104-4dd9-ac30-eab3c34999ad tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:08.220992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4d6620c-4104-4dd9-ac30-eab3c34999ad tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:08.221762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4d6620c-4104-4dd9-ac30-eab3c34999ad tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:08.222237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4d6620c-4104-4dd9-ac30-eab3c34999ad tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:08.349311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c4d6620c-4104-4dd9-ac30-eab3c34999ad tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:08.356824 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c4d6620c-4104-4dd9-ac30-eab3c34999ad tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.148153 May 28 21:48:08.357412 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3153/6347] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:08 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:09.374792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f1d60ed4-fd94-4480-9f31-eca9d89f7be7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:09.375344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f1d60ed4-fd94-4480-9f31-eca9d89f7be7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:09.382891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1d60ed4-fd94-4480-9f31-eca9d89f7be7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:09.383410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1d60ed4-fd94-4480-9f31-eca9d89f7be7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:09.384250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1d60ed4-fd94-4480-9f31-eca9d89f7be7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:09.384697 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1d60ed4-fd94-4480-9f31-eca9d89f7be7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:09.557196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f1d60ed4-fd94-4480-9f31-eca9d89f7be7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:09.564723 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f1d60ed4-fd94-4480-9f31-eca9d89f7be7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.194464 May 28 21:48:09.565288 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3195/6348] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:09 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:10.581014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-946ca75f-4a0f-4fa0-852e-eeba7d548776 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:10.581677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-946ca75f-4a0f-4fa0-852e-eeba7d548776 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:10.588937 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-946ca75f-4a0f-4fa0-852e-eeba7d548776 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:10.589438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-946ca75f-4a0f-4fa0-852e-eeba7d548776 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:10.590251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-946ca75f-4a0f-4fa0-852e-eeba7d548776 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:10.590705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-946ca75f-4a0f-4fa0-852e-eeba7d548776 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:10.719165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-946ca75f-4a0f-4fa0-852e-eeba7d548776 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:10.726825 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-946ca75f-4a0f-4fa0-852e-eeba7d548776 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.149799 May 28 21:48:10.727401 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3154/6349] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:10 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:11.743790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fec12a7c-9378-4b97-b471-14b7d23d534e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:11.744449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fec12a7c-9378-4b97-b471-14b7d23d534e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:11.751694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fec12a7c-9378-4b97-b471-14b7d23d534e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:11.752158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fec12a7c-9378-4b97-b471-14b7d23d534e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:11.752940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fec12a7c-9378-4b97-b471-14b7d23d534e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:11.753385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fec12a7c-9378-4b97-b471-14b7d23d534e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:11.890659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fec12a7c-9378-4b97-b471-14b7d23d534e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:11.900724 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fec12a7c-9378-4b97-b471-14b7d23d534e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.160935 May 28 21:48:11.901313 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3196/6350] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:11 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:12.917263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7a420a14-4bc6-4ece-8a83-92f16ce746ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:12.917855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7a420a14-4bc6-4ece-8a83-92f16ce746ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:12.924978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a420a14-4bc6-4ece-8a83-92f16ce746ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:12.925513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a420a14-4bc6-4ece-8a83-92f16ce746ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:12.926337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a420a14-4bc6-4ece-8a83-92f16ce746ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:12.926793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a420a14-4bc6-4ece-8a83-92f16ce746ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:13.054834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7a420a14-4bc6-4ece-8a83-92f16ce746ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:13.062532 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7a420a14-4bc6-4ece-8a83-92f16ce746ea tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.149451 May 28 21:48:13.063116 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3155/6351] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:12 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:14.079882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fa49605a-d103-4047-94f8-2d2bb6f5ffb8 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:14.081791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fa49605a-d103-4047-94f8-2d2bb6f5ffb8 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:14.087510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa49605a-d103-4047-94f8-2d2bb6f5ffb8 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:14.087964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa49605a-d103-4047-94f8-2d2bb6f5ffb8 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:14.088733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa49605a-d103-4047-94f8-2d2bb6f5ffb8 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:14.089175 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa49605a-d103-4047-94f8-2d2bb6f5ffb8 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:14.218558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fa49605a-d103-4047-94f8-2d2bb6f5ffb8 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:14.226936 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fa49605a-d103-4047-94f8-2d2bb6f5ffb8 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.150972 May 28 21:48:14.227527 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3197/6352] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:14 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:15.244867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8b66d442-fe33-48ff-b8e0-1a27884f32d2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:15.245407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8b66d442-fe33-48ff-b8e0-1a27884f32d2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:15.252410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8b66d442-fe33-48ff-b8e0-1a27884f32d2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:15.252877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8b66d442-fe33-48ff-b8e0-1a27884f32d2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:15.254336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8b66d442-fe33-48ff-b8e0-1a27884f32d2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:15.254793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8b66d442-fe33-48ff-b8e0-1a27884f32d2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:15.385291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8b66d442-fe33-48ff-b8e0-1a27884f32d2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:15.392828 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8b66d442-fe33-48ff-b8e0-1a27884f32d2 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.152302 May 28 21:48:15.393400 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3156/6353] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:15 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:16.410323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c164dcac-041e-4504-86f9-47b8afadabbd tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:16.411622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c164dcac-041e-4504-86f9-47b8afadabbd tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:16.418910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c164dcac-041e-4504-86f9-47b8afadabbd tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:16.419372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c164dcac-041e-4504-86f9-47b8afadabbd tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:16.420148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c164dcac-041e-4504-86f9-47b8afadabbd tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:16.420643 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c164dcac-041e-4504-86f9-47b8afadabbd tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:16.548230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c164dcac-041e-4504-86f9-47b8afadabbd tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:16.556099 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c164dcac-041e-4504-86f9-47b8afadabbd tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.150245 May 28 21:48:16.556689 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3198/6354] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:16 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:17.573717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0349482f-09f4-47d0-897c-cc07afe5ba8f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:17.574590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0349482f-09f4-47d0-897c-cc07afe5ba8f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:17.581707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0349482f-09f4-47d0-897c-cc07afe5ba8f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:17.582865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0349482f-09f4-47d0-897c-cc07afe5ba8f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:17.583663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0349482f-09f4-47d0-897c-cc07afe5ba8f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:17.584134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0349482f-09f4-47d0-897c-cc07afe5ba8f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:17.716293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0349482f-09f4-47d0-897c-cc07afe5ba8f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:17.724039 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0349482f-09f4-47d0-897c-cc07afe5ba8f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.154315 May 28 21:48:17.724630 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3157/6355] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:17 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:18.740736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2ab765d9-0653-4e90-937c-bb1e22e69e6a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:18.741356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2ab765d9-0653-4e90-937c-bb1e22e69e6a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:18.748485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ab765d9-0653-4e90-937c-bb1e22e69e6a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:18.748975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ab765d9-0653-4e90-937c-bb1e22e69e6a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:18.749759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ab765d9-0653-4e90-937c-bb1e22e69e6a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:18.750234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ab765d9-0653-4e90-937c-bb1e22e69e6a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:18.881977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2ab765d9-0653-4e90-937c-bb1e22e69e6a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:18.889541 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2ab765d9-0653-4e90-937c-bb1e22e69e6a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.152894 May 28 21:48:18.890176 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3199/6356] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:18 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:19.907240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-339ba081-2dfb-4e6d-8b2b-04b0260a8e46 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:19.907879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-339ba081-2dfb-4e6d-8b2b-04b0260a8e46 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:19.915524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-339ba081-2dfb-4e6d-8b2b-04b0260a8e46 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:19.915999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-339ba081-2dfb-4e6d-8b2b-04b0260a8e46 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:19.916786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-339ba081-2dfb-4e6d-8b2b-04b0260a8e46 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:19.917247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-339ba081-2dfb-4e6d-8b2b-04b0260a8e46 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:20.051525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-339ba081-2dfb-4e6d-8b2b-04b0260a8e46 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:20.059247 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-339ba081-2dfb-4e6d-8b2b-04b0260a8e46 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.155992 May 28 21:48:20.059833 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3158/6357] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:19 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:21.077829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cecde401-1415-4db7-b9ee-001c34704f4f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:21.078487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cecde401-1415-4db7-b9ee-001c34704f4f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:21.085745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cecde401-1415-4db7-b9ee-001c34704f4f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:21.086269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cecde401-1415-4db7-b9ee-001c34704f4f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:21.087931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cecde401-1415-4db7-b9ee-001c34704f4f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:21.088390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cecde401-1415-4db7-b9ee-001c34704f4f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:21.214998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cecde401-1415-4db7-b9ee-001c34704f4f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:21.222634 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cecde401-1415-4db7-b9ee-001c34704f4f tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.148775 May 28 21:48:21.223215 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3200/6358] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:21 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:22.240719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-415a1ac1-e9ed-4ef2-8cba-fc6cf620ef3e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:22.241368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-415a1ac1-e9ed-4ef2-8cba-fc6cf620ef3e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:22.248484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-415a1ac1-e9ed-4ef2-8cba-fc6cf620ef3e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:22.248957 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-415a1ac1-e9ed-4ef2-8cba-fc6cf620ef3e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:22.249785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-415a1ac1-e9ed-4ef2-8cba-fc6cf620ef3e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:22.250273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-415a1ac1-e9ed-4ef2-8cba-fc6cf620ef3e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:22.379649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-415a1ac1-e9ed-4ef2-8cba-fc6cf620ef3e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:22.387868 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-415a1ac1-e9ed-4ef2-8cba-fc6cf620ef3e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.151762 May 28 21:48:22.388458 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3159/6359] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:22 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:23.404181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9fc4d43e-c3ff-4f18-84de-b1ead6cbee07 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:23.404737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9fc4d43e-c3ff-4f18-84de-b1ead6cbee07 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:23.412291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9fc4d43e-c3ff-4f18-84de-b1ead6cbee07 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:23.412755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9fc4d43e-c3ff-4f18-84de-b1ead6cbee07 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:23.413518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9fc4d43e-c3ff-4f18-84de-b1ead6cbee07 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:23.413986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9fc4d43e-c3ff-4f18-84de-b1ead6cbee07 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:23.546836 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9fc4d43e-c3ff-4f18-84de-b1ead6cbee07 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:23.555425 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9fc4d43e-c3ff-4f18-84de-b1ead6cbee07 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.155259 May 28 21:48:23.556005 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3201/6360] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:23 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:24.573300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c3a49ad6-53c6-4a4b-ae91-891e4311eb82 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:24.580587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c3a49ad6-53c6-4a4b-ae91-891e4311eb82 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:24.581184 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3a49ad6-53c6-4a4b-ae91-891e4311eb82 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:24.581658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3a49ad6-53c6-4a4b-ae91-891e4311eb82 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:24.582474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3a49ad6-53c6-4a4b-ae91-891e4311eb82 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:24.582936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3a49ad6-53c6-4a4b-ae91-891e4311eb82 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:24.710892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c3a49ad6-53c6-4a4b-ae91-891e4311eb82 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:24.718474 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c3a49ad6-53c6-4a4b-ae91-891e4311eb82 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.149172 May 28 21:48:24.719060 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3160/6361] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:24 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:25.734541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-57ff15ef-2c9d-46a0-bab1-ce382ae81f13 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:25.735077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-57ff15ef-2c9d-46a0-bab1-ce382ae81f13 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:25.742859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57ff15ef-2c9d-46a0-bab1-ce382ae81f13 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:25.743315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57ff15ef-2c9d-46a0-bab1-ce382ae81f13 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:25.744079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57ff15ef-2c9d-46a0-bab1-ce382ae81f13 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:25.744524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-57ff15ef-2c9d-46a0-bab1-ce382ae81f13 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:25.877934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-57ff15ef-2c9d-46a0-bab1-ce382ae81f13 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:25.885974 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-57ff15ef-2c9d-46a0-bab1-ce382ae81f13 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.155423 May 28 21:48:25.886646 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3202/6362] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:25 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:26.903718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-451fe08b-4046-42cc-9e6e-a7ba9551d283 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:26.904351 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-451fe08b-4046-42cc-9e6e-a7ba9551d283 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:26.910855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-451fe08b-4046-42cc-9e6e-a7ba9551d283 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:26.911914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-451fe08b-4046-42cc-9e6e-a7ba9551d283 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:26.912688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-451fe08b-4046-42cc-9e6e-a7ba9551d283 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:26.913142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-451fe08b-4046-42cc-9e6e-a7ba9551d283 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:27.039523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-451fe08b-4046-42cc-9e6e-a7ba9551d283 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:27.047115 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-451fe08b-4046-42cc-9e6e-a7ba9551d283 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.147329 May 28 21:48:27.047691 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3161/6363] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:26 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:28.064614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fa0d4332-b79b-46ed-8563-7d616469310a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:28.065241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fa0d4332-b79b-46ed-8563-7d616469310a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:28.072112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa0d4332-b79b-46ed-8563-7d616469310a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:28.072570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa0d4332-b79b-46ed-8563-7d616469310a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:28.073337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa0d4332-b79b-46ed-8563-7d616469310a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:28.073809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fa0d4332-b79b-46ed-8563-7d616469310a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:28.201221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fa0d4332-b79b-46ed-8563-7d616469310a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:28.208823 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fa0d4332-b79b-46ed-8563-7d616469310a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.148624 May 28 21:48:28.209659 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3203/6364] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:28 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:29.226139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1d5b1517-4fa2-4c06-b86b-2e7c0c34e727 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:29.226771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1d5b1517-4fa2-4c06-b86b-2e7c0c34e727 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:29.233744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d5b1517-4fa2-4c06-b86b-2e7c0c34e727 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:29.234240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d5b1517-4fa2-4c06-b86b-2e7c0c34e727 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:29.235010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d5b1517-4fa2-4c06-b86b-2e7c0c34e727 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:29.235461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d5b1517-4fa2-4c06-b86b-2e7c0c34e727 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:29.367785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1d5b1517-4fa2-4c06-b86b-2e7c0c34e727 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:29.375283 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1d5b1517-4fa2-4c06-b86b-2e7c0c34e727 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.153128 May 28 21:48:29.375860 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3162/6365] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:29 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:30.391730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2874ad17-3ce0-4111-9f02-d836f4f6d70d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:30.392312 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2874ad17-3ce0-4111-9f02-d836f4f6d70d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:30.399935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2874ad17-3ce0-4111-9f02-d836f4f6d70d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:30.400395 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2874ad17-3ce0-4111-9f02-d836f4f6d70d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:30.401172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2874ad17-3ce0-4111-9f02-d836f4f6d70d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:30.401626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2874ad17-3ce0-4111-9f02-d836f4f6d70d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:30.530252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2874ad17-3ce0-4111-9f02-d836f4f6d70d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:30.538531 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2874ad17-3ce0-4111-9f02-d836f4f6d70d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.150780 May 28 21:48:30.539113 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3204/6366] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:30 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:31.555598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a8e85d13-28ad-4d42-b22e-b1ac2c899f14 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:31.556230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a8e85d13-28ad-4d42-b22e-b1ac2c899f14 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:31.563311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8e85d13-28ad-4d42-b22e-b1ac2c899f14 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:31.563781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8e85d13-28ad-4d42-b22e-b1ac2c899f14 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:31.564558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8e85d13-28ad-4d42-b22e-b1ac2c899f14 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:31.565013 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8e85d13-28ad-4d42-b22e-b1ac2c899f14 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:31.698075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a8e85d13-28ad-4d42-b22e-b1ac2c899f14 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:31.705718 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a8e85d13-28ad-4d42-b22e-b1ac2c899f14 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.154090 May 28 21:48:31.706320 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3163/6367] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:31 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:32.723375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d3fe7988-2a41-4619-9d42-419fa61fc15e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:32.724003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d3fe7988-2a41-4619-9d42-419fa61fc15e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:32.726730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=34 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:48:32.731632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3fe7988-2a41-4619-9d42-419fa61fc15e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:32.732091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3fe7988-2a41-4619-9d42-419fa61fc15e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:32.732862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3fe7988-2a41-4619-9d42-419fa61fc15e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:32.733320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d3fe7988-2a41-4619-9d42-419fa61fc15e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:32.737283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:48:32.863712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d3fe7988-2a41-4619-9d42-419fa61fc15e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:32.871698 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d3fe7988-2a41-4619-9d42-419fa61fc15e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1514 microversion: 2.1 time: 0.152221 May 28 21:48:32.872276 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3205/6368] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:32 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:33.888668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ef80cdd2-876e-44b8-a15a-790da7bc92ca tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:33.889299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ef80cdd2-876e-44b8-a15a-790da7bc92ca tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:33.896674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef80cdd2-876e-44b8-a15a-790da7bc92ca tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:33.897786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef80cdd2-876e-44b8-a15a-790da7bc92ca tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:33.898578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef80cdd2-876e-44b8-a15a-790da7bc92ca tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:33.899038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef80cdd2-876e-44b8-a15a-790da7bc92ca tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:33.903207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=82 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:48:34.123344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ef80cdd2-876e-44b8-a15a-790da7bc92ca tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:34.130992 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ef80cdd2-876e-44b8-a15a-790da7bc92ca tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1513 microversion: 2.1 time: 0.246309 May 28 21:48:34.132230 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3164/6369] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:33 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1513 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:34.351765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-2505f146-e0d4-4804-8dfe-b9c3dcc3b23c req-94475b2d-511f-4953-836f-16a7a347f3ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd2b8c8-65db-470f-8ac9-503ffcd46431", "name": "network-vif-unplugged", "status": "completed", "tag": "48e179a5-b060-4a83-a5d9-558129bd1fb9"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:48:34.362833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2505f146-e0d4-4804-8dfe-b9c3dcc3b23c req-94475b2d-511f-4953-836f-16a7a347f3ea service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:34.362833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2505f146-e0d4-4804-8dfe-b9c3dcc3b23c req-94475b2d-511f-4953-836f-16a7a347f3ea service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:34.376309 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-2505f146-e0d4-4804-8dfe-b9c3dcc3b23c req-94475b2d-511f-4953-836f-16a7a347f3ea service nova] Creating event network-vif-unplugged:48e179a5-b060-4a83-a5d9-558129bd1fb9 for instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 on nch2-master-1 May 28 21:48:34.382312 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-2505f146-e0d4-4804-8dfe-b9c3dcc3b23c req-94475b2d-511f-4953-836f-16a7a347f3ea service nova] Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:48:34.393185 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-2505f146-e0d4-4804-8dfe-b9c3dcc3b23c req-94475b2d-511f-4953-836f-16a7a347f3ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045876 May 28 21:48:34.393795 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3206/6370] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:48:35.148676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f23949b1-020f-430e-a88a-c916fad05957 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:35.149307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f23949b1-020f-430e-a88a-c916fad05957 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:35.156532 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f23949b1-020f-430e-a88a-c916fad05957 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:35.157001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f23949b1-020f-430e-a88a-c916fad05957 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:35.157780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f23949b1-020f-430e-a88a-c916fad05957 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:35.158279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f23949b1-020f-430e-a88a-c916fad05957 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:35.315793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f23949b1-020f-430e-a88a-c916fad05957 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:35.323355 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f23949b1-020f-430e-a88a-c916fad05957 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1513 microversion: 2.1 time: 0.178660 May 28 21:48:35.323916 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3165/6371] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:35 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1513 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:36.342337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8b8efeac-530d-41e8-b24e-20086284e84d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:36.342999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8b8efeac-530d-41e8-b24e-20086284e84d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:36.349356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b8efeac-530d-41e8-b24e-20086284e84d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:36.350434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b8efeac-530d-41e8-b24e-20086284e84d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:36.351288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b8efeac-530d-41e8-b24e-20086284e84d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:36.351662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8b8efeac-530d-41e8-b24e-20086284e84d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:36.427252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-761cc7ee-cb89-4aeb-b24d-8ccc492da20e req-f27149d7-e84a-419b-b263-1da3819f7512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dd2b8c8-65db-470f-8ac9-503ffcd46431", "tag": "48e179a5-b060-4a83-a5d9-558129bd1fb9"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:48:36.431682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=28 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:48:36.436948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-761cc7ee-cb89-4aeb-b24d-8ccc492da20e req-f27149d7-e84a-419b-b263-1da3819f7512 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:36.437413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-761cc7ee-cb89-4aeb-b24d-8ccc492da20e req-f27149d7-e84a-419b-b263-1da3819f7512 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:36.449795 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-761cc7ee-cb89-4aeb-b24d-8ccc492da20e req-f27149d7-e84a-419b-b263-1da3819f7512 service nova] Creating event network-changed:48e179a5-b060-4a83-a5d9-558129bd1fb9 for instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 on nch2-master-1 May 28 21:48:36.455626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-761cc7ee-cb89-4aeb-b24d-8ccc492da20e req-f27149d7-e84a-419b-b263-1da3819f7512 service nova] Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:48:36.467461 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-761cc7ee-cb89-4aeb-b24d-8ccc492da20e req-f27149d7-e84a-419b-b263-1da3819f7512 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043648 May 28 21:48:36.468111 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3166/6372] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:48:36.494905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8b8efeac-530d-41e8-b24e-20086284e84d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:36.503108 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8b8efeac-530d-41e8-b24e-20086284e84d tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1511 microversion: 2.1 time: 0.166099 May 28 21:48:36.503696 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3207/6373] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:36 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:37.522432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-716b0247-9b6b-46ed-8e33-5940707c4d48 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:37.523160 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-716b0247-9b6b-46ed-8e33-5940707c4d48 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:37.529832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-716b0247-9b6b-46ed-8e33-5940707c4d48 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:37.530334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-716b0247-9b6b-46ed-8e33-5940707c4d48 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:37.531125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-716b0247-9b6b-46ed-8e33-5940707c4d48 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:37.531594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-716b0247-9b6b-46ed-8e33-5940707c4d48 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:37.666892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-716b0247-9b6b-46ed-8e33-5940707c4d48 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:37.674554 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-716b0247-9b6b-46ed-8e33-5940707c4d48 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1508 microversion: 2.1 time: 0.157686 May 28 21:48:37.675130 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3167/6374] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:37 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:37.690714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7a1e8589-1cdb-4b33-9b3c-a617110a39d7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:37.691247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7a1e8589-1cdb-4b33-9b3c-a617110a39d7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:37.698333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a1e8589-1cdb-4b33-9b3c-a617110a39d7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:37.698788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a1e8589-1cdb-4b33-9b3c-a617110a39d7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:37.699560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a1e8589-1cdb-4b33-9b3c-a617110a39d7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:37.700037 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a1e8589-1cdb-4b33-9b3c-a617110a39d7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:37.726903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7a1e8589-1cdb-4b33-9b3c-a617110a39d7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:48:37.828823 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.compute.api [None req-7a1e8589-1cdb-4b33-9b3c-a617110a39d7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Found an unconfirmed migration during delete, id: 16, status: finished May 28 21:48:39.719845 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7a1e8589-1cdb-4b33-9b3c-a617110a39d7 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 204 len: 0 microversion: 2.1 time: 2.032820 May 28 21:48:39.721220 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3208/6375] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:48:37 2022] DELETE /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 0 bytes in 2035 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:48:39.730054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f6612846-a7dd-43c7-bb6a-2a297458cf0a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:39.730632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f6612846-a7dd-43c7-bb6a-2a297458cf0a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:39.738448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6612846-a7dd-43c7-bb6a-2a297458cf0a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:39.738845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6612846-a7dd-43c7-bb6a-2a297458cf0a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:39.739690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6612846-a7dd-43c7-bb6a-2a297458cf0a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:39.740155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f6612846-a7dd-43c7-bb6a-2a297458cf0a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:39.869459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f6612846-a7dd-43c7-bb6a-2a297458cf0a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:39.877018 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f6612846-a7dd-43c7-bb6a-2a297458cf0a tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1500 microversion: 2.1 time: 0.150883 May 28 21:48:39.877593 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3168/6376] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:39 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1500 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:40.894127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7f43bea8-122c-486e-b659-f42f24dccdac tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:40.894841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7f43bea8-122c-486e-b659-f42f24dccdac tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:40.902053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f43bea8-122c-486e-b659-f42f24dccdac tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:40.902510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f43bea8-122c-486e-b659-f42f24dccdac tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:40.903279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f43bea8-122c-486e-b659-f42f24dccdac tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:40.903749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f43bea8-122c-486e-b659-f42f24dccdac tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:41.039492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7f43bea8-122c-486e-b659-f42f24dccdac tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:41.047307 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7f43bea8-122c-486e-b659-f42f24dccdac tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1500 microversion: 2.1 time: 0.157498 May 28 21:48:41.047902 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3209/6377] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:40 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:41.186041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-75a5bc34-e3ee-4273-aed0-25456e8f822f req-0d8f8e51-e900-468e-a986-ecf1f0d29155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd2b8c8-65db-470f-8ac9-503ffcd46431", "name": "network-vif-plugged", "status": "completed", "tag": "48e179a5-b060-4a83-a5d9-558129bd1fb9"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:48:41.196657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-75a5bc34-e3ee-4273-aed0-25456e8f822f req-0d8f8e51-e900-468e-a986-ecf1f0d29155 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:41.197128 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-75a5bc34-e3ee-4273-aed0-25456e8f822f req-0d8f8e51-e900-468e-a986-ecf1f0d29155 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:41.208136 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-75a5bc34-e3ee-4273-aed0-25456e8f822f req-0d8f8e51-e900-468e-a986-ecf1f0d29155 service nova] Creating event network-vif-plugged:48e179a5-b060-4a83-a5d9-558129bd1fb9 for instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 on nch2-master-1 May 28 21:48:41.213945 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-75a5bc34-e3ee-4273-aed0-25456e8f822f req-0d8f8e51-e900-468e-a986-ecf1f0d29155 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031577 May 28 21:48:41.214756 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3169/6378] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:48:41.603659 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-e6dcdc9a-7980-4fa0-a8f8-6ab5c53a83c6 req-0ba2a655-0dd6-4cbd-9cbe-6b00951e6604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dd2b8c8-65db-470f-8ac9-503ffcd46431", "name": "network-vif-deleted", "tag": "48e179a5-b060-4a83-a5d9-558129bd1fb9"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:48:41.612195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e6dcdc9a-7980-4fa0-a8f8-6ab5c53a83c6 req-0ba2a655-0dd6-4cbd-9cbe-6b00951e6604 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:41.612651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e6dcdc9a-7980-4fa0-a8f8-6ab5c53a83c6 req-0ba2a655-0dd6-4cbd-9cbe-6b00951e6604 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:41.623710 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e6dcdc9a-7980-4fa0-a8f8-6ab5c53a83c6 req-0ba2a655-0dd6-4cbd-9cbe-6b00951e6604 service nova] Creating event network-vif-deleted:48e179a5-b060-4a83-a5d9-558129bd1fb9 for instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 on nch2-master-1 May 28 21:48:41.628759 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-e6dcdc9a-7980-4fa0-a8f8-6ab5c53a83c6 req-0ba2a655-0dd6-4cbd-9cbe-6b00951e6604 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029366 May 28 21:48:41.629363 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3210/6379] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:48:42.065171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-61727aa5-1747-43c2-a0f4-a87a0f5812e0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:42.065919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-61727aa5-1747-43c2-a0f4-a87a0f5812e0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:42.073188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61727aa5-1747-43c2-a0f4-a87a0f5812e0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:42.073660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61727aa5-1747-43c2-a0f4-a87a0f5812e0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:42.074475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61727aa5-1747-43c2-a0f4-a87a0f5812e0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:42.074929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61727aa5-1747-43c2-a0f4-a87a0f5812e0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:42.107043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61727aa5-1747-43c2-a0f4-a87a0f5812e0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:42.107518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61727aa5-1747-43c2-a0f4-a87a0f5812e0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:42.107989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-61727aa5-1747-43c2-a0f4-a87a0f5812e0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lazy-loading 'fault' on Instance uuid 1dd2b8c8-65db-470f-8ac9-503ffcd46431 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:48:42.154445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-61727aa5-1747-43c2-a0f4-a87a0f5812e0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45bef914dfcc4fb49dfc30dc1acdd799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bf011cdf83d49df98c2e932eda352cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:42.162135 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-61727aa5-1747-43c2-a0f4-a87a0f5812e0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 200 len: 1303 microversion: 2.1 time: 0.101281 May 28 21:48:42.163649 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3170/6380] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:42 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:43.180695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b5c97364-6324-47d1-ba2f-675318c6718e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:43.181441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b5c97364-6324-47d1-ba2f-675318c6718e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:43.187959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b5c97364-6324-47d1-ba2f-675318c6718e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:43.188428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b5c97364-6324-47d1-ba2f-675318c6718e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:43.189206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b5c97364-6324-47d1-ba2f-675318c6718e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:43.189660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b5c97364-6324-47d1-ba2f-675318c6718e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:43.203391 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-b5c97364-6324-47d1-ba2f-675318c6718e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] HTTP exception thrown: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b5c97364-6324-47d1-ba2f-675318c6718e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Request method failure captured: May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 HTTP/1.1 May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpiGKeDYisda5tPEvpavJeV8tPObvK_k0EXqdhLnXSuNBpdUtkF9FIyrQ2_Qlh8BhzGTBU42nl0ArEE3dSSwAw0qbwpuQ8FsSURbyYw9R7Jb5aXZ2Xu05_DHCQgdkXLBf-YKRpz0H6qO8tTpwOARxvGvZxXT-IR_uitMTxc9zfqGL-Y May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 6bf011cdf83d49df98c2e932eda352cd May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-DeleteServersTestJSON-1784039067 May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6bf011cdf83d49df98c2e932eda352cd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6bf011cdf83d49df98c2e932eda352cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6bf011cdf83d49df98c2e932eda352cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6bf011cdf83d49df98c2e932eda352cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-DeleteServersTestJSON-1784039067 May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 6bf011cdf83d49df98c2e932eda352cd May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-DeleteServersTestJSON-1784039067 May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-DeleteServersTestJSON-1784039067-project May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 45bef914dfcc4fb49dfc30dc1acdd799 May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-DeleteServersTestJSON-1784039067-project May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '1dd2b8c8-65db-470f-8ac9-503ffcd46431'} May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:48:43.205026 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:48:43.211708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:48:43.211708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:48:43.211708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:48:43.211708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:48:43.211708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:48:43.211708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. May 28 21:48:43.211708 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:48:43.211708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b5c97364-6324-47d1-ba2f-675318c6718e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Returning 404 to user: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:48:43.211708 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b5c97364-6324-47d1-ba2f-675318c6718e tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 404 len: 111 microversion: 2.1 time: 0.031102 May 28 21:48:43.211708 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3211/6381] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:43 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:48:43.220369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8d2e5cab-5613-44f0-adac-91a1359f5ea3 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:43.220900 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8d2e5cab-5613-44f0-adac-91a1359f5ea3 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:43.227902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d2e5cab-5613-44f0-adac-91a1359f5ea3 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:43.228373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d2e5cab-5613-44f0-adac-91a1359f5ea3 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:43.229161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d2e5cab-5613-44f0-adac-91a1359f5ea3 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:43.229623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8d2e5cab-5613-44f0-adac-91a1359f5ea3 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:43.242955 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-8d2e5cab-5613-44f0-adac-91a1359f5ea3 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] HTTP exception thrown: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8d2e5cab-5613-44f0-adac-91a1359f5ea3 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Request method failure captured: May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 HTTP/1.1 May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpiGKeDYisda5tPEvpavJeV8tPObvK_k0EXqdhLnXSuNBpdUtkF9FIyrQ2_Qlh8BhzGTBU42nl0ArEE3dSSwAw0qbwpuQ8FsSURbyYw9R7Jb5aXZ2Xu05_DHCQgdkXLBf-YKRpz0H6qO8tTpwOARxvGvZxXT-IR_uitMTxc9zfqGL-Y May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 6bf011cdf83d49df98c2e932eda352cd May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-DeleteServersTestJSON-1784039067 May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6bf011cdf83d49df98c2e932eda352cd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6bf011cdf83d49df98c2e932eda352cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6bf011cdf83d49df98c2e932eda352cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6bf011cdf83d49df98c2e932eda352cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-DeleteServersTestJSON-1784039067 May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 6bf011cdf83d49df98c2e932eda352cd May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-DeleteServersTestJSON-1784039067 May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-DeleteServersTestJSON-1784039067-project May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 45bef914dfcc4fb49dfc30dc1acdd799 May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-DeleteServersTestJSON-1784039067-project May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '1dd2b8c8-65db-470f-8ac9-503ffcd46431'} May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:48:43.244640 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:48:43.250011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. May 28 21:48:43.250011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:48:43.250011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:48:43.250011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:48:43.250011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:48:43.250011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:48:43.250011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:48:43.250011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:48:43.250011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:48:43.250011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. May 28 21:48:43.250011 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:48:43.250011 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8d2e5cab-5613-44f0-adac-91a1359f5ea3 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Returning 404 to user: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:48:43.250011 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8d2e5cab-5613-44f0-adac-91a1359f5ea3 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 404 len: 111 microversion: 2.1 time: 0.029649 May 28 21:48:43.250011 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3171/6382] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:48:43 2022] DELETE /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:48:43.254637 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3bd1b3dd-dd18-4eb2-baae-6020c8c3a0a0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:43.255261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3bd1b3dd-dd18-4eb2-baae-6020c8c3a0a0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] [instance: 1dd2b8c8-65db-470f-8ac9-503ffcd46431] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:43.263943 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3bd1b3dd-dd18-4eb2-baae-6020c8c3a0a0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:43.264414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3bd1b3dd-dd18-4eb2-baae-6020c8c3a0a0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:43.265197 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3bd1b3dd-dd18-4eb2-baae-6020c8c3a0a0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:43.265652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3bd1b3dd-dd18-4eb2-baae-6020c8c3a0a0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:43.279637 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-3bd1b3dd-dd18-4eb2-baae-6020c8c3a0a0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] HTTP exception thrown: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3bd1b3dd-dd18-4eb2-baae-6020c8c3a0a0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Request method failure captured: May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 HTTP/1.1 May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpiGKeDYisda5tPEvpavJeV8tPObvK_k0EXqdhLnXSuNBpdUtkF9FIyrQ2_Qlh8BhzGTBU42nl0ArEE3dSSwAw0qbwpuQ8FsSURbyYw9R7Jb5aXZ2Xu05_DHCQgdkXLBf-YKRpz0H6qO8tTpwOARxvGvZxXT-IR_uitMTxc9zfqGL-Y May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 6bf011cdf83d49df98c2e932eda352cd May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-DeleteServersTestJSON-1784039067 May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_6bf011cdf83d49df98c2e932eda352cd", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6bf011cdf83d49df98c2e932eda352cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/6bf011cdf83d49df98c2e932eda352cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/6bf011cdf83d49df98c2e932eda352cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-DeleteServersTestJSON-1784039067 May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 6bf011cdf83d49df98c2e932eda352cd May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-DeleteServersTestJSON-1784039067 May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-DeleteServersTestJSON-1784039067-project May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 45bef914dfcc4fb49dfc30dc1acdd799 May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-DeleteServersTestJSON-1784039067-project May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '1dd2b8c8-65db-470f-8ac9-503ffcd46431'} May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:48:43.281183 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:48:43.286323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:48:43.286323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:48:43.286323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:48:43.286323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:48:43.286323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:48:43.286323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. May 28 21:48:43.286323 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:48:43.286323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3bd1b3dd-dd18-4eb2-baae-6020c8c3a0a0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] Returning 404 to user: Instance 1dd2b8c8-65db-470f-8ac9-503ffcd46431 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:48:43.286323 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3bd1b3dd-dd18-4eb2-baae-6020c8c3a0a0 tempest-DeleteServersTestJSON-1784039067 tempest-DeleteServersTestJSON-1784039067-project] 10.222.0.33 "GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431" status: 404 len: 111 microversion: 2.1 time: 0.031841 May 28 21:48:43.286323 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3212/6383] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:43 2022] GET /compute/v2.1/servers/1dd2b8c8-65db-470f-8ac9-503ffcd46431 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:48:47.011606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-853728841", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "cfac1a52-65bd-4486-8cf7-34cc653d4730"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:48:47.062998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] validate_networks() for [('cfac1a52-65bd-4486-8cf7-34cc653d4730', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:48:47.397548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:48:47.398025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:48:47.398524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:48:47.398951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:48:47.399388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:48:47.408367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:47.411137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:47.411137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:47.411137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:47.427901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Getting quotas for project ded5b434b72f4a2ba885f887baa3c35a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:48:47.433247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Getting quotas for user c44b88da38234871ad6732dab5858246 and project ded5b434b72f4a2ba885f887baa3c35a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:48:47.445623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:48:47.448275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:48:47.607026 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9c36bb0d-0c91-458a-a27a-160c7d1c7235 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.713929 May 28 21:48:47.607694 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3172/6384] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:48:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:48:47.617604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-441fb90e-31d3-4ccf-9037-f718b4837000 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:47.619698 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-441fb90e-31d3-4ccf-9037-f718b4837000 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:47.678239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-441fb90e-31d3-4ccf-9037-f718b4837000 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:47.689313 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-441fb90e-31d3-4ccf-9037-f718b4837000 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1217 microversion: 2.1 time: 0.075519 May 28 21:48:47.689942 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3213/6385] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:47 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1217 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:48.707667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1e45d569-913a-4cdc-807f-a567bd65500a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:48.708407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1e45d569-913a-4cdc-807f-a567bd65500a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:48.715440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e45d569-913a-4cdc-807f-a567bd65500a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:48.715913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e45d569-913a-4cdc-807f-a567bd65500a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:48.716725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e45d569-913a-4cdc-807f-a567bd65500a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:48.717187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1e45d569-913a-4cdc-807f-a567bd65500a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:48.779049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1e45d569-913a-4cdc-807f-a567bd65500a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:48.786812 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1e45d569-913a-4cdc-807f-a567bd65500a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1221 microversion: 2.1 time: 0.083976 May 28 21:48:48.787412 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3173/6386] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:48 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1221 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:49.803621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-28cebebb-0ba7-4b78-8da0-182f5e7bf109 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:49.804278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-28cebebb-0ba7-4b78-8da0-182f5e7bf109 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:49.811364 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28cebebb-0ba7-4b78-8da0-182f5e7bf109 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:49.811857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28cebebb-0ba7-4b78-8da0-182f5e7bf109 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:49.812636 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28cebebb-0ba7-4b78-8da0-182f5e7bf109 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:49.813089 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-28cebebb-0ba7-4b78-8da0-182f5e7bf109 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:49.878061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-28cebebb-0ba7-4b78-8da0-182f5e7bf109 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:49.885880 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-28cebebb-0ba7-4b78-8da0-182f5e7bf109 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1277 microversion: 2.1 time: 0.086261 May 28 21:48:49.886557 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3214/6387] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:49 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:50.902839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-59364e68-64c6-4c53-9e29-7551baaaf10d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:50.903409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-59364e68-64c6-4c53-9e29-7551baaaf10d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:50.910509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59364e68-64c6-4c53-9e29-7551baaaf10d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:50.910977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59364e68-64c6-4c53-9e29-7551baaaf10d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:50.911768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59364e68-64c6-4c53-9e29-7551baaaf10d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:50.912225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59364e68-64c6-4c53-9e29-7551baaaf10d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:51.121810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-59364e68-64c6-4c53-9e29-7551baaaf10d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:51.129503 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-59364e68-64c6-4c53-9e29-7551baaaf10d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1317 microversion: 2.1 time: 0.230727 May 28 21:48:51.130277 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3174/6388] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:50 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:51.301928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-df6bea81-9793-4d4d-a0c9-4136bbb1f780 req-ef13326b-25b6-405a-9aee-613b1db8d3da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6242cd25-7bc5-4bff-842e-76d3afd96cba", "tag": "1b10a766-081d-49ce-b6b6-df586120fdf8"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:48:51.311268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-df6bea81-9793-4d4d-a0c9-4136bbb1f780 req-ef13326b-25b6-405a-9aee-613b1db8d3da service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:51.311832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-df6bea81-9793-4d4d-a0c9-4136bbb1f780 req-ef13326b-25b6-405a-9aee-613b1db8d3da service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:51.323694 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-df6bea81-9793-4d4d-a0c9-4136bbb1f780 req-ef13326b-25b6-405a-9aee-613b1db8d3da service nova] Creating event network-changed:1b10a766-081d-49ce-b6b6-df586120fdf8 for instance 6242cd25-7bc5-4bff-842e-76d3afd96cba on nch2-master-1 May 28 21:48:51.328761 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-df6bea81-9793-4d4d-a0c9-4136bbb1f780 req-ef13326b-25b6-405a-9aee-613b1db8d3da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030810 May 28 21:48:51.329375 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3215/6389] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:48:52.146790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8e10d479-64aa-4cbe-949e-cfa1cc85b88f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:52.147425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8e10d479-64aa-4cbe-949e-cfa1cc85b88f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:52.154388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e10d479-64aa-4cbe-949e-cfa1cc85b88f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:52.154865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e10d479-64aa-4cbe-949e-cfa1cc85b88f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:52.155646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e10d479-64aa-4cbe-949e-cfa1cc85b88f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:52.156099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8e10d479-64aa-4cbe-949e-cfa1cc85b88f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:52.380313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8e10d479-64aa-4cbe-949e-cfa1cc85b88f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:52.388230 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8e10d479-64aa-4cbe-949e-cfa1cc85b88f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1317 microversion: 2.1 time: 0.245307 May 28 21:48:52.388810 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3175/6390] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:52 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:53.405640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2e2feaba-f966-4f64-94c2-bbe43bb0bc54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:53.406377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2e2feaba-f966-4f64-94c2-bbe43bb0bc54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:53.413771 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e2feaba-f966-4f64-94c2-bbe43bb0bc54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:53.421032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e2feaba-f966-4f64-94c2-bbe43bb0bc54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:53.421032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e2feaba-f966-4f64-94c2-bbe43bb0bc54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:53.421032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2e2feaba-f966-4f64-94c2-bbe43bb0bc54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:53.544318 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2e2feaba-f966-4f64-94c2-bbe43bb0bc54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:53.551938 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2e2feaba-f966-4f64-94c2-bbe43bb0bc54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1317 microversion: 2.1 time: 0.150661 May 28 21:48:53.552519 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3216/6391] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:53 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:54.569781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-348f436f-461f-4722-98f1-adf7721321c1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:54.570438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-348f436f-461f-4722-98f1-adf7721321c1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:54.577406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-348f436f-461f-4722-98f1-adf7721321c1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:54.577891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-348f436f-461f-4722-98f1-adf7721321c1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:54.578672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-348f436f-461f-4722-98f1-adf7721321c1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:54.579124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-348f436f-461f-4722-98f1-adf7721321c1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:54.710386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-348f436f-461f-4722-98f1-adf7721321c1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:54.717915 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-348f436f-461f-4722-98f1-adf7721321c1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1317 microversion: 2.1 time: 0.152597 May 28 21:48:54.718492 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3176/6392] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:54 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:55.734211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-642ce414-2c6b-4d77-8491-26d755ad5647 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:55.734837 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-642ce414-2c6b-4d77-8491-26d755ad5647 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:55.742349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-642ce414-2c6b-4d77-8491-26d755ad5647 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:55.742812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-642ce414-2c6b-4d77-8491-26d755ad5647 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:55.743583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-642ce414-2c6b-4d77-8491-26d755ad5647 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:55.744031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-642ce414-2c6b-4d77-8491-26d755ad5647 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:55.869577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-642ce414-2c6b-4d77-8491-26d755ad5647 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:55.877150 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-642ce414-2c6b-4d77-8491-26d755ad5647 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1317 microversion: 2.1 time: 0.146895 May 28 21:48:55.877723 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3217/6393] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:55 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:56.894486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bc28fe3c-2347-4fa1-973d-44c4fa99f8ce tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:56.895123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bc28fe3c-2347-4fa1-973d-44c4fa99f8ce tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:56.901300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc28fe3c-2347-4fa1-973d-44c4fa99f8ce tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:56.901773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc28fe3c-2347-4fa1-973d-44c4fa99f8ce tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:56.902585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc28fe3c-2347-4fa1-973d-44c4fa99f8ce tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:56.903046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bc28fe3c-2347-4fa1-973d-44c4fa99f8ce tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:57.029800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bc28fe3c-2347-4fa1-973d-44c4fa99f8ce tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:57.037493 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bc28fe3c-2347-4fa1-973d-44c4fa99f8ce tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1317 microversion: 2.1 time: 0.147321 May 28 21:48:57.038721 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3177/6394] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:56 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:57.217830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-6bfbc8e6-3cfb-4a77-8c84-ae623351f036 req-a698f8d9-46c7-456e-9992-8a8447a23cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6242cd25-7bc5-4bff-842e-76d3afd96cba", "name": "network-vif-plugged", "status": "completed", "tag": "1b10a766-081d-49ce-b6b6-df586120fdf8"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:48:57.227071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6bfbc8e6-3cfb-4a77-8c84-ae623351f036 req-a698f8d9-46c7-456e-9992-8a8447a23cd5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:57.227531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-6bfbc8e6-3cfb-4a77-8c84-ae623351f036 req-a698f8d9-46c7-456e-9992-8a8447a23cd5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:57.238454 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-6bfbc8e6-3cfb-4a77-8c84-ae623351f036 req-a698f8d9-46c7-456e-9992-8a8447a23cd5 service nova] Creating event network-vif-plugged:1b10a766-081d-49ce-b6b6-df586120fdf8 for instance 6242cd25-7bc5-4bff-842e-76d3afd96cba on nch2-master-1 May 28 21:48:57.243392 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-6bfbc8e6-3cfb-4a77-8c84-ae623351f036 req-a698f8d9-46c7-456e-9992-8a8447a23cd5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029352 May 28 21:48:57.247228 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3218/6395] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:48:58.055342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-10c3b11d-6123-4b0f-99ab-d9011be094a8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:58.056039 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-10c3b11d-6123-4b0f-99ab-d9011be094a8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:58.058129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:48:58.058836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:48:58.068590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10c3b11d-6123-4b0f-99ab-d9011be094a8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:58.070066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10c3b11d-6123-4b0f-99ab-d9011be094a8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:58.071204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10c3b11d-6123-4b0f-99ab-d9011be094a8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:58.071918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-10c3b11d-6123-4b0f-99ab-d9011be094a8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:58.200963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-10c3b11d-6123-4b0f-99ab-d9011be094a8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:58.208509 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-10c3b11d-6123-4b0f-99ab-d9011be094a8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1317 microversion: 2.1 time: 0.157589 May 28 21:48:58.209343 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3178/6396] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:58 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:59.222653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:48:59.228158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-35c9d716-4e17-4d3a-be8b-9c817f11f265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:59.232687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-35c9d716-4e17-4d3a-be8b-9c817f11f265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:59.235297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35c9d716-4e17-4d3a-be8b-9c817f11f265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:59.235763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35c9d716-4e17-4d3a-be8b-9c817f11f265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:59.236539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35c9d716-4e17-4d3a-be8b-9c817f11f265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:59.236994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-35c9d716-4e17-4d3a-be8b-9c817f11f265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:59.367539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-35c9d716-4e17-4d3a-be8b-9c817f11f265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:59.375187 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-35c9d716-4e17-4d3a-be8b-9c817f11f265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1508 microversion: 2.1 time: 0.153535 May 28 21:48:59.375775 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3219/6397] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:59 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:59.392259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-09b9bdc2-e791-412c-b748-c09d30f05cdb tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:59.392928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-09b9bdc2-e791-412c-b748-c09d30f05cdb tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:59.400552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-09b9bdc2-e791-412c-b748-c09d30f05cdb tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:59.401020 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-09b9bdc2-e791-412c-b748-c09d30f05cdb tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:59.401805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-09b9bdc2-e791-412c-b748-c09d30f05cdb tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:59.402290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-09b9bdc2-e791-412c-b748-c09d30f05cdb tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:59.532737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-09b9bdc2-e791-412c-b748-c09d30f05cdb tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:59.541204 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-09b9bdc2-e791-412c-b748-c09d30f05cdb tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1508 microversion: 2.1 time: 0.153804 May 28 21:48:59.541826 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3179/6398] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:59 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:59.557008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9cf043f9-3999-4a68-84dd-aaa73bd4fa4c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:48:59.558159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9cf043f9-3999-4a68-84dd-aaa73bd4fa4c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:59.564227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9cf043f9-3999-4a68-84dd-aaa73bd4fa4c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:59.564621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9cf043f9-3999-4a68-84dd-aaa73bd4fa4c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:59.565389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9cf043f9-3999-4a68-84dd-aaa73bd4fa4c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:59.565830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9cf043f9-3999-4a68-84dd-aaa73bd4fa4c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:59.689400 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9cf043f9-3999-4a68-84dd-aaa73bd4fa4c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "PUT /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1080 microversion: 2.1 time: 0.136281 May 28 21:48:59.690114 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3220/6399] 10.222.0.33 () {60 vars in 1255 bytes} [Sat May 28 21:48:59 2022] PUT /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1080 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:59.704387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d6e68277-e94e-4973-938d-a0bd93b4981f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:59.705036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d6e68277-e94e-4973-938d-a0bd93b4981f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:59.712322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6e68277-e94e-4973-938d-a0bd93b4981f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:59.712796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6e68277-e94e-4973-938d-a0bd93b4981f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:59.713584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6e68277-e94e-4973-938d-a0bd93b4981f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:59.714086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d6e68277-e94e-4973-938d-a0bd93b4981f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:59.842423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d6e68277-e94e-4973-938d-a0bd93b4981f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:48:59.850131 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d6e68277-e94e-4973-938d-a0bd93b4981f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1506 microversion: 2.1 time: 0.149748 May 28 21:48:59.851038 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3180/6400] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:59 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:48:59.866571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9eaba5d5-1f2a-47f0-9474-466c27d3bc8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:48:59.868558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9eaba5d5-1f2a-47f0-9474-466c27d3bc8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:48:59.873374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9eaba5d5-1f2a-47f0-9474-466c27d3bc8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:59.873862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9eaba5d5-1f2a-47f0-9474-466c27d3bc8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:48:59.874635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9eaba5d5-1f2a-47f0-9474-466c27d3bc8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:48:59.875079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9eaba5d5-1f2a-47f0-9474-466c27d3bc8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:00.005898 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9eaba5d5-1f2a-47f0-9474-466c27d3bc8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:00.014089 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9eaba5d5-1f2a-47f0-9474-466c27d3bc8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1506 microversion: 2.1 time: 0.151376 May 28 21:49:00.014651 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3221/6401] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:48:59 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:00.030417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d0f0b443-8b3b-41ea-82a4-9f05dfad6ab4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:49:00.031496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d0f0b443-8b3b-41ea-82a4-9f05dfad6ab4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:00.037554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0f0b443-8b3b-41ea-82a4-9f05dfad6ab4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:00.038166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0f0b443-8b3b-41ea-82a4-9f05dfad6ab4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:00.038942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0f0b443-8b3b-41ea-82a4-9f05dfad6ab4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:00.039400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d0f0b443-8b3b-41ea-82a4-9f05dfad6ab4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:00.067669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d0f0b443-8b3b-41ea-82a4-9f05dfad6ab4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:00.074489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d0f0b443-8b3b-41ea-82a4-9f05dfad6ab4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Old instance type m1.heat2, new instance type m1.heat {{(pid=143128) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 21:49:00.081038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d0f0b443-8b3b-41ea-82a4-9f05dfad6ab4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:49:00.081789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d0f0b443-8b3b-41ea-82a4-9f05dfad6ab4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:49:00.082388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d0f0b443-8b3b-41ea-82a4-9f05dfad6ab4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:49:00.082836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d0f0b443-8b3b-41ea-82a4-9f05dfad6ab4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:49:00.083273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d0f0b443-8b3b-41ea-82a4-9f05dfad6ab4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:49:00.118570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:49:00.299680 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d0f0b443-8b3b-41ea-82a4-9f05dfad6ab4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "POST /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba/action" status: 202 len: 0 microversion: 2.1 time: 0.273064 May 28 21:49:00.300301 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3181/6402] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:49:00 2022] POST /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:49:00.309042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-788a346b-7ea0-4b41-816e-1d0872d26361 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:00.309763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-788a346b-7ea0-4b41-816e-1d0872d26361 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:00.317246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-788a346b-7ea0-4b41-816e-1d0872d26361 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:00.317821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-788a346b-7ea0-4b41-816e-1d0872d26361 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:00.318670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-788a346b-7ea0-4b41-816e-1d0872d26361 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:00.320309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-788a346b-7ea0-4b41-816e-1d0872d26361 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:00.450657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-788a346b-7ea0-4b41-816e-1d0872d26361 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:00.458583 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-788a346b-7ea0-4b41-816e-1d0872d26361 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1517 microversion: 2.1 time: 0.153484 May 28 21:49:00.459656 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3222/6403] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:00 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:01.476914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b37806d6-7b95-4cdf-bade-fe21dbf58f45 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:01.477566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b37806d6-7b95-4cdf-bade-fe21dbf58f45 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:01.483859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b37806d6-7b95-4cdf-bade-fe21dbf58f45 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:01.484332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b37806d6-7b95-4cdf-bade-fe21dbf58f45 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:01.485123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b37806d6-7b95-4cdf-bade-fe21dbf58f45 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:01.485589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b37806d6-7b95-4cdf-bade-fe21dbf58f45 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:01.621089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b37806d6-7b95-4cdf-bade-fe21dbf58f45 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:01.629110 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b37806d6-7b95-4cdf-bade-fe21dbf58f45 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1517 microversion: 2.1 time: 0.157805 May 28 21:49:01.629779 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3182/6404] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:01 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:02.646315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bb58ee1e-2dfa-4993-b965-a06f4c77e533 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:02.647036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bb58ee1e-2dfa-4993-b965-a06f4c77e533 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:02.654351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb58ee1e-2dfa-4993-b965-a06f4c77e533 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:02.654817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb58ee1e-2dfa-4993-b965-a06f4c77e533 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:02.655607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb58ee1e-2dfa-4993-b965-a06f4c77e533 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:02.656059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bb58ee1e-2dfa-4993-b965-a06f4c77e533 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:02.672269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:49:02.869966 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bb58ee1e-2dfa-4993-b965-a06f4c77e533 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:02.877950 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bb58ee1e-2dfa-4993-b965-a06f4c77e533 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1517 microversion: 2.1 time: 0.235536 May 28 21:49:02.878527 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3223/6405] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:02 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1517 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:03.893936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0edc358f-28b8-4a95-82ce-89c7bafe3b9f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:03.894735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0edc358f-28b8-4a95-82ce-89c7bafe3b9f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:03.902265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0edc358f-28b8-4a95-82ce-89c7bafe3b9f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:03.902735 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0edc358f-28b8-4a95-82ce-89c7bafe3b9f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:03.903522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0edc358f-28b8-4a95-82ce-89c7bafe3b9f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:03.903977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0edc358f-28b8-4a95-82ce-89c7bafe3b9f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:04.038906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0edc358f-28b8-4a95-82ce-89c7bafe3b9f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:04.046516 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0edc358f-28b8-4a95-82ce-89c7bafe3b9f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.156480 May 28 21:49:04.047101 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3183/6406] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:03 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:05.068781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-184cb5c2-64ee-4002-93e6-c616807b0ea0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:05.069469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-184cb5c2-64ee-4002-93e6-c616807b0ea0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:05.072456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:49:05.077667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-184cb5c2-64ee-4002-93e6-c616807b0ea0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:05.078157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-184cb5c2-64ee-4002-93e6-c616807b0ea0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:05.078979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-184cb5c2-64ee-4002-93e6-c616807b0ea0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:05.079496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-184cb5c2-64ee-4002-93e6-c616807b0ea0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:05.213792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-184cb5c2-64ee-4002-93e6-c616807b0ea0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:05.221863 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-184cb5c2-64ee-4002-93e6-c616807b0ea0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.157344 May 28 21:49:05.222448 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3224/6407] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:05 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:06.239595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-da96abea-c542-45d8-8778-59c2490bb20c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:06.240232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-da96abea-c542-45d8-8778-59c2490bb20c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:06.247806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da96abea-c542-45d8-8778-59c2490bb20c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:06.249568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da96abea-c542-45d8-8778-59c2490bb20c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:06.249568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da96abea-c542-45d8-8778-59c2490bb20c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:06.249568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da96abea-c542-45d8-8778-59c2490bb20c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:06.377981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-da96abea-c542-45d8-8778-59c2490bb20c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:06.386203 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-da96abea-c542-45d8-8778-59c2490bb20c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.150605 May 28 21:49:06.387174 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3184/6408] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:06 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:07.403158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d6134641-585d-478f-95e4-c34262b7c6e2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:07.403723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d6134641-585d-478f-95e4-c34262b7c6e2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:07.410745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6134641-585d-478f-95e4-c34262b7c6e2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:07.411202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6134641-585d-478f-95e4-c34262b7c6e2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:07.411967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6134641-585d-478f-95e4-c34262b7c6e2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:07.412413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d6134641-585d-478f-95e4-c34262b7c6e2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:07.546651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d6134641-585d-478f-95e4-c34262b7c6e2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:07.554346 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d6134641-585d-478f-95e4-c34262b7c6e2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.155233 May 28 21:49:07.555011 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3225/6409] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:07 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:08.572744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e4d53a0d-401c-4d30-a2ca-15c1dd285e79 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:08.573412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e4d53a0d-401c-4d30-a2ca-15c1dd285e79 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:08.576361 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:49:08.581163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4d53a0d-401c-4d30-a2ca-15c1dd285e79 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:08.581631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4d53a0d-401c-4d30-a2ca-15c1dd285e79 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:08.582440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4d53a0d-401c-4d30-a2ca-15c1dd285e79 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:08.582893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4d53a0d-401c-4d30-a2ca-15c1dd285e79 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:08.716588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e4d53a0d-401c-4d30-a2ca-15c1dd285e79 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:08.724287 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e4d53a0d-401c-4d30-a2ca-15c1dd285e79 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.156476 May 28 21:49:08.724873 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3185/6410] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:08 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:09.742492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fe6f8530-db00-436a-a4d7-cc9e94c7012a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:09.743122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fe6f8530-db00-436a-a4d7-cc9e94c7012a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:09.750308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe6f8530-db00-436a-a4d7-cc9e94c7012a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:09.750780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe6f8530-db00-436a-a4d7-cc9e94c7012a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:09.751572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe6f8530-db00-436a-a4d7-cc9e94c7012a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:09.752057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe6f8530-db00-436a-a4d7-cc9e94c7012a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:09.883222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fe6f8530-db00-436a-a4d7-cc9e94c7012a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:09.890823 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fe6f8530-db00-436a-a4d7-cc9e94c7012a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.152914 May 28 21:49:09.891393 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3226/6411] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:09 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:10.908387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6c6c3133-88eb-483f-962b-144060d070bf tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:10.909019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6c6c3133-88eb-483f-962b-144060d070bf tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:10.916196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c6c3133-88eb-483f-962b-144060d070bf tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:10.916669 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c6c3133-88eb-483f-962b-144060d070bf tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:10.917448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c6c3133-88eb-483f-962b-144060d070bf tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:10.917932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c6c3133-88eb-483f-962b-144060d070bf tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:11.051038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6c6c3133-88eb-483f-962b-144060d070bf tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:11.058752 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6c6c3133-88eb-483f-962b-144060d070bf tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.154328 May 28 21:49:11.059636 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3186/6412] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:10 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:12.076237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-edf6388b-1c53-4d7d-98d6-df434dd5cc70 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:12.076859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-edf6388b-1c53-4d7d-98d6-df434dd5cc70 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:12.084265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edf6388b-1c53-4d7d-98d6-df434dd5cc70 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:12.084720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edf6388b-1c53-4d7d-98d6-df434dd5cc70 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:12.085481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edf6388b-1c53-4d7d-98d6-df434dd5cc70 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:12.085959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edf6388b-1c53-4d7d-98d6-df434dd5cc70 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:12.216426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-edf6388b-1c53-4d7d-98d6-df434dd5cc70 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:12.224580 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-edf6388b-1c53-4d7d-98d6-df434dd5cc70 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.152262 May 28 21:49:12.225164 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3227/6413] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:12 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:13.241313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-664c214c-f0c3-4380-9909-2e04cae8740f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:13.241979 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-664c214c-f0c3-4380-9909-2e04cae8740f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:13.249671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-664c214c-f0c3-4380-9909-2e04cae8740f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:13.250166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-664c214c-f0c3-4380-9909-2e04cae8740f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:13.250952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-664c214c-f0c3-4380-9909-2e04cae8740f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:13.251437 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-664c214c-f0c3-4380-9909-2e04cae8740f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:13.387893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-664c214c-f0c3-4380-9909-2e04cae8740f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:13.395482 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-664c214c-f0c3-4380-9909-2e04cae8740f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.158587 May 28 21:49:13.396055 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3187/6414] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:13 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:14.412874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5b20e9be-dde7-432a-b247-8d09c503acde tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:14.413608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5b20e9be-dde7-432a-b247-8d09c503acde tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:14.421192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b20e9be-dde7-432a-b247-8d09c503acde tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:14.421649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b20e9be-dde7-432a-b247-8d09c503acde tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:14.422446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b20e9be-dde7-432a-b247-8d09c503acde tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:14.422889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b20e9be-dde7-432a-b247-8d09c503acde tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:14.582208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5b20e9be-dde7-432a-b247-8d09c503acde tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:14.589953 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5b20e9be-dde7-432a-b247-8d09c503acde tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.181416 May 28 21:49:14.590531 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3228/6415] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:14 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:15.606740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f7d4c275-f804-47b2-9229-339cb6be9e20 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:15.607275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f7d4c275-f804-47b2-9229-339cb6be9e20 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:15.614393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7d4c275-f804-47b2-9229-339cb6be9e20 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:15.614857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7d4c275-f804-47b2-9229-339cb6be9e20 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:15.615629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7d4c275-f804-47b2-9229-339cb6be9e20 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:15.616079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f7d4c275-f804-47b2-9229-339cb6be9e20 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:15.743650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f7d4c275-f804-47b2-9229-339cb6be9e20 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:15.751233 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f7d4c275-f804-47b2-9229-339cb6be9e20 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.148445 May 28 21:49:15.751836 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3188/6416] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:15 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:16.769358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-21e3aac4-46a9-42e7-9137-9075b96e78e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:16.770011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-21e3aac4-46a9-42e7-9137-9075b96e78e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:16.776991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21e3aac4-46a9-42e7-9137-9075b96e78e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:16.777445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21e3aac4-46a9-42e7-9137-9075b96e78e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:16.778232 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21e3aac4-46a9-42e7-9137-9075b96e78e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:16.778677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21e3aac4-46a9-42e7-9137-9075b96e78e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:16.910420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-21e3aac4-46a9-42e7-9137-9075b96e78e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:16.918486 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-21e3aac4-46a9-42e7-9137-9075b96e78e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.153033 May 28 21:49:16.919068 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3229/6417] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:16 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:17.935148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b0193f73-2f2e-4d2e-a969-df9eac9362b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:17.935802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b0193f73-2f2e-4d2e-a969-df9eac9362b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:17.942841 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0193f73-2f2e-4d2e-a969-df9eac9362b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:17.943302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0193f73-2f2e-4d2e-a969-df9eac9362b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:17.944073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0193f73-2f2e-4d2e-a969-df9eac9362b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:17.944525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0193f73-2f2e-4d2e-a969-df9eac9362b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:18.074281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b0193f73-2f2e-4d2e-a969-df9eac9362b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:18.081997 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b0193f73-2f2e-4d2e-a969-df9eac9362b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.150783 May 28 21:49:18.082581 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3189/6418] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:17 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:19.098125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4997bd32-05b8-42bc-9cf7-9d8fd842a5de tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:19.098750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4997bd32-05b8-42bc-9cf7-9d8fd842a5de tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:19.106230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4997bd32-05b8-42bc-9cf7-9d8fd842a5de tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:19.106693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4997bd32-05b8-42bc-9cf7-9d8fd842a5de tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:19.107459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4997bd32-05b8-42bc-9cf7-9d8fd842a5de tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:19.107903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4997bd32-05b8-42bc-9cf7-9d8fd842a5de tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:19.234995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4997bd32-05b8-42bc-9cf7-9d8fd842a5de tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:19.242524 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4997bd32-05b8-42bc-9cf7-9d8fd842a5de tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.148368 May 28 21:49:19.243099 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3230/6419] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:19 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:20.259156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4f24626d-24db-4558-ad8e-a8594ee0bc4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:20.259799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4f24626d-24db-4558-ad8e-a8594ee0bc4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:20.266966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f24626d-24db-4558-ad8e-a8594ee0bc4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:20.267438 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f24626d-24db-4558-ad8e-a8594ee0bc4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:20.268229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f24626d-24db-4558-ad8e-a8594ee0bc4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:20.268688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4f24626d-24db-4558-ad8e-a8594ee0bc4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:20.403105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4f24626d-24db-4558-ad8e-a8594ee0bc4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:20.410826 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4f24626d-24db-4558-ad8e-a8594ee0bc4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.156296 May 28 21:49:20.411407 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3190/6420] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:20 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:21.428079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1c4ac2f0-a901-4484-912d-98de755f5b15 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:21.428699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1c4ac2f0-a901-4484-912d-98de755f5b15 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:21.435832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1c4ac2f0-a901-4484-912d-98de755f5b15 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:21.436288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1c4ac2f0-a901-4484-912d-98de755f5b15 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:21.437084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1c4ac2f0-a901-4484-912d-98de755f5b15 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:21.437528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1c4ac2f0-a901-4484-912d-98de755f5b15 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:21.567158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1c4ac2f0-a901-4484-912d-98de755f5b15 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:21.575112 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1c4ac2f0-a901-4484-912d-98de755f5b15 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.150979 May 28 21:49:21.575692 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3231/6421] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:21 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:22.591956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-49fdd720-9d31-4476-a5d9-4cb294aafd61 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:22.592601 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-49fdd720-9d31-4476-a5d9-4cb294aafd61 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:22.599689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-49fdd720-9d31-4476-a5d9-4cb294aafd61 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:22.600159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-49fdd720-9d31-4476-a5d9-4cb294aafd61 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:22.600939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-49fdd720-9d31-4476-a5d9-4cb294aafd61 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:22.601939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-49fdd720-9d31-4476-a5d9-4cb294aafd61 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:22.736638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-49fdd720-9d31-4476-a5d9-4cb294aafd61 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:22.744833 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-49fdd720-9d31-4476-a5d9-4cb294aafd61 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.156837 May 28 21:49:22.745417 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3191/6422] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:22 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:23.762598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d23b6c8a-024e-429b-a17f-3944e986be44 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:23.763147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d23b6c8a-024e-429b-a17f-3944e986be44 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:23.770283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d23b6c8a-024e-429b-a17f-3944e986be44 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:23.772137 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d23b6c8a-024e-429b-a17f-3944e986be44 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:23.772137 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d23b6c8a-024e-429b-a17f-3944e986be44 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:23.772137 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d23b6c8a-024e-429b-a17f-3944e986be44 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:23.902252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d23b6c8a-024e-429b-a17f-3944e986be44 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:23.909788 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d23b6c8a-024e-429b-a17f-3944e986be44 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.151289 May 28 21:49:23.910402 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3232/6423] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:23 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:24.926143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cf41e08c-1523-4464-8403-0dad351a9646 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:24.926782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cf41e08c-1523-4464-8403-0dad351a9646 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:24.934415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf41e08c-1523-4464-8403-0dad351a9646 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:24.934887 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf41e08c-1523-4464-8403-0dad351a9646 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:24.935672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf41e08c-1523-4464-8403-0dad351a9646 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:24.936131 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf41e08c-1523-4464-8403-0dad351a9646 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:25.125586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cf41e08c-1523-4464-8403-0dad351a9646 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:25.133246 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cf41e08c-1523-4464-8403-0dad351a9646 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.211089 May 28 21:49:25.133832 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3192/6424] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:24 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:26.150854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-72080bba-9e09-48f9-888a-ae5cfc9c8870 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:26.151481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-72080bba-9e09-48f9-888a-ae5cfc9c8870 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:26.157867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72080bba-9e09-48f9-888a-ae5cfc9c8870 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:26.158372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72080bba-9e09-48f9-888a-ae5cfc9c8870 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:26.159145 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72080bba-9e09-48f9-888a-ae5cfc9c8870 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:26.159587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72080bba-9e09-48f9-888a-ae5cfc9c8870 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:26.345262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-72080bba-9e09-48f9-888a-ae5cfc9c8870 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:26.352885 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-72080bba-9e09-48f9-888a-ae5cfc9c8870 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.206605 May 28 21:49:26.353465 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3233/6425] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:26 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:27.370776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9ee37031-67ac-4a95-ade2-ed2216d4bac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:27.371328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9ee37031-67ac-4a95-ade2-ed2216d4bac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:27.377742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ee37031-67ac-4a95-ade2-ed2216d4bac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:27.378240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ee37031-67ac-4a95-ade2-ed2216d4bac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:27.379018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ee37031-67ac-4a95-ade2-ed2216d4bac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:27.379469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ee37031-67ac-4a95-ade2-ed2216d4bac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:27.510147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9ee37031-67ac-4a95-ade2-ed2216d4bac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:27.518659 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9ee37031-67ac-4a95-ade2-ed2216d4bac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.151684 May 28 21:49:27.518659 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3193/6426] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:27 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:28.535390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5385f1b9-837e-405b-bf76-5850ed4a867a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:28.536016 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5385f1b9-837e-405b-bf76-5850ed4a867a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:28.543161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5385f1b9-837e-405b-bf76-5850ed4a867a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:28.543627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5385f1b9-837e-405b-bf76-5850ed4a867a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:28.544403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5385f1b9-837e-405b-bf76-5850ed4a867a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:28.544850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5385f1b9-837e-405b-bf76-5850ed4a867a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:28.675431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5385f1b9-837e-405b-bf76-5850ed4a867a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:28.683049 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5385f1b9-837e-405b-bf76-5850ed4a867a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.151650 May 28 21:49:28.683631 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3234/6427] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:28 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:29.700715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f5b1d12e-c075-4c6a-8f8b-7d5e5703164f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:29.701372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f5b1d12e-c075-4c6a-8f8b-7d5e5703164f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:29.708379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5b1d12e-c075-4c6a-8f8b-7d5e5703164f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:29.709102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5b1d12e-c075-4c6a-8f8b-7d5e5703164f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:29.709906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5b1d12e-c075-4c6a-8f8b-7d5e5703164f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:29.710364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5b1d12e-c075-4c6a-8f8b-7d5e5703164f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:29.840031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f5b1d12e-c075-4c6a-8f8b-7d5e5703164f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:29.847702 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f5b1d12e-c075-4c6a-8f8b-7d5e5703164f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1522 microversion: 2.1 time: 0.150933 May 28 21:49:29.848280 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3194/6428] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:29 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:30.864805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b1d917c9-c059-4261-8a0a-a27388eb727a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:30.865428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b1d917c9-c059-4261-8a0a-a27388eb727a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:30.872485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1d917c9-c059-4261-8a0a-a27388eb727a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:30.872876 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1d917c9-c059-4261-8a0a-a27388eb727a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:30.873645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1d917c9-c059-4261-8a0a-a27388eb727a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:30.874111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1d917c9-c059-4261-8a0a-a27388eb727a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:30.992295 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-d63b79a1-c201-493f-8198-9b96daa919ea req-30208822-02e5-4169-bc2e-f61ec9f3b27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6242cd25-7bc5-4bff-842e-76d3afd96cba", "name": "network-vif-unplugged", "status": "completed", "tag": "1b10a766-081d-49ce-b6b6-df586120fdf8"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:49:31.001729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d63b79a1-c201-493f-8198-9b96daa919ea req-30208822-02e5-4169-bc2e-f61ec9f3b27f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:31.004374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d63b79a1-c201-493f-8198-9b96daa919ea req-30208822-02e5-4169-bc2e-f61ec9f3b27f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:31.006280 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:49:31.008870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b1d917c9-c059-4261-8a0a-a27388eb727a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:31.014950 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-d63b79a1-c201-493f-8198-9b96daa919ea req-30208822-02e5-4169-bc2e-f61ec9f3b27f service nova] Creating event network-vif-unplugged:1b10a766-081d-49ce-b6b6-df586120fdf8 for instance 6242cd25-7bc5-4bff-842e-76d3afd96cba on nch1-master-1 May 28 21:49:31.016818 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b1d917c9-c059-4261-8a0a-a27388eb727a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1521 microversion: 2.1 time: 0.155922 May 28 21:49:31.017406 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3235/6429] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:30 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:31.020750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-d63b79a1-c201-493f-8198-9b96daa919ea req-30208822-02e5-4169-bc2e-f61ec9f3b27f service nova] Instance 6242cd25-7bc5-4bff-842e-76d3afd96cba is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:49:31.032311 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-d63b79a1-c201-493f-8198-9b96daa919ea req-30208822-02e5-4169-bc2e-f61ec9f3b27f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044002 May 28 21:49:31.032979 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3195/6430] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:49:32.035004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ed9d1231-54bb-48ad-86a1-98454cd9fc2b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:32.037119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ed9d1231-54bb-48ad-86a1-98454cd9fc2b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:32.043432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed9d1231-54bb-48ad-86a1-98454cd9fc2b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:32.043899 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed9d1231-54bb-48ad-86a1-98454cd9fc2b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:32.044676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed9d1231-54bb-48ad-86a1-98454cd9fc2b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:32.045126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ed9d1231-54bb-48ad-86a1-98454cd9fc2b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:32.176519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ed9d1231-54bb-48ad-86a1-98454cd9fc2b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:32.184361 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ed9d1231-54bb-48ad-86a1-98454cd9fc2b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1521 microversion: 2.1 time: 0.153335 May 28 21:49:32.184974 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3236/6431] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:32 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:33.048101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-aa135d52-f022-43b5-891e-ed905c42a3e2 req-d970bbcc-3e34-44bc-89ec-daf3d6a65c82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6242cd25-7bc5-4bff-842e-76d3afd96cba", "tag": "1b10a766-081d-49ce-b6b6-df586120fdf8"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:49:33.057621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-aa135d52-f022-43b5-891e-ed905c42a3e2 req-d970bbcc-3e34-44bc-89ec-daf3d6a65c82 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:33.058159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-aa135d52-f022-43b5-891e-ed905c42a3e2 req-d970bbcc-3e34-44bc-89ec-daf3d6a65c82 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:33.069744 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-aa135d52-f022-43b5-891e-ed905c42a3e2 req-d970bbcc-3e34-44bc-89ec-daf3d6a65c82 service nova] Creating event network-changed:1b10a766-081d-49ce-b6b6-df586120fdf8 for instance 6242cd25-7bc5-4bff-842e-76d3afd96cba on nch1-master-1 May 28 21:49:33.075139 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-aa135d52-f022-43b5-891e-ed905c42a3e2 req-d970bbcc-3e34-44bc-89ec-daf3d6a65c82 service nova] Instance 6242cd25-7bc5-4bff-842e-76d3afd96cba is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:49:33.086453 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-aa135d52-f022-43b5-891e-ed905c42a3e2 req-d970bbcc-3e34-44bc-89ec-daf3d6a65c82 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043150 May 28 21:49:33.087062 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3196/6432] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:49:33.200916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-69698338-1ecd-44a9-9acf-531cf9fd090f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:33.201569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-69698338-1ecd-44a9-9acf-531cf9fd090f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:33.209947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69698338-1ecd-44a9-9acf-531cf9fd090f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:33.210466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69698338-1ecd-44a9-9acf-531cf9fd090f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:33.211262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69698338-1ecd-44a9-9acf-531cf9fd090f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:33.211717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-69698338-1ecd-44a9-9acf-531cf9fd090f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:33.217732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=82 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:49:33.425387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-69698338-1ecd-44a9-9acf-531cf9fd090f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:33.433285 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-69698338-1ecd-44a9-9acf-531cf9fd090f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1519 microversion: 2.1 time: 0.236539 May 28 21:49:33.433974 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3237/6433] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:33 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1519 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:34.452726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-40e0b656-1720-4699-b737-7dc8b3464e4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:34.453400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-40e0b656-1720-4699-b737-7dc8b3464e4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:34.460838 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40e0b656-1720-4699-b737-7dc8b3464e4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:34.461310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40e0b656-1720-4699-b737-7dc8b3464e4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:34.462187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40e0b656-1720-4699-b737-7dc8b3464e4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:34.462648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-40e0b656-1720-4699-b737-7dc8b3464e4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:34.592117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-40e0b656-1720-4699-b737-7dc8b3464e4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:34.599720 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-40e0b656-1720-4699-b737-7dc8b3464e4d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1516 microversion: 2.1 time: 0.152197 May 28 21:49:34.600304 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3197/6434] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:34 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:34.617302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ddf5e98b-a330-4e54-afe0-68e585009632 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:49:34.617860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ddf5e98b-a330-4e54-afe0-68e585009632 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:34.624950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddf5e98b-a330-4e54-afe0-68e585009632 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:34.625414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddf5e98b-a330-4e54-afe0-68e585009632 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:34.626304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddf5e98b-a330-4e54-afe0-68e585009632 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:34.626755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ddf5e98b-a330-4e54-afe0-68e585009632 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:34.801403 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ddf5e98b-a330-4e54-afe0-68e585009632 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "POST /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba/action" status: 204 len: 0 microversion: 2.1 time: 0.188372 May 28 21:49:34.802212 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3238/6435] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:49:34 2022] POST /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba/action => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:49:34.811010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d79e79a7-74ea-4db6-aa7d-990af6d6bb92 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:34.811654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d79e79a7-74ea-4db6-aa7d-990af6d6bb92 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:34.817903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d79e79a7-74ea-4db6-aa7d-990af6d6bb92 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:34.818398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d79e79a7-74ea-4db6-aa7d-990af6d6bb92 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:34.819167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d79e79a7-74ea-4db6-aa7d-990af6d6bb92 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:34.819626 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d79e79a7-74ea-4db6-aa7d-990af6d6bb92 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:35.017917 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d79e79a7-74ea-4db6-aa7d-990af6d6bb92 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:35.026267 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d79e79a7-74ea-4db6-aa7d-990af6d6bb92 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1516 microversion: 2.1 time: 0.219036 May 28 21:49:35.026857 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3198/6436] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:34 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1516 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:35.203766 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 21:49:35.203974 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 21:49:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 21:49:36.044468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e6887621-5625-461c-9277-a374b354842b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:36.045185 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e6887621-5625-461c-9277-a374b354842b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:36.048076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=30 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:49:36.053212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6887621-5625-461c-9277-a374b354842b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:36.053672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6887621-5625-461c-9277-a374b354842b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:36.055142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6887621-5625-461c-9277-a374b354842b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:36.055597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6887621-5625-461c-9277-a374b354842b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:36.140153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-f1bca88a-4049-4131-92e0-839b55b01269 req-20286438-18e2-47bd-99a8-b9099b4294cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6242cd25-7bc5-4bff-842e-76d3afd96cba", "name": "network-vif-plugged", "status": "completed", "tag": "1b10a766-081d-49ce-b6b6-df586120fdf8"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:49:36.156919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f1bca88a-4049-4131-92e0-839b55b01269 req-20286438-18e2-47bd-99a8-b9099b4294cb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:36.167226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f1bca88a-4049-4131-92e0-839b55b01269 req-20286438-18e2-47bd-99a8-b9099b4294cb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:36.183350 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-f1bca88a-4049-4131-92e0-839b55b01269 req-20286438-18e2-47bd-99a8-b9099b4294cb service nova] Creating event network-vif-plugged:1b10a766-081d-49ce-b6b6-df586120fdf8 for instance 6242cd25-7bc5-4bff-842e-76d3afd96cba on nch1-master-1 May 28 21:49:36.189541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-f1bca88a-4049-4131-92e0-839b55b01269 req-20286438-18e2-47bd-99a8-b9099b4294cb service nova] Instance 6242cd25-7bc5-4bff-842e-76d3afd96cba is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:49:36.201392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e6887621-5625-461c-9277-a374b354842b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:36.203916 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-f1bca88a-4049-4131-92e0-839b55b01269 req-20286438-18e2-47bd-99a8-b9099b4294cb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136335 May 28 21:49:36.207722 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3199/6437] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:49:36.212514 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e6887621-5625-461c-9277-a374b354842b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1516 microversion: 2.1 time: 0.172051 May 28 21:49:36.213200 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3239/6438] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:36 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:49:37.231477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cf4f98e0-00eb-4650-8953-8acd98b26133 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:37.232200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cf4f98e0-00eb-4650-8953-8acd98b26133 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:37.238583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf4f98e0-00eb-4650-8953-8acd98b26133 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:37.239050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf4f98e0-00eb-4650-8953-8acd98b26133 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:37.239829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf4f98e0-00eb-4650-8953-8acd98b26133 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:37.240287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cf4f98e0-00eb-4650-8953-8acd98b26133 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:37.370882 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cf4f98e0-00eb-4650-8953-8acd98b26133 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:37.378598 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cf4f98e0-00eb-4650-8953-8acd98b26133 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1508 microversion: 2.1 time: 0.152866 May 28 21:49:37.379175 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3200/6439] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:37 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:37.394427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-163bea42-46a5-49b0-809d-1c712bf8c0ee tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:37.395063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-163bea42-46a5-49b0-809d-1c712bf8c0ee tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:37.402563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-163bea42-46a5-49b0-809d-1c712bf8c0ee tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:37.403059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-163bea42-46a5-49b0-809d-1c712bf8c0ee tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:37.403841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-163bea42-46a5-49b0-809d-1c712bf8c0ee tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:37.404294 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-163bea42-46a5-49b0-809d-1c712bf8c0ee tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:37.532461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-163bea42-46a5-49b0-809d-1c712bf8c0ee tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:37.540270 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-163bea42-46a5-49b0-809d-1c712bf8c0ee tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1508 microversion: 2.1 time: 0.149738 May 28 21:49:37.540879 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3240/6440] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:37 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:37.555955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-90319086-d935-439d-b714-2ab159793958 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:37.556597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-90319086-d935-439d-b714-2ab159793958 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:37.562752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90319086-d935-439d-b714-2ab159793958 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:37.563222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90319086-d935-439d-b714-2ab159793958 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:37.564005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90319086-d935-439d-b714-2ab159793958 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:37.564465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-90319086-d935-439d-b714-2ab159793958 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:37.693387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-90319086-d935-439d-b714-2ab159793958 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:37.703516 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-90319086-d935-439d-b714-2ab159793958 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 200 len: 1508 microversion: 2.1 time: 0.151413 May 28 21:49:37.704096 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3201/6441] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:37 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:37.720125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8e5981ff-e149-46f9-a5f3-59e0de1d3e66 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:37.720657 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8e5981ff-e149-46f9-a5f3-59e0de1d3e66 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:37.726833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e5981ff-e149-46f9-a5f3-59e0de1d3e66 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:37.727327 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e5981ff-e149-46f9-a5f3-59e0de1d3e66 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:37.728086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e5981ff-e149-46f9-a5f3-59e0de1d3e66 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:37.728709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e5981ff-e149-46f9-a5f3-59e0de1d3e66 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:37.753340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8e5981ff-e149-46f9-a5f3-59e0de1d3e66 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:49:38.011616 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8e5981ff-e149-46f9-a5f3-59e0de1d3e66 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 204 len: 0 microversion: 2.1 time: 0.295023 May 28 21:49:38.012152 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3241/6442] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:49:37 2022] DELETE /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:49:38.066827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1936009215", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "cfac1a52-65bd-4486-8cf7-34cc653d4730"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:49:38.117952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] validate_networks() for [('cfac1a52-65bd-4486-8cf7-34cc653d4730', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:49:38.469469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:49:38.470089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:49:38.470468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:49:38.470895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:49:38.471326 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:49:38.481079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:38.481553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:38.482415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:38.482875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:38.500455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Getting quotas for project ded5b434b72f4a2ba885f887baa3c35a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:49:38.505792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Getting quotas for user c44b88da38234871ad6732dab5858246 and project ded5b434b72f4a2ba885f887baa3c35a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:49:38.518304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:49:38.520587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:49:38.657127 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a8da9c18-77ac-4243-882c-321cc4dbb6b0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593989 May 28 21:49:38.657755 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3202/6443] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:49:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:49:38.669348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b1f28344-ae14-4ed8-8f2b-0efc5275f084 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:38.670317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b1f28344-ae14-4ed8-8f2b-0efc5275f084 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:38.728046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b1f28344-ae14-4ed8-8f2b-0efc5275f084 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:38.736198 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b1f28344-ae14-4ed8-8f2b-0efc5275f084 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1218 microversion: 2.1 time: 0.071124 May 28 21:49:38.737139 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3242/6444] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:38 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:39.753671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5f7a8c75-9198-4920-bf25-6b176c59cc08 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:39.754258 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5f7a8c75-9198-4920-bf25-6b176c59cc08 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:39.756303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:49:39.762457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f7a8c75-9198-4920-bf25-6b176c59cc08 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:39.768354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f7a8c75-9198-4920-bf25-6b176c59cc08 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:39.768354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f7a8c75-9198-4920-bf25-6b176c59cc08 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:39.768354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f7a8c75-9198-4920-bf25-6b176c59cc08 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:39.828489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5f7a8c75-9198-4920-bf25-6b176c59cc08 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:39.851767 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5f7a8c75-9198-4920-bf25-6b176c59cc08 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1222 microversion: 2.1 time: 0.088860 May 28 21:49:39.852774 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3203/6445] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:39 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:40.154275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-9b591fa1-0eaf-4666-a08b-433132b1f085 req-682d6a09-a60a-463d-b2c9-c40c443c901a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6242cd25-7bc5-4bff-842e-76d3afd96cba", "name": "network-vif-deleted", "tag": "1b10a766-081d-49ce-b6b6-df586120fdf8"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:49:40.163683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9b591fa1-0eaf-4666-a08b-433132b1f085 req-682d6a09-a60a-463d-b2c9-c40c443c901a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:40.164148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9b591fa1-0eaf-4666-a08b-433132b1f085 req-682d6a09-a60a-463d-b2c9-c40c443c901a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:40.175246 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-9b591fa1-0eaf-4666-a08b-433132b1f085 req-682d6a09-a60a-463d-b2c9-c40c443c901a service nova] Creating event network-vif-deleted:1b10a766-081d-49ce-b6b6-df586120fdf8 for instance 6242cd25-7bc5-4bff-842e-76d3afd96cba on nch1-master-1 May 28 21:49:40.180842 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-9b591fa1-0eaf-4666-a08b-433132b1f085 req-682d6a09-a60a-463d-b2c9-c40c443c901a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030360 May 28 21:49:40.181444 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3243/6446] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:49:40.871261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2eb86d4b-e954-4c81-b5d9-3c91b08844ae tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:40.875566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2eb86d4b-e954-4c81-b5d9-3c91b08844ae tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:40.882743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2eb86d4b-e954-4c81-b5d9-3c91b08844ae tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:40.883544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2eb86d4b-e954-4c81-b5d9-3c91b08844ae tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:40.884582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2eb86d4b-e954-4c81-b5d9-3c91b08844ae tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:40.885288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2eb86d4b-e954-4c81-b5d9-3c91b08844ae tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:40.952538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2eb86d4b-e954-4c81-b5d9-3c91b08844ae tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:40.960490 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2eb86d4b-e954-4c81-b5d9-3c91b08844ae tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1288 microversion: 2.1 time: 0.094508 May 28 21:49:40.961087 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3204/6447] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:40 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1288 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:41.977691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d1c7fca3-bcb5-4a31-8554-333d8f695ca1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:41.978872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d1c7fca3-bcb5-4a31-8554-333d8f695ca1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:41.986383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d1c7fca3-bcb5-4a31-8554-333d8f695ca1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:41.986847 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d1c7fca3-bcb5-4a31-8554-333d8f695ca1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:41.987631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d1c7fca3-bcb5-4a31-8554-333d8f695ca1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:41.988234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d1c7fca3-bcb5-4a31-8554-333d8f695ca1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:42.129236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d1c7fca3-bcb5-4a31-8554-333d8f695ca1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:42.137061 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d1c7fca3-bcb5-4a31-8554-333d8f695ca1 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1318 microversion: 2.1 time: 0.163986 May 28 21:49:42.137653 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3244/6448] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:41 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:42.259667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-cdd94e31-64d0-47d3-a174-784c8cabdcdc req-94fca7f7-509b-4433-9072-11cac1bd5a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5594eb-8f3f-42e2-b89d-cab4c49ec503", "tag": "25c516e9-38d7-470d-ade9-bedeb1134d8d"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:49:42.267833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cdd94e31-64d0-47d3-a174-784c8cabdcdc req-94fca7f7-509b-4433-9072-11cac1bd5a69 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:42.268315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cdd94e31-64d0-47d3-a174-784c8cabdcdc req-94fca7f7-509b-4433-9072-11cac1bd5a69 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:42.279603 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-cdd94e31-64d0-47d3-a174-784c8cabdcdc req-94fca7f7-509b-4433-9072-11cac1bd5a69 service nova] Creating event network-changed:25c516e9-38d7-470d-ade9-bedeb1134d8d for instance 0e5594eb-8f3f-42e2-b89d-cab4c49ec503 on nch1-master-1 May 28 21:49:42.284353 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-cdd94e31-64d0-47d3-a174-784c8cabdcdc req-94fca7f7-509b-4433-9072-11cac1bd5a69 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032961 May 28 21:49:42.284970 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3205/6449] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:49:43.155250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4042c917-3c90-4080-a9f1-27900a343c54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:43.155810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4042c917-3c90-4080-a9f1-27900a343c54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:43.162840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4042c917-3c90-4080-a9f1-27900a343c54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:43.163945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4042c917-3c90-4080-a9f1-27900a343c54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:43.164718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4042c917-3c90-4080-a9f1-27900a343c54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:43.165167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4042c917-3c90-4080-a9f1-27900a343c54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:43.290633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4042c917-3c90-4080-a9f1-27900a343c54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:43.298279 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4042c917-3c90-4080-a9f1-27900a343c54 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1318 microversion: 2.1 time: 0.147035 May 28 21:49:43.298854 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3245/6450] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:43 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:44.316329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0ab9f059-1842-41de-b99c-61efd2b12102 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:44.316971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0ab9f059-1842-41de-b99c-61efd2b12102 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:44.323402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ab9f059-1842-41de-b99c-61efd2b12102 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:44.323873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ab9f059-1842-41de-b99c-61efd2b12102 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:44.324655 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ab9f059-1842-41de-b99c-61efd2b12102 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:44.325111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ab9f059-1842-41de-b99c-61efd2b12102 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:44.788804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0ab9f059-1842-41de-b99c-61efd2b12102 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:44.796421 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0ab9f059-1842-41de-b99c-61efd2b12102 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1318 microversion: 2.1 time: 0.485349 May 28 21:49:44.797002 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3206/6451] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:44 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:45.812616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f4f053bc-cac5-4999-98b9-1e07a1d953fd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:45.813240 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f4f053bc-cac5-4999-98b9-1e07a1d953fd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:45.820614 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4f053bc-cac5-4999-98b9-1e07a1d953fd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:45.821082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4f053bc-cac5-4999-98b9-1e07a1d953fd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:45.821892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4f053bc-cac5-4999-98b9-1e07a1d953fd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:45.822344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4f053bc-cac5-4999-98b9-1e07a1d953fd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:45.953412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f4f053bc-cac5-4999-98b9-1e07a1d953fd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:45.961399 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f4f053bc-cac5-4999-98b9-1e07a1d953fd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1318 microversion: 2.1 time: 0.152724 May 28 21:49:45.962008 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3246/6452] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:45 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:46.978797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-26775925-25ab-4c5c-9e25-75b4fb9689ac tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:46.979434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-26775925-25ab-4c5c-9e25-75b4fb9689ac tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:46.986461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26775925-25ab-4c5c-9e25-75b4fb9689ac tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:46.986930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26775925-25ab-4c5c-9e25-75b4fb9689ac tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:46.987711 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26775925-25ab-4c5c-9e25-75b4fb9689ac tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:46.988170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26775925-25ab-4c5c-9e25-75b4fb9689ac tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:47.116360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-26775925-25ab-4c5c-9e25-75b4fb9689ac tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:47.124012 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-26775925-25ab-4c5c-9e25-75b4fb9689ac tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1318 microversion: 2.1 time: 0.149730 May 28 21:49:47.124587 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3207/6453] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:46 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:48.008763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-fe7e6502-5f9c-4b68-83ae-4e0b342467f0 req-5f1b9608-c317-430f-827d-8f70ed119858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5594eb-8f3f-42e2-b89d-cab4c49ec503", "name": "network-vif-plugged", "status": "completed", "tag": "25c516e9-38d7-470d-ade9-bedeb1134d8d"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:49:48.018149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-fe7e6502-5f9c-4b68-83ae-4e0b342467f0 req-5f1b9608-c317-430f-827d-8f70ed119858 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:48.024212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-fe7e6502-5f9c-4b68-83ae-4e0b342467f0 req-5f1b9608-c317-430f-827d-8f70ed119858 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:48.029781 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-fe7e6502-5f9c-4b68-83ae-4e0b342467f0 req-5f1b9608-c317-430f-827d-8f70ed119858 service nova] Creating event network-vif-plugged:25c516e9-38d7-470d-ade9-bedeb1134d8d for instance 0e5594eb-8f3f-42e2-b89d-cab4c49ec503 on nch1-master-1 May 28 21:49:48.035044 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-fe7e6502-5f9c-4b68-83ae-4e0b342467f0 req-5f1b9608-c317-430f-827d-8f70ed119858 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030102 May 28 21:49:48.035575 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3247/6454] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:49:48.140855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-59749a1c-a1b3-431b-a302-bd749db8a48c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:48.141492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-59749a1c-a1b3-431b-a302-bd749db8a48c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:48.148667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59749a1c-a1b3-431b-a302-bd749db8a48c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:48.149134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59749a1c-a1b3-431b-a302-bd749db8a48c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:48.149991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59749a1c-a1b3-431b-a302-bd749db8a48c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:48.150446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59749a1c-a1b3-431b-a302-bd749db8a48c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:48.278155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-59749a1c-a1b3-431b-a302-bd749db8a48c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:48.285755 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-59749a1c-a1b3-431b-a302-bd749db8a48c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1318 microversion: 2.1 time: 0.149066 May 28 21:49:48.286326 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3208/6455] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:48 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:49.300231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:49:49.305863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f62a8191-2d25-44b3-a25a-a92f828c253b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:49.308283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f62a8191-2d25-44b3-a25a-a92f828c253b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:49.312766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f62a8191-2d25-44b3-a25a-a92f828c253b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:49.313226 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f62a8191-2d25-44b3-a25a-a92f828c253b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:49.314081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f62a8191-2d25-44b3-a25a-a92f828c253b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:49.314487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f62a8191-2d25-44b3-a25a-a92f828c253b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:49.447526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f62a8191-2d25-44b3-a25a-a92f828c253b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:49.455903 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f62a8191-2d25-44b3-a25a-a92f828c253b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1318 microversion: 2.1 time: 0.156478 May 28 21:49:49.456510 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3248/6456] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:49 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:50.473346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2ef0a605-b37a-4c2d-831e-0bbda2ed51a6 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:50.473940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2ef0a605-b37a-4c2d-831e-0bbda2ed51a6 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:50.477075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:49:50.477761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:49:50.482285 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ef0a605-b37a-4c2d-831e-0bbda2ed51a6 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:50.486667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ef0a605-b37a-4c2d-831e-0bbda2ed51a6 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:50.486667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ef0a605-b37a-4c2d-831e-0bbda2ed51a6 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:50.486667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ef0a605-b37a-4c2d-831e-0bbda2ed51a6 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:50.617374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2ef0a605-b37a-4c2d-831e-0bbda2ed51a6 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:50.625652 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2ef0a605-b37a-4c2d-831e-0bbda2ed51a6 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1508 microversion: 2.1 time: 0.156352 May 28 21:49:50.626267 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3209/6457] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:50 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:50.642619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4b2317fa-8412-4039-a070-177c0295aac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:50.643250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4b2317fa-8412-4039-a070-177c0295aac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:50.650278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4b2317fa-8412-4039-a070-177c0295aac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:50.650745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4b2317fa-8412-4039-a070-177c0295aac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:50.651665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4b2317fa-8412-4039-a070-177c0295aac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:50.652131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4b2317fa-8412-4039-a070-177c0295aac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:50.778989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4b2317fa-8412-4039-a070-177c0295aac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:50.786733 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4b2317fa-8412-4039-a070-177c0295aac9 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1508 microversion: 2.1 time: 0.148049 May 28 21:49:50.787307 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3249/6458] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:50 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:49:50.802581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0f779943-15ae-4336-983e-7ff2a69c4f36 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:49:50.803578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0f779943-15ae-4336-983e-7ff2a69c4f36 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:50.810222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f779943-15ae-4336-983e-7ff2a69c4f36 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:50.810688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f779943-15ae-4336-983e-7ff2a69c4f36 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:50.811460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f779943-15ae-4336-983e-7ff2a69c4f36 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:50.811914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0f779943-15ae-4336-983e-7ff2a69c4f36 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:50.840263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0f779943-15ae-4336-983e-7ff2a69c4f36 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:50.846041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0f779943-15ae-4336-983e-7ff2a69c4f36 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Old instance type m1.heat2, new instance type m1.heat {{(pid=143128) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 21:49:50.852574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0f779943-15ae-4336-983e-7ff2a69c4f36 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:49:50.853073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0f779943-15ae-4336-983e-7ff2a69c4f36 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:49:50.853497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0f779943-15ae-4336-983e-7ff2a69c4f36 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:49:50.853958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0f779943-15ae-4336-983e-7ff2a69c4f36 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:49:50.857489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-0f779943-15ae-4336-983e-7ff2a69c4f36 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:49:51.067980 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0f779943-15ae-4336-983e-7ff2a69c4f36 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "POST /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503/action" status: 202 len: 0 microversion: 2.1 time: 0.269254 May 28 21:49:51.068886 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3210/6459] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:49:50 2022] POST /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:49:51.077044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1601aa1b-28ce-401f-908b-a70814a0428a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:51.077665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1601aa1b-28ce-401f-908b-a70814a0428a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:51.084266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1601aa1b-28ce-401f-908b-a70814a0428a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:51.084725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1601aa1b-28ce-401f-908b-a70814a0428a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:51.085503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1601aa1b-28ce-401f-908b-a70814a0428a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:51.085981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1601aa1b-28ce-401f-908b-a70814a0428a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:51.216349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1601aa1b-28ce-401f-908b-a70814a0428a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:51.224011 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1601aa1b-28ce-401f-908b-a70814a0428a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1515 microversion: 2.1 time: 0.150971 May 28 21:49:51.224550 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3250/6460] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:51 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:52.241467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-16db83b2-e366-4556-988b-fee0be027e7c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:52.242098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-16db83b2-e366-4556-988b-fee0be027e7c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:52.249768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16db83b2-e366-4556-988b-fee0be027e7c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:52.250267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16db83b2-e366-4556-988b-fee0be027e7c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:52.251054 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16db83b2-e366-4556-988b-fee0be027e7c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:52.251515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16db83b2-e366-4556-988b-fee0be027e7c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:52.385200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-16db83b2-e366-4556-988b-fee0be027e7c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:52.393391 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-16db83b2-e366-4556-988b-fee0be027e7c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1515 microversion: 2.1 time: 0.156069 May 28 21:49:52.395267 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3211/6461] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:52 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:53.411263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5f1b9e3f-f590-407e-9d5a-c5533edec20d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:53.411896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5f1b9e3f-f590-407e-9d5a-c5533edec20d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:53.418965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f1b9e3f-f590-407e-9d5a-c5533edec20d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:53.419426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f1b9e3f-f590-407e-9d5a-c5533edec20d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:53.420213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f1b9e3f-f590-407e-9d5a-c5533edec20d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:53.420664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f1b9e3f-f590-407e-9d5a-c5533edec20d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:53.555444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5f1b9e3f-f590-407e-9d5a-c5533edec20d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:53.563019 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5f1b9e3f-f590-407e-9d5a-c5533edec20d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1515 microversion: 2.1 time: 0.155773 May 28 21:49:53.563594 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3251/6462] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:53 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:54.580616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b043b228-403e-4169-9560-9d7e9048f025 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:54.581254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b043b228-403e-4169-9560-9d7e9048f025 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:54.589121 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b043b228-403e-4169-9560-9d7e9048f025 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:54.589585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b043b228-403e-4169-9560-9d7e9048f025 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:54.590385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b043b228-403e-4169-9560-9d7e9048f025 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:54.590837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b043b228-403e-4169-9560-9d7e9048f025 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:54.720184 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b043b228-403e-4169-9560-9d7e9048f025 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:54.722480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:49:54.728959 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b043b228-403e-4169-9560-9d7e9048f025 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.152286 May 28 21:49:54.729530 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3212/6463] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:54 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:55.748488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ec9f6bb1-2584-4612-8072-fa63bc3240b8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:55.749183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ec9f6bb1-2584-4612-8072-fa63bc3240b8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:55.756302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec9f6bb1-2584-4612-8072-fa63bc3240b8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:55.756765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec9f6bb1-2584-4612-8072-fa63bc3240b8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:55.757538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec9f6bb1-2584-4612-8072-fa63bc3240b8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:55.758027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec9f6bb1-2584-4612-8072-fa63bc3240b8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:55.890355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ec9f6bb1-2584-4612-8072-fa63bc3240b8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:55.898003 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ec9f6bb1-2584-4612-8072-fa63bc3240b8 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.153404 May 28 21:49:55.898580 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3252/6464] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:55 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:56.916641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eb24f871-13b6-4afe-9b0b-8b2efabbb24a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:56.917279 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eb24f871-13b6-4afe-9b0b-8b2efabbb24a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:56.923951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb24f871-13b6-4afe-9b0b-8b2efabbb24a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:56.924422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb24f871-13b6-4afe-9b0b-8b2efabbb24a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:56.925208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb24f871-13b6-4afe-9b0b-8b2efabbb24a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:56.925668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb24f871-13b6-4afe-9b0b-8b2efabbb24a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:57.052218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eb24f871-13b6-4afe-9b0b-8b2efabbb24a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:57.059966 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eb24f871-13b6-4afe-9b0b-8b2efabbb24a tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.148360 May 28 21:49:57.060588 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3213/6465] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:56 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:58.077210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b57c6c4e-5df5-421a-8ef4-c4c8b96932e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:58.077867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b57c6c4e-5df5-421a-8ef4-c4c8b96932e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:58.084451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b57c6c4e-5df5-421a-8ef4-c4c8b96932e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:58.084913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b57c6c4e-5df5-421a-8ef4-c4c8b96932e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:58.085686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b57c6c4e-5df5-421a-8ef4-c4c8b96932e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:58.086159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b57c6c4e-5df5-421a-8ef4-c4c8b96932e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:58.090834 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:49:58.217244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b57c6c4e-5df5-421a-8ef4-c4c8b96932e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:58.224801 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b57c6c4e-5df5-421a-8ef4-c4c8b96932e3 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.151680 May 28 21:49:58.225384 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3253/6466] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:58 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:49:59.242390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-abe739cd-cc81-4cb4-b703-4a71da8e9284 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:49:59.243038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-abe739cd-cc81-4cb4-b703-4a71da8e9284 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:49:59.250585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abe739cd-cc81-4cb4-b703-4a71da8e9284 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:59.251050 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abe739cd-cc81-4cb4-b703-4a71da8e9284 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:59.251851 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abe739cd-cc81-4cb4-b703-4a71da8e9284 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:49:59.252305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-abe739cd-cc81-4cb4-b703-4a71da8e9284 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:49:59.383135 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-abe739cd-cc81-4cb4-b703-4a71da8e9284 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:49:59.390823 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-abe739cd-cc81-4cb4-b703-4a71da8e9284 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.152410 May 28 21:49:59.391396 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3214/6467] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:49:59 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:00.407196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eb79fc8a-ff54-4b7d-b4e2-07606fb2c167 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:00.407766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eb79fc8a-ff54-4b7d-b4e2-07606fb2c167 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:00.414857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb79fc8a-ff54-4b7d-b4e2-07606fb2c167 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:00.415916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb79fc8a-ff54-4b7d-b4e2-07606fb2c167 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:00.416682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb79fc8a-ff54-4b7d-b4e2-07606fb2c167 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:00.417126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eb79fc8a-ff54-4b7d-b4e2-07606fb2c167 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:00.546709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eb79fc8a-ff54-4b7d-b4e2-07606fb2c167 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:00.554309 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eb79fc8a-ff54-4b7d-b4e2-07606fb2c167 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.151136 May 28 21:50:00.554882 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3254/6468] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:00 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:01.571649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-173cb733-7390-409e-b3e3-829994d2d00f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:01.572341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-173cb733-7390-409e-b3e3-829994d2d00f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:01.579631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-173cb733-7390-409e-b3e3-829994d2d00f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:01.580100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-173cb733-7390-409e-b3e3-829994d2d00f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:01.580893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-173cb733-7390-409e-b3e3-829994d2d00f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:01.581348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-173cb733-7390-409e-b3e3-829994d2d00f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:01.715452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-173cb733-7390-409e-b3e3-829994d2d00f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:01.723227 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-173cb733-7390-409e-b3e3-829994d2d00f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.156014 May 28 21:50:01.723809 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3215/6469] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:01 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:02.740192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e90f7834-942e-4919-bc19-e60c395b1f03 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:02.740748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e90f7834-942e-4919-bc19-e60c395b1f03 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:02.747803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e90f7834-942e-4919-bc19-e60c395b1f03 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:02.748267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e90f7834-942e-4919-bc19-e60c395b1f03 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:02.749039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e90f7834-942e-4919-bc19-e60c395b1f03 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:02.749507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e90f7834-942e-4919-bc19-e60c395b1f03 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:02.876438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e90f7834-942e-4919-bc19-e60c395b1f03 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:02.883995 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e90f7834-942e-4919-bc19-e60c395b1f03 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.147816 May 28 21:50:02.884576 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3255/6470] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:02 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:03.901383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ae59ae1c-a72b-45b7-bebb-2367329c00ba tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:03.902082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ae59ae1c-a72b-45b7-bebb-2367329c00ba tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:03.910866 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae59ae1c-a72b-45b7-bebb-2367329c00ba tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:03.911334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae59ae1c-a72b-45b7-bebb-2367329c00ba tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:03.912116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae59ae1c-a72b-45b7-bebb-2367329c00ba tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:03.912576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ae59ae1c-a72b-45b7-bebb-2367329c00ba tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:04.041344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ae59ae1c-a72b-45b7-bebb-2367329c00ba tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:04.048965 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ae59ae1c-a72b-45b7-bebb-2367329c00ba tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.152156 May 28 21:50:04.049543 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3216/6471] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:03 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:05.065754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-783e8f1b-9091-42a1-9e01-698c91b80664 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:05.066418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-783e8f1b-9091-42a1-9e01-698c91b80664 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:05.073558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-783e8f1b-9091-42a1-9e01-698c91b80664 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:05.074054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-783e8f1b-9091-42a1-9e01-698c91b80664 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:05.074835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-783e8f1b-9091-42a1-9e01-698c91b80664 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:05.075298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-783e8f1b-9091-42a1-9e01-698c91b80664 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:05.206196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-783e8f1b-9091-42a1-9e01-698c91b80664 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:05.214676 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-783e8f1b-9091-42a1-9e01-698c91b80664 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.152873 May 28 21:50:05.215246 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3256/6472] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:05 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:06.232224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7704ad78-7777-437c-9945-f733758e2aa4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:06.232903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7704ad78-7777-437c-9945-f733758e2aa4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:06.240179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7704ad78-7777-437c-9945-f733758e2aa4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:06.240683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7704ad78-7777-437c-9945-f733758e2aa4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:06.241486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7704ad78-7777-437c-9945-f733758e2aa4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:06.241975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7704ad78-7777-437c-9945-f733758e2aa4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:06.372224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7704ad78-7777-437c-9945-f733758e2aa4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:06.383117 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7704ad78-7777-437c-9945-f733758e2aa4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.155329 May 28 21:50:06.383717 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3217/6473] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:06 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:07.401195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-443ef101-24f4-4241-bdd6-857bec7b80a0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:07.401783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-443ef101-24f4-4241-bdd6-857bec7b80a0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:07.404479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:50:07.409384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-443ef101-24f4-4241-bdd6-857bec7b80a0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:07.409864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-443ef101-24f4-4241-bdd6-857bec7b80a0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:07.410663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-443ef101-24f4-4241-bdd6-857bec7b80a0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:07.411135 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-443ef101-24f4-4241-bdd6-857bec7b80a0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:07.544064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-443ef101-24f4-4241-bdd6-857bec7b80a0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:07.551622 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-443ef101-24f4-4241-bdd6-857bec7b80a0 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.154908 May 28 21:50:07.552202 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3257/6474] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:07 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:08.568744 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d30f9dae-2e36-46d4-a4ca-fa0a2f81222b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:08.569382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d30f9dae-2e36-46d4-a4ca-fa0a2f81222b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:08.576699 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d30f9dae-2e36-46d4-a4ca-fa0a2f81222b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:08.577167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d30f9dae-2e36-46d4-a4ca-fa0a2f81222b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:08.577975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d30f9dae-2e36-46d4-a4ca-fa0a2f81222b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:08.578432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d30f9dae-2e36-46d4-a4ca-fa0a2f81222b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:08.709047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d30f9dae-2e36-46d4-a4ca-fa0a2f81222b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:08.717269 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d30f9dae-2e36-46d4-a4ca-fa0a2f81222b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.152480 May 28 21:50:08.721412 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3218/6475] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:08 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:09.735040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-146a33eb-2663-413e-8ce8-725001719ffd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:09.735937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-146a33eb-2663-413e-8ce8-725001719ffd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:09.743633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-146a33eb-2663-413e-8ce8-725001719ffd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:09.744101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-146a33eb-2663-413e-8ce8-725001719ffd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:09.744886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-146a33eb-2663-413e-8ce8-725001719ffd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:09.745339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-146a33eb-2663-413e-8ce8-725001719ffd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:09.876602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-146a33eb-2663-413e-8ce8-725001719ffd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:09.885112 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-146a33eb-2663-413e-8ce8-725001719ffd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.154579 May 28 21:50:09.885701 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3258/6476] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:09 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:10.902649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9db11474-e42a-4c0f-8c61-69ae27588843 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:10.903346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9db11474-e42a-4c0f-8c61-69ae27588843 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:10.906019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=36 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:50:10.910865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9db11474-e42a-4c0f-8c61-69ae27588843 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:10.911333 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9db11474-e42a-4c0f-8c61-69ae27588843 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:10.912114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9db11474-e42a-4c0f-8c61-69ae27588843 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:10.912574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9db11474-e42a-4c0f-8c61-69ae27588843 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:11.040918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9db11474-e42a-4c0f-8c61-69ae27588843 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:11.048586 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9db11474-e42a-4c0f-8c61-69ae27588843 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.150472 May 28 21:50:11.049161 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3219/6477] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:10 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:12.066014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-01d70416-b380-4eb4-a2da-62693d9b238e tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:12.066797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-01d70416-b380-4eb4-a2da-62693d9b238e tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:12.074064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01d70416-b380-4eb4-a2da-62693d9b238e tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:12.080419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01d70416-b380-4eb4-a2da-62693d9b238e tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:12.080419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01d70416-b380-4eb4-a2da-62693d9b238e tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:12.080419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-01d70416-b380-4eb4-a2da-62693d9b238e tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:12.206958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-01d70416-b380-4eb4-a2da-62693d9b238e tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:12.214898 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-01d70416-b380-4eb4-a2da-62693d9b238e tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.152954 May 28 21:50:12.215485 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3259/6478] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:12 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:13.231400 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-579b61be-e23a-4d7b-ad7e-10d2766df72f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:13.232057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-579b61be-e23a-4d7b-ad7e-10d2766df72f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:13.239327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-579b61be-e23a-4d7b-ad7e-10d2766df72f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:13.239798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-579b61be-e23a-4d7b-ad7e-10d2766df72f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:13.240585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-579b61be-e23a-4d7b-ad7e-10d2766df72f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:13.241043 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-579b61be-e23a-4d7b-ad7e-10d2766df72f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:13.393408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-579b61be-e23a-4d7b-ad7e-10d2766df72f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:13.401752 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-579b61be-e23a-4d7b-ad7e-10d2766df72f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.174915 May 28 21:50:13.402399 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3220/6479] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:13 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:14.419523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-95d40adb-5a97-482d-bcbc-cf73e08ca473 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:14.420054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-95d40adb-5a97-482d-bcbc-cf73e08ca473 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:14.427304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95d40adb-5a97-482d-bcbc-cf73e08ca473 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:14.428086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95d40adb-5a97-482d-bcbc-cf73e08ca473 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:14.428909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95d40adb-5a97-482d-bcbc-cf73e08ca473 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:14.429363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-95d40adb-5a97-482d-bcbc-cf73e08ca473 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:14.559288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-95d40adb-5a97-482d-bcbc-cf73e08ca473 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:14.566854 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-95d40adb-5a97-482d-bcbc-cf73e08ca473 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.151864 May 28 21:50:14.567442 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3260/6480] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:14 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:15.584143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-316db8fa-bb5c-48cd-919e-1a745a24437c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:15.584785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-316db8fa-bb5c-48cd-919e-1a745a24437c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:15.591830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-316db8fa-bb5c-48cd-919e-1a745a24437c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:15.605786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-316db8fa-bb5c-48cd-919e-1a745a24437c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:15.605786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-316db8fa-bb5c-48cd-919e-1a745a24437c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:15.605786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-316db8fa-bb5c-48cd-919e-1a745a24437c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:15.725718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-316db8fa-bb5c-48cd-919e-1a745a24437c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:15.734064 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-316db8fa-bb5c-48cd-919e-1a745a24437c tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.154015 May 28 21:50:15.734648 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3221/6481] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:15 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:16.751859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9160b0e5-cb2c-4bab-bb6b-43864df2125b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:16.752468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9160b0e5-cb2c-4bab-bb6b-43864df2125b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:16.759982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9160b0e5-cb2c-4bab-bb6b-43864df2125b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:16.760435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9160b0e5-cb2c-4bab-bb6b-43864df2125b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:16.761203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9160b0e5-cb2c-4bab-bb6b-43864df2125b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:16.761644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9160b0e5-cb2c-4bab-bb6b-43864df2125b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:16.889208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9160b0e5-cb2c-4bab-bb6b-43864df2125b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:16.897353 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9160b0e5-cb2c-4bab-bb6b-43864df2125b tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.149314 May 28 21:50:16.897990 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3261/6482] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:16 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:17.914877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3b2b97b1-6163-4bac-b56c-33443f1102ff tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:17.915549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3b2b97b1-6163-4bac-b56c-33443f1102ff tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:17.922694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b2b97b1-6163-4bac-b56c-33443f1102ff tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:17.923164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b2b97b1-6163-4bac-b56c-33443f1102ff tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:17.923953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b2b97b1-6163-4bac-b56c-33443f1102ff tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:17.924409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b2b97b1-6163-4bac-b56c-33443f1102ff tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:18.056706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3b2b97b1-6163-4bac-b56c-33443f1102ff tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:18.064617 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3b2b97b1-6163-4bac-b56c-33443f1102ff tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.153713 May 28 21:50:18.065201 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3222/6483] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:17 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:19.082103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4eefb0a9-be97-47a7-b679-e02eaf25cd6f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:19.082730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4eefb0a9-be97-47a7-b679-e02eaf25cd6f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:19.090439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4eefb0a9-be97-47a7-b679-e02eaf25cd6f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:19.090907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4eefb0a9-be97-47a7-b679-e02eaf25cd6f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:19.091658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4eefb0a9-be97-47a7-b679-e02eaf25cd6f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:19.092101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4eefb0a9-be97-47a7-b679-e02eaf25cd6f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:19.221956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4eefb0a9-be97-47a7-b679-e02eaf25cd6f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:19.230236 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4eefb0a9-be97-47a7-b679-e02eaf25cd6f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.152077 May 28 21:50:19.230812 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3262/6484] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:19 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:20.247716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-30b8dddc-8240-4eaa-8451-6e336d3fef5d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:20.248349 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-30b8dddc-8240-4eaa-8451-6e336d3fef5d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:20.255276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30b8dddc-8240-4eaa-8451-6e336d3fef5d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:20.255737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30b8dddc-8240-4eaa-8451-6e336d3fef5d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:20.256521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30b8dddc-8240-4eaa-8451-6e336d3fef5d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:20.256978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30b8dddc-8240-4eaa-8451-6e336d3fef5d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:20.386930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-30b8dddc-8240-4eaa-8451-6e336d3fef5d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:20.394569 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-30b8dddc-8240-4eaa-8451-6e336d3fef5d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1520 microversion: 2.1 time: 0.151384 May 28 21:50:20.395152 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3223/6485] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:20 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:21.388670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ab3b6e36-6961-4aea-870b-f22fd1b8af23 req-96869e53-fd0c-4cb0-bed4-2594bc254c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5594eb-8f3f-42e2-b89d-cab4c49ec503", "name": "network-vif-unplugged", "status": "completed", "tag": "25c516e9-38d7-470d-ade9-bedeb1134d8d"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:50:21.397019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ab3b6e36-6961-4aea-870b-f22fd1b8af23 req-96869e53-fd0c-4cb0-bed4-2594bc254c81 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:21.397480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ab3b6e36-6961-4aea-870b-f22fd1b8af23 req-96869e53-fd0c-4cb0-bed4-2594bc254c81 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:21.409815 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ab3b6e36-6961-4aea-870b-f22fd1b8af23 req-96869e53-fd0c-4cb0-bed4-2594bc254c81 service nova] Creating event network-vif-unplugged:25c516e9-38d7-470d-ade9-bedeb1134d8d for instance 0e5594eb-8f3f-42e2-b89d-cab4c49ec503 on nch2-master-1 May 28 21:50:21.411990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b15cbd94-b8e5-47c4-97fb-37650d760aea tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:21.412839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b15cbd94-b8e5-47c4-97fb-37650d760aea tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:21.416149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-ab3b6e36-6961-4aea-870b-f22fd1b8af23 req-96869e53-fd0c-4cb0-bed4-2594bc254c81 service nova] Instance 0e5594eb-8f3f-42e2-b89d-cab4c49ec503 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:50:21.421185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b15cbd94-b8e5-47c4-97fb-37650d760aea tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:21.422082 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b15cbd94-b8e5-47c4-97fb-37650d760aea tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:21.423162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b15cbd94-b8e5-47c4-97fb-37650d760aea tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:21.423734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b15cbd94-b8e5-47c4-97fb-37650d760aea tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:21.431473 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ab3b6e36-6961-4aea-870b-f22fd1b8af23 req-96869e53-fd0c-4cb0-bed4-2594bc254c81 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114867 May 28 21:50:21.432456 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3263/6486] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:50:21.632628 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b15cbd94-b8e5-47c4-97fb-37650d760aea tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:21.640980 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b15cbd94-b8e5-47c4-97fb-37650d760aea tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1519 microversion: 2.1 time: 0.233200 May 28 21:50:21.641571 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3224/6487] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:21 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1519 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:50:22.658703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8d010bed-01cd-491a-b2e1-8c2e57f87cf2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:22.659430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8d010bed-01cd-491a-b2e1-8c2e57f87cf2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:22.666692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d010bed-01cd-491a-b2e1-8c2e57f87cf2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:22.667165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d010bed-01cd-491a-b2e1-8c2e57f87cf2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:22.667947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d010bed-01cd-491a-b2e1-8c2e57f87cf2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:22.668403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8d010bed-01cd-491a-b2e1-8c2e57f87cf2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:22.799099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8d010bed-01cd-491a-b2e1-8c2e57f87cf2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:22.805877 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8d010bed-01cd-491a-b2e1-8c2e57f87cf2 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1517 microversion: 2.1 time: 0.151359 May 28 21:50:22.806403 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3264/6488] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:22 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:23.446008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-bef2c82b-a581-4a04-8e8a-bbe737eac7fc req-f7465e61-bbbf-4b5a-a229-e0ceaa076f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e5594eb-8f3f-42e2-b89d-cab4c49ec503", "tag": "25c516e9-38d7-470d-ade9-bedeb1134d8d"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:50:23.455098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-bef2c82b-a581-4a04-8e8a-bbe737eac7fc req-f7465e61-bbbf-4b5a-a229-e0ceaa076f57 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:23.455594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-bef2c82b-a581-4a04-8e8a-bbe737eac7fc req-f7465e61-bbbf-4b5a-a229-e0ceaa076f57 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:23.467526 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-bef2c82b-a581-4a04-8e8a-bbe737eac7fc req-f7465e61-bbbf-4b5a-a229-e0ceaa076f57 service nova] Creating event network-changed:25c516e9-38d7-470d-ade9-bedeb1134d8d for instance 0e5594eb-8f3f-42e2-b89d-cab4c49ec503 on nch2-master-1 May 28 21:50:23.472891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-bef2c82b-a581-4a04-8e8a-bbe737eac7fc req-f7465e61-bbbf-4b5a-a229-e0ceaa076f57 service nova] Instance 0e5594eb-8f3f-42e2-b89d-cab4c49ec503 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:50:23.483999 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-bef2c82b-a581-4a04-8e8a-bbe737eac7fc req-f7465e61-bbbf-4b5a-a229-e0ceaa076f57 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041768 May 28 21:50:23.484598 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3225/6489] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:50:23.823084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-21fdd7b6-e392-4a27-9634-043aa1f653aa tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:23.823789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-21fdd7b6-e392-4a27-9634-043aa1f653aa tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:23.830986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21fdd7b6-e392-4a27-9634-043aa1f653aa tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:23.831450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21fdd7b6-e392-4a27-9634-043aa1f653aa tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:23.832234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21fdd7b6-e392-4a27-9634-043aa1f653aa tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:23.832682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-21fdd7b6-e392-4a27-9634-043aa1f653aa tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:24.044542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-21fdd7b6-e392-4a27-9634-043aa1f653aa tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:24.052368 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-21fdd7b6-e392-4a27-9634-043aa1f653aa tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1517 microversion: 2.1 time: 0.233122 May 28 21:50:24.052944 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3265/6490] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:23 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1517 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:25.069990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b5207a5f-023f-4e0c-b899-4ff7fd857b10 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:25.070752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b5207a5f-023f-4e0c-b899-4ff7fd857b10 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:25.077151 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5207a5f-023f-4e0c-b899-4ff7fd857b10 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:25.077620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5207a5f-023f-4e0c-b899-4ff7fd857b10 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:25.078432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5207a5f-023f-4e0c-b899-4ff7fd857b10 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:25.078893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b5207a5f-023f-4e0c-b899-4ff7fd857b10 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:25.212457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b5207a5f-023f-4e0c-b899-4ff7fd857b10 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:25.220151 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b5207a5f-023f-4e0c-b899-4ff7fd857b10 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1514 microversion: 2.1 time: 0.155386 May 28 21:50:25.220794 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3226/6491] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:25 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:50:25.237300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1b3cd132-09f3-4055-a2ce-a7f1190c13f4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:50:25.237884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1b3cd132-09f3-4055-a2ce-a7f1190c13f4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:25.244900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b3cd132-09f3-4055-a2ce-a7f1190c13f4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:25.245372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b3cd132-09f3-4055-a2ce-a7f1190c13f4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:25.246265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b3cd132-09f3-4055-a2ce-a7f1190c13f4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:25.246717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1b3cd132-09f3-4055-a2ce-a7f1190c13f4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:25.430950 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1b3cd132-09f3-4055-a2ce-a7f1190c13f4 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "POST /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503/action" status: 204 len: 0 microversion: 2.1 time: 0.197287 May 28 21:50:25.431625 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3266/6492] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:50:25 2022] POST /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503/action => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:50:25.441673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a9edc708-5305-4403-a394-67294c10b265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:25.442431 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a9edc708-5305-4403-a394-67294c10b265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:25.449807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a9edc708-5305-4403-a394-67294c10b265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:25.451973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a9edc708-5305-4403-a394-67294c10b265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:25.451973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a9edc708-5305-4403-a394-67294c10b265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:25.451973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a9edc708-5305-4403-a394-67294c10b265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:25.588101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a9edc708-5305-4403-a394-67294c10b265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:25.596036 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a9edc708-5305-4403-a394-67294c10b265 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1514 microversion: 2.1 time: 0.158885 May 28 21:50:25.596838 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3227/6493] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:25 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:26.615162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a0f2b9f1-ce9a-436c-b474-54dd2f19a107 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:26.615885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a0f2b9f1-ce9a-436c-b474-54dd2f19a107 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:26.622275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0f2b9f1-ce9a-436c-b474-54dd2f19a107 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:26.622762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0f2b9f1-ce9a-436c-b474-54dd2f19a107 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:26.623544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0f2b9f1-ce9a-436c-b474-54dd2f19a107 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:26.623994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0f2b9f1-ce9a-436c-b474-54dd2f19a107 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:26.755370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a0f2b9f1-ce9a-436c-b474-54dd2f19a107 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:26.763321 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a0f2b9f1-ce9a-436c-b474-54dd2f19a107 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1514 microversion: 2.1 time: 0.153470 May 28 21:50:26.763899 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3267/6494] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:26 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:27.625390 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-fa961359-5527-4acc-9719-cdc7ad467623 req-b7cc8f79-68f0-443b-8293-865faa1e39e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5594eb-8f3f-42e2-b89d-cab4c49ec503", "name": "network-vif-plugged", "status": "completed", "tag": "25c516e9-38d7-470d-ade9-bedeb1134d8d"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:50:27.634470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-fa961359-5527-4acc-9719-cdc7ad467623 req-b7cc8f79-68f0-443b-8293-865faa1e39e5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:27.635517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-fa961359-5527-4acc-9719-cdc7ad467623 req-b7cc8f79-68f0-443b-8293-865faa1e39e5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:27.639463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=90 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:50:27.646751 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-fa961359-5527-4acc-9719-cdc7ad467623 req-b7cc8f79-68f0-443b-8293-865faa1e39e5 service nova] Creating event network-vif-plugged:25c516e9-38d7-470d-ade9-bedeb1134d8d for instance 0e5594eb-8f3f-42e2-b89d-cab4c49ec503 on nch2-master-1 May 28 21:50:27.651897 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-fa961359-5527-4acc-9719-cdc7ad467623 req-b7cc8f79-68f0-443b-8293-865faa1e39e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030366 May 28 21:50:27.652492 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3228/6495] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:50:27.780587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-643ce6b9-5a5e-42e1-9c7e-d575c34bc325 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:27.781209 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-643ce6b9-5a5e-42e1-9c7e-d575c34bc325 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:27.788317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-643ce6b9-5a5e-42e1-9c7e-d575c34bc325 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:27.788774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-643ce6b9-5a5e-42e1-9c7e-d575c34bc325 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:27.789539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-643ce6b9-5a5e-42e1-9c7e-d575c34bc325 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:27.790015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-643ce6b9-5a5e-42e1-9c7e-d575c34bc325 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:27.922924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-643ce6b9-5a5e-42e1-9c7e-d575c34bc325 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:27.930606 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-643ce6b9-5a5e-42e1-9c7e-d575c34bc325 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1506 microversion: 2.1 time: 0.153930 May 28 21:50:27.931188 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3268/6496] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:27 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:27.948298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bf12cbbf-8788-4da4-b336-e3e5fc1b12e7 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:27.949064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bf12cbbf-8788-4da4-b336-e3e5fc1b12e7 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:27.955686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf12cbbf-8788-4da4-b336-e3e5fc1b12e7 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:27.956158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf12cbbf-8788-4da4-b336-e3e5fc1b12e7 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:27.956946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf12cbbf-8788-4da4-b336-e3e5fc1b12e7 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:27.957410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf12cbbf-8788-4da4-b336-e3e5fc1b12e7 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:28.086786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bf12cbbf-8788-4da4-b336-e3e5fc1b12e7 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:28.096066 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bf12cbbf-8788-4da4-b336-e3e5fc1b12e7 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1506 microversion: 2.1 time: 0.151483 May 28 21:50:28.096066 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3229/6497] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:27 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:28.112156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f5081595-ca17-4d64-bf70-b4db1d6dcdca tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:28.112809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f5081595-ca17-4d64-bf70-b4db1d6dcdca tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:28.118859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5081595-ca17-4d64-bf70-b4db1d6dcdca tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:28.119453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5081595-ca17-4d64-bf70-b4db1d6dcdca tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:28.120077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5081595-ca17-4d64-bf70-b4db1d6dcdca tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:28.120517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f5081595-ca17-4d64-bf70-b4db1d6dcdca tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:28.124609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:50:28.251824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f5081595-ca17-4d64-bf70-b4db1d6dcdca tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:28.259352 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f5081595-ca17-4d64-bf70-b4db1d6dcdca tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1506 microversion: 2.1 time: 0.151108 May 28 21:50:28.259932 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3269/6498] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:28 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:28.274840 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-086d9404-2cd2-42fa-bc81-fe9b2ded17dd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:28.275874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-086d9404-2cd2-42fa-bc81-fe9b2ded17dd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:28.282038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-086d9404-2cd2-42fa-bc81-fe9b2ded17dd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:28.282472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-086d9404-2cd2-42fa-bc81-fe9b2ded17dd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:28.283269 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-086d9404-2cd2-42fa-bc81-fe9b2ded17dd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:28.283718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-086d9404-2cd2-42fa-bc81-fe9b2ded17dd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:28.308426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-086d9404-2cd2-42fa-bc81-fe9b2ded17dd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:50:28.585953 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-086d9404-2cd2-42fa-bc81-fe9b2ded17dd tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 204 len: 0 microversion: 2.1 time: 0.314520 May 28 21:50:28.586464 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3230/6499] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:50:28 2022] DELETE /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:50:28.603445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f408f6f1-e81f-4745-997b-5738ce11f608 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:28.603949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f408f6f1-e81f-4745-997b-5738ce11f608 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:28.610102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f408f6f1-e81f-4745-997b-5738ce11f608 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:28.613786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f408f6f1-e81f-4745-997b-5738ce11f608 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:28.613786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f408f6f1-e81f-4745-997b-5738ce11f608 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:28.613786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f408f6f1-e81f-4745-997b-5738ce11f608 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:28.636478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f408f6f1-e81f-4745-997b-5738ce11f608 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:50:28.720195 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.compute.api [None req-f408f6f1-e81f-4745-997b-5738ce11f608 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Instance is already in deleting state, ignoring this request May 28 21:50:28.721057 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f408f6f1-e81f-4745-997b-5738ce11f608 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 204 len: 0 microversion: 2.1 time: 0.121679 May 28 21:50:28.721623 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3270/6500] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:50:28 2022] DELETE /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:50:28.730335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9b088b85-8809-4cb8-8d42-b40899e4db38 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:28.731066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9b088b85-8809-4cb8-8d42-b40899e4db38 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:28.738180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b088b85-8809-4cb8-8d42-b40899e4db38 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:28.739970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b088b85-8809-4cb8-8d42-b40899e4db38 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:28.739970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b088b85-8809-4cb8-8d42-b40899e4db38 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:28.739970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9b088b85-8809-4cb8-8d42-b40899e4db38 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:28.871494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9b088b85-8809-4cb8-8d42-b40899e4db38 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:28.879133 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9b088b85-8809-4cb8-8d42-b40899e4db38 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1512 microversion: 2.1 time: 0.153128 May 28 21:50:28.879711 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3231/6501] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:28 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1512 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:29.897217 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-94f45072-67f2-4401-83b7-23506377e100 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:29.897780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-94f45072-67f2-4401-83b7-23506377e100 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:29.904867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94f45072-67f2-4401-83b7-23506377e100 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:29.905323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94f45072-67f2-4401-83b7-23506377e100 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:29.906111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94f45072-67f2-4401-83b7-23506377e100 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:29.906561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94f45072-67f2-4401-83b7-23506377e100 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:30.144202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-94f45072-67f2-4401-83b7-23506377e100 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c44b88da38234871ad6732dab5858246', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ded5b434b72f4a2ba885f887baa3c35a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:30.155482 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-94f45072-67f2-4401-83b7-23506377e100 tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 200 len: 1512 microversion: 2.1 time: 0.262317 May 28 21:50:30.156368 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3271/6502] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:29 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 1512 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:30.506317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-03307b8b-2f46-45a4-a442-a5f7642a6e7e req-85c573c0-a1af-4aba-96b9-43b4a8ca157c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e5594eb-8f3f-42e2-b89d-cab4c49ec503", "name": "network-vif-deleted", "tag": "25c516e9-38d7-470d-ade9-bedeb1134d8d"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:50:30.515958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-03307b8b-2f46-45a4-a442-a5f7642a6e7e req-85c573c0-a1af-4aba-96b9-43b4a8ca157c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:30.516411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-03307b8b-2f46-45a4-a442-a5f7642a6e7e req-85c573c0-a1af-4aba-96b9-43b4a8ca157c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:30.527575 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-03307b8b-2f46-45a4-a442-a5f7642a6e7e req-85c573c0-a1af-4aba-96b9-43b4a8ca157c service nova] Creating event network-vif-deleted:25c516e9-38d7-470d-ade9-bedeb1134d8d for instance 0e5594eb-8f3f-42e2-b89d-cab4c49ec503 on nch2-master-1 May 28 21:50:30.532813 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-03307b8b-2f46-45a4-a442-a5f7642a6e7e req-85c573c0-a1af-4aba-96b9-43b4a8ca157c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030189 May 28 21:50:30.533695 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3232/6503] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:50:31.173925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-335f6dd2-e056-4c7c-b15d-d81b2599fa8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:31.174587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-335f6dd2-e056-4c7c-b15d-d81b2599fa8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 0e5594eb-8f3f-42e2-b89d-cab4c49ec503] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:31.181555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-335f6dd2-e056-4c7c-b15d-d81b2599fa8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:31.182100 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-335f6dd2-e056-4c7c-b15d-d81b2599fa8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:31.182896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-335f6dd2-e056-4c7c-b15d-d81b2599fa8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:31.183348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-335f6dd2-e056-4c7c-b15d-d81b2599fa8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:31.199520 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-335f6dd2-e056-4c7c-b15d-d81b2599fa8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] HTTP exception thrown: Instance 0e5594eb-8f3f-42e2-b89d-cab4c49ec503 could not be found. May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-335f6dd2-e056-4c7c-b15d-d81b2599fa8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Request method failure captured: May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 HTTP/1.1 May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpi-bMngFUiCdYnDdu8fIrac5PrRs6zM7O7zdZO8tPn6QNHVYt6ZVZxJ4WR_NcwQOhS9nbNx7z-OlfbL8AUZ80ZPAU4WqcGqZLMRMlA6iSj4sVC1_tCcMLm0iSzcJB79e8L1CoLdhPohB1ybjBLZ305F7Z_e5xduIK63PK-IDw9DRlg May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: ded5b434b72f4a2ba885f887baa3c35a May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1536937016 May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ded5b434b72f4a2ba885f887baa3c35a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ded5b434b72f4a2ba885f887baa3c35a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ded5b434b72f4a2ba885f887baa3c35a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ded5b434b72f4a2ba885f887baa3c35a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerDiskConfigTestJSON-1536937016 May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: ded5b434b72f4a2ba885f887baa3c35a May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1536937016 May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerDiskConfigTestJSON-1536937016-project May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: c44b88da38234871ad6732dab5858246 May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerDiskConfigTestJSON-1536937016-project May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 0e5594eb-8f3f-42e2-b89d-cab4c49ec503 could not be found. May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '0e5594eb-8f3f-42e2-b89d-cab4c49ec503'} May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e5594eb-8f3f-42e2-b89d-cab4c49ec503 could not be found. May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e5594eb-8f3f-42e2-b89d-cab4c49ec503 could not be found. May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:50:31.201211 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:50:31.207410 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:50:31.207410 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:50:31.207410 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:50:31.207410 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:50:31.207410 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:50:31.207410 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e5594eb-8f3f-42e2-b89d-cab4c49ec503 could not be found. May 28 21:50:31.207410 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:50:31.207410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-335f6dd2-e056-4c7c-b15d-d81b2599fa8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Returning 404 to user: Instance 0e5594eb-8f3f-42e2-b89d-cab4c49ec503 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:50:31.207410 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-335f6dd2-e056-4c7c-b15d-d81b2599fa8d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503" status: 404 len: 111 microversion: 2.1 time: 0.032770 May 28 21:50:31.207410 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3272/6504] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:31 2022] GET /compute/v2.1/servers/0e5594eb-8f3f-42e2-b89d-cab4c49ec503 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:50:31.212179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c73399f-8614-4bc3-8c53-cba7d241e12f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:31.212781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8c73399f-8614-4bc3-8c53-cba7d241e12f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:31.219820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c73399f-8614-4bc3-8c53-cba7d241e12f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:31.220284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c73399f-8614-4bc3-8c53-cba7d241e12f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:31.221057 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c73399f-8614-4bc3-8c53-cba7d241e12f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:31.221509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c73399f-8614-4bc3-8c53-cba7d241e12f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:31.235170 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-8c73399f-8614-4bc3-8c53-cba7d241e12f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] HTTP exception thrown: Instance 6242cd25-7bc5-4bff-842e-76d3afd96cba could not be found. May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c73399f-8614-4bc3-8c53-cba7d241e12f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Request method failure captured: May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba HTTP/1.1 May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpi-bMngFUiCdYnDdu8fIrac5PrRs6zM7O7zdZO8tPn6QNHVYt6ZVZxJ4WR_NcwQOhS9nbNx7z-OlfbL8AUZ80ZPAU4WqcGqZLMRMlA6iSj4sVC1_tCcMLm0iSzcJB79e8L1CoLdhPohB1ybjBLZ305F7Z_e5xduIK63PK-IDw9DRlg May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: ded5b434b72f4a2ba885f887baa3c35a May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1536937016 May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ded5b434b72f4a2ba885f887baa3c35a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ded5b434b72f4a2ba885f887baa3c35a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ded5b434b72f4a2ba885f887baa3c35a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ded5b434b72f4a2ba885f887baa3c35a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerDiskConfigTestJSON-1536937016 May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: ded5b434b72f4a2ba885f887baa3c35a May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1536937016 May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerDiskConfigTestJSON-1536937016-project May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: c44b88da38234871ad6732dab5858246 May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerDiskConfigTestJSON-1536937016-project May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 6242cd25-7bc5-4bff-842e-76d3afd96cba could not be found. May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '6242cd25-7bc5-4bff-842e-76d3afd96cba'} May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6242cd25-7bc5-4bff-842e-76d3afd96cba could not be found. May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:50:31.236816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:50:31.242353 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6242cd25-7bc5-4bff-842e-76d3afd96cba could not be found. May 28 21:50:31.242353 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:50:31.242353 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:50:31.242353 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:50:31.242353 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:50:31.242353 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:50:31.242353 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:50:31.242353 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:50:31.242353 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:50:31.242353 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6242cd25-7bc5-4bff-842e-76d3afd96cba could not be found. May 28 21:50:31.242353 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:50:31.242353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c73399f-8614-4bc3-8c53-cba7d241e12f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Returning 404 to user: Instance 6242cd25-7bc5-4bff-842e-76d3afd96cba could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:50:31.242353 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8c73399f-8614-4bc3-8c53-cba7d241e12f tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 404 len: 111 microversion: 2.1 time: 0.030591 May 28 21:50:31.242353 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3233/6505] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:50:31 2022] DELETE /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:50:31.246813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-25355c51-b436-4101-86d8-b2458c65680d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:31.247470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-25355c51-b436-4101-86d8-b2458c65680d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] [instance: 6242cd25-7bc5-4bff-842e-76d3afd96cba] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:31.253625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25355c51-b436-4101-86d8-b2458c65680d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:31.254118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25355c51-b436-4101-86d8-b2458c65680d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:31.254896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25355c51-b436-4101-86d8-b2458c65680d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:31.255349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25355c51-b436-4101-86d8-b2458c65680d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:31.268974 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-25355c51-b436-4101-86d8-b2458c65680d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] HTTP exception thrown: Instance 6242cd25-7bc5-4bff-842e-76d3afd96cba could not be found. May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-25355c51-b436-4101-86d8-b2458c65680d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Request method failure captured: May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba HTTP/1.1 May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpi-bMngFUiCdYnDdu8fIrac5PrRs6zM7O7zdZO8tPn6QNHVYt6ZVZxJ4WR_NcwQOhS9nbNx7z-OlfbL8AUZ80ZPAU4WqcGqZLMRMlA6iSj4sVC1_tCcMLm0iSzcJB79e8L1CoLdhPohB1ybjBLZ305F7Z_e5xduIK63PK-IDw9DRlg May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: ded5b434b72f4a2ba885f887baa3c35a May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1536937016 May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ded5b434b72f4a2ba885f887baa3c35a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ded5b434b72f4a2ba885f887baa3c35a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ded5b434b72f4a2ba885f887baa3c35a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ded5b434b72f4a2ba885f887baa3c35a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerDiskConfigTestJSON-1536937016 May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: ded5b434b72f4a2ba885f887baa3c35a May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1536937016 May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerDiskConfigTestJSON-1536937016-project May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: c44b88da38234871ad6732dab5858246 May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerDiskConfigTestJSON-1536937016-project May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 6242cd25-7bc5-4bff-842e-76d3afd96cba could not be found. May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '6242cd25-7bc5-4bff-842e-76d3afd96cba'} May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6242cd25-7bc5-4bff-842e-76d3afd96cba could not be found. May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6242cd25-7bc5-4bff-842e-76d3afd96cba could not be found. May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:50:31.270541 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:50:31.276661 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:50:31.276661 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:50:31.276661 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:50:31.276661 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:50:31.276661 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:50:31.276661 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6242cd25-7bc5-4bff-842e-76d3afd96cba could not be found. May 28 21:50:31.276661 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:50:31.276661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-25355c51-b436-4101-86d8-b2458c65680d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] Returning 404 to user: Instance 6242cd25-7bc5-4bff-842e-76d3afd96cba could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:50:31.276661 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-25355c51-b436-4101-86d8-b2458c65680d tempest-ServerDiskConfigTestJSON-1536937016 tempest-ServerDiskConfigTestJSON-1536937016-project] 10.222.0.33 "GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba" status: 404 len: 111 microversion: 2.1 time: 0.029105 May 28 21:50:31.276661 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3273/6506] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:31 2022] GET /compute/v2.1/servers/6242cd25-7bc5-4bff-842e-76d3afd96cba => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:50:39.065808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3a37ffd3-cece-4bf7-ae05-fb14a49e3952 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'create', calling method: .version_select at 0x7f4d64528b80>, body: {"keypair": {"name": "tempest-keypair-1087605141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCALdK3DWiJ6fDLBUO/SkZSRmJAmRHFqDaWVCdWX0kKUWY3qjO5Zsz8jinEKn6rhNkhd4TmyAkHAfQJr/7/T6f8geFGYNEEfA9Zpk9y4yzKLZOt4zL47eonqaVegvcwBkg=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:50:39.065808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-3a37ffd3-cece-4bf7-ae05-fb14a49e3952 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Getting quotas for project 77ee3a3a7c3c4288984836d79f10e732. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:50:39.065808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-3a37ffd3-cece-4bf7-ae05-fb14a49e3952 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Getting quotas for user aa3da8047b124549a05e86b438789dfb and project 77ee3a3a7c3c4288984836d79f10e732. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:50:39.170779 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3a37ffd3-cece-4bf7-ae05-fb14a49e3952 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.263154 May 28 21:50:39.171281 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3234/6507] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:50:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:50:41.619156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1526781704", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8779b3e1-d96f-4dd9-848b-4204f604f786"}], "security_groups": [{"name": "tempest-securitygroup--535478282"}], "key_name": "tempest-keypair-1087605141", "user_data": "}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:50:41.633553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=33 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:50:41.634457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:50:41.759306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] validate_networks() for [('8779b3e1-d96f-4dd9-848b-4204f604f786', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:50:42.186152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:50:42.186594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:50:42.187234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:50:42.187663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:50:42.188096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:50:42.197506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:42.198016 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:42.198905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:42.199365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:42.218398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Getting quotas for project 77ee3a3a7c3c4288984836d79f10e732. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:50:42.223916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Getting quotas for user aa3da8047b124549a05e86b438789dfb and project 77ee3a3a7c3c4288984836d79f10e732. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:50:42.238136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:50:42.240484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:50:42.341102 ncdv-master-1 devstack@n-api.service[143129]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [1fdd8e4e-3f9f-4e68-8d64-0a7335600a5c] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 21:50:43.348344 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [1fdd8e4e-3f9f-4e68-8d64-0a7335600a5c] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 50800. May 28 21:50:43.352222 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cef8873c-6109-4569-bc52-66431b35c932 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.745470 May 28 21:50:43.352876 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3274/6508] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:50:41 2022] POST /compute/v2.1/servers => generated 408 bytes in 1747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:50:43.360420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:50:43.364526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c9d81f50-0e30-4004-bcda-94a3905e7988 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:43.365261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c9d81f50-0e30-4004-bcda-94a3905e7988 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:43.368190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:50:43.423537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c9d81f50-0e30-4004-bcda-94a3905e7988 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:43.430257 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c9d81f50-0e30-4004-bcda-94a3905e7988 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1239 microversion: 2.1 time: 0.071474 May 28 21:50:43.430832 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3235/6509] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:43 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:44.449050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f2d968b2-1b1b-44ed-a67e-73d58e3b1b3d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:44.449696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f2d968b2-1b1b-44ed-a67e-73d58e3b1b3d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:44.507066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f2d968b2-1b1b-44ed-a67e-73d58e3b1b3d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:44.514670 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f2d968b2-1b1b-44ed-a67e-73d58e3b1b3d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1239 microversion: 2.1 time: 0.071448 May 28 21:50:44.515244 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3275/6510] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:44 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:45.537959 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b09f0cea-9f71-4971-ac58-c0e7d1f0e04d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:45.538869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b09f0cea-9f71-4971-ac58-c0e7d1f0e04d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:45.548133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b09f0cea-9f71-4971-ac58-c0e7d1f0e04d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:45.548732 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b09f0cea-9f71-4971-ac58-c0e7d1f0e04d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:45.549600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b09f0cea-9f71-4971-ac58-c0e7d1f0e04d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:45.550093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b09f0cea-9f71-4971-ac58-c0e7d1f0e04d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:45.617281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b09f0cea-9f71-4971-ac58-c0e7d1f0e04d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:45.625229 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b09f0cea-9f71-4971-ac58-c0e7d1f0e04d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1309 microversion: 2.1 time: 0.091973 May 28 21:50:45.626108 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3236/6511] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:45 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:46.642469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-76632c0e-1414-4d8e-9a85-9312789e2c2b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:46.643098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-76632c0e-1414-4d8e-9a85-9312789e2c2b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:46.650146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76632c0e-1414-4d8e-9a85-9312789e2c2b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:46.650608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76632c0e-1414-4d8e-9a85-9312789e2c2b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:46.651387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76632c0e-1414-4d8e-9a85-9312789e2c2b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:46.651845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76632c0e-1414-4d8e-9a85-9312789e2c2b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:46.788052 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-76632c0e-1414-4d8e-9a85-9312789e2c2b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:46.796175 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-76632c0e-1414-4d8e-9a85-9312789e2c2b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1364 microversion: 2.1 time: 0.157674 May 28 21:50:46.796744 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3276/6512] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:46 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:47.154353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-353ae5ac-6544-49c8-8413-98d22fae23e8 req-4a8b3ed2-a456-46e8-9cd9-811f74f60eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f", "tag": "5c959d19-98fd-4c19-990a-823f253c01ec"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:50:47.172508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-353ae5ac-6544-49c8-8413-98d22fae23e8 req-4a8b3ed2-a456-46e8-9cd9-811f74f60eae service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:47.172978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-353ae5ac-6544-49c8-8413-98d22fae23e8 req-4a8b3ed2-a456-46e8-9cd9-811f74f60eae service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:47.185175 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-353ae5ac-6544-49c8-8413-98d22fae23e8 req-4a8b3ed2-a456-46e8-9cd9-811f74f60eae service nova] Creating event network-changed:5c959d19-98fd-4c19-990a-823f253c01ec for instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f on nch2-master-1 May 28 21:50:47.190494 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-353ae5ac-6544-49c8-8413-98d22fae23e8 req-4a8b3ed2-a456-46e8-9cd9-811f74f60eae service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041722 May 28 21:50:47.191284 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3237/6513] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:50:47.813260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-00635a77-e78c-4f08-8600-735afa6bdf13 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:47.813948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-00635a77-e78c-4f08-8600-735afa6bdf13 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:47.821171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00635a77-e78c-4f08-8600-735afa6bdf13 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:47.821628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00635a77-e78c-4f08-8600-735afa6bdf13 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:47.822575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00635a77-e78c-4f08-8600-735afa6bdf13 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:47.823020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00635a77-e78c-4f08-8600-735afa6bdf13 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:48.079582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-00635a77-e78c-4f08-8600-735afa6bdf13 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:48.087458 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-00635a77-e78c-4f08-8600-735afa6bdf13 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1364 microversion: 2.1 time: 0.278151 May 28 21:50:48.088031 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3277/6514] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:47 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1364 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:49.105594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-33404284-85bf-4f66-b85f-eacc261a9664 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:49.106358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-33404284-85bf-4f66-b85f-eacc261a9664 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:49.112674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33404284-85bf-4f66-b85f-eacc261a9664 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:49.113142 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33404284-85bf-4f66-b85f-eacc261a9664 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:49.113948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33404284-85bf-4f66-b85f-eacc261a9664 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:49.114407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33404284-85bf-4f66-b85f-eacc261a9664 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:49.242174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-33404284-85bf-4f66-b85f-eacc261a9664 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:49.250198 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-33404284-85bf-4f66-b85f-eacc261a9664 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1364 microversion: 2.1 time: 0.149726 May 28 21:50:49.250772 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3238/6515] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:49 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:50.266977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-87677d0e-94dc-48f6-bb9a-951a19c06808 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:50.267607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-87677d0e-94dc-48f6-bb9a-951a19c06808 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:50.274712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87677d0e-94dc-48f6-bb9a-951a19c06808 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:50.275176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87677d0e-94dc-48f6-bb9a-951a19c06808 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:50.275949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87677d0e-94dc-48f6-bb9a-951a19c06808 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:50.276396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87677d0e-94dc-48f6-bb9a-951a19c06808 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:50.410497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-87677d0e-94dc-48f6-bb9a-951a19c06808 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:50.418110 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-87677d0e-94dc-48f6-bb9a-951a19c06808 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1364 microversion: 2.1 time: 0.155005 May 28 21:50:50.418683 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3278/6516] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:50 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:51.434445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a0b288e3-32f9-451e-bb11-55a11bb03a73 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:51.435168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a0b288e3-32f9-451e-bb11-55a11bb03a73 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:51.442213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a0b288e3-32f9-451e-bb11-55a11bb03a73 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:51.442683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a0b288e3-32f9-451e-bb11-55a11bb03a73 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:51.443503 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a0b288e3-32f9-451e-bb11-55a11bb03a73 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:51.443988 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a0b288e3-32f9-451e-bb11-55a11bb03a73 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:51.575577 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a0b288e3-32f9-451e-bb11-55a11bb03a73 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:51.584128 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a0b288e3-32f9-451e-bb11-55a11bb03a73 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1364 microversion: 2.1 time: 0.153696 May 28 21:50:51.585432 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3239/6517] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:51 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:52.600631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f827b465-cb38-42b6-9621-b8a931a7fb91 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:52.601272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f827b465-cb38-42b6-9621-b8a931a7fb91 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:52.604015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:50:52.609542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f827b465-cb38-42b6-9621-b8a931a7fb91 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:52.610043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f827b465-cb38-42b6-9621-b8a931a7fb91 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:52.610814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f827b465-cb38-42b6-9621-b8a931a7fb91 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:52.611260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f827b465-cb38-42b6-9621-b8a931a7fb91 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:52.742534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f827b465-cb38-42b6-9621-b8a931a7fb91 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:52.750742 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f827b465-cb38-42b6-9621-b8a931a7fb91 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1364 microversion: 2.1 time: 0.154058 May 28 21:50:52.751317 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3279/6518] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:52 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:53.749484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-75949dee-8ffc-41b0-afea-70b1d5426f3a req-9b44f72b-d358-40d1-9389-5f4f9c94c197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f", "name": "network-vif-plugged", "status": "completed", "tag": "5c959d19-98fd-4c19-990a-823f253c01ec"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:50:53.753994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:50:53.759318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-75949dee-8ffc-41b0-afea-70b1d5426f3a req-9b44f72b-d358-40d1-9389-5f4f9c94c197 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:53.759829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-75949dee-8ffc-41b0-afea-70b1d5426f3a req-9b44f72b-d358-40d1-9389-5f4f9c94c197 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:53.768058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b79ceabe-b6f6-4a3a-9082-8b795409dd48 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:53.768690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b79ceabe-b6f6-4a3a-9082-8b795409dd48 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:53.771721 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-75949dee-8ffc-41b0-afea-70b1d5426f3a req-9b44f72b-d358-40d1-9389-5f4f9c94c197 service nova] Creating event network-vif-plugged:5c959d19-98fd-4c19-990a-823f253c01ec for instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f on nch2-master-1 May 28 21:50:53.775710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b79ceabe-b6f6-4a3a-9082-8b795409dd48 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:53.776176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b79ceabe-b6f6-4a3a-9082-8b795409dd48 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:53.776989 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-75949dee-8ffc-41b0-afea-70b1d5426f3a req-9b44f72b-d358-40d1-9389-5f4f9c94c197 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031785 May 28 21:50:53.777094 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b79ceabe-b6f6-4a3a-9082-8b795409dd48 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:53.777490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b79ceabe-b6f6-4a3a-9082-8b795409dd48 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:53.777596 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3240/6519] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:50:53.977584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b79ceabe-b6f6-4a3a-9082-8b795409dd48 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:53.986177 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b79ceabe-b6f6-4a3a-9082-8b795409dd48 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1364 microversion: 2.1 time: 0.221858 May 28 21:50:53.986776 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3280/6520] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:53 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:55.004509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-49939408-8601-4613-80ee-33550e750ea8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:55.005391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-49939408-8601-4613-80ee-33550e750ea8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:55.011884 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-49939408-8601-4613-80ee-33550e750ea8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:55.012352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-49939408-8601-4613-80ee-33550e750ea8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:55.013130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-49939408-8601-4613-80ee-33550e750ea8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:55.013588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-49939408-8601-4613-80ee-33550e750ea8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:55.149031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-49939408-8601-4613-80ee-33550e750ea8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:55.158501 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-49939408-8601-4613-80ee-33550e750ea8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1364 microversion: 2.1 time: 0.159418 May 28 21:50:55.159111 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3241/6521] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:54 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:56.176237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-12cf648c-7a0d-4233-bf4a-1b0a18d5f5c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:56.176916 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-12cf648c-7a0d-4233-bf4a-1b0a18d5f5c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:56.178994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=8 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:50:56.184573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12cf648c-7a0d-4233-bf4a-1b0a18d5f5c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:56.185066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12cf648c-7a0d-4233-bf4a-1b0a18d5f5c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:56.185887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12cf648c-7a0d-4233-bf4a-1b0a18d5f5c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:56.186339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12cf648c-7a0d-4233-bf4a-1b0a18d5f5c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:56.312984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-12cf648c-7a0d-4233-bf4a-1b0a18d5f5c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:56.320690 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-12cf648c-7a0d-4233-bf4a-1b0a18d5f5c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1551 microversion: 2.1 time: 0.148669 May 28 21:50:56.321212 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3281/6522] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:56 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1551 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:56.337005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b6a22a39-d7b6-43eb-b8c6-1cef61ef4eb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:56.337555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b6a22a39-d7b6-43eb-b8c6-1cef61ef4eb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:56.343903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6a22a39-d7b6-43eb-b8c6-1cef61ef4eb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:56.344373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6a22a39-d7b6-43eb-b8c6-1cef61ef4eb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:56.345152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6a22a39-d7b6-43eb-b8c6-1cef61ef4eb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:56.345610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b6a22a39-d7b6-43eb-b8c6-1cef61ef4eb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:56.426222 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b6a22a39-d7b6-43eb-b8c6-1cef61ef4eb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093470 May 28 21:50:56.426887 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3242/6523] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:50:56 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:50:57.805490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-731484a1-8ccf-4168-b63f-360acd63013e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:57.806298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-731484a1-8ccf-4168-b63f-360acd63013e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:57.815427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-731484a1-8ccf-4168-b63f-360acd63013e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:57.815427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-731484a1-8ccf-4168-b63f-360acd63013e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:57.815427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-731484a1-8ccf-4168-b63f-360acd63013e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:57.815427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-731484a1-8ccf-4168-b63f-360acd63013e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:57.884178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-997ec476-4e6b-4705-a232-c7cf84593215 req-60a5508f-f6ac-41bb-90cd-c59f2b3444f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f", "tag": "5c959d19-98fd-4c19-990a-823f253c01ec"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:50:57.894545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-997ec476-4e6b-4705-a232-c7cf84593215 req-60a5508f-f6ac-41bb-90cd-c59f2b3444f7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:57.895146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-997ec476-4e6b-4705-a232-c7cf84593215 req-60a5508f-f6ac-41bb-90cd-c59f2b3444f7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:57.908410 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-997ec476-4e6b-4705-a232-c7cf84593215 req-60a5508f-f6ac-41bb-90cd-c59f2b3444f7 service nova] Creating event network-changed:5c959d19-98fd-4c19-990a-823f253c01ec for instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f on nch2-master-1 May 28 21:50:57.914467 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-997ec476-4e6b-4705-a232-c7cf84593215 req-60a5508f-f6ac-41bb-90cd-c59f2b3444f7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110986 May 28 21:50:57.915267 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3243/6524] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:50:57.996681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-731484a1-8ccf-4168-b63f-360acd63013e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:58.004916 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-731484a1-8ccf-4168-b63f-360acd63013e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1551 microversion: 2.1 time: 0.203439 May 28 21:50:58.005508 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3282/6525] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:57 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1551 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:58.022391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c89149b8-aea8-443a-a9cc-f70507959cbd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:58.023190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c89149b8-aea8-443a-a9cc-f70507959cbd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:58.029792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c89149b8-aea8-443a-a9cc-f70507959cbd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:58.030379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c89149b8-aea8-443a-a9cc-f70507959cbd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:58.031234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c89149b8-aea8-443a-a9cc-f70507959cbd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:58.031757 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c89149b8-aea8-443a-a9cc-f70507959cbd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:58.243155 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c89149b8-aea8-443a-a9cc-f70507959cbd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:58.252464 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c89149b8-aea8-443a-a9cc-f70507959cbd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1551 microversion: 2.1 time: 0.234293 May 28 21:50:58.254133 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3244/6526] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:58 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1551 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:59.270337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-10234f56-d19c-4c21-8910-b3140094a305 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:59.270985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-10234f56-d19c-4c21-8910-b3140094a305 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:59.278640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10234f56-d19c-4c21-8910-b3140094a305 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:59.279039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10234f56-d19c-4c21-8910-b3140094a305 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:59.279800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10234f56-d19c-4c21-8910-b3140094a305 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:59.280242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-10234f56-d19c-4c21-8910-b3140094a305 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:59.412140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-10234f56-d19c-4c21-8910-b3140094a305 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:59.419767 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-10234f56-d19c-4c21-8910-b3140094a305 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1670 microversion: 2.1 time: 0.153411 May 28 21:50:59.420342 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3283/6527] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:59 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:59.435646 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-382d8b09-1ad6-41bc-91fb-e364f7d07daa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:59.436307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-382d8b09-1ad6-41bc-91fb-e364f7d07daa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:59.443544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-382d8b09-1ad6-41bc-91fb-e364f7d07daa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:59.444012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-382d8b09-1ad6-41bc-91fb-e364f7d07daa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:59.444786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-382d8b09-1ad6-41bc-91fb-e364f7d07daa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:59.445236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-382d8b09-1ad6-41bc-91fb-e364f7d07daa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:59.574463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-382d8b09-1ad6-41bc-91fb-e364f7d07daa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:59.581977 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-382d8b09-1ad6-41bc-91fb-e364f7d07daa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1670 microversion: 2.1 time: 0.150426 May 28 21:50:59.582800 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3245/6528] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:59 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:50:59.598379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2cc0c9a3-65a9-4a4c-9860-c4d3faa1bfad tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:50:59.599463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2cc0c9a3-65a9-4a4c-9860-c4d3faa1bfad tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:59.605516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2cc0c9a3-65a9-4a4c-9860-c4d3faa1bfad tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:59.606044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2cc0c9a3-65a9-4a4c-9860-c4d3faa1bfad tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:59.606820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2cc0c9a3-65a9-4a4c-9860-c4d3faa1bfad tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:59.607271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2cc0c9a3-65a9-4a4c-9860-c4d3faa1bfad tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:59.635155 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2cc0c9a3-65a9-4a4c-9860-c4d3faa1bfad tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:50:59.641444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2cc0c9a3-65a9-4a4c-9860-c4d3faa1bfad tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Old instance type m1.heat2, new instance type m1.heat {{(pid=143129) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 21:50:59.647647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2cc0c9a3-65a9-4a4c-9860-c4d3faa1bfad tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:50:59.648088 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2cc0c9a3-65a9-4a4c-9860-c4d3faa1bfad tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:50:59.648575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2cc0c9a3-65a9-4a4c-9860-c4d3faa1bfad tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:50:59.648996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2cc0c9a3-65a9-4a4c-9860-c4d3faa1bfad tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:50:59.649416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-2cc0c9a3-65a9-4a4c-9860-c4d3faa1bfad tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:50:59.872961 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2cc0c9a3-65a9-4a4c-9860-c4d3faa1bfad tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f/action" status: 202 len: 0 microversion: 2.1 time: 0.278587 May 28 21:50:59.873572 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3284/6529] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:50:59 2022] POST /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:50:59.881911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a960b41b-6a0c-4065-ad1b-d2e4d7b79220 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:50:59.882551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a960b41b-6a0c-4065-ad1b-d2e4d7b79220 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:50:59.888903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a960b41b-6a0c-4065-ad1b-d2e4d7b79220 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:59.889104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a960b41b-6a0c-4065-ad1b-d2e4d7b79220 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:50:59.889926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a960b41b-6a0c-4065-ad1b-d2e4d7b79220 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:50:59.890407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a960b41b-6a0c-4065-ad1b-d2e4d7b79220 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:00.022798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a960b41b-6a0c-4065-ad1b-d2e4d7b79220 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:00.030608 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a960b41b-6a0c-4065-ad1b-d2e4d7b79220 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1679 microversion: 2.1 time: 0.152638 May 28 21:51:00.031196 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3246/6530] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:50:59 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:01.049692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fde1143a-0f5b-49fa-a89c-012937b9560c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:01.050352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fde1143a-0f5b-49fa-a89c-012937b9560c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:01.056671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fde1143a-0f5b-49fa-a89c-012937b9560c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:01.062841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fde1143a-0f5b-49fa-a89c-012937b9560c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:01.063672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fde1143a-0f5b-49fa-a89c-012937b9560c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:01.064624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fde1143a-0f5b-49fa-a89c-012937b9560c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:01.206523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fde1143a-0f5b-49fa-a89c-012937b9560c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:01.214666 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fde1143a-0f5b-49fa-a89c-012937b9560c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1679 microversion: 2.1 time: 0.170771 May 28 21:51:01.215239 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3285/6531] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:01 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:02.231307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-de50ea95-0c1c-45d0-8f5d-d80f95675819 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:02.231948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-de50ea95-0c1c-45d0-8f5d-d80f95675819 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:02.239386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de50ea95-0c1c-45d0-8f5d-d80f95675819 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:02.239861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de50ea95-0c1c-45d0-8f5d-d80f95675819 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:02.240657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de50ea95-0c1c-45d0-8f5d-d80f95675819 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:02.241123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-de50ea95-0c1c-45d0-8f5d-d80f95675819 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:02.472893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-de50ea95-0c1c-45d0-8f5d-d80f95675819 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:02.481075 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-de50ea95-0c1c-45d0-8f5d-d80f95675819 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1679 microversion: 2.1 time: 0.253688 May 28 21:51:02.481673 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3247/6532] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:02 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1679 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:03.499257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e923ddbc-2123-483f-bd63-659f3264dddc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:03.499809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e923ddbc-2123-483f-bd63-659f3264dddc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:03.507423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e923ddbc-2123-483f-bd63-659f3264dddc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:03.507883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e923ddbc-2123-483f-bd63-659f3264dddc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:03.508661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e923ddbc-2123-483f-bd63-659f3264dddc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:03.509136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e923ddbc-2123-483f-bd63-659f3264dddc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:03.640575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e923ddbc-2123-483f-bd63-659f3264dddc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:03.648509 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e923ddbc-2123-483f-bd63-659f3264dddc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1684 microversion: 2.1 time: 0.153885 May 28 21:51:03.649144 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3286/6533] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:03 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:04.665492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-99df858b-462a-4125-b253-900b887d68f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:04.666170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-99df858b-462a-4125-b253-900b887d68f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:04.673296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99df858b-462a-4125-b253-900b887d68f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:04.673772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99df858b-462a-4125-b253-900b887d68f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:04.674609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99df858b-462a-4125-b253-900b887d68f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:04.675074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-99df858b-462a-4125-b253-900b887d68f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:04.807473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-99df858b-462a-4125-b253-900b887d68f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:04.815557 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-99df858b-462a-4125-b253-900b887d68f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1684 microversion: 2.1 time: 0.153823 May 28 21:51:04.816167 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3248/6534] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:04 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:05.833572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-af5b7493-95a8-4351-b4d6-288b67a34087 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:05.834167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-af5b7493-95a8-4351-b4d6-288b67a34087 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:05.841663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af5b7493-95a8-4351-b4d6-288b67a34087 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:05.842156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af5b7493-95a8-4351-b4d6-288b67a34087 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:05.842934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af5b7493-95a8-4351-b4d6-288b67a34087 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:05.843389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-af5b7493-95a8-4351-b4d6-288b67a34087 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:05.971311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-af5b7493-95a8-4351-b4d6-288b67a34087 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:05.979003 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-af5b7493-95a8-4351-b4d6-288b67a34087 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1684 microversion: 2.1 time: 0.149658 May 28 21:51:05.979582 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3287/6535] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:05 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:06.996750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3b144543-abcf-4213-bbda-8fcb38d2c9c1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:06.997386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3b144543-abcf-4213-bbda-8fcb38d2c9c1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:07.004597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b144543-abcf-4213-bbda-8fcb38d2c9c1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:07.005100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b144543-abcf-4213-bbda-8fcb38d2c9c1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:07.005906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b144543-abcf-4213-bbda-8fcb38d2c9c1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:07.006367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b144543-abcf-4213-bbda-8fcb38d2c9c1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:07.134903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3b144543-abcf-4213-bbda-8fcb38d2c9c1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:07.142555 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3b144543-abcf-4213-bbda-8fcb38d2c9c1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1684 microversion: 2.1 time: 0.150342 May 28 21:51:07.143140 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3249/6536] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:06 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:08.160563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-da9f031e-3b79-4191-811b-f4503da08df8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:08.161189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-da9f031e-3b79-4191-811b-f4503da08df8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:08.168965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da9f031e-3b79-4191-811b-f4503da08df8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:08.169425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da9f031e-3b79-4191-811b-f4503da08df8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:08.170225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da9f031e-3b79-4191-811b-f4503da08df8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:08.170668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-da9f031e-3b79-4191-811b-f4503da08df8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:08.303823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-da9f031e-3b79-4191-811b-f4503da08df8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:08.312050 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-da9f031e-3b79-4191-811b-f4503da08df8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1684 microversion: 2.1 time: 0.155457 May 28 21:51:08.312627 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3288/6537] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:08 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:09.329095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5a88429c-463a-4b34-ae31-f76c5a67ee19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:09.329723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5a88429c-463a-4b34-ae31-f76c5a67ee19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:09.336939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5a88429c-463a-4b34-ae31-f76c5a67ee19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:09.337404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5a88429c-463a-4b34-ae31-f76c5a67ee19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:09.338203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5a88429c-463a-4b34-ae31-f76c5a67ee19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:09.338658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5a88429c-463a-4b34-ae31-f76c5a67ee19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:09.466362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5a88429c-463a-4b34-ae31-f76c5a67ee19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:09.474422 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5a88429c-463a-4b34-ae31-f76c5a67ee19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1684 microversion: 2.1 time: 0.149261 May 28 21:51:09.475002 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3250/6538] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:09 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:10.491544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-346240cd-3429-452a-be3e-ad1cff4a4406 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:10.492121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-346240cd-3429-452a-be3e-ad1cff4a4406 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:10.499471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-346240cd-3429-452a-be3e-ad1cff4a4406 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:10.499928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-346240cd-3429-452a-be3e-ad1cff4a4406 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:10.500702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-346240cd-3429-452a-be3e-ad1cff4a4406 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:10.501147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-346240cd-3429-452a-be3e-ad1cff4a4406 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:10.634404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-346240cd-3429-452a-be3e-ad1cff4a4406 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:10.642756 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-346240cd-3429-452a-be3e-ad1cff4a4406 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1684 microversion: 2.1 time: 0.155224 May 28 21:51:10.643346 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3289/6539] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:10 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:11.660412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5ddec49a-5f8b-4696-abd2-fac28d903d7e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:11.660970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5ddec49a-5f8b-4696-abd2-fac28d903d7e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:11.668736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ddec49a-5f8b-4696-abd2-fac28d903d7e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:11.669199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ddec49a-5f8b-4696-abd2-fac28d903d7e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:11.670044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ddec49a-5f8b-4696-abd2-fac28d903d7e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:11.670497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5ddec49a-5f8b-4696-abd2-fac28d903d7e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:11.800457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5ddec49a-5f8b-4696-abd2-fac28d903d7e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:11.808034 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5ddec49a-5f8b-4696-abd2-fac28d903d7e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1684 microversion: 2.1 time: 0.151648 May 28 21:51:11.808602 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3251/6540] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:11 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:12.824780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2ea3269e-615a-4dde-b4fc-f72d8f1f1bc1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:12.825374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2ea3269e-615a-4dde-b4fc-f72d8f1f1bc1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:12.828139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:51:12.833271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ea3269e-615a-4dde-b4fc-f72d8f1f1bc1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:12.840948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ea3269e-615a-4dde-b4fc-f72d8f1f1bc1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:12.840948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ea3269e-615a-4dde-b4fc-f72d8f1f1bc1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:12.840948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ea3269e-615a-4dde-b4fc-f72d8f1f1bc1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:12.840948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:51:12.965899 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2ea3269e-615a-4dde-b4fc-f72d8f1f1bc1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:12.973786 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2ea3269e-615a-4dde-b4fc-f72d8f1f1bc1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1684 microversion: 2.1 time: 0.153192 May 28 21:51:12.974432 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3290/6541] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:12 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:13.553089 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 21:51:13.553330 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 21:51:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 21:51:13.991545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eb3d3fa8-70f1-4ebe-98e5-fbf1e801bbac tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:13.992201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eb3d3fa8-70f1-4ebe-98e5-fbf1e801bbac tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:13.999709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb3d3fa8-70f1-4ebe-98e5-fbf1e801bbac tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:14.000169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb3d3fa8-70f1-4ebe-98e5-fbf1e801bbac tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:14.000943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb3d3fa8-70f1-4ebe-98e5-fbf1e801bbac tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:14.001393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb3d3fa8-70f1-4ebe-98e5-fbf1e801bbac tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:14.135857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eb3d3fa8-70f1-4ebe-98e5-fbf1e801bbac tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:14.143672 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eb3d3fa8-70f1-4ebe-98e5-fbf1e801bbac tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1684 microversion: 2.1 time: 0.156088 May 28 21:51:14.144634 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3252/6542] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:13 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:15.160455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-23b81121-2109-42e0-9285-dc9444d08bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:15.161090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-23b81121-2109-42e0-9285-dc9444d08bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:15.168979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23b81121-2109-42e0-9285-dc9444d08bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:15.169441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23b81121-2109-42e0-9285-dc9444d08bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:15.170250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23b81121-2109-42e0-9285-dc9444d08bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:15.170703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-23b81121-2109-42e0-9285-dc9444d08bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:15.301287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-23b81121-2109-42e0-9285-dc9444d08bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:15.308940 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-23b81121-2109-42e0-9285-dc9444d08bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1684 microversion: 2.1 time: 0.152430 May 28 21:51:15.309746 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3291/6543] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:15 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:16.327038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-175569f7-821a-4014-ae80-8ce7df9cf987 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:16.327643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-175569f7-821a-4014-ae80-8ce7df9cf987 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:16.334975 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-175569f7-821a-4014-ae80-8ce7df9cf987 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:16.335447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-175569f7-821a-4014-ae80-8ce7df9cf987 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:16.336226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-175569f7-821a-4014-ae80-8ce7df9cf987 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:16.336684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-175569f7-821a-4014-ae80-8ce7df9cf987 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:16.468654 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-175569f7-821a-4014-ae80-8ce7df9cf987 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:16.476447 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-175569f7-821a-4014-ae80-8ce7df9cf987 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1684 microversion: 2.1 time: 0.153971 May 28 21:51:16.477026 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3253/6544] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:16 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:17.493384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b02664b5-3dee-4947-90a1-822f30ee0c34 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:17.494064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b02664b5-3dee-4947-90a1-822f30ee0c34 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:17.501457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b02664b5-3dee-4947-90a1-822f30ee0c34 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:17.501956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b02664b5-3dee-4947-90a1-822f30ee0c34 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:17.502732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b02664b5-3dee-4947-90a1-822f30ee0c34 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:17.503174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b02664b5-3dee-4947-90a1-822f30ee0c34 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:17.725032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b02664b5-3dee-4947-90a1-822f30ee0c34 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:17.733216 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b02664b5-3dee-4947-90a1-822f30ee0c34 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1684 microversion: 2.1 time: 0.243801 May 28 21:51:17.733799 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3292/6545] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:17 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1684 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:18.751072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-144b3878-a6de-4b6b-a852-2c1c9d19d5fc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:18.751732 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-144b3878-a6de-4b6b-a852-2c1c9d19d5fc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:18.754642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=40 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:51:18.759685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-144b3878-a6de-4b6b-a852-2c1c9d19d5fc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:18.760163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-144b3878-a6de-4b6b-a852-2c1c9d19d5fc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:18.760948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-144b3878-a6de-4b6b-a852-2c1c9d19d5fc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:18.761403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-144b3878-a6de-4b6b-a852-2c1c9d19d5fc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:18.765474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=95 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:51:18.892127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-144b3878-a6de-4b6b-a852-2c1c9d19d5fc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:18.899628 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-144b3878-a6de-4b6b-a852-2c1c9d19d5fc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1684 microversion: 2.1 time: 0.152473 May 28 21:51:18.900217 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3254/6546] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:18 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:19.916583 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-348f3523-071b-4ef8-95c8-82d30177927d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:19.917206 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-348f3523-071b-4ef8-95c8-82d30177927d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:19.924403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-348f3523-071b-4ef8-95c8-82d30177927d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:19.924864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-348f3523-071b-4ef8-95c8-82d30177927d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:19.925638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-348f3523-071b-4ef8-95c8-82d30177927d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:19.926124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-348f3523-071b-4ef8-95c8-82d30177927d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:20.060474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-348f3523-071b-4ef8-95c8-82d30177927d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:20.068377 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-348f3523-071b-4ef8-95c8-82d30177927d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1684 microversion: 2.1 time: 0.155755 May 28 21:51:20.071152 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3293/6547] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:19 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:20.608736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-36c413c8-134d-47e2-917f-4bddfc32ab1b req-a10a9038-353e-4665-8080-b1e0d17a0b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f", "name": "network-vif-unplugged", "status": "completed", "tag": "5c959d19-98fd-4c19-990a-823f253c01ec"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:51:20.617697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-36c413c8-134d-47e2-917f-4bddfc32ab1b req-a10a9038-353e-4665-8080-b1e0d17a0b90 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:20.618198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-36c413c8-134d-47e2-917f-4bddfc32ab1b req-a10a9038-353e-4665-8080-b1e0d17a0b90 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:20.629970 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-36c413c8-134d-47e2-917f-4bddfc32ab1b req-a10a9038-353e-4665-8080-b1e0d17a0b90 service nova] Creating event network-vif-unplugged:5c959d19-98fd-4c19-990a-823f253c01ec for instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f on nch1-master-1 May 28 21:51:20.635255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-36c413c8-134d-47e2-917f-4bddfc32ab1b req-a10a9038-353e-4665-8080-b1e0d17a0b90 service nova] Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:51:20.645777 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-36c413c8-134d-47e2-917f-4bddfc32ab1b req-a10a9038-353e-4665-8080-b1e0d17a0b90 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041561 May 28 21:51:20.646431 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3255/6548] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:51:21.086504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a9d3a699-4dcf-4ad1-b74e-8dd847db932a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:21.087141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a9d3a699-4dcf-4ad1-b74e-8dd847db932a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:21.094963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9d3a699-4dcf-4ad1-b74e-8dd847db932a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:21.095414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9d3a699-4dcf-4ad1-b74e-8dd847db932a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:21.096189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9d3a699-4dcf-4ad1-b74e-8dd847db932a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:21.096639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9d3a699-4dcf-4ad1-b74e-8dd847db932a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:21.228540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a9d3a699-4dcf-4ad1-b74e-8dd847db932a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:21.236538 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a9d3a699-4dcf-4ad1-b74e-8dd847db932a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1683 microversion: 2.1 time: 0.154430 May 28 21:51:21.247245 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3294/6549] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:21 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:22.255909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4bee2ca7-fa9d-483f-b3c2-14edd49b8f1e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:22.256625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4bee2ca7-fa9d-483f-b3c2-14edd49b8f1e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:22.263542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bee2ca7-fa9d-483f-b3c2-14edd49b8f1e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:22.264005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bee2ca7-fa9d-483f-b3c2-14edd49b8f1e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:22.264778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bee2ca7-fa9d-483f-b3c2-14edd49b8f1e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:22.265229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bee2ca7-fa9d-483f-b3c2-14edd49b8f1e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:22.395925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4bee2ca7-fa9d-483f-b3c2-14edd49b8f1e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:22.403370 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4bee2ca7-fa9d-483f-b3c2-14edd49b8f1e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1681 microversion: 2.1 time: 0.152603 May 28 21:51:22.403945 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3256/6550] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:22 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:22.660207 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ae1a4686-f560-4315-b128-ed4f2e3019ba req-3017dc90-6609-4a11-98d3-74c8bb86a41b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f", "tag": "5c959d19-98fd-4c19-990a-823f253c01ec"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:51:22.670028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ae1a4686-f560-4315-b128-ed4f2e3019ba req-3017dc90-6609-4a11-98d3-74c8bb86a41b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:22.670483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ae1a4686-f560-4315-b128-ed4f2e3019ba req-3017dc90-6609-4a11-98d3-74c8bb86a41b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:22.681996 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ae1a4686-f560-4315-b128-ed4f2e3019ba req-3017dc90-6609-4a11-98d3-74c8bb86a41b service nova] Creating event network-changed:5c959d19-98fd-4c19-990a-823f253c01ec for instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f on nch1-master-1 May 28 21:51:22.687962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-ae1a4686-f560-4315-b128-ed4f2e3019ba req-3017dc90-6609-4a11-98d3-74c8bb86a41b service nova] Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:51:22.699080 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ae1a4686-f560-4315-b128-ed4f2e3019ba req-3017dc90-6609-4a11-98d3-74c8bb86a41b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042660 May 28 21:51:22.699673 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3295/6551] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:51:23.420543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-70d20ef6-417e-466f-a3a1-2d2848c69e2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:23.421173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-70d20ef6-417e-466f-a3a1-2d2848c69e2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:23.428310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70d20ef6-417e-466f-a3a1-2d2848c69e2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:23.428776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70d20ef6-417e-466f-a3a1-2d2848c69e2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:23.429555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70d20ef6-417e-466f-a3a1-2d2848c69e2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:23.430032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70d20ef6-417e-466f-a3a1-2d2848c69e2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:23.564560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-70d20ef6-417e-466f-a3a1-2d2848c69e2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:23.573434 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-70d20ef6-417e-466f-a3a1-2d2848c69e2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1681 microversion: 2.1 time: 0.156737 May 28 21:51:23.574632 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3257/6552] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:23 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:24.594213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d4411487-e8b2-4978-9dae-8de6cbfadcfc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:24.594931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d4411487-e8b2-4978-9dae-8de6cbfadcfc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:24.601275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d4411487-e8b2-4978-9dae-8de6cbfadcfc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:24.601734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d4411487-e8b2-4978-9dae-8de6cbfadcfc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:24.602530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d4411487-e8b2-4978-9dae-8de6cbfadcfc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:24.602977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d4411487-e8b2-4978-9dae-8de6cbfadcfc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:24.730693 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d4411487-e8b2-4978-9dae-8de6cbfadcfc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:24.738268 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d4411487-e8b2-4978-9dae-8de6cbfadcfc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1678 microversion: 2.1 time: 0.149112 May 28 21:51:24.738853 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3296/6553] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:24 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:24.755137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b011a44b-5aef-4c66-86ff-ae05f3ed7b9a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:51:24.755636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b011a44b-5aef-4c66-86ff-ae05f3ed7b9a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:24.762660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b011a44b-5aef-4c66-86ff-ae05f3ed7b9a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:24.763132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b011a44b-5aef-4c66-86ff-ae05f3ed7b9a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:24.763914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b011a44b-5aef-4c66-86ff-ae05f3ed7b9a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:24.764371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b011a44b-5aef-4c66-86ff-ae05f3ed7b9a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:24.932479 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b011a44b-5aef-4c66-86ff-ae05f3ed7b9a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f/action" status: 204 len: 0 microversion: 2.1 time: 0.181177 May 28 21:51:24.933831 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3258/6554] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:51:24 2022] POST /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f/action => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:51:24.943025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-46e283a8-4d35-44d7-92fa-1d32bd30aa65 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:24.943761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-46e283a8-4d35-44d7-92fa-1d32bd30aa65 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:24.950474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-46e283a8-4d35-44d7-92fa-1d32bd30aa65 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:24.950934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-46e283a8-4d35-44d7-92fa-1d32bd30aa65 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:24.951701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-46e283a8-4d35-44d7-92fa-1d32bd30aa65 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:24.952148 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-46e283a8-4d35-44d7-92fa-1d32bd30aa65 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:25.154606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-46e283a8-4d35-44d7-92fa-1d32bd30aa65 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:25.162233 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-46e283a8-4d35-44d7-92fa-1d32bd30aa65 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1678 microversion: 2.1 time: 0.223392 May 28 21:51:25.162819 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3297/6555] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:24 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1678 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:26.180895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3ef9aed7-3e66-4f1e-8063-b5a75efcbf27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:26.181623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3ef9aed7-3e66-4f1e-8063-b5a75efcbf27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:26.188588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ef9aed7-3e66-4f1e-8063-b5a75efcbf27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:26.189157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ef9aed7-3e66-4f1e-8063-b5a75efcbf27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:26.189901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ef9aed7-3e66-4f1e-8063-b5a75efcbf27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:26.190364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ef9aed7-3e66-4f1e-8063-b5a75efcbf27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:26.328371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3ef9aed7-3e66-4f1e-8063-b5a75efcbf27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:26.336646 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3ef9aed7-3e66-4f1e-8063-b5a75efcbf27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1678 microversion: 2.1 time: 0.160953 May 28 21:51:26.338000 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3259/6556] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:26 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:27.354544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c92149f5-2452-4c16-b1be-88a5aba7d50a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:27.355115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c92149f5-2452-4c16-b1be-88a5aba7d50a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:27.361619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c92149f5-2452-4c16-b1be-88a5aba7d50a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:27.362113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c92149f5-2452-4c16-b1be-88a5aba7d50a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:27.362879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c92149f5-2452-4c16-b1be-88a5aba7d50a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:27.363328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c92149f5-2452-4c16-b1be-88a5aba7d50a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:27.492185 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c92149f5-2452-4c16-b1be-88a5aba7d50a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:27.499912 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c92149f5-2452-4c16-b1be-88a5aba7d50a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1670 microversion: 2.1 time: 0.149346 May 28 21:51:27.500504 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3298/6557] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:27 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1670 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:27.520205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9308b36b-02d8-4dad-9b6f-cf4c02b96205 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:27.520837 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9308b36b-02d8-4dad-9b6f-cf4c02b96205 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:27.529002 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9308b36b-02d8-4dad-9b6f-cf4c02b96205 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:27.529472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9308b36b-02d8-4dad-9b6f-cf4c02b96205 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:27.530297 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9308b36b-02d8-4dad-9b6f-cf4c02b96205 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:27.530783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9308b36b-02d8-4dad-9b6f-cf4c02b96205 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:27.660648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9308b36b-02d8-4dad-9b6f-cf4c02b96205 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:27.668192 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9308b36b-02d8-4dad-9b6f-cf4c02b96205 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1670 microversion: 2.1 time: 0.151975 May 28 21:51:27.668781 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3260/6558] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:27 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:27.684008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8323526c-ce9f-4457-aeac-3d76a3de02f3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:27.684625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8323526c-ce9f-4457-aeac-3d76a3de02f3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:27.690688 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8323526c-ce9f-4457-aeac-3d76a3de02f3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:27.691143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8323526c-ce9f-4457-aeac-3d76a3de02f3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:27.691911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8323526c-ce9f-4457-aeac-3d76a3de02f3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:27.692350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8323526c-ce9f-4457-aeac-3d76a3de02f3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:27.821312 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8323526c-ce9f-4457-aeac-3d76a3de02f3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:27.829444 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8323526c-ce9f-4457-aeac-3d76a3de02f3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1670 microversion: 2.1 time: 0.149390 May 28 21:51:27.830050 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3299/6559] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:27 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1670 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:27.846219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4ba3bc1b-6d17-4537-901f-5e1542ff106e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:27.846740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4ba3bc1b-6d17-4537-901f-5e1542ff106e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:27.852908 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ba3bc1b-6d17-4537-901f-5e1542ff106e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:27.853382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ba3bc1b-6d17-4537-901f-5e1542ff106e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:27.854205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ba3bc1b-6d17-4537-901f-5e1542ff106e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:27.854698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ba3bc1b-6d17-4537-901f-5e1542ff106e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:27.878980 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4ba3bc1b-6d17-4537-901f-5e1542ff106e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:51:28.200740 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4ba3bc1b-6d17-4537-901f-5e1542ff106e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 204 len: 0 microversion: 2.1 time: 0.357991 May 28 21:51:28.201281 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3261/6560] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:51:27 2022] DELETE /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:51:28.209722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d94247d2-e6f4-462f-b9d5-d20c6627eee6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:28.210376 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d94247d2-e6f4-462f-b9d5-d20c6627eee6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:28.216526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d94247d2-e6f4-462f-b9d5-d20c6627eee6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:28.216984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d94247d2-e6f4-462f-b9d5-d20c6627eee6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:28.217758 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d94247d2-e6f4-462f-b9d5-d20c6627eee6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:28.218231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d94247d2-e6f4-462f-b9d5-d20c6627eee6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:28.350086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d94247d2-e6f4-462f-b9d5-d20c6627eee6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:28.358445 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d94247d2-e6f4-462f-b9d5-d20c6627eee6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1676 microversion: 2.1 time: 0.152907 May 28 21:51:28.359025 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3300/6561] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:28 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:28.474610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-24d047a0-8a9c-4feb-8701-fffe6aebca18 req-a7cba5c6-3fd9-4b30-80f9-654906eed561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f", "name": "network-vif-plugged", "status": "completed", "tag": "5c959d19-98fd-4c19-990a-823f253c01ec"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:51:28.484594 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-24d047a0-8a9c-4feb-8701-fffe6aebca18 req-a7cba5c6-3fd9-4b30-80f9-654906eed561 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:28.485056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-24d047a0-8a9c-4feb-8701-fffe6aebca18 req-a7cba5c6-3fd9-4b30-80f9-654906eed561 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:28.497060 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-24d047a0-8a9c-4feb-8701-fffe6aebca18 req-a7cba5c6-3fd9-4b30-80f9-654906eed561 service nova] Creating event network-vif-plugged:5c959d19-98fd-4c19-990a-823f253c01ec for instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f on nch1-master-1 May 28 21:51:28.501895 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-24d047a0-8a9c-4feb-8701-fffe6aebca18 req-a7cba5c6-3fd9-4b30-80f9-654906eed561 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032192 May 28 21:51:28.507382 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3262/6562] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:51:29.375892 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e9d26c1a-ad76-4043-bc6e-05079ed00cb5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:29.377097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e9d26c1a-ad76-4043-bc6e-05079ed00cb5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:29.384186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e9d26c1a-ad76-4043-bc6e-05079ed00cb5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:29.384644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e9d26c1a-ad76-4043-bc6e-05079ed00cb5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:29.385424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e9d26c1a-ad76-4043-bc6e-05079ed00cb5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:29.385900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e9d26c1a-ad76-4043-bc6e-05079ed00cb5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:29.524292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e9d26c1a-ad76-4043-bc6e-05079ed00cb5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:29.537544 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e9d26c1a-ad76-4043-bc6e-05079ed00cb5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1676 microversion: 2.1 time: 0.165574 May 28 21:51:29.538386 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3301/6563] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:29 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:30.450747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a6eced4a-1dc8-4f7b-b715-65f2018d3e14 req-daaa174f-ad6a-4d56-95f5-a0f0bbb6b6ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f", "name": "network-vif-deleted", "tag": "5c959d19-98fd-4c19-990a-823f253c01ec"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:51:30.459352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a6eced4a-1dc8-4f7b-b715-65f2018d3e14 req-daaa174f-ad6a-4d56-95f5-a0f0bbb6b6ba service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:30.459820 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a6eced4a-1dc8-4f7b-b715-65f2018d3e14 req-daaa174f-ad6a-4d56-95f5-a0f0bbb6b6ba service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:30.471671 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a6eced4a-1dc8-4f7b-b715-65f2018d3e14 req-daaa174f-ad6a-4d56-95f5-a0f0bbb6b6ba service nova] Creating event network-vif-deleted:5c959d19-98fd-4c19-990a-823f253c01ec for instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f on nch1-master-1 May 28 21:51:30.476585 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a6eced4a-1dc8-4f7b-b715-65f2018d3e14 req-daaa174f-ad6a-4d56-95f5-a0f0bbb6b6ba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031152 May 28 21:51:30.477457 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3263/6564] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:51:30.555214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9da0ad63-927f-4f33-9f1c-ab17f012909f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:30.555833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9da0ad63-927f-4f33-9f1c-ab17f012909f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:30.563001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9da0ad63-927f-4f33-9f1c-ab17f012909f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:30.563541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9da0ad63-927f-4f33-9f1c-ab17f012909f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:30.564388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9da0ad63-927f-4f33-9f1c-ab17f012909f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:30.564938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9da0ad63-927f-4f33-9f1c-ab17f012909f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:30.629732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9da0ad63-927f-4f33-9f1c-ab17f012909f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:30.638182 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9da0ad63-927f-4f33-9f1c-ab17f012909f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 200 len: 1609 microversion: 2.1 time: 0.087119 May 28 21:51:30.638769 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3302/6565] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:30 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 1609 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:31.657134 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9ab380ba-e743-4a6e-857d-6b7c15b08b58 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:31.657872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9ab380ba-e743-4a6e-857d-6b7c15b08b58 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:31.664236 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ab380ba-e743-4a6e-857d-6b7c15b08b58 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:31.664701 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ab380ba-e743-4a6e-857d-6b7c15b08b58 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:31.665486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ab380ba-e743-4a6e-857d-6b7c15b08b58 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:31.665972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ab380ba-e743-4a6e-857d-6b7c15b08b58 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:31.679676 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-9ab380ba-e743-4a6e-857d-6b7c15b08b58 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9ab380ba-e743-4a6e-857d-6b7c15b08b58 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f HTTP/1.1 May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f'} May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:51:31.681287 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:51:31.685923 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:51:31.685923 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:51:31.685923 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:51:31.685923 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:51:31.685923 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:51:31.685923 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:51:31.685923 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:51:31.685923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9ab380ba-e743-4a6e-857d-6b7c15b08b58 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:51:31.685923 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9ab380ba-e743-4a6e-857d-6b7c15b08b58 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 404 len: 111 microversion: 2.1 time: 0.030869 May 28 21:51:31.685923 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3264/6566] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:31 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:51:31.696497 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f2aede35-918a-4304-b120-a2a81ce8ac19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:31.697119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f2aede35-918a-4304-b120-a2a81ce8ac19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:31.704092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2aede35-918a-4304-b120-a2a81ce8ac19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:31.704543 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2aede35-918a-4304-b120-a2a81ce8ac19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:31.705311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2aede35-918a-4304-b120-a2a81ce8ac19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:31.705766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f2aede35-918a-4304-b120-a2a81ce8ac19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:31.719785 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-f2aede35-918a-4304-b120-a2a81ce8ac19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f2aede35-918a-4304-b120-a2a81ce8ac19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f HTTP/1.1 May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f'} May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:51:31.721445 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:51:31.725425 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:51:31.725425 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:51:31.725425 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:51:31.725425 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:51:31.725425 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:51:31.725425 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:51:31.725425 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:51:31.725425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f2aede35-918a-4304-b120-a2a81ce8ac19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:51:31.725425 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f2aede35-918a-4304-b120-a2a81ce8ac19 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 404 len: 111 microversion: 2.1 time: 0.030282 May 28 21:51:31.725425 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3303/6567] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:31 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:51:31.775308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-72822068", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "8779b3e1-d96f-4dd9-848b-4204f604f786"}], "security_groups": [{"name": "tempest-securitygroup--535478282"}], "key_name": "tempest-keypair-1087605141", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:51:31.876705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] validate_networks() for [('8779b3e1-d96f-4dd9-848b-4204f604f786', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:51:32.282912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:51:32.283385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:51:32.283877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:51:32.284305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:51:32.284741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:51:32.294172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:32.294638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:32.295460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:32.295918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:32.313389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Getting quotas for project 77ee3a3a7c3c4288984836d79f10e732. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:51:32.318675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Getting quotas for user aa3da8047b124549a05e86b438789dfb and project 77ee3a3a7c3c4288984836d79f10e732. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:51:32.331116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:51:32.333710 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:51:32.484456 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-263e7e03-f0a3-41cf-8356-db36f776a421 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.713085 May 28 21:51:32.485174 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3265/6568] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:51:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:51:32.495260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-019be8ac-d428-4ea1-b6ac-55cca0116c9c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:32.496031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-019be8ac-d428-4ea1-b6ac-55cca0116c9c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:32.549934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-019be8ac-d428-4ea1-b6ac-55cca0116c9c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:32.556734 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-019be8ac-d428-4ea1-b6ac-55cca0116c9c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1237 microversion: 2.1 time: 0.065444 May 28 21:51:32.557303 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3304/6569] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:32 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:33.574726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c3aac15a-20f7-41d5-a41d-a29f603cd68f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:33.575612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c3aac15a-20f7-41d5-a41d-a29f603cd68f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:33.584102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3aac15a-20f7-41d5-a41d-a29f603cd68f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:33.584570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3aac15a-20f7-41d5-a41d-a29f603cd68f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:33.586171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3aac15a-20f7-41d5-a41d-a29f603cd68f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:33.586171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c3aac15a-20f7-41d5-a41d-a29f603cd68f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:33.648415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c3aac15a-20f7-41d5-a41d-a29f603cd68f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:33.656979 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c3aac15a-20f7-41d5-a41d-a29f603cd68f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1241 microversion: 2.1 time: 0.086874 May 28 21:51:33.657561 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3266/6570] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:33 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:34.674642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9d575b52-ca54-4f3f-809d-1d3509bc6b35 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:34.675188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9d575b52-ca54-4f3f-809d-1d3509bc6b35 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:34.683621 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d575b52-ca54-4f3f-809d-1d3509bc6b35 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:34.684080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d575b52-ca54-4f3f-809d-1d3509bc6b35 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:34.684841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d575b52-ca54-4f3f-809d-1d3509bc6b35 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:34.685282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d575b52-ca54-4f3f-809d-1d3509bc6b35 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:34.758468 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9d575b52-ca54-4f3f-809d-1d3509bc6b35 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:34.766436 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9d575b52-ca54-4f3f-809d-1d3509bc6b35 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1307 microversion: 2.1 time: 0.095716 May 28 21:51:34.767353 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3305/6571] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:34 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:35.784107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ceecdd50-9008-4977-a20b-ecec0dedaa98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:35.785263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ceecdd50-9008-4977-a20b-ecec0dedaa98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:35.793382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ceecdd50-9008-4977-a20b-ecec0dedaa98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:35.793868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ceecdd50-9008-4977-a20b-ecec0dedaa98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:35.794694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ceecdd50-9008-4977-a20b-ecec0dedaa98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:35.795153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ceecdd50-9008-4977-a20b-ecec0dedaa98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:35.937220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ceecdd50-9008-4977-a20b-ecec0dedaa98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:35.949092 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ceecdd50-9008-4977-a20b-ecec0dedaa98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1362 microversion: 2.1 time: 0.168260 May 28 21:51:35.949876 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3267/6572] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:35 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:36.083122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-20353bf4-af36-4545-a9b9-013d5e9f56b7 req-b1dea964-75b0-4035-aedf-17d3fcf6f05c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2", "tag": "d087cd30-8be7-4e1e-9684-b3837d43d90b"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:51:36.099493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-20353bf4-af36-4545-a9b9-013d5e9f56b7 req-b1dea964-75b0-4035-aedf-17d3fcf6f05c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:36.099493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-20353bf4-af36-4545-a9b9-013d5e9f56b7 req-b1dea964-75b0-4035-aedf-17d3fcf6f05c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:36.116008 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-20353bf4-af36-4545-a9b9-013d5e9f56b7 req-b1dea964-75b0-4035-aedf-17d3fcf6f05c service nova] Creating event network-changed:d087cd30-8be7-4e1e-9684-b3837d43d90b for instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 on nch1-master-1 May 28 21:51:36.121652 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-20353bf4-af36-4545-a9b9-013d5e9f56b7 req-b1dea964-75b0-4035-aedf-17d3fcf6f05c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042474 May 28 21:51:36.122319 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3306/6573] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:51:36.967758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a45f06c9-9845-42b7-b7c5-62cd3b9e64ae tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:36.968691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a45f06c9-9845-42b7-b7c5-62cd3b9e64ae tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:36.975748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a45f06c9-9845-42b7-b7c5-62cd3b9e64ae tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:36.976219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a45f06c9-9845-42b7-b7c5-62cd3b9e64ae tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:36.977007 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a45f06c9-9845-42b7-b7c5-62cd3b9e64ae tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:36.977463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a45f06c9-9845-42b7-b7c5-62cd3b9e64ae tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:37.114034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a45f06c9-9845-42b7-b7c5-62cd3b9e64ae tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:37.121573 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a45f06c9-9845-42b7-b7c5-62cd3b9e64ae tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1362 microversion: 2.1 time: 0.158386 May 28 21:51:37.122194 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3268/6574] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:36 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:38.140211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-31443318-ee8e-470c-bf58-784d21d0ecd0 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:38.140920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-31443318-ee8e-470c-bf58-784d21d0ecd0 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:38.147357 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31443318-ee8e-470c-bf58-784d21d0ecd0 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:38.152845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31443318-ee8e-470c-bf58-784d21d0ecd0 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:38.152845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31443318-ee8e-470c-bf58-784d21d0ecd0 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:38.152845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-31443318-ee8e-470c-bf58-784d21d0ecd0 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:38.276208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-31443318-ee8e-470c-bf58-784d21d0ecd0 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:38.283886 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-31443318-ee8e-470c-bf58-784d21d0ecd0 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1362 microversion: 2.1 time: 0.148840 May 28 21:51:38.284463 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3307/6575] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:38 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:39.301546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d36efb25-1263-45d1-a54f-bb1d1fc3348f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:39.302237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d36efb25-1263-45d1-a54f-bb1d1fc3348f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:39.309307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d36efb25-1263-45d1-a54f-bb1d1fc3348f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:39.309779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d36efb25-1263-45d1-a54f-bb1d1fc3348f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:39.310588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d36efb25-1263-45d1-a54f-bb1d1fc3348f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:39.311044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d36efb25-1263-45d1-a54f-bb1d1fc3348f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:39.437250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d36efb25-1263-45d1-a54f-bb1d1fc3348f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:39.445123 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d36efb25-1263-45d1-a54f-bb1d1fc3348f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1362 microversion: 2.1 time: 0.147579 May 28 21:51:39.445712 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3269/6576] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:39 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:40.462813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-209117b0-efc0-46d7-86c4-6db19132da77 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:40.463586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-209117b0-efc0-46d7-86c4-6db19132da77 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:40.470547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-209117b0-efc0-46d7-86c4-6db19132da77 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:40.471038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-209117b0-efc0-46d7-86c4-6db19132da77 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:40.471820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-209117b0-efc0-46d7-86c4-6db19132da77 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:40.472270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-209117b0-efc0-46d7-86c4-6db19132da77 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:40.610831 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-209117b0-efc0-46d7-86c4-6db19132da77 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:40.618410 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-209117b0-efc0-46d7-86c4-6db19132da77 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1362 microversion: 2.1 time: 0.159530 May 28 21:51:40.618992 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3308/6577] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:40 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:41.635913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1a46c5eb-69d0-4786-922f-9f8ec31b4784 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:41.636541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1a46c5eb-69d0-4786-922f-9f8ec31b4784 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:41.643687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a46c5eb-69d0-4786-922f-9f8ec31b4784 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:41.644154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a46c5eb-69d0-4786-922f-9f8ec31b4784 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:41.644928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a46c5eb-69d0-4786-922f-9f8ec31b4784 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:41.645424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a46c5eb-69d0-4786-922f-9f8ec31b4784 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:41.777469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1a46c5eb-69d0-4786-922f-9f8ec31b4784 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:41.781107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:51:41.785533 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1a46c5eb-69d0-4786-922f-9f8ec31b4784 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1362 microversion: 2.1 time: 0.153697 May 28 21:51:41.786150 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3270/6578] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:41 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:51:42.519547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-2b82b62a-8d7f-466e-ae64-ca21d799a720 req-b12d8677-b66d-4587-81b0-9e5be03ba7cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2", "name": "network-vif-plugged", "status": "completed", "tag": "d087cd30-8be7-4e1e-9684-b3837d43d90b"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:51:42.528703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2b82b62a-8d7f-466e-ae64-ca21d799a720 req-b12d8677-b66d-4587-81b0-9e5be03ba7cb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:42.529176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2b82b62a-8d7f-466e-ae64-ca21d799a720 req-b12d8677-b66d-4587-81b0-9e5be03ba7cb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:42.540540 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-2b82b62a-8d7f-466e-ae64-ca21d799a720 req-b12d8677-b66d-4587-81b0-9e5be03ba7cb service nova] Creating event network-vif-plugged:d087cd30-8be7-4e1e-9684-b3837d43d90b for instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 on nch1-master-1 May 28 21:51:42.545587 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-2b82b62a-8d7f-466e-ae64-ca21d799a720 req-b12d8677-b66d-4587-81b0-9e5be03ba7cb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029898 May 28 21:51:42.546220 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3309/6579] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:51:42.803819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-238d89ae-4e3a-4f5f-adbf-946332b7122c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:42.804452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-238d89ae-4e3a-4f5f-adbf-946332b7122c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:42.806686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:51:42.807347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:51:42.814147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-238d89ae-4e3a-4f5f-adbf-946332b7122c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:42.818209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-238d89ae-4e3a-4f5f-adbf-946332b7122c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:42.818209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-238d89ae-4e3a-4f5f-adbf-946332b7122c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:42.818209 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-238d89ae-4e3a-4f5f-adbf-946332b7122c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:42.948939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-238d89ae-4e3a-4f5f-adbf-946332b7122c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:42.956660 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-238d89ae-4e3a-4f5f-adbf-946332b7122c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1362 microversion: 2.1 time: 0.156768 May 28 21:51:42.957825 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3271/6580] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:42 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:51:43.975737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-46aae2a6-fc22-4429-92f0-f88aa993ab68 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:43.976377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-46aae2a6-fc22-4429-92f0-f88aa993ab68 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:43.978473 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:51:43.980812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=42 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:51:43.985863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-46aae2a6-fc22-4429-92f0-f88aa993ab68 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:43.986619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-46aae2a6-fc22-4429-92f0-f88aa993ab68 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:43.987159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-46aae2a6-fc22-4429-92f0-f88aa993ab68 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:43.987609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-46aae2a6-fc22-4429-92f0-f88aa993ab68 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:43.990283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=100 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:51:44.117874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-46aae2a6-fc22-4429-92f0-f88aa993ab68 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:51:44.125548 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-46aae2a6-fc22-4429-92f0-f88aa993ab68 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1549 microversion: 2.1 time: 0.154325 May 28 21:51:44.126170 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3310/6581] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:51:43 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:51:44.143185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f32d1b2e-8f59-4408-8435-f4923ce71863 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:51:44.147218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f32d1b2e-8f59-4408-8435-f4923ce71863 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:51:44.150851 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f32d1b2e-8f59-4408-8435-f4923ce71863 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:44.151331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f32d1b2e-8f59-4408-8435-f4923ce71863 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:44.152762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f32d1b2e-8f59-4408-8435-f4923ce71863 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:44.153221 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f32d1b2e-8f59-4408-8435-f4923ce71863 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:44.229777 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f32d1b2e-8f59-4408-8435-f4923ce71863 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090491 May 28 21:51:44.230443 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3272/6582] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:51:44 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:51:45.512912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-1b3cb808-6269-4562-8c83-348b438e7918 req-0efdcd7e-5e13-4c2b-b18a-bb0384487c03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2", "tag": "d087cd30-8be7-4e1e-9684-b3837d43d90b"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:51:45.522490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1b3cb808-6269-4562-8c83-348b438e7918 req-0efdcd7e-5e13-4c2b-b18a-bb0384487c03 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:51:45.522944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-1b3cb808-6269-4562-8c83-348b438e7918 req-0efdcd7e-5e13-4c2b-b18a-bb0384487c03 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:51:45.533984 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-1b3cb808-6269-4562-8c83-348b438e7918 req-0efdcd7e-5e13-4c2b-b18a-bb0384487c03 service nova] Creating event network-changed:d087cd30-8be7-4e1e-9684-b3837d43d90b for instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 on nch1-master-1 May 28 21:51:45.539072 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-1b3cb808-6269-4562-8c83-348b438e7918 req-0efdcd7e-5e13-4c2b-b18a-bb0384487c03 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031043 May 28 21:51:45.539703 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3311/6583] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:52:21.805868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:52:21.806682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=10 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:52:21.810807 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fd73a6ba-8478-4efd-851e-d41317f7ae2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:52:21.818316 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fd73a6ba-8478-4efd-851e-d41317f7ae2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:21.818788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fd73a6ba-8478-4efd-851e-d41317f7ae2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:21.841830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fd73a6ba-8478-4efd-851e-d41317f7ae2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Going to try to stop instance {{(pid=143128) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 21:52:21.996112 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fd73a6ba-8478-4efd-851e-d41317f7ae2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2/action" status: 202 len: 0 microversion: 2.1 time: 0.191989 May 28 21:52:21.996844 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3273/6584] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:52:21 2022] POST /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:52:22.006658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f4899d5f-4089-42cf-83b1-46abfd4e2851 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:22.007407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f4899d5f-4089-42cf-83b1-46abfd4e2851 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:22.010566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:52:22.011233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=7 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:52:22.016276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4899d5f-4089-42cf-83b1-46abfd4e2851 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:22.016727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4899d5f-4089-42cf-83b1-46abfd4e2851 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:22.018165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4899d5f-4089-42cf-83b1-46abfd4e2851 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:22.018610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f4899d5f-4089-42cf-83b1-46abfd4e2851 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:22.151257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f4899d5f-4089-42cf-83b1-46abfd4e2851 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:22.158962 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f4899d5f-4089-42cf-83b1-46abfd4e2851 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.157635 May 28 21:52:22.159545 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3312/6585] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:22 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:23.178277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0d061674-3c5d-4ebf-a38c-9201f9a9c937 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:23.179001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0d061674-3c5d-4ebf-a38c-9201f9a9c937 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:23.185789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d061674-3c5d-4ebf-a38c-9201f9a9c937 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:23.186286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d061674-3c5d-4ebf-a38c-9201f9a9c937 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:23.187072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d061674-3c5d-4ebf-a38c-9201f9a9c937 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:23.187530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0d061674-3c5d-4ebf-a38c-9201f9a9c937 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:23.319543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0d061674-3c5d-4ebf-a38c-9201f9a9c937 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:23.327505 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0d061674-3c5d-4ebf-a38c-9201f9a9c937 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.154881 May 28 21:52:23.328105 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3274/6586] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:23 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:24.345096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b2219193-9142-4c6f-abba-ba61a393c900 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:24.345669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b2219193-9142-4c6f-abba-ba61a393c900 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:24.353196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2219193-9142-4c6f-abba-ba61a393c900 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:24.353662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2219193-9142-4c6f-abba-ba61a393c900 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:24.354472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2219193-9142-4c6f-abba-ba61a393c900 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:24.354930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2219193-9142-4c6f-abba-ba61a393c900 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:24.483167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b2219193-9142-4c6f-abba-ba61a393c900 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:24.490826 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b2219193-9142-4c6f-abba-ba61a393c900 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.149738 May 28 21:52:24.491409 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3313/6587] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:24 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:25.508667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-32f8b803-e5a9-4fad-a375-4d7c2b816800 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:25.509243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-32f8b803-e5a9-4fad-a375-4d7c2b816800 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:25.515610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32f8b803-e5a9-4fad-a375-4d7c2b816800 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:25.516073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32f8b803-e5a9-4fad-a375-4d7c2b816800 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:25.516846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32f8b803-e5a9-4fad-a375-4d7c2b816800 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:25.517341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-32f8b803-e5a9-4fad-a375-4d7c2b816800 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:25.649932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-32f8b803-e5a9-4fad-a375-4d7c2b816800 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:25.657663 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-32f8b803-e5a9-4fad-a375-4d7c2b816800 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.153150 May 28 21:52:25.658288 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3275/6588] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:25 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:26.676476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3f45ce1e-993d-43de-9f6d-a9e63350e414 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:26.677098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3f45ce1e-993d-43de-9f6d-a9e63350e414 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:26.683374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f45ce1e-993d-43de-9f6d-a9e63350e414 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:26.683832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f45ce1e-993d-43de-9f6d-a9e63350e414 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:26.684604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f45ce1e-993d-43de-9f6d-a9e63350e414 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:26.685048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f45ce1e-993d-43de-9f6d-a9e63350e414 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:26.810236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3f45ce1e-993d-43de-9f6d-a9e63350e414 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:26.817758 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3f45ce1e-993d-43de-9f6d-a9e63350e414 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.145924 May 28 21:52:26.818354 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3314/6589] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:26 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:27.835868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c7691898-f557-436c-b460-0c8f6d4e9862 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:27.836485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c7691898-f557-436c-b460-0c8f6d4e9862 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:27.843488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7691898-f557-436c-b460-0c8f6d4e9862 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:27.843963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7691898-f557-436c-b460-0c8f6d4e9862 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:27.844746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7691898-f557-436c-b460-0c8f6d4e9862 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:27.845203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7691898-f557-436c-b460-0c8f6d4e9862 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:27.970881 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c7691898-f557-436c-b460-0c8f6d4e9862 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:27.979662 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c7691898-f557-436c-b460-0c8f6d4e9862 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.147980 May 28 21:52:27.980576 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3276/6590] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:27 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:52:28.996645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e6d0a01e-767c-4776-adbc-3304dc130228 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:28.997178 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e6d0a01e-767c-4776-adbc-3304dc130228 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:29.004816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6d0a01e-767c-4776-adbc-3304dc130228 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:29.005274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6d0a01e-767c-4776-adbc-3304dc130228 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:29.006079 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6d0a01e-767c-4776-adbc-3304dc130228 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:29.006526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e6d0a01e-767c-4776-adbc-3304dc130228 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:29.139167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e6d0a01e-767c-4776-adbc-3304dc130228 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:29.146835 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e6d0a01e-767c-4776-adbc-3304dc130228 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.154192 May 28 21:52:29.147410 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3315/6591] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:28 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:30.164203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ad610aa0-2c6e-4bf3-8d0d-974922827e2a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:30.164826 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ad610aa0-2c6e-4bf3-8d0d-974922827e2a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:30.172292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad610aa0-2c6e-4bf3-8d0d-974922827e2a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:30.172383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad610aa0-2c6e-4bf3-8d0d-974922827e2a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:30.173122 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad610aa0-2c6e-4bf3-8d0d-974922827e2a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:30.173580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad610aa0-2c6e-4bf3-8d0d-974922827e2a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:30.302909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ad610aa0-2c6e-4bf3-8d0d-974922827e2a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:30.310696 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ad610aa0-2c6e-4bf3-8d0d-974922827e2a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.150523 May 28 21:52:30.311355 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3277/6592] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:30 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:31.328485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f09bf9a5-fde9-41cb-b82b-3b43431c2355 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:31.329071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f09bf9a5-fde9-41cb-b82b-3b43431c2355 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:31.336283 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f09bf9a5-fde9-41cb-b82b-3b43431c2355 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:31.336735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f09bf9a5-fde9-41cb-b82b-3b43431c2355 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:31.337498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f09bf9a5-fde9-41cb-b82b-3b43431c2355 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:31.337969 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f09bf9a5-fde9-41cb-b82b-3b43431c2355 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:31.471116 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f09bf9a5-fde9-41cb-b82b-3b43431c2355 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:31.478858 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f09bf9a5-fde9-41cb-b82b-3b43431c2355 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.154410 May 28 21:52:31.479439 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3316/6593] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:31 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:32.495789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8c5453c8-f6c0-4b85-93f9-fab98fc2ac66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:32.496342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8c5453c8-f6c0-4b85-93f9-fab98fc2ac66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:32.503415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c5453c8-f6c0-4b85-93f9-fab98fc2ac66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:32.503884 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c5453c8-f6c0-4b85-93f9-fab98fc2ac66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:32.504666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c5453c8-f6c0-4b85-93f9-fab98fc2ac66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:32.505123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8c5453c8-f6c0-4b85-93f9-fab98fc2ac66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:32.632651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8c5453c8-f6c0-4b85-93f9-fab98fc2ac66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:32.640466 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8c5453c8-f6c0-4b85-93f9-fab98fc2ac66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.148671 May 28 21:52:32.641050 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3278/6594] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:32 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:33.657666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-691f05b0-f621-47f9-9950-b810d4db35f6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:33.658317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-691f05b0-f621-47f9-9950-b810d4db35f6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:33.665377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-691f05b0-f621-47f9-9950-b810d4db35f6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:33.665851 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-691f05b0-f621-47f9-9950-b810d4db35f6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:33.666638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-691f05b0-f621-47f9-9950-b810d4db35f6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:33.667082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-691f05b0-f621-47f9-9950-b810d4db35f6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:33.795348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-691f05b0-f621-47f9-9950-b810d4db35f6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:33.803756 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-691f05b0-f621-47f9-9950-b810d4db35f6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.150068 May 28 21:52:33.804334 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3317/6595] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:33 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:34.821068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-46b638fe-1248-43d6-8ef9-6bba349b96f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:34.821723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-46b638fe-1248-43d6-8ef9-6bba349b96f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:34.829036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46b638fe-1248-43d6-8ef9-6bba349b96f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:34.832023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46b638fe-1248-43d6-8ef9-6bba349b96f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:34.832023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46b638fe-1248-43d6-8ef9-6bba349b96f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:34.832023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-46b638fe-1248-43d6-8ef9-6bba349b96f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:34.963690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-46b638fe-1248-43d6-8ef9-6bba349b96f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:34.971313 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-46b638fe-1248-43d6-8ef9-6bba349b96f9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.154261 May 28 21:52:34.971894 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3279/6596] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:34 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:35.987555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0dd813a8-4488-430b-9667-79e07a5f91ec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:35.988173 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0dd813a8-4488-430b-9667-79e07a5f91ec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:35.995194 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0dd813a8-4488-430b-9667-79e07a5f91ec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:35.995650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0dd813a8-4488-430b-9667-79e07a5f91ec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:35.996415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0dd813a8-4488-430b-9667-79e07a5f91ec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:35.996861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0dd813a8-4488-430b-9667-79e07a5f91ec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:36.124377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0dd813a8-4488-430b-9667-79e07a5f91ec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:36.132587 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0dd813a8-4488-430b-9667-79e07a5f91ec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.149037 May 28 21:52:36.133166 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3318/6597] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:35 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:37.148849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-71d1eba1-863a-4423-8d60-f2718eb336cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:37.149480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-71d1eba1-863a-4423-8d60-f2718eb336cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:37.156511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71d1eba1-863a-4423-8d60-f2718eb336cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:37.156970 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71d1eba1-863a-4423-8d60-f2718eb336cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:37.157746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71d1eba1-863a-4423-8d60-f2718eb336cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:37.158737 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71d1eba1-863a-4423-8d60-f2718eb336cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:37.290539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-71d1eba1-863a-4423-8d60-f2718eb336cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:37.298421 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-71d1eba1-863a-4423-8d60-f2718eb336cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.153448 May 28 21:52:37.299058 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3280/6598] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:37 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:38.315576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a9c0c8db-c4f8-46a9-a5b4-e9468454c8a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:38.316124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a9c0c8db-c4f8-46a9-a5b4-e9468454c8a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:38.323217 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9c0c8db-c4f8-46a9-a5b4-e9468454c8a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:38.323677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9c0c8db-c4f8-46a9-a5b4-e9468454c8a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:38.324444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9c0c8db-c4f8-46a9-a5b4-e9468454c8a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:38.324889 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9c0c8db-c4f8-46a9-a5b4-e9468454c8a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:38.449854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a9c0c8db-c4f8-46a9-a5b4-e9468454c8a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:38.457673 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a9c0c8db-c4f8-46a9-a5b4-e9468454c8a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1655 microversion: 2.1 time: 0.146079 May 28 21:52:38.458289 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3319/6599] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:38 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1655 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:38.474428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4ef36c14-a274-4391-8917-5adecd66c05d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:52:38.475472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4ef36c14-a274-4391-8917-5adecd66c05d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:38.482397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ef36c14-a274-4391-8917-5adecd66c05d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:38.482859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ef36c14-a274-4391-8917-5adecd66c05d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:38.483631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ef36c14-a274-4391-8917-5adecd66c05d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:38.484081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4ef36c14-a274-4391-8917-5adecd66c05d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:38.514680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4ef36c14-a274-4391-8917-5adecd66c05d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:38.520543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4ef36c14-a274-4391-8917-5adecd66c05d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Old instance type m1.heat2, new instance type m1.heat {{(pid=143128) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 21:52:38.526777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-4ef36c14-a274-4391-8917-5adecd66c05d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:52:38.527211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-4ef36c14-a274-4391-8917-5adecd66c05d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:52:38.527703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-4ef36c14-a274-4391-8917-5adecd66c05d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:52:38.528126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-4ef36c14-a274-4391-8917-5adecd66c05d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:52:38.528552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-4ef36c14-a274-4391-8917-5adecd66c05d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:52:38.752566 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4ef36c14-a274-4391-8917-5adecd66c05d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2/action" status: 202 len: 0 microversion: 2.1 time: 0.282433 May 28 21:52:38.753116 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3281/6600] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:52:38 2022] POST /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:52:38.761368 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0828f4fb-e29b-484f-966e-5148e2787b50 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:38.762176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0828f4fb-e29b-484f-966e-5148e2787b50 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:38.768885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0828f4fb-e29b-484f-966e-5148e2787b50 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:38.769342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0828f4fb-e29b-484f-966e-5148e2787b50 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:38.770140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0828f4fb-e29b-484f-966e-5148e2787b50 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:38.770675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0828f4fb-e29b-484f-966e-5148e2787b50 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:38.902386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0828f4fb-e29b-484f-966e-5148e2787b50 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:38.910578 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0828f4fb-e29b-484f-966e-5148e2787b50 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.153309 May 28 21:52:38.911150 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3320/6601] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:38 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:52:39.928835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4240dec9-e333-43fd-a13a-c4bf2bf2eb53 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:39.929475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4240dec9-e333-43fd-a13a-c4bf2bf2eb53 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:39.935656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4240dec9-e333-43fd-a13a-c4bf2bf2eb53 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:39.936128 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4240dec9-e333-43fd-a13a-c4bf2bf2eb53 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:39.936911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4240dec9-e333-43fd-a13a-c4bf2bf2eb53 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:39.937370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4240dec9-e333-43fd-a13a-c4bf2bf2eb53 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:40.069381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4240dec9-e333-43fd-a13a-c4bf2bf2eb53 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:40.077119 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4240dec9-e333-43fd-a13a-c4bf2bf2eb53 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.153102 May 28 21:52:40.088206 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3282/6602] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:39 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:41.095298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0a6fabfd-d6d6-4e32-a07f-b441c662c6c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:41.096496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0a6fabfd-d6d6-4e32-a07f-b441c662c6c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:41.103515 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a6fabfd-d6d6-4e32-a07f-b441c662c6c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:41.103971 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a6fabfd-d6d6-4e32-a07f-b441c662c6c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:41.104748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a6fabfd-d6d6-4e32-a07f-b441c662c6c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:41.105200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a6fabfd-d6d6-4e32-a07f-b441c662c6c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:41.239255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0a6fabfd-d6d6-4e32-a07f-b441c662c6c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:41.247024 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0a6fabfd-d6d6-4e32-a07f-b441c662c6c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1678 microversion: 2.1 time: 0.155587 May 28 21:52:41.247591 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3321/6603] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:41 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:42.263472 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f8ea255c-cad6-4148-be4c-c7c28acca872 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:42.264114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f8ea255c-cad6-4148-be4c-c7c28acca872 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:42.271166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8ea255c-cad6-4148-be4c-c7c28acca872 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:42.271636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8ea255c-cad6-4148-be4c-c7c28acca872 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:42.272466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8ea255c-cad6-4148-be4c-c7c28acca872 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:42.272921 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f8ea255c-cad6-4148-be4c-c7c28acca872 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:42.399806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f8ea255c-cad6-4148-be4c-c7c28acca872 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:42.407406 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f8ea255c-cad6-4148-be4c-c7c28acca872 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1683 microversion: 2.1 time: 0.147930 May 28 21:52:42.408488 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3283/6604] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:42 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:43.425549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a540cbdb-3c19-4f3b-bf93-2c22d38019b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:43.426119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a540cbdb-3c19-4f3b-bf93-2c22d38019b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:43.433081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a540cbdb-3c19-4f3b-bf93-2c22d38019b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:43.433542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a540cbdb-3c19-4f3b-bf93-2c22d38019b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:43.434353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a540cbdb-3c19-4f3b-bf93-2c22d38019b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:43.434803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a540cbdb-3c19-4f3b-bf93-2c22d38019b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:43.564784 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a540cbdb-3c19-4f3b-bf93-2c22d38019b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:43.572434 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a540cbdb-3c19-4f3b-bf93-2c22d38019b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1683 microversion: 2.1 time: 0.150963 May 28 21:52:43.573009 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3322/6605] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:43 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:44.590179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cc3a7b33-367b-4f90-813c-fb267dabdb66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:44.590895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cc3a7b33-367b-4f90-813c-fb267dabdb66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:44.598215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc3a7b33-367b-4f90-813c-fb267dabdb66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:44.598694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc3a7b33-367b-4f90-813c-fb267dabdb66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:44.599527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc3a7b33-367b-4f90-813c-fb267dabdb66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:44.599986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cc3a7b33-367b-4f90-813c-fb267dabdb66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:44.736146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-0282f736-467d-4e9d-9631-52818c617a4c req-44d89576-e141-402f-8d39-c348d9e2b570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2", "name": "network-vif-unplugged", "status": "completed", "tag": "d087cd30-8be7-4e1e-9684-b3837d43d90b"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:52:44.745806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0282f736-467d-4e9d-9631-52818c617a4c req-44d89576-e141-402f-8d39-c348d9e2b570 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:44.746309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0282f736-467d-4e9d-9631-52818c617a4c req-44d89576-e141-402f-8d39-c348d9e2b570 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:44.758896 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-0282f736-467d-4e9d-9631-52818c617a4c req-44d89576-e141-402f-8d39-c348d9e2b570 service nova] Creating event network-vif-unplugged:d087cd30-8be7-4e1e-9684-b3837d43d90b for instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 on nch2-master-1 May 28 21:52:44.764466 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-0282f736-467d-4e9d-9631-52818c617a4c req-44d89576-e141-402f-8d39-c348d9e2b570 service nova] Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:52:44.775505 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-0282f736-467d-4e9d-9631-52818c617a4c req-44d89576-e141-402f-8d39-c348d9e2b570 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043069 May 28 21:52:44.776112 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3323/6606] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:52:44.790430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cc3a7b33-367b-4f90-813c-fb267dabdb66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:44.798053 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cc3a7b33-367b-4f90-813c-fb267dabdb66 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1682 microversion: 2.1 time: 0.211883 May 28 21:52:44.798745 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3284/6607] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:44 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:45.818506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7a5176b3-8458-45d9-8850-66757eac9b3a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:45.819329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7a5176b3-8458-45d9-8850-66757eac9b3a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:45.825891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a5176b3-8458-45d9-8850-66757eac9b3a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:45.826356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a5176b3-8458-45d9-8850-66757eac9b3a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:45.827161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a5176b3-8458-45d9-8850-66757eac9b3a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:45.827609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7a5176b3-8458-45d9-8850-66757eac9b3a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:45.973725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7a5176b3-8458-45d9-8850-66757eac9b3a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:45.982388 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7a5176b3-8458-45d9-8850-66757eac9b3a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1682 microversion: 2.1 time: 0.169782 May 28 21:52:45.982974 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3324/6608] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:45 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:46.791832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-47a3b14b-3dfe-4d15-8c70-2476e3a3b113 req-94531e6d-b575-464d-abc0-7ce7b47163eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2", "tag": "d087cd30-8be7-4e1e-9684-b3837d43d90b"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:52:46.801429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-47a3b14b-3dfe-4d15-8c70-2476e3a3b113 req-94531e6d-b575-464d-abc0-7ce7b47163eb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:46.801913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-47a3b14b-3dfe-4d15-8c70-2476e3a3b113 req-94531e6d-b575-464d-abc0-7ce7b47163eb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:46.813328 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-47a3b14b-3dfe-4d15-8c70-2476e3a3b113 req-94531e6d-b575-464d-abc0-7ce7b47163eb service nova] Creating event network-changed:d087cd30-8be7-4e1e-9684-b3837d43d90b for instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 on nch2-master-1 May 28 21:52:46.818758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-47a3b14b-3dfe-4d15-8c70-2476e3a3b113 req-94531e6d-b575-464d-abc0-7ce7b47163eb service nova] Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:52:46.829152 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-47a3b14b-3dfe-4d15-8c70-2476e3a3b113 req-94531e6d-b575-464d-abc0-7ce7b47163eb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041440 May 28 21:52:46.829732 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3285/6609] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:52:46.999858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-64318a20-e8e2-4e74-91cc-e5ca20aa4aa3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:47.000481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-64318a20-e8e2-4e74-91cc-e5ca20aa4aa3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:47.008223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64318a20-e8e2-4e74-91cc-e5ca20aa4aa3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:47.008684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64318a20-e8e2-4e74-91cc-e5ca20aa4aa3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:47.009454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64318a20-e8e2-4e74-91cc-e5ca20aa4aa3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:47.009937 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64318a20-e8e2-4e74-91cc-e5ca20aa4aa3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:47.151538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-64318a20-e8e2-4e74-91cc-e5ca20aa4aa3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:47.159487 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-64318a20-e8e2-4e74-91cc-e5ca20aa4aa3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1680 microversion: 2.1 time: 0.163636 May 28 21:52:47.160152 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3325/6610] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:46 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:48.178549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0a27085f-f5b2-422f-ac76-736c5e98889c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:48.179355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0a27085f-f5b2-422f-ac76-736c5e98889c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:48.185565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a27085f-f5b2-422f-ac76-736c5e98889c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:48.186097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a27085f-f5b2-422f-ac76-736c5e98889c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:48.186903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a27085f-f5b2-422f-ac76-736c5e98889c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:48.187356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a27085f-f5b2-422f-ac76-736c5e98889c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:48.318822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0a27085f-f5b2-422f-ac76-736c5e98889c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:48.326502 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0a27085f-f5b2-422f-ac76-736c5e98889c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1676 microversion: 2.1 time: 0.153707 May 28 21:52:48.327720 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3286/6611] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:48 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:48.343720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8bc8c112-338a-4975-bcb7-8d57c5112a01 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:52:48.344263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8bc8c112-338a-4975-bcb7-8d57c5112a01 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:48.351521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bc8c112-338a-4975-bcb7-8d57c5112a01 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:48.352011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bc8c112-338a-4975-bcb7-8d57c5112a01 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:48.352802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bc8c112-338a-4975-bcb7-8d57c5112a01 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:48.353227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8bc8c112-338a-4975-bcb7-8d57c5112a01 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:48.531116 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8bc8c112-338a-4975-bcb7-8d57c5112a01 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2/action" status: 204 len: 0 microversion: 2.1 time: 0.191085 May 28 21:52:48.531761 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3326/6612] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:52:48 2022] POST /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2/action => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:52:48.540066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-52dd86d0-e2a2-49db-8b29-996380e1e02c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:48.540707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-52dd86d0-e2a2-49db-8b29-996380e1e02c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:48.550527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52dd86d0-e2a2-49db-8b29-996380e1e02c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:48.551364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52dd86d0-e2a2-49db-8b29-996380e1e02c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:48.552511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52dd86d0-e2a2-49db-8b29-996380e1e02c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:48.553066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52dd86d0-e2a2-49db-8b29-996380e1e02c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:48.573909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:52:48.700317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-52dd86d0-e2a2-49db-8b29-996380e1e02c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:48.711625 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-52dd86d0-e2a2-49db-8b29-996380e1e02c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1676 microversion: 2.1 time: 0.175307 May 28 21:52:48.713880 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3287/6613] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:48 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:49.730191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-092ed686-27cb-41af-8c2b-ce4772e073b8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:49.730882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-092ed686-27cb-41af-8c2b-ce4772e073b8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:49.737963 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-092ed686-27cb-41af-8c2b-ce4772e073b8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:49.738509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-092ed686-27cb-41af-8c2b-ce4772e073b8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:49.739336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-092ed686-27cb-41af-8c2b-ce4772e073b8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:49.739787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-092ed686-27cb-41af-8c2b-ce4772e073b8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:49.874984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-092ed686-27cb-41af-8c2b-ce4772e073b8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:49.877459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:52:49.883774 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-092ed686-27cb-41af-8c2b-ce4772e073b8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1676 microversion: 2.1 time: 0.158963 May 28 21:52:49.884355 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3327/6614] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:49 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:50.324133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2f2a6db1-e1ac-4c1a-9556-d3e6a4b0b640 req-296ceb39-2f86-41a9-8d05-51884f6b7111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2", "name": "network-vif-plugged", "status": "completed", "tag": "d087cd30-8be7-4e1e-9684-b3837d43d90b"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:52:50.333794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2f2a6db1-e1ac-4c1a-9556-d3e6a4b0b640 req-296ceb39-2f86-41a9-8d05-51884f6b7111 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:50.334291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2f2a6db1-e1ac-4c1a-9556-d3e6a4b0b640 req-296ceb39-2f86-41a9-8d05-51884f6b7111 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:50.345229 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2f2a6db1-e1ac-4c1a-9556-d3e6a4b0b640 req-296ceb39-2f86-41a9-8d05-51884f6b7111 service nova] Creating event network-vif-plugged:d087cd30-8be7-4e1e-9684-b3837d43d90b for instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 on nch2-master-1 May 28 21:52:50.350888 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2f2a6db1-e1ac-4c1a-9556-d3e6a4b0b640 req-296ceb39-2f86-41a9-8d05-51884f6b7111 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030898 May 28 21:52:50.351478 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3288/6615] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:52:50.902149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e0bc93d1-6682-44b4-aaa6-4db5be15b7b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:50.902701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e0bc93d1-6682-44b4-aaa6-4db5be15b7b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:50.910824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0bc93d1-6682-44b4-aaa6-4db5be15b7b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:50.922415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0bc93d1-6682-44b4-aaa6-4db5be15b7b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:50.922415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0bc93d1-6682-44b4-aaa6-4db5be15b7b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:50.922415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e0bc93d1-6682-44b4-aaa6-4db5be15b7b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:51.040354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e0bc93d1-6682-44b4-aaa6-4db5be15b7b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:51.048001 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e0bc93d1-6682-44b4-aaa6-4db5be15b7b3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1655 microversion: 2.1 time: 0.150270 May 28 21:52:51.048581 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3328/6616] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:50 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1655 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:51.065240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4dbd3ed1-9604-4b2f-8995-3c5456230c78 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:51.066004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4dbd3ed1-9604-4b2f-8995-3c5456230c78 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:51.072342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4dbd3ed1-9604-4b2f-8995-3c5456230c78 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:51.072811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4dbd3ed1-9604-4b2f-8995-3c5456230c78 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:51.073629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4dbd3ed1-9604-4b2f-8995-3c5456230c78 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:51.074119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4dbd3ed1-9604-4b2f-8995-3c5456230c78 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:51.203808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4dbd3ed1-9604-4b2f-8995-3c5456230c78 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:51.211782 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4dbd3ed1-9604-4b2f-8995-3c5456230c78 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1655 microversion: 2.1 time: 0.150786 May 28 21:52:51.212362 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3289/6617] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:51 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1655 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:51.228276 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-79a2dc99-7767-4440-96d3-dea221f007aa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:52:51.235373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79a2dc99-7767-4440-96d3-dea221f007aa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:51.235832 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79a2dc99-7767-4440-96d3-dea221f007aa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:51.261092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-79a2dc99-7767-4440-96d3-dea221f007aa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Going to try to start instance {{(pid=143129) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 21:52:51.440837 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-79a2dc99-7767-4440-96d3-dea221f007aa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2/action" status: 202 len: 0 microversion: 2.1 time: 0.216300 May 28 21:52:51.441384 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3329/6618] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:52:51 2022] POST /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:52:51.454478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c4cdcfc7-9a32-469c-9f5d-1ddb47098571 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:51.456461 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c4cdcfc7-9a32-469c-9f5d-1ddb47098571 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:51.463480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4cdcfc7-9a32-469c-9f5d-1ddb47098571 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:51.464147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4cdcfc7-9a32-469c-9f5d-1ddb47098571 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:51.464783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4cdcfc7-9a32-469c-9f5d-1ddb47098571 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:51.465252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c4cdcfc7-9a32-469c-9f5d-1ddb47098571 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:51.597568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c4cdcfc7-9a32-469c-9f5d-1ddb47098571 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:51.605566 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c4cdcfc7-9a32-469c-9f5d-1ddb47098571 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1664 microversion: 2.1 time: 0.155058 May 28 21:52:51.606519 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3290/6619] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:51 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:52.624274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3fd1d4a6-abbc-43ae-b232-0c49d529ef00 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:52.625039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3fd1d4a6-abbc-43ae-b232-0c49d529ef00 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:52.627005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=37 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:52:52.632068 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fd1d4a6-abbc-43ae-b232-0c49d529ef00 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:52.632683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fd1d4a6-abbc-43ae-b232-0c49d529ef00 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:52.633496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fd1d4a6-abbc-43ae-b232-0c49d529ef00 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:52.633972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fd1d4a6-abbc-43ae-b232-0c49d529ef00 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:52.764604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3fd1d4a6-abbc-43ae-b232-0c49d529ef00 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:52.772382 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3fd1d4a6-abbc-43ae-b232-0c49d529ef00 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1664 microversion: 2.1 time: 0.153194 May 28 21:52:52.778105 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3330/6620] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:52 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:53.790096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e4733ff5-97ef-4154-a5cf-659b327f7099 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:53.790759 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e4733ff5-97ef-4154-a5cf-659b327f7099 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:53.793597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=41 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:52:53.798479 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4733ff5-97ef-4154-a5cf-659b327f7099 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:53.799078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4733ff5-97ef-4154-a5cf-659b327f7099 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:53.799716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4733ff5-97ef-4154-a5cf-659b327f7099 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:53.800164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e4733ff5-97ef-4154-a5cf-659b327f7099 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:53.930399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e4733ff5-97ef-4154-a5cf-659b327f7099 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:53.937925 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e4733ff5-97ef-4154-a5cf-659b327f7099 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1668 microversion: 2.1 time: 0.151715 May 28 21:52:53.938507 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3291/6621] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:53 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:53.959415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-735068f9-e720-44b1-aa1c-78e698267083 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:53.959932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-735068f9-e720-44b1-aa1c-78e698267083 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:53.967058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-735068f9-e720-44b1-aa1c-78e698267083 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:53.967522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-735068f9-e720-44b1-aa1c-78e698267083 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:53.968297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-735068f9-e720-44b1-aa1c-78e698267083 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:53.968772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-735068f9-e720-44b1-aa1c-78e698267083 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:53.995036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-735068f9-e720-44b1-aa1c-78e698267083 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:52:54.261163 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-735068f9-e720-44b1-aa1c-78e698267083 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 204 len: 0 microversion: 2.1 time: 0.306052 May 28 21:52:54.261684 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3331/6622] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:52:53 2022] DELETE /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:52:54.270633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d9f6da45-7d0b-45da-aeed-530c9dbab88f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:54.271265 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d9f6da45-7d0b-45da-aeed-530c9dbab88f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:54.277435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9f6da45-7d0b-45da-aeed-530c9dbab88f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:54.277942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9f6da45-7d0b-45da-aeed-530c9dbab88f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:54.278719 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9f6da45-7d0b-45da-aeed-530c9dbab88f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:54.279172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9f6da45-7d0b-45da-aeed-530c9dbab88f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:54.404394 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d9f6da45-7d0b-45da-aeed-530c9dbab88f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:54.411889 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d9f6da45-7d0b-45da-aeed-530c9dbab88f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1674 microversion: 2.1 time: 0.145815 May 28 21:52:54.412468 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3292/6623] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:54 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1674 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:55.429348 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f9c416b3-f8ac-4d4f-90b4-6c69bb1fbb7a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:55.430041 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f9c416b3-f8ac-4d4f-90b4-6c69bb1fbb7a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:55.437045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9c416b3-f8ac-4d4f-90b4-6c69bb1fbb7a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:55.437506 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9c416b3-f8ac-4d4f-90b4-6c69bb1fbb7a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:55.438331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9c416b3-f8ac-4d4f-90b4-6c69bb1fbb7a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:55.438815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f9c416b3-f8ac-4d4f-90b4-6c69bb1fbb7a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:55.608316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f9c416b3-f8ac-4d4f-90b4-6c69bb1fbb7a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:55.616214 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f9c416b3-f8ac-4d4f-90b4-6c69bb1fbb7a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1674 microversion: 2.1 time: 0.191220 May 28 21:52:55.616942 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3332/6624] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:55 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1674 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:56.635203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0a0ed8ef-7042-4db2-bd2c-cff95f9cbd37 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:56.635938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0a0ed8ef-7042-4db2-bd2c-cff95f9cbd37 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:56.644379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a0ed8ef-7042-4db2-bd2c-cff95f9cbd37 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:56.644856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a0ed8ef-7042-4db2-bd2c-cff95f9cbd37 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:56.645664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a0ed8ef-7042-4db2-bd2c-cff95f9cbd37 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:56.646148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0a0ed8ef-7042-4db2-bd2c-cff95f9cbd37 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:56.758616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0a0ed8ef-7042-4db2-bd2c-cff95f9cbd37 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:56.766236 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0a0ed8ef-7042-4db2-bd2c-cff95f9cbd37 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 200 len: 1607 microversion: 2.1 time: 0.136860 May 28 21:52:56.766820 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3293/6625] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:56 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 1607 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:56.847045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-3ed84136-e0cf-4fae-aa8b-a39bfde19610 req-e9a3a733-fcfd-4df9-8c4f-e0308de8b5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2", "name": "network-vif-deleted", "tag": "d087cd30-8be7-4e1e-9684-b3837d43d90b"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:52:56.858472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3ed84136-e0cf-4fae-aa8b-a39bfde19610 req-e9a3a733-fcfd-4df9-8c4f-e0308de8b5f5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:56.858472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-3ed84136-e0cf-4fae-aa8b-a39bfde19610 req-e9a3a733-fcfd-4df9-8c4f-e0308de8b5f5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:56.867393 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-3ed84136-e0cf-4fae-aa8b-a39bfde19610 req-e9a3a733-fcfd-4df9-8c4f-e0308de8b5f5 service nova] Creating event network-vif-deleted:d087cd30-8be7-4e1e-9684-b3837d43d90b for instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 on nch2-master-1 May 28 21:52:56.872389 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-3ed84136-e0cf-4fae-aa8b-a39bfde19610 req-e9a3a733-fcfd-4df9-8c4f-e0308de8b5f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029790 May 28 21:52:56.872989 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3333/6626] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:52:57.784552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-77d360b7-c4a7-4242-923b-cb9615e0b8c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:57.785225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-77d360b7-c4a7-4242-923b-cb9615e0b8c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:57.792213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77d360b7-c4a7-4242-923b-cb9615e0b8c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:57.792687 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77d360b7-c4a7-4242-923b-cb9615e0b8c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:57.793478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77d360b7-c4a7-4242-923b-cb9615e0b8c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:57.793969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77d360b7-c4a7-4242-923b-cb9615e0b8c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:57.808213 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-77d360b7-c4a7-4242-923b-cb9615e0b8c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-77d360b7-c4a7-4242-923b-cb9615e0b8c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 HTTP/1.1 May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2'} May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:52:57.809939 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:52:57.814119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:52:57.814119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:52:57.814119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:52:57.814119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:52:57.814119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:52:57.814119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:52:57.814119 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:52:57.814119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-77d360b7-c4a7-4242-923b-cb9615e0b8c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:52:57.814119 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-77d360b7-c4a7-4242-923b-cb9615e0b8c9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 404 len: 111 microversion: 2.1 time: 0.031407 May 28 21:52:57.814119 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3294/6627] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:57 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:52:57.829630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c0d6696f-4e5f-4787-9ea0-6f348a2203cb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:57.832403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c0d6696f-4e5f-4787-9ea0-6f348a2203cb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:57.837071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0d6696f-4e5f-4787-9ea0-6f348a2203cb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:57.837526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0d6696f-4e5f-4787-9ea0-6f348a2203cb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:57.838361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0d6696f-4e5f-4787-9ea0-6f348a2203cb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:57.838807 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0d6696f-4e5f-4787-9ea0-6f348a2203cb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:57.855296 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-c0d6696f-4e5f-4787-9ea0-6f348a2203cb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c0d6696f-4e5f-4787-9ea0-6f348a2203cb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 HTTP/1.1 May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2'} May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:52:57.856531 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:52:57.870647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:52:57.870647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:52:57.870647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:52:57.870647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:52:57.870647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:52:57.870647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:52:57.870647 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:52:57.870647 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c0d6696f-4e5f-4787-9ea0-6f348a2203cb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:52:57.870647 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c0d6696f-4e5f-4787-9ea0-6f348a2203cb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 404 len: 111 microversion: 2.1 time: 0.032681 May 28 21:52:57.870647 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3334/6628] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:57 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:52:57.918823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-858390743", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "8779b3e1-d96f-4dd9-848b-4204f604f786"}], "security_groups": [{"name": "tempest-securitygroup--535478282"}], "key_name": "tempest-keypair-1087605141", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:52:58.023406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] validate_networks() for [('8779b3e1-d96f-4dd9-848b-4204f604f786', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:52:58.384592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:52:58.385038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:52:58.385537 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:52:58.386014 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:52:58.386451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:52:58.396030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:58.396507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:58.397335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:58.397799 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:58.415377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Getting quotas for project 77ee3a3a7c3c4288984836d79f10e732. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:52:58.420679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Getting quotas for user aa3da8047b124549a05e86b438789dfb and project 77ee3a3a7c3c4288984836d79f10e732. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:52:58.433106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:52:58.435545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:52:58.567974 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-98cb53df-c87b-43ec-925f-81734f7e0929 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.653084 May 28 21:52:58.568632 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3295/6629] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:52:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:52:58.579072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c5f5de00-122f-47f4-8d4b-c7d7ccae1908 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:58.579795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c5f5de00-122f-47f4-8d4b-c7d7ccae1908 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:58.636828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c5f5de00-122f-47f4-8d4b-c7d7ccae1908 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:58.645475 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c5f5de00-122f-47f4-8d4b-c7d7ccae1908 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1238 microversion: 2.1 time: 0.069817 May 28 21:52:58.655799 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3335/6630] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:58 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:52:59.663849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2ca77778-5e08-47ce-ba77-65f116b89401 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:52:59.664403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2ca77778-5e08-47ce-ba77-65f116b89401 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:52:59.670598 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ca77778-5e08-47ce-ba77-65f116b89401 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:59.671074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ca77778-5e08-47ce-ba77-65f116b89401 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:59.671862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ca77778-5e08-47ce-ba77-65f116b89401 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:52:59.672330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2ca77778-5e08-47ce-ba77-65f116b89401 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:52:59.735563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2ca77778-5e08-47ce-ba77-65f116b89401 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:52:59.743204 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2ca77778-5e08-47ce-ba77-65f116b89401 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1242 microversion: 2.1 time: 0.084913 May 28 21:52:59.743802 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3296/6631] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:52:59 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:00.760511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-00f992a9-b1e0-43c4-a2bd-fc12dc10f86f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:00.761134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-00f992a9-b1e0-43c4-a2bd-fc12dc10f86f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:00.770560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00f992a9-b1e0-43c4-a2bd-fc12dc10f86f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:00.771020 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00f992a9-b1e0-43c4-a2bd-fc12dc10f86f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:00.772453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00f992a9-b1e0-43c4-a2bd-fc12dc10f86f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:00.772903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-00f992a9-b1e0-43c4-a2bd-fc12dc10f86f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:00.842777 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-00f992a9-b1e0-43c4-a2bd-fc12dc10f86f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:00.850645 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-00f992a9-b1e0-43c4-a2bd-fc12dc10f86f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1296 microversion: 2.1 time: 0.094048 May 28 21:53:00.851221 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3336/6632] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:00 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:01.869104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b07ac089-946e-4539-ba82-d26b1d3f4ecc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:01.869743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b07ac089-946e-4539-ba82-d26b1d3f4ecc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:01.877362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b07ac089-946e-4539-ba82-d26b1d3f4ecc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:01.877853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b07ac089-946e-4539-ba82-d26b1d3f4ecc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:01.878666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b07ac089-946e-4539-ba82-d26b1d3f4ecc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:01.879126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b07ac089-946e-4539-ba82-d26b1d3f4ecc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:01.990187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d4a96e72-07af-4508-920f-cee3a9274a68 req-0ef5d9e0-231b-40b3-9c61-865520a74289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c1de70-20e9-428e-98c8-dfee533d359a", "tag": "8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:53:02.002627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d4a96e72-07af-4508-920f-cee3a9274a68 req-0ef5d9e0-231b-40b3-9c61-865520a74289 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:02.003710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d4a96e72-07af-4508-920f-cee3a9274a68 req-0ef5d9e0-231b-40b3-9c61-865520a74289 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:02.017888 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d4a96e72-07af-4508-920f-cee3a9274a68 req-0ef5d9e0-231b-40b3-9c61-865520a74289 service nova] Creating event network-changed:8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7 for instance 04c1de70-20e9-428e-98c8-dfee533d359a on nch1-master-1 May 28 21:53:02.025192 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d4a96e72-07af-4508-920f-cee3a9274a68 req-0ef5d9e0-231b-40b3-9c61-865520a74289 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040166 May 28 21:53:02.026311 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3337/6633] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:53:02.034793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b07ac089-946e-4539-ba82-d26b1d3f4ecc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:02.042611 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b07ac089-946e-4539-ba82-d26b1d3f4ecc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1363 microversion: 2.1 time: 0.177350 May 28 21:53:02.043261 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3297/6634] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:01 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:03.061562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aa66dd9c-1173-4e03-aab7-fd35f5fa0e86 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:03.062307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aa66dd9c-1173-4e03-aab7-fd35f5fa0e86 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:03.068798 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa66dd9c-1173-4e03-aab7-fd35f5fa0e86 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:03.069267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa66dd9c-1173-4e03-aab7-fd35f5fa0e86 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:03.070080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa66dd9c-1173-4e03-aab7-fd35f5fa0e86 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:03.070537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aa66dd9c-1173-4e03-aab7-fd35f5fa0e86 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:03.202500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aa66dd9c-1173-4e03-aab7-fd35f5fa0e86 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:03.210376 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aa66dd9c-1173-4e03-aab7-fd35f5fa0e86 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1363 microversion: 2.1 time: 0.154024 May 28 21:53:03.210953 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3338/6635] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:03 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:04.227464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e7bbd3af-f360-4763-b069-aff4b0b26f24 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:04.228104 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e7bbd3af-f360-4763-b069-aff4b0b26f24 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:04.235107 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7bbd3af-f360-4763-b069-aff4b0b26f24 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:04.235576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7bbd3af-f360-4763-b069-aff4b0b26f24 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:04.236360 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7bbd3af-f360-4763-b069-aff4b0b26f24 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:04.236818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e7bbd3af-f360-4763-b069-aff4b0b26f24 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:04.364037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e7bbd3af-f360-4763-b069-aff4b0b26f24 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:04.371525 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e7bbd3af-f360-4763-b069-aff4b0b26f24 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1363 microversion: 2.1 time: 0.148083 May 28 21:53:04.372087 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3298/6636] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:04 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:05.389879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5af208ea-b11f-4119-9598-9f3ee15d9ae6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:05.390426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5af208ea-b11f-4119-9598-9f3ee15d9ae6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:05.398113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5af208ea-b11f-4119-9598-9f3ee15d9ae6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:05.398575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5af208ea-b11f-4119-9598-9f3ee15d9ae6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:05.399347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5af208ea-b11f-4119-9598-9f3ee15d9ae6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:05.399799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5af208ea-b11f-4119-9598-9f3ee15d9ae6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:05.526091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5af208ea-b11f-4119-9598-9f3ee15d9ae6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:05.533565 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5af208ea-b11f-4119-9598-9f3ee15d9ae6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1363 microversion: 2.1 time: 0.147801 May 28 21:53:05.534169 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3339/6637] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:05 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:06.549981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-69459ec3-71df-479d-a3a3-16df0ee9f180 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:06.550633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-69459ec3-71df-479d-a3a3-16df0ee9f180 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:06.557619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69459ec3-71df-479d-a3a3-16df0ee9f180 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:06.558114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69459ec3-71df-479d-a3a3-16df0ee9f180 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:06.558894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69459ec3-71df-479d-a3a3-16df0ee9f180 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:06.559344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-69459ec3-71df-479d-a3a3-16df0ee9f180 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:06.695029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-69459ec3-71df-479d-a3a3-16df0ee9f180 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:06.700877 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-69459ec3-71df-479d-a3a3-16df0ee9f180 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1363 microversion: 2.1 time: 0.154880 May 28 21:53:06.701467 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3299/6638] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:06 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:07.718938 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9517359a-0dc5-42af-ad00-fe21955ff18b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:07.719561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9517359a-0dc5-42af-ad00-fe21955ff18b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:07.727420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9517359a-0dc5-42af-ad00-fe21955ff18b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:07.727885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9517359a-0dc5-42af-ad00-fe21955ff18b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:07.728667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9517359a-0dc5-42af-ad00-fe21955ff18b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:07.729115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9517359a-0dc5-42af-ad00-fe21955ff18b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:07.858555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9517359a-0dc5-42af-ad00-fe21955ff18b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:07.866761 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9517359a-0dc5-42af-ad00-fe21955ff18b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1363 microversion: 2.1 time: 0.151789 May 28 21:53:07.867336 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3340/6639] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:07 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:08.884281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a2c61b9b-d824-45f2-8cea-363930fd6fb4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:08.884908 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a2c61b9b-d824-45f2-8cea-363930fd6fb4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:08.887658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:53:08.888332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:53:08.895159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2c61b9b-d824-45f2-8cea-363930fd6fb4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:08.895159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2c61b9b-d824-45f2-8cea-363930fd6fb4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:08.895159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2c61b9b-d824-45f2-8cea-363930fd6fb4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:08.895414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a2c61b9b-d824-45f2-8cea-363930fd6fb4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:09.036451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a2c61b9b-d824-45f2-8cea-363930fd6fb4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:09.044494 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a2c61b9b-d824-45f2-8cea-363930fd6fb4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1363 microversion: 2.1 time: 0.164174 May 28 21:53:09.045350 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3300/6640] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:08 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:09.152028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-a0744ef9-e5bd-4284-b980-869685180781 req-3a45c3e1-f562-420f-a3ac-275ced99076f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c1de70-20e9-428e-98c8-dfee533d359a", "name": "network-vif-plugged", "status": "completed", "tag": "8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:53:09.155838 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:53:09.163028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a0744ef9-e5bd-4284-b980-869685180781 req-3a45c3e1-f562-420f-a3ac-275ced99076f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:09.163489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a0744ef9-e5bd-4284-b980-869685180781 req-3a45c3e1-f562-420f-a3ac-275ced99076f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:09.174403 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a0744ef9-e5bd-4284-b980-869685180781 req-3a45c3e1-f562-420f-a3ac-275ced99076f service nova] Creating event network-vif-plugged:8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7 for instance 04c1de70-20e9-428e-98c8-dfee533d359a on nch1-master-1 May 28 21:53:09.180004 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-a0744ef9-e5bd-4284-b980-869685180781 req-3a45c3e1-f562-420f-a3ac-275ced99076f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031834 May 28 21:53:09.180584 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3341/6641] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:53:10.062834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b522e65b-59b5-4ce0-8d84-ca0b0b5d274c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:10.063363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b522e65b-59b5-4ce0-8d84-ca0b0b5d274c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:10.070943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b522e65b-59b5-4ce0-8d84-ca0b0b5d274c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:10.071409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b522e65b-59b5-4ce0-8d84-ca0b0b5d274c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:10.072188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b522e65b-59b5-4ce0-8d84-ca0b0b5d274c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:10.072636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b522e65b-59b5-4ce0-8d84-ca0b0b5d274c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:10.201510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b522e65b-59b5-4ce0-8d84-ca0b0b5d274c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:10.209309 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b522e65b-59b5-4ce0-8d84-ca0b0b5d274c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1363 microversion: 2.1 time: 0.150490 May 28 21:53:10.209906 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3301/6642] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:10 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:11.228341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b85da62e-1b0e-4844-b46a-c673a8f3fbbf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:11.229036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b85da62e-1b0e-4844-b46a-c673a8f3fbbf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:11.236263 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b85da62e-1b0e-4844-b46a-c673a8f3fbbf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:11.236718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b85da62e-1b0e-4844-b46a-c673a8f3fbbf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:11.238003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b85da62e-1b0e-4844-b46a-c673a8f3fbbf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:11.238447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b85da62e-1b0e-4844-b46a-c673a8f3fbbf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:11.366097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b85da62e-1b0e-4844-b46a-c673a8f3fbbf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:11.373687 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b85da62e-1b0e-4844-b46a-c673a8f3fbbf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1550 microversion: 2.1 time: 0.150499 May 28 21:53:11.374286 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3342/6643] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:11 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1550 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:11.390371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-38f707d6-2f61-4fa0-85a7-4cf0e1443a87 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:11.391231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-38f707d6-2f61-4fa0-85a7-4cf0e1443a87 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:11.398412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-38f707d6-2f61-4fa0-85a7-4cf0e1443a87 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:11.398923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-38f707d6-2f61-4fa0-85a7-4cf0e1443a87 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:11.399717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-38f707d6-2f61-4fa0-85a7-4cf0e1443a87 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:11.400167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-38f707d6-2f61-4fa0-85a7-4cf0e1443a87 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:11.480672 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-38f707d6-2f61-4fa0-85a7-4cf0e1443a87 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094369 May 28 21:53:11.481362 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3302/6644] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:53:11 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:53:12.436950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-37b55c27-10a8-477d-b3a6-e77beb5e3d7c req-daaeda0c-fcea-4cab-9988-861bdb3489b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c1de70-20e9-428e-98c8-dfee533d359a", "tag": "8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:53:12.446568 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-37b55c27-10a8-477d-b3a6-e77beb5e3d7c req-daaeda0c-fcea-4cab-9988-861bdb3489b3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:12.447029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-37b55c27-10a8-477d-b3a6-e77beb5e3d7c req-daaeda0c-fcea-4cab-9988-861bdb3489b3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:12.458388 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-37b55c27-10a8-477d-b3a6-e77beb5e3d7c req-daaeda0c-fcea-4cab-9988-861bdb3489b3 service nova] Creating event network-changed:8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7 for instance 04c1de70-20e9-428e-98c8-dfee533d359a on nch1-master-1 May 28 21:53:12.463475 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-37b55c27-10a8-477d-b3a6-e77beb5e3d7c req-daaeda0c-fcea-4cab-9988-861bdb3489b3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030069 May 28 21:53:12.464240 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3343/6645] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:53:45.331752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:53:45.332467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=78 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:53:45.336482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6becfe75-4375-4f43-94eb-019d29888bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:53:45.337518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6becfe75-4375-4f43-94eb-019d29888bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:45.343491 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6becfe75-4375-4f43-94eb-019d29888bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:45.364504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6becfe75-4375-4f43-94eb-019d29888bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:45.364504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6becfe75-4375-4f43-94eb-019d29888bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:45.364504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6becfe75-4375-4f43-94eb-019d29888bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:45.373364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6becfe75-4375-4f43-94eb-019d29888bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:45.379525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6becfe75-4375-4f43-94eb-019d29888bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Old instance type m1.heat2, new instance type m1.heat {{(pid=143128) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 21:53:45.387005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-6becfe75-4375-4f43-94eb-019d29888bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:53:45.387441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-6becfe75-4375-4f43-94eb-019d29888bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:53:45.387929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-6becfe75-4375-4f43-94eb-019d29888bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:53:45.388475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-6becfe75-4375-4f43-94eb-019d29888bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:53:45.388912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-6becfe75-4375-4f43-94eb-019d29888bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:53:45.601313 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6becfe75-4375-4f43-94eb-019d29888bec tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a/action" status: 202 len: 0 microversion: 2.1 time: 0.271610 May 28 21:53:45.602088 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3303/6646] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:53:45 2022] POST /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:53:45.608560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:53:45.609332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:53:45.613451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b93e040c-c9e6-4d75-a760-5e927de7153b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:45.614117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b93e040c-c9e6-4d75-a760-5e927de7153b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:45.620821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b93e040c-c9e6-4d75-a760-5e927de7153b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:45.622539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b93e040c-c9e6-4d75-a760-5e927de7153b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:45.622539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b93e040c-c9e6-4d75-a760-5e927de7153b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:45.622803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b93e040c-c9e6-4d75-a760-5e927de7153b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:45.763474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b93e040c-c9e6-4d75-a760-5e927de7153b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:45.771063 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b93e040c-c9e6-4d75-a760-5e927de7153b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1678 microversion: 2.1 time: 0.164778 May 28 21:53:45.771646 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3344/6647] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:45 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:46.788611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bdbb0a0b-fb3e-4bbb-97ac-07a3675bd080 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:46.789254 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bdbb0a0b-fb3e-4bbb-97ac-07a3675bd080 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:46.796290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdbb0a0b-fb3e-4bbb-97ac-07a3675bd080 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:46.796793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdbb0a0b-fb3e-4bbb-97ac-07a3675bd080 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:46.797606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdbb0a0b-fb3e-4bbb-97ac-07a3675bd080 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:46.798089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdbb0a0b-fb3e-4bbb-97ac-07a3675bd080 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:46.927708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bdbb0a0b-fb3e-4bbb-97ac-07a3675bd080 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:46.937552 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bdbb0a0b-fb3e-4bbb-97ac-07a3675bd080 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1678 microversion: 2.1 time: 0.152745 May 28 21:53:46.938486 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3304/6648] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:46 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:47.955783 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-51d2b700-f813-4cee-8bfd-8f46c1cfe964 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:47.956408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-51d2b700-f813-4cee-8bfd-8f46c1cfe964 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:47.964335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51d2b700-f813-4cee-8bfd-8f46c1cfe964 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:47.964795 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51d2b700-f813-4cee-8bfd-8f46c1cfe964 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:47.965597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51d2b700-f813-4cee-8bfd-8f46c1cfe964 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:47.966093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51d2b700-f813-4cee-8bfd-8f46c1cfe964 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:48.106907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-51d2b700-f813-4cee-8bfd-8f46c1cfe964 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:48.114580 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-51d2b700-f813-4cee-8bfd-8f46c1cfe964 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1678 microversion: 2.1 time: 0.163373 May 28 21:53:48.115161 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3345/6649] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:47 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:49.132313 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5fb0845d-d108-43b6-82f5-99d153480c93 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:49.132981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5fb0845d-d108-43b6-82f5-99d153480c93 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:49.140309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5fb0845d-d108-43b6-82f5-99d153480c93 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:49.140781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5fb0845d-d108-43b6-82f5-99d153480c93 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:49.141575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5fb0845d-d108-43b6-82f5-99d153480c93 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:49.142068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5fb0845d-d108-43b6-82f5-99d153480c93 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:49.269829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5fb0845d-d108-43b6-82f5-99d153480c93 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:49.278018 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5fb0845d-d108-43b6-82f5-99d153480c93 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1683 microversion: 2.1 time: 0.149669 May 28 21:53:49.278601 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3305/6650] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:49 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:50.295935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e33b6b98-9048-4685-8900-e5315a71f469 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:50.296588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e33b6b98-9048-4685-8900-e5315a71f469 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:50.303591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e33b6b98-9048-4685-8900-e5315a71f469 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:50.304045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e33b6b98-9048-4685-8900-e5315a71f469 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:50.304810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e33b6b98-9048-4685-8900-e5315a71f469 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:50.305252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e33b6b98-9048-4685-8900-e5315a71f469 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:50.436496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e33b6b98-9048-4685-8900-e5315a71f469 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:50.444561 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e33b6b98-9048-4685-8900-e5315a71f469 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1683 microversion: 2.1 time: 0.152005 May 28 21:53:50.445127 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3346/6651] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:50 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:51.462246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-67c44aee-b26d-4f24-b9fe-ce29b06c0040 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:51.462904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-67c44aee-b26d-4f24-b9fe-ce29b06c0040 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:51.470037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67c44aee-b26d-4f24-b9fe-ce29b06c0040 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:51.470510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67c44aee-b26d-4f24-b9fe-ce29b06c0040 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:51.471289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67c44aee-b26d-4f24-b9fe-ce29b06c0040 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:51.471743 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-67c44aee-b26d-4f24-b9fe-ce29b06c0040 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:51.599132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-67c44aee-b26d-4f24-b9fe-ce29b06c0040 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:51.606698 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-67c44aee-b26d-4f24-b9fe-ce29b06c0040 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1683 microversion: 2.1 time: 0.148623 May 28 21:53:51.607303 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3306/6652] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:51 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:52.624345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-04fe47a8-f8aa-4901-91b7-413aa9c33f2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:52.624978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-04fe47a8-f8aa-4901-91b7-413aa9c33f2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:52.632598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04fe47a8-f8aa-4901-91b7-413aa9c33f2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:52.633063 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04fe47a8-f8aa-4901-91b7-413aa9c33f2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:52.633862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04fe47a8-f8aa-4901-91b7-413aa9c33f2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:52.634311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-04fe47a8-f8aa-4901-91b7-413aa9c33f2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:52.762369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-04fe47a8-f8aa-4901-91b7-413aa9c33f2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:52.769969 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-04fe47a8-f8aa-4901-91b7-413aa9c33f2d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1683 microversion: 2.1 time: 0.149584 May 28 21:53:52.770547 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3347/6653] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:52 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:53.788193 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6abd0f92-02b1-4996-b9ab-7aea4cb1037a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:53.788851 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6abd0f92-02b1-4996-b9ab-7aea4cb1037a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:53.795833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6abd0f92-02b1-4996-b9ab-7aea4cb1037a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:53.796294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6abd0f92-02b1-4996-b9ab-7aea4cb1037a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:53.797064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6abd0f92-02b1-4996-b9ab-7aea4cb1037a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:53.797514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6abd0f92-02b1-4996-b9ab-7aea4cb1037a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:53.930267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6abd0f92-02b1-4996-b9ab-7aea4cb1037a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:53.937905 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6abd0f92-02b1-4996-b9ab-7aea4cb1037a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1683 microversion: 2.1 time: 0.154197 May 28 21:53:53.938500 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3307/6654] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:53 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:54.954350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-84ae276e-4513-4736-be7d-d1403bfee075 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:54.954973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-84ae276e-4513-4736-be7d-d1403bfee075 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:54.962902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84ae276e-4513-4736-be7d-d1403bfee075 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:54.963361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84ae276e-4513-4736-be7d-d1403bfee075 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:54.964134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84ae276e-4513-4736-be7d-d1403bfee075 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:54.964584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-84ae276e-4513-4736-be7d-d1403bfee075 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:55.092934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-84ae276e-4513-4736-be7d-d1403bfee075 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:55.100517 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-84ae276e-4513-4736-be7d-d1403bfee075 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1683 microversion: 2.1 time: 0.150100 May 28 21:53:55.103886 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3348/6655] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:54 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:56.118527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f1bb16e0-7884-4c8b-8319-3d79f903f9cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:56.119185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f1bb16e0-7884-4c8b-8319-3d79f903f9cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:56.125695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1bb16e0-7884-4c8b-8319-3d79f903f9cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:56.126189 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1bb16e0-7884-4c8b-8319-3d79f903f9cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:56.126959 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1bb16e0-7884-4c8b-8319-3d79f903f9cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:56.127415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f1bb16e0-7884-4c8b-8319-3d79f903f9cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:56.259582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f1bb16e0-7884-4c8b-8319-3d79f903f9cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:56.267251 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f1bb16e0-7884-4c8b-8319-3d79f903f9cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1683 microversion: 2.1 time: 0.153214 May 28 21:53:56.267825 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3308/6656] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:56 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:57.285280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-161db099-041f-42d4-b0ca-ec33ccf4d90b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:57.285932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-161db099-041f-42d4-b0ca-ec33ccf4d90b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:57.292288 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-161db099-041f-42d4-b0ca-ec33ccf4d90b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:57.293230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-161db099-041f-42d4-b0ca-ec33ccf4d90b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:57.293513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-161db099-041f-42d4-b0ca-ec33ccf4d90b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:57.293994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-161db099-041f-42d4-b0ca-ec33ccf4d90b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:57.422709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-161db099-041f-42d4-b0ca-ec33ccf4d90b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:57.430806 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-161db099-041f-42d4-b0ca-ec33ccf4d90b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1683 microversion: 2.1 time: 0.149737 May 28 21:53:57.431387 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3349/6657] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:57 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:58.448550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1f11a987-0fac-4ee2-9901-5e050f34acd4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:58.449117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1f11a987-0fac-4ee2-9901-5e050f34acd4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:58.456414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f11a987-0fac-4ee2-9901-5e050f34acd4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:58.468041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f11a987-0fac-4ee2-9901-5e050f34acd4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:58.468041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f11a987-0fac-4ee2-9901-5e050f34acd4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:58.468041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1f11a987-0fac-4ee2-9901-5e050f34acd4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:58.586698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1f11a987-0fac-4ee2-9901-5e050f34acd4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:58.594324 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1f11a987-0fac-4ee2-9901-5e050f34acd4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1683 microversion: 2.1 time: 0.150272 May 28 21:53:58.594903 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3309/6658] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:58 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:53:59.611550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4e302d07-037b-40fb-ac0c-97862665dd25 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:53:59.612180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4e302d07-037b-40fb-ac0c-97862665dd25 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:53:59.619743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e302d07-037b-40fb-ac0c-97862665dd25 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:59.620208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e302d07-037b-40fb-ac0c-97862665dd25 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:59.620988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e302d07-037b-40fb-ac0c-97862665dd25 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:53:59.621440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e302d07-037b-40fb-ac0c-97862665dd25 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:53:59.755765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4e302d07-037b-40fb-ac0c-97862665dd25 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:53:59.764002 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4e302d07-037b-40fb-ac0c-97862665dd25 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1683 microversion: 2.1 time: 0.156370 May 28 21:53:59.764590 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3350/6659] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:53:59 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:00.781008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ef14df94-8e3e-4e83-a2ea-9da3c0d023c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:00.781641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ef14df94-8e3e-4e83-a2ea-9da3c0d023c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:00.789208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef14df94-8e3e-4e83-a2ea-9da3c0d023c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:00.789679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef14df94-8e3e-4e83-a2ea-9da3c0d023c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:00.790497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef14df94-8e3e-4e83-a2ea-9da3c0d023c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:00.790953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef14df94-8e3e-4e83-a2ea-9da3c0d023c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:00.917666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ef14df94-8e3e-4e83-a2ea-9da3c0d023c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:00.925492 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ef14df94-8e3e-4e83-a2ea-9da3c0d023c3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1683 microversion: 2.1 time: 0.148420 May 28 21:54:00.926122 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3310/6660] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:00 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:01.944237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c220c662-1f8f-4590-95e1-b4bfe195dda1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:01.944792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c220c662-1f8f-4590-95e1-b4bfe195dda1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:01.952158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c220c662-1f8f-4590-95e1-b4bfe195dda1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:01.952624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c220c662-1f8f-4590-95e1-b4bfe195dda1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:01.953416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c220c662-1f8f-4590-95e1-b4bfe195dda1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:01.953877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c220c662-1f8f-4590-95e1-b4bfe195dda1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:02.084380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c220c662-1f8f-4590-95e1-b4bfe195dda1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:02.091927 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c220c662-1f8f-4590-95e1-b4bfe195dda1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1683 microversion: 2.1 time: 0.152240 May 28 21:54:02.092495 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3351/6661] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:01 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:03.108864 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-30bfe902-5521-4af7-83c0-148e86c933cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:03.109528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-30bfe902-5521-4af7-83c0-148e86c933cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:03.116523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30bfe902-5521-4af7-83c0-148e86c933cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:03.116991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30bfe902-5521-4af7-83c0-148e86c933cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:03.117769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30bfe902-5521-4af7-83c0-148e86c933cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:03.118246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30bfe902-5521-4af7-83c0-148e86c933cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:03.245665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-30bfe902-5521-4af7-83c0-148e86c933cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:03.253416 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-30bfe902-5521-4af7-83c0-148e86c933cf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1683 microversion: 2.1 time: 0.148470 May 28 21:54:03.254022 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3311/6662] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:03 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:04.271198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8ac05d73-aa58-4062-940b-be5a1f15d7bc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:04.271826 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8ac05d73-aa58-4062-940b-be5a1f15d7bc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:04.278941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ac05d73-aa58-4062-940b-be5a1f15d7bc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:04.279429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ac05d73-aa58-4062-940b-be5a1f15d7bc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:04.280204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ac05d73-aa58-4062-940b-be5a1f15d7bc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:04.280689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ac05d73-aa58-4062-940b-be5a1f15d7bc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:04.409678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8ac05d73-aa58-4062-940b-be5a1f15d7bc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:04.417733 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8ac05d73-aa58-4062-940b-be5a1f15d7bc tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1683 microversion: 2.1 time: 0.150524 May 28 21:54:04.418333 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3352/6663] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:04 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:05.434690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cb94fadf-2cb2-4827-b2dd-9773b430b7b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:05.435325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cb94fadf-2cb2-4827-b2dd-9773b430b7b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:05.442432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb94fadf-2cb2-4827-b2dd-9773b430b7b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:05.442904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb94fadf-2cb2-4827-b2dd-9773b430b7b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:05.444292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb94fadf-2cb2-4827-b2dd-9773b430b7b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:05.444753 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb94fadf-2cb2-4827-b2dd-9773b430b7b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:05.573821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cb94fadf-2cb2-4827-b2dd-9773b430b7b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:05.582110 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cb94fadf-2cb2-4827-b2dd-9773b430b7b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1683 microversion: 2.1 time: 0.151287 May 28 21:54:05.582698 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3312/6664] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:05 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:06.285299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-987d382c-2bdf-4f77-a3d9-a82b9f4f0e28 req-d501455a-e39a-46ce-9819-4de2b16075f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c1de70-20e9-428e-98c8-dfee533d359a", "name": "network-vif-unplugged", "status": "completed", "tag": "8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:54:06.294936 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-987d382c-2bdf-4f77-a3d9-a82b9f4f0e28 req-d501455a-e39a-46ce-9819-4de2b16075f5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:06.295386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-987d382c-2bdf-4f77-a3d9-a82b9f4f0e28 req-d501455a-e39a-46ce-9819-4de2b16075f5 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:06.307232 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-987d382c-2bdf-4f77-a3d9-a82b9f4f0e28 req-d501455a-e39a-46ce-9819-4de2b16075f5 service nova] Creating event network-vif-unplugged:8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7 for instance 04c1de70-20e9-428e-98c8-dfee533d359a on nch2-master-1 May 28 21:54:06.312529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-987d382c-2bdf-4f77-a3d9-a82b9f4f0e28 req-d501455a-e39a-46ce-9819-4de2b16075f5 service nova] Instance 04c1de70-20e9-428e-98c8-dfee533d359a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:54:06.323728 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-987d382c-2bdf-4f77-a3d9-a82b9f4f0e28 req-d501455a-e39a-46ce-9819-4de2b16075f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042101 May 28 21:54:06.324324 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3353/6665] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:54:06.602341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d9807f91-851c-45d2-b459-863eac2c9aeb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:06.602973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d9807f91-851c-45d2-b459-863eac2c9aeb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:06.609920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9807f91-851c-45d2-b459-863eac2c9aeb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:06.610386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9807f91-851c-45d2-b459-863eac2c9aeb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:06.611424 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9807f91-851c-45d2-b459-863eac2c9aeb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:06.611880 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d9807f91-851c-45d2-b459-863eac2c9aeb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:06.779352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d9807f91-851c-45d2-b459-863eac2c9aeb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:06.787037 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d9807f91-851c-45d2-b459-863eac2c9aeb tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1682 microversion: 2.1 time: 0.188672 May 28 21:54:06.787670 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3313/6666] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:06 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:07.806103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-eccb69c6-fd34-4071-b177-9d3b68d99d4b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:07.806850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-eccb69c6-fd34-4071-b177-9d3b68d99d4b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:07.813291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eccb69c6-fd34-4071-b177-9d3b68d99d4b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:07.813759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eccb69c6-fd34-4071-b177-9d3b68d99d4b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:07.814567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eccb69c6-fd34-4071-b177-9d3b68d99d4b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:07.815021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-eccb69c6-fd34-4071-b177-9d3b68d99d4b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:07.947165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-eccb69c6-fd34-4071-b177-9d3b68d99d4b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:07.954751 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-eccb69c6-fd34-4071-b177-9d3b68d99d4b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1680 microversion: 2.1 time: 0.154008 May 28 21:54:07.955588 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3354/6667] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:07 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:08.337888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a38c3ec6-30c2-4c4c-aa89-c017ca0415dd req-0e31f4cd-0f7a-43db-b3c9-d6c4b90bfbbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c1de70-20e9-428e-98c8-dfee533d359a", "tag": "8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:54:08.346845 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a38c3ec6-30c2-4c4c-aa89-c017ca0415dd req-0e31f4cd-0f7a-43db-b3c9-d6c4b90bfbbb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:08.347310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a38c3ec6-30c2-4c4c-aa89-c017ca0415dd req-0e31f4cd-0f7a-43db-b3c9-d6c4b90bfbbb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:08.361542 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a38c3ec6-30c2-4c4c-aa89-c017ca0415dd req-0e31f4cd-0f7a-43db-b3c9-d6c4b90bfbbb service nova] Creating event network-changed:8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7 for instance 04c1de70-20e9-428e-98c8-dfee533d359a on nch2-master-1 May 28 21:54:08.367595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-a38c3ec6-30c2-4c4c-aa89-c017ca0415dd req-0e31f4cd-0f7a-43db-b3c9-d6c4b90bfbbb service nova] Instance 04c1de70-20e9-428e-98c8-dfee533d359a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:54:08.378469 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a38c3ec6-30c2-4c4c-aa89-c017ca0415dd req-0e31f4cd-0f7a-43db-b3c9-d6c4b90bfbbb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044523 May 28 21:54:08.379068 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3314/6668] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:54:08.973085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a0d6d0d6-a8c7-4564-8de5-fcf7b8004476 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:08.973742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a0d6d0d6-a8c7-4564-8de5-fcf7b8004476 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:08.982364 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0d6d0d6-a8c7-4564-8de5-fcf7b8004476 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:08.982891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0d6d0d6-a8c7-4564-8de5-fcf7b8004476 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:08.983976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0d6d0d6-a8c7-4564-8de5-fcf7b8004476 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:08.984507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0d6d0d6-a8c7-4564-8de5-fcf7b8004476 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:09.224278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a0d6d0d6-a8c7-4564-8de5-fcf7b8004476 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:09.232639 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a0d6d0d6-a8c7-4564-8de5-fcf7b8004476 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1680 microversion: 2.1 time: 0.263607 May 28 21:54:09.233227 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3355/6669] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:08 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1680 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:10.251141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-054f1f4c-bbe7-40ad-83af-2664d782a513 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:10.251872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-054f1f4c-bbe7-40ad-83af-2664d782a513 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:10.258311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-054f1f4c-bbe7-40ad-83af-2664d782a513 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:10.258783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-054f1f4c-bbe7-40ad-83af-2664d782a513 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:10.259595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-054f1f4c-bbe7-40ad-83af-2664d782a513 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:10.260036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-054f1f4c-bbe7-40ad-83af-2664d782a513 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:10.389990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-054f1f4c-bbe7-40ad-83af-2664d782a513 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:10.397564 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-054f1f4c-bbe7-40ad-83af-2664d782a513 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1677 microversion: 2.1 time: 0.151674 May 28 21:54:10.398193 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3315/6670] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:10 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:10.414450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fae79a63-e1ed-494a-9598-417cce02a13a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:54:10.415014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fae79a63-e1ed-494a-9598-417cce02a13a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:10.421817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fae79a63-e1ed-494a-9598-417cce02a13a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:10.422308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fae79a63-e1ed-494a-9598-417cce02a13a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:10.423082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fae79a63-e1ed-494a-9598-417cce02a13a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:10.423510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fae79a63-e1ed-494a-9598-417cce02a13a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:10.463058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fae79a63-e1ed-494a-9598-417cce02a13a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:10.463514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fae79a63-e1ed-494a-9598-417cce02a13a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:10.464309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fae79a63-e1ed-494a-9598-417cce02a13a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:10.464753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fae79a63-e1ed-494a-9598-417cce02a13a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:10.486055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-fae79a63-e1ed-494a-9598-417cce02a13a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Getting quotas for project 77ee3a3a7c3c4288984836d79f10e732. Resources: {'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:54:10.491763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-fae79a63-e1ed-494a-9598-417cce02a13a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Getting quotas for user aa3da8047b124549a05e86b438789dfb and project 77ee3a3a7c3c4288984836d79f10e732. Resources: {'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:54:10.918228 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fae79a63-e1ed-494a-9598-417cce02a13a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a/action" status: 202 len: 0 microversion: 2.1 time: 0.507559 May 28 21:54:10.918788 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3356/6671] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:54:10 2022] POST /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:54:10.927773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1889d12a-9a9b-4731-a6ed-57051416650e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:10.928516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1889d12a-9a9b-4731-a6ed-57051416650e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:10.934834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1889d12a-9a9b-4731-a6ed-57051416650e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:10.935298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1889d12a-9a9b-4731-a6ed-57051416650e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:10.936271 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1889d12a-9a9b-4731-a6ed-57051416650e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:10.936720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1889d12a-9a9b-4731-a6ed-57051416650e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:11.151206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1889d12a-9a9b-4731-a6ed-57051416650e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:11.159454 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1889d12a-9a9b-4731-a6ed-57051416650e tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1676 microversion: 2.1 time: 0.236215 May 28 21:54:11.160367 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3316/6672] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:10 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1676 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:12.177595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3029228b-f7d7-46c6-a9c8-0d5b720307f8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:12.178849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3029228b-f7d7-46c6-a9c8-0d5b720307f8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:12.186103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3029228b-f7d7-46c6-a9c8-0d5b720307f8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:12.186570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3029228b-f7d7-46c6-a9c8-0d5b720307f8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:12.187349 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3029228b-f7d7-46c6-a9c8-0d5b720307f8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:12.187802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3029228b-f7d7-46c6-a9c8-0d5b720307f8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:12.317429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3029228b-f7d7-46c6-a9c8-0d5b720307f8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:12.321914 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:54:12.326445 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3029228b-f7d7-46c6-a9c8-0d5b720307f8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1676 microversion: 2.1 time: 0.153261 May 28 21:54:12.327025 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3357/6673] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:12 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:12.692072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-ac55f3b9-1dd4-4c6a-897e-e2621444f4d8 req-a3754853-0d66-4216-8f5e-5da7827b9594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c1de70-20e9-428e-98c8-dfee533d359a", "name": "network-vif-plugged", "status": "completed", "tag": "8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:54:12.707352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ac55f3b9-1dd4-4c6a-897e-e2621444f4d8 req-a3754853-0d66-4216-8f5e-5da7827b9594 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:12.707825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ac55f3b9-1dd4-4c6a-897e-e2621444f4d8 req-a3754853-0d66-4216-8f5e-5da7827b9594 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:12.720722 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-ac55f3b9-1dd4-4c6a-897e-e2621444f4d8 req-a3754853-0d66-4216-8f5e-5da7827b9594 service nova] Creating event network-vif-plugged:8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7 for instance 04c1de70-20e9-428e-98c8-dfee533d359a on nch2-master-1 May 28 21:54:12.726218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-ac55f3b9-1dd4-4c6a-897e-e2621444f4d8 req-a3754853-0d66-4216-8f5e-5da7827b9594 service nova] Instance 04c1de70-20e9-428e-98c8-dfee533d359a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:54:12.737467 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-ac55f3b9-1dd4-4c6a-897e-e2621444f4d8 req-a3754853-0d66-4216-8f5e-5da7827b9594 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049153 May 28 21:54:12.738140 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3317/6674] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:54:13.344204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bcc92072-1ae8-4724-8eb2-c153214eedcf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:13.344754 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bcc92072-1ae8-4724-8eb2-c153214eedcf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:13.353056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bcc92072-1ae8-4724-8eb2-c153214eedcf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:13.354328 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bcc92072-1ae8-4724-8eb2-c153214eedcf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:13.354435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bcc92072-1ae8-4724-8eb2-c153214eedcf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:13.354788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bcc92072-1ae8-4724-8eb2-c153214eedcf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:13.489268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bcc92072-1ae8-4724-8eb2-c153214eedcf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:13.496908 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bcc92072-1ae8-4724-8eb2-c153214eedcf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1676 microversion: 2.1 time: 0.156783 May 28 21:54:13.497609 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3358/6675] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:13 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:14.514787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e10a0d2b-0ea2-4d64-8dff-ca4f9f69abaa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:14.515672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e10a0d2b-0ea2-4d64-8dff-ca4f9f69abaa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:14.522459 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e10a0d2b-0ea2-4d64-8dff-ca4f9f69abaa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:14.522929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e10a0d2b-0ea2-4d64-8dff-ca4f9f69abaa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:14.523747 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e10a0d2b-0ea2-4d64-8dff-ca4f9f69abaa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:14.524688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e10a0d2b-0ea2-4d64-8dff-ca4f9f69abaa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:14.663380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e10a0d2b-0ea2-4d64-8dff-ca4f9f69abaa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:14.667168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:54:14.671994 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e10a0d2b-0ea2-4d64-8dff-ca4f9f69abaa tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1676 microversion: 2.1 time: 0.162419 May 28 21:54:14.672595 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3318/6676] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:14 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:54:14.824670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-aeacc981-f299-494c-97c1-7a110268fb25 req-b9d45c12-cf0f-454a-9d54-84760a7e6251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c1de70-20e9-428e-98c8-dfee533d359a", "name": "network-vif-unplugged", "status": "completed", "tag": "8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:54:14.834110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-aeacc981-f299-494c-97c1-7a110268fb25 req-b9d45c12-cf0f-454a-9d54-84760a7e6251 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:14.834608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-aeacc981-f299-494c-97c1-7a110268fb25 req-b9d45c12-cf0f-454a-9d54-84760a7e6251 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:14.846673 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-aeacc981-f299-494c-97c1-7a110268fb25 req-b9d45c12-cf0f-454a-9d54-84760a7e6251 service nova] Creating event network-vif-unplugged:8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7 for instance 04c1de70-20e9-428e-98c8-dfee533d359a on nch1-master-1 May 28 21:54:14.852024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-aeacc981-f299-494c-97c1-7a110268fb25 req-b9d45c12-cf0f-454a-9d54-84760a7e6251 service nova] Instance 04c1de70-20e9-428e-98c8-dfee533d359a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:54:14.862545 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-aeacc981-f299-494c-97c1-7a110268fb25 req-b9d45c12-cf0f-454a-9d54-84760a7e6251 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042690 May 28 21:54:14.863144 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3359/6677] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:54:15.690231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eda727f0-b768-45ab-b3a3-952ff04ddca9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:15.691256 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eda727f0-b768-45ab-b3a3-952ff04ddca9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:15.696447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=37 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:54:15.700664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eda727f0-b768-45ab-b3a3-952ff04ddca9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:15.701130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eda727f0-b768-45ab-b3a3-952ff04ddca9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:15.701939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eda727f0-b768-45ab-b3a3-952ff04ddca9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:15.702446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eda727f0-b768-45ab-b3a3-952ff04ddca9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:15.839158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eda727f0-b768-45ab-b3a3-952ff04ddca9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:15.846759 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eda727f0-b768-45ab-b3a3-952ff04ddca9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1676 microversion: 2.1 time: 0.161989 May 28 21:54:15.847272 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3319/6678] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:15 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:16.864649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-12cc451c-c866-4970-b599-82303fd8e416 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:16.865268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-12cc451c-c866-4970-b599-82303fd8e416 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:16.871694 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12cc451c-c866-4970-b599-82303fd8e416 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:16.872150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12cc451c-c866-4970-b599-82303fd8e416 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:16.872919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12cc451c-c866-4970-b599-82303fd8e416 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:16.873361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-12cc451c-c866-4970-b599-82303fd8e416 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:16.876611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a7709599-dc21-41cd-b0f5-451fc4e0c348 req-d327da2a-381c-4432-b333-a1deb46538b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c1de70-20e9-428e-98c8-dfee533d359a", "tag": "8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:54:16.886683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a7709599-dc21-41cd-b0f5-451fc4e0c348 req-d327da2a-381c-4432-b333-a1deb46538b9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:16.887146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a7709599-dc21-41cd-b0f5-451fc4e0c348 req-d327da2a-381c-4432-b333-a1deb46538b9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:16.898690 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a7709599-dc21-41cd-b0f5-451fc4e0c348 req-d327da2a-381c-4432-b333-a1deb46538b9 service nova] Creating event network-changed:8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7 for instance 04c1de70-20e9-428e-98c8-dfee533d359a on nch1-master-1 May 28 21:54:16.904694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-a7709599-dc21-41cd-b0f5-451fc4e0c348 req-d327da2a-381c-4432-b333-a1deb46538b9 service nova] Instance 04c1de70-20e9-428e-98c8-dfee533d359a is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:54:16.915398 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a7709599-dc21-41cd-b0f5-451fc4e0c348 req-d327da2a-381c-4432-b333-a1deb46538b9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042395 May 28 21:54:16.916004 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3320/6679] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:54:17.097372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-12cc451c-c866-4970-b599-82303fd8e416 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:17.105320 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-12cc451c-c866-4970-b599-82303fd8e416 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1676 microversion: 2.1 time: 0.245849 May 28 21:54:17.105933 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3360/6680] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:16 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:18.124029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f45fa39d-4227-4aec-8542-2a5686ee1cda tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:18.124758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f45fa39d-4227-4aec-8542-2a5686ee1cda tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:18.131399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f45fa39d-4227-4aec-8542-2a5686ee1cda tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:18.131901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f45fa39d-4227-4aec-8542-2a5686ee1cda tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:18.132723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f45fa39d-4227-4aec-8542-2a5686ee1cda tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:18.133184 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f45fa39d-4227-4aec-8542-2a5686ee1cda tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:18.261562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f45fa39d-4227-4aec-8542-2a5686ee1cda tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:18.269291 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f45fa39d-4227-4aec-8542-2a5686ee1cda tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1669 microversion: 2.1 time: 0.150466 May 28 21:54:18.269953 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3321/6681] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:18 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1669 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:18.286381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9d5ca1ae-37be-43af-ac61-ee57b66ded18 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:18.287015 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9d5ca1ae-37be-43af-ac61-ee57b66ded18 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:18.290493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:54:18.295417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d5ca1ae-37be-43af-ac61-ee57b66ded18 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:18.295883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d5ca1ae-37be-43af-ac61-ee57b66ded18 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:18.296666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d5ca1ae-37be-43af-ac61-ee57b66ded18 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:18.297117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d5ca1ae-37be-43af-ac61-ee57b66ded18 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:18.429035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9d5ca1ae-37be-43af-ac61-ee57b66ded18 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:18.436561 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9d5ca1ae-37be-43af-ac61-ee57b66ded18 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1669 microversion: 2.1 time: 0.154068 May 28 21:54:18.437138 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3361/6682] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:18 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:18.452677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-20a199e8-316a-4426-8ab4-c1f43f0ee415 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:18.453311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-20a199e8-316a-4426-8ab4-c1f43f0ee415 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:18.459603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20a199e8-316a-4426-8ab4-c1f43f0ee415 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:18.460068 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20a199e8-316a-4426-8ab4-c1f43f0ee415 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:18.460838 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20a199e8-316a-4426-8ab4-c1f43f0ee415 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:18.461289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20a199e8-316a-4426-8ab4-c1f43f0ee415 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:18.593078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-20a199e8-316a-4426-8ab4-c1f43f0ee415 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:18.600724 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-20a199e8-316a-4426-8ab4-c1f43f0ee415 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1669 microversion: 2.1 time: 0.151881 May 28 21:54:18.601313 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3322/6683] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:18 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:18.616669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a0837623-446c-4860-abef-6445d909c3d9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:18.617179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a0837623-446c-4860-abef-6445d909c3d9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:18.623282 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0837623-446c-4860-abef-6445d909c3d9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:18.623745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0837623-446c-4860-abef-6445d909c3d9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:18.624516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0837623-446c-4860-abef-6445d909c3d9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:18.624962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a0837623-446c-4860-abef-6445d909c3d9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:18.653538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a0837623-446c-4860-abef-6445d909c3d9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:54:18.924277 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a0837623-446c-4860-abef-6445d909c3d9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "DELETE /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 204 len: 0 microversion: 2.1 time: 0.311093 May 28 21:54:18.924801 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3362/6684] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:54:18 2022] DELETE /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:54:18.933599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b58c70b8-4232-473a-afdc-55892148a3d2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:18.934258 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b58c70b8-4232-473a-afdc-55892148a3d2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:18.940625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b58c70b8-4232-473a-afdc-55892148a3d2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:18.943202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b58c70b8-4232-473a-afdc-55892148a3d2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:18.943202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b58c70b8-4232-473a-afdc-55892148a3d2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:18.943202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b58c70b8-4232-473a-afdc-55892148a3d2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:19.076429 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b58c70b8-4232-473a-afdc-55892148a3d2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:19.084772 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b58c70b8-4232-473a-afdc-55892148a3d2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1675 microversion: 2.1 time: 0.155544 May 28 21:54:19.085623 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3323/6685] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:18 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:20.102033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-17be73f2-9024-4503-a0d9-5ae02a53d002 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:20.102755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-17be73f2-9024-4503-a0d9-5ae02a53d002 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:20.110451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17be73f2-9024-4503-a0d9-5ae02a53d002 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:20.110920 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17be73f2-9024-4503-a0d9-5ae02a53d002 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:20.111702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17be73f2-9024-4503-a0d9-5ae02a53d002 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:20.112154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-17be73f2-9024-4503-a0d9-5ae02a53d002 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:20.244608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-17be73f2-9024-4503-a0d9-5ae02a53d002 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:20.252565 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-17be73f2-9024-4503-a0d9-5ae02a53d002 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1675 microversion: 2.1 time: 0.154797 May 28 21:54:20.253151 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3363/6686] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:20 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:21.269953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cb2009c0-ed32-494e-b20b-ae8d44760c5b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:21.270578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cb2009c0-ed32-494e-b20b-ae8d44760c5b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:21.277770 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb2009c0-ed32-494e-b20b-ae8d44760c5b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:21.278347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb2009c0-ed32-494e-b20b-ae8d44760c5b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:21.279324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb2009c0-ed32-494e-b20b-ae8d44760c5b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:21.279922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb2009c0-ed32-494e-b20b-ae8d44760c5b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:21.324485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-cd425c86-c4ec-458f-9611-615649425741 req-201222be-4043-44a9-86a2-da6e9ad94d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c1de70-20e9-428e-98c8-dfee533d359a", "name": "network-vif-deleted", "tag": "8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:54:21.328123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:54:21.334809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cd425c86-c4ec-458f-9611-615649425741 req-201222be-4043-44a9-86a2-da6e9ad94d7a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:21.335530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-cd425c86-c4ec-458f-9611-615649425741 req-201222be-4043-44a9-86a2-da6e9ad94d7a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:21.347659 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-cd425c86-c4ec-458f-9611-615649425741 req-201222be-4043-44a9-86a2-da6e9ad94d7a service nova] Creating event network-vif-deleted:8f7cda14-af5e-4ef8-be1f-ce30cfb46bd7 for instance 04c1de70-20e9-428e-98c8-dfee533d359a on nch1-master-1 May 28 21:54:21.352768 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-cd425c86-c4ec-458f-9611-615649425741 req-201222be-4043-44a9-86a2-da6e9ad94d7a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031896 May 28 21:54:21.355742 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3364/6687] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:54:21.374488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cb2009c0-ed32-494e-b20b-ae8d44760c5b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:21.382292 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cb2009c0-ed32-494e-b20b-ae8d44760c5b tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 200 len: 1608 microversion: 2.1 time: 0.116206 May 28 21:54:21.382963 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3324/6688] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:21 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 1608 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:22.402733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bc7195f0-ca95-4fd8-a3ab-fa6299d645fe tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:22.403499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bc7195f0-ca95-4fd8-a3ab-fa6299d645fe tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:22.410255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bc7195f0-ca95-4fd8-a3ab-fa6299d645fe tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:22.410712 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bc7195f0-ca95-4fd8-a3ab-fa6299d645fe tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:22.411485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bc7195f0-ca95-4fd8-a3ab-fa6299d645fe tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:22.411928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bc7195f0-ca95-4fd8-a3ab-fa6299d645fe tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:22.426085 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-bc7195f0-ca95-4fd8-a3ab-fa6299d645fe tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bc7195f0-ca95-4fd8-a3ab-fa6299d645fe tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a HTTP/1.1 May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '04c1de70-20e9-428e-98c8-dfee533d359a'} May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:54:22.427803 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:54:22.431564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:54:22.431564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:54:22.431564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:54:22.431564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:54:22.431564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:54:22.431564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:54:22.431564 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:54:22.431564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bc7195f0-ca95-4fd8-a3ab-fa6299d645fe tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:54:22.431564 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bc7195f0-ca95-4fd8-a3ab-fa6299d645fe tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 404 len: 111 microversion: 2.1 time: 0.032407 May 28 21:54:22.431564 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3365/6689] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:22 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:54:22.447693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ad473a89-88d6-4a61-92c3-35a08dbc3db1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:22.448335 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ad473a89-88d6-4a61-92c3-35a08dbc3db1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:22.455726 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad473a89-88d6-4a61-92c3-35a08dbc3db1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:22.456200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad473a89-88d6-4a61-92c3-35a08dbc3db1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:22.456986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad473a89-88d6-4a61-92c3-35a08dbc3db1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:22.457449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad473a89-88d6-4a61-92c3-35a08dbc3db1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:22.471755 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-ad473a89-88d6-4a61-92c3-35a08dbc3db1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ad473a89-88d6-4a61-92c3-35a08dbc3db1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a HTTP/1.1 May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '04c1de70-20e9-428e-98c8-dfee533d359a'} May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:54:22.478973 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:54:22.483508 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:54:22.483508 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:54:22.483508 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:54:22.483508 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:54:22.483508 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:54:22.483508 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:54:22.483508 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:54:22.483508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ad473a89-88d6-4a61-92c3-35a08dbc3db1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:54:22.483508 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ad473a89-88d6-4a61-92c3-35a08dbc3db1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 404 len: 111 microversion: 2.1 time: 0.031336 May 28 21:54:22.483508 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3325/6690] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:22 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:54:22.525092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1101508099", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "8779b3e1-d96f-4dd9-848b-4204f604f786"}], "security_groups": [{"name": "tempest-securitygroup--535478282"}], "key_name": "tempest-keypair-1087605141", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:54:22.632862 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] validate_networks() for [('8779b3e1-d96f-4dd9-848b-4204f604f786', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:54:23.045104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:54:23.045537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:54:23.046060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:54:23.046531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:54:23.046954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:54:23.055910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:23.056367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:23.057806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:23.058293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:23.075399 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Getting quotas for project 77ee3a3a7c3c4288984836d79f10e732. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:54:23.080808 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Getting quotas for user aa3da8047b124549a05e86b438789dfb and project 77ee3a3a7c3c4288984836d79f10e732. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:54:23.093169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:54:23.095505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:54:23.209500 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-229ac1e9-c938-4722-8420-32646c6c9570 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.688276 May 28 21:54:23.210190 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3366/6691] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:54:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:54:23.220883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a55683e7-6e54-486f-8a85-cc488f922286 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:23.221523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a55683e7-6e54-486f-8a85-cc488f922286 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:23.282430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a55683e7-6e54-486f-8a85-cc488f922286 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:23.289881 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a55683e7-6e54-486f-8a85-cc488f922286 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1239 microversion: 2.1 time: 0.072801 May 28 21:54:23.290471 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3326/6692] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:23 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:24.310604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a2915fa1-ecb7-47fb-9a4d-a88a3bdbf732 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:24.311256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a2915fa1-ecb7-47fb-9a4d-a88a3bdbf732 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:24.319398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2915fa1-ecb7-47fb-9a4d-a88a3bdbf732 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:24.319897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2915fa1-ecb7-47fb-9a4d-a88a3bdbf732 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:24.320680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2915fa1-ecb7-47fb-9a4d-a88a3bdbf732 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:24.321159 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2915fa1-ecb7-47fb-9a4d-a88a3bdbf732 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:24.385256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a2915fa1-ecb7-47fb-9a4d-a88a3bdbf732 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:24.393083 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a2915fa1-ecb7-47fb-9a4d-a88a3bdbf732 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1243 microversion: 2.1 time: 0.089739 May 28 21:54:24.393655 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3367/6693] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:24 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1243 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:25.416668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e647a532-5fde-4c5f-be55-cbd013975c12 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:25.417304 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e647a532-5fde-4c5f-be55-cbd013975c12 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:25.423903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e647a532-5fde-4c5f-be55-cbd013975c12 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:25.424374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e647a532-5fde-4c5f-be55-cbd013975c12 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:25.425181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e647a532-5fde-4c5f-be55-cbd013975c12 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:25.425643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e647a532-5fde-4c5f-be55-cbd013975c12 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:25.565860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e647a532-5fde-4c5f-be55-cbd013975c12 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:25.574126 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e647a532-5fde-4c5f-be55-cbd013975c12 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1297 microversion: 2.1 time: 0.161478 May 28 21:54:25.574708 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3327/6694] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:25 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1297 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:26.592981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6600e903-76bf-4419-adc0-f823cec2aa8d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:26.594458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6600e903-76bf-4419-adc0-f823cec2aa8d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:26.601227 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6600e903-76bf-4419-adc0-f823cec2aa8d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:26.601994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6600e903-76bf-4419-adc0-f823cec2aa8d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:26.602968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6600e903-76bf-4419-adc0-f823cec2aa8d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:26.603416 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6600e903-76bf-4419-adc0-f823cec2aa8d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:26.811056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6600e903-76bf-4419-adc0-f823cec2aa8d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:26.834499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2bc305a1-cbbd-455f-8e63-1e11b5d811d7 req-24d092d5-1900-4c53-91c9-14cd492ee3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e52de4-b38f-402b-9ac3-0c959790891c", "tag": "96f47ee7-bcd7-44f2-9f71-ba6039a4831c"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:54:26.838388 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6600e903-76bf-4419-adc0-f823cec2aa8d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1364 microversion: 2.1 time: 0.240944 May 28 21:54:26.839428 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3368/6695] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:26 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:26.856278 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2bc305a1-cbbd-455f-8e63-1e11b5d811d7 req-24d092d5-1900-4c53-91c9-14cd492ee3c3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:26.856939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2bc305a1-cbbd-455f-8e63-1e11b5d811d7 req-24d092d5-1900-4c53-91c9-14cd492ee3c3 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:26.869254 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2bc305a1-cbbd-455f-8e63-1e11b5d811d7 req-24d092d5-1900-4c53-91c9-14cd492ee3c3 service nova] Creating event network-changed:96f47ee7-bcd7-44f2-9f71-ba6039a4831c for instance e2e52de4-b38f-402b-9ac3-0c959790891c on nch1-master-1 May 28 21:54:26.874627 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2bc305a1-cbbd-455f-8e63-1e11b5d811d7 req-24d092d5-1900-4c53-91c9-14cd492ee3c3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043581 May 28 21:54:26.875151 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3328/6696] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:54:27.855873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ca1f61c3-0241-4042-8025-fd5c626e6143 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:27.856424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ca1f61c3-0241-4042-8025-fd5c626e6143 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:27.863660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca1f61c3-0241-4042-8025-fd5c626e6143 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:27.864138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca1f61c3-0241-4042-8025-fd5c626e6143 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:27.864941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca1f61c3-0241-4042-8025-fd5c626e6143 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:27.865385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca1f61c3-0241-4042-8025-fd5c626e6143 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:27.998300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ca1f61c3-0241-4042-8025-fd5c626e6143 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:28.006758 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ca1f61c3-0241-4042-8025-fd5c626e6143 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1364 microversion: 2.1 time: 0.154919 May 28 21:54:28.007336 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3369/6697] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:27 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:29.025511 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0ac283b1-b2cc-4c8f-8a98-80ed93dac46c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:29.026284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0ac283b1-b2cc-4c8f-8a98-80ed93dac46c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:29.032662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ac283b1-b2cc-4c8f-8a98-80ed93dac46c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:29.033129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ac283b1-b2cc-4c8f-8a98-80ed93dac46c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:29.033959 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ac283b1-b2cc-4c8f-8a98-80ed93dac46c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:29.034415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ac283b1-b2cc-4c8f-8a98-80ed93dac46c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:29.163202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0ac283b1-b2cc-4c8f-8a98-80ed93dac46c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:29.171344 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0ac283b1-b2cc-4c8f-8a98-80ed93dac46c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1364 microversion: 2.1 time: 0.151108 May 28 21:54:29.171914 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3329/6698] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:29 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:30.188491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-df00c25e-84d9-4e4e-8d4a-19eec2f667e8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:30.189115 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-df00c25e-84d9-4e4e-8d4a-19eec2f667e8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:30.196346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df00c25e-84d9-4e4e-8d4a-19eec2f667e8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:30.196809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df00c25e-84d9-4e4e-8d4a-19eec2f667e8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:30.198300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df00c25e-84d9-4e4e-8d4a-19eec2f667e8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:30.198746 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df00c25e-84d9-4e4e-8d4a-19eec2f667e8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:30.340711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-df00c25e-84d9-4e4e-8d4a-19eec2f667e8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:30.348403 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-df00c25e-84d9-4e4e-8d4a-19eec2f667e8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1364 microversion: 2.1 time: 0.163802 May 28 21:54:30.348973 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3370/6699] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:30 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:31.366148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6773461e-6cc6-48dc-b4b9-f1a634f5b9dd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:31.366736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6773461e-6cc6-48dc-b4b9-f1a634f5b9dd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:31.374289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6773461e-6cc6-48dc-b4b9-f1a634f5b9dd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:31.374754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6773461e-6cc6-48dc-b4b9-f1a634f5b9dd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:31.375527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6773461e-6cc6-48dc-b4b9-f1a634f5b9dd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:31.375977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6773461e-6cc6-48dc-b4b9-f1a634f5b9dd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:31.508294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6773461e-6cc6-48dc-b4b9-f1a634f5b9dd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:31.515925 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6773461e-6cc6-48dc-b4b9-f1a634f5b9dd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1364 microversion: 2.1 time: 0.153860 May 28 21:54:31.516497 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3330/6700] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:31 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:32.533886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bddcb970-7fc8-4e43-ae05-9098fa8e6eaf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:32.534511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bddcb970-7fc8-4e43-ae05-9098fa8e6eaf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:32.542083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bddcb970-7fc8-4e43-ae05-9098fa8e6eaf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:32.542550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bddcb970-7fc8-4e43-ae05-9098fa8e6eaf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:32.543323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bddcb970-7fc8-4e43-ae05-9098fa8e6eaf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:32.543769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bddcb970-7fc8-4e43-ae05-9098fa8e6eaf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:32.676171 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bddcb970-7fc8-4e43-ae05-9098fa8e6eaf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:32.683767 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bddcb970-7fc8-4e43-ae05-9098fa8e6eaf tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1364 microversion: 2.1 time: 0.153882 May 28 21:54:32.684345 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3371/6701] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:32 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:33.358910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-34cf143e-226e-4dac-a454-b37254fe67d2 req-c04eb5f2-76cd-40ce-8fd1-f8525d406c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e52de4-b38f-402b-9ac3-0c959790891c", "name": "network-vif-plugged", "status": "completed", "tag": "96f47ee7-bcd7-44f2-9f71-ba6039a4831c"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:54:33.363346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:54:33.369366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-34cf143e-226e-4dac-a454-b37254fe67d2 req-c04eb5f2-76cd-40ce-8fd1-f8525d406c19 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:33.369993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-34cf143e-226e-4dac-a454-b37254fe67d2 req-c04eb5f2-76cd-40ce-8fd1-f8525d406c19 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:33.383230 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-34cf143e-226e-4dac-a454-b37254fe67d2 req-c04eb5f2-76cd-40ce-8fd1-f8525d406c19 service nova] Creating event network-vif-plugged:96f47ee7-bcd7-44f2-9f71-ba6039a4831c for instance e2e52de4-b38f-402b-9ac3-0c959790891c on nch1-master-1 May 28 21:54:33.388208 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-34cf143e-226e-4dac-a454-b37254fe67d2 req-c04eb5f2-76cd-40ce-8fd1-f8525d406c19 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033074 May 28 21:54:33.388802 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3331/6702] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:54:33.561564 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 21:54:33.562092 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 21:54:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 21:54:33.700702 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a169f9f6-bd7e-4bce-93fe-4a8eb6be100d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:33.701367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a169f9f6-bd7e-4bce-93fe-4a8eb6be100d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:33.703340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:54:33.704029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:54:33.710152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a169f9f6-bd7e-4bce-93fe-4a8eb6be100d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:33.710612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a169f9f6-bd7e-4bce-93fe-4a8eb6be100d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:33.711375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a169f9f6-bd7e-4bce-93fe-4a8eb6be100d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:33.711815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a169f9f6-bd7e-4bce-93fe-4a8eb6be100d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:33.841919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a169f9f6-bd7e-4bce-93fe-4a8eb6be100d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:33.849396 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a169f9f6-bd7e-4bce-93fe-4a8eb6be100d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1364 microversion: 2.1 time: 0.152731 May 28 21:54:33.850062 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3372/6703] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:33 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:34.868156 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2c30d272-1ca9-495e-8cfd-fc42368e905f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:34.869466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2c30d272-1ca9-495e-8cfd-fc42368e905f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:34.876426 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c30d272-1ca9-495e-8cfd-fc42368e905f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:34.876901 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c30d272-1ca9-495e-8cfd-fc42368e905f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:34.877691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c30d272-1ca9-495e-8cfd-fc42368e905f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:34.878257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c30d272-1ca9-495e-8cfd-fc42368e905f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:35.005959 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2c30d272-1ca9-495e-8cfd-fc42368e905f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:54:35.013635 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2c30d272-1ca9-495e-8cfd-fc42368e905f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1550 microversion: 2.1 time: 0.150585 May 28 21:54:35.014256 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3332/6704] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:54:34 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1550 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:54:35.030182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4a222361-ff46-432d-9fc6-f2c1ea2c37d1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:54:35.030699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4a222361-ff46-432d-9fc6-f2c1ea2c37d1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:54:35.037638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4a222361-ff46-432d-9fc6-f2c1ea2c37d1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:35.038208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4a222361-ff46-432d-9fc6-f2c1ea2c37d1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:35.038984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4a222361-ff46-432d-9fc6-f2c1ea2c37d1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:35.039438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4a222361-ff46-432d-9fc6-f2c1ea2c37d1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:35.120868 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4a222361-ff46-432d-9fc6-f2c1ea2c37d1 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094553 May 28 21:54:35.121464 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3373/6705] 10.222.0.33 () {58 vars in 1274 bytes} [Sat May 28 21:54:35 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:54:36.057083 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-347580cd-4f86-4ed0-a0f4-7ccc760d4df4 req-06b4fe94-dd2d-4b4d-a414-ea2b51135f59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e52de4-b38f-402b-9ac3-0c959790891c", "tag": "96f47ee7-bcd7-44f2-9f71-ba6039a4831c"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:54:36.067876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-347580cd-4f86-4ed0-a0f4-7ccc760d4df4 req-06b4fe94-dd2d-4b4d-a414-ea2b51135f59 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:54:36.068112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-347580cd-4f86-4ed0-a0f4-7ccc760d4df4 req-06b4fe94-dd2d-4b4d-a414-ea2b51135f59 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:54:36.080712 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-347580cd-4f86-4ed0-a0f4-7ccc760d4df4 req-06b4fe94-dd2d-4b4d-a414-ea2b51135f59 service nova] Creating event network-changed:96f47ee7-bcd7-44f2-9f71-ba6039a4831c for instance e2e52de4-b38f-402b-9ac3-0c959790891c on nch1-master-1 May 28 21:54:36.085549 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-347580cd-4f86-4ed0-a0f4-7ccc760d4df4 req-06b4fe94-dd2d-4b4d-a414-ea2b51135f59 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032747 May 28 21:54:36.086484 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3333/6706] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:55:10.630957 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:55:10.631825 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:55:10.637463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-20f884c6-a3cc-4f05-92e2-26e8b3a39346 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:10.638314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-20f884c6-a3cc-4f05-92e2-26e8b3a39346 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:10.645423 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20f884c6-a3cc-4f05-92e2-26e8b3a39346 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:10.645988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20f884c6-a3cc-4f05-92e2-26e8b3a39346 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:10.646870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20f884c6-a3cc-4f05-92e2-26e8b3a39346 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:10.647403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-20f884c6-a3cc-4f05-92e2-26e8b3a39346 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:10.783408 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-20f884c6-a3cc-4f05-92e2-26e8b3a39346 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:10.791384 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-20f884c6-a3cc-4f05-92e2-26e8b3a39346 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1669 microversion: 2.1 time: 0.162793 May 28 21:55:10.791959 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3374/6707] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:10 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:10.805814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=31 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:55:10.806624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=66 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:55:10.810888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d8db4903-60e5-4bf7-9080-398b86c64ed9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aacef0b7-ccd9-44aa-b2dd-efab9ae27c17"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:55:10.812041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d8db4903-60e5-4bf7-9080-398b86c64ed9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:10.818165 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8db4903-60e5-4bf7-9080-398b86c64ed9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:10.818634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8db4903-60e5-4bf7-9080-398b86c64ed9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:10.819417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8db4903-60e5-4bf7-9080-398b86c64ed9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:10.819875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d8db4903-60e5-4bf7-9080-398b86c64ed9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:11.589958 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d8db4903-60e5-4bf7-9080-398b86c64ed9 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.785958 May 28 21:55:11.590618 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3334/6708] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:55:10 2022] POST /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c/os-volume_attachments => generated 194 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:55:14.871762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3d4c2897-0aeb-4f93-87e3-1c7af7d2c804 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:55:14.873293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3d4c2897-0aeb-4f93-87e3-1c7af7d2c804 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:14.881375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d4c2897-0aeb-4f93-87e3-1c7af7d2c804 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:14.881752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d4c2897-0aeb-4f93-87e3-1c7af7d2c804 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:14.882541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d4c2897-0aeb-4f93-87e3-1c7af7d2c804 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:14.882981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d4c2897-0aeb-4f93-87e3-1c7af7d2c804 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:14.911297 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3d4c2897-0aeb-4f93-87e3-1c7af7d2c804 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:14.917290 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3d4c2897-0aeb-4f93-87e3-1c7af7d2c804 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Old instance type m1.heat2, new instance type m1.heat {{(pid=143129) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 21:55:14.924121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-3d4c2897-0aeb-4f93-87e3-1c7af7d2c804 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:55:14.924551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-3d4c2897-0aeb-4f93-87e3-1c7af7d2c804 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:55:14.925027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-3d4c2897-0aeb-4f93-87e3-1c7af7d2c804 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:55:14.925444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-3d4c2897-0aeb-4f93-87e3-1c7af7d2c804 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:55:14.925881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-3d4c2897-0aeb-4f93-87e3-1c7af7d2c804 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:55:15.125286 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3d4c2897-0aeb-4f93-87e3-1c7af7d2c804 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c/action" status: 202 len: 0 microversion: 2.1 time: 0.257407 May 28 21:55:15.125953 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3375/6709] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:55:14 2022] POST /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:55:15.135595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3afe743f-02a2-42cb-9706-a4519cb6174d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:15.136324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3afe743f-02a2-42cb-9706-a4519cb6174d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:15.143454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3afe743f-02a2-42cb-9706-a4519cb6174d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:15.144101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3afe743f-02a2-42cb-9706-a4519cb6174d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:15.144964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3afe743f-02a2-42cb-9706-a4519cb6174d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:15.145440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3afe743f-02a2-42cb-9706-a4519cb6174d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:15.276307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3afe743f-02a2-42cb-9706-a4519cb6174d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:15.284672 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3afe743f-02a2-42cb-9706-a4519cb6174d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1724 microversion: 2.1 time: 0.154231 May 28 21:55:15.285448 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3335/6710] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:15 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:16.308073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0a29e1a7-1211-4bdc-b645-e373ed96c543 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:16.308708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0a29e1a7-1211-4bdc-b645-e373ed96c543 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:16.317029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a29e1a7-1211-4bdc-b645-e373ed96c543 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:16.324764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a29e1a7-1211-4bdc-b645-e373ed96c543 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:16.324764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a29e1a7-1211-4bdc-b645-e373ed96c543 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:16.324764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a29e1a7-1211-4bdc-b645-e373ed96c543 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:16.456620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0a29e1a7-1211-4bdc-b645-e373ed96c543 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:16.463715 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0a29e1a7-1211-4bdc-b645-e373ed96c543 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1724 microversion: 2.1 time: 0.161290 May 28 21:55:16.464305 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3376/6711] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:16 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:17.483680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-74301994-b4a6-49ea-87ff-17d8a8e09ada tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:17.484213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-74301994-b4a6-49ea-87ff-17d8a8e09ada tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:17.491510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-74301994-b4a6-49ea-87ff-17d8a8e09ada tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:17.492097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-74301994-b4a6-49ea-87ff-17d8a8e09ada tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:17.492984 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-74301994-b4a6-49ea-87ff-17d8a8e09ada tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:17.493612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-74301994-b4a6-49ea-87ff-17d8a8e09ada tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:17.647338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-74301994-b4a6-49ea-87ff-17d8a8e09ada tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:17.656594 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-74301994-b4a6-49ea-87ff-17d8a8e09ada tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1724 microversion: 2.1 time: 0.176866 May 28 21:55:17.657194 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3336/6712] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:17 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:18.674487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e07dfbcb-142c-462a-b1f7-d4ac7be206ef tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:18.675118 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e07dfbcb-142c-462a-b1f7-d4ac7be206ef tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:18.682162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e07dfbcb-142c-462a-b1f7-d4ac7be206ef tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:18.682626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e07dfbcb-142c-462a-b1f7-d4ac7be206ef tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:18.683412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e07dfbcb-142c-462a-b1f7-d4ac7be206ef tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:18.683865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e07dfbcb-142c-462a-b1f7-d4ac7be206ef tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:18.815802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e07dfbcb-142c-462a-b1f7-d4ac7be206ef tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:18.823899 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e07dfbcb-142c-462a-b1f7-d4ac7be206ef tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1729 microversion: 2.1 time: 0.153836 May 28 21:55:18.828939 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3377/6713] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:18 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:19.841250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8f976998-dff1-4eba-a688-9b4da33bb6e5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:19.842528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8f976998-dff1-4eba-a688-9b4da33bb6e5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:19.849512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f976998-dff1-4eba-a688-9b4da33bb6e5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:19.850028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f976998-dff1-4eba-a688-9b4da33bb6e5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:19.850823 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f976998-dff1-4eba-a688-9b4da33bb6e5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:19.851284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f976998-dff1-4eba-a688-9b4da33bb6e5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:19.980004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8f976998-dff1-4eba-a688-9b4da33bb6e5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:19.988216 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8f976998-dff1-4eba-a688-9b4da33bb6e5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1729 microversion: 2.1 time: 0.150939 May 28 21:55:19.988793 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3337/6714] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:19 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:21.005490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5f562b79-1217-4887-9004-443c1880d863 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:21.006052 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5f562b79-1217-4887-9004-443c1880d863 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:21.013383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f562b79-1217-4887-9004-443c1880d863 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:21.013865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f562b79-1217-4887-9004-443c1880d863 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:21.014658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f562b79-1217-4887-9004-443c1880d863 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:21.015107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5f562b79-1217-4887-9004-443c1880d863 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:21.143142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5f562b79-1217-4887-9004-443c1880d863 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:21.151120 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5f562b79-1217-4887-9004-443c1880d863 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1729 microversion: 2.1 time: 0.149719 May 28 21:55:21.151692 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3378/6715] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:21 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:22.169092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6148838a-cc3a-4201-8743-5a9d4729c678 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:22.169720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6148838a-cc3a-4201-8743-5a9d4729c678 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:22.177289 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6148838a-cc3a-4201-8743-5a9d4729c678 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:22.177751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6148838a-cc3a-4201-8743-5a9d4729c678 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:22.178551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6148838a-cc3a-4201-8743-5a9d4729c678 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:22.179000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6148838a-cc3a-4201-8743-5a9d4729c678 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:22.308727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6148838a-cc3a-4201-8743-5a9d4729c678 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:22.320549 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6148838a-cc3a-4201-8743-5a9d4729c678 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1729 microversion: 2.1 time: 0.151577 May 28 21:55:22.320549 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3338/6716] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:22 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:23.333433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1625818b-5fb1-46b6-a1f5-cbd2d7f0102a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:23.334036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1625818b-5fb1-46b6-a1f5-cbd2d7f0102a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:23.341042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1625818b-5fb1-46b6-a1f5-cbd2d7f0102a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:23.341510 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1625818b-5fb1-46b6-a1f5-cbd2d7f0102a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:23.342819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1625818b-5fb1-46b6-a1f5-cbd2d7f0102a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:23.343268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1625818b-5fb1-46b6-a1f5-cbd2d7f0102a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:23.469674 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1625818b-5fb1-46b6-a1f5-cbd2d7f0102a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:23.478097 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1625818b-5fb1-46b6-a1f5-cbd2d7f0102a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1729 microversion: 2.1 time: 0.148861 May 28 21:55:23.479202 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3379/6717] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:23 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:24.495900 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-36ebec5b-d3bb-49d4-aba6-30c9a85dd6a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:24.496455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-36ebec5b-d3bb-49d4-aba6-30c9a85dd6a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:24.504152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36ebec5b-d3bb-49d4-aba6-30c9a85dd6a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:24.504624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36ebec5b-d3bb-49d4-aba6-30c9a85dd6a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:24.505404 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36ebec5b-d3bb-49d4-aba6-30c9a85dd6a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:24.505874 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-36ebec5b-d3bb-49d4-aba6-30c9a85dd6a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:24.638207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-36ebec5b-d3bb-49d4-aba6-30c9a85dd6a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:24.646807 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-36ebec5b-d3bb-49d4-aba6-30c9a85dd6a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1729 microversion: 2.1 time: 0.154842 May 28 21:55:24.647387 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3339/6718] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:24 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:25.663871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2b350ef7-3a5d-4994-93ba-3442a42532e3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:25.664513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2b350ef7-3a5d-4994-93ba-3442a42532e3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:25.671570 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b350ef7-3a5d-4994-93ba-3442a42532e3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:25.672028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b350ef7-3a5d-4994-93ba-3442a42532e3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:25.672800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b350ef7-3a5d-4994-93ba-3442a42532e3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:25.673253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2b350ef7-3a5d-4994-93ba-3442a42532e3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:25.799389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2b350ef7-3a5d-4994-93ba-3442a42532e3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:25.807469 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2b350ef7-3a5d-4994-93ba-3442a42532e3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1729 microversion: 2.1 time: 0.147539 May 28 21:55:25.808048 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3380/6719] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:25 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:26.824684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2c5c95a8-a39a-4414-a8cc-810aac1e4989 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:26.825315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2c5c95a8-a39a-4414-a8cc-810aac1e4989 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:26.833106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c5c95a8-a39a-4414-a8cc-810aac1e4989 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:26.833574 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c5c95a8-a39a-4414-a8cc-810aac1e4989 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:26.834413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c5c95a8-a39a-4414-a8cc-810aac1e4989 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:26.834865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c5c95a8-a39a-4414-a8cc-810aac1e4989 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:26.962679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2c5c95a8-a39a-4414-a8cc-810aac1e4989 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:26.970864 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2c5c95a8-a39a-4414-a8cc-810aac1e4989 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1729 microversion: 2.1 time: 0.150125 May 28 21:55:26.971440 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3340/6720] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:26 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:55:27.988103 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8e98f180-987e-4046-abb5-db17be536e98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:27.988740 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8e98f180-987e-4046-abb5-db17be536e98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:27.995248 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e98f180-987e-4046-abb5-db17be536e98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:27.995709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e98f180-987e-4046-abb5-db17be536e98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:27.996482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e98f180-987e-4046-abb5-db17be536e98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:27.996929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8e98f180-987e-4046-abb5-db17be536e98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:28.128477 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8e98f180-987e-4046-abb5-db17be536e98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:28.136445 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8e98f180-987e-4046-abb5-db17be536e98 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1729 microversion: 2.1 time: 0.152275 May 28 21:55:28.137021 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3381/6721] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:27 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:29.153610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a44c3ee4-5f7b-414f-b93c-e56975217ede tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:29.154267 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a44c3ee4-5f7b-414f-b93c-e56975217ede tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:29.161762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a44c3ee4-5f7b-414f-b93c-e56975217ede tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:29.162259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a44c3ee4-5f7b-414f-b93c-e56975217ede tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:29.163036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a44c3ee4-5f7b-414f-b93c-e56975217ede tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:29.163493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a44c3ee4-5f7b-414f-b93c-e56975217ede tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:29.297944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a44c3ee4-5f7b-414f-b93c-e56975217ede tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:29.298866 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a44c3ee4-5f7b-414f-b93c-e56975217ede tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1729 microversion: 2.1 time: 0.149247 May 28 21:55:29.299441 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3341/6722] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:29 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:30.317606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e05771ee-3a76-4c21-a932-86638c150115 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:30.318225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e05771ee-3a76-4c21-a932-86638c150115 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:30.325361 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e05771ee-3a76-4c21-a932-86638c150115 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:30.325827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e05771ee-3a76-4c21-a932-86638c150115 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:30.328420 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e05771ee-3a76-4c21-a932-86638c150115 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:30.329167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e05771ee-3a76-4c21-a932-86638c150115 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:30.481224 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e05771ee-3a76-4c21-a932-86638c150115 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:30.489988 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e05771ee-3a76-4c21-a932-86638c150115 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1729 microversion: 2.1 time: 0.177554 May 28 21:55:30.490591 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3382/6723] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:30 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:31.508449 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9ee87149-6eec-4f27-b0e6-78111bb97500 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:31.509290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9ee87149-6eec-4f27-b0e6-78111bb97500 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:31.516396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ee87149-6eec-4f27-b0e6-78111bb97500 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:31.516872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ee87149-6eec-4f27-b0e6-78111bb97500 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:31.517662 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ee87149-6eec-4f27-b0e6-78111bb97500 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:31.518149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ee87149-6eec-4f27-b0e6-78111bb97500 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:31.725822 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9ee87149-6eec-4f27-b0e6-78111bb97500 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:31.733985 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9ee87149-6eec-4f27-b0e6-78111bb97500 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1728 microversion: 2.1 time: 0.229396 May 28 21:55:31.734577 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3342/6724] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:31 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1728 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:32.070499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d1fd46ae-43d9-4b18-a30a-03ad09396d73 req-20e65f49-125b-4599-b618-d3381691410a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e52de4-b38f-402b-9ac3-0c959790891c", "name": "network-vif-unplugged", "status": "completed", "tag": "96f47ee7-bcd7-44f2-9f71-ba6039a4831c"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:55:32.080796 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d1fd46ae-43d9-4b18-a30a-03ad09396d73 req-20e65f49-125b-4599-b618-d3381691410a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:32.081254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d1fd46ae-43d9-4b18-a30a-03ad09396d73 req-20e65f49-125b-4599-b618-d3381691410a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:32.093480 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d1fd46ae-43d9-4b18-a30a-03ad09396d73 req-20e65f49-125b-4599-b618-d3381691410a service nova] Creating event network-vif-unplugged:96f47ee7-bcd7-44f2-9f71-ba6039a4831c for instance e2e52de4-b38f-402b-9ac3-0c959790891c on nch2-master-1 May 28 21:55:32.099867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-d1fd46ae-43d9-4b18-a30a-03ad09396d73 req-20e65f49-125b-4599-b618-d3381691410a service nova] Instance e2e52de4-b38f-402b-9ac3-0c959790891c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:55:32.112744 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d1fd46ae-43d9-4b18-a30a-03ad09396d73 req-20e65f49-125b-4599-b618-d3381691410a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116131 May 28 21:55:32.113552 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3383/6725] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:55:32.751399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1675e4fd-02bf-42d4-8406-1a29b1ec40c7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:32.752034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1675e4fd-02bf-42d4-8406-1a29b1ec40c7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:32.761388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1675e4fd-02bf-42d4-8406-1a29b1ec40c7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:32.761904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1675e4fd-02bf-42d4-8406-1a29b1ec40c7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:32.762875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1675e4fd-02bf-42d4-8406-1a29b1ec40c7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:32.763482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1675e4fd-02bf-42d4-8406-1a29b1ec40c7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:32.958940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1675e4fd-02bf-42d4-8406-1a29b1ec40c7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:32.967233 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1675e4fd-02bf-42d4-8406-1a29b1ec40c7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1728 microversion: 2.1 time: 0.220619 May 28 21:55:32.967811 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3343/6726] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:32 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1728 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:33.989888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1d4e7fc4-dbca-4304-aa7d-4fd0e9d065a4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:33.990661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1d4e7fc4-dbca-4304-aa7d-4fd0e9d065a4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:33.997091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d4e7fc4-dbca-4304-aa7d-4fd0e9d065a4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:33.997555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d4e7fc4-dbca-4304-aa7d-4fd0e9d065a4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:33.998390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d4e7fc4-dbca-4304-aa7d-4fd0e9d065a4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:33.998878 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d4e7fc4-dbca-4304-aa7d-4fd0e9d065a4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:34.136592 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1d4e7fc4-dbca-4304-aa7d-4fd0e9d065a4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:34.145672 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1d4e7fc4-dbca-4304-aa7d-4fd0e9d065a4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1726 microversion: 2.1 time: 0.161051 May 28 21:55:34.146394 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3384/6727] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:33 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:34.152098 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-cb150599-efa4-4c38-8974-5f6030dfd860 req-b91b4717-2330-4b8e-8625-924642a9836e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e52de4-b38f-402b-9ac3-0c959790891c", "tag": "96f47ee7-bcd7-44f2-9f71-ba6039a4831c"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:55:34.161828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cb150599-efa4-4c38-8974-5f6030dfd860 req-b91b4717-2330-4b8e-8625-924642a9836e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:34.162411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cb150599-efa4-4c38-8974-5f6030dfd860 req-b91b4717-2330-4b8e-8625-924642a9836e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:34.174380 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-cb150599-efa4-4c38-8974-5f6030dfd860 req-b91b4717-2330-4b8e-8625-924642a9836e service nova] Creating event network-changed:96f47ee7-bcd7-44f2-9f71-ba6039a4831c for instance e2e52de4-b38f-402b-9ac3-0c959790891c on nch2-master-1 May 28 21:55:34.179859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-cb150599-efa4-4c38-8974-5f6030dfd860 req-b91b4717-2330-4b8e-8625-924642a9836e service nova] Instance e2e52de4-b38f-402b-9ac3-0c959790891c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:55:34.190644 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-cb150599-efa4-4c38-8974-5f6030dfd860 req-b91b4717-2330-4b8e-8625-924642a9836e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042697 May 28 21:55:34.191310 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3344/6728] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:55:35.162537 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a9c3aac8-22b7-43e8-baf8-2d9949e5ae11 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:35.163160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a9c3aac8-22b7-43e8-baf8-2d9949e5ae11 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:35.170223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9c3aac8-22b7-43e8-baf8-2d9949e5ae11 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:35.173275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9c3aac8-22b7-43e8-baf8-2d9949e5ae11 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:35.173275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9c3aac8-22b7-43e8-baf8-2d9949e5ae11 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:35.173275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a9c3aac8-22b7-43e8-baf8-2d9949e5ae11 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:35.301406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a9c3aac8-22b7-43e8-baf8-2d9949e5ae11 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:35.309512 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a9c3aac8-22b7-43e8-baf8-2d9949e5ae11 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1726 microversion: 2.1 time: 0.150887 May 28 21:55:35.310123 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3385/6729] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:35 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:36.329794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b7e6061c-6a51-4c69-aa70-a604fcd2d9e7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:36.330464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b7e6061c-6a51-4c69-aa70-a604fcd2d9e7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:36.336883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7e6061c-6a51-4c69-aa70-a604fcd2d9e7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:36.337369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7e6061c-6a51-4c69-aa70-a604fcd2d9e7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:36.338251 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7e6061c-6a51-4c69-aa70-a604fcd2d9e7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:36.338706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7e6061c-6a51-4c69-aa70-a604fcd2d9e7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:36.466567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b7e6061c-6a51-4c69-aa70-a604fcd2d9e7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:36.475235 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b7e6061c-6a51-4c69-aa70-a604fcd2d9e7 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1726 microversion: 2.1 time: 0.151179 May 28 21:55:36.475818 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3345/6730] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:36 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:37.493122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3308bfbe-cb7f-425e-a8e8-71f709793689 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:37.493751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3308bfbe-cb7f-425e-a8e8-71f709793689 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:37.501613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3308bfbe-cb7f-425e-a8e8-71f709793689 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:37.502104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3308bfbe-cb7f-425e-a8e8-71f709793689 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:37.502883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3308bfbe-cb7f-425e-a8e8-71f709793689 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:37.503388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3308bfbe-cb7f-425e-a8e8-71f709793689 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:37.635539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3308bfbe-cb7f-425e-a8e8-71f709793689 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:37.643596 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3308bfbe-cb7f-425e-a8e8-71f709793689 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1726 microversion: 2.1 time: 0.154660 May 28 21:55:37.644174 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3386/6731] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:37 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:38.661331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f5a578b6-2f3a-4ef7-8067-482c35f050ea tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:38.662003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f5a578b6-2f3a-4ef7-8067-482c35f050ea tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:38.669023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5a578b6-2f3a-4ef7-8067-482c35f050ea tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:38.669495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5a578b6-2f3a-4ef7-8067-482c35f050ea tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:38.670303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5a578b6-2f3a-4ef7-8067-482c35f050ea tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:38.670757 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5a578b6-2f3a-4ef7-8067-482c35f050ea tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:38.810471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f5a578b6-2f3a-4ef7-8067-482c35f050ea tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:38.819221 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f5a578b6-2f3a-4ef7-8067-482c35f050ea tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1726 microversion: 2.1 time: 0.162577 May 28 21:55:38.819811 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3346/6732] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:38 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:39.887634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-02870515-a3bf-4e11-a3e2-08ebce72b33d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:39.888279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-02870515-a3bf-4e11-a3e2-08ebce72b33d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:39.894422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02870515-a3bf-4e11-a3e2-08ebce72b33d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:39.894921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02870515-a3bf-4e11-a3e2-08ebce72b33d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:39.895679 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02870515-a3bf-4e11-a3e2-08ebce72b33d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:39.896141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02870515-a3bf-4e11-a3e2-08ebce72b33d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:40.025905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-02870515-a3bf-4e11-a3e2-08ebce72b33d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:40.034009 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-02870515-a3bf-4e11-a3e2-08ebce72b33d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1723 microversion: 2.1 time: 0.200645 May 28 21:55:40.034577 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3387/6733] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:39 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:40.050708 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d856c8c0-bf06-4376-9b9b-4dee326e8c88 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:55:40.051273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d856c8c0-bf06-4376-9b9b-4dee326e8c88 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:40.058363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d856c8c0-bf06-4376-9b9b-4dee326e8c88 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:40.058840 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d856c8c0-bf06-4376-9b9b-4dee326e8c88 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:40.059667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d856c8c0-bf06-4376-9b9b-4dee326e8c88 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:40.060133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d856c8c0-bf06-4376-9b9b-4dee326e8c88 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:40.098085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d856c8c0-bf06-4376-9b9b-4dee326e8c88 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:40.098558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d856c8c0-bf06-4376-9b9b-4dee326e8c88 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:40.099401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d856c8c0-bf06-4376-9b9b-4dee326e8c88 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:40.099844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d856c8c0-bf06-4376-9b9b-4dee326e8c88 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:40.120785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-d856c8c0-bf06-4376-9b9b-4dee326e8c88 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Getting quotas for project 77ee3a3a7c3c4288984836d79f10e732. Resources: {'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:55:40.126653 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-d856c8c0-bf06-4376-9b9b-4dee326e8c88 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Getting quotas for user aa3da8047b124549a05e86b438789dfb and project 77ee3a3a7c3c4288984836d79f10e732. Resources: {'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:55:40.249414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:55:40.512723 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d856c8c0-bf06-4376-9b9b-4dee326e8c88 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "POST /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c/action" status: 202 len: 0 microversion: 2.1 time: 0.466242 May 28 21:55:40.513340 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3347/6734] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:55:40 2022] POST /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:55:40.522597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7d1ad467-7c49-4bba-9f30-256151c09992 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:40.523221 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7d1ad467-7c49-4bba-9f30-256151c09992 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:40.529487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d1ad467-7c49-4bba-9f30-256151c09992 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:40.529970 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d1ad467-7c49-4bba-9f30-256151c09992 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:40.530780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d1ad467-7c49-4bba-9f30-256151c09992 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:40.531222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d1ad467-7c49-4bba-9f30-256151c09992 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:40.731281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7d1ad467-7c49-4bba-9f30-256151c09992 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:40.739418 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7d1ad467-7c49-4bba-9f30-256151c09992 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1722 microversion: 2.1 time: 0.221786 May 28 21:55:40.740080 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3388/6735] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:40 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:41.351664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-da20e893-4d8b-4f49-a141-0c4472c00247 req-fc263d02-a262-4c89-8c05-28a7e28ef1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e52de4-b38f-402b-9ac3-0c959790891c", "name": "network-vif-plugged", "status": "completed", "tag": "96f47ee7-bcd7-44f2-9f71-ba6039a4831c"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:55:41.356368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:55:41.363746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-da20e893-4d8b-4f49-a141-0c4472c00247 req-fc263d02-a262-4c89-8c05-28a7e28ef1a6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:41.364218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-da20e893-4d8b-4f49-a141-0c4472c00247 req-fc263d02-a262-4c89-8c05-28a7e28ef1a6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:41.376265 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-da20e893-4d8b-4f49-a141-0c4472c00247 req-fc263d02-a262-4c89-8c05-28a7e28ef1a6 service nova] Creating event network-vif-plugged:96f47ee7-bcd7-44f2-9f71-ba6039a4831c for instance e2e52de4-b38f-402b-9ac3-0c959790891c on nch2-master-1 May 28 21:55:41.381969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-da20e893-4d8b-4f49-a141-0c4472c00247 req-fc263d02-a262-4c89-8c05-28a7e28ef1a6 service nova] Instance e2e52de4-b38f-402b-9ac3-0c959790891c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:55:41.393145 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-da20e893-4d8b-4f49-a141-0c4472c00247 req-fc263d02-a262-4c89-8c05-28a7e28ef1a6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109275 May 28 21:55:41.393767 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3348/6736] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:55:41.760475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-49247aab-9932-4bd7-bcaf-57af912049cd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:41.761108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-49247aab-9932-4bd7-bcaf-57af912049cd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:41.768185 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49247aab-9932-4bd7-bcaf-57af912049cd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:41.768651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49247aab-9932-4bd7-bcaf-57af912049cd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:41.769484 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49247aab-9932-4bd7-bcaf-57af912049cd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:41.769965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-49247aab-9932-4bd7-bcaf-57af912049cd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:41.788965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:55:41.909211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-49247aab-9932-4bd7-bcaf-57af912049cd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:41.917454 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-49247aab-9932-4bd7-bcaf-57af912049cd tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1722 microversion: 2.1 time: 0.161112 May 28 21:55:41.918097 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3389/6737] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:41 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:42.936119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-61a6b5b9-5b1e-43f5-820e-4dc50ca631d8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:42.936829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-61a6b5b9-5b1e-43f5-820e-4dc50ca631d8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:42.945274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61a6b5b9-5b1e-43f5-820e-4dc50ca631d8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:42.945818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61a6b5b9-5b1e-43f5-820e-4dc50ca631d8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:42.946575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61a6b5b9-5b1e-43f5-820e-4dc50ca631d8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:42.947031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-61a6b5b9-5b1e-43f5-820e-4dc50ca631d8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:43.078552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-61a6b5b9-5b1e-43f5-820e-4dc50ca631d8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:43.087214 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-61a6b5b9-5b1e-43f5-820e-4dc50ca631d8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1722 microversion: 2.1 time: 0.155381 May 28 21:55:43.087783 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3349/6738] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:42 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:44.103451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-42064b0a-0a89-4e05-b442-13ab947baef4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:44.104080 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-42064b0a-0a89-4e05-b442-13ab947baef4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:44.112517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42064b0a-0a89-4e05-b442-13ab947baef4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:44.112973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42064b0a-0a89-4e05-b442-13ab947baef4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:44.113752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42064b0a-0a89-4e05-b442-13ab947baef4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:44.114237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42064b0a-0a89-4e05-b442-13ab947baef4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:44.251575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-42064b0a-0a89-4e05-b442-13ab947baef4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:44.259943 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-42064b0a-0a89-4e05-b442-13ab947baef4 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1722 microversion: 2.1 time: 0.160398 May 28 21:55:44.261723 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3390/6739] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:44 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:44.885644 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-303eb5fe-783f-443d-98e2-7df375bf7d5e req-4bed53c5-61e3-493b-b760-44c9cb3ea761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e52de4-b38f-402b-9ac3-0c959790891c", "name": "network-vif-unplugged", "status": "completed", "tag": "96f47ee7-bcd7-44f2-9f71-ba6039a4831c"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:55:44.894578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-303eb5fe-783f-443d-98e2-7df375bf7d5e req-4bed53c5-61e3-493b-b760-44c9cb3ea761 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:44.895045 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-303eb5fe-783f-443d-98e2-7df375bf7d5e req-4bed53c5-61e3-493b-b760-44c9cb3ea761 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:44.909923 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-303eb5fe-783f-443d-98e2-7df375bf7d5e req-4bed53c5-61e3-493b-b760-44c9cb3ea761 service nova] Creating event network-vif-unplugged:96f47ee7-bcd7-44f2-9f71-ba6039a4831c for instance e2e52de4-b38f-402b-9ac3-0c959790891c on nch1-master-1 May 28 21:55:44.915246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-303eb5fe-783f-443d-98e2-7df375bf7d5e req-4bed53c5-61e3-493b-b760-44c9cb3ea761 service nova] Instance e2e52de4-b38f-402b-9ac3-0c959790891c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:55:44.926380 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-303eb5fe-783f-443d-98e2-7df375bf7d5e req-4bed53c5-61e3-493b-b760-44c9cb3ea761 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044419 May 28 21:55:44.926992 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3350/6740] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:55:45.277561 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-feaaed32-c65b-4116-8cf3-28b98fdafdb8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:45.278256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-feaaed32-c65b-4116-8cf3-28b98fdafdb8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:45.281049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=39 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:55:45.286625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-feaaed32-c65b-4116-8cf3-28b98fdafdb8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:45.287097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-feaaed32-c65b-4116-8cf3-28b98fdafdb8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:45.287884 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-feaaed32-c65b-4116-8cf3-28b98fdafdb8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:45.288336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-feaaed32-c65b-4116-8cf3-28b98fdafdb8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:45.422848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-feaaed32-c65b-4116-8cf3-28b98fdafdb8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:45.432352 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-feaaed32-c65b-4116-8cf3-28b98fdafdb8 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1722 microversion: 2.1 time: 0.158771 May 28 21:55:45.442586 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3391/6741] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:45 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:46.450367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c5e6d4cb-6728-490b-af7f-ccc8e62b2a7d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:46.451012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c5e6d4cb-6728-490b-af7f-ccc8e62b2a7d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:46.457672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5e6d4cb-6728-490b-af7f-ccc8e62b2a7d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:46.458170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5e6d4cb-6728-490b-af7f-ccc8e62b2a7d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:46.458955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5e6d4cb-6728-490b-af7f-ccc8e62b2a7d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:46.459413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5e6d4cb-6728-490b-af7f-ccc8e62b2a7d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:46.591092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c5e6d4cb-6728-490b-af7f-ccc8e62b2a7d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:46.599800 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c5e6d4cb-6728-490b-af7f-ccc8e62b2a7d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1722 microversion: 2.1 time: 0.154739 May 28 21:55:46.600377 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3351/6742] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:46 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:46.941459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ad351cbc-47ba-4e15-b53c-b97c8f097319 req-05d5a889-7f1a-45e5-a475-0aef7adc61cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2e52de4-b38f-402b-9ac3-0c959790891c", "tag": "96f47ee7-bcd7-44f2-9f71-ba6039a4831c"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:55:46.952751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ad351cbc-47ba-4e15-b53c-b97c8f097319 req-05d5a889-7f1a-45e5-a475-0aef7adc61cf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:46.954012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ad351cbc-47ba-4e15-b53c-b97c8f097319 req-05d5a889-7f1a-45e5-a475-0aef7adc61cf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:46.967036 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ad351cbc-47ba-4e15-b53c-b97c8f097319 req-05d5a889-7f1a-45e5-a475-0aef7adc61cf service nova] Creating event network-changed:96f47ee7-bcd7-44f2-9f71-ba6039a4831c for instance e2e52de4-b38f-402b-9ac3-0c959790891c on nch1-master-1 May 28 21:55:46.974886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-ad351cbc-47ba-4e15-b53c-b97c8f097319 req-05d5a889-7f1a-45e5-a475-0aef7adc61cf service nova] Instance e2e52de4-b38f-402b-9ac3-0c959790891c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 21:55:46.986660 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ad351cbc-47ba-4e15-b53c-b97c8f097319 req-05d5a889-7f1a-45e5-a475-0aef7adc61cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048849 May 28 21:55:46.987381 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3392/6743] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:55:47.616773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-edf204bb-57f6-4f97-9042-271a3340ae0c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:47.617420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-edf204bb-57f6-4f97-9042-271a3340ae0c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:47.624408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-edf204bb-57f6-4f97-9042-271a3340ae0c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:47.624884 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-edf204bb-57f6-4f97-9042-271a3340ae0c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:47.626350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-edf204bb-57f6-4f97-9042-271a3340ae0c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:47.626816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-edf204bb-57f6-4f97-9042-271a3340ae0c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:47.761650 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-edf204bb-57f6-4f97-9042-271a3340ae0c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:47.769999 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-edf204bb-57f6-4f97-9042-271a3340ae0c tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1722 microversion: 2.1 time: 0.157201 May 28 21:55:47.770579 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3352/6744] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:47 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:48.787650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ff1808f4-95c3-45dd-8cbe-893bcf6777ab tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:48.788353 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ff1808f4-95c3-45dd-8cbe-893bcf6777ab tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:48.795489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff1808f4-95c3-45dd-8cbe-893bcf6777ab tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:48.795948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff1808f4-95c3-45dd-8cbe-893bcf6777ab tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:48.796715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff1808f4-95c3-45dd-8cbe-893bcf6777ab tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:48.797820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ff1808f4-95c3-45dd-8cbe-893bcf6777ab tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:48.926475 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ff1808f4-95c3-45dd-8cbe-893bcf6777ab tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:48.934623 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ff1808f4-95c3-45dd-8cbe-893bcf6777ab tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1722 microversion: 2.1 time: 0.151163 May 28 21:55:48.935199 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3393/6745] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:48 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:49.952477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-56b530d1-c8a5-4683-ab78-e5d4297d8185 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:49.953063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-56b530d1-c8a5-4683-ab78-e5d4297d8185 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:49.960546 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56b530d1-c8a5-4683-ab78-e5d4297d8185 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:49.961022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56b530d1-c8a5-4683-ab78-e5d4297d8185 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:49.961805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56b530d1-c8a5-4683-ab78-e5d4297d8185 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:49.962291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-56b530d1-c8a5-4683-ab78-e5d4297d8185 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:50.092320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-56b530d1-c8a5-4683-ab78-e5d4297d8185 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:50.101146 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-56b530d1-c8a5-4683-ab78-e5d4297d8185 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1722 microversion: 2.1 time: 0.152837 May 28 21:55:50.101728 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3353/6746] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:49 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:51.118340 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-13f1d709-0e5e-4269-9818-6aaa2969f753 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:51.118958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-13f1d709-0e5e-4269-9818-6aaa2969f753 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:51.126511 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13f1d709-0e5e-4269-9818-6aaa2969f753 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:51.126968 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13f1d709-0e5e-4269-9818-6aaa2969f753 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:51.127733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13f1d709-0e5e-4269-9818-6aaa2969f753 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:51.128180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-13f1d709-0e5e-4269-9818-6aaa2969f753 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:51.260534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-13f1d709-0e5e-4269-9818-6aaa2969f753 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:51.268677 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-13f1d709-0e5e-4269-9818-6aaa2969f753 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1715 microversion: 2.1 time: 0.154226 May 28 21:55:51.269246 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3394/6747] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:51 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1715 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:51.284690 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c7f7e1b3-aa4e-4998-b5a1-78c91bc65a80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:51.285328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c7f7e1b3-aa4e-4998-b5a1-78c91bc65a80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:51.287380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:55:51.293145 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7f7e1b3-aa4e-4998-b5a1-78c91bc65a80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:51.296294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7f7e1b3-aa4e-4998-b5a1-78c91bc65a80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:51.296294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7f7e1b3-aa4e-4998-b5a1-78c91bc65a80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:51.296294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c7f7e1b3-aa4e-4998-b5a1-78c91bc65a80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:51.423100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c7f7e1b3-aa4e-4998-b5a1-78c91bc65a80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:51.431180 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c7f7e1b3-aa4e-4998-b5a1-78c91bc65a80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1715 microversion: 2.1 time: 0.150434 May 28 21:55:51.431753 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3354/6748] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:51 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:51.453046 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-03959afc-a117-4cf9-a118-dfebc2964a27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:51.453997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-03959afc-a117-4cf9-a118-dfebc2964a27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:51.460195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-03959afc-a117-4cf9-a118-dfebc2964a27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:51.460699 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-03959afc-a117-4cf9-a118-dfebc2964a27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:51.461538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-03959afc-a117-4cf9-a118-dfebc2964a27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:51.462022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-03959afc-a117-4cf9-a118-dfebc2964a27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:51.597186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-03959afc-a117-4cf9-a118-dfebc2964a27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:51.605614 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-03959afc-a117-4cf9-a118-dfebc2964a27 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1715 microversion: 2.1 time: 0.161095 May 28 21:55:51.606239 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3395/6749] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:51 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:51.622775 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-04e6c901-0f13-4231-82aa-bdb57d18d3a3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:51.623302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-04e6c901-0f13-4231-82aa-bdb57d18d3a3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:51.630063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04e6c901-0f13-4231-82aa-bdb57d18d3a3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:51.630539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04e6c901-0f13-4231-82aa-bdb57d18d3a3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:51.631373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04e6c901-0f13-4231-82aa-bdb57d18d3a3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:51.631995 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04e6c901-0f13-4231-82aa-bdb57d18d3a3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:51.658620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-04e6c901-0f13-4231-82aa-bdb57d18d3a3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:55:51.955186 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-04e6c901-0f13-4231-82aa-bdb57d18d3a3 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 204 len: 0 microversion: 2.1 time: 0.336136 May 28 21:55:51.955732 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3355/6750] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:55:51 2022] DELETE /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:55:51.963959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2df12f54-1a6d-4031-b11a-94b2c9207541 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:51.964631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2df12f54-1a6d-4031-b11a-94b2c9207541 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:51.971491 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2df12f54-1a6d-4031-b11a-94b2c9207541 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:51.971929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2df12f54-1a6d-4031-b11a-94b2c9207541 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:51.972799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2df12f54-1a6d-4031-b11a-94b2c9207541 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:51.973244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2df12f54-1a6d-4031-b11a-94b2c9207541 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:52.108913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2df12f54-1a6d-4031-b11a-94b2c9207541 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:52.117147 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2df12f54-1a6d-4031-b11a-94b2c9207541 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1721 microversion: 2.1 time: 0.157065 May 28 21:55:52.117738 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3396/6751] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:51 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:53.134903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-851825e2-2fc6-4d6a-a6b2-d197b3a7fe1a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:53.135624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-851825e2-2fc6-4d6a-a6b2-d197b3a7fe1a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:53.142700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-851825e2-2fc6-4d6a-a6b2-d197b3a7fe1a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:53.143182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-851825e2-2fc6-4d6a-a6b2-d197b3a7fe1a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:53.143934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-851825e2-2fc6-4d6a-a6b2-d197b3a7fe1a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:53.144381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-851825e2-2fc6-4d6a-a6b2-d197b3a7fe1a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:53.275758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-851825e2-2fc6-4d6a-a6b2-d197b3a7fe1a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:53.284386 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-851825e2-2fc6-4d6a-a6b2-d197b3a7fe1a tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1721 microversion: 2.1 time: 0.153774 May 28 21:55:53.284970 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3356/6752] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:53 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:53.757029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-54d98b25-57d1-4ad7-aab4-702cb2ffc10d req-7dccdb8a-90d1-4365-b57c-a09badbed7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e52de4-b38f-402b-9ac3-0c959790891c", "name": "network-vif-plugged", "status": "completed", "tag": "96f47ee7-bcd7-44f2-9f71-ba6039a4831c"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:55:53.768391 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-54d98b25-57d1-4ad7-aab4-702cb2ffc10d req-7dccdb8a-90d1-4365-b57c-a09badbed7cd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:53.770771 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-54d98b25-57d1-4ad7-aab4-702cb2ffc10d req-7dccdb8a-90d1-4365-b57c-a09badbed7cd service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:53.780550 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-54d98b25-57d1-4ad7-aab4-702cb2ffc10d req-7dccdb8a-90d1-4365-b57c-a09badbed7cd service nova] Creating event network-vif-plugged:96f47ee7-bcd7-44f2-9f71-ba6039a4831c for instance e2e52de4-b38f-402b-9ac3-0c959790891c on nch1-master-1 May 28 21:55:53.786061 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-54d98b25-57d1-4ad7-aab4-702cb2ffc10d req-7dccdb8a-90d1-4365-b57c-a09badbed7cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032728 May 28 21:55:53.786609 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3397/6753] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:55:54.301016 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-71d6702d-b4cf-4253-a8b5-da35628b5e6f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:54.301648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-71d6702d-b4cf-4253-a8b5-da35628b5e6f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:54.308752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71d6702d-b4cf-4253-a8b5-da35628b5e6f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:54.309228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71d6702d-b4cf-4253-a8b5-da35628b5e6f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:54.310062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71d6702d-b4cf-4253-a8b5-da35628b5e6f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:54.310518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71d6702d-b4cf-4253-a8b5-da35628b5e6f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:54.392423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-71d6702d-b4cf-4253-a8b5-da35628b5e6f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:54.401493 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-71d6702d-b4cf-4253-a8b5-da35628b5e6f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1654 microversion: 2.1 time: 0.104766 May 28 21:55:54.402872 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3357/6754] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:54 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1654 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:54.508156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-58e2f635-9778-4c2d-9d71-c459bb478d85 req-f3defad0-72e3-4f97-9370-be8ee1214b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2e52de4-b38f-402b-9ac3-0c959790891c", "name": "network-vif-deleted", "tag": "96f47ee7-bcd7-44f2-9f71-ba6039a4831c"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:55:54.517573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-58e2f635-9778-4c2d-9d71-c459bb478d85 req-f3defad0-72e3-4f97-9370-be8ee1214b65 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:54.518060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-58e2f635-9778-4c2d-9d71-c459bb478d85 req-f3defad0-72e3-4f97-9370-be8ee1214b65 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:54.529195 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-58e2f635-9778-4c2d-9d71-c459bb478d85 req-f3defad0-72e3-4f97-9370-be8ee1214b65 service nova] Creating event network-vif-deleted:96f47ee7-bcd7-44f2-9f71-ba6039a4831c for instance e2e52de4-b38f-402b-9ac3-0c959790891c on nch1-master-1 May 28 21:55:54.534907 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-58e2f635-9778-4c2d-9d71-c459bb478d85 req-f3defad0-72e3-4f97-9370-be8ee1214b65 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031371 May 28 21:55:54.535487 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3398/6755] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:55:55.420035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a5f7dc09-7325-4889-a291-3d8ac98bcb80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:55.420697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a5f7dc09-7325-4889-a291-3d8ac98bcb80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:55.427465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5f7dc09-7325-4889-a291-3d8ac98bcb80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:55.427940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5f7dc09-7325-4889-a291-3d8ac98bcb80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:55.428840 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5f7dc09-7325-4889-a291-3d8ac98bcb80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:55.429918 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5f7dc09-7325-4889-a291-3d8ac98bcb80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:55.467556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5f7dc09-7325-4889-a291-3d8ac98bcb80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:55.468028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a5f7dc09-7325-4889-a291-3d8ac98bcb80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:55.468504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-a5f7dc09-7325-4889-a291-3d8ac98bcb80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lazy-loading 'fault' on Instance uuid e2e52de4-b38f-402b-9ac3-0c959790891c {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:55:55.510374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a5f7dc09-7325-4889-a291-3d8ac98bcb80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3da8047b124549a05e86b438789dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77ee3a3a7c3c4288984836d79f10e732', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:55:55.518515 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a5f7dc09-7325-4889-a291-3d8ac98bcb80 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 200 len: 1375 microversion: 2.1 time: 0.102559 May 28 21:55:55.519101 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3358/6756] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:55 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 1375 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:55:56.540639 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3fcaa383-7e08-41bb-981b-8a3264b540ee tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:56.541352 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3fcaa383-7e08-41bb-981b-8a3264b540ee tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:56.547824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fcaa383-7e08-41bb-981b-8a3264b540ee tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:56.548284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fcaa383-7e08-41bb-981b-8a3264b540ee tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:56.549056 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fcaa383-7e08-41bb-981b-8a3264b540ee tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:56.549502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3fcaa383-7e08-41bb-981b-8a3264b540ee tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:56.562681 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-3fcaa383-7e08-41bb-981b-8a3264b540ee tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3fcaa383-7e08-41bb-981b-8a3264b540ee tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c HTTP/1.1 May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'e2e52de4-b38f-402b-9ac3-0c959790891c'} May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:55:56.564303 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:55:56.568588 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:55:56.568588 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:55:56.568588 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:55:56.568588 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:55:56.568588 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:55:56.568588 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:55:56.568588 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:55:56.568588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3fcaa383-7e08-41bb-981b-8a3264b540ee tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:55:56.568588 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3fcaa383-7e08-41bb-981b-8a3264b540ee tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 404 len: 111 microversion: 2.1 time: 0.030420 May 28 21:55:56.568588 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3399/6757] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:55:56 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:55:56.622774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-95647f5b-ba74-4fa0-bbd8-19353887e58f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:55:56.623760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-95647f5b-ba74-4fa0-bbd8-19353887e58f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:55:56.630607 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95647f5b-ba74-4fa0-bbd8-19353887e58f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:56.631078 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95647f5b-ba74-4fa0-bbd8-19353887e58f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:56.631873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95647f5b-ba74-4fa0-bbd8-19353887e58f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:55:56.632329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95647f5b-ba74-4fa0-bbd8-19353887e58f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:55:56.645723 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-95647f5b-ba74-4fa0-bbd8-19353887e58f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-95647f5b-ba74-4fa0-bbd8-19353887e58f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c/os-volume_attachments HTTP/1.1 May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'server_id': 'e2e52de4-b38f-402b-9ac3-0c959790891c'} May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:55:56.649001 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:55:56.653470 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:55:56.653470 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:55:56.653470 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:55:56.653470 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:55:56.653470 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:55:56.653470 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:55:56.653470 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:55:56.653470 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:55:56.653470 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:55:56.653470 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:55:56.653470 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:55:56.653470 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-95647f5b-ba74-4fa0-bbd8-19353887e58f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:55:56.653470 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-95647f5b-ba74-4fa0-bbd8-19353887e58f tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.030206 May 28 21:55:56.653470 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3359/6758] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:55:56 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:56:00.064186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b6aad19f-c3b5-49ef-93e1-d9f63d62134d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:00.064602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b6aad19f-c3b5-49ef-93e1-d9f63d62134d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:00.071612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b6aad19f-c3b5-49ef-93e1-d9f63d62134d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.072048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b6aad19f-c3b5-49ef-93e1-d9f63d62134d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.072814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b6aad19f-c3b5-49ef-93e1-d9f63d62134d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.073255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b6aad19f-c3b5-49ef-93e1-d9f63d62134d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.087516 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-b6aad19f-c3b5-49ef-93e1-d9f63d62134d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b6aad19f-c3b5-49ef-93e1-d9f63d62134d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c HTTP/1.1 May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'e2e52de4-b38f-402b-9ac3-0c959790891c'} May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:56:00.089110 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:56:00.092680 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:56:00.092680 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.092680 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.092680 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.092680 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.092680 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.092680 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.092680 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:56:00.092680 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:56:00.092680 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:56:00.092680 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.092680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b6aad19f-c3b5-49ef-93e1-d9f63d62134d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:56:00.092680 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b6aad19f-c3b5-49ef-93e1-d9f63d62134d tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 404 len: 111 microversion: 2.1 time: 0.030404 May 28 21:56:00.092680 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3400/6759] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:56:00 2022] DELETE /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:56:00.099834 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ab732725-cffb-4ff0-b79c-9d275c89cb43 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:00.100513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ab732725-cffb-4ff0-b79c-9d275c89cb43 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: e2e52de4-b38f-402b-9ac3-0c959790891c] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:00.107528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab732725-cffb-4ff0-b79c-9d275c89cb43 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.108004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab732725-cffb-4ff0-b79c-9d275c89cb43 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.108792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab732725-cffb-4ff0-b79c-9d275c89cb43 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.109260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ab732725-cffb-4ff0-b79c-9d275c89cb43 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.122582 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-ab732725-cffb-4ff0-b79c-9d275c89cb43 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ab732725-cffb-4ff0-b79c-9d275c89cb43 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c HTTP/1.1 May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'e2e52de4-b38f-402b-9ac3-0c959790891c'} May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.124127 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.127816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.127816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.127816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.127816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:56:00.127816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:56:00.127816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. May 28 21:56:00.127816 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.127816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ab732725-cffb-4ff0-b79c-9d275c89cb43 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance e2e52de4-b38f-402b-9ac3-0c959790891c could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:56:00.127816 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ab732725-cffb-4ff0-b79c-9d275c89cb43 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c" status: 404 len: 111 microversion: 2.1 time: 0.030231 May 28 21:56:00.127816 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3360/6760] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:00 2022] GET /compute/v2.1/servers/e2e52de4-b38f-402b-9ac3-0c959790891c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:56:00.133897 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f13f47f5-f76f-4e24-a08b-a797dcdfddb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:00.134410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f13f47f5-f76f-4e24-a08b-a797dcdfddb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:00.140412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f13f47f5-f76f-4e24-a08b-a797dcdfddb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.140868 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f13f47f5-f76f-4e24-a08b-a797dcdfddb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.141635 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f13f47f5-f76f-4e24-a08b-a797dcdfddb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.142611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f13f47f5-f76f-4e24-a08b-a797dcdfddb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.155735 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-f13f47f5-f76f-4e24-a08b-a797dcdfddb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f13f47f5-f76f-4e24-a08b-a797dcdfddb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a HTTP/1.1 May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '04c1de70-20e9-428e-98c8-dfee533d359a'} May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:56:00.157261 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:56:00.161690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:56:00.161690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.161690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.161690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.161690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.161690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.161690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.161690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:56:00.161690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:56:00.161690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:56:00.161690 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.161690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f13f47f5-f76f-4e24-a08b-a797dcdfddb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:56:00.161690 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f13f47f5-f76f-4e24-a08b-a797dcdfddb2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "DELETE /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 404 len: 111 microversion: 2.1 time: 0.029264 May 28 21:56:00.161690 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3401/6761] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:56:00 2022] DELETE /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:56:00.167697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-182b4abc-8883-4a41-9916-4f57d58790a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:00.168337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-182b4abc-8883-4a41-9916-4f57d58790a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 04c1de70-20e9-428e-98c8-dfee533d359a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:00.174489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-182b4abc-8883-4a41-9916-4f57d58790a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.174966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-182b4abc-8883-4a41-9916-4f57d58790a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.175761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-182b4abc-8883-4a41-9916-4f57d58790a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.176231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-182b4abc-8883-4a41-9916-4f57d58790a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.189488 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-182b4abc-8883-4a41-9916-4f57d58790a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-182b4abc-8883-4a41-9916-4f57d58790a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a HTTP/1.1 May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '04c1de70-20e9-428e-98c8-dfee533d359a'} May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.191118 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.195412 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.195412 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.195412 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.195412 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:56:00.195412 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:56:00.195412 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. May 28 21:56:00.195412 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.195412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-182b4abc-8883-4a41-9916-4f57d58790a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance 04c1de70-20e9-428e-98c8-dfee533d359a could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:56:00.195412 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-182b4abc-8883-4a41-9916-4f57d58790a6 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a" status: 404 len: 111 microversion: 2.1 time: 0.028812 May 28 21:56:00.195412 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3361/6762] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:00 2022] GET /compute/v2.1/servers/04c1de70-20e9-428e-98c8-dfee533d359a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:56:00.200701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-537902a5-35f0-46eb-88a4-60fbdfd53614 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:00.201200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-537902a5-35f0-46eb-88a4-60fbdfd53614 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:00.208140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-537902a5-35f0-46eb-88a4-60fbdfd53614 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.208594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-537902a5-35f0-46eb-88a4-60fbdfd53614 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.209355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-537902a5-35f0-46eb-88a4-60fbdfd53614 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.209797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-537902a5-35f0-46eb-88a4-60fbdfd53614 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.223536 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-537902a5-35f0-46eb-88a4-60fbdfd53614 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-537902a5-35f0-46eb-88a4-60fbdfd53614 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 HTTP/1.1 May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2'} May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:56:00.225174 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:56:00.228652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:56:00.228652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.228652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.228652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.228652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.228652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.228652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.228652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:56:00.228652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:56:00.228652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:56:00.228652 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.228652 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-537902a5-35f0-46eb-88a4-60fbdfd53614 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:56:00.228652 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-537902a5-35f0-46eb-88a4-60fbdfd53614 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "DELETE /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 404 len: 111 microversion: 2.1 time: 0.029699 May 28 21:56:00.228652 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3402/6763] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:56:00 2022] DELETE /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:56:00.234788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-13fc9fef-cfb7-44a5-aabd-4a196a6791b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:00.235464 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-13fc9fef-cfb7-44a5-aabd-4a196a6791b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:00.241605 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13fc9fef-cfb7-44a5-aabd-4a196a6791b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.242112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13fc9fef-cfb7-44a5-aabd-4a196a6791b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.242897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13fc9fef-cfb7-44a5-aabd-4a196a6791b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.243357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-13fc9fef-cfb7-44a5-aabd-4a196a6791b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.256681 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-13fc9fef-cfb7-44a5-aabd-4a196a6791b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-13fc9fef-cfb7-44a5-aabd-4a196a6791b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 HTTP/1.1 May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2'} May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.258255 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.262754 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.262754 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.262754 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.262754 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:56:00.262754 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:56:00.262754 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. May 28 21:56:00.262754 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.262754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-13fc9fef-cfb7-44a5-aabd-4a196a6791b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:56:00.262754 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-13fc9fef-cfb7-44a5-aabd-4a196a6791b2 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2" status: 404 len: 111 microversion: 2.1 time: 0.028696 May 28 21:56:00.262754 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3362/6764] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:00 2022] GET /compute/v2.1/servers/bf06b9b7-2ecc-474e-85ec-b43e26ee6dd2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:56:00.269202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e5b15e3e-bbcf-4378-9161-a4baf603a7a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:00.269202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e5b15e3e-bbcf-4378-9161-a4baf603a7a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:00.275324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5b15e3e-bbcf-4378-9161-a4baf603a7a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.275786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5b15e3e-bbcf-4378-9161-a4baf603a7a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.276559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5b15e3e-bbcf-4378-9161-a4baf603a7a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.277002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e5b15e3e-bbcf-4378-9161-a4baf603a7a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.291185 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-e5b15e3e-bbcf-4378-9161-a4baf603a7a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e5b15e3e-bbcf-4378-9161-a4baf603a7a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f HTTP/1.1 May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f'} May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:56:00.292711 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:56:00.296863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:56:00.296863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.296863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.296863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.296863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.296863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.296863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.296863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:56:00.296863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:56:00.296863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:56:00.296863 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:00.296863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e5b15e3e-bbcf-4378-9161-a4baf603a7a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:56:00.296863 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e5b15e3e-bbcf-4378-9161-a4baf603a7a5 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 404 len: 111 microversion: 2.1 time: 0.029836 May 28 21:56:00.296863 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3403/6765] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:56:00 2022] DELETE /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:56:00.302490 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-528429c7-a1b3-49cb-a439-9db3b557f934 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:00.303116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-528429c7-a1b3-49cb-a439-9db3b557f934 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] [instance: 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:00.309226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-528429c7-a1b3-49cb-a439-9db3b557f934 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.309691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-528429c7-a1b3-49cb-a439-9db3b557f934 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.310496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-528429c7-a1b3-49cb-a439-9db3b557f934 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:00.310946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-528429c7-a1b3-49cb-a439-9db3b557f934 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:00.324351 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-528429c7-a1b3-49cb-a439-9db3b557f934 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] HTTP exception thrown: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-528429c7-a1b3-49cb-a439-9db3b557f934 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Request method failure captured: May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f HTTP/1.1 May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpku6xDacNKYIUb0QB2z0Fu5V05x1Tb7uXnOtPOj1HWjhqGm69J6Br0D0tzl3HTWsuWziQGQKJP_sSbeSXQZ3hmBC0z3yYbV4jjkp1mv6XxD1ig5SLxOOsA73N8TkT_J6XLocL9qAXXTUFN96g08Qs9MCVF99Fv5Qss-KfrTISSSCrc May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77ee3a3a7c3c4288984836d79f10e732", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77ee3a3a7c3c4288984836d79f10e732"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 77ee3a3a7c3c4288984836d79f10e732 May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServerActionsTestJSON-1410661479 May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: aa3da8047b124549a05e86b438789dfb May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServerActionsTestJSON-1410661479-project May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f'} May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:00.330934 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.338538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:00.338538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:00.338538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:00.338538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:56:00.338538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:56:00.338538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. May 28 21:56:00.338538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:00.338538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-528429c7-a1b3-49cb-a439-9db3b557f934 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Returning 404 to user: Instance 6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:56:00.338538 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-528429c7-a1b3-49cb-a439-9db3b557f934 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f" status: 404 len: 111 microversion: 2.1 time: 0.028739 May 28 21:56:00.338538 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3363/6766] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:00 2022] GET /compute/v2.1/servers/6dd9ca8b-65b2-4128-89ec-66a96a5d2b8f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:56:00.340867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-486ee97a-45a2-414c-8bab-ef8dbd093081 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] Calling method '.version_select at 0x7f4d56c31670>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:00.441574 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-486ee97a-45a2-414c-8bab-ef8dbd093081 tempest-ServerActionsTestJSON-1410661479 tempest-ServerActionsTestJSON-1410661479-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087605141" status: 202 len: 0 microversion: 2.1 time: 0.107367 May 28 21:56:00.442199 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3404/6767] 10.222.0.33 () {58 vars in 1220 bytes} [Sat May 28 21:56:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1087605141 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:56:08.100086 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-239904572", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "161470f8-5e69-47c3-874d-b8a4f0eba225"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:56:08.152150 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] validate_networks() for [('161470f8-5e69-47c3-874d-b8a4f0eba225', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:56:08.490583 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:56:08.491048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:56:08.491536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:56:08.491960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:56:08.492387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:56:08.501229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:08.501691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:08.503171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:08.503621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:08.520187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Getting quotas for project 22e09bcdc3974f888d75cc14a7cd098a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:56:08.525302 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Getting quotas for user 65d8da19cff64475bd6cb5ce24ae530b and project 22e09bcdc3974f888d75cc14a7cd098a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:56:08.537402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:56:08.539694 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:56:08.664238 ncdv-master-1 devstack@n-api.service[143128]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [63d4e346-ce63-4579-a13d-e28abfa098f7] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 21:56:09.672123 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [63d4e346-ce63-4579-a13d-e28abfa098f7] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 51860. May 28 21:56:09.675967 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7bb8c102-b752-4117-9569-1d77ba5187ee tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.698594 May 28 21:56:09.676631 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3364/6768] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:56:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:56:09.687807 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1c3357bf-a0a2-4bba-99c4-6c1f95a4e053 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:09.688474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1c3357bf-a0a2-4bba-99c4-6c1f95a4e053 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:09.743979 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1c3357bf-a0a2-4bba-99c4-6c1f95a4e053 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:09.750836 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1c3357bf-a0a2-4bba-99c4-6c1f95a4e053 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1216 microversion: 2.1 time: 0.067964 May 28 21:56:09.751575 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3405/6769] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:09 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:56:10.769501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-431e1ed9-645a-486e-8ddc-282320d195ba tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:10.770666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-431e1ed9-645a-486e-8ddc-282320d195ba tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:10.826783 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-431e1ed9-645a-486e-8ddc-282320d195ba tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:10.834598 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-431e1ed9-645a-486e-8ddc-282320d195ba tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1216 microversion: 2.1 time: 0.069919 May 28 21:56:10.835164 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3365/6770] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:10 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:11.851238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e387c91e-278b-4b8e-a136-71a6b3e364ef tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:11.851854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e387c91e-278b-4b8e-a136-71a6b3e364ef tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:11.853867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=56 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:56:11.859792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e387c91e-278b-4b8e-a136-71a6b3e364ef tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:11.860247 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e387c91e-278b-4b8e-a136-71a6b3e364ef tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:11.861021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e387c91e-278b-4b8e-a136-71a6b3e364ef tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:11.861463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e387c91e-278b-4b8e-a136-71a6b3e364ef tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:11.928369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e387c91e-278b-4b8e-a136-71a6b3e364ef tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:11.937704 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e387c91e-278b-4b8e-a136-71a6b3e364ef tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1276 microversion: 2.1 time: 0.090848 May 28 21:56:11.938766 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3406/6771] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:11 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1276 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:12.955321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9230b786-6566-4b8f-bcc1-3a8d80c93ded tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:12.955907 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9230b786-6566-4b8f-bcc1-3a8d80c93ded tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:12.965301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9230b786-6566-4b8f-bcc1-3a8d80c93ded tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:12.965805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9230b786-6566-4b8f-bcc1-3a8d80c93ded tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:12.966631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9230b786-6566-4b8f-bcc1-3a8d80c93ded tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:12.967089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9230b786-6566-4b8f-bcc1-3a8d80c93ded tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:12.971298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:56:13.100629 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9230b786-6566-4b8f-bcc1-3a8d80c93ded tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:13.108064 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9230b786-6566-4b8f-bcc1-3a8d80c93ded tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1316 microversion: 2.1 time: 0.157184 May 28 21:56:13.108630 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3366/6772] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:12 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:13.562133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-dfa1b39d-ef94-4d14-8feb-9ae924c6aa5d req-c0c92258-5a97-4ab6-9e3b-77e37283066e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d655a5-5768-41f3-9109-122db7b43021", "tag": "ba1fb4da-bb7e-4088-a216-d2b49f80bf14"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:56:13.572191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-dfa1b39d-ef94-4d14-8feb-9ae924c6aa5d req-c0c92258-5a97-4ab6-9e3b-77e37283066e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:13.572913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-dfa1b39d-ef94-4d14-8feb-9ae924c6aa5d req-c0c92258-5a97-4ab6-9e3b-77e37283066e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:13.585905 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-dfa1b39d-ef94-4d14-8feb-9ae924c6aa5d req-c0c92258-5a97-4ab6-9e3b-77e37283066e service nova] Creating event network-changed:ba1fb4da-bb7e-4088-a216-d2b49f80bf14 for instance 62d655a5-5768-41f3-9109-122db7b43021 on nch1-master-1 May 28 21:56:13.590894 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-dfa1b39d-ef94-4d14-8feb-9ae924c6aa5d req-c0c92258-5a97-4ab6-9e3b-77e37283066e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103060 May 28 21:56:13.591504 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3407/6773] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 21:56:14.124766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ad2d5f05-d6ad-4eba-892c-e9a2055564dd tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:14.125330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ad2d5f05-d6ad-4eba-892c-e9a2055564dd tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:14.128455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:56:14.134190 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad2d5f05-d6ad-4eba-892c-e9a2055564dd tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:14.134752 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad2d5f05-d6ad-4eba-892c-e9a2055564dd tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:14.138318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad2d5f05-d6ad-4eba-892c-e9a2055564dd tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:14.138318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ad2d5f05-d6ad-4eba-892c-e9a2055564dd tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:14.269482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ad2d5f05-d6ad-4eba-892c-e9a2055564dd tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:14.277431 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ad2d5f05-d6ad-4eba-892c-e9a2055564dd tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1316 microversion: 2.1 time: 0.156730 May 28 21:56:14.278055 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3367/6774] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:14 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:15.216084 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 21:56:15.216708 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 21:56:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 21:56:15.294859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-02ac04df-f421-4584-a051-2625e026c934 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:15.295574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-02ac04df-f421-4584-a051-2625e026c934 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:15.303556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02ac04df-f421-4584-a051-2625e026c934 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:15.304014 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02ac04df-f421-4584-a051-2625e026c934 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:15.304794 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02ac04df-f421-4584-a051-2625e026c934 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:15.305234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-02ac04df-f421-4584-a051-2625e026c934 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:15.439033 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-02ac04df-f421-4584-a051-2625e026c934 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:15.447199 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-02ac04df-f421-4584-a051-2625e026c934 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1316 microversion: 2.1 time: 0.156583 May 28 21:56:15.447786 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3408/6775] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:15 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:16.464325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-70801c67-1eb3-4698-b9c0-16f881918243 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:16.464911 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-70801c67-1eb3-4698-b9c0-16f881918243 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:16.472015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70801c67-1eb3-4698-b9c0-16f881918243 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:16.472483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70801c67-1eb3-4698-b9c0-16f881918243 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:16.473264 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70801c67-1eb3-4698-b9c0-16f881918243 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:16.473720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70801c67-1eb3-4698-b9c0-16f881918243 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:16.602184 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-70801c67-1eb3-4698-b9c0-16f881918243 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:16.609732 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-70801c67-1eb3-4698-b9c0-16f881918243 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1316 microversion: 2.1 time: 0.149443 May 28 21:56:16.610364 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3368/6776] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:16 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:17.626351 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-06bc71e2-7ed3-47d1-b0a9-84c2350d4e58 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:17.626974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-06bc71e2-7ed3-47d1-b0a9-84c2350d4e58 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:17.629883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:56:17.635268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-06bc71e2-7ed3-47d1-b0a9-84c2350d4e58 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:17.635730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-06bc71e2-7ed3-47d1-b0a9-84c2350d4e58 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:17.636556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-06bc71e2-7ed3-47d1-b0a9-84c2350d4e58 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:17.637107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-06bc71e2-7ed3-47d1-b0a9-84c2350d4e58 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:17.774422 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-06bc71e2-7ed3-47d1-b0a9-84c2350d4e58 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:17.782281 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-06bc71e2-7ed3-47d1-b0a9-84c2350d4e58 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1316 microversion: 2.1 time: 0.159788 May 28 21:56:17.782884 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3409/6777] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:17 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:18.798981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-467ce198-c6c7-4c1f-8a0e-340303340700 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:18.799645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-467ce198-c6c7-4c1f-8a0e-340303340700 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:18.802385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:56:18.807909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-467ce198-c6c7-4c1f-8a0e-340303340700 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:18.808481 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-467ce198-c6c7-4c1f-8a0e-340303340700 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:18.809263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-467ce198-c6c7-4c1f-8a0e-340303340700 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:18.809714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-467ce198-c6c7-4c1f-8a0e-340303340700 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:18.938763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-467ce198-c6c7-4c1f-8a0e-340303340700 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:18.946223 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-467ce198-c6c7-4c1f-8a0e-340303340700 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1316 microversion: 2.1 time: 0.151171 May 28 21:56:18.946788 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3369/6778] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:18 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:19.921219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-23f5c510-bc0b-40fa-bb2a-6b7a4557582a req-cb66a0a3-0a94-4f78-ae65-e017383a6f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d655a5-5768-41f3-9109-122db7b43021", "name": "network-vif-plugged", "status": "completed", "tag": "ba1fb4da-bb7e-4088-a216-d2b49f80bf14"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:56:19.925653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:56:19.931132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-23f5c510-bc0b-40fa-bb2a-6b7a4557582a req-cb66a0a3-0a94-4f78-ae65-e017383a6f1d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:19.931574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-23f5c510-bc0b-40fa-bb2a-6b7a4557582a req-cb66a0a3-0a94-4f78-ae65-e017383a6f1d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:19.942590 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-23f5c510-bc0b-40fa-bb2a-6b7a4557582a req-cb66a0a3-0a94-4f78-ae65-e017383a6f1d service nova] Creating event network-vif-plugged:ba1fb4da-bb7e-4088-a216-d2b49f80bf14 for instance 62d655a5-5768-41f3-9109-122db7b43021 on nch1-master-1 May 28 21:56:19.948073 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-23f5c510-bc0b-40fa-bb2a-6b7a4557582a req-cb66a0a3-0a94-4f78-ae65-e017383a6f1d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030688 May 28 21:56:19.953473 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3410/6779] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:56:19.963659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-26c5512d-fb36-4b20-9e87-952f6b89ca20 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:19.964240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-26c5512d-fb36-4b20-9e87-952f6b89ca20 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:19.971428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26c5512d-fb36-4b20-9e87-952f6b89ca20 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:19.976430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26c5512d-fb36-4b20-9e87-952f6b89ca20 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:19.976430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26c5512d-fb36-4b20-9e87-952f6b89ca20 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:19.976430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-26c5512d-fb36-4b20-9e87-952f6b89ca20 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:20.117217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-26c5512d-fb36-4b20-9e87-952f6b89ca20 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:20.124939 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-26c5512d-fb36-4b20-9e87-952f6b89ca20 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1316 microversion: 2.1 time: 0.165838 May 28 21:56:20.125527 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3370/6780] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:19 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:21.142779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-72a2567b-4542-4fff-90d5-10eef687a76f tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:21.143488 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-72a2567b-4542-4fff-90d5-10eef687a76f tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:21.150801 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72a2567b-4542-4fff-90d5-10eef687a76f tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:21.151262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72a2567b-4542-4fff-90d5-10eef687a76f tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:21.152058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72a2567b-4542-4fff-90d5-10eef687a76f tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:21.152504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-72a2567b-4542-4fff-90d5-10eef687a76f tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:21.279722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-72a2567b-4542-4fff-90d5-10eef687a76f tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:21.288496 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-72a2567b-4542-4fff-90d5-10eef687a76f tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1505 microversion: 2.1 time: 0.150155 May 28 21:56:21.289093 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3411/6781] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:21 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:21.344224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-346394978", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "161470f8-5e69-47c3-874d-b8a4f0eba225"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:56:21.350903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:56:21.403516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] validate_networks() for [('161470f8-5e69-47c3-874d-b8a4f0eba225', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:56:21.767064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:56:21.767505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:56:21.767994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:56:21.768450 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:56:21.768873 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:56:21.777767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:21.778270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:21.779084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:21.779535 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:21.796584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Getting quotas for project 22e09bcdc3974f888d75cc14a7cd098a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:56:21.801620 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Getting quotas for user 65d8da19cff64475bd6cb5ce24ae530b and project 22e09bcdc3974f888d75cc14a7cd098a. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:56:21.814549 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:56:21.817502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:56:21.941042 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9f68a80b-ae2b-4d58-9f68-29aa530b8324 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600504 May 28 21:56:21.941625 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3371/6782] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:56:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:56:21.952281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-321dfb26-889f-4638-b7c1-d2c7f4d54102 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:21.952941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-321dfb26-889f-4638-b7c1-d2c7f4d54102 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:22.013450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-321dfb26-889f-4638-b7c1-d2c7f4d54102 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:22.020531 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-321dfb26-889f-4638-b7c1-d2c7f4d54102 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 200 len: 1216 microversion: 2.1 time: 0.072158 May 28 21:56:22.021108 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3412/6783] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:21 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 1216 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:23.036610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd35aa4e-c11c-4375-8fb3-dfaa6979f539 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:23.037293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bd35aa4e-c11c-4375-8fb3-dfaa6979f539 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:23.045079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd35aa4e-c11c-4375-8fb3-dfaa6979f539 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:23.045551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd35aa4e-c11c-4375-8fb3-dfaa6979f539 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:23.049862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd35aa4e-c11c-4375-8fb3-dfaa6979f539 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:23.049862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd35aa4e-c11c-4375-8fb3-dfaa6979f539 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:23.111751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bd35aa4e-c11c-4375-8fb3-dfaa6979f539 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:23.119565 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bd35aa4e-c11c-4375-8fb3-dfaa6979f539 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 200 len: 1220 microversion: 2.1 time: 0.086872 May 28 21:56:23.120524 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3372/6784] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:23 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:24.136584 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9e249120-fa0f-4d19-8d08-f3cdb2353be9 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:24.137214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9e249120-fa0f-4d19-8d08-f3cdb2353be9 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:24.144845 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e249120-fa0f-4d19-8d08-f3cdb2353be9 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:24.147611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e249120-fa0f-4d19-8d08-f3cdb2353be9 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:24.147611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e249120-fa0f-4d19-8d08-f3cdb2353be9 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:24.147611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9e249120-fa0f-4d19-8d08-f3cdb2353be9 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:24.222485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9e249120-fa0f-4d19-8d08-f3cdb2353be9 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:24.230521 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9e249120-fa0f-4d19-8d08-f3cdb2353be9 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 200 len: 1286 microversion: 2.1 time: 0.097878 May 28 21:56:24.233341 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3413/6785] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:24 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 1286 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:25.247798 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ecf0e7de-0da7-4d06-9b9d-e3876d4ff708 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:25.248436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ecf0e7de-0da7-4d06-9b9d-e3876d4ff708 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:25.255212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecf0e7de-0da7-4d06-9b9d-e3876d4ff708 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:25.255740 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecf0e7de-0da7-4d06-9b9d-e3876d4ff708 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:25.257089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecf0e7de-0da7-4d06-9b9d-e3876d4ff708 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:25.257540 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ecf0e7de-0da7-4d06-9b9d-e3876d4ff708 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:25.429641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ecf0e7de-0da7-4d06-9b9d-e3876d4ff708 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:25.437346 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ecf0e7de-0da7-4d06-9b9d-e3876d4ff708 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 200 len: 1316 microversion: 2.1 time: 0.193596 May 28 21:56:25.438023 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3373/6786] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:25 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:25.614997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-323b1dbe-7c50-43e1-a1b5-c1d8aabaf310 req-0a3129f7-6f45-439c-82e2-156aa099697c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a", "tag": "75bea697-407c-441c-8853-211175958cd9"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:56:25.624260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-323b1dbe-7c50-43e1-a1b5-c1d8aabaf310 req-0a3129f7-6f45-439c-82e2-156aa099697c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:25.624723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-323b1dbe-7c50-43e1-a1b5-c1d8aabaf310 req-0a3129f7-6f45-439c-82e2-156aa099697c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:25.636898 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-323b1dbe-7c50-43e1-a1b5-c1d8aabaf310 req-0a3129f7-6f45-439c-82e2-156aa099697c service nova] Creating event network-changed:75bea697-407c-441c-8853-211175958cd9 for instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a on nch2-master-1 May 28 21:56:25.641638 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-323b1dbe-7c50-43e1-a1b5-c1d8aabaf310 req-0a3129f7-6f45-439c-82e2-156aa099697c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030647 May 28 21:56:25.642273 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3414/6787] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:56:26.455231 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e95d95ed-1b78-460f-b5e8-72194b120cad tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:26.455828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e95d95ed-1b78-460f-b5e8-72194b120cad tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:26.462867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e95d95ed-1b78-460f-b5e8-72194b120cad tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:26.463332 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e95d95ed-1b78-460f-b5e8-72194b120cad tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:26.464112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e95d95ed-1b78-460f-b5e8-72194b120cad tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:26.464562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e95d95ed-1b78-460f-b5e8-72194b120cad tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:26.592681 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e95d95ed-1b78-460f-b5e8-72194b120cad tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:26.600761 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e95d95ed-1b78-460f-b5e8-72194b120cad tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 200 len: 1316 microversion: 2.1 time: 0.149283 May 28 21:56:26.601333 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3374/6788] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:26 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:27.619719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8fb7f385-e104-4570-a124-ef3e6b03b1e3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:27.620435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8fb7f385-e104-4570-a124-ef3e6b03b1e3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:27.626870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fb7f385-e104-4570-a124-ef3e6b03b1e3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:27.627329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fb7f385-e104-4570-a124-ef3e6b03b1e3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:27.628093 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fb7f385-e104-4570-a124-ef3e6b03b1e3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:27.628542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8fb7f385-e104-4570-a124-ef3e6b03b1e3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:27.756012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8fb7f385-e104-4570-a124-ef3e6b03b1e3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:27.763637 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8fb7f385-e104-4570-a124-ef3e6b03b1e3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 200 len: 1316 microversion: 2.1 time: 0.149894 May 28 21:56:27.764203 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3415/6789] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:27 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:56:28.780700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c59621e4-e2b9-4ef1-9463-0c5ab3b6a774 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:28.781328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c59621e4-e2b9-4ef1-9463-0c5ab3b6a774 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:28.788867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c59621e4-e2b9-4ef1-9463-0c5ab3b6a774 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:28.789398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c59621e4-e2b9-4ef1-9463-0c5ab3b6a774 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:28.790203 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c59621e4-e2b9-4ef1-9463-0c5ab3b6a774 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:28.790657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c59621e4-e2b9-4ef1-9463-0c5ab3b6a774 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:29.273569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c59621e4-e2b9-4ef1-9463-0c5ab3b6a774 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:29.281733 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c59621e4-e2b9-4ef1-9463-0c5ab3b6a774 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 200 len: 1316 microversion: 2.1 time: 0.504964 May 28 21:56:29.283013 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3375/6790] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:28 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:30.299291 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-43a3120f-80b8-4c12-9340-b1301d8842a7 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:30.299954 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-43a3120f-80b8-4c12-9340-b1301d8842a7 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:30.306967 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-43a3120f-80b8-4c12-9340-b1301d8842a7 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:30.307427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-43a3120f-80b8-4c12-9340-b1301d8842a7 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:30.308199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-43a3120f-80b8-4c12-9340-b1301d8842a7 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:30.308658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-43a3120f-80b8-4c12-9340-b1301d8842a7 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:30.439281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-43a3120f-80b8-4c12-9340-b1301d8842a7 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:30.448114 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-43a3120f-80b8-4c12-9340-b1301d8842a7 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 200 len: 1316 microversion: 2.1 time: 0.152760 May 28 21:56:30.462218 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3416/6791] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:30 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:31.385257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-3e8baf5e-9161-428a-9d7b-e1f35ab27867 req-7c3a67e2-bf4e-4b7b-811f-cc91910ff765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a", "name": "network-vif-plugged", "status": "completed", "tag": "75bea697-407c-441c-8853-211175958cd9"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:56:31.394034 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3e8baf5e-9161-428a-9d7b-e1f35ab27867 req-7c3a67e2-bf4e-4b7b-811f-cc91910ff765 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:31.394516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3e8baf5e-9161-428a-9d7b-e1f35ab27867 req-7c3a67e2-bf4e-4b7b-811f-cc91910ff765 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:31.406088 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-3e8baf5e-9161-428a-9d7b-e1f35ab27867 req-7c3a67e2-bf4e-4b7b-811f-cc91910ff765 service nova] Creating event network-vif-plugged:75bea697-407c-441c-8853-211175958cd9 for instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a on nch2-master-1 May 28 21:56:31.411030 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-3e8baf5e-9161-428a-9d7b-e1f35ab27867 req-7c3a67e2-bf4e-4b7b-811f-cc91910ff765 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030056 May 28 21:56:31.411608 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3376/6792] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:56:31.476787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-df0cce5c-7c87-404e-bc0a-0c94139fc506 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:31.477412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-df0cce5c-7c87-404e-bc0a-0c94139fc506 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:31.486028 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df0cce5c-7c87-404e-bc0a-0c94139fc506 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:31.486487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df0cce5c-7c87-404e-bc0a-0c94139fc506 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:31.487269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df0cce5c-7c87-404e-bc0a-0c94139fc506 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:31.487717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-df0cce5c-7c87-404e-bc0a-0c94139fc506 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:31.648684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-df0cce5c-7c87-404e-bc0a-0c94139fc506 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:31.656255 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-df0cce5c-7c87-404e-bc0a-0c94139fc506 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 200 len: 1316 microversion: 2.1 time: 0.183632 May 28 21:56:31.656832 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3417/6793] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:31 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:32.670712 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:56:32.671550 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:56:32.676471 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3b9cc65e-93d8-472d-ae46-45565d0f27f5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:32.677208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3b9cc65e-93d8-472d-ae46-45565d0f27f5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:32.683601 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b9cc65e-93d8-472d-ae46-45565d0f27f5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:32.684080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b9cc65e-93d8-472d-ae46-45565d0f27f5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:32.684872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b9cc65e-93d8-472d-ae46-45565d0f27f5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:32.685331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3b9cc65e-93d8-472d-ae46-45565d0f27f5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:32.818310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3b9cc65e-93d8-472d-ae46-45565d0f27f5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:32.827016 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3b9cc65e-93d8-472d-ae46-45565d0f27f5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 200 len: 1316 microversion: 2.1 time: 0.157257 May 28 21:56:32.827601 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3377/6794] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:32 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:33.844577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc829d33-26a0-4e69-b04f-c9bedb35b393 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:33.845196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc829d33-26a0-4e69-b04f-c9bedb35b393 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:33.847210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:56:33.853463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc829d33-26a0-4e69-b04f-c9bedb35b393 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:33.853947 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc829d33-26a0-4e69-b04f-c9bedb35b393 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:33.854723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc829d33-26a0-4e69-b04f-c9bedb35b393 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:33.855172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc829d33-26a0-4e69-b04f-c9bedb35b393 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:33.980745 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc829d33-26a0-4e69-b04f-c9bedb35b393 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:33.988218 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc829d33-26a0-4e69-b04f-c9bedb35b393 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 200 len: 1505 microversion: 2.1 time: 0.147551 May 28 21:56:33.988793 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3418/6795] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:33 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:34.003966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-778ac7a0-66b7-4fea-9f3f-3d0e8b4dd616 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:34.004486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-778ac7a0-66b7-4fea-9f3f-3d0e8b4dd616 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:34.012232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-778ac7a0-66b7-4fea-9f3f-3d0e8b4dd616 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:34.012706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-778ac7a0-66b7-4fea-9f3f-3d0e8b4dd616 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:34.013494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-778ac7a0-66b7-4fea-9f3f-3d0e8b4dd616 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:34.014005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-778ac7a0-66b7-4fea-9f3f-3d0e8b4dd616 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:34.039686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-778ac7a0-66b7-4fea-9f3f-3d0e8b4dd616 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:56:34.321740 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-778ac7a0-66b7-4fea-9f3f-3d0e8b4dd616 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 204 len: 0 microversion: 2.1 time: 0.321363 May 28 21:56:34.322393 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3378/6796] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:56:33 2022] DELETE /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:56:34.330698 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4758603f-5a38-4700-9e47-cc3526ac0754 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:34.331314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4758603f-5a38-4700-9e47-cc3526ac0754 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:34.337568 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4758603f-5a38-4700-9e47-cc3526ac0754 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:34.338070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4758603f-5a38-4700-9e47-cc3526ac0754 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:34.338833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4758603f-5a38-4700-9e47-cc3526ac0754 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:34.339289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4758603f-5a38-4700-9e47-cc3526ac0754 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:34.467338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4758603f-5a38-4700-9e47-cc3526ac0754 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:34.474940 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4758603f-5a38-4700-9e47-cc3526ac0754 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 200 len: 1511 microversion: 2.1 time: 0.148409 May 28 21:56:34.475510 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3419/6797] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:34 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:35.492430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-827a7dcf-d6e0-4c9f-9e5c-eac1d584b473 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:35.493276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-827a7dcf-d6e0-4c9f-9e5c-eac1d584b473 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:35.500314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-827a7dcf-d6e0-4c9f-9e5c-eac1d584b473 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:35.500784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-827a7dcf-d6e0-4c9f-9e5c-eac1d584b473 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:35.501573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-827a7dcf-d6e0-4c9f-9e5c-eac1d584b473 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:35.502067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-827a7dcf-d6e0-4c9f-9e5c-eac1d584b473 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:35.705074 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-827a7dcf-d6e0-4c9f-9e5c-eac1d584b473 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:35.713507 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-827a7dcf-d6e0-4c9f-9e5c-eac1d584b473 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 200 len: 1511 microversion: 2.1 time: 0.225325 May 28 21:56:35.714143 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3379/6798] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:35 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 1511 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:36.148753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-2913eb39-7593-4e68-b5c7-3a53725ace2b req-d25ff9d7-3c17-440c-bede-c69c9e450d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a", "name": "network-vif-deleted", "tag": "75bea697-407c-441c-8853-211175958cd9"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:56:36.164097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2913eb39-7593-4e68-b5c7-3a53725ace2b req-d25ff9d7-3c17-440c-bede-c69c9e450d1f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:36.164569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2913eb39-7593-4e68-b5c7-3a53725ace2b req-d25ff9d7-3c17-440c-bede-c69c9e450d1f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:36.176360 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-2913eb39-7593-4e68-b5c7-3a53725ace2b req-d25ff9d7-3c17-440c-bede-c69c9e450d1f service nova] Creating event network-vif-deleted:75bea697-407c-441c-8853-211175958cd9 for instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a on nch2-master-1 May 28 21:56:36.182070 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-2913eb39-7593-4e68-b5c7-3a53725ace2b req-d25ff9d7-3c17-440c-bede-c69c9e450d1f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037068 May 28 21:56:36.183008 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3420/6799] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:56:36.730827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ac099f2e-e81c-471a-b76c-d0903f8c26d5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:36.731338 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ac099f2e-e81c-471a-b76c-d0903f8c26d5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:36.738582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac099f2e-e81c-471a-b76c-d0903f8c26d5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:36.739056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac099f2e-e81c-471a-b76c-d0903f8c26d5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:36.739840 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac099f2e-e81c-471a-b76c-d0903f8c26d5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:36.740298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac099f2e-e81c-471a-b76c-d0903f8c26d5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:36.774750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac099f2e-e81c-471a-b76c-d0903f8c26d5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:36.775217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac099f2e-e81c-471a-b76c-d0903f8c26d5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:36.775684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-ac099f2e-e81c-471a-b76c-d0903f8c26d5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lazy-loading 'fault' on Instance uuid 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:56:36.815855 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ac099f2e-e81c-471a-b76c-d0903f8c26d5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:36.824111 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ac099f2e-e81c-471a-b76c-d0903f8c26d5 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 200 len: 1306 microversion: 2.1 time: 0.097331 May 28 21:56:36.824674 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3380/6800] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:36 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:37.842696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aaafe7a5-21f0-4c9e-99fb-41780c9ef0d3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:37.843404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aaafe7a5-21f0-4c9e-99fb-41780c9ef0d3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:37.849725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aaafe7a5-21f0-4c9e-99fb-41780c9ef0d3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:37.850279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aaafe7a5-21f0-4c9e-99fb-41780c9ef0d3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:37.851051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aaafe7a5-21f0-4c9e-99fb-41780c9ef0d3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:37.851496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aaafe7a5-21f0-4c9e-99fb-41780c9ef0d3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:37.864668 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-aaafe7a5-21f0-4c9e-99fb-41780c9ef0d3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] HTTP exception thrown: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aaafe7a5-21f0-4c9e-99fb-41780c9ef0d3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Request method failure captured: May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a HTTP/1.1 May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpp3y4AlaYpstq8S9DWKHqcFJpSrvRbHMdwUjB3D-zGJNT7wYA5QtIjFwaBZdx8g3_uLN-I-OeGrliZW-VRGH-WLblwstJ6Ijbe_FayAoN5CjUp84yfMzDhFBE8Dq4t1U_l6j-oedQxGOYpj3WcirkFNxMAnkHQtYg3GobLkH--wxsA May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 22e09bcdc3974f888d75cc14a7cd098a May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_22e09bcdc3974f888d75cc14a7cd098a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 22e09bcdc3974f888d75cc14a7cd098a May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-1324703581-project May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 65d8da19cff64475bd6cb5ce24ae530b May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-1324703581-project May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a'} May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:37.866315 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:37.870989 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:37.870989 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:37.870989 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:37.870989 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:56:37.870989 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:56:37.870989 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. May 28 21:56:37.870989 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:37.870989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aaafe7a5-21f0-4c9e-99fb-41780c9ef0d3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Returning 404 to user: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:56:37.870989 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aaafe7a5-21f0-4c9e-99fb-41780c9ef0d3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 404 len: 111 microversion: 2.1 time: 0.030189 May 28 21:56:37.870989 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3421/6801] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:37 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:56:37.876742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5823ad09-c2ce-4a58-92fa-c92fa63ec416 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:37.878656 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5823ad09-c2ce-4a58-92fa-c92fa63ec416 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:37.884898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5823ad09-c2ce-4a58-92fa-c92fa63ec416 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:37.885368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5823ad09-c2ce-4a58-92fa-c92fa63ec416 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:37.886185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5823ad09-c2ce-4a58-92fa-c92fa63ec416 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:37.886677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5823ad09-c2ce-4a58-92fa-c92fa63ec416 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.014179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5823ad09-c2ce-4a58-92fa-c92fa63ec416 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:38.021722 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5823ad09-c2ce-4a58-92fa-c92fa63ec416 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1505 microversion: 2.1 time: 0.148803 May 28 21:56:38.022956 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3381/6802] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:37 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:56:38.039174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2dd9c9db-a281-40d1-846d-96ec9298adb6 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:56:38.040147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2dd9c9db-a281-40d1-846d-96ec9298adb6 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 54ee9ab5-81f1-4186-a4c5-01fb2951b6a6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:38.045581 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-2dd9c9db-a281-40d1-846d-96ec9298adb6 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] HTTP exception thrown: Instance 54ee9ab5-81f1-4186-a4c5-01fb2951b6a6 could not be found. May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2dd9c9db-a281-40d1-846d-96ec9298adb6 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Request method failure captured: May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/54ee9ab5-81f1-4186-a4c5-01fb2951b6a6/action HTTP/1.1 May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 32 May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpp3y4AlaYpstq8S9DWKHqcFJpSrvRbHMdwUjB3D-zGJNT7wYA5QtIjFwaBZdx8g3_uLN-I-OeGrliZW-VRGH-WLblwstJ6Ijbe_FayAoN5CjUp84yfMzDhFBE8Dq4t1U_l6j-oedQxGOYpj3WcirkFNxMAnkHQtYg3GobLkH--wxsA May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 22e09bcdc3974f888d75cc14a7cd098a May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_22e09bcdc3974f888d75cc14a7cd098a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 22e09bcdc3974f888d75cc14a7cd098a May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-1324703581-project May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 65d8da19cff64475bd6cb5ce24ae530b May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-1324703581-project May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: {"resize": {"flavorRef": "452"}} May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 54ee9ab5-81f1-4186-a4c5-01fb2951b6a6 could not be found. May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '54ee9ab5-81f1-4186-a4c5-01fb2951b6a6', 'body': {'resize': {'flavorRef': '452'}}} May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ee9ab5-81f1-4186-a4c5-01fb2951b6a6 could not be found. May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:56:38.047168 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:56:38.051571 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ee9ab5-81f1-4186-a4c5-01fb2951b6a6 could not be found. May 28 21:56:38.051571 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.051571 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:38.051571 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.051571 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:38.051571 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:38.051571 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:38.051571 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:56:38.051571 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:56:38.051571 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ee9ab5-81f1-4186-a4c5-01fb2951b6a6 could not be found. May 28 21:56:38.051571 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.051571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2dd9c9db-a281-40d1-846d-96ec9298adb6 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Returning 404 to user: Instance 54ee9ab5-81f1-4186-a4c5-01fb2951b6a6 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:56:38.051571 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2dd9c9db-a281-40d1-846d-96ec9298adb6 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "POST /compute/v2.1/servers/54ee9ab5-81f1-4186-a4c5-01fb2951b6a6/action" status: 404 len: 111 microversion: 2.1 time: 0.013378 May 28 21:56:38.051571 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3422/6803] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:56:38 2022] POST /compute/v2.1/servers/54ee9ab5-81f1-4186-a4c5-01fb2951b6a6/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 28 21:56:38.057064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7e40afae-c99c-4e33-9a62-78f63ccdfeab tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:38.057704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7e40afae-c99c-4e33-9a62-78f63ccdfeab tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:38.063806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e40afae-c99c-4e33-9a62-78f63ccdfeab tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.064275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e40afae-c99c-4e33-9a62-78f63ccdfeab tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.065061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e40afae-c99c-4e33-9a62-78f63ccdfeab tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.065544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e40afae-c99c-4e33-9a62-78f63ccdfeab tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.070300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:56:38.197638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7e40afae-c99c-4e33-9a62-78f63ccdfeab tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:38.205505 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7e40afae-c99c-4e33-9a62-78f63ccdfeab tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1505 microversion: 2.1 time: 0.152426 May 28 21:56:38.206122 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3382/6804] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:38 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:38.222735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2902a129-f1ef-433c-ac98-64756944dfd4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:38.223359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2902a129-f1ef-433c-ac98-64756944dfd4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:38.230189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2902a129-f1ef-433c-ac98-64756944dfd4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.230644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2902a129-f1ef-433c-ac98-64756944dfd4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.231405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2902a129-f1ef-433c-ac98-64756944dfd4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.231844 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2902a129-f1ef-433c-ac98-64756944dfd4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.359905 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2902a129-f1ef-433c-ac98-64756944dfd4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:38.368038 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2902a129-f1ef-433c-ac98-64756944dfd4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1505 microversion: 2.1 time: 0.149085 May 28 21:56:38.368591 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3423/6805] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:38 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:38.384999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-585773bf-3df4-4e7c-892d-f8ef4b3f7f43 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "248dddcb-85d0-47a1-9aff-5d95c5786388"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:56:38.386037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-585773bf-3df4-4e7c-892d-f8ef4b3f7f43 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:38.392172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-585773bf-3df4-4e7c-892d-f8ef4b3f7f43 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.392645 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-585773bf-3df4-4e7c-892d-f8ef4b3f7f43 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.393506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-585773bf-3df4-4e7c-892d-f8ef4b3f7f43 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.393926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-585773bf-3df4-4e7c-892d-f8ef4b3f7f43 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.421281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-585773bf-3df4-4e7c-892d-f8ef4b3f7f43 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:38.426482 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-585773bf-3df4-4e7c-892d-f8ef4b3f7f43 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] HTTP exception thrown: Flavor 248dddcb-85d0-47a1-9aff-5d95c5786388 could not be found. May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-585773bf-3df4-4e7c-892d-f8ef4b3f7f43 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Request method failure captured: May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: request: POST /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021/action HTTP/1.1 May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 65 May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpp3y4AlaYpstq8S9DWKHqcFJpSrvRbHMdwUjB3D-zGJNT7wYA5QtIjFwaBZdx8g3_uLN-I-OeGrliZW-VRGH-WLblwstJ6Ijbe_FayAoN5CjUp84yfMzDhFBE8Dq4t1U_l6j-oedQxGOYpj3WcirkFNxMAnkHQtYg3GobLkH--wxsA May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 22e09bcdc3974f888d75cc14a7cd098a May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_22e09bcdc3974f888d75cc14a7cd098a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 22e09bcdc3974f888d75cc14a7cd098a May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-1324703581-project May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 65d8da19cff64475bd6cb5ce24ae530b May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-1324703581-project May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: {"resize": {"flavorRef": "248dddcb-85d0-47a1-9aff-5d95c5786388"}} May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: exception: Flavor 248dddcb-85d0-47a1-9aff-5d95c5786388 could not be found. May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '62d655a5-5768-41f3-9109-122db7b43021', 'body': {'resize': {'flavorRef': '248dddcb-85d0-47a1-9aff-5d95c5786388'}}} May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 28 21:56:38.428946 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 248dddcb-85d0-47a1-9aff-5d95c5786388 could not be found. May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 248dddcb-85d0-47a1-9aff-5d95c5786388 could not be found. May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 248dddcb-85d0-47a1-9aff-5d95c5786388 could not be found. May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-585773bf-3df4-4e7c-892d-f8ef4b3f7f43 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Returning 400 to user: Flavor 248dddcb-85d0-47a1-9aff-5d95c5786388 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-585773bf-3df4-4e7c-892d-f8ef4b3f7f43 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "POST /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021/action" status: 400 len: 107 microversion: 2.1 time: 0.050122 May 28 21:56:38.432895 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3383/6806] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:56:38 2022] POST /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021/action => generated 107 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:56:38.439113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dbb7b1c1-717d-4f29-b83a-78d2c81f8646 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:38.439742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dbb7b1c1-717d-4f29-b83a-78d2c81f8646 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:38.446449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbb7b1c1-717d-4f29-b83a-78d2c81f8646 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.446910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbb7b1c1-717d-4f29-b83a-78d2c81f8646 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.447691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbb7b1c1-717d-4f29-b83a-78d2c81f8646 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.448141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dbb7b1c1-717d-4f29-b83a-78d2c81f8646 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.575189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-dbb7b1c1-717d-4f29-b83a-78d2c81f8646 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:38.582930 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dbb7b1c1-717d-4f29-b83a-78d2c81f8646 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1505 microversion: 2.1 time: 0.147671 May 28 21:56:38.583497 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3424/6807] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:38 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1505 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:56:38.599618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-91069a2e-4f7e-4eb5-b105-768ba93b7d3a tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:38.600762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-91069a2e-4f7e-4eb5-b105-768ba93b7d3a tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:38.606925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91069a2e-4f7e-4eb5-b105-768ba93b7d3a tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.607393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91069a2e-4f7e-4eb5-b105-768ba93b7d3a tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.608157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91069a2e-4f7e-4eb5-b105-768ba93b7d3a tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.608608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-91069a2e-4f7e-4eb5-b105-768ba93b7d3a tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.739523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-91069a2e-4f7e-4eb5-b105-768ba93b7d3a tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:38.748745 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-91069a2e-4f7e-4eb5-b105-768ba93b7d3a tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1505 microversion: 2.1 time: 0.152703 May 28 21:56:38.749447 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3384/6808] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:38 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:38.764972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a34d7339-3aae-42a2-80bc-7287352911d3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a34d7339-3aae-42a2-80bc-7287352911d3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Request method failure captured: May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: request: POST /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021/action HTTP/1.1 May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 29 May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpp3y4AlaYpstq8S9DWKHqcFJpSrvRbHMdwUjB3D-zGJNT7wYA5QtIjFwaBZdx8g3_uLN-I-OeGrliZW-VRGH-WLblwstJ6Ijbe_FayAoN5CjUp84yfMzDhFBE8Dq4t1U_l6j-oedQxGOYpj3WcirkFNxMAnkHQtYg3GobLkH--wxsA May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 22e09bcdc3974f888d75cc14a7cd098a May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_22e09bcdc3974f888d75cc14a7cd098a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 22e09bcdc3974f888d75cc14a7cd098a May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-1324703581-project May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 65d8da19cff64475bd6cb5ce24ae530b May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-1324703581-project May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: {"resize": {"flavorRef": ""}} May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '62d655a5-5768-41f3-9109-122db7b43021', 'body': {'resize': {'flavorRef': ''}}} May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise error May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi On instance['resize']: May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi '' May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.767286 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:38.771237 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.771237 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:38.771237 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:38.771237 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:38.771237 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 28 21:56:38.771237 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 28 21:56:38.771237 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short May 28 21:56:38.771237 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.771237 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a34d7339-3aae-42a2-80bc-7287352911d3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:56:38.771237 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a34d7339-3aae-42a2-80bc-7287352911d3 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "POST /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021/action" status: 400 len: 113 microversion: 2.1 time: 0.007641 May 28 21:56:38.771237 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3425/6809] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:56:38 2022] POST /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 28 21:56:38.776996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4e64207e-e1f8-41e1-b644-93f753f311cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:38.778462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4e64207e-e1f8-41e1-b644-93f753f311cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:38.783877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e64207e-e1f8-41e1-b644-93f753f311cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.784344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e64207e-e1f8-41e1-b644-93f753f311cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.785126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e64207e-e1f8-41e1-b644-93f753f311cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.785584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e64207e-e1f8-41e1-b644-93f753f311cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.916023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4e64207e-e1f8-41e1-b644-93f753f311cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:38.923742 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4e64207e-e1f8-41e1-b644-93f753f311cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1505 microversion: 2.1 time: 0.150543 May 28 21:56:38.924325 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3385/6810] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:38 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:38.944496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1d789747-53c0-4aaa-9faf-11ec7556e2d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:38.945011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1d789747-53c0-4aaa-9faf-11ec7556e2d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:38.954724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d789747-53c0-4aaa-9faf-11ec7556e2d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.955187 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d789747-53c0-4aaa-9faf-11ec7556e2d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.956000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d789747-53c0-4aaa-9faf-11ec7556e2d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.956457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1d789747-53c0-4aaa-9faf-11ec7556e2d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.969991 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-1d789747-53c0-4aaa-9faf-11ec7556e2d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] HTTP exception thrown: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1d789747-53c0-4aaa-9faf-11ec7556e2d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Request method failure captured: May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: request: DELETE /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a HTTP/1.1 May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikpp3y4AlaYpstq8S9DWKHqcFJpSrvRbHMdwUjB3D-zGJNT7wYA5QtIjFwaBZdx8g3_uLN-I-OeGrliZW-VRGH-WLblwstJ6Ijbe_FayAoN5CjUp84yfMzDhFBE8Dq4t1U_l6j-oedQxGOYpj3WcirkFNxMAnkHQtYg3GobLkH--wxsA May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 22e09bcdc3974f888d75cc14a7cd098a May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_22e09bcdc3974f888d75cc14a7cd098a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 22e09bcdc3974f888d75cc14a7cd098a May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-ServersNegativeTestJSON-1324703581-project May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 65d8da19cff64475bd6cb5ce24ae530b May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-ServersNegativeTestJSON-1324703581-project May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a'} May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:56:38.971551 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:56:38.976383 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. May 28 21:56:38.976383 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.976383 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:38.976383 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.976383 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:38.976383 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:38.976383 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:38.976383 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:56:38.976383 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:56:38.976383 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. May 28 21:56:38.976383 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 21:56:38.976383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1d789747-53c0-4aaa-9faf-11ec7556e2d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Returning 404 to user: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:56:38.976383 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1d789747-53c0-4aaa-9faf-11ec7556e2d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 404 len: 111 microversion: 2.1 time: 0.033116 May 28 21:56:38.976383 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3426/6811] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:56:38 2022] DELETE /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:56:38.981829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ae42efa-635b-459e-a649-0ae95165bb42 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:38.982496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8ae42efa-635b-459e-a649-0ae95165bb42 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:38.988588 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ae42efa-635b-459e-a649-0ae95165bb42 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.989046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ae42efa-635b-459e-a649-0ae95165bb42 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:38.989831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ae42efa-635b-459e-a649-0ae95165bb42 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:38.990322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8ae42efa-635b-459e-a649-0ae95165bb42 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:39.003854 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-8ae42efa-635b-459e-a649-0ae95165bb42 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] HTTP exception thrown: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ae42efa-635b-459e-a649-0ae95165bb42 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Request method failure captured: May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a HTTP/1.1 May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpp3y4AlaYpstq8S9DWKHqcFJpSrvRbHMdwUjB3D-zGJNT7wYA5QtIjFwaBZdx8g3_uLN-I-OeGrliZW-VRGH-WLblwstJ6Ijbe_FayAoN5CjUp84yfMzDhFBE8Dq4t1U_l6j-oedQxGOYpj3WcirkFNxMAnkHQtYg3GobLkH--wxsA May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 22e09bcdc3974f888d75cc14a7cd098a May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_22e09bcdc3974f888d75cc14a7cd098a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 22e09bcdc3974f888d75cc14a7cd098a May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-1324703581-project May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 65d8da19cff64475bd6cb5ce24ae530b May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-1324703581-project May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a'} May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:39.005389 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:39.010073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:39.010073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:39.010073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:39.010073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:56:39.010073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:56:39.010073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. May 28 21:56:39.010073 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:39.010073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8ae42efa-635b-459e-a649-0ae95165bb42 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Returning 404 to user: Instance 2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:56:39.010073 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8ae42efa-635b-459e-a649-0ae95165bb42 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a" status: 404 len: 111 microversion: 2.1 time: 0.028839 May 28 21:56:39.010073 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3386/6812] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:38 2022] GET /compute/v2.1/servers/2cf7e2ee-8d89-4aee-a1d4-600aff3a1f0a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:56:39.015096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dc556910-57d3-44bb-ac87-55f4ef73a113 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:39.015611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dc556910-57d3-44bb-ac87-55f4ef73a113 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:39.021804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc556910-57d3-44bb-ac87-55f4ef73a113 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:39.022827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc556910-57d3-44bb-ac87-55f4ef73a113 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:39.023630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc556910-57d3-44bb-ac87-55f4ef73a113 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:39.024108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc556910-57d3-44bb-ac87-55f4ef73a113 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:39.049278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dc556910-57d3-44bb-ac87-55f4ef73a113 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:56:39.186978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:56:39.387912 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dc556910-57d3-44bb-ac87-55f4ef73a113 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "DELETE /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 204 len: 0 microversion: 2.1 time: 0.376278 May 28 21:56:39.388610 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3427/6813] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:56:39 2022] DELETE /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:56:39.396797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4bafe769-faea-40f8-8426-6f545232f0d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:39.398096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4bafe769-faea-40f8-8426-6f545232f0d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:39.404427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bafe769-faea-40f8-8426-6f545232f0d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:39.404895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bafe769-faea-40f8-8426-6f545232f0d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:39.405677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bafe769-faea-40f8-8426-6f545232f0d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:39.406172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bafe769-faea-40f8-8426-6f545232f0d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:39.537689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4bafe769-faea-40f8-8426-6f545232f0d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:39.545340 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4bafe769-faea-40f8-8426-6f545232f0d0 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1511 microversion: 2.1 time: 0.152504 May 28 21:56:39.545925 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3387/6814] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:39 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:40.563034 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-671f7723-9f8c-4726-8686-49f6858618c4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:40.563752 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-671f7723-9f8c-4726-8686-49f6858618c4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:40.571442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-671f7723-9f8c-4726-8686-49f6858618c4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:40.571903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-671f7723-9f8c-4726-8686-49f6858618c4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:40.572676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-671f7723-9f8c-4726-8686-49f6858618c4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:40.573129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-671f7723-9f8c-4726-8686-49f6858618c4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:40.700312 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-671f7723-9f8c-4726-8686-49f6858618c4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:40.708278 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-671f7723-9f8c-4726-8686-49f6858618c4 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1511 microversion: 2.1 time: 0.149548 May 28 21:56:40.708855 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3428/6815] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:40 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:41.218368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-8d0aaad9-20dd-44e7-b75f-6b4a0b9bd6cc req-e3381a1e-0a68-4cce-bcd7-67b8c13b21b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d655a5-5768-41f3-9109-122db7b43021", "name": "network-vif-deleted", "tag": "ba1fb4da-bb7e-4088-a216-d2b49f80bf14"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:56:41.227909 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8d0aaad9-20dd-44e7-b75f-6b4a0b9bd6cc req-e3381a1e-0a68-4cce-bcd7-67b8c13b21b1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:41.228371 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-8d0aaad9-20dd-44e7-b75f-6b4a0b9bd6cc req-e3381a1e-0a68-4cce-bcd7-67b8c13b21b1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:41.239252 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-8d0aaad9-20dd-44e7-b75f-6b4a0b9bd6cc req-e3381a1e-0a68-4cce-bcd7-67b8c13b21b1 service nova] Creating event network-vif-deleted:ba1fb4da-bb7e-4088-a216-d2b49f80bf14 for instance 62d655a5-5768-41f3-9109-122db7b43021 on nch1-master-1 May 28 21:56:41.244600 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-8d0aaad9-20dd-44e7-b75f-6b4a0b9bd6cc req-e3381a1e-0a68-4cce-bcd7-67b8c13b21b1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029925 May 28 21:56:41.245180 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3388/6816] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:56:41.725728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4323f0ea-e975-4e1e-aea9-afbcb9bb39cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:41.726908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4323f0ea-e975-4e1e-aea9-afbcb9bb39cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:41.737680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4323f0ea-e975-4e1e-aea9-afbcb9bb39cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:41.737680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4323f0ea-e975-4e1e-aea9-afbcb9bb39cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:41.737680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4323f0ea-e975-4e1e-aea9-afbcb9bb39cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:41.737680 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4323f0ea-e975-4e1e-aea9-afbcb9bb39cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:41.767219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4323f0ea-e975-4e1e-aea9-afbcb9bb39cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:41.767682 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4323f0ea-e975-4e1e-aea9-afbcb9bb39cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:41.768143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-4323f0ea-e975-4e1e-aea9-afbcb9bb39cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lazy-loading 'fault' on Instance uuid 62d655a5-5768-41f3-9109-122db7b43021 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:56:41.810913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4323f0ea-e975-4e1e-aea9-afbcb9bb39cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65d8da19cff64475bd6cb5ce24ae530b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e09bcdc3974f888d75cc14a7cd098a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:56:41.818684 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4323f0ea-e975-4e1e-aea9-afbcb9bb39cb tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 200 len: 1306 microversion: 2.1 time: 0.096743 May 28 21:56:41.819259 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3429/6817] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:41 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:56:42.837001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-afa0d055-8058-487d-a0c6-f176e7a1c105 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:56:42.837716 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-afa0d055-8058-487d-a0c6-f176e7a1c105 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] [instance: 62d655a5-5768-41f3-9109-122db7b43021] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:56:42.844129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afa0d055-8058-487d-a0c6-f176e7a1c105 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:42.845009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afa0d055-8058-487d-a0c6-f176e7a1c105 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:42.845792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afa0d055-8058-487d-a0c6-f176e7a1c105 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:56:42.846274 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-afa0d055-8058-487d-a0c6-f176e7a1c105 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:56:42.860240 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-afa0d055-8058-487d-a0c6-f176e7a1c105 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] HTTP exception thrown: Instance 62d655a5-5768-41f3-9109-122db7b43021 could not be found. May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-afa0d055-8058-487d-a0c6-f176e7a1c105 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Request method failure captured: May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 HTTP/1.1 May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpp3y4AlaYpstq8S9DWKHqcFJpSrvRbHMdwUjB3D-zGJNT7wYA5QtIjFwaBZdx8g3_uLN-I-OeGrliZW-VRGH-WLblwstJ6Ijbe_FayAoN5CjUp84yfMzDhFBE8Dq4t1U_l6j-oedQxGOYpj3WcirkFNxMAnkHQtYg3GobLkH--wxsA May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 22e09bcdc3974f888d75cc14a7cd098a May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_22e09bcdc3974f888d75cc14a7cd098a", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/22e09bcdc3974f888d75cc14a7cd098a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 22e09bcdc3974f888d75cc14a7cd098a May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1324703581 May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-ServersNegativeTestJSON-1324703581-project May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 65d8da19cff64475bd6cb5ce24ae530b May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-ServersNegativeTestJSON-1324703581-project May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 62d655a5-5768-41f3-9109-122db7b43021 could not be found. May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '62d655a5-5768-41f3-9109-122db7b43021'} May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d655a5-5768-41f3-9109-122db7b43021 could not be found. May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d655a5-5768-41f3-9109-122db7b43021 could not be found. May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:56:42.861867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:42.865976 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:56:42.865976 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:56:42.865976 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:56:42.865976 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:56:42.865976 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:56:42.865976 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d655a5-5768-41f3-9109-122db7b43021 could not be found. May 28 21:56:42.865976 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:56:42.865976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-afa0d055-8058-487d-a0c6-f176e7a1c105 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] Returning 404 to user: Instance 62d655a5-5768-41f3-9109-122db7b43021 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:56:42.865976 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-afa0d055-8058-487d-a0c6-f176e7a1c105 tempest-ServersNegativeTestJSON-1324703581 tempest-ServersNegativeTestJSON-1324703581-project] 10.222.0.33 "GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021" status: 404 len: 111 microversion: 2.1 time: 0.032016 May 28 21:56:42.865976 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3389/6818] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:56:42 2022] GET /compute/v2.1/servers/62d655a5-5768-41f3-9109-122db7b43021 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:57:35.380292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6e12308d-c7a5-46aa-be63-f4a3c6f90ec3 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Action: 'create', calling method: .version_select at 0x7f4d56bd0c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-823842097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMh0g7PPAcH0z3JVVmbc78vOCsiS/2zaKxDffKDkH6DGiyh/Z3LoinvHanmBPAfJWYup3REeKQs2ELD9omy35FFAdl5FDNuv6W7cMSCSQCs2AFMqCukT+ViHltw49Ntz+w=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:57:35.384802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:57:35.385496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=14 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:57:35.401888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-6e12308d-c7a5-46aa-be63-f4a3c6f90ec3 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Getting quotas for project f1c74667a82a49b6b4334c53eabb842f. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:57:35.401888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-6e12308d-c7a5-46aa-be63-f4a3c6f90ec3 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Getting quotas for user b99fe7794c22452484990b7e783f9a43 and project f1c74667a82a49b6b4334c53eabb842f. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:57:35.479741 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6e12308d-c7a5-46aa-be63-f4a3c6f90ec3 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.102954 May 28 21:57:35.480340 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3430/6819] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:57:35 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:57:35.530212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1352125531", "imageRef": "e74f3f7c-880a-44d2-9bc1-67f9a2ece156", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-823842097", "networks": [{"uuid": "f7778ced-8357-43de-9d09-5b8d9e89b49a"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:57:35.537380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:57:35.539070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=33 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:57:35.582996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] validate_networks() for [('f7778ced-8357-43de-9d09-5b8d9e89b49a', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:57:36.047960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:57:36.047960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:57:36.048192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:57:36.048495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:57:36.048926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:57:36.058299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:36.058766 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:36.059640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:36.060137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:36.079734 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Getting quotas for project f1c74667a82a49b6b4334c53eabb842f. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:57:36.085090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Getting quotas for user b99fe7794c22452484990b7e783f9a43 and project f1c74667a82a49b6b4334c53eabb842f. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:57:36.098173 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:57:36.100418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e74f3f7c-880a-44d2-9bc1-67f9a2ece156',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:57:36.253610 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9e5a02b4-5fc1-4b9a-80ad-bf72e80770ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728276 May 28 21:57:36.254325 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3390/6820] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:57:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:57:36.265618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7d98be46-f8bc-467e-8b70-455ae255b4ad tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:36.266575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7d98be46-f8bc-467e-8b70-455ae255b4ad tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:36.325230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7d98be46-f8bc-467e-8b70-455ae255b4ad tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:36.333254 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7d98be46-f8bc-467e-8b70-455ae255b4ad tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1258 microversion: 2.1 time: 0.072919 May 28 21:57:36.333879 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3431/6821] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:36 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:37.350722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-118ff31f-66fe-4b38-9c9b-3ffb4e9d1779 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:37.351282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-118ff31f-66fe-4b38-9c9b-3ffb4e9d1779 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:37.404688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-118ff31f-66fe-4b38-9c9b-3ffb4e9d1779 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:37.411515 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-118ff31f-66fe-4b38-9c9b-3ffb4e9d1779 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1258 microversion: 2.1 time: 0.066000 May 28 21:57:37.412078 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3391/6822] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:37 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:38.432723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a38a564c-1f26-4152-9dcc-d1b95b255001 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:38.433267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a38a564c-1f26-4152-9dcc-d1b95b255001 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:38.441300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a38a564c-1f26-4152-9dcc-d1b95b255001 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:38.441763 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a38a564c-1f26-4152-9dcc-d1b95b255001 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:38.442574 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a38a564c-1f26-4152-9dcc-d1b95b255001 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:38.443021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a38a564c-1f26-4152-9dcc-d1b95b255001 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:38.507157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a38a564c-1f26-4152-9dcc-d1b95b255001 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:38.515356 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a38a564c-1f26-4152-9dcc-d1b95b255001 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1310 microversion: 2.1 time: 0.086699 May 28 21:57:38.515996 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3432/6823] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:38 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:39.532720 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dfffb155-6892-4e1c-b968-29378b003317 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:39.533272 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dfffb155-6892-4e1c-b968-29378b003317 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:39.548375 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfffb155-6892-4e1c-b968-29378b003317 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:39.549365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfffb155-6892-4e1c-b968-29378b003317 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:39.550683 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfffb155-6892-4e1c-b968-29378b003317 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:39.551483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dfffb155-6892-4e1c-b968-29378b003317 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:39.776856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dfffb155-6892-4e1c-b968-29378b003317 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:39.784968 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dfffb155-6892-4e1c-b968-29378b003317 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1358 microversion: 2.1 time: 0.256207 May 28 21:57:39.794982 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3392/6824] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:39 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1358 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:40.804629 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-79457b81-489e-4940-9da6-bff76213dccc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:40.805489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-79457b81-489e-4940-9da6-bff76213dccc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:40.813503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79457b81-489e-4940-9da6-bff76213dccc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:40.814235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79457b81-489e-4940-9da6-bff76213dccc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:40.815114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79457b81-489e-4940-9da6-bff76213dccc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:40.815566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-79457b81-489e-4940-9da6-bff76213dccc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:40.971962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-79457b81-489e-4940-9da6-bff76213dccc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:40.978306 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-79457b81-489e-4940-9da6-bff76213dccc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1358 microversion: 2.1 time: 0.177917 May 28 21:57:40.978974 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3433/6825] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:40 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:41.996941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a06427df-94bf-494d-9755-6623ce87aec9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:41.997580 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a06427df-94bf-494d-9755-6623ce87aec9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:42.004709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a06427df-94bf-494d-9755-6623ce87aec9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:42.005166 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a06427df-94bf-494d-9755-6623ce87aec9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:42.005993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a06427df-94bf-494d-9755-6623ce87aec9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:42.006458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a06427df-94bf-494d-9755-6623ce87aec9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:42.152611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a06427df-94bf-494d-9755-6623ce87aec9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:42.160378 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a06427df-94bf-494d-9755-6623ce87aec9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1358 microversion: 2.1 time: 0.167912 May 28 21:57:42.160963 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3393/6826] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:41 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:43.179252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ca28fe87-11d3-4342-a32a-9e6900517575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:43.179929 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ca28fe87-11d3-4342-a32a-9e6900517575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:43.200077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca28fe87-11d3-4342-a32a-9e6900517575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:43.200569 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca28fe87-11d3-4342-a32a-9e6900517575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:43.201404 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca28fe87-11d3-4342-a32a-9e6900517575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:43.201881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ca28fe87-11d3-4342-a32a-9e6900517575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:43.376572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ca28fe87-11d3-4342-a32a-9e6900517575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:43.384716 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ca28fe87-11d3-4342-a32a-9e6900517575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1358 microversion: 2.1 time: 0.209464 May 28 21:57:43.385356 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3434/6827] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:43 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:44.404080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-71e289a0-61ff-42ca-9d9c-fae3c6192f8e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:44.405345 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-71e289a0-61ff-42ca-9d9c-fae3c6192f8e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:44.412663 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71e289a0-61ff-42ca-9d9c-fae3c6192f8e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:44.413132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71e289a0-61ff-42ca-9d9c-fae3c6192f8e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:44.413977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71e289a0-61ff-42ca-9d9c-fae3c6192f8e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:44.414440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-71e289a0-61ff-42ca-9d9c-fae3c6192f8e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:44.563592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-71e289a0-61ff-42ca-9d9c-fae3c6192f8e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:44.571857 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-71e289a0-61ff-42ca-9d9c-fae3c6192f8e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1358 microversion: 2.1 time: 0.172177 May 28 21:57:44.583101 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3394/6828] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:44 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:45.589877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-713e463a-c2f9-4452-bba1-498adda1358d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:45.591177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-713e463a-c2f9-4452-bba1-498adda1358d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:45.599919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-713e463a-c2f9-4452-bba1-498adda1358d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:45.600384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-713e463a-c2f9-4452-bba1-498adda1358d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:45.601182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-713e463a-c2f9-4452-bba1-498adda1358d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:45.601670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-713e463a-c2f9-4452-bba1-498adda1358d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:45.743939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-713e463a-c2f9-4452-bba1-498adda1358d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:45.753852 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-713e463a-c2f9-4452-bba1-498adda1358d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1358 microversion: 2.1 time: 0.167840 May 28 21:57:45.756252 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3435/6829] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:45 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:46.771436 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-718db2d4-0f6f-4499-a33e-606780dc0908 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:46.772079 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-718db2d4-0f6f-4499-a33e-606780dc0908 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:46.774859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:57:46.779971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-718db2d4-0f6f-4499-a33e-606780dc0908 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:46.784647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-718db2d4-0f6f-4499-a33e-606780dc0908 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:46.784647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-718db2d4-0f6f-4499-a33e-606780dc0908 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:46.784647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-718db2d4-0f6f-4499-a33e-606780dc0908 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:46.920237 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-718db2d4-0f6f-4499-a33e-606780dc0908 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:46.927817 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-718db2d4-0f6f-4499-a33e-606780dc0908 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1358 microversion: 2.1 time: 0.160873 May 28 21:57:46.928385 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3395/6830] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:46 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:47.554885 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-377c2feb-5946-4b31-ae16-a6e5270c160c req-acc6fe2e-62cb-4641-9efe-b62a5876afc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4", "tag": "39e0046a-80f3-45fe-acec-3087b1a3cceb"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:57:47.558689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:57:47.565941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-377c2feb-5946-4b31-ae16-a6e5270c160c req-acc6fe2e-62cb-4641-9efe-b62a5876afc4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:47.566566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-377c2feb-5946-4b31-ae16-a6e5270c160c req-acc6fe2e-62cb-4641-9efe-b62a5876afc4 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:47.579788 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-377c2feb-5946-4b31-ae16-a6e5270c160c req-acc6fe2e-62cb-4641-9efe-b62a5876afc4 service nova] Creating event network-changed:39e0046a-80f3-45fe-acec-3087b1a3cceb for instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 on nch1-master-1 May 28 21:57:47.585332 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-377c2feb-5946-4b31-ae16-a6e5270c160c req-acc6fe2e-62cb-4641-9efe-b62a5876afc4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034504 May 28 21:57:47.586341 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3436/6831] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:57:47.944603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7e591d7a-9b18-4604-922d-5aa97331d893 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:47.945374 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7e591d7a-9b18-4604-922d-5aa97331d893 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:47.947362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:57:47.954168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e591d7a-9b18-4604-922d-5aa97331d893 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:47.954168 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e591d7a-9b18-4604-922d-5aa97331d893 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:47.954914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e591d7a-9b18-4604-922d-5aa97331d893 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:47.955363 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e591d7a-9b18-4604-922d-5aa97331d893 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:48.094365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7e591d7a-9b18-4604-922d-5aa97331d893 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:48.102712 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7e591d7a-9b18-4604-922d-5aa97331d893 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1358 microversion: 2.1 time: 0.161953 May 28 21:57:48.103295 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3396/6832] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:47 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:49.122558 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7f6a24be-4088-4b2a-855e-0be04253f28d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:49.123265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7f6a24be-4088-4b2a-855e-0be04253f28d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:49.130166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f6a24be-4088-4b2a-855e-0be04253f28d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:49.130622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f6a24be-4088-4b2a-855e-0be04253f28d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:49.131386 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f6a24be-4088-4b2a-855e-0be04253f28d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:49.131829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7f6a24be-4088-4b2a-855e-0be04253f28d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:49.258445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7f6a24be-4088-4b2a-855e-0be04253f28d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:49.266560 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7f6a24be-4088-4b2a-855e-0be04253f28d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1358 microversion: 2.1 time: 0.149697 May 28 21:57:49.267129 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3437/6833] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:49 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:50.282751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-74be8f4a-9f58-46a8-b480-7c14bba5a3bd tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:50.291773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-74be8f4a-9f58-46a8-b480-7c14bba5a3bd tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:50.291773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-74be8f4a-9f58-46a8-b480-7c14bba5a3bd tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:50.291773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-74be8f4a-9f58-46a8-b480-7c14bba5a3bd tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:50.291773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-74be8f4a-9f58-46a8-b480-7c14bba5a3bd tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:50.292146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-74be8f4a-9f58-46a8-b480-7c14bba5a3bd tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:50.420992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-74be8f4a-9f58-46a8-b480-7c14bba5a3bd tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:50.428488 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-74be8f4a-9f58-46a8-b480-7c14bba5a3bd tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1358 microversion: 2.1 time: 0.149634 May 28 21:57:50.429072 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3397/6834] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:50 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:51.444608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f7a1d9b0-9e2f-4c82-a886-4aa3706675a5 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:51.445161 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f7a1d9b0-9e2f-4c82-a886-4aa3706675a5 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:51.453073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7a1d9b0-9e2f-4c82-a886-4aa3706675a5 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:51.453527 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7a1d9b0-9e2f-4c82-a886-4aa3706675a5 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:51.454323 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7a1d9b0-9e2f-4c82-a886-4aa3706675a5 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:51.454911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7a1d9b0-9e2f-4c82-a886-4aa3706675a5 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:51.581476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f7a1d9b0-9e2f-4c82-a886-4aa3706675a5 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:51.589064 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f7a1d9b0-9e2f-4c82-a886-4aa3706675a5 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1358 microversion: 2.1 time: 0.148429 May 28 21:57:51.589641 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3438/6835] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:51 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:52.605412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aca6cb15-f9c5-47e0-85a2-61e62c22b01a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:52.606199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aca6cb15-f9c5-47e0-85a2-61e62c22b01a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:52.613099 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aca6cb15-f9c5-47e0-85a2-61e62c22b01a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:52.613565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aca6cb15-f9c5-47e0-85a2-61e62c22b01a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:52.614373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aca6cb15-f9c5-47e0-85a2-61e62c22b01a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:52.614859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aca6cb15-f9c5-47e0-85a2-61e62c22b01a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:52.748339 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aca6cb15-f9c5-47e0-85a2-61e62c22b01a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:52.755902 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aca6cb15-f9c5-47e0-85a2-61e62c22b01a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1358 microversion: 2.1 time: 0.154907 May 28 21:57:52.756472 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3398/6836] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:52 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:53.683564 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 21:57:53.684149 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 21:57:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 21:57:53.772588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7bc90a82-e53a-43db-88d7-09892786e6b9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:53.773210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7bc90a82-e53a-43db-88d7-09892786e6b9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:53.780023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bc90a82-e53a-43db-88d7-09892786e6b9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:53.780433 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bc90a82-e53a-43db-88d7-09892786e6b9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:53.781203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bc90a82-e53a-43db-88d7-09892786e6b9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:53.781654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7bc90a82-e53a-43db-88d7-09892786e6b9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:53.908722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7bc90a82-e53a-43db-88d7-09892786e6b9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:53.916910 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7bc90a82-e53a-43db-88d7-09892786e6b9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1358 microversion: 2.1 time: 0.147759 May 28 21:57:53.917490 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3439/6837] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:53 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:54.348512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-28f9fb60-645e-4605-bd8c-fbd5fc10a15a req-981d712a-c6cc-4dc2-bcde-114759e6bd46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4", "name": "network-vif-plugged", "status": "completed", "tag": "39e0046a-80f3-45fe-acec-3087b1a3cceb"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:57:54.357934 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-28f9fb60-645e-4605-bd8c-fbd5fc10a15a req-981d712a-c6cc-4dc2-bcde-114759e6bd46 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:54.358398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-28f9fb60-645e-4605-bd8c-fbd5fc10a15a req-981d712a-c6cc-4dc2-bcde-114759e6bd46 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:54.370111 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-28f9fb60-645e-4605-bd8c-fbd5fc10a15a req-981d712a-c6cc-4dc2-bcde-114759e6bd46 service nova] Creating event network-vif-plugged:39e0046a-80f3-45fe-acec-3087b1a3cceb for instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 on nch1-master-1 May 28 21:57:54.375273 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-28f9fb60-645e-4605-bd8c-fbd5fc10a15a req-981d712a-c6cc-4dc2-bcde-114759e6bd46 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030586 May 28 21:57:54.380669 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3399/6838] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:57:54.940092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-63f8a7b3-d212-4779-a5df-a7f640665e59 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:54.940722 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-63f8a7b3-d212-4779-a5df-a7f640665e59 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:54.947835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63f8a7b3-d212-4779-a5df-a7f640665e59 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:54.948302 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63f8a7b3-d212-4779-a5df-a7f640665e59 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:54.949081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63f8a7b3-d212-4779-a5df-a7f640665e59 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:54.949531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-63f8a7b3-d212-4779-a5df-a7f640665e59 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:55.082007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-63f8a7b3-d212-4779-a5df-a7f640665e59 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:55.090091 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-63f8a7b3-d212-4779-a5df-a7f640665e59 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1358 microversion: 2.1 time: 0.153869 May 28 21:57:55.090677 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3440/6839] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:54 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:56.108284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-72d5826e-a4d8-4c95-bbe3-633155176155 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:56.108988 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-72d5826e-a4d8-4c95-bbe3-633155176155 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:56.115330 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72d5826e-a4d8-4c95-bbe3-633155176155 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:56.115794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72d5826e-a4d8-4c95-bbe3-633155176155 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:56.116563 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72d5826e-a4d8-4c95-bbe3-633155176155 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:56.117015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-72d5826e-a4d8-4c95-bbe3-633155176155 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:56.246486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-72d5826e-a4d8-4c95-bbe3-633155176155 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:56.254244 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-72d5826e-a4d8-4c95-bbe3-633155176155 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1547 microversion: 2.1 time: 0.150974 May 28 21:57:56.256700 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3400/6840] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:56 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:57:56.270620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5a615a19-7960-4d4b-bac3-1d6d6b3fc575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:56.271251 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5a615a19-7960-4d4b-bac3-1d6d6b3fc575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:56.277619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a615a19-7960-4d4b-bac3-1d6d6b3fc575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:56.278112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a615a19-7960-4d4b-bac3-1d6d6b3fc575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:56.279668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a615a19-7960-4d4b-bac3-1d6d6b3fc575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:56.279668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a615a19-7960-4d4b-bac3-1d6d6b3fc575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:56.404176 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5a615a19-7960-4d4b-bac3-1d6d6b3fc575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:56.411735 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5a615a19-7960-4d4b-bac3-1d6d6b3fc575 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1547 microversion: 2.1 time: 0.145335 May 28 21:57:56.412314 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3441/6841] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:56 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1547 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:56.427905 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-586567d8-b3ea-4383-b0a3-1b8c341565d6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:56.431261 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-586567d8-b3ea-4383-b0a3-1b8c341565d6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:56.432731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-586567d8-b3ea-4383-b0a3-1b8c341565d6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Searching by: {'deleted': False, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f'} {{(pid=143128) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 28 21:57:56.438186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-586567d8-b3ea-4383-b0a3-1b8c341565d6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:56.438660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-586567d8-b3ea-4383-b0a3-1b8c341565d6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:56.439480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-586567d8-b3ea-4383-b0a3-1b8c341565d6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:56.439941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-586567d8-b3ea-4383-b0a3-1b8c341565d6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:56.466599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.multi_cell_list [None req-586567d8-b3ea-4383-b0a3-1b8c341565d6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=143128) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 28 21:57:56.493238 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-586567d8-b3ea-4383-b0a3-1b8c341565d6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069171 May 28 21:57:56.493826 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3401/6842] 10.222.0.33 () {58 vars in 1124 bytes} [Sat May 28 21:57:56 2022] GET /compute/v2.1/servers => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:57:56.504085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7334a1e0-7593-4dec-931b-1ca11b5806cb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:57:56.505011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7334a1e0-7593-4dec-931b-1ca11b5806cb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:56.510883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7334a1e0-7593-4dec-931b-1ca11b5806cb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:56.511338 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7334a1e0-7593-4dec-931b-1ca11b5806cb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:56.512149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7334a1e0-7593-4dec-931b-1ca11b5806cb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:56.512591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7334a1e0-7593-4dec-931b-1ca11b5806cb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:56.644828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7334a1e0-7593-4dec-931b-1ca11b5806cb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:57:56.652412 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7334a1e0-7593-4dec-931b-1ca11b5806cb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1547 microversion: 2.1 time: 0.152222 May 28 21:57:56.652974 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3442/6843] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:57:56 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:57:58.515201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-70042a5b-bc25-455c-9d36-458da81b73ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef9bd7bc-d94a-4522-b99c-668994610269"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:57:58.516287 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-70042a5b-bc25-455c-9d36-458da81b73ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:57:58.523386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70042a5b-bc25-455c-9d36-458da81b73ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:58.523896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70042a5b-bc25-455c-9d36-458da81b73ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:58.524679 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70042a5b-bc25-455c-9d36-458da81b73ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:57:58.525138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-70042a5b-bc25-455c-9d36-458da81b73ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:57:59.278328 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-70042a5b-bc25-455c-9d36-458da81b73ac tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "POST /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.766864 May 28 21:57:59.278965 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3402/6844] 10.222.0.33 () {60 vars in 1322 bytes} [Sat May 28 21:57:58 2022] POST /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/os-volume_attachments => generated 194 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:58:02.604580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ac1a3d70-029f-4518-b063-483207b3cde9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:02.605201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ac1a3d70-029f-4518-b063-483207b3cde9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:02.612229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac1a3d70-029f-4518-b063-483207b3cde9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:02.612686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac1a3d70-029f-4518-b063-483207b3cde9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:02.613453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac1a3d70-029f-4518-b063-483207b3cde9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:02.613919 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ac1a3d70-029f-4518-b063-483207b3cde9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:02.742165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ac1a3d70-029f-4518-b063-483207b3cde9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:02.750696 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ac1a3d70-029f-4518-b063-483207b3cde9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1593 microversion: 2.1 time: 0.149942 May 28 21:58:02.751281 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3443/6845] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:02 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1593 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:58:04.944218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-b3e2feb9-c20d-4774-b2bb-44e8f0aaa608 req-381675d9-c41d-465e-a631-643f12ab6948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4", "tag": "39e0046a-80f3-45fe-acec-3087b1a3cceb"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:58:04.945582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b3e2feb9-c20d-4774-b2bb-44e8f0aaa608 req-381675d9-c41d-465e-a631-643f12ab6948 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:04.946089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b3e2feb9-c20d-4774-b2bb-44e8f0aaa608 req-381675d9-c41d-465e-a631-643f12ab6948 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:04.959413 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-b3e2feb9-c20d-4774-b2bb-44e8f0aaa608 req-381675d9-c41d-465e-a631-643f12ab6948 service nova] Creating event network-changed:39e0046a-80f3-45fe-acec-3087b1a3cceb for instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 on nch1-master-1 May 28 21:58:04.964388 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-b3e2feb9-c20d-4774-b2bb-44e8f0aaa608 req-381675d9-c41d-465e-a631-643f12ab6948 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032466 May 28 21:58:04.965004 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3403/6846] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:58:07.347360 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bfbb3abe-a959-4b48-b56f-0a6b1760c554 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-53717858"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:58:07.347928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bfbb3abe-a959-4b48-b56f-0a6b1760c554 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:07.350734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:58:07.356139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bfbb3abe-a959-4b48-b56f-0a6b1760c554 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:07.356610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bfbb3abe-a959-4b48-b56f-0a6b1760c554 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:07.357430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bfbb3abe-a959-4b48-b56f-0a6b1760c554 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:07.357894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bfbb3abe-a959-4b48-b56f-0a6b1760c554 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:07.360253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=69 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:58:07.484640 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.network.security_group_api [None req-bfbb3abe-a959-4b48-b56f-0a6b1760c554 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Adding security group 511164db-93c9-4324-901f-d10bce0dc56f to port 39e0046a-80f3-45fe-acec-3087b1a3cceb May 28 21:58:07.955877 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bfbb3abe-a959-4b48-b56f-0a6b1760c554 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "POST /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/action" status: 202 len: 0 microversion: 2.1 time: 0.608039 May 28 21:58:07.955877 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3444/6847] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:58:07 2022] POST /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:58:07.958293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:58:07.963556 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-5ad5e49f-c216-4f64-adad-bf11ffd9722c req-ebdffcdf-3a51-411a-b58e-2d72630bd840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4", "tag": "39e0046a-80f3-45fe-acec-3087b1a3cceb"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:58:07.964600 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a4467b21-a8c0-4e8b-8069-7cef3e112820 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:07.965236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a4467b21-a8c0-4e8b-8069-7cef3e112820 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:07.974654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4467b21-a8c0-4e8b-8069-7cef3e112820 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:07.974965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4467b21-a8c0-4e8b-8069-7cef3e112820 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:07.976762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4467b21-a8c0-4e8b-8069-7cef3e112820 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:07.978057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a4467b21-a8c0-4e8b-8069-7cef3e112820 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:07.980288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:58:07.992416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5ad5e49f-c216-4f64-adad-bf11ffd9722c req-ebdffcdf-3a51-411a-b58e-2d72630bd840 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:07.992416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5ad5e49f-c216-4f64-adad-bf11ffd9722c req-ebdffcdf-3a51-411a-b58e-2d72630bd840 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:07.995966 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:58:08.004791 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-5ad5e49f-c216-4f64-adad-bf11ffd9722c req-ebdffcdf-3a51-411a-b58e-2d72630bd840 service nova] Creating event network-changed:39e0046a-80f3-45fe-acec-3087b1a3cceb for instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 on nch1-master-1 May 28 21:58:08.011269 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-5ad5e49f-c216-4f64-adad-bf11ffd9722c req-ebdffcdf-3a51-411a-b58e-2d72630bd840 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054600 May 28 21:58:08.020153 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3404/6848] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:58:08.185009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a4467b21-a8c0-4e8b-8069-7cef3e112820 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:08.194366 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a4467b21-a8c0-4e8b-8069-7cef3e112820 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1757 microversion: 2.1 time: 0.235107 May 28 21:58:08.195595 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3445/6849] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:07 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1757 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:58:30.852392 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e0647f51-a889-4d30-98eb-b93d45fe0498 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:58:30.853427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e0647f51-a889-4d30-98eb-b93d45fe0498 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:30.861125 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0647f51-a889-4d30-98eb-b93d45fe0498 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:30.861590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0647f51-a889-4d30-98eb-b93d45fe0498 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:30.862406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0647f51-a889-4d30-98eb-b93d45fe0498 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:30.862857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e0647f51-a889-4d30-98eb-b93d45fe0498 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:31.043315 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e0647f51-a889-4d30-98eb-b93d45fe0498 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "POST /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/action" status: 202 len: 0 microversion: 2.1 time: 0.196500 May 28 21:58:31.043950 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3405/6850] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:58:30 2022] POST /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:58:31.052413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3df634b4-7707-47a1-90d4-cfb7a0e536e8 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:31.053042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3df634b4-7707-47a1-90d4-cfb7a0e536e8 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:31.055255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:58:31.055939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=9 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:58:31.060999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3df634b4-7707-47a1-90d4-cfb7a0e536e8 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:31.062035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3df634b4-7707-47a1-90d4-cfb7a0e536e8 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:31.062944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3df634b4-7707-47a1-90d4-cfb7a0e536e8 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:31.063393 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3df634b4-7707-47a1-90d4-cfb7a0e536e8 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:31.212541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3df634b4-7707-47a1-90d4-cfb7a0e536e8 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:31.221708 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3df634b4-7707-47a1-90d4-cfb7a0e536e8 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1749 microversion: 2.1 time: 0.173347 May 28 21:58:31.222374 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3446/6851] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:31 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1749 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:58:32.240512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-39b06e10-3674-4ea4-be7e-479a43c4cf9e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:32.241229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-39b06e10-3674-4ea4-be7e-479a43c4cf9e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:32.247527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39b06e10-3674-4ea4-be7e-479a43c4cf9e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:32.247989 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39b06e10-3674-4ea4-be7e-479a43c4cf9e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:32.248756 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39b06e10-3674-4ea4-be7e-479a43c4cf9e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:32.249204 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-39b06e10-3674-4ea4-be7e-479a43c4cf9e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:32.391309 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-39b06e10-3674-4ea4-be7e-479a43c4cf9e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:32.399438 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-39b06e10-3674-4ea4-be7e-479a43c4cf9e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1754 microversion: 2.1 time: 0.164015 May 28 21:58:32.400040 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3406/6852] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:32 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:58:33.416809 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c0a7d23b-6fb7-4563-a939-085c4b16904d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:33.417356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c0a7d23b-6fb7-4563-a939-085c4b16904d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:33.424989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0a7d23b-6fb7-4563-a939-085c4b16904d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:33.425450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0a7d23b-6fb7-4563-a939-085c4b16904d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:33.426262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0a7d23b-6fb7-4563-a939-085c4b16904d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:33.426711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c0a7d23b-6fb7-4563-a939-085c4b16904d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:33.569542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c0a7d23b-6fb7-4563-a939-085c4b16904d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:33.578776 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c0a7d23b-6fb7-4563-a939-085c4b16904d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1754 microversion: 2.1 time: 0.165935 May 28 21:58:33.579381 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3447/6853] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:33 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:58:34.595850 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-837fe6dc-5ffe-45cd-8950-1a2fe785f7ca tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:34.596483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-837fe6dc-5ffe-45cd-8950-1a2fe785f7ca tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:34.603529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-837fe6dc-5ffe-45cd-8950-1a2fe785f7ca tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:34.603988 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-837fe6dc-5ffe-45cd-8950-1a2fe785f7ca tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:34.604763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-837fe6dc-5ffe-45cd-8950-1a2fe785f7ca tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:34.605215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-837fe6dc-5ffe-45cd-8950-1a2fe785f7ca tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:34.748929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-837fe6dc-5ffe-45cd-8950-1a2fe785f7ca tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:34.757217 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-837fe6dc-5ffe-45cd-8950-1a2fe785f7ca tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1754 microversion: 2.1 time: 0.165911 May 28 21:58:34.757801 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3407/6854] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:34 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:58:35.774772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-edae0e8d-0dd9-42f9-aac2-1cef386d1237 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:35.775396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-edae0e8d-0dd9-42f9-aac2-1cef386d1237 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:35.782486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edae0e8d-0dd9-42f9-aac2-1cef386d1237 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:35.782942 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edae0e8d-0dd9-42f9-aac2-1cef386d1237 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:35.783706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edae0e8d-0dd9-42f9-aac2-1cef386d1237 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:35.784146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-edae0e8d-0dd9-42f9-aac2-1cef386d1237 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:35.928072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-edae0e8d-0dd9-42f9-aac2-1cef386d1237 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:35.936226 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-edae0e8d-0dd9-42f9-aac2-1cef386d1237 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1754 microversion: 2.1 time: 0.165691 May 28 21:58:35.937397 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3448/6855] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:35 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:58:36.954836 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aca5354b-74a0-48fb-8d6b-3343560b3d07 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:36.955474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aca5354b-74a0-48fb-8d6b-3343560b3d07 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:36.962611 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aca5354b-74a0-48fb-8d6b-3343560b3d07 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:36.967310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aca5354b-74a0-48fb-8d6b-3343560b3d07 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:36.967310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aca5354b-74a0-48fb-8d6b-3343560b3d07 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:36.967310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aca5354b-74a0-48fb-8d6b-3343560b3d07 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:37.105021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aca5354b-74a0-48fb-8d6b-3343560b3d07 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:37.113390 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aca5354b-74a0-48fb-8d6b-3343560b3d07 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1754 microversion: 2.1 time: 0.163317 May 28 21:58:37.113997 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3408/6856] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:36 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:58:38.131380 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e769b00e-2801-40d7-9b42-ff89f47c8037 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:38.132003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e769b00e-2801-40d7-9b42-ff89f47c8037 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:38.138972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e769b00e-2801-40d7-9b42-ff89f47c8037 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:38.139435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e769b00e-2801-40d7-9b42-ff89f47c8037 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:38.140200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e769b00e-2801-40d7-9b42-ff89f47c8037 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:38.140640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e769b00e-2801-40d7-9b42-ff89f47c8037 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:38.287230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e769b00e-2801-40d7-9b42-ff89f47c8037 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:38.295401 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e769b00e-2801-40d7-9b42-ff89f47c8037 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1754 microversion: 2.1 time: 0.168149 May 28 21:58:38.295985 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3449/6857] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:38 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:58:39.312910 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-19bc4864-f09e-4faa-8377-ecac5ebbb5e1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:39.313804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-19bc4864-f09e-4faa-8377-ecac5ebbb5e1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:39.320555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19bc4864-f09e-4faa-8377-ecac5ebbb5e1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:39.321031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19bc4864-f09e-4faa-8377-ecac5ebbb5e1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:39.321810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19bc4864-f09e-4faa-8377-ecac5ebbb5e1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:39.322290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-19bc4864-f09e-4faa-8377-ecac5ebbb5e1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:39.461762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-19bc4864-f09e-4faa-8377-ecac5ebbb5e1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:39.470640 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-19bc4864-f09e-4faa-8377-ecac5ebbb5e1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1754 microversion: 2.1 time: 0.161645 May 28 21:58:39.471213 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3409/6858] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:39 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:58:40.488183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a67a0834-e98a-480f-b4af-e62a5cffd65a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:40.488723 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a67a0834-e98a-480f-b4af-e62a5cffd65a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:40.495645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a67a0834-e98a-480f-b4af-e62a5cffd65a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:40.496105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a67a0834-e98a-480f-b4af-e62a5cffd65a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:40.496872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a67a0834-e98a-480f-b4af-e62a5cffd65a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:40.497317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a67a0834-e98a-480f-b4af-e62a5cffd65a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:40.636982 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a67a0834-e98a-480f-b4af-e62a5cffd65a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:40.645065 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a67a0834-e98a-480f-b4af-e62a5cffd65a tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1754 microversion: 2.1 time: 0.161351 May 28 21:58:40.645641 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3450/6859] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:40 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:58:41.661788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-77b2330f-0442-4f5f-a6f9-6eb50aaaaecc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:41.662454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-77b2330f-0442-4f5f-a6f9-6eb50aaaaecc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:41.669919 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77b2330f-0442-4f5f-a6f9-6eb50aaaaecc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:41.670385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77b2330f-0442-4f5f-a6f9-6eb50aaaaecc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:41.671157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77b2330f-0442-4f5f-a6f9-6eb50aaaaecc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:41.671616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-77b2330f-0442-4f5f-a6f9-6eb50aaaaecc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:41.818387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-77b2330f-0442-4f5f-a6f9-6eb50aaaaecc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:41.827102 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-77b2330f-0442-4f5f-a6f9-6eb50aaaaecc tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1754 microversion: 2.1 time: 0.169217 May 28 21:58:41.827680 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3410/6860] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:41 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:58:42.844256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0769366d-2b2b-40fe-94ec-615f47ce1a73 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:42.844821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0769366d-2b2b-40fe-94ec-615f47ce1a73 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:42.852216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0769366d-2b2b-40fe-94ec-615f47ce1a73 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:42.852678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0769366d-2b2b-40fe-94ec-615f47ce1a73 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:42.853450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0769366d-2b2b-40fe-94ec-615f47ce1a73 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:42.853932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0769366d-2b2b-40fe-94ec-615f47ce1a73 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:42.995855 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0769366d-2b2b-40fe-94ec-615f47ce1a73 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:43.004454 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0769366d-2b2b-40fe-94ec-615f47ce1a73 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1754 microversion: 2.1 time: 0.164143 May 28 21:58:43.005036 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3451/6861] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:42 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:58:44.021421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-258cbe3b-2201-40aa-a3fd-13cd4eb31844 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:44.021992 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-258cbe3b-2201-40aa-a3fd-13cd4eb31844 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:44.028953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-258cbe3b-2201-40aa-a3fd-13cd4eb31844 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:44.029422 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-258cbe3b-2201-40aa-a3fd-13cd4eb31844 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:44.030230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-258cbe3b-2201-40aa-a3fd-13cd4eb31844 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:44.030715 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-258cbe3b-2201-40aa-a3fd-13cd4eb31844 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:44.183476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-258cbe3b-2201-40aa-a3fd-13cd4eb31844 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:44.192384 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-258cbe3b-2201-40aa-a3fd-13cd4eb31844 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1754 microversion: 2.1 time: 0.174922 May 28 21:58:44.192967 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3411/6862] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:44 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:58:45.209602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1720d029-85ec-4c81-9b21-b5b8b687593e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:45.210255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1720d029-85ec-4c81-9b21-b5b8b687593e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:45.217339 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1720d029-85ec-4c81-9b21-b5b8b687593e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:45.217802 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1720d029-85ec-4c81-9b21-b5b8b687593e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:45.218616 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1720d029-85ec-4c81-9b21-b5b8b687593e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:45.219074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1720d029-85ec-4c81-9b21-b5b8b687593e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:45.360539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1720d029-85ec-4c81-9b21-b5b8b687593e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:45.368779 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1720d029-85ec-4c81-9b21-b5b8b687593e tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1754 microversion: 2.1 time: 0.163114 May 28 21:58:45.369354 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3452/6863] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:45 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:58:46.386929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-96affb28-ea85-40ce-a423-5c4f00a74373 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:46.387489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-96affb28-ea85-40ce-a423-5c4f00a74373 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:46.394948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96affb28-ea85-40ce-a423-5c4f00a74373 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:46.395412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96affb28-ea85-40ce-a423-5c4f00a74373 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:46.396229 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96affb28-ea85-40ce-a423-5c4f00a74373 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:46.396678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96affb28-ea85-40ce-a423-5c4f00a74373 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:46.541928 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-96affb28-ea85-40ce-a423-5c4f00a74373 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:46.549994 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-96affb28-ea85-40ce-a423-5c4f00a74373 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1754 microversion: 2.1 time: 0.167045 May 28 21:58:46.550572 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3412/6864] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:46 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:58:47.567618 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f7d7ae84-fe31-4d92-af49-ee2c50ecbc98 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:58:47.568274 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f7d7ae84-fe31-4d92-af49-ee2c50ecbc98 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:58:47.575841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7d7ae84-fe31-4d92-af49-ee2c50ecbc98 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:47.576572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7d7ae84-fe31-4d92-af49-ee2c50ecbc98 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:47.577363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7d7ae84-fe31-4d92-af49-ee2c50ecbc98 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:58:47.577875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f7d7ae84-fe31-4d92-af49-ee2c50ecbc98 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:58:47.727704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f7d7ae84-fe31-4d92-af49-ee2c50ecbc98 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:58:47.736333 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f7d7ae84-fe31-4d92-af49-ee2c50ecbc98 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1757 microversion: 2.1 time: 0.173101 May 28 21:58:47.736854 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3453/6865] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:58:47 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:59:19.866457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8029cfc2-0b9a-499e-a786-8b1a5cf0da2b tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-53717858"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:59:19.867048 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8029cfc2-0b9a-499e-a786-8b1a5cf0da2b tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:19.869365 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=17 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:59:19.870268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:59:19.875105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8029cfc2-0b9a-499e-a786-8b1a5cf0da2b tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:19.875579 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8029cfc2-0b9a-499e-a786-8b1a5cf0da2b tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:19.876367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8029cfc2-0b9a-499e-a786-8b1a5cf0da2b tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:19.876821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8029cfc2-0b9a-499e-a786-8b1a5cf0da2b tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:20.003377 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.network.security_group_api [None req-8029cfc2-0b9a-499e-a786-8b1a5cf0da2b tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Removing security group 511164db-93c9-4324-901f-d10bce0dc56f from port 39e0046a-80f3-45fe-acec-3087b1a3cceb May 28 21:59:20.445482 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8029cfc2-0b9a-499e-a786-8b1a5cf0da2b tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "POST /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/action" status: 202 len: 0 microversion: 2.1 time: 0.583203 May 28 21:59:20.446351 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3413/6866] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 21:59:19 2022] POST /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:59:20.456035 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-e0bf54f8-1e2e-4a4a-aa3f-8bb338e9ea82 req-4ba7bce7-957a-4299-9caa-e2c1b6093db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4", "tag": "39e0046a-80f3-45fe-acec-3087b1a3cceb"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:59:20.459768 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=16 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:59:20.460442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=48 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:59:20.470116 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e0bf54f8-1e2e-4a4a-aa3f-8bb338e9ea82 req-4ba7bce7-957a-4299-9caa-e2c1b6093db1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:20.470977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-e0bf54f8-1e2e-4a4a-aa3f-8bb338e9ea82 req-4ba7bce7-957a-4299-9caa-e2c1b6093db1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:20.489190 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-e0bf54f8-1e2e-4a4a-aa3f-8bb338e9ea82 req-4ba7bce7-957a-4299-9caa-e2c1b6093db1 service nova] Creating event network-changed:39e0046a-80f3-45fe-acec-3087b1a3cceb for instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 on nch1-master-1 May 28 21:59:20.504808 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-e0bf54f8-1e2e-4a4a-aa3f-8bb338e9ea82 req-4ba7bce7-957a-4299-9caa-e2c1b6093db1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052672 May 28 21:59:20.506386 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3454/6867] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:59:21.731044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ed1810b8-c8f3-4c57-96b5-44a31c1dc24d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:21.731806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ed1810b8-c8f3-4c57-96b5-44a31c1dc24d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:21.738000 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed1810b8-c8f3-4c57-96b5-44a31c1dc24d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:21.738469 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed1810b8-c8f3-4c57-96b5-44a31c1dc24d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:21.739248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed1810b8-c8f3-4c57-96b5-44a31c1dc24d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:21.739698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed1810b8-c8f3-4c57-96b5-44a31c1dc24d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:21.828906 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-ed1810b8-c8f3-4c57-96b5-44a31c1dc24d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lazy-loading 'services' on Instance uuid 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:59:22.088855 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ed1810b8-c8f3-4c57-96b5-44a31c1dc24d tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/os-volume_attachments/ef9bd7bc-d94a-4522-b99c-668994610269" status: 202 len: 0 microversion: 2.1 time: 0.363431 May 28 21:59:22.089554 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3414/6868] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:59:21 2022] DELETE /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/os-volume_attachments/ef9bd7bc-d94a-4522-b99c-668994610269 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:59:22.098974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cd8147eb-e4e1-4fa7-84bf-e680b450f5e9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:22.108778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cd8147eb-e4e1-4fa7-84bf-e680b450f5e9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:22.117102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd8147eb-e4e1-4fa7-84bf-e680b450f5e9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:22.119536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd8147eb-e4e1-4fa7-84bf-e680b450f5e9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:22.119536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd8147eb-e4e1-4fa7-84bf-e680b450f5e9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:22.119536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cd8147eb-e4e1-4fa7-84bf-e680b450f5e9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:22.149904 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cd8147eb-e4e1-4fa7-84bf-e680b450f5e9 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055672 May 28 21:59:22.150485 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3455/6869] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:59:22 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:59:22.541184 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-dd60c670-05d4-4cdf-9e5b-8954c9180290 req-6dc18732-256f-4d65-a3a1-a0a8baa064bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4", "tag": "39e0046a-80f3-45fe-acec-3087b1a3cceb"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:59:22.550094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-dd60c670-05d4-4cdf-9e5b-8954c9180290 req-6dc18732-256f-4d65-a3a1-a0a8baa064bb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:22.551192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-dd60c670-05d4-4cdf-9e5b-8954c9180290 req-6dc18732-256f-4d65-a3a1-a0a8baa064bb service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:22.565009 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-dd60c670-05d4-4cdf-9e5b-8954c9180290 req-6dc18732-256f-4d65-a3a1-a0a8baa064bb service nova] Creating event network-changed:39e0046a-80f3-45fe-acec-3087b1a3cceb for instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 on nch1-master-1 May 28 21:59:22.570671 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-dd60c670-05d4-4cdf-9e5b-8954c9180290 req-6dc18732-256f-4d65-a3a1-a0a8baa064bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034809 May 28 21:59:22.571459 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3415/6870] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:59:23.162546 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a27f8954-fe46-4751-8bad-07f81ea9eb01 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:23.163480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a27f8954-fe46-4751-8bad-07f81ea9eb01 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:23.170425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a27f8954-fe46-4751-8bad-07f81ea9eb01 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:23.170874 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a27f8954-fe46-4751-8bad-07f81ea9eb01 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:23.171625 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a27f8954-fe46-4751-8bad-07f81ea9eb01 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:23.172064 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a27f8954-fe46-4751-8bad-07f81ea9eb01 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:23.208315 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a27f8954-fe46-4751-8bad-07f81ea9eb01 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049747 May 28 21:59:23.208881 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3456/6871] 10.222.0.33 () {58 vars in 1301 bytes} [Sat May 28 21:59:23 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 28 21:59:23.221149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-17fd5928-0319-4e7d-9705-5ac1bf065ff6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:23.221753 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-17fd5928-0319-4e7d-9705-5ac1bf065ff6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:23.228140 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-17fd5928-0319-4e7d-9705-5ac1bf065ff6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:23.228614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-17fd5928-0319-4e7d-9705-5ac1bf065ff6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:23.229428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-17fd5928-0319-4e7d-9705-5ac1bf065ff6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:23.229935 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-17fd5928-0319-4e7d-9705-5ac1bf065ff6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:23.304971 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-17fd5928-0319-4e7d-9705-5ac1bf065ff6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] HTTP exception thrown: Instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 is not attached to volume ef9bd7bc-d94a-4522-b99c-668994610269 May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-17fd5928-0319-4e7d-9705-5ac1bf065ff6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Request method failure captured: May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: request: DELETE /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/os-volume_attachments/ef9bd7bc-d94a-4522-b99c-668994610269 HTTP/1.1 May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpq9nW0aiRwgYecriUl1PDpY7YS8qywR_XwYQ-IbrltIjH_4JKJxHvyugdtRkTHF2AMR3unUOmHY6rxU9SQuA3aKZDSiprWGat7nEpKnkrKMh38FDbZ7IjAe5ZIL1B0cWwB8G2zhnGGVM0jkJFN5IciJ90Hcx4fKD70iyTNYVZvT_98 May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: f1c74667a82a49b6b4334c53eabb842f May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestMinimumBasicScenario-1635957539 May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f1c74667a82a49b6b4334c53eabb842f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1c74667a82a49b6b4334c53eabb842f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f1c74667a82a49b6b4334c53eabb842f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1c74667a82a49b6b4334c53eabb842f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestMinimumBasicScenario-1635957539 May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: f1c74667a82a49b6b4334c53eabb842f May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1635957539 May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestMinimumBasicScenario-1635957539-project May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: b99fe7794c22452484990b7e783f9a43 May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestMinimumBasicScenario-1635957539-project May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 is not attached to volume ef9bd7bc-d94a-4522-b99c-668994610269 May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'server_id': '8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4', 'id': 'ef9bd7bc-d94a-4522-b99c-668994610269'} May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ef9bd7bc-d94a-4522-b99c-668994610269. May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 is not attached to volume ef9bd7bc-d94a-4522-b99c-668994610269 May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:59:23.312174 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:59:23.316562 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:59:23.316562 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:59:23.316562 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 is not attached to volume ef9bd7bc-d94a-4522-b99c-668994610269 May 28 21:59:23.316562 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:59:23.316562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-17fd5928-0319-4e7d-9705-5ac1bf065ff6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Returning 404 to user: Instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 is not attached to volume ef9bd7bc-d94a-4522-b99c-668994610269 {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:59:23.316562 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-17fd5928-0319-4e7d-9705-5ac1bf065ff6 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/os-volume_attachments/ef9bd7bc-d94a-4522-b99c-668994610269" status: 404 len: 154 microversion: 2.1 time: 0.097982 May 28 21:59:23.316562 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3416/6872] 10.222.0.33 () {58 vars in 1415 bytes} [Sat May 28 21:59:23 2022] DELETE /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4/os-volume_attachments/ef9bd7bc-d94a-4522-b99c-668994610269 => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:59:26.684860 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-87f4ee1a-558d-4054-b879-eb9224730c78 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:26.685306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-87f4ee1a-558d-4054-b879-eb9224730c78 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:26.691721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87f4ee1a-558d-4054-b879-eb9224730c78 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:26.692184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87f4ee1a-558d-4054-b879-eb9224730c78 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:26.692985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87f4ee1a-558d-4054-b879-eb9224730c78 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:26.693432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-87f4ee1a-558d-4054-b879-eb9224730c78 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:26.718333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-87f4ee1a-558d-4054-b879-eb9224730c78 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 21:59:26.998533 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-87f4ee1a-558d-4054-b879-eb9224730c78 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 204 len: 0 microversion: 2.1 time: 0.317157 May 28 21:59:26.999070 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3457/6873] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 21:59:26 2022] DELETE /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 21:59:27.015066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b92476fb-7feb-42c6-baf9-a6ed4f93ced1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:27.015691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b92476fb-7feb-42c6-baf9-a6ed4f93ced1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:27.022047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b92476fb-7feb-42c6-baf9-a6ed4f93ced1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:27.022525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b92476fb-7feb-42c6-baf9-a6ed4f93ced1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:27.023964 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b92476fb-7feb-42c6-baf9-a6ed4f93ced1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:27.024460 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b92476fb-7feb-42c6-baf9-a6ed4f93ced1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:27.264804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b92476fb-7feb-42c6-baf9-a6ed4f93ced1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:59:27.272455 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b92476fb-7feb-42c6-baf9-a6ed4f93ced1 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1553 microversion: 2.1 time: 0.261471 May 28 21:59:27.273079 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3417/6874] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:59:27 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:59:28.289751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c024e6da-085d-49b1-9310-c877ef8f72bb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:28.291152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c024e6da-085d-49b1-9310-c877ef8f72bb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:28.298211 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c024e6da-085d-49b1-9310-c877ef8f72bb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:28.298677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c024e6da-085d-49b1-9310-c877ef8f72bb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:28.299456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c024e6da-085d-49b1-9310-c877ef8f72bb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:28.299906 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c024e6da-085d-49b1-9310-c877ef8f72bb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:28.482134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c024e6da-085d-49b1-9310-c877ef8f72bb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:59:28.489688 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c024e6da-085d-49b1-9310-c877ef8f72bb tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1553 microversion: 2.1 time: 0.204208 May 28 21:59:28.490303 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3458/6875] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:59:28 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:59:29.140961 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-63a4519e-ea02-492d-ab0f-b1a44de14984 req-69f8295b-8376-4649-b661-185f820f649a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4", "name": "network-vif-deleted", "tag": "39e0046a-80f3-45fe-acec-3087b1a3cceb"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:59:29.150262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-63a4519e-ea02-492d-ab0f-b1a44de14984 req-69f8295b-8376-4649-b661-185f820f649a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:29.150718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-63a4519e-ea02-492d-ab0f-b1a44de14984 req-69f8295b-8376-4649-b661-185f820f649a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:29.162079 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-63a4519e-ea02-492d-ab0f-b1a44de14984 req-69f8295b-8376-4649-b661-185f820f649a service nova] Creating event network-vif-deleted:39e0046a-80f3-45fe-acec-3087b1a3cceb for instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 on nch1-master-1 May 28 21:59:29.167644 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-63a4519e-ea02-492d-ab0f-b1a44de14984 req-69f8295b-8376-4649-b661-185f820f649a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030716 May 28 21:59:29.168220 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3418/6876] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:59:29.506678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-25f782ec-9bf7-4f8c-80e6-238fa8a12be3 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:29.507311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-25f782ec-9bf7-4f8c-80e6-238fa8a12be3 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:29.514690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25f782ec-9bf7-4f8c-80e6-238fa8a12be3 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:29.515390 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25f782ec-9bf7-4f8c-80e6-238fa8a12be3 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:29.517956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25f782ec-9bf7-4f8c-80e6-238fa8a12be3 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:29.517956 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25f782ec-9bf7-4f8c-80e6-238fa8a12be3 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:29.551298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25f782ec-9bf7-4f8c-80e6-238fa8a12be3 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:29.551762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25f782ec-9bf7-4f8c-80e6-238fa8a12be3 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:29.552234 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-25f782ec-9bf7-4f8c-80e6-238fa8a12be3 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lazy-loading 'fault' on Instance uuid 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 21:59:29.597741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-25f782ec-9bf7-4f8c-80e6-238fa8a12be3 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b99fe7794c22452484990b7e783f9a43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1c74667a82a49b6b4334c53eabb842f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:59:29.606161 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-25f782ec-9bf7-4f8c-80e6-238fa8a12be3 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 200 len: 1348 microversion: 2.1 time: 0.103448 May 28 21:59:29.606741 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3459/6877] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:59:29 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 1348 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:59:30.624773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-63f10fed-39eb-439a-9ae7-f70d8faad609 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:30.625502 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-63f10fed-39eb-439a-9ae7-f70d8faad609 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] [instance: 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:30.631860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63f10fed-39eb-439a-9ae7-f70d8faad609 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:30.632328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63f10fed-39eb-439a-9ae7-f70d8faad609 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:30.633114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63f10fed-39eb-439a-9ae7-f70d8faad609 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:30.633572 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-63f10fed-39eb-439a-9ae7-f70d8faad609 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:30.647250 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-63f10fed-39eb-439a-9ae7-f70d8faad609 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] HTTP exception thrown: Instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 could not be found. May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-63f10fed-39eb-439a-9ae7-f70d8faad609 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Request method failure captured: May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 HTTP/1.1 May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikpq9nW0aiRwgYecriUl1PDpY7YS8qywR_XwYQ-IbrltIjH_4JKJxHvyugdtRkTHF2AMR3unUOmHY6rxU9SQuA3aKZDSiprWGat7nEpKnkrKMh38FDbZ7IjAe5ZIL1B0cWwB8G2zhnGGVM0jkJFN5IciJ90Hcx4fKD70iyTNYVZvT_98 May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: f1c74667a82a49b6b4334c53eabb842f May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestMinimumBasicScenario-1635957539 May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f1c74667a82a49b6b4334c53eabb842f", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1c74667a82a49b6b4334c53eabb842f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f1c74667a82a49b6b4334c53eabb842f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1c74667a82a49b6b4334c53eabb842f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestMinimumBasicScenario-1635957539 May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: f1c74667a82a49b6b4334c53eabb842f May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1635957539 May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestMinimumBasicScenario-1635957539-project May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: b99fe7794c22452484990b7e783f9a43 May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestMinimumBasicScenario-1635957539-project May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 could not be found. May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': '8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4'} May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 could not be found. May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 could not be found. May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 21:59:30.648867 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:59:30.653668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 21:59:30.653668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 21:59:30.653668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 21:59:30.653668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 21:59:30.653668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 21:59:30.653668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 could not be found. May 28 21:59:30.653668 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 21:59:30.653668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-63f10fed-39eb-439a-9ae7-f70d8faad609 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Returning 404 to user: Instance 8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 21:59:30.653668 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-63f10fed-39eb-439a-9ae7-f70d8faad609 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4" status: 404 len: 111 microversion: 2.1 time: 0.031419 May 28 21:59:30.653668 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3419/6878] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:59:30 2022] GET /compute/v2.1/servers/8f1644dc-c331-4fcb-bb7b-bf1091d5c8f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 21:59:30.659502 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4b5cd081-0eb5-499f-8599-a4abd5015942 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] Calling method '.version_select at 0x7f4d56c73dc0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:30.741356 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4b5cd081-0eb5-499f-8599-a4abd5015942 tempest-TestMinimumBasicScenario-1635957539 tempest-TestMinimumBasicScenario-1635957539-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-823842097" status: 202 len: 0 microversion: 2.1 time: 0.085580 May 28 21:59:30.741958 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3460/6879] 10.222.0.33 () {58 vars in 1268 bytes} [Sat May 28 21:59:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-823842097 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 21:59:35.224509 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 21:59:35.224991 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 21:59:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 21:59:42.923307 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=14 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:59:42.924093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:59:43.085228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cdfebde0-0185-43b8-a555-a1a046a59433 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'create', calling method: .version_select at 0x7f4d542d6700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-914764054", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdJoCQMLEaFaj/fzfM8q40ZLjdyGmc6cq00bqkjN0Rh6fnKNHQaK6jprC9buKebLOuuXc7Z/tk/iZ8lmLRpKgzzffW9+EwtVekyxldlDJdb0RgO3H1yCf4FirZQCa1Amg=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:59:43.100473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-cdfebde0-0185-43b8-a555-a1a046a59433 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for project 38d3db1f6443461f90a5be23358b6816. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:59:43.106514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-cdfebde0-0185-43b8-a555-a1a046a59433 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for user 56b376ad4a314418bca5fcbf8a8ca429 and project 38d3db1f6443461f90a5be23358b6816. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:59:43.187715 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cdfebde0-0185-43b8-a555-a1a046a59433 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.269922 May 28 21:59:43.188536 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3420/6880] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 21:59:42 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:59:51.738405 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:59:51.739711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 21:59:51.743991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1982974176", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "c8388499-689f-43ff-9a01-fd61c2ff8d8f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-914764054", "security_groups": [{"name": "tempest-secgroup-smoke-1194136270"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:59:51.888644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] validate_networks() for [('c8388499-689f-43ff-9a01-fd61c2ff8d8f', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 21:59:52.360098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 21:59:52.360735 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 21:59:52.361235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 21:59:52.361664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 21:59:52.362124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 21:59:52.372677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:52.373166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:52.374013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:52.374465 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:52.392493 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for project 38d3db1f6443461f90a5be23358b6816. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 21:59:52.398358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for user 56b376ad4a314418bca5fcbf8a8ca429 and project 38d3db1f6443461f90a5be23358b6816. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 21:59:52.411786 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 21:59:52.414144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 21:59:52.567928 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bbf58619-c5dc-4d13-9a41-07862b2dc953 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.831522 May 28 21:59:52.568599 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3461/6881] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 21:59:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 21:59:52.580036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-089ce39d-25de-4af6-ad26-cd5c6af6486b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:52.580842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-089ce39d-25de-4af6-ad26-cd5c6af6486b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:52.647252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-089ce39d-25de-4af6-ad26-cd5c6af6486b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:59:52.655485 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-089ce39d-25de-4af6-ad26-cd5c6af6486b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1266 microversion: 2.1 time: 0.080492 May 28 21:59:52.656062 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3421/6882] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:59:52 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 21:59:53.673122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d9d5dda6-b862-406c-ac7a-d92c07cc4a6e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:53.673857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d9d5dda6-b862-406c-ac7a-d92c07cc4a6e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:53.681262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9d5dda6-b862-406c-ac7a-d92c07cc4a6e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:53.681724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9d5dda6-b862-406c-ac7a-d92c07cc4a6e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:53.683049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9d5dda6-b862-406c-ac7a-d92c07cc4a6e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:53.683495 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d9d5dda6-b862-406c-ac7a-d92c07cc4a6e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:53.750523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d9d5dda6-b862-406c-ac7a-d92c07cc4a6e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:59:53.758282 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d9d5dda6-b862-406c-ac7a-d92c07cc4a6e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1270 microversion: 2.1 time: 0.089643 May 28 21:59:53.758865 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3462/6883] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:59:53 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:59:54.776291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-35079668-2f75-48f1-abfd-64a134126771 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:54.776968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-35079668-2f75-48f1-abfd-64a134126771 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:54.786262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35079668-2f75-48f1-abfd-64a134126771 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:54.787004 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35079668-2f75-48f1-abfd-64a134126771 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:54.788960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35079668-2f75-48f1-abfd-64a134126771 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:54.789434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-35079668-2f75-48f1-abfd-64a134126771 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:54.858227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-35079668-2f75-48f1-abfd-64a134126771 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:59:54.869480 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-35079668-2f75-48f1-abfd-64a134126771 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1326 microversion: 2.1 time: 0.097877 May 28 21:59:54.870317 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3422/6884] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:59:54 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:59:55.894555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7be33d4c-cfad-4952-b901-623cb7f2c3b1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:55.895196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7be33d4c-cfad-4952-b901-623cb7f2c3b1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:55.904683 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7be33d4c-cfad-4952-b901-623cb7f2c3b1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:55.905155 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7be33d4c-cfad-4952-b901-623cb7f2c3b1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:55.905988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7be33d4c-cfad-4952-b901-623cb7f2c3b1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:55.906733 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7be33d4c-cfad-4952-b901-623cb7f2c3b1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:56.049279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7be33d4c-cfad-4952-b901-623cb7f2c3b1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:59:56.061566 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7be33d4c-cfad-4952-b901-623cb7f2c3b1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1392 microversion: 2.1 time: 0.172726 May 28 21:59:56.062872 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3463/6885] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:59:55 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:59:56.351519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-7b10240d-2fc9-4c3c-8acd-f4def369a793 req-8c613a32-fb04-4932-9543-e98bb8ca2fdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca20a809-ee30-4bf1-8f91-2723b7f7befd", "tag": "68bb2ccb-b7e4-4160-a283-96b3fecff70c"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 21:59:56.361069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7b10240d-2fc9-4c3c-8acd-f4def369a793 req-8c613a32-fb04-4932-9543-e98bb8ca2fdc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:56.361527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-7b10240d-2fc9-4c3c-8acd-f4def369a793 req-8c613a32-fb04-4932-9543-e98bb8ca2fdc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:56.375719 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-7b10240d-2fc9-4c3c-8acd-f4def369a793 req-8c613a32-fb04-4932-9543-e98bb8ca2fdc service nova] Creating event network-changed:68bb2ccb-b7e4-4160-a283-96b3fecff70c for instance ca20a809-ee30-4bf1-8f91-2723b7f7befd on nch1-master-1 May 28 21:59:56.380839 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-7b10240d-2fc9-4c3c-8acd-f4def369a793 req-8c613a32-fb04-4932-9543-e98bb8ca2fdc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034231 May 28 21:59:56.381923 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3423/6886] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 21:59:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 21:59:57.079661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-234c19ef-0124-4a3b-99d2-efe3642b7685 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:57.080287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-234c19ef-0124-4a3b-99d2-efe3642b7685 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:57.086689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-234c19ef-0124-4a3b-99d2-efe3642b7685 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:57.087149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-234c19ef-0124-4a3b-99d2-efe3642b7685 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:57.087931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-234c19ef-0124-4a3b-99d2-efe3642b7685 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:57.088409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-234c19ef-0124-4a3b-99d2-efe3642b7685 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:57.221671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-234c19ef-0124-4a3b-99d2-efe3642b7685 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:59:57.229829 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-234c19ef-0124-4a3b-99d2-efe3642b7685 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1392 microversion: 2.1 time: 0.154091 May 28 21:59:57.230423 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3464/6887] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:59:57 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:59:58.247848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-92121b73-c441-40c4-9f73-bdaa8e48f83a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:58.248571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-92121b73-c441-40c4-9f73-bdaa8e48f83a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:58.254942 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92121b73-c441-40c4-9f73-bdaa8e48f83a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:58.255418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92121b73-c441-40c4-9f73-bdaa8e48f83a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:58.256199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92121b73-c441-40c4-9f73-bdaa8e48f83a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:58.256658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-92121b73-c441-40c4-9f73-bdaa8e48f83a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:58.385794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-92121b73-c441-40c4-9f73-bdaa8e48f83a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:59:58.393408 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-92121b73-c441-40c4-9f73-bdaa8e48f83a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1392 microversion: 2.1 time: 0.150607 May 28 21:59:58.394015 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3424/6888] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:59:58 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1392 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 21:59:59.411060 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8ac0e0d5-042d-4103-bafd-7e6b738e4f7e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 21:59:59.411650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8ac0e0d5-042d-4103-bafd-7e6b738e4f7e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 21:59:59.418624 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ac0e0d5-042d-4103-bafd-7e6b738e4f7e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:59.419090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ac0e0d5-042d-4103-bafd-7e6b738e4f7e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:59.419864 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ac0e0d5-042d-4103-bafd-7e6b738e4f7e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 21:59:59.420313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ac0e0d5-042d-4103-bafd-7e6b738e4f7e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 21:59:59.548498 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8ac0e0d5-042d-4103-bafd-7e6b738e4f7e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 21:59:59.556095 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8ac0e0d5-042d-4103-bafd-7e6b738e4f7e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1392 microversion: 2.1 time: 0.149032 May 28 21:59:59.557438 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3465/6889] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 21:59:59 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1392 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:00:00.573453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-466d7aac-2f07-4e44-9d98-92b32d8aa62e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:00.574150 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-466d7aac-2f07-4e44-9d98-92b32d8aa62e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:00.581412 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-466d7aac-2f07-4e44-9d98-92b32d8aa62e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:00.581926 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-466d7aac-2f07-4e44-9d98-92b32d8aa62e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:00.582722 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-466d7aac-2f07-4e44-9d98-92b32d8aa62e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:00.583188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-466d7aac-2f07-4e44-9d98-92b32d8aa62e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:00.716912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-466d7aac-2f07-4e44-9d98-92b32d8aa62e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:00:00.724421 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-466d7aac-2f07-4e44-9d98-92b32d8aa62e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1392 microversion: 2.1 time: 0.155068 May 28 22:00:00.724999 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3425/6890] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:00 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:00:01.741678 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b06dff84-446a-469c-9934-4d1e20d3a33d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:01.742330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b06dff84-446a-469c-9934-4d1e20d3a33d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:01.750025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b06dff84-446a-469c-9934-4d1e20d3a33d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:01.750490 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b06dff84-446a-469c-9934-4d1e20d3a33d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:01.751266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b06dff84-446a-469c-9934-4d1e20d3a33d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:01.751721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b06dff84-446a-469c-9934-4d1e20d3a33d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:01.882058 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b06dff84-446a-469c-9934-4d1e20d3a33d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:00:01.890380 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b06dff84-446a-469c-9934-4d1e20d3a33d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1392 microversion: 2.1 time: 0.152640 May 28 22:00:01.892843 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3466/6891] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:01 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:00:02.907812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3ef88308-4257-4c2a-b0be-d329aee14d68 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:02.912698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3ef88308-4257-4c2a-b0be-d329aee14d68 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:02.912698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:00:02.916571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ef88308-4257-4c2a-b0be-d329aee14d68 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:02.917046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ef88308-4257-4c2a-b0be-d329aee14d68 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:02.917932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ef88308-4257-4c2a-b0be-d329aee14d68 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:02.918402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3ef88308-4257-4c2a-b0be-d329aee14d68 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:03.121711 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-819b23f2-4624-4fa5-9eaf-584b35f373cd req-8c985a7c-4985-4cb6-9bf0-9eee0053a08b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca20a809-ee30-4bf1-8f91-2723b7f7befd", "name": "network-vif-plugged", "status": "completed", "tag": "68bb2ccb-b7e4-4160-a283-96b3fecff70c"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:00:03.126000 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:00:03.126871 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:00:03.133514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-819b23f2-4624-4fa5-9eaf-584b35f373cd req-8c985a7c-4985-4cb6-9bf0-9eee0053a08b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:03.134002 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-819b23f2-4624-4fa5-9eaf-584b35f373cd req-8c985a7c-4985-4cb6-9bf0-9eee0053a08b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:03.146884 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-819b23f2-4624-4fa5-9eaf-584b35f373cd req-8c985a7c-4985-4cb6-9bf0-9eee0053a08b service nova] Creating event network-vif-plugged:68bb2ccb-b7e4-4160-a283-96b3fecff70c for instance ca20a809-ee30-4bf1-8f91-2723b7f7befd on nch1-master-1 May 28 22:00:03.153138 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-819b23f2-4624-4fa5-9eaf-584b35f373cd req-8c985a7c-4985-4cb6-9bf0-9eee0053a08b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035402 May 28 22:00:03.153760 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3467/6892] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:00:03.347804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3ef88308-4257-4c2a-b0be-d329aee14d68 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:00:03.355321 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3ef88308-4257-4c2a-b0be-d329aee14d68 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1392 microversion: 2.1 time: 0.451539 May 28 22:00:03.355897 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3426/6893] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:02 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1392 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:00:04.374458 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-51be0205-fb1d-454d-b893-08858f6b5490 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:04.375180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-51be0205-fb1d-454d-b893-08858f6b5490 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:04.382114 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51be0205-fb1d-454d-b893-08858f6b5490 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:04.382619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51be0205-fb1d-454d-b893-08858f6b5490 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:04.383407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51be0205-fb1d-454d-b893-08858f6b5490 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:04.383854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51be0205-fb1d-454d-b893-08858f6b5490 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:04.517720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-51be0205-fb1d-454d-b893-08858f6b5490 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:00:04.526052 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-51be0205-fb1d-454d-b893-08858f6b5490 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1564 microversion: 2.1 time: 0.156790 May 28 22:00:04.526695 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3468/6894] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:04 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:00:04.542987 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ac3fa930-7870-4de7-8286-10880dc6f8ea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:04.543661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ac3fa930-7870-4de7-8286-10880dc6f8ea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:04.550777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac3fa930-7870-4de7-8286-10880dc6f8ea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:04.551244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac3fa930-7870-4de7-8286-10880dc6f8ea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:04.552035 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac3fa930-7870-4de7-8286-10880dc6f8ea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:04.552500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ac3fa930-7870-4de7-8286-10880dc6f8ea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:04.688633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ac3fa930-7870-4de7-8286-10880dc6f8ea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:00:04.696276 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ac3fa930-7870-4de7-8286-10880dc6f8ea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1564 microversion: 2.1 time: 0.157255 May 28 22:00:04.696849 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3427/6895] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:04 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:00:06.516158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-f6ad91e3-6f32-4631-86c0-dd2ad8b2a9dd req-767cb12d-c348-442b-bb8c-1a6e7922aa9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca20a809-ee30-4bf1-8f91-2723b7f7befd", "tag": "68bb2ccb-b7e4-4160-a283-96b3fecff70c"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:00:06.519174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-03baf7ec-5df9-41c5-b2ae-876cc189a258 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:06.519806 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-03baf7ec-5df9-41c5-b2ae-876cc189a258 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:06.532764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f6ad91e3-6f32-4631-86c0-dd2ad8b2a9dd req-767cb12d-c348-442b-bb8c-1a6e7922aa9d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:06.533235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f6ad91e3-6f32-4631-86c0-dd2ad8b2a9dd req-767cb12d-c348-442b-bb8c-1a6e7922aa9d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:06.538824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-03baf7ec-5df9-41c5-b2ae-876cc189a258 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:06.539379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-03baf7ec-5df9-41c5-b2ae-876cc189a258 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:06.540186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-03baf7ec-5df9-41c5-b2ae-876cc189a258 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:06.540644 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-03baf7ec-5df9-41c5-b2ae-876cc189a258 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:06.546204 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-f6ad91e3-6f32-4631-86c0-dd2ad8b2a9dd req-767cb12d-c348-442b-bb8c-1a6e7922aa9d service nova] Creating event network-changed:68bb2ccb-b7e4-4160-a283-96b3fecff70c for instance ca20a809-ee30-4bf1-8f91-2723b7f7befd on nch1-master-1 May 28 22:00:06.551797 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-f6ad91e3-6f32-4631-86c0-dd2ad8b2a9dd req-767cb12d-c348-442b-bb8c-1a6e7922aa9d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039639 May 28 22:00:06.552636 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3428/6896] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:00:06.690557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-03baf7ec-5df9-41c5-b2ae-876cc189a258 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:00:06.700983 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-03baf7ec-5df9-41c5-b2ae-876cc189a258 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1564 microversion: 2.1 time: 0.193604 May 28 22:00:06.702022 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3469/6897] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:06 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1564 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:00:29.983244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:00:29.984069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=34 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:00:29.988359 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-04074b8d-b0fd-4b17-9d87-26b5bacc20fe tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:00:29.989381 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-04074b8d-b0fd-4b17-9d87-26b5bacc20fe tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:29.995581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04074b8d-b0fd-4b17-9d87-26b5bacc20fe tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:29.996053 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04074b8d-b0fd-4b17-9d87-26b5bacc20fe tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:29.997441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04074b8d-b0fd-4b17-9d87-26b5bacc20fe tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:29.997933 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-04074b8d-b0fd-4b17-9d87-26b5bacc20fe tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:30.048473 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-04074b8d-b0fd-4b17-9d87-26b5bacc20fe tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd/action" status: 200 len: 24571 microversion: 2.1 time: 0.067764 May 28 22:00:30.049145 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3429/6898] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:00:29 2022] POST /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd/action => generated 24571 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 22:00:36.468811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9137e4ef-eb00-4c41-8797-364692e159cb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:00:36.469387 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9137e4ef-eb00-4c41-8797-364692e159cb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:36.471887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:00:36.472588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=46 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:00:36.477499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9137e4ef-eb00-4c41-8797-364692e159cb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:36.478021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9137e4ef-eb00-4c41-8797-364692e159cb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:36.478805 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9137e4ef-eb00-4c41-8797-364692e159cb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:36.479262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9137e4ef-eb00-4c41-8797-364692e159cb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:36.713954 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9137e4ef-eb00-4c41-8797-364692e159cb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd/action" status: 202 len: 0 microversion: 2.1 time: 0.249872 May 28 22:00:36.714617 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3470/6899] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:00:36 2022] POST /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:00:36.725420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ef6e340c-905f-454d-835a-d3dca380b19c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:36.726175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ef6e340c-905f-454d-835a-d3dca380b19c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:36.733724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef6e340c-905f-454d-835a-d3dca380b19c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:36.734216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef6e340c-905f-454d-835a-d3dca380b19c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:36.734994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef6e340c-905f-454d-835a-d3dca380b19c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:36.735442 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ef6e340c-905f-454d-835a-d3dca380b19c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:36.870006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ef6e340c-905f-454d-835a-d3dca380b19c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:00:36.878139 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ef6e340c-905f-454d-835a-d3dca380b19c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1688 microversion: 2.1 time: 0.157586 May 28 22:00:36.878714 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3430/6900] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:36 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:00:37.898192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0a4a59a5-ad04-4901-95b0-00e2ab32314d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:37.898934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0a4a59a5-ad04-4901-95b0-00e2ab32314d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:37.905960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a4a59a5-ad04-4901-95b0-00e2ab32314d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:37.906425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a4a59a5-ad04-4901-95b0-00e2ab32314d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:37.907195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a4a59a5-ad04-4901-95b0-00e2ab32314d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:37.907642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a4a59a5-ad04-4901-95b0-00e2ab32314d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:38.042713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0a4a59a5-ad04-4901-95b0-00e2ab32314d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:00:38.050620 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0a4a59a5-ad04-4901-95b0-00e2ab32314d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1668 microversion: 2.1 time: 0.157760 May 28 22:00:38.051192 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3471/6901] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:37 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1668 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:00:39.136685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5f51edb0-3961-4912-925c-5f385e95e251 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:00:39.137636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5f51edb0-3961-4912-925c-5f385e95e251 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:39.145396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f51edb0-3961-4912-925c-5f385e95e251 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:39.145897 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f51edb0-3961-4912-925c-5f385e95e251 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:39.146677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f51edb0-3961-4912-925c-5f385e95e251 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:39.147129 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5f51edb0-3961-4912-925c-5f385e95e251 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:39.194153 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5f51edb0-3961-4912-925c-5f385e95e251 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd/action" status: 200 len: 32643 microversion: 2.1 time: 0.061257 May 28 22:00:39.194790 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3431/6902] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:00:39 2022] POST /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd/action => generated 32643 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 22:00:39.206214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b1be7bd4-8615-4d8c-975f-0219ba6c0fa2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:00:39.206759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b1be7bd4-8615-4d8c-975f-0219ba6c0fa2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:39.213704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1be7bd4-8615-4d8c-975f-0219ba6c0fa2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:39.214198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1be7bd4-8615-4d8c-975f-0219ba6c0fa2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:39.214976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1be7bd4-8615-4d8c-975f-0219ba6c0fa2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:39.215429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b1be7bd4-8615-4d8c-975f-0219ba6c0fa2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:39.417061 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b1be7bd4-8615-4d8c-975f-0219ba6c0fa2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd/action" status: 202 len: 0 microversion: 2.1 time: 0.214629 May 28 22:00:39.417712 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3472/6903] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:00:39 2022] POST /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:00:39.427704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3e63d24c-d9ca-4026-90f3-834e57a32db5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:39.432963 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3e63d24c-d9ca-4026-90f3-834e57a32db5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:39.436665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e63d24c-d9ca-4026-90f3-834e57a32db5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:39.437137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e63d24c-d9ca-4026-90f3-834e57a32db5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:39.437956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e63d24c-d9ca-4026-90f3-834e57a32db5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:39.438421 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e63d24c-d9ca-4026-90f3-834e57a32db5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:39.577458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3e63d24c-d9ca-4026-90f3-834e57a32db5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:00:39.585151 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3e63d24c-d9ca-4026-90f3-834e57a32db5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1675 microversion: 2.1 time: 0.161846 May 28 22:00:39.585725 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3432/6904] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:39 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:00:40.604610 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a198d7c2-c751-4be9-a3f3-0c1b2c912fb7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:40.605322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a198d7c2-c751-4be9-a3f3-0c1b2c912fb7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:40.611989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a198d7c2-c751-4be9-a3f3-0c1b2c912fb7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:40.612447 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a198d7c2-c751-4be9-a3f3-0c1b2c912fb7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:40.613271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a198d7c2-c751-4be9-a3f3-0c1b2c912fb7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:40.613715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a198d7c2-c751-4be9-a3f3-0c1b2c912fb7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:40.745792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a198d7c2-c751-4be9-a3f3-0c1b2c912fb7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:00:40.753810 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a198d7c2-c751-4be9-a3f3-0c1b2c912fb7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1683 microversion: 2.1 time: 0.154655 May 28 22:00:40.754406 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3473/6905] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:40 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:00:40.849213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-33bf6720-d38b-4583-8bf5-94de904cc49f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:00:40.850200 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-33bf6720-d38b-4583-8bf5-94de904cc49f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:40.858094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33bf6720-d38b-4583-8bf5-94de904cc49f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:40.858512 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33bf6720-d38b-4583-8bf5-94de904cc49f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:40.859300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33bf6720-d38b-4583-8bf5-94de904cc49f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:40.859764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-33bf6720-d38b-4583-8bf5-94de904cc49f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:40.906564 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-33bf6720-d38b-4583-8bf5-94de904cc49f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd/action" status: 200 len: 36320 microversion: 2.1 time: 0.061162 May 28 22:00:40.907194 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3433/6906] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:00:40 2022] POST /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd/action => generated 36320 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 22:00:42.053474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-970ab4f0-c88a-43b2-b3d5-80e4814bbac5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:42.054022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-970ab4f0-c88a-43b2-b3d5-80e4814bbac5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:42.056227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-49ac335b-d710-45f3-86ca-8dbfc76ce018 req-df27102e-bd1b-4f1f-a352-0ccf32c5831f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca20a809-ee30-4bf1-8f91-2723b7f7befd", "tag": "68bb2ccb-b7e4-4160-a283-96b3fecff70c"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:00:42.062848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-970ab4f0-c88a-43b2-b3d5-80e4814bbac5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:42.063627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-970ab4f0-c88a-43b2-b3d5-80e4814bbac5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:42.064770 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-970ab4f0-c88a-43b2-b3d5-80e4814bbac5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:42.065225 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-970ab4f0-c88a-43b2-b3d5-80e4814bbac5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:42.077208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-49ac335b-d710-45f3-86ca-8dbfc76ce018 req-df27102e-bd1b-4f1f-a352-0ccf32c5831f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:42.077673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-49ac335b-d710-45f3-86ca-8dbfc76ce018 req-df27102e-bd1b-4f1f-a352-0ccf32c5831f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:42.089605 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-49ac335b-d710-45f3-86ca-8dbfc76ce018 req-df27102e-bd1b-4f1f-a352-0ccf32c5831f service nova] Creating event network-changed:68bb2ccb-b7e4-4160-a283-96b3fecff70c for instance ca20a809-ee30-4bf1-8f91-2723b7f7befd on nch1-master-1 May 28 22:00:42.093507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-970ab4f0-c88a-43b2-b3d5-80e4814bbac5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 22:00:42.094486 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-49ac335b-d710-45f3-86ca-8dbfc76ce018 req-df27102e-bd1b-4f1f-a352-0ccf32c5831f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042259 May 28 22:00:42.095347 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3434/6907] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:00:42.380086 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-970ab4f0-c88a-43b2-b3d5-80e4814bbac5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 204 len: 0 microversion: 2.1 time: 0.330405 May 28 22:00:42.380805 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3474/6908] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 22:00:42 2022] DELETE /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 22:00:42.393059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-16a7227d-4cee-4c96-92f3-8d309314cbbd tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:42.393059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-16a7227d-4cee-4c96-92f3-8d309314cbbd tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:42.398476 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16a7227d-4cee-4c96-92f3-8d309314cbbd tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:42.398955 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16a7227d-4cee-4c96-92f3-8d309314cbbd tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:42.399796 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16a7227d-4cee-4c96-92f3-8d309314cbbd tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:42.400259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16a7227d-4cee-4c96-92f3-8d309314cbbd tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:42.540615 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-16a7227d-4cee-4c96-92f3-8d309314cbbd tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:00:42.548976 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-16a7227d-4cee-4c96-92f3-8d309314cbbd tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1689 microversion: 2.1 time: 0.163369 May 28 22:00:42.549555 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3435/6909] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:42 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:00:43.567641 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3a01ebf6-619c-4bb9-8cdf-db463ab6062d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:43.568358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3a01ebf6-619c-4bb9-8cdf-db463ab6062d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:43.576337 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a01ebf6-619c-4bb9-8cdf-db463ab6062d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:43.576807 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a01ebf6-619c-4bb9-8cdf-db463ab6062d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:43.577587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a01ebf6-619c-4bb9-8cdf-db463ab6062d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:43.578073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3a01ebf6-619c-4bb9-8cdf-db463ab6062d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:43.710102 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3a01ebf6-619c-4bb9-8cdf-db463ab6062d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:00:43.717992 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3a01ebf6-619c-4bb9-8cdf-db463ab6062d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1689 microversion: 2.1 time: 0.154557 May 28 22:00:43.718578 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3475/6910] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:43 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:00:44.441976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a889321a-463b-49ff-88c4-b06b80a987f4 req-2d481519-324b-4d43-9d2e-aecc26cad2cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca20a809-ee30-4bf1-8f91-2723b7f7befd", "name": "network-vif-deleted", "tag": "68bb2ccb-b7e4-4160-a283-96b3fecff70c"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:00:44.451758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a889321a-463b-49ff-88c4-b06b80a987f4 req-2d481519-324b-4d43-9d2e-aecc26cad2cf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:44.454524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a889321a-463b-49ff-88c4-b06b80a987f4 req-2d481519-324b-4d43-9d2e-aecc26cad2cf service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:44.463363 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a889321a-463b-49ff-88c4-b06b80a987f4 req-2d481519-324b-4d43-9d2e-aecc26cad2cf service nova] Creating event network-vif-deleted:68bb2ccb-b7e4-4160-a283-96b3fecff70c for instance ca20a809-ee30-4bf1-8f91-2723b7f7befd on nch1-master-1 May 28 22:00:44.468225 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a889321a-463b-49ff-88c4-b06b80a987f4 req-2d481519-324b-4d43-9d2e-aecc26cad2cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030045 May 28 22:00:44.468808 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3436/6911] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:00:44.735609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-73fb5f7c-cfd8-4cec-a72f-2ee6b1b7008e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:44.736229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-73fb5f7c-cfd8-4cec-a72f-2ee6b1b7008e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:44.743524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73fb5f7c-cfd8-4cec-a72f-2ee6b1b7008e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:44.744036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73fb5f7c-cfd8-4cec-a72f-2ee6b1b7008e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:44.744816 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73fb5f7c-cfd8-4cec-a72f-2ee6b1b7008e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:44.745257 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-73fb5f7c-cfd8-4cec-a72f-2ee6b1b7008e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:44.820823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-73fb5f7c-cfd8-4cec-a72f-2ee6b1b7008e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:00:44.829616 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-73fb5f7c-cfd8-4cec-a72f-2ee6b1b7008e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 200 len: 1351 microversion: 2.1 time: 0.097942 May 28 22:00:44.830301 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3476/6912] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:44 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:00:45.847354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1fec76f7-1158-4635-8e30-ff4c904e0491 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:45.848060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1fec76f7-1158-4635-8e30-ff4c904e0491 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: ca20a809-ee30-4bf1-8f91-2723b7f7befd] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:45.857324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1fec76f7-1158-4635-8e30-ff4c904e0491 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:45.857324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1fec76f7-1158-4635-8e30-ff4c904e0491 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:45.857324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1fec76f7-1158-4635-8e30-ff4c904e0491 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:45.857324 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1fec76f7-1158-4635-8e30-ff4c904e0491 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:45.873781 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-1fec76f7-1158-4635-8e30-ff4c904e0491 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] HTTP exception thrown: Instance ca20a809-ee30-4bf1-8f91-2723b7f7befd could not be found. May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1fec76f7-1158-4635-8e30-ff4c904e0491 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Request method failure captured: May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd HTTP/1.1 May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikptOuO8oVBSIrBTIbL1qBafkM3bRPqHRtdmD9HRzAg7Rq6Sa9lPn2eCwncLkJYy5x5D810AJAdLKgrCA2pyb1pdvaP3HK5GoIFP0N8s94-1UlDC3wszHDUtJtWOu2ExEC0RSI6YR2LI3hXkxUjTpT0O1jnASr-USfa-JS-4KnaOepP0 May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 38d3db1f6443461f90a5be23358b6816 May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-582264347 May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38d3db1f6443461f90a5be23358b6816", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d3db1f6443461f90a5be23358b6816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38d3db1f6443461f90a5be23358b6816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d3db1f6443461f90a5be23358b6816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestNetworkAdvancedServerOps-582264347 May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 38d3db1f6443461f90a5be23358b6816 May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-582264347 May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestNetworkAdvancedServerOps-582264347-project May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 56b376ad4a314418bca5fcbf8a8ca429 May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestNetworkAdvancedServerOps-582264347-project May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance ca20a809-ee30-4bf1-8f91-2723b7f7befd could not be found. May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'ca20a809-ee30-4bf1-8f91-2723b7f7befd'} May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca20a809-ee30-4bf1-8f91-2723b7f7befd could not be found. May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca20a809-ee30-4bf1-8f91-2723b7f7befd could not be found. May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:00:45.875478 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:00:45.881651 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:00:45.881651 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:00:45.881651 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:00:45.881651 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 22:00:45.881651 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 22:00:45.881651 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca20a809-ee30-4bf1-8f91-2723b7f7befd could not be found. May 28 22:00:45.881651 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:00:45.881651 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1fec76f7-1158-4635-8e30-ff4c904e0491 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Returning 404 to user: Instance ca20a809-ee30-4bf1-8f91-2723b7f7befd could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 22:00:45.881651 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1fec76f7-1158-4635-8e30-ff4c904e0491 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd" status: 404 len: 111 microversion: 2.1 time: 0.034034 May 28 22:00:45.881651 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3437/6913] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:45 2022] GET /compute/v2.1/servers/ca20a809-ee30-4bf1-8f91-2723b7f7befd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 22:00:49.596512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e3e857e9-a448-46d0-8388-c773172c7579 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '.version_select at 0x7f4d57867820>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:49.689517 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e3e857e9-a448-46d0-8388-c773172c7579 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-914764054" status: 202 len: 0 microversion: 2.1 time: 0.096956 May 28 22:00:49.690119 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3477/6914] 10.222.0.33 () {58 vars in 1280 bytes} [Sat May 28 22:00:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-914764054 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:00:49.717698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-14db3c77-71a7-4ffb-a374-1b1808ec0580 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'create', calling method: .version_select at 0x7f4d542931f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-906650219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTRWDXw0rd15jiHiCQCy+zszqmKyzHpwiLO0emanLIEymBEswqBsGdExWkJErExf6bRh+2yM/xk+8cwPIhH1nSe/NbVvrZIpRp2RiH4ZkDdvwMBRji2idtXpW9SnpkpoA=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:00:49.732571 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-14db3c77-71a7-4ffb-a374-1b1808ec0580 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for project 38d3db1f6443461f90a5be23358b6816. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 22:00:49.738674 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-14db3c77-71a7-4ffb-a374-1b1808ec0580 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for user 56b376ad4a314418bca5fcbf8a8ca429 and project 38d3db1f6443461f90a5be23358b6816. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 22:00:49.832071 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-14db3c77-71a7-4ffb-a374-1b1808ec0580 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.118239 May 28 22:00:49.832882 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3438/6915] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 22:00:49 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:00:57.899623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:00:57.905424 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-454262796", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "1f44e229-0550-4acf-869b-a8ac8dc0c3ff"}], "key_name": "tempest-TestNetworkAdvancedServerOps-906650219", "security_groups": [{"name": "tempest-secgroup-smoke-811508586"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:00:58.117322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] validate_networks() for [('1f44e229-0550-4acf-869b-a8ac8dc0c3ff', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 22:00:58.573925 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 22:00:58.574984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 22:00:58.579706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 22:00:58.579706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 22:00:58.579706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 22:00:58.592755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:58.593804 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:58.595031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:58.595675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:58.628326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for project 38d3db1f6443461f90a5be23358b6816. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 22:00:58.635645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for user 56b376ad4a314418bca5fcbf8a8ca429 and project 38d3db1f6443461f90a5be23358b6816. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 22:00:58.650879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 22:00:58.653230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 22:00:58.758547 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dd8a8594-7c59-4586-ab8d-85b446ddabd3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.864861 May 28 22:00:58.759318 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3478/6916] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 22:00:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 22:00:58.767249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=36 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:00:58.772268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-46ed3a0f-edbc-4ca2-b776-c477c75291cd tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:58.772268 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-46ed3a0f-edbc-4ca2-b776-c477c75291cd tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:58.872207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-46ed3a0f-edbc-4ca2-b776-c477c75291cd tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:00:58.879782 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-46ed3a0f-edbc-4ca2-b776-c477c75291cd tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1265 microversion: 2.1 time: 0.114416 May 28 22:00:58.882039 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3439/6917] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:58 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1265 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:00:59.900749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fc96e5e3-1cab-4e1a-bcc4-95547dea38a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:00:59.902113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fc96e5e3-1cab-4e1a-bcc4-95547dea38a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:00:59.910857 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc96e5e3-1cab-4e1a-bcc4-95547dea38a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:59.911443 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc96e5e3-1cab-4e1a-bcc4-95547dea38a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:59.912372 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc96e5e3-1cab-4e1a-bcc4-95547dea38a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:00:59.912917 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fc96e5e3-1cab-4e1a-bcc4-95547dea38a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:00:59.989216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fc96e5e3-1cab-4e1a-bcc4-95547dea38a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:00:59.997394 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fc96e5e3-1cab-4e1a-bcc4-95547dea38a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1269 microversion: 2.1 time: 0.102102 May 28 22:00:59.999122 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3479/6918] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:00:59 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1269 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:01.015903 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-da5acd17-7a76-4038-bb18-1c2daa066d96 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:01.016552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-da5acd17-7a76-4038-bb18-1c2daa066d96 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:01.024427 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da5acd17-7a76-4038-bb18-1c2daa066d96 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:01.024914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da5acd17-7a76-4038-bb18-1c2daa066d96 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:01.025706 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da5acd17-7a76-4038-bb18-1c2daa066d96 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:01.026378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-da5acd17-7a76-4038-bb18-1c2daa066d96 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:01.099355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-da5acd17-7a76-4038-bb18-1c2daa066d96 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:01.107161 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-da5acd17-7a76-4038-bb18-1c2daa066d96 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1323 microversion: 2.1 time: 0.095939 May 28 22:01:01.108473 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3440/6919] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:01 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1323 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:02.124273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3e70a65e-434e-4151-87f8-41b20c3a3265 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:02.125345 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3e70a65e-434e-4151-87f8-41b20c3a3265 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:02.133630 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e70a65e-434e-4151-87f8-41b20c3a3265 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:02.134229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e70a65e-434e-4151-87f8-41b20c3a3265 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:02.135149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e70a65e-434e-4151-87f8-41b20c3a3265 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:02.135667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e70a65e-434e-4151-87f8-41b20c3a3265 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:02.386923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3e70a65e-434e-4151-87f8-41b20c3a3265 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:02.390813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-b08a1f10-860e-4ffc-b01c-b99b441c5a62 req-cebe0699-29e4-4eab-8dfd-de1ef60c83ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749", "tag": "c11af0b4-2610-47f4-99a3-d852fe5e4718"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:01:02.397157 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3e70a65e-434e-4151-87f8-41b20c3a3265 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1390 microversion: 2.1 time: 0.276742 May 28 22:01:02.398209 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3480/6920] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:02 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1390 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:02.412278 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b08a1f10-860e-4ffc-b01c-b99b441c5a62 req-cebe0699-29e4-4eab-8dfd-de1ef60c83ff service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:02.412758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-b08a1f10-860e-4ffc-b01c-b99b441c5a62 req-cebe0699-29e4-4eab-8dfd-de1ef60c83ff service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:02.425542 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-b08a1f10-860e-4ffc-b01c-b99b441c5a62 req-cebe0699-29e4-4eab-8dfd-de1ef60c83ff service nova] Creating event network-changed:c11af0b4-2610-47f4-99a3-d852fe5e4718 for instance fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 on nch1-master-1 May 28 22:01:02.430751 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-b08a1f10-860e-4ffc-b01c-b99b441c5a62 req-cebe0699-29e4-4eab-8dfd-de1ef60c83ff service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051452 May 28 22:01:02.433398 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3441/6921] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:01:03.414113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-963f852b-2ac0-46ba-a7dd-daaa58aa801a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:03.414662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-963f852b-2ac0-46ba-a7dd-daaa58aa801a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:03.421698 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-963f852b-2ac0-46ba-a7dd-daaa58aa801a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:03.422266 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-963f852b-2ac0-46ba-a7dd-daaa58aa801a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:03.423039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-963f852b-2ac0-46ba-a7dd-daaa58aa801a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:03.423489 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-963f852b-2ac0-46ba-a7dd-daaa58aa801a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:03.555709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-963f852b-2ac0-46ba-a7dd-daaa58aa801a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:03.563508 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-963f852b-2ac0-46ba-a7dd-daaa58aa801a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1390 microversion: 2.1 time: 0.153439 May 28 22:01:03.564095 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3481/6922] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:03 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:04.582123 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7221cc74-8e07-4323-9ba1-2641cdee2861 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:04.582848 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7221cc74-8e07-4323-9ba1-2641cdee2861 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:04.589154 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7221cc74-8e07-4323-9ba1-2641cdee2861 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:04.589624 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7221cc74-8e07-4323-9ba1-2641cdee2861 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:04.590439 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7221cc74-8e07-4323-9ba1-2641cdee2861 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:04.590896 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7221cc74-8e07-4323-9ba1-2641cdee2861 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:04.800868 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7221cc74-8e07-4323-9ba1-2641cdee2861 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:04.808575 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7221cc74-8e07-4323-9ba1-2641cdee2861 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1390 microversion: 2.1 time: 0.231593 May 28 22:01:04.809158 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3442/6923] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:04 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1390 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:05.825731 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4cc3fc72-5366-4664-9f09-ce8acb6d07b3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:05.826896 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4cc3fc72-5366-4664-9f09-ce8acb6d07b3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:05.833976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4cc3fc72-5366-4664-9f09-ce8acb6d07b3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:05.834440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4cc3fc72-5366-4664-9f09-ce8acb6d07b3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:05.835220 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4cc3fc72-5366-4664-9f09-ce8acb6d07b3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:05.835675 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4cc3fc72-5366-4664-9f09-ce8acb6d07b3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:05.971241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4cc3fc72-5366-4664-9f09-ce8acb6d07b3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:05.978741 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4cc3fc72-5366-4664-9f09-ce8acb6d07b3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1390 microversion: 2.1 time: 0.157394 May 28 22:01:05.979784 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3482/6924] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:05 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1390 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:06.996235 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7401cda0-471a-46fb-8e63-d6d772dc76ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:06.996877 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7401cda0-471a-46fb-8e63-d6d772dc76ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:07.000192 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:01:07.005056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7401cda0-471a-46fb-8e63-d6d772dc76ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:07.005527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7401cda0-471a-46fb-8e63-d6d772dc76ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:07.006350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7401cda0-471a-46fb-8e63-d6d772dc76ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:07.006810 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7401cda0-471a-46fb-8e63-d6d772dc76ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:07.138423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7401cda0-471a-46fb-8e63-d6d772dc76ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:07.146706 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7401cda0-471a-46fb-8e63-d6d772dc76ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1390 microversion: 2.1 time: 0.154432 May 28 22:01:07.147300 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3443/6925] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:06 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:07.405521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-36c77bdc-cf1c-410c-87b5-7a6a4de15d34 req-1ff5f8c0-0219-484e-b588-9c188c7c2081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749", "name": "network-vif-plugged", "status": "completed", "tag": "c11af0b4-2610-47f4-99a3-d852fe5e4718"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:01:07.409082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:01:07.414463 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-36c77bdc-cf1c-410c-87b5-7a6a4de15d34 req-1ff5f8c0-0219-484e-b588-9c188c7c2081 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:07.414962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-36c77bdc-cf1c-410c-87b5-7a6a4de15d34 req-1ff5f8c0-0219-484e-b588-9c188c7c2081 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:07.426686 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-36c77bdc-cf1c-410c-87b5-7a6a4de15d34 req-1ff5f8c0-0219-484e-b588-9c188c7c2081 service nova] Creating event network-vif-plugged:c11af0b4-2610-47f4-99a3-d852fe5e4718 for instance fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 on nch1-master-1 May 28 22:01:07.432469 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-36c77bdc-cf1c-410c-87b5-7a6a4de15d34 req-1ff5f8c0-0219-484e-b588-9c188c7c2081 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088453 May 28 22:01:07.432469 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3483/6926] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:01:08.163635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ea38aa03-b1c6-4dcf-bcec-4c643ec21833 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:08.302001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ea38aa03-b1c6-4dcf-bcec-4c643ec21833 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:08.302001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea38aa03-b1c6-4dcf-bcec-4c643ec21833 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:08.302001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea38aa03-b1c6-4dcf-bcec-4c643ec21833 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:08.302001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea38aa03-b1c6-4dcf-bcec-4c643ec21833 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:08.302001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ea38aa03-b1c6-4dcf-bcec-4c643ec21833 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:08.308977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ea38aa03-b1c6-4dcf-bcec-4c643ec21833 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:08.316437 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ea38aa03-b1c6-4dcf-bcec-4c643ec21833 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1390 microversion: 2.1 time: 0.156945 May 28 22:01:08.317002 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3444/6927] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:08 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:01:09.330634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:01:09.331542 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:01:09.335556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f1631ba3-b271-4e36-a2bb-f7f7a5c0e3a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:09.336308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f1631ba3-b271-4e36-a2bb-f7f7a5c0e3a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:09.343664 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1631ba3-b271-4e36-a2bb-f7f7a5c0e3a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:09.344121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1631ba3-b271-4e36-a2bb-f7f7a5c0e3a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:09.344894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1631ba3-b271-4e36-a2bb-f7f7a5c0e3a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:09.345341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f1631ba3-b271-4e36-a2bb-f7f7a5c0e3a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:09.481559 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f1631ba3-b271-4e36-a2bb-f7f7a5c0e3a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:09.489390 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f1631ba3-b271-4e36-a2bb-f7f7a5c0e3a6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1563 microversion: 2.1 time: 0.160524 May 28 22:01:09.490003 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3484/6928] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:09 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:09.505286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2b7d2a31-1172-4b53-b50e-87c13066b05a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:09.505947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2b7d2a31-1172-4b53-b50e-87c13066b05a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:09.507936 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:01:09.514195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b7d2a31-1172-4b53-b50e-87c13066b05a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:09.519632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b7d2a31-1172-4b53-b50e-87c13066b05a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:09.519632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b7d2a31-1172-4b53-b50e-87c13066b05a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:09.519632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b7d2a31-1172-4b53-b50e-87c13066b05a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:09.648109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2b7d2a31-1172-4b53-b50e-87c13066b05a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:09.656489 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2b7d2a31-1172-4b53-b50e-87c13066b05a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1563 microversion: 2.1 time: 0.155120 May 28 22:01:09.657085 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3445/6929] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:09 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:11.942918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-91f0761a-6dca-4d6e-834b-26a981e6ba64 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:11.943560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-91f0761a-6dca-4d6e-834b-26a981e6ba64 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:11.953008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91f0761a-6dca-4d6e-834b-26a981e6ba64 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:11.953479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91f0761a-6dca-4d6e-834b-26a981e6ba64 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:11.954303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91f0761a-6dca-4d6e-834b-26a981e6ba64 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:11.954890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91f0761a-6dca-4d6e-834b-26a981e6ba64 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:12.020488 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-39c1ca6f-1be3-403f-808f-38f831c83ff8 req-a1f8c47a-063c-4491-b2cd-9c734d90ca02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749", "tag": "c11af0b4-2610-47f4-99a3-d852fe5e4718"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:01:12.032495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-39c1ca6f-1be3-403f-808f-38f831c83ff8 req-a1f8c47a-063c-4491-b2cd-9c734d90ca02 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:12.033504 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-39c1ca6f-1be3-403f-808f-38f831c83ff8 req-a1f8c47a-063c-4491-b2cd-9c734d90ca02 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:12.115350 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-91f0761a-6dca-4d6e-834b-26a981e6ba64 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:12.124060 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-91f0761a-6dca-4d6e-834b-26a981e6ba64 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1563 microversion: 2.1 time: 0.185879 May 28 22:01:12.124912 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3485/6930] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:11 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1563 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:12.328692 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-39c1ca6f-1be3-403f-808f-38f831c83ff8 req-a1f8c47a-063c-4491-b2cd-9c734d90ca02 service nova] Creating event network-changed:c11af0b4-2610-47f4-99a3-d852fe5e4718 for instance fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 on nch1-master-1 May 28 22:01:12.333776 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-39c1ca6f-1be3-403f-808f-38f831c83ff8 req-a1f8c47a-063c-4491-b2cd-9c734d90ca02 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.393497 May 28 22:01:12.334718 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3446/6931] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 22:01:33.365043 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-108bcea1-51c3-4a5e-bcf4-09b5a169111d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:01:33.365976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-108bcea1-51c3-4a5e-bcf4-09b5a169111d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:33.368309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=5 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:01:33.368984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=40 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:01:33.373814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-108bcea1-51c3-4a5e-bcf4-09b5a169111d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:33.374320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-108bcea1-51c3-4a5e-bcf4-09b5a169111d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:33.375090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-108bcea1-51c3-4a5e-bcf4-09b5a169111d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:33.375617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-108bcea1-51c3-4a5e-bcf4-09b5a169111d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:33.428454 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-108bcea1-51c3-4a5e-bcf4-09b5a169111d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749/action" status: 200 len: 24573 microversion: 2.1 time: 0.067274 May 28 22:01:33.429120 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3486/6932] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:01:33 2022] POST /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749/action => generated 24573 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 22:01:44.557073 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=7 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:01:44.557997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=34 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:01:44.562697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8545a10a-4a0b-4f56-99bb-46cf584f68aa tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:01:44.563725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8545a10a-4a0b-4f56-99bb-46cf584f68aa tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:44.570282 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8545a10a-4a0b-4f56-99bb-46cf584f68aa tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:44.574239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8545a10a-4a0b-4f56-99bb-46cf584f68aa tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:44.574239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8545a10a-4a0b-4f56-99bb-46cf584f68aa tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:44.574239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8545a10a-4a0b-4f56-99bb-46cf584f68aa tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:44.773811 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8545a10a-4a0b-4f56-99bb-46cf584f68aa tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749/action" status: 202 len: 0 microversion: 2.1 time: 0.218600 May 28 22:01:44.774468 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3447/6933] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:01:44 2022] POST /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:01:44.783872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5ecf9d77-f981-4183-9d12-e35841dc53ee tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:44.784598 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5ecf9d77-f981-4183-9d12-e35841dc53ee tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:44.787894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:01:44.793449 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ecf9d77-f981-4183-9d12-e35841dc53ee tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:44.793972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ecf9d77-f981-4183-9d12-e35841dc53ee tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:44.794757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ecf9d77-f981-4183-9d12-e35841dc53ee tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:44.795216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ecf9d77-f981-4183-9d12-e35841dc53ee tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:44.930684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5ecf9d77-f981-4183-9d12-e35841dc53ee tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:44.938460 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5ecf9d77-f981-4183-9d12-e35841dc53ee tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1674 microversion: 2.1 time: 0.159536 May 28 22:01:44.939042 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3487/6934] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:44 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:45.957446 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dbade0b7-cd72-4256-9eb4-b3a83d29ab74 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:45.958206 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dbade0b7-cd72-4256-9eb4-b3a83d29ab74 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:45.964833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dbade0b7-cd72-4256-9eb4-b3a83d29ab74 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:45.965314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dbade0b7-cd72-4256-9eb4-b3a83d29ab74 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:45.966191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dbade0b7-cd72-4256-9eb4-b3a83d29ab74 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:45.966659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dbade0b7-cd72-4256-9eb4-b3a83d29ab74 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:46.101080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dbade0b7-cd72-4256-9eb4-b3a83d29ab74 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:46.110456 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dbade0b7-cd72-4256-9eb4-b3a83d29ab74 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1679 microversion: 2.1 time: 0.158105 May 28 22:01:46.111029 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3448/6935] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:45 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:47.128295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-936eeee8-dfb8-467f-90e3-f9f6ad1d684b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:47.128923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-936eeee8-dfb8-467f-90e3-f9f6ad1d684b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:47.136025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-936eeee8-dfb8-467f-90e3-f9f6ad1d684b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:47.136486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-936eeee8-dfb8-467f-90e3-f9f6ad1d684b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:47.137262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-936eeee8-dfb8-467f-90e3-f9f6ad1d684b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:47.137709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-936eeee8-dfb8-467f-90e3-f9f6ad1d684b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:47.270962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-936eeee8-dfb8-467f-90e3-f9f6ad1d684b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:47.278564 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-936eeee8-dfb8-467f-90e3-f9f6ad1d684b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1679 microversion: 2.1 time: 0.154727 May 28 22:01:47.283255 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3488/6936] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:47 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:48.295831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-cb05a605-b105-44f0-9a8d-5ad0ba721774 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:48.296506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-cb05a605-b105-44f0-9a8d-5ad0ba721774 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:48.303568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb05a605-b105-44f0-9a8d-5ad0ba721774 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:48.304030 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb05a605-b105-44f0-9a8d-5ad0ba721774 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:48.304895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb05a605-b105-44f0-9a8d-5ad0ba721774 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:48.305334 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-cb05a605-b105-44f0-9a8d-5ad0ba721774 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:48.434147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-cb05a605-b105-44f0-9a8d-5ad0ba721774 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:48.442597 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-cb05a605-b105-44f0-9a8d-5ad0ba721774 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1679 microversion: 2.1 time: 0.150717 May 28 22:01:48.443166 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3449/6937] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:48 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:49.460086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-94b940ac-8440-43d1-8cf6-f8bc8797c064 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:49.460620 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-94b940ac-8440-43d1-8cf6-f8bc8797c064 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:49.467725 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94b940ac-8440-43d1-8cf6-f8bc8797c064 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:49.468179 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94b940ac-8440-43d1-8cf6-f8bc8797c064 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:49.468959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94b940ac-8440-43d1-8cf6-f8bc8797c064 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:49.469436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94b940ac-8440-43d1-8cf6-f8bc8797c064 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:49.604182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-94b940ac-8440-43d1-8cf6-f8bc8797c064 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:49.611804 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-94b940ac-8440-43d1-8cf6-f8bc8797c064 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1679 microversion: 2.1 time: 0.155901 May 28 22:01:49.612378 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3489/6938] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:49 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:50.628991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f5cadd41-3d4f-46d7-9dac-48349eef93f4 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:50.629631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f5cadd41-3d4f-46d7-9dac-48349eef93f4 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:50.636676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5cadd41-3d4f-46d7-9dac-48349eef93f4 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:50.637147 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5cadd41-3d4f-46d7-9dac-48349eef93f4 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:50.637959 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5cadd41-3d4f-46d7-9dac-48349eef93f4 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:50.638423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f5cadd41-3d4f-46d7-9dac-48349eef93f4 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:50.766751 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f5cadd41-3d4f-46d7-9dac-48349eef93f4 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:50.774459 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f5cadd41-3d4f-46d7-9dac-48349eef93f4 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1679 microversion: 2.1 time: 0.149488 May 28 22:01:50.775028 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3450/6939] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:50 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:51.792048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-018dc0da-c480-46ce-bcaf-3fa50a50b274 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:51.792676 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-018dc0da-c480-46ce-bcaf-3fa50a50b274 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:51.800293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-018dc0da-c480-46ce-bcaf-3fa50a50b274 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:51.800756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-018dc0da-c480-46ce-bcaf-3fa50a50b274 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:51.801562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-018dc0da-c480-46ce-bcaf-3fa50a50b274 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:51.802053 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-018dc0da-c480-46ce-bcaf-3fa50a50b274 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:51.940354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-018dc0da-c480-46ce-bcaf-3fa50a50b274 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:51.947946 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-018dc0da-c480-46ce-bcaf-3fa50a50b274 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1679 microversion: 2.1 time: 0.159817 May 28 22:01:51.948796 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3490/6940] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:51 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:52.965211 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-47c5ce59-ffdb-4104-92e0-f417cef121da tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:52.965861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-47c5ce59-ffdb-4104-92e0-f417cef121da tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:52.973323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47c5ce59-ffdb-4104-92e0-f417cef121da tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:52.973793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47c5ce59-ffdb-4104-92e0-f417cef121da tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:52.974610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47c5ce59-ffdb-4104-92e0-f417cef121da tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:52.975070 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47c5ce59-ffdb-4104-92e0-f417cef121da tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:53.106415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-47c5ce59-ffdb-4104-92e0-f417cef121da tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:53.114685 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-47c5ce59-ffdb-4104-92e0-f417cef121da tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1679 microversion: 2.1 time: 0.153373 May 28 22:01:53.115256 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3451/6941] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:52 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:54.132101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-547a2c56-90fe-4877-ad19-d36e73d7142d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:54.132757 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-547a2c56-90fe-4877-ad19-d36e73d7142d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:54.139384 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-547a2c56-90fe-4877-ad19-d36e73d7142d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:54.141071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-547a2c56-90fe-4877-ad19-d36e73d7142d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:54.141071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-547a2c56-90fe-4877-ad19-d36e73d7142d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:54.141071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-547a2c56-90fe-4877-ad19-d36e73d7142d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:54.547229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-547a2c56-90fe-4877-ad19-d36e73d7142d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:54.554888 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-547a2c56-90fe-4877-ad19-d36e73d7142d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1679 microversion: 2.1 time: 0.426716 May 28 22:01:54.555461 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3491/6942] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:54 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1679 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:55.572525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-af924084-a95e-4682-91f8-e31d94d2d9ac tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:55.573410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-af924084-a95e-4682-91f8-e31d94d2d9ac tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:55.580558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af924084-a95e-4682-91f8-e31d94d2d9ac tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:55.581032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af924084-a95e-4682-91f8-e31d94d2d9ac tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:55.581821 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af924084-a95e-4682-91f8-e31d94d2d9ac tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:55.582370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af924084-a95e-4682-91f8-e31d94d2d9ac tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:55.713972 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-af924084-a95e-4682-91f8-e31d94d2d9ac tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:55.722188 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-af924084-a95e-4682-91f8-e31d94d2d9ac tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1679 microversion: 2.1 time: 0.153647 May 28 22:01:55.722763 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3452/6943] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:55 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:56.739435 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5b83a0be-0f79-4348-9369-0797b9c2a9a7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:56.740007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5b83a0be-0f79-4348-9369-0797b9c2a9a7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:56.746901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b83a0be-0f79-4348-9369-0797b9c2a9a7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:56.747385 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b83a0be-0f79-4348-9369-0797b9c2a9a7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:56.748167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b83a0be-0f79-4348-9369-0797b9c2a9a7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:56.748638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5b83a0be-0f79-4348-9369-0797b9c2a9a7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:56.879370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5b83a0be-0f79-4348-9369-0797b9c2a9a7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:56.886863 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5b83a0be-0f79-4348-9369-0797b9c2a9a7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1679 microversion: 2.1 time: 0.151605 May 28 22:01:56.887425 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3492/6944] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:56 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:57.903814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-978d8100-779b-4e92-ba48-b49b5f72c7ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:57.904415 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-978d8100-779b-4e92-ba48-b49b5f72c7ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:57.912037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-978d8100-779b-4e92-ba48-b49b5f72c7ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:57.912507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-978d8100-779b-4e92-ba48-b49b5f72c7ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:57.913327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-978d8100-779b-4e92-ba48-b49b5f72c7ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:57.914006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-978d8100-779b-4e92-ba48-b49b5f72c7ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:58.047802 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-978d8100-779b-4e92-ba48-b49b5f72c7ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:58.056262 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-978d8100-779b-4e92-ba48-b49b5f72c7ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1679 microversion: 2.1 time: 0.156379 May 28 22:01:58.057057 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3453/6945] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:57 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:01:59.073575 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6653216e-df5e-449b-a746-c1aa69b408c9 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:01:59.074249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6653216e-df5e-449b-a746-c1aa69b408c9 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:01:59.081774 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6653216e-df5e-449b-a746-c1aa69b408c9 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:59.082259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6653216e-df5e-449b-a746-c1aa69b408c9 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:59.083032 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6653216e-df5e-449b-a746-c1aa69b408c9 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:01:59.083478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6653216e-df5e-449b-a746-c1aa69b408c9 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:01:59.211158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6653216e-df5e-449b-a746-c1aa69b408c9 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:01:59.218653 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6653216e-df5e-449b-a746-c1aa69b408c9 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1679 microversion: 2.1 time: 0.149220 May 28 22:01:59.219215 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3493/6946] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:01:59 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:02:00.235555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e6ca4c68-442c-4537-8fcc-96c509a5696a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:00.236187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e6ca4c68-442c-4537-8fcc-96c509a5696a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:00.243224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6ca4c68-442c-4537-8fcc-96c509a5696a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:00.243689 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6ca4c68-442c-4537-8fcc-96c509a5696a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:00.244474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6ca4c68-442c-4537-8fcc-96c509a5696a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:00.244932 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e6ca4c68-442c-4537-8fcc-96c509a5696a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:00.376001 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e6ca4c68-442c-4537-8fcc-96c509a5696a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:02:00.383746 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e6ca4c68-442c-4537-8fcc-96c509a5696a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1679 microversion: 2.1 time: 0.152088 May 28 22:02:00.384378 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3454/6947] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:02:00 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:02:01.401563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-282d2666-7865-4558-8613-8ca0fe32ab71 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:01.402147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-282d2666-7865-4558-8613-8ca0fe32ab71 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:01.409709 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-282d2666-7865-4558-8613-8ca0fe32ab71 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:01.410208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-282d2666-7865-4558-8613-8ca0fe32ab71 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:01.410988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-282d2666-7865-4558-8613-8ca0fe32ab71 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:01.411444 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-282d2666-7865-4558-8613-8ca0fe32ab71 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:01.544402 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-282d2666-7865-4558-8613-8ca0fe32ab71 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:02:01.554083 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-282d2666-7865-4558-8613-8ca0fe32ab71 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1679 microversion: 2.1 time: 0.156390 May 28 22:02:01.554924 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3494/6948] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:02:01 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:02:02.572023 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b7c15916-eb01-4369-94b9-42728f550f3f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:02.572680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b7c15916-eb01-4369-94b9-42728f550f3f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:02.582790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7c15916-eb01-4369-94b9-42728f550f3f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:02.583259 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7c15916-eb01-4369-94b9-42728f550f3f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:02.584041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7c15916-eb01-4369-94b9-42728f550f3f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:02.584499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b7c15916-eb01-4369-94b9-42728f550f3f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:02.712991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b7c15916-eb01-4369-94b9-42728f550f3f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:02:02.722981 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b7c15916-eb01-4369-94b9-42728f550f3f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1682 microversion: 2.1 time: 0.154891 May 28 22:02:02.723563 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3455/6949] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:02:02 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:02:26.905789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7fb108d6-67cd-4a86-993a-fb670844a54e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:02:26.906761 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7fb108d6-67cd-4a86-993a-fb670844a54e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:26.909066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=16 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:02:26.909791 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=52 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:02:26.916633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fb108d6-67cd-4a86-993a-fb670844a54e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:26.917165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fb108d6-67cd-4a86-993a-fb670844a54e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:26.917946 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fb108d6-67cd-4a86-993a-fb670844a54e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:26.924700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7fb108d6-67cd-4a86-993a-fb670844a54e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:26.975239 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7fb108d6-67cd-4a86-993a-fb670844a54e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749/action" status: 200 len: 69214 microversion: 2.1 time: 0.073786 May 28 22:02:26.975826 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3495/6950] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:02:26 2022] POST /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749/action => generated 69214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 22:02:34.134220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4bc23fe7-aaf8-490d-917e-a0813cbb3fc7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:34.134220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4bc23fe7-aaf8-490d-917e-a0813cbb3fc7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:34.134220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=18 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:02:34.134220 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:02:34.137939 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bc23fe7-aaf8-490d-917e-a0813cbb3fc7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:34.138451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bc23fe7-aaf8-490d-917e-a0813cbb3fc7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:34.139270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bc23fe7-aaf8-490d-917e-a0813cbb3fc7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:34.139736 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4bc23fe7-aaf8-490d-917e-a0813cbb3fc7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:34.170575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4bc23fe7-aaf8-490d-917e-a0813cbb3fc7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 22:02:34.236101 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-042e6bcb-1d00-4c62-adc5-59a6e5b0d07d req-f190fd44-c9c0-4f9c-969a-500619ff6110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749", "tag": "c11af0b4-2610-47f4-99a3-d852fe5e4718"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:02:34.246381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-042e6bcb-1d00-4c62-adc5-59a6e5b0d07d req-f190fd44-c9c0-4f9c-969a-500619ff6110 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:34.246867 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-042e6bcb-1d00-4c62-adc5-59a6e5b0d07d req-f190fd44-c9c0-4f9c-969a-500619ff6110 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:34.257921 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-042e6bcb-1d00-4c62-adc5-59a6e5b0d07d req-f190fd44-c9c0-4f9c-969a-500619ff6110 service nova] Creating event network-changed:c11af0b4-2610-47f4-99a3-d852fe5e4718 for instance fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 on nch1-master-1 May 28 22:02:34.263428 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-042e6bcb-1d00-4c62-adc5-59a6e5b0d07d req-f190fd44-c9c0-4f9c-969a-500619ff6110 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088936 May 28 22:02:34.264023 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3496/6951] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 22:02:34.488084 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4bc23fe7-aaf8-490d-917e-a0813cbb3fc7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 204 len: 0 microversion: 2.1 time: 0.361936 May 28 22:02:34.488084 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3456/6952] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 22:02:34 2022] DELETE /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 22:02:34.497081 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0ef5d77c-56f1-403e-9c8c-2ce04ea83758 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:34.498107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0ef5d77c-56f1-403e-9c8c-2ce04ea83758 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:34.505454 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ef5d77c-56f1-403e-9c8c-2ce04ea83758 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:34.505951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ef5d77c-56f1-403e-9c8c-2ce04ea83758 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:34.506750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ef5d77c-56f1-403e-9c8c-2ce04ea83758 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:34.507204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0ef5d77c-56f1-403e-9c8c-2ce04ea83758 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:34.652140 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0ef5d77c-56f1-403e-9c8c-2ce04ea83758 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:02:34.660221 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0ef5d77c-56f1-403e-9c8c-2ce04ea83758 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1688 microversion: 2.1 time: 0.167379 May 28 22:02:34.660810 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3497/6953] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:02:34 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:02:35.679522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-59f108b6-6b64-4e0e-8586-15884728320d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:35.680186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-59f108b6-6b64-4e0e-8586-15884728320d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:35.687976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59f108b6-6b64-4e0e-8586-15884728320d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:35.688452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59f108b6-6b64-4e0e-8586-15884728320d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:35.689257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59f108b6-6b64-4e0e-8586-15884728320d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:35.689721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-59f108b6-6b64-4e0e-8586-15884728320d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:35.827060 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-59f108b6-6b64-4e0e-8586-15884728320d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:02:35.834869 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-59f108b6-6b64-4e0e-8586-15884728320d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1688 microversion: 2.1 time: 0.160679 May 28 22:02:35.835460 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3457/6954] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:02:35 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:02:36.568530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-15c98a2e-5570-483b-bfb6-5cc845d7d7c0 req-e5d2312b-d745-4c28-97bb-c601b80bae6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749", "name": "network-vif-deleted", "tag": "c11af0b4-2610-47f4-99a3-d852fe5e4718"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:02:36.577139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-15c98a2e-5570-483b-bfb6-5cc845d7d7c0 req-e5d2312b-d745-4c28-97bb-c601b80bae6f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:36.584057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-15c98a2e-5570-483b-bfb6-5cc845d7d7c0 req-e5d2312b-d745-4c28-97bb-c601b80bae6f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:36.589120 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-15c98a2e-5570-483b-bfb6-5cc845d7d7c0 req-e5d2312b-d745-4c28-97bb-c601b80bae6f service nova] Creating event network-vif-deleted:c11af0b4-2610-47f4-99a3-d852fe5e4718 for instance fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 on nch1-master-1 May 28 22:02:36.594280 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-15c98a2e-5570-483b-bfb6-5cc845d7d7c0 req-e5d2312b-d745-4c28-97bb-c601b80bae6f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081459 May 28 22:02:36.594866 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3498/6955] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:02:36.852925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-307b76c8-363d-4abd-86b7-709b09774ea2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:36.853566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-307b76c8-363d-4abd-86b7-709b09774ea2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:36.861425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-307b76c8-363d-4abd-86b7-709b09774ea2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:36.862094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-307b76c8-363d-4abd-86b7-709b09774ea2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:36.863031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-307b76c8-363d-4abd-86b7-709b09774ea2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:36.863507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-307b76c8-363d-4abd-86b7-709b09774ea2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:36.900805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-307b76c8-363d-4abd-86b7-709b09774ea2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:36.901242 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-307b76c8-363d-4abd-86b7-709b09774ea2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:36.901805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-307b76c8-363d-4abd-86b7-709b09774ea2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lazy-loading 'fault' on Instance uuid fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 22:02:36.942405 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-307b76c8-363d-4abd-86b7-709b09774ea2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:02:36.950138 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-307b76c8-363d-4abd-86b7-709b09774ea2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 200 len: 1355 microversion: 2.1 time: 0.101376 May 28 22:02:36.950724 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3458/6956] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:02:36 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 1355 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:02:37.968285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2ab88e5e-d952-48e6-8f88-834be872751f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:37.969036 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2ab88e5e-d952-48e6-8f88-834be872751f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:37.976355 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ab88e5e-d952-48e6-8f88-834be872751f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:37.976824 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ab88e5e-d952-48e6-8f88-834be872751f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:37.977612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ab88e5e-d952-48e6-8f88-834be872751f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:37.978096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2ab88e5e-d952-48e6-8f88-834be872751f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:37.992550 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-2ab88e5e-d952-48e6-8f88-834be872751f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] HTTP exception thrown: Instance fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 could not be found. May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2ab88e5e-d952-48e6-8f88-834be872751f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Request method failure captured: May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 HTTP/1.1 May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikptOuO8oVBSIrBTIbL1qBafkM3bRPqHRtdmD9HRzAg7Rq6Sa9lPn2eCwncLkJYy5x5D810AJAdLKgrCA2pyb1pdvaP3HK5GoIFP0N8s94-1UlDC3wszHDUtJtWOu2ExEC0RSI6YR2LI3hXkxUjTpT0O1jnASr-USfa-JS-4KnaOepP0 May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 38d3db1f6443461f90a5be23358b6816 May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-582264347 May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38d3db1f6443461f90a5be23358b6816", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d3db1f6443461f90a5be23358b6816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38d3db1f6443461f90a5be23358b6816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d3db1f6443461f90a5be23358b6816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestNetworkAdvancedServerOps-582264347 May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 38d3db1f6443461f90a5be23358b6816 May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-582264347 May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestNetworkAdvancedServerOps-582264347-project May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 56b376ad4a314418bca5fcbf8a8ca429 May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestNetworkAdvancedServerOps-582264347-project May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 could not be found. May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749'} May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 could not be found. May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 could not be found. May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:02:37.994271 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:02:37.998961 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:02:37.998961 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:02:37.998961 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:02:37.998961 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 22:02:37.998961 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 22:02:37.998961 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 could not be found. May 28 22:02:37.998961 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:02:37.998961 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2ab88e5e-d952-48e6-8f88-834be872751f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Returning 404 to user: Instance fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 22:02:37.998961 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2ab88e5e-d952-48e6-8f88-834be872751f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749" status: 404 len: 111 microversion: 2.1 time: 0.031709 May 28 22:02:37.998961 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3499/6957] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:02:37 2022] GET /compute/v2.1/servers/fd6cc1b2-f0d9-40ee-ae9a-a82c135d0749 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 22:02:41.342137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-64f6b529-9575-420e-be1d-7d4ada744ae3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '.version_select at 0x7f4d64144280>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:41.418038 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-64f6b529-9575-420e-be1d-7d4ada744ae3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-906650219" status: 202 len: 0 microversion: 2.1 time: 0.079756 May 28 22:02:41.418640 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3459/6958] 10.222.0.33 () {58 vars in 1280 bytes} [Sat May 28 22:02:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-906650219 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:02:41.448332 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bb090b2d-4a90-4921-9bf2-be3bf5f9f12c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'create', calling method: .version_select at 0x7f4d56bd0ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1746507166", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPzvL29IJUe74E8WWGrQVE2B+52ZmmsvyDsclW1rdztcR9JDl3Do1KttIOeyT79t37vJdjjyaDlJgtPsOx7LIn/lOad6TJkkBP99tCUBvVqWox0qo1knqiM8Biv3JmMhQ=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:02:41.466255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-bb090b2d-4a90-4921-9bf2-be3bf5f9f12c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for project 38d3db1f6443461f90a5be23358b6816. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 22:02:41.472245 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-bb090b2d-4a90-4921-9bf2-be3bf5f9f12c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for user 56b376ad4a314418bca5fcbf8a8ca429 and project 38d3db1f6443461f90a5be23358b6816. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 22:02:41.561994 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bb090b2d-4a90-4921-9bf2-be3bf5f9f12c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.117821 May 28 22:02:41.562533 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3500/6959] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 22:02:41 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:02:49.588709 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:02:49.592922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1175232665", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "425c939a-56d4-405e-b8ed-bc60903adf2c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1746507166", "security_groups": [{"name": "tempest-secgroup-smoke-824394099"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:02:49.710842 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] validate_networks() for [('425c939a-56d4-405e-b8ed-bc60903adf2c', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 22:02:50.225960 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 22:02:50.226414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 22:02:50.226944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 22:02:50.227414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 22:02:50.227851 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 22:02:50.239526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:50.240717 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:50.241561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:50.242095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:50.262581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for project 38d3db1f6443461f90a5be23358b6816. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 22:02:50.268599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for user 56b376ad4a314418bca5fcbf8a8ca429 and project 38d3db1f6443461f90a5be23358b6816. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 22:02:50.282983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 22:02:50.285423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 22:02:50.403976 ncdv-master-1 devstack@n-api.service[143128]: ERROR oslo.messaging._drivers.impl_rabbit [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [63d4e346-ce63-4579-a13d-e28abfa098f7] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 22:02:51.411678 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [63d4e346-ce63-4579-a13d-e28abfa098f7] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 53294. May 28 22:02:51.416736 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-30d973a0-d45e-4994-8b56-8f07969de0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.830194 May 28 22:02:51.418039 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3460/6960] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 22:02:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 22:02:51.425799 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=16 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:02:51.429829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5ab19f83-2dd6-44ea-9e96-b74a1faa4ab5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:51.430487 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5ab19f83-2dd6-44ea-9e96-b74a1faa4ab5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:51.479833 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:02:51.494188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5ab19f83-2dd6-44ea-9e96-b74a1faa4ab5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:02:51.501152 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5ab19f83-2dd6-44ea-9e96-b74a1faa4ab5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1267 microversion: 2.1 time: 0.077108 May 28 22:02:51.501822 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3501/6961] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:02:51 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1267 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:02:52.519244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bc4b492b-4ece-4861-b6df-3fdc38aa2fd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:52.519891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bc4b492b-4ece-4861-b6df-3fdc38aa2fd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:52.593180 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bc4b492b-4ece-4861-b6df-3fdc38aa2fd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:02:52.601143 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bc4b492b-4ece-4861-b6df-3fdc38aa2fd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1267 microversion: 2.1 time: 0.086586 May 28 22:02:52.601732 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3461/6962] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:02:52 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:02:53.618586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6d7eb533-c385-46bb-b553-b00332aff340 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:53.619092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6d7eb533-c385-46bb-b553-b00332aff340 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:53.681054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6d7eb533-c385-46bb-b553-b00332aff340 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:02:53.688396 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6d7eb533-c385-46bb-b553-b00332aff340 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1267 microversion: 2.1 time: 0.074332 May 28 22:02:53.688968 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3502/6963] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:02:53 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1267 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:02:54.705978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c6b48456-16f6-4906-9758-4a1a7a61ea03 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:54.706625 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c6b48456-16f6-4906-9758-4a1a7a61ea03 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:54.761418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c6b48456-16f6-4906-9758-4a1a7a61ea03 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:02:54.768254 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c6b48456-16f6-4906-9758-4a1a7a61ea03 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1267 microversion: 2.1 time: 0.066268 May 28 22:02:54.768832 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3462/6964] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:02:54 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1267 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:02:55.785459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-98bc0d9d-a99f-4e16-8c28-982546c7c5b0 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:55.786111 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-98bc0d9d-a99f-4e16-8c28-982546c7c5b0 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:55.793730 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98bc0d9d-a99f-4e16-8c28-982546c7c5b0 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:55.794216 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98bc0d9d-a99f-4e16-8c28-982546c7c5b0 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:55.794987 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98bc0d9d-a99f-4e16-8c28-982546c7c5b0 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:55.795434 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-98bc0d9d-a99f-4e16-8c28-982546c7c5b0 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:55.860307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-98bc0d9d-a99f-4e16-8c28-982546c7c5b0 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:02:55.867798 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-98bc0d9d-a99f-4e16-8c28-982546c7c5b0 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1271 microversion: 2.1 time: 0.086087 May 28 22:02:55.868365 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3503/6965] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:02:55 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:02:56.884575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-87a898ca-b6c1-43e6-b1e6-93cd28f0394f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:56.885217 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-87a898ca-b6c1-43e6-b1e6-93cd28f0394f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:56.891941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87a898ca-b6c1-43e6-b1e6-93cd28f0394f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:56.892423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87a898ca-b6c1-43e6-b1e6-93cd28f0394f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:56.893218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87a898ca-b6c1-43e6-b1e6-93cd28f0394f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:56.893684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-87a898ca-b6c1-43e6-b1e6-93cd28f0394f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:56.965049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-87a898ca-b6c1-43e6-b1e6-93cd28f0394f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:02:56.972742 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-87a898ca-b6c1-43e6-b1e6-93cd28f0394f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1319 microversion: 2.1 time: 0.092217 May 28 22:02:56.973328 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3463/6966] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:02:56 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1319 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:02:57.990514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-34d33df2-d01e-4716-8f8d-26386281bb19 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:57.991142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-34d33df2-d01e-4716-8f8d-26386281bb19 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:57.993622 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:02:57.998627 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34d33df2-d01e-4716-8f8d-26386281bb19 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:57.999082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34d33df2-d01e-4716-8f8d-26386281bb19 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:57.999858 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34d33df2-d01e-4716-8f8d-26386281bb19 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:58.000306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-34d33df2-d01e-4716-8f8d-26386281bb19 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:58.062815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-34d33df2-d01e-4716-8f8d-26386281bb19 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:02:58.071125 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-34d33df2-d01e-4716-8f8d-26386281bb19 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1325 microversion: 2.1 time: 0.084673 May 28 22:02:58.071693 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3504/6967] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:02:57 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1325 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:02:59.082791 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a968d1d8-fd6f-4c69-b681-b66d091a695c req-3a560c16-3748-43be-a50f-b731ef739327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9990818-693f-44e3-9260-63e081967773", "tag": "eb51946c-4542-403e-bef7-778dbcffcc19"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:02:59.092188 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a968d1d8-fd6f-4c69-b681-b66d091a695c req-3a560c16-3748-43be-a50f-b731ef739327 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:59.092659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a968d1d8-fd6f-4c69-b681-b66d091a695c req-3a560c16-3748-43be-a50f-b731ef739327 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:59.097304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-67aa32d0-e350-402f-915c-3bd9071b3808 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:02:59.098822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-67aa32d0-e350-402f-915c-3bd9071b3808 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:02:59.107518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67aa32d0-e350-402f-915c-3bd9071b3808 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:59.107926 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a968d1d8-fd6f-4c69-b681-b66d091a695c req-3a560c16-3748-43be-a50f-b731ef739327 service nova] Creating event network-changed:eb51946c-4542-403e-bef7-778dbcffcc19 for instance d9990818-693f-44e3-9260-63e081967773 on nch1-master-1 May 28 22:02:59.108690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67aa32d0-e350-402f-915c-3bd9071b3808 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:59.109718 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67aa32d0-e350-402f-915c-3bd9071b3808 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:02:59.110413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-67aa32d0-e350-402f-915c-3bd9071b3808 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:02:59.115437 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a968d1d8-fd6f-4c69-b681-b66d091a695c req-3a560c16-3748-43be-a50f-b731ef739327 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040139 May 28 22:02:59.116578 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3464/6968] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:02:59.278888 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-67aa32d0-e350-402f-915c-3bd9071b3808 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:02:59.286742 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-67aa32d0-e350-402f-915c-3bd9071b3808 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1392 microversion: 2.1 time: 0.194048 May 28 22:02:59.287328 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3505/6969] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:02:59 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1392 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:03:00.301486 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:03:00.306519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-af05bee0-649f-4304-ab81-8c5320f14886 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:00.307247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-af05bee0-649f-4304-ab81-8c5320f14886 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:00.313566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af05bee0-649f-4304-ab81-8c5320f14886 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:00.314029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af05bee0-649f-4304-ab81-8c5320f14886 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:00.320705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af05bee0-649f-4304-ab81-8c5320f14886 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:00.320705 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af05bee0-649f-4304-ab81-8c5320f14886 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:00.451904 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-af05bee0-649f-4304-ab81-8c5320f14886 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:00.459610 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-af05bee0-649f-4304-ab81-8c5320f14886 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1392 microversion: 2.1 time: 0.159927 May 28 22:03:00.460175 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3465/6970] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:00 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:01.476368 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-94a76cb3-97fb-40e8-af48-a0b9ae6b572c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:01.476999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-94a76cb3-97fb-40e8-af48-a0b9ae6b572c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:01.484322 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94a76cb3-97fb-40e8-af48-a0b9ae6b572c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:01.484787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94a76cb3-97fb-40e8-af48-a0b9ae6b572c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:01.485557 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94a76cb3-97fb-40e8-af48-a0b9ae6b572c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:01.486038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94a76cb3-97fb-40e8-af48-a0b9ae6b572c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:01.623949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-94a76cb3-97fb-40e8-af48-a0b9ae6b572c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:01.631509 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-94a76cb3-97fb-40e8-af48-a0b9ae6b572c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1392 microversion: 2.1 time: 0.159097 May 28 22:03:01.632091 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3506/6971] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:01 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:02.648672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0c395949-01ae-4a6e-8623-ef1231afc8c8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:02.649813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0c395949-01ae-4a6e-8623-ef1231afc8c8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:02.656900 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c395949-01ae-4a6e-8623-ef1231afc8c8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:02.657372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c395949-01ae-4a6e-8623-ef1231afc8c8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:02.658194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c395949-01ae-4a6e-8623-ef1231afc8c8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:02.658657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0c395949-01ae-4a6e-8623-ef1231afc8c8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:02.791885 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0c395949-01ae-4a6e-8623-ef1231afc8c8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:02.799491 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0c395949-01ae-4a6e-8623-ef1231afc8c8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1392 microversion: 2.1 time: 0.154872 May 28 22:03:02.800065 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3466/6972] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:02 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:03.816486 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-50114749-7c63-4221-a40d-5aed23470b8e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:03.817149 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-50114749-7c63-4221-a40d-5aed23470b8e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:03.819944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:03:03.826074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50114749-7c63-4221-a40d-5aed23470b8e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:03.826549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50114749-7c63-4221-a40d-5aed23470b8e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:03.827342 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50114749-7c63-4221-a40d-5aed23470b8e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:03.827829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-50114749-7c63-4221-a40d-5aed23470b8e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:03.964374 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-50114749-7c63-4221-a40d-5aed23470b8e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:03.972269 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-50114749-7c63-4221-a40d-5aed23470b8e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1392 microversion: 2.1 time: 0.159725 May 28 22:03:03.972854 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3507/6973] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:03 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:04.119578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-030a3030-f21a-4062-ba25-f398d4abd89d req-02e70ff0-9706-4cd1-aed6-bf9229b721f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9990818-693f-44e3-9260-63e081967773", "name": "network-vif-plugged", "status": "completed", "tag": "eb51946c-4542-403e-bef7-778dbcffcc19"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:03:04.127818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-030a3030-f21a-4062-ba25-f398d4abd89d req-02e70ff0-9706-4cd1-aed6-bf9229b721f1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:04.128284 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-030a3030-f21a-4062-ba25-f398d4abd89d req-02e70ff0-9706-4cd1-aed6-bf9229b721f1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:04.142815 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-030a3030-f21a-4062-ba25-f398d4abd89d req-02e70ff0-9706-4cd1-aed6-bf9229b721f1 service nova] Creating event network-vif-plugged:eb51946c-4542-403e-bef7-778dbcffcc19 for instance d9990818-693f-44e3-9260-63e081967773 on nch1-master-1 May 28 22:03:04.148129 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-030a3030-f21a-4062-ba25-f398d4abd89d req-02e70ff0-9706-4cd1-aed6-bf9229b721f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084709 May 28 22:03:04.149005 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3467/6974] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 22:03:04.989154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-39db6983-07f1-4cb7-b81f-5340c3f34641 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:04.989779 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-39db6983-07f1-4cb7-b81f-5340c3f34641 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:04.996859 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39db6983-07f1-4cb7-b81f-5340c3f34641 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:04.997320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39db6983-07f1-4cb7-b81f-5340c3f34641 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:04.998124 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39db6983-07f1-4cb7-b81f-5340c3f34641 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:04.998576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-39db6983-07f1-4cb7-b81f-5340c3f34641 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:05.132075 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-39db6983-07f1-4cb7-b81f-5340c3f34641 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:05.140148 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-39db6983-07f1-4cb7-b81f-5340c3f34641 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1392 microversion: 2.1 time: 0.154922 May 28 22:03:05.140709 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3508/6975] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:04 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:06.163456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-aa5b9448-39f1-4405-839a-2f19c1e58617 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:06.164187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-aa5b9448-39f1-4405-839a-2f19c1e58617 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:06.166950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=10 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:03:06.168473 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:03:06.173589 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa5b9448-39f1-4405-839a-2f19c1e58617 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:06.174164 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa5b9448-39f1-4405-839a-2f19c1e58617 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:06.174930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa5b9448-39f1-4405-839a-2f19c1e58617 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:06.175383 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-aa5b9448-39f1-4405-839a-2f19c1e58617 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:06.306534 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-aa5b9448-39f1-4405-839a-2f19c1e58617 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:06.314232 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-aa5b9448-39f1-4405-839a-2f19c1e58617 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1564 microversion: 2.1 time: 0.155098 May 28 22:03:06.314808 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3468/6976] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:06 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:06.330222 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4e2db8d8-3134-459f-ab03-f54444916836 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:06.331550 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4e2db8d8-3134-459f-ab03-f54444916836 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:06.338606 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e2db8d8-3134-459f-ab03-f54444916836 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:06.339066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e2db8d8-3134-459f-ab03-f54444916836 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:06.339835 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e2db8d8-3134-459f-ab03-f54444916836 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:06.340504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4e2db8d8-3134-459f-ab03-f54444916836 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:06.471354 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4e2db8d8-3134-459f-ab03-f54444916836 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:06.479757 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4e2db8d8-3134-459f-ab03-f54444916836 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1564 microversion: 2.1 time: 0.153292 May 28 22:03:06.489303 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3509/6977] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:06 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:08.686455 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6a9512dc-ef9e-48f1-a7a0-36eec54a8802 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:08.686975 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-bb74bab2-6738-4cc9-8fea-dd32e2f75c8e req-e99334fc-a876-4044-b8b9-ec5a46f3f61f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9990818-693f-44e3-9260-63e081967773", "tag": "eb51946c-4542-403e-bef7-778dbcffcc19"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:03:08.687343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6a9512dc-ef9e-48f1-a7a0-36eec54a8802 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:08.695548 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a9512dc-ef9e-48f1-a7a0-36eec54a8802 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:08.696675 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a9512dc-ef9e-48f1-a7a0-36eec54a8802 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:08.702367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a9512dc-ef9e-48f1-a7a0-36eec54a8802 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:08.702485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-bb74bab2-6738-4cc9-8fea-dd32e2f75c8e req-e99334fc-a876-4044-b8b9-ec5a46f3f61f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:08.702750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6a9512dc-ef9e-48f1-a7a0-36eec54a8802 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:08.702838 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-bb74bab2-6738-4cc9-8fea-dd32e2f75c8e req-e99334fc-a876-4044-b8b9-ec5a46f3f61f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:08.711544 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-bb74bab2-6738-4cc9-8fea-dd32e2f75c8e req-e99334fc-a876-4044-b8b9-ec5a46f3f61f service nova] Creating event network-changed:eb51946c-4542-403e-bef7-778dbcffcc19 for instance d9990818-693f-44e3-9260-63e081967773 on nch1-master-1 May 28 22:03:08.717168 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-bb74bab2-6738-4cc9-8fea-dd32e2f75c8e req-e99334fc-a876-4044-b8b9-ec5a46f3f61f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034157 May 28 22:03:08.718010 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3510/6978] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:03:08.850953 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6a9512dc-ef9e-48f1-a7a0-36eec54a8802 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:08.859051 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6a9512dc-ef9e-48f1-a7a0-36eec54a8802 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1564 microversion: 2.1 time: 0.178138 May 28 22:03:08.871309 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3469/6979] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:08 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1564 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:30.085076 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-65c6f132-b42f-4c1e-8b4a-ba82c41326d5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:03:30.086143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-65c6f132-b42f-4c1e-8b4a-ba82c41326d5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:30.088485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=13 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:03:30.089667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=44 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:03:30.094663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65c6f132-b42f-4c1e-8b4a-ba82c41326d5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:30.095128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65c6f132-b42f-4c1e-8b4a-ba82c41326d5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:30.095918 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65c6f132-b42f-4c1e-8b4a-ba82c41326d5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:30.096370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65c6f132-b42f-4c1e-8b4a-ba82c41326d5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:30.148932 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-65c6f132-b42f-4c1e-8b4a-ba82c41326d5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773/action" status: 200 len: 24564 microversion: 2.1 time: 0.068132 May 28 22:03:30.149575 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3511/6980] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:03:30 2022] POST /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773/action => generated 24564 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 22:03:36.570451 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-96c2ffb5-468e-449a-b887-26cea76fdd58 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:03:36.571445 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-96c2ffb5-468e-449a-b887-26cea76fdd58 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:36.574458 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:03:36.575126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=36 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:03:36.579993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96c2ffb5-468e-449a-b887-26cea76fdd58 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:36.582067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96c2ffb5-468e-449a-b887-26cea76fdd58 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:36.582067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96c2ffb5-468e-449a-b887-26cea76fdd58 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:36.582067 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96c2ffb5-468e-449a-b887-26cea76fdd58 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:36.622754 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-96c2ffb5-468e-449a-b887-26cea76fdd58 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:36.628066 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-96c2ffb5-468e-449a-b887-26cea76fdd58 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Old instance type m1.heat2, new instance type m1.heat {{(pid=143128) resize /opt/stack/nova/nova/compute/api.py:4166}} May 28 22:03:36.634320 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-96c2ffb5-468e-449a-b887-26cea76fdd58 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 22:03:36.634770 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-96c2ffb5-468e-449a-b887-26cea76fdd58 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 22:03:36.635263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-96c2ffb5-468e-449a-b887-26cea76fdd58 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 22:03:36.636201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-96c2ffb5-468e-449a-b887-26cea76fdd58 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 22:03:36.636630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-96c2ffb5-468e-449a-b887-26cea76fdd58 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 22:03:36.871191 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-96c2ffb5-468e-449a-b887-26cea76fdd58 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773/action" status: 202 len: 0 microversion: 2.1 time: 0.304271 May 28 22:03:36.871969 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3470/6981] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:03:36 2022] POST /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:03:36.880513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-51f8916c-2868-4d6e-a576-ded62d75b173 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:36.881229 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-51f8916c-2868-4d6e-a576-ded62d75b173 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:36.891008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51f8916c-2868-4d6e-a576-ded62d75b173 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:36.891478 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51f8916c-2868-4d6e-a576-ded62d75b173 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:36.892249 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51f8916c-2868-4d6e-a576-ded62d75b173 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:36.892714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-51f8916c-2868-4d6e-a576-ded62d75b173 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:37.027132 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-51f8916c-2868-4d6e-a576-ded62d75b173 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:37.034959 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-51f8916c-2868-4d6e-a576-ded62d75b173 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1692 microversion: 2.1 time: 0.158789 May 28 22:03:37.035531 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3512/6982] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:36 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:38.052843 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d45012c9-cbfb-4901-b662-e4b3cac7921f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:38.053478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d45012c9-cbfb-4901-b662-e4b3cac7921f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:38.060777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d45012c9-cbfb-4901-b662-e4b3cac7921f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:38.061233 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d45012c9-cbfb-4901-b662-e4b3cac7921f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:38.062051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d45012c9-cbfb-4901-b662-e4b3cac7921f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:38.062516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d45012c9-cbfb-4901-b662-e4b3cac7921f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:38.207983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d45012c9-cbfb-4901-b662-e4b3cac7921f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:38.216359 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d45012c9-cbfb-4901-b662-e4b3cac7921f tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1692 microversion: 2.1 time: 0.167576 May 28 22:03:38.216936 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3471/6983] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:38 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:39.234509 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c177724b-7e3e-4c67-88a9-4a6c9d975921 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:39.241526 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c177724b-7e3e-4c67-88a9-4a6c9d975921 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:39.243011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c177724b-7e3e-4c67-88a9-4a6c9d975921 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:39.243480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c177724b-7e3e-4c67-88a9-4a6c9d975921 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:39.244303 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c177724b-7e3e-4c67-88a9-4a6c9d975921 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:39.244756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c177724b-7e3e-4c67-88a9-4a6c9d975921 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:39.381430 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c177724b-7e3e-4c67-88a9-4a6c9d975921 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:39.389095 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c177724b-7e3e-4c67-88a9-4a6c9d975921 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1692 microversion: 2.1 time: 0.159201 May 28 22:03:39.389668 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3513/6984] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:39 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:40.406132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9defa89c-6387-473a-8c36-de62b748a375 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:40.407069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9defa89c-6387-473a-8c36-de62b748a375 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:40.414159 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9defa89c-6387-473a-8c36-de62b748a375 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:40.414630 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9defa89c-6387-473a-8c36-de62b748a375 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:40.415417 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9defa89c-6387-473a-8c36-de62b748a375 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:40.415876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9defa89c-6387-473a-8c36-de62b748a375 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:40.548416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9defa89c-6387-473a-8c36-de62b748a375 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:40.556070 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9defa89c-6387-473a-8c36-de62b748a375 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1697 microversion: 2.1 time: 0.154635 May 28 22:03:40.556654 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3472/6985] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:40 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:41.574441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1a323953-4006-4ce9-b7fd-2e44493dccd8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:41.575065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1a323953-4006-4ce9-b7fd-2e44493dccd8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:41.582336 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a323953-4006-4ce9-b7fd-2e44493dccd8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:41.582797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a323953-4006-4ce9-b7fd-2e44493dccd8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:41.583566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a323953-4006-4ce9-b7fd-2e44493dccd8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:41.584013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1a323953-4006-4ce9-b7fd-2e44493dccd8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:41.716122 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1a323953-4006-4ce9-b7fd-2e44493dccd8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:41.723901 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1a323953-4006-4ce9-b7fd-2e44493dccd8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1697 microversion: 2.1 time: 0.153645 May 28 22:03:41.724477 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3514/6986] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:41 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:42.741163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4e05f33a-e291-4e73-94af-9332a7544528 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:42.741795 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4e05f33a-e291-4e73-94af-9332a7544528 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:42.749499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e05f33a-e291-4e73-94af-9332a7544528 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:42.750019 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e05f33a-e291-4e73-94af-9332a7544528 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:42.750859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e05f33a-e291-4e73-94af-9332a7544528 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:42.751305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e05f33a-e291-4e73-94af-9332a7544528 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:42.884700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4e05f33a-e291-4e73-94af-9332a7544528 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:42.892853 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4e05f33a-e291-4e73-94af-9332a7544528 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1697 microversion: 2.1 time: 0.155659 May 28 22:03:42.893442 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3473/6987] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:42 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:43.909729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6cfc930d-37c0-443c-932f-696b894e6b7a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:43.910482 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6cfc930d-37c0-443c-932f-696b894e6b7a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:43.917560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cfc930d-37c0-443c-932f-696b894e6b7a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:43.918055 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cfc930d-37c0-443c-932f-696b894e6b7a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:43.918828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cfc930d-37c0-443c-932f-696b894e6b7a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:43.919272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6cfc930d-37c0-443c-932f-696b894e6b7a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:44.053814 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6cfc930d-37c0-443c-932f-696b894e6b7a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:44.061650 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6cfc930d-37c0-443c-932f-696b894e6b7a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1697 microversion: 2.1 time: 0.155858 May 28 22:03:44.062460 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3515/6988] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:43 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:03:45.080850 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-526750fd-5b33-4406-9cc0-18defc3c214d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:45.081489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-526750fd-5b33-4406-9cc0-18defc3c214d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:45.088467 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-526750fd-5b33-4406-9cc0-18defc3c214d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:45.088940 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-526750fd-5b33-4406-9cc0-18defc3c214d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:45.089724 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-526750fd-5b33-4406-9cc0-18defc3c214d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:45.090213 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-526750fd-5b33-4406-9cc0-18defc3c214d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:45.225949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-526750fd-5b33-4406-9cc0-18defc3c214d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:45.233657 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-526750fd-5b33-4406-9cc0-18defc3c214d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1697 microversion: 2.1 time: 0.156820 May 28 22:03:45.234266 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3474/6989] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:45 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:46.251582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d756c10c-20c9-413c-8389-132aa6b14186 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:46.252166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d756c10c-20c9-413c-8389-132aa6b14186 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:46.259183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d756c10c-20c9-413c-8389-132aa6b14186 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:46.259650 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d756c10c-20c9-413c-8389-132aa6b14186 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:46.260429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d756c10c-20c9-413c-8389-132aa6b14186 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:46.260882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d756c10c-20c9-413c-8389-132aa6b14186 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:46.394128 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d756c10c-20c9-413c-8389-132aa6b14186 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:46.401683 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d756c10c-20c9-413c-8389-132aa6b14186 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1697 microversion: 2.1 time: 0.154185 May 28 22:03:46.402285 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3516/6990] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:46 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:47.419425 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-09e854f3-333e-4915-97dc-a5a2feda9840 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:47.420358 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-09e854f3-333e-4915-97dc-a5a2feda9840 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:47.427531 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-09e854f3-333e-4915-97dc-a5a2feda9840 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:47.428009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-09e854f3-333e-4915-97dc-a5a2feda9840 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:47.428787 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-09e854f3-333e-4915-97dc-a5a2feda9840 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:47.429240 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-09e854f3-333e-4915-97dc-a5a2feda9840 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:47.559297 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-09e854f3-333e-4915-97dc-a5a2feda9840 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:47.566885 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-09e854f3-333e-4915-97dc-a5a2feda9840 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1697 microversion: 2.1 time: 0.152158 May 28 22:03:47.567462 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3475/6991] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:47 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1697 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:48.583903 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5a063e8b-b678-4050-b356-422aab41f6f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:48.584528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5a063e8b-b678-4050-b356-422aab41f6f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:48.591656 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a063e8b-b678-4050-b356-422aab41f6f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:48.592067 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a063e8b-b678-4050-b356-422aab41f6f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:48.592911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a063e8b-b678-4050-b356-422aab41f6f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:48.593438 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5a063e8b-b678-4050-b356-422aab41f6f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:48.727003 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5a063e8b-b678-4050-b356-422aab41f6f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:48.735105 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5a063e8b-b678-4050-b356-422aab41f6f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1697 microversion: 2.1 time: 0.155283 May 28 22:03:48.735673 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3517/6992] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:48 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:49.752818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d91a4329-13c4-4ac7-becf-1761a6e8143a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:49.753411 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d91a4329-13c4-4ac7-becf-1761a6e8143a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:49.760456 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d91a4329-13c4-4ac7-becf-1761a6e8143a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:49.760925 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d91a4329-13c4-4ac7-becf-1761a6e8143a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:49.762389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d91a4329-13c4-4ac7-becf-1761a6e8143a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:49.762844 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d91a4329-13c4-4ac7-becf-1761a6e8143a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:49.892262 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d91a4329-13c4-4ac7-becf-1761a6e8143a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:49.900029 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d91a4329-13c4-4ac7-becf-1761a6e8143a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1697 microversion: 2.1 time: 0.151242 May 28 22:03:49.900617 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3476/6993] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:49 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:50.917131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1c74f0c6-3d3d-44be-8ef7-ef71a33dd71b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:50.917681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1c74f0c6-3d3d-44be-8ef7-ef71a33dd71b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:50.924685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1c74f0c6-3d3d-44be-8ef7-ef71a33dd71b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:50.925146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1c74f0c6-3d3d-44be-8ef7-ef71a33dd71b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:50.925945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1c74f0c6-3d3d-44be-8ef7-ef71a33dd71b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:50.926398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1c74f0c6-3d3d-44be-8ef7-ef71a33dd71b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:51.054011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1c74f0c6-3d3d-44be-8ef7-ef71a33dd71b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:51.062328 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1c74f0c6-3d3d-44be-8ef7-ef71a33dd71b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1697 microversion: 2.1 time: 0.149171 May 28 22:03:51.062907 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3518/6994] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:50 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1697 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:52.079581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4fb64870-e23e-4abf-907c-66b6c25090d7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:52.081101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4fb64870-e23e-4abf-907c-66b6c25090d7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:52.087762 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fb64870-e23e-4abf-907c-66b6c25090d7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:52.088228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fb64870-e23e-4abf-907c-66b6c25090d7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:52.089006 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fb64870-e23e-4abf-907c-66b6c25090d7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:52.089465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4fb64870-e23e-4abf-907c-66b6c25090d7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:52.225661 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4fb64870-e23e-4abf-907c-66b6c25090d7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:52.233908 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4fb64870-e23e-4abf-907c-66b6c25090d7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1697 microversion: 2.1 time: 0.158204 May 28 22:03:52.234497 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3477/6995] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:52 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:52.954981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-c1d58640-85e2-47f1-8a24-3a0b0a831c34 req-db928181-c210-431e-b4f3-5c64fb40cbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9990818-693f-44e3-9260-63e081967773", "name": "network-vif-unplugged", "status": "completed", "tag": "eb51946c-4542-403e-bef7-778dbcffcc19"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:03:52.964065 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c1d58640-85e2-47f1-8a24-3a0b0a831c34 req-db928181-c210-431e-b4f3-5c64fb40cbb8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:52.967242 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-c1d58640-85e2-47f1-8a24-3a0b0a831c34 req-db928181-c210-431e-b4f3-5c64fb40cbb8 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:52.976079 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-c1d58640-85e2-47f1-8a24-3a0b0a831c34 req-db928181-c210-431e-b4f3-5c64fb40cbb8 service nova] Creating event network-vif-unplugged:eb51946c-4542-403e-bef7-778dbcffcc19 for instance d9990818-693f-44e3-9260-63e081967773 on nch2-master-1 May 28 22:03:52.982011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [req-c1d58640-85e2-47f1-8a24-3a0b0a831c34 req-db928181-c210-431e-b4f3-5c64fb40cbb8 service nova] Instance d9990818-693f-44e3-9260-63e081967773 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143129) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 22:03:52.992795 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-c1d58640-85e2-47f1-8a24-3a0b0a831c34 req-db928181-c210-431e-b4f3-5c64fb40cbb8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041637 May 28 22:03:52.993422 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3519/6996] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:03:53.252171 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eba187e4-168c-4e30-9494-26b08f237a16 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:53.252849 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eba187e4-168c-4e30-9494-26b08f237a16 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:53.260005 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eba187e4-168c-4e30-9494-26b08f237a16 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:53.260508 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eba187e4-168c-4e30-9494-26b08f237a16 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:53.261311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eba187e4-168c-4e30-9494-26b08f237a16 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:53.261808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eba187e4-168c-4e30-9494-26b08f237a16 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:53.462640 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eba187e4-168c-4e30-9494-26b08f237a16 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:53.471091 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eba187e4-168c-4e30-9494-26b08f237a16 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1696 microversion: 2.1 time: 0.223160 May 28 22:03:53.471699 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3478/6997] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:53 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1696 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:54.490272 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3ac2c1af-a961-4be1-8d47-1524898fa331 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:54.490993 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3ac2c1af-a961-4be1-8d47-1524898fa331 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:54.498047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ac2c1af-a961-4be1-8d47-1524898fa331 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:54.498513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ac2c1af-a961-4be1-8d47-1524898fa331 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:54.500265 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ac2c1af-a961-4be1-8d47-1524898fa331 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:54.500719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3ac2c1af-a961-4be1-8d47-1524898fa331 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:54.634407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3ac2c1af-a961-4be1-8d47-1524898fa331 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:54.641950 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3ac2c1af-a961-4be1-8d47-1524898fa331 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1694 microversion: 2.1 time: 0.156723 May 28 22:03:54.642532 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3520/6998] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:54 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1694 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:55.006492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-ce70c540-2643-4760-ac19-80212f44ea86 req-d07e02f7-e045-403d-9ee3-bb2dfa2c159e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9990818-693f-44e3-9260-63e081967773", "tag": "eb51946c-4542-403e-bef7-778dbcffcc19"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:03:55.015493 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ce70c540-2643-4760-ac19-80212f44ea86 req-d07e02f7-e045-403d-9ee3-bb2dfa2c159e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:55.015954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ce70c540-2643-4760-ac19-80212f44ea86 req-d07e02f7-e045-403d-9ee3-bb2dfa2c159e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:55.030739 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-ce70c540-2643-4760-ac19-80212f44ea86 req-d07e02f7-e045-403d-9ee3-bb2dfa2c159e service nova] Creating event network-changed:eb51946c-4542-403e-bef7-778dbcffcc19 for instance d9990818-693f-44e3-9260-63e081967773 on nch2-master-1 May 28 22:03:55.036102 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [req-ce70c540-2643-4760-ac19-80212f44ea86 req-d07e02f7-e045-403d-9ee3-bb2dfa2c159e service nova] Instance d9990818-693f-44e3-9260-63e081967773 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=143128) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} May 28 22:03:55.047784 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-ce70c540-2643-4760-ac19-80212f44ea86 req-d07e02f7-e045-403d-9ee3-bb2dfa2c159e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044979 May 28 22:03:55.048385 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3479/6999] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:03:55.658882 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9326bf4d-dce3-48bc-90ba-175af580e185 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:55.659894 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9326bf4d-dce3-48bc-90ba-175af580e185 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:55.668295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9326bf4d-dce3-48bc-90ba-175af580e185 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:55.668295 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9326bf4d-dce3-48bc-90ba-175af580e185 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:55.668973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9326bf4d-dce3-48bc-90ba-175af580e185 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:55.669431 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9326bf4d-dce3-48bc-90ba-175af580e185 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:55.849099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9326bf4d-dce3-48bc-90ba-175af580e185 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:55.857828 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9326bf4d-dce3-48bc-90ba-175af580e185 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1694 microversion: 2.1 time: 0.202926 May 28 22:03:55.861795 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3521/7000] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:55 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1694 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:56.877178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ce7a807a-5b3b-4471-b56c-8f09bd769dd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:56.877945 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ce7a807a-5b3b-4471-b56c-8f09bd769dd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:56.884520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce7a807a-5b3b-4471-b56c-8f09bd769dd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:56.884998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce7a807a-5b3b-4471-b56c-8f09bd769dd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:56.885784 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce7a807a-5b3b-4471-b56c-8f09bd769dd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:56.886275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ce7a807a-5b3b-4471-b56c-8f09bd769dd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:57.021081 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ce7a807a-5b3b-4471-b56c-8f09bd769dd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:57.029123 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ce7a807a-5b3b-4471-b56c-8f09bd769dd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1691 microversion: 2.1 time: 0.157876 May 28 22:03:57.029702 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3480/7001] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:56 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:03:57.046280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e04b8cb7-f792-4d4d-b9d1-a3aa86cba9b3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:03:57.046840 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e04b8cb7-f792-4d4d-b9d1-a3aa86cba9b3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:57.053396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e04b8cb7-f792-4d4d-b9d1-a3aa86cba9b3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:57.053900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e04b8cb7-f792-4d4d-b9d1-a3aa86cba9b3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:57.054689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e04b8cb7-f792-4d4d-b9d1-a3aa86cba9b3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:57.055152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e04b8cb7-f792-4d4d-b9d1-a3aa86cba9b3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:57.261045 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e04b8cb7-f792-4d4d-b9d1-a3aa86cba9b3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773/action" status: 204 len: 0 microversion: 2.1 time: 0.219283 May 28 22:03:57.261724 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3522/7002] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:03:57 2022] POST /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773/action => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 22:03:57.270452 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-955d7bca-58f4-4f9b-8f1c-1f5368b71579 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:57.271247 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-955d7bca-58f4-4f9b-8f1c-1f5368b71579 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:57.277246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-955d7bca-58f4-4f9b-8f1c-1f5368b71579 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:57.277729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-955d7bca-58f4-4f9b-8f1c-1f5368b71579 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:57.279162 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-955d7bca-58f4-4f9b-8f1c-1f5368b71579 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:57.279623 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-955d7bca-58f4-4f9b-8f1c-1f5368b71579 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:57.416367 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-955d7bca-58f4-4f9b-8f1c-1f5368b71579 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:57.424515 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-955d7bca-58f4-4f9b-8f1c-1f5368b71579 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1691 microversion: 2.1 time: 0.158585 May 28 22:03:57.427973 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3481/7003] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:57 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:57.441950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-893e4198-2a9f-4e9a-a07f-41138ae94e59 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:57.442677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-893e4198-2a9f-4e9a-a07f-41138ae94e59 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:57.449381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-893e4198-2a9f-4e9a-a07f-41138ae94e59 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:57.450397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-893e4198-2a9f-4e9a-a07f-41138ae94e59 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:57.451203 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-893e4198-2a9f-4e9a-a07f-41138ae94e59 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:57.451661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-893e4198-2a9f-4e9a-a07f-41138ae94e59 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:57.591298 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-893e4198-2a9f-4e9a-a07f-41138ae94e59 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:57.599182 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-893e4198-2a9f-4e9a-a07f-41138ae94e59 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1691 microversion: 2.1 time: 0.161508 May 28 22:03:57.599767 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3523/7004] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:57 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:58.616161 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9ba87017-b4db-4311-8fb4-d3605f7cc0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:58.616838 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9ba87017-b4db-4311-8fb4-d3605f7cc0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:58.624075 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ba87017-b4db-4311-8fb4-d3605f7cc0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:58.624553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ba87017-b4db-4311-8fb4-d3605f7cc0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:58.625340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ba87017-b4db-4311-8fb4-d3605f7cc0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:58.625797 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9ba87017-b4db-4311-8fb4-d3605f7cc0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:58.757631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9ba87017-b4db-4311-8fb4-d3605f7cc0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:58.766371 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9ba87017-b4db-4311-8fb4-d3605f7cc0cf tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1691 microversion: 2.1 time: 0.154082 May 28 22:03:58.766972 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3482/7005] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:58 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:03:59.374470 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-0cd0dab1-75ac-4300-a3f9-834026ee91a1 req-ef037d33-c53e-4c11-9c7e-a4d8fb9c2ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9990818-693f-44e3-9260-63e081967773", "name": "network-vif-plugged", "status": "completed", "tag": "eb51946c-4542-403e-bef7-778dbcffcc19"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:03:59.383541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0cd0dab1-75ac-4300-a3f9-834026ee91a1 req-ef037d33-c53e-4c11-9c7e-a4d8fb9c2ae0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:59.384130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0cd0dab1-75ac-4300-a3f9-834026ee91a1 req-ef037d33-c53e-4c11-9c7e-a4d8fb9c2ae0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:59.395157 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-0cd0dab1-75ac-4300-a3f9-834026ee91a1 req-ef037d33-c53e-4c11-9c7e-a4d8fb9c2ae0 service nova] Creating event network-vif-plugged:eb51946c-4542-403e-bef7-778dbcffcc19 for instance d9990818-693f-44e3-9260-63e081967773 on nch2-master-1 May 28 22:03:59.400032 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-0cd0dab1-75ac-4300-a3f9-834026ee91a1 req-ef037d33-c53e-4c11-9c7e-a4d8fb9c2ae0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029372 May 28 22:03:59.400672 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3524/7006] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:03:59.784514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-eb273d39-b447-4660-b726-c91121e4a561 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:03:59.785152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-eb273d39-b447-4660-b726-c91121e4a561 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:03:59.792187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb273d39-b447-4660-b726-c91121e4a561 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:59.792660 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb273d39-b447-4660-b726-c91121e4a561 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:59.793484 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb273d39-b447-4660-b726-c91121e4a561 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:03:59.793978 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-eb273d39-b447-4660-b726-c91121e4a561 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:03:59.926185 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-eb273d39-b447-4660-b726-c91121e4a561 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:03:59.934003 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-eb273d39-b447-4660-b726-c91121e4a561 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1683 microversion: 2.1 time: 0.153395 May 28 22:03:59.934577 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3483/7007] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:03:59 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:04:20.094581 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=28 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:04:20.095645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:04:20.100174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-22f5ab49-6716-4e0a-bd0c-565b59156c45 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:04:20.101208 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-22f5ab49-6716-4e0a-bd0c-565b59156c45 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:20.107480 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22f5ab49-6716-4e0a-bd0c-565b59156c45 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:20.107949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22f5ab49-6716-4e0a-bd0c-565b59156c45 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:20.108732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22f5ab49-6716-4e0a-bd0c-565b59156c45 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:20.109186 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-22f5ab49-6716-4e0a-bd0c-565b59156c45 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:20.159278 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-22f5ab49-6716-4e0a-bd0c-565b59156c45 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773/action" status: 200 len: 24568 microversion: 2.1 time: 0.067158 May 28 22:04:20.159890 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3525/7008] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:04:20 2022] POST /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773/action => generated 24568 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 22:04:27.485790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7e177e3e-755e-40bf-a795-d0bd08afde1d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:27.486956 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7e177e3e-755e-40bf-a795-d0bd08afde1d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:27.487720 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-d5af205e-ec70-4da5-8dfd-97227f9f72c7 req-b37860fc-a1d2-4782-82d2-ca23f558a582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9990818-693f-44e3-9260-63e081967773", "tag": "eb51946c-4542-403e-bef7-778dbcffcc19"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:04:27.490505 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=32 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:04:27.491249 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:04:27.495357 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e177e3e-755e-40bf-a795-d0bd08afde1d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:27.495833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e177e3e-755e-40bf-a795-d0bd08afde1d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:27.496631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e177e3e-755e-40bf-a795-d0bd08afde1d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:27.497093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7e177e3e-755e-40bf-a795-d0bd08afde1d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:27.499190 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d5af205e-ec70-4da5-8dfd-97227f9f72c7 req-b37860fc-a1d2-4782-82d2-ca23f558a582 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:27.499363 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-d5af205e-ec70-4da5-8dfd-97227f9f72c7 req-b37860fc-a1d2-4782-82d2-ca23f558a582 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:27.513023 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-d5af205e-ec70-4da5-8dfd-97227f9f72c7 req-b37860fc-a1d2-4782-82d2-ca23f558a582 service nova] Creating event network-changed:eb51946c-4542-403e-bef7-778dbcffcc19 for instance d9990818-693f-44e3-9260-63e081967773 on nch2-master-1 May 28 22:04:27.519564 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-d5af205e-ec70-4da5-8dfd-97227f9f72c7 req-b37860fc-a1d2-4782-82d2-ca23f558a582 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036215 May 28 22:04:27.520352 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3526/7009] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 22:04:27.535741 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7e177e3e-755e-40bf-a795-d0bd08afde1d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 22:04:27.847589 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7e177e3e-755e-40bf-a795-d0bd08afde1d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 204 len: 0 microversion: 2.1 time: 0.365373 May 28 22:04:27.848604 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3484/7010] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 22:04:27 2022] DELETE /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 22:04:27.865549 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-035b3902-df49-4ba2-b1d7-cf093cb7b414 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:27.866304 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-035b3902-df49-4ba2-b1d7-cf093cb7b414 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:27.874507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-035b3902-df49-4ba2-b1d7-cf093cb7b414 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:27.874977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-035b3902-df49-4ba2-b1d7-cf093cb7b414 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:27.875778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-035b3902-df49-4ba2-b1d7-cf093cb7b414 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:27.876235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-035b3902-df49-4ba2-b1d7-cf093cb7b414 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:28.014843 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-035b3902-df49-4ba2-b1d7-cf093cb7b414 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:28.022779 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-035b3902-df49-4ba2-b1d7-cf093cb7b414 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1689 microversion: 2.1 time: 0.162068 May 28 22:04:28.023368 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3527/7011] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:27 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:04:29.041587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ba9531ca-97ed-4863-9122-da9de14747d2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:29.042350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ba9531ca-97ed-4863-9122-da9de14747d2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:29.049862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba9531ca-97ed-4863-9122-da9de14747d2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:29.050340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba9531ca-97ed-4863-9122-da9de14747d2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:29.051135 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba9531ca-97ed-4863-9122-da9de14747d2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:29.051596 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ba9531ca-97ed-4863-9122-da9de14747d2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:29.246114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ba9531ca-97ed-4863-9122-da9de14747d2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:29.259260 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ba9531ca-97ed-4863-9122-da9de14747d2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1689 microversion: 2.1 time: 0.222256 May 28 22:04:29.260018 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3485/7012] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:29 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1689 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:04:29.815861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ceb96692-444a-4c79-a841-1784ea84c01d req-321698ac-4602-47e0-8451-ec4c8df717d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9990818-693f-44e3-9260-63e081967773", "name": "network-vif-deleted", "tag": "eb51946c-4542-403e-bef7-778dbcffcc19"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:04:29.825108 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ceb96692-444a-4c79-a841-1784ea84c01d req-321698ac-4602-47e0-8451-ec4c8df717d9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:29.827153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ceb96692-444a-4c79-a841-1784ea84c01d req-321698ac-4602-47e0-8451-ec4c8df717d9 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:29.837204 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ceb96692-444a-4c79-a841-1784ea84c01d req-321698ac-4602-47e0-8451-ec4c8df717d9 service nova] Creating event network-vif-deleted:eb51946c-4542-403e-bef7-778dbcffcc19 for instance d9990818-693f-44e3-9260-63e081967773 on nch2-master-1 May 28 22:04:29.842769 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ceb96692-444a-4c79-a841-1784ea84c01d req-321698ac-4602-47e0-8451-ec4c8df717d9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030560 May 28 22:04:29.843364 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3528/7013] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:04:30.276811 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8fc94e2d-7f16-4713-8f63-a4c25acfef62 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:30.277457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8fc94e2d-7f16-4713-8f63-a4c25acfef62 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:30.284536 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fc94e2d-7f16-4713-8f63-a4c25acfef62 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:30.285010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fc94e2d-7f16-4713-8f63-a4c25acfef62 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:30.285800 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fc94e2d-7f16-4713-8f63-a4c25acfef62 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:30.286292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fc94e2d-7f16-4713-8f63-a4c25acfef62 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:30.322480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fc94e2d-7f16-4713-8f63-a4c25acfef62 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:30.323012 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8fc94e2d-7f16-4713-8f63-a4c25acfef62 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:30.323496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-8fc94e2d-7f16-4713-8f63-a4c25acfef62 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lazy-loading 'fault' on Instance uuid d9990818-693f-44e3-9260-63e081967773 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 22:04:30.366077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8fc94e2d-7f16-4713-8f63-a4c25acfef62 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:30.374299 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8fc94e2d-7f16-4713-8f63-a4c25acfef62 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 200 len: 1357 microversion: 2.1 time: 0.100904 May 28 22:04:30.375396 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3486/7014] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:30 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 1357 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:04:31.394040 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bed87ccb-f952-49bb-aa40-951748171a26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:31.394706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bed87ccb-f952-49bb-aa40-951748171a26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: d9990818-693f-44e3-9260-63e081967773] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:31.401024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bed87ccb-f952-49bb-aa40-951748171a26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:31.401492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bed87ccb-f952-49bb-aa40-951748171a26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:31.402320 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bed87ccb-f952-49bb-aa40-951748171a26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:31.402778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bed87ccb-f952-49bb-aa40-951748171a26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:31.416752 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-bed87ccb-f952-49bb-aa40-951748171a26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] HTTP exception thrown: Instance d9990818-693f-44e3-9260-63e081967773 could not be found. May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bed87ccb-f952-49bb-aa40-951748171a26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Request method failure captured: May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 HTTP/1.1 May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikptOuO8oVBSIrBTIbL1qBafkM3bRPqHRtdmD9HRzAg7Rq6Sa9lPn2eCwncLkJYy5x5D810AJAdLKgrCA2pyb1pdvaP3HK5GoIFP0N8s94-1UlDC3wszHDUtJtWOu2ExEC0RSI6YR2LI3hXkxUjTpT0O1jnASr-USfa-JS-4KnaOepP0 May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 38d3db1f6443461f90a5be23358b6816 May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-582264347 May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38d3db1f6443461f90a5be23358b6816", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d3db1f6443461f90a5be23358b6816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38d3db1f6443461f90a5be23358b6816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d3db1f6443461f90a5be23358b6816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestNetworkAdvancedServerOps-582264347 May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 38d3db1f6443461f90a5be23358b6816 May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-582264347 May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestNetworkAdvancedServerOps-582264347-project May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 56b376ad4a314418bca5fcbf8a8ca429 May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestNetworkAdvancedServerOps-582264347-project May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance d9990818-693f-44e3-9260-63e081967773 could not be found. May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': 'd9990818-693f-44e3-9260-63e081967773'} May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9990818-693f-44e3-9260-63e081967773 could not be found. May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9990818-693f-44e3-9260-63e081967773 could not be found. May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:04:31.418457 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:04:31.422492 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:04:31.422492 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:04:31.422492 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:04:31.422492 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 22:04:31.422492 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 22:04:31.422492 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9990818-693f-44e3-9260-63e081967773 could not be found. May 28 22:04:31.422492 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:04:31.422492 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bed87ccb-f952-49bb-aa40-951748171a26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Returning 404 to user: Instance d9990818-693f-44e3-9260-63e081967773 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 22:04:31.422492 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bed87ccb-f952-49bb-aa40-951748171a26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773" status: 404 len: 111 microversion: 2.1 time: 0.031751 May 28 22:04:31.422492 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3529/7015] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:31 2022] GET /compute/v2.1/servers/d9990818-693f-44e3-9260-63e081967773 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 22:04:34.911291 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fb2e74c3-230b-4046-8bb9-6ceeb2f8def3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '.version_select at 0x7f4d64144280>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:34.996016 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fb2e74c3-230b-4046-8bb9-6ceeb2f8def3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1746507166" status: 202 len: 0 microversion: 2.1 time: 0.088627 May 28 22:04:34.996621 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3487/7016] 10.222.0.33 () {58 vars in 1283 bytes} [Sat May 28 22:04:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1746507166 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:04:35.024233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-26885585-d273-4e27-ac15-58c9bb319726 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'create', calling method: .version_select at 0x7f4d56d87670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-537323381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfCC7PKJbNBcgG/QQKeAcVw8pQfNZ02VNveYtuuU6Wb+X+vXh1cOm13k0XoIRNC466hPURNaDc8kp5n8OjK+tKWBoSUkeHb0EC7ZOEexyeHuPQPzun0AfUuLqH5jYiycQ=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:04:35.039738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-26885585-d273-4e27-ac15-58c9bb319726 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for project 38d3db1f6443461f90a5be23358b6816. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 22:04:35.048951 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-26885585-d273-4e27-ac15-58c9bb319726 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for user 56b376ad4a314418bca5fcbf8a8ca429 and project 38d3db1f6443461f90a5be23358b6816. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 22:04:35.135829 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-26885585-d273-4e27-ac15-58c9bb319726 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.115508 May 28 22:04:35.136463 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3530/7017] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 22:04:35 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:04:43.319971 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:04:43.379130 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1426570909", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "24b00f89-9319-4cd8-b872-337bc3f44d22"}], "key_name": "tempest-TestNetworkAdvancedServerOps-537323381", "security_groups": [{"name": "tempest-secgroup-smoke-133372378"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:04:43.503342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] validate_networks() for [('24b00f89-9319-4cd8-b872-337bc3f44d22', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 22:04:44.288080 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 22:04:44.288529 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 22:04:44.289084 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 22:04:44.289524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 22:04:44.290234 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 22:04:44.300063 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:44.300543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:44.301875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:44.302356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:44.322805 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for project 38d3db1f6443461f90a5be23358b6816. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 22:04:44.329187 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for user 56b376ad4a314418bca5fcbf8a8ca429 and project 38d3db1f6443461f90a5be23358b6816. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 22:04:44.343862 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 22:04:44.346582 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 22:04:44.473223 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6023989f-80c9-465b-b1c1-ab356e7681bb tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.159467 May 28 22:04:44.480413 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3488/7018] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 22:04:43 2022] POST /compute/v2.1/servers => generated 405 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 22:04:44.484685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=16 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:04:44.496989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b43415b9-3aa3-45a1-b35f-0cc174bd11ed tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:44.496989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b43415b9-3aa3-45a1-b35f-0cc174bd11ed tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:44.561409 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b43415b9-3aa3-45a1-b35f-0cc174bd11ed tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:44.569460 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b43415b9-3aa3-45a1-b35f-0cc174bd11ed tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1266 microversion: 2.1 time: 0.087365 May 28 22:04:44.570209 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3531/7019] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:44 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:04:45.587718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1a600672-5278-4a18-ac2f-1c41ee1b9100 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:45.588353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1a600672-5278-4a18-ac2f-1c41ee1b9100 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:45.596723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a600672-5278-4a18-ac2f-1c41ee1b9100 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:45.597202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a600672-5278-4a18-ac2f-1c41ee1b9100 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:45.598199 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a600672-5278-4a18-ac2f-1c41ee1b9100 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:45.599018 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1a600672-5278-4a18-ac2f-1c41ee1b9100 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:45.666496 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1a600672-5278-4a18-ac2f-1c41ee1b9100 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:45.674443 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1a600672-5278-4a18-ac2f-1c41ee1b9100 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1270 microversion: 2.1 time: 0.091608 May 28 22:04:45.675396 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3489/7020] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:45 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:04:46.697070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bf4d1070-681e-4ad1-8153-ad4a76a628e5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:46.697638 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bf4d1070-681e-4ad1-8153-ad4a76a628e5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:46.705389 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf4d1070-681e-4ad1-8153-ad4a76a628e5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:46.705900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf4d1070-681e-4ad1-8153-ad4a76a628e5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:46.706689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf4d1070-681e-4ad1-8153-ad4a76a628e5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:46.707144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf4d1070-681e-4ad1-8153-ad4a76a628e5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:46.770151 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bf4d1070-681e-4ad1-8153-ad4a76a628e5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:46.778160 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bf4d1070-681e-4ad1-8153-ad4a76a628e5 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1336 microversion: 2.1 time: 0.085240 May 28 22:04:46.778994 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3532/7021] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:46 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1336 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:04:47.795612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-80d0bfc8-3543-4f08-9d62-947d2134c631 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:47.796258 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-80d0bfc8-3543-4f08-9d62-947d2134c631 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:47.803248 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80d0bfc8-3543-4f08-9d62-947d2134c631 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:47.803806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80d0bfc8-3543-4f08-9d62-947d2134c631 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:47.804597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80d0bfc8-3543-4f08-9d62-947d2134c631 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:47.805056 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-80d0bfc8-3543-4f08-9d62-947d2134c631 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:47.959062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-80d0bfc8-3543-4f08-9d62-947d2134c631 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:47.967296 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-80d0bfc8-3543-4f08-9d62-947d2134c631 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1391 microversion: 2.1 time: 0.175780 May 28 22:04:47.967895 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3490/7022] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:47 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:04:48.106994 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-2ad4188b-a4a4-4187-9b20-47554348228e req-3d7b2a90-a93b-41c7-9804-d537ef56e4da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f869435-7c02-42ff-bef9-8a88e60af7d6", "tag": "752f8fad-b32e-47cd-9f56-a4a27a7ef00e"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:04:48.125554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2ad4188b-a4a4-4187-9b20-47554348228e req-3d7b2a90-a93b-41c7-9804-d537ef56e4da service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:48.125554 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-2ad4188b-a4a4-4187-9b20-47554348228e req-3d7b2a90-a93b-41c7-9804-d537ef56e4da service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:48.137722 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-2ad4188b-a4a4-4187-9b20-47554348228e req-3d7b2a90-a93b-41c7-9804-d537ef56e4da service nova] Creating event network-changed:752f8fad-b32e-47cd-9f56-a4a27a7ef00e for instance 9f869435-7c02-42ff-bef9-8a88e60af7d6 on nch1-master-1 May 28 22:04:48.143591 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-2ad4188b-a4a4-4187-9b20-47554348228e req-3d7b2a90-a93b-41c7-9804-d537ef56e4da service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044587 May 28 22:04:48.144787 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3533/7023] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:04:48.985501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e70ef545-4416-47e6-ba4e-27eddbb42ec6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:48.986109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e70ef545-4416-47e6-ba4e-27eddbb42ec6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:48.993114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e70ef545-4416-47e6-ba4e-27eddbb42ec6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:48.993584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e70ef545-4416-47e6-ba4e-27eddbb42ec6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:48.994402 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e70ef545-4416-47e6-ba4e-27eddbb42ec6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:48.994860 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e70ef545-4416-47e6-ba4e-27eddbb42ec6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:49.123065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e70ef545-4416-47e6-ba4e-27eddbb42ec6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:49.130626 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e70ef545-4416-47e6-ba4e-27eddbb42ec6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1391 microversion: 2.1 time: 0.149757 May 28 22:04:49.131215 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3491/7024] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:48 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:04:50.148850 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b86ebdb1-eb74-4f28-b1eb-1ea6e656cdea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:50.149567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b86ebdb1-eb74-4f28-b1eb-1ea6e656cdea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:50.151593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:04:50.157189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b86ebdb1-eb74-4f28-b1eb-1ea6e656cdea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:50.157658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b86ebdb1-eb74-4f28-b1eb-1ea6e656cdea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:50.158459 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b86ebdb1-eb74-4f28-b1eb-1ea6e656cdea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:50.158914 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b86ebdb1-eb74-4f28-b1eb-1ea6e656cdea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:50.294134 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b86ebdb1-eb74-4f28-b1eb-1ea6e656cdea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:50.302608 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b86ebdb1-eb74-4f28-b1eb-1ea6e656cdea tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1391 microversion: 2.1 time: 0.158872 May 28 22:04:50.303200 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3534/7025] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:50 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:04:51.319852 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-257c0bd6-52f8-407b-8278-53cc908cf69b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:51.320758 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-257c0bd6-52f8-407b-8278-53cc908cf69b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:51.328835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-257c0bd6-52f8-407b-8278-53cc908cf69b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:51.329308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-257c0bd6-52f8-407b-8278-53cc908cf69b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:51.330146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-257c0bd6-52f8-407b-8278-53cc908cf69b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:51.330612 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-257c0bd6-52f8-407b-8278-53cc908cf69b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:51.461322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-257c0bd6-52f8-407b-8278-53cc908cf69b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:51.469431 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-257c0bd6-52f8-407b-8278-53cc908cf69b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1391 microversion: 2.1 time: 0.153864 May 28 22:04:51.470047 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3492/7026] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:51 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:04:52.486370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-32c5299d-b582-47fb-b1ff-748d8d127ab1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:52.487005 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-32c5299d-b582-47fb-b1ff-748d8d127ab1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:52.494172 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32c5299d-b582-47fb-b1ff-748d8d127ab1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:52.499268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32c5299d-b582-47fb-b1ff-748d8d127ab1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:52.499268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32c5299d-b582-47fb-b1ff-748d8d127ab1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:52.499268 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-32c5299d-b582-47fb-b1ff-748d8d127ab1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:52.637236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-32c5299d-b582-47fb-b1ff-748d8d127ab1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:52.645697 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-32c5299d-b582-47fb-b1ff-748d8d127ab1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1391 microversion: 2.1 time: 0.163293 May 28 22:04:52.646305 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3535/7027] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:52 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:04:53.663348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2e935d1e-2f3e-4944-89da-2c9a943bf81e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:53.663898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2e935d1e-2f3e-4944-89da-2c9a943bf81e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:53.671172 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e935d1e-2f3e-4944-89da-2c9a943bf81e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:53.671641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e935d1e-2f3e-4944-89da-2c9a943bf81e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:53.672423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e935d1e-2f3e-4944-89da-2c9a943bf81e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:53.672879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2e935d1e-2f3e-4944-89da-2c9a943bf81e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:53.805544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2e935d1e-2f3e-4944-89da-2c9a943bf81e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:53.813148 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2e935d1e-2f3e-4944-89da-2c9a943bf81e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1391 microversion: 2.1 time: 0.153974 May 28 22:04:53.813765 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3493/7028] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:53 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:04:54.532597 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-59d52448-2baf-44cb-abc3-e17f4ce87d37 req-6ade1552-2075-46c5-bbc6-6c355019882a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f869435-7c02-42ff-bef9-8a88e60af7d6", "name": "network-vif-plugged", "status": "completed", "tag": "752f8fad-b32e-47cd-9f56-a4a27a7ef00e"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:04:54.541772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-59d52448-2baf-44cb-abc3-e17f4ce87d37 req-6ade1552-2075-46c5-bbc6-6c355019882a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:54.542261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-59d52448-2baf-44cb-abc3-e17f4ce87d37 req-6ade1552-2075-46c5-bbc6-6c355019882a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:54.555080 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-59d52448-2baf-44cb-abc3-e17f4ce87d37 req-6ade1552-2075-46c5-bbc6-6c355019882a service nova] Creating event network-vif-plugged:752f8fad-b32e-47cd-9f56-a4a27a7ef00e for instance 9f869435-7c02-42ff-bef9-8a88e60af7d6 on nch1-master-1 May 28 22:04:54.560349 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-59d52448-2baf-44cb-abc3-e17f4ce87d37 req-6ade1552-2075-46c5-bbc6-6c355019882a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031718 May 28 22:04:54.560994 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3536/7029] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:04:54.830196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c0d0e4d1-17ae-4f92-a4ec-6b3eead04437 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:54.830835 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c0d0e4d1-17ae-4f92-a4ec-6b3eead04437 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:54.832707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:04:54.833413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=6 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:04:54.839194 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c0d0e4d1-17ae-4f92-a4ec-6b3eead04437 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:54.839673 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c0d0e4d1-17ae-4f92-a4ec-6b3eead04437 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:54.840466 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c0d0e4d1-17ae-4f92-a4ec-6b3eead04437 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:54.840930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c0d0e4d1-17ae-4f92-a4ec-6b3eead04437 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:54.970878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c0d0e4d1-17ae-4f92-a4ec-6b3eead04437 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:54.979474 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c0d0e4d1-17ae-4f92-a4ec-6b3eead04437 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1391 microversion: 2.1 time: 0.153290 May 28 22:04:54.980055 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3494/7030] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:54 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:04:55.993935 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:04:55.998990 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-62756071-1ce1-4ee6-9a0d-c6b64d3c0f03 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:55.999714 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-62756071-1ce1-4ee6-9a0d-c6b64d3c0f03 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:56.006406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62756071-1ce1-4ee6-9a0d-c6b64d3c0f03 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:56.006873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62756071-1ce1-4ee6-9a0d-c6b64d3c0f03 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:56.007689 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62756071-1ce1-4ee6-9a0d-c6b64d3c0f03 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:56.008142 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62756071-1ce1-4ee6-9a0d-c6b64d3c0f03 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:56.147593 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-62756071-1ce1-4ee6-9a0d-c6b64d3c0f03 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:56.155403 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-62756071-1ce1-4ee6-9a0d-c6b64d3c0f03 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1563 microversion: 2.1 time: 0.162529 May 28 22:04:56.155992 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3537/7031] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:55 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:04:56.171495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ec045ca6-bbf3-400e-b20a-9e4ac05bc1e8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:56.172133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ec045ca6-bbf3-400e-b20a-9e4ac05bc1e8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:56.178684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec045ca6-bbf3-400e-b20a-9e4ac05bc1e8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:56.179157 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec045ca6-bbf3-400e-b20a-9e4ac05bc1e8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:56.179938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec045ca6-bbf3-400e-b20a-9e4ac05bc1e8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:56.180396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ec045ca6-bbf3-400e-b20a-9e4ac05bc1e8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:56.309785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ec045ca6-bbf3-400e-b20a-9e4ac05bc1e8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:56.318071 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ec045ca6-bbf3-400e-b20a-9e4ac05bc1e8 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1563 microversion: 2.1 time: 0.150473 May 28 22:04:56.318653 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3495/7032] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:56 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1563 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:04:58.280749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-65e48b00-b785-4dd0-97df-d43c749f321d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:04:58.281577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-65e48b00-b785-4dd0-97df-d43c749f321d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:04:58.283634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-a5166a09-66cc-4282-9a9f-0dfef83b1a49 req-9aa57937-b905-4db5-a578-ffb10c2d1f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f869435-7c02-42ff-bef9-8a88e60af7d6", "tag": "752f8fad-b32e-47cd-9f56-a4a27a7ef00e"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:04:58.288608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65e48b00-b785-4dd0-97df-d43c749f321d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:58.288828 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:04:58.289077 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65e48b00-b785-4dd0-97df-d43c749f321d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:58.290369 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65e48b00-b785-4dd0-97df-d43c749f321d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:58.290986 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65e48b00-b785-4dd0-97df-d43c749f321d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:58.295196 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a5166a09-66cc-4282-9a9f-0dfef83b1a49 req-9aa57937-b905-4db5-a578-ffb10c2d1f24 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:04:58.295671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-a5166a09-66cc-4282-9a9f-0dfef83b1a49 req-9aa57937-b905-4db5-a578-ffb10c2d1f24 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:04:58.308758 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-a5166a09-66cc-4282-9a9f-0dfef83b1a49 req-9aa57937-b905-4db5-a578-ffb10c2d1f24 service nova] Creating event network-changed:752f8fad-b32e-47cd-9f56-a4a27a7ef00e for instance 9f869435-7c02-42ff-bef9-8a88e60af7d6 on nch1-master-1 May 28 22:04:58.315789 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-a5166a09-66cc-4282-9a9f-0dfef83b1a49 req-9aa57937-b905-4db5-a578-ffb10c2d1f24 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036349 May 28 22:04:58.317621 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3496/7033] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:04:58.443983 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-65e48b00-b785-4dd0-97df-d43c749f321d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:04:58.452600 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-65e48b00-b785-4dd0-97df-d43c749f321d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1563 microversion: 2.1 time: 0.176617 May 28 22:04:58.453185 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3538/7034] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:04:58 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:05:21.688707 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-df0613f5-1224-4870-ac30-bfb3697bb502 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:05:21.689815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-df0613f5-1224-4870-ac30-bfb3697bb502 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:05:21.692817 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=46 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:05:21.698691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df0613f5-1224-4870-ac30-bfb3697bb502 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:21.702062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df0613f5-1224-4870-ac30-bfb3697bb502 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:21.702062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df0613f5-1224-4870-ac30-bfb3697bb502 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:21.702062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-df0613f5-1224-4870-ac30-bfb3697bb502 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:21.750248 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-df0613f5-1224-4870-ac30-bfb3697bb502 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6/action" status: 200 len: 24569 microversion: 2.1 time: 0.066493 May 28 22:05:21.750918 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3497/7035] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:05:21 2022] POST /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6/action => generated 24569 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 22:05:28.175602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-65c017db-5ba6-4dfc-82e6-c8722a80010e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:05:28.179039 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=9 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:05:28.179628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=34 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:05:28.183196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65c017db-5ba6-4dfc-82e6-c8722a80010e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:28.183663 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-65c017db-5ba6-4dfc-82e6-c8722a80010e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:28.206514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-65c017db-5ba6-4dfc-82e6-c8722a80010e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Going to try to stop instance {{(pid=143129) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 28 22:05:28.396647 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-65c017db-5ba6-4dfc-82e6-c8722a80010e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6/action" status: 202 len: 0 microversion: 2.1 time: 0.225769 May 28 22:05:28.397265 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3539/7036] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:05:28 2022] POST /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:05:28.406482 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b0e60d39-b2da-43b4-9ac4-31be996c7329 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:05:28.408414 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b0e60d39-b2da-43b4-9ac4-31be996c7329 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:05:28.416090 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0e60d39-b2da-43b4-9ac4-31be996c7329 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:28.416569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0e60d39-b2da-43b4-9ac4-31be996c7329 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:28.417378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0e60d39-b2da-43b4-9ac4-31be996c7329 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:28.417867 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0e60d39-b2da-43b4-9ac4-31be996c7329 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:28.561017 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b0e60d39-b2da-43b4-9ac4-31be996c7329 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:05:28.569044 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b0e60d39-b2da-43b4-9ac4-31be996c7329 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1692 microversion: 2.1 time: 0.166971 May 28 22:05:28.569650 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3498/7037] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:05:28 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:05:29.588560 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-25323091-9b0d-4a51-85ed-3b34fb7bcb5b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:05:29.589284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-25323091-9b0d-4a51-85ed-3b34fb7bcb5b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:05:29.596326 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25323091-9b0d-4a51-85ed-3b34fb7bcb5b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:29.596797 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25323091-9b0d-4a51-85ed-3b34fb7bcb5b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:29.597591 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25323091-9b0d-4a51-85ed-3b34fb7bcb5b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:29.598085 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-25323091-9b0d-4a51-85ed-3b34fb7bcb5b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:29.730129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-25323091-9b0d-4a51-85ed-3b34fb7bcb5b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:05:29.737896 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-25323091-9b0d-4a51-85ed-3b34fb7bcb5b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1692 microversion: 2.1 time: 0.154818 May 28 22:05:29.738474 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3540/7038] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:05:29 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:05:30.755276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6407af7b-c129-4992-b8ed-52523c13c5cc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:05:30.755923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6407af7b-c129-4992-b8ed-52523c13c5cc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:05:30.762974 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6407af7b-c129-4992-b8ed-52523c13c5cc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:30.763395 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6407af7b-c129-4992-b8ed-52523c13c5cc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:30.764181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6407af7b-c129-4992-b8ed-52523c13c5cc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:30.764641 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6407af7b-c129-4992-b8ed-52523c13c5cc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:30.893507 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6407af7b-c129-4992-b8ed-52523c13c5cc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:05:30.901164 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6407af7b-c129-4992-b8ed-52523c13c5cc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1692 microversion: 2.1 time: 0.149931 May 28 22:05:30.901738 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3499/7039] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:05:30 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1692 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:05:31.918588 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-64dca833-6398-4d93-9cd5-69ea4d18a1e3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:05:31.919214 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-64dca833-6398-4d93-9cd5-69ea4d18a1e3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:05:31.926751 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64dca833-6398-4d93-9cd5-69ea4d18a1e3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:31.927210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64dca833-6398-4d93-9cd5-69ea4d18a1e3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:31.928392 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64dca833-6398-4d93-9cd5-69ea4d18a1e3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:31.928945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-64dca833-6398-4d93-9cd5-69ea4d18a1e3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:32.065098 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-64dca833-6398-4d93-9cd5-69ea4d18a1e3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:05:32.073579 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-64dca833-6398-4d93-9cd5-69ea4d18a1e3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1692 microversion: 2.1 time: 0.159058 May 28 22:05:32.074248 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3541/7040] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:05:31 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:05:33.090854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f3465aca-75e9-4d29-86ca-bdd44d0eb99a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:05:33.091497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f3465aca-75e9-4d29-86ca-bdd44d0eb99a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:05:33.098857 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3465aca-75e9-4d29-86ca-bdd44d0eb99a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:33.099327 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3465aca-75e9-4d29-86ca-bdd44d0eb99a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:33.100115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3465aca-75e9-4d29-86ca-bdd44d0eb99a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:33.100585 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f3465aca-75e9-4d29-86ca-bdd44d0eb99a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:33.233545 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f3465aca-75e9-4d29-86ca-bdd44d0eb99a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:05:33.241201 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f3465aca-75e9-4d29-86ca-bdd44d0eb99a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1692 microversion: 2.1 time: 0.154347 May 28 22:05:33.241775 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3500/7041] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:05:33 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:05:34.258315 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-5ba9e8fd-a11d-4eee-b359-37ef08bfad9a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:05:34.258974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-5ba9e8fd-a11d-4eee-b359-37ef08bfad9a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:05:34.266162 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ba9e8fd-a11d-4eee-b359-37ef08bfad9a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:34.266564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ba9e8fd-a11d-4eee-b359-37ef08bfad9a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:34.267846 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ba9e8fd-a11d-4eee-b359-37ef08bfad9a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:34.268293 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-5ba9e8fd-a11d-4eee-b359-37ef08bfad9a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:34.401183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-5ba9e8fd-a11d-4eee-b359-37ef08bfad9a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:05:34.408939 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-5ba9e8fd-a11d-4eee-b359-37ef08bfad9a tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1692 microversion: 2.1 time: 0.154759 May 28 22:05:34.409519 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3542/7042] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:05:34 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:05:35.426685 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6398759b-7352-46d5-bb8a-eaa000e6b0fc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:05:35.427323 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6398759b-7352-46d5-bb8a-eaa000e6b0fc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:05:35.434388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6398759b-7352-46d5-bb8a-eaa000e6b0fc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:35.434859 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6398759b-7352-46d5-bb8a-eaa000e6b0fc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:35.435643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6398759b-7352-46d5-bb8a-eaa000e6b0fc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:35.436100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6398759b-7352-46d5-bb8a-eaa000e6b0fc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:35.563738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6398759b-7352-46d5-bb8a-eaa000e6b0fc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:05:35.571516 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6398759b-7352-46d5-bb8a-eaa000e6b0fc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1692 microversion: 2.1 time: 0.149479 May 28 22:05:35.572089 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3501/7043] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:05:35 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1692 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:05:36.588612 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a278da6d-59dc-44de-9223-0b11487d3fd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:05:36.589269 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a278da6d-59dc-44de-9223-0b11487d3fd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:05:36.596284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a278da6d-59dc-44de-9223-0b11487d3fd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:36.596748 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a278da6d-59dc-44de-9223-0b11487d3fd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:36.597528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a278da6d-59dc-44de-9223-0b11487d3fd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:36.598010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a278da6d-59dc-44de-9223-0b11487d3fd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:36.729619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a278da6d-59dc-44de-9223-0b11487d3fd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:05:36.737254 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a278da6d-59dc-44de-9223-0b11487d3fd1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1692 microversion: 2.1 time: 0.152627 May 28 22:05:36.737855 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3543/7044] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:05:36 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:05:37.754522 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ccb8d347-7987-4647-8d55-f5d94bebe2ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:05:37.755182 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ccb8d347-7987-4647-8d55-f5d94bebe2ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:05:37.762112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccb8d347-7987-4647-8d55-f5d94bebe2ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:37.762581 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccb8d347-7987-4647-8d55-f5d94bebe2ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:37.763369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccb8d347-7987-4647-8d55-f5d94bebe2ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:37.763827 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ccb8d347-7987-4647-8d55-f5d94bebe2ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:37.900062 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ccb8d347-7987-4647-8d55-f5d94bebe2ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:05:37.907689 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ccb8d347-7987-4647-8d55-f5d94bebe2ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1692 microversion: 2.1 time: 0.157706 May 28 22:05:37.908271 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3502/7045] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:05:37 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:05:38.925410 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ea0a72dd-2bcf-41cd-96ee-de49ecf8b752 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:05:38.926072 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ea0a72dd-2bcf-41cd-96ee-de49ecf8b752 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:05:38.933275 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea0a72dd-2bcf-41cd-96ee-de49ecf8b752 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:38.933742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea0a72dd-2bcf-41cd-96ee-de49ecf8b752 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:38.934567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea0a72dd-2bcf-41cd-96ee-de49ecf8b752 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:38.935022 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ea0a72dd-2bcf-41cd-96ee-de49ecf8b752 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:39.065479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ea0a72dd-2bcf-41cd-96ee-de49ecf8b752 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:05:39.073556 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ea0a72dd-2bcf-41cd-96ee-de49ecf8b752 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1669 microversion: 2.1 time: 0.152817 May 28 22:05:39.074245 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3544/7046] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:05:38 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:05:40.162608 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b65cccc5-7b39-48cc-ab61-043fedbcc320 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:05:40.163613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b65cccc5-7b39-48cc-ab61-043fedbcc320 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:05:40.170774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b65cccc5-7b39-48cc-ab61-043fedbcc320 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:40.171257 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b65cccc5-7b39-48cc-ab61-043fedbcc320 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:40.172051 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b65cccc5-7b39-48cc-ab61-043fedbcc320 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:40.172516 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b65cccc5-7b39-48cc-ab61-043fedbcc320 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:40.219061 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b65cccc5-7b39-48cc-ab61-043fedbcc320 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6/action" status: 200 len: 36348 microversion: 2.1 time: 0.061016 May 28 22:05:40.219701 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3503/7047] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:05:40 2022] POST /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6/action => generated 36348 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 22:05:40.231429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cbd5af42-13a4-4788-9371-54846db15d6d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:05:40.238685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cbd5af42-13a4-4788-9371-54846db15d6d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:40.239152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cbd5af42-13a4-4788-9371-54846db15d6d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:40.261158 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cbd5af42-13a4-4788-9371-54846db15d6d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Going to try to start instance {{(pid=143129) start /opt/stack/nova/nova/compute/api.py:2730}} May 28 22:05:40.448146 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cbd5af42-13a4-4788-9371-54846db15d6d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6/action" status: 202 len: 0 microversion: 2.1 time: 0.220412 May 28 22:05:40.448797 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3545/7048] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:05:40 2022] POST /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:05:40.458560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-21ed93ae-3908-44f6-9a7f-0a494e197f78 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:05:40.462968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-21ed93ae-3908-44f6-9a7f-0a494e197f78 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:05:40.466514 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21ed93ae-3908-44f6-9a7f-0a494e197f78 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:40.466993 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21ed93ae-3908-44f6-9a7f-0a494e197f78 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:40.467792 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21ed93ae-3908-44f6-9a7f-0a494e197f78 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:40.468263 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-21ed93ae-3908-44f6-9a7f-0a494e197f78 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:40.607127 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-21ed93ae-3908-44f6-9a7f-0a494e197f78 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:05:40.615094 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-21ed93ae-3908-44f6-9a7f-0a494e197f78 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1678 microversion: 2.1 time: 0.161510 May 28 22:05:40.615677 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3504/7049] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:05:40 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:05:41.634189 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-aceca835-60d6-4b21-825a-d8b55f8bbc53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:05:41.634912 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-aceca835-60d6-4b21-825a-d8b55f8bbc53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:05:41.641195 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aceca835-60d6-4b21-825a-d8b55f8bbc53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:41.641662 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aceca835-60d6-4b21-825a-d8b55f8bbc53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:41.642976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aceca835-60d6-4b21-825a-d8b55f8bbc53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:41.643428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-aceca835-60d6-4b21-825a-d8b55f8bbc53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:41.780105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-aceca835-60d6-4b21-825a-d8b55f8bbc53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:05:41.788369 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-aceca835-60d6-4b21-825a-d8b55f8bbc53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1678 microversion: 2.1 time: 0.159405 May 28 22:05:41.788950 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3546/7050] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:05:41 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:05:42.805700 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-96cb7c23-80ba-4cff-af59-607b875e674c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:05:42.806370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-96cb7c23-80ba-4cff-af59-607b875e674c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:05:42.814044 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96cb7c23-80ba-4cff-af59-607b875e674c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:42.814517 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96cb7c23-80ba-4cff-af59-607b875e674c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:42.815298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96cb7c23-80ba-4cff-af59-607b875e674c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:05:42.815755 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96cb7c23-80ba-4cff-af59-607b875e674c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:05:42.942538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-96cb7c23-80ba-4cff-af59-607b875e674c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:05:42.950303 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-96cb7c23-80ba-4cff-af59-607b875e674c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1682 microversion: 2.1 time: 0.148544 May 28 22:05:42.950876 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3505/7051] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:05:42 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:05.121047 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-59abd5f2-d988-4e4b-9970-75205be83517 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:06:05.122071 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-59abd5f2-d988-4e4b-9970-75205be83517 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:05.124429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=16 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:06:05.125091 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:06:05.130427 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-59abd5f2-d988-4e4b-9970-75205be83517 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:05.130890 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-59abd5f2-d988-4e4b-9970-75205be83517 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:05.131660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-59abd5f2-d988-4e4b-9970-75205be83517 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:05.132107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-59abd5f2-d988-4e4b-9970-75205be83517 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:05.184730 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-59abd5f2-d988-4e4b-9970-75205be83517 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6/action" status: 200 len: 60907 microversion: 2.1 time: 0.067632 May 28 22:06:05.185397 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3547/7052] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:06:05 2022] POST /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6/action => generated 60907 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 22:06:12.220541 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fd286d99-dfed-4a1b-a641-3cf413024238 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:12.227418 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-9adebd93-c4f6-458a-8d16-3bb77f4054f7 req-70df224a-0b4d-4d1e-8837-d739c77c7b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f869435-7c02-42ff-bef9-8a88e60af7d6", "tag": "752f8fad-b32e-47cd-9f56-a4a27a7ef00e"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:06:12.231968 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fd286d99-dfed-4a1b-a641-3cf413024238 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:12.234812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=19 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:06:12.235617 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=50 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:06:12.240806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fd286d99-dfed-4a1b-a641-3cf413024238 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:12.241407 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fd286d99-dfed-4a1b-a641-3cf413024238 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:12.242378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fd286d99-dfed-4a1b-a641-3cf413024238 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:12.242954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fd286d99-dfed-4a1b-a641-3cf413024238 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:12.243661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9adebd93-c4f6-458a-8d16-3bb77f4054f7 req-70df224a-0b4d-4d1e-8837-d739c77c7b77 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:12.244123 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-9adebd93-c4f6-458a-8d16-3bb77f4054f7 req-70df224a-0b4d-4d1e-8837-d739c77c7b77 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:12.255662 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-9adebd93-c4f6-458a-8d16-3bb77f4054f7 req-70df224a-0b4d-4d1e-8837-d739c77c7b77 service nova] Creating event network-changed:752f8fad-b32e-47cd-9f56-a4a27a7ef00e for instance 9f869435-7c02-42ff-bef9-8a88e60af7d6 on nch1-master-1 May 28 22:06:12.261024 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-9adebd93-c4f6-458a-8d16-3bb77f4054f7 req-70df224a-0b4d-4d1e-8837-d739c77c7b77 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037924 May 28 22:06:12.261879 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3548/7053] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:06:12.278991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fd286d99-dfed-4a1b-a641-3cf413024238 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 22:06:12.598685 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fd286d99-dfed-4a1b-a641-3cf413024238 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 204 len: 0 microversion: 2.1 time: 0.382050 May 28 22:06:12.599819 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3506/7054] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 22:06:12 2022] DELETE /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 22:06:12.609585 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4d98f0f9-697d-4220-9c5d-0f27c0123dad tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:12.610472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4d98f0f9-697d-4220-9c5d-0f27c0123dad tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:12.617684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d98f0f9-697d-4220-9c5d-0f27c0123dad tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:12.618178 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d98f0f9-697d-4220-9c5d-0f27c0123dad tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:12.618973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d98f0f9-697d-4220-9c5d-0f27c0123dad tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:12.619426 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4d98f0f9-697d-4220-9c5d-0f27c0123dad tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:12.812414 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-4d98f0f9-697d-4220-9c5d-0f27c0123dad tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:12.820842 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4d98f0f9-697d-4220-9c5d-0f27c0123dad tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1688 microversion: 2.1 time: 0.216064 May 28 22:06:12.821421 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3549/7055] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:12 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1688 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:13.697789 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:06:13.698404 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 22:06:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:06:13.839789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6c40c721-60ab-4343-b0dc-569af79a5af1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:13.840531 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-6c40c721-60ab-4343-b0dc-569af79a5af1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:13.847809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c40c721-60ab-4343-b0dc-569af79a5af1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:13.848292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c40c721-60ab-4343-b0dc-569af79a5af1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:13.849096 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c40c721-60ab-4343-b0dc-569af79a5af1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:13.849568 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-6c40c721-60ab-4343-b0dc-569af79a5af1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:14.026322 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-6c40c721-60ab-4343-b0dc-569af79a5af1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:14.034535 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6c40c721-60ab-4343-b0dc-569af79a5af1 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1688 microversion: 2.1 time: 0.199193 May 28 22:06:14.035119 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3507/7056] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:13 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1688 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:14.926139 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-87cf49ca-6361-4164-bcee-f144a409c375 req-f525769b-840b-4e20-9bd7-970008a8339d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f869435-7c02-42ff-bef9-8a88e60af7d6", "name": "network-vif-deleted", "tag": "752f8fad-b32e-47cd-9f56-a4a27a7ef00e"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:06:14.935715 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-87cf49ca-6361-4164-bcee-f144a409c375 req-f525769b-840b-4e20-9bd7-970008a8339d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:14.936178 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-87cf49ca-6361-4164-bcee-f144a409c375 req-f525769b-840b-4e20-9bd7-970008a8339d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:14.947273 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-87cf49ca-6361-4164-bcee-f144a409c375 req-f525769b-840b-4e20-9bd7-970008a8339d service nova] Creating event network-vif-deleted:752f8fad-b32e-47cd-9f56-a4a27a7ef00e for instance 9f869435-7c02-42ff-bef9-8a88e60af7d6 on nch1-master-1 May 28 22:06:14.952036 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-87cf49ca-6361-4164-bcee-f144a409c375 req-f525769b-840b-4e20-9bd7-970008a8339d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029688 May 28 22:06:14.955639 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3550/7057] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:06:15.051356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b0cefc5a-aa1a-4120-bd54-492d53186b10 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:15.051990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b0cefc5a-aa1a-4120-bd54-492d53186b10 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:15.060033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0cefc5a-aa1a-4120-bd54-492d53186b10 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:15.060746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0cefc5a-aa1a-4120-bd54-492d53186b10 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:15.061652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0cefc5a-aa1a-4120-bd54-492d53186b10 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:15.062143 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b0cefc5a-aa1a-4120-bd54-492d53186b10 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:15.125595 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b0cefc5a-aa1a-4120-bd54-492d53186b10 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:15.134052 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b0cefc5a-aa1a-4120-bd54-492d53186b10 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 200 len: 1351 microversion: 2.1 time: 0.086484 May 28 22:06:15.134581 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3508/7058] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:15 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 1351 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:16.153469 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e60d1099-f37e-48d1-8a1e-8ef1b9444c83 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:16.154223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e60d1099-f37e-48d1-8a1e-8ef1b9444c83 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: 9f869435-7c02-42ff-bef9-8a88e60af7d6] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:16.161258 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e60d1099-f37e-48d1-8a1e-8ef1b9444c83 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:16.161721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e60d1099-f37e-48d1-8a1e-8ef1b9444c83 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:16.162524 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e60d1099-f37e-48d1-8a1e-8ef1b9444c83 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:16.162985 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e60d1099-f37e-48d1-8a1e-8ef1b9444c83 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:16.179075 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-e60d1099-f37e-48d1-8a1e-8ef1b9444c83 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] HTTP exception thrown: Instance 9f869435-7c02-42ff-bef9-8a88e60af7d6 could not be found. May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e60d1099-f37e-48d1-8a1e-8ef1b9444c83 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Request method failure captured: May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 HTTP/1.1 May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikptOuO8oVBSIrBTIbL1qBafkM3bRPqHRtdmD9HRzAg7Rq6Sa9lPn2eCwncLkJYy5x5D810AJAdLKgrCA2pyb1pdvaP3HK5GoIFP0N8s94-1UlDC3wszHDUtJtWOu2ExEC0RSI6YR2LI3hXkxUjTpT0O1jnASr-USfa-JS-4KnaOepP0 May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 38d3db1f6443461f90a5be23358b6816 May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-582264347 May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38d3db1f6443461f90a5be23358b6816", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d3db1f6443461f90a5be23358b6816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38d3db1f6443461f90a5be23358b6816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d3db1f6443461f90a5be23358b6816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestNetworkAdvancedServerOps-582264347 May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 38d3db1f6443461f90a5be23358b6816 May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-582264347 May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestNetworkAdvancedServerOps-582264347-project May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 56b376ad4a314418bca5fcbf8a8ca429 May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestNetworkAdvancedServerOps-582264347-project May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 9f869435-7c02-42ff-bef9-8a88e60af7d6 could not be found. May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '9f869435-7c02-42ff-bef9-8a88e60af7d6'} May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f869435-7c02-42ff-bef9-8a88e60af7d6 could not be found. May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f869435-7c02-42ff-bef9-8a88e60af7d6 could not be found. May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:06:16.180716 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:06:16.185446 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:06:16.185446 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:06:16.185446 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:06:16.185446 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 22:06:16.185446 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 22:06:16.185446 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f869435-7c02-42ff-bef9-8a88e60af7d6 could not be found. May 28 22:06:16.185446 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:06:16.185446 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e60d1099-f37e-48d1-8a1e-8ef1b9444c83 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Returning 404 to user: Instance 9f869435-7c02-42ff-bef9-8a88e60af7d6 could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 22:06:16.185446 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e60d1099-f37e-48d1-8a1e-8ef1b9444c83 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6" status: 404 len: 111 microversion: 2.1 time: 0.034001 May 28 22:06:16.185446 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3551/7059] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:16 2022] GET /compute/v2.1/servers/9f869435-7c02-42ff-bef9-8a88e60af7d6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 22:06:19.610523 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bddd05d0-8ef7-4946-9238-5c3329fde175 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '.version_select at 0x7f4d641449d0>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:19.719833 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bddd05d0-8ef7-4946-9238-5c3329fde175 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-537323381" status: 202 len: 0 microversion: 2.1 time: 0.116601 May 28 22:06:19.720355 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3509/7060] 10.222.0.33 () {58 vars in 1280 bytes} [Sat May 28 22:06:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-537323381 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:06:19.753508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ea88436f-6ec4-4741-90f9-d279ba8c1dec tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'create', calling method: .version_select at 0x7f4d5727f5e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1862018501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8ei4QKanQEnDPURMCp564IJfSY5zNZCVQLfxqThUyypu9ckMyxlAaHohzX/RSO719DhqcdJ+AMCmMr4hsaDB2hfa/OWTOeuBp7VFTwGmGoXXD0QgVCwdfIYwNyU//gTg=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:06:19.769006 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ea88436f-6ec4-4741-90f9-d279ba8c1dec tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for project 38d3db1f6443461f90a5be23358b6816. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 22:06:19.775129 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ea88436f-6ec4-4741-90f9-d279ba8c1dec tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for user 56b376ad4a314418bca5fcbf8a8ca429 and project 38d3db1f6443461f90a5be23358b6816. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 22:06:19.885356 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ea88436f-6ec4-4741-90f9-d279ba8c1dec tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.135704 May 28 22:06:19.886002 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3552/7061] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 22:06:19 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:06:28.326380 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:06:28.330991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1976253112", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "networks": [{"uuid": "d4d9d34e-2bb3-418c-bfa4-138bf1821852"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1862018501", "security_groups": [{"name": "tempest-secgroup-smoke-591533755"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:06:28.479398 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] validate_networks() for [('d4d9d34e-2bb3-418c-bfa4-138bf1821852', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 22:06:28.902468 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 22:06:28.902938 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 22:06:28.903441 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 22:06:28.903879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 22:06:28.904356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 22:06:28.914298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:28.914777 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:28.915613 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:28.916377 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:28.934413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for project 38d3db1f6443461f90a5be23358b6816. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 22:06:28.939876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Getting quotas for user 56b376ad4a314418bca5fcbf8a8ca429 and project 38d3db1f6443461f90a5be23358b6816. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 22:06:28.953314 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 22:06:28.956474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 22:06:29.063457 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-66fb7ff2-8185-419a-a9a8-46adc2299413 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.739034 May 28 22:06:29.076213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a16be553-2963-449c-ba6d-4a486a3ad830 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:29.078921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a16be553-2963-449c-ba6d-4a486a3ad830 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:29.079054 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3510/7062] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 22:06:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 22:06:29.080359 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=16 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:06:29.136250 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a16be553-2963-449c-ba6d-4a486a3ad830 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:29.143958 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a16be553-2963-449c-ba6d-4a486a3ad830 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1267 microversion: 2.1 time: 0.071264 May 28 22:06:29.144548 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3553/7063] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:29 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1267 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:30.161603 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0946da15-ee72-4a47-9c0e-c391db43885d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:30.162428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0946da15-ee72-4a47-9c0e-c391db43885d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:30.226494 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0946da15-ee72-4a47-9c0e-c391db43885d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:30.235474 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0946da15-ee72-4a47-9c0e-c391db43885d tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1267 microversion: 2.1 time: 0.078653 May 28 22:06:30.236404 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3511/7064] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:30 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1267 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:31.253505 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6bd98967-006f-4fab-852f-31a155b5e9f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:31.254090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6bd98967-006f-4fab-852f-31a155b5e9f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:31.262154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6bd98967-006f-4fab-852f-31a155b5e9f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:31.262623 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6bd98967-006f-4fab-852f-31a155b5e9f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:31.263417 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6bd98967-006f-4fab-852f-31a155b5e9f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:31.264066 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6bd98967-006f-4fab-852f-31a155b5e9f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:31.328201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6bd98967-006f-4fab-852f-31a155b5e9f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:31.336022 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6bd98967-006f-4fab-852f-31a155b5e9f2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1271 microversion: 2.1 time: 0.087245 May 28 22:06:31.336612 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3554/7065] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:31 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:32.353148 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2b31492c-3a2f-41b2-9ad2-6cf726e61d85 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:32.353789 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2b31492c-3a2f-41b2-9ad2-6cf726e61d85 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:32.360913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b31492c-3a2f-41b2-9ad2-6cf726e61d85 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:32.361393 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b31492c-3a2f-41b2-9ad2-6cf726e61d85 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:32.362790 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b31492c-3a2f-41b2-9ad2-6cf726e61d85 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:32.363260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b31492c-3a2f-41b2-9ad2-6cf726e61d85 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:32.427815 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2b31492c-3a2f-41b2-9ad2-6cf726e61d85 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:32.435562 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2b31492c-3a2f-41b2-9ad2-6cf726e61d85 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1263 microversion: 2.1 time: 0.086563 May 28 22:06:32.436369 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3512/7066] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:32 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1263 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:33.454117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b9f8ff9d-bef1-4b02-8cac-242c39846703 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:33.454755 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b9f8ff9d-bef1-4b02-8cac-242c39846703 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:33.462437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9f8ff9d-bef1-4b02-8cac-242c39846703 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:33.462913 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9f8ff9d-bef1-4b02-8cac-242c39846703 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:33.463707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9f8ff9d-bef1-4b02-8cac-242c39846703 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:33.464165 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b9f8ff9d-bef1-4b02-8cac-242c39846703 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:33.527231 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b9f8ff9d-bef1-4b02-8cac-242c39846703 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:33.535514 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b9f8ff9d-bef1-4b02-8cac-242c39846703 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1325 microversion: 2.1 time: 0.085352 May 28 22:06:33.536133 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3555/7067] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:33 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1325 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:34.555725 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ade52645-7f71-4e61-b48c-6773653ef347 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:34.569606 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ade52645-7f71-4e61-b48c-6773653ef347 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:34.569759 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-b395821b-eed3-49fe-8a4e-caff1eca6d89 req-e7a4352e-b9cc-4b08-8f9f-e376a66ae9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e342549d-d255-4e2a-ab54-a88c59fa4499", "tag": "52e9903b-eb4a-4da2-9838-5f726533fd14"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:06:34.570250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ade52645-7f71-4e61-b48c-6773653ef347 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:34.570250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ade52645-7f71-4e61-b48c-6773653ef347 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:34.570250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ade52645-7f71-4e61-b48c-6773653ef347 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:34.570250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ade52645-7f71-4e61-b48c-6773653ef347 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:34.576398 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b395821b-eed3-49fe-8a4e-caff1eca6d89 req-e7a4352e-b9cc-4b08-8f9f-e376a66ae9cc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:34.577396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-b395821b-eed3-49fe-8a4e-caff1eca6d89 req-e7a4352e-b9cc-4b08-8f9f-e376a66ae9cc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:34.595361 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-b395821b-eed3-49fe-8a4e-caff1eca6d89 req-e7a4352e-b9cc-4b08-8f9f-e376a66ae9cc service nova] Creating event network-changed:52e9903b-eb4a-4da2-9838-5f726533fd14 for instance e342549d-d255-4e2a-ab54-a88c59fa4499 on nch1-master-1 May 28 22:06:34.601236 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-b395821b-eed3-49fe-8a4e-caff1eca6d89 req-e7a4352e-b9cc-4b08-8f9f-e376a66ae9cc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047093 May 28 22:06:34.602514 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3556/7068] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:06:34.731977 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ade52645-7f71-4e61-b48c-6773653ef347 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:34.740615 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ade52645-7f71-4e61-b48c-6773653ef347 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1392 microversion: 2.1 time: 0.191227 May 28 22:06:34.741590 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3513/7069] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:34 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1392 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:35.758609 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e24b4b57-4351-4a7a-bab6-02b12ab131ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:35.759252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e24b4b57-4351-4a7a-bab6-02b12ab131ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:35.761213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:06:35.766316 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e24b4b57-4351-4a7a-bab6-02b12ab131ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:35.766778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e24b4b57-4351-4a7a-bab6-02b12ab131ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:35.767556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e24b4b57-4351-4a7a-bab6-02b12ab131ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:35.768007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e24b4b57-4351-4a7a-bab6-02b12ab131ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:35.900619 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e24b4b57-4351-4a7a-bab6-02b12ab131ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:35.908417 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e24b4b57-4351-4a7a-bab6-02b12ab131ef tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1392 microversion: 2.1 time: 0.155083 May 28 22:06:35.909031 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3557/7070] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:35 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:36.926117 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bd3f4318-98c5-4bb6-b482-145b09536256 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:36.927296 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bd3f4318-98c5-4bb6-b482-145b09536256 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:36.934298 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd3f4318-98c5-4bb6-b482-145b09536256 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:36.934771 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd3f4318-98c5-4bb6-b482-145b09536256 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:36.935561 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd3f4318-98c5-4bb6-b482-145b09536256 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:36.936022 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bd3f4318-98c5-4bb6-b482-145b09536256 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:37.069590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bd3f4318-98c5-4bb6-b482-145b09536256 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:37.077314 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bd3f4318-98c5-4bb6-b482-145b09536256 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1392 microversion: 2.1 time: 0.155225 May 28 22:06:37.077947 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3514/7071] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:36 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:38.094138 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0af99e2c-7f58-49f4-8f10-847f7ab6f810 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:38.094776 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0af99e2c-7f58-49f4-8f10-847f7ab6f810 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:38.102373 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0af99e2c-7f58-49f4-8f10-847f7ab6f810 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:38.102849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0af99e2c-7f58-49f4-8f10-847f7ab6f810 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:38.103632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0af99e2c-7f58-49f4-8f10-847f7ab6f810 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:38.104087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0af99e2c-7f58-49f4-8f10-847f7ab6f810 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:38.231785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0af99e2c-7f58-49f4-8f10-847f7ab6f810 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:38.239907 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0af99e2c-7f58-49f4-8f10-847f7ab6f810 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1392 microversion: 2.1 time: 0.149140 May 28 22:06:38.240480 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3558/7072] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:38 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1392 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:39.256929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0691a4af-fd94-4c93-944f-75697d11ea26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:39.257562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0691a4af-fd94-4c93-944f-75697d11ea26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:39.260354 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:06:39.265578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0691a4af-fd94-4c93-944f-75697d11ea26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:39.270890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0691a4af-fd94-4c93-944f-75697d11ea26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:39.270890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0691a4af-fd94-4c93-944f-75697d11ea26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:39.270890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0691a4af-fd94-4c93-944f-75697d11ea26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:39.399878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0691a4af-fd94-4c93-944f-75697d11ea26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:39.407842 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0691a4af-fd94-4c93-944f-75697d11ea26 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1392 microversion: 2.1 time: 0.155163 May 28 22:06:39.408433 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3515/7073] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:39 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:40.424767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b37c70f2-ec66-4c9c-9875-f0086f85f1a3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:40.425507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b37c70f2-ec66-4c9c-9875-f0086f85f1a3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:40.429011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:06:40.433981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b37c70f2-ec66-4c9c-9875-f0086f85f1a3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:40.434450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b37c70f2-ec66-4c9c-9875-f0086f85f1a3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:40.435219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b37c70f2-ec66-4c9c-9875-f0086f85f1a3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:40.435667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b37c70f2-ec66-4c9c-9875-f0086f85f1a3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:40.572742 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b37c70f2-ec66-4c9c-9875-f0086f85f1a3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:40.580274 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b37c70f2-ec66-4c9c-9875-f0086f85f1a3 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1392 microversion: 2.1 time: 0.159521 May 28 22:06:40.580861 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3559/7074] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:40 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:06:41.003447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-89662e24-9e66-4d02-b890-9dd23e85a8f9 req-a24102d7-3648-45ab-aaa6-c5c81b17f87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e342549d-d255-4e2a-ab54-a88c59fa4499", "name": "network-vif-plugged", "status": "completed", "tag": "52e9903b-eb4a-4da2-9838-5f726533fd14"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:06:41.007688 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:06:41.014366 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-89662e24-9e66-4d02-b890-9dd23e85a8f9 req-a24102d7-3648-45ab-aaa6-c5c81b17f87c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:41.016638 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-89662e24-9e66-4d02-b890-9dd23e85a8f9 req-a24102d7-3648-45ab-aaa6-c5c81b17f87c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:41.026786 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-89662e24-9e66-4d02-b890-9dd23e85a8f9 req-a24102d7-3648-45ab-aaa6-c5c81b17f87c service nova] Creating event network-vif-plugged:52e9903b-eb4a-4da2-9838-5f726533fd14 for instance e342549d-d255-4e2a-ab54-a88c59fa4499 on nch1-master-1 May 28 22:06:41.032425 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-89662e24-9e66-4d02-b890-9dd23e85a8f9 req-a24102d7-3648-45ab-aaa6-c5c81b17f87c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032758 May 28 22:06:41.033387 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3516/7075] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:06:41.597547 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-fe2fe8ea-e9d8-461c-b6d3-cd46e685b950 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:41.598301 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-fe2fe8ea-e9d8-461c-b6d3-cd46e685b950 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:41.606025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe2fe8ea-e9d8-461c-b6d3-cd46e685b950 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:41.606496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe2fe8ea-e9d8-461c-b6d3-cd46e685b950 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:41.607296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe2fe8ea-e9d8-461c-b6d3-cd46e685b950 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:41.610891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-fe2fe8ea-e9d8-461c-b6d3-cd46e685b950 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:41.737513 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-fe2fe8ea-e9d8-461c-b6d3-cd46e685b950 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:41.745659 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-fe2fe8ea-e9d8-461c-b6d3-cd46e685b950 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1392 microversion: 2.1 time: 0.152107 May 28 22:06:41.746263 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3560/7076] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:41 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:42.762420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-85f69860-bb8d-452e-9e83-e034d0ea5f95 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:42.763135 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-85f69860-bb8d-452e-9e83-e034d0ea5f95 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:42.766328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:06:42.772382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85f69860-bb8d-452e-9e83-e034d0ea5f95 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:42.772853 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85f69860-bb8d-452e-9e83-e034d0ea5f95 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:42.773632 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85f69860-bb8d-452e-9e83-e034d0ea5f95 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:42.774114 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-85f69860-bb8d-452e-9e83-e034d0ea5f95 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:42.909144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-85f69860-bb8d-452e-9e83-e034d0ea5f95 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:42.916781 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-85f69860-bb8d-452e-9e83-e034d0ea5f95 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1565 microversion: 2.1 time: 0.158737 May 28 22:06:42.917363 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3517/7077] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:42 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:42.933308 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d21be183-f42e-4d5a-a876-f26f55b730b7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:42.933981 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d21be183-f42e-4d5a-a876-f26f55b730b7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:42.940949 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d21be183-f42e-4d5a-a876-f26f55b730b7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:42.941415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d21be183-f42e-4d5a-a876-f26f55b730b7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:42.942767 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d21be183-f42e-4d5a-a876-f26f55b730b7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:42.943230 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d21be183-f42e-4d5a-a876-f26f55b730b7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:43.073126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d21be183-f42e-4d5a-a876-f26f55b730b7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:43.080897 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d21be183-f42e-4d5a-a876-f26f55b730b7 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1565 microversion: 2.1 time: 0.151484 May 28 22:06:43.081472 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3561/7078] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:42 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1565 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:06:45.282420 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ed8a2efb-e2b2-40a6-8bf5-e72d2249a21e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:06:45.282990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ed8a2efb-e2b2-40a6-8bf5-e72d2249a21e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:06:45.283782 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-a19a9bb1-823f-4484-9745-59fb64ec8959 req-fb26c5ad-280d-414e-8c45-58d37fb6e671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e342549d-d255-4e2a-ab54-a88c59fa4499", "tag": "52e9903b-eb4a-4da2-9838-5f726533fd14"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:06:45.291144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed8a2efb-e2b2-40a6-8bf5-e72d2249a21e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:45.291642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed8a2efb-e2b2-40a6-8bf5-e72d2249a21e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:45.292440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed8a2efb-e2b2-40a6-8bf5-e72d2249a21e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:45.292895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ed8a2efb-e2b2-40a6-8bf5-e72d2249a21e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:45.293875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a19a9bb1-823f-4484-9745-59fb64ec8959 req-fb26c5ad-280d-414e-8c45-58d37fb6e671 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:06:45.294419 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-a19a9bb1-823f-4484-9745-59fb64ec8959 req-fb26c5ad-280d-414e-8c45-58d37fb6e671 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:06:45.307834 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-a19a9bb1-823f-4484-9745-59fb64ec8959 req-fb26c5ad-280d-414e-8c45-58d37fb6e671 service nova] Creating event network-changed:52e9903b-eb4a-4da2-9838-5f726533fd14 for instance e342549d-d255-4e2a-ab54-a88c59fa4499 on nch1-master-1 May 28 22:06:45.313092 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-a19a9bb1-823f-4484-9745-59fb64ec8959 req-fb26c5ad-280d-414e-8c45-58d37fb6e671 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033628 May 28 22:06:45.314259 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3562/7079] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 22:06:45.451590 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ed8a2efb-e2b2-40a6-8bf5-e72d2249a21e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:06:45.459341 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ed8a2efb-e2b2-40a6-8bf5-e72d2249a21e tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1565 microversion: 2.1 time: 0.182387 May 28 22:06:45.469866 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3518/7080] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:06:45 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1565 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:07:06.679849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=11 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:07:06.680538 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=46 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:07:06.684817 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9edf1ec6-52d2-48cb-adef-5fa4185d6c47 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:07:06.685911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9edf1ec6-52d2-48cb-adef-5fa4185d6c47 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:06.695157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9edf1ec6-52d2-48cb-adef-5fa4185d6c47 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:06.695157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9edf1ec6-52d2-48cb-adef-5fa4185d6c47 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:06.695157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9edf1ec6-52d2-48cb-adef-5fa4185d6c47 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:06.695157 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9edf1ec6-52d2-48cb-adef-5fa4185d6c47 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:06.750357 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9edf1ec6-52d2-48cb-adef-5fa4185d6c47 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499/action" status: 200 len: 24553 microversion: 2.1 time: 0.072468 May 28 22:07:06.751038 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3563/7081] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:07:06 2022] POST /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499/action => generated 24553 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 22:07:17.734659 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-47e00ca9-2ce4-4a2c-9b44-585a26c158ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:07:17.735212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-47e00ca9-2ce4-4a2c-9b44-585a26c158ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:17.737430 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:07:17.738133 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=40 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:07:17.743009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47e00ca9-2ce4-4a2c-9b44-585a26c158ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:17.743557 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47e00ca9-2ce4-4a2c-9b44-585a26c158ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:17.744344 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47e00ca9-2ce4-4a2c-9b44-585a26c158ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:17.744794 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-47e00ca9-2ce4-4a2c-9b44-585a26c158ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:17.769300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.objects.instance [None req-47e00ca9-2ce4-4a2c-9b44-585a26c158ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lazy-loading 'flavor' on Instance uuid e342549d-d255-4e2a-ab54-a88c59fa4499 {{(pid=143128) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 22:07:18.017994 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-47e00ca9-2ce4-4a2c-9b44-585a26c158ae tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499/action" status: 202 len: 0 microversion: 2.1 time: 0.287838 May 28 22:07:18.018617 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3519/7082] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:07:17 2022] POST /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:07:18.027661 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6a4517ce-ceec-4f78-82bb-cf2d5dcdafe2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:18.028388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6a4517ce-ceec-4f78-82bb-cf2d5dcdafe2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:18.031456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:07:18.032125 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=4 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:07:18.037865 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a4517ce-ceec-4f78-82bb-cf2d5dcdafe2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:18.039346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a4517ce-ceec-4f78-82bb-cf2d5dcdafe2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:18.039346 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a4517ce-ceec-4f78-82bb-cf2d5dcdafe2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:18.039553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6a4517ce-ceec-4f78-82bb-cf2d5dcdafe2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:18.174577 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6a4517ce-ceec-4f78-82bb-cf2d5dcdafe2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:18.182281 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6a4517ce-ceec-4f78-82bb-cf2d5dcdafe2 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1691 microversion: 2.1 time: 0.159360 May 28 22:07:18.182869 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3564/7083] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:18 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:07:19.201664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-135da75c-d9bc-4b03-b378-9d1e021b7033 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:19.202413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-135da75c-d9bc-4b03-b378-9d1e021b7033 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:19.208767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-135da75c-d9bc-4b03-b378-9d1e021b7033 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:19.209239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-135da75c-d9bc-4b03-b378-9d1e021b7033 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:19.210061 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-135da75c-d9bc-4b03-b378-9d1e021b7033 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:19.210521 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-135da75c-d9bc-4b03-b378-9d1e021b7033 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:19.346306 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-135da75c-d9bc-4b03-b378-9d1e021b7033 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:19.354008 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-135da75c-d9bc-4b03-b378-9d1e021b7033 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1674 microversion: 2.1 time: 0.157551 May 28 22:07:19.354599 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3520/7084] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:19 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:07:20.439997 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-112a5596-daea-4c26-b1d8-648c6044cd81 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:07:20.440870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-112a5596-daea-4c26-b1d8-648c6044cd81 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:20.450365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-112a5596-daea-4c26-b1d8-648c6044cd81 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:20.450853 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-112a5596-daea-4c26-b1d8-648c6044cd81 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:20.451645 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-112a5596-daea-4c26-b1d8-648c6044cd81 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:20.452136 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-112a5596-daea-4c26-b1d8-648c6044cd81 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:20.501651 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-112a5596-daea-4c26-b1d8-648c6044cd81 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499/action" status: 200 len: 38401 microversion: 2.1 time: 0.065571 May 28 22:07:20.502335 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3565/7085] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:07:20 2022] POST /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499/action => generated 38401 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 22:07:20.513478 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-098f4ca0-ea32-4e1c-9e9f-1835016b726c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:07:20.514108 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-098f4ca0-ea32-4e1c-9e9f-1835016b726c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:20.521195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-098f4ca0-ea32-4e1c-9e9f-1835016b726c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:20.521676 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-098f4ca0-ea32-4e1c-9e9f-1835016b726c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:20.522519 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-098f4ca0-ea32-4e1c-9e9f-1835016b726c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:20.522986 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-098f4ca0-ea32-4e1c-9e9f-1835016b726c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:20.706100 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-098f4ca0-ea32-4e1c-9e9f-1835016b726c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499/action" status: 202 len: 0 microversion: 2.1 time: 0.196328 May 28 22:07:20.706735 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3521/7086] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:07:20 2022] POST /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:07:20.716330 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-841f70aa-1122-47bd-8b2b-9d45d48c9480 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:20.717062 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-841f70aa-1122-47bd-8b2b-9d45d48c9480 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:20.724520 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-841f70aa-1122-47bd-8b2b-9d45d48c9480 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:20.724991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-841f70aa-1122-47bd-8b2b-9d45d48c9480 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:20.725789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-841f70aa-1122-47bd-8b2b-9d45d48c9480 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:20.726281 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-841f70aa-1122-47bd-8b2b-9d45d48c9480 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:20.869582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-841f70aa-1122-47bd-8b2b-9d45d48c9480 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:20.878166 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-841f70aa-1122-47bd-8b2b-9d45d48c9480 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1680 microversion: 2.1 time: 0.166672 May 28 22:07:20.879062 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3566/7087] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:20 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:07:21.897824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fc2a15c8-afde-4ffc-b0d8-f3f8c55d3d32 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:21.898584 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fc2a15c8-afde-4ffc-b0d8-f3f8c55d3d32 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:21.905704 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc2a15c8-afde-4ffc-b0d8-f3f8c55d3d32 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:21.906718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc2a15c8-afde-4ffc-b0d8-f3f8c55d3d32 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:21.906982 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc2a15c8-afde-4ffc-b0d8-f3f8c55d3d32 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:21.907444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fc2a15c8-afde-4ffc-b0d8-f3f8c55d3d32 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:22.046286 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fc2a15c8-afde-4ffc-b0d8-f3f8c55d3d32 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:22.054604 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fc2a15c8-afde-4ffc-b0d8-f3f8c55d3d32 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1680 microversion: 2.1 time: 0.161961 May 28 22:07:22.055194 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3522/7088] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:21 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:07:23.072930 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-62ef4c8c-89d9-4527-acd9-e52338da2385 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:23.073562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-62ef4c8c-89d9-4527-acd9-e52338da2385 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:23.080660 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62ef4c8c-89d9-4527-acd9-e52338da2385 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:23.081119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62ef4c8c-89d9-4527-acd9-e52338da2385 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:23.081928 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62ef4c8c-89d9-4527-acd9-e52338da2385 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:23.082375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-62ef4c8c-89d9-4527-acd9-e52338da2385 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:23.212383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-62ef4c8c-89d9-4527-acd9-e52338da2385 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:23.220947 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-62ef4c8c-89d9-4527-acd9-e52338da2385 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1683 microversion: 2.1 time: 0.152802 May 28 22:07:23.221461 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3567/7089] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:23 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:07:23.311657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-12843945-a702-43bd-9913-ceaf30368771 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:07:23.312652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-12843945-a702-43bd-9913-ceaf30368771 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:23.320112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12843945-a702-43bd-9913-ceaf30368771 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:23.320586 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12843945-a702-43bd-9913-ceaf30368771 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:23.321369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12843945-a702-43bd-9913-ceaf30368771 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:23.321819 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-12843945-a702-43bd-9913-ceaf30368771 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:23.363361 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-12843945-a702-43bd-9913-ceaf30368771 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "POST /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499/action" status: 200 len: 38401 microversion: 2.1 time: 0.055515 May 28 22:07:23.365714 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3523/7090] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:07:23 2022] POST /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499/action => generated 38401 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 22:07:24.734993 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9f2c8e57-0fbc-4df7-ac14-8289d35dea53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:24.735508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9f2c8e57-0fbc-4df7-ac14-8289d35dea53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:24.737576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-92eb677e-b06d-487f-a70c-d665acc8143b req-bf7b77a7-2910-47f3-b926-fcc3bee478d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e342549d-d255-4e2a-ab54-a88c59fa4499", "tag": "52e9903b-eb4a-4da2-9838-5f726533fd14"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:07:24.743199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f2c8e57-0fbc-4df7-ac14-8289d35dea53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:24.743872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f2c8e57-0fbc-4df7-ac14-8289d35dea53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:24.744667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f2c8e57-0fbc-4df7-ac14-8289d35dea53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:24.745127 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9f2c8e57-0fbc-4df7-ac14-8289d35dea53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:24.747813 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-92eb677e-b06d-487f-a70c-d665acc8143b req-bf7b77a7-2910-47f3-b926-fcc3bee478d6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:24.748526 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-92eb677e-b06d-487f-a70c-d665acc8143b req-bf7b77a7-2910-47f3-b926-fcc3bee478d6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:24.760447 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-92eb677e-b06d-487f-a70c-d665acc8143b req-bf7b77a7-2910-47f3-b926-fcc3bee478d6 service nova] Creating event network-changed:52e9903b-eb4a-4da2-9838-5f726533fd14 for instance e342549d-d255-4e2a-ab54-a88c59fa4499 on nch1-master-1 May 28 22:07:24.766496 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-92eb677e-b06d-487f-a70c-d665acc8143b req-bf7b77a7-2910-47f3-b926-fcc3bee478d6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033322 May 28 22:07:24.770785 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3524/7091] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:07:24.773199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9f2c8e57-0fbc-4df7-ac14-8289d35dea53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 22:07:25.069236 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9f2c8e57-0fbc-4df7-ac14-8289d35dea53 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 204 len: 0 microversion: 2.1 time: 0.338914 May 28 22:07:25.076462 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3568/7092] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 22:07:24 2022] DELETE /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 22:07:25.080664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-96329e14-dbca-4233-8fc6-d263d026669c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:25.081480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-96329e14-dbca-4233-8fc6-d263d026669c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:25.088208 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96329e14-dbca-4233-8fc6-d263d026669c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:25.100205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96329e14-dbca-4233-8fc6-d263d026669c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:25.100205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96329e14-dbca-4233-8fc6-d263d026669c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:25.100205 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-96329e14-dbca-4233-8fc6-d263d026669c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:25.226569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-96329e14-dbca-4233-8fc6-d263d026669c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:25.234812 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-96329e14-dbca-4233-8fc6-d263d026669c tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1689 microversion: 2.1 time: 0.158711 May 28 22:07:25.235425 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3525/7093] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:25 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:07:26.253284 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-91e51e62-bf85-4c05-b85b-ff8a531881e6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:26.254027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-91e51e62-bf85-4c05-b85b-ff8a531881e6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:26.260726 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91e51e62-bf85-4c05-b85b-ff8a531881e6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:26.261192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91e51e62-bf85-4c05-b85b-ff8a531881e6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:26.261988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91e51e62-bf85-4c05-b85b-ff8a531881e6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:26.262441 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-91e51e62-bf85-4c05-b85b-ff8a531881e6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:26.397999 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-91e51e62-bf85-4c05-b85b-ff8a531881e6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:26.406193 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-91e51e62-bf85-4c05-b85b-ff8a531881e6 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1689 microversion: 2.1 time: 0.157614 May 28 22:07:26.406791 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3569/7094] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:26 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:07:27.060946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-1c36e36e-9be1-4460-bb5d-8e7debab0a54 req-45f28e26-7f3e-402a-a2d8-38cc806fe6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e342549d-d255-4e2a-ab54-a88c59fa4499", "name": "network-vif-deleted", "tag": "52e9903b-eb4a-4da2-9838-5f726533fd14"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:07:27.070097 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1c36e36e-9be1-4460-bb5d-8e7debab0a54 req-45f28e26-7f3e-402a-a2d8-38cc806fe6d1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:27.070569 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-1c36e36e-9be1-4460-bb5d-8e7debab0a54 req-45f28e26-7f3e-402a-a2d8-38cc806fe6d1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:27.082588 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-1c36e36e-9be1-4460-bb5d-8e7debab0a54 req-45f28e26-7f3e-402a-a2d8-38cc806fe6d1 service nova] Creating event network-vif-deleted:52e9903b-eb4a-4da2-9838-5f726533fd14 for instance e342549d-d255-4e2a-ab54-a88c59fa4499 on nch1-master-1 May 28 22:07:27.087466 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-1c36e36e-9be1-4460-bb5d-8e7debab0a54 req-45f28e26-7f3e-402a-a2d8-38cc806fe6d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031450 May 28 22:07:27.088064 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3526/7095] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:07:27.423952 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d4032c26-8e6e-470b-a316-88de3917435b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:27.424586 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d4032c26-8e6e-470b-a316-88de3917435b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:27.432116 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d4032c26-8e6e-470b-a316-88de3917435b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:27.432580 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d4032c26-8e6e-470b-a316-88de3917435b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:27.433378 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d4032c26-8e6e-470b-a316-88de3917435b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:27.433830 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d4032c26-8e6e-470b-a316-88de3917435b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:27.468059 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d4032c26-8e6e-470b-a316-88de3917435b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:27.468528 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d4032c26-8e6e-470b-a316-88de3917435b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:27.469010 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-d4032c26-8e6e-470b-a316-88de3917435b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lazy-loading 'fault' on Instance uuid e342549d-d255-4e2a-ab54-a88c59fa4499 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 22:07:27.511901 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d4032c26-8e6e-470b-a316-88de3917435b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b376ad4a314418bca5fcbf8a8ca429', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d3db1f6443461f90a5be23358b6816', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:27.519635 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d4032c26-8e6e-470b-a316-88de3917435b tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 200 len: 1357 microversion: 2.1 time: 0.099756 May 28 22:07:27.520206 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3570/7096] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:27 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 1357 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:07:28.538299 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84c9aa8c-8ebe-4b2f-8ad4-40b8bd687445 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:28.539009 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-84c9aa8c-8ebe-4b2f-8ad4-40b8bd687445 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] [instance: e342549d-d255-4e2a-ab54-a88c59fa4499] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:28.546046 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84c9aa8c-8ebe-4b2f-8ad4-40b8bd687445 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:28.546524 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84c9aa8c-8ebe-4b2f-8ad4-40b8bd687445 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:28.547308 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84c9aa8c-8ebe-4b2f-8ad4-40b8bd687445 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:28.547764 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-84c9aa8c-8ebe-4b2f-8ad4-40b8bd687445 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:28.564030 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-84c9aa8c-8ebe-4b2f-8ad4-40b8bd687445 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] HTTP exception thrown: Instance e342549d-d255-4e2a-ab54-a88c59fa4499 could not be found. May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84c9aa8c-8ebe-4b2f-8ad4-40b8bd687445 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Request method failure captured: May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 HTTP/1.1 May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikptOuO8oVBSIrBTIbL1qBafkM3bRPqHRtdmD9HRzAg7Rq6Sa9lPn2eCwncLkJYy5x5D810AJAdLKgrCA2pyb1pdvaP3HK5GoIFP0N8s94-1UlDC3wszHDUtJtWOu2ExEC0RSI6YR2LI3hXkxUjTpT0O1jnASr-USfa-JS-4KnaOepP0 May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 38d3db1f6443461f90a5be23358b6816 May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-582264347 May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_38d3db1f6443461f90a5be23358b6816", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d3db1f6443461f90a5be23358b6816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/38d3db1f6443461f90a5be23358b6816"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/38d3db1f6443461f90a5be23358b6816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestNetworkAdvancedServerOps-582264347 May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 38d3db1f6443461f90a5be23358b6816 May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-582264347 May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestNetworkAdvancedServerOps-582264347-project May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 56b376ad4a314418bca5fcbf8a8ca429 May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestNetworkAdvancedServerOps-582264347-project May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance e342549d-d255-4e2a-ab54-a88c59fa4499 could not be found. May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'e342549d-d255-4e2a-ab54-a88c59fa4499'} May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e342549d-d255-4e2a-ab54-a88c59fa4499 could not be found. May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e342549d-d255-4e2a-ab54-a88c59fa4499 could not be found. May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:07:28.565718 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:07:28.570768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:07:28.570768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:07:28.570768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:07:28.570768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 22:07:28.570768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 22:07:28.570768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e342549d-d255-4e2a-ab54-a88c59fa4499 could not be found. May 28 22:07:28.570768 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:07:28.570768 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-84c9aa8c-8ebe-4b2f-8ad4-40b8bd687445 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Returning 404 to user: Instance e342549d-d255-4e2a-ab54-a88c59fa4499 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 22:07:28.570768 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-84c9aa8c-8ebe-4b2f-8ad4-40b8bd687445 tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499" status: 404 len: 111 microversion: 2.1 time: 0.034327 May 28 22:07:28.570768 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3527/7097] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:28 2022] GET /compute/v2.1/servers/e342549d-d255-4e2a-ab54-a88c59fa4499 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 22:07:32.024810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-22908b09-8487-49d1-98db-ec73985174dc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] Calling method '.version_select at 0x7f4d5738b9d0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:32.103730 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-22908b09-8487-49d1-98db-ec73985174dc tempest-TestNetworkAdvancedServerOps-582264347 tempest-TestNetworkAdvancedServerOps-582264347-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1862018501" status: 202 len: 0 microversion: 2.1 time: 0.083091 May 28 22:07:32.104639 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3571/7098] 10.222.0.33 () {58 vars in 1283 bytes} [Sat May 28 22:07:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1862018501 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:07:46.687746 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=18 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:07:46.688929 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:07:46.873600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4d933644-8392-4020-b528-7fa7feb5705e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Action: 'create', calling method: .version_select at 0x7f4d643a8700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1768058375", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDrWb/0nMJ8HXtox++5Rsi0i9Yg45nNX8xVrasWeZ9yKZ4KzNcCq9kDM7hM5Besd9VaMjPIuETKOqui5/zYIcr6Qr3WIo+JhufX6tlaiUMK58e2m3vpF9cQVVvUj0Q6LA=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:07:46.888353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-4d933644-8392-4020-b528-7fa7feb5705e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Getting quotas for project 4ef8feba0c8e45fdb82f09eeab276061. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 22:07:46.893693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-4d933644-8392-4020-b528-7fa7feb5705e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Getting quotas for user 31c2c3ecbc7148859a7c530deef8ab95 and project 4ef8feba0c8e45fdb82f09eeab276061. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 22:07:46.984214 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4d933644-8392-4020-b528-7fa7feb5705e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.302563 May 28 22:07:46.984829 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3528/7099] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 22:07:46 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:07:49.472649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:07:49.474177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:07:49.478407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-445713158", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1768058375", "security_groups": [{"name": "tempest-secgroup-smoke-1720539114"}], "networks": [{"uuid": "d60da12f-65b5-434d-b54c-d0e6e88d1348"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:07:49.587199 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] validate_networks() for [('d60da12f-65b5-434d-b54c-d0e6e88d1348', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 22:07:50.081481 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 22:07:50.081948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 22:07:50.082437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 22:07:50.091452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 22:07:50.091452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 22:07:50.092856 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:50.093317 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:50.094153 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:50.094604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:50.115471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Getting quotas for project 4ef8feba0c8e45fdb82f09eeab276061. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 22:07:50.121479 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Getting quotas for user 31c2c3ecbc7148859a7c530deef8ab95 and project 4ef8feba0c8e45fdb82f09eeab276061. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 22:07:50.134476 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 22:07:50.137324 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 22:07:50.271980 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0522bc69-90d3-440f-a2c5-2dee80f3df1a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.800879 May 28 22:07:50.273558 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3572/7100] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 22:07:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 22:07:50.284951 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d7b9c619-5024-47ca-967e-9bbfa50ef1bc tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:50.285686 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d7b9c619-5024-47ca-967e-9bbfa50ef1bc tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:50.361337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-d7b9c619-5024-47ca-967e-9bbfa50ef1bc tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:50.369829 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d7b9c619-5024-47ca-967e-9bbfa50ef1bc tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1246 microversion: 2.1 time: 0.089187 May 28 22:07:50.370440 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3529/7101] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:50 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:07:51.389286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-82b385be-ac24-4229-82bb-4f9a8d595870 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:51.390031 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-82b385be-ac24-4229-82bb-4f9a8d595870 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:51.452681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-82b385be-ac24-4229-82bb-4f9a8d595870 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:51.460138 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-82b385be-ac24-4229-82bb-4f9a8d595870 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1246 microversion: 2.1 time: 0.076799 May 28 22:07:51.460963 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3573/7102] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:51 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:07:52.476804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8696b70b-6bdb-4fb5-93b9-88b6ce636c3f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:52.477465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8696b70b-6bdb-4fb5-93b9-88b6ce636c3f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:52.531277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8696b70b-6bdb-4fb5-93b9-88b6ce636c3f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:52.538217 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8696b70b-6bdb-4fb5-93b9-88b6ce636c3f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1246 microversion: 2.1 time: 0.065620 May 28 22:07:52.538936 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3530/7103] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:52 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1246 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:07:53.555169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-561046f9-c180-47da-aa0f-3ae8ad7de91b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:53.555737 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-561046f9-c180-47da-aa0f-3ae8ad7de91b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:53.608750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-561046f9-c180-47da-aa0f-3ae8ad7de91b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:53.615568 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-561046f9-c180-47da-aa0f-3ae8ad7de91b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1246 microversion: 2.1 time: 0.064413 May 28 22:07:53.616143 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3574/7104] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:53 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1246 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:07:54.632969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-16842bf7-8156-49e4-8f43-0f523e602016 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:54.633513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-16842bf7-8156-49e4-8f43-0f523e602016 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:54.641239 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16842bf7-8156-49e4-8f43-0f523e602016 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:54.641730 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16842bf7-8156-49e4-8f43-0f523e602016 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:54.642533 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16842bf7-8156-49e4-8f43-0f523e602016 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:54.642997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-16842bf7-8156-49e4-8f43-0f523e602016 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:54.703875 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-16842bf7-8156-49e4-8f43-0f523e602016 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:54.711427 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-16842bf7-8156-49e4-8f43-0f523e602016 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1250 microversion: 2.1 time: 0.082503 May 28 22:07:54.712001 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3531/7105] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:54 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1250 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:07:55.730594 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-a2197855-ab82-4acf-a193-d58b0ae564e9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:55.731233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-a2197855-ab82-4acf-a193-d58b0ae564e9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:55.739628 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2197855-ab82-4acf-a193-d58b0ae564e9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:55.740096 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2197855-ab82-4acf-a193-d58b0ae564e9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:55.740887 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2197855-ab82-4acf-a193-d58b0ae564e9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:55.741344 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-a2197855-ab82-4acf-a193-d58b0ae564e9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:55.806870 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-a2197855-ab82-4acf-a193-d58b0ae564e9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:55.815132 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-a2197855-ab82-4acf-a193-d58b0ae564e9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1250 microversion: 2.1 time: 0.088692 May 28 22:07:55.815704 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3575/7106] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:55 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1250 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:07:56.832636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-7a63e4c3-e52b-4d9d-ad9e-81e7a0b4c46f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:56.833394 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-7a63e4c3-e52b-4d9d-ad9e-81e7a0b4c46f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:56.839566 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a63e4c3-e52b-4d9d-ad9e-81e7a0b4c46f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:56.840219 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a63e4c3-e52b-4d9d-ad9e-81e7a0b4c46f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:56.841015 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a63e4c3-e52b-4d9d-ad9e-81e7a0b4c46f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:56.841477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-7a63e4c3-e52b-4d9d-ad9e-81e7a0b4c46f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:56.906695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-7a63e4c3-e52b-4d9d-ad9e-81e7a0b4c46f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:56.914513 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-7a63e4c3-e52b-4d9d-ad9e-81e7a0b4c46f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1316 microversion: 2.1 time: 0.086208 May 28 22:07:56.915100 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3532/7107] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:56 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1316 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:07:57.934933 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-42305ab4-527a-4811-bb02-3b4c18fc91bb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:57.935692 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-42305ab4-527a-4811-bb02-3b4c18fc91bb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:57.942007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42305ab4-527a-4811-bb02-3b4c18fc91bb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:57.942572 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42305ab4-527a-4811-bb02-3b4c18fc91bb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:57.943696 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42305ab4-527a-4811-bb02-3b4c18fc91bb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:57.944254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-42305ab4-527a-4811-bb02-3b4c18fc91bb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:58.077595 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-42305ab4-527a-4811-bb02-3b4c18fc91bb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:58.085449 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-42305ab4-527a-4811-bb02-3b4c18fc91bb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1372 microversion: 2.1 time: 0.154757 May 28 22:07:58.086075 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3576/7108] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:57 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:07:58.477341 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-26d02458-ecf6-4d71-85fa-ed53cd509d18 req-1e3b29c4-5a89-4acf-8ced-38057f90742d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d4a1d9-9616-436b-85bb-c2124f8f140d", "tag": "78a8db52-b8cd-4f0d-99aa-d266a08a3196"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:07:58.488485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-26d02458-ecf6-4d71-85fa-ed53cd509d18 req-1e3b29c4-5a89-4acf-8ced-38057f90742d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:58.489350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-26d02458-ecf6-4d71-85fa-ed53cd509d18 req-1e3b29c4-5a89-4acf-8ced-38057f90742d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:58.503607 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-26d02458-ecf6-4d71-85fa-ed53cd509d18 req-1e3b29c4-5a89-4acf-8ced-38057f90742d service nova] Creating event network-changed:78a8db52-b8cd-4f0d-99aa-d266a08a3196 for instance e2d4a1d9-9616-436b-85bb-c2124f8f140d on nch1-master-1 May 28 22:07:58.509302 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-26d02458-ecf6-4d71-85fa-ed53cd509d18 req-1e3b29c4-5a89-4acf-8ced-38057f90742d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102652 May 28 22:07:58.510186 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3533/7109] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:07:59.103094 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-88b1bb86-1dda-4d68-8792-98296853f7c3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:07:59.103719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-88b1bb86-1dda-4d68-8792-98296853f7c3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:07:59.111732 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88b1bb86-1dda-4d68-8792-98296853f7c3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:59.112192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88b1bb86-1dda-4d68-8792-98296853f7c3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:59.112962 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88b1bb86-1dda-4d68-8792-98296853f7c3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:07:59.113413 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-88b1bb86-1dda-4d68-8792-98296853f7c3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:07:59.246522 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-88b1bb86-1dda-4d68-8792-98296853f7c3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:07:59.253999 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-88b1bb86-1dda-4d68-8792-98296853f7c3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1372 microversion: 2.1 time: 0.154873 May 28 22:07:59.254572 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3577/7110] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:07:59 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:08:00.271772 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5db04ace-58ac-4a68-9d65-3af57d80688d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:08:00.272560 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5db04ace-58ac-4a68-9d65-3af57d80688d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:08:00.279832 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5db04ace-58ac-4a68-9d65-3af57d80688d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:00.280352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5db04ace-58ac-4a68-9d65-3af57d80688d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:00.281152 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5db04ace-58ac-4a68-9d65-3af57d80688d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:00.281619 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5db04ace-58ac-4a68-9d65-3af57d80688d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:00.413255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5db04ace-58ac-4a68-9d65-3af57d80688d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:08:00.421468 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5db04ace-58ac-4a68-9d65-3af57d80688d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1372 microversion: 2.1 time: 0.153571 May 28 22:08:00.427421 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3534/7111] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:08:00 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:08:01.439054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3f659918-9401-4824-9ae0-402879943a70 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:08:01.439607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3f659918-9401-4824-9ae0-402879943a70 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:08:01.441485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:08:01.447633 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f659918-9401-4824-9ae0-402879943a70 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:01.448099 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f659918-9401-4824-9ae0-402879943a70 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:01.452669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f659918-9401-4824-9ae0-402879943a70 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:01.452669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3f659918-9401-4824-9ae0-402879943a70 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:01.590827 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3f659918-9401-4824-9ae0-402879943a70 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:08:01.598527 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3f659918-9401-4824-9ae0-402879943a70 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1372 microversion: 2.1 time: 0.164078 May 28 22:08:01.599102 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3578/7112] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:08:01 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:08:02.615243 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-ebd4d3c1-38a7-45ea-b556-6579f5ecd88b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:08:02.615876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-ebd4d3c1-38a7-45ea-b556-6579f5ecd88b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:08:02.618727 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:08:02.623678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebd4d3c1-38a7-45ea-b556-6579f5ecd88b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:02.624144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebd4d3c1-38a7-45ea-b556-6579f5ecd88b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:02.624923 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebd4d3c1-38a7-45ea-b556-6579f5ecd88b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:02.625401 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-ebd4d3c1-38a7-45ea-b556-6579f5ecd88b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:02.756943 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-ebd4d3c1-38a7-45ea-b556-6579f5ecd88b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:08:02.764975 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-ebd4d3c1-38a7-45ea-b556-6579f5ecd88b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1372 microversion: 2.1 time: 0.153153 May 28 22:08:02.765653 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3535/7113] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:08:02 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:08:03.392152 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ad91ff17-6454-44c3-9de1-2239bb7f3558 req-b3b87cc9-f87b-4aaf-bab0-df34b6a2de55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d4a1d9-9616-436b-85bb-c2124f8f140d", "name": "network-vif-plugged", "status": "completed", "tag": "78a8db52-b8cd-4f0d-99aa-d266a08a3196"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:08:03.401343 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ad91ff17-6454-44c3-9de1-2239bb7f3558 req-b3b87cc9-f87b-4aaf-bab0-df34b6a2de55 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:03.402669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ad91ff17-6454-44c3-9de1-2239bb7f3558 req-b3b87cc9-f87b-4aaf-bab0-df34b6a2de55 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:03.413183 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ad91ff17-6454-44c3-9de1-2239bb7f3558 req-b3b87cc9-f87b-4aaf-bab0-df34b6a2de55 service nova] Creating event network-vif-plugged:78a8db52-b8cd-4f0d-99aa-d266a08a3196 for instance e2d4a1d9-9616-436b-85bb-c2124f8f140d on nch1-master-1 May 28 22:08:03.418288 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ad91ff17-6454-44c3-9de1-2239bb7f3558 req-b3b87cc9-f87b-4aaf-bab0-df34b6a2de55 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029985 May 28 22:08:03.419165 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3579/7114] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:08:03.782576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1cd372b7-d967-43ad-b397-812b83c02f81 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:08:03.783230 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1cd372b7-d967-43ad-b397-812b83c02f81 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:08:03.790513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cd372b7-d967-43ad-b397-812b83c02f81 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:03.791037 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cd372b7-d967-43ad-b397-812b83c02f81 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:03.795277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cd372b7-d967-43ad-b397-812b83c02f81 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:03.795277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1cd372b7-d967-43ad-b397-812b83c02f81 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:03.931370 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1cd372b7-d967-43ad-b397-812b83c02f81 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:08:03.939034 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1cd372b7-d967-43ad-b397-812b83c02f81 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1372 microversion: 2.1 time: 0.161008 May 28 22:08:03.939622 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3536/7115] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:08:03 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:08:04.952993 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=10 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:08:04.958133 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-925e06dc-3b8c-430c-be6c-a710b5f03c2a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:08:04.958849 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-925e06dc-3b8c-430c-be6c-a710b5f03c2a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:08:04.965785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-925e06dc-3b8c-430c-be6c-a710b5f03c2a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:04.966278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-925e06dc-3b8c-430c-be6c-a710b5f03c2a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:04.967049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-925e06dc-3b8c-430c-be6c-a710b5f03c2a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:04.967596 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-925e06dc-3b8c-430c-be6c-a710b5f03c2a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:05.105329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-925e06dc-3b8c-430c-be6c-a710b5f03c2a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:08:05.114033 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-925e06dc-3b8c-430c-be6c-a710b5f03c2a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1372 microversion: 2.1 time: 0.161905 May 28 22:08:05.118392 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3580/7116] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:08:04 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:08:06.131477 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a43589e2-8b21-467c-9de5-b582cdb194ee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:08:06.132111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a43589e2-8b21-467c-9de5-b582cdb194ee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:08:06.139085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a43589e2-8b21-467c-9de5-b582cdb194ee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:06.139552 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a43589e2-8b21-467c-9de5-b582cdb194ee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:06.140325 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a43589e2-8b21-467c-9de5-b582cdb194ee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:06.140780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a43589e2-8b21-467c-9de5-b582cdb194ee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:06.272731 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a43589e2-8b21-467c-9de5-b582cdb194ee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:08:06.280949 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a43589e2-8b21-467c-9de5-b582cdb194ee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1556 microversion: 2.1 time: 0.152876 May 28 22:08:06.281529 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3537/7117] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:08:06 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:08:06.296881 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-44040ae3-d22b-424e-a23a-ff3a89de443c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:08:06.297518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-44040ae3-d22b-424e-a23a-ff3a89de443c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:08:06.304582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44040ae3-d22b-424e-a23a-ff3a89de443c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:06.305049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44040ae3-d22b-424e-a23a-ff3a89de443c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:06.305823 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44040ae3-d22b-424e-a23a-ff3a89de443c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:06.306313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-44040ae3-d22b-424e-a23a-ff3a89de443c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:06.442273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-44040ae3-d22b-424e-a23a-ff3a89de443c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:08:06.450161 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-44040ae3-d22b-424e-a23a-ff3a89de443c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1556 microversion: 2.1 time: 0.157156 May 28 22:08:06.450756 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3581/7118] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:08:06 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:08:08.469355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-fea709c7-ed47-4411-9e2c-bc3adebbab15 req-7b45e2e6-ef72-42a5-8e75-2bc685a63bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d4a1d9-9616-436b-85bb-c2124f8f140d", "tag": "78a8db52-b8cd-4f0d-99aa-d266a08a3196"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:08:08.477649 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-fea709c7-ed47-4411-9e2c-bc3adebbab15 req-7b45e2e6-ef72-42a5-8e75-2bc685a63bcc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:08:08.478300 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-fea709c7-ed47-4411-9e2c-bc3adebbab15 req-7b45e2e6-ef72-42a5-8e75-2bc685a63bcc service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:08:08.490026 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-fea709c7-ed47-4411-9e2c-bc3adebbab15 req-7b45e2e6-ef72-42a5-8e75-2bc685a63bcc service nova] Creating event network-changed:78a8db52-b8cd-4f0d-99aa-d266a08a3196 for instance e2d4a1d9-9616-436b-85bb-c2124f8f140d on nch1-master-1 May 28 22:08:08.495409 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-fea709c7-ed47-4411-9e2c-bc3adebbab15 req-7b45e2e6-ef72-42a5-8e75-2bc685a63bcc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086022 May 28 22:08:08.496300 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3538/7119] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:09:33.585058 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:09:33.585621 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 22:09:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:09:36.187208 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:09:36.187679 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 22:09:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:10:02.455544 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f3c540fd-cf05-4b97-a0d8-f167e0b240fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:10:02.456130 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f3c540fd-cf05-4b97-a0d8-f167e0b240fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:02.458545 ncdv-master-1 devstack@n-api.service[143129]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0135df6d-06bc-4c7e-99b7-8ac7fe500326] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 22:10:02.459411 ncdv-master-1 devstack@n-api.service[143129]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac93fc00-477b-44ec-8099-842dbc0762a6] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 22:10:02.459953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:10:02.461278 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=40 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:10:02.466024 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3c540fd-cf05-4b97-a0d8-f167e0b240fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:02.466483 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3c540fd-cf05-4b97-a0d8-f167e0b240fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:02.467252 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3c540fd-cf05-4b97-a0d8-f167e0b240fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:02.467721 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f3c540fd-cf05-4b97-a0d8-f167e0b240fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:02.490792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-f3c540fd-cf05-4b97-a0d8-f167e0b240fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lazy-loading 'flavor' on Instance uuid e2d4a1d9-9616-436b-85bb-c2124f8f140d {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 22:10:03.079501 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f3c540fd-cf05-4b97-a0d8-f167e0b240fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "POST /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d/action" status: 202 len: 0 microversion: 2.1 time: 0.628453 May 28 22:10:03.080140 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3582/7120] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:10:02 2022] POST /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d/action => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:10:03.086663 ncdv-master-1 devstack@n-api.service[143128]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c389da86-0e4e-4c71-b4f6-a8fc5e8f642f] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 22:10:03.087509 ncdv-master-1 devstack@n-api.service[143128]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71d375b4-1aec-4c8d-819c-c0bdf546db7b] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 22:10:03.088170 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:10:03.088947 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=40 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:10:03.093408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-dc796fea-cbdf-4f8a-b4a5-d5350f9fb81d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:03.094176 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-dc796fea-cbdf-4f8a-b4a5-d5350f9fb81d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:03.100440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc796fea-cbdf-4f8a-b4a5-d5350f9fb81d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:03.100920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc796fea-cbdf-4f8a-b4a5-d5350f9fb81d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:03.101714 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc796fea-cbdf-4f8a-b4a5-d5350f9fb81d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:03.102273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-dc796fea-cbdf-4f8a-b4a5-d5350f9fb81d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:03.245025 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-dc796fea-cbdf-4f8a-b4a5-d5350f9fb81d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:03.253251 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-dc796fea-cbdf-4f8a-b4a5-d5350f9fb81d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1680 microversion: 2.1 time: 0.168441 May 28 22:10:03.253819 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3539/7121] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:03 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:04.273741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-b2ca96e4-ba5f-444a-ac0e-04202ee6bc3b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:04.274512 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-b2ca96e4-ba5f-444a-ac0e-04202ee6bc3b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:04.283555 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2ca96e4-ba5f-444a-ac0e-04202ee6bc3b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:04.284023 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2ca96e4-ba5f-444a-ac0e-04202ee6bc3b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:04.284810 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2ca96e4-ba5f-444a-ac0e-04202ee6bc3b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:04.285270 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-b2ca96e4-ba5f-444a-ac0e-04202ee6bc3b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:04.289709 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] [0135df6d-06bc-4c7e-99b7-8ac7fe500326] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 54326. May 28 22:10:04.292630 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac93fc00-477b-44ec-8099-842dbc0762a6] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 54328. May 28 22:10:04.420008 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-b2ca96e4-ba5f-444a-ac0e-04202ee6bc3b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:04.427713 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-b2ca96e4-ba5f-444a-ac0e-04202ee6bc3b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1680 microversion: 2.1 time: 0.160215 May 28 22:10:04.428288 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3583/7122] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:04 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:05.445927 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-51df60f6-030f-4dac-9c92-c5ab06ae8135 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:05.446487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-51df60f6-030f-4dac-9c92-c5ab06ae8135 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:05.456340 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51df60f6-030f-4dac-9c92-c5ab06ae8135 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:05.456804 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51df60f6-030f-4dac-9c92-c5ab06ae8135 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:05.457587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51df60f6-030f-4dac-9c92-c5ab06ae8135 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:05.458315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-51df60f6-030f-4dac-9c92-c5ab06ae8135 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:05.464920 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] [c389da86-0e4e-4c71-b4f6-a8fc5e8f642f] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 54334. May 28 22:10:05.476944 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] [71d375b4-1aec-4c8d-819c-c0bdf546db7b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 54336. May 28 22:10:05.596587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-51df60f6-030f-4dac-9c92-c5ab06ae8135 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:05.604248 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-51df60f6-030f-4dac-9c92-c5ab06ae8135 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1680 microversion: 2.1 time: 0.162652 May 28 22:10:05.604845 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3540/7123] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:05 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:06.621235 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6f610a95-640e-4fdb-a06c-7514c7451c8e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:06.621940 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6f610a95-640e-4fdb-a06c-7514c7451c8e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:06.629084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f610a95-640e-4fdb-a06c-7514c7451c8e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:06.630090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f610a95-640e-4fdb-a06c-7514c7451c8e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:06.630397 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f610a95-640e-4fdb-a06c-7514c7451c8e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:06.630854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6f610a95-640e-4fdb-a06c-7514c7451c8e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:06.761670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6f610a95-640e-4fdb-a06c-7514c7451c8e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:06.769342 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6f610a95-640e-4fdb-a06c-7514c7451c8e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1680 microversion: 2.1 time: 0.152732 May 28 22:10:06.769939 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3584/7124] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:06 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:07.787146 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-0ef183be-70de-418f-a145-1e8cc89214fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:07.787780 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-0ef183be-70de-418f-a145-1e8cc89214fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:07.795216 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ef183be-70de-418f-a145-1e8cc89214fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:07.795678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ef183be-70de-418f-a145-1e8cc89214fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:07.796462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ef183be-70de-418f-a145-1e8cc89214fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:07.796915 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-0ef183be-70de-418f-a145-1e8cc89214fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:07.929355 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-0ef183be-70de-418f-a145-1e8cc89214fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:07.937560 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-0ef183be-70de-418f-a145-1e8cc89214fb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1680 microversion: 2.1 time: 0.154524 May 28 22:10:07.938176 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3541/7125] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:07 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:08.954445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1204d0c4-c03f-48e5-9682-3579b4b918d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:08.955074 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1204d0c4-c03f-48e5-9682-3579b4b918d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:08.962706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1204d0c4-c03f-48e5-9682-3579b4b918d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:08.963166 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1204d0c4-c03f-48e5-9682-3579b4b918d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:08.963941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1204d0c4-c03f-48e5-9682-3579b4b918d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:08.964383 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1204d0c4-c03f-48e5-9682-3579b4b918d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:09.094287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1204d0c4-c03f-48e5-9682-3579b4b918d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:09.102533 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1204d0c4-c03f-48e5-9682-3579b4b918d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1680 microversion: 2.1 time: 0.152050 May 28 22:10:09.103112 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3585/7126] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:08 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:10.119599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e9ac1767-6288-4a0f-9d30-c7d30196aba1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:10.120232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e9ac1767-6288-4a0f-9d30-c7d30196aba1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:10.127385 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9ac1767-6288-4a0f-9d30-c7d30196aba1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:10.127851 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9ac1767-6288-4a0f-9d30-c7d30196aba1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:10.128634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9ac1767-6288-4a0f-9d30-c7d30196aba1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:10.129093 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e9ac1767-6288-4a0f-9d30-c7d30196aba1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:10.257616 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e9ac1767-6288-4a0f-9d30-c7d30196aba1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:10.265753 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e9ac1767-6288-4a0f-9d30-c7d30196aba1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1680 microversion: 2.1 time: 0.150067 May 28 22:10:10.266361 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3542/7127] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:10 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:11.283787 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-afebf2a0-1a66-4ffe-a9a9-e02921a59607 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:11.284436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-afebf2a0-1a66-4ffe-a9a9-e02921a59607 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:11.292027 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afebf2a0-1a66-4ffe-a9a9-e02921a59607 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:11.292485 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afebf2a0-1a66-4ffe-a9a9-e02921a59607 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:11.293256 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afebf2a0-1a66-4ffe-a9a9-e02921a59607 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:11.293701 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-afebf2a0-1a66-4ffe-a9a9-e02921a59607 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:11.427078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-afebf2a0-1a66-4ffe-a9a9-e02921a59607 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:11.434649 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-afebf2a0-1a66-4ffe-a9a9-e02921a59607 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1680 microversion: 2.1 time: 0.154963 May 28 22:10:11.435225 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3586/7128] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:11 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:12.452310 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f18f6f9e-7893-4ea2-9cf6-07fcf376a2f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:12.452872 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f18f6f9e-7893-4ea2-9cf6-07fcf376a2f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:12.459958 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f18f6f9e-7893-4ea2-9cf6-07fcf376a2f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:12.460447 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f18f6f9e-7893-4ea2-9cf6-07fcf376a2f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:12.461215 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f18f6f9e-7893-4ea2-9cf6-07fcf376a2f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:12.461672 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f18f6f9e-7893-4ea2-9cf6-07fcf376a2f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:12.593100 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f18f6f9e-7893-4ea2-9cf6-07fcf376a2f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:12.600649 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f18f6f9e-7893-4ea2-9cf6-07fcf376a2f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1680 microversion: 2.1 time: 0.152454 May 28 22:10:12.601218 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3543/7129] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:12 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:13.618605 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-94c02ae4-25d7-4b32-a4c7-eb20aa04c7eb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:13.619239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-94c02ae4-25d7-4b32-a4c7-eb20aa04c7eb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:13.626335 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94c02ae4-25d7-4b32-a4c7-eb20aa04c7eb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:13.626792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94c02ae4-25d7-4b32-a4c7-eb20aa04c7eb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:13.627563 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94c02ae4-25d7-4b32-a4c7-eb20aa04c7eb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:13.628007 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-94c02ae4-25d7-4b32-a4c7-eb20aa04c7eb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:13.765180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-94c02ae4-25d7-4b32-a4c7-eb20aa04c7eb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:13.772809 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-94c02ae4-25d7-4b32-a4c7-eb20aa04c7eb tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1680 microversion: 2.1 time: 0.158665 May 28 22:10:13.774619 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3587/7130] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:13 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:14.790033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-22add9c6-2f01-47dc-8cec-b973644a53ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:14.790682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-22add9c6-2f01-47dc-8cec-b973644a53ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:14.797773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22add9c6-2f01-47dc-8cec-b973644a53ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:14.798278 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22add9c6-2f01-47dc-8cec-b973644a53ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:14.799064 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22add9c6-2f01-47dc-8cec-b973644a53ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:14.799525 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-22add9c6-2f01-47dc-8cec-b973644a53ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:14.929346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-22add9c6-2f01-47dc-8cec-b973644a53ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:14.937727 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-22add9c6-2f01-47dc-8cec-b973644a53ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1701 microversion: 2.1 time: 0.151682 May 28 22:10:14.938367 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3544/7131] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:14 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1701 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:15.955201 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0a52993d-a184-4e48-82f2-a58bc5534f63 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:15.955861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0a52993d-a184-4e48-82f2-a58bc5534f63 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:15.964092 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a52993d-a184-4e48-82f2-a58bc5534f63 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:15.964331 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a52993d-a184-4e48-82f2-a58bc5534f63 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:15.965104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a52993d-a184-4e48-82f2-a58bc5534f63 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:15.965703 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0a52993d-a184-4e48-82f2-a58bc5534f63 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:16.085998 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-3243f818-a24c-4f1c-a3a1-ac520af52f24 req-8736702b-4f58-47c6-8610-a7e9e89b41f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d4a1d9-9616-436b-85bb-c2124f8f140d", "name": "network-vif-plugged", "status": "completed", "tag": "78a8db52-b8cd-4f0d-99aa-d266a08a3196"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:10:16.094195 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3243f818-a24c-4f1c-a3a1-ac520af52f24 req-8736702b-4f58-47c6-8610-a7e9e89b41f2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:16.095898 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-3243f818-a24c-4f1c-a3a1-ac520af52f24 req-8736702b-4f58-47c6-8610-a7e9e89b41f2 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:16.107062 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-3243f818-a24c-4f1c-a3a1-ac520af52f24 req-8736702b-4f58-47c6-8610-a7e9e89b41f2 service nova] Creating event network-vif-plugged:78a8db52-b8cd-4f0d-99aa-d266a08a3196 for instance e2d4a1d9-9616-436b-85bb-c2124f8f140d on nch1-master-1 May 28 22:10:16.112385 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-3243f818-a24c-4f1c-a3a1-ac520af52f24 req-8736702b-4f58-47c6-8610-a7e9e89b41f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093905 May 28 22:10:16.112920 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3545/7132] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:10:16.124521 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0a52993d-a184-4e48-82f2-a58bc5534f63 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:16.132162 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0a52993d-a184-4e48-82f2-a58bc5534f63 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1696 microversion: 2.1 time: 0.181026 May 28 22:10:16.132754 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3588/7133] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:15 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:10:17.153029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-95748d65-b401-4b6b-9b5c-0020e05e6ba9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:17.154515 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-95748d65-b401-4b6b-9b5c-0020e05e6ba9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:17.161352 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95748d65-b401-4b6b-9b5c-0020e05e6ba9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:17.162045 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95748d65-b401-4b6b-9b5c-0020e05e6ba9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:17.163347 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95748d65-b401-4b6b-9b5c-0020e05e6ba9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:17.165487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-95748d65-b401-4b6b-9b5c-0020e05e6ba9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:17.315378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-95748d65-b401-4b6b-9b5c-0020e05e6ba9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:17.327797 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-95748d65-b401-4b6b-9b5c-0020e05e6ba9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1696 microversion: 2.1 time: 0.181570 May 28 22:10:17.337785 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3546/7134] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:17 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:18.345533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-7d7b3162-892b-439f-806d-be0cb747307d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:18.346167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-7d7b3162-892b-439f-806d-be0cb747307d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:18.358973 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d7b3162-892b-439f-806d-be0cb747307d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:18.359582 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d7b3162-892b-439f-806d-be0cb747307d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:18.360377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d7b3162-892b-439f-806d-be0cb747307d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:18.360822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-7d7b3162-892b-439f-806d-be0cb747307d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:18.508105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-7d7b3162-892b-439f-806d-be0cb747307d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:18.520794 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-7d7b3162-892b-439f-806d-be0cb747307d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1696 microversion: 2.1 time: 0.179165 May 28 22:10:18.521576 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3589/7135] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:18 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1696 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:19.542668 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3e7aab8c-7ce9-4c1e-8ce0-aaf3136e7e0e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:19.543643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3e7aab8c-7ce9-4c1e-8ce0-aaf3136e7e0e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:19.551527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e7aab8c-7ce9-4c1e-8ce0-aaf3136e7e0e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:19.552277 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e7aab8c-7ce9-4c1e-8ce0-aaf3136e7e0e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:19.553077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e7aab8c-7ce9-4c1e-8ce0-aaf3136e7e0e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:19.553785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3e7aab8c-7ce9-4c1e-8ce0-aaf3136e7e0e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:19.691912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3e7aab8c-7ce9-4c1e-8ce0-aaf3136e7e0e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:19.700145 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3e7aab8c-7ce9-4c1e-8ce0-aaf3136e7e0e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1696 microversion: 2.1 time: 0.163222 May 28 22:10:19.700737 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3547/7136] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:19 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:20.717792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ec17fecc-61d1-4d62-b02e-8da6b07e9db6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:20.718504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ec17fecc-61d1-4d62-b02e-8da6b07e9db6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:20.727403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec17fecc-61d1-4d62-b02e-8da6b07e9db6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:20.728205 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec17fecc-61d1-4d62-b02e-8da6b07e9db6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:20.729001 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec17fecc-61d1-4d62-b02e-8da6b07e9db6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:20.729456 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ec17fecc-61d1-4d62-b02e-8da6b07e9db6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:20.880879 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ec17fecc-61d1-4d62-b02e-8da6b07e9db6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:20.890060 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ec17fecc-61d1-4d62-b02e-8da6b07e9db6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1696 microversion: 2.1 time: 0.176732 May 28 22:10:20.890845 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3590/7137] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:20 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:21.908303 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-94e6f784-73ea-4703-bab1-242aeace7967 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:21.909024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-94e6f784-73ea-4703-bab1-242aeace7967 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:21.917888 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94e6f784-73ea-4703-bab1-242aeace7967 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:21.918573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94e6f784-73ea-4703-bab1-242aeace7967 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:21.919378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94e6f784-73ea-4703-bab1-242aeace7967 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:21.919920 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-94e6f784-73ea-4703-bab1-242aeace7967 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:22.072317 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-94e6f784-73ea-4703-bab1-242aeace7967 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:22.078781 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-94e6f784-73ea-4703-bab1-242aeace7967 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1696 microversion: 2.1 time: 0.175105 May 28 22:10:22.079612 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3548/7138] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:21 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:23.096260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2a0b9275-0272-4963-94ea-aa5f6e6e227d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:23.096972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2a0b9275-0272-4963-94ea-aa5f6e6e227d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:23.104665 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a0b9275-0272-4963-94ea-aa5f6e6e227d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:23.108233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a0b9275-0272-4963-94ea-aa5f6e6e227d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:23.108233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a0b9275-0272-4963-94ea-aa5f6e6e227d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:23.108233 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2a0b9275-0272-4963-94ea-aa5f6e6e227d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:23.248440 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2a0b9275-0272-4963-94ea-aa5f6e6e227d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:23.256856 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2a0b9275-0272-4963-94ea-aa5f6e6e227d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1696 microversion: 2.1 time: 0.164513 May 28 22:10:23.257884 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3591/7139] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:23 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:24.275779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f235b1f2-a725-497c-80b0-55464ed57ca0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:24.277029 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f235b1f2-a725-497c-80b0-55464ed57ca0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:24.284914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f235b1f2-a725-497c-80b0-55464ed57ca0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:24.285475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f235b1f2-a725-497c-80b0-55464ed57ca0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:24.286475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f235b1f2-a725-497c-80b0-55464ed57ca0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:24.286999 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f235b1f2-a725-497c-80b0-55464ed57ca0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:24.447463 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f235b1f2-a725-497c-80b0-55464ed57ca0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:24.456094 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f235b1f2-a725-497c-80b0-55464ed57ca0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1696 microversion: 2.1 time: 0.185207 May 28 22:10:24.456705 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3549/7140] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:24 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1696 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:25.482984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0fd77470-b50e-4550-b7a6-71579a5f9045 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:25.484821 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0fd77470-b50e-4550-b7a6-71579a5f9045 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:25.505119 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0fd77470-b50e-4550-b7a6-71579a5f9045 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:25.507602 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0fd77470-b50e-4550-b7a6-71579a5f9045 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:25.509496 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0fd77470-b50e-4550-b7a6-71579a5f9045 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:25.512180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0fd77470-b50e-4550-b7a6-71579a5f9045 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:25.679653 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0fd77470-b50e-4550-b7a6-71579a5f9045 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:25.687731 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0fd77470-b50e-4550-b7a6-71579a5f9045 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1696 microversion: 2.1 time: 0.217555 May 28 22:10:25.697676 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3592/7141] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:25 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1696 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:26.705336 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bdb8cc3d-1353-4d4d-b189-c0ee5235ff22 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:26.705930 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bdb8cc3d-1353-4d4d-b189-c0ee5235ff22 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:26.713680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdb8cc3d-1353-4d4d-b189-c0ee5235ff22 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:26.714191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdb8cc3d-1353-4d4d-b189-c0ee5235ff22 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:26.714983 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdb8cc3d-1353-4d4d-b189-c0ee5235ff22 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:26.715475 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bdb8cc3d-1353-4d4d-b189-c0ee5235ff22 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:26.844409 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bdb8cc3d-1353-4d4d-b189-c0ee5235ff22 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:26.852203 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bdb8cc3d-1353-4d4d-b189-c0ee5235ff22 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1696 microversion: 2.1 time: 0.150921 May 28 22:10:26.855276 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3550/7142] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:26 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1696 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:27.869421 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f53f0142-615c-4982-a46b-960fc4ea2a53 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:27.870078 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f53f0142-615c-4982-a46b-960fc4ea2a53 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:27.876998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f53f0142-615c-4982-a46b-960fc4ea2a53 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:27.877461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f53f0142-615c-4982-a46b-960fc4ea2a53 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:27.878259 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f53f0142-615c-4982-a46b-960fc4ea2a53 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:27.878704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f53f0142-615c-4982-a46b-960fc4ea2a53 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:28.015104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f53f0142-615c-4982-a46b-960fc4ea2a53 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:28.022819 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f53f0142-615c-4982-a46b-960fc4ea2a53 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1678 microversion: 2.1 time: 0.157332 May 28 22:10:28.023419 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3593/7143] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:27 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:29.041141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-20267fa8-6591-4997-bd0a-0b3e04bfefbd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:29.041774 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-20267fa8-6591-4997-bd0a-0b3e04bfefbd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:29.048824 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20267fa8-6591-4997-bd0a-0b3e04bfefbd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:29.049292 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20267fa8-6591-4997-bd0a-0b3e04bfefbd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:29.050109 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20267fa8-6591-4997-bd0a-0b3e04bfefbd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:29.050570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-20267fa8-6591-4997-bd0a-0b3e04bfefbd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:29.183509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-20267fa8-6591-4997-bd0a-0b3e04bfefbd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:29.191756 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-20267fa8-6591-4997-bd0a-0b3e04bfefbd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1678 microversion: 2.1 time: 0.154745 May 28 22:10:29.195928 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3551/7144] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:29 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:30.054719 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-da7f65a8-809b-4a7b-a542-612b099645b0 req-be1759ef-5cfb-4e8e-86a3-41282ab3a0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d4a1d9-9616-436b-85bb-c2124f8f140d", "name": "network-vif-unplugged", "status": "completed", "tag": "78a8db52-b8cd-4f0d-99aa-d266a08a3196"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:10:30.065415 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-da7f65a8-809b-4a7b-a542-612b099645b0 req-be1759ef-5cfb-4e8e-86a3-41282ab3a0c0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:30.065922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-da7f65a8-809b-4a7b-a542-612b099645b0 req-be1759ef-5cfb-4e8e-86a3-41282ab3a0c0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:30.078713 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.compute.server_external_events [req-da7f65a8-809b-4a7b-a542-612b099645b0 req-be1759ef-5cfb-4e8e-86a3-41282ab3a0c0 service nova] Unable to find a host for instance e2d4a1d9-9616-436b-85bb-c2124f8f140d. Dropping event network-vif-unplugged {{(pid=143129) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 28 22:10:30.079615 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-da7f65a8-809b-4a7b-a542-612b099645b0 req-be1759ef-5cfb-4e8e-86a3-41282ab3a0c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029365 May 28 22:10:30.080220 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3594/7145] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 28 22:10:30.211558 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4e572f6e-6116-4910-bc8c-80118de9edf0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:30.212132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4e572f6e-6116-4910-bc8c-80118de9edf0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:30.219153 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e572f6e-6116-4910-bc8c-80118de9edf0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:30.219652 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e572f6e-6116-4910-bc8c-80118de9edf0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:30.220410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e572f6e-6116-4910-bc8c-80118de9edf0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:30.220869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4e572f6e-6116-4910-bc8c-80118de9edf0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:30.355372 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4e572f6e-6116-4910-bc8c-80118de9edf0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:30.363019 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4e572f6e-6116-4910-bc8c-80118de9edf0 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1621 microversion: 2.1 time: 0.155497 May 28 22:10:30.363600 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3552/7146] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:30 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1621 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:30.380042 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ce684e42-8523-42a7-80d3-c42cc906ab2d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:10:30.380669 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ce684e42-8523-42a7-80d3-c42cc906ab2d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:30.386877 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce684e42-8523-42a7-80d3-c42cc906ab2d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:30.387341 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce684e42-8523-42a7-80d3-c42cc906ab2d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:30.388121 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce684e42-8523-42a7-80d3-c42cc906ab2d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:30.388626 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce684e42-8523-42a7-80d3-c42cc906ab2d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:30.601081 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ce684e42-8523-42a7-80d3-c42cc906ab2d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "POST /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d/action" status: 202 len: 0 microversion: 2.1 time: 0.224957 May 28 22:10:30.601925 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3595/7147] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:10:30 2022] POST /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:10:30.610666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2713401d-0157-4468-866a-40aef1643453 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:30.611396 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2713401d-0157-4468-866a-40aef1643453 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:30.617738 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2713401d-0157-4468-866a-40aef1643453 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:30.618865 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2713401d-0157-4468-866a-40aef1643453 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:30.619671 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2713401d-0157-4468-866a-40aef1643453 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:30.620132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2713401d-0157-4468-866a-40aef1643453 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:30.752489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2713401d-0157-4468-866a-40aef1643453 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:30.760178 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2713401d-0157-4468-866a-40aef1643453 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1629 microversion: 2.1 time: 0.153579 May 28 22:10:30.760764 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3553/7148] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:30 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1629 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:31.778104 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-414c1757-e9bf-42d5-978c-42923774e530 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:31.778736 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-414c1757-e9bf-42d5-978c-42923774e530 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:31.784922 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-414c1757-e9bf-42d5-978c-42923774e530 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:31.785394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-414c1757-e9bf-42d5-978c-42923774e530 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:31.786200 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-414c1757-e9bf-42d5-978c-42923774e530 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:31.786654 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-414c1757-e9bf-42d5-978c-42923774e530 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:31.790670 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:10:31.920181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-414c1757-e9bf-42d5-978c-42923774e530 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:31.927820 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-414c1757-e9bf-42d5-978c-42923774e530 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1629 microversion: 2.1 time: 0.155225 May 28 22:10:31.928563 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3596/7149] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:31 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1629 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:32.945281 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-18e0a89d-12ae-4318-9b51-71e81c4e3024 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:32.945886 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-18e0a89d-12ae-4318-9b51-71e81c4e3024 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:32.953462 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18e0a89d-12ae-4318-9b51-71e81c4e3024 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:32.953976 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18e0a89d-12ae-4318-9b51-71e81c4e3024 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:32.954769 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18e0a89d-12ae-4318-9b51-71e81c4e3024 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:32.955232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-18e0a89d-12ae-4318-9b51-71e81c4e3024 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:33.086353 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-18e0a89d-12ae-4318-9b51-71e81c4e3024 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:33.093866 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-18e0a89d-12ae-4318-9b51-71e81c4e3024 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1629 microversion: 2.1 time: 0.152866 May 28 22:10:33.094444 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3554/7150] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:32 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1629 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:34.110915 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3d8b69ad-6299-4fac-9dfd-7c7d6688296a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:34.111539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3d8b69ad-6299-4fac-9dfd-7c7d6688296a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:34.114613 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=33 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:10:34.119700 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d8b69ad-6299-4fac-9dfd-7c7d6688296a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:34.120156 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d8b69ad-6299-4fac-9dfd-7c7d6688296a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:34.120995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d8b69ad-6299-4fac-9dfd-7c7d6688296a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:34.121437 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3d8b69ad-6299-4fac-9dfd-7c7d6688296a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:34.264634 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3d8b69ad-6299-4fac-9dfd-7c7d6688296a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:34.272941 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3d8b69ad-6299-4fac-9dfd-7c7d6688296a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1631 microversion: 2.1 time: 0.166027 May 28 22:10:34.273951 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3597/7151] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:34 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1631 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:35.292391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9592bfff-9ff6-4382-9f60-f6061d6189ab tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:35.293667 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-9592bfff-9ff6-4382-9f60-f6061d6189ab tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:35.296530 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=33 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:10:35.301387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9592bfff-9ff6-4382-9f60-f6061d6189ab tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:35.301883 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9592bfff-9ff6-4382-9f60-f6061d6189ab tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:35.302677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9592bfff-9ff6-4382-9f60-f6061d6189ab tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:35.303136 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-9592bfff-9ff6-4382-9f60-f6061d6189ab tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:35.307144 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=93 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:10:35.443453 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-9592bfff-9ff6-4382-9f60-f6061d6189ab tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:35.452252 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9592bfff-9ff6-4382-9f60-f6061d6189ab tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1687 microversion: 2.1 time: 0.163821 May 28 22:10:35.452859 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3555/7152] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:35 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:10:36.471445 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d7978b6d-48a0-479e-9bef-29dfd86633ed tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:36.472764 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d7978b6d-48a0-479e-9bef-29dfd86633ed tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:36.480790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7978b6d-48a0-479e-9bef-29dfd86633ed tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:36.481253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7978b6d-48a0-479e-9bef-29dfd86633ed tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:36.482084 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7978b6d-48a0-479e-9bef-29dfd86633ed tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:36.482533 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d7978b6d-48a0-479e-9bef-29dfd86633ed tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:36.633673 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d7978b6d-48a0-479e-9bef-29dfd86633ed tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:36.639213 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d7978b6d-48a0-479e-9bef-29dfd86633ed tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1687 microversion: 2.1 time: 0.172251 May 28 22:10:36.639834 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3598/7153] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:36 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:37.656809 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c5b6c469-1600-414d-9c4b-b1b604d1627c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:37.657444 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c5b6c469-1600-414d-9c4b-b1b604d1627c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:37.663839 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5b6c469-1600-414d-9c4b-b1b604d1627c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:37.664312 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5b6c469-1600-414d-9c4b-b1b604d1627c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:37.665095 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5b6c469-1600-414d-9c4b-b1b604d1627c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:37.665562 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c5b6c469-1600-414d-9c4b-b1b604d1627c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:37.814149 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c5b6c469-1600-414d-9c4b-b1b604d1627c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:37.836415 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c5b6c469-1600-414d-9c4b-b1b604d1627c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1687 microversion: 2.1 time: 0.183739 May 28 22:10:37.837230 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3556/7154] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:37 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1687 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:38.854743 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ce783506-9412-43b8-8bc3-4bccaa91819b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:38.855685 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ce783506-9412-43b8-8bc3-4bccaa91819b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:38.862974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce783506-9412-43b8-8bc3-4bccaa91819b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:38.866819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce783506-9412-43b8-8bc3-4bccaa91819b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:38.866819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce783506-9412-43b8-8bc3-4bccaa91819b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:38.866819 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ce783506-9412-43b8-8bc3-4bccaa91819b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:39.005525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ce783506-9412-43b8-8bc3-4bccaa91819b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:39.014630 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ce783506-9412-43b8-8bc3-4bccaa91819b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1687 microversion: 2.1 time: 0.164546 May 28 22:10:39.016366 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3599/7155] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:38 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:10:40.032406 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e1c6746c-a817-4b84-9452-2764444bd2da tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:40.033028 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e1c6746c-a817-4b84-9452-2764444bd2da tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:40.040049 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1c6746c-a817-4b84-9452-2764444bd2da tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:40.040528 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1c6746c-a817-4b84-9452-2764444bd2da tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:40.041364 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1c6746c-a817-4b84-9452-2764444bd2da tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:40.041806 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1c6746c-a817-4b84-9452-2764444bd2da tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:40.192554 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e1c6746c-a817-4b84-9452-2764444bd2da tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:40.202022 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e1c6746c-a817-4b84-9452-2764444bd2da tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1687 microversion: 2.1 time: 0.173390 May 28 22:10:40.202769 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3557/7156] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:40 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:41.220070 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bc27da03-d21e-4896-bb9f-dcbcff0400c7 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:41.221318 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bc27da03-d21e-4896-bb9f-dcbcff0400c7 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:41.230215 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bc27da03-d21e-4896-bb9f-dcbcff0400c7 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:41.231516 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bc27da03-d21e-4896-bb9f-dcbcff0400c7 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:41.232519 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bc27da03-d21e-4896-bb9f-dcbcff0400c7 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:41.233160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bc27da03-d21e-4896-bb9f-dcbcff0400c7 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:41.696504 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bc27da03-d21e-4896-bb9f-dcbcff0400c7 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:41.705946 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bc27da03-d21e-4896-bb9f-dcbcff0400c7 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1687 microversion: 2.1 time: 0.490023 May 28 22:10:41.706556 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3600/7157] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:41 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1687 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:42.725902 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-bf7de46d-3181-4c1f-8611-c48b6cd6c51c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:42.768858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-bf7de46d-3181-4c1f-8611-c48b6cd6c51c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:42.768858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf7de46d-3181-4c1f-8611-c48b6cd6c51c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:42.768858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf7de46d-3181-4c1f-8611-c48b6cd6c51c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:42.768858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf7de46d-3181-4c1f-8611-c48b6cd6c51c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:42.768858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-bf7de46d-3181-4c1f-8611-c48b6cd6c51c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:42.895665 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-bf7de46d-3181-4c1f-8611-c48b6cd6c51c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:42.904847 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-bf7de46d-3181-4c1f-8611-c48b6cd6c51c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1687 microversion: 2.1 time: 0.184249 May 28 22:10:42.905694 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3558/7158] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:42 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1687 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:43.922365 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-d95cd999-1120-47da-83bb-a7b528cb4aee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:43.923054 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-d95cd999-1120-47da-83bb-a7b528cb4aee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:43.930347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d95cd999-1120-47da-83bb-a7b528cb4aee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:43.930813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d95cd999-1120-47da-83bb-a7b528cb4aee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:43.931604 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d95cd999-1120-47da-83bb-a7b528cb4aee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:43.932051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-d95cd999-1120-47da-83bb-a7b528cb4aee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:44.083773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-d95cd999-1120-47da-83bb-a7b528cb4aee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:44.093175 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-d95cd999-1120-47da-83bb-a7b528cb4aee tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1687 microversion: 2.1 time: 0.175840 May 28 22:10:44.093984 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3601/7159] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:43 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1687 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:45.181410 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-1d18cdff-6cf8-4b41-9ed6-342b0a3a39ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:45.182077 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-1d18cdff-6cf8-4b41-9ed6-342b0a3a39ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:45.189059 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d18cdff-6cf8-4b41-9ed6-342b0a3a39ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:45.189527 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d18cdff-6cf8-4b41-9ed6-342b0a3a39ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:45.190331 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d18cdff-6cf8-4b41-9ed6-342b0a3a39ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:45.190786 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-1d18cdff-6cf8-4b41-9ed6-342b0a3a39ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:45.321465 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-1d18cdff-6cf8-4b41-9ed6-342b0a3a39ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:45.329485 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-1d18cdff-6cf8-4b41-9ed6-342b0a3a39ad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1687 microversion: 2.1 time: 0.152075 May 28 22:10:45.330088 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3559/7160] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:45 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:46.348154 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c88d4687-8116-43c5-abe4-50634e8b2ccf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:46.348788 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c88d4687-8116-43c5-abe4-50634e8b2ccf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:46.356499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c88d4687-8116-43c5-abe4-50634e8b2ccf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:46.356958 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c88d4687-8116-43c5-abe4-50634e8b2ccf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:46.357727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c88d4687-8116-43c5-abe4-50634e8b2ccf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:46.358213 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c88d4687-8116-43c5-abe4-50634e8b2ccf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:46.492541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c88d4687-8116-43c5-abe4-50634e8b2ccf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:46.501330 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c88d4687-8116-43c5-abe4-50634e8b2ccf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1687 microversion: 2.1 time: 0.157501 May 28 22:10:46.501989 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3602/7161] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:46 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:47.518391 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2eaa9f07-969b-466a-bf1c-c5dbbe4f604a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:47.518946 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2eaa9f07-969b-466a-bf1c-c5dbbe4f604a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:47.526031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2eaa9f07-969b-466a-bf1c-c5dbbe4f604a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:47.526500 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2eaa9f07-969b-466a-bf1c-c5dbbe4f604a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:47.527276 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2eaa9f07-969b-466a-bf1c-c5dbbe4f604a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:47.527763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2eaa9f07-969b-466a-bf1c-c5dbbe4f604a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:47.658570 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2eaa9f07-969b-466a-bf1c-c5dbbe4f604a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:47.666242 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2eaa9f07-969b-466a-bf1c-c5dbbe4f604a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1687 microversion: 2.1 time: 0.151856 May 28 22:10:47.666819 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3560/7162] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:47 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:48.178061 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-739b2142-3aee-4cf4-96df-72311cc27fd2 req-a574ee0e-a7aa-4a6f-8667-aee7e23b0f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d4a1d9-9616-436b-85bb-c2124f8f140d", "name": "network-vif-plugged", "status": "completed", "tag": "78a8db52-b8cd-4f0d-99aa-d266a08a3196"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:10:48.187107 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-739b2142-3aee-4cf4-96df-72311cc27fd2 req-a574ee0e-a7aa-4a6f-8667-aee7e23b0f7b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:48.187562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-739b2142-3aee-4cf4-96df-72311cc27fd2 req-a574ee0e-a7aa-4a6f-8667-aee7e23b0f7b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:48.200283 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-739b2142-3aee-4cf4-96df-72311cc27fd2 req-a574ee0e-a7aa-4a6f-8667-aee7e23b0f7b service nova] Creating event network-vif-plugged:78a8db52-b8cd-4f0d-99aa-d266a08a3196 for instance e2d4a1d9-9616-436b-85bb-c2124f8f140d on nch1-master-1 May 28 22:10:48.205433 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-739b2142-3aee-4cf4-96df-72311cc27fd2 req-a574ee0e-a7aa-4a6f-8667-aee7e23b0f7b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031520 May 28 22:10:48.206052 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3603/7163] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:10:48.684435 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2c1f367e-538a-47bf-9a12-2e687a958222 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:48.684981 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2c1f367e-538a-47bf-9a12-2e687a958222 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:48.692346 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c1f367e-538a-47bf-9a12-2e687a958222 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:48.692816 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c1f367e-538a-47bf-9a12-2e687a958222 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:48.693604 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c1f367e-538a-47bf-9a12-2e687a958222 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:48.694094 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2c1f367e-538a-47bf-9a12-2e687a958222 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:48.829678 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2c1f367e-538a-47bf-9a12-2e687a958222 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:48.837474 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2c1f367e-538a-47bf-9a12-2e687a958222 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1687 microversion: 2.1 time: 0.157675 May 28 22:10:48.838105 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3561/7164] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:48 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:49.855239 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8ee3384a-b442-4c9a-9013-34ab34372cbc tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:49.855955 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8ee3384a-b442-4c9a-9013-34ab34372cbc tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:49.863248 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ee3384a-b442-4c9a-9013-34ab34372cbc tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:49.863672 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ee3384a-b442-4c9a-9013-34ab34372cbc tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:49.864452 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ee3384a-b442-4c9a-9013-34ab34372cbc tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:49.864902 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8ee3384a-b442-4c9a-9013-34ab34372cbc tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:49.996451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8ee3384a-b442-4c9a-9013-34ab34372cbc tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:50.004459 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8ee3384a-b442-4c9a-9013-34ab34372cbc tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1687 microversion: 2.1 time: 0.153674 May 28 22:10:50.005906 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3604/7165] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:49 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:10:51.022179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a91020a1-b3e6-4e40-bf1e-d9dd3bba13f8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:10:51.022818 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a91020a1-b3e6-4e40-bf1e-d9dd3bba13f8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:10:51.030846 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a91020a1-b3e6-4e40-bf1e-d9dd3bba13f8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:51.031321 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a91020a1-b3e6-4e40-bf1e-d9dd3bba13f8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:51.032115 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a91020a1-b3e6-4e40-bf1e-d9dd3bba13f8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:10:51.032578 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a91020a1-b3e6-4e40-bf1e-d9dd3bba13f8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:10:51.163058 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a91020a1-b3e6-4e40-bf1e-d9dd3bba13f8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:10:51.171274 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a91020a1-b3e6-4e40-bf1e-d9dd3bba13f8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1674 microversion: 2.1 time: 0.153087 May 28 22:10:51.171850 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3562/7166] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:10:51 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:02.603908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=15 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:12:02.603908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=48 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:12:02.604497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=15 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:12:02.604497 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=47 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:12:02.608382 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-854263b3-ed02-41e1-9045-7faac804f0d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:02.608904 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-854263b3-ed02-41e1-9045-7faac804f0d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:02.609032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-5defbe50-5ea4-4a9c-963e-bb41c8d63ace req-8116fbf8-88a5-4d29-aeba-8e69d0d53e41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d4a1d9-9616-436b-85bb-c2124f8f140d", "tag": "78a8db52-b8cd-4f0d-99aa-d266a08a3196"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:12:02.615112 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-854263b3-ed02-41e1-9045-7faac804f0d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:02.615579 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-854263b3-ed02-41e1-9045-7faac804f0d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:02.616553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-854263b3-ed02-41e1-9045-7faac804f0d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:02.617013 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-854263b3-ed02-41e1-9045-7faac804f0d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:02.618158 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5defbe50-5ea4-4a9c-963e-bb41c8d63ace req-8116fbf8-88a5-4d29-aeba-8e69d0d53e41 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:02.618621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-5defbe50-5ea4-4a9c-963e-bb41c8d63ace req-8116fbf8-88a5-4d29-aeba-8e69d0d53e41 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:02.638697 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-5defbe50-5ea4-4a9c-963e-bb41c8d63ace req-8116fbf8-88a5-4d29-aeba-8e69d0d53e41 service nova] Creating event network-changed:78a8db52-b8cd-4f0d-99aa-d266a08a3196 for instance e2d4a1d9-9616-436b-85bb-c2124f8f140d on nch1-master-1 May 28 22:12:02.644313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-854263b3-ed02-41e1-9045-7faac804f0d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 22:12:02.645053 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-5defbe50-5ea4-4a9c-963e-bb41c8d63ace req-8116fbf8-88a5-4d29-aeba-8e69d0d53e41 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043072 May 28 22:12:02.645872 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3563/7167] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 22:12:02.898049 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-854263b3-ed02-41e1-9045-7faac804f0d4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 204 len: 0 microversion: 2.1 time: 0.298155 May 28 22:12:02.898840 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3605/7168] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 22:12:02 2022] DELETE /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 22:12:02.909509 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-755aa797-1cba-4691-8129-41692e949dec tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:02.913091 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-755aa797-1cba-4691-8129-41692e949dec tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:02.924024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-755aa797-1cba-4691-8129-41692e949dec tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:02.924495 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-755aa797-1cba-4691-8129-41692e949dec tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:02.925294 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-755aa797-1cba-4691-8129-41692e949dec tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:02.925748 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-755aa797-1cba-4691-8129-41692e949dec tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:03.129244 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-755aa797-1cba-4691-8129-41692e949dec tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:03.137162 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-755aa797-1cba-4691-8129-41692e949dec tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1680 microversion: 2.1 time: 0.233721 May 28 22:12:03.138224 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3564/7169] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:02 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1680 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:04.161044 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-89110be8-5132-4b52-a9ec-fbd987bf0c3f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:04.161766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-89110be8-5132-4b52-a9ec-fbd987bf0c3f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:04.169567 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89110be8-5132-4b52-a9ec-fbd987bf0c3f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:04.170045 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89110be8-5132-4b52-a9ec-fbd987bf0c3f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:04.170828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89110be8-5132-4b52-a9ec-fbd987bf0c3f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:04.171273 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-89110be8-5132-4b52-a9ec-fbd987bf0c3f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:04.366772 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-89110be8-5132-4b52-a9ec-fbd987bf0c3f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:04.374739 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-89110be8-5132-4b52-a9ec-fbd987bf0c3f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1680 microversion: 2.1 time: 0.220061 May 28 22:12:04.375346 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3606/7170] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:04 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:04.756614 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-9c0e8cbf-3cf3-47e2-a91f-3c898f420559 req-988c4ece-6051-48f8-ba2c-7e729400ef0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d4a1d9-9616-436b-85bb-c2124f8f140d", "name": "network-vif-deleted", "tag": "78a8db52-b8cd-4f0d-99aa-d266a08a3196"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:12:04.766273 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9c0e8cbf-3cf3-47e2-a91f-3c898f420559 req-988c4ece-6051-48f8-ba2c-7e729400ef0a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:04.766833 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-9c0e8cbf-3cf3-47e2-a91f-3c898f420559 req-988c4ece-6051-48f8-ba2c-7e729400ef0a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:04.777975 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-9c0e8cbf-3cf3-47e2-a91f-3c898f420559 req-988c4ece-6051-48f8-ba2c-7e729400ef0a service nova] Creating event network-vif-deleted:78a8db52-b8cd-4f0d-99aa-d266a08a3196 for instance e2d4a1d9-9616-436b-85bb-c2124f8f140d on nch1-master-1 May 28 22:12:04.783495 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-9c0e8cbf-3cf3-47e2-a91f-3c898f420559 req-988c4ece-6051-48f8-ba2c-7e729400ef0a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030637 May 28 22:12:04.784091 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3565/7171] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:12:05.392210 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0b54a970-3b83-4e90-b1d1-c4239fe23cc1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:05.392872 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0b54a970-3b83-4e90-b1d1-c4239fe23cc1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:05.399960 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b54a970-3b83-4e90-b1d1-c4239fe23cc1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:05.400428 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b54a970-3b83-4e90-b1d1-c4239fe23cc1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:05.401212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b54a970-3b83-4e90-b1d1-c4239fe23cc1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:05.401671 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b54a970-3b83-4e90-b1d1-c4239fe23cc1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:05.433358 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b54a970-3b83-4e90-b1d1-c4239fe23cc1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:05.433811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b54a970-3b83-4e90-b1d1-c4239fe23cc1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:05.434306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-0b54a970-3b83-4e90-b1d1-c4239fe23cc1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lazy-loading 'fault' on Instance uuid e2d4a1d9-9616-436b-85bb-c2124f8f140d {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 22:12:05.476706 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0b54a970-3b83-4e90-b1d1-c4239fe23cc1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:05.484377 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0b54a970-3b83-4e90-b1d1-c4239fe23cc1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 200 len: 1336 microversion: 2.1 time: 0.096148 May 28 22:12:05.485460 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3607/7172] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:05 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 1336 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:06.504318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b09bb0ad-0dab-40ea-bbab-8313e36b4e39 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:06.504985 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b09bb0ad-0dab-40ea-bbab-8313e36b4e39 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: e2d4a1d9-9616-436b-85bb-c2124f8f140d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:06.511419 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b09bb0ad-0dab-40ea-bbab-8313e36b4e39 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:06.511890 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b09bb0ad-0dab-40ea-bbab-8313e36b4e39 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:06.512703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b09bb0ad-0dab-40ea-bbab-8313e36b4e39 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:06.513167 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b09bb0ad-0dab-40ea-bbab-8313e36b4e39 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:06.527095 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-b09bb0ad-0dab-40ea-bbab-8313e36b4e39 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] HTTP exception thrown: Instance e2d4a1d9-9616-436b-85bb-c2124f8f140d could not be found. May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b09bb0ad-0dab-40ea-bbab-8313e36b4e39 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Request method failure captured: May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d HTTP/1.1 May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikp0sm4MHsiSratMu-qj1sCVf1otdldWgkl3kiHFAcl_cgFfZfpTfvCn7_0KjAUNcvb8oMa3-AFH9jjAa58lXjMfKiGu6OLbf1pmRI6hzDjtRs7QfEXWfYziBQJXDX7JB_St21QzLQplJl03P_U58bDp7IrxeDq3jGQ-GTojKCLWdI3Q May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: 4ef8feba0c8e45fdb82f09eeab276061 May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestShelveInstance-491367012 May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4ef8feba0c8e45fdb82f09eeab276061", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4ef8feba0c8e45fdb82f09eeab276061"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4ef8feba0c8e45fdb82f09eeab276061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4ef8feba0c8e45fdb82f09eeab276061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestShelveInstance-491367012 May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: 4ef8feba0c8e45fdb82f09eeab276061 May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestShelveInstance-491367012 May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestShelveInstance-491367012-project May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: 31c2c3ecbc7148859a7c530deef8ab95 May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestShelveInstance-491367012-project May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance e2d4a1d9-9616-436b-85bb-c2124f8f140d could not be found. May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'e2d4a1d9-9616-436b-85bb-c2124f8f140d'} May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2d4a1d9-9616-436b-85bb-c2124f8f140d could not be found. May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2d4a1d9-9616-436b-85bb-c2124f8f140d could not be found. May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:12:06.528803 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:12:06.533543 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:12:06.533543 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:12:06.533543 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:12:06.533543 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 22:12:06.533543 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 22:12:06.533543 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2d4a1d9-9616-436b-85bb-c2124f8f140d could not be found. May 28 22:12:06.533543 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:12:06.533543 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b09bb0ad-0dab-40ea-bbab-8313e36b4e39 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Returning 404 to user: Instance e2d4a1d9-9616-436b-85bb-c2124f8f140d could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 22:12:06.533543 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b09bb0ad-0dab-40ea-bbab-8313e36b4e39 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d" status: 404 len: 111 microversion: 2.1 time: 0.031795 May 28 22:12:06.533543 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3566/7173] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:06 2022] GET /compute/v2.1/servers/e2d4a1d9-9616-436b-85bb-c2124f8f140d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 22:12:06.743021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ecebaba8-bb8e-4405-bbab-a0d44b49e17c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '.version_select at 0x7f4d56d21940>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:06.838771 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ecebaba8-bb8e-4405-bbab-a0d44b49e17c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1768058375" status: 202 len: 0 microversion: 2.1 time: 0.099697 May 28 22:12:06.839368 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3608/7174] 10.222.0.33 () {58 vars in 1253 bytes} [Sat May 28 22:12:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1768058375 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:12:06.862175 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-6c0d6fba-3c02-4b48-bb50-92c33db42882 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Action: 'create', calling method: .version_select at 0x7f4d57803e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-732297354", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMyWC5ZYQMYskviNWHBR6kIJ00CgroELSgGWgHRaIBIFpxwAsql8gjW3AaILSTUCpdVF7MrOXymEnNEf2khAYJbuEnmmam/Y280EKq0z0yRYLTapjt/9Gwd0Nl1NMu4PQ=="}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:12:06.876788 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-6c0d6fba-3c02-4b48-bb50-92c33db42882 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Getting quotas for project 4ef8feba0c8e45fdb82f09eeab276061. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 22:12:06.882065 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-6c0d6fba-3c02-4b48-bb50-92c33db42882 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Getting quotas for user 31c2c3ecbc7148859a7c530deef8ab95 and project 4ef8feba0c8e45fdb82f09eeab276061. Resources: {'key_pairs'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 22:12:06.981317 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-6c0d6fba-3c02-4b48-bb50-92c33db42882 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.123565 May 28 22:12:06.981954 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3567/7175] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 22:12:06 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:12:14.211841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-9106765", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-732297354", "security_groups": [{"name": "tempest-secgroup-smoke-994490348"}], "networks": [{"uuid": "d60da12f-65b5-434d-b54c-d0e6e88d1348"}], "block_device_mapping_v2": [{"uuid": "afa9bd0d-561b-4f64-b2cc-9199f4a91324", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:12:14.324996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] validate_networks() for [('d60da12f-65b5-434d-b54c-d0e6e88d1348', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 22:12:14.699244 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 22:12:14.699686 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 22:12:14.700180 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 22:12:14.700611 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 22:12:14.701038 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 22:12:14.710050 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:14.710545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:14.711356 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:14.711811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:14.729062 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Getting quotas for project 4ef8feba0c8e45fdb82f09eeab276061. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 22:12:14.734442 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Getting quotas for user 31c2c3ecbc7148859a7c530deef8ab95 and project 4ef8feba0c8e45fdb82f09eeab276061. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 22:12:14.793347 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 22:12:14.795534 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='afa9bd0d-561b-4f64-b2cc-9199f4a91324',volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 22:12:15.223121 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ffb191ee-957f-4437-a7c3-ad13ba39c31d tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.016588 May 28 22:12:15.223872 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3609/7176] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 22:12:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 22:12:15.234891 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-64b29aeb-331c-4860-9a16-2b012d528eb9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:15.235501 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-64b29aeb-331c-4860-9a16-2b012d528eb9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:15.290863 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-64b29aeb-331c-4860-9a16-2b012d528eb9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:15.297731 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-64b29aeb-331c-4860-9a16-2b012d528eb9 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1085 microversion: 2.1 time: 0.067825 May 28 22:12:15.298332 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3568/7177] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:15 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1085 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:16.315691 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-02107c64-2542-42f1-9701-052fc646eff3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:16.316312 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-02107c64-2542-42f1-9701-052fc646eff3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:16.368848 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-02107c64-2542-42f1-9701-052fc646eff3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:16.375717 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-02107c64-2542-42f1-9701-052fc646eff3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1085 microversion: 2.1 time: 0.065152 May 28 22:12:16.376304 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3610/7178] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:16 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1085 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:17.392356 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8880800d-d838-4105-93e4-65a0d9086004 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:17.393008 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8880800d-d838-4105-93e4-65a0d9086004 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:17.396551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=12 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:12:17.452952 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8880800d-d838-4105-93e4-65a0d9086004 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:17.461443 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8880800d-d838-4105-93e4-65a0d9086004 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1085 microversion: 2.1 time: 0.072956 May 28 22:12:17.471192 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3569/7179] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:17 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1085 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:18.479105 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6cf11f50-4a7b-438b-a337-4c58b41fc41b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:18.479681 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6cf11f50-4a7b-438b-a337-4c58b41fc41b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:18.534191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-6cf11f50-4a7b-438b-a337-4c58b41fc41b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:18.541495 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6cf11f50-4a7b-438b-a337-4c58b41fc41b tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1085 microversion: 2.1 time: 0.066497 May 28 22:12:18.542107 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3611/7180] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:18 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1085 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:19.558666 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-a001b330-4e7c-46d9-92ba-ddb1000742fd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:19.559301 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-a001b330-4e7c-46d9-92ba-ddb1000742fd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:19.568201 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a001b330-4e7c-46d9-92ba-ddb1000742fd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:19.568677 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a001b330-4e7c-46d9-92ba-ddb1000742fd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:19.569474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a001b330-4e7c-46d9-92ba-ddb1000742fd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:19.569969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-a001b330-4e7c-46d9-92ba-ddb1000742fd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:19.629861 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-a001b330-4e7c-46d9-92ba-ddb1000742fd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:19.637404 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-a001b330-4e7c-46d9-92ba-ddb1000742fd tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1135 microversion: 2.1 time: 0.082795 May 28 22:12:19.637949 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3570/7181] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:19 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1135 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:20.654177 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3e703df4-ad72-4a55-b036-6fb2a56940cf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:20.655019 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3e703df4-ad72-4a55-b036-6fb2a56940cf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:20.662646 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e703df4-ad72-4a55-b036-6fb2a56940cf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:20.663113 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e703df4-ad72-4a55-b036-6fb2a56940cf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:20.663886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e703df4-ad72-4a55-b036-6fb2a56940cf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:20.664333 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3e703df4-ad72-4a55-b036-6fb2a56940cf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:20.726371 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3e703df4-ad72-4a55-b036-6fb2a56940cf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:20.734043 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3e703df4-ad72-4a55-b036-6fb2a56940cf tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1127 microversion: 2.1 time: 0.083935 May 28 22:12:20.734627 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3612/7182] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:20 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1127 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:21.752252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-db4b32ed-ba8b-47ad-8d1d-5b5429095da6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:21.752892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-db4b32ed-ba8b-47ad-8d1d-5b5429095da6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:21.760973 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db4b32ed-ba8b-47ad-8d1d-5b5429095da6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:21.761440 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db4b32ed-ba8b-47ad-8d1d-5b5429095da6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:21.762399 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db4b32ed-ba8b-47ad-8d1d-5b5429095da6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:21.762856 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-db4b32ed-ba8b-47ad-8d1d-5b5429095da6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:21.835634 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-db4b32ed-ba8b-47ad-8d1d-5b5429095da6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:21.844851 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-db4b32ed-ba8b-47ad-8d1d-5b5429095da6 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1201 microversion: 2.1 time: 0.096631 May 28 22:12:21.845820 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3571/7183] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:21 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1201 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:22.862377 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-bf18c712-293a-4cdd-9cfe-d42971ab4245 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:22.863707 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-bf18c712-293a-4cdd-9cfe-d42971ab4245 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:22.871196 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf18c712-293a-4cdd-9cfe-d42971ab4245 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:22.871900 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf18c712-293a-4cdd-9cfe-d42971ab4245 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:22.872911 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf18c712-293a-4cdd-9cfe-d42971ab4245 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:22.873514 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-bf18c712-293a-4cdd-9cfe-d42971ab4245 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:23.010944 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-d4349ab3-0569-4d52-82ef-6b89c8b98126 req-8b8ba312-7154-4053-b35e-0fcbde750c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00094224-898e-41b9-9641-c150cfbfe17d", "tag": "73b297d2-33d0-437f-b7a0-9be2d650f773"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:12:23.026296 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-bf18c712-293a-4cdd-9cfe-d42971ab4245 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:23.026489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d4349ab3-0569-4d52-82ef-6b89c8b98126 req-8b8ba312-7154-4053-b35e-0fcbde750c47 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:23.026489 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d4349ab3-0569-4d52-82ef-6b89c8b98126 req-8b8ba312-7154-4053-b35e-0fcbde750c47 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:23.037540 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-bf18c712-293a-4cdd-9cfe-d42971ab4245 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1268 microversion: 2.1 time: 0.179257 May 28 22:12:23.043047 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3613/7184] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:22 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:23.054694 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-d4349ab3-0569-4d52-82ef-6b89c8b98126 req-8b8ba312-7154-4053-b35e-0fcbde750c47 service nova] Creating event network-changed:73b297d2-33d0-437f-b7a0-9be2d650f773 for instance 00094224-898e-41b9-9641-c150cfbfe17d on nch2-master-1 May 28 22:12:23.064858 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-d4349ab3-0569-4d52-82ef-6b89c8b98126 req-8b8ba312-7154-4053-b35e-0fcbde750c47 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057021 May 28 22:12:23.065439 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3572/7185] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:12:24.059131 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-40590a1c-b34d-4719-8d41-0b8e2f7486d8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:24.059785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-40590a1c-b34d-4719-8d41-0b8e2f7486d8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:24.070212 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40590a1c-b34d-4719-8d41-0b8e2f7486d8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:24.070677 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40590a1c-b34d-4719-8d41-0b8e2f7486d8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:24.072073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40590a1c-b34d-4719-8d41-0b8e2f7486d8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:24.072532 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-40590a1c-b34d-4719-8d41-0b8e2f7486d8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:24.209566 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-40590a1c-b34d-4719-8d41-0b8e2f7486d8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:24.217334 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-40590a1c-b34d-4719-8d41-0b8e2f7486d8 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1256 microversion: 2.1 time: 0.162406 May 28 22:12:24.218031 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3614/7186] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:24 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1256 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:25.236416 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2b490cb4-2da3-433a-b693-219ccf776ee4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:25.237076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2b490cb4-2da3-433a-b693-219ccf776ee4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:25.244163 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b490cb4-2da3-433a-b693-219ccf776ee4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:25.244635 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b490cb4-2da3-433a-b693-219ccf776ee4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:25.245428 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b490cb4-2da3-433a-b693-219ccf776ee4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:25.245991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2b490cb4-2da3-433a-b693-219ccf776ee4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:25.382633 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2b490cb4-2da3-433a-b693-219ccf776ee4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:25.390344 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2b490cb4-2da3-433a-b693-219ccf776ee4 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1256 microversion: 2.1 time: 0.159243 May 28 22:12:25.390933 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3573/7187] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:25 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1256 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:26.407313 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-0b725a76-7cd7-4ead-82c8-1a6eefb8443a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:26.407861 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-0b725a76-7cd7-4ead-82c8-1a6eefb8443a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:26.409863 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:12:26.415632 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b725a76-7cd7-4ead-82c8-1a6eefb8443a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:26.417174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b725a76-7cd7-4ead-82c8-1a6eefb8443a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:26.417174 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b725a76-7cd7-4ead-82c8-1a6eefb8443a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:26.417370 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-0b725a76-7cd7-4ead-82c8-1a6eefb8443a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:26.545738 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-0b725a76-7cd7-4ead-82c8-1a6eefb8443a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:26.553804 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-0b725a76-7cd7-4ead-82c8-1a6eefb8443a tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1256 microversion: 2.1 time: 0.150560 May 28 22:12:26.554399 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3615/7188] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:26 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1256 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:27.570812 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2bfccdbb-d21b-4a5c-8699-5afcdf877518 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:27.571480 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2bfccdbb-d21b-4a5c-8699-5afcdf877518 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:27.574378 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:12:27.579386 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bfccdbb-d21b-4a5c-8699-5afcdf877518 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:27.579858 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bfccdbb-d21b-4a5c-8699-5afcdf877518 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:27.580642 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bfccdbb-d21b-4a5c-8699-5afcdf877518 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:27.581106 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2bfccdbb-d21b-4a5c-8699-5afcdf877518 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:27.712840 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2bfccdbb-d21b-4a5c-8699-5afcdf877518 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:27.720465 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2bfccdbb-d21b-4a5c-8699-5afcdf877518 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1256 microversion: 2.1 time: 0.153598 May 28 22:12:27.721038 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3574/7189] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:27 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1256 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:28.738531 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-1aaf5154-f3c7-4197-8cac-17b6503f2901 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:28.739163 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-1aaf5154-f3c7-4197-8cac-17b6503f2901 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:28.741907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=10 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:12:28.746926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1aaf5154-f3c7-4197-8cac-17b6503f2901 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:28.762589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1aaf5154-f3c7-4197-8cac-17b6503f2901 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:28.762589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1aaf5154-f3c7-4197-8cac-17b6503f2901 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:28.762589 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-1aaf5154-f3c7-4197-8cac-17b6503f2901 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:28.880762 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-1aaf5154-f3c7-4197-8cac-17b6503f2901 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:28.888421 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-1aaf5154-f3c7-4197-8cac-17b6503f2901 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1256 microversion: 2.1 time: 0.154451 May 28 22:12:28.889016 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3616/7190] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:28 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1256 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:29.904814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-114e7d71-9188-4858-858a-7826bee25f30 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:29.905457 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-114e7d71-9188-4858-858a-7826bee25f30 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:29.912745 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-114e7d71-9188-4858-858a-7826bee25f30 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:29.913222 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-114e7d71-9188-4858-858a-7826bee25f30 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:29.914032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-114e7d71-9188-4858-858a-7826bee25f30 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:29.914492 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-114e7d71-9188-4858-858a-7826bee25f30 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:29.967988 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-ddc173f9-e66b-4ff9-bd12-093e4e879edd req-fc108844-639b-467c-ac10-0018578e19f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00094224-898e-41b9-9641-c150cfbfe17d", "name": "network-vif-plugged", "status": "completed", "tag": "73b297d2-33d0-437f-b7a0-9be2d650f773"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:12:29.977450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ddc173f9-e66b-4ff9-bd12-093e4e879edd req-fc108844-639b-467c-ac10-0018578e19f1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:29.977931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-ddc173f9-e66b-4ff9-bd12-093e4e879edd req-fc108844-639b-467c-ac10-0018578e19f1 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:29.993562 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-ddc173f9-e66b-4ff9-bd12-093e4e879edd req-fc108844-639b-467c-ac10-0018578e19f1 service nova] Creating event network-vif-plugged:73b297d2-33d0-437f-b7a0-9be2d650f773 for instance 00094224-898e-41b9-9641-c150cfbfe17d on nch2-master-1 May 28 22:12:29.995167 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-ddc173f9-e66b-4ff9-bd12-093e4e879edd req-fc108844-639b-467c-ac10-0018578e19f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031009 May 28 22:12:29.996126 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3617/7191] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 22:12:30.050894 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-114e7d71-9188-4858-858a-7826bee25f30 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:30.059309 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-114e7d71-9188-4858-858a-7826bee25f30 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1256 microversion: 2.1 time: 0.158416 May 28 22:12:30.061883 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3575/7192] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:29 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1256 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:31.078301 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c8efecfc-ac08-433f-abc0-2fda24c0f24c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:31.079030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c8efecfc-ac08-433f-abc0-2fda24c0f24c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:31.086219 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8efecfc-ac08-433f-abc0-2fda24c0f24c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:31.086687 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8efecfc-ac08-433f-abc0-2fda24c0f24c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:31.087474 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8efecfc-ac08-433f-abc0-2fda24c0f24c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:31.087926 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c8efecfc-ac08-433f-abc0-2fda24c0f24c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:31.224260 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c8efecfc-ac08-433f-abc0-2fda24c0f24c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:31.232134 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c8efecfc-ac08-433f-abc0-2fda24c0f24c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1256 microversion: 2.1 time: 0.159166 May 28 22:12:31.232800 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3618/7193] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:31 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1256 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:32.248969 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e1b5c19e-2f72-42a7-a8b1-2bac176147f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:32.249609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e1b5c19e-2f72-42a7-a8b1-2bac176147f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:32.256782 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1b5c19e-2f72-42a7-a8b1-2bac176147f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:32.257252 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1b5c19e-2f72-42a7-a8b1-2bac176147f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:32.258089 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1b5c19e-2f72-42a7-a8b1-2bac176147f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:32.258553 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e1b5c19e-2f72-42a7-a8b1-2bac176147f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:32.390318 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e1b5c19e-2f72-42a7-a8b1-2bac176147f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:32.398634 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e1b5c19e-2f72-42a7-a8b1-2bac176147f1 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1439 microversion: 2.1 time: 0.153677 May 28 22:12:32.399217 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3576/7194] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:32 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1439 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:32.418141 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-18b590d8-9e34-404a-9e91-2391550fd0c2 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:12:32.418780 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-18b590d8-9e34-404a-9e91-2391550fd0c2 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:12:32.426029 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-18b590d8-9e34-404a-9e91-2391550fd0c2 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:32.426500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-18b590d8-9e34-404a-9e91-2391550fd0c2 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:32.427287 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-18b590d8-9e34-404a-9e91-2391550fd0c2 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:32.427741 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-18b590d8-9e34-404a-9e91-2391550fd0c2 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:32.566607 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-18b590d8-9e34-404a-9e91-2391550fd0c2 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:12:32.574421 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-18b590d8-9e34-404a-9e91-2391550fd0c2 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1439 microversion: 2.1 time: 0.160314 May 28 22:12:32.575193 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3619/7195] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:12:32 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1439 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:12:34.494270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-d1732e76-57c2-439d-b139-bd8e78de1aaf req-9dd13f18-d5ed-4f0b-93a8-905d526ec95e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00094224-898e-41b9-9641-c150cfbfe17d", "tag": "73b297d2-33d0-437f-b7a0-9be2d650f773"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:12:34.498518 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:12:34.504126 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d1732e76-57c2-439d-b139-bd8e78de1aaf req-9dd13f18-d5ed-4f0b-93a8-905d526ec95e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:12:34.504592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-d1732e76-57c2-439d-b139-bd8e78de1aaf req-9dd13f18-d5ed-4f0b-93a8-905d526ec95e service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:12:34.516010 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-d1732e76-57c2-439d-b139-bd8e78de1aaf req-9dd13f18-d5ed-4f0b-93a8-905d526ec95e service nova] Creating event network-changed:73b297d2-33d0-437f-b7a0-9be2d650f773 for instance 00094224-898e-41b9-9641-c150cfbfe17d on nch2-master-1 May 28 22:12:34.521657 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-d1732e76-57c2-439d-b139-bd8e78de1aaf req-9dd13f18-d5ed-4f0b-93a8-905d526ec95e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031141 May 28 22:12:34.522315 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3577/7196] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:12:56.195531 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:12:56.196177 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 22:12:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:14:33.594614 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:14:33.596030 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 22:14:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:14:35.246256 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:14:35.246823 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 22:14:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:14:59.987456 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:14:59.988162 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 22:14:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:16:04.876193 ncdv-master-1 devstack@n-api.service[143129]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac93fc00-477b-44ec-8099-842dbc0762a6] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 22:16:04.877128 ncdv-master-1 devstack@n-api.service[143129]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0135df6d-06bc-4c7e-99b7-8ac7fe500326] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 28 22:16:04.877753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:16:04.878587 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:16:04.951261 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3c99c27d-76cb-4322-b692-bc20a507cdad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:16:04.952279 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3c99c27d-76cb-4322-b692-bc20a507cdad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:04.959188 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c99c27d-76cb-4322-b692-bc20a507cdad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:04.959695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c99c27d-76cb-4322-b692-bc20a507cdad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:04.960471 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c99c27d-76cb-4322-b692-bc20a507cdad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:04.960921 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3c99c27d-76cb-4322-b692-bc20a507cdad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:05.888263 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac93fc00-477b-44ec-8099-842dbc0762a6] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 54968. May 28 22:16:05.893110 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3c99c27d-76cb-4322-b692-bc20a507cdad tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "POST /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d/action" status: 200 len: 24567 microversion: 2.1 time: 1.018927 May 28 22:16:05.893738 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3620/7197] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:16:04 2022] POST /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d/action => generated 24567 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 28 22:16:07.220438 ncdv-master-1 devstack@n-api.service[143128]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c389da86-0e4e-4c71-b4f6-a8fc5e8f642f] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 22:16:07.223948 ncdv-master-1 devstack@n-api.service[143128]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71d375b4-1aec-4c8d-819c-c0bdf546db7b] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 22:16:07.223948 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=40 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:16:07.226997 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2d7e9afc-9280-42fe-a36b-1655de66474c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:07.227621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2d7e9afc-9280-42fe-a36b-1655de66474c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:07.230462 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] [0135df6d-06bc-4c7e-99b7-8ac7fe500326] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 54970. May 28 22:16:07.236551 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d7e9afc-9280-42fe-a36b-1655de66474c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:07.237032 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d7e9afc-9280-42fe-a36b-1655de66474c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:07.237879 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d7e9afc-9280-42fe-a36b-1655de66474c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:07.238499 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d7e9afc-9280-42fe-a36b-1655de66474c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:07.268599 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2d7e9afc-9280-42fe-a36b-1655de66474c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Going to try to terminate instance {{(pid=143128) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 22:16:07.282781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-0a2db768-a49a-4c50-914a-71155e963900 req-49d9f9b8-8808-4c14-aff0-96d5dbfc05a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00094224-898e-41b9-9641-c150cfbfe17d", "tag": "73b297d2-33d0-437f-b7a0-9be2d650f773"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:16:07.295873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0a2db768-a49a-4c50-914a-71155e963900 req-49d9f9b8-8808-4c14-aff0-96d5dbfc05a7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:07.295873 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-0a2db768-a49a-4c50-914a-71155e963900 req-49d9f9b8-8808-4c14-aff0-96d5dbfc05a7 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:07.305881 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-0a2db768-a49a-4c50-914a-71155e963900 req-49d9f9b8-8808-4c14-aff0-96d5dbfc05a7 service nova] Creating event network-changed:73b297d2-33d0-437f-b7a0-9be2d650f773 for instance 00094224-898e-41b9-9641-c150cfbfe17d on nch2-master-1 May 28 22:16:07.312999 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-0a2db768-a49a-4c50-914a-71155e963900 req-49d9f9b8-8808-4c14-aff0-96d5dbfc05a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092128 May 28 22:16:07.313768 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3621/7198] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:16:07.660206 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2d7e9afc-9280-42fe-a36b-1655de66474c tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "DELETE /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 204 len: 0 microversion: 2.1 time: 0.441642 May 28 22:16:07.661694 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3578/7199] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 22:16:07 2022] DELETE /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 22:16:07.671087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-f80ca538-3f70-4951-8d59-f194bf9e786f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:07.672183 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-f80ca538-3f70-4951-8d59-f194bf9e786f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:07.680248 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f80ca538-3f70-4951-8d59-f194bf9e786f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:07.685144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f80ca538-3f70-4951-8d59-f194bf9e786f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:07.685144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f80ca538-3f70-4951-8d59-f194bf9e786f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:07.685144 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-f80ca538-3f70-4951-8d59-f194bf9e786f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:07.826367 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-f80ca538-3f70-4951-8d59-f194bf9e786f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:07.834781 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-f80ca538-3f70-4951-8d59-f194bf9e786f tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1563 microversion: 2.1 time: 0.168467 May 28 22:16:07.835622 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3622/7200] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:07 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:16:08.855657 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-82e5ad6c-0217-4ba2-92f3-c150707070a3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:08.856387 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-82e5ad6c-0217-4ba2-92f3-c150707070a3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:08.866379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82e5ad6c-0217-4ba2-92f3-c150707070a3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:08.866778 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82e5ad6c-0217-4ba2-92f3-c150707070a3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:08.867575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82e5ad6c-0217-4ba2-92f3-c150707070a3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:08.868036 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-82e5ad6c-0217-4ba2-92f3-c150707070a3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:08.874442 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] [71d375b4-1aec-4c8d-819c-c0bdf546db7b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 54990. May 28 22:16:08.885051 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] [c389da86-0e4e-4c71-b4f6-a8fc5e8f642f] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 54988. May 28 22:16:09.008895 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-82e5ad6c-0217-4ba2-92f3-c150707070a3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:09.017027 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-82e5ad6c-0217-4ba2-92f3-c150707070a3 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1445 microversion: 2.1 time: 0.166355 May 28 22:16:09.017600 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3579/7201] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:08 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1445 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:16:09.647828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-04122170-6757-40bb-8d07-3821bffbcd71 req-21177fdf-c35e-4fc6-b783-b978c06235ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00094224-898e-41b9-9641-c150cfbfe17d", "name": "network-vif-deleted", "tag": "73b297d2-33d0-437f-b7a0-9be2d650f773"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:16:09.656310 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-04122170-6757-40bb-8d07-3821bffbcd71 req-21177fdf-c35e-4fc6-b783-b978c06235ce service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:09.656781 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-04122170-6757-40bb-8d07-3821bffbcd71 req-21177fdf-c35e-4fc6-b783-b978c06235ce service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:09.668432 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-04122170-6757-40bb-8d07-3821bffbcd71 req-21177fdf-c35e-4fc6-b783-b978c06235ce service nova] Creating event network-vif-deleted:73b297d2-33d0-437f-b7a0-9be2d650f773 for instance 00094224-898e-41b9-9641-c150cfbfe17d on nch2-master-1 May 28 22:16:09.673716 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-04122170-6757-40bb-8d07-3821bffbcd71 req-21177fdf-c35e-4fc6-b783-b978c06235ce service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030559 May 28 22:16:09.674323 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3623/7202] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:16:10.040342 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-5901f962-cd85-4fd8-a12d-365b4cafc441 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:10.040990 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-5901f962-cd85-4fd8-a12d-365b4cafc441 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:10.048996 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5901f962-cd85-4fd8-a12d-365b4cafc441 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:10.049728 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5901f962-cd85-4fd8-a12d-365b4cafc441 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:10.050576 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5901f962-cd85-4fd8-a12d-365b4cafc441 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:10.051038 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-5901f962-cd85-4fd8-a12d-365b4cafc441 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:10.115922 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-5901f962-cd85-4fd8-a12d-365b4cafc441 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31c2c3ecbc7148859a7c530deef8ab95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ef8feba0c8e45fdb82f09eeab276061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:10.123758 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-5901f962-cd85-4fd8-a12d-365b4cafc441 tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 200 len: 1216 microversion: 2.1 time: 0.088316 May 28 22:16:10.124700 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3580/7203] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:10 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 1216 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:16:11.140710 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6795e79d-00e6-4db3-bf59-86948661871e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:11.141425 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-6795e79d-00e6-4db3-bf59-86948661871e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] [instance: 00094224-898e-41b9-9641-c150cfbfe17d] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:11.148708 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6795e79d-00e6-4db3-bf59-86948661871e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:11.149160 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6795e79d-00e6-4db3-bf59-86948661871e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:11.149950 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6795e79d-00e6-4db3-bf59-86948661871e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:11.150396 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-6795e79d-00e6-4db3-bf59-86948661871e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:11.163676 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.wsgi [None req-6795e79d-00e6-4db3-bf59-86948661871e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] HTTP exception thrown: Instance 00094224-898e-41b9-9641-c150cfbfe17d could not be found. May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6795e79d-00e6-4db3-bf59-86948661871e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Request method failure captured: May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: request: GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d HTTP/1.1 May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: Accept: application/json May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: Accept-Encoding: identity May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: Connection: close May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: Content-Length: 0 May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: Content-Type: application/json May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: Host: 10.222.0.33 May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: Openstack-System-Scope: None May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: User-Agent: python-urllib3/1.26.9 May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-Auth-Token: gAAAAABikp0sm4MHsiSratMu-qj1sCVf1otdldWgkl3kiHFAcl_cgFfZfpTfvCn7_0KjAUNcvb8oMa3-AFH9jjAa58lXjMfKiGu6OLbf1pmRI6hzDjtRs7QfEXWfYziBQJXDX7JB_St21QzLQplJl03P_U58bDp7IrxeDq3jGQ-GTojKCLWdI3Q May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Id: None May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-Domain-Name: None May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-Identity-Status: Confirmed May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-Is-Admin-Project: True May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Id: default May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Domain-Name: Default May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Id: 4ef8feba0c8e45fdb82f09eeab276061 May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-Project-Name: tempest-TestShelveInstance-491367012 May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-Role: member,reader May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-Roles: member,reader May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_4ef8feba0c8e45fdb82f09eeab276061", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4ef8feba0c8e45fdb82f09eeab276061"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/4ef8feba0c8e45fdb82f09eeab276061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/4ef8feba0c8e45fdb82f09eeab276061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant: tempest-TestShelveInstance-491367012 May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Id: 4ef8feba0c8e45fdb82f09eeab276061 May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-Tenant-Name: tempest-TestShelveInstance-491367012 May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-User: tempest-TestShelveInstance-491367012-project May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Id: default May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-User-Domain-Name: Default May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-User-Id: 31c2c3ecbc7148859a7c530deef8ab95 May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: X-User-Name: tempest-TestShelveInstance-491367012-project May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: method: > May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: exception: Instance 00094224-898e-41b9-9641-c150cfbfe17d could not be found. May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: action_args: {'id': '00094224-898e-41b9-9641-c150cfbfe17d'} May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00094224-898e-41b9-9641-c150cfbfe17d could not be found. May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00094224-898e-41b9-9641-c150cfbfe17d could not be found. May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:16:11.165292 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:16:11.170267 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:16:11.170267 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:16:11.170267 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:16:11.170267 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 22:16:11.170267 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 22:16:11.170267 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00094224-898e-41b9-9641-c150cfbfe17d could not be found. May 28 22:16:11.170267 ncdv-master-1 devstack@n-api.service[143129]: ERROR nova.api.openstack.wsgi May 28 22:16:11.170267 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-6795e79d-00e6-4db3-bf59-86948661871e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Returning 404 to user: Instance 00094224-898e-41b9-9641-c150cfbfe17d could not be found. {{(pid=143129) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 22:16:11.170267 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-6795e79d-00e6-4db3-bf59-86948661871e tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d" status: 404 len: 111 microversion: 2.1 time: 0.030380 May 28 22:16:11.170267 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3624/7204] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:11 2022] GET /compute/v2.1/servers/00094224-898e-41b9-9641-c150cfbfe17d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 22:16:11.394697 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-9037b1df-d732-47f6-a84b-1fe1a03342fc tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] Calling method '.version_select at 0x7f4d579a2040>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:11.471415 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-9037b1df-d732-47f6-a84b-1fe1a03342fc tempest-TestShelveInstance-491367012 tempest-TestShelveInstance-491367012-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-732297354" status: 202 len: 0 microversion: 2.1 time: 0.080500 May 28 22:16:11.472080 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3581/7205] 10.222.0.33 () {58 vars in 1250 bytes} [Sat May 28 22:16:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-732297354 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:16:16.205343 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:16:16.205962 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 22:16:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:16:33.410948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=10 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:16:33.411729 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=16 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:16:33.582135 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dda456a3-db37-4818-abba-19622950a102 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Action: 'create', calling method: .version_select at 0x7f4d576623a0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-176826489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkNZB/Ge+2t5t+5qjkzyf57lrOWhzfPM3W3YbeQLrLaDQL//OCdHG6UUYHgIwqEC50AU58h+pGC/s2TGzhTMY2vyPjaRmIvBT6auj/zRxvc7QddPsrU3fIGsHKQcLJ+SA=="}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:16:33.606948 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-dda456a3-db37-4818-abba-19622950a102 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Getting quotas for project c9313da576ba44f4a4fdb41a1306a1c2. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 22:16:33.615375 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-dda456a3-db37-4818-abba-19622950a102 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Getting quotas for user ef1a345c9a0b4a3287ac4110fcf90e50 and project c9313da576ba44f4a4fdb41a1306a1c2. Resources: {'key_pairs'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 22:16:33.713860 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dda456a3-db37-4818-abba-19622950a102 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.308384 May 28 22:16:33.714537 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3625/7206] 10.222.0.33 () {60 vars in 1158 bytes} [Sat May 28 22:16:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:16:36.171246 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-322996071", "imageRef": "9586d0d3-c540-4636-bb36-06bb4b16c195", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-176826489", "security_groups": [{"name": "tempest-secgroup-smoke-167359481"}], "networks": [{"uuid": "ccf60520-5e87-4537-83e3-f55fe9a37a91"}]}} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:16:36.179941 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:16:36.180808 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:16:36.290542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.network.neutron [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] validate_networks() for [('ccf60520-5e87-4537-83e3-f55fe9a37a91', None, None, None, None, None)] {{(pid=143128) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 22:16:36.834119 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Flavor limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 22:16:36.834567 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Image limits 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 22:16:36.835423 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Flavor pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 22:16:36.835869 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Image pref 0:0:0 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 22:16:36.836305 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.virt.hardware [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143128) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 22:16:36.846112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:36.846587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:36.848101 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:36.848575 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:36.869202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Getting quotas for project c9313da576ba44f4a4fdb41a1306a1c2. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 22:16:36.875618 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.quota [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Getting quotas for user ef1a345c9a0b4a3287ac4110fcf90e50 and project c9313da576ba44f4a4fdb41a1306a1c2. Resources: {'instances', 'cores', 'ram'} {{(pid=143128) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 22:16:36.890418 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Going to run 1 instances... {{(pid=143128) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 22:16:36.892767 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9586d0d3-c540-4636-bb36-06bb4b16c195',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143128) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 22:16:37.036670 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-d2bd36cc-35b7-44f7-b4af-e3aa83456972 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.870618 May 28 22:16:37.037615 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3582/7207] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 22:16:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 22:16:37.056875 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-003834cd-7359-42fa-abd5-e49c53b5b6ab tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:37.058241 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-003834cd-7359-42fa-abd5-e49c53b5b6ab tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:37.187854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-003834cd-7359-42fa-abd5-e49c53b5b6ab tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:37.205655 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-003834cd-7359-42fa-abd5-e49c53b5b6ab tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1247 microversion: 2.1 time: 0.161335 May 28 22:16:37.206532 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3626/7208] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:37 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1247 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:16:38.225003 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-87863748-c185-4f2e-84e4-d5dfe7e16503 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:38.225600 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-87863748-c185-4f2e-84e4-d5dfe7e16503 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:38.279135 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-87863748-c185-4f2e-84e4-d5dfe7e16503 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:38.286197 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-87863748-c185-4f2e-84e4-d5dfe7e16503 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1247 microversion: 2.1 time: 0.066152 May 28 22:16:38.286990 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3583/7209] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:38 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1247 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:16:39.303939 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-2208cf2a-0f6c-43ed-8f24-37411e13e423 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:39.304571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-2208cf2a-0f6c-43ed-8f24-37411e13e423 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:39.312792 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2208cf2a-0f6c-43ed-8f24-37411e13e423 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:39.313264 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2208cf2a-0f6c-43ed-8f24-37411e13e423 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:39.314082 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2208cf2a-0f6c-43ed-8f24-37411e13e423 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:39.314540 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-2208cf2a-0f6c-43ed-8f24-37411e13e423 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:39.383941 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-2208cf2a-0f6c-43ed-8f24-37411e13e423 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:39.392507 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-2208cf2a-0f6c-43ed-8f24-37411e13e423 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1307 microversion: 2.1 time: 0.092625 May 28 22:16:39.393096 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3627/7210] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:39 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:16:40.410793 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-af02829e-3f2b-4e81-aa17-9584e70e1300 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:40.411432 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-af02829e-3f2b-4e81-aa17-9584e70e1300 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:40.417680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af02829e-3f2b-4e81-aa17-9584e70e1300 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:40.418773 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af02829e-3f2b-4e81-aa17-9584e70e1300 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:40.419723 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af02829e-3f2b-4e81-aa17-9584e70e1300 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:40.420191 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-af02829e-3f2b-4e81-aa17-9584e70e1300 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:40.550116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-af02829e-3f2b-4e81-aa17-9584e70e1300 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:40.557814 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-af02829e-3f2b-4e81-aa17-9584e70e1300 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1372 microversion: 2.1 time: 0.151349 May 28 22:16:40.558428 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3584/7211] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:40 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:16:41.159649 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-539bc500-7601-4499-86b9-b084017d1934 req-305bd094-935a-4152-9ce5-d62c6dcd5307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcf64e1d-77ea-4353-a512-ab0dff52c2e2", "tag": "bc1320d7-3d19-46dd-b104-449035fe3d7d"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:16:41.171429 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-539bc500-7601-4499-86b9-b084017d1934 req-305bd094-935a-4152-9ce5-d62c6dcd5307 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:41.172246 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-539bc500-7601-4499-86b9-b084017d1934 req-305bd094-935a-4152-9ce5-d62c6dcd5307 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:41.187341 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-539bc500-7601-4499-86b9-b084017d1934 req-305bd094-935a-4152-9ce5-d62c6dcd5307 service nova] Creating event network-changed:bc1320d7-3d19-46dd-b104-449035fe3d7d for instance dcf64e1d-77ea-4353-a512-ab0dff52c2e2 on nch1-master-1 May 28 22:16:41.193887 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-539bc500-7601-4499-86b9-b084017d1934 req-305bd094-935a-4152-9ce5-d62c6dcd5307 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038482 May 28 22:16:41.194051 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3628/7212] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:16:41.575695 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-8f179ed6-6116-4301-b376-e77dc46cc724 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:41.576362 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-8f179ed6-6116-4301-b376-e77dc46cc724 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:41.583389 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f179ed6-6116-4301-b376-e77dc46cc724 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:41.583854 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f179ed6-6116-4301-b376-e77dc46cc724 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:41.584636 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f179ed6-6116-4301-b376-e77dc46cc724 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:41.585088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-8f179ed6-6116-4301-b376-e77dc46cc724 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:41.722329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-8f179ed6-6116-4301-b376-e77dc46cc724 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:41.729979 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-8f179ed6-6116-4301-b376-e77dc46cc724 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1372 microversion: 2.1 time: 0.158363 May 28 22:16:41.731104 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3585/7213] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:41 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:16:42.747846 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cea454d2-ddc8-46d9-aa51-be1832f66c75 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:42.748553 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cea454d2-ddc8-46d9-aa51-be1832f66c75 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:42.755820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cea454d2-ddc8-46d9-aa51-be1832f66c75 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:42.756300 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cea454d2-ddc8-46d9-aa51-be1832f66c75 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:42.757057 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cea454d2-ddc8-46d9-aa51-be1832f66c75 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:42.757503 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cea454d2-ddc8-46d9-aa51-be1832f66c75 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:42.897608 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cea454d2-ddc8-46d9-aa51-be1832f66c75 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:42.905622 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cea454d2-ddc8-46d9-aa51-be1832f66c75 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1372 microversion: 2.1 time: 0.162656 May 28 22:16:42.906275 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3629/7214] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:42 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:16:43.923124 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4485f372-3352-4f3f-ac23-11d358d8dfee tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:43.923761 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4485f372-3352-4f3f-ac23-11d358d8dfee tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:43.930779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4485f372-3352-4f3f-ac23-11d358d8dfee tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:43.931250 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4485f372-3352-4f3f-ac23-11d358d8dfee tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:43.932031 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4485f372-3352-4f3f-ac23-11d358d8dfee tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:43.932487 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4485f372-3352-4f3f-ac23-11d358d8dfee tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:44.063591 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4485f372-3352-4f3f-ac23-11d358d8dfee tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:44.071348 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4485f372-3352-4f3f-ac23-11d358d8dfee tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1372 microversion: 2.1 time: 0.152204 May 28 22:16:44.071919 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3586/7215] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:43 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:16:45.088147 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-741c2db9-ea60-4be5-a49b-d3c63e2a2ec2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:45.088769 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-741c2db9-ea60-4be5-a49b-d3c63e2a2ec2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:45.096556 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-741c2db9-ea60-4be5-a49b-d3c63e2a2ec2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:45.097011 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-741c2db9-ea60-4be5-a49b-d3c63e2a2ec2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:45.102631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-741c2db9-ea60-4be5-a49b-d3c63e2a2ec2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:45.102631 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-741c2db9-ea60-4be5-a49b-d3c63e2a2ec2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:45.232790 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-741c2db9-ea60-4be5-a49b-d3c63e2a2ec2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:45.240317 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-741c2db9-ea60-4be5-a49b-d3c63e2a2ec2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1372 microversion: 2.1 time: 0.156075 May 28 22:16:45.240878 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3630/7216] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:45 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:16:46.257111 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3487b76e-6507-4378-ae3f-4bb50c0137f7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:46.257750 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3487b76e-6507-4378-ae3f-4bb50c0137f7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:46.264785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3487b76e-6507-4378-ae3f-4bb50c0137f7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:46.265255 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3487b76e-6507-4378-ae3f-4bb50c0137f7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:46.266092 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3487b76e-6507-4378-ae3f-4bb50c0137f7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:46.266544 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3487b76e-6507-4378-ae3f-4bb50c0137f7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:46.404369 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3487b76e-6507-4378-ae3f-4bb50c0137f7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:46.412119 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3487b76e-6507-4378-ae3f-4bb50c0137f7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1372 microversion: 2.1 time: 0.159016 May 28 22:16:46.412695 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3587/7217] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:46 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:16:47.429523 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c55c65d8-5b49-4f99-9ad2-90a589db4853 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:47.430184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c55c65d8-5b49-4f99-9ad2-90a589db4853 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:47.433009 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:16:47.443146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c55c65d8-5b49-4f99-9ad2-90a589db4853 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:47.443146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c55c65d8-5b49-4f99-9ad2-90a589db4853 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:47.443146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c55c65d8-5b49-4f99-9ad2-90a589db4853 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:47.443146 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c55c65d8-5b49-4f99-9ad2-90a589db4853 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:47.576167 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c55c65d8-5b49-4f99-9ad2-90a589db4853 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:47.583691 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c55c65d8-5b49-4f99-9ad2-90a589db4853 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1372 microversion: 2.1 time: 0.158134 May 28 22:16:47.584278 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3631/7218] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:47 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:16:47.881408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:16:47.942914 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-f61251db-a01f-4aa3-8cbf-8f6bc07eaa6f req-54375ef4-8a04-4c82-bc80-00aa38cb5d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf64e1d-77ea-4353-a512-ab0dff52c2e2", "name": "network-vif-plugged", "status": "completed", "tag": "bc1320d7-3d19-46dd-b104-449035fe3d7d"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:16:47.951218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f61251db-a01f-4aa3-8cbf-8f6bc07eaa6f req-54375ef4-8a04-4c82-bc80-00aa38cb5d0f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:47.951684 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f61251db-a01f-4aa3-8cbf-8f6bc07eaa6f req-54375ef4-8a04-4c82-bc80-00aa38cb5d0f service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:47.963146 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-f61251db-a01f-4aa3-8cbf-8f6bc07eaa6f req-54375ef4-8a04-4c82-bc80-00aa38cb5d0f service nova] Creating event network-vif-plugged:bc1320d7-3d19-46dd-b104-449035fe3d7d for instance dcf64e1d-77ea-4353-a512-ab0dff52c2e2 on nch1-master-1 May 28 22:16:47.969954 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-f61251db-a01f-4aa3-8cbf-8f6bc07eaa6f req-54375ef4-8a04-4c82-bc80-00aa38cb5d0f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092826 May 28 22:16:47.970604 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3588/7219] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:16:48.600525 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-76af4821-e1f0-4140-8ae3-2d07488d2e60 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:48.601150 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-76af4821-e1f0-4140-8ae3-2d07488d2e60 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:48.608307 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76af4821-e1f0-4140-8ae3-2d07488d2e60 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:48.608766 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76af4821-e1f0-4140-8ae3-2d07488d2e60 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:48.609545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76af4821-e1f0-4140-8ae3-2d07488d2e60 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:48.610021 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-76af4821-e1f0-4140-8ae3-2d07488d2e60 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:48.744539 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-76af4821-e1f0-4140-8ae3-2d07488d2e60 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:48.752898 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-76af4821-e1f0-4140-8ae3-2d07488d2e60 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1372 microversion: 2.1 time: 0.156390 May 28 22:16:48.753472 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3632/7220] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:48 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:16:49.766483 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=8 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:16:49.771876 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-b8eacc6d-1fc3-47c3-8bb8-2c628f626806 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:49.772621 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-b8eacc6d-1fc3-47c3-8bb8-2c628f626806 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:49.779693 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b8eacc6d-1fc3-47c3-8bb8-2c628f626806 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:49.780181 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b8eacc6d-1fc3-47c3-8bb8-2c628f626806 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:49.780954 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b8eacc6d-1fc3-47c3-8bb8-2c628f626806 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:49.781408 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-b8eacc6d-1fc3-47c3-8bb8-2c628f626806 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:49.912202 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-b8eacc6d-1fc3-47c3-8bb8-2c628f626806 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:49.919812 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-b8eacc6d-1fc3-47c3-8bb8-2c628f626806 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1557 microversion: 2.1 time: 0.154287 May 28 22:16:49.920407 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3589/7221] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:49 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:16:49.936204 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-816ef362-bc87-4b90-b5e8-196ab4c3b7f2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:16:49.937086 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-816ef362-bc87-4b90-b5e8-196ab4c3b7f2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:16:49.944049 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-816ef362-bc87-4b90-b5e8-196ab4c3b7f2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:49.944518 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-816ef362-bc87-4b90-b5e8-196ab4c3b7f2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:49.945285 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-816ef362-bc87-4b90-b5e8-196ab4c3b7f2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:49.945734 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-816ef362-bc87-4b90-b5e8-196ab4c3b7f2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:50.080704 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-816ef362-bc87-4b90-b5e8-196ab4c3b7f2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:16:50.088493 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-816ef362-bc87-4b90-b5e8-196ab4c3b7f2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1557 microversion: 2.1 time: 0.156680 May 28 22:16:50.089065 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3633/7222] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:16:49 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:16:52.070178 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-ae8dc548-567d-47e4-9e3d-b740e9ab623a req-f2b1ea1e-4242-40a9-8977-c38c756d9f7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcf64e1d-77ea-4353-a512-ab0dff52c2e2", "tag": "bc1320d7-3d19-46dd-b104-449035fe3d7d"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:16:52.079733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ae8dc548-567d-47e4-9e3d-b740e9ab623a req-f2b1ea1e-4242-40a9-8977-c38c756d9f7b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:16:52.080116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-ae8dc548-567d-47e4-9e3d-b740e9ab623a req-f2b1ea1e-4242-40a9-8977-c38c756d9f7b service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:16:52.091734 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-ae8dc548-567d-47e4-9e3d-b740e9ab623a req-f2b1ea1e-4242-40a9-8977-c38c756d9f7b service nova] Creating event network-changed:bc1320d7-3d19-46dd-b104-449035fe3d7d for instance dcf64e1d-77ea-4353-a512-ab0dff52c2e2 on nch1-master-1 May 28 22:16:52.097022 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-ae8dc548-567d-47e4-9e3d-b740e9ab623a req-f2b1ea1e-4242-40a9-8977-c38c756d9f7b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030712 May 28 22:16:52.097698 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3590/7223] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:17:53.713950 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:17:53.714558 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 22:17:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:18:47.554311 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:18:47.556439 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=38 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:18:47.560724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4ccdcba6-b1ad-4e92-af30-19d915fe7fbd tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-235229489"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:18:47.561750 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4ccdcba6-b1ad-4e92-af30-19d915fe7fbd tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:18:47.567728 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ccdcba6-b1ad-4e92-af30-19d915fe7fbd tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:18:47.568181 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ccdcba6-b1ad-4e92-af30-19d915fe7fbd tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:18:47.568945 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ccdcba6-b1ad-4e92-af30-19d915fe7fbd tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:18:47.569388 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4ccdcba6-b1ad-4e92-af30-19d915fe7fbd tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:18:48.185631 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4ccdcba6-b1ad-4e92-af30-19d915fe7fbd tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "POST /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2/action" status: 202 len: 0 microversion: 2.1 time: 0.632824 May 28 22:18:48.186238 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3634/7224] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:18:47 2022] POST /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2/action => generated 0 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 22:18:54.568518 ncdv-master-1 devstack@n-api.service[143128]: ERROR oslo.messaging._drivers.impl_rabbit [-] [71d375b4-1aec-4c8d-819c-c0bdf546db7b] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 28 22:18:54.570300 ncdv-master-1 devstack@n-api.service[143128]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c389da86-0e4e-4c71-b4f6-a8fc5e8f642f] AMQP server on 10.222.0.33:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 28 22:18:54.570913 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:18:54.571892 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=36 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:18:54.576373 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-2299ebf3-50f4-4e8f-8f3f-a4b1248c4ba6 req-2d4609eb-b593-4f4d-98b0-6e1b91eaa32d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf64e1d-77ea-4353-a512-ab0dff52c2e2", "name": "network-vif-plugged", "status": "completed", "tag": "bc1320d7-3d19-46dd-b104-449035fe3d7d"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:18:54.586829 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2299ebf3-50f4-4e8f-8f3f-a4b1248c4ba6 req-2d4609eb-b593-4f4d-98b0-6e1b91eaa32d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:18:54.591547 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-2299ebf3-50f4-4e8f-8f3f-a4b1248c4ba6 req-2d4609eb-b593-4f4d-98b0-6e1b91eaa32d service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:18:54.603939 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-2299ebf3-50f4-4e8f-8f3f-a4b1248c4ba6 req-2d4609eb-b593-4f4d-98b0-6e1b91eaa32d service nova] Creating event network-vif-plugged:bc1320d7-3d19-46dd-b104-449035fe3d7d for instance dcf64e1d-77ea-4353-a512-ab0dff52c2e2 on nch1-master-1 May 28 22:18:54.609351 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-2299ebf3-50f4-4e8f-8f3f-a4b1248c4ba6 req-2d4609eb-b593-4f4d-98b0-6e1b91eaa32d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043687 May 28 22:18:54.610115 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3591/7225] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:19:02.833642 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:19:02.834461 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:19:02.838775 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1572932684", "imageRef": "5c9dcc34-3c7c-4d1a-a4c3-c455b57b3aae", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-176826489", "security_groups": [{"name": "tempest-secgroup-smoke-167359481"}], "networks": [{"uuid": "ccf60520-5e87-4537-83e3-f55fe9a37a91"}]}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:19:02.943910 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.network.neutron [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] validate_networks() for [('ccf60520-5e87-4537-83e3-f55fe9a37a91', None, None, None, None, None)] {{(pid=143129) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 28 22:19:03.648529 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Flavor limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 28 22:19:03.648998 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Image limits 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 28 22:19:03.649517 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Flavor pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 28 22:19:03.649974 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Image pref 0:0:0 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 28 22:19:03.650403 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.virt.hardware [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=143129) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 28 22:19:03.659536 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:03.660004 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:03.660829 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:03.661286 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:03.678305 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Getting quotas for project c9313da576ba44f4a4fdb41a1306a1c2. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 28 22:19:03.684120 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.quota [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Getting quotas for user ef1a345c9a0b4a3287ac4110fcf90e50 and project c9313da576ba44f4a4fdb41a1306a1c2. Resources: {'instances', 'cores', 'ram'} {{(pid=143129) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 28 22:19:03.696883 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Going to run 1 instances... {{(pid=143129) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 28 22:19:03.699996 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5c9dcc34-3c7c-4d1a-a4c3-c455b57b3aae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=143129) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 28 22:19:03.835762 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-4218de7a-573b-4b42-b91b-543e6a67c024 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.004094 May 28 22:19:03.837136 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3635/7226] 10.222.0.33 () {60 vars in 1146 bytes} [Sat May 28 22:19:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 28 22:19:03.848225 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-85c8df07-187b-4faf-899d-da0592e71e16 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:03.848949 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-85c8df07-187b-4faf-899d-da0592e71e16 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:03.863440 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] [c389da86-0e4e-4c71-b4f6-a8fc5e8f642f] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 55468. May 28 22:19:03.874302 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] [71d375b4-1aec-4c8d-819c-c0bdf546db7b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 55466. May 28 22:19:03.978830 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-85c8df07-187b-4faf-899d-da0592e71e16 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:03.987098 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-85c8df07-187b-4faf-899d-da0592e71e16 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1248 microversion: 2.1 time: 0.144399 May 28 22:19:03.987752 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3592/7227] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:03 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1248 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:05.004822 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cacb9967-0c51-4a03-ae77-bedc0202d254 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:05.005450 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cacb9967-0c51-4a03-ae77-bedc0202d254 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:05.013684 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cacb9967-0c51-4a03-ae77-bedc0202d254 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:05.014191 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cacb9967-0c51-4a03-ae77-bedc0202d254 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:05.014978 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cacb9967-0c51-4a03-ae77-bedc0202d254 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:05.015432 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cacb9967-0c51-4a03-ae77-bedc0202d254 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:05.078277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cacb9967-0c51-4a03-ae77-bedc0202d254 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:05.085958 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cacb9967-0c51-4a03-ae77-bedc0202d254 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1252 microversion: 2.1 time: 0.085253 May 28 22:19:05.086524 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3636/7228] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:04 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1252 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:06.103379 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-2d118860-f24a-4bc5-8133-09b28235a072 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:06.104024 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-2d118860-f24a-4bc5-8133-09b28235a072 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:06.111350 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d118860-f24a-4bc5-8133-09b28235a072 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:06.111825 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d118860-f24a-4bc5-8133-09b28235a072 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:06.112664 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d118860-f24a-4bc5-8133-09b28235a072 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:06.113076 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-2d118860-f24a-4bc5-8133-09b28235a072 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:06.186454 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-2d118860-f24a-4bc5-8133-09b28235a072 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:06.195371 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-2d118860-f24a-4bc5-8133-09b28235a072 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1318 microversion: 2.1 time: 0.095981 May 28 22:19:06.195984 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3593/7229] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:06 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1318 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:06.596640 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [req-869b7d3d-34de-4a73-8848-a7b2644d9726 req-c6869c42-f4a2-46e5-95e3-42ba1c783aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf64e1d-77ea-4353-a512-ab0dff52c2e2", "name": "network-vif-unplugged", "status": "completed", "tag": "bc1320d7-3d19-46dd-b104-449035fe3d7d"}]} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:19:06.614364 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-869b7d3d-34de-4a73-8848-a7b2644d9726 req-c6869c42-f4a2-46e5-95e3-42ba1c783aea service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:06.614828 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [req-869b7d3d-34de-4a73-8848-a7b2644d9726 req-c6869c42-f4a2-46e5-95e3-42ba1c783aea service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:06.661310 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.compute.server_external_events [req-869b7d3d-34de-4a73-8848-a7b2644d9726 req-c6869c42-f4a2-46e5-95e3-42ba1c783aea service nova] Creating event network-vif-unplugged:bc1320d7-3d19-46dd-b104-449035fe3d7d for instance dcf64e1d-77ea-4353-a512-ab0dff52c2e2 on nch1-master-1 May 28 22:19:06.669899 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [req-869b7d3d-34de-4a73-8848-a7b2644d9726 req-c6869c42-f4a2-46e5-95e3-42ba1c783aea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076761 May 28 22:19:06.671233 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3637/7230] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:19:07.215397 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-52b48a7f-ffaf-486b-82b5-0564fe766d03 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:07.217027 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-52b48a7f-ffaf-486b-82b5-0564fe766d03 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:07.227290 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52b48a7f-ffaf-486b-82b5-0564fe766d03 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:07.228186 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52b48a7f-ffaf-486b-82b5-0564fe766d03 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:07.230348 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52b48a7f-ffaf-486b-82b5-0564fe766d03 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:07.231021 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-52b48a7f-ffaf-486b-82b5-0564fe766d03 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:07.392232 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-52b48a7f-ffaf-486b-82b5-0564fe766d03 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:07.402637 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-52b48a7f-ffaf-486b-82b5-0564fe766d03 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1373 microversion: 2.1 time: 0.193256 May 28 22:19:07.403242 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3594/7231] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:07 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1373 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:08.420457 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c1d5ee25-c20d-4384-a067-bd28c4353e5b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:08.422193 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c1d5ee25-c20d-4384-a067-bd28c4353e5b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:08.430117 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c1d5ee25-c20d-4384-a067-bd28c4353e5b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:08.430909 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c1d5ee25-c20d-4384-a067-bd28c4353e5b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:08.432238 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c1d5ee25-c20d-4384-a067-bd28c4353e5b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:08.432932 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c1d5ee25-c20d-4384-a067-bd28c4353e5b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:08.579381 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c1d5ee25-c20d-4384-a067-bd28c4353e5b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:08.587749 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c1d5ee25-c20d-4384-a067-bd28c4353e5b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1373 microversion: 2.1 time: 0.171555 May 28 22:19:08.597997 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3638/7232] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:08 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:19:09.604587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-fa97f682-92a6-4315-bee3-2796b0427938 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:09.605218 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-fa97f682-92a6-4315-bee3-2796b0427938 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:09.612698 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fa97f682-92a6-4315-bee3-2796b0427938 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:09.613227 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fa97f682-92a6-4315-bee3-2796b0427938 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:09.614169 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fa97f682-92a6-4315-bee3-2796b0427938 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:09.614831 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-fa97f682-92a6-4315-bee3-2796b0427938 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:09.762643 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-fa97f682-92a6-4315-bee3-2796b0427938 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:09.771218 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-fa97f682-92a6-4315-bee3-2796b0427938 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1373 microversion: 2.1 time: 0.170465 May 28 22:19:09.771828 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3595/7233] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:09 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:10.791545 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-636c823e-c8f3-4d7d-8f7b-5b922b7db397 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:10.792564 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-636c823e-c8f3-4d7d-8f7b-5b922b7db397 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:10.804820 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-636c823e-c8f3-4d7d-8f7b-5b922b7db397 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:10.805451 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-636c823e-c8f3-4d7d-8f7b-5b922b7db397 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:10.806841 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-636c823e-c8f3-4d7d-8f7b-5b922b7db397 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:10.807789 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-636c823e-c8f3-4d7d-8f7b-5b922b7db397 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:10.966749 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-636c823e-c8f3-4d7d-8f7b-5b922b7db397 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:10.980186 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-636c823e-c8f3-4d7d-8f7b-5b922b7db397 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1373 microversion: 2.1 time: 0.194704 May 28 22:19:10.980784 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3639/7234] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:10 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1373 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:11.999179 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-f4e6bfca-c480-4f74-a2de-64b2315d1c3f tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:12.000069 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-f4e6bfca-c480-4f74-a2de-64b2315d1c3f tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:12.008137 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f4e6bfca-c480-4f74-a2de-64b2315d1c3f tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:12.008610 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f4e6bfca-c480-4f74-a2de-64b2315d1c3f tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:12.009413 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f4e6bfca-c480-4f74-a2de-64b2315d1c3f tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:12.009893 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-f4e6bfca-c480-4f74-a2de-64b2315d1c3f tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:12.160721 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-f4e6bfca-c480-4f74-a2de-64b2315d1c3f tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:12.169972 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-f4e6bfca-c480-4f74-a2de-64b2315d1c3f tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1373 microversion: 2.1 time: 0.175252 May 28 22:19:12.170604 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3596/7235] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:11 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:13.186891 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c13c2514-853f-4df4-a8db-167af88ece80 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:13.187499 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c13c2514-853f-4df4-a8db-167af88ece80 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:13.194690 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c13c2514-853f-4df4-a8db-167af88ece80 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:13.195182 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c13c2514-853f-4df4-a8db-167af88ece80 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:13.195953 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c13c2514-853f-4df4-a8db-167af88ece80 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:13.196436 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c13c2514-853f-4df4-a8db-167af88ece80 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:13.376617 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c13c2514-853f-4df4-a8db-167af88ece80 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:13.376617 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c13c2514-853f-4df4-a8db-167af88ece80 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1373 microversion: 2.1 time: 0.174459 May 28 22:19:13.376617 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3640/7236] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:13 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:14.375434 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-c645473e-b93b-49bc-99b0-e319b0ca074b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:14.376138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-c645473e-b93b-49bc-99b0-e319b0ca074b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:14.380343 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell0:SELECT=2 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:19:14.384329 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c645473e-b93b-49bc-99b0-e319b0ca074b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:14.384814 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c645473e-b93b-49bc-99b0-e319b0ca074b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:14.385647 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c645473e-b93b-49bc-99b0-e319b0ca074b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:14.386141 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-c645473e-b93b-49bc-99b0-e319b0ca074b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:14.535555 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-c645473e-b93b-49bc-99b0-e319b0ca074b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:14.544808 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-c645473e-b93b-49bc-99b0-e319b0ca074b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1373 microversion: 2.1 time: 0.173786 May 28 22:19:14.549117 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3597/7237] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:14 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:15.562407 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-61d9af60-ed1d-4a4f-8d83-6151509f3edd tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:15.563126 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-61d9af60-ed1d-4a4f-8d83-6151509f3edd tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:15.565169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:19:15.566030 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell0:SELECT=6 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:19:15.572254 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61d9af60-ed1d-4a4f-8d83-6151509f3edd tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:15.572717 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61d9af60-ed1d-4a4f-8d83-6151509f3edd tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:15.573507 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61d9af60-ed1d-4a4f-8d83-6151509f3edd tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:15.573995 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-61d9af60-ed1d-4a4f-8d83-6151509f3edd tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:15.713959 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-61d9af60-ed1d-4a4f-8d83-6151509f3edd tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:15.721528 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-61d9af60-ed1d-4a4f-8d83-6151509f3edd tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1373 microversion: 2.1 time: 0.163529 May 28 22:19:15.722187 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3641/7238] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:15 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:16.103315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-f1b35367-63ff-4ec9-9b48-651a7df435e3 req-77f0f6db-0515-4331-bdff-9eda834e4467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d6dca1-9415-482f-ac78-6a0a0a1264d5", "tag": "c99d6584-85e2-4e42-8cf0-fe70998f529a"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:19:16.115368 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f1b35367-63ff-4ec9-9b48-651a7df435e3 req-77f0f6db-0515-4331-bdff-9eda834e4467 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:16.117542 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-f1b35367-63ff-4ec9-9b48-651a7df435e3 req-77f0f6db-0515-4331-bdff-9eda834e4467 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:16.128836 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-f1b35367-63ff-4ec9-9b48-651a7df435e3 req-77f0f6db-0515-4331-bdff-9eda834e4467 service nova] Creating event network-changed:c99d6584-85e2-4e42-8cf0-fe70998f529a for instance d6d6dca1-9415-482f-ac78-6a0a0a1264d5 on nch2-master-1 May 28 22:19:16.134057 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-f1b35367-63ff-4ec9-9b48-651a7df435e3 req-77f0f6db-0515-4331-bdff-9eda834e4467 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035218 May 28 22:19:16.134915 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3598/7239] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 28 22:19:16.738907 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-45dd68cb-c929-4a62-8009-09b6d73f4c0d tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:16.739562 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-45dd68cb-c929-4a62-8009-09b6d73f4c0d tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:16.746800 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-45dd68cb-c929-4a62-8009-09b6d73f4c0d tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:16.747262 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-45dd68cb-c929-4a62-8009-09b6d73f4c0d tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:16.748048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-45dd68cb-c929-4a62-8009-09b6d73f4c0d tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:16.748500 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-45dd68cb-c929-4a62-8009-09b6d73f4c0d tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:16.880984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-45dd68cb-c929-4a62-8009-09b6d73f4c0d tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:16.889348 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-45dd68cb-c929-4a62-8009-09b6d73f4c0d tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1373 microversion: 2.1 time: 0.154448 May 28 22:19:16.894006 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3642/7240] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:16 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:17.908382 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c7a33a9-99b4-4c37-88f7-c8a1b44435d0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:17.909105 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3c7a33a9-99b4-4c37-88f7-c8a1b44435d0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:17.915520 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c7a33a9-99b4-4c37-88f7-c8a1b44435d0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:17.915994 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c7a33a9-99b4-4c37-88f7-c8a1b44435d0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:17.916779 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c7a33a9-99b4-4c37-88f7-c8a1b44435d0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:17.917912 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c7a33a9-99b4-4c37-88f7-c8a1b44435d0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:18.052055 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-3c7a33a9-99b4-4c37-88f7-c8a1b44435d0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:18.060047 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3c7a33a9-99b4-4c37-88f7-c8a1b44435d0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1373 microversion: 2.1 time: 0.156520 May 28 22:19:18.060900 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3599/7241] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:17 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:19.077299 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-8dee47a3-be15-4401-b62b-3bbbdd972667 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:19.078048 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-8dee47a3-be15-4401-b62b-3bbbdd972667 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:19.085236 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8dee47a3-be15-4401-b62b-3bbbdd972667 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:19.085724 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8dee47a3-be15-4401-b62b-3bbbdd972667 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:19.086541 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8dee47a3-be15-4401-b62b-3bbbdd972667 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:19.086989 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-8dee47a3-be15-4401-b62b-3bbbdd972667 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:19.221280 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-8dee47a3-be15-4401-b62b-3bbbdd972667 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:19.228915 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-8dee47a3-be15-4401-b62b-3bbbdd972667 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1373 microversion: 2.1 time: 0.156157 May 28 22:19:19.229497 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3643/7242] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:19 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:20.246033 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-41793958-2fb5-479e-bfdd-56835c9acc16 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:20.246597 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-41793958-2fb5-479e-bfdd-56835c9acc16 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:20.253703 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41793958-2fb5-479e-bfdd-56835c9acc16 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:20.254224 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41793958-2fb5-479e-bfdd-56835c9acc16 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:20.255047 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41793958-2fb5-479e-bfdd-56835c9acc16 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:20.255506 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-41793958-2fb5-479e-bfdd-56835c9acc16 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:20.397403 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-41793958-2fb5-479e-bfdd-56835c9acc16 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:20.405653 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-41793958-2fb5-479e-bfdd-56835c9acc16 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1373 microversion: 2.1 time: 0.163670 May 28 22:19:20.406290 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3600/7243] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:20 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:21.423143 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-3bc2bc98-7b70-412e-b52f-90bb48fb0ca5 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:21.423667 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-3bc2bc98-7b70-412e-b52f-90bb48fb0ca5 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:21.430854 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3bc2bc98-7b70-412e-b52f-90bb48fb0ca5 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:21.431312 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3bc2bc98-7b70-412e-b52f-90bb48fb0ca5 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:21.432083 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3bc2bc98-7b70-412e-b52f-90bb48fb0ca5 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:21.432530 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-3bc2bc98-7b70-412e-b52f-90bb48fb0ca5 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:21.563651 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-3bc2bc98-7b70-412e-b52f-90bb48fb0ca5 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:21.571568 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-3bc2bc98-7b70-412e-b52f-90bb48fb0ca5 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1373 microversion: 2.1 time: 0.152426 May 28 22:19:21.572475 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3644/7244] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:21 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:22.003510 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-88494634-ddf4-45e0-b9fe-05dcc7cf9dd9 req-0766cc5d-7e91-4ad7-a377-6055b4009e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d6dca1-9415-482f-ac78-6a0a0a1264d5", "name": "network-vif-plugged", "status": "completed", "tag": "c99d6584-85e2-4e42-8cf0-fe70998f529a"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:19:22.013260 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-88494634-ddf4-45e0-b9fe-05dcc7cf9dd9 req-0766cc5d-7e91-4ad7-a377-6055b4009e64 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:22.013733 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-88494634-ddf4-45e0-b9fe-05dcc7cf9dd9 req-0766cc5d-7e91-4ad7-a377-6055b4009e64 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:22.025001 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-88494634-ddf4-45e0-b9fe-05dcc7cf9dd9 req-0766cc5d-7e91-4ad7-a377-6055b4009e64 service nova] Creating event network-vif-plugged:c99d6584-85e2-4e42-8cf0-fe70998f529a for instance d6d6dca1-9415-482f-ac78-6a0a0a1264d5 on nch2-master-1 May 28 22:19:22.030083 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-88494634-ddf4-45e0-b9fe-05dcc7cf9dd9 req-0766cc5d-7e91-4ad7-a377-6055b4009e64 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030288 May 28 22:19:22.030730 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3601/7245] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:19:22.588576 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-c72499da-c9d8-4ffd-87d9-1d0eb22bd242 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:22.589202 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-c72499da-c9d8-4ffd-87d9-1d0eb22bd242 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:22.596815 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c72499da-c9d8-4ffd-87d9-1d0eb22bd242 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:22.597277 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c72499da-c9d8-4ffd-87d9-1d0eb22bd242 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:22.598087 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c72499da-c9d8-4ffd-87d9-1d0eb22bd242 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:22.598571 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-c72499da-c9d8-4ffd-87d9-1d0eb22bd242 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:22.732394 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-c72499da-c9d8-4ffd-87d9-1d0eb22bd242 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:22.739968 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-c72499da-c9d8-4ffd-87d9-1d0eb22bd242 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1373 microversion: 2.1 time: 0.155399 May 28 22:19:22.740541 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3645/7246] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:22 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:23.757781 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-4c2b99e9-d99a-45f6-b680-6a892c7a8a25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:23.758565 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-4c2b99e9-d99a-45f6-b680-6a892c7a8a25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:23.764871 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c2b99e9-d99a-45f6-b680-6a892c7a8a25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:23.765337 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c2b99e9-d99a-45f6-b680-6a892c7a8a25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:23.766138 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c2b99e9-d99a-45f6-b680-6a892c7a8a25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:23.766602 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-4c2b99e9-d99a-45f6-b680-6a892c7a8a25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:23.898760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-4c2b99e9-d99a-45f6-b680-6a892c7a8a25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:23.906916 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-4c2b99e9-d99a-45f6-b680-6a892c7a8a25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1559 microversion: 2.1 time: 0.154225 May 28 22:19:23.907487 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3602/7247] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:23 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:19:23.922934 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-e29cd9a6-17cd-49ef-b6a2-0566779c5151 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:19:23.923573 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-e29cd9a6-17cd-49ef-b6a2-0566779c5151 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:19:23.930508 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e29cd9a6-17cd-49ef-b6a2-0566779c5151 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:23.930964 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e29cd9a6-17cd-49ef-b6a2-0566779c5151 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:23.931727 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e29cd9a6-17cd-49ef-b6a2-0566779c5151 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:23.932168 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-e29cd9a6-17cd-49ef-b6a2-0566779c5151 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:24.062813 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-e29cd9a6-17cd-49ef-b6a2-0566779c5151 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:19:24.070600 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-e29cd9a6-17cd-49ef-b6a2-0566779c5151 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1559 microversion: 2.1 time: 0.151496 May 28 22:19:24.071190 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3646/7248] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:19:23 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:19:25.963198 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-50f34d0f-3cd4-4ff2-922c-9087abf1edf9 req-86d3ded8-99b2-4ba0-bd8b-eccccb53d58a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d6dca1-9415-482f-ac78-6a0a0a1264d5", "tag": "c99d6584-85e2-4e42-8cf0-fe70998f529a"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:19:25.972275 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-50f34d0f-3cd4-4ff2-922c-9087abf1edf9 req-86d3ded8-99b2-4ba0-bd8b-eccccb53d58a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:19:25.972742 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-50f34d0f-3cd4-4ff2-922c-9087abf1edf9 req-86d3ded8-99b2-4ba0-bd8b-eccccb53d58a service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:19:25.984520 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-50f34d0f-3cd4-4ff2-922c-9087abf1edf9 req-86d3ded8-99b2-4ba0-bd8b-eccccb53d58a service nova] Creating event network-changed:c99d6584-85e2-4e42-8cf0-fe70998f529a for instance d6d6dca1-9415-482f-ac78-6a0a0a1264d5 on nch2-master-1 May 28 22:19:25.990376 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-50f34d0f-3cd4-4ff2-922c-9087abf1edf9 req-86d3ded8-99b2-4ba0-bd8b-eccccb53d58a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030769 May 28 22:19:25.991017 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3603/7249] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:19:33.605448 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:19:33.606047 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 22:19:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:19:36.214734 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:19:36.215258 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 22:19:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:20:53.188908 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:20:53.189695 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=64 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:20:53.194253 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-43b3738d-e7e1-4aca-bdac-4e0996f441b7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1027737645"}} {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:20:53.195289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-43b3738d-e7e1-4aca-bdac-4e0996f441b7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:20:53.201306 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-43b3738d-e7e1-4aca-bdac-4e0996f441b7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:20:53.201765 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-43b3738d-e7e1-4aca-bdac-4e0996f441b7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:20:53.202578 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-43b3738d-e7e1-4aca-bdac-4e0996f441b7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:20:53.203025 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-43b3738d-e7e1-4aca-bdac-4e0996f441b7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:20:53.651050 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-43b3738d-e7e1-4aca-bdac-4e0996f441b7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "POST /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5/action" status: 202 len: 0 microversion: 2.1 time: 0.463759 May 28 22:20:53.651618 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3647/7250] 10.222.0.33 () {60 vars in 1277 bytes} [Sat May 28 22:20:53 2022] POST /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) May 28 22:20:58.435132 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_api:SELECT=28 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:20:58.436878 ncdv-master-1 devstack@n-api.service[143128]: DEBUG dbcounter [-] [143128] Writing DB stats nova_cell1:SELECT=56 {{(pid=143128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:20:58.440112 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-c5885e42-fc05-4aac-aa4e-ea86517eefc6 req-10eadaae-dc07-4dd4-97ba-42dac72d443c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d6dca1-9415-482f-ac78-6a0a0a1264d5", "name": "network-vif-plugged", "status": "completed", "tag": "c99d6584-85e2-4e42-8cf0-fe70998f529a"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:20:58.449763 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c5885e42-fc05-4aac-aa4e-ea86517eefc6 req-10eadaae-dc07-4dd4-97ba-42dac72d443c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:20:58.450680 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c5885e42-fc05-4aac-aa4e-ea86517eefc6 req-10eadaae-dc07-4dd4-97ba-42dac72d443c service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:20:58.464470 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-c5885e42-fc05-4aac-aa4e-ea86517eefc6 req-10eadaae-dc07-4dd4-97ba-42dac72d443c service nova] Creating event network-vif-plugged:c99d6584-85e2-4e42-8cf0-fe70998f529a for instance d6d6dca1-9415-482f-ac78-6a0a0a1264d5 on nch2-master-1 May 28 22:20:58.469881 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-c5885e42-fc05-4aac-aa4e-ea86517eefc6 req-10eadaae-dc07-4dd4-97ba-42dac72d443c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037095 May 28 22:20:58.470779 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3604/7251] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:21:09.933222 ncdv-master-1 devstack@n-api.service[143129]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0135df6d-06bc-4c7e-99b7-8ac7fe500326] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 22:21:09.934138 ncdv-master-1 devstack@n-api.service[143129]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ac93fc00-477b-44ec-8099-842dbc0762a6] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 28 22:21:09.934756 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_api:SELECT=2 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:21:09.935811 ncdv-master-1 devstack@n-api.service[143129]: DEBUG dbcounter [-] [143129] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=143129) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 28 22:21:09.940073 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-dc3a5ad8-4a15-4295-8de6-79d1213fd4c2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:21:09.941379 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dc3a5ad8-4a15-4295-8de6-79d1213fd4c2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:21:09.948329 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc3a5ad8-4a15-4295-8de6-79d1213fd4c2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:09.949977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc3a5ad8-4a15-4295-8de6-79d1213fd4c2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:09.949977 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc3a5ad8-4a15-4295-8de6-79d1213fd4c2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:09.950192 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-dc3a5ad8-4a15-4295-8de6-79d1213fd4c2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:09.982965 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-dc3a5ad8-4a15-4295-8de6-79d1213fd4c2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 22:21:10.008288 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-c57edaad-4755-4d6e-a2f6-0f31aa17354a req-dc277fff-154d-4808-a552-b534f0549cab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6d6dca1-9415-482f-ac78-6a0a0a1264d5", "tag": "c99d6584-85e2-4e42-8cf0-fe70998f529a"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:21:10.017776 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c57edaad-4755-4d6e-a2f6-0f31aa17354a req-dc277fff-154d-4808-a552-b534f0549cab service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:10.018315 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-c57edaad-4755-4d6e-a2f6-0f31aa17354a req-dc277fff-154d-4808-a552-b534f0549cab service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:10.030800 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-c57edaad-4755-4d6e-a2f6-0f31aa17354a req-dc277fff-154d-4808-a552-b534f0549cab service nova] Creating event network-changed:c99d6584-85e2-4e42-8cf0-fe70998f529a for instance d6d6dca1-9415-482f-ac78-6a0a0a1264d5 on nch2-master-1 May 28 22:21:10.036247 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-c57edaad-4755-4d6e-a2f6-0f31aa17354a req-dc277fff-154d-4808-a552-b534f0549cab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101326 May 28 22:21:10.036860 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3605/7252] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:21:10.255326 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-dc3a5ad8-4a15-4295-8de6-79d1213fd4c2 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 204 len: 0 microversion: 2.1 time: 0.323726 May 28 22:21:10.256283 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3648/7253] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 22:21:09 2022] DELETE /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 22:21:10.265328 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-e57005b2-75ef-4457-8798-bba9d241dc13 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:21:10.266991 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-e57005b2-75ef-4457-8798-bba9d241dc13 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:21:10.274311 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e57005b2-75ef-4457-8798-bba9d241dc13 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:10.275207 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e57005b2-75ef-4457-8798-bba9d241dc13 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:10.276116 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e57005b2-75ef-4457-8798-bba9d241dc13 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:10.276682 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-e57005b2-75ef-4457-8798-bba9d241dc13 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:10.415592 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-e57005b2-75ef-4457-8798-bba9d241dc13 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:21:10.423156 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-e57005b2-75ef-4457-8798-bba9d241dc13 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1684 microversion: 2.1 time: 0.162108 May 28 22:21:10.423959 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3606/7254] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:21:10 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 28 22:21:11.441552 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-ffb03fb9-e290-428e-a741-f03bd6ac674b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:21:11.442289 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-ffb03fb9-e290-428e-a741-f03bd6ac674b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:21:11.452255 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffb03fb9-e290-428e-a741-f03bd6ac674b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:11.452716 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffb03fb9-e290-428e-a741-f03bd6ac674b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:11.453494 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffb03fb9-e290-428e-a741-f03bd6ac674b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:11.453972 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-ffb03fb9-e290-428e-a741-f03bd6ac674b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:11.460897 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] [ac93fc00-477b-44ec-8099-842dbc0762a6] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 55818. May 28 22:21:11.461601 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] [0135df6d-06bc-4c7e-99b7-8ac7fe500326] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 55816. May 28 22:21:11.595924 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-ffb03fb9-e290-428e-a741-f03bd6ac674b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:21:11.604525 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-ffb03fb9-e290-428e-a741-f03bd6ac674b tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1684 microversion: 2.1 time: 0.167260 May 28 22:21:11.605347 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3649/7255] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:21:11 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:21:12.321609 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-00a60a37-1a4c-4995-982e-005aa963bade req-05021195-eace-4fb2-b166-fe27b57574a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6d6dca1-9415-482f-ac78-6a0a0a1264d5", "name": "network-vif-deleted", "tag": "c99d6584-85e2-4e42-8cf0-fe70998f529a"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:21:12.330631 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-00a60a37-1a4c-4995-982e-005aa963bade req-05021195-eace-4fb2-b166-fe27b57574a0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:12.336214 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-00a60a37-1a4c-4995-982e-005aa963bade req-05021195-eace-4fb2-b166-fe27b57574a0 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:12.342274 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-00a60a37-1a4c-4995-982e-005aa963bade req-05021195-eace-4fb2-b166-fe27b57574a0 service nova] Creating event network-vif-deleted:c99d6584-85e2-4e42-8cf0-fe70998f529a for instance d6d6dca1-9415-482f-ac78-6a0a0a1264d5 on nch2-master-1 May 28 22:21:12.347369 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-00a60a37-1a4c-4995-982e-005aa963bade req-05021195-eace-4fb2-b166-fe27b57574a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030396 May 28 22:21:12.347965 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3607/7256] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:21:12.622991 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-9d9bc504-389a-4389-b499-7860652248e7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:21:12.623658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-9d9bc504-389a-4389-b499-7860652248e7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:21:12.631184 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d9bc504-389a-4389-b499-7860652248e7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:12.631668 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d9bc504-389a-4389-b499-7860652248e7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:12.632448 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d9bc504-389a-4389-b499-7860652248e7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:12.633090 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d9bc504-389a-4389-b499-7860652248e7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:12.674812 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d9bc504-389a-4389-b499-7860652248e7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:12.675309 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-9d9bc504-389a-4389-b499-7860652248e7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:12.675773 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-9d9bc504-389a-4389-b499-7860652248e7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lazy-loading 'fault' on Instance uuid d6d6dca1-9415-482f-ac78-6a0a0a1264d5 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 22:21:12.720778 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-9d9bc504-389a-4389-b499-7860652248e7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:21:12.729345 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-9d9bc504-389a-4389-b499-7860652248e7 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 200 len: 1338 microversion: 2.1 time: 0.110417 May 28 22:21:12.730127 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3650/7257] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:21:12 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 1338 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:21:13.748729 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-adcfe423-b0e5-46b5-beed-ff9edc73c84e tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:21:13.749448 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-adcfe423-b0e5-46b5-beed-ff9edc73c84e tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: d6d6dca1-9415-482f-ac78-6a0a0a1264d5] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:21:13.756658 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-adcfe423-b0e5-46b5-beed-ff9edc73c84e tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:13.757760 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-adcfe423-b0e5-46b5-beed-ff9edc73c84e tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:13.758587 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-adcfe423-b0e5-46b5-beed-ff9edc73c84e tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:13.759045 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-adcfe423-b0e5-46b5-beed-ff9edc73c84e tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:13.772305 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-adcfe423-b0e5-46b5-beed-ff9edc73c84e tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] HTTP exception thrown: Instance d6d6dca1-9415-482f-ac78-6a0a0a1264d5 could not be found. May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-adcfe423-b0e5-46b5-beed-ff9edc73c84e tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Request method failure captured: May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 HTTP/1.1 May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikp86OzlHRsULMFJ5N4nPNt-7KEt93dKDqzGqKOMgHt21FK7nSOhRrbf6km369IyDtbDQp_fjLMuTLLWuVz-hTqJTxu60ILlZtlyb97cUuabKbPQS8povcpn4yIbUCitl3u60DaxGe_F_580GzczGMXnBOJfwyax6L9JekzYMuphKDMo May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: c9313da576ba44f4a4fdb41a1306a1c2 May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestSnapshotPattern-1959933623 May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9313da576ba44f4a4fdb41a1306a1c2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9313da576ba44f4a4fdb41a1306a1c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9313da576ba44f4a4fdb41a1306a1c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9313da576ba44f4a4fdb41a1306a1c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestSnapshotPattern-1959933623 May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: c9313da576ba44f4a4fdb41a1306a1c2 May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestSnapshotPattern-1959933623 May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestSnapshotPattern-1959933623-project May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ef1a345c9a0b4a3287ac4110fcf90e50 May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestSnapshotPattern-1959933623-project May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance d6d6dca1-9415-482f-ac78-6a0a0a1264d5 could not be found. May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'd6d6dca1-9415-482f-ac78-6a0a0a1264d5'} May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6d6dca1-9415-482f-ac78-6a0a0a1264d5 could not be found. May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6d6dca1-9415-482f-ac78-6a0a0a1264d5 could not be found. May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:21:13.774010 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:21:13.778538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:21:13.778538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:21:13.778538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:21:13.778538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 22:21:13.778538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 22:21:13.778538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6d6dca1-9415-482f-ac78-6a0a0a1264d5 could not be found. May 28 22:21:13.778538 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:21:13.778538 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-adcfe423-b0e5-46b5-beed-ff9edc73c84e tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Returning 404 to user: Instance d6d6dca1-9415-482f-ac78-6a0a0a1264d5 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 22:21:13.778538 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-adcfe423-b0e5-46b5-beed-ff9edc73c84e tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5" status: 404 len: 111 microversion: 2.1 time: 0.031048 May 28 22:21:13.778538 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3608/7258] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:21:13 2022] GET /compute/v2.1/servers/d6d6dca1-9415-482f-ac78-6a0a0a1264d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 22:21:15.259544 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:21:15.260260 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 22:21:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:21:16.023051 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-48ced569-5c53-4cfd-9fe9-6632a8a97699 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:21:16.023785 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-48ced569-5c53-4cfd-9fe9-6632a8a97699 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:21:16.024293 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-cac64ffd-f003-4c24-9514-5c9f3bf299e0 req-165c1f9c-e8b5-410c-be2e-7255563249c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcf64e1d-77ea-4353-a512-ab0dff52c2e2", "tag": "bc1320d7-3d19-46dd-b104-449035fe3d7d"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:21:16.031658 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-48ced569-5c53-4cfd-9fe9-6632a8a97699 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:16.032314 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-48ced569-5c53-4cfd-9fe9-6632a8a97699 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:16.033243 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-48ced569-5c53-4cfd-9fe9-6632a8a97699 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:16.033984 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-48ced569-5c53-4cfd-9fe9-6632a8a97699 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:16.037226 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cac64ffd-f003-4c24-9514-5c9f3bf299e0 req-165c1f9c-e8b5-410c-be2e-7255563249c6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:16.037691 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-cac64ffd-f003-4c24-9514-5c9f3bf299e0 req-165c1f9c-e8b5-410c-be2e-7255563249c6 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:16.048836 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-cac64ffd-f003-4c24-9514-5c9f3bf299e0 req-165c1f9c-e8b5-410c-be2e-7255563249c6 service nova] Creating event network-changed:bc1320d7-3d19-46dd-b104-449035fe3d7d for instance dcf64e1d-77ea-4353-a512-ab0dff52c2e2 on nch1-master-1 May 28 22:21:16.054598 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-cac64ffd-f003-4c24-9514-5c9f3bf299e0 req-165c1f9c-e8b5-410c-be2e-7255563249c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033559 May 28 22:21:16.056170 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3609/7259] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:21:16.077406 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-48ced569-5c53-4cfd-9fe9-6632a8a97699 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Going to try to terminate instance {{(pid=143129) delete /opt/stack/nova/nova/compute/api.py:2664}} May 28 22:21:16.311729 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-48ced569-5c53-4cfd-9fe9-6632a8a97699 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "DELETE /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 204 len: 0 microversion: 2.1 time: 0.292314 May 28 22:21:16.312432 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3651/7260] 10.222.0.33 () {58 vars in 1238 bytes} [Sat May 28 22:21:16 2022] DELETE /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 28 22:21:16.321474 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-136793fe-0dcb-41e6-b9dc-5b5e85584c25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:21:16.322212 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-136793fe-0dcb-41e6-b9dc-5b5e85584c25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:21:16.328785 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-136793fe-0dcb-41e6-b9dc-5b5e85584c25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:16.329388 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-136793fe-0dcb-41e6-b9dc-5b5e85584c25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:16.330513 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-136793fe-0dcb-41e6-b9dc-5b5e85584c25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:16.331072 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-136793fe-0dcb-41e6-b9dc-5b5e85584c25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:16.472088 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.policy [None req-136793fe-0dcb-41e6-b9dc-5b5e85584c25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143128) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:21:16.480633 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-136793fe-0dcb-41e6-b9dc-5b5e85584c25 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1681 microversion: 2.1 time: 0.163528 May 28 22:21:16.481220 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3610/7261] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:21:16 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:21:17.499223 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-cbb6652d-0fc1-4a46-b43b-0c585a8545a6 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:21:17.499846 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-cbb6652d-0fc1-4a46-b43b-0c585a8545a6 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:21:17.506931 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cbb6652d-0fc1-4a46-b43b-0c585a8545a6 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:17.507976 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cbb6652d-0fc1-4a46-b43b-0c585a8545a6 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:17.508753 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cbb6652d-0fc1-4a46-b43b-0c585a8545a6 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:17.509198 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-cbb6652d-0fc1-4a46-b43b-0c585a8545a6 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:17.644548 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-cbb6652d-0fc1-4a46-b43b-0c585a8545a6 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:21:17.652295 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-cbb6652d-0fc1-4a46-b43b-0c585a8545a6 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1681 microversion: 2.1 time: 0.157747 May 28 22:21:17.652923 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3652/7262] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:21:17 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:21:18.393950 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [req-fa3b4ae7-5e9f-4872-abe2-22eb3a871d13 req-7d1e9bc4-5147-4169-b3bc-fd1c162db972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf64e1d-77ea-4353-a512-ab0dff52c2e2", "name": "network-vif-deleted", "tag": "bc1320d7-3d19-46dd-b104-449035fe3d7d"}]} {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 28 22:21:18.402648 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-fa3b4ae7-5e9f-4872-abe2-22eb3a871d13 req-7d1e9bc4-5147-4169-b3bc-fd1c162db972 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:18.403184 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [req-fa3b4ae7-5e9f-4872-abe2-22eb3a871d13 req-7d1e9bc4-5147-4169-b3bc-fd1c162db972 service nova] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:18.414917 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.compute.server_external_events [req-fa3b4ae7-5e9f-4872-abe2-22eb3a871d13 req-7d1e9bc4-5147-4169-b3bc-fd1c162db972 service nova] Creating event network-vif-deleted:bc1320d7-3d19-46dd-b104-449035fe3d7d for instance dcf64e1d-77ea-4353-a512-ab0dff52c2e2 on nch1-master-1 May 28 22:21:18.420029 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [req-fa3b4ae7-5e9f-4872-abe2-22eb3a871d13 req-7d1e9bc4-5147-4169-b3bc-fd1c162db972 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084886 May 28 22:21:18.420602 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3611/7263] 10.222.0.33 () {64 vars in 1317 bytes} [Sat May 28 22:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 28 22:21:18.670453 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-15e89366-9af9-476a-a995-9dbba4c3e8f0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:21:18.671097 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.compute.api [None req-15e89366-9af9-476a-a995-9dbba4c3e8f0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143129) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:21:18.678455 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15e89366-9af9-476a-a995-9dbba4c3e8f0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:18.678923 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15e89366-9af9-476a-a995-9dbba4c3e8f0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:18.680012 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15e89366-9af9-476a-a995-9dbba4c3e8f0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:18.680472 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15e89366-9af9-476a-a995-9dbba4c3e8f0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:18.721944 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15e89366-9af9-476a-a995-9dbba4c3e8f0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:18.722412 ncdv-master-1 devstack@n-api.service[143129]: DEBUG oslo_concurrency.lockutils [None req-15e89366-9af9-476a-a995-9dbba4c3e8f0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143129) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:18.722886 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.objects.instance [None req-15e89366-9af9-476a-a995-9dbba4c3e8f0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lazy-loading 'fault' on Instance uuid dcf64e1d-77ea-4353-a512-ab0dff52c2e2 {{(pid=143129) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 28 22:21:18.769666 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.policy [None req-15e89366-9af9-476a-a995-9dbba4c3e8f0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef1a345c9a0b4a3287ac4110fcf90e50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9313da576ba44f4a4fdb41a1306a1c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=143129) authorize /opt/stack/nova/nova/policy.py:199}} May 28 22:21:18.777880 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-15e89366-9af9-476a-a995-9dbba4c3e8f0 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 200 len: 1337 microversion: 2.1 time: 0.111532 May 28 22:21:18.778456 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3653/7264] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:21:18 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 1337 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 28 22:21:19.798485 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c5f8a1f-3eef-4b21-85ea-b69c4ea7c4bc tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '>' {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:21:19.799228 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.compute.api [None req-3c5f8a1f-3eef-4b21-85ea-b69c4ea7c4bc tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] [instance: dcf64e1d-77ea-4353-a512-ab0dff52c2e2] Fetching instance by UUID {{(pid=143128) get /opt/stack/nova/nova/compute/api.py:2920}} May 28 22:21:19.806573 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c5f8a1f-3eef-4b21-85ea-b69c4ea7c4bc tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:19.807041 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c5f8a1f-3eef-4b21-85ea-b69c4ea7c4bc tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:19.808085 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c5f8a1f-3eef-4b21-85ea-b69c4ea7c4bc tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 28 22:21:19.808539 ncdv-master-1 devstack@n-api.service[143128]: DEBUG oslo_concurrency.lockutils [None req-3c5f8a1f-3eef-4b21-85ea-b69c4ea7c4bc tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Lock "fc53a60a-e345-4363-abb1-87c4d33bcbf6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=143128) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 28 22:21:19.821609 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.wsgi [None req-3c5f8a1f-3eef-4b21-85ea-b69c4ea7c4bc tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] HTTP exception thrown: Instance dcf64e1d-77ea-4353-a512-ab0dff52c2e2 could not be found. May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c5f8a1f-3eef-4b21-85ea-b69c4ea7c4bc tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Request method failure captured: May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: request: GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 HTTP/1.1 May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: Accept: application/json May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: Accept-Encoding: identity May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: Connection: close May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: Content-Length: 0 May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: Content-Type: application/json May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: Host: 10.222.0.33 May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: Openstack-System-Scope: None May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: User-Agent: python-urllib3/1.26.9 May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-Auth-Token: gAAAAABikp86OzlHRsULMFJ5N4nPNt-7KEt93dKDqzGqKOMgHt21FK7nSOhRrbf6km369IyDtbDQp_fjLMuTLLWuVz-hTqJTxu60ILlZtlyb97cUuabKbPQS8povcpn4yIbUCitl3u60DaxGe_F_580GzczGMXnBOJfwyax6L9JekzYMuphKDMo May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Id: None May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-Domain-Name: None May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-Identity-Status: Confirmed May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-Is-Admin-Project: True May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Id: default May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Domain-Name: Default May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Id: c9313da576ba44f4a4fdb41a1306a1c2 May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-Project-Name: tempest-TestSnapshotPattern-1959933623 May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-Role: member,reader May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-Roles: member,reader May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c9313da576ba44f4a4fdb41a1306a1c2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9313da576ba44f4a4fdb41a1306a1c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c9313da576ba44f4a4fdb41a1306a1c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c9313da576ba44f4a4fdb41a1306a1c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}] May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant: tempest-TestSnapshotPattern-1959933623 May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Id: c9313da576ba44f4a4fdb41a1306a1c2 May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-Tenant-Name: tempest-TestSnapshotPattern-1959933623 May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-User: tempest-TestSnapshotPattern-1959933623-project May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Id: default May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-User-Domain-Name: Default May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-User-Id: ef1a345c9a0b4a3287ac4110fcf90e50 May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: X-User-Name: tempest-TestSnapshotPattern-1959933623-project May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: method: > May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: exception: Instance dcf64e1d-77ea-4353-a512-ab0dff52c2e2 could not be found. May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: action_args: {'id': 'dcf64e1d-77ea-4353-a512-ab0dff52c2e2'} May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: {{(pid=143128) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcf64e1d-77ea-4353-a512-ab0dff52c2e2 could not be found. May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcf64e1d-77ea-4353-a512-ab0dff52c2e2 could not be found. May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 28 22:21:19.823270 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:21:19.827801 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 28 22:21:19.827801 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 28 22:21:19.827801 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 28 22:21:19.827801 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 28 22:21:19.827801 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 28 22:21:19.827801 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcf64e1d-77ea-4353-a512-ab0dff52c2e2 could not be found. May 28 22:21:19.827801 ncdv-master-1 devstack@n-api.service[143128]: ERROR nova.api.openstack.wsgi May 28 22:21:19.827801 ncdv-master-1 devstack@n-api.service[143128]: DEBUG nova.api.openstack.wsgi [None req-3c5f8a1f-3eef-4b21-85ea-b69c4ea7c4bc tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Returning 404 to user: Instance dcf64e1d-77ea-4353-a512-ab0dff52c2e2 could not be found. {{(pid=143128) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 28 22:21:19.827801 ncdv-master-1 devstack@n-api.service[143128]: INFO nova.api.openstack.requestlog [None req-3c5f8a1f-3eef-4b21-85ea-b69c4ea7c4bc tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2" status: 404 len: 111 microversion: 2.1 time: 0.030559 May 28 22:21:19.827801 ncdv-master-1 devstack@n-api.service[143128]: [pid: 143128|app: 0|req: 3612/7265] 10.222.0.33 () {58 vars in 1235 bytes} [Sat May 28 22:21:19 2022] GET /compute/v2.1/servers/dcf64e1d-77ea-4353-a512-ab0dff52c2e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 28 22:21:20.031169 ncdv-master-1 devstack@n-api.service[143129]: DEBUG nova.api.openstack.wsgi [None req-810dc1fd-30dd-4e40-8ed1-833b29e687e1 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] Calling method '.version_select at 0x7f4d641bddc0>' {{(pid=143129) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 28 22:21:20.113568 ncdv-master-1 devstack@n-api.service[143129]: INFO nova.api.openstack.requestlog [None req-810dc1fd-30dd-4e40-8ed1-833b29e687e1 tempest-TestSnapshotPattern-1959933623 tempest-TestSnapshotPattern-1959933623-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-176826489" status: 202 len: 0 microversion: 2.1 time: 0.086267 May 28 22:21:20.114225 ncdv-master-1 devstack@n-api.service[143129]: [pid: 143129|app: 0|req: 3654/7266] 10.222.0.33 () {58 vars in 1253 bytes} [Sat May 28 22:21:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-176826489 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 28 22:22:56.223496 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:22:56.223975 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 22:22:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:24:33.616504 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:24:33.617091 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 22:24:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:24:33.725631 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:24:33.725808 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 22:24:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:24:35.269447 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:24:35.269959 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 22:24:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:26:16.231216 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:26:16.231879 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 22:26:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:26:31.919072 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:26:31.919660 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 22:26:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:26:40.003623 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:26:40.004169 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 22:26:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:27:53.624744 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:27:53.625908 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 22:27:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:27:53.732653 ncdv-master-1 devstack@n-api.service[143129]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:27:53.732792 ncdv-master-1 devstack@n-api.service[143129]: Sat May 28 22:27:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 28 22:27:55.278151 ncdv-master-1 devstack@n-api.service[143128]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 28 22:27:55.278743 ncdv-master-1 devstack@n-api.service[143128]: Sat May 28 22:27:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!